| CARVIEW |
Select Language
HTTP/2 200
date: Tue, 29 Jul 2025 13:08:37 GMT
content-type: text/html; charset=utf-8
vary: X-PJAX, X-PJAX-Container, Turbo-Visit, Turbo-Frame, X-Requested-With,Accept-Encoding, Accept, X-Requested-With
etag: W/"ba3dcaa9a0ce4f5775e174385dcdd758"
cache-control: max-age=0, private, must-revalidate
strict-transport-security: max-age=31536000; includeSubdomains; preload
x-frame-options: deny
x-content-type-options: nosniff
x-xss-protection: 0
referrer-policy: no-referrer-when-downgrade
content-security-policy: default-src 'none'; base-uri 'self'; child-src github.githubassets.com github.com/assets-cdn/worker/ github.com/assets/ gist.github.com/assets-cdn/worker/; connect-src 'self' uploads.github.com www.githubstatus.com collector.github.com raw.githubusercontent.com api.github.com github-cloud.s3.amazonaws.com github-production-repository-file-5c1aeb.s3.amazonaws.com github-production-upload-manifest-file-7fdce7.s3.amazonaws.com github-production-user-asset-6210df.s3.amazonaws.com *.rel.tunnels.api.visualstudio.com wss://*.rel.tunnels.api.visualstudio.com objects-origin.githubusercontent.com copilot-proxy.githubusercontent.com proxy.individual.githubcopilot.com proxy.business.githubcopilot.com proxy.enterprise.githubcopilot.com *.actions.githubusercontent.com wss://*.actions.githubusercontent.com productionresultssa0.blob.core.windows.net/ productionresultssa1.blob.core.windows.net/ productionresultssa2.blob.core.windows.net/ productionresultssa3.blob.core.windows.net/ productionresultssa4.blob.core.windows.net/ productionresultssa5.blob.core.windows.net/ productionresultssa6.blob.core.windows.net/ productionresultssa7.blob.core.windows.net/ productionresultssa8.blob.core.windows.net/ productionresultssa9.blob.core.windows.net/ productionresultssa10.blob.core.windows.net/ productionresultssa11.blob.core.windows.net/ productionresultssa12.blob.core.windows.net/ productionresultssa13.blob.core.windows.net/ productionresultssa14.blob.core.windows.net/ productionresultssa15.blob.core.windows.net/ productionresultssa16.blob.core.windows.net/ productionresultssa17.blob.core.windows.net/ productionresultssa18.blob.core.windows.net/ productionresultssa19.blob.core.windows.net/ github-production-repository-image-32fea6.s3.amazonaws.com github-production-release-asset-2e65be.s3.amazonaws.com insights.github.com wss://alive.github.com api.githubcopilot.com api.individual.githubcopilot.com api.business.githubcopilot.com api.enterprise.githubcopilot.com; font-src github.githubassets.com; form-action 'self' github.com gist.github.com copilot-workspace.githubnext.com objects-origin.githubusercontent.com; frame-ancestors 'none'; frame-src viewscreen.githubusercontent.com notebooks.githubusercontent.com; img-src 'self' data: blob: github.githubassets.com media.githubusercontent.com camo.githubusercontent.com identicons.github.com avatars.githubusercontent.com private-avatars.githubusercontent.com github-cloud.s3.amazonaws.com objects.githubusercontent.com release-assets.githubusercontent.com secured-user-images.githubusercontent.com/ user-images.githubusercontent.com/ private-user-images.githubusercontent.com opengraph.githubassets.com copilotprodattachments.blob.core.windows.net/github-production-copilot-attachments/ github-production-user-asset-6210df.s3.amazonaws.com customer-stories-feed.github.com spotlights-feed.github.com objects-origin.githubusercontent.com *.githubusercontent.com; manifest-src 'self'; media-src github.com user-images.githubusercontent.com/ secured-user-images.githubusercontent.com/ private-user-images.githubusercontent.com github-production-user-asset-6210df.s3.amazonaws.com gist.github.com; script-src github.githubassets.com; style-src 'unsafe-inline' github.githubassets.com; upgrade-insecure-requests; worker-src github.githubassets.com github.com/assets-cdn/worker/ github.com/assets/ gist.github.com/assets-cdn/worker/
server: github.com
content-encoding: gzip
accept-ranges: bytes
set-cookie: _gh_sess=Oq8Xb7Wf3PA4MkDtDKxODkFNemDalp8xKLWfPSboplQNC7uWHAd%2FRkuUOtFWtF%2F0Yf28M4uk0VjPdKm599pTsWVxXX4JqbhebYnrEmEWSwaf4XqR%2FMkNleKsiLI7yRIuyoKeZd%2BGUHFM41lyHMP1HsJLILhQbNlxW7F9Zpev2KeR7fyU9XzgHXG4YLJaqCBdIsI9bGrmd8gPiGp1iEiPBw%2FEjgE%2FqmOJNuDQWhaxyyc7YxvRAfydNEwxoiJf5g4%2FHk4xB9OllkAIv3b6pbLukA%3D%3D--iSVyeRrVx4wp4Gkp--mm2AlYhz2dimxTe5A2LaVA%3D%3D; Path=/; HttpOnly; Secure; SameSite=Lax
set-cookie: _octo=GH1.1.840004483.1753794516; Path=/; Domain=github.com; Expires=Wed, 29 Jul 2026 13:08:36 GMT; Secure; SameSite=Lax
set-cookie: logged_in=no; Path=/; Domain=github.com; Expires=Wed, 29 Jul 2026 13:08:36 GMT; HttpOnly; Secure; SameSite=Lax
x-github-request-id: A062:2A06CB:B61133:D821D3:6888C7D4
Release DJLServing v0.21.0 release · deepjavalibrary/djl-serving · GitHub
Loading
Skip to content
Navigation Menu
{{ message }}
-
Notifications
You must be signed in to change notification settings - Fork 77
DJLServing v0.21.0 release
Compare
·
1801 commits
to master
since this release
583dbc0
This commit was created on GitHub.com and signed with GitHub’s verified signature.
The key has expired.
Key Features
- Adds faster transformer support (#424)
- Adds Deepspeed ahead of time partition script in DLC (#466)
- Adds SageMaker MME support (#479)
- Adds support for stable-diffusion-2-1-base model (#484)
- Adds support for stable diffusion depth model (#488)
- Adds out of memory protection for modle loading (#496)
- Makes load_on_devices per model setting (#493)
- Improves several per model settings
- Improves management console model loading and inference UI (#431, #432)
- Updates deepspeed to 0.8.0 (#465)
- Upgrades PyTorch to 1.13.1 (#414)
Enhancement
- Adds model_id support for huggingface models (#406)
- Adds AI template package (#485)
- Improves snakeyaml error message (#400)
- Improves s5cmd error handling (#442)
- Emits medel inference metrics to log file (#452)
- Supports model.pt and model.onnx file name (#459)
- Makes batch per model setting (#456)
- Keeps failure worker status for 1 minutes (#463)
- Detects engine to avoid uncessarily download MXNet engine (#481)
- Uses temp directory instead of /tmp (#404)
- Adds better logging and error handling for s5cmd process execution (#409)
- Uses jacoco aggregation report plugin (#421)
- Rollback model if failed start work in synchronous mode (#427)
- Adds fastertransformer t5 integration test (#469)
- Print better stacktrace if channel is closed (#473)
- Supports FasterFansformer to run in mpi mode (#474)
Bug fixes
- Adds fix to workaround SageMaker changes (#401)
- Treats empty HTTP parameter as absent (#429)
- Fixes inference console UI bug (#439)
- Fixed gpt-neox model name typo (#441)
- Fixes wrong onnx configuration (#449)
- Fixes issue with passing dtype in huggingface handler. Refactor dtype_f…
- Fixes issues with model_dir and model_id usage that occur when s3url is…
- Fixes broken vue tags (#453)
Breaking change
- Remove unecessary java engine adapter (#448)
- Removes djl-central module in favor of management console (#447)
- Sets model status to failure after exceed retry threshold (#455)
- Removes DLR support (#468)
Documentation
Assets 4
You can’t perform that action at this time.