CARVIEW |
Select Language
HTTP/2 200
date: Fri, 25 Jul 2025 02:57:48 GMT
content-type: text/html; charset=utf-8
vary: X-PJAX, X-PJAX-Container, Turbo-Visit, Turbo-Frame, X-Requested-With,Accept-Encoding, Accept, X-Requested-With
etag: W/"cfa07bd8bb3729799cd3dae33e2872e3"
cache-control: max-age=0, private, must-revalidate
strict-transport-security: max-age=31536000; includeSubdomains; preload
x-frame-options: deny
x-content-type-options: nosniff
x-xss-protection: 0
referrer-policy: no-referrer-when-downgrade
content-security-policy: default-src 'none'; base-uri 'self'; child-src github.githubassets.com github.com/assets-cdn/worker/ github.com/assets/ gist.github.com/assets-cdn/worker/; connect-src 'self' uploads.github.com www.githubstatus.com collector.github.com raw.githubusercontent.com api.github.com github-cloud.s3.amazonaws.com github-production-repository-file-5c1aeb.s3.amazonaws.com github-production-upload-manifest-file-7fdce7.s3.amazonaws.com github-production-user-asset-6210df.s3.amazonaws.com *.rel.tunnels.api.visualstudio.com wss://*.rel.tunnels.api.visualstudio.com objects-origin.githubusercontent.com copilot-proxy.githubusercontent.com proxy.individual.githubcopilot.com proxy.business.githubcopilot.com proxy.enterprise.githubcopilot.com *.actions.githubusercontent.com wss://*.actions.githubusercontent.com productionresultssa0.blob.core.windows.net/ productionresultssa1.blob.core.windows.net/ productionresultssa2.blob.core.windows.net/ productionresultssa3.blob.core.windows.net/ productionresultssa4.blob.core.windows.net/ productionresultssa5.blob.core.windows.net/ productionresultssa6.blob.core.windows.net/ productionresultssa7.blob.core.windows.net/ productionresultssa8.blob.core.windows.net/ productionresultssa9.blob.core.windows.net/ productionresultssa10.blob.core.windows.net/ productionresultssa11.blob.core.windows.net/ productionresultssa12.blob.core.windows.net/ productionresultssa13.blob.core.windows.net/ productionresultssa14.blob.core.windows.net/ productionresultssa15.blob.core.windows.net/ productionresultssa16.blob.core.windows.net/ productionresultssa17.blob.core.windows.net/ productionresultssa18.blob.core.windows.net/ productionresultssa19.blob.core.windows.net/ github-production-repository-image-32fea6.s3.amazonaws.com github-production-release-asset-2e65be.s3.amazonaws.com insights.github.com wss://alive.github.com api.githubcopilot.com api.individual.githubcopilot.com api.business.githubcopilot.com api.enterprise.githubcopilot.com; font-src github.githubassets.com; form-action 'self' github.com gist.github.com copilot-workspace.githubnext.com objects-origin.githubusercontent.com; frame-ancestors 'none'; frame-src viewscreen.githubusercontent.com notebooks.githubusercontent.com; img-src 'self' data: blob: github.githubassets.com media.githubusercontent.com camo.githubusercontent.com identicons.github.com avatars.githubusercontent.com private-avatars.githubusercontent.com github-cloud.s3.amazonaws.com objects.githubusercontent.com release-assets.githubusercontent.com secured-user-images.githubusercontent.com/ user-images.githubusercontent.com/ private-user-images.githubusercontent.com opengraph.githubassets.com copilotprodattachments.blob.core.windows.net/github-production-copilot-attachments/ github-production-user-asset-6210df.s3.amazonaws.com customer-stories-feed.github.com spotlights-feed.github.com objects-origin.githubusercontent.com *.githubusercontent.com; manifest-src 'self'; media-src github.com user-images.githubusercontent.com/ secured-user-images.githubusercontent.com/ private-user-images.githubusercontent.com github-production-user-asset-6210df.s3.amazonaws.com gist.github.com; script-src github.githubassets.com; style-src 'unsafe-inline' github.githubassets.com; upgrade-insecure-requests; worker-src github.githubassets.com github.com/assets-cdn/worker/ github.com/assets/ gist.github.com/assets-cdn/worker/
server: github.com
content-encoding: gzip
accept-ranges: bytes
set-cookie: _gh_sess=lC%2Fbbf6sKIsoXfx%2BroPbsHf5%2BllKBg73%2B1N6WDZpSPpGTmVvxR0S%2BP2NSDxmH0rxQdbA1yoN0F%2F%2FYqAD66S36QIbIhXvaa4AeMpqLzmCQBbILSCgXiJMUx8krOdX1xbp7ZNhpZBEGE5O7K5NNxErUQY5%2Bkl3ZGWozhQkasndMPhmoeS2HPUC8Lx52bdK3v8xUflor7mQPXOojN3%2FBM2eXVrGWrXrQ2XXIiRVjMFXGfmIrtzL8zXp3ng%2FXi4ACH4PX%2Fng2p9IWZz6JH19wjgzEQ%3D%3D--XJmzMDhATcoIl8dL--wqU1eNZrj7N0S%2FnQR%2FCDbA%3D%3D; Path=/; HttpOnly; Secure; SameSite=Lax
set-cookie: _octo=GH1.1.1080581093.1753412267; Path=/; Domain=github.com; Expires=Sat, 25 Jul 2026 02:57:47 GMT; Secure; SameSite=Lax
set-cookie: logged_in=no; Path=/; Domain=github.com; Expires=Sat, 25 Jul 2026 02:57:47 GMT; HttpOnly; Secure; SameSite=Lax
x-github-request-id: D4BE:2C1B9F:E7731:15A5D5:6882F2AB
Release DJL v0.14.0 release Β· deepjavalibrary/djl Β· GitHub
Loading
Skip to content
Navigation Menu
{{ message }}
-
Notifications
You must be signed in to change notification settings - Fork 714
DJL v0.14.0 release
Compare
DJL v0.14.0 updates the engines PyTorch to 1.9.1 and introduces several new features:
Key Features
- Upgrades PyTorch engine to 1.9.1
- Adds support for Neuron SDK 1.16.1
- Adds autoscale in djl-serving for AWS Inferentia model
- Introduces OpenCV extension to provide high performance image processing
- Adds support for older version of PyTorch engine, user now can use PyTorch 1.8.1 with latest DJL
- Adds support for precxx11 PyTorch native library in auto detection mode
- Adds AWS Inferentia support in djl-bench
- Adds support for TorchServe .mar format, user can deploy TorchServe model archive in djl-serving
Enhancement
- Introduces several new features in djl-serving:
- Adds autoscale feature for AWS Inferentia (#31)
- Creates SageMaker hosting compatible docker image for AWS Inferentia (#36)
- Adds auto detect number of neuron cores feature for AWS Inferentia (#34)
- Adds autoscale support for SageMaker style .tar.gz model (#35)
- Adds support to load torchserve model (#32)
- Adds support to pip installed dependency per model (#37)
- Adds custom environment variable support for python engine (#29)
- Adds nested folder support in model archive file (#38)
- Improves model status with model version support (#25)
- Adds model warn up feature for python engine. (#23)
- Adds WorkLoadManager.unregisterModel (#33)
- Adds testing tool to test python model locally (#22)
- Adds set python executable path for python engine (#21)
- Creates Workflow for ModelServing (#26)
- Adds OpenCV extension (#1331)
- Introduces several new features in djl-bench:
- Adds support for AWS Inferentia (#1329)
- Introduces several new features in Apache MXNet engine:
- Implements LayerNorm for Apache MXNet (#1342)
- Introduces several new features in PyTorch engine:
- Upgrades PyTorch to 1.9.1 (#1297)
- Implements padding to bert tokenizer (#1328)
- Makes pytorch-native-auto package optional (#1326)
- Adds support to use different version of PyTorch native library (#1323)
- Adds map_location support for load model from InputStream (#1314)
- Makes map_location optional (#1312)
- Introduces several new features in TensorFlow Lite engine:
- Makes tensor-native-auto package optional (#1301)
- Introduces several API improvements:
- Adds support for nested folder in model archive (#1349)
- Improves translator output error message (#1348)
- Improves Predictor API to support predict with device (#1346)
- Improves BufferedImageFactory.fromNDArray performance (#1339)
- Adds support for downloading .mar file (#1338)
- Adds debugging toString to Input and Output (#1327)
- Refactors BERT Translator and Tokenizer (#1318)
- Makes question answering model serving ready (#1311)
- Refactors minMaxWorkers from ModelInfo to WorkerPool (#30)
Documentation and examples
- Adds huggingface Inferentia serving example (#184)
- Adds AWS SageMaker hosting document
- Adds python hybrid engine demo (#182)
- Improves DJL examples project gradle build script (#1344)
Breaking change
- PyTorch 1.9.1 no longer supports Amazon Linux 2, AL2 user has to use pytorch-native-cpu-precxx11
- Image.Type is removed and Image.duplicate() function no longer take Image.Type as input
- Image.getSubimage() is renamed to Image.getSubImage()
- PaddlePaddle model loading may break due to prefix changes.
Bug Fixes
- Fixes 2nd inference throw exception bug (#1351)
- Fixes calculation for SigmoidBinaryCrossEntropyLoss from sigmoid (#1345)
- Fixes jar model url download bug (#1336)
- Fixes memory in Trainer.checkGradients (#1319)
- Fixes NDManager is closed bug (#1308)
- Fixes PyTorch GPU model loading issue (#1302)
- Fixes MXNet EngineException message (#1300)
- Fixes python resnet18 demo model GPU bug (#24)
- Fixes python engine get_as_bytes() bug (#20)
Contributors
This release is thanks to the following contributors:
- Frank Liu (@frankfliu)
- Jake Lee (@stu1130)
- enpasos (@enpasos)
- Qing Lan (@lanking520)
- Zach Kimberg (@zachgk)
Assets 2
1 person reacted
0
Join discussion
You canβt perform that action at this time.