Key Changes

• Engine Updates:
  • PyTorch 2.5.1 #3517
  • HuggingFace Tokenizers 0.20.3 #3514
• Added Android support for HuggingFace Tokenizers @naveen521kk in #3531
• Fixed issue with cross-platform archive extraction #3544

Enhancements

• [api] Use encoder/decoder for Segment anython2 translator by @frankfliu in #3487
• [api] alternative NDArray should not be closed in NDScope by @frankfliu in #3490
• [api] Adds sam2 model to onnxruntime model zoo by @frankfliu in #3492
• [api] Standardizes CV output format by @frankfliu in #3493
• [api] Visualize sam2 output for Sam2ServingTranslator by @frankfliu in #3494
• [api] Improve Sam2Translator for PyTorch traced model by @frankfliu in #3495
• [android] Update pytorch version to 2.4.0 by @xyang16 in #3474
• [tokenizers] Use tokenizers from rust.io by @xyang16 in #3476
• [rust] Remove unnecessary clone in cublaslt by @xyang16 in #3482
• [api] Makes Sam2 input consistent with other CV model by @frankfliu in #3498
• [api] Adds serving support for some CV models by @frankfliu in #3499
• HuggingFaceTokenizer: add support for Android by @naveen521kk in #3531
• [tokenizer] Updates tokenizer to 0.20.3 by @xyang16 in #3514
• [tokenizer] Updates tokenizer to 0.20.3 in libs.versions.toml by @xyang16 in #3515
• [pytorch] Adds Yolo11 model to model zoo by @xyang16 in #3516
• [pytorch] Updates PyTorch to 2.5.1 by @xyang16 in #3517
• [converter] Trim jit output token_str by @xyang16 in #3527

Bug Fixes

• [PyTorch] Fixes sam2 model version by @frankfliu in #3496
• [api] Fixes QaServingTranslator output format by @frankfliu in #3500
• [djl-convert] Fix huggingface converter by @xyang16 in #3505

Documentation

• [docs] Updates PyTorch engine README for 2.4.0 by @frankfliu in #3472
• Docs: Added a link by @operagxoksana in #3510
• [doc] Add blogposts index to docs by @xyang16 in #3519
• [doc] Add blogposts link to README by @xyang16 in #3520
• add lmi breaking changes document to docs site by @siddvenk in #3529
• Update troubleshooting.md - UnsatisfiedLinkError issue by @ThiloteE in #3512

CI/CD

• [fix][ci] configure aws creds manually to avoid node20 issues on inco… by @siddvenk in #3469
• [ci] Updates gradle to 8.10.1 by @frankfliu in #3470
• [ci] configure aws creds manually to avoid node20 issues for AL2 by @frankfliu in #3471
• [ci] Update tensorrt native build container by @xyang16 in #3477
• [ci] Fixes fasttext native build for nodejs20 issue by @xyang16 in #3478
• [ci] Fixes sentencepiece native build for nodejs20 issue by @xyang16 in #3479
• Increase build version to 0.31.0 by @xyang16 in #3475
• [mxnet] Fixes build error on JDK 22 by @frankfliu in #3485
• [ci] Fixes java 21 compile error by @frankfliu in #3497
• Delete serving publish from DJL repo by @brndysgit in #3501
• Bump com.google.protobuf:protobuf-java from 3.25.4 to 3.25.5 by @dependabot in #3502
• dependency updates for djl by @siddvenk in #3528
• Add CI for the hugging face tokenizers android by @naveen521kk in #3532
• CI: setup cargo-ndk for huggingface tokenizers android builds by @naveen521kk in #3535
• update DJL version to 0.31.0 in docs by @siddvenk in #3534
• Fix a typo in android/tokenizer-native/build.gradle by @naveen521kk in #3537
• fix dependency versions in examples/pom.xml by @siddvenk in #3539
• [android] fix djl version for android by @siddvenk in #3526

New Contributors

• @brndysgit made their first contribution in #3501
• @operagxoksana made their first contribution in #3510
• @ThiloteE made their first contribution in #3512
• @naveen521kk made their first contribution in #3531

Full Changelog: v0.30.0...v0.31.1