Key Features

• Engine Upgrades
  • Makes PyTorch 2.0.1 the default version #2710
  • OnnxRuntime to 1.16.0 #2784
• SafeTensors support #2763
• YoloV8 Support #2776

Enhancement

• [spark] Update djl version in dockerfile by @sindhuvahinis in #2712
• [pytorch] Makes PyTorch 2.0.1 default version for DJL 0.24.0 by @frankfliu in #2710
• pytorch support inference on separate cuda stream by @jiyuanq in #2706
• [spark] Update javacv version to 1.5.9 for spark docker by @frankfliu in #2713
• [pytorch] Upgrade pytorch andorid to 2.0.1 by @frankfliu in #2717
• [api] Makes getNeuronDevices() public by @frankfliu in #2721
• [api] Log warning message if failed to load specified class by @frankfliu in #2724
• [api] Workaround detect neuron issue on SageMaker by @frankfliu in #2729
• Setup custom ft build for Llama support by @rohithkrn in #2732
• [api] Fixes NeuronUtils issue when running as non-root user by @frankfliu in #2735
• Adds Utils.getEnvOrSystemProperty with default by @zachgk in #2742
• Issue #2693 Implement PtNDArrayEx.multiBoxPrior with validation by @juliangamble in #2715
• [api] Implements NDArray.toType() for NDArrayAdapter by @frankfliu in #2746
• [onnxruntime] Upgrades onnxruntime version to 1.15.1 by @frankfliu in #2743
• [api] Output endPosition induced by reaching EOS token by @KexinFeng in #2730
• [api] Adds Safetensors support by @frankfliu in #2763
• [SentencePiece] Make SpProcessor public by @frankfliu in #2765
• [tokenizer] Print out warning in model_zoo_importer by @frankfliu in #2759
• To support Yolov8 by @SidneyLann in #2776
• [onnxruntime] Upgrades OnnxRuntime to 1.16.0 by @frankfliu in #2784
• Build FT for sm90 by @rohithkrn in #2785
• PtndArrayEx.multiboxDetection() implementation by @juliangamble in #2769

Bug fixes

• [api] Fixes ChunkedBytesSupplier read timeout bug by @frankfliu in #2716
• [fix] Set past_kv name for corner case. by @KexinFeng in #2722
• Fix AmazonReviews by @zachgk in #2725
• Fix issue with setPadding and setTruncation overriding configurations… by @siddvenk in #2741
• Fixes #2744, support onnx model for TextEmbeddingTranslator by @bryanktliu in #2749
• [api] Fixes NDArray.toDevice() missing name issue by @frankfliu in #2751
• [pytorch] Avoid toByteBuffer() crash for large tensor by @frankfliu in #2780

Documentation and Examples

• Update DJL version to 0.23.0 in documents by @sindhuvahinis in #2694
• [docs] Updates README for pytorch 2.0.1 by @frankfliu in #2705
• Update docs and Bump up version to 0.24.0 by @sindhuvahinis in #2708
• [docs] Updates troubleshooting README to remove outdated content by @frankfliu in #2734
• [docs] Update IntelliJ debug view image by @frankfliu in #2747
• [examples] Fixes whipser model on GPU machine by @frankfliu in #2752

CI

• [api] Restore Lm search unittest to recover coverage rate by @KexinFeng in #2723
• [ci] Fixes PMD warnings by @frankfliu in #2764
• [ci] Fixes gradle deprecation warnings by @frankfliu in #2774

New Contributors

• @jiyuanq made their first contribution in #2706
• @rohithkrn made their first contribution in #2732
• @SidneyLann made their first contribution in #2776

Full Changelog: v0.23.0...v0.24.0