Key Changes

• Upgrades for engines
  • PyTorch 2.2.2 #3155
  • Sentencepiece 0.2.0 #3163
• Enhancements for engines and API
  • Adds experimental Rust engine #3078

Enhancement

• [api] Automatically detect translatorFactory based on task by @frankfliu in #3136
• [api] Adds OnesBlockFactory to make it easy for testing by @frankfliu in #3140
• Ensure the alternative ND manager can use GPUs by @david-sitsky in #3138
• [api] Tries to use the same device for alternative NDManager by @frankfliu in #3146
• [api] Supports serialize NaN in json by @frankfliu in #3156
• [rust] Add rust engine implemenation by @frankfliu in #3078
• [rust] Adds Rust model zoo by @frankfliu in #3132
• [rust] Support load DJL model for RsModel by @frankfliu in #3147
• [rust] RsModel delete model in close by @xyang16 in #3170
• [tokenizers] Updates tokenizer to 0.19.1 by @frankfliu in #3143
• [tokenizer] Allows use HF_TOKEN to access gated model by @frankfliu in #3150
• [tokenizers] Create djl_converter package by @xyang16 in #3172
• [tokenizer] Refactor djl_convert python code by @frankfliu in #3179
• Updates on djl_converter by @xyang16 in #3187
• [pytorch] Updates PyTorch to 2.2.2 by @frankfliu in #3155
• [pytorch] Update PyTorch engine README for version 2.2.2 by @frankfliu in #3165
• [pytorch] optimize memory copy cost for pytorch NDArray by @ewan0x79 in #3137
• [pytorch] Updates PyTorch to 2.3.0 by @frankfliu in #3192
• [sentencepiece] Updates sentencepiece to 0.2.0 by @frankfliu in #3163
• [huggingface] Adds more option to convert onnx model by @frankfliu in #3180

Bug Fixes

• [gitignore] Avoid checking binary files. by @frankfliu in #3134
• [api] Closes file stream by @frankfliu in #3130
• [api] Fixes logging invoke convention by @frankfliu in #3148
• [api] Fixes Criteria.toString() bug by @frankfliu in #3151
• [api] Fixes tarslip issue by @frankfliu in #3075
• [examples] Fixes TextGeneration EOS bug by @frankfliu in #3177
• [tokenizer] Fixes model zoo import script by @frankfliu in #3126
• [Lgbm] fix LgbmNDArray replaced.close() release data problem by @ewan0x79 in #3174
• [rust] Fixes compile warnings by @frankfliu in #3189
• [ci] Fixes pytorch jni build for 1.13.1 by @frankfliu in #3184
• [ci] Fixes awscurl publish location by @frankfliu in #3182
• [ci] Fixes build on macOS aarch64 machine by @frankfliu in #3191
• [ci] Fixes nightly pytorch jni build by @frankfliu in #3196

Documentation

• [examples] Re-organize CV examaples by @frankfliu in #3135
• [examples] Prepare for MXNet deprecation by @frankfliu in #3157
• [doc] Removes mention of future lab by @zachgk in #3154
• [docs] Updates docs for setup java on mac by @frankfliu in #3188
• [website] Remove live demo from djl.ai web page by @frankfliu in #3171
• Fixed Typo in Docs by @fensch in #3193
• Update README.md by @elect86 in #3195

CI/CD

• [ci] Update github action runner to macOS x86_64 instance by @frankfliu in #3144
• [ci] Updates google code formatter to 1.22.0 by @frankfliu in #3149
• [ci] Upgrades gradle to 8.5 by @frankfliu in #3153
• [ci] Updates dependencies version by @frankfliu in #3164
• [ci] Adds cuda version as github actions parameter for Pytorch JNI build by @frankfliu in #3185

New Contributors

• @david-sitsky made their first contribution in #3138
• @elect86 made their first contribution in #3195

Full Changelog: v0.27.0...v0.28.0