Olive-ai 0.9.0

Feature Updates

Implement lm-eval-harness based LLM quality evaluator for ONNX GenAI models #1720
Update minimum supported target opset for ONNX to 17. #1741
QDQ support for ModelBuilder pass #1736
Refactor OnnxOpVersionConversion to conditionally use onnxscript version converter #1784
HQQ Quantizer Pass #1799, #1835
Introducing global definitions for Precision & PrecisionBits #1808
Improvements in PeepholeHoleOptimizer #1697, #1698

OnnxScriptFusion: ONNX script fusion
OpenVINOEncapsulation, OpenVINOReshape, OpenVINOIoUpdate: OpenVINO encapsulation #1754
TrtMatMulToConvTransform: Convert non-4D MatMul to Transpose-Conv-Transpose sequence
OpenVINOOptimumConversion: Add optimum Intel® pass for converting a Huggingface Model to an OpenVINO Model
Graph Surgeries
- MatMulAddGemm: Graph surgery to transform Add Op followed by Matmul as Gemm op
- PowReduceSumPowDiv2LpNorm: Graph surgery to merge Pow ReduceSum Pow Div pattern to L2Norm
OnnxHqqQuantization: Implements 4-bit HQQ quantization
VitisAIAddMetaData: Adds metadata to an ONNX model based on specified model attributes.

Alibaba-NLP/gte #1695
DeepSeek
- OpenVINO #1786
Google BERT
- QDQ #1701, #1718, #1733, #1797, #1817
- QNN #1764
- VitisAI #1728
Google VIT
- QDQ #1701, #1733, #1797, #1817
- QNN #1701, #1749
- VitisAI #1728
- OpenVINO #1757, #1767
Intel BERT
- QDQ #1797, #1817
- QNN #1749
- OpenVINO #1767, #1768, #1777, #1822
Laion Clip
- QDQ #1701, #1733, #1797
- QNN #1701, #1749
- VitisAI #1728
- OpenVINO #1793
Llama3
- OpenVINO #1786
Meta Llama3
- QDQ #1707
OpenAI Clip (16 and 32)
- QDQ #1701, #1733, #1797, #1817
- QNN #1701, #1764
- VitisAI #1728
- OpenVINO #1793
Phi3.5
- QDQ #1707, #1733, #1817
- VitisAI #1707, #1728
- OpenVINO #1786
Phi4
- OpenVINO #1828
Qwen
- QNN #1699
- OpenVINO #1786, #1828
Resnet50
- QDQ #1701, #1749, #1817
- QNN #1701, #1749
- OpenVINO #1757, #1767, #1786
Sentence Transformers CLIP
- QDQ #1797
- QNN #1694, #1797
Stable Diffusion
- QDQ #1730