A flexible Python front-end inference SDK.

• Flexible

  FlexInfer has a Python front-end, which makes it easy to build a computer vision product prototype.

• Efficient

  Most of time consuming part of FlexInfer is powered by C++ or CUDA, so FlexInfer is also efficient. If you are really hungry for efficiency and don't mind the trouble of C++, you can refer to CheetahInfer.

This project is released under Apache 2.0 license.

• Linux
• Python 3.6 or higher
• TensorRT 7.1.3.4 or higher
• PyTorch 1.4.0 or higher
• CUDA 10.2 or higher
• volksdep 3.2.0 or higher

We have tested the following versions of OS and softwares:

• OS: Ubuntu 16.04.6 LTS
• Python 3.6.9
• TensorRT 7.1.3.4
• PyTorch 1.6.0
• CUDA: 10.2
• volksdep: 3.2.0

1. If your platform is x86 or x64, you can create a conda virtual environment and activate it.

conda create -n flexinfer python=3.6.9 -y
conda activate flexinfer

2. Install volksdep following the official instructions

3. Setup

pip install "git+https://github.com/Media-Smart/flexinfer.git"

We provide some examples for different tasks.

• Classification
• Segmentation
• Object Detection
• Scene Text Recognition

• Device: Jetson AGX Xavier
• CUDA: 10.2

We provide some toolboxes of different tasks for training, testing and deploying.

• Classification (vedacls)

• Segmentation (vedaseg)

• Object Detection (vedadet)

• Scene Text Recognition (vedastr)

This repository is currently maintained by Yuxin Zou (@Yuxin Zou), Jun Sun(@ChaseMonsterAway), Hongxiang Cai (@hxcai) and Yichao Xiong (@mileistone).