Sophisticated docker builds for parent project lm-sys/FastChat.

Easy setup. Compatible. Tweakable. Scaleable.

amd64, arm64

Containers follow the version scheme of the parent project

main (default), v0.2.9, etc.

See Releases

• docker and docker compose are available on your system

These containers require nvidia-container-toolkit installed and reboot

Short description what it does The following wil get all im

• get docker-compose.yml (clone repo, copy or else)
• Run docker compose up
• wait for model download (~7GB)
• open/refresh https://localhost:3000

[] TODO Environment variables to set for the specific service

Prepend, e.g. FASTCHAT_VERSION=v0.2.9

docker compose pull

docker compose rm

When there is a new version and there is need of builds or you require the latest main build, feel free to open an issue

Open an issue on the Issue Tracker

We cannot support issues regarding the base software. Please refer to the main project page mentioned in the second line of this card.