Abso

Abso is an open-source LLM proxy that automatically routes requests between fast and slow models based on prompt complexity. It uses various heuristics to chose the proper model. It's very fast and has low latency.

Installation and setup​

pip install langchain-abso

Chat Model​

See usage details here