Changelog

• 5392783 ui: tweak vertical space for mobile (#343)

Changelog

• 00b738c Add Macro-In-Macro Support (#337)

This release includes two new features:

• model macros (#330): macros can now be defined as part of a model's configuration. These take precedence over macros defined at the global level.
• model metadata (#333): metadata can now be defined in a model's configuration. This is a schema-less object that supports integers, floats, bools, strings, arrays and child objects. metadata fields also support macro substitution. Metadata is only used in the v1/models endpoint under a new JSON key: meta.llamaswap.

Other smaller changes:

• macro values can be any integer, string, bools, or float types. This enhancement makes JSON encoding of metadata with macros behave as expected. Previously macro values could only be strings.

Changelog

• 70930e4 proxy: add support for user defined metadata in model configs (#333)
• 1f61791 proxy/config: add model level macros (#330)
• 216c40b proxy/config: create config package and migrate configuration (#329)

Changelog

• 9e3d491 proxyToUpstream: add redirect with trailing slash to upstream endpoint (#322)

Changelog

• 1a84926 proxy: add unload of single model (#318)

Changelog

• fc3bb71 UI styling / code improvements (#307)

Changelog

• c36986f upstream handler support for model names with forward slash (#298)
• 558801d Fix nginx proxy buffering for streaming endpoints (#295)
• b21dee2 Fix #288 Vite hot module reloading creating multiple SSE connections (#290)

Changelog

• f58c8c8 Support llama.cpp's cache_n in timings info (#287)
• 954e2de Remove cmdStart from README [skip ci]

Changelog

• a533aec small tweak to example config
• 97b17fc Add ${MODEL_ID} macro (#226)
• 2457840 Update README.md [skip ci]
• 7f55494 Update README.md [skip ci]

Changelog

• 831a90d Add different timeout scenarios to Process.checkHealthEndpoint #276 (#278)
• 977f185 add /completion endpoint (#275)
• 52b329f Fix #277 race condition in ProcessGroup.ProxyRequest when swap=true