Handle: anythingllm
URL: https://localhost:34171

A full-stack application that enables you to turn any document, resource, or piece of content into context that any LLM can use as references during chatting. This application allows you to pick and choose which LLM or Vector Database you want to use as well as supporting multi-user management and permissions.

AnythingLLM divides your documents into objects called workspaces. A Workspace functions a lot like a thread, but with the addition of containerization of your documents. Workspaces can share documents, but they do not talk to each other so you can keep your context for each workspace clean.

# [Optional] Pre-pull an image
harbor pull anythingllm
# Start the service
harbor up anythingllm
# [Optional] Open the UI
harbor open anythingllm
# [Optional] Inspect service logs
harbor logs anythingllm

Local data is stored in Harbor's workspace, you can find a path to it with the following command:

echo $(harbor home)/anythingllm/storage

Out of the box, Harbor pre-connects AnythingLLM to:

• Ollama - You'll still need to select specific models for LLM and embeddings
• llama.cpp - Embeddings are not pre-configured
• SearXNG for Web RAG, but still needs to be enabled in the UI

Other than that, you can adjust following settings via harbor config:

# Port to allocate on your host for the
# AnythingLLM web app
anythingllm.host_port=34171
# Docker image to use, below is the official one
anythingllm.image="mintplexlabs/anythingllm"
# Docker tag/version to use, you might want to pin this
# in case latest doesn't work as expected
anythingllm.version="latest"
# Secret to use for JWT tokens, you can change this
# to a more secure value if exposing AnythingLLM over the network
anythingllm.jwt_secret="sk-anythingllm-jwt"

An example of AnythingLLM with Harbor documentation imported into workspace: