🤖 Chat with multiple PDFs locally

📖 Table of Contents

Feature
Idea
Setup
- Kaggle
- Local
  - Clone
  - Install
  - Run
Todo

⭐️ Key Features

Easy to run on Local or Kaggle (new)
Using any model from Huggingface and Ollama
Process multiple PDF inputs.
Chat with multiples languages (Coming soon).
Simple UI with Gradio.

💡 Idea (Experiment)

💻 Setup

1. Kaggle (Recommended)

Import notebooks/kaggle.ipynb to Kaggle
Replace <YOUR_NGROK_TOKEN> with your tokens.

2. Local

2.1. Clone project

git clone https://github.com/datvodinh/rag-chatbot.git
cd rag-chatbot

2.2 Install

2.2.1 Docker

docker compose up --build

2.2.2 Using script (Ollama, Ngrok, python package)

source ./scripts/install_extra.sh

2.2.3 Install manually

1. `Ollama`

MacOS, Window: Download
Linux

curl -fsSL https://ollama.com/install.sh | sh

2. `Ngrok`

Macos

brew install ngrok/ngrok/ngrok

Linux

curl -s https://ngrok-agent.s3.amazonaws.com/ngrok.asc \
| sudo tee /etc/apt/trusted.gpg.d/ngrok.asc >/dev/null \
&& echo "deb https://ngrok-agent.s3.amazonaws.com buster main" \
| sudo tee /etc/apt/sources.list.d/ngrok.list \
&& sudo apt update \
&& sudo apt install ngrok

3. Install `rag_chatbot` Package

source ./scripts/install.sh

2.3 Run

source ./scripts/run.sh

or

python -m rag_chatbot --host localhost

Using Ngrok

source ./scripts/run.sh --ngrok

3. Go to: `https://0.0.0.0:7860/` or Ngrok link after setup completed

🎯 Todo

Add evaluation.
Better Document Processing.
Support better Embedding Model for Vietnamese and other languages.
ReAct Agent.
Document mangement (Qrdant, MongoDB,...)

Name		Name	Last commit message	Last commit date
Latest commit History 145 Commits
.github		.github
assets		assets
notebooks		notebooks
rag_chatbot		rag_chatbot
scripts		scripts
.dockerignore		.dockerignore
.gitignore		.gitignore
Dockerfile		Dockerfile
LICENSE		LICENSE
Makefile		Makefile
README.md		README.md
docker-compose.yml		docker-compose.yml
poetry.lock		poetry.lock
pyproject.toml		pyproject.toml

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Repository files navigation

🤖 Chat with multiple PDFs locally

📖 Table of Contents

⭐️ Key Features

💡 Idea (Experiment)

💻 Setup

1. Kaggle (Recommended)

2. Local

2.1. Clone project

2.2 Install

2.2.1 Docker

2.2.2 Using script (Ollama, Ngrok, python package)

2.2.3 Install manually

1. `Ollama`

2. `Ngrok`

3. Install `rag_chatbot` Package

2.3 Run

3. Go to: `https://0.0.0.0:7860/` or Ngrok link after setup completed

🎯 Todo

🌟 Star History

About

Uh oh!

Releases 10

Packages

Uh oh!

Uh oh!

Languages

License

datvodinh/rag-chatbot

Folders and files

Latest commit

History

Repository files navigation

🤖 Chat with multiple PDFs locally

📖 Table of Contents

⭐️ Key Features

💡 Idea (Experiment)

💻 Setup

1. Kaggle (Recommended)

2. Local

2.1. Clone project

2.2 Install

2.2.1 Docker

2.2.2 Using script (Ollama, Ngrok, python package)

2.2.3 Install manually

1. Ollama

2. Ngrok

3. Install rag_chatbot Package

2.3 Run

3. Go to: https://0.0.0.0:7860/ or Ngrok link after setup completed

🎯 Todo

🌟 Star History

About

Topics

Resources

License

Uh oh!

Stars

Watchers

Forks

Releases 10

Packages 0

Uh oh!

Uh oh!

Languages

1. `Ollama`

2. `Ngrok`

3. Install `rag_chatbot` Package

3. Go to: `https://0.0.0.0:7860/` or Ngrok link after setup completed

Packages