Skip to content

Building Generative AI application using Retrieval Augmented Generation(RAG) using Mistral 7B LLM, LangChain orchestration framework & In memory vector database FAISS (Facebook AI Similarity Search)

License

Notifications You must be signed in to change notification settings

amogh18t/RAGbot

Repository files navigation

Use Window Powershell to run following steps

Step 1: Install WSL(Windows Subsystem for Linux)

wsl --install

Step 2: List the different Linux Distribution that you can choose to install

wsl.exe -l -o

Step 3: install Linux distribtion received from above command example as below Ubuntu-22.04

wsl.exe --install Ubuntu-22.04

Step 4: Install Ollama at WSL

curl https://ollama.ai/install.sh | sh

Step 5: Run Opensource LLM a per your choice example as below using mistral LLM

ollama run mistral

Step 5: Ask LLM question and get answer :)

Now you can ask question from LLM to get response at Windows powershell terminal.

Future work is where you can run that as API endpoint at Google Collab, VSCode and Ollama it's own chat interface.

About

Building Generative AI application using Retrieval Augmented Generation(RAG) using Mistral 7B LLM, LangChain orchestration framework & In memory vector database FAISS (Facebook AI Similarity Search)

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published