How I built a RAG system with Open-Source And Custom LLM Models

In this post, I will discuss how I integrated the RAG system from start to end. There are a few prerequisites required to run the LLM locally.

  1. Docker
  2. LMStudio
  3. Embedding Model
  4. Conversation Model