- Published on
PrivateGPT is an API that allows users to ask questions about their documents using the power of large language models (LLMs) without risking a data leak.
The project is production-ready and provides two logical blocks: a high-level API that manages ingestion, splitting, metadata extraction, embedding generation and storage, and a low-level API for implementing more complex pipelines.
It also offers a Gradio UI client to test the API and tools such as a bulk model download script and a documents folder watch.
Based on the LlamaIndex framework, PrivateGPT is designed to be easily extended and adapted to suit user needs, with dependency injection, usage of abstractions, and simplicity of design.