alexpinel/Dot

Text-To-Speech, RAG, and LLMs. All local!

JavaScript

1,915

47 commits

updated Dec 9, 2024

See the code

README

Dot App Banner

License GitHub release (latest by date) GitHub commits GitHub stars

Visit the Dot Website


🚀 About Dot

Dot is a standalone, open-source application designed for seamless interaction with documents and files using local LLMs and Retrieval Augmented Generation (RAG). It is inspired by solutions like Nvidia's Chat with RTX, providing a user-friendly interface for those without a programming background. Using the Phi-3.5 LLM by default, Dot ensures accessibility and simplicity right out of the box.

https://github.com/alexpinel/Dot/assets/93524949/28b26128-7bdc-4bf7-99f3-d09bd8431875

📜 What does it do?

Dot allows you to load multiple documents into an LLM and interact with them in a fully local environment. Supported document types include PDF, DOCX, PPTX, XLSX, and more! Users can also engage with Big Dot for inquiries not directly related to their documents, similar to interacting with ChatGPT.

🔧 How does it work?

Built with Electron JS, The application uses libraries such as FAISS for creating local vector stores, Langchain, llama.cpp & Huggingface for setting up conversation chains, and additional tools for document management and interaction.

📥 Install

To use Dot:

  • Visit the Dot website to download the application for Apple Silicon or Windows.

For developers:

  • Clone the repository $ https://github.com/alexpinel/Dot.git
  • Install Node js and then run npm install inside the project repository, you can run npm install --force if you face any issues at this stage. Once complete, move to cd aadotllm and run npm install once more!

🌟 Future Features I'd Like to Add

  • Linux support
  • Choice of LLM - Done!
  • Image file support
  • Enhanced document awareness beyond content
  • Simplified file loading (select individual files, not just folders)
  • Increased security measures for using local LLMs
  • Support for additional document types - Done!
  • Efficient file database management for quicker access to groups of files

🤝 Want to Help?

Contributions are highly encouraged! As a student managing this project on the side, any help is greatly appreciated. Whether it's coding, documentation, or feature suggestions, please feel free to get involved!

Star History

Star History Chart


document-chat
embeddings
faiss
langchain
llamacpp
llm
local
phi-3
privategpt
rag
self-hosted
standalone
standalone-app
tts
whisper-cpp

alexpinel/Dot

Text-To-Speech, RAG, and LLMs. All local!

JavaScript

1,915

47 commits

updated Dec 9, 2024

See the code

README

Dot App Banner

License GitHub release (latest by date) GitHub commits GitHub stars

Visit the Dot Website


🚀 About Dot

Dot is a standalone, open-source application designed for seamless interaction with documents and files using local LLMs and Retrieval Augmented Generation (RAG). It is inspired by solutions like Nvidia's Chat with RTX, providing a user-friendly interface for those without a programming background. Using the Phi-3.5 LLM by default, Dot ensures accessibility and simplicity right out of the box.

https://github.com/alexpinel/Dot/assets/93524949/28b26128-7bdc-4bf7-99f3-d09bd8431875

📜 What does it do?

Dot allows you to load multiple documents into an LLM and interact with them in a fully local environment. Supported document types include PDF, DOCX, PPTX, XLSX, and more! Users can also engage with Big Dot for inquiries not directly related to their documents, similar to interacting with ChatGPT.

🔧 How does it work?

Built with Electron JS, The application uses libraries such as FAISS for creating local vector stores, Langchain, llama.cpp & Huggingface for setting up conversation chains, and additional tools for document management and interaction.

📥 Install

To use Dot:

  • Visit the Dot website to download the application for Apple Silicon or Windows.

For developers:

  • Clone the repository $ https://github.com/alexpinel/Dot.git
  • Install Node js and then run npm install inside the project repository, you can run npm install --force if you face any issues at this stage. Once complete, move to cd aadotllm and run npm install once more!

🌟 Future Features I'd Like to Add

  • Linux support
  • Choice of LLM - Done!
  • Image file support
  • Enhanced document awareness beyond content
  • Simplified file loading (select individual files, not just folders)
  • Increased security measures for using local LLMs
  • Support for additional document types - Done!
  • Efficient file database management for quicker access to groups of files

🤝 Want to Help?

Contributions are highly encouraged! As a student managing this project on the side, any help is greatly appreciated. Whether it's coding, documentation, or feature suggestions, please feel free to get involved!

Star History

Star History Chart


document-chat
embeddings
faiss
langchain
llamacpp
llm
local
phi-3
privategpt
rag
self-hosted
standalone
standalone-app
tts
whisper-cpp

Significant stargazers

Vincent Koc

2,245 followers · starred Jul 2024

Georgi Gerganov

20,771 followers · starred Apr 2024

Zaki Manian

526 followers · starred Apr 2024

Jamie Pine

2,666 followers · starred Apr 2024