README

GPT4All


  Now with support for DeepSeek R1 Distillations



  Website • Documentation • Discord • YouTube Tutorial



  GPT4All runs large language models (LLMs) privately on everyday desktops & laptops.


  No API calls or GPUs required - you can just download the application and get started.



  Read about what's new in our blog.


  Subscribe to the newsletter


https://github.com/nomic-ai/gpt4all/assets/70534565/513a0f15-4964-4109-89e4-4f9a9011f311


GPT4All is made possible by our compute partner Paperspace.


 Download Links


  — 
     Windows Installer
   —


  — 
     Windows ARM Installer
   —


  — 
     macOS Installer
   —


  — 
     Ubuntu Installer
   —


  The Windows and Linux builds require Intel Core i3 2nd Gen / AMD Bulldozer, or better.


  The Windows ARM build supports Qualcomm Snapdragon and Microsoft SQ1/SQ2 processors.


  The Linux build is x86-64 only (no ARM).


  The macOS build requires Monterey 12.6 or newer. Best results with Apple Silicon M-series processors.


See the full System Requirements for more details.




  
    
    Flathub (community maintained)
  


 Install GPT4All Python

gpt4all gives you access to LLMs with our Python client around llama.cpp implementations. 

Nomic contributes to open source software like llama.cpp to make LLMs accessible and efficient for all.

bash
pip install gpt4all


python
from gpt4all import GPT4All
model = GPT4All("Meta-Llama-3-8B-Instruct.Q4_0.gguf")  downloads / loads a 4.66GB LLM
with model.chat_session():
    print(model.generate("How can I run LLMs efficiently on my laptop?", max_tokens=1024))



 Integrations

:parrot::link: Langchain
:card_file_box: Weaviate Vector Database - module docs
:telescope: OpenLIT (OTel-native Monitoring) - Docs

 Release History
- July 2nd, 2024: V3.0.0 Release
    - Fresh redesign of the chat application UI
    - Improved user workflow for LocalDocs
    - Expanded access to more model architectures
- October 19th, 2023: GGUF Support Launches with Support for:
    - Mistral 7b base model, an updated model gallery on our website, several new local code models including Rift Coder v1.5
    - Nomic Vulkan support for Q4\_0 and Q4\_1 quantizations in GGUF.
    - Offline build support for running old versions of the GPT4All Local LLM Chat Client.
- September 18th, 2023: Nomic Vulkan launches supporting local LLM inference on NVIDIA and AMD GPUs.
- July 2023: Stable support for LocalDocs, a feature that allows you to privately and locally chat with your data.
- June 28th, 2023: [Docker-based API server] launches allowing inference of local LLMs from an OpenAI-compatible HTTP endpoint.

[Docker-based API server]: https://github.com/nomic-ai/gpt4all/tree/cef74c2be20f5b697055d5b8b506861c7b997fab/gpt4all-api

 Contributing
GPT4All welcomes contributions, involvement, and discussion from the open source community!
Please see CONTRIBUTING.md and follow the issues, bug reports, and P

Top issues

Discussions

Latest release

What's New
 Remote Models:
   The Add Model page now has a dedicated tab for remote model providers.
   Groq, OpenAI, and Mistral remote models are now easier to configure.
 CUDA Compatibility: GPUs with CUDA compute capability 5.0 such as the GTX 750 are now supported by the CUDA backend.
 New Model: The non-MoE Granite model is now supported.
 Translation Updates:
   The Italian translation has been updated.
   The Simplified Chinese translation has been significantly improved.
 Better Chat Templates: The default chat templates for OLMoE 7B 0924/0125 and Granite 3.1 3B/8B have been