9.3 Ollama
Like GPT4All, Ollama is a tool that allows you to run AI models locally on your system. In contrast to GPT4All, however, Ollama doesn’t provide a GUI, but focuses on local execution and the management of models in the terminal. The application is so flexible that you can add a graphical interface or integrations into other applications on your system in just a few steps.
Ollama is an open-source project managed on GitHub (https://github.com/ollama/ollama). The official website of the project with admittedly somewhat sparse documentation, but an interesting blog can be found at https://ollama.com.
Ollama is able to make optimal use of your system’s hardware and can use both the system’s CPU and GPU to run the models. You should ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access