Ollama

Ollama is a command-line tool used to run large language models on local computers, allowing users to download and run models like Llama 2, Code Llama, and others locally, and supporting customization and creation of their own models. This free and open-source project currently supports macOS and Linux operating systems, and will also support Windows systems in the future.
In addition, Ollama also provides an official Docker image, making it easier to deploy large language models using Docker containers, ensuring that all interactions with these models occur locally without the need to send private data to third-party services. Ollama supports GPU acceleration on macOS and Linux, and provides a simple command-line interface (CLI) and REST API for interacting with applications.
This tool is particularly useful for developers or researchers who need to run and experiment with large language models on local machines, without relying on external cloud services.