ollama.com · ML Frameworks
Open source local model runner with a one line pull and run CLI, a desktop app and a local HTTP API. Uses llama.cpp-based and MLX engines; optional paid cloud models.
Ollama is one of 20 ML framework tools on Axiomi. See all ML framework tools or how we check facts.
// guides
What is safetensors? A plain guide to the Hugging Face model file format: why it is safer than pickle, how it compares to GGUF, and how to load or convert it.
Ollama vs vLLM compared: setup, model formats, speed for one user or many, hardware, Mac support and the signs it is time to move from Ollama to vLLM.
Tinygrad vs MLX compared for Apple silicon and beyond: hardware support, lazy graphs, JIT and compile, LLM tooling, install and which framework fits your project.
Can you run DeepSeek V4.1 Flash locally? Real RAM, VRAM and disk needs by GGUF, Strata on one 12 GB GPU, the llama.cpp PR, vLLM, Ollama and DGX Spark.
SmolLM vs Llama compared on benchmarks, licence, context, languages, memory and local setup, so you can choose between SmolLM3 and Llama 3.2 for your project.
SGLang vs vLLM on DGX Spark compared on setup, memory, NVFP4 models, speed and clustering, so you can pick the right server for your GB10 desktop.
// related
LM Studiolmstudio.aiDesktop app for macOS, Windows and Linux to find, download and chat with local models, running GGUF on llama.cpp and MLX on Apple Silicon, with a local API server.ML FrameworksFreemiumHN 3
llama.cppgithub.comPlain C/C++ LLM inference engine that popularised GGUF quantised models running on everyday hardware.ML FrameworksOpen source★ 132.6kStratagithub.comMIT licensed local inference app and terminal that runs very large mixture of experts models on one consumer GPU by keeping busy experts in RAM and streaming the rest from SSD.ML FrameworksOpen source★ 34.8kmlx-lmgithub.comPython package from Apple's MLX team for generating text with, quantizing, serving and fine tuning (LoRA or full) language models on Apple silicon, using Hugging Face Hub models.ML FrameworksOpen source★ 7.5k
vLLMvllm.aiHigh throughput open source inference and serving engine built around PagedAttention and continuous batching, with an OpenAI compatible server that scales from one GPU to clusters.ML FrameworksOpen source★ 95.7k
PyTorchpytorch.orgThe dominant deep learning framework in research, with eager execution, torch.compile and a huge ecosystem.ML FrameworksOpen source★ 105.1k