ggml-org (Georgi Gerganov and contributors) · Local LLM inference & serving
In-depth entry
C/C++ inference engine for LLMs and vision-language models with GGUF quantized weights, Metal, CUDA, Vulkan and other backends, a CLI and an OpenAI-compatible server
Element Labs, Inc. · Local LLM inference & serving
In-depth entry
Proprietary desktop app for discovering, downloading and running local LLMs with llama.cpp and MLX engines, a chat UI, an OpenAI-compatible server, CLI, SDKs and a headless daemon
MathWorks' commercial numeric computing environment and language for engineers and scientists, with toolboxes, Simulink integration, apps and MATLAB Online
Microsoft's public cloud with virtual machines, AKS, Azure Functions, Cosmos DB, Azure Database for PostgreSQL, Entra ID identity and Microsoft Foundry for hosted AI models
French model provider offering open-weight and proprietary models through the Studio API, OCR and speech models, the Vibe agent for productivity and coding, and self-deployment options
Document database storing BSON documents with a rich aggregation pipeline, available as a source-available Community Server or the managed Atlas service
React framework from Vercel for full-stack web applications with file-based routing, server components, server-side rendering, static generation and API route handlers
Event-driven HTTP server, reverse proxy, load balancer and mail proxy, distributed as open source under the 2-clause BSD license with a commercial Plus edition
Hosted ingress service that exposes local servers through public URLs via an agent or SDK, with Traffic Policy rules, API gateway features and reserved domains
Open-source runtime and model manager for running open-weight LLMs locally on macOS, Windows and Linux, with a REST API, OpenAI- and Anthropic-compatible endpoints and optional cloud models