ggml-org (Georgi Gerganov and contributors) · Local LLM inference & serving
In-depth entry
C/C++ inference engine for LLMs and vision-language models with GGUF quantized weights, Metal, CUDA, Vulkan and other backends, a CLI and an OpenAI-compatible server
Element Labs, Inc. · Local LLM inference & serving
In-depth entry
Proprietary desktop app for discovering, downloading and running local LLMs with llama.cpp and MLX engines, a chat UI, an OpenAI-compatible server, CLI, SDKs and a headless daemon
React framework from Vercel for full-stack web applications with file-based routing, server components, server-side rendering, static generation and API route handlers
Open-source runtime and model manager for running open-weight LLMs locally on macOS, Windows and Linux, with a REST API, OpenAI- and Anthropic-compatible endpoints and optional cloud models
Universal document converter that translates between Markdown, LaTeX, HTML, DOCX, EPUB, Typst, Jupyter and dozens of other formats, with citeproc and Lua filters
Open-source scientific publishing system from Posit that renders Markdown with executable Python, R, Julia or Observable code to HTML, PDF, Word, slides, websites and books via Pandoc
Ray project (Anyscale and contributors) · Distributed & parallel computing
In-depth entry
Open-source Python framework for distributing tasks, actors and ML workloads across a cluster, with libraries for data processing, training, tuning, serving and reinforcement learning
In-memory key-value data store used as cache, message broker and database, with data structures, Pub/Sub, Streams and, since Redis 8, built-in JSON, search and time-series modules
LicenseRef-RSALv2 OR SSPL-1.0 OR AGPL-3.0-onlyOpen sourceFreeSelf-hostedNov 2, 2026
Scrapy developers (maintained with Zyte) · Data collection & crawling
In-depth entry
Mature open-source Python framework for writing crawlers (spiders) that fetch pages asynchronously, extract structured items and export them through pipelines
WireGuard-based mesh overlay network with a hosted coordination service, identity-provider login, access policies, MagicDNS and features such as Tailscale SSH, Serve and Funnel