Directory

Mature open-source Python framework for writing crawlers (spiders) that fetch pages asynchronously, extract structured items and export them through pipelines

Open-source cluster resource manager and job scheduler for Linux clusters, allocating nodes, launching jobs and managing queues on many HPC systems

Open-source backend platform built around a dedicated PostgreSQL database with auto-generated APIs, authentication, file storage, realtime subscriptions and edge functions

The comprehensive free TeX distribution for Linux, macOS and Windows, released yearly with the tlmgr package manager and all major engines, packages and fonts

Terminal multiplexer that keeps shell sessions alive on a server, splits a terminal into windows and panes, and lets sessions be detached and reattached

Cloud-native reverse proxy and ingress controller that discovers routes from Docker, Kubernetes and other providers and automates TLS through ACME

Hugging Face's model-definition library for text, vision, audio, video and multimodal models, with Pipeline, Trainer and generate APIs used as the reference by training and inference engines

Distributed SQL query engine that federates queries across data lakes, warehouses and databases through connectors, formerly PrestoSQL

Open-source scanner that finds known vulnerabilities, misconfigurations, exposed secrets and license issues in container images, file systems, git repositories, IaC and Kubernetes clusters

Statically typed superset of JavaScript from Microsoft that compiles to plain JavaScript and powers editor tooling across the web ecosystem

Markup-based typesetting system with an Apache-2.0 compiler written in Rust and a collaborative web app, positioned as a faster, simpler alternative to LaTeX

Open-source framework for fine-tuning and running LLMs with reduced memory, covering LoRA, QLoRA, full fine-tuning and RL, GGUF export, Dynamic quantizations and a local Studio/Desktop UI

High-throughput LLM inference and serving engine with PagedAttention, continuous batching, quantization and an OpenAI-compatible server for GPU and accelerator clusters

ML experiment tracking, sweeps, artifacts and model registry plus Weave for LLM tracing and evaluation, now sold by CoreWeave within its Forge platform with a free academic tier

Minimal, high-speed VPN protocol and implementation built on modern cryptography, included in the Linux kernel and available on macOS, iOS, Windows, Android and BSD