Directory

Open-source runtime and model manager for running open-weight LLMs locally on macOS, Windows and Linux, with a REST API, OpenAI- and Anthropic-compatible endpoints and optional cloud models

PostgreSQL extension adding vector types, distance operators and HNSW/IVFFlat indexes for similarity search inside the database

Open-source vector search engine written in Rust with filterable HNSW indexes, sparse and multi-vector support, REST/gRPC APIs and a managed cloud