Tools · SPBoucher
Menu

Directory

22 tools

Results

AutoGen

Microsoft · Agent frameworks & orchestration

Microsoft's multi-agent framework (Core, AgentChat, Extensions, Studio) for Python and .NET, now archived with users directed to Microsoft Agent Framework

MITOpen sourceFreeLocalSelf-hostedDeprecatedNov 2, 2026

Axolotl

Axolotl AI · Training & fine-tuning

YAML-configured open-source framework for fine-tuning and post-training LLMs: full, LoRA and QLoRA training, preference and RL methods, multimodal models and multi-GPU or multi-node runs

Apache-2.0Open sourceFreeSelf-hostedNov 2, 2026

Chroma

Chroma · Vector databases

Open-source embedding database with a minimal Python and JavaScript API, usable in-process, as a server or through Chroma Cloud

Apache-2.0Open sourceUsage-basedLocalSelf-hostedNov 2, 2026

CrewAI

CrewAI, Inc. · Agent frameworks & orchestration

Open-source Python framework for role-based multi-agent crews and event-driven flows, with a commercial enterprise console for deploying, monitoring and triggering automations

MITOpen sourceFreemiumLocalSelf-hostedNov 2, 2026

DSPy

Stanford NLP and the DSPy community · Prompting, evaluation & observability

Python framework for programming language-model pipelines with typed signatures and modules, then optimizing prompts and weights automatically against a metric

MITOpen sourceFreeLocalSelf-hostedNov 2, 2026

JAX

Google (Chrome DevTools team) · Training & fine-tuning

Python library for NumPy-style array computing with composable transformations (jit, grad, vmap, shard_map) compiled through XLA to CPU, GPU and TPU

Apache-2.0Open sourceFreeLocalSelf-hostedNov 2, 2026

LangChain

LangChain, Inc. · Agent frameworks & orchestration

Open-source Python and JavaScript framework whose create_agent harness builds tool-using agents on the LangGraph runtime with swappable model providers and middleware

MITOpen sourceFreeLocalSelf-hostedNov 2, 2026

LangGraph

LangChain, Inc. · Agent frameworks & orchestration

In-depth entry

Low-level orchestration framework and runtime for stateful, long-running agents expressed as graphs, with durable execution, checkpointing, human-in-the-loop and streaming

MITOpen sourceFreeLocalSelf-hostedNov 2, 2026

LiteLLM

BerriAI · Prompting, evaluation & observability

In-depth entry

Open-source Python SDK and self-hosted AI gateway that calls 100+ LLM providers in the OpenAI format, with routing, fallbacks, virtual keys, budgets, spend tracking and logging callbacks

MITOpen sourceFreeLocalSelf-hostedNov 2, 2026

llama.cpp

ggml-org (Georgi Gerganov and contributors) · Local LLM inference & serving

In-depth entry

C/C++ inference engine for LLMs and vision-language models with GGUF quantized weights, Metal, CUDA, Vulkan and other backends, a CLI and an OpenAI-compatible server

MITOpen sourceFreeLocalSelf-hostedNov 2, 2026

LlamaIndex

LlamaIndex, Inc. · Agent frameworks & orchestration

Open-source Python framework for retrieval-augmented agents over your data, with connectors, indexes, query engines and event-driven workflows, alongside the commercial LlamaParse document platform

MITOpen sourceFreeLocalSelf-hostedNov 2, 2026

Milvus

Zilliz / LF AI & Data Foundation · Vector databases

Open-source vector database from Zilliz with Lite, Standalone and Distributed deployments, many index types and GPU acceleration

Apache-2.0Open sourceFreeLocalSelf-hostedNov 2, 2026

OpenAI Agents SDK

OpenAI · Agent frameworks & orchestration

Lightweight open-source Python and TypeScript framework for agents, handoffs, guardrails, sessions and tracing, defaulting to OpenAI's Responses API with adapters for other providers

MITOpen sourceFreeLocalSelf-hostedNov 2, 2026

pgvector

Andrew Kane (pgvector project) · Vector databases

In-depth entry

PostgreSQL extension adding vector types, distance operators and HNSW/IVFFlat indexes for similarity search inside the database

PostgreSQLOpen sourceFreeSelf-hostedNov 2, 2026

promptfoo

Promptfoo, Inc. · Prompting, evaluation & observability

Open-source, local-first CLI and library for evaluating prompts, models, RAG pipelines and agents, with automated red teaming and CI integration

MITOpen sourceFreeLocalSelf-hostedBroken

Pydantic AI

Pydantic Services Inc. · Agent frameworks & orchestration

Type-safe Python agent framework from the Pydantic team with validated structured outputs, dependency injection, swappable model providers, MCP, durable execution and evals

MITOpen sourceFreeLocalSelf-hostedNov 2, 2026

PyTorch

PyTorch Foundation (Linux Foundation) · Training & fine-tuning

Open-source deep-learning framework with eager tensors, autograd, torch.compile and distributed training, governed by the PyTorch Foundation and the base of most LLM tooling

BSD-3-ClauseOpen sourceFreeLocalSelf-hostedBroken

Ray

Ray project (Anyscale and contributors) · Distributed & parallel computing

In-depth entry

Open-source Python framework for distributing tasks, actors and ML workloads across a cluster, with libraries for data processing, training, tuning, serving and reinforcement learning

Apache-2.0Open sourceFreeLocalSelf-hostedBroken

Sentence Transformers

Hugging Face · Embeddings, reranking & retrieval

Python library for computing and training embedding, cross-encoder reranker, sparse and multi-vector retrieval models, maintained by Hugging Face with thousands of pretrained models on the Hub

Apache-2.0Open sourceFreeLocalSelf-hostedNov 2, 2026

Transformers

Hugging Face · Training & fine-tuning

Hugging Face's model-definition library for text, vision, audio, video and multimodal models, with Pipeline, Trainer and generate APIs used as the reference by training and inference engines

Apache-2.0Open sourceFreeLocalSelf-hostedNov 2, 2026

Unsloth

Unsloth AI · Training & fine-tuning

Open-source framework for fine-tuning and running LLMs with reduced memory, covering LoRA, QLoRA, full fine-tuning and RL, GGUF export, Dynamic quantizations and a local Studio/Desktop UI

Apache-2.0Open sourceFreeLocalSelf-hostedNov 2, 2026

vLLM

vLLM project (originated at UC Berkeley Sky Computing Lab) · Local LLM inference & serving

In-depth entry

High-throughput LLM inference and serving engine with PagedAttention, continuous batching, quantization and an OpenAI-compatible server for GPU and accelerator clusters

Apache-2.0Open sourceFreeSelf-hostedNov 2, 2026

Page 1 of 1

Share this view: /tools?category=ai&exec=self-hosted&iface=library