AutoGen
Microsoft · Agent frameworks & orchestration
Microsoft's multi-agent framework (Core, AgentChat, Extensions, Studio) for Python and .NET, now archived with users directed to Microsoft Agent Framework
22 tools
Microsoft · Agent frameworks & orchestration
Microsoft's multi-agent framework (Core, AgentChat, Extensions, Studio) for Python and .NET, now archived with users directed to Microsoft Agent Framework
Axolotl AI · Training & fine-tuning
YAML-configured open-source framework for fine-tuning and post-training LLMs: full, LoRA and QLoRA training, preference and RL methods, multimodal models and multi-GPU or multi-node runs
Chroma · Vector databases
Open-source embedding database with a minimal Python and JavaScript API, usable in-process, as a server or through Chroma Cloud
Cohere Inc. · Model providers & APIs
Enterprise-focused model provider with Command generation, Embed and Rerank retrieval models, Aya multilingual research models, the North agent platform and private or dedicated deployment options
CrewAI, Inc. · Agent frameworks & orchestration
Open-source Python framework for role-based multi-agent crews and event-driven flows, with a commercial enterprise console for deploying, monitoring and triggering automations
Stanford NLP and the DSPy community · Prompting, evaluation & observability
Python framework for programming language-model pipelines with typed signatures and modules, then optimizing prompts and weights automatically against a metric
Exo Labs · Distributed & parallel computing
Open-source software that pools several Apple Silicon Macs (and Linux hosts) into one local inference cluster, sharding large models across devices with MLX
Google (Chrome DevTools team) · Training & fine-tuning
Python library for NumPy-style array computing with composable transformations (jit, grad, vmap, shard_map) compiled through XLA to CPU, GPU and TPU
LangChain, Inc. · Agent frameworks & orchestration
Open-source Python and JavaScript framework whose create_agent harness builds tool-using agents on the LangGraph runtime with swappable model providers and middleware
LangChain, Inc. · Prompting, evaluation & observability
LangChain's hosted platform for tracing, evaluating and deploying LLM applications and agents, with prompt tooling, an LLM gateway and cloud, hybrid or self-hosted options
LlamaIndex, Inc. · Agent frameworks & orchestration
Open-source Python framework for retrieval-augmented agents over your data, with connectors, indexes, query engines and event-driven workflows, alongside the commercial LlamaParse document platform
Zilliz / LF AI & Data Foundation · Vector databases
Open-source vector database from Zilliz with Lite, Standalone and Distributed deployments, many index types and GPU acceleration
Mistral AI · Model providers & APIs
French model provider offering open-weight and proprietary models through the Studio API, OCR and speech models, the Vibe agent for productivity and coding, and self-deployment options
OpenAI · Agent frameworks & orchestration
Lightweight open-source Python and TypeScript framework for agents, handoffs, guardrails, sessions and tracing, defaulting to OpenAI's Responses API with adapters for other providers
Promptfoo, Inc. · Prompting, evaluation & observability
Open-source, local-first CLI and library for evaluating prompts, models, RAG pipelines and agents, with automated red teaming and CI integration
Pydantic Services Inc. · Agent frameworks & orchestration
Type-safe Python agent framework from the Pydantic team with validated structured outputs, dependency injection, swappable model providers, MCP, durable execution and evals
PyTorch Foundation (Linux Foundation) · Training & fine-tuning
Open-source deep-learning framework with eager tensors, autograd, torch.compile and distributed training, governed by the PyTorch Foundation and the base of most LLM tooling
Hugging Face · Embeddings, reranking & retrieval
Python library for computing and training embedding, cross-encoder reranker, sparse and multi-vector retrieval models, maintained by Hugging Face with thousands of pretrained models on the Hub
Hugging Face · Training & fine-tuning
Hugging Face's model-definition library for text, vision, audio, video and multimodal models, with Pipeline, Trainer and generate APIs used as the reference by training and inference engines
Unsloth AI · Training & fine-tuning
Open-source framework for fine-tuning and running LLMs with reduced memory, covering LoRA, QLoRA, full fine-tuning and RL, GGUF export, Dynamic quantizations and a local Studio/Desktop UI
Weaviate B.V. · Vector databases
Open-source vector database in Go with pluggable vectorizer modules, hybrid BM25 and vector search, multi-tenancy and a managed cloud
CoreWeave · Training & fine-tuning
ML experiment tracking, sweeps, artifacts and model registry plus Weave for LLM tracing and evaluation, now sold by CoreWeave within its Forge platform with a free academic tier
Page 1 of 1
Share this view: /tools?category=ai&exec=self-hosted&depth=standard