Tools · SPBoucher
Menu

Directory

29 tools

Results

AutoGen

Microsoft · Agent frameworks & orchestration

Microsoft's multi-agent framework (Core, AgentChat, Extensions, Studio) for Python and .NET, now archived with users directed to Microsoft Agent Framework

MITOpen sourceFreeLocalSelf-hostedDeprecatedNov 2, 2026

Chroma

Chroma · Vector databases

Open-source embedding database with a minimal Python and JavaScript API, usable in-process, as a server or through Chroma Cloud

Apache-2.0Open sourceUsage-basedLocalSelf-hostedNov 2, 2026

ComfyUI

Comfy Org · Voice, vision & multimodal AI

Open-source node-based interface and inference engine for diffusion and other generative models (image, video, audio, 3D), runnable locally with desktop apps or as a hosted cloud

GPL-3.0-onlyOpen sourceFreeLocalNov 2, 2026

CrewAI

CrewAI, Inc. · Agent frameworks & orchestration

Open-source Python framework for role-based multi-agent crews and event-driven flows, with a commercial enterprise console for deploying, monitoring and triggering automations

MITOpen sourceFreemiumLocalSelf-hostedNov 2, 2026

DSPy

Stanford NLP and the DSPy community · Prompting, evaluation & observability

Python framework for programming language-model pipelines with typed signatures and modules, then optimizing prompts and weights automatically against a metric

MITOpen sourceFreeLocalSelf-hostedNov 2, 2026

Instructor

Jason Liu and contributors (567 Labs) · Agent frameworks & orchestration

Python library for extracting validated structured data from LLM responses using Pydantic models, with automatic retries, streaming partials and support for many providers

MITOpen sourceFreeLocalNov 2, 2026

JAX

Google (Chrome DevTools team) · Training & fine-tuning

Python library for NumPy-style array computing with composable transformations (jit, grad, vmap, shard_map) compiled through XLA to CPU, GPU and TPU

Apache-2.0Open sourceFreeLocalSelf-hostedNov 2, 2026

LangChain

LangChain, Inc. · Agent frameworks & orchestration

Open-source Python and JavaScript framework whose create_agent harness builds tool-using agents on the LangGraph runtime with swappable model providers and middleware

MITOpen sourceFreeLocalSelf-hostedNov 2, 2026

LangGraph

LangChain, Inc. · Agent frameworks & orchestration

In-depth entry

Low-level orchestration framework and runtime for stateful, long-running agents expressed as graphs, with durable execution, checkpointing, human-in-the-loop and streaming

MITOpen sourceFreeLocalSelf-hostedNov 2, 2026

LiteLLM

BerriAI · Prompting, evaluation & observability

In-depth entry

Open-source Python SDK and self-hosted AI gateway that calls 100+ LLM providers in the OpenAI format, with routing, fallbacks, virtual keys, budgets, spend tracking and logging callbacks

MITOpen sourceFreeLocalSelf-hostedNov 2, 2026

llama.cpp

ggml-org (Georgi Gerganov and contributors) · Local LLM inference & serving

In-depth entry

C/C++ inference engine for LLMs and vision-language models with GGUF quantized weights, Metal, CUDA, Vulkan and other backends, a CLI and an OpenAI-compatible server

MITOpen sourceFreeLocalSelf-hostedNov 2, 2026

LlamaIndex

LlamaIndex, Inc. · Agent frameworks & orchestration

Open-source Python framework for retrieval-augmented agents over your data, with connectors, indexes, query engines and event-driven workflows, alongside the commercial LlamaParse document platform

MITOpen sourceFreeLocalSelf-hostedNov 2, 2026

LM Studio

Element Labs, Inc. · Local LLM inference & serving

In-depth entry

Proprietary desktop app for discovering, downloading and running local LLMs with llama.cpp and MLX engines, a chat UI, an OpenAI-compatible server, CLI, SDKs and a headless daemon

ProprietaryFreemiumPaidLocalBroken

Milvus

Zilliz / LF AI & Data Foundation · Vector databases

Open-source vector database from Zilliz with Lite, Standalone and Distributed deployments, many index types and GPU acceleration

Apache-2.0Open sourceFreeLocalSelf-hostedNov 2, 2026

Ollama

Ollama · Local LLM inference & serving

In-depth entry

Open-source runtime and model manager for running open-weight LLMs locally on macOS, Windows and Linux, with a REST API, OpenAI- and Anthropic-compatible endpoints and optional cloud models

MITOpen sourceFreeLocalSelf-hostedNov 2, 2026

OpenAI Agents SDK

OpenAI · Agent frameworks & orchestration

Lightweight open-source Python and TypeScript framework for agents, handoffs, guardrails, sessions and tracing, defaulting to OpenAI's Responses API with adapters for other providers

MITOpen sourceFreeLocalSelf-hostedNov 2, 2026

pgvector

Andrew Kane (pgvector project) · Vector databases

In-depth entry

PostgreSQL extension adding vector types, distance operators and HNSW/IVFFlat indexes for similarity search inside the database

PostgreSQLOpen sourceFreeSelf-hostedNov 2, 2026

promptfoo

Promptfoo, Inc. · Prompting, evaluation & observability

Open-source, local-first CLI and library for evaluating prompts, models, RAG pipelines and agents, with automated red teaming and CI integration

MITOpen sourceFreeLocalSelf-hostedBroken

Pydantic AI

Pydantic Services Inc. · Agent frameworks & orchestration

Type-safe Python agent framework from the Pydantic team with validated structured outputs, dependency injection, swappable model providers, MCP, durable execution and evals

MITOpen sourceFreeLocalSelf-hostedNov 2, 2026

PyTorch

PyTorch Foundation (Linux Foundation) · Training & fine-tuning

Open-source deep-learning framework with eager tensors, autograd, torch.compile and distributed training, governed by the PyTorch Foundation and the base of most LLM tooling

BSD-3-ClauseOpen sourceFreeLocalSelf-hostedBroken

Qdrant

Qdrant Solutions GmbH · Vector databases

In-depth entry

Open-source vector search engine written in Rust with filterable HNSW indexes, sparse and multi-vector support, REST/gRPC APIs and a managed cloud

Apache-2.0Open sourceFreemiumLocalSelf-hostedNov 2, 2026

Ragas

Vibrant Labs (formerly Exploding Gradients) · Prompting, evaluation & observability

Open-source Python library for evaluating LLM and RAG applications with LLM-driven and custom metrics, experiments, dataset management and result tracking

Apache-2.0Open sourceFreeLocalBroken

Ray

Ray project (Anyscale and contributors) · Distributed & parallel computing

In-depth entry

Open-source Python framework for distributing tasks, actors and ML workloads across a cluster, with libraries for data processing, training, tuning, serving and reinforcement learning

Apache-2.0Open sourceFreeLocalSelf-hostedBroken

scikit-learn

scikit-learn developers · Mathematical & statistical computing

BSD-licensed Python machine-learning library for classification, regression, clustering, dimensionality reduction, preprocessing and model selection on NumPy and SciPy

BSD-3-ClauseFreeOpen sourceLocalNov 2, 2026

Page 1 of 2

Share this view: /tools?category=ai&os=windows&selfhost=1