Tools · SPBoucher
Menu

Artificial Intelligence

Models, assistants, inference engines, agent frameworks and the tooling around them.

Tools in this category

Apify

Apify Technologies s.r.o. · Data collection & crawling

In-depth entry

Cloud platform and marketplace for running web-scraping and automation programs (Actors), with storages, proxies, scheduling, an API and an MCP server for agents

Apache-2.0FreemiumUsage-basedNov 2, 2026

Claude Code

Anthropic · Coding agents & AI IDEs

In-depth entry

Anthropic's agentic coding tool that reads a codebase, edits files and runs commands from the terminal, IDEs, a desktop app, the web and CI, with MCP, hooks, skills and subagents

ProprietaryPaidUsage-basedLocalNov 2, 2026

Claude Platform

Anthropic · Model providers & APIs

In-depth entry

Anthropic's developer platform for the Claude models: Messages API, tool use, structured outputs, prompt caching, batch processing and Managed Agents, plus cloud availability

ProprietaryUsage-basedEnterpriseNov 2, 2026

Langfuse

Langfuse (part of ClickHouse, Inc. since January 2026) · Prompting, evaluation & observability

In-depth entry

Open-source LLM observability and evaluation platform: tracing, LLM-as-judge and human evals, prompt management, datasets and cost dashboards, self-hostable or as Langfuse Cloud

MITOpen sourceFreemiumSelf-hostedNov 2, 2026

LangGraph

LangChain, Inc. · Agent frameworks & orchestration

In-depth entry

Low-level orchestration framework and runtime for stateful, long-running agents expressed as graphs, with durable execution, checkpointing, human-in-the-loop and streaming

MITOpen sourceFreeLocalSelf-hostedNov 2, 2026

LiteLLM

BerriAI · Prompting, evaluation & observability

In-depth entry

Open-source Python SDK and self-hosted AI gateway that calls 100+ LLM providers in the OpenAI format, with routing, fallbacks, virtual keys, budgets, spend tracking and logging callbacks

MITOpen sourceFreeLocalSelf-hostedNov 2, 2026

llama.cpp

ggml-org (Georgi Gerganov and contributors) · Local LLM inference & serving

In-depth entry

C/C++ inference engine for LLMs and vision-language models with GGUF quantized weights, Metal, CUDA, Vulkan and other backends, a CLI and an OpenAI-compatible server

MITOpen sourceFreeLocalSelf-hostedNov 2, 2026

LM Studio

Element Labs, Inc. · Local LLM inference & serving

In-depth entry

Proprietary desktop app for discovering, downloading and running local LLMs with llama.cpp and MLX engines, a chat UI, an OpenAI-compatible server, CLI, SDKs and a headless daemon

ProprietaryFreemiumPaidLocalBroken

MLX

Apple Inc. · Apple Silicon ML & MLX

In-depth entry

Apple's open-source array framework for machine learning on Apple Silicon, with NumPy-like Python, C++ and Swift APIs and unified CPU/GPU memory

MITOpen sourceFreeLocalNov 2, 2026

MLX LM

Apple Inc. · Apple Silicon ML & MLX

In-depth entry

Python package and CLI for running, serving, quantizing and fine-tuning large language models on Apple Silicon with MLX

MITOpen sourceFreeLocalNov 2, 2026

Ollama

Ollama · Local LLM inference & serving

In-depth entry

Open-source runtime and model manager for running open-weight LLMs locally on macOS, Windows and Linux, with a REST API, OpenAI- and Anthropic-compatible endpoints and optional cloud models

MITOpen sourceFreeLocalSelf-hostedNov 2, 2026

OpenAI API

OpenAI · Model providers & APIs

In-depth entry

OpenAI's hosted developer platform: Responses and Chat Completions APIs, Realtime voice, embeddings, images, audio, fine-tuning, evals and managed agents

ProprietaryUsage-basedEnterpriseNov 2, 2026

pgvector

Andrew Kane (pgvector project) · Vector databases

In-depth entry

PostgreSQL extension adding vector types, distance operators and HNSW/IVFFlat indexes for similarity search inside the database

PostgreSQLOpen sourceFreeSelf-hostedNov 2, 2026

Qdrant

Qdrant Solutions GmbH · Vector databases

In-depth entry

Open-source vector search engine written in Rust with filterable HNSW indexes, sparse and multi-vector support, REST/gRPC APIs and a managed cloud

Apache-2.0Open sourceFreemiumLocalSelf-hostedNov 2, 2026

Ray

Ray project (Anyscale and contributors) · Distributed & parallel computing

In-depth entry

Open-source Python framework for distributing tasks, actors and ML workloads across a cluster, with libraries for data processing, training, tuning, serving and reinforcement learning

Apache-2.0Open sourceFreeLocalSelf-hostedBroken

Visual Studio Code

Microsoft · IDEs & editors

In-depth entry

Free, extensible code editor from Microsoft with a large extension marketplace, integrated terminal, debugging, remote development and built-in AI assistance

MITFreeLocalNov 2, 2026

vLLM

vLLM project (originated at UC Berkeley Sky Computing Lab) · Local LLM inference & serving

In-depth entry

High-throughput LLM inference and serving engine with PagedAttention, continuous batching, quantization and an OpenAI-compatible server for GPU and accelerator clusters

Apache-2.0Open sourceFreeSelf-hostedNov 2, 2026

Cursor

Anysphere · Coding agents & AI IDEs

AI-native code editor from Anysphere, forked from VS Code, with inline edits, codebase-aware chat and agent mode that can run multi-step changes

ProprietaryFreemiumPaidLocalNov 2, 2026

Zed

Zed Industries · IDEs & editors

Native, GPU-rendered code editor written in Rust by Zed Industries, with built-in collaboration, language servers and optional AI assistance

GPL-3.0-or-laterOpen sourceFreeLocalNov 2, 2026

Hugging Face Hub

Hugging Face · Training & fine-tuning

In-depth entry

Hosting platform for open models, datasets and Spaces demo apps built on git repositories and Xet storage, with Inference Providers, Endpoints, Jobs and an open-source Python client and CLI

MixedFreemiumPaidLocalNov 2, 2026

Model Context Protocol

Model Context Protocol, a Series of LF Projects, LLC (originated by Anthropic) · Agent frameworks & orchestration

In-depth entry

Open JSON-RPC standard for connecting AI applications to tools, data and prompts through servers, now stewarded under the Linux Foundation with SDKs in many languages

Open sourceOpen sourceFreeLocalSelf-hostedNov 2, 2026

OpenRouter

OpenRouter, Inc. · Model providers & APIs

Unified API gateway to hundreds of models from many providers with automatic fallbacks, credit-based pass-through billing, BYOK, free models and data-policy routing

ProprietaryFreemiumUsage-basedBroken

Pydantic AI

Pydantic Services Inc. · Agent frameworks & orchestration

Type-safe Python agent framework from the Pydantic team with validated structured outputs, dependency injection, swappable model providers, MCP, durable execution and evals

MITOpen sourceFreeLocalSelf-hostedNov 2, 2026

scikit-learn

scikit-learn developers · Mathematical & statistical computing

BSD-licensed Python machine-learning library for classification, regression, clustering, dimensionality reduction, preprocessing and model selection on NumPy and SciPy

BSD-3-ClauseFreeOpen sourceLocalNov 2, 2026