Tools · SPBoucher
Menu

Directory

26 tools

Results

Axolotl

Axolotl AI · Training & fine-tuning

YAML-configured open-source framework for fine-tuning and post-training LLMs: full, LoRA and QLoRA training, preference and RL methods, multimodal models and multi-GPU or multi-node runs

Apache-2.0Open sourceFreeSelf-hostedNov 2, 2026

Braintrust

Braintrust Data, Inc. · Prompting, evaluation & observability

Hosted observability and evaluation platform for AI agents with tracing, experiments, pattern detection, a CLI, MCP access and an AI assistant (Loop) that analyzes traces and builds evals

MixedFreemiumPaidNov 2, 2026

Claude Code

Anthropic · Coding agents & AI IDEs

In-depth entry

Anthropic's agentic coding tool that reads a codebase, edits files and runs commands from the terminal, IDEs, a desktop app, the web and CI, with MCP, hooks, skills and subagents

ProprietaryPaidUsage-basedLocalNov 2, 2026

Claude Platform

Anthropic · Model providers & APIs

In-depth entry

Anthropic's developer platform for the Claude models: Messages API, tool use, structured outputs, prompt caching, batch processing and Managed Agents, plus cloud availability

ProprietaryUsage-basedEnterpriseNov 2, 2026

CrewAI

CrewAI, Inc. · Agent frameworks & orchestration

Open-source Python framework for role-based multi-agent crews and event-driven flows, with a commercial enterprise console for deploying, monitoring and triggering automations

MITOpen sourceFreemiumLocalSelf-hostedNov 2, 2026

exo

Exo Labs · Distributed & parallel computing

Open-source software that pools several Apple Silicon Macs (and Linux hosts) into one local inference cluster, sharding large models across devices with MLX

Apache-2.0Open sourceFreeLocalSelf-hostedNov 2, 2026

Firecrawl

Firecrawl (formerly Mendable) · Data collection & crawling

In-depth entry

Web data API that scrapes, crawls, maps and searches websites and returns clean Markdown or structured JSON for LLM pipelines, with an AGPL-licensed self-hostable core

AGPL-3.0-onlyFreemiumPaidSelf-hostedNov 2, 2026

Google Cloud

Google (Chrome DevTools team) · Cloud & hosting providers

Google's public cloud with Compute Engine, GKE, Cloud Run, BigQuery, Cloud Storage and the Vertex AI platform for Gemini and other models

ProprietaryUsage-basedFreemiumNov 2, 2026

Hugging Face Hub

Hugging Face · Training & fine-tuning

In-depth entry

Hosting platform for open models, datasets and Spaces demo apps built on git repositories and Xet storage, with Inference Providers, Endpoints, Jobs and an open-source Python client and CLI

MixedFreemiumPaidLocalNov 2, 2026

LiteLLM

BerriAI · Prompting, evaluation & observability

In-depth entry

Open-source Python SDK and self-hosted AI gateway that calls 100+ LLM providers in the OpenAI format, with routing, fallbacks, virtual keys, budgets, spend tracking and logging callbacks

MITOpen sourceFreeLocalSelf-hostedNov 2, 2026

llama.cpp

ggml-org (Georgi Gerganov and contributors) · Local LLM inference & serving

In-depth entry

C/C++ inference engine for LLMs and vision-language models with GGUF quantized weights, Metal, CUDA, Vulkan and other backends, a CLI and an OpenAI-compatible server

MITOpen sourceFreeLocalSelf-hostedNov 2, 2026

LM Studio

Element Labs, Inc. · Local LLM inference & serving

In-depth entry

Proprietary desktop app for discovering, downloading and running local LLMs with llama.cpp and MLX engines, a chat UI, an OpenAI-compatible server, CLI, SDKs and a headless daemon

ProprietaryFreemiumPaidLocalBroken

Microsoft Azure

Microsoft · Cloud & hosting providers

Microsoft's public cloud with virtual machines, AKS, Azure Functions, Cosmos DB, Azure Database for PostgreSQL, Entra ID identity and Microsoft Foundry for hosted AI models

ProprietaryUsage-basedFreemiumNov 2, 2026

Mistral AI

Mistral AI · Model providers & APIs

French model provider offering open-weight and proprietary models through the Studio API, OCR and speech models, the Vibe agent for productivity and coding, and self-deployment options

MixedFreemiumUsage-basedSelf-hostedBroken

MLX LM

Apple Inc. · Apple Silicon ML & MLX

In-depth entry

Python package and CLI for running, serving, quantizing and fine-tuning large language models on Apple Silicon with MLX

MITOpen sourceFreeLocalNov 2, 2026

Ollama

Ollama · Local LLM inference & serving

In-depth entry

Open-source runtime and model manager for running open-weight LLMs locally on macOS, Windows and Linux, with a REST API, OpenAI- and Anthropic-compatible endpoints and optional cloud models

MITOpen sourceFreeLocalSelf-hostedNov 2, 2026

OpenAI API

OpenAI · Model providers & APIs

In-depth entry

OpenAI's hosted developer platform: Responses and Chat Completions APIs, Realtime voice, embeddings, images, audio, fine-tuning, evals and managed agents

ProprietaryUsage-basedEnterpriseNov 2, 2026

OpenAI Codex

OpenAI · Coding agents & AI IDEs

OpenAI's coding agent: an open-source Rust terminal CLI plus IDE extension, desktop app and cloud agent, signed in with a ChatGPT plan or an API key

Apache-2.0PaidUsage-basedLocalNov 2, 2026

promptfoo

Promptfoo, Inc. · Prompting, evaluation & observability

Open-source, local-first CLI and library for evaluating prompts, models, RAG pipelines and agents, with automated red teaming and CI integration

MITOpen sourceFreeLocalSelf-hostedBroken

Ray

Ray project (Anyscale and contributors) · Distributed & parallel computing

In-depth entry

Open-source Python framework for distributing tasks, actors and ML workloads across a cluster, with libraries for data processing, training, tuning, serving and reinforcement learning

Apache-2.0Open sourceFreeLocalSelf-hostedBroken

Tavily

Tavily (Alpha AI Technologies Inc.) · Search & web-data APIs

In-depth entry

Web search, extraction, crawling and research API designed for LLM agents, returning concise source content with SDKs, framework integrations and a hosted MCP server

ProprietaryFreemiumUsage-basedNov 2, 2026

Transformers

Hugging Face · Training & fine-tuning

Hugging Face's model-definition library for text, vision, audio, video and multimodal models, with Pipeline, Trainer and generate APIs used as the reference by training and inference engines

Apache-2.0Open sourceFreeLocalSelf-hostedNov 2, 2026

Unsloth

Unsloth AI · Training & fine-tuning

Open-source framework for fine-tuning and running LLMs with reduced memory, covering LoRA, QLoRA, full fine-tuning and RL, GGUF export, Dynamic quantizations and a local Studio/Desktop UI

Apache-2.0Open sourceFreeLocalSelf-hostedNov 2, 2026

vLLM

vLLM project (originated at UC Berkeley Sky Computing Lab) · Local LLM inference & serving

In-depth entry

High-throughput LLM inference and serving engine with PagedAttention, continuous batching, quantization and an OpenAI-compatible server for GPU and accelerator clusters

Apache-2.0Open sourceFreeSelf-hostedNov 2, 2026

Page 1 of 2

Share this view: /tools?tag=llm&iface=cli