Ragas
Vibrant Labs (formerly Exploding Gradients) · Prompting, evaluation & observability
Open-source Python library for evaluating LLM and RAG applications with LLM-driven and custom metrics, experiments, dataset management and result tracking
59 tools
Vibrant Labs (formerly Exploding Gradients) · Prompting, evaluation & observability
Open-source Python library for evaluating LLM and RAG applications with LLM-driven and custom metrics, experiments, dataset management and result tracking
Ray project (Anyscale and contributors) · Distributed & parallel computing
Open-source Python framework for distributing tasks, actors and ML workloads across a cluster, with libraries for data processing, training, tuning, serving and reinforcement learning
Scite LLC (Research Solutions) · Literature discovery & review
Citation-analysis platform whose Smart Citations show whether later papers support, contrast or merely mention a claim, with an AI assistant and reference checking
Tavily (Alpha AI Technologies Inc.) · Search & web-data APIs
Web search, extraction, crawling and research API designed for LLM agents, returning concise source content with SDKs, framework integrations and a hosted MCP server
Together AI · Model providers & APIs
Cloud platform for open-source models: serverless and dedicated inference, fine-tuning, GPU clusters, batch jobs and code sandboxes behind an OpenAI-compatible API
Hugging Face · Training & fine-tuning
Hugging Face's model-definition library for text, vision, audio, video and multimodal models, with Pipeline, Trainer and generate APIs used as the reference by training and inference engines
Unsloth AI · Training & fine-tuning
Open-source framework for fine-tuning and running LLMs with reduced memory, covering LoRA, QLoRA, full fine-tuning and RL, GGUF export, Dynamic quantizations and a local Studio/Desktop UI
vLLM project (originated at UC Berkeley Sky Computing Lab) · Local LLM inference & serving
High-throughput LLM inference and serving engine with PagedAttention, continuous batching, quantization and an OpenAI-compatible server for GPU and accelerator clusters
Warp (Denver Technologies) · Terminals & shells
Commercial terminal built in Rust that groups output into blocks, adds an IDE-style input editor and integrates AI agents for command generation and debugging
CoreWeave · Training & fine-tuning
ML experiment tracking, sweeps, artifacts and model registry plus Weave for LLM tracing and evaluation, now sold by CoreWeave within its Forge platform with a free academic tier
Zed Industries · IDEs & editors
Native, GPU-rendered code editor written in Rust by Zed Industries, with built-in collaboration, language servers and optional AI assistance
Page 3 of 3
Share this view: /tools?tag=llm