Artificial Intelligence

Open-source software that pools several Apple Silicon Macs (and Linux hosts) into one local inference cluster, sharding large models across devices with MLX

Python library for extracting validated structured data from LLM responses using Pydantic models, with automatic retries, streaming partials and support for many providers

Python library for NumPy-style array computing with composable transformations (jit, grad, vmap, shard_map) compiled through XLA to CPU, GPU and TPU

Open-source, local-first CLI and library for evaluating prompts, models, RAG pipelines and agents, with automated red teaming and CI integration

Open-source embedding database with a minimal Python and JavaScript API, usable in-process, as a server or through Chroma Cloud

Python framework for programming language-model pipelines with typed signatures and modules, then optimizing prompts and weights automatically against a metric

Apple's Swift framework giving apps access to the on-device Apple Intelligence language model with guided generation, tool calling and sessions, on OS 26 and later

Microsoft's multi-agent framework (Core, AgentChat, Extensions, Studio) for Python and .NET, now archived with users directed to Microsoft Agent Framework

Port of OpenAI's Whisper speech-recognition models to MLX, offering a CLI and Python API for local transcription on Apple Silicon

OpenAI's coding agent: an open-source Rust terminal CLI plus IDE extension, desktop app and cloud agent, signed in with a ChatGPT plan or an API key

Fully managed, proprietary vector database service with serverless indexes, namespaces, metadata filtering and integrated embedding and reranking

Low-latency hosted inference API for open-weight models on Groq's LPU hardware, OpenAI-compatible, with speech-to-text, text-to-speech, tool use and batch tiers

Open-source Python library for evaluating LLM and RAG applications with LLM-driven and custom metrics, experiments, dataset management and result tracking

Hosted observability and evaluation platform for AI agents with tracing, experiments, pattern detection, a CLI, MCP access and an AI assistant (Loop) that analyzes traces and builds evals

Google's consumer assistant on web, Android and iOS, with Gemini Live voice, Deep Research, Canvas, Gems and image and video generation, tied to Google AI subscription plans

Open-source vector database from Zilliz with Lite, Standalone and Distributed deployments, many index types and GPU acceleration

OpenAI's consumer and workplace assistant, available on the web, desktop and mobile, with projects, plugins, browsing, voice and the Codex coding agent