Kubernetes
Cloud Native Computing Foundation · Containers & virtualization
Open-source system for scheduling, scaling and operating containerized workloads across a cluster of machines
3 tools
Cloud Native Computing Foundation · Containers & virtualization
Open-source system for scheduling, scaling and operating containerized workloads across a cluster of machines
Ray project (Anyscale and contributors) · Distributed & parallel computing
Open-source Python framework for distributing tasks, actors and ML workloads across a cluster, with libraries for data processing, training, tuning, serving and reinforcement learning
vLLM project (originated at UC Berkeley Sky Computing Lab) · Local LLM inference & serving
High-throughput LLM inference and serving engine with PagedAttention, continuous batching, quantization and an OpenAI-compatible server for GPU and accelerator clusters
Page 1 of 1
Share this view: /tools?category=distributed-computing&depth=deep