Directory

Python package and CLI for running, serving, quantizing and fine-tuning large language models on Apple Silicon with MLX

Open-source framework for fine-tuning and running LLMs with reduced memory, covering LoRA, QLoRA, full fine-tuning and RL, GGUF export, Dynamic quantizations and a local Studio/Desktop UI