swift-mlx-lm

What problem does it solve?

This Skill enables users to run powerful Large Language Models (LLMs) and Vision-Language Models (VLMs) directly on their Apple Silicon Macs, making advanced AI capabilities accessible without relying on cloud services.

Core Features & Use Cases

• Local Inference: Run LLMs and VLMs efficiently on your Apple Silicon device.
• Streaming Generation: Get responses in real-time as the model generates text.
• Tool Calling: Integrate LLM capabilities with external tools and functions.
• Fine-tuning: Adapt models using LoRA for specific tasks.
• Use Case: Develop a Swift application that uses a local LLM to summarize user-provided text, answer questions about local documents, or even generate creative content, all processed on the user's machine.

Quick Start

Use the swift-mlx-lm skill to explain how to load a Qwen3-4B-4bit model for chat.