Awesome MLX

An awesome list dedicated to the MLX library from Apple

Articles

2024

• On-device ML research with MLX and Swift
• MLX: On-device machine learning on Apple Silicon
• A Deep Dive into Apple’s Machine Learning Framework (MLX) — Step by Step Introduction
• Deploying LLMs locally with Apple’s MLX framework
• MLX Tutorial: Apple's Bold Move in Machine Learning Arena!
• Deep Dive into AI with MLX and PyTorch: "Deep Dive into AI with MLX and PyTorch" is an educational initiative designed to help anyone interested in AI, specifically in machine learning and deep learning, using Apple's MLX and Meta's PyTorch frameworks.
• Notes on the Apple MLX machine learning framework: Shared personal notes created while working with the Apple MLX machine learning framework

Models

• Models on HuggingFace
• Using MLX at Hugging Face
• llama-3-8B-Instruct-function-calling: This model is fine-tuned based on Meta-Llama/Meta-Llama-3-8B instructions via mlx-lm.

Libraries and Tools

• mlxserver: This Python library is the easist way to begin building on top of Apple's machine learning library, MLX.
• mlx-llm: Large Language Models (LLMs) applications and tools running on Apple Silicon in real-time with Apple MLX.
• lightning-whisper-mlx: An incredibly fast implementation of Whisper optimized for Apple Silicon.
• mlx-benchmark: Benchmark of Apple MLX operations on all Apple Silicon chips (GPU, CPU) + MPS and CUDA.
• MLX-VLM: MLX-VLM is a package for running Vision LLMs locally on your Mac using MLX.
• mlx-llm-server: For inferring and serving local LLMs using the MLX framework
• mlx-transformers: MLX Transformers is a library that provides model implementation in MLX. It uses a similar model interface as HuggingFace Transformers and provides a way to load and run models in Apple Silicon devices.
• mlxcli: Run large models from the terminal using Apple MLX.
• SiLLM: SiLLM simplifies the process of training and running Large Language Models (LLMs) on Apple Silicon by leveraging the MLX framework.
• MLX_CLIP 📚🤖: A simple package to use CLIP on apple silicon using the MLX libraries from Apple
• outlinesmlx: A fast minimalistic implementation of guided generation on Apple Silicon using Outlines and MLX
• mlx-embedding-models: Run text embeddings on your Apple Silicon GPU. Supports any BERT- or RoBERTa-based embedding model, with a curated registry of high-performing models that just work off the shelf.
• RLX: Reinforcement Learning with MLX: https://github.com/noahfarr/rlx
• 🍏 MLX - ResNet 🍏: ResNet implementation with the MLX, Apple's DL framework.
• mlx_stft: Short-Time Fourier Transform (STFT) for MLX (Apple)
• PyOllaMx (Ollama + MlX): Your gateway to both Ollama & Apple MlX models
• mlx-bench: Benchmark MLX Performance across commits
• mlx-image: mlx image models for Apple Silicon machines
• mlx-local-server: A tiny server to run local inference on MLX model in the style of OpenAI
• AutoMLX: An easy-to-use LLMs inference tool for quickly loading models accelerated by the Apple MLX framework on Mac devices, and providing a simple and compatible API interface for integration with other LLMs tools.

Demo

• mlx-chat-app: Chat with MLX is a high-performance macOS application that connects your local documents to a personalized large language model (LLM).
• photo-similarity-search: Super simple MLX (apple silicon) CLIP based photo similarity web app
• Video Summarization: Transcribe and summarize videos using whisper and llms on apple mlx framework
• MLX Assistant: A simple script to enhance text editing across your Mac, leveraging the power of MLX. Designed for seamless integration, it offers real-time text correction everywhere you type.
• MLX RAG With GGUF Model Weights: Minimal, clean code implementation of RAG with mlx using gguf model weights
• Enhancing Video Analysis with MLX: A Guide: Explore the capabilities of the MLX library and leverage the genAI stack on MacOS to interact with any video.
• MLX Demos: Explore machine learning techniques with Gradio interfaces for Stable Diffusion image generation and LoRA text generation with the Apple MLX framework.
• MLX Chat: A simple UI / Web / Frontend for MLX mlx-lm using Streamlit.
• SiLLM-examples: Examples for using SiLLM
• PyOMlx: A wannabe Ollama equivalent for Apple MlX models
• MLX Community Projects: Let's collect some cool MLX integrations and community lead projects here for visibility!
• nanoGPT_mlx: Port of Andrej Karpathy's nanoGPT to Apple MLX framework.
• Autogram: Grammar checker with a keyboard shortcut for Ollama and Apple MLX with Automator on macOS.
• MLX RAG: Retrieval Augmented Generation (RAG) example using Langchain (loader), Chroma (vector database), Hugging Face sentence-transformers (embeddings) and MLX (LLM).

MLX Swift

• MLX Swift: Swift API for MLX
• MLX Swift Examples: Examples using MLX Swift
• mlx-swift-chat: A multi-platform SwiftUI frontend for running local LLMs with Apple's MLX framework.
• ChatMLX: ChatMLX is a large model real-time conversation app implemented using MLX
• Ph3iOSOnDeviceChatApp: Source code to run Microsoft's Phi 3 Min 4K model completely on device