I’ve been experimenting with MLX (and mlx-lm / mlx-vlm — great work by others) and started a small WIP project to see how vLLM-style ideas could work on Apple Silicon.
It’s super early, just me tweaking things and learning, but if you’re into MLX or running LLMs/VLMs on a Mac, I’d love feedback or contributors.
waybarrios•2mo ago
I’ve been experimenting with MLX (and mlx-lm / mlx-vlm — great work by others) and started a small WIP project to see how vLLM-style ideas could work on Apple Silicon.
It’s super early, just me tweaking things and learning, but if you’re into MLX or running LLMs/VLMs on a Mac, I’d love feedback or contributors.
Repo: https://github.com/waybarrios/vllm-mlx