Local LLM on MacBookPro

https://huggingface.co/mlx-community https://github.com/ml-explore/mlx-lm https://github.com/jundot/omlx Install # install hf uv tool install "huggingface_hub" --with hf-xet --upgrade hf auth login hf auth whoami # install mlx_lm uv tool install --force \ --from 'git+https://github.com/ml-explore/mlx-lm.git@refs/pull/1192/head' mlx-lm \ --with 'transformers @ git+https://github.com/huggingface/transformers.git' # install mlx-openai-server uv pip install git+https://github.com/cubist38/mlx-openai-server.git --system # install [litellm](https://github.com/BerriAI/litellm) uv tool install 'litellm[proxy]' # install [claw-code](https://github.com/ultraworkers/claw-code) cargo install agent-code Download Model HF_HUB_DISABLE_XET=1 hf download mlx-community/DeepSeek-V4-Flash-4bit \ --local-dir deepseekV4 --repo-type model Run Server mlx_lm.server --model /Users/ricky/git/mlx/deepseekV4 --port 8080 or