zlacker

[return to "My iPhone 16 Pro Max produces garbage output when running MLX LLMs"]
1. zcbenz+Ys1[view] [source] 2026-02-02 11:46:08
>>rafael+(OP)
It is a bug in MLX that has been fixed a few days ago: https://github.com/ml-explore/mlx/pull/3083
◧◩
2. embedd+Gt1[view] [source] 2026-02-02 11:51:24
>>zcbenz+Ys1
Blog post dated 28 Jan 2026, the bug fix posted 29 Jan 2026, so I guess this story had a happy ending :)

Still, sad state of affairs that it seems like Apple is still fixing bugs based on what blog posts gets the most attention on the internet, but I guess once they started that approach, it's hard to stop and go back to figuring out priorities on their own.

◧◩◪
3. llm_ne+9A1[view] [source] 2026-02-02 12:43:37
>>embedd+Gt1
MLX is a fairly esoteric library seeing very little usage, mostly to try to foment a broader NN space on Apple devices. This isn't something that is widely affecting people, and most people simply aren't trying to run general LLMs on their iPhone.

I don't think that fix is specific to this, but it's absolutely true that MLX is trying to lever every advantage it can find on specific hardware, so it's possible it made a bad choice on a particular device.

[go to top]