zlacker

[return to "My iPhone 16 Pro Max produces garbage output when running MLX LLMs"]
1. zcbenz+Ys1[view] [source] 2026-02-02 11:46:08
>>rafael+(OP)
It is a bug in MLX that has been fixed a few days ago: https://github.com/ml-explore/mlx/pull/3083
◧◩
2. zozbot+3v1[view] [source] 2026-02-02 12:03:32
>>zcbenz+Ys1
So the underlying issue is that the iPhone 16 Pro SKU was misdetected as having Neural Accelerator (nax) support and this caused silently wrong results. Not a problem with the actual hardware.
◧◩◪
3. TimByt+7O1[view] [source] 2026-02-02 14:09:04
>>zozbot+3v1
From a debugging point of view, the author's conclusion was still completely reasonable given the evidence they had
◧◩◪◨
4. consta+Pw2[view] [source] 2026-02-02 17:56:49
>>TimByt+7O1
No it wasn't. A hardware defect so disastrous that it affects floating point computation on the neural engine, yet so minor that it does not affect any of the software on the device utilizing that hardware is exceedingly improbable.

The conclusion, that it was not the fault of the developer was correct, but assuming anything other than a problem at some point in the software stack is unreasonable.

◧◩◪◨⬒
5. Dylan1+sL2[view] [source] 2026-02-02 19:08:02
>>consta+Pw2
> yet so minor that it does not affect any of the software on the device utilizing that hardware

You're being unfair here. The showpiece software that uses that hardware wouldn't install, and almost all software ignores it.

◧◩◪◨⬒⬓
6. consta+XO2[view] [source] 2026-02-02 19:27:40
>>Dylan1+sL2
The hardware itself is utilized by many pieces of software on any Apple device. Face ID uses it, Siri uses it, the camera uses it, there are also other Apple on device LLM features, where you could easily test whether the basic capabilities are there.

I highly doubt that you could have a usable iPhone with a broken neural engine, at the very least it would be obvious to the user that there is something very wrong going on.

[go to top]