Category Archives: LLM

LLM – Optical problem solving now works

Finally got the PDF OCR flow working, and the LLM can now solve math problems. Only grey diagrams are still hard for it to recognize properly.

I used a math training exam that my son is currently working on in preparation for Gymnasium.

And even the 27B model is sufficient to solve this level of math.

LLM full throttle on M3 Ultra 84 Watts !

What a crazy efficiency monster.
Running a LLM on all 80 GPU cores and the system is only drawing 84 Watts…..

Nvidia must be crying at night.

and this is only M3, M4 is even more efficient, but yet not available as an ultra fusion variant, and end of year Apple will manufacture in 2nm