The '42x speedup' in llama.cpp was only about draft generation. Testing prompt lookup on an M4 Mac, code rewriting was 2.2x faster, while creative writing was 10…

A post on r/LocalLLaMA claiming that 'llama.cpp's prompt lookup has been made 42x faster' is gaining attention.Looking at the ...