Hacker News · item history
Why your local LLM feels dumber than it is
2
first seen points
507
peak points
507
latest points
38
observations
Posted on X
- Local LLMs don't feel dumber because the weights are worse. They feel dumber because the defaults are set for your laptop's RAM, not the model's actual capability. Most of the gap is context window, temperature, and sampling settings you can fix in 30 seconds.