Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

CoT is both correlated and causal of the model's real computations, it's just imperfect. If you manually add "Let's wrap it up" in the CoT during generation, most LLMs will actually wrap it up (this is a commonly used trick in local LLM circles to get long-winded LLMs to stop reasoning). This wouldn't work if CoT text didn't affect the actual internal model logic.
 help



Why does injecting random text increase the precision then?



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: