Letterpaths: Or how LLMs can be good even when they're bad