Several recent advances in AI systems solve problems by providing a"scaffolding"program that structures multiple calls to language models (LMs) to generate better outputs. A scaffolding program is written in a programming language such as Python. In this work, we use a language-model-infused scaf…