Arithmetic Reasoning with LLM: Prolog Generation & Permutation

“…(LLMs), with their scaling of model size and data size, have demonstrated impressive performance across various understanding and generation tasks (Brown et al., 2020; Chowdh-ery et al., 2022; Rae et al., 2021; Thoppilan et al., 2022; Touvron et al., 2023; Almazrouei et al., 2023; Jiang et al.,…”

“Since Prolog predicates are permutable, inspired by XLNet (Yang et al., 2020) that performs a token-wise permutation via attention masking, we decided to also use the permutation technique.”

“We adopted 8-bit quantization and LoRA (Hu et al., 2021) to finetune models efficiently at a reasonable performance cost.”

“Prolog is a logic programming language, which was initially designed for artificial intelligence and computational linguistics (Clocksin and Mellish, 2003; Bratko, 2012; Covington, 2002).”

“Prolog is a logic programming language, which was initially designed for artificial intelligence and computational linguistics (Clocksin and Mellish, 2003; Bratko, 2012; Covington, 2002).”

“A line of work has focused on augmenting language models with deterministic computation resources like a calculator (Schick et al., 2023) or program-based tools (Gao et al., 2023; Gou et al., 2023).”

“Neural Symbolic Reasoning Neural symbolic reasoning (Andreas et al., 2016; Neelakantan et al., 2017; Hudson and Manning, 2019; Gupta et al., 2020; Nye et al., 2021) aims to leverage both neural networks and symbolic reasoning to obtain better reasoning abilities and transparency.”

“…with their scaling of model size and data size, have demonstrated impressive performance across various understanding and generation tasks (Brown et al., 2020; Chowdh-ery et al., 2022; Rae et al., 2021; Thoppilan et al., 2022; Touvron et al., 2023; Almazrouei et al., 2023; Jiang et al., 2023).”

“Dataset We used the GSM8K-Prolog described in Section 3.1.”

“Note that this setting resulted in training only 0.248% of the 7 billion parameters for Llama2 and CodeLlama, and 0.188% of the 7 billion for Mistral.”

“Afterwards, advancements have been made in LLMs’ reasoning capacity via step-by-step meth-ods (Zhou et al., 2023; Zhu et al., 2023; Huang et al., 2022; Liang et al., 2023).”

“Therefore, one trajectory of efforts has been made to leverage reasoning structures like trees (Yao et al., 2023; Long, 2023) and graphs (Besta et al., 2023; Zhang et al., 2023).”

“Afterwards, advancements have been made in LLMs’ reasoning capacity via step-by-step meth-ods (Zhou et al., 2023; Zhu et al., 2023; Huang et al., 2022; Liang et al., 2023).”

“Neural Symbolic Reasoning Neural symbolic reasoning (Andreas et al., 2016; Neelakantan et al., 2017; Hudson and Manning, 2019; Gupta et al., 2020; Nye et al., 2021) aims to leverage both neural networks and symbolic reasoning to obtain better reasoning abilities and transparency.”

“Nevertheless, such LLMs fall short in addressing mathematical problems that involves arithmetic, commonsense, and symbolic reasoning – topics that may appear deceptively simple to humans (Rae et al., 2021).”

“Afterwards, advancements have been made in LLMs’ reasoning capacity via step-by-step meth-ods (Zhou et al., 2023; Zhu et al., 2023; Huang et al., 2022; Liang et al., 2023).”

“Another trajectory is to render the reasoning task based on external tools (Cobbe et al., 2021; Mishra et al., 2023; Gou et al., 2023; Gao et al., 2023; Shao et al., 2023; Chen et al., 2023), which is the one that we are following.”

“Prolog is a logic programming language, which was initially designed for artificial intelligence and computational linguistics (Clocksin and Mellish, 2003; Bratko, 2012; Covington, 2002).”

“LLMs are hence adopted to generate symbolic representations from natural language (Lyu et al., 2023; Pan et al., 2023; Yang et al., 2023), where deterministic symbolic solvers will process the query and symbolic representations generated by LLMs to conduct reasoning or proofs.”

“Neural Symbolic Reasoning Neural symbolic reasoning (Andreas et al., 2016; Neelakantan et al., 2017; Hudson and Manning, 2019; Gupta et al., 2020; Nye et al., 2021) aims to leverage both neural networks and symbolic reasoning to obtain better reasoning abilities and transparency.”

“Another trajectory is to render the reasoning task based on external tools (Cobbe et al., 2021; Mishra et al., 2023; Gou et al., 2023; Gao et al., 2023; Shao et al., 2023; Chen et al., 2023), which is the one that we are following.”

“Neural Symbolic Reasoning Neural symbolic reasoning (Andreas et al., 2016; Neelakantan et al., 2017; Hudson and Manning, 2019; Gupta et al., 2020; Nye et al., 2021) aims to leverage both neural networks and symbolic reasoning to obtain better reasoning abilities and transparency.”

“Neural Symbolic Reasoning Neural symbolic reasoning (Andreas et al., 2016; Neelakantan et al., 2017; Hudson and Manning, 2019; Gupta et al., 2020; Nye et al., 2021) aims to leverage both neural networks and symbolic reasoning to obtain better reasoning abilities and transparency.”

“LLMs are hence adopted to generate symbolic representations from natural language (Lyu et al., 2023; Pan et al., 2023; Yang et al., 2023), where deterministic symbolic solvers will process the query and symbolic representations generated by LLMs to conduct reasoning or proofs.”

“Afterwards, advancements have been made in LLMs’ reasoning capacity via step-by-step meth-ods (Zhou et al., 2023; Zhu et al., 2023; Huang et al., 2022; Liang et al., 2023).”

“5 beneits from ine-tuning on code and improved instruction-following as well as RLHF. GPT-3.”

“However, the scope of such ontologies is also limited, in particular when it comes to covering the entire breadth of less common situations.”

“1 For example, in a study on mathematics, researchers used LLM-generated Prolog code to solve math problems more reliably by avoiding cascaded calculation errors (Yang et al. 2024c).”

“However, LLMs are prone to unfaith-fulness, resulting in cascaded intermediate errors (Bao et al., 2024; Yang et al., 2024b).”

“They frequently hallucinate numbers, misapply logic, or embed biases—unacceptable in engineering contexts [10,11].”

“The main tasks in this field include arithmetic computation problems [45, 56, 83, 151], math word problems (MWPs) [37, 49, 63, 116], and automated theorem proving (ATP) [2, 152].”

“…interest in the integration of LLMs and ASP to create powerful AI systems capable of both processing complex natural language inputs and performing sophisticated logical inference [ Ishay et al. , 2023b; Rajasekharan et al. , 2023a; Wang et al. , 2024; Yang et al. , 2024; Kaur et al. , 2025].”

“Another encouraging direction of equipping LLMs with real reasoning capabilities is to use LLMs as generative code writers of logic programming languages like Prolog [7, 11].”

“Existing approaches rely on prompt engineering or create complex planning and reasoning systems (Yang, Chen, and Tam 2024; Stein et al. 2023; Vyas et al. 2024).”

“By design, LLMs generate statistical predictions rather than verifiable computations [12–14].”

“Unlike prior work (Yang et al., 2024; Chen and Tam, 2024) Program Generation.”

“Their modules, such as self-attention and positional encoding, are optimized for capturing textual semantics, not mathematical operations and symbolic manipulations (Yang et al. 2024 ).”

“…models to generate the symbolic knowledge, based on the task or query, to overcome the labor-intensive nature of hand-crafting rules for every single task and the time required in the automatic learning of symbolic knowledge from data (Ishay et al., 2023; Xu et al., 2024a; Yang et al., 2024).”

“LLMs [33,46] have been utilized in various tasks in multiple domains [25,29,31, 38,41,57].”

“Since LLMs process text-based information and do not perform actual calculations [46], the direct output can lead to errors in position and velocity values.”

“[15] fine-tune LLMs to generate Prolog for arithmetic word problems, while [16] use a Prolog engine to produce verified reasoning trajectories that an LLM imitates as structured chain-of-thought.”

“A promising strategy is pairing an LLM with a symbolic reasoning engine—such as a Prolog-style rule base, constraint solver, or medical ontology (Yang et al. 2024, Tan et al. 2024, Mellgren et al. 2025, Galitsky 2025).”

“Yang, Chen and Tam [31] used logic programs generated by LLMs to solve arithmetic problems.”

“Yang et al. [19] suggested ProPer in which Prolog code is generated using beam search on GSM-HARD, but the use of external interpreter limits scalability.”

“These developments have led to notable improvements in tasks such as arithmetic computation [19], algebraic manipulation [20], and theorem proving [21].”

“With the help of GPT-4 and few-shot prompting technique, we handcraft Prolog solutions of a subset of the problems in the training set, and use GPT-4 to generate Prolog solutions on the rest of training problems following (Yang et al., 2024).”

“• Arithmetic problems [36] focus on numerical calculations and the application of formulas, requiring precision in math operations such as addition, subtraction, multiplication, division, and exponentiation.”

“However, the scope of such ontologies is also limited, in particular when it comes to covering the entire breadth of less common situations.”

“More broadly, LLMs have become standard tools for translating natural language into ASP or other logic-based representations amenable to symbolic inference (Kaur et al. 2025; Rajasekharan et al. 2023; Z. Wang et al. 2024; Yang et al. 2024).”

“Yang et al. [17] proposed that large language models could produce Prolog code that is executed outside the model to perform arithmetic reasoning.”

“Some methods extract useful facts or write down rules to solve the problems [14].”

“Moreover, studies such as Yang et al. (2024) [8] explored the task of generating Prolog code from mathematical word problems.”

“For Prolog programming language, some previous work [4, 7, 32] leveraged it as an intermediate representation to improve the reasoning ability of LLMs.”

“• We show that grounding model reasoning in formal verification systems produces auditable symbolic traces and improves reliability—critical requirements for deploying language models in safety-critical applications”