Planning Domain Generation via Feedback Space Search: Collaborative Exploration of Large Language Models and Symbolic Intelligence

This article explores how to use large language models (LLMs) combined with symbolic feedback mechanisms to generate high-quality planning domains through heuristic search in the model space, demonstrating the potential of collaboration between LLMs and symbolic verification tools in the field of automated planning. Planning domain generation is a key prerequisite for automated planning, but generating high-quality planning domains from natural language poses challenges. Relying solely on LLMs has limitations, and the feedback-driven framework proposed in this article provides an innovative solution to this problem.

The core prerequisite for automated planning is planning domain generation (defining states, actions, constraints), but automatically generating high-quality planning domains from natural language is an open problem. Although LLMs have language understanding and generation capabilities, using them alone has issues such as insufficient logical consistency, inability to handle natural language ambiguity, and lack of formal verification capabilities, leading to potential semantic defects in the generated planning domains.

The solution is to combine LLMs with symbolic feedback to optimize planning domains through heuristic search. In the framework, LLMs act as generators, adjusting outputs with the help of external symbolic feedback (milestone feedback, VAL validator feedback). Milestone feedback can quickly identify structural issues; the VAL validator provides precise feedback on syntax, semantic consistency, and solvability. The search strategy uses iterative optimization, evaluating candidate domains with heuristic functions such as syntax complexity and semantic consistency.

Experiments show that the feedback-driven method significantly improves the quality of planning domains, with improvements in planning success rate, efficiency, and generalization ability compared to baselines. This method exhibits good scalability in complex planning domains, and the structured information from feedback becomes more important as the problem scale increases.

Relying solely on LLMs makes it difficult to generate ideal planning domains. The feedback-driven framework in this article combines the generation capabilities of LLMs with symbolic verification feedback, effectively improving generation quality and providing implications for the development of neuro-symbolic AI.

This method can be extended to scenarios such as robot task planning, business process automation, and game AI design; future research can explore further refinement and diversification of feedback mechanisms.