DocFormFlow: An LLM-Powered Intelligent Document Formatting Workflow System

This article introduces DocFormFlow, a workflow method that decouples document formatting tasks into two stages: "Target Localization" and "Modification Execution". It also releases the accompanying DocFormBench evaluation benchmark, which has been validated on multiple large language models (LLMs) and multimodal models to improve accuracy and reduce token consumption. The original paper is from arXiv, published on June 1, 2026, link: http://arxiv.org/abs/2606.01936v1.

With the rapid advancement of large language model (LLM) capabilities, automated document processing has become a promising application area. However, real-world scenarios require format adjustments based on the semantic content of documents (e.g., bolding breach clauses in legal contracts, adjusting reference number styles in academic papers). The core challenge is that "the model must first understand where changes are needed before deciding how to make them". Content-aware formatting has long lacked a systematic evaluation benchmark, making it difficult to conduct horizontal comparisons and sustained progress in related research.

To fill this gap, the research team launched DocFormBench—a dataset designed for content-aware formatting scenarios. It covers real-world needs such as structural hierarchy adjustments (title font size/indentation), semantic highlighting (keyword bolding/italics), list formatting (converting plain text to ordered/unordered lists), and table alignment (cell alignment). In addition to accuracy, efficiency metrics (token consumption) are introduced to reflect practical deployment cost considerations.

To address the token waste problem caused by repeated document reading in existing methods, DocFormFlow is proposed, which decouples formatting tasks into two stages:

1. Target Localization (What to Format): Read through the document to identify areas that need formatting, output structured localization information (position, type, expected effect), and avoid repeated reading of the original text in subsequent steps;
2. Modification Execution (How to Format): Efficiently perform format adjustments based on localization information. Advantages: Modularization (independent optimization and upgrading), interpretability (intermediate outputs facilitate debugging), and efficiency improvement (reducing redundant reading).

Evaluations on GPT-4, Claude series, and multimodal models show that DocFormFlow has significant improvements over baselines:

Model Type	Accuracy Improvement	Token Consumption Reduction
GPT-4	+12%	-35%
Claude-3	+15%	-28%
Multimodal Model	+18%	-42%
Accurate target localization is the primary factor affecting formatting performance; correctly identifying target boundaries can significantly improve the success rate of subsequent modifications.

DocFormFlow and DocFormBench provide new tools and evaluation standards for the field of intelligent document processing. Potential application scenarios:

• Enterprise document automation: Batch processing of contracts, reports, bids, etc.;
• Academic publishing assistance: Automatically adjust paper formats to meet journal requirements;
• Legal document processing: Apply specific format specifications based on clause types;
• Government document systems: Ensure format standardization and consistency. This work provides a quantifiable evaluation framework for "content-aware" capabilities, promoting the emergence of related research.

Core Insight: In complex document processing, explicit task decomposition is superior to end-to-end black-box solutions; separating "understanding" and "execution" improves performance, interpretability, and controllability. Future Research Directions:

1. Finer-grained localization (from paragraph level to sentence/word level);
2. Cross-document format migration (learning format rules from one document to apply to another);
3. Real-time collaborative editing (maintaining format consistency during multi-user editing). Developers can refer to the modular architecture paradigm to balance the convenience of end-to-end solutions and the long-term benefits of modularization.