Traditional RAG systems are effective at answering individual questions but have limited utility for organizations requiring more comprehensive insights and decision-making content. This Structured Report Generation blueprint with LangGraph addresses this need by using NVIDIA NIM microservices to create structured, decision-oriented reports based on user-supplied topics and report structure.
Unlike other Structured Report Generation agents, this blueprint shows how NVIDIA NIM microservices with LangChain improves scalability of data sources, accuracy and throughput. Developers can use this flexible reference blueprint to update an existing LangChain solution with NVIDIA AI, create a new structured report generation agent or apply it to a different use case that includes LangChain and NVIDIA NIM.
Architecture Diagram
Key Features
Within this blueprint, LangChain's LangGraph is used to build a Report Planning Agent that takes in user defined topics and structure, then plans the topics of the section indicated in the structure. The Research Agent uses Tavily to do web search on the given topics and the Report Writing Agent uses this information to write the sections and synthesize the final report.
A two-phase approach is used for planning and research:
Phase 1 - Planning
- Analyzes user inputs
- Maps out report sections
Phase 2 - Research
- Conducts parallel web research via Tavily API
- Processes relevant data for each section
The report is then written in strategic sequence:
- Write research-based sections in parallel
- Write introductions, conclusions, and connect each of the sections
All sections maintain awareness of each other's content for consistency.
Minimum System Requirements
The solution leverages NVIDIA's cloud-based API Catalog endpoints, eliminating the need for local GPU hardware. All model inference is performed on NVIDIA's cloud infrastructure.
Software used in this blueprint
NIM microservices
3rd-Party Technologies
Ethical Considerations
NVIDIA believes Trustworthy AI is a shared responsibility, and we have established policies and practices to enable development for a wide array of AI applications. When downloaded or used in accordance with our terms of service, developers should work with their supporting model team to ensure the models meet requirements for the relevant industry and use case and address unforeseen product misuse. For more detailed information on ethical considerations for the models, please see the Model Card++ Explainability, Bias, Safety & Security, and Privacy Subcards. Please report security vulnerabilities or NVIDIA AI concerns here.
License
Use of the models in this blueprint is governed by the NVIDIA AI Foundation Models Community License.
Terms of Use
GOVERNING TERMS: The blueprint is governed by the NVIDIA Agreements | Enterprise Software | NVIDIA Software License Agreement and NVIDIA Agreements | Enterprise Software | Product Specific Terms for AI Product.
Meta Llama 3.3 70B
GOVERNING TERMS: The NIM container is governed by the NVIDIA Software License Agreement and the Product Specific Terms for AI Products;
Use of this model is governed by the NVIDIA AI Foundation Models Community License Agreement. ADDITIONAL INFORMATION: Llama 3.3 Community License Agreement, Built with Llama.
