사업성과 BK21 FOUR 산업혁신 애널리틱스 교육연구단

학술대회발표

2025 Extracting Policy Intelligence from Public Data Sources : LLMs as Policy Assistants

페이지 정보

작성자 관리자 작성일 26-07-15 11:02

본문

저자
Giyun Kim, Seoul National University, Seoul, Korea, Republic of, Sanghyun Park, Dongyoon Shin, Jungeun Kim, Sungjoo Lee
학술대회명
2025 INFORMS Annual Meeting
개최지
미국
발표형식
구두
년도
2025

Developing domain-specific frameworks for large language model (LLM) applications has been widely studied to enhance research efficiency across various fields. As policy planning requires detailed analysis of reliable sources, LLM applications have significant potential to enhance analytical efficiency. Therefore, we propose a novel LLM application framework designed for policy planning that reduces the time and resources required for analyzing global policy trends and their comprehensive content, including goals, implementation processes, outcomes, and causal relationships. First, a systematic collection and evaluation of datasets to identify reliable sources of global policy information that could serve as valuable references for policymakers was conducted. This process involved indicator development for data quality assessment in terms of reliability, relevance, completeness, and timeliness. We then categorized types of policy planning based on an in-depth analysis of previous policy documents, establishing key content requirements for each category. Subsequently, the fine-tuning and retrieval-augmented generation (RAG) approaches for the datasets were suggested and validated to efficiently extract required information from the collected datasets. We expect the framework to help policymakers effectively analyze global policy landscapes, identify policy implementation strategies along with their results, and derive valuable insights for policy planning across diverse contexts and challenges.