-
ChatCite: LLM Agent with Human Workflow Guidance for Comparative Literature Summary논문 리뷰 2025. 5. 20. 14:33반응형
Background and Motivation
- Literature review is a key stage in the research process
- Enables understanding of the research problem and comparison of existing work
- Literature summarization is time-consuming and challenging
Limitations of Existing Approaches
- Previous LLM-based studies focused on the full pipeline: retrieval, screening, and summarization
- Summarization often relied on simple Chain-of-Thought techniques
- Lacked sufficient ability for comparative summarization
Proposed Method: ChatCite
- ChatCite is an LLM agent designed to mimic human literature summarization workflow
- Extracts key elements from relevant papers
- Generates summaries using a Reflective Incremental Mechanism
- Focuses solely on the summarization step as an independent task
Evaluation and Performance
- Introduces G-Score, an automatic LLM-based evaluation metric aligned with human assessment criteria
- ChatCite outperformed baseline models across multiple evaluation dimensions
- Generated summaries can be directly used to draft literature reviews
Source Code
- Source code is publicly available: https://github.com/miaisamelia/ChatCite
- Datasets: https://github.com/NudtRwG/NudtRwG-Dataset
Question
- ref가 많으면 context가 점점 길어지는 거 아닌지? 그럼 어떻게 처리할건지
- Reflective Evaluator (반성적 평가기) 평가 기준은?
반응형'논문 리뷰' 카테고리의 다른 글
GLaMM: Pixel Grounding Large Multimodal Model (0) 2025.05.21 LitLLM: A Toolkit for Scientific Literature Review (0) 2025.05.20 ALMA: Alignment with Minimal Annotation (0) 2025.04.10 Siren’s Song in the AI Ocean:A Survey on Hallucination in Large Language Models (0) 2024.07.02 Do Language Models Know When They’re Hallucinating References? (0) 2024.05.27