跳到主要导航 跳到搜索 跳到主要内容

Charting the Uncharted: Building and Analyzing a Multifaceted Chart Question Answering Dataset for Complex Logical Reasoning Process

  • East China Normal University
  • Fudan University

科研成果: 书/报告/会议事项章节 › 会议稿件 › 同行评审

摘要

Charts, as a vital part of visualization language, are omnipresent in real-world. Understanding charts is crucial for unveiling implicit data insights. The evolution of large-scale models has marked significant milestones in chart comprehension. However, comprehending multiple charts jointly remains challenging due to the complexities of multi-chart reasoning and the intricate dataset construction involving multiple charts. In this study, we introduce DGE, a sophisticated logic-based multi-chart question-answering dataset generation engine that, with only simple data input, generates diverse joint charts and questions with complex logic. It employs logical templates to guide question generation, ensuring excellent scalability. Leveraging the DGE engine, we propose MCQA, the inaugural large-scale dataset for joint reasoning question-answering involving multiple charts, which includes 22,860 chart pairs and 100,331 complex questions, each annotated with an inference process. Finally, we evaluate several baselines on the MCQA dataset, establishing a research foundation for the chart question answering community. The MCQA dataset is available at github (https://github.com/ICALK-CVU/MCQA).

源语言英语
主期刊名Pattern Recognition and Computer Vision - 7th Chinese Conference, PRCV 2024, Proceedings
编辑Zhouchen Lin, Hongbin Zha, Ming-Ming Cheng, Ran He, Cheng-Lin Liu, Kurban Ubul, Wushouer Silamu, Jie Zhou
出版商Springer Science and Business Media Deutschland GmbH
页18-33
页数16
ISBN(印刷版)9789819786190
DOI
出版状态已出版 - 2025
活动7th Chinese Conference on Pattern Recognition and Computer Vision, PRCV 2024 - Urumqi, 中国
期限: 18 10月 2024 → 20 10月 2024

丛书

姓名Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
卷15035 LNCS
ISSN(印刷版)0302-9743
ISSN(电子版)1611-3349

会议

会议7th Chinese Conference on Pattern Recognition and Computer Vision, PRCV 2024
国家/地区中国
市Urumqi
时期18/10/24 → 20/10/24

学术指纹

探究 'Charting the Uncharted: Building and Analyzing a Multifaceted Chart Question Answering Dataset for Complex Logical Reasoning Process' 的科研主题。它们共同构成独一无二的学术指纹。

引用此