ProphetAgent: Automatically Synthesizing GUI Tests from Test Cases in Natural Language for Mobile Apps

Qichao Kong, Zhengwei Lv, Yiheng Xiong, Jingling Sun, Ting Su, Dingchun Wang, Letao Li, Xu Yang, Gang Huo

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

GUI tests is crucial for ensuring software quality and user satisfaction of mobile apps. In practice, companies often maintain extensive test cases written in natural language. Testers need to convert these test cases into executable scripts for regression and compatibility testing. Requirement changes or version updates often necessitate the addition and modification to these test cases. Thus, when faced with large volumes of test cases and regular updates, this process becomes costly, which is a common challenge across the industry. To address this issue, this paper proposes ProphetAgent that can automatically synthesize executable GUI tests from the test cases written in natural language. ProphetAgent first constructs a Clustered UI Transition Graph (CUTG) enriched with semantic information, then leverages large language models to generate the executable test case based on CUTG and test cases written in natural language. Experiment results show that ProphetAgent achieved a 78.1% success rate across 120 test cases in Douyin, Doubao, and six open-source apps, surpassing existing automated approaches (21.4% for AppAgent and 32.5% for AutoDroid). Additionally, statistical data from ByteDance’s testing platform show that ProphetAgent increased testers’ efficiency in synthesizing UI tests by 260%.

Original languageEnglish
Title of host publicationFSE Companion 2025 - Companion Proceedings of the 33rd ACM International Conference on the Foundations of Software Engineering
EditorsJingyue Li
PublisherAssociation for Computing Machinery
Pages174-179
Number of pages6
ISBN (Electronic)9798400712760
DOIs
StatePublished - 28 Jul 2025
Event33rd ACM International Conference on the Foundations of Software Engineering, FSE Companion 2025 - Trondheim, Norway
Duration: 23 Jun 202527 Jun 2025

Publication series

NameProceedings of the ACM SIGSOFT Symposium on the Foundations of Software Engineering
ISSN (Print)1539-7521

Conference

Conference33rd ACM International Conference on the Foundations of Software Engineering, FSE Companion 2025
Country/TerritoryNorway
CityTrondheim
Period23/06/2527/06/25

Keywords

  • GUI Testing
  • Large Language Model Agents
  • Test Cases

Fingerprint

Dive into the research topics of 'ProphetAgent: Automatically Synthesizing GUI Tests from Test Cases in Natural Language for Mobile Apps'. Together they form a unique fingerprint.

Cite this