MLTL benchmark generation via formula progression

  • Jianwen Li*
  • , Kristin Y. Rozier
  • *Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

6 Scopus citations

Abstract

Safe cyber-physical system operation requires runtime verification (RV), yet the burgeoning collection of RV technologies remain comparatively untested due to a dearth of benchmarks with oracles enabling objectively evaluating their performance. Mission-time LTL (MLTL) adds integer temporal bounds to LTL to intuitively describe missions of such systems. An MLTL benchmark for runtime verification is a 3-tuple consisting of (1) an MLTL specification ϕ; (2) a set of finite input streams representing propositional system variables (call this computation π) over the alphabet of ϕ; (3) an oracle stream of 〈v, t〉 pairs where verdict v is the result (true or false) for time t of evaluating whether πt |= ϕ (computation π at time t satisfies formula ϕ). We introduce an algorithm for reliably generating MLTL benchmarks via formula progression. We prove its correctness, demonstrate it executes efficiently, and show how to use it to generate a variety of useful patterns for the evaluation and comparative analysis of RV tools.

Original languageEnglish
Title of host publicationRuntime Verification- 18th International Conference, RV 2018, Proceedings
EditorsChristian Colombo, Martin Leucker
PublisherSpringer Verlag
Pages426-433
Number of pages8
ISBN (Print)9783030037680
DOIs
StatePublished - 2019
Externally publishedYes
Event18th International Conference on Runtime Verification, RV 2018 - Limassol, Cyprus
Duration: 10 Nov 201813 Nov 2018

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume11237
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference18th International Conference on Runtime Verification, RV 2018
Country/TerritoryCyprus
CityLimassol
Period10/11/1813/11/18

Fingerprint

Dive into the research topics of 'MLTL benchmark generation via formula progression'. Together they form a unique fingerprint.

Cite this