Universität Bremen  
  Universität Bremen FB3 TZI BISS  
  AG BS > Deutsch
English
 

Embedded Systems Testing Benchmarks Site
 

Welcome to the
Embedded Systems Testing Benchmarks Site

This site has been created on 2011-05-23 and will be continuously updated and maintained by the research team AGBS - operating systems and distributed systems at the University of Bremen, Department of Mathematics and Computer Science FB3.

Objectives

The Embedded Systems Testing Benchmarks Site will provide benchmarks for automated model-based testing (MBT) tools. A first suggestion how to structure these benchmarks has been accepted for publication in the Proceedings of the ICTSS 2011; an extended version of this article may be downloaded here PDF File.
    [1] Jan Peleska, Artur Honisch, Florian Lapschies, Helge Löding, Hermann Schmid, Peer Smuda, Elena Vorobev, and Cornelia Zahlten: A Real-World Benchmark Model for Testing Concurrent Real-Time Systems in the Automotive Domain.
Suggestions from other researchers for extending or improving the benchmark criteria are welcome; to this end, please contact Jan Peleska, jp_at_informatik.uni-bremen.de

Basically, the components of a MBT benchmark are

  • a formal model from where automated test cases and test data should be derived,
  • a test suite that has been generated by means of a reference tool and
  • benchmark evaluation data associated with the tool and the test suite.
As suggested by the authors in [1; Section 4], benchmarks for model-based testing should be structured into two sub-classes.
  • Test strength benchmarks investigate the error detection capabilities of concrete test cases and test data generated by MBT tools.
  • Test generation benchmarks input formal specification of test cases (symbolic test cases according to the terminology used in [1]) and measure the time needed to generate concrete test data.
The first benchmark is provided by the researchers listed above; it also serves as an example of how other contributions should be structured.

Benchmarks

  • Turn Indicator Model Rev. 1.4 (last update: 2011-08-03)
    This model is currently used by Daimler for system tests of functionality related to the turn indicator lights. An introductory overview over the model is given in [1] above; more detailed explanations are contained in the model itself, in the form of notes.
 
   
Author: jp 		 
  AG BS 
Last updated: August 3, 2011   Impressum