INTUITESTBEDS 2023

co-located with ICST 2023 in Dublin, Ireland

About

This is the 6th edition of INTUITESTBEDS (International Workshop on User Interface Test Automation and Testing Techniques for Event Based Software). INTUITESTBEDS is a merge of two workshops with very similar goals and topics, INTUITEST – International Workshop on User Interface Test Automation (organized 3 times before the merge), and TESTBEDS – International Workshop on TESting Techniques for event BasED Software (organized 7 times before the merge).

The workshop aims to bring together the researchers, practitioners and tool developers working on topics related to:

automated testing of applications through the user interfaces, including but not limited to graphical user interfaces, user interfaces of mobile devices and applications, and user interfaces of web applications, and
testing of other types of event-driven software, such as network protocols, embedded software, IoT applications and devices, web services and device drivers.

News

This year the CoAST (Context aware and Adaptive Software systems Testing) workshop will be co-located with INTUITESTBEDS.

Program April 20th 2023

(CET Time)	INTUITESTBEDS WORKSHOP
09:00 – 09:15	Welcome and Opening Message (Riccardo Coppola, Michel Nass, Andreas Bauer)
09:15 – 10:00	Keynote: Wishnu Prasetya Ready Agent One: Automatically Play Testing Computer Games
10:00 – 10:30	Paper presentation: Matej Klima, Miroslav Bures, Michaela Kubisova and Pavel Herout. Open Benchmark Testbed to Evaluate Effectiveness of Path-based Tests
10:30 – 11:00	Coffee break
11:00 – 11:30	Paper presentation: Tommaso Fulcini, Riccardo Coppola, Marco Torchiano and Luca Ardito. An analysis of widget layout attributes to support Android GUI-based testing
11:30 – 12:00	Paper presentation: Humaid Mollah and Petra van den Bos. From User Stories to End-to-end Web Testing
12:00 – 12:30	Paper presentation: Alessio Gambi, Hemant Gouni, Daniel Berreiter, Vsevolod Tymofyeyev and Mattia Fazzini. Action-Based Test Carving for Android Apps
12:30 – 14:00	Lunch break
14:00 – 14:30	Paper presentation: Rohini Bisht, Selomie Kindu Ejigu, Gregory Gay and Predrag Filipovikj. Identifying Redundancies and Gaps Across Testing Levels During Verification of Automotive Software
14:30 – 15:00	Paper presentation (CoAST): Pierre Martou, Benoît Duhoux, Kim Mens and Axel Legay Beyond Combinatorial Interaction Testing: On the need for transition testing in dynamically adaptive context-aware systems
15:00 – 15:30	Paper presentation (CoAST): Muralidhar Yalla, Mahesh Venkataraman and Mallika Fernandes Deep Industry Use Cases on Context-Aware Adaptive Mobile Systems Experience Testing
15:30 – 16:00	Closing
16:00 – 17:30	Focus Group on Challenges for GUI and Context Aware Testing

Keynote

Wishnu Prasetya about Ready Agent One: Automatically Play Testing Computer Games

Abstract:

In this talk I will give an overview of the results achieved by a recent collaborative project called IV4XR, which stands for Intelligent Verification and Validation of Extended Reality (XR) Systems. Much of the research in the project has focused on automated game testing which is deemed as a crucial stepping stone towards verification and validation of XR systems in general. Computer games, or XR systems in general, take a lot of effort to build and the market is very competitive. While Quality Assurance is understood to be important, the Industry lacks automated testing technology and consequently have to rely on time consuming and expensive manual play testing. Moreover, for such a system user experience is often an important aspect, for which there exists no clear idea how its assessment can be automated. The problem is not just the lack of tools. It is also fundamental.

Computer game is a very challenging domain for software testing due to its very fine grained interaction space, limited observability, non-determinism, and even hostile elements that we do not usually have when testing traditional applications. All these make them untractable to be directly targeted by existing automated testing algorithms such as search based tetsing (SBT), model based testing (MBT), or machine learning (ML) based testing. In this talk I will show our novel agent- based approach that underlies IV4XR, with tactical and goal-based programming. This allows more resource efficient reasoning-based test algorithms to be implemented rather than relying on brute force approaches. We will show how the approach can be combined with a computational model of emotion to also cover user experience testing. We will also show how such an agent-based approach can provide a middle layer that enables other automation techniques such as SBT and ML to much more efficiently target computer games. At the end we will discuss how to proceed to cover other types of XR systems.

Call for papers

We solicit novel papers related to the following topics (not strictly limited) in the context of testing User Interface and other Event Based Systems:

modeling and model inference,
test case generation and execution,
test oracles,
coverage, metrics and evaluation,
data analysis and reporting,
abstraction and re-usability,
interoperability and cross-platform testing,
prioritization and optimization,
tooling and industrial experiences.

Papers can be of one of the following four types:

Full research contributions will be 8 pages (including references) in two-column IEEE conference publication format.
Position papers describing an important direction for our community will be a maximum of 4 pages (including references) in two-column IEEE conference publication format.
Testing tool demos will be 4 pages length (including references) in two-column IEEE conference publication format, for researchers who want to present tools relevant to the workshop.
Industrial presentations will require the submission of a 2 page overview and 4 example slides.

Each paper in the first three categories (full, position and demo) will be reviewed by at least three program committee members. Papers should be submitted as PDF files in two-column IEEE conference publication format. Templates for LaTeX and Microsoft Word are available here. Please use the letter, format template and conference option.

Accepted papers will be published as part of ICST workshops proceedings, through the IEEE digital library.

Papers should be submitted through EasyChair.

Important dates

2023-02-03 – Submission deadline (extended)
2023-02-24 – Author Notification
2023-03-03 – Camera Ready
2023-04-20 – Workshop Date

Venue

INTUITESTBEDS will be organized as a workshop of ICST 2023 (IEEE International Conference on Software Testing, Verification and Validation) in Dublin, Ireland.