WSESE2024 is an ICSE2024 Workshop.

With the steep increase in the number of empirical studies and the advent of secondary studies that aggregate or perform meta-analysis on those studies, one main concern that arises is the quality of the primary studies (e.g., a single experiment). While researchers have raised concerns about different types of quality issues for many years,  many of these issues remain, at least partially due to the complexity of empirical studies in our field—whether human subjects are involved or not. Specifically, problems related to appropriate design and the correct usage of statistical tests are crucial for the trustworthiness of the results. Consequently, as a community, we need to better understand these issues and how to mitigate, if not eliminate them. The workshop’s aim is to increase awareness of the importance of the quality and appropriateness of the methods applied during the different stages of software engineering empirical studies to yield reliable results and to disseminate this knowledge to the broader SE community.

Submission Guidelines

Papers must describe original work not submitted or presented at other forums (the studies could be). Accepted papers will be published in ICSE workshop proceedings.

Technical papers (6-8 pages): formally describe studies, explain how they were designed and executed to overcome challenges, highlight concrete results, and describe any advances to the state-of-the-art.

Experience reports (4-6 pages) describe the experience in conducting studies and lessons learned that address methodological issues.

Vision / Position papers (2-4 pages) describe new directions in conducting empirical studies including convincing arguments supported by clear rationale.

List of Topics

• Topics of interest include, but are not restricted to:

• Issues with the motivation and definition of appropriate research questions.
• Issues with the operationalization, e.g., missing standard metrics.
• Issues with the systematic identification of threats to validity and how to address them
• Issues selecting an appropriate study design and the consequences of that selection,
• Issues with drawing appropriate conclusions from the findings and generalizing them
• Issues with aggregating results from individual studies
• Issues with reproduction, replication, or families of studies
• Issues with quantitative, qualitative approaches and combined approaches
• Issues with understanding failures and successes: lessons learned

Committees

Program Committee

• Currently under development

Organizing committee

• Sira Vegas, UPM, Spain
• Andreas Jedlitschka, Fraunhofer IESE, Germany
• Jeffrey C. Carver, UA, USA

Publication

WSESE2024 proceedings will be published in the ICSE Workshop Proceedings. Papers must be formatted according to ICSE 2024 guidelines (https://www.acm.org/publications/proceedings-template & the respective section here: submission process: https://conf.researchr.org/track/icse-2024/icse-2024-research-track).

Venue

https://conf.researchr.org/venue/icse-2024/icse-2024-venue

The conference will be held in Lisboa, Portugal. The concrete dates are not yet known.

Contact

All questions about submissions should be emailed to svegas at fi dot upm dot es