-------- Weitergeleitete Nachricht -------- Betreff: CPS-IoTBench 2023: Call for Papers and for Reproducibility Studies Datum: Thu, 15 Dec 2022 12:44:14 +0000 Von: Michael Baddeley Michael.Baddeley@tii.ae

------------------------------------------------------------------------------ The 6th Workshop on Benchmarking Cyber-Physical Systems and Internet of Things     (CPS-IoTBench2023) --https://www.iotbench.ethz.ch/cps-iotbench-2023/ https://www.iotbench.ethz.ch/cps-iotbench-2023/           Co-located withCPS-IoT Week -- May 9, 2023 ------------------------------------------------------------------------------

Over the last decade, research on Cyber-Physical Systems (CPS) and Internet of Things (IoT) has led to smart systems at different scales and environments, from smart homes to smart cities and smart factories. Despite many successes, it is difficult to measure and compare the utility of these results due to a lack of standard evaluation criteria and methodologies. This problem inhibits evaluation against the state-of-the-art, the comparability of different integrated designs (e.g., control and networking), and the applicability of tested scenarios to present and future real-world cyber-physical applications and deployments. This state of affairs is alarming, as it significantly hinders further progress in CPS and IoT systems research.

The Workshop on Benchmarking Cyber-Physical Systems and Internet of Things (CPS-IoTBench) brings together researchers from the different sub-communities of CPS-IoT Week to engage in a lively debate on all facets of rigorously evaluating and comparing experimental results on cyber-physical networks and systems.

*Following the success of last year, we once again will have a special session on the benchmarking and reproducibility of AI and machine learning techniques in CPS and IoT systems.*

For the workshop's 6th edition, we invite researchers and practitioners from academia and industry to submit papers (up to 6 pages, double-column) focusing on one of the following topics:

- Identify fundamental challenges and open questions in CPS and IoT systems through rigorous benchmarking and evaluation. - Expose key issues (or support current practice!) on the application and reproducibility of AI and machine learning techniques in CPS and IoT systems. - Report on success stories or failures with using standard evaluation criteria. - Present example benchmark systems and approaches from any of the relevant communities (embedded systems, networking, low-power wireless, control, robotics, machine learning, etc.). - Propose new research directions, methodologies, or tools to increase the level of reproducibility and comparability of evaluation results. - Report on examples of best practices in different CPS-IoT sub-communities towards achieving the repeatability of results. - Present models to capture and compare the properties of algorithms and systems.

Well-reasoned arguments or preliminary evaluations are sufficient to support a paper’s claims.

Unique to this workshop, we also seek reports describing the reproduction of experimental results from published papers within any of the relevant communities (embedded systems, networking, AI and machine learning, low-power wireless, control, robotics, etc.). Examples of this include:

- Reproducibility studies of a given scientific paper or article. - Evaluations carried out by researchers or industry practitioners looking to validate another piece of work before comparing their own to it. - Reproducibility studies of a given scientific work for which some key aspect(s) in the experimental setup was unspecified, showing the different spectrum of solutions as a function of such aspect(s).

Such reports can be submitted using up to 6 pages, double-column format and should carefully describe the experimental setup as well as how the authors made sure to carefully reproduce the same conditions as in the original study. Regardless of the study results, the tone of the report will be constructive and not offensive with respect to the original authors. Prospect authors are invited to contact the original authors of the examined study and let them provide a short rebuttal paragraph that can be included in the final section within the report.

**​*** Submission instructions *** https://www.iotbench.ethz.ch/cps-iotbench-2023/call-for-papers/ Submission instructions will be available at https://www.iotbench.ethz.ch/cps-iotbench-2023/call-for-papers/ https://www.iotbench.ethz.ch/cps-iotbench-2023/call-for-papers/. Acceptedpaperswill be published in the ACM Digital Library as part of theCPS-IoT Week2023proceedings. Authors of acceptedpapersare expected to present their work in a plenary session as part of the main workshop program.

*** Important dates *** Paper submission: February 1, 2023 Notification of acceptance: March 1, 2023 Camera-ready: March 15, 2023 Workshop day: May 9, 2023

*** Workshop Organizers *** - Michael Baddeley (Technology Innovation Institute, UAE) - Michael Breza (Imperial College London, United Kingdom) - Daniel Friesel (Osnabrück University, Germany) - Romain Jacob (ETH Zurich, Switzerland) - Ramona Marfievici (Digital Catapult, United Kingdom)

----------------------------------------------------------------------------- Our sincere apologies if you receive multiple copies of thecall -----------------------------------------------------------------------------

*Dr. Michael Baddeley *Lead Researcher

POBox: 9639* *Masdar City, Abu Dhabi, UAE*

*M: +971 58 946 46 99

michael.baddeley@tii.ae mailto:michael.baddeley@tii.aemailto:oksana.sandulenko@tii.ae

* **tii.ae* https://tii.ae/