Portal:Sources

Notes for improvement

organize and structure to better differentiate between documentation, resources (e.g. test ranges and tools), and collaborative activities (e.g. conferences)

Standards

• 1012-2016 - IEEE Standard for System, Software, and Hardware Verification and Validation [1]

Books on verification

• Model checking book. E. Clarke
• Other model checking book by Peter Katoen
• Book on software testing/model-based testing
• Artificial Intelligence and Software Testing - Building systems you can trust (2022). Rex Black, James Davenport, Joanna Olszewska, Jeremias Rößler, Adam Leon Smith, Jonathon Wright. Edited by Adam Leon Smith link

Special issues on VAS

• Journals

Case studies

• Steps and method followed when verifying a system

Whitepapers on autonomous systems V&V from regulators

• How to apply V&V to autonomous systems
• How to interpret regulations for different countries
• What remains to be done for regulations

E.g.

• Reviews on regulations for autonomous systems in Australia

Review or survey papers on V&V

• Michael Fisher's survey paper
• Signe + David Tate's white paper

Existing projects

• Metrics [2] - finding ways to organize competitions that are reproducible, benchmarks to structure robotics competitions, comparing hardware and software together. Applications: healthcare, agriculture, etc.

Benchmark models

• Simulink model benchmark for falsification (3 models)

Testing fields & sites/labs

• Georgia Tech Robotarium
• Urban search and rescue at Texas A&M

Robotics & autonomous systems competitions

• DARPA
• Autonomous vehicles
• European Robotics League
• ROBOCUP
• AWS Deepracer (deep learning for training autonomous vehicles)
• Australia & New Zealand Search and Rescue
• SAUC-E - underwater robotics competition
• Robosub

Most recent relevant papers

• Formal verification of neural network controlled autonomous systems, X Sun, H Khedr, Y Shoukry - Proceedings HSCC 2019 link
• Towards a framework for certification of reliable autonomous systems, M Fisher, V Mascardi, KY Rozier, BH Schlinglof, M Winikoff, N Yorke-Smith - Autonomous Agents and Multi-Agent Systems 2021 link
• Verifying the safety of autonomous systems with neural network controllers, R Ivanov, TJ Carpenter, J Weimer, R Alur, GJ Pappas, I Lee - ACM Transactions on Embedded Computing Systems 2020 link
• A Review of Verification and Validation for Space Autonomous Systems, RC Cardoso, G Kourtis, LA Dennis, C Dixon, M Farrell, M Fisher, M Webster - Current Robotics Reports 2021 link
• Formal verification of colreg-based navigation of maritime autonomous systems, F Shokri-Manninen, J Vain, M Waldén - Proceedings of SEFM 2020 link
• Reaching Out Towards Fully Verified Autonomous Systems, S Sankaranarayanan, S Dutta, S Mover - Proceedings of RP 2019 link
• Compositional verification for autonomous systems with deep learning components, CS Păsăreanu, D Gopinath, H Yu - Safe, Autonomous and Intelligent Vehicles 2019 link
• Recent trends in formal validation and verification of autonomous robots software, F Ingrand - IEEE International Conference on Robotic Computing, 2019 link
• Safety Verification of Autonomous Systems: A Multi-Fidelity Reinforcement Learning Approach, JJ Beard, A Baheri - arXiv preprint 2022 link
• On-line testing for autonomous systems driven by RISC-V processor design verification, A Ruospo, R Cantoro, E Sanchez, PD Schiavone, A Garofalo, L Benini - IEEE International Symposium on Defect and Fault Tolerance in VLSI and Nanotechnology Systems 2019 link