Portal:Sources

From Verification Body of Knowledge
Jump to navigation Jump to search
Notes for improvement
organize and structure to better differentiate between documentation, resources (e.g. test ranges and tools), and collaborative activities (e.g. conferences)

Standards

  • 1012-2016 - IEEE Standard for System, Software, and Hardware Verification and Validation [1]
  • P2817 - IEEE Guide for Verification of Autonomous Systems [2]

Best practices

Books on verification

  • Model checking, E. Clarke et al [3]
  • Principles of model checking, P. Katoen et al [4]
  • Book on software testing/model-based testing
  • Artificial Intelligence and Software Testing - Building systems you can trust (2022). Rex Black, James Davenport, Joanna Olszewska, Jeremias Rößler, Adam Leon Smith, Jonathon Wright. Edited by Adam Leon Smith link
  • 25 Years of Model Checking, O. Grumberg et al [5]

Special issues on VAS

  • Journals

Case studies

  • Steps and method followed when verifying a system


Whitepapers on autonomous systems V&V from regulators

  • How to apply V&V to autonomous systems
  • How to interpret regulations for different countries
  • What remains to be done for regulations

E.g.

  • Reviews on regulations for autonomous systems in Australia


Review or survey papers on V&V

  • Michael Fisher's survey paper
  • Signe + David Tate's white paper

Existing projects

  • Metrics [6] - finding ways to organize competitions that are reproducible, benchmarks to structure robotics competitions, comparing hardware and software together. Applications: healthcare, agriculture, etc.

Benchmark models

  • Simulink model benchmark for falsification (3 models)


Testing fields & sites/labs

  • Georgia Tech Robotarium
  • Urban search and rescue at Texas A&M

Robotics & autonomous systems competitions

  • DARPA
  • Autonomous vehicles
  • European Robotics League
  • ROBOCUP
  • AWS Deepracer (deep learning for training autonomous vehicles)
  • Australia & New Zealand Search and Rescue
  • SAUC-E - underwater robotics competition
  • Robosub

Conferences

Patents

Most recent relevant papers

  • Formal verification of neural network controlled autonomous systems, X Sun, H Khedr, Y Shoukry - Proceedings HSCC 2019 link
  • Towards a framework for certification of reliable autonomous systems, M Fisher, V Mascardi, KY Rozier, BH Schlinglof, M Winikoff, N Yorke-Smith - Autonomous Agents and Multi-Agent Systems 2021 link
  • Verifying the safety of autonomous systems with neural network controllers, R Ivanov, TJ Carpenter, J Weimer, R Alur, GJ Pappas, I Lee - ACM Transactions on Embedded Computing Systems 2020 link
  • A Review of Verification and Validation for Space Autonomous Systems, RC Cardoso, G Kourtis, LA Dennis, C Dixon, M Farrell, M Fisher, M Webster - Current Robotics Reports 2021 link
  • Formal verification of colreg-based navigation of maritime autonomous systems, F Shokri-Manninen, J Vain, M Waldén - Proceedings of SEFM 2020 link
  • Compositional verification for autonomous systems with deep learning components, CS Păsăreanu, D Gopinath, H Yu - Safe, Autonomous and Intelligent Vehicles 2019 link
  • Recent trends in formal validation and verification of autonomous robots software, F Ingrand - IEEE International Conference on Robotic Computing, 2019 link
  • On-line testing for autonomous systems driven by RISC-V processor design verification, A Ruospo, R Cantoro, E Sanchez, PD Schiavone, A Garofalo, L Benini - IEEE International Symposium on Defect and Fault Tolerance in VLSI and Nanotechnology Systems 2019 link
  • Testing, Validation, and Verification of Robotic and Autonomous Systems: A Systematic Review, H Araujo, MR Mousavi, M Varshosaz - ACM Transactions on Software Engineering and Methodology 2022 link
  • Verifiable self-aware agent-based autonomous systems, LA Dennis, M Fisher - Proceedings of the IEEE 2020 link
  • Reliability and safety of autonomous systems based on semantic modelling for self-certification, O Zaki, M Dunnigan, V Robu, D Flynn - Robotics 2021 link
  • Autonomics: In search of a foundation for next-generation autonomous systems, D Harel, A Marron, J Sifakis - Proceedings of the National Academy of Sciences 2020 link
  • DIAT: Data Integrity Attestation for Resilient Collaboration of Autonomous Systems, T Abera, R Bahmani, F Brasser, A Ibrahim, AR Sadeghi, M Schunter - NDSS 2019 link
  • Neural bridge sampling for evaluating safety-critical autonomous systems, A Sinha, M O'Kelly, R Tedrake, JC Duchi - NeurIPS 2020 link
  • Security in autonomous systems, S Katzenbeisser, I Polian, F Regazzoni, M Stottinger - IEEE European Test Symposium 2019 link
  • Assured Autonomy: Path Toward Living With Autonomous Systems We Can Trust, U Topcu, N Bliss, N Cooke, M Cummings, A Llorens, H Shrobe, L Zuck, arXiv preprint 2020 link
  • Guidance on the assurance of machine learning in autonomous systems (AMLAS), R Hawkins, C Paterson, C Picardi, Y Jia, R Calinescu, I Habli, arXiv prepring 2021 link
  • Assured Autonomy Survey, C Rouff, L Watkins - Foundations and Trends in Privacy and Security 2022 link
  • Autonomous Systems Design: Charting a New Discipline, S Saidi, J Deshmukh, D Ziegenbein, R Ernst - IEEE Design & Test 2021 link
  • A Scenario Approach to Risk-Aware Safety-Critical System Verification, P Akella, M Ahmadi, A Ames - ArXiv preprint 2022 link