Difference between revisions of "Portal:Sources"

From Verification Body of Knowledge
Jump to navigation Jump to search
Line 67: Line 67:
* A Review of Verification and Validation for Space Autonomous Systems, RC Cardoso, G Kourtis, LA Dennis, C Dixon, M Farrell, M Fisher, M Webster - Current Robotics Reports 2021 [https://link.springer.com/article/10.1007/s43154-021-00058-1 link]
* A Review of Verification and Validation for Space Autonomous Systems, RC Cardoso, G Kourtis, LA Dennis, C Dixon, M Farrell, M Fisher, M Webster - Current Robotics Reports 2021 [https://link.springer.com/article/10.1007/s43154-021-00058-1 link]
* Formal verification of colreg-based navigation of maritime autonomous systems, F Shokri-Manninen, J Vain, M Waldén - Proceedings of SEFM 2020 [https://link.springer.com/chapter/10.1007/978-3-030-58768-0_3 link]
* Formal verification of colreg-based navigation of maritime autonomous systems, F Shokri-Manninen, J Vain, M Waldén - Proceedings of SEFM 2020 [https://link.springer.com/chapter/10.1007/978-3-030-58768-0_3 link]
* Reaching Out Towards Fully Verified Autonomous Systems, S Sankaranarayanan, S Dutta, S Mover - Proceedings of RP 2019 [https://link.springer.com/chapter/10.1007/978-3-030-30806-3_3 link]
* Compositional verification for autonomous systems with deep learning components, CS Păsăreanu, D Gopinath, H Yu - Safe, Autonomous and Intelligent Vehicles 2019 [https://link.springer.com/chapter/10.1007/978-3-319-97301-2_10 link]  
* Compositional verification for autonomous systems with deep learning components, CS Păsăreanu, D Gopinath, H Yu - Safe, Autonomous and Intelligent Vehicles 2019 [https://link.springer.com/chapter/10.1007/978-3-319-97301-2_10 link]  
* Recent trends in formal validation and verification of autonomous robots software, F Ingrand - IEEE International Conference on Robotic Computing, 2019 [https://ieeexplore.ieee.org/abstract/document/8675610/ link]  
* Recent trends in formal validation and verification of autonomous robots software, F Ingrand - IEEE International Conference on Robotic Computing, 2019 [https://ieeexplore.ieee.org/abstract/document/8675610/ link]  
* Safety Verification of Autonomous Systems: A Multi-Fidelity Reinforcement Learning Approach, JJ Beard, A Baheri - arXiv preprint 2022 [https://arxiv.org/abs/2203.03451 link]
* On-line testing for autonomous systems driven by RISC-V processor design verification, A Ruospo, R Cantoro, E Sanchez, PD Schiavone, A Garofalo, L Benini - IEEE International Symposium on Defect and Fault Tolerance in VLSI and Nanotechnology Systems 2019 [https://ieeexplore.ieee.org/abstract/document/8875345 link]
* On-line testing for autonomous systems driven by RISC-V processor design verification, A Ruospo, R Cantoro, E Sanchez, PD Schiavone, A Garofalo, L Benini - IEEE International Symposium on Defect and Fault Tolerance in VLSI and Nanotechnology Systems 2019 [https://ieeexplore.ieee.org/abstract/document/8875345 link]
* Testing, Validation, and Verification of Robotic and Autonomous Systems: A Systematic Review, H Araujo, MR Mousavi, M Varshosaz - ACM Transactions on Software Engineering and Methodology 2022 [https://dl.acm.org/doi/abs/10.1145/3542945 link]
* Verifiable self-aware agent-based autonomous systems, LA Dennis, M Fisher - Proceedings of the IEEE 2020 [https://ieeexplore.ieee.org/abstract/document/9094672 link]
* Reliability and safety of autonomous systems based on semantic modelling for self-certification, O Zaki, M Dunnigan, V Robu, D Flynn - Robotics 2021 [https://www.mdpi.com/2218-6581/10/1/10 link]
* Autonomics: In search of a foundation for next-generation autonomous systems, D Harel, A Marron, J Sifakis - Proceedings of the National Academy of Sciences 2020 [https://www.pnas.org/doi/abs/10.1073/pnas.2003162117 link]
* DIAT: Data Integrity Attestation for Resilient Collaboration of Autonomous Systems, T Abera, R Bahmani, F Brasser, A Ibrahim, AR Sadeghi, M Schunter - NDSS 2019 [https://www.ndss-symposium.org/wp-content/uploads/2019/02/ndss2019_07A-4_Abera_paper.pdf link]
* Neural bridge sampling for evaluating safety-critical autonomous systems
A Sinha, M O'Kelly, R Tedrake, JC Duchi - NeurIPS 2020 [https://proceedings.neurips.cc/paper/2020/hash/475d66314dc56a0df8fb8f7c5dbbaf78-Abstract.html link]
* Security in autonomous systems, S Katzenbeisser, I Polian, F Regazzoni, M Stottinger - IEEE European Test Symposium 2019 [https://ieeexplore.ieee.org/abstract/document/8791552 link]
* Assured Autonomy: Path Toward Living With Autonomous Systems We Can Trust, U Topcu, N Bliss, N Cooke, M Cummings, A Llorens, H Shrobe, L Zuck,  arXiv preprint 2020 [https://arxiv.org/abs/2010.14443 link]
* Guidance on the assurance of machine learning in autonomous systems (AMLAS), R Hawkins, C Paterson, C Picardi, Y Jia, R Calinescu, I Habli, arXiv prepring 2021 [https://arxiv.org/abs/2102.01564 link]

Revision as of 15:11, 19 September 2022

Notes for improvement
organize and structure to better differentiate between documentation, resources (e.g. test ranges and tools), and collaborative activities (e.g. conferences)

Standards

  • 1012-2016 - IEEE Standard for System, Software, and Hardware Verification and Validation [1]

Best practices

Books on verification

  • Model checking book. E. Clarke
  • Other model checking book by Peter Katoen
  • Book on software testing/model-based testing
  • Artificial Intelligence and Software Testing - Building systems you can trust (2022). Rex Black, James Davenport, Joanna Olszewska, Jeremias Rößler, Adam Leon Smith, Jonathon Wright. Edited by Adam Leon Smith link

Special issues on VAS

  • Journals

Case studies

  • Steps and method followed when verifying a system


Whitepapers on autonomous systems V&V from regulators

  • How to apply V&V to autonomous systems
  • How to interpret regulations for different countries
  • What remains to be done for regulations

E.g.

  • Reviews on regulations for autonomous systems in Australia


Review or survey papers on V&V

  • Michael Fisher's survey paper
  • Signe + David Tate's white paper

Existing projects

  • Metrics [2] - finding ways to organize competitions that are reproducible, benchmarks to structure robotics competitions, comparing hardware and software together. Applications: healthcare, agriculture, etc.

Benchmark models

  • Simulink model benchmark for falsification (3 models)


Testing fields & sites/labs

  • Georgia Tech Robotarium
  • Urban search and rescue at Texas A&M

Robotics & autonomous systems competitions

  • DARPA
  • Autonomous vehicles
  • European Robotics League
  • ROBOCUP
  • AWS Deepracer (deep learning for training autonomous vehicles)
  • Australia & New Zealand Search and Rescue
  • SAUC-E - underwater robotics competition
  • Robosub

Conferences

Most recent relevant papers

  • Formal verification of neural network controlled autonomous systems, X Sun, H Khedr, Y Shoukry - Proceedings HSCC 2019 link
  • Towards a framework for certification of reliable autonomous systems, M Fisher, V Mascardi, KY Rozier, BH Schlinglof, M Winikoff, N Yorke-Smith - Autonomous Agents and Multi-Agent Systems 2021 link
  • Verifying the safety of autonomous systems with neural network controllers, R Ivanov, TJ Carpenter, J Weimer, R Alur, GJ Pappas, I Lee - ACM Transactions on Embedded Computing Systems 2020 link
  • A Review of Verification and Validation for Space Autonomous Systems, RC Cardoso, G Kourtis, LA Dennis, C Dixon, M Farrell, M Fisher, M Webster - Current Robotics Reports 2021 link
  • Formal verification of colreg-based navigation of maritime autonomous systems, F Shokri-Manninen, J Vain, M Waldén - Proceedings of SEFM 2020 link
  • Compositional verification for autonomous systems with deep learning components, CS Păsăreanu, D Gopinath, H Yu - Safe, Autonomous and Intelligent Vehicles 2019 link
  • Recent trends in formal validation and verification of autonomous robots software, F Ingrand - IEEE International Conference on Robotic Computing, 2019 link
  • On-line testing for autonomous systems driven by RISC-V processor design verification, A Ruospo, R Cantoro, E Sanchez, PD Schiavone, A Garofalo, L Benini - IEEE International Symposium on Defect and Fault Tolerance in VLSI and Nanotechnology Systems 2019 link
  • Testing, Validation, and Verification of Robotic and Autonomous Systems: A Systematic Review, H Araujo, MR Mousavi, M Varshosaz - ACM Transactions on Software Engineering and Methodology 2022 link
  • Verifiable self-aware agent-based autonomous systems, LA Dennis, M Fisher - Proceedings of the IEEE 2020 link
  • Reliability and safety of autonomous systems based on semantic modelling for self-certification, O Zaki, M Dunnigan, V Robu, D Flynn - Robotics 2021 link
  • Autonomics: In search of a foundation for next-generation autonomous systems, D Harel, A Marron, J Sifakis - Proceedings of the National Academy of Sciences 2020 link
  • DIAT: Data Integrity Attestation for Resilient Collaboration of Autonomous Systems, T Abera, R Bahmani, F Brasser, A Ibrahim, AR Sadeghi, M Schunter - NDSS 2019 link
  • Neural bridge sampling for evaluating safety-critical autonomous systems

A Sinha, M O'Kelly, R Tedrake, JC Duchi - NeurIPS 2020 link

  • Security in autonomous systems, S Katzenbeisser, I Polian, F Regazzoni, M Stottinger - IEEE European Test Symposium 2019 link
  • Assured Autonomy: Path Toward Living With Autonomous Systems We Can Trust, U Topcu, N Bliss, N Cooke, M Cummings, A Llorens, H Shrobe, L Zuck, arXiv preprint 2020 link
  • Guidance on the assurance of machine learning in autonomous systems (AMLAS), R Hawkins, C Paterson, C Picardi, Y Jia, R Calinescu, I Habli, arXiv prepring 2021 link
Retrieved from "https://robotistry.org/vasbok/index.php?title=Portal:Sources&oldid=79896"