Difference between revisions of "Portal:Sources"
Jump to navigation
Jump to search
| (4 intermediate revisions by the same user not shown) | |||
| Line 3: | Line 3: | ||
== Standards == | == Standards == | ||
* 1012-2016 - IEEE Standard for System, Software, and Hardware Verification and Validation [https://ieeexplore.ieee.org/document/8055462] | * 1012-2016 - IEEE Standard for System, Software, and Hardware Verification and Validation [https://ieeexplore.ieee.org/document/8055462] | ||
* P2817 - IEEE Guide for Verification of Autonomous Systems [https://standards.ieee.org/ieee/2817/7644/] | |||
== Best practices == | == Best practices == | ||
== Books on verification == | == Books on verification == | ||
* Model checking | * Model checking, E. Clarke et al [https://mitpress.mit.edu/9780262038836/model-checking/] | ||
* | * Principles of model checking, P. Katoen et al [https://mitpress.mit.edu/9780262026499/principles-of-model-checking/] | ||
* Book on software testing/model-based testing | * Book on software testing/model-based testing | ||
* Artificial Intelligence and Software Testing - Building systems you can trust (2022). Rex Black, James Davenport, Joanna Olszewska, Jeremias Rößler, Adam Leon Smith, Jonathon Wright. Edited by Adam Leon Smith [https://shop.bcs.org/store/221/detail/workgroup?id=3-221-9781780175768 link] | * Artificial Intelligence and Software Testing - Building systems you can trust (2022). Rex Black, James Davenport, Joanna Olszewska, Jeremias Rößler, Adam Leon Smith, Jonathon Wright. Edited by Adam Leon Smith [https://shop.bcs.org/store/221/detail/workgroup?id=3-221-9781780175768 link] | ||
* 25 Years of Model Checking, O. Grumberg et al [https://link.springer.com/book/10.1007/978-3-540-69850-0] | |||
== Special issues on VAS == | == Special issues on VAS == | ||
| Line 58: | Line 60: | ||
== Conferences == | == Conferences == | ||
* | * | ||
== Patents == | |||
== Most recent relevant papers == | == Most recent relevant papers == | ||
| Line 75: | Line 79: | ||
* Autonomics: In search of a foundation for next-generation autonomous systems, D Harel, A Marron, J Sifakis - Proceedings of the National Academy of Sciences 2020 [https://www.pnas.org/doi/abs/10.1073/pnas.2003162117 link] | * Autonomics: In search of a foundation for next-generation autonomous systems, D Harel, A Marron, J Sifakis - Proceedings of the National Academy of Sciences 2020 [https://www.pnas.org/doi/abs/10.1073/pnas.2003162117 link] | ||
* DIAT: Data Integrity Attestation for Resilient Collaboration of Autonomous Systems, T Abera, R Bahmani, F Brasser, A Ibrahim, AR Sadeghi, M Schunter - NDSS 2019 [https://www.ndss-symposium.org/wp-content/uploads/2019/02/ndss2019_07A-4_Abera_paper.pdf link] | * DIAT: Data Integrity Attestation for Resilient Collaboration of Autonomous Systems, T Abera, R Bahmani, F Brasser, A Ibrahim, AR Sadeghi, M Schunter - NDSS 2019 [https://www.ndss-symposium.org/wp-content/uploads/2019/02/ndss2019_07A-4_Abera_paper.pdf link] | ||
* Neural bridge sampling for evaluating safety-critical autonomous systems | * Neural bridge sampling for evaluating safety-critical autonomous systems, A Sinha, M O'Kelly, R Tedrake, JC Duchi - NeurIPS 2020 [https://proceedings.neurips.cc/paper/2020/hash/475d66314dc56a0df8fb8f7c5dbbaf78-Abstract.html link] | ||
A Sinha, M O'Kelly, R Tedrake, JC Duchi - NeurIPS 2020 [https://proceedings.neurips.cc/paper/2020/hash/475d66314dc56a0df8fb8f7c5dbbaf78-Abstract.html link] | |||
* Security in autonomous systems, S Katzenbeisser, I Polian, F Regazzoni, M Stottinger - IEEE European Test Symposium 2019 [https://ieeexplore.ieee.org/abstract/document/8791552 link] | * Security in autonomous systems, S Katzenbeisser, I Polian, F Regazzoni, M Stottinger - IEEE European Test Symposium 2019 [https://ieeexplore.ieee.org/abstract/document/8791552 link] | ||
* Assured Autonomy: Path Toward Living With Autonomous Systems We Can Trust, U Topcu, N Bliss, N Cooke, M Cummings, A Llorens, H Shrobe, L Zuck, arXiv preprint 2020 [https://arxiv.org/abs/2010.14443 link] | * Assured Autonomy: Path Toward Living With Autonomous Systems We Can Trust, U Topcu, N Bliss, N Cooke, M Cummings, A Llorens, H Shrobe, L Zuck, arXiv preprint 2020 [https://arxiv.org/abs/2010.14443 link] | ||
* Guidance on the assurance of machine learning in autonomous systems (AMLAS), R Hawkins, C Paterson, C Picardi, Y Jia, R Calinescu, I Habli, arXiv prepring 2021 [https://arxiv.org/abs/2102.01564 link] | * Guidance on the assurance of machine learning in autonomous systems (AMLAS), R Hawkins, C Paterson, C Picardi, Y Jia, R Calinescu, I Habli, arXiv prepring 2021 [https://arxiv.org/abs/2102.01564 link] | ||
* Assured Autonomy Survey, C Rouff, L Watkins - Foundations and Trends in Privacy and Security 2022 [https://www.nowpublishers.com/article/Details/SEC-027 link] | |||
* Autonomous Systems Design: Charting a New Discipline, S Saidi, J Deshmukh, D Ziegenbein, R Ernst - IEEE Design & Test 2021 [https://ieeexplore.ieee.org/abstract/document/9615198 link] | |||
* A Scenario Approach to Risk-Aware Safety-Critical System Verification, P Akella, M Ahmadi, A Ames - ArXiv preprint 2022 [https://arxiv.org/abs/2203.02595 link] | |||
Latest revision as of 12:29, 4 October 2022
- Notes for improvement
- organize and structure to better differentiate between documentation, resources (e.g. test ranges and tools), and collaborative activities (e.g. conferences)
Standards
- 1012-2016 - IEEE Standard for System, Software, and Hardware Verification and Validation [1]
- P2817 - IEEE Guide for Verification of Autonomous Systems [2]
Best practices
Books on verification
- Model checking, E. Clarke et al [3]
- Principles of model checking, P. Katoen et al [4]
- Book on software testing/model-based testing
- Artificial Intelligence and Software Testing - Building systems you can trust (2022). Rex Black, James Davenport, Joanna Olszewska, Jeremias Rößler, Adam Leon Smith, Jonathon Wright. Edited by Adam Leon Smith link
- 25 Years of Model Checking, O. Grumberg et al [5]
Special issues on VAS
- Journals
Case studies
- Steps and method followed when verifying a system
Whitepapers on autonomous systems V&V from regulators
- How to apply V&V to autonomous systems
- How to interpret regulations for different countries
- What remains to be done for regulations
E.g.
- Reviews on regulations for autonomous systems in Australia
Review or survey papers on V&V
- Michael Fisher's survey paper
- Signe + David Tate's white paper
Existing projects
- Metrics [6] - finding ways to organize competitions that are reproducible, benchmarks to structure robotics competitions, comparing hardware and software together. Applications: healthcare, agriculture, etc.
Benchmark models
- Simulink model benchmark for falsification (3 models)
Testing fields & sites/labs
- Georgia Tech Robotarium
- Urban search and rescue at Texas A&M
Robotics & autonomous systems competitions
- DARPA
- Autonomous vehicles
- European Robotics League
- ROBOCUP
- AWS Deepracer (deep learning for training autonomous vehicles)
- Australia & New Zealand Search and Rescue
- SAUC-E - underwater robotics competition
- Robosub
Conferences
Patents
Most recent relevant papers
- Formal verification of neural network controlled autonomous systems, X Sun, H Khedr, Y Shoukry - Proceedings HSCC 2019 link
- Towards a framework for certification of reliable autonomous systems, M Fisher, V Mascardi, KY Rozier, BH Schlinglof, M Winikoff, N Yorke-Smith - Autonomous Agents and Multi-Agent Systems 2021 link
- Verifying the safety of autonomous systems with neural network controllers, R Ivanov, TJ Carpenter, J Weimer, R Alur, GJ Pappas, I Lee - ACM Transactions on Embedded Computing Systems 2020 link
- A Review of Verification and Validation for Space Autonomous Systems, RC Cardoso, G Kourtis, LA Dennis, C Dixon, M Farrell, M Fisher, M Webster - Current Robotics Reports 2021 link
- Formal verification of colreg-based navigation of maritime autonomous systems, F Shokri-Manninen, J Vain, M Waldén - Proceedings of SEFM 2020 link
- Compositional verification for autonomous systems with deep learning components, CS Păsăreanu, D Gopinath, H Yu - Safe, Autonomous and Intelligent Vehicles 2019 link
- Recent trends in formal validation and verification of autonomous robots software, F Ingrand - IEEE International Conference on Robotic Computing, 2019 link
- On-line testing for autonomous systems driven by RISC-V processor design verification, A Ruospo, R Cantoro, E Sanchez, PD Schiavone, A Garofalo, L Benini - IEEE International Symposium on Defect and Fault Tolerance in VLSI and Nanotechnology Systems 2019 link
- Testing, Validation, and Verification of Robotic and Autonomous Systems: A Systematic Review, H Araujo, MR Mousavi, M Varshosaz - ACM Transactions on Software Engineering and Methodology 2022 link
- Verifiable self-aware agent-based autonomous systems, LA Dennis, M Fisher - Proceedings of the IEEE 2020 link
- Reliability and safety of autonomous systems based on semantic modelling for self-certification, O Zaki, M Dunnigan, V Robu, D Flynn - Robotics 2021 link
- Autonomics: In search of a foundation for next-generation autonomous systems, D Harel, A Marron, J Sifakis - Proceedings of the National Academy of Sciences 2020 link
- DIAT: Data Integrity Attestation for Resilient Collaboration of Autonomous Systems, T Abera, R Bahmani, F Brasser, A Ibrahim, AR Sadeghi, M Schunter - NDSS 2019 link
- Neural bridge sampling for evaluating safety-critical autonomous systems, A Sinha, M O'Kelly, R Tedrake, JC Duchi - NeurIPS 2020 link
- Security in autonomous systems, S Katzenbeisser, I Polian, F Regazzoni, M Stottinger - IEEE European Test Symposium 2019 link
- Assured Autonomy: Path Toward Living With Autonomous Systems We Can Trust, U Topcu, N Bliss, N Cooke, M Cummings, A Llorens, H Shrobe, L Zuck, arXiv preprint 2020 link
- Guidance on the assurance of machine learning in autonomous systems (AMLAS), R Hawkins, C Paterson, C Picardi, Y Jia, R Calinescu, I Habli, arXiv prepring 2021 link
- Assured Autonomy Survey, C Rouff, L Watkins - Foundations and Trends in Privacy and Security 2022 link
- Autonomous Systems Design: Charting a New Discipline, S Saidi, J Deshmukh, D Ziegenbein, R Ernst - IEEE Design & Test 2021 link
- A Scenario Approach to Risk-Aware Safety-Critical System Verification, P Akella, M Ahmadi, A Ames - ArXiv preprint 2022 link