https://robotistry.org/vasbok/api.php?action=feedcontributions&feedformat=atom&user=Arinajed 2026-10-23T09:57:24Z User contributions MediaWiki 1.37.1 https://robotistry.org/vasbok/index.php?title=History&diff=79913 2022-10-19T05:55:24Z

<p>Arinajed: /* Developing As A Field */</p> <hr /> <div>== History of Verification of Autonomous Systems ==<br /> <br /> === History of Autonomous systems ===<br /> <br /> According to common knowledge and history records, the two first autonomous robots designed and implemented are the following:<br /> <br /> * Tortoises by Grey Walters in the 1940s [https://spectrum.ieee.org/meet-roombas-ancestor-cybernetic-tortoise] [https://www.youtube.com/watch?time_continue=1&amp;v=lLULRlmXkKo&amp;feature=emb_logo]<br /> <br /> * Shakey the robot between 1966 and 1972 [https://ieeemilestones.ethw.org/Milestones:Shakey:_The_World%E2%80%99s_First_Mobile,_Intelligent_Robot,_1972]<br /> <br /> === Prior Work in Related Fields ===<br /> <br /> &lt;Bit of text about different fields&#039; related work&gt;<br /> <br /> ==== Software Assurance ====<br /> <br /> &lt;Summary of relevant work in software assurance&gt;<br /> <br /> ==== Formal Methods ====<br /> <br /> &lt;Summary of work in formal approaches to assurance and verification prior to application to autonomous systems&gt;<br /> <br /> === Early Activities ===<br /> <br /> &lt;Discussion of the Verification of Autonomous Systems Working Group (VASWG)&gt;<br /> <br /> === Developing As A Field ===<br /> <br /> &lt;Text about maturation, current state, pointer to roadmap?&gt;<br /> <br /> Some of the first instances of the application of verification tools and techniques to autonomous systems appear in late 1990s and early 2000s. <br /> <br /> * &quot;Towards automatic verification of autonomous systems&quot;, R. Simmons, C. Pecheur, G. Srinivasan, 2000. [https://ieeexplore.ieee.org/abstract/document/893218 link]<br /> Formal methods applied to fault diagnosis systems and mobile robots. <br /> <br /> * &quot;Verification of autonomous systems using embedded behavior auditors&quot;, D. Dvorak, E. Tailor [https://aip.scitation.org/doi/abs/10.1063/1.57633 link]<br /> Formal methods applied to spacecraft and rovers. <br /> <br /> <br /> <br /> Later work:<br /> <br /> * &quot;Verifying Autonomous Systems&quot;, M. Fisher, L. Dennis, M. Webster. In [https://cacm.acm.org/magazines/2013/9/167136-verifying-autonomous-systems/abstract Communications of the ACM], 2013. <br /> <br /> <br /> ==== IEEE Technical Committee ====<br /> <br /> Drawing on the efforts from the global working group, the IEEE Robotics and Automation Society Technical Committee on Verification of Autonomous Systems was officially inaugurated in 2019. The first co-chairs were Signe Redfield, Michael Fisher, and Dejanira Araiza-Illan.<br /> <br /> ==== IEEE Standards Development ====<br /> <br /> &lt;Standards development&gt;</div>

Arinajed https://robotistry.org/vasbok/index.php?title=History&diff=79912 2022-10-19T05:47:47Z

<p>Arinajed: /* IEEE Technical Committee */</p> <hr /> <div>== History of Verification of Autonomous Systems ==<br /> <br /> === History of Autonomous systems ===<br /> <br /> According to common knowledge and history records, the two first autonomous robots designed and implemented are the following:<br /> <br /> * Tortoises by Grey Walters in the 1940s [https://spectrum.ieee.org/meet-roombas-ancestor-cybernetic-tortoise] [https://www.youtube.com/watch?time_continue=1&amp;v=lLULRlmXkKo&amp;feature=emb_logo]<br /> <br /> * Shakey the robot between 1966 and 1972 [https://ieeemilestones.ethw.org/Milestones:Shakey:_The_World%E2%80%99s_First_Mobile,_Intelligent_Robot,_1972]<br /> <br /> === Prior Work in Related Fields ===<br /> <br /> &lt;Bit of text about different fields&#039; related work&gt;<br /> <br /> ==== Software Assurance ====<br /> <br /> &lt;Summary of relevant work in software assurance&gt;<br /> <br /> ==== Formal Methods ====<br /> <br /> &lt;Summary of work in formal approaches to assurance and verification prior to application to autonomous systems&gt;<br /> <br /> === Early Activities ===<br /> <br /> &lt;Discussion of the Verification of Autonomous Systems Working Group (VASWG)&gt;<br /> <br /> === Developing As A Field ===<br /> <br /> &lt;Text about maturation, current state, pointer to roadmap?&gt;<br /> <br /> Key publications that pioneered the use of verification tools and techniques specifically applied to autonomous systems are the following:<br /> <br /> * Verifying Autonomous Systems, Michael Fisher, Louise Dennis, Matt Webster. In [https://cacm.acm.org/magazines/2013/9/167136-verifying-autonomous-systems/abstract Communications of the ACM], 2013. <br /> <br /> <br /> ==== IEEE Technical Committee ====<br /> <br /> Drawing on the efforts from the global working group, the IEEE Robotics and Automation Society Technical Committee on Verification of Autonomous Systems was officially inaugurated in 2019. The first co-chairs were Signe Redfield, Michael Fisher, and Dejanira Araiza-Illan.<br /> <br /> ==== IEEE Standards Development ====<br /> <br /> &lt;Standards development&gt;</div>

Arinajed https://robotistry.org/vasbok/index.php?title=History&diff=79911 2022-10-19T05:45:55Z

<p>Arinajed: </p> <hr /> <div>== History of Verification of Autonomous Systems ==<br /> <br /> === History of Autonomous systems ===<br /> <br /> According to common knowledge and history records, the two first autonomous robots designed and implemented are the following:<br /> <br /> * Tortoises by Grey Walters in the 1940s [https://spectrum.ieee.org/meet-roombas-ancestor-cybernetic-tortoise] [https://www.youtube.com/watch?time_continue=1&amp;v=lLULRlmXkKo&amp;feature=emb_logo]<br /> <br /> * Shakey the robot between 1966 and 1972 [https://ieeemilestones.ethw.org/Milestones:Shakey:_The_World%E2%80%99s_First_Mobile,_Intelligent_Robot,_1972]<br /> <br /> === Prior Work in Related Fields ===<br /> <br /> &lt;Bit of text about different fields&#039; related work&gt;<br /> <br /> ==== Software Assurance ====<br /> <br /> &lt;Summary of relevant work in software assurance&gt;<br /> <br /> ==== Formal Methods ====<br /> <br /> &lt;Summary of work in formal approaches to assurance and verification prior to application to autonomous systems&gt;<br /> <br /> === Early Activities ===<br /> <br /> &lt;Discussion of the Verification of Autonomous Systems Working Group (VASWG)&gt;<br /> <br /> === Developing As A Field ===<br /> <br /> &lt;Text about maturation, current state, pointer to roadmap?&gt;<br /> <br /> Key publications that pioneered the use of verification tools and techniques specifically applied to autonomous systems are the following:<br /> <br /> * Verifying Autonomous Systems, Michael Fisher, Louise Dennis, Matt Webster. In [https://cacm.acm.org/magazines/2013/9/167136-verifying-autonomous-systems/abstract Communications of the ACM], 2013. <br /> <br /> <br /> ==== IEEE Technical Committee ====<br /> <br /> &lt;Formation of TC&gt;<br /> <br /> ==== IEEE Standards Development ====<br /> <br /> &lt;Standards development&gt;</div>

Arinajed https://robotistry.org/vasbok/index.php?title=History&diff=79910 2022-10-19T05:45:11Z

<p>Arinajed: </p> <hr /> <div>== History of Verification of Autonomous Systems ==<br /> <br /> === History of Autonomous systems ===<br /> <br /> According to common knowledge and history records, the two first autonomous robots designed and implemented are the following:<br /> <br /> * Tortoises by Grey Walters in the 1940s [https://spectrum.ieee.org/meet-roombas-ancestor-cybernetic-tortoise] [https://www.youtube.com/watch?time_continue=1&amp;v=lLULRlmXkKo&amp;feature=emb_logo]<br /> <br /> * Shakey the robot between 1966 and 1972 [https://ieeemilestones.ethw.org/Milestones:Shakey:_The_World%E2%80%99s_First_Mobile,_Intelligent_Robot,_1972]<br /> <br /> === Prior Work in Related Fields ===<br /> <br /> &lt;Bit of text about different fields&#039; related work&gt;<br /> <br /> ==== Software Assurance ====<br /> <br /> &lt;Summary of relevant work in software assurance&gt;<br /> <br /> ==== Formal Methods ====<br /> <br /> &lt;Summary of work in formal approaches to assurance and verification prior to application to autonomous systems&gt;<br /> <br /> === Early Activities ===<br /> <br /> &lt;Discussion of the Verification of Autonomous Systems Working Group (VASWG)&gt;<br /> <br /> === Developing As A Field ===<br /> <br /> &lt;Text about maturation, current state, pointer to roadmap?&gt;<br /> <br /> A few publications that define the use of verification tools and techniques for autonomous systems are the following:<br /> <br /> * Verifying Autonomous Systems, Michael Fisher, Louise Dennis, Matt Webster. In [https://cacm.acm.org/magazines/2013/9/167136-verifying-autonomous-systems/abstract Communications of the ACM], 2013. <br /> <br /> <br /> ==== IEEE Technical Committee ====<br /> <br /> &lt;Formation of TC&gt;<br /> <br /> ==== IEEE Standards Development ====<br /> <br /> &lt;Standards development&gt;</div>

Arinajed https://robotistry.org/vasbok/index.php?title=History&diff=79909 2022-10-04T12:58:54Z

<p>Arinajed: </p> <hr /> <div>== History of Verification of Autonomous Systems ==<br /> <br /> === History of Autonomous systems ===<br /> <br /> Tortoises by Grey Walters [https://spectrum.ieee.org/meet-roombas-ancestor-cybernetic-tortoise] [https://www.youtube.com/watch?time_continue=1&amp;v=lLULRlmXkKo&amp;feature=emb_logo]<br /> <br /> Shakey robot [https://ieeemilestones.ethw.org/Milestones:Shakey:_The_World%E2%80%99s_First_Mobile,_Intelligent_Robot,_1972]<br /> <br /> === Prior Work in Related Fields ===<br /> <br /> &lt;Bit of text about different fields&#039; related work&gt;<br /> <br /> ==== Software Assurance ====<br /> <br /> &lt;Summary of relevant work in software assurance&gt;<br /> <br /> ==== Formal Methods ====<br /> <br /> &lt;Summary of work in formal approaches to assurance and verification prior to application to autonomous systems&gt;<br /> <br /> === Early Activities ===<br /> <br /> &lt;Discussion of the Verification of Autonomous Systems Working Group (VASWG)&gt;<br /> <br /> === Developing As A Field ===<br /> <br /> &lt;Text about maturation, current state, pointer to roadmap?&gt;<br /> <br /> ==== IEEE Technical Committee ====<br /> <br /> &lt;Formation of TC&gt;<br /> <br /> ==== IEEE Standards Development ====<br /> <br /> &lt;Standards development&gt;</div>

Arinajed https://robotistry.org/vasbok/index.php?title=Welcome_to_VASBoK&diff=79908 2022-10-04T12:41:29Z

<p>Arinajed: </p> <hr /> <div>The Verification of Autonomous Systems Body of Knowledge ([[VAS-BoK]]) is a project founded by the [https://www.ieee.org IEEE] [https://www.ieee-ras.org Robotics and Automation Society]&#039;s [https://www.ieee-ras.org/verification-of-autonomous-systems Technical Committee for Verification of Autonomous Systems] (TC-VAS) Education Working Group.<br /> <br /> It is powered by the autonomous systems verification community, and built by volunteers including researchers from industry, government, and academia. We are crowd-sourcing a knowledge base on the history, science and practice of verification of autonomous and AI-enabled systems. <br /> <br /> {| id=&quot;searchtable&quot; class=&quot;wikitable&quot; style=&quot;margin: auto; text-align:center!important; vertical-align:middle; border-width: 20px; border-color: white; caption-side:bottom;&quot;<br /> &lt;!--|+&#039;&#039;VASBoK&#039;s {{NUMBEROFARTICLES}} articles have been viewed &lt;span class = &quot;totalnumberofviews&quot;&gt;&lt;/span&gt; times.&#039;&#039;--&gt;<br /> &lt;!-- !&lt;inputbox&gt;<br /> type=fulltext<br /> break=no<br /> searchbuttonlabel={{MediaWiki:search/{{PAGELANGUAGE}}}}<br /> &lt;/inputbox&gt; --&gt;<br /> |-<br /> !<br /> &lt;big&gt;[[VASBoK:About|{{MediaWiki:aboutsite/{{PAGELANGUAGE}}}}]]&lt;/big&gt;<br /> |}<br /> <br /> &lt;gallery&gt;<br /> File:Question.png|[[Portal:Verification|What is Verification?]]<br /> File:GraduationCap2.png|[[Portal:Tutorials|Tutorials]]<br /> File:Books2.png|[[Portal:Sources|Sources]]<br /> File:People.png|[[Portal:People|People]]<br /> File:Hammer2.png|[[Portal:Tools|Tools and Processes]]<br /> File:Glossary.png|[[Portal:Glossary|Glossary]]<br /> File:Events.png|[[Portal:Events|Events]]<br /> &lt;/gallery&gt;<br /> <br /> == Learn the basics ==<br /> * [[Definitions]]<br /> * [[Primer for researchers]]<br /> * [[Primer for certification and licensing agencies]]<br /> * [[Primer for robot developers]]<br /> * [[Primer for autonomous behavior designers]]<br /> * [[Primer for artificial intelligence specialists]]<br /> <br /> == Verification in practice ==<br /> * [[Best practices for xxx]]<br /> * [[Guide for yyy]]<br /> <br /> == Learn More ==<br /> * [https://robotistry.org/vaswg More information and history on the verification of autonomous systems working group] (from the Verification of Autonomous Systems Working Group)<br /> * [[History]] of Verification of Autonomous Systems<br /> <br /> == Opportunities to Participate ==<br /> * Join the [https://standards.ieee.org/ieee/2817/7644/ IEEE Standards Development Working Group P2817]<br /> * Join the [https://www.ieee-ras.org/verification-of-autonomous-systems IEEE RAS Technical Committee on Verification of Autonomous Systems]<br /> ** Education Working Group <br /> *** Contribution to the Book of Knowledge on Verification of Autonomous Systems <br /> *** Organization of dedicated forums, e.g. schools and symposia<br /> ** Roadmap Development Working Group<br /> <br /> [[Category:VASBoK navigation]]</div>

Arinajed https://robotistry.org/vasbok/index.php?title=Welcome_to_VASBoK&diff=79907 2022-10-04T12:40:34Z

<p>Arinajed: </p> <hr /> <div>The Verification of Autonomous Systems Body of Knowledge ([[VAS-BoK]]) is a project founded by the [https://www.ieee.org IEEE] [https://www.ieee-ras.org Robotics and Automation Society]&#039;s [https://www.ieee-ras.org/verification-of-autonomous-systems Technical Committee for Verification of Autonomous Systems] (TC-VAS) Education Working Group.<br /> <br /> It is powered by the autonomous systems verification community, and built by volunteers including researchers from industry, government, and academia. We are crowd-sourcing a knowledge base on the history, science and practice of verification of autonomous and AI-enabled systems. <br /> <br /> {| id=&quot;searchtable&quot; class=&quot;wikitable&quot; style=&quot;margin: auto; text-align:center!important; vertical-align:middle; border-width: 20px; border-color: white; caption-side:bottom;&quot;<br /> &lt;!--|+&#039;&#039;VASBoK&#039;s {{NUMBEROFARTICLES}} articles have been viewed &lt;span class = &quot;totalnumberofviews&quot;&gt;&lt;/span&gt; times.&#039;&#039;--&gt;<br /> &lt;!-- !&lt;inputbox&gt;<br /> type=fulltext<br /> break=no<br /> searchbuttonlabel={{MediaWiki:search/{{PAGELANGUAGE}}}}<br /> &lt;/inputbox&gt; --&gt;<br /> |-<br /> !<br /> &lt;big&gt;[[VASBoK:About|{{MediaWiki:aboutsite/{{PAGELANGUAGE}}}}]]&lt;/big&gt;<br /> |}<br /> <br /> &lt;gallery&gt;<br /> File:Question.png|[[Portal:Verification|What is Verification?]]<br /> File:GraduationCap2.png|[[Portal:Tutorials|Tutorials]]<br /> File:Books2.png|[[Portal:Sources|Sources]]<br /> File:People.png|[[Portal:People|People]]<br /> File:Hammer2.png|[[Portal:Tools|Tools and Processes]]<br /> File:Glossary.png|[[Portal:Glossary|Glossary]]<br /> File:Events.png|[[Portal:Events|Events]]<br /> &lt;/gallery&gt;<br /> <br /> == Learn the basics ==<br /> * [[Definitions]]<br /> * [[Primer for researchers]]<br /> * [[Primer for certification and licensing agencies]]<br /> * [[Primer for robot developers]]<br /> * [[Primer for autonomous behavior designers]]<br /> * [[Primer for artificial intelligence specialists]]<br /> <br /> == Verification in practice ==<br /> * [[Best practices for xxx]]<br /> * [[Guide for yyy]]<br /> <br /> == Learn More ==<br /> * [https://robotistry.org/vaswg More information and history on the verification of autonomous systems working group] (from the Verification of Autonomous Systems Working Group)<br /> * [[History]] of Verification of Autonomous Systems<br /> <br /> == Opportunities to Participate ==<br /> * Link to IEEE Standards Development Working Group P2817 [https://standards.ieee.org/ieee/2817/7644/]<br /> * Join the IEEE RAS Technical Committee on Verification of Autonomous Systems [https://www.ieee-ras.org/verification-of-autonomous-systems]<br /> ** Education Working Group <br /> *** Contribution to the Book of Knowledge on Verification of Autonomous Systems <br /> *** Organization of dedicated forums, e.g. schools and symposia<br /> ** Roadmap Development Working Group<br /> <br /> [[Category:VASBoK navigation]]</div>

Arinajed https://robotistry.org/vasbok/index.php?title=Portal:Sources&diff=79905 2022-10-04T12:29:22Z

<p>Arinajed: </p> <hr /> <div>;Notes for improvement: organize and structure to better differentiate between documentation, resources (e.g. test ranges and tools), and collaborative activities (e.g. conferences)<br /> <br /> == Standards ==<br /> * 1012-2016 - IEEE Standard for System, Software, and Hardware Verification and Validation [https://ieeexplore.ieee.org/document/8055462]<br /> * P2817 - IEEE Guide for Verification of Autonomous Systems [https://standards.ieee.org/ieee/2817/7644/]<br /> <br /> == Best practices ==<br /> <br /> == Books on verification ==<br /> * Model checking, E. Clarke et al [https://mitpress.mit.edu/9780262038836/model-checking/]<br /> * Principles of model checking, P. Katoen et al [https://mitpress.mit.edu/9780262026499/principles-of-model-checking/]<br /> * Book on software testing/model-based testing<br /> * Artificial Intelligence and Software Testing - Building systems you can trust (2022). Rex Black, James Davenport, Joanna Olszewska, Jeremias Rößler, Adam Leon Smith, Jonathon Wright. Edited by Adam Leon Smith [https://shop.bcs.org/store/221/detail/workgroup?id=3-221-9781780175768 link]<br /> * 25 Years of Model Checking, O. Grumberg et al [https://link.springer.com/book/10.1007/978-3-540-69850-0]<br /> <br /> == Special issues on VAS ==<br /> * Journals<br /> <br /> == Case studies ==<br /> <br /> * Steps and method followed when verifying a system<br /> <br /> <br /> == Whitepapers on autonomous systems V&amp;V from regulators ==<br /> * How to apply V&amp;V to autonomous systems<br /> * How to interpret regulations for different countries<br /> * What remains to be done for regulations<br /> <br /> E.g. <br /> * Reviews on regulations for autonomous systems in Australia<br /> <br /> <br /> == Review or survey papers on V&amp;V ==<br /> * Michael Fisher&#039;s survey paper<br /> * Signe + David Tate&#039;s white paper<br /> <br /> == Existing projects ==<br /> * Metrics [https://metricsproject.eu/] - finding ways to organize competitions that are reproducible, benchmarks to structure robotics competitions, comparing hardware and software together. Applications: healthcare, agriculture, etc.<br /> <br /> == Benchmark models ==<br /> <br /> * Simulink model benchmark for falsification (3 models) <br /> <br /> <br /> == Testing fields &amp; sites/labs ==<br /> * Georgia Tech Robotarium <br /> * Urban search and rescue at Texas A&amp;M<br /> *<br /> <br /> == Robotics &amp; autonomous systems competitions ==<br /> * DARPA<br /> * Autonomous vehicles<br /> * European Robotics League<br /> * ROBOCUP<br /> * AWS Deepracer (deep learning for training autonomous vehicles)<br /> * [https://uavchallenge.org/search-and-rescue/ Australia &amp; New Zealand Search and Rescue]<br /> * SAUC-E - underwater robotics competition<br /> * Robosub<br /> <br /> == Conferences ==<br /> *<br /> <br /> == Patents ==<br /> <br /> == Most recent relevant papers ==<br /> <br /> <br /> * Formal verification of neural network controlled autonomous systems, X Sun, H Khedr, Y Shoukry - Proceedings HSCC 2019 [https://dl.acm.org/doi/abs/10.1145/3302504.3311802 link]<br /> * Towards a framework for certification of reliable autonomous systems, M Fisher, V Mascardi, KY Rozier, BH Schlinglof, M Winikoff, N Yorke-Smith - Autonomous Agents and Multi-Agent Systems 2021 [https://link.springer.com/article/10.1007/s10458-020-09487-2 link]<br /> * Verifying the safety of autonomous systems with neural network controllers, R Ivanov, TJ Carpenter, J Weimer, R Alur, GJ Pappas, I Lee - ACM Transactions on Embedded Computing Systems 2020 [https://dl.acm.org/doi/abs/10.1145/3419742 link]<br /> * A Review of Verification and Validation for Space Autonomous Systems, RC Cardoso, G Kourtis, LA Dennis, C Dixon, M Farrell, M Fisher, M Webster - Current Robotics Reports 2021 [https://link.springer.com/article/10.1007/s43154-021-00058-1 link]<br /> * Formal verification of colreg-based navigation of maritime autonomous systems, F Shokri-Manninen, J Vain, M Waldén - Proceedings of SEFM 2020 [https://link.springer.com/chapter/10.1007/978-3-030-58768-0_3 link]<br /> * Compositional verification for autonomous systems with deep learning components, CS Păsăreanu, D Gopinath, H Yu - Safe, Autonomous and Intelligent Vehicles 2019 [https://link.springer.com/chapter/10.1007/978-3-319-97301-2_10 link] <br /> * Recent trends in formal validation and verification of autonomous robots software, F Ingrand - IEEE International Conference on Robotic Computing, 2019 [https://ieeexplore.ieee.org/abstract/document/8675610/ link] <br /> * On-line testing for autonomous systems driven by RISC-V processor design verification, A Ruospo, R Cantoro, E Sanchez, PD Schiavone, A Garofalo, L Benini - IEEE International Symposium on Defect and Fault Tolerance in VLSI and Nanotechnology Systems 2019 [https://ieeexplore.ieee.org/abstract/document/8875345 link]<br /> * Testing, Validation, and Verification of Robotic and Autonomous Systems: A Systematic Review, H Araujo, MR Mousavi, M Varshosaz - ACM Transactions on Software Engineering and Methodology 2022 [https://dl.acm.org/doi/abs/10.1145/3542945 link]<br /> * Verifiable self-aware agent-based autonomous systems, LA Dennis, M Fisher - Proceedings of the IEEE 2020 [https://ieeexplore.ieee.org/abstract/document/9094672 link]<br /> * Reliability and safety of autonomous systems based on semantic modelling for self-certification, O Zaki, M Dunnigan, V Robu, D Flynn - Robotics 2021 [https://www.mdpi.com/2218-6581/10/1/10 link]<br /> * Autonomics: In search of a foundation for next-generation autonomous systems, D Harel, A Marron, J Sifakis - Proceedings of the National Academy of Sciences 2020 [https://www.pnas.org/doi/abs/10.1073/pnas.2003162117 link]<br /> * DIAT: Data Integrity Attestation for Resilient Collaboration of Autonomous Systems, T Abera, R Bahmani, F Brasser, A Ibrahim, AR Sadeghi, M Schunter - NDSS 2019 [https://www.ndss-symposium.org/wp-content/uploads/2019/02/ndss2019_07A-4_Abera_paper.pdf link]<br /> * Neural bridge sampling for evaluating safety-critical autonomous systems, A Sinha, M O&#039;Kelly, R Tedrake, JC Duchi - NeurIPS 2020 [https://proceedings.neurips.cc/paper/2020/hash/475d66314dc56a0df8fb8f7c5dbbaf78-Abstract.html link]<br /> * Security in autonomous systems, S Katzenbeisser, I Polian, F Regazzoni, M Stottinger - IEEE European Test Symposium 2019 [https://ieeexplore.ieee.org/abstract/document/8791552 link]<br /> * Assured Autonomy: Path Toward Living With Autonomous Systems We Can Trust, U Topcu, N Bliss, N Cooke, M Cummings, A Llorens, H Shrobe, L Zuck, arXiv preprint 2020 [https://arxiv.org/abs/2010.14443 link]<br /> * Guidance on the assurance of machine learning in autonomous systems (AMLAS), R Hawkins, C Paterson, C Picardi, Y Jia, R Calinescu, I Habli, arXiv prepring 2021 [https://arxiv.org/abs/2102.01564 link]<br /> * Assured Autonomy Survey, C Rouff, L Watkins - Foundations and Trends in Privacy and Security 2022 [https://www.nowpublishers.com/article/Details/SEC-027 link]<br /> * Autonomous Systems Design: Charting a New Discipline, S Saidi, J Deshmukh, D Ziegenbein, R Ernst - IEEE Design &amp; Test 2021 [https://ieeexplore.ieee.org/abstract/document/9615198 link]<br /> * A Scenario Approach to Risk-Aware Safety-Critical System Verification, P Akella, M Ahmadi, A Ames - ArXiv preprint 2022 [https://arxiv.org/abs/2203.02595 link]</div>

Arinajed https://robotistry.org/vasbok/index.php?title=Portal:Sources&diff=79904 2022-10-04T12:23:19Z

<p>Arinajed: </p> <hr /> <div>;Notes for improvement: organize and structure to better differentiate between documentation, resources (e.g. test ranges and tools), and collaborative activities (e.g. conferences)<br /> <br /> == Standards ==<br /> * 1012-2016 - IEEE Standard for System, Software, and Hardware Verification and Validation [https://ieeexplore.ieee.org/document/8055462]<br /> * P2817 - IEEE Guide for Verification of Autonomous Systems [https://standards.ieee.org/ieee/2817/7644/]<br /> <br /> == Best practices ==<br /> <br /> == Books on verification ==<br /> * Model checking book. E. Clarke<br /> * Other model checking book by Peter Katoen<br /> * Book on software testing/model-based testing<br /> * Artificial Intelligence and Software Testing - Building systems you can trust (2022). Rex Black, James Davenport, Joanna Olszewska, Jeremias Rößler, Adam Leon Smith, Jonathon Wright. Edited by Adam Leon Smith [https://shop.bcs.org/store/221/detail/workgroup?id=3-221-9781780175768 link]<br /> <br /> == Special issues on VAS ==<br /> * Journals<br /> <br /> == Case studies ==<br /> <br /> * Steps and method followed when verifying a system<br /> <br /> <br /> == Whitepapers on autonomous systems V&amp;V from regulators ==<br /> * How to apply V&amp;V to autonomous systems<br /> * How to interpret regulations for different countries<br /> * What remains to be done for regulations<br /> <br /> E.g. <br /> * Reviews on regulations for autonomous systems in Australia<br /> <br /> <br /> == Review or survey papers on V&amp;V ==<br /> * Michael Fisher&#039;s survey paper<br /> * Signe + David Tate&#039;s white paper<br /> <br /> == Existing projects ==<br /> * Metrics [https://metricsproject.eu/] - finding ways to organize competitions that are reproducible, benchmarks to structure robotics competitions, comparing hardware and software together. Applications: healthcare, agriculture, etc.<br /> <br /> == Benchmark models ==<br /> <br /> * Simulink model benchmark for falsification (3 models) <br /> <br /> <br /> == Testing fields &amp; sites/labs ==<br /> * Georgia Tech Robotarium <br /> * Urban search and rescue at Texas A&amp;M<br /> *<br /> <br /> == Robotics &amp; autonomous systems competitions ==<br /> * DARPA<br /> * Autonomous vehicles<br /> * European Robotics League<br /> * ROBOCUP<br /> * AWS Deepracer (deep learning for training autonomous vehicles)<br /> * [https://uavchallenge.org/search-and-rescue/ Australia &amp; New Zealand Search and Rescue]<br /> * SAUC-E - underwater robotics competition<br /> * Robosub<br /> <br /> == Conferences ==<br /> *<br /> <br /> == Patents ==<br /> <br /> == Most recent relevant papers ==<br /> <br /> <br /> * Formal verification of neural network controlled autonomous systems, X Sun, H Khedr, Y Shoukry - Proceedings HSCC 2019 [https://dl.acm.org/doi/abs/10.1145/3302504.3311802 link]<br /> * Towards a framework for certification of reliable autonomous systems, M Fisher, V Mascardi, KY Rozier, BH Schlinglof, M Winikoff, N Yorke-Smith - Autonomous Agents and Multi-Agent Systems 2021 [https://link.springer.com/article/10.1007/s10458-020-09487-2 link]<br /> * Verifying the safety of autonomous systems with neural network controllers, R Ivanov, TJ Carpenter, J Weimer, R Alur, GJ Pappas, I Lee - ACM Transactions on Embedded Computing Systems 2020 [https://dl.acm.org/doi/abs/10.1145/3419742 link]<br /> * A Review of Verification and Validation for Space Autonomous Systems, RC Cardoso, G Kourtis, LA Dennis, C Dixon, M Farrell, M Fisher, M Webster - Current Robotics Reports 2021 [https://link.springer.com/article/10.1007/s43154-021-00058-1 link]<br /> * Formal verification of colreg-based navigation of maritime autonomous systems, F Shokri-Manninen, J Vain, M Waldén - Proceedings of SEFM 2020 [https://link.springer.com/chapter/10.1007/978-3-030-58768-0_3 link]<br /> * Compositional verification for autonomous systems with deep learning components, CS Păsăreanu, D Gopinath, H Yu - Safe, Autonomous and Intelligent Vehicles 2019 [https://link.springer.com/chapter/10.1007/978-3-319-97301-2_10 link] <br /> * Recent trends in formal validation and verification of autonomous robots software, F Ingrand - IEEE International Conference on Robotic Computing, 2019 [https://ieeexplore.ieee.org/abstract/document/8675610/ link] <br /> * On-line testing for autonomous systems driven by RISC-V processor design verification, A Ruospo, R Cantoro, E Sanchez, PD Schiavone, A Garofalo, L Benini - IEEE International Symposium on Defect and Fault Tolerance in VLSI and Nanotechnology Systems 2019 [https://ieeexplore.ieee.org/abstract/document/8875345 link]<br /> * Testing, Validation, and Verification of Robotic and Autonomous Systems: A Systematic Review, H Araujo, MR Mousavi, M Varshosaz - ACM Transactions on Software Engineering and Methodology 2022 [https://dl.acm.org/doi/abs/10.1145/3542945 link]<br /> * Verifiable self-aware agent-based autonomous systems, LA Dennis, M Fisher - Proceedings of the IEEE 2020 [https://ieeexplore.ieee.org/abstract/document/9094672 link]<br /> * Reliability and safety of autonomous systems based on semantic modelling for self-certification, O Zaki, M Dunnigan, V Robu, D Flynn - Robotics 2021 [https://www.mdpi.com/2218-6581/10/1/10 link]<br /> * Autonomics: In search of a foundation for next-generation autonomous systems, D Harel, A Marron, J Sifakis - Proceedings of the National Academy of Sciences 2020 [https://www.pnas.org/doi/abs/10.1073/pnas.2003162117 link]<br /> * DIAT: Data Integrity Attestation for Resilient Collaboration of Autonomous Systems, T Abera, R Bahmani, F Brasser, A Ibrahim, AR Sadeghi, M Schunter - NDSS 2019 [https://www.ndss-symposium.org/wp-content/uploads/2019/02/ndss2019_07A-4_Abera_paper.pdf link]<br /> * Neural bridge sampling for evaluating safety-critical autonomous systems, A Sinha, M O&#039;Kelly, R Tedrake, JC Duchi - NeurIPS 2020 [https://proceedings.neurips.cc/paper/2020/hash/475d66314dc56a0df8fb8f7c5dbbaf78-Abstract.html link]<br /> * Security in autonomous systems, S Katzenbeisser, I Polian, F Regazzoni, M Stottinger - IEEE European Test Symposium 2019 [https://ieeexplore.ieee.org/abstract/document/8791552 link]<br /> * Assured Autonomy: Path Toward Living With Autonomous Systems We Can Trust, U Topcu, N Bliss, N Cooke, M Cummings, A Llorens, H Shrobe, L Zuck, arXiv preprint 2020 [https://arxiv.org/abs/2010.14443 link]<br /> * Guidance on the assurance of machine learning in autonomous systems (AMLAS), R Hawkins, C Paterson, C Picardi, Y Jia, R Calinescu, I Habli, arXiv prepring 2021 [https://arxiv.org/abs/2102.01564 link]<br /> * Assured Autonomy Survey, C Rouff, L Watkins - Foundations and Trends in Privacy and Security 2022 [https://www.nowpublishers.com/article/Details/SEC-027 link]<br /> * Autonomous Systems Design: Charting a New Discipline, S Saidi, J Deshmukh, D Ziegenbein, R Ernst - IEEE Design &amp; Test 2021 [https://ieeexplore.ieee.org/abstract/document/9615198 link]<br /> * A Scenario Approach to Risk-Aware Safety-Critical System Verification, P Akella, M Ahmadi, A Ames - ArXiv preprint 2022 [https://arxiv.org/abs/2203.02595 link]</div>

Arinajed https://robotistry.org/vasbok/index.php?title=Portal:People&diff=79903 2022-10-04T12:19:18Z

<p>Arinajed: </p> <hr /> <div>== Organizations &amp; Large Projects ==<br /> <br /> * [https://verifiability.org/ (UK) Trustworthy Autonomous Systems: Verifiability Node] <br /> <br /> * [https://resilience.tas.ac.uk/ (UK) Trustworthy Autonomous Systems: Resilience Node] <br /> <br /> * [https://tas-security.lancs.ac.uk/ (UK) Trustworthy Autonomous Systems: Security Node] <br /> <br /> * [https://trust.tas.ac.uk/ (UK) Trustworthy Autonomous Systems: Trust Node] <br /> <br /> * [https://www.tas.org/ (UK) Trustworthy Autonomous Systems: Hub] <br /> <br /> * [https://www.york.ac.uk/assuring-autonomy/ (UK) Assuring Autonomy International Programme]<br /> <br /> * [https://www.confiance.ai/en/ (France) Confiance AI]<br /> <br /> == Research Groups ==<br /> <br /> Organize by research focus? <br /> Assign individual glossary pages to individual experts - people should contact the person responsible for that page instead of listing them here? Is this even a good category to have here?<br /> <br /> Applied Research Institute https://www.irt-systemx.fr/en/<br /> <br /> == Agencies ==<br /> <br /> Organize by ... interest? domain? (e.g. US Department of Transportation evaluation of autonomous cars group)</div>

Arinajed https://robotistry.org/vasbok/index.php?title=Portal:People&diff=79902 2022-10-04T12:16:11Z

<p>Arinajed: </p> <hr /> <div>== Organizations &amp; Large Projects ==<br /> <br /> * [https://verifiability.org/ (UK) Trustworthy Autonomous Systems: Verifiability Node] <br /> <br /> * [https://resilience.tas.ac.uk/ (UK) Trustworthy Autonomous Systems: Resilience Node] <br /> <br /> * [https://tas-security.lancs.ac.uk/ (UK) Trustworthy Autonomous Systems: Security Node] <br /> <br /> * [https://trust.tas.ac.uk/ (UK) Trustworthy Autonomous Systems: Trust Node] <br /> <br /> * [https://www.tas.org/ (UK) Trustworthy Autonomous Systems: Hub] <br /> <br /> * [https://www.york.ac.uk/assuring-autonomy/ (UK) Assuring Autonomy International Programme]<br /> <br /> * [ (France) ]<br /> <br /> == Research Groups ==<br /> <br /> Organize by research focus? <br /> Assign individual glossary pages to individual experts - people should contact the person responsible for that page instead of listing them here? Is this even a good category to have here?<br /> <br /> Applied Research Institute https://www.irt-systemx.fr/en/<br /> <br /> == Agencies ==<br /> <br /> Organize by ... interest? domain? (e.g. US Department of Transportation evaluation of autonomous cars group)</div>

Arinajed https://robotistry.org/vasbok/index.php?title=Portal:Sources&diff=79901 2022-10-04T12:13:24Z

<p>Arinajed: </p> <hr /> <div>;Notes for improvement: organize and structure to better differentiate between documentation, resources (e.g. test ranges and tools), and collaborative activities (e.g. conferences)<br /> <br /> == Standards ==<br /> * 1012-2016 - IEEE Standard for System, Software, and Hardware Verification and Validation [https://ieeexplore.ieee.org/document/8055462]<br /> <br /> == Best practices ==<br /> <br /> == Books on verification ==<br /> * Model checking book. E. Clarke<br /> * Other model checking book by Peter Katoen<br /> * Book on software testing/model-based testing<br /> * Artificial Intelligence and Software Testing - Building systems you can trust (2022). Rex Black, James Davenport, Joanna Olszewska, Jeremias Rößler, Adam Leon Smith, Jonathon Wright. Edited by Adam Leon Smith [https://shop.bcs.org/store/221/detail/workgroup?id=3-221-9781780175768 link]<br /> <br /> == Special issues on VAS ==<br /> * Journals<br /> <br /> == Case studies ==<br /> <br /> * Steps and method followed when verifying a system<br /> <br /> <br /> == Whitepapers on autonomous systems V&amp;V from regulators ==<br /> * How to apply V&amp;V to autonomous systems<br /> * How to interpret regulations for different countries<br /> * What remains to be done for regulations<br /> <br /> E.g. <br /> * Reviews on regulations for autonomous systems in Australia<br /> <br /> <br /> == Review or survey papers on V&amp;V ==<br /> * Michael Fisher&#039;s survey paper<br /> * Signe + David Tate&#039;s white paper<br /> <br /> == Existing projects ==<br /> * Metrics [https://metricsproject.eu/] - finding ways to organize competitions that are reproducible, benchmarks to structure robotics competitions, comparing hardware and software together. Applications: healthcare, agriculture, etc.<br /> <br /> == Benchmark models ==<br /> <br /> * Simulink model benchmark for falsification (3 models) <br /> <br /> <br /> == Testing fields &amp; sites/labs ==<br /> * Georgia Tech Robotarium <br /> * Urban search and rescue at Texas A&amp;M<br /> *<br /> <br /> == Robotics &amp; autonomous systems competitions ==<br /> * DARPA<br /> * Autonomous vehicles<br /> * European Robotics League<br /> * ROBOCUP<br /> * AWS Deepracer (deep learning for training autonomous vehicles)<br /> * [https://uavchallenge.org/search-and-rescue/ Australia &amp; New Zealand Search and Rescue]<br /> * SAUC-E - underwater robotics competition<br /> * Robosub<br /> <br /> == Conferences ==<br /> *<br /> <br /> == Patents ==<br /> <br /> == Most recent relevant papers ==<br /> <br /> <br /> * Formal verification of neural network controlled autonomous systems, X Sun, H Khedr, Y Shoukry - Proceedings HSCC 2019 [https://dl.acm.org/doi/abs/10.1145/3302504.3311802 link]<br /> * Towards a framework for certification of reliable autonomous systems, M Fisher, V Mascardi, KY Rozier, BH Schlinglof, M Winikoff, N Yorke-Smith - Autonomous Agents and Multi-Agent Systems 2021 [https://link.springer.com/article/10.1007/s10458-020-09487-2 link]<br /> * Verifying the safety of autonomous systems with neural network controllers, R Ivanov, TJ Carpenter, J Weimer, R Alur, GJ Pappas, I Lee - ACM Transactions on Embedded Computing Systems 2020 [https://dl.acm.org/doi/abs/10.1145/3419742 link]<br /> * A Review of Verification and Validation for Space Autonomous Systems, RC Cardoso, G Kourtis, LA Dennis, C Dixon, M Farrell, M Fisher, M Webster - Current Robotics Reports 2021 [https://link.springer.com/article/10.1007/s43154-021-00058-1 link]<br /> * Formal verification of colreg-based navigation of maritime autonomous systems, F Shokri-Manninen, J Vain, M Waldén - Proceedings of SEFM 2020 [https://link.springer.com/chapter/10.1007/978-3-030-58768-0_3 link]<br /> * Compositional verification for autonomous systems with deep learning components, CS Păsăreanu, D Gopinath, H Yu - Safe, Autonomous and Intelligent Vehicles 2019 [https://link.springer.com/chapter/10.1007/978-3-319-97301-2_10 link] <br /> * Recent trends in formal validation and verification of autonomous robots software, F Ingrand - IEEE International Conference on Robotic Computing, 2019 [https://ieeexplore.ieee.org/abstract/document/8675610/ link] <br /> * On-line testing for autonomous systems driven by RISC-V processor design verification, A Ruospo, R Cantoro, E Sanchez, PD Schiavone, A Garofalo, L Benini - IEEE International Symposium on Defect and Fault Tolerance in VLSI and Nanotechnology Systems 2019 [https://ieeexplore.ieee.org/abstract/document/8875345 link]<br /> * Testing, Validation, and Verification of Robotic and Autonomous Systems: A Systematic Review, H Araujo, MR Mousavi, M Varshosaz - ACM Transactions on Software Engineering and Methodology 2022 [https://dl.acm.org/doi/abs/10.1145/3542945 link]<br /> * Verifiable self-aware agent-based autonomous systems, LA Dennis, M Fisher - Proceedings of the IEEE 2020 [https://ieeexplore.ieee.org/abstract/document/9094672 link]<br /> * Reliability and safety of autonomous systems based on semantic modelling for self-certification, O Zaki, M Dunnigan, V Robu, D Flynn - Robotics 2021 [https://www.mdpi.com/2218-6581/10/1/10 link]<br /> * Autonomics: In search of a foundation for next-generation autonomous systems, D Harel, A Marron, J Sifakis - Proceedings of the National Academy of Sciences 2020 [https://www.pnas.org/doi/abs/10.1073/pnas.2003162117 link]<br /> * DIAT: Data Integrity Attestation for Resilient Collaboration of Autonomous Systems, T Abera, R Bahmani, F Brasser, A Ibrahim, AR Sadeghi, M Schunter - NDSS 2019 [https://www.ndss-symposium.org/wp-content/uploads/2019/02/ndss2019_07A-4_Abera_paper.pdf link]<br /> * Neural bridge sampling for evaluating safety-critical autonomous systems, A Sinha, M O&#039;Kelly, R Tedrake, JC Duchi - NeurIPS 2020 [https://proceedings.neurips.cc/paper/2020/hash/475d66314dc56a0df8fb8f7c5dbbaf78-Abstract.html link]<br /> * Security in autonomous systems, S Katzenbeisser, I Polian, F Regazzoni, M Stottinger - IEEE European Test Symposium 2019 [https://ieeexplore.ieee.org/abstract/document/8791552 link]<br /> * Assured Autonomy: Path Toward Living With Autonomous Systems We Can Trust, U Topcu, N Bliss, N Cooke, M Cummings, A Llorens, H Shrobe, L Zuck, arXiv preprint 2020 [https://arxiv.org/abs/2010.14443 link]<br /> * Guidance on the assurance of machine learning in autonomous systems (AMLAS), R Hawkins, C Paterson, C Picardi, Y Jia, R Calinescu, I Habli, arXiv prepring 2021 [https://arxiv.org/abs/2102.01564 link]<br /> * Assured Autonomy Survey, C Rouff, L Watkins - Foundations and Trends in Privacy and Security 2022 [https://www.nowpublishers.com/article/Details/SEC-027 link]<br /> * Autonomous Systems Design: Charting a New Discipline, S Saidi, J Deshmukh, D Ziegenbein, R Ernst - IEEE Design &amp; Test 2021 [https://ieeexplore.ieee.org/abstract/document/9615198 link]<br /> * A Scenario Approach to Risk-Aware Safety-Critical System Verification, P Akella, M Ahmadi, A Ames - ArXiv preprint 2022 [https://arxiv.org/abs/2203.02595 link]</div>

Arinajed https://robotistry.org/vasbok/index.php?title=Portal:Tools&diff=79900 2022-09-23T06:15:59Z

<p>Arinajed: </p> <hr /> <div>&lt;big&gt;Verification of Autonomous Systems -- A Selection of Tools and Processes &lt;/big&gt;<br /> <br /> == Latest technical innovations ==<br /> * Verification of autonomous systems that are able to learn and adapt to their environmental conditions through testing or formal methods. Verifying autonomous systems that learn goes beyond verifying neural networks or deep learning models, a more dedicated verification topic that has started to occupy the research space for the last 5 to 10 years. <br /> * Industrial effort on the verification of autonomous vehicles for public deployment (e.g. autonomous cars, autonomous water vehicles, and drones). This means a documented large scale application of verification tools and methods by companies. <br /> * Specifications of large-scale autonomous systems through the richness of formal languages and ontologies. A careful balance between expressiveness and formalism is required to describe and model the wide range of behaviours of an autonomous system in the wild<br /> * The latest version of the verification tool UPPAAL [https://www.it.uu.se/research/group/darts/uppaal/index.shtml link], the tool C2E2 [https://publish.illinois.edu/c2e2-tool/ link], and tools mentioned in the Assured Autonomy compendium [https://assured-autonomy.org/tools link], in particular, VerifAI, Scenic, and Overt/OvertVerify. These tools exemplify the cutting-edge innovation in Verification of Autonomous Systems. <br /> <br /> <br /> == Tools ==<br /> <br /> === Specification &amp; Modelling ===<br /> * Modelling of Robotic Systems: [https://www.cs.york.ac.uk/robostar/robotool/ RoboTool]<br /> * Modelling of Robotic Systems: [https://redmine.laas.fr/projects/genom3-fiacre-template/gollum/index GenoM]<br /> * Executable Agent Specifications: [https://www.csc.liv.ac.uk/~michael/TLBook/MetateM-System/ Concurrent MetateM] (not maintained)<br /> <br /> [[Portal:Sources#Title 1|Title 1]]<br /> <br /> === Formal Verification ===<br /> * Program model-checking of agent-based Autonomous Systems: [https://autonomy-and-verification.github.io/tools/mcapl MCAPL]<br /> * Robustness analyzer for Neural Networks: [https://github.com/eth-sri/eran ERAN]<br /> * SMT solver for Neural Networks: [https://github.com/NeuralNetworkVerification/Marabou Marabou]<br /> * Theorem prover for Cyber-Physical Systems: [http://www.ls.cs.cmu.edu/KeYmaeraX/ KeYmaera X]<br /> <br /> === Software Testing ===<br /> * Conformance testing of Cyber-Physical Systems: [https://github.com/hlsa/HyConf HyConf]<br /> <br /> ==== Concolic Testing ==== <br /> Concolic testing alternates between concrete examples and symbolic analysis. <br /> * Concolic testing for Deep Neural Networks: [https://github.com/xiaoweih/DeepConcolic DeepConcolic]<br /> <br /> <br /> === Physical Testing ===<br /> * Physical integration testing for ROS 2: [https://github.com/FlorisE/rospit2/blob/main/README.md ROSPIT]<br /> <br /> <br /> === Runtime Verification ===<br /> * Runtime verification for Robot Operating System (ROS): [https://github.com/autonomy-and-verification-uol/ROSMonitoring ROSMonitoring]<br /> * Runtime verification of Robotic Systems: [https://github.com/autonomy-and-verification-uol/varanus Varanus]<br /> * Runtime verification for Robot Operating System (ROS): [https://github.com/Formal-Systems-Laboratory/ROSRV ROSRV]<br /> <br /> === Multi-purpose verification tools ===<br /> * [https://github.com/decyphir/breach Breach]<br /> ** How to write STL requirements<br /> ** Falsification of STL requirements<br /> ** Monitoring for STL formulae<br /> ** Interfacing with Simulink models using the toolbox<br /> ** Available in Github<br /> <br /> * [https://sites.google.com/a/asu.edu/s-taliro/s-taliro S-Taliro] <br /> ** Verification<br /> ** Conformance testing<br /> ** MATLAB toolbox<br /> <br /> * [https://gitlab.com/sbtg/psy-taliro PSY-Taliro]<br /> ** Python toolbox for S-Taliro <br /> ** Available on Gitlab<br /> ** [https://link.springer.com/chapter/10.1007/978-3-030-85248-1_15 Paper reference]<br /> <br /> <br /> <br /> == Processes ==<br /> * Model after the Guide on VAS but more detailed<br /> * Refer to standards on verification processes (double V model, software verification, cybersecurity(?), assurance cases, etc.)<br /> * This can link back to tools sections<br /> <br /> === Specifications ===<br /> === Formal methods ===<br /> === Assurance cases ===<br /> === Testing ===</div>

Arinajed https://robotistry.org/vasbok/index.php?title=Portal:Sources&diff=79899 2022-09-20T04:29:52Z

<p>Arinajed: </p> <hr /> <div>;Notes for improvement: organize and structure to better differentiate between documentation, resources (e.g. test ranges and tools), and collaborative activities (e.g. conferences)<br /> <br /> == Standards ==<br /> * 1012-2016 - IEEE Standard for System, Software, and Hardware Verification and Validation [https://ieeexplore.ieee.org/document/8055462]<br /> <br /> == Best practices ==<br /> <br /> == Books on verification ==<br /> * Model checking book. E. Clarke<br /> * Other model checking book by Peter Katoen<br /> * Book on software testing/model-based testing<br /> * Artificial Intelligence and Software Testing - Building systems you can trust (2022). Rex Black, James Davenport, Joanna Olszewska, Jeremias Rößler, Adam Leon Smith, Jonathon Wright. Edited by Adam Leon Smith [https://shop.bcs.org/store/221/detail/workgroup?id=3-221-9781780175768 link]<br /> <br /> == Special issues on VAS ==<br /> * Journals<br /> <br /> == Case studies ==<br /> <br /> * Steps and method followed when verifying a system<br /> <br /> <br /> == Whitepapers on autonomous systems V&amp;V from regulators ==<br /> * How to apply V&amp;V to autonomous systems<br /> * How to interpret regulations for different countries<br /> * What remains to be done for regulations<br /> <br /> E.g. <br /> * Reviews on regulations for autonomous systems in Australia<br /> <br /> <br /> == Review or survey papers on V&amp;V ==<br /> * Michael Fisher&#039;s survey paper<br /> * Signe + David Tate&#039;s white paper<br /> <br /> == Existing projects ==<br /> * Metrics [https://metricsproject.eu/] - finding ways to organize competitions that are reproducible, benchmarks to structure robotics competitions, comparing hardware and software together. Applications: healthcare, agriculture, etc.<br /> <br /> == Benchmark models ==<br /> <br /> * Simulink model benchmark for falsification (3 models) <br /> <br /> <br /> == Testing fields &amp; sites/labs ==<br /> * Georgia Tech Robotarium <br /> * Urban search and rescue at Texas A&amp;M<br /> *<br /> <br /> == Robotics &amp; autonomous systems competitions ==<br /> * DARPA<br /> * Autonomous vehicles<br /> * European Robotics League<br /> * ROBOCUP<br /> * AWS Deepracer (deep learning for training autonomous vehicles)<br /> * [https://uavchallenge.org/search-and-rescue/ Australia &amp; New Zealand Search and Rescue]<br /> * SAUC-E - underwater robotics competition<br /> * Robosub<br /> <br /> == Conferences ==<br /> *<br /> <br /> == Most recent relevant papers ==<br /> <br /> <br /> * Formal verification of neural network controlled autonomous systems, X Sun, H Khedr, Y Shoukry - Proceedings HSCC 2019 [https://dl.acm.org/doi/abs/10.1145/3302504.3311802 link]<br /> * Towards a framework for certification of reliable autonomous systems, M Fisher, V Mascardi, KY Rozier, BH Schlinglof, M Winikoff, N Yorke-Smith - Autonomous Agents and Multi-Agent Systems 2021 [https://link.springer.com/article/10.1007/s10458-020-09487-2 link]<br /> * Verifying the safety of autonomous systems with neural network controllers, R Ivanov, TJ Carpenter, J Weimer, R Alur, GJ Pappas, I Lee - ACM Transactions on Embedded Computing Systems 2020 [https://dl.acm.org/doi/abs/10.1145/3419742 link]<br /> * A Review of Verification and Validation for Space Autonomous Systems, RC Cardoso, G Kourtis, LA Dennis, C Dixon, M Farrell, M Fisher, M Webster - Current Robotics Reports 2021 [https://link.springer.com/article/10.1007/s43154-021-00058-1 link]<br /> * Formal verification of colreg-based navigation of maritime autonomous systems, F Shokri-Manninen, J Vain, M Waldén - Proceedings of SEFM 2020 [https://link.springer.com/chapter/10.1007/978-3-030-58768-0_3 link]<br /> * Compositional verification for autonomous systems with deep learning components, CS Păsăreanu, D Gopinath, H Yu - Safe, Autonomous and Intelligent Vehicles 2019 [https://link.springer.com/chapter/10.1007/978-3-319-97301-2_10 link] <br /> * Recent trends in formal validation and verification of autonomous robots software, F Ingrand - IEEE International Conference on Robotic Computing, 2019 [https://ieeexplore.ieee.org/abstract/document/8675610/ link] <br /> * On-line testing for autonomous systems driven by RISC-V processor design verification, A Ruospo, R Cantoro, E Sanchez, PD Schiavone, A Garofalo, L Benini - IEEE International Symposium on Defect and Fault Tolerance in VLSI and Nanotechnology Systems 2019 [https://ieeexplore.ieee.org/abstract/document/8875345 link]<br /> * Testing, Validation, and Verification of Robotic and Autonomous Systems: A Systematic Review, H Araujo, MR Mousavi, M Varshosaz - ACM Transactions on Software Engineering and Methodology 2022 [https://dl.acm.org/doi/abs/10.1145/3542945 link]<br /> * Verifiable self-aware agent-based autonomous systems, LA Dennis, M Fisher - Proceedings of the IEEE 2020 [https://ieeexplore.ieee.org/abstract/document/9094672 link]<br /> * Reliability and safety of autonomous systems based on semantic modelling for self-certification, O Zaki, M Dunnigan, V Robu, D Flynn - Robotics 2021 [https://www.mdpi.com/2218-6581/10/1/10 link]<br /> * Autonomics: In search of a foundation for next-generation autonomous systems, D Harel, A Marron, J Sifakis - Proceedings of the National Academy of Sciences 2020 [https://www.pnas.org/doi/abs/10.1073/pnas.2003162117 link]<br /> * DIAT: Data Integrity Attestation for Resilient Collaboration of Autonomous Systems, T Abera, R Bahmani, F Brasser, A Ibrahim, AR Sadeghi, M Schunter - NDSS 2019 [https://www.ndss-symposium.org/wp-content/uploads/2019/02/ndss2019_07A-4_Abera_paper.pdf link]<br /> * Neural bridge sampling for evaluating safety-critical autonomous systems, A Sinha, M O&#039;Kelly, R Tedrake, JC Duchi - NeurIPS 2020 [https://proceedings.neurips.cc/paper/2020/hash/475d66314dc56a0df8fb8f7c5dbbaf78-Abstract.html link]<br /> * Security in autonomous systems, S Katzenbeisser, I Polian, F Regazzoni, M Stottinger - IEEE European Test Symposium 2019 [https://ieeexplore.ieee.org/abstract/document/8791552 link]<br /> * Assured Autonomy: Path Toward Living With Autonomous Systems We Can Trust, U Topcu, N Bliss, N Cooke, M Cummings, A Llorens, H Shrobe, L Zuck, arXiv preprint 2020 [https://arxiv.org/abs/2010.14443 link]<br /> * Guidance on the assurance of machine learning in autonomous systems (AMLAS), R Hawkins, C Paterson, C Picardi, Y Jia, R Calinescu, I Habli, arXiv prepring 2021 [https://arxiv.org/abs/2102.01564 link]<br /> * Assured Autonomy Survey, C Rouff, L Watkins - Foundations and Trends in Privacy and Security 2022 [https://www.nowpublishers.com/article/Details/SEC-027 link]<br /> * Autonomous Systems Design: Charting a New Discipline, S Saidi, J Deshmukh, D Ziegenbein, R Ernst - IEEE Design &amp; Test 2021 [https://ieeexplore.ieee.org/abstract/document/9615198 link]<br /> * A Scenario Approach to Risk-Aware Safety-Critical System Verification, P Akella, M Ahmadi, A Ames - ArXiv preprint 2022 [https://arxiv.org/abs/2203.02595 link]</div>

Arinajed https://robotistry.org/vasbok/index.php?title=Portal:Tools&diff=79898 2022-09-19T15:17:41Z

<p>Arinajed: </p> <hr /> <div>&lt;big&gt;Verification of Autonomous Systems -- A Selection of Tools and Processes &lt;/big&gt;<br /> <br /> == Latest technical innovations ==<br /> * Verification of autonomous systems that are able to learn and adapt to their environmental conditions through testing or formal methods. Verifying autonomous systems that learn goes beyond verifying neural networks or deep learning models, a more dedicated verification topic that has started to occupy the research space for the last 5 to 10 years. <br /> * Industrial effort on the verification of autonomous vehicles for public deployment (e.g. autonomous cars, autonomous water vehicles, and drones). This means a documented large scale application of verification tools and methods by companies. <br /> * Specifications of large-scale autonomous systems through the richness of formal languages and ontologies. A careful balance between expressiveness and formalism is required to describe and model the wide range of behaviours of an autonomous system in the wild<br /> <br /> <br /> == Tools ==<br /> <br /> === Specification &amp; Modelling ===<br /> * Modelling of Robotic Systems: [https://www.cs.york.ac.uk/robostar/robotool/ RoboTool]<br /> * Modelling of Robotic Systems: [https://redmine.laas.fr/projects/genom3-fiacre-template/gollum/index GenoM]<br /> * Executable Agent Specifications: [https://www.csc.liv.ac.uk/~michael/TLBook/MetateM-System/ Concurrent MetateM] (not maintained)<br /> <br /> [[Portal:Sources#Title 1|Title 1]]<br /> <br /> === Formal Verification ===<br /> * Program model-checking of agent-based Autonomous Systems: [https://autonomy-and-verification.github.io/tools/mcapl MCAPL]<br /> * Robustness analyzer for Neural Networks: [https://github.com/eth-sri/eran ERAN]<br /> * SMT solver for Neural Networks: [https://github.com/NeuralNetworkVerification/Marabou Marabou]<br /> * Theorem prover for Cyber-Physical Systems: [http://www.ls.cs.cmu.edu/KeYmaeraX/ KeYmaera X]<br /> <br /> === Software Testing ===<br /> * Conformance testing of Cyber-Physical Systems: [https://github.com/hlsa/HyConf HyConf]<br /> <br /> ==== Concolic Testing ==== <br /> Concolic testing alternates between concrete examples and symbolic analysis. <br /> * Concolic testing for Deep Neural Networks: [https://github.com/xiaoweih/DeepConcolic DeepConcolic]<br /> <br /> <br /> === Physical Testing ===<br /> * Physical integration testing for ROS 2: [https://github.com/FlorisE/rospit2/blob/main/README.md ROSPIT]<br /> <br /> <br /> === Runtime Verification ===<br /> * Runtime verification for Robot Operating System (ROS): [https://github.com/autonomy-and-verification-uol/ROSMonitoring ROSMonitoring]<br /> * Runtime verification of Robotic Systems: [https://github.com/autonomy-and-verification-uol/varanus Varanus]<br /> * Runtime verification for Robot Operating System (ROS): [https://github.com/Formal-Systems-Laboratory/ROSRV ROSRV]<br /> <br /> === Multi-purpose verification tools ===<br /> * [https://github.com/decyphir/breach Breach]<br /> ** How to write STL requirements<br /> ** Falsification of STL requirements<br /> ** Monitoring for STL formulae<br /> ** Interfacing with Simulink models using the toolbox<br /> ** Available in Github<br /> <br /> * [https://sites.google.com/a/asu.edu/s-taliro/s-taliro S-Taliro] <br /> ** Verification<br /> ** Conformance testing<br /> ** MATLAB toolbox<br /> <br /> * [https://gitlab.com/sbtg/psy-taliro PSY-Taliro]<br /> ** Python toolbox for S-Taliro <br /> ** Available on Gitlab<br /> ** [https://link.springer.com/chapter/10.1007/978-3-030-85248-1_15 Paper reference]<br /> <br /> <br /> <br /> == Processes ==<br /> * Model after the Guide on VAS but more detailed<br /> * Refer to standards on verification processes (double V model, software verification, cybersecurity(?), assurance cases, etc.)<br /> * This can link back to tools sections<br /> <br /> === Specifications ===<br /> === Formal methods ===<br /> === Assurance cases ===<br /> === Testing ===</div>

Arinajed https://robotistry.org/vasbok/index.php?title=Portal:Sources&diff=79897 2022-09-19T15:11:32Z

<p>Arinajed: </p> <hr /> <div>;Notes for improvement: organize and structure to better differentiate between documentation, resources (e.g. test ranges and tools), and collaborative activities (e.g. conferences)<br /> <br /> == Standards ==<br /> * 1012-2016 - IEEE Standard for System, Software, and Hardware Verification and Validation [https://ieeexplore.ieee.org/document/8055462]<br /> <br /> == Best practices ==<br /> <br /> == Books on verification ==<br /> * Model checking book. E. Clarke<br /> * Other model checking book by Peter Katoen<br /> * Book on software testing/model-based testing<br /> * Artificial Intelligence and Software Testing - Building systems you can trust (2022). Rex Black, James Davenport, Joanna Olszewska, Jeremias Rößler, Adam Leon Smith, Jonathon Wright. Edited by Adam Leon Smith [https://shop.bcs.org/store/221/detail/workgroup?id=3-221-9781780175768 link]<br /> <br /> == Special issues on VAS ==<br /> * Journals<br /> <br /> == Case studies ==<br /> <br /> * Steps and method followed when verifying a system<br /> <br /> <br /> == Whitepapers on autonomous systems V&amp;V from regulators ==<br /> * How to apply V&amp;V to autonomous systems<br /> * How to interpret regulations for different countries<br /> * What remains to be done for regulations<br /> <br /> E.g. <br /> * Reviews on regulations for autonomous systems in Australia<br /> <br /> <br /> == Review or survey papers on V&amp;V ==<br /> * Michael Fisher&#039;s survey paper<br /> * Signe + David Tate&#039;s white paper<br /> <br /> == Existing projects ==<br /> * Metrics [https://metricsproject.eu/] - finding ways to organize competitions that are reproducible, benchmarks to structure robotics competitions, comparing hardware and software together. Applications: healthcare, agriculture, etc.<br /> <br /> == Benchmark models ==<br /> <br /> * Simulink model benchmark for falsification (3 models) <br /> <br /> <br /> == Testing fields &amp; sites/labs ==<br /> * Georgia Tech Robotarium <br /> * Urban search and rescue at Texas A&amp;M<br /> *<br /> <br /> == Robotics &amp; autonomous systems competitions ==<br /> * DARPA<br /> * Autonomous vehicles<br /> * European Robotics League<br /> * ROBOCUP<br /> * AWS Deepracer (deep learning for training autonomous vehicles)<br /> * [https://uavchallenge.org/search-and-rescue/ Australia &amp; New Zealand Search and Rescue]<br /> * SAUC-E - underwater robotics competition<br /> * Robosub<br /> <br /> == Conferences ==<br /> *<br /> <br /> == Most recent relevant papers ==<br /> <br /> <br /> * Formal verification of neural network controlled autonomous systems, X Sun, H Khedr, Y Shoukry - Proceedings HSCC 2019 [https://dl.acm.org/doi/abs/10.1145/3302504.3311802 link]<br /> * Towards a framework for certification of reliable autonomous systems, M Fisher, V Mascardi, KY Rozier, BH Schlinglof, M Winikoff, N Yorke-Smith - Autonomous Agents and Multi-Agent Systems 2021 [https://link.springer.com/article/10.1007/s10458-020-09487-2 link]<br /> * Verifying the safety of autonomous systems with neural network controllers, R Ivanov, TJ Carpenter, J Weimer, R Alur, GJ Pappas, I Lee - ACM Transactions on Embedded Computing Systems 2020 [https://dl.acm.org/doi/abs/10.1145/3419742 link]<br /> * A Review of Verification and Validation for Space Autonomous Systems, RC Cardoso, G Kourtis, LA Dennis, C Dixon, M Farrell, M Fisher, M Webster - Current Robotics Reports 2021 [https://link.springer.com/article/10.1007/s43154-021-00058-1 link]<br /> * Formal verification of colreg-based navigation of maritime autonomous systems, F Shokri-Manninen, J Vain, M Waldén - Proceedings of SEFM 2020 [https://link.springer.com/chapter/10.1007/978-3-030-58768-0_3 link]<br /> * Compositional verification for autonomous systems with deep learning components, CS Păsăreanu, D Gopinath, H Yu - Safe, Autonomous and Intelligent Vehicles 2019 [https://link.springer.com/chapter/10.1007/978-3-319-97301-2_10 link] <br /> * Recent trends in formal validation and verification of autonomous robots software, F Ingrand - IEEE International Conference on Robotic Computing, 2019 [https://ieeexplore.ieee.org/abstract/document/8675610/ link] <br /> * On-line testing for autonomous systems driven by RISC-V processor design verification, A Ruospo, R Cantoro, E Sanchez, PD Schiavone, A Garofalo, L Benini - IEEE International Symposium on Defect and Fault Tolerance in VLSI and Nanotechnology Systems 2019 [https://ieeexplore.ieee.org/abstract/document/8875345 link]<br /> * Testing, Validation, and Verification of Robotic and Autonomous Systems: A Systematic Review, H Araujo, MR Mousavi, M Varshosaz - ACM Transactions on Software Engineering and Methodology 2022 [https://dl.acm.org/doi/abs/10.1145/3542945 link]<br /> * Verifiable self-aware agent-based autonomous systems, LA Dennis, M Fisher - Proceedings of the IEEE 2020 [https://ieeexplore.ieee.org/abstract/document/9094672 link]<br /> * Reliability and safety of autonomous systems based on semantic modelling for self-certification, O Zaki, M Dunnigan, V Robu, D Flynn - Robotics 2021 [https://www.mdpi.com/2218-6581/10/1/10 link]<br /> * Autonomics: In search of a foundation for next-generation autonomous systems, D Harel, A Marron, J Sifakis - Proceedings of the National Academy of Sciences 2020 [https://www.pnas.org/doi/abs/10.1073/pnas.2003162117 link]<br /> * DIAT: Data Integrity Attestation for Resilient Collaboration of Autonomous Systems, T Abera, R Bahmani, F Brasser, A Ibrahim, AR Sadeghi, M Schunter - NDSS 2019 [https://www.ndss-symposium.org/wp-content/uploads/2019/02/ndss2019_07A-4_Abera_paper.pdf link]<br /> * Neural bridge sampling for evaluating safety-critical autonomous systems, A Sinha, M O&#039;Kelly, R Tedrake, JC Duchi - NeurIPS 2020 [https://proceedings.neurips.cc/paper/2020/hash/475d66314dc56a0df8fb8f7c5dbbaf78-Abstract.html link]<br /> * Security in autonomous systems, S Katzenbeisser, I Polian, F Regazzoni, M Stottinger - IEEE European Test Symposium 2019 [https://ieeexplore.ieee.org/abstract/document/8791552 link]<br /> * Assured Autonomy: Path Toward Living With Autonomous Systems We Can Trust, U Topcu, N Bliss, N Cooke, M Cummings, A Llorens, H Shrobe, L Zuck, arXiv preprint 2020 [https://arxiv.org/abs/2010.14443 link]<br /> * Guidance on the assurance of machine learning in autonomous systems (AMLAS), R Hawkins, C Paterson, C Picardi, Y Jia, R Calinescu, I Habli, arXiv prepring 2021 [https://arxiv.org/abs/2102.01564 link]</div>

Arinajed https://robotistry.org/vasbok/index.php?title=Portal:Sources&diff=79896 2022-09-19T15:11:09Z

<p>Arinajed: </p> <hr /> <div>;Notes for improvement: organize and structure to better differentiate between documentation, resources (e.g. test ranges and tools), and collaborative activities (e.g. conferences)<br /> <br /> == Standards ==<br /> * 1012-2016 - IEEE Standard for System, Software, and Hardware Verification and Validation [https://ieeexplore.ieee.org/document/8055462]<br /> <br /> == Best practices ==<br /> <br /> == Books on verification ==<br /> * Model checking book. E. Clarke<br /> * Other model checking book by Peter Katoen<br /> * Book on software testing/model-based testing<br /> * Artificial Intelligence and Software Testing - Building systems you can trust (2022). Rex Black, James Davenport, Joanna Olszewska, Jeremias Rößler, Adam Leon Smith, Jonathon Wright. Edited by Adam Leon Smith [https://shop.bcs.org/store/221/detail/workgroup?id=3-221-9781780175768 link]<br /> <br /> == Special issues on VAS ==<br /> * Journals<br /> <br /> == Case studies ==<br /> <br /> * Steps and method followed when verifying a system<br /> <br /> <br /> == Whitepapers on autonomous systems V&amp;V from regulators ==<br /> * How to apply V&amp;V to autonomous systems<br /> * How to interpret regulations for different countries<br /> * What remains to be done for regulations<br /> <br /> E.g. <br /> * Reviews on regulations for autonomous systems in Australia<br /> <br /> <br /> == Review or survey papers on V&amp;V ==<br /> * Michael Fisher&#039;s survey paper<br /> * Signe + David Tate&#039;s white paper<br /> <br /> == Existing projects ==<br /> * Metrics [https://metricsproject.eu/] - finding ways to organize competitions that are reproducible, benchmarks to structure robotics competitions, comparing hardware and software together. Applications: healthcare, agriculture, etc.<br /> <br /> == Benchmark models ==<br /> <br /> * Simulink model benchmark for falsification (3 models) <br /> <br /> <br /> == Testing fields &amp; sites/labs ==<br /> * Georgia Tech Robotarium <br /> * Urban search and rescue at Texas A&amp;M<br /> *<br /> <br /> == Robotics &amp; autonomous systems competitions ==<br /> * DARPA<br /> * Autonomous vehicles<br /> * European Robotics League<br /> * ROBOCUP<br /> * AWS Deepracer (deep learning for training autonomous vehicles)<br /> * [https://uavchallenge.org/search-and-rescue/ Australia &amp; New Zealand Search and Rescue]<br /> * SAUC-E - underwater robotics competition<br /> * Robosub<br /> <br /> == Conferences ==<br /> *<br /> <br /> == Most recent relevant papers ==<br /> <br /> <br /> * Formal verification of neural network controlled autonomous systems, X Sun, H Khedr, Y Shoukry - Proceedings HSCC 2019 [https://dl.acm.org/doi/abs/10.1145/3302504.3311802 link]<br /> * Towards a framework for certification of reliable autonomous systems, M Fisher, V Mascardi, KY Rozier, BH Schlinglof, M Winikoff, N Yorke-Smith - Autonomous Agents and Multi-Agent Systems 2021 [https://link.springer.com/article/10.1007/s10458-020-09487-2 link]<br /> * Verifying the safety of autonomous systems with neural network controllers, R Ivanov, TJ Carpenter, J Weimer, R Alur, GJ Pappas, I Lee - ACM Transactions on Embedded Computing Systems 2020 [https://dl.acm.org/doi/abs/10.1145/3419742 link]<br /> * A Review of Verification and Validation for Space Autonomous Systems, RC Cardoso, G Kourtis, LA Dennis, C Dixon, M Farrell, M Fisher, M Webster - Current Robotics Reports 2021 [https://link.springer.com/article/10.1007/s43154-021-00058-1 link]<br /> * Formal verification of colreg-based navigation of maritime autonomous systems, F Shokri-Manninen, J Vain, M Waldén - Proceedings of SEFM 2020 [https://link.springer.com/chapter/10.1007/978-3-030-58768-0_3 link]<br /> * Compositional verification for autonomous systems with deep learning components, CS Păsăreanu, D Gopinath, H Yu - Safe, Autonomous and Intelligent Vehicles 2019 [https://link.springer.com/chapter/10.1007/978-3-319-97301-2_10 link] <br /> * Recent trends in formal validation and verification of autonomous robots software, F Ingrand - IEEE International Conference on Robotic Computing, 2019 [https://ieeexplore.ieee.org/abstract/document/8675610/ link] <br /> * On-line testing for autonomous systems driven by RISC-V processor design verification, A Ruospo, R Cantoro, E Sanchez, PD Schiavone, A Garofalo, L Benini - IEEE International Symposium on Defect and Fault Tolerance in VLSI and Nanotechnology Systems 2019 [https://ieeexplore.ieee.org/abstract/document/8875345 link]<br /> * Testing, Validation, and Verification of Robotic and Autonomous Systems: A Systematic Review, H Araujo, MR Mousavi, M Varshosaz - ACM Transactions on Software Engineering and Methodology 2022 [https://dl.acm.org/doi/abs/10.1145/3542945 link]<br /> * Verifiable self-aware agent-based autonomous systems, LA Dennis, M Fisher - Proceedings of the IEEE 2020 [https://ieeexplore.ieee.org/abstract/document/9094672 link]<br /> * Reliability and safety of autonomous systems based on semantic modelling for self-certification, O Zaki, M Dunnigan, V Robu, D Flynn - Robotics 2021 [https://www.mdpi.com/2218-6581/10/1/10 link]<br /> * Autonomics: In search of a foundation for next-generation autonomous systems, D Harel, A Marron, J Sifakis - Proceedings of the National Academy of Sciences 2020 [https://www.pnas.org/doi/abs/10.1073/pnas.2003162117 link]<br /> * DIAT: Data Integrity Attestation for Resilient Collaboration of Autonomous Systems, T Abera, R Bahmani, F Brasser, A Ibrahim, AR Sadeghi, M Schunter - NDSS 2019 [https://www.ndss-symposium.org/wp-content/uploads/2019/02/ndss2019_07A-4_Abera_paper.pdf link]<br /> * Neural bridge sampling for evaluating safety-critical autonomous systems<br /> A Sinha, M O&#039;Kelly, R Tedrake, JC Duchi - NeurIPS 2020 [https://proceedings.neurips.cc/paper/2020/hash/475d66314dc56a0df8fb8f7c5dbbaf78-Abstract.html link]<br /> * Security in autonomous systems, S Katzenbeisser, I Polian, F Regazzoni, M Stottinger - IEEE European Test Symposium 2019 [https://ieeexplore.ieee.org/abstract/document/8791552 link]<br /> * Assured Autonomy: Path Toward Living With Autonomous Systems We Can Trust, U Topcu, N Bliss, N Cooke, M Cummings, A Llorens, H Shrobe, L Zuck, arXiv preprint 2020 [https://arxiv.org/abs/2010.14443 link]<br /> * Guidance on the assurance of machine learning in autonomous systems (AMLAS), R Hawkins, C Paterson, C Picardi, Y Jia, R Calinescu, I Habli, arXiv prepring 2021 [https://arxiv.org/abs/2102.01564 link]</div>

Arinajed https://robotistry.org/vasbok/index.php?title=Portal:Sources&diff=79895 2022-09-19T14:55:42Z

<p>Arinajed: </p> <hr /> <div>;Notes for improvement: organize and structure to better differentiate between documentation, resources (e.g. test ranges and tools), and collaborative activities (e.g. conferences)<br /> <br /> == Standards ==<br /> * 1012-2016 - IEEE Standard for System, Software, and Hardware Verification and Validation [https://ieeexplore.ieee.org/document/8055462]<br /> <br /> == Best practices ==<br /> <br /> == Books on verification ==<br /> * Model checking book. E. Clarke<br /> * Other model checking book by Peter Katoen<br /> * Book on software testing/model-based testing<br /> * Artificial Intelligence and Software Testing - Building systems you can trust (2022). Rex Black, James Davenport, Joanna Olszewska, Jeremias Rößler, Adam Leon Smith, Jonathon Wright. Edited by Adam Leon Smith [https://shop.bcs.org/store/221/detail/workgroup?id=3-221-9781780175768 link]<br /> <br /> == Special issues on VAS ==<br /> * Journals<br /> <br /> == Case studies ==<br /> <br /> * Steps and method followed when verifying a system<br /> <br /> <br /> == Whitepapers on autonomous systems V&amp;V from regulators ==<br /> * How to apply V&amp;V to autonomous systems<br /> * How to interpret regulations for different countries<br /> * What remains to be done for regulations<br /> <br /> E.g. <br /> * Reviews on regulations for autonomous systems in Australia<br /> <br /> <br /> == Review or survey papers on V&amp;V ==<br /> * Michael Fisher&#039;s survey paper<br /> * Signe + David Tate&#039;s white paper<br /> <br /> == Existing projects ==<br /> * Metrics [https://metricsproject.eu/] - finding ways to organize competitions that are reproducible, benchmarks to structure robotics competitions, comparing hardware and software together. Applications: healthcare, agriculture, etc.<br /> <br /> == Benchmark models ==<br /> <br /> * Simulink model benchmark for falsification (3 models) <br /> <br /> <br /> == Testing fields &amp; sites/labs ==<br /> * Georgia Tech Robotarium <br /> * Urban search and rescue at Texas A&amp;M<br /> *<br /> <br /> == Robotics &amp; autonomous systems competitions ==<br /> * DARPA<br /> * Autonomous vehicles<br /> * European Robotics League<br /> * ROBOCUP<br /> * AWS Deepracer (deep learning for training autonomous vehicles)<br /> * [https://uavchallenge.org/search-and-rescue/ Australia &amp; New Zealand Search and Rescue]<br /> * SAUC-E - underwater robotics competition<br /> * Robosub<br /> <br /> == Conferences ==<br /> *<br /> <br /> == Most recent relevant papers ==<br /> <br /> <br /> * Formal verification of neural network controlled autonomous systems, X Sun, H Khedr, Y Shoukry - Proceedings HSCC 2019 [https://dl.acm.org/doi/abs/10.1145/3302504.3311802 link]<br /> * Towards a framework for certification of reliable autonomous systems, M Fisher, V Mascardi, KY Rozier, BH Schlinglof, M Winikoff, N Yorke-Smith - Autonomous Agents and Multi-Agent Systems 2021 [https://link.springer.com/article/10.1007/s10458-020-09487-2 link]<br /> * Verifying the safety of autonomous systems with neural network controllers, R Ivanov, TJ Carpenter, J Weimer, R Alur, GJ Pappas, I Lee - ACM Transactions on Embedded Computing Systems 2020 [https://dl.acm.org/doi/abs/10.1145/3419742 link]<br /> * A Review of Verification and Validation for Space Autonomous Systems, RC Cardoso, G Kourtis, LA Dennis, C Dixon, M Farrell, M Fisher, M Webster - Current Robotics Reports 2021 [https://link.springer.com/article/10.1007/s43154-021-00058-1 link]<br /> * Formal verification of colreg-based navigation of maritime autonomous systems, F Shokri-Manninen, J Vain, M Waldén - Proceedings of SEFM 2020 [https://link.springer.com/chapter/10.1007/978-3-030-58768-0_3 link]<br /> * Reaching Out Towards Fully Verified Autonomous Systems, S Sankaranarayanan, S Dutta, S Mover - Proceedings of RP 2019 [https://link.springer.com/chapter/10.1007/978-3-030-30806-3_3 link]<br /> * Compositional verification for autonomous systems with deep learning components, CS Păsăreanu, D Gopinath, H Yu - Safe, Autonomous and Intelligent Vehicles 2019 [https://link.springer.com/chapter/10.1007/978-3-319-97301-2_10 link] <br /> * Recent trends in formal validation and verification of autonomous robots software, F Ingrand - IEEE International Conference on Robotic Computing, 2019 [https://ieeexplore.ieee.org/abstract/document/8675610/ link] <br /> * Safety Verification of Autonomous Systems: A Multi-Fidelity Reinforcement Learning Approach, JJ Beard, A Baheri - arXiv preprint 2022 [https://arxiv.org/abs/2203.03451 link] <br /> * On-line testing for autonomous systems driven by RISC-V processor design verification, A Ruospo, R Cantoro, E Sanchez, PD Schiavone, A Garofalo, L Benini - IEEE International Symposium on Defect and Fault Tolerance in VLSI and Nanotechnology Systems 2019 [https://ieeexplore.ieee.org/abstract/document/8875345 link]</div>

Arinajed https://robotistry.org/vasbok/index.php?title=Portal:Sources&diff=79894 2022-09-19T14:54:34Z

<p>Arinajed: </p> <hr /> <div>;Notes for improvement: organize and structure to better differentiate between documentation, resources (e.g. test ranges and tools), and collaborative activities (e.g. conferences)<br /> <br /> == Standards ==<br /> * 1012-2016 - IEEE Standard for System, Software, and Hardware Verification and Validation [https://ieeexplore.ieee.org/document/8055462]<br /> <br /> == Best practices ==<br /> <br /> == Books on verification ==<br /> * Model checking book. E. Clarke<br /> * Other model checking book by Peter Katoen<br /> * Book on software testing/model-based testing<br /> * Artificial Intelligence and Software Testing - Building systems you can trust (2022). Rex Black, James Davenport, Joanna Olszewska, Jeremias Rößler, Adam Leon Smith, Jonathon Wright. Edited by Adam Leon Smith [https://shop.bcs.org/store/221/detail/workgroup?id=3-221-9781780175768 link]<br /> <br /> == Special issues on VAS ==<br /> * Journals<br /> <br /> == Case studies ==<br /> <br /> * Steps and method followed when verifying a system<br /> <br /> <br /> == Whitepapers on autonomous systems V&amp;V from regulators ==<br /> * How to apply V&amp;V to autonomous systems<br /> * How to interpret regulations for different countries<br /> * What remains to be done for regulations<br /> <br /> E.g. <br /> * Reviews on regulations for autonomous systems in Australia<br /> <br /> <br /> == Review or survey papers on V&amp;V ==<br /> * Michael Fisher&#039;s survey paper<br /> * Signe + David Tate&#039;s white paper<br /> <br /> == Existing projects ==<br /> * Metrics [https://metricsproject.eu/] - finding ways to organize competitions that are reproducible, benchmarks to structure robotics competitions, comparing hardware and software together. Applications: healthcare, agriculture, etc.<br /> <br /> == Benchmark models ==<br /> <br /> * Simulink model benchmark for falsification (3 models) <br /> <br /> <br /> == Testing fields &amp; sites/labs ==<br /> * Georgia Tech Robotarium <br /> * Urban search and rescue at Texas A&amp;M<br /> *<br /> <br /> == Robotics &amp; autonomous systems competitions ==<br /> * DARPA<br /> * Autonomous vehicles<br /> * European Robotics League<br /> * ROBOCUP<br /> * AWS Deepracer (deep learning for training autonomous vehicles)<br /> * [https://uavchallenge.org/search-and-rescue/ Australia &amp; New Zealand Search and Rescue]<br /> * SAUC-E - underwater robotics competition<br /> * Robosub<br /> <br /> == Conferences ==<br /> *<br /> <br /> == Most recent papers ==<br /> Ordered by number of citations<br /> <br /> * Formal verification of neural network controlled autonomous systems, X Sun, H Khedr, Y Shoukry - Proceedings HSCC 2019 [https://dl.acm.org/doi/abs/10.1145/3302504.3311802 link]<br /> * Towards a framework for certification of reliable autonomous systems, M Fisher, V Mascardi, KY Rozier, BH Schlinglof, M Winikoff, N Yorke-Smith - Autonomous Agents and Multi-Agent Systems 2021 [https://link.springer.com/article/10.1007/s10458-020-09487-2 link]<br /> * Verifying the safety of autonomous systems with neural network controllers, R Ivanov, TJ Carpenter, J Weimer, R Alur, GJ Pappas, I Lee - ACM Transactions on Embedded Computing Systems 2020 [https://dl.acm.org/doi/abs/10.1145/3419742 link]<br /> * A Review of Verification and Validation for Space Autonomous Systems, RC Cardoso, G Kourtis, LA Dennis, C Dixon, M Farrell, M Fisher, M Webster - Current Robotics Reports 2021 [https://link.springer.com/article/10.1007/s43154-021-00058-1 link]<br /> * Formal verification of colreg-based navigation of maritime autonomous systems, F Shokri-Manninen, J Vain, M Waldén - Proceedings of SEFM 2020 [https://link.springer.com/chapter/10.1007/978-3-030-58768-0_3 link]<br /> * Reaching Out Towards Fully Verified Autonomous Systems, S Sankaranarayanan, S Dutta, S Mover - Proceedings of RP 2019 [https://link.springer.com/chapter/10.1007/978-3-030-30806-3_3 link]<br /> * Compositional verification for autonomous systems with deep learning components, CS Păsăreanu, D Gopinath, H Yu - Safe, Autonomous and Intelligent Vehicles 2019 [https://link.springer.com/chapter/10.1007/978-3-319-97301-2_10 link] <br /> * Recent trends in formal validation and verification of autonomous robots software, F Ingrand - IEEE International Conference on Robotic Computing, 2019 [https://ieeexplore.ieee.org/abstract/document/8675610/ link] <br /> * Safety Verification of Autonomous Systems: A Multi-Fidelity Reinforcement Learning Approach, JJ Beard, A Baheri - arXiv preprint 2022 [https://arxiv.org/abs/2203.03451 link] <br /> * On-line testing for autonomous systems driven by RISC-V processor design verification, A Ruospo, R Cantoro, E Sanchez, PD Schiavone, A Garofalo, L Benini - IEEE International Symposium on Defect and Fault Tolerance in VLSI and Nanotechnology Systems 2019 [https://ieeexplore.ieee.org/abstract/document/8875345 link]</div>

Arinajed https://robotistry.org/vasbok/index.php?title=Portal:Events&diff=90 2022-05-31T12:54:45Z

<p>Arinajed: Created page with &quot;Link to our previous TC VAS workshops!! Working group meetings ICRA 2016? IROS... ICRA 2022 Our Webinars (link to activities page)&quot;</p> <hr /> <div>Link to our previous TC VAS workshops!!<br /> <br /> Working group meetings<br /> <br /> ICRA 2016?<br /> <br /> IROS...<br /> <br /> ICRA 2022<br /> <br /> Our Webinars (link to activities page)</div>

Arinajed https://robotistry.org/vasbok/index.php?title=Portal:Verification&diff=89 2022-05-31T12:52:40Z

<p>Arinajed: </p> <hr /> <div>Technical explanation for verification and validation<br /> * Understand the topic of the site in more detail<br /> <br /> == What is verification? ==<br /> * Discussion about the difference between verification and validation<br /> * Relation to certification<br /> * Relation to processes<br /> * General guide of what you&#039;ll find in this BOK and what the TC&#039;s scope is<br /> <br /> <br /> == In-scope ==<br /> <br /> <br /> == Out of scope ==</div>

Arinajed https://robotistry.org/vasbok/index.php?title=Portal:Verification&diff=88 2022-05-31T12:52:26Z

<p>Arinajed: Created page with &quot;Technical explanation for verification and validation * Understand the topic of the site in more detail == What is verification? == * Discussion about the difference between verification and validation * Relation to certification * Relation to processes * General guide of what you&#039;ll find in this BOK and what the TC&#039;s scope is == What is validation? == == In-scope == == Out of scope ==&quot;</p> <hr /> <div>Technical explanation for verification and validation<br /> * Understand the topic of the site in more detail<br /> <br /> == What is verification? ==<br /> * Discussion about the difference between verification and validation<br /> * Relation to certification<br /> * Relation to processes<br /> * General guide of what you&#039;ll find in this BOK and what the TC&#039;s scope is<br /> <br /> <br /> == What is validation? ==<br /> <br /> <br /> == In-scope ==<br /> <br /> <br /> == Out of scope ==</div>

Arinajed https://robotistry.org/vasbok/index.php?title=Portal:People&diff=87 2022-05-31T12:46:49Z

<p>Arinajed: </p> <hr /> <div>== Organizations &amp; Large Projects ==<br /> <br /> * [https://verifiability.org/ (UK) Trustworthy Autonomous Systems: Verifiability Node] <br /> <br /> * [https://resilience.tas.ac.uk/ (UK) Trustworthy Autonomous Systems: Resilience Node] <br /> <br /> * [https://tas-security.lancs.ac.uk/ (UK) Trustworthy Autonomous Systems: Security Node] <br /> <br /> * [https://trust.tas.ac.uk/ (UK) Trustworthy Autonomous Systems: Trust Node] <br /> <br /> * [https://www.tas.org/ (UK) Trustworthy Autonomous Systems: Hub] <br /> <br /> * [https://www.york.ac.uk/assuring-autonomy/ (UK) Assuring Autonomy International Programme]<br /> <br /> == Research Groups ==<br /> <br /> Organize by research focus? <br /> Assign individual glossary pages to individual experts - people should contact the person responsible for that page instead of listing them here? Is this even a good category to have here?<br /> <br /> Applied Research Institute https://www.irt-systemx.fr/en/<br /> <br /> == Agencies ==<br /> <br /> Organize by ... interest? domain? (e.g. US Department of Transportation evaluation of autonomous cars group)</div>

Arinajed https://robotistry.org/vasbok/index.php?title=Definitions&diff=86 2022-05-31T12:44:44Z

<p>Arinajed: Verification of Autonomous Systems for Dummies</p> <hr /> <div>Verification of Autonomous Systems for Dummies<br /> <br /> Most important terms in simplest language (pick from the Glossary)<br /> * This section is for total newbies and are not aware about challenges and problems or terms<br /> * How to avoid being biased? E.g. highlight one area more than others</div>

Arinajed https://robotistry.org/vasbok/index.php?title=Definitions&diff=85 2022-05-31T12:43:37Z

<p>Arinajed: Created page with &quot;Most important terms in simplest language (pick from the Glossary) * This section is for total newbies and are not aware about challenges and problems or terms * How to avoid being biased? E.g. highlight one area more than others&quot;</p> <hr /> <div>Most important terms in simplest language (pick from the Glossary)<br /> * This section is for total newbies and are not aware about challenges and problems or terms<br /> * How to avoid being biased? E.g. highlight one area more than others</div>

Arinajed https://robotistry.org/vasbok/index.php?title=Portal:Glossary&diff=83 2022-05-31T12:38:30Z

<p>Arinajed: </p> <hr /> <div>Offer different classifications and groupings - in main page<br /> <br /> * Verification techniques (tree?)<br /> * Metrics (grouping)<br /> * Application area (e.g. ML systems, for HRI, for medical robots)<br /> <br /> Contents of each linked page: <br /> * definitions with links to sources<br /> * short discussion of how topic relates to verification of autonomous systems<br /> <br /> [[Template]] for definition pages - please copy the markup from this page into your new definition page<br /> <br /> <br /> ;Acceptability<br /> ;Acceptance testing <br /> ;Accountability <br /> ;Assessment <br /> ;Assurance <br /> ;Assurance cases <br /> ;[[Autonomous System]]<br /> : &quot;system which has the ability to perform intended tasks based on current state, knowledge and sensing, without human intervention&quot; [https://shop.bsigroup.com/products/robots-and-robotic-devices-guide-to-the-ethical-design-and-application-of-robots-and-robotic-systems/standard BSI 8611:2016]<br /> ;Autonomous systems design<br /> ;Autonomy<br /> <br /> <br /> ;Behavior verification for autonomous systems and ML systems <br /> ;Behavioral verification <br /> <br /> <br /> ;Combining V&amp;V Techniques <br /> ;Contextual reasoning <br /> ;Correctness verification <br /> ;Credibility <br /> ;Cross-domain / multi-domain validation<br /> ;Cyber-security <br /> <br /> <br /> ;Dependability <br /> <br /> <br /> ;Executable specifications <br /> ;Experiment design <br /> ;Explainability <br /> <br /> <br /> ;Failure detection and recovery <br /> ;Formal methods for autonomous systems <br /> ;Formal modelling <br /> ;Formal software verification <br /> ;Functional assurance<br /> ;Functional requirements <br /> ;Functional verification <br /> <br /> <br /> ;HRI (Human-robot interactions)<br /> ;HRI verification <br /> ;Hybrid Logical/Dynamical Planning and Verification <br /> <br /> <br /> ;Generalizability <br /> <br /> <br /> ;Integrity of autonomous systems<br /> <br /> <br /> ;Liability <br /> ;Licensing and certification <br /> <br /> <br /> ;Model-based evaluation <br /> <br /> <br /> ;Objective evidence<br /> : ISO 9000:2015 - &quot;data, supporting the existence or verity of something&quot;<br /> <br /> <br /> ;Operational design domain<br /> <br /> <br /> ;Qualitative assessment <br /> ;Quantitative assessment <br /> <br /> <br /> ;Performance evaluation and benchmarking <br /> ;Privacy <br /> <br /> <br /> ;Redundant robots <br /> ;Reliability <br /> ;Replicability <br /> ;Reproducibility <br /> ;Requirements <br /> : Workspace and conditions/context of operations <br /> <br /> ;Requirement <br /> - ISO 9000:2015 - &quot;need or expectation that is stated, generally implied or obligatory&quot;<br /> <br /> ;Requirements development processes <br /> ;Resilience<br /> ;Responsibility <br /> ;Robot safety <br /> ;Robotic Systems <br /> : Robot systems engineering <br /> ;Robustness <br /> ;Run-time verification and monitoring <br /> <br /> <br /> ;Safety <br /> ;Safety and security interaction<br /> ;Safety in HRI<br /> : safety, system function<br /> : verification of any function in the system including ML &amp; non-deterministic functions<br /> ;Safety-centric HRI protocols<br /> ;Safety requirements <br /> ;Security <br /> ;Security requirements<br /> ;Simulation-based testing <br /> ;Sim-based evaluation<br /> ;Social/legal/ethical requirements <br /> ;Software testing and debugging <br /> ;Software tools for benchmarking and <br /> ;Software tools for testing <br /> : software testing <br /> ;Specification<br /> - ISO 9000:2015 - &quot;document stating requirements&quot;<br /> ;Synthetic environment <br /> : to develop high level test scenarios, drive test case development <br /> <br /> <br /> ;Test cases for verification purposes <br /> ;Testing <br /> ;Transparency <br /> ;Trust<br /> ;Trustworthiness <br /> <br /> <br /> ;Use-case scenario generation <br /> ;Use Case testing <br /> <br /> <br /> ;Validation:<br /> - ISO 9000:2015 defines verification as &quot;Confirmation, through the provision of objective evidence, that the requirements for a specific intended use or application have been fulfilled&quot;<br /> - ISO/IEC/IEEE 15288:2015 further adds as &quot;A system is able to accomplish its intended use, goals and objectives (i.e., meet stakeholder requirements) in the intended operational environment. The right system was built.”<br /> ;Verification: <br /> - ISO 9000:2015 defines verification as &quot;Confirmation, through the provision of objective evidence, that specified requirements have been fulfilled&quot;<br /> - ISO/IEC/IEEE 15288:2015 further adds as &quot;Verification is a set of activities that compare a system or system element against the required characteristics. This includes, but is not limited to specified requirements, design description and the system itself. The system was built right.&quot;<br /> <br /> <br /> <br /> ;Quality requirement<br /> - ISO 9000:2015 - &quot;requirement related to quality&quot;</div>

Arinajed https://robotistry.org/vasbok/index.php?title=Portal:Glossary&diff=81 2022-05-31T12:37:50Z

<p>Arinajed: </p> <hr /> <div>If you want to add a new term, please use the template here (TODO: put link to template)<br /> <br /> <br /> Offer different classifications and groupings - in main page<br /> <br /> * Verification techniques (tree?)<br /> * Metrics (grouping)<br /> * Application area (e.g. ML systems, for HRI, for medical robots)<br /> <br /> Contents of each linked page: <br /> * definitions with links to sources<br /> * short discussion of how topic relates to verification of autonomous systems<br /> <br /> [[Template]] for definition pages - please copy the markup from this page into your new definition page<br /> <br /> <br /> ;Acceptability<br /> ;Acceptance testing <br /> ;Accountability <br /> ;Assessment <br /> ;Assurance <br /> ;Assurance cases <br /> ;[[Autonomous System]]<br /> : &quot;system which has the ability to perform intended tasks based on current state, knowledge and sensing, without human intervention&quot; [https://shop.bsigroup.com/products/robots-and-robotic-devices-guide-to-the-ethical-design-and-application-of-robots-and-robotic-systems/standard BSI 8611:2016]<br /> ;Autonomous systems design<br /> ;Autonomy<br /> <br /> <br /> ;Behavior verification for autonomous systems and ML systems <br /> ;Behavioral verification <br /> <br /> <br /> ;Combining V&amp;V Techniques <br /> ;Contextual reasoning <br /> ;Correctness verification <br /> ;Credibility <br /> ;Cross-domain / multi-domain validation<br /> ;Cyber-security <br /> <br /> <br /> ;Dependability <br /> <br /> <br /> ;Executable specifications <br /> ;Experiment design <br /> ;Explainability <br /> <br /> <br /> ;Failure detection and recovery <br /> ;Formal methods for autonomous systems <br /> ;Formal modelling <br /> ;Formal software verification <br /> ;Functional assurance<br /> ;Functional requirements <br /> ;Functional verification <br /> <br /> <br /> ;HRI (Human-robot interactions)<br /> ;HRI verification <br /> ;Hybrid Logical/Dynamical Planning and Verification <br /> <br /> <br /> ;Generalizability <br /> <br /> <br /> ;Integrity of autonomous systems<br /> <br /> <br /> ;Liability <br /> ;Licensing and certification <br /> <br /> <br /> ;Model-based evaluation <br /> <br /> <br /> ;Objective evidence<br /> : ISO 9000:2015 - &quot;data, supporting the existence or verity of something&quot;<br /> <br /> <br /> ;Operational design domain<br /> <br /> <br /> ;Qualitative assessment <br /> ;Quantitative assessment <br /> <br /> <br /> ;Performance evaluation and benchmarking <br /> ;Privacy <br /> <br /> <br /> ;Redundant robots <br /> ;Reliability <br /> ;Replicability <br /> ;Reproducibility <br /> ;Requirements <br /> : Workspace and conditions/context of operations <br /> <br /> ;Requirement <br /> - ISO 9000:2015 - &quot;need or expectation that is stated, generally implied or obligatory&quot;<br /> <br /> ;Requirements development processes <br /> ;Resilience<br /> ;Responsibility <br /> ;Robot safety <br /> ;Robotic Systems <br /> : Robot systems engineering <br /> ;Robustness <br /> ;Run-time verification and monitoring <br /> <br /> <br /> ;Safety <br /> ;Safety and security interaction<br /> ;Safety in HRI<br /> : safety, system function<br /> : verification of any function in the system including ML &amp; non-deterministic functions<br /> ;Safety-centric HRI protocols<br /> ;Safety requirements <br /> ;Security <br /> ;Security requirements<br /> ;Simulation-based testing <br /> ;Sim-based evaluation<br /> ;Social/legal/ethical requirements <br /> ;Software testing and debugging <br /> ;Software tools for benchmarking and <br /> ;Software tools for testing <br /> : software testing <br /> ;Specification<br /> - ISO 9000:2015 - &quot;document stating requirements&quot;<br /> ;Synthetic environment <br /> : to develop high level test scenarios, drive test case development <br /> <br /> <br /> ;Test cases for verification purposes <br /> ;Testing <br /> ;Transparency <br /> ;Trust<br /> ;Trustworthiness <br /> <br /> <br /> ;Use-case scenario generation <br /> ;Use Case testing <br /> <br /> <br /> ;Validation:<br /> - ISO 9000:2015 defines verification as &quot;Confirmation, through the provision of objective evidence, that the requirements for a specific intended use or application have been fulfilled&quot;<br /> - ISO/IEC/IEEE 15288:2015 further adds as &quot;A system is able to accomplish its intended use, goals and objectives (i.e., meet stakeholder requirements) in the intended operational environment. The right system was built.”<br /> ;Verification: <br /> - ISO 9000:2015 defines verification as &quot;Confirmation, through the provision of objective evidence, that specified requirements have been fulfilled&quot;<br /> - ISO/IEC/IEEE 15288:2015 further adds as &quot;Verification is a set of activities that compare a system or system element against the required characteristics. This includes, but is not limited to specified requirements, design description and the system itself. The system was built right.&quot;<br /> <br /> <br /> <br /> ;Quality requirement<br /> - ISO 9000:2015 - &quot;requirement related to quality&quot;</div>

Arinajed https://robotistry.org/vasbok/index.php?title=Autonomous_System&diff=79 2022-05-31T12:34:47Z

<p>Arinajed: </p> <hr /> <div><br /> <br /> Table of Contents<br /> <br /> &lt;Top level summary, most common definition for &#039;&#039;autonomous system&#039;&#039;&gt;<br /> <br /> == History ==<br /> &lt;Summary of the history of the term - how the definition has changed over time&gt;<br /> * Where was this first used? Who coined the term or started naming them like that? <br /> * Was it called differently before?<br /> <br /> == Contextual Uses ==<br /> &lt;Description of the different contexts this term is used in&gt;<br /> * E.g. ISO standards<br /> * IEEE dictionary<br /> <br /> === Context 1 ===<br /> &lt;Description of context 1&gt;<br /> <br /> &lt;Definition used in context 1&gt;<br /> <br /> === Context 2 ===<br /> &lt;Description of context 2&gt;<br /> <br /> &lt;Definition used in context 2&gt;<br /> <br /> === What is NOT included in this BOK ===<br /> * Other random definitions that are outside the scope of VAS like autonomy<br /> * e.g. don&#039;t confuse robotics and automation with RPA (scripts to automate paperwork)</div>

Arinajed https://robotistry.org/vasbok/index.php?title=Autonomous_System&diff=78 2022-05-31T12:34:24Z

<p>Arinajed: </p> <hr /> <div><br /> <br /> Table of Contents<br /> <br /> &lt;Top level summary, most common definition for &#039;&#039;autonomous system&#039;&#039;&gt;<br /> <br /> == History ==<br /> &lt;Summary of the history of the term - how the definition has changed over time&gt;<br /> * Where was this first used? Who coined the term or started naming them like that? <br /> * Was it called differently before?<br /> <br /> == Contextual Uses ==<br /> &lt;Description of the different contexts this term is used in&gt;<br /> * E.g. ISO standards<br /> * IEEE dictionary<br /> <br /> === Context 1 ===<br /> &lt;Description of context 1&gt;<br /> <br /> &lt;Definition used in context 1&gt;<br /> <br /> === Context 2 ===<br /> &lt;Description of context 2&gt;<br /> <br /> &lt;Definition used in context 2&gt;<br /> <br /> === What is NOT included in this BOK ==<br /> * Other random definitions that are outside the scope of VAS like autonomy<br /> * e.g. don&#039;t confuse robotics and automation with RPA (scripts to automate paperwork)</div>

Arinajed https://robotistry.org/vasbok/index.php?title=Autonomous_System&diff=77 2022-05-31T12:31:47Z

<p>Arinajed: </p> <hr /> <div><br /> <br /> Table of Contents<br /> <br /> &lt;Top level summary, most common definition for &#039;&#039;autonomous system&#039;&#039;&gt;<br /> <br /> == History ==<br /> &lt;Summary of the history of the term - how the definition has changed over time&gt;<br /> * Where was this first used? Who coined the term or started naming them like that? <br /> * Was it called differently before?<br /> <br /> == Contextual Uses ==<br /> &lt;Description of the different contexts this term is used in&gt;<br /> <br /> === Context 1 ===<br /> &lt;Description of context 1&gt;<br /> <br /> &lt;Definition used in context 1&gt;<br /> <br /> === Context 2 ===<br /> &lt;Description of context 2&gt;<br /> <br /> &lt;Definition used in context 2</div>

Arinajed https://robotistry.org/vasbok/index.php?title=Portal:Tools&diff=76 2022-05-31T12:28:48Z

<p>Arinajed: </p> <hr /> <div>&lt;big&gt;Verification of Autonomous Systems -- A Selection of Tools and Processes &lt;/big&gt;<br /> <br /> == Tools ==<br /> <br /> === Specification &amp; Modelling ===<br /> * Modelling of Robotic Systems: [https://www.cs.york.ac.uk/robostar/robotool/ RoboTool]<br /> * Modelling of Robotic Systems: [https://redmine.laas.fr/projects/genom3-fiacre-template/gollum/index GenoM]<br /> * Executable Agent Specifications: [https://www.csc.liv.ac.uk/~michael/TLBook/MetateM-System/ Concurrent MetateM] <br /> <br /> [[Portal:Sources#Title 1|Title 1]]<br /> <br /> <br /> === Formal Verification ===<br /> * Program model-checking of agent-based Autonomous Systems: [https://autonomy-and-verification.github.io/tools/mcapl MCAPL]<br /> * Robustness analyzer for Neural Networks: [https://github.com/eth-sri/eran ERAN]<br /> * SMT solver for Neural Networks: [https://github.com/NeuralNetworkVerification/Marabou Marabou]<br /> * Theorem prover for Cyber-Physical Systems: [http://www.ls.cs.cmu.edu/KeYmaeraX/ KeYmaera X]<br /> <br /> === Software Testing ===<br /> * Conformance testing of Cyber-Physical Systems: [https://github.com/hlsa/HyConf HyConf]<br /> * Concolic testing for Deep Neural Networks: [https://github.com/xiaoweih/DeepConcolic DeepConcolic]<br /> <br /> <br /> === Physical Testing ===<br /> * Physical integration testing for ROS 2: [https://github.com/FlorisE/rospit2/blob/main/README.md ROSPIT]<br /> <br /> <br /> === Runtime Verification ===<br /> * Runtime verification for Robot Operating System (ROS): [https://github.com/autonomy-and-verification-uol/ROSMonitoring ROSMonitoring]<br /> * Runtime verification of Robotic Systems: [https://github.com/autonomy-and-verification-uol/varanus Varanus]<br /> * Runtime verification for Robot Operating System (ROS): [https://github.com/Formal-Systems-Laboratory/ROSRV ROSRV]<br /> <br /> === Multi-purpose verification tools ===<br /> * [https://github.com/decyphir/breach Breach]<br /> ** How to write STL requirements<br /> ** Falsification of STL requirements<br /> ** Monitoring for STL formulae<br /> ** Interfacing with Simulink models using the toolbox<br /> ** Available in Github<br /> <br /> * [https://sites.google.com/a/asu.edu/s-taliro/s-taliro S-Taliro] <br /> ** Verification<br /> ** Conformance testing<br /> ** MATLAB toolbox<br /> <br /> * [https://gitlab.com/sbtg/psy-taliro PSY-Taliro]<br /> ** Python toolbox for S-Taliro <br /> ** Available on Gitlab<br /> ** [https://link.springer.com/chapter/10.1007/978-3-030-85248-1_15 Paper reference]<br /> <br /> <br /> <br /> == Processes ==<br /> * Model after the Guide on VAS but more detailed<br /> * Refer to standards on verification processes (double V model, software verification, cybersecurity(?), assurance cases, etc.)<br /> * This can link back to tools sections<br /> <br /> === Specifications ===<br /> === Formal methods ===<br /> === Assurance cases ===<br /> === Testing ===</div>

Arinajed https://robotistry.org/vasbok/index.php?title=Portal:Tools&diff=75 2022-05-31T12:26:34Z

<p>Arinajed: </p> <hr /> <div>&lt;big&gt;Verification of Autonomous Systems -- A Selection of Tools and Processes &lt;/big&gt;<br /> <br /> == Tools ==<br /> <br /> === Specification &amp; Modelling ===<br /> * Modelling of Robotic Systems: [https://www.cs.york.ac.uk/robostar/robotool/ RoboTool]<br /> * Modelling of Robotic Systems: [https://redmine.laas.fr/projects/genom3-fiacre-template/gollum/index GenoM]<br /> * Executable Agent Specifications: [https://www.csc.liv.ac.uk/~michael/TLBook/MetateM-System/ Concurrent MetateM] <br /> <br /> [[Portal:Sources#Title 1|Title 1]]<br /> <br /> <br /> === Formal Verification ===<br /> * Program model-checking of agent-based Autonomous Systems: [https://autonomy-and-verification.github.io/tools/mcapl MCAPL]<br /> * Robustness analyzer for Neural Networks: [https://github.com/eth-sri/eran ERAN]<br /> * SMT solver for Neural Networks: [https://github.com/NeuralNetworkVerification/Marabou Marabou]<br /> * Theorem prover for Cyber-Physical Systems: [http://www.ls.cs.cmu.edu/KeYmaeraX/ KeYmaera X]<br /> <br /> === Software Testing ===<br /> * Conformance testing of Cyber-Physical Systems: [https://github.com/hlsa/HyConf HyConf]<br /> * Concolic testing for Deep Neural Networks: [https://github.com/xiaoweih/DeepConcolic DeepConcolic]<br /> <br /> <br /> === Physical Testing ===<br /> * Physical integration testing for ROS 2: [https://github.com/FlorisE/rospit2/blob/main/README.md ROSPIT]<br /> <br /> <br /> === Runtime Verification ===<br /> * Runtime verification for Robot Operating System (ROS): [https://github.com/autonomy-and-verification-uol/ROSMonitoring ROSMonitoring]<br /> * Runtime verification of Robotic Systems: [https://github.com/autonomy-and-verification-uol/varanus Varanus]<br /> * Runtime verification for Robot Operating System (ROS): [https://github.com/Formal-Systems-Laboratory/ROSRV ROSRV]<br /> <br /> === Multi-purpose verification tools ===<br /> * [https://github.com/decyphir/breach Breach]<br /> ** How to write STL requirements<br /> ** Falsification of STL requirements<br /> ** Monitoring for STL formulae<br /> ** Interfacing with Simulink models using the toolbox<br /> ** Available in Github<br /> <br /> * [https://sites.google.com/a/asu.edu/s-taliro/s-taliro S-Taliro] <br /> ** Verification<br /> ** Conformance testing<br /> ** MATLAB toolbox<br /> <br /> * [https://gitlab.com/sbtg/psy-taliro PSY-Taliro]<br /> ** Python toolbox for S-Taliro <br /> ** Available on Gitlab<br /> ** [https://link.springer.com/chapter/10.1007/978-3-030-85248-1_15 Paper reference]<br /> <br /> == Processes ==</div>

Arinajed https://robotistry.org/vasbok/index.php?title=Portal:Tools&diff=74 2022-05-31T12:26:03Z

<p>Arinajed: </p> <hr /> <div>&lt;big&gt;Verification of Autonomous Systems -- A Selection of Tools and Processes &lt;/big&gt;<br /> <br /> == Tools ==<br /> <br /> === Specification &amp; Modelling ===<br /> * Modelling of Robotic Systems: [https://www.cs.york.ac.uk/robostar/robotool/ RoboTool]<br /> * Modelling of Robotic Systems: [https://redmine.laas.fr/projects/genom3-fiacre-template/gollum/index GenoM]<br /> * Executable Agent Specifications: [https://www.csc.liv.ac.uk/~michael/TLBook/MetateM-System/ Concurrent MetateM] <br /> <br /> [[Portal:Sources#Title 1|Title 1]]<br /> <br /> <br /> == Formal Verification ==<br /> * Program model-checking of agent-based Autonomous Systems: [https://autonomy-and-verification.github.io/tools/mcapl MCAPL]<br /> * Robustness analyzer for Neural Networks: [https://github.com/eth-sri/eran ERAN]<br /> * SMT solver for Neural Networks: [https://github.com/NeuralNetworkVerification/Marabou Marabou]<br /> * Theorem prover for Cyber-Physical Systems: [http://www.ls.cs.cmu.edu/KeYmaeraX/ KeYmaera X]<br /> <br /> == Software Testing ==<br /> * Conformance testing of Cyber-Physical Systems: [https://github.com/hlsa/HyConf HyConf]<br /> * Concolic testing for Deep Neural Networks: [https://github.com/xiaoweih/DeepConcolic DeepConcolic]<br /> <br /> <br /> == Physical Testing ==<br /> * Physical integration testing for ROS 2: [https://github.com/FlorisE/rospit2/blob/main/README.md ROSPIT]<br /> <br /> <br /> == Runtime Verification ==<br /> * Runtime verification for Robot Operating System (ROS): [https://github.com/autonomy-and-verification-uol/ROSMonitoring ROSMonitoring]<br /> * Runtime verification of Robotic Systems: [https://github.com/autonomy-and-verification-uol/varanus Varanus]<br /> * Runtime verification for Robot Operating System (ROS): [https://github.com/Formal-Systems-Laboratory/ROSRV ROSRV]<br /> <br /> == Multi-purpose verification tools ==<br /> * [https://github.com/decyphir/breach Breach]<br /> ** How to write STL requirements<br /> ** Falsification of STL requirements<br /> ** Monitoring for STL formulae<br /> ** Interfacing with Simulink models using the toolbox<br /> ** Available in Github<br /> <br /> * [https://sites.google.com/a/asu.edu/s-taliro/s-taliro S-Taliro] <br /> ** Verification<br /> ** Conformance testing<br /> ** MATLAB toolbox<br /> <br /> * [https://gitlab.com/sbtg/psy-taliro PSY-Taliro]<br /> ** Python toolbox for S-Taliro <br /> ** Available on Gitlab<br /> ** [https://link.springer.com/chapter/10.1007/978-3-030-85248-1_15 Paper reference]<br /> <br /> == Processes ==</div>

Arinajed