https://robotistry.org/vasbok/api.php?action=feedcontributions&feedformat=atom&user=AristeneaVerification Body of Knowledge - User contributions [en]2026-10-23T09:57:16ZUser contributionsMediaWiki 1.37.1https://robotistry.org/vasbok/index.php?title=Portal:Sources&diff=53Portal:Sources2022-04-19T12:46:28Z<p>Aristenea: /* Standards */</p>
<hr />
<div>== Standards ==<br />
* 1012-2016 - IEEE Standard for System, Software, and Hardware Verification and Validation [https://ieeexplore.ieee.org/document/8055462]<br />
<br />
== Best practices ==<br />
<br />
== Books on verification ==<br />
* Model checking book. E. Clarke<br />
* Other model checking book by Peter Katoen<br />
* Book on software testing/model-based testing<br />
* Artificial Intelligence and Software Testing - Building systems you can trust (2022). Rex Black, James Davenport, Joanna Olszewska, Jeremias Rößler, Adam Leon Smith, Jonathon Wright. Edited by Adam Leon Smith [https://shop.bcs.org/store/221/detail/workgroup?id=3-221-9781780175768 link]<br />
<br />
== Special issues on VAS ==<br />
* Journals<br />
<br />
== Case studies ==<br />
<br />
* Steps and method followed when verifying a system<br />
<br />
<br />
== Whitepapers on autonomous systems V&V from regulators ==<br />
* How to apply V&V to autonomous systems<br />
* How to interpret regulations for different countries<br />
* What remains to be done for regulations<br />
<br />
E.g. <br />
* Reviews on regulations for autonomous systems in Australia<br />
<br />
<br />
== Review or survey papers on V&V ==<br />
* Michael Fisher's survey paper<br />
* Signe + David Tate's white paper<br />
<br />
== Existing projects ==<br />
* Metrics [https://metricsproject.eu/] - finding ways to organize competitions that are reproducible, benchmarks to structure robotics competitions, comparing hardware and software together. Applications: healthcare, agriculture, etc.<br />
<br />
== Benchmark models ==<br />
<br />
* Simulink model benchmark for falsification (3 models) <br />
<br />
<br />
== Testing fields & sites/labs ==<br />
* Georgia Tech Robotarium <br />
* Urban search and rescue at Texas A&M<br />
*<br />
<br />
== Robotics & autonomous systems competitions ==<br />
* DARPA<br />
* Autonomous vehicles<br />
* European Robotics League<br />
* ROBOCUP<br />
* AWS Deepracer (deep learning for training autonomous vehicles)<br />
* Australia & New Zealand Search and Rescue [https://uavchallenge.org/search-and-rescue/]<br />
* SAUC-E - underwater robotics competition<br />
* Robosub<br />
<br />
== Conferences ==<br />
*</div>Aristeneahttps://robotistry.org/vasbok/index.php?title=Portal:Sources&diff=52Portal:Sources2022-04-19T12:40:27Z<p>Aristenea: </p>
<hr />
<div>== Standards ==<br />
<br />
<br />
== Best practices ==<br />
<br />
== Books on verification ==<br />
* Model checking book. E. Clarke<br />
* Other model checking book by Peter Katoen<br />
* Book on software testing/model-based testing<br />
* Artificial Intelligence and Software Testing - Building systems you can trust (2022). Rex Black, James Davenport, Joanna Olszewska, Jeremias Rößler, Adam Leon Smith, Jonathon Wright. Edited by Adam Leon Smith [https://shop.bcs.org/store/221/detail/workgroup?id=3-221-9781780175768 link]<br />
<br />
== Special issues on VAS ==<br />
* Journals<br />
<br />
== Case studies ==<br />
<br />
* Steps and method followed when verifying a system<br />
<br />
<br />
== Whitepapers on autonomous systems V&V from regulators ==<br />
* How to apply V&V to autonomous systems<br />
* How to interpret regulations for different countries<br />
* What remains to be done for regulations<br />
<br />
E.g. <br />
* Reviews on regulations for autonomous systems in Australia<br />
<br />
<br />
== Review or survey papers on V&V ==<br />
* Michael Fisher's survey paper<br />
* Signe + David Tate's white paper<br />
<br />
== Existing projects ==<br />
* Metrics [https://metricsproject.eu/] - finding ways to organize competitions that are reproducible, benchmarks to structure robotics competitions, comparing hardware and software together. Applications: healthcare, agriculture, etc.<br />
<br />
== Benchmark models ==<br />
<br />
* Simulink model benchmark for falsification (3 models) <br />
<br />
<br />
== Testing fields & sites/labs ==<br />
* Georgia Tech Robotarium <br />
* Urban search and rescue at Texas A&M<br />
*<br />
<br />
== Robotics & autonomous systems competitions ==<br />
* DARPA<br />
* Autonomous vehicles<br />
* European Robotics League<br />
* ROBOCUP<br />
* AWS Deepracer (deep learning for training autonomous vehicles)<br />
* Australia & New Zealand Search and Rescue [https://uavchallenge.org/search-and-rescue/]<br />
* SAUC-E - underwater robotics competition<br />
* Robosub<br />
<br />
== Conferences ==<br />
*</div>Aristeneahttps://robotistry.org/vasbok/index.php?title=Portal:Glossary&diff=51Portal:Glossary2022-04-19T12:19:10Z<p>Aristenea: </p>
<hr />
<div>Offer different classifications and groupings - in main page<br />
<br />
* Verification techniques (tree?)<br />
* Metrics (grouping)<br />
* Application area (e.g. ML systems, for HRI, for medical robots)<br />
<br />
<br />
<br />
<br />
;Acceptability<br />
;Acceptance testing <br />
;Accountability <br />
;Assessment <br />
;Assurance <br />
;Assurance cases <br />
;Autonomous systems design<br />
<br />
<br />
;Behavior verification for autonomous systems and ML systems <br />
;Behavioral verification <br />
<br />
<br />
;Combining V&V Techniques <br />
;Contextual reasoning <br />
;Correctness verification <br />
;Credibility <br />
;Cross-domain / multi-domain validation<br />
;Cyber-security <br />
<br />
<br />
;Dependability <br />
<br />
<br />
;Executable specifications <br />
;Experiment design <br />
;Explainability <br />
<br />
<br />
;Failure detection and recovery <br />
;Formal methods for autonomous systems <br />
;Formal modelling <br />
;Formal software verification <br />
;Functional assurance<br />
;Functional requirements <br />
;Functional verification <br />
<br />
<br />
;HRI (Human-robot interactions)<br />
;HRI verification <br />
;Hybrid Logical/Dynamical Planning and Verification <br />
<br />
<br />
;Generalizability <br />
<br />
<br />
;Integrity of autonomous systems<br />
<br />
<br />
;Liability <br />
;Licensing and certification <br />
<br />
<br />
;Model-based evaluation <br />
<br />
<br />
;Operational design domain<br />
<br />
<br />
;Qualitative assessment <br />
;Quantitative assessment <br />
<br />
<br />
;Performance evaluation and benchmarking <br />
;Privacy <br />
<br />
<br />
;Redundant robots <br />
;Reliability <br />
;Replicability <br />
;Reproducibility <br />
;Requirements <br />
: Workspace and conditions/context of operations <br />
;Requirements development processes <br />
;Resilience<br />
;Responsibility <br />
;Robot safety <br />
;Robotic Systems <br />
: Robot systems engineering <br />
;Robustness <br />
;Run-time verification and monitoring <br />
<br />
<br />
;Safety <br />
;Safety and security interaction<br />
;Safety in HRI<br />
: safety, system function<br />
: verification of any function in the system including ML & non-deterministic functions<br />
;Safety-centric HRI protocols<br />
;Safety requirements <br />
;Security <br />
;Security requirements<br />
;Simulation-based testing <br />
;Sim-based evaluation<br />
;Social/legal/ethical requirements <br />
;Software testing and debugging <br />
;Software tools for benchmarking and <br />
;Software tools for testing <br />
: software testing <br />
;Specifications<br />
;Synthetic environment <br />
: to develop high level test scenarios, drive test case development <br />
<br />
<br />
;Test cases for verification purposes <br />
;Testing <br />
;Transparency <br />
;Trust<br />
;Trustworthiness <br />
<br />
<br />
;Use-case scenario generation <br />
;Use Case testing <br />
<br />
<br />
;Validation <br />
;Verification</div>Aristeneahttps://robotistry.org/vasbok/index.php?title=Portal:Sources&diff=50Portal:Sources2022-04-19T12:14:17Z<p>Aristenea: /* Review or survey papers on V&V */</p>
<hr />
<div><br />
<br />
== Books on verification ==<br />
* Model checking book. E. Clarke<br />
* Other model checking book by Peter Katoen<br />
* Book on software testing/model-based testing<br />
* Artificial Intelligence and Software Testing - Building systems you can trust (2022). Rex Black, James Davenport, Joanna Olszewska, Jeremias Rößler, Adam Leon Smith, Jonathon Wright. Edited by Adam Leon Smith [https://shop.bcs.org/store/221/detail/workgroup?id=3-221-9781780175768 link]<br />
<br />
== Special issues on VAS ==<br />
* Journals<br />
<br />
== Case studies ==<br />
<br />
* Steps and method followed when verifying a system<br />
<br />
<br />
== Whitepapers on autonomous systems V&V from regulators ==<br />
* How to apply V&V to autonomous systems<br />
* How to interpret regulations for different countries<br />
* What remains to be done for regulations<br />
<br />
E.g. <br />
* Reviews on regulations for autonomous systems in Australia<br />
<br />
<br />
== Review or survey papers on V&V ==<br />
* Michael Fisher's survey paper<br />
* Signe + David Tate's white paper<br />
<br />
== Existing projects ==<br />
* Metrics [https://metricsproject.eu/] - finding ways to organize competitions that are reproducible, benchmarks to structure robotics competitions, comparing hardware and software together. Applications: healthcare, agriculture, etc.<br />
<br />
== Benchmark models ==<br />
<br />
* Simulink model benchmark for falsification (3 models) <br />
<br />
<br />
== Testing fields & sites/labs ==<br />
* Georgia Tech Robotarium <br />
* Urban search and rescue at Texas A&M<br />
*<br />
<br />
== Robotics & autonomous systems competitions ==<br />
* DARPA<br />
* Autonomous vehicles<br />
* European Robotics League<br />
* ROBOCUP<br />
* AWS Deepracer (deep learning for training autonomous vehicles)<br />
* Australia & New Zealand Search and Rescue [https://uavchallenge.org/search-and-rescue/]<br />
* SAUC-E - underwater robotics competition<br />
* Robosub<br />
<br />
== Conferences ==<br />
*</div>Aristeneahttps://robotistry.org/vasbok/index.php?title=Portal:Sources&diff=49Portal:Sources2022-04-19T12:13:45Z<p>Aristenea: /* Conferences */</p>
<hr />
<div><br />
<br />
== Books on verification ==<br />
* Model checking book. E. Clarke<br />
* Other model checking book by Peter Katoen<br />
* Book on software testing/model-based testing<br />
* Artificial Intelligence and Software Testing - Building systems you can trust (2022). Rex Black, James Davenport, Joanna Olszewska, Jeremias Rößler, Adam Leon Smith, Jonathon Wright. Edited by Adam Leon Smith [https://shop.bcs.org/store/221/detail/workgroup?id=3-221-9781780175768 link]<br />
<br />
== Special issues on VAS ==<br />
* Journals<br />
<br />
== Case studies ==<br />
<br />
* Steps and method followed when verifying a system<br />
<br />
<br />
== Whitepapers on autonomous systems V&V from regulators ==<br />
* How to apply V&V to autonomous systems<br />
* How to interpret regulations for different countries<br />
* What remains to be done for regulations<br />
<br />
E.g. <br />
* Reviews on regulations for autonomous systems in Australia<br />
<br />
<br />
== Review or survey papers on V&V ==<br />
<br />
<br />
== Existing projects ==<br />
* Metrics [https://metricsproject.eu/] - finding ways to organize competitions that are reproducible, benchmarks to structure robotics competitions, comparing hardware and software together. Applications: healthcare, agriculture, etc.<br />
<br />
== Benchmark models ==<br />
<br />
* Simulink model benchmark for falsification (3 models) <br />
<br />
<br />
== Testing fields & sites/labs ==<br />
* Georgia Tech Robotarium <br />
* Urban search and rescue at Texas A&M<br />
*<br />
<br />
== Robotics & autonomous systems competitions ==<br />
* DARPA<br />
* Autonomous vehicles<br />
* European Robotics League<br />
* ROBOCUP<br />
* AWS Deepracer (deep learning for training autonomous vehicles)<br />
* Australia & New Zealand Search and Rescue [https://uavchallenge.org/search-and-rescue/]<br />
* SAUC-E - underwater robotics competition<br />
* Robosub<br />
<br />
== Conferences ==<br />
*</div>Aristeneahttps://robotistry.org/vasbok/index.php?title=Portal:Sources&diff=48Portal:Sources2022-04-19T12:10:32Z<p>Aristenea: /* Existing projects */</p>
<hr />
<div><br />
<br />
== Books on verification ==<br />
* Model checking book. E. Clarke<br />
* Other model checking book by Peter Katoen<br />
* Book on software testing/model-based testing<br />
* Artificial Intelligence and Software Testing - Building systems you can trust (2022). Rex Black, James Davenport, Joanna Olszewska, Jeremias Rößler, Adam Leon Smith, Jonathon Wright. Edited by Adam Leon Smith [https://shop.bcs.org/store/221/detail/workgroup?id=3-221-9781780175768 link]<br />
<br />
== Special issues on VAS ==<br />
* Journals<br />
<br />
== Case studies ==<br />
<br />
* Steps and method followed when verifying a system<br />
<br />
<br />
== Whitepapers on autonomous systems V&V from regulators ==<br />
* How to apply V&V to autonomous systems<br />
* How to interpret regulations for different countries<br />
* What remains to be done for regulations<br />
<br />
E.g. <br />
* Reviews on regulations for autonomous systems in Australia<br />
<br />
<br />
== Review or survey papers on V&V ==<br />
<br />
<br />
== Existing projects ==<br />
* Metrics [https://metricsproject.eu/] - finding ways to organize competitions that are reproducible, benchmarks to structure robotics competitions, comparing hardware and software together. Applications: healthcare, agriculture, etc.<br />
<br />
== Benchmark models ==<br />
<br />
* Simulink model benchmark for falsification (3 models) <br />
<br />
<br />
== Testing fields & sites/labs ==<br />
* Georgia Tech Robotarium <br />
* Urban search and rescue at Texas A&M<br />
*<br />
<br />
== Robotics & autonomous systems competitions ==<br />
* DARPA<br />
* Autonomous vehicles<br />
* European Robotics League<br />
* ROBOCUP<br />
* AWS Deepracer (deep learning for training autonomous vehicles)<br />
* Australia & New Zealand Search and Rescue [https://uavchallenge.org/search-and-rescue/]<br />
* SAUC-E - underwater robotics competition<br />
* Robosub<br />
<br />
== Conferences ==</div>Aristeneahttps://robotistry.org/vasbok/index.php?title=Portal:Sources&diff=47Portal:Sources2022-04-19T12:07:24Z<p>Aristenea: /* Testing fields & sites/labs */</p>
<hr />
<div><br />
<br />
== Books on verification ==<br />
* Model checking book. E. Clarke<br />
* Other model checking book by Peter Katoen<br />
* Book on software testing/model-based testing<br />
* Artificial Intelligence and Software Testing - Building systems you can trust (2022). Rex Black, James Davenport, Joanna Olszewska, Jeremias Rößler, Adam Leon Smith, Jonathon Wright. Edited by Adam Leon Smith [https://shop.bcs.org/store/221/detail/workgroup?id=3-221-9781780175768 link]<br />
<br />
== Special issues on VAS ==<br />
* Journals<br />
<br />
== Case studies ==<br />
<br />
* Steps and method followed when verifying a system<br />
<br />
<br />
== Whitepapers on autonomous systems V&V from regulators ==<br />
* How to apply V&V to autonomous systems<br />
* How to interpret regulations for different countries<br />
* What remains to be done for regulations<br />
<br />
E.g. <br />
* Reviews on regulations for autonomous systems in Australia<br />
<br />
<br />
== Review or survey papers on V&V ==<br />
<br />
<br />
== Existing projects ==<br />
<br />
<br />
<br />
<br />
== Benchmark models ==<br />
<br />
* Simulink model benchmark for falsification (3 models) <br />
<br />
<br />
== Testing fields & sites/labs ==<br />
* Georgia Tech Robotarium <br />
* Urban search and rescue at Texas A&M<br />
*<br />
<br />
== Robotics & autonomous systems competitions ==<br />
* DARPA<br />
* Autonomous vehicles<br />
* European Robotics League<br />
* ROBOCUP<br />
* AWS Deepracer (deep learning for training autonomous vehicles)<br />
* Australia & New Zealand Search and Rescue [https://uavchallenge.org/search-and-rescue/]<br />
* SAUC-E - underwater robotics competition<br />
* Robosub<br />
<br />
== Conferences ==</div>Aristeneahttps://robotistry.org/vasbok/index.php?title=Portal:Sources&diff=46Portal:Sources2022-04-19T12:05:05Z<p>Aristenea: /* Robotics & autonomous systems competitions */</p>
<hr />
<div><br />
<br />
== Books on verification ==<br />
* Model checking book. E. Clarke<br />
* Other model checking book by Peter Katoen<br />
* Book on software testing/model-based testing<br />
* Artificial Intelligence and Software Testing - Building systems you can trust (2022). Rex Black, James Davenport, Joanna Olszewska, Jeremias Rößler, Adam Leon Smith, Jonathon Wright. Edited by Adam Leon Smith [https://shop.bcs.org/store/221/detail/workgroup?id=3-221-9781780175768 link]<br />
<br />
== Special issues on VAS ==<br />
* Journals<br />
<br />
== Case studies ==<br />
<br />
* Steps and method followed when verifying a system<br />
<br />
<br />
== Whitepapers on autonomous systems V&V from regulators ==<br />
* How to apply V&V to autonomous systems<br />
* How to interpret regulations for different countries<br />
* What remains to be done for regulations<br />
<br />
E.g. <br />
* Reviews on regulations for autonomous systems in Australia<br />
<br />
<br />
== Review or survey papers on V&V ==<br />
<br />
<br />
== Existing projects ==<br />
<br />
<br />
<br />
<br />
== Benchmark models ==<br />
<br />
* Simulink model benchmark for falsification (3 models) <br />
<br />
<br />
== Testing fields & sites/labs ==<br />
<br />
<br />
<br />
<br />
== Robotics & autonomous systems competitions ==<br />
* DARPA<br />
* Autonomous vehicles<br />
* European Robotics League<br />
* ROBOCUP<br />
* AWS Deepracer (deep learning for training autonomous vehicles)<br />
* Australia & New Zealand Search and Rescue [https://uavchallenge.org/search-and-rescue/]<br />
* SAUC-E - underwater robotics competition<br />
* Robosub<br />
<br />
== Conferences ==</div>Aristenea