https://robotistry.org/vasbok/api.php?action=feedcontributions&feedformat=atom&user=Lm2292Verification Body of Knowledge - User contributions [en]2026-10-23T08:17:24ZUser contributionsMediaWiki 1.37.1https://robotistry.org/vasbok/index.php?title=Portal:Glossary&diff=106Portal:Glossary2022-06-14T12:04:46Z<p>Lm2292: </p>
<hr />
<div>Offer different classifications and groupings - in main page<br />
<br />
* Verification techniques (tree?)<br />
* Metrics (grouping)<br />
* Application area (e.g. ML systems, for HRI, for medical robots)<br />
<br />
Contents of each linked page: <br />
* definitions with links to sources<br />
* short discussion of how topic relates to verification of autonomous systems<br />
<br />
'''''[[Template]]''''' for definition pages - please copy the markup from this page into your new definition page<br />
<br />
<br />
;Acceptability<br />
;Acceptance testing <br />
;Accountability <br />
;Activity <br />
- set of tasks that describe the technical effort to accomplish a process and help generate expected outcome [https://www.nasa.gov/seh/index.html NASA Systems Engineering Handbook]<br />
;Assessment <br />
;Assurance <br />
;Assurance cases <br />
;[[Autonomous System]]<br />
: "system which has the ability to perform intended tasks based on current state, knowledge and sensing, without human intervention" [https://shop.bsigroup.com/products/robots-and-robotic-devices-guide-to-the-ethical-design-and-application-of-robots-and-robotic-systems/standard BSI 8611:2016]<br />
;Autonomous systems design<br />
;Autonomy<br />
;Automation<br />
- allocation of system functions to machines versus humans [https://www.nasa.gov/seh/index.html NASA Systems Engineering Handbook] <br />
;Anomaly <br />
- unexpected performance of intended function [https://www.nasa.gov/seh/index.html NASA Systems Engineering Handbook]<br />
<br />
<br />
;Behavior verification for autonomous systems and ML systems <br />
;Behavioral verification <br />
<br />
<br />
;Combining V&V Techniques <br />
;Contextual reasoning <br />
;Correctness verification <br />
;Credibility <br />
;Cross-domain / multi-domain validation<br />
;Cyber-security <br />
<br />
<br />
;Dependability <br />
<br />
<br />
;Executable specifications <br />
;Experiment design <br />
;Explainability <br />
<br />
;Failure<br />
- inability of a system, subsystem or component to perform its required function within specified limits [https://www.nasa.gov/seh/index.html NASA Systems Engineering Handbook]<br />
<br />
;Failure detection and recovery <br />
;Fault<br />
- physical or logical cause, which explains a failure [https://www.nasa.gov/seh/index.html NASA Systems Engineering Handbook]<br />
;Formal methods for autonomous systems <br />
;Formal modelling <br />
;Formal software verification <br />
;Functional assurance<br />
;Functional requirements <br />
;Functional verification <br />
<br />
<br />
;HRI (Human-robot interactions)<br />
;HRI verification <br />
;Hybrid Logical/Dynamical Planning and Verification <br />
<br />
<br />
;Generalizability <br />
<br />
<br />
;Integrity of autonomous systems<br />
<br />
<br />
;Liability <br />
;Licensing and certification <br />
<br />
<br />
;Model-based evaluation <br />
<br />
<br />
<br />
<br />
;Objective evidence<br />
: ISO 9000:2015 - "data, supporting the existence or verity of something" [https://bsol.bsigroup.com/Bibliographic/BibliographicInfoData/000000000030412048 ISO 9000:2015]<br />
<br />
<br />
;Operational design domain<br />
<br />
;Process <br />
ISO 9000:2015 - "set of interrelated or interacting activities that use inputs to deliver an intended result" [https://bsol.bsigroup.com/Bibliographic/BibliographicInfoData/000000000030412048 ISO 9000:2015]<br />
<br />
;Qualitative assessment <br />
;Quality requirement<br />
- ISO 9000:2015 - "requirement related to quality" [https://bsol.bsigroup.com/Bibliographic/BibliographicInfoData/000000000030412048 ISO 9000:2015]<br />
;Quality plan <br />
- ISO 9000:2015 - "specification of the procedures and associated resources to be applied when and by whom to a specific object" [https://bsol.bsigroup.com/Bibliographic/BibliographicInfoData/000000000030412048 ISO 9000:2015]<br />
;Quantitative assessment <br />
<br />
<br />
<br />
;Performance evaluation and benchmarking <br />
;Privacy <br />
<br />
<br />
;Redundant robots <br />
;Reliability <br />
;Replicability <br />
;Reproducibility <br />
;Requirements <br />
: Workspace and conditions/context of operations <br />
<br />
;Requirement <br />
- ISO 9000:2015 - "need or expectation that is stated, generally implied or obligatory" [https://bsol.bsigroup.com/Bibliographic/BibliographicInfoData/000000000030412048 ISO 9000:2015]<br />
<br />
;Requirements development processes <br />
;Resilience<br />
;Responsibility <br />
;Robot safety <br />
;Robotic Systems <br />
: Robot systems engineering <br />
;Robustness <br />
;Run-time verification and monitoring <br />
<br />
<br />
;Safety <br />
;Safety and security interaction<br />
;Safety in HRI<br />
: safety, system function<br />
: verification of any function in the system including ML & non-deterministic functions<br />
;Safety-centric HRI protocols<br />
;Safety requirements <br />
;Security <br />
;Security requirements<br />
;Simulation-based testing <br />
;Sim-based evaluation<br />
;Social/legal/ethical requirements <br />
;Software testing and debugging <br />
;Software tools for benchmarking and <br />
;Software tools for testing <br />
: software testing <br />
;Specification<br />
- ISO 9000:2015 - "document stating requirements" [https://bsol.bsigroup.com/Bibliographic/BibliographicInfoData/000000000030412048 ISO 9000:2015]<br />
;Synthetic environment <br />
: to develop high level test scenarios, drive test case development <br />
<br />
<br />
;Test cases for verification purposes <br />
;Testing <br />
;Transparency <br />
;Trust<br />
;Trustworthiness <br />
<br />
<br />
;Use-case scenario generation <br />
;Use Case testing <br />
<br />
<br />
;Validation: <br />
- ISO 9000:2015 defines verification as "Confirmation, through the provision of objective evidence, that the requirements for a specific intended use or application have been fulfilled" [https://bsol.bsigroup.com/Bibliographic/BibliographicInfoData/000000000030412048 ISO 9000:2015]<br />
- ISO/IEC/IEEE 15288:2015 further adds as "A system is able to accomplish its intended use, goals and objectives (i.e., meet stakeholder requirements) in the intended operational environment. The right system was built.”<br />
;Verification: <br />
- ISO 9000:2015 defines verification as "Confirmation, through the provision of objective evidence, that specified requirements have been fulfilled" [https://bsol.bsigroup.com/Bibliographic/BibliographicInfoData/000000000030412048 ISO 9000:2015]<br />
- ISO/IEC/IEEE 15288:2015 further adds as "Verification is a set of activities that compare a system or system element against the required characteristics. This includes, but is not limited to specified requirements, design description and the system itself. The system was built right."</div>Lm2292https://robotistry.org/vasbok/index.php?title=Portal:Glossary&diff=105Portal:Glossary2022-06-14T12:02:11Z<p>Lm2292: </p>
<hr />
<div>Offer different classifications and groupings - in main page<br />
<br />
* Verification techniques (tree?)<br />
* Metrics (grouping)<br />
* Application area (e.g. ML systems, for HRI, for medical robots)<br />
<br />
Contents of each linked page: <br />
* definitions with links to sources<br />
* short discussion of how topic relates to verification of autonomous systems<br />
<br />
'''''[[Template]]''''' for definition pages - please copy the markup from this page into your new definition page<br />
<br />
<br />
;Acceptability<br />
;Acceptance testing <br />
;Accountability <br />
;Activity <br />
- set of tasks that describe the technical effort to accomplish a process and help generate expected outcome [https://www.nasa.gov/seh/index.html NASA Systems Engineering Handbook]<br />
;Assessment <br />
;Assurance <br />
;Assurance cases <br />
;[[Autonomous System]]<br />
: "system which has the ability to perform intended tasks based on current state, knowledge and sensing, without human intervention" [https://shop.bsigroup.com/products/robots-and-robotic-devices-guide-to-the-ethical-design-and-application-of-robots-and-robotic-systems/standard BSI 8611:2016]<br />
;Autonomous systems design<br />
;Autonomy<br />
;Automation<br />
- allocation of system functions to machines versus humans [https://www.nasa.gov/seh/index.html NASA Systems Engineering Handbook] <br />
;Anomaly <br />
- unexpected performance of intended function [https://www.nasa.gov/seh/index.html NASA Systems Engineering Handbook]<br />
<br />
<br />
;Behavior verification for autonomous systems and ML systems <br />
;Behavioral verification <br />
<br />
<br />
;Combining V&V Techniques <br />
;Contextual reasoning <br />
;Correctness verification <br />
;Credibility <br />
;Cross-domain / multi-domain validation<br />
;Cyber-security <br />
<br />
<br />
;Dependability <br />
<br />
<br />
;Executable specifications <br />
;Experiment design <br />
;Explainability <br />
<br />
;Failure<br />
- inability of a system, subsystem or component to perform its required function within specified limits [https://www.nasa.gov/seh/index.html NASA Systems Engineering Handbook]<br />
<br />
;Failure detection and recovery <br />
;Fault<br />
- physical or logical cause, which explains a failure [https://www.nasa.gov/seh/index.html NASA Systems Engineering Handbook]<br />
;Formal methods for autonomous systems <br />
;Formal modelling <br />
;Formal software verification <br />
;Functional assurance<br />
;Functional requirements <br />
;Functional verification <br />
<br />
<br />
;HRI (Human-robot interactions)<br />
;HRI verification <br />
;Hybrid Logical/Dynamical Planning and Verification <br />
<br />
<br />
;Generalizability <br />
<br />
<br />
;Integrity of autonomous systems<br />
<br />
<br />
;Liability <br />
;Licensing and certification <br />
<br />
<br />
;Model-based evaluation <br />
<br />
<br />
<br />
<br />
;Objective evidence<br />
: ISO 9000:2015 - "data, supporting the existence or verity of something" [https://bsol.bsigroup.com/Bibliographic/BibliographicInfoData/000000000030412048 ISO 9000:2015]<br />
<br />
<br />
;Operational design domain<br />
<br />
;Process <br />
ISO 9000:2015 - "set of interrelated or interacting activities that use inputs to deliver an intended result" [https://bsol.bsigroup.com/Bibliographic/BibliographicInfoData/000000000030412048 ISO 9000:2015]<br />
<br />
;Qualitative assessment <br />
;Quality requirement<br />
- ISO 9000:2015 - "requirement related to quality" [https://bsol.bsigroup.com/Bibliographic/BibliographicInfoData/000000000030412048 ISO 9000:2015]<br />
;Quality plan <br />
- ISO 9000:2015 - "specification of the procedures and associated resources to be applied when and by whom to a specific object" [https://bsol.bsigroup.com/Bibliographic/BibliographicInfoData/000000000030412048 ISO 9000:2015]<br />
;Quantitative assessment <br />
<br />
<br />
;Performance evaluation and benchmarking <br />
;Privacy <br />
<br />
<br />
;Redundant robots <br />
;Reliability <br />
;Replicability <br />
;Reproducibility <br />
;Requirements <br />
: Workspace and conditions/context of operations <br />
<br />
;Requirement <br />
- ISO 9000:2015 - "need or expectation that is stated, generally implied or obligatory" [https://bsol.bsigroup.com/Bibliographic/BibliographicInfoData/000000000030412048 ISO 9000:2015]<br />
<br />
;Requirements development processes <br />
;Resilience<br />
;Responsibility <br />
;Robot safety <br />
;Robotic Systems <br />
: Robot systems engineering <br />
;Robustness <br />
;Run-time verification and monitoring <br />
<br />
<br />
;Safety <br />
;Safety and security interaction<br />
;Safety in HRI<br />
: safety, system function<br />
: verification of any function in the system including ML & non-deterministic functions<br />
;Safety-centric HRI protocols<br />
;Safety requirements <br />
;Security <br />
;Security requirements<br />
;Simulation-based testing <br />
;Sim-based evaluation<br />
;Social/legal/ethical requirements <br />
;Software testing and debugging <br />
;Software tools for benchmarking and <br />
;Software tools for testing <br />
: software testing <br />
;Specification<br />
- ISO 9000:2015 - "document stating requirements" [https://bsol.bsigroup.com/Bibliographic/BibliographicInfoData/000000000030412048 ISO 9000:2015]<br />
;Synthetic environment <br />
: to develop high level test scenarios, drive test case development <br />
<br />
<br />
;Test cases for verification purposes <br />
;Testing <br />
;Transparency <br />
;Trust<br />
;Trustworthiness <br />
<br />
<br />
;Use-case scenario generation <br />
;Use Case testing <br />
<br />
<br />
;Validation: <br />
- ISO 9000:2015 defines verification as "Confirmation, through the provision of objective evidence, that the requirements for a specific intended use or application have been fulfilled" [https://bsol.bsigroup.com/Bibliographic/BibliographicInfoData/000000000030412048 ISO 9000:2015]<br />
- ISO/IEC/IEEE 15288:2015 further adds as "A system is able to accomplish its intended use, goals and objectives (i.e., meet stakeholder requirements) in the intended operational environment. The right system was built.”<br />
;Verification: <br />
- ISO 9000:2015 defines verification as "Confirmation, through the provision of objective evidence, that specified requirements have been fulfilled" [https://bsol.bsigroup.com/Bibliographic/BibliographicInfoData/000000000030412048 ISO 9000:2015]<br />
- ISO/IEC/IEEE 15288:2015 further adds as "Verification is a set of activities that compare a system or system element against the required characteristics. This includes, but is not limited to specified requirements, design description and the system itself. The system was built right."</div>Lm2292https://robotistry.org/vasbok/index.php?title=Portal:Glossary&diff=103Portal:Glossary2022-06-14T10:59:40Z<p>Lm2292: </p>
<hr />
<div>Offer different classifications and groupings - in main page<br />
<br />
* Verification techniques (tree?)<br />
* Metrics (grouping)<br />
* Application area (e.g. ML systems, for HRI, for medical robots)<br />
<br />
Contents of each linked page: <br />
* definitions with links to sources<br />
* short discussion of how topic relates to verification of autonomous systems<br />
<br />
'''''[[Template]]''''' for definition pages - please copy the markup from this page into your new definition page<br />
<br />
<br />
;Acceptability<br />
;Acceptance testing <br />
;Accountability <br />
;Activity <br />
- set of tasks that describe the technical effort to accomplish a process and help generate expected outcome [https://www.nasa.gov/seh/index.html NASA Systems Engineering Handbook]<br />
;Assessment <br />
;Assurance <br />
;Assurance cases <br />
;[[Autonomous System]]<br />
: "system which has the ability to perform intended tasks based on current state, knowledge and sensing, without human intervention" [https://shop.bsigroup.com/products/robots-and-robotic-devices-guide-to-the-ethical-design-and-application-of-robots-and-robotic-systems/standard BSI 8611:2016]<br />
;Autonomous systems design<br />
;Autonomy<br />
;Automation<br />
- allocation of system functions to machines versus humans [https://www.nasa.gov/seh/index.html NASA Systems Engineering Handbook] <br />
;Anomaly <br />
- unexpected performance of intended function [https://www.nasa.gov/seh/index.html NASA Systems Engineering Handbook]<br />
<br />
<br />
;Behavior verification for autonomous systems and ML systems <br />
;Behavioral verification <br />
<br />
<br />
;Combining V&V Techniques <br />
;Contextual reasoning <br />
;Correctness verification <br />
;Credibility <br />
;Cross-domain / multi-domain validation<br />
;Cyber-security <br />
<br />
<br />
;Dependability <br />
<br />
<br />
;Executable specifications <br />
;Experiment design <br />
;Explainability <br />
<br />
<br />
;Failure detection and recovery <br />
;Formal methods for autonomous systems <br />
;Formal modelling <br />
;Formal software verification <br />
;Functional assurance<br />
;Functional requirements <br />
;Functional verification <br />
<br />
<br />
;HRI (Human-robot interactions)<br />
;HRI verification <br />
;Hybrid Logical/Dynamical Planning and Verification <br />
<br />
<br />
;Generalizability <br />
<br />
<br />
;Integrity of autonomous systems<br />
<br />
<br />
;Liability <br />
;Licensing and certification <br />
<br />
<br />
;Model-based evaluation <br />
<br />
<br />
<br />
<br />
;Objective evidence<br />
: ISO 9000:2015 - "data, supporting the existence or verity of something" [https://bsol.bsigroup.com/Bibliographic/BibliographicInfoData/000000000030412048 ISO 9000:2015]<br />
<br />
<br />
;Operational design domain<br />
<br />
;Process <br />
ISO 9000:2015 - "set of interrelated or interacting activities that use inputs to deliver an intended result" [https://bsol.bsigroup.com/Bibliographic/BibliographicInfoData/000000000030412048 ISO 9000:2015]<br />
<br />
;Qualitative assessment <br />
;Quality requirement<br />
- ISO 9000:2015 - "requirement related to quality" [https://bsol.bsigroup.com/Bibliographic/BibliographicInfoData/000000000030412048 ISO 9000:2015]<br />
;Quality plan <br />
- ISO 9000:2015 - "specification of the procedures and associated resources to be applied when and by whom to a specific object" [https://bsol.bsigroup.com/Bibliographic/BibliographicInfoData/000000000030412048 ISO 9000:2015]<br />
;Quantitative assessment <br />
<br />
<br />
;Performance evaluation and benchmarking <br />
;Privacy <br />
<br />
<br />
;Redundant robots <br />
;Reliability <br />
;Replicability <br />
;Reproducibility <br />
;Requirements <br />
: Workspace and conditions/context of operations <br />
<br />
;Requirement <br />
- ISO 9000:2015 - "need or expectation that is stated, generally implied or obligatory" [https://bsol.bsigroup.com/Bibliographic/BibliographicInfoData/000000000030412048 ISO 9000:2015]<br />
<br />
;Requirements development processes <br />
;Resilience<br />
;Responsibility <br />
;Robot safety <br />
;Robotic Systems <br />
: Robot systems engineering <br />
;Robustness <br />
;Run-time verification and monitoring <br />
<br />
<br />
;Safety <br />
;Safety and security interaction<br />
;Safety in HRI<br />
: safety, system function<br />
: verification of any function in the system including ML & non-deterministic functions<br />
;Safety-centric HRI protocols<br />
;Safety requirements <br />
;Security <br />
;Security requirements<br />
;Simulation-based testing <br />
;Sim-based evaluation<br />
;Social/legal/ethical requirements <br />
;Software testing and debugging <br />
;Software tools for benchmarking and <br />
;Software tools for testing <br />
: software testing <br />
;Specification<br />
- ISO 9000:2015 - "document stating requirements" [https://bsol.bsigroup.com/Bibliographic/BibliographicInfoData/000000000030412048 ISO 9000:2015]<br />
;Synthetic environment <br />
: to develop high level test scenarios, drive test case development <br />
<br />
<br />
;Test cases for verification purposes <br />
;Testing <br />
;Transparency <br />
;Trust<br />
;Trustworthiness <br />
<br />
<br />
;Use-case scenario generation <br />
;Use Case testing <br />
<br />
<br />
;Validation: <br />
- ISO 9000:2015 defines verification as "Confirmation, through the provision of objective evidence, that the requirements for a specific intended use or application have been fulfilled" [https://bsol.bsigroup.com/Bibliographic/BibliographicInfoData/000000000030412048 ISO 9000:2015]<br />
- ISO/IEC/IEEE 15288:2015 further adds as "A system is able to accomplish its intended use, goals and objectives (i.e., meet stakeholder requirements) in the intended operational environment. The right system was built.”<br />
;Verification: <br />
- ISO 9000:2015 defines verification as "Confirmation, through the provision of objective evidence, that specified requirements have been fulfilled" [https://bsol.bsigroup.com/Bibliographic/BibliographicInfoData/000000000030412048 ISO 9000:2015]<br />
- ISO/IEC/IEEE 15288:2015 further adds as "Verification is a set of activities that compare a system or system element against the required characteristics. This includes, but is not limited to specified requirements, design description and the system itself. The system was built right."</div>Lm2292https://robotistry.org/vasbok/index.php?title=Portal:Glossary&diff=102Portal:Glossary2022-06-14T10:50:52Z<p>Lm2292: </p>
<hr />
<div>Offer different classifications and groupings - in main page<br />
<br />
* Verification techniques (tree?)<br />
* Metrics (grouping)<br />
* Application area (e.g. ML systems, for HRI, for medical robots)<br />
<br />
Contents of each linked page: <br />
* definitions with links to sources<br />
* short discussion of how topic relates to verification of autonomous systems<br />
<br />
'''''[[Template]]''''' for definition pages - please copy the markup from this page into your new definition page<br />
<br />
<br />
;Acceptability<br />
;Acceptance testing <br />
;Accountability <br />
;Assessment <br />
;Assurance <br />
;Assurance cases <br />
;[[Autonomous System]]<br />
: "system which has the ability to perform intended tasks based on current state, knowledge and sensing, without human intervention" [https://shop.bsigroup.com/products/robots-and-robotic-devices-guide-to-the-ethical-design-and-application-of-robots-and-robotic-systems/standard BSI 8611:2016]<br />
;Autonomous systems design<br />
;Autonomy<br />
<br />
<br />
;Behavior verification for autonomous systems and ML systems <br />
;Behavioral verification <br />
<br />
<br />
;Combining V&V Techniques <br />
;Contextual reasoning <br />
;Correctness verification <br />
;Credibility <br />
;Cross-domain / multi-domain validation<br />
;Cyber-security <br />
<br />
<br />
;Dependability <br />
<br />
<br />
;Executable specifications <br />
;Experiment design <br />
;Explainability <br />
<br />
<br />
;Failure detection and recovery <br />
;Formal methods for autonomous systems <br />
;Formal modelling <br />
;Formal software verification <br />
;Functional assurance<br />
;Functional requirements <br />
;Functional verification <br />
<br />
<br />
;HRI (Human-robot interactions)<br />
;HRI verification <br />
;Hybrid Logical/Dynamical Planning and Verification <br />
<br />
<br />
;Generalizability <br />
<br />
<br />
;Integrity of autonomous systems<br />
<br />
<br />
;Liability <br />
;Licensing and certification <br />
<br />
<br />
;Model-based evaluation <br />
<br />
<br />
;Objective evidence<br />
: ISO 9000:2015 - "data, supporting the existence or verity of something" [https://bsol.bsigroup.com/Bibliographic/BibliographicInfoData/000000000030412048 ISO 9000:2015]<br />
<br />
<br />
;Operational design domain<br />
<br />
;Process <br />
ISO 9000:2015 - "set of interrelated or interacting activities that use inputs to deliver an intended result" [https://bsol.bsigroup.com/Bibliographic/BibliographicInfoData/000000000030412048 ISO 9000:2015]<br />
<br />
;Qualitative assessment <br />
;Quality requirement<br />
- ISO 9000:2015 - "requirement related to quality" [https://bsol.bsigroup.com/Bibliographic/BibliographicInfoData/000000000030412048 ISO 9000:2015]<br />
;Quality plan <br />
- ISO 9000:2015 - "specification of the procedures and associated resources to be applied when and by whom to a specific object" [https://bsol.bsigroup.com/Bibliographic/BibliographicInfoData/000000000030412048 ISO 9000:2015]<br />
;Quantitative assessment <br />
<br />
<br />
;Performance evaluation and benchmarking <br />
;Privacy <br />
<br />
<br />
;Redundant robots <br />
;Reliability <br />
;Replicability <br />
;Reproducibility <br />
;Requirements <br />
: Workspace and conditions/context of operations <br />
<br />
;Requirement <br />
- ISO 9000:2015 - "need or expectation that is stated, generally implied or obligatory" [https://bsol.bsigroup.com/Bibliographic/BibliographicInfoData/000000000030412048 ISO 9000:2015]<br />
<br />
;Requirements development processes <br />
;Resilience<br />
;Responsibility <br />
;Robot safety <br />
;Robotic Systems <br />
: Robot systems engineering <br />
;Robustness <br />
;Run-time verification and monitoring <br />
<br />
<br />
;Safety <br />
;Safety and security interaction<br />
;Safety in HRI<br />
: safety, system function<br />
: verification of any function in the system including ML & non-deterministic functions<br />
;Safety-centric HRI protocols<br />
;Safety requirements <br />
;Security <br />
;Security requirements<br />
;Simulation-based testing <br />
;Sim-based evaluation<br />
;Social/legal/ethical requirements <br />
;Software testing and debugging <br />
;Software tools for benchmarking and <br />
;Software tools for testing <br />
: software testing <br />
;Specification<br />
- ISO 9000:2015 - "document stating requirements" [https://bsol.bsigroup.com/Bibliographic/BibliographicInfoData/000000000030412048 ISO 9000:2015]<br />
;Synthetic environment <br />
: to develop high level test scenarios, drive test case development <br />
<br />
<br />
;Test cases for verification purposes <br />
;Testing <br />
;Transparency <br />
;Trust<br />
;Trustworthiness <br />
<br />
<br />
;Use-case scenario generation <br />
;Use Case testing <br />
<br />
<br />
;Validation: <br />
- ISO 9000:2015 defines verification as "Confirmation, through the provision of objective evidence, that the requirements for a specific intended use or application have been fulfilled" [https://bsol.bsigroup.com/Bibliographic/BibliographicInfoData/000000000030412048 ISO 9000:2015]<br />
- ISO/IEC/IEEE 15288:2015 further adds as "A system is able to accomplish its intended use, goals and objectives (i.e., meet stakeholder requirements) in the intended operational environment. The right system was built.”<br />
;Verification: <br />
- ISO 9000:2015 defines verification as "Confirmation, through the provision of objective evidence, that specified requirements have been fulfilled" [https://bsol.bsigroup.com/Bibliographic/BibliographicInfoData/000000000030412048 ISO 9000:2015]<br />
- ISO/IEC/IEEE 15288:2015 further adds as "Verification is a set of activities that compare a system or system element against the required characteristics. This includes, but is not limited to specified requirements, design description and the system itself. The system was built right."</div>Lm2292https://robotistry.org/vasbok/index.php?title=Portal:Glossary&diff=101Portal:Glossary2022-06-14T10:49:46Z<p>Lm2292: </p>
<hr />
<div>Offer different classifications and groupings - in main page<br />
<br />
* Verification techniques (tree?)<br />
* Metrics (grouping)<br />
* Application area (e.g. ML systems, for HRI, for medical robots)<br />
<br />
Contents of each linked page: <br />
* definitions with links to sources<br />
* short discussion of how topic relates to verification of autonomous systems<br />
<br />
'''''[[Template]]''''' for definition pages - please copy the markup from this page into your new definition page<br />
<br />
<br />
;Acceptability<br />
;Acceptance testing <br />
;Accountability <br />
;Assessment <br />
;Assurance <br />
;Assurance cases <br />
;[[Autonomous System]]<br />
: "system which has the ability to perform intended tasks based on current state, knowledge and sensing, without human intervention" [https://shop.bsigroup.com/products/robots-and-robotic-devices-guide-to-the-ethical-design-and-application-of-robots-and-robotic-systems/standard BSI 8611:2016]<br />
;Autonomous systems design<br />
;Autonomy<br />
<br />
<br />
;Behavior verification for autonomous systems and ML systems <br />
;Behavioral verification <br />
<br />
<br />
;Combining V&V Techniques <br />
;Contextual reasoning <br />
;Correctness verification <br />
;Credibility <br />
;Cross-domain / multi-domain validation<br />
;Cyber-security <br />
<br />
<br />
;Dependability <br />
<br />
<br />
;Executable specifications <br />
;Experiment design <br />
;Explainability <br />
<br />
<br />
;Failure detection and recovery <br />
;Formal methods for autonomous systems <br />
;Formal modelling <br />
;Formal software verification <br />
;Functional assurance<br />
;Functional requirements <br />
;Functional verification <br />
<br />
<br />
;HRI (Human-robot interactions)<br />
;HRI verification <br />
;Hybrid Logical/Dynamical Planning and Verification <br />
<br />
<br />
;Generalizability <br />
<br />
<br />
;Integrity of autonomous systems<br />
<br />
<br />
;Liability <br />
;Licensing and certification <br />
<br />
<br />
;Model-based evaluation <br />
<br />
<br />
;Objective evidence<br />
: ISO 9000:2015 - "data, supporting the existence or verity of something"<br />
<br />
<br />
;Operational design domain<br />
<br />
;Process <br />
ISO 9000:2015 - "set of interrelated or interacting activities that use inputs to deliver an intended result"<br />
<br />
;Qualitative assessment <br />
;Quality requirement<br />
- ISO 9000:2015 - "requirement related to quality"<br />
;Quality plan <br />
- ISO 9000:2015 - "specification of the procedures and associated resources to be applied when and by whom to a specific object"<br />
;Quantitative assessment <br />
<br />
<br />
;Performance evaluation and benchmarking <br />
;Privacy <br />
<br />
<br />
;Redundant robots <br />
;Reliability <br />
;Replicability <br />
;Reproducibility <br />
;Requirements <br />
: Workspace and conditions/context of operations <br />
<br />
;Requirement <br />
- ISO 9000:2015 - "need or expectation that is stated, generally implied or obligatory"<br />
<br />
;Requirements development processes <br />
;Resilience<br />
;Responsibility <br />
;Robot safety <br />
;Robotic Systems <br />
: Robot systems engineering <br />
;Robustness <br />
;Run-time verification and monitoring <br />
<br />
<br />
;Safety <br />
;Safety and security interaction<br />
;Safety in HRI<br />
: safety, system function<br />
: verification of any function in the system including ML & non-deterministic functions<br />
;Safety-centric HRI protocols<br />
;Safety requirements <br />
;Security <br />
;Security requirements<br />
;Simulation-based testing <br />
;Sim-based evaluation<br />
;Social/legal/ethical requirements <br />
;Software testing and debugging <br />
;Software tools for benchmarking and <br />
;Software tools for testing <br />
: software testing <br />
;Specification<br />
- ISO 9000:2015 - "document stating requirements"<br />
;Synthetic environment <br />
: to develop high level test scenarios, drive test case development <br />
<br />
<br />
;Test cases for verification purposes <br />
;Testing <br />
;Transparency <br />
;Trust<br />
;Trustworthiness <br />
<br />
<br />
;Use-case scenario generation <br />
;Use Case testing <br />
<br />
<br />
;Validation:<br />
- ISO 9000:2015 defines verification as "Confirmation, through the provision of objective evidence, that the requirements for a specific intended use or application have been fulfilled"<br />
- ISO/IEC/IEEE 15288:2015 further adds as "A system is able to accomplish its intended use, goals and objectives (i.e., meet stakeholder requirements) in the intended operational environment. The right system was built.”<br />
;Verification: <br />
- ISO 9000:2015 defines verification as "Confirmation, through the provision of objective evidence, that specified requirements have been fulfilled"<br />
- ISO/IEC/IEEE 15288:2015 further adds as "Verification is a set of activities that compare a system or system element against the required characteristics. This includes, but is not limited to specified requirements, design description and the system itself. The system was built right."</div>Lm2292https://robotistry.org/vasbok/index.php?title=Portal:Tutorials&diff=68Portal:Tutorials2022-05-17T12:04:59Z<p>Lm2292: </p>
<hr />
<div>;Verification Tools & Processes Tutorials<br />
<br />
<br />
;Autonomy Tools & Processes Tutorials<br />
<br />
<br />
;Verification of Autonomous Systems Tools & Processes Tutorials<br />
<br />
* Andre Platzer [https://keymaerax.org/Xtutorial.html Tutorial on how to use Keymaera-X]<br />
<br />
*<br />
;KeyMaeraX - Garage Door<br />
<br />
ArchiveEntry "Garage Door"<br />
Definitions <br />
Real m = 50;<br />
Real k = 600; <br />
Real K = 0.6; <br />
Real R = 0.005; <br />
Real J = 0.02;<br />
Real Kp = 240; <br />
<br />
Real error(Real ref, Real theta) = (ref - theta); <br />
<br />
HP ctrl ::= {u := Kp*error;};<br />
<br />
HP motion ::= {{<br />
theta' = thetadt, <br />
thetadt' = (K*R^2)/(J+m*R^2)*theta + (K*R)/(J+m*R^2)*u <br />
& theta >=0}}; <br />
End. <br />
ProgramVariables<br />
Real theta; /*position*/<br />
Real thetadt; /*velocity*/<br />
Real u; /*control input*/<br />
End. <br />
Problem<br />
theta > 0 -> [{ctrl; motion;}*] theta >= 0<br />
End.<br />
End.<br />
<br />
;KeymaeraX DrivelineDynamics<br />
ArchiveEntry "DrivelineDynamics"<br />
Definitions <br />
Real Jf = 0.625;<br />
Real Jc = 6250; <br />
Real cs = 65000; <br />
Real ds = 1000; <br />
Real Tload = 7000;<br />
Real r = 12.5; <br />
Real K1 = 5.4567;<br />
Real K2 = 57.1911;<br />
Real K3 = -12.9458;<br />
HP ctrl ::= {u := -(K1*Weng + K2*Wwheel + K3*phi);}; <br />
HP driveline ::= {{<br />
Weng' = (1/Jf)*(u - (1/r)*(cs*phi + ds*((Weng/r)-Wwheel))),<br />
Wwheel' = (1/Jc)*(cs*phi + ds*((Weng/r)-Wwheel)-Tload),<br />
phi' = (Weng/r) - Wwheel <br />
}};<br />
<br />
End. <br />
ProgramVariables<br />
Real Weng; /*engine speed*/<br />
Real Wwheel; /*wheel speed*/<br />
Real phi; /*torsion*/<br />
Real u; /*control input*/<br />
End. <br />
Problem<br />
Weng > 0 & Wwheel > 0 & phi > 0 -> [{ctrl; driveline;}*] Weng >= 0 & Wwheel > 0 & phi = 0<br />
End.<br />
End.</div>Lm2292https://robotistry.org/vasbok/index.php?title=Portal:Tutorials&diff=67Portal:Tutorials2022-05-17T12:04:00Z<p>Lm2292: </p>
<hr />
<div>;Verification Tools & Processes Tutorials<br />
<br />
<br />
;Autonomy Tools & Processes Tutorials<br />
<br />
<br />
;Verification of Autonomous Systems Tools & Processes Tutorials<br />
<br />
* Andre Platzer [https://keymaerax.org/Xtutorial.html Tutorial on how to use Keymaera-X]<br />
<br />
*<br />
;KeyMaeraX - Garage Door<br />
<br />
ArchiveEntry "Garage Door"<br />
Definitions <br />
Real m = 50;<br />
Real k = 600; <br />
Real K = 0.6; <br />
Real R = 0.005; <br />
Real J = 0.02;<br />
Real Kp = 240; <br />
<br />
Real error(Real ref, Real theta) = (ref - theta); <br />
<br />
HP ctrl ::= {u := Kp*error;};<br />
<br />
HP motion ::= {{<br />
theta' = thetadt, <br />
thetadt' = (K*R^2)/(J+m*R^2)*theta + (K*R)/(J+m*R^2)*u <br />
& theta >=0}}; <br />
End. <br />
ProgramVariables<br />
Real theta; /*position*/<br />
Real thetadt; /*velocity*/<br />
Real u; /*control input*/<br />
End. <br />
Problem<br />
theta > 0 -> [{ctrl; motion;}*] theta >= 0<br />
End.<br />
End.<br />
<br />
ArchiveEntry "DrivelineDynamics"<br />
Definitions <br />
Real Jf = 0.625;<br />
Real Jc = 6250; <br />
Real cs = 65000; <br />
Real ds = 1000; <br />
Real Tload = 7000;<br />
Real r = 12.5; <br />
Real K1 = 5.4567;<br />
Real K2 = 57.1911;<br />
Real K3 = -12.9458;<br />
<br />
HP ctrl ::= {u := -(K1*Weng + K2*Wwheel + K3*phi);};<br />
<br />
HP driveline ::= {{<br />
Weng' = (1/Jf)*(u - (1/r)*(cs*phi + ds*((Weng/r)-Wwheel))),<br />
Wwheel' = (1/Jc)*(cs*phi + ds*((Weng/r)-Wwheel)-Tload),<br />
phi' = (Weng/r) - Wwheel <br />
}};<br />
<br />
End. <br />
ProgramVariables<br />
Real Weng; /*engine speed*/<br />
Real Wwheel; /*wheel speed*/<br />
Real phi; /*torsion*/<br />
Real u; /*control input*/<br />
End. <br />
Problem<br />
Weng > 0 & Wwheel > 0 & phi > 0 -> [{ctrl; driveline;}*] Weng >= 0 & Wwheel > 0 & phi = 0<br />
End.<br />
End.</div>Lm2292https://robotistry.org/vasbok/index.php?title=Portal:Tutorials&diff=66Portal:Tutorials2022-05-17T12:03:44Z<p>Lm2292: </p>
<hr />
<div>;Verification Tools & Processes Tutorials<br />
<br />
<br />
;Autonomy Tools & Processes Tutorials<br />
<br />
<br />
;Verification of Autonomous Systems Tools & Processes Tutorials<br />
<br />
* Andre Platzer [https://keymaerax.org/Xtutorial.html Tutorial on how to use Keymaera-X]<br />
<br />
*<br />
;KeyMaeraX - Garage Door<br />
<br />
ArchiveEntry "Garage Door"<br />
Definitions <br />
Real m = 50;<br />
Real k = 600; <br />
Real K = 0.6; <br />
Real R = 0.005; <br />
Real J = 0.02;<br />
Real Kp = 240; <br />
<br />
Real error(Real ref, Real theta) = (ref - theta); <br />
<br />
HP ctrl ::= {u := Kp*error;};<br />
<br />
HP motion ::= {{<br />
theta' = thetadt, <br />
thetadt' = (K*R^2)/(J+m*R^2)*theta + (K*R)/(J+m*R^2)*u <br />
& theta >=0}};<br />
<br />
End. <br />
ProgramVariables<br />
Real theta; /*position*/<br />
Real thetadt; /*velocity*/<br />
Real u; /*control input*/<br />
End. <br />
Problem<br />
theta > 0 -> [{ctrl; motion;}*] theta >= 0<br />
End.<br />
End.<br />
<br />
ArchiveEntry "DrivelineDynamics"<br />
Definitions <br />
Real Jf = 0.625;<br />
Real Jc = 6250; <br />
Real cs = 65000; <br />
Real ds = 1000; <br />
Real Tload = 7000;<br />
Real r = 12.5; <br />
Real K1 = 5.4567;<br />
Real K2 = 57.1911;<br />
Real K3 = -12.9458;<br />
<br />
HP ctrl ::= {u := -(K1*Weng + K2*Wwheel + K3*phi);};<br />
<br />
HP driveline ::= {{<br />
Weng' = (1/Jf)*(u - (1/r)*(cs*phi + ds*((Weng/r)-Wwheel))),<br />
Wwheel' = (1/Jc)*(cs*phi + ds*((Weng/r)-Wwheel)-Tload),<br />
phi' = (Weng/r) - Wwheel <br />
}};<br />
<br />
End. <br />
ProgramVariables<br />
Real Weng; /*engine speed*/<br />
Real Wwheel; /*wheel speed*/<br />
Real phi; /*torsion*/<br />
Real u; /*control input*/<br />
End. <br />
Problem<br />
Weng > 0 & Wwheel > 0 & phi > 0 -> [{ctrl; driveline;}*] Weng >= 0 & Wwheel > 0 & phi = 0<br />
End.<br />
End.</div>Lm2292https://robotistry.org/vasbok/index.php?title=Portal:Tutorials&diff=65Portal:Tutorials2022-05-17T12:03:09Z<p>Lm2292: </p>
<hr />
<div>;Verification Tools & Processes Tutorials<br />
<br />
<br />
;Autonomy Tools & Processes Tutorials<br />
<br />
<br />
;Verification of Autonomous Systems Tools & Processes Tutorials<br />
<br />
* Andre Platzer [https://keymaerax.org/Xtutorial.html Tutorial on how to use Keymaera-X]<br />
<br />
*<br />
;KeyMaeraX - Garage Door<br />
<br />
ArchiveEntry "Garage Door"<br />
Definitions <br />
Real m = 50;<br />
Real k = 600; <br />
Real K = 0.6; <br />
Real R = 0.005; <br />
Real J = 0.02;<br />
Real Kp = 240; <br />
<br />
Real error(Real ref, Real theta) = (ref - theta); <br />
<br />
HP ctrl ::= {u := Kp*error;};<br />
<br />
HP motion ::= {{<br />
theta' = thetadt, <br />
thetadt' = (K*R^2)/(J+m*R^2)*theta + (K*R)/(J+m*R^2)*u <br />
& theta >=0}};<br />
<br />
End. <br />
ProgramVariables<br />
Real theta; /*position*/<br />
Real thetadt; /*velocity*/<br />
Real u; /*control input*/<br />
End. <br />
Problem<br />
theta > 0 -> [{ctrl; motion;}*] theta >= 0<br />
End.<br />
End.<br />
<br />
ArchiveEntry "DrivelineDynamics"<br />
<br />
Definitions <br />
Real Jf = 0.625;<br />
Real Jc = 6250; <br />
Real cs = 65000; <br />
Real ds = 1000; <br />
Real Tload = 7000;<br />
Real r = 12.5; <br />
Real K1 = 5.4567;<br />
Real K2 = 57.1911;<br />
Real K3 = -12.9458;<br />
<br />
HP ctrl ::= {u := -(K1*Weng + K2*Wwheel + K3*phi);};<br />
<br />
HP driveline ::= {{<br />
Weng' = (1/Jf)*(u - (1/r)*(cs*phi + ds*((Weng/r)-Wwheel))),<br />
Wwheel' = (1/Jc)*(cs*phi + ds*((Weng/r)-Wwheel)-Tload),<br />
phi' = (Weng/r) - Wwheel <br />
}};<br />
<br />
End. <br />
<br />
ProgramVariables<br />
Real Weng; /*engine speed*/<br />
Real Wwheel; /*wheel speed*/<br />
Real phi; /*torsion*/<br />
Real u; /*control input*/<br />
End. <br />
<br />
Problem<br />
Weng > 0 & Wwheel > 0 & phi > 0 -> [{ctrl; driveline;}*] Weng >= 0 & Wwheel > 0 & phi = 0<br />
End.<br />
End.</div>Lm2292https://robotistry.org/vasbok/index.php?title=Portal:Glossary&diff=64Portal:Glossary2022-05-17T11:30:03Z<p>Lm2292: </p>
<hr />
<div>Offer different classifications and groupings - in main page<br />
<br />
* Verification techniques (tree?)<br />
* Metrics (grouping)<br />
* Application area (e.g. ML systems, for HRI, for medical robots)<br />
<br />
Contents of each linked page: <br />
* definitions with links to sources<br />
* short discussion of how topic relates to verification of autonomous systems<br />
<br />
<br />
;Acceptability<br />
;Acceptance testing <br />
;Accountability <br />
;Assessment <br />
;Assurance <br />
;Assurance cases <br />
;Autonomous System: "system which has the ability to perform intended tasks based on current state, knowledge and sensing, without human intervention" [https://shop.bsigroup.com/products/robots-and-robotic-devices-guide-to-the-ethical-design-and-application-of-robots-and-robotic-systems/standard BSI 8611:2016]<br />
;Autonomous systems design<br />
;Autonomy<br />
<br />
<br />
;Behavior verification for autonomous systems and ML systems <br />
;Behavioral verification <br />
<br />
<br />
;Combining V&V Techniques <br />
;Contextual reasoning <br />
;Correctness verification <br />
;Credibility <br />
;Cross-domain / multi-domain validation<br />
;Cyber-security <br />
<br />
<br />
;Dependability <br />
<br />
<br />
;Executable specifications <br />
;Experiment design <br />
;Explainability <br />
<br />
<br />
;Failure detection and recovery <br />
;Formal methods for autonomous systems <br />
;Formal modelling <br />
;Formal software verification <br />
;Functional assurance<br />
;Functional requirements <br />
;Functional verification <br />
<br />
<br />
;HRI (Human-robot interactions)<br />
;HRI verification <br />
;Hybrid Logical/Dynamical Planning and Verification <br />
<br />
<br />
;Generalizability <br />
<br />
<br />
;Integrity of autonomous systems<br />
<br />
<br />
;Liability <br />
;Licensing and certification <br />
<br />
<br />
;Model-based evaluation <br />
<br />
<br />
;Objective evidence: <br />
- ISO 9000:2015 - "data, supporting the existence or verity of something"<br />
<br />
<br />
;Operational design domain<br />
<br />
<br />
;Qualitative assessment <br />
;Quantitative assessment <br />
<br />
<br />
;Performance evaluation and benchmarking <br />
;Privacy <br />
<br />
<br />
;Redundant robots <br />
;Reliability <br />
;Replicability <br />
;Reproducibility <br />
;Requirements <br />
: Workspace and conditions/context of operations <br />
<br />
;Requirement <br />
- ISO 9000:2015 - "need or expectation that is stated, generally implied or obligatory"<br />
<br />
;Requirements development processes <br />
;Resilience<br />
;Responsibility <br />
;Robot safety <br />
;Robotic Systems <br />
: Robot systems engineering <br />
;Robustness <br />
;Run-time verification and monitoring <br />
<br />
<br />
;Safety <br />
;Safety and security interaction<br />
;Safety in HRI<br />
: safety, system function<br />
: verification of any function in the system including ML & non-deterministic functions<br />
;Safety-centric HRI protocols<br />
;Safety requirements <br />
;Security <br />
;Security requirements<br />
;Simulation-based testing <br />
;Sim-based evaluation<br />
;Social/legal/ethical requirements <br />
;Software testing and debugging <br />
;Software tools for benchmarking and <br />
;Software tools for testing <br />
: software testing <br />
;Specification<br />
- ISO 9000:2015 - "document stating requirements"<br />
;Synthetic environment <br />
: to develop high level test scenarios, drive test case development <br />
<br />
<br />
;Test cases for verification purposes <br />
;Testing <br />
;Transparency <br />
;Trust<br />
;Trustworthiness <br />
<br />
<br />
;Use-case scenario generation <br />
;Use Case testing <br />
<br />
<br />
;Validation:<br />
- ISO 9000:2015 defines verification as "Confirmation, through the provision of objective evidence, that the requirements for a specific intended use or application have been fulfilled"<br />
- ISO/IEC/IEEE 15288:2015 further adds as "A system is able to accomplish its intended use, goals and objectives (i.e., meet stakeholder requirements) in the intended operational environment. The right system was built.”<br />
;Verification: <br />
- ISO 9000:2015 defines verification as "Confirmation, through the provision of objective evidence, that specified requirements have been fulfilled"<br />
- ISO/IEC/IEEE 15288:2015 further adds as "Verification is a set of activities that compare a system or system element against the required characteristics. This includes, but is not limited to specified requirements, design description and the system itself. The system was built right."<br />
<br />
<br />
<br />
;Quality requirement<br />
- ISO 9000:2015 - "requirement related to quality"</div>Lm2292https://robotistry.org/vasbok/index.php?title=Portal:Glossary&diff=63Portal:Glossary2022-05-17T11:19:59Z<p>Lm2292: </p>
<hr />
<div>Offer different classifications and groupings - in main page<br />
<br />
* Verification techniques (tree?)<br />
* Metrics (grouping)<br />
* Application area (e.g. ML systems, for HRI, for medical robots)<br />
<br />
Contents of each linked page: <br />
* definitions with links to sources<br />
* short discussion of how topic relates to verification of autonomous systems<br />
<br />
<br />
;Acceptability<br />
;Acceptance testing <br />
;Accountability <br />
;Assessment <br />
;Assurance <br />
;Assurance cases <br />
;Autonomous System: "system which has the ability to perform intended tasks based on current state, knowledge and sensing, without human intervention" [https://shop.bsigroup.com/products/robots-and-robotic-devices-guide-to-the-ethical-design-and-application-of-robots-and-robotic-systems/standard BSI 8611:2016]<br />
;Autonomous systems design<br />
;Autonomy<br />
<br />
<br />
;Behavior verification for autonomous systems and ML systems <br />
;Behavioral verification <br />
<br />
<br />
;Combining V&V Techniques <br />
;Contextual reasoning <br />
;Correctness verification <br />
;Credibility <br />
;Cross-domain / multi-domain validation<br />
;Cyber-security <br />
<br />
<br />
;Dependability <br />
<br />
<br />
;Executable specifications <br />
;Experiment design <br />
;Explainability <br />
<br />
<br />
;Failure detection and recovery <br />
;Formal methods for autonomous systems <br />
;Formal modelling <br />
;Formal software verification <br />
;Functional assurance<br />
;Functional requirements <br />
;Functional verification <br />
<br />
<br />
;HRI (Human-robot interactions)<br />
;HRI verification <br />
;Hybrid Logical/Dynamical Planning and Verification <br />
<br />
<br />
;Generalizability <br />
<br />
<br />
;Integrity of autonomous systems<br />
<br />
<br />
;Liability <br />
;Licensing and certification <br />
<br />
<br />
;Model-based evaluation <br />
<br />
<br />
;Operational design domain<br />
<br />
<br />
;Qualitative assessment <br />
;Quantitative assessment <br />
<br />
<br />
;Performance evaluation and benchmarking <br />
;Privacy <br />
<br />
<br />
;Redundant robots <br />
;Reliability <br />
;Replicability <br />
;Reproducibility <br />
;Requirements <br />
: Workspace and conditions/context of operations <br />
;Requirements development processes <br />
;Resilience<br />
;Responsibility <br />
;Robot safety <br />
;Robotic Systems <br />
: Robot systems engineering <br />
;Robustness <br />
;Run-time verification and monitoring <br />
<br />
<br />
;Safety <br />
;Safety and security interaction<br />
;Safety in HRI<br />
: safety, system function<br />
: verification of any function in the system including ML & non-deterministic functions<br />
;Safety-centric HRI protocols<br />
;Safety requirements <br />
;Security <br />
;Security requirements<br />
;Simulation-based testing <br />
;Sim-based evaluation<br />
;Social/legal/ethical requirements <br />
;Software testing and debugging <br />
;Software tools for benchmarking and <br />
;Software tools for testing <br />
: software testing <br />
;Specifications<br />
;Synthetic environment <br />
: to develop high level test scenarios, drive test case development <br />
<br />
<br />
;Test cases for verification purposes <br />
;Testing <br />
;Transparency <br />
;Trust<br />
;Trustworthiness <br />
<br />
<br />
;Use-case scenario generation <br />
;Use Case testing <br />
<br />
<br />
;Validation:<br />
- ISO 9000:2005 (now deprecated, ISO 9000:2015 cannot access) "Confirmation, through the provision of objective evidence, that the requirements for a specific intended use or application have been fulfilled"<br />
- ISO/IEC/IEEE 15288:2015 further adds as "A system is able to accomplish its intended use, goals and objectives (i.e., meet stakeholder requirements) in the intended operational environment. The right system was built.”<br />
;Verification: <br />
- ISO 9000:2005 (now deprecated, ISO 9000:2015 cannot access) defines verification as "Confirmation, through the provision of objective evidence, that specified requirements have been fulfilled"<br />
- ISO/IEC/IEEE 15288:2015 further adds as "Verification is a set of activities that compare a system or system element against the required characteristics. This includes, but is not limited to specified requirements, design description and the system itself. The system was built right."</div>Lm2292