The Dutch Ministry of Defense (NL-MoD) has recently acquired an update of its medium range anti tank (MRAT) missile system, called the GILL. The update to the SPIKE Long Range (LR) weapon system is accompanied with the acquisition of new simulation training devices (STDs). These devices are bought Commercial off the Shelf (COTS). The question arises whether the STDs are valid training means for the NL MoD intended training purposes. In this paper we present the application of the Generic Methodology for Verification and Validation (GM-VV) to the question above. First the intended purpose of the STD’s is determined by executing a training needs analysis, then the verification and validation (V&V) areas of interest are selected based on how the training curriculum depends on the usage of an STD and the uncertainty about its quality. During the V&V study it was found that specific tests would only be possible at a later time, e.g. due to unavailable validation reference data, outside of the time frame of the V&V study, and feasible substitute tests had to be defined. Many findings from the V&V tests indicate the usefulness of the STDs, while others indicate that changes are required, either to the training curriculum or to the STDs. The GM-VV allows for adapting to the scope as well as the graceful degradation of the V&V tests. The NL MoD can build upon the current findings at a later time, e.g. by adding reference data, to further decrease uncertainty, and thus reducing the M&S use risk.

Experiences in the military M&S domain show that verification and validation (V&V) is still often more of an afterthought than an integral part of a M&S development or procurement. This is due to the fact that V&V is often considered as a difficult, costly and intangible practice, which highly depends on the M&S context. Due to decreasing budgets the Dutch MoD is increasing its reliance on M&S to help ensure their operational effectiveness. Given this increased reliance and the lack of common V&V practices, the Dutch MoD expressed the need to establish a V&V standard and a permanent V&V service provision organization. The Dutch National Aerospace Laboratory NLR and the Netherlands Organization for Applied Scientific Research TNO were tasked to realize this objective. This resulted in a V&V expertise center, named Q-tility. Q-tility is currently the preferred V&V service provider for the Dutch MoD, delivering V&V studies, training and consultancy.

The Generic Methodology for Verification and Validation (GM-VV) is a generic and comprehensive methodology for structuring, organizing and managing the verification and validation (V&V) of modelling and simulation (M&S) assets. The GM-VV is an emerging recommended practice within the Simulation Interoperability Standards Organization (SISO). The GM-VV provides a technical framework to efficiently develop arguments to justify why M&S assets are acceptable or unacceptable for a specific intended use. This argumentation supports M&S stakeholders in their acceptance decision-making process regarding the development, application and reuse of such M&S assets. The GM-VV technical framework assures that during the execution of the V&V work the decisions, actions, information and evidence underlying such acceptance arguments will be traceable, reproducible, transparent and documented. Since the GM-VV is a generic (i.e. abstract) methodology it must be tailored to fit the specific V&V needs of a M&S organization, project or application domain. Therefore, V&V practitioners must incorporate specific V&V techniques within the generic architectural template offered by the GM-VV in order to properly assess the M&S assets under review. The first part of this paper provides an introductory overview of the GM-VV basic principles, concepts, methodology components and their interrelationships. The second part of the paper focuses on how the GM-VV may be tailored for a specific simulation application. This effort is illustrated with some results and lessons learned from several technology demonstration programs of the Dutch Ministry of Defence.

The SUPRA research project - Simulation of Upset Recovery in Aviation - has been funded by the European Union 7th Framework Program to enhance the flight simulation envelope for upset recovery simulation. Within the project an extended aerodynamic model, capturing the key aerodynamics during and beyond stall for a large category transport aircraft and new motion cueing solutions for both hexapod and centrifuge-based platforms were developed. This paper describes the recent piloted evaluation experiments. In the first experiment a group of ten experimental test pilots, with actual experience in stall conditions, subjectively judged the validity of the aerodynamic model and the motion cueing solutions in the simulators in different upset conditions. Pilots rated the stall behavior of the SUPRA model as representative and useful for training. They preferred improved over conventional hexapod motion cueing. Centrifuge-based cuing was considered highly valuable to recognize the positive G-loads during the late recovery phase. The second experiment showed that line pilots without previous exposure to upset conditions perform more conservative recoveries under actual G-loads in the centrifuge compared to hexapod. After some practice the number of stick shaker events and excursions into critical angle-of-attack was reduced. We conclude that the SUPRA aerodynamic model successfully demonstrates upset conditions, including stall, and that conventional hexapod motion cueing can be improved for the purpose of upset simulation. If available, centrifuge-based simulation of the G-load is a recommended addition to the upset recovery training. © 2012 by SUPRA consortium.

As a part of the SUPRA project, NLR has been developing motion cueing for Upset Prevention and Recovery Training on conventional full flight simulators. This paper describes the concept development, implementation and piloted evaluation of modified motion cueing on the GRACE hexapod simulator. The focus of these developments was to improve the motion cueing with minimum impact on the existing hardware and software of the simulator. Two different strategies were applied within the motion cueing solution – workspace and perception optimised. The workspace strategy aimed to improve the fidelity by maximising the use of the simulator’s motion envelope. The perception strategy reproduced the G-load perception effects on the acceleration onset cueing. In addition a modification to the stall buffet cueing effect was developed. Two phases of experimental evaluation were carried out consisting of a subjective validation by experimental test pilots and an evaluation with current line pilots. The outcome of these experiments indicated the onset cueing could be objectively improved. The perception of the motion cueing in the upset and stall recovery scenario’s was enhanced, without introducing false cues. The stall buffet modifications resulted in reduced stall recognition times. These experiments at NLR demonstrated that the hexapod based flight simulator forms a valuable training facility for Upset Prevention and Recovery Training.

The Generic Methodology for Verification and Validation (GM-VV) is a generic and comprehensive methodology for the verification and validation (V&V) of M&S assets. The GM-VV is currently prepared for standardization within the Simulation Interoperability Standards Organization (SISO), and is at the same time under consideration by defense directorates of various nations to be incorporated as part of their M&S policies. The GMVV provides a conceptual, implementation and tailoring framework to efficiently develop arguments to justify why M&S assets are acceptable or unacceptable for a specific intended use. This argumentation supports M&S stakeholders in their acceptance decision-making process regarding the development, application and reuse of such M&S assets. The first part of this paper provides an introductory overview of the GM-VV basic principles, concepts, methodology components and their interrelationships. Since GM-VV is generic methodology it needs to be tailored to fit the specific V&V needs of an M&S organization, project or application domain. The second part of the paper focuses on how GM-VV may be tailored for a specific simulation application. This effort is illustrated with some results and lessons learned from several running technology demonstration programs of the Dutch MoD.

Mission training and rehearsal are vital to successful operations. Advances in modeling and simulation (M&S) technology now allow for Collective Mission Simulation (CMS). The Royal Netherlands Armed Forces have exploited CMS through participation in a number of virtual exercises. The potential of collective mission simulation has been recognized and the requirement for a CMS capability was formalized. Such a capability is characterized by effective realism, interoperable systems across domains, and seamless information flow. Within the next few years the Royal Netherlands Armed Forces want to establish a validated, reusable, interoperable mission simulation environment that will support the distributed simulation of tactical and operational missions at varying degrees of security classification.

Verification, Validation & Accreditation of legacy Simulations using Business Process Modeling Notation

In the spring of 2007 TNO Human Factors together with AMST Systemtechnik GmbH have completed the development of their newest research simulator, the Desdemona, in The Netherlands. The Desdemona research simulator features a unique motion system not seen elsewhere in the world. Its serial design and geometrical dimensions give the motion system a large cylindrical motion space and a broad range of dynamic performance capabilities, which go beyond those of a classical Stewart platform. Like any other motion-base simulator the Desdemona motion system is driven by motion filters that transform the various simulation model outputs into safe and optimal motion cues. For the development of these motion filters it is necessary to exactly determine the dynamic performance characteristics of Desdemona and check whether these characteristics meet the specified motion system requirements. This paper describes the test protocol to measure, specify and verify the dynamic performance characteristics of the Desdemona motion system. The performance test protocol builds upon and extends the classical synergistic motion system test approaches, like the AGARD standard, to suite the specific Desdemona motion system capabilities.