Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “system validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

Maxar Initial Satellite Characterization

This documents reports on the initial Assessment Specification and Validation (ASV) of Maxar satellite imagery as a geolocation system. Validation is a prerequisite for using geolocation for applications that require quantified uncertainty. A Variance Component Estimation (VCE) calibration of the provider’s co- variance matrices concluded that they were exaggerated. However, we currently lack enough independent validation data to quantify the improvement from the VCE. The current ASV process is slow and expensive. It will not be able to keep up with growing numbers of satellite systems. We proposed a method to automate ASV using controlled imagery. The proposed method will allow us to keep up with new sensors and generate unbounded amounts of calibration data, leading to unprecedented accuracy.

47 OTHER INSTRUMENTATION↗

An expert system development methodology which supports verification and validation

Expert systems have demonstrated commercial viability in a wide range of applications, but still face some obstacles to widespread use. A major stumbling block is the lack of well defined verification and validation (V and V) techniques. The primary difficulty with expert system V and V is the use of development methodologies which do not support V and V. As with conventional code, the key to effective V and V is the development methodology. An expert system development methodology is described which is based upon a panel review approach, that allows input from all parties concerned with the expert system.

Culbert, Chris↗

EOS Airborne Program for Validation Studies of EOS Data Products

An overview of the NASA EOS (Earth Observing System) Validation Program will be given with special emphasis on synergy of airborne field missions and EOS satellite missions. Presentation will describe objectives of program and recent field campaigns for validation of standard scientific data products from EOS Terra. Airborne simulators developed for Terra validation will also be described. Plans for future field activity and airborne simulators, especially for EOS Aqua validation and also encompassing EOS Aura validation, will also be briefly presented.

Starr, David OC.↗

Computers in Aerospace Conference, 5th, Long Beach, CA, October 21-23, 1985, Technical Papers

Among the topics discussed are: access control models for a distributed CAIS-conforming system; a knowledge-based advisory system for casualty procedures; and automated interactive simulation modeling system. Consideration is also given to: reusable software concepts and software development methodologies; the electronic device aspects of neutral network memories; an expert system for automated satellite anomaly resolution; and the use of automatic programming techniques for fault-tolerant computing systems. Among additional topics discussed are: systems approaches to software fault tolerance; a Space Shuttle navigation validation system; and a vision-based road following system for an autonomous land vehicle.

Source record↗

NASA Crew Launch Vehicle Flight Test Options

Options for development flight testing (DFT) of the Ares I Crew Launch Vehicle (CLV) are discussed. The Ares-I Crew Launch Vehicle (CLV) is being developed by the U.S. National Aeronautics and Space Administration (NASA) to launch the Crew Exploration Vehicle (CEV) into low Earth Orbit (LEO). The Ares-I implements one of the components of the Vision for Space Exploration (VSE), providing crew and cargo access to the International Space Station (ISS) after retirement of the Space Shuttle and, eventually, forming part of the launch capability needed for lunar exploration. The role of development flight testing is to demonstrate key sub-systems, address key technical risks, and provide flight data to validate engineering models in representative flight environments. This is distinguished from certification flight testing, which is designed to formally validate system functionality and achieve flight readiness. Lessons learned from Saturn V, Space Shuttle, and other flight programs are examined along with key Ares-I technical risks in order to provide insight into possible development flight test strategies. A strategy for the first test flight of the Ares I, known as Ares I-1, is presented.

Cockrell, Charles E., Jr.↗

Nemesis Autonomous Test System

A generalized framework has been developed for systems validation that can be applied to both traditional and autonomous systems. The framework consists of an automated test case generation and execution system called Nemesis that rapidly and thoroughly identifies flaws or vulnerabilities within a system. By applying genetic optimization and goal-seeking algorithms on the test equipment side, a "war game" is conducted between a system and its complementary nemesis. The end result of the war games is a collection of scenarios that reveals any undesirable behaviors of the system under test. The software provides a reusable framework to evolve test scenarios using genetic algorithms using an operation model of the system under test. It can automatically generate and execute test cases that reveal flaws in behaviorally complex systems. Genetic algorithms focus the exploration of tests on the set of test cases that most effectively reveals the flaws and vulnerabilities of the system under test. It leverages advances in state- and model-based engineering, which are essential in defining the behavior of autonomous systems. It also uses goal networks to describe test scenarios.

Barltrop, Kevin J.↗

NASA’s MBSE Approach for Advanced Air Mobility

NASA’s Aeronautics Research Mission Directorate (ARMD) has a significant research effort for advanced air mobility (AAM). AAM involves bringing aviation closer to where people live and work and offers the possibility of making aviation a normal part of everyday life. The scope of AAM is broad, including transformations in aircraft, airspace operations, and in how these new aviation capabilities will integrate into local communities. Due to the nature of AAM cutting across multiple aspects of the aircraft, airspace, and community domains, NASA is applying tools and techniques aligned with a model-based systems engineering approach. These are intended to capture and organize applicable system architectures and potential requirements in order to deliver a validated system architecture and recommended set of requirements that enable sustainable and scalable medium density AAM operations.

Advanced Air Mobility↗

Thermo-Fluid Modeling Framework for Supercomputer Digital Twins: Part 1, Demonstration at Exascale

A thermo-fluid modeling framework is being developed for ExaDigiT---an open-source framework for developing comprehensive digital twins of liquid-cooled supercomputers. The work is being conducted in two parts, and discussion is divided into two companion papers. The work documented in this paper focuses on the development of a cooling system library in Dymola for the Frontier supercomputer at Oak Ridge National Laboratory. The second part, outlined in a companion paper, focuses on a templating structure called Auto-CSM for easily creating model-agnostic, physics-based thermo-fluid cooling system models for liquid-cooled supercomputers using a text-based schema. The cooling model is being developed using primarily the open-source Transient Simulation Framework of Reconfigurable Models (TRANSFORM) library. The library follows the templating architecture developed within the TRANSFORM library for modeling subsystems. A full-system validation was performed to validate a very simple model that is integrated with the system controls, and the results are presented herein.

Kumar, Vineet↗

Commercial PV Inverter IEEE 1547.1 Ride-Through Assessments Using an Automated PHIL Test Platform

As more countries seek solutions to their de-carbonization targets using renewable energy (RE) technologies, interconnection standards and national grid codes for distributed energy resources (DER) are being updated to support higher penetrations of RE and improve grid stability. Common grid-code revisions mandate DER devices, such as solar inverters and energy storage systems, ride-through (RT) voltage and frequency disturbances. This is necessary because as the percentage of generation from DER increases, there is a greater risk power system faults will cause many or all DER to trip, triggering a substantial load-generation imbalance and possible cascading blackout. This paper demonstrates for the first time a methodology to verify commercial DER devices are compliant to new voltage, frequency, and rate of change of frequency (ROCOF) RT requirements established in IEEE Std. 1547-2018. The methodology incorporates a software automation tool, called the SunSpec System Validation Platform (SVP), in combination with a hardware-in-the-loop (HIL) system to execute the IEEE Std. 1547.1-2020 RT test protocols. In this paper, the approach is validated with two commercial photovoltaic inverters, the test results are analyzed for compliance, and improvements to the test procedure are suggested.

14 SOLAR ENERGY↗

Reliability techniques for computer executive programs

Computer techniques for increasing the stability and reliability of executive and supervisory systems were studied. Program segmentation characteristics are discussed along with a validation system which is designed to retain the natural top down outlook in coding. An analysis of redundancy techniques and roll back procedures is included.

Source record↗

Challenges in verification and validation of autonomous systems for space exploration

Space exploration applications offer a unique opportunity for the development and deployment of autonomous systems, due to limited communications, large distances, and great expense of direct operation. At the same time, the risk and cost of space missions leads to reluctance to taking on new, complex and difficult-to-understand technology. A key issue in addressing these concerns is the validation of autonomous systems. In recent years, higher-level autonomous systems have been applied in space applications. In this presentation, we will highlight those autonomous systems, and discuss issues in validating these systems. We will then look to future demands on validating autonomous systems for space, identify promising technologies and open issues.

Brat, Guillaume↗

Earth Science Enterprise Scientific Data Purchase Project: Verification and Validation

This paper presents viewgraphs on the Earth Science Enterprise Scientific Data Purchase Project's verification,and validation process. The topics include: 1) What is Verification and Validation? 2) Why Verification and Validation? 3) Background; 4) ESE Data Purchas Validation Process; 5) Data Validation System and Ingest Queue; 6) Shipment Verification; 7) Tracking and Metrics; 8) Validation of Contract Specifications; 9) Earth Watch Data Validation; 10) Validation of Vertical Accuracy; and 11) Results of Vertical Accuracy Assessment.

Jenner, Jeff↗

Validation of multiprocessor systems

Experiments that can be used to validate fault free performance of multiprocessor systems in aerospace systems integrating flight controls and avionics are discussed. Engineering prototypes for two fault tolerant multiprocessors are tested.

Siewiorek, D. P.↗

Microelectrospray Thrusters

Propulsion technology is often a critical enabling technology for space missions. NASA is investing in technologies to enable high value missions with very small spacecraft, even CubeSats. However, these nanosatellites currently lack any appreciable propulsion capability. CubeSats are typically deployed and tumble or drift without any ability to transfer to higher value orbits, perform orbit maintenance, or perform de-orbit. Larger spacecraft can also benefit from high precision attitude control systems. Existing practices include reaction wheels with lifetime concerns and system level complexity. Microelectrospray thrusters will provide new propulsion capabilities to address these mission needs. Electric propulsion is an approach to accelerate propellant to very high exhaust velocities through the use of electrical power. Typical propulsion systems are limited to the combustion energy available in the chemical bonds of the fuel and then acceleration through a converging diverging nozzle. However, electric propulsion can accelerate propellant to ten times higher velocities and therefore increase momentum transfer efficiency, or essentially, increase the fuel economy. Fuel efficiency of thrusters is proportional to the exhaust velocity and referred to as specific impulse (Isp). The state-of-the-art (SOA) for CubeSats is cold gas propulsion with an Isp of 50-80 s. The Space Shuttle main engine demonstrated a specific impulse of 450 s. The target Isp for the Mars Exploration Program (MEP) systems is >1,500 s. This propellant efficiency can enable a 1-kg, 10-cm cube to transfer from low-Earth orbit to interplanetary space with only 200 g of propellant. In September 2013, NASA's Game Changing Development program competitively awarded three teams with contracts to develop MEP systems from Technology Readiness Level-3 (TRL-3), experimental concept, to TRL-5, system validation in a relevant environment. The project is planned for 18 months of system development. Due to the ambitious project goals, NASA has awarded contracts to mature three unique methods to achieve the desired goals. Some of the MEP concepts have been developed for more than a decade at the component level, but are now ready for system maturation. The three concepts include the high aspect ratio porous surface (HARPS) microthruster system, the scalable ion electrospray propulsion system (S-iEPS), and an indium microfluidic electrospray propulsion system. The HARPS system is under development by Busek Co. The HARPS thruster is an electrospray thruster that relies on surface emission of a porous metal with a passive capillary wicking system for propellant management. The HARPS thruster is expected to provide a simple, high ΔV and low-cost solution. The HARPS thruster concept is shown in figure 1. Figure 1 includes the thruster, integrated power processing unit, and propellant reservoir.

Dankanich, John↗

Evaluation of a coastal acoustic buoy for cetacean detections, bearing accuracy and exclusion zone monitoring

Abstract There is strong socio‐political support for offshore wind development in US territorial waters and construction is planned off several east coast states. Some of the planned development sites coincide with important habitat for critically endangered North Atlantic right whales. Both exclusion zones and passive acoustic monitoring are important tools for managing interactions between marine mammals and human activities. Understanding where animals are with respect to exclusion zones is important to avoid costly construction delays while minimizing the potential for negative impacts. Impact piling from construction of hundreds of offshore wind turbines likely require exclusion zones as large as 10 km. We have developed a three‐hydrophone passive acoustic monitoring system that provides bearing information along with marine mammal detections to allow for informed management decisions in real‐time. Multiple units form a monitoring system designed to determine whether marine mammal calls originate from inside or outside of an exclusion zone. In October 2021, we undertook a full system validation, with a focus on evaluating the detection range and bearing accuracy of the system with respect to right whale upcalls. Five units were deployed in Mid‐Atlantic waters and we played more than 3500 simulated right whale upcalls at known locations to characterize the detection function and bearing accuracy of each unit. The modelled results of the detection function error were then used to compare the effectiveness of a bearing‐based system to a single sensor that can only detect a signal but not ascertain directivity. Field trials indicated maximum detection ranges from 4–7.3 km depending on source and ambient noise levels. Simulations showed that incorporating bearing detections provide a substantial improvement in false alarm rates (6 to 12 times depending on number of units, placement and signal to noise conditions) for a small increase in the risk of missed detections inside of an exclusion zone (1%–3%). We show that the system can be used for monitoring exclusion zones and clearly highlight the value of including bearing estimation into exclusion zone monitoring plans while noting that placement and configuration of units should reflect anticipated ambient noise conditions.

17 WIND ENERGY↗

Knowledge based system verification and validation as related to automation of space station subsystems: Rationale for a knowledge based system lifecycle

The role of verification and validation (V and V) in software has been to support and strengthen the software lifecycle and to ensure that the resultant code meets the standards of the requirements documents. Knowledge Based System (KBS) V and V should serve the same role, but the KBS lifecycle is ill-defined. The rationale of a simple form of the KBS lifecycle is presented, including accommodation to certain critical KBS differences from software development.

Richardson, Keith↗

Knowledge based system verification and validation as related to automation of Space Station subsystems - Rationale for a knowledge based system lifecycle

The role of verification and validation (V and V) in software has been to support and strengthen the software lifecycle and to ensure that the resultant code meets the standards of the requirements documents. Knowledge-based system (KBS) V and V should serve the same role, but the KBS lifecycle is ill-defined. The rationale of a simple form of the KBS lifecycle is presented, including accommodation to certain critical KBS differences from software development.

Richardson, Keith↗

Validation of a fault-tolerant clock synchronization system

A validation method for the synchronization subsystem of a fault tolerant computer system is investigated. The method combines formal design verification with experimental testing. The design proof reduces the correctness of the clock synchronization system to the correctness of a set of axioms which are experimentally validated. Since the reliability requirements are often extreme, requiring the estimation of extremely large quantiles, an asymptotic approach to estimation in the tail of a distribution is employed.

Butler, R. W.↗