Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “system validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,675 records · Page 93

Functional and Operating Requirements for the Microreactor Agile Non-Nuclear Experimental Test Bed (MAGNET)

Microreactors, or small, transportable reactors with a capacity of < 20 MWTH, are sought to provide heat and power for myriad applications in remote areas, military installations, emergency operations, humanitarian missions and disaster relief zones as illustrated in Figure 1. These small, transportable reactor designs, while offering many advantages, are largely untested and unproven. System and component testing is needed to demonstrate to regulators that these designs are safe and to convince customers that the systems are robust, reliable, and efficient. The microreactor agile non-nuclear experimental test bed (MAGNET) is being constructed at Idaho National Laboratory to assist with the development, demonstration, and validation of microreactor components and systems. MAGNET will support technology maturation to reduce uncertainty and risk relative to the operation and deployment of this unique class of systems. Stakeholders for this test bed include microreactor developers, energy users, and regulators. Regulators will be engaged early in the design and testing to expedite regulatory approval and licensing. Within MAGNET, systems and components can be safely tested, providing valuable information on operating regimes, failure modes, and thresholds. Since there are various types of microreactors being proposed, which can be classified according to their core cooling method, heat-pipes, gas-cooled (pebble bed or prismatic), molten salt, light water, or light water, the goal is to provide a test bed that is broadly applicable to multiple microreactor concepts. Each reactor type poses a different set of design and operational challenges and performance claims stated by commercial vendors have not been independently verified through rigorous testing. The initial set of tests to be performed in MAGNET are targeted towards demonstrating the feasibility and performance of heat-pipe cooled reactors, since this concept is unique to very small nuclear reactors. However, the testbed will be constructed to accommodate other designs in addition to heat-pipe cooled reactors.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Overview of the MEDLI Project

The Mars Science Laboratory Entry, Descent, and Landing Instrumentation (MEDLI) Project's objectives are to measure aerothermal environments, sub-surface heatshield material response, vehicle orientation, and atmospheric density for the atmospheric entry and descent phases of the Mars Science Laboratory (MSL) entry vehicle. The flight science objectives of MEDLI directly address the largest uncertainties in the ability to design and validate a robust Mars entry system, including aerothermal, aerodynamic and atmosphere models, and thermal protection system (TPS) design. The instrumentation suite will be installed in the heatshield of the MSL entry vehicle. The acquired data will support future Mars entry and aerocapture missions by providing measured atmospheric data to validate Mars atmosphere models and clarify the design margins for future Mars missions. MEDLI thermocouple and recession sensor data will significantly improve the understanding of aeroheating and TPS performance uncertainties for future missions. MEDLI pressure data will permit more accurate trajectory reconstruction, as well as separation of aerodynamic and atmospheric uncertainties in the hypersonic and supersonic regimes. This paper provides an overview of the project including the instrumentation design, system architecture, and expected measurement response.

Gazarik, Michael J.↗

Overview of the MEDLI Project

The Mars Science Laboratory Entry, Descent, and Landing Instrumentation (MEDLI) Project s objectives are to measure aerothermal environments, sub-surface heatshield material response, vehicle orientation, and atmospheric density for the atmospheric entry and descent phases of the Mars Science Laboratory (MSL) entry vehicle. The flight science objectives of MEDLI directly address the largest uncertainties in the ability to design and validate a robust Mars entry system, including aerothermal, aerodynamic and atmosphere models, and thermal protection system (TPS) design. The instrumentation suite will be installed in the heatshield of the MSL entry vehicle. The acquired data will support future Mars entry and aerocapture missions by providing measured atmospheric data to validate Mars atmosphere models and clarify the design margins for future Mars missions. MEDLI thermocouple and recession sensor data will significantly improve the understanding of aeroheating and TPS performance uncertainties for future missions. MEDLI pressure data will permit more accurate trajectory reconstruction, as well as separation of aerodynamic and atmospheric uncertainties in the hypersonic and supersonic regimes. This paper provides an overview of the project including the instrumentation design, system architecture, and expected measurement response.

Gazarik, Michael J.↗

Operational resilience metrics for power systems with penetration of renewable resources

Abstract Modern power grid is evolving towards carbon neutrality by deploying increasing amount of renewable energy resources. However, the impact of renewable generation on power system planning and operation is not sufficiently investigated, especially the capability of renewable penetrated power systems to resist and recover from major disturbances, which is a critical concern for system operators. Novel metrics and evaluation methodologies are needed to depict systems’ ability in response to events caused by natural disasters, and quantitatively evaluate system performance in various time scales. In this paper, operational resilience metrics are proposed for power systems with penetration of renewable energy resources based on transient stability principles. A systematic methodology is proposed to quantitatively assess the evolution of system performance during various stages of the disaster process. Based on the proposed metrics, a resilience‐oriented disaster management strategy is designed and validated using the modified IEEE 39‐bus test system. The simulation results demonstrate the validity of the proposed metrics and strategy, and show that the system resilience is enhanced during the mitigation of fault conditions.

Gui, Jianzhong↗

VADER: A Tool for Criticality Safety Validation

The purpose of criticality safety is to prevent any inadvertent criticality from occurring during the handling or storage of fissile material. Calculations are frequently used to demonstrate that a sufficient subcritical margin exists. Validation is a key aspect of the evaluation process, establishing the suitability, accuracy, and associated uncertainty of the computational method and data to be used for the intended application. The validation process is performed by comparing the results of critical experiments with the calculated results from models of the experiments using the computational method to be validated. Laboratory critical experiments are controlled systems that achieve a k eff of approximately 1 in order to investigate the parameters at which such a critical condition is achieved. The validation parameters that are traditionally applied to safety analysis calculations are the bias and the bias uncertainty . The bias is the deviation of the average k eff of the validation suite from unity. The bias uncertainty accounts for the statistical uncertainty in the bias based on the standard deviation, sample size, and distribution of k eff values of the validation suite. The values of bias and bias uncertainty ensure that the systems predicted to be subcritical by the computational method will indeed be subcritical. The bias and bias uncertainty are often combined to determine an upper subcritical limit (USL) or computational margin that can then be applied to safety analysis calculations. Many methods have been developed by different organizations to calculate the bias and bias uncertainty for various types of criticality analyses. Each of these methods typically requires that the validity of various underpinning statistical assumptions be confirmed to demonstrate that the method is appropriate for the analysis of a given validation suite. An example of the validation decision making flow is shown in Fig.1. As shown in Fig. 1, the analyst performing the validation fits a trend line to the data and performs a test to determine if the trend was a statistically better representation of the data than if it were treated as an uncorrelated sample. If the trend line is a better representation of the data, then the analyst uses any one of a number of trending techniques to determine the bias and bias uncertainty. If a trend is not an appropriate representation of the data, then the analyst proceeds to perform a normality assessment for the data. If the normal assumption can be shown to be acceptable, then the analyst calculates the bias and bias uncertainty with the parametric technique. If the assumption of normality cannot be justified, then the nonparametric technique is used. Once the decision flow has been followed and the appropriate technique has been selected, the bias and bias uncertainty is typically combined with an administrative margin to determine a USL below which calculated values of k eff for safety analysis models can be considered subcritical. The calculations used in each decision are often performed with spreadsheets or with small programs available at various sites performing criticality analyses. Expertise in understanding and interpreting the results must be maintained to perform these calculations. This can often be an error-prone process. Oak Ridge National Laboratory (ORNL) is currently developing the Validation and Data Evaluation Resource (VADER) to simplify and automate the criticality safety validation process and to provide a software quality assurance pedigree to the calculational methods used. This paper discusses the use of the Fulcrum user interface with VADER, the anticipated initial capabilities of VADER to perform validation analyses, and the output from the code.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Investigation of Boundary Conditions for Flexible Multibody Spacecraft Dynamics

In support of both the Space Shuttle and International Space Station programs, a set of generic multibody dynamics algorithms integrated within the Trick simulation environment have addressed the variety of on-orbit manipulator simulation requirements for engineering analysis, procedures development and crew familiarization/training at the NASA Johnson Space Center (JSC). Enhancements to these dynamics algorithms are now being driven by a new set of Constellation program requirements for flexible multibody spacecraft simulation. One particular issue that has been discussed within the NASA community is the assumption of cantilever-type flexible body boundary conditions. This assumption has been commonly utilized within manipulator multibody dynamics formulations as it simplifies the computation of relative motion for articulated flexible topologies. Moreover, its use for modeling of space-based manipulators such as the Shuttle Remote Manipulator System (SRMS) and Space Station Remote Manipulator System (SSRMS) has been extensively validated against flight data. For more general flexible spacecraft applications, however, the assumption of cantilever-type boundary conditions may not be sufficient. This paper describes the boundary condition assumptions that were used in the original formulation, demonstrates that this formulation can be augmented to accommodate systems in which the assumption of cantilever boundary conditions no longer applies, and verifies the approach through comparison with an independent model previously validated against experimental hardware test data from a spacecraft flexible dynamics emulator.

Boundary-value problems↗

NTP comparison process

The systems engineering process for the concept definition phase of the program involves requirements definition, system definition, and consistent concept definition. The requirements definition process involves obtaining a complete understanding of the system requirements based on customer needs, mission scenarios, and nuclear thermal propulsion (NTP) operating characteristics. A system functional analysis is performed to provide a comprehensive traceability and verification of top-level requirements down to detailed system specifications and provides significant insight into the measures of system effectiveness to be utilized in system evaluation. The second key element in the process is the definition of system concepts to meet the requirements. This part of the process involves engine system and reactor contractor teams to develop alternative NTP system concepts that can be evaluated against specific attributes, as well as a reference configuration against which to compare system benefits and merits. Quality function deployment (QFD), as an excellent tool within Total Quality Management (TQM) techniques, can provide the required structure and provide a link to the voice of the customer in establishing critical system qualities and their relationships. The third element of the process is the consistent performance comparison. The comparison process involves validating developed concept data and quantifying system merits through analysis, computer modeling, simulation, and rapid prototyping of the proposed high risk NTP subsystems. The maximum amount possible of quantitative data will be developed and/or validated to be utilized in the QFD evaluation matrix. If upon evaluation of a new concept or its associated subsystems determine to have substantial merit, those features will be incorporated into the reference configuration for subsequent system definition and comparison efforts.

Corban, Robert↗

Implementing Online Oscillation Monitoring and Forced Oscillation Source Locating at Peak Reliability

This paper introduces a framework of online oscillation monitoring systems and forced oscillation detection & source location tools that Peak Reliability ('PEAK') has implemented for the Reliability Coordinator (RC) function of the Western Interconnection. The framework consists of four main components: (1) Montana Tech's Modal Analysis Software (MAS) engine; (2) Washington State University's Oscillation Monitor System (OMS) software; (3) Forced Oscillation Detection and Source Location Algorithms (FODSL); and (4) PEAK in-house visualization tool and alarming logic built in PI Processbook. The framework has been validated and applied for real system oscillation studies successfully. Implementation experience and lessons learned will be discussed in the paper.

14 SOLAR ENERGY↗

Engine System Loads Analysis Compared to Hot-Fire Data

Early implementation of structural dynamics finite element analyses for calculation of design loads is considered common design practice for high volume manufacturing industries such as automotive and aeronautical industries. However with the rarity of rocket engine development programs starts, these tools are relatively new to the design of rocket engines. In the NASA MC-1 engine program, the focus was to reduce the cost-to-weight ratio. The techniques for structural dynamics analysis practices, were tailored in this program to meet both production and structural design goals. Perturbation of rocket engine design parameters resulted in a number of MC-1 load cycles necessary to characterize the impact due to mass and stiffness changes. Evolution of loads and load extraction methodologies, parametric considerations and a discussion of load path sensitivities are important during the design and integration of a new engine system. During the final stages of development, it is important to verify the results of an engine system model to determine the validity of the results. During the final stages of the MC-1 program, hot-fire test results were obtained and compared to the structural design loads calculated by the engine system model. These comparisons are presented in this paper.

Frady, Gregory P.↗

SCALE 6.2.4: Validation Overview

SCALE is a multi-application code system with tools for reactor physics, criticality safety, radiation shielding, and spent fuel characterization for a range of nuclear systems. The last of the SCALE 6.2 series, version 6.2.4, was released in June 2020. Validation studies in nuclear criticality safety, reactor physics, and shielding applications were performed to confirm results, assess accuracy, and identify biases from SCALE simulations. Nuclear criticality safety applications yield small code biases for a wide range of systems, generally overestimating cross section uncertainty. Reactor physics applications improvements in nuclide inventory and full-core eigenvalue predictions, with similar performance in decay heat predictions. Radiation shielding applications yield sufficient agreement in comparisons to measurements and alternate simulations for eight shielding experiments.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

AmesDT: Digital Twin and Autonomy Validation Environment

A simulation of NASA Ames Research Center was developed to provide a common testbed for multiple areas of research within the Intelligent Systems Division, primarily related to verification and validation of autonomous technologies, machine learning, and digital twin systems. AmesSim corresponds a physical rover that is capable of navigation in the real-world environment; in this way, the same experiments can be run in both settings, with the same software and hardware stacks in the loop. The simulation is built in Unreal Engine 4 and uses the AirSim plugin for API convenience. Several custom modifications allow deterministic, faster-than-realtime execution, which enables consistent testing of on-line algorithms and large-scale data collection. This paper describes the architecture and capabilities of the simulation and discusses development challenge.

simulation↗

NASA's Commercial Crew Program, the Next Step in U.S. Space Transportation

The Commercial Crew Program (CCP) is leading NASA's efforts to develop the next U.S. capability for crew transportation and rescue services to and from the International Space Station (ISS) by the middecade timeframe. The outcome of this capability is expected to stimulate and expand the U.S. space transportation industry. NASA is relying on its decades of human space flight experience to certify U.S. crewed vehicles to the ISS and is doing so in a two phase certification approach. NASA certification will cover all aspects of a crew transportation system, including: Development, test, evaluation, and verification. Program management and control. Flight readiness certification. Launch, landing, recovery, and mission operations. Sustaining engineering and maintenance/upgrades. To ensure NASA crew safety, NASA certification will validate technical and performance requirements, verify compliance with NASA requirements, validate that the crew transportation system operates in the appropriate environments, and quantify residual risks. The Commercial Crew Program will present progress to date and how it manages safety and reduces risk.

Mango, Edward J., Jr.↗

Metal Oxide Varistor (MOV) Lifetime Estimation with Impulse-Based Testing in PV Inverter Systems

Surges caused by lightning strikes could damage electrical components in photovoltaic (PV) systems. Metal oxide varistors (MOVs) are commonly used to protect PV systems from lightning strikes. This paper proposes a holistic impulse-based MOV lifetime estimation framework. The impacts of peak current and fault duration induced by lightning events are considered in the MOV lifetime estimation framework. Moreover, the impact of different parameter combinations on MOV lifetime estimation is analyzed. The effectiveness of the proposed work is validated in a PV inverter test system developed in MATLAB/Simulink.

lifetime estimation↗

A Variable Pressure Multi-Pressure Rail System Design for Agricultural Applications

This paper presents a solution for reducing energy loss in the hydraulic control system of agricultural tractors and their implements. The solution is referred to as a multi-pressure rail (MPR) and provides power to the hydraulic functions following a pressure control logic, as opposed to the traditional flow control logic typical of hydraulic systems used in off-road vehicles. The proposed hydraulic control system allows for elimination of redundant flow control valves in the state-of-the-art system, which cause excessive throttling losses leading to poor overall energy efficiency. Related work on MPR technology targets construction vehicles, where the MPR solution can allow energy recovery during overrunning loads and better engine management. This paper alternatively addresses the case of agricultural applications where functions mostly operate under resistive load conditions with slow dynamics, which offers an opportunity to target throttle losses. For this purpose, the paper introduces a variable pressure control strategy to handle the instantaneous pressure at each rail. To develop both the controller and the hydraulic system architecture, a stationary test rig is conceived and used to validate a numerical simulation model of the MPR system and its control strategy. Particular focus is given to the dynamic behavior of the system during the switches of a function between different pressure rails, which needs to ensure reduced oscillations of the flow provided to each hydraulic function. Once validated, the simulation model is used to predict the energy savings of the MPR solution in an actual application: a 435 hp hydraulic tractor powering a 16-row planter, for which operating features during typical drive cycles were available to the authors. The results show up to 59% total power reduction at the pump shaft, corresponding to 89.8% system efficiency gain.

36 MATERIALS SCIENCE↗

100 kW Nested Hall Thruster System Development

Large scale cargo transportation to support human missions to the Moon and Mars will require very high power Solar Electric Propulsion (SEP) systems operating between 200 and 400 kW. Aerojet Rocketdyne's NextSTEP program is developing and demonstrating a 100 kW EP system, the XR-100, using a Nested Hall Thruster (NHT) designed for powers up to 200 kW, a modular power processor and a modular flow controller. The three year program objective is to operate the integrated EP system continuously at 100 kW for 100 h, advancing this very high power Electric Propulsion (EP) system to Technology Readiness Level (TRL) 5. With our University of Michigan, Jet Propulsion Laboratory and NASA Glenn Research Center teammates, Aerojet Rocketdyne has completed the initial phase of the program, including operating the thruster at up to 30 kW to validate the thermal models and developing and operating multiple power processor modules in the required seriesparallel configuration. The current phase includes completing a TRL 4 integrated system test at reduced power to validate all system operating phases. Design upgrades to demonstrate the TRL 5 capabilities are underway. This paper will present the high power XR-100 capabilities, overall program and design approach and the latest test results for the 100 kW EP system demonstration program.

Jackson, Jerry↗

An integrated user-oriented laboratory for verification of digital flight control systems: Features and capabilities

A Digital Flight Control Systems Verification Laboratory (DFCSVL) has been established at NASA Ames Research Center. This report describes the major elements of the laboratory, the research activities that can be supported in the area of verification and validation of digital flight control systems (DFCS), and the operating scenarios within which these activities can be carried out. The DFCSVL consists of a palletized dual-dual flight-control system linked to a dedicated PDP-11/60 processor. Major software support programs are hosted in a remotely located UNIVAC 1100 accessible from the PDP-11/60 through a modem link. Important features of the DFCSVL include extensive hardware and software fault insertion capabilities, a real-time closed loop environment to exercise the DFCS, an integrated set of software verification tools, and a user-oriented interface to all the resources and capabilities.

Defeo, P.↗

Anomaly Detection Based on Machine Learning for the CMS Electromagnetic Calorimeter Online Data Quality Monitoring

Using a semi-supervised machine learning approach we present a real-time anomaly detection system based on an autoencoder used for online data quality monitoring of the CMS electromagnetic calorimeter operating at the CERN LHC. We introduce a novel method that maximizes the anomaly detection performance making use of the time-dependence of anomalies and the spatial variations in the detector response. The autoencoder-based system efficiently detects anomalies in real time and maintains a very low false discovery rate. We validate the performance of this novel system with anomalies from LHC collision data taken in 2018 and 2022. In addition, results are presented after deploying the autoencoder-based system in the CMS online Data Quality Monitoring workflow at the beginning of LHC Run 3 resulting in the system to detect issues that were missed by the existing system.

Harilal, Abhirami [Carnegie Mellon University, Pit↗

CO2 Reduction Assembly Prototype Using Microlith-Based Sabatier Reactor for Ground Demonstration

The utilization of CO2 to produce life support consumables, such as O2 and H2O, via the Sabatier reaction is an important aspect of NASA's cabin Atmosphere Revitalization System (ARS) and In-Situ Resource Utilization (ISRU) architectures for both low-earth orbit and long-term manned space missions. Carbon dioxide can be reacted with H2, obtained from the electrolysis of water, via Sabatier reaction to produce methane and H2O. Methane can be stored and utilized as propellant while H2O can be either stored or electrolyzed to produce oxygen and regain the hydrogen atoms. Depending on the application, O2 can be used to replenish the atmosphere in human-crewed missions or as an oxidant for robotic and return missions. Precision Combustion, Inc. (PCI), with support from NASA, has previously developed an efficient and compact Sabatier reactor based on its Microlith® catalytic technology and demonstrated the capability to achieve high CO2 conversion and CH4 selectivity (i.e., ≥90% of the thermodynamic equilibrium values) at high space velocities and low operating temperatures. This was made possible through the use of high-heat-transfer and high-surface-area Microlith catalytic substrates. Using this Sabatier reactor, PCI designed, developed, and demonstrated a stand-alone CO2 Reduction Assembly (CRA) test system for ground demonstration and performance validation. The Sabatier reactor was integrated with the necessary balance-of-plant components and controls system, allowing an automated, single "push-button" start-up and shutdown. Additionally, the versatility of the test system prototype was demonstrated by operating it under H2-rich (H2/CO2 of >4), stoichiometric (ratio of 4), and CO2-rich conditions (ratio of <4) without affecting its performance and meeting the equilibrium-predicted water recovery rates. In this paper, the development of the CRA test system for ground demonstration will be discussed. Additionally, the performance results from testing the system at various operating conditions and the results from durability testing will be presented.

Junaedi, Christian↗