Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “system validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 775 records · Page 43
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Seasonal forecasting skill for the High Mountain Asia region in the Goddard Earth Observing System

Seasonal variability of the global hydrologic cycle directly impacts human activities, including hazard assessment and mitigation, agricultural decisions, and water resources management. This is particularly true across the High Mountain Asia (HMA) region, where availability of water resources can change depending on local seasonality of the hydrologic cycle. Forecasting the atmospheric states and surface conditions, including hydrometeorologically relevant variables, at subseasonal-to-seasonal (S2S) lead times of weeks to months is an area of active research and development. NASA's Goddard Earth Observing System (GEOS) S2S prediction system has been developed with this research goal in mind. Here, we benchmark the forecast skill of GEOS-S2S (version 2) hydrometeorological forecasts at 1–3-month lead times in the HMA region, including a portion of the Indian subcontinent, during the retrospective forecast period, 1981–2016. To assess forecast skill, we evaluate 2 m air temperature, total precipitation, fractional snow cover, snow water equivalent, surface soil moisture, and terrestrial water storage forecasts against the Modern-Era Retrospective analysis for Research and Applications, Version 2 (MERRA-2) and independent reanalysis data, satellite observations, and data fusion products. Anomaly correlation is highest when the forecasts are evaluated against MERRA-2 and particularly in variables with long memory in the climate system, likely due to the similar initial conditions and model architecture used in GEOS-S2S and MERRA-2. When compared to MERRA-2, results for the 1-month forecast skill range from an anomaly correlation of R anom =0.18 for precipitation to R anom =0.62 for soil moisture. Anomaly correlations are consistently lower when forecasts are evaluated against independent observations; results for the 1-month forecast skill range from R anom =0.13 for snow water equivalent to R anom =0.24 for fractional snow cover. We find that, generally, hydrometeorological forecast skill is dependent on the forecast lead time, the memory of the variable within the physical system, and the validation dataset used. Overall, these results benchmark the GEOS-S2S system's ability to forecast HMA hydrometeorology.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2000

Remote Diagnosis of the International Space Station Utilizing Telemetry Data

Modern systems such as fly-by-wire aircraft, nuclear power plants, manufacturing facilities, battlefields, etc., are all examples of highly connected network enabled systems. Many of these systems are also mission critical and need to be monitored round the clock. Such systems typically consist of embedded sensors in networked subsystems that can transmit data to central (or remote) monitoring stations. Moreover, many legacy are safety systems were originally not designed for real-time onboard diagnosis, but a critical and would benefit from such a solution. Embedding additional software or hardware in such systems is often considered too intrusive and introduces flight safety and validation concerns. Such systems can be equipped to transmit the sensor data to a remote-processing center for continuous health monitoring. At Qualtech Systems, we are developing a Remote Diagnosis Server (RDS) that can support multiple simultaneous diagnostic sessions from a variety of remote subsystems.

Deb, Somnath↗
NASA NTRSDate not supplied

Resilience Modeling in Complex Engineered Systems with Human-Machine Interactions

In recent times, there has been a growing interest in resilience-based design. Resilience-based design operates on the concept that failures and unexpected events will happen, and when they occur, complex engineered systems should be able to operate within acceptable bounds and recover reasonably. Humans can contribute to the resilience of a system by quickly detecting unforeseen events and taking corrective measures. To this effect, researchers have proposed guidelines and design approaches that can help promote human-system resilience. However, there is no early design stage tool to validate if a system is indeed resilient after applying these guidelines and design methods. In this research, we integrate the Human Error and Functional Failure Reasoning (HEFFR) framework into the fmdtools toolkit to enable designers to model the combined (machine, human, and joint) failures, including their propagation and dynamic effects, during early design stages. This integrated tool also allows designers to model the effects of performance shaping factors, team dynamics, and human-machine interactions in systems of systems. A demonstrative example of a remotely operated rover is explored to demonstrate how this approach can be applied to understand resilience in complex engineered systems with human interactions.

Lukman Irshad↗
NASA NTRS2023

Seasonal Forecasting Skill for the High Mountain Asia Region in the Goddard Earth Observing System

Seasonal variability of the global hydrologic cycle directly impacts human activities, including hazard assessment and mitigation, agricultural decisions, and water resources management. This is particularly true across the High Mountain Asia (HMA) region, where availability of water resources can change depending on local seasonality of the hydrologic cycle. Forecasting the atmospheric states and surface conditions, including hydrometeorological relevant variables, at subseasonal-to-seasonal (S2S) lead times of weeks-to-months is an area of active research and development. NASA’s 15 Goddard Earth Observing System (GEOS) S2S prediction system has been developed with this research goal in mind. Here, we benchmark the forecast skill of GEOS-S2S (version 2) hydrometeorological forecasts at 1-3 month lead times in the HMA region, including a portion of the Indian Subcontinent, during the retrospective forecast period, 1981-2016. To assess forecast skill, we evaluate 2-m air temperature, total precipitation, fractional snow cover, snow water equivalent, surface soil moisture, and terrestrial water storage forecasts against the Modern-Era Retrospective analysis for Research and 20 Applications, Version 2 (MERRA-2) and independent reanalysis data, satellite observations, and data fusion products. Anomaly correlation is highest when the forecasts are evaluated against MERRA-2 and particularly in variables with long memory in the climate system, likely due to similar initial conditions and model architecture used in GEOS-S2S and MERRA-2. When compared to MERRA-2, results for the 1-month forecast skill range from anomaly correlation of R anom =0.18 for precipitation to R anom =0.62 for soil moisture. Anomaly correlations are consistently lower when forecasts are 25 evaluated against independent observations; results for the 1-month forecast skill range from R anom =0.13 for snow water equivalent to R anom =0.24 for fractional snow cover. We find that, generally, hydrometeorological forecast skill is dependent on the forecast lead time, the memory of the variable within the physical system, and the validation dataset used. Overall, these results benchmark the GEOS-S2S system’s ability to forecast HMA hydrometeorology.

GEOS↗
NASA NTRS2018

Optical Measurement System for Strain Field Ahead of a Crack Tip for Lattice Structures

The aim of the ARAMADAS project is to automate the construction of cuboctahedral lattice structures. Lattice materials are appealing for aerospace applications due to their strength and stiffness at ultra-light densities. However, in order for any material to be realistically considered for such environments, it must also be damage tolerant. The ability of a material to absorb damage is characterized by its fracture toughness, which remains poorly characterized for lattice materials. Consequently, the objective of this research is to develop an optical measurement system to experimentally validate the strain field ahead of a crack tip in architecture lattice materials. Although the ability to predict the strain field ahead of a crack tip has been investigated for continuum materials, such behaviour of three-dimensional architectures is under-investigated. As such, we will use a custom optical measurement system to track deformation of the voxels in a side-cracked plate fracture specimen. The system shall use 3D pose estimation, stereo imaging, and possibly color tracking, in combination with optical flow algorithms, to compute information regarding the three-dimensional movement movement of the lattice nodes during mechanical testing. Bench top experiments will validate the optical measurement system and characterize precision. Additionally, the effect of multiple cameras on precision, as well as system scalability will be investigated. Final results will compare measured lattice deformation with finite element predictions.

Lennig, Miriam↗
NASA NTRS1997

Verifying Stability of Dynamic Soft-Computing Systems

Soft computing is a general term for algorithms that learn from human knowledge and mimic human skills. Example of such algorithms are fuzzy inference systems and neural networks. Many applications, especially in control engineering, have demonstrated their appropriateness in building intelligent systems that are flexible and robust. Although recent research have shown that certain class of neuro-fuzzy controllers can be proven bounded and stable, they are implementation dependent and difficult to apply to the design and validation process. Many practitioners adopt the trial and error approach for system validation or resort to exhaustive testing using prototypes. In this paper, we describe our on-going research towards establishing necessary theoretic foundation as well as building practical tools for the verification and validation of soft-computing systems. A unified model for general neuro-fuzzy system is adopted. Classic non-linear system control theory and recent results of its applications to neuro-fuzzy systems are incorporated and applied to the unified model. It is hoped that general tools can be developed to help the designer to visualize and manipulate the regions of stability and boundedness, much the same way Bode plots and Root locus plots have helped conventional control design and validation.

Wen, Wu↗
DOE OSTI2021

SCALE 6.2.4 Validation for Light Water Reactor Decay Heat Analysis

Energy release from the decay of radionuclides in nuclear fuel after its discharge from reactor is a critical parameter for design, safety, and licensing analyses of used nuclear fuel storage, transportation, and repository systems. Well-validated computational tools and nuclear data are essential for decay heat prediction. This paper summarizes the validation of the SCALE nuclear analysis code system version 6.2.4, used with ENDF/B-VII.1 libraries, for decay heat analysis of light water reactor used fuel. The experimental data used for validation include full-assembly decay heat measurements that cover assembly burnups of 5 to 51 GWd/tonne U, cooling times after discharge in the 2- to 27-year range, and initial fuel enrichments up to 4 wt% 235U. The comparison between calculated (C) and experimental (E) decay heat showed very good agreement, with an average C/E over all considered measurements of 1.006 (σ = 0.016) for pressurized water reactor and 0.984 (σ = 0.077) for boiling water reactor assembly measurements. The effect of using assembly-average versus axially varying modeling data on the calculated decay heat, important to thermal analyses for used fuel transportation and storage systems, is discussed.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
NASA NTRS1983

A large antenna system flight experiment

The design and development of large antenna systems are discussed. The validation objectives and techniques of the structural behavior of the system are outlined along with studies of the dynamics, deployment, and unpacking. The validation of flexible control and system performance are also considered.

Soosaar, K.↗
DOE OSTI2023

Parallel Grid-Forming Inverter-Driven Black Start: Power-Hardware-in-the-Loop Validation: Preprint

With power systems encountering increasing deployment levels of inverter-based resources (IBRs), system restoration using grid-forming (GFM) IBRs has gained attention. Engineered to establish grid voltages in the absence of a stiff grid, black-start-capable GFM IBRs are expected to enhance power system resilience by playing a critical role in bottom-up system restoration. This paper experimentally studies the feasibility of the novel approach through power-hardware-in-the-loop (PHIL) testing and validation with a commercial GFM inverter. The PHIL test setup demonstrates an inverter-driven black start of a 5-MW unbalanced distribution feeder where two GFM inverters collectively black start the feeder: one is a commercial hardware GFM inverter interacting through the PHIL interface, and the other is a software GFM emulated by a real-time simulation with full electromagnetic transient (EMT) models. Both GFM inverters are equipped with negative-sequence voltage control to suppress the voltage imbalance resulting from the unbalanced loading, allowing us to study the dynamic interactions between the GFMs with their control parameters unknown. To evaluate the dynamic behavior of the GFM inverters under the entire black-start process, the EMT model of the distribution system details the transformer and motor dynamics to emulate their inrush and startup behaviors. It abstracts conventional grid-connected inverter dynamics, i.e., grid-following inverters. Oscilloscope measurements of the hardware GFM inverter are also presented for critical steps. Takeaways for further study and field deployment are provided.

grid-forming inverter↗
DOE OSTI2024

Structural Impact of Grid-Forming Inverters on Power System Coherency

This paper addresses the following fundamental research question: how does the integration of grid-forming inverters (GFMs) replacing conventional synchronous generators (SGs) impact the slow coherent eigen-structure and the low frequency oscillatory behavior of future power systems? Due to time-scale separated dynamics, generator states inside a coherent area synchronize over a fast time-scale due to stronger coupling, while the areas themselves synchronize over a slower time scale. Our mathematical analysis shows that due to the large-scale integration of GFMs, the weighted Laplacian structure of the frequency dynamics is preserved, however, the entries of the Laplacian may be significantly modified based on the location and penetration levels of the GFMs. This can impact and potentially significantly alter the coherency structure of the system. We have validated our findings with numerical results using the IEEE 68-bus test system.

Mukherjee, Sayak [BATTELLE (PACIFIC NW LAB)]↗
DOE OSTI2021

Processing Aleatory and Epistemic Uncertainties in Experimental Data From Sparse Replicate Tests of Stochastic Systems for Real-Space Model Validation

This paper presents a practical methodology for propagating and processing uncertainties associated with random measurement and estimation errors (that vary from test-to-test) and systematic measurement and estimation errors (uncertain but similar from test-to-test) in inputs and outputs of replicate tests to characterize response variability of stochastically varying test units. Also treated are test condition control variability from test-to-test and sampling uncertainty due to limited numbers of replicate tests. These aleatory variabilities and epistemic uncertainties result in uncertainty on computed statistics of output response quantities. The methodology was developed in the context of processing experimental data for “real-space” (RS) model validation comparisons against model-predicted statistics and uncertainty thereof. The methodology is flexible and sufficient for many types of experimental and data uncertainty, offering the most extensive data uncertainty quantification (UQ) treatment of any model validation method the authors are aware of. It handles both interval and probabilistic uncertainty descriptions and can be performed with relatively little computational cost through use of simple and effective dimension- and order-adaptive polynomial response surfaces in a Monte Carlo (MC) uncertainty propagation approach. A key feature of the progressively upgraded response surfaces is that they enable estimation of propagation error contributed by the surrogate model. Sensitivity analysis of the relative contributions of the various uncertainty sources to the total uncertainty of statistical estimates is also presented. Finally, the methodologies are demonstrated on real experimental validation data involving all the mentioned sources and types of error and uncertainty in five replicate tests of pressure vessels heated and pressurized to failure. Simple spreadsheet procedures are used for all processing operations.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Testing the 10 spectrograph units for DESI: approach and results

The recently commissioned Dark Energy Spectroscopic Instrument (DESI) will measure the expansion history of the Universe using the Baryon Acoustic Oscillation technique. The spectra of 35 million galaxies and quasars over 14000 sqdeg will be measured during the life of the experiment. A new prime focus corrector for the KPNO Mayall telescope delivers light to 5000 fiber optic positioners. The fibers in turn feed ten broad-band spectrographs. A consortium of Aix-Marseille University (AMU) and CNRS laboratories (LAM, OHP and CPPM) together with LPNHE (CNRS, IN2P3, Sorbonne Université and Université de Paris) and the WINLIGHT Systems company based in Pertuis (France), were in charge of integrating and validating the performance requirements of the ten full spectrographs, equipped with their cryostats, shutters and other mechanisms. We present a summary of our activity which allowed an efficient validation of the systems in a short-time schedule. We detail the main results. We emphasize the benefits of our approach and also its limitations.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2020

Empirical Validation of Multi-Zone HVAC System Model: Evaluation of Existing Infiltration Models used in Building Energy Simulation

Infiltration can have a significant impact on building loads. Studies have shown that infiltration can account for 15-40% of annual space conditioning needs in commercial buildings (Emmerich et al. 2019; Younes et al. 2012). The driving force of infiltration is the pressure difference across the building envelope caused by wind, the stack effect (known as buoyancy effect), and the operation of ventilation equipment. Wind pressure is governed by wind direction, speed, building shape, and other structures around the building. The stack effect is a function of the building height and air density differences of ambient air (Han, 2015). The effect of wind is dominant in low-rise residential buildings, and the stack effect is dominant in highrise buildings (ASHRAE 2017). In building energy simulation programs (e.g., EnergyPlus), various empirical infiltration models (e.g., the effective leakage area model, the flow coefficient model) are available to simulate infiltration rates. To help users in selecting a proper infiltration model for modeling of the two-story Flexible Research Platform (FRP), the team evaluates the existing infiltration models in EnergyPlus based on field measurements from the FRP. The blower door and tracer gas decay tests were performed in the FRP. The blower door test result was used to estimate input parameters required in the infiltration models. The actual infiltration rates were estimated with the tracer gas decay test results.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2025

Transition of SRT Source Term Software to Modern Version Control System to Enable More Efficient Verification, Validation, and User Engagement

The Simplified Radionuclide Transport (SRT) code assists in reactor design and licensing by providing a detailed analysis of radionuclide transport under specific transient scenarios. This analysis is essential for ensuring that reactors meet safety and regulatory standards before they are authorized to operate. Mechanistic source term analysis, which involves a realistic evaluation of radionuclide behavior from the source to the environment, is a key component of this process. It provides a comprehensive understanding of potential release scenarios, supporting the development of robust safety measures.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2021

Two Young Planetary Systems around Field Stars with Ages between 20 and 320 Myr from TESS

Planets around young stars trace the early evolution of planetary systems. We report the discovery and validation of two planetary systems with ages ≲300 Myr from observations by the Transiting Exoplanet Survey Satellite (TESS). The 40--320 Myr old G star TOI-251 hosts a 2.74{sub −0.18}{sup +0.18} R{sub ⊕} mini-Neptune with a 4.94 day period. The 20--160 Myr old K star TOI-942 hosts a system of inflated Neptune-sized planets, with TOI-942b orbiting in a period of 4.32 days with a radius of 4.81{sub −0.20}{sup +0.20} R{sub ⊕} and TOI-942c orbiting in a period of 10.16 days with a radius of 5.79{sub −0.18}{sup +0.19} R{sub ⊕}. Though we cannot place either host star into a known stellar association or cluster, we can estimate their ages via their photometric and spectroscopic properties. Both stars exhibit significant photometric variability due to spot modulation, with measured rotation periods of ∼3.5 days. These stars also exhibit significant chromospheric activity, with age estimates from the chromospheric calcium emission lines and X-ray fluxes matching that estimated from gyrochronology. Both stars also exhibit significant lithium absorption, similar in equivalent width to well-characterized young cluster members. TESS has the potential to deliver a population of young planet-bearing field stars, contributing significantly to tracing the properties of planets as a function of their age.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
NASA NTRS1988

A rule-based systems approach to spacecraft communications configuration optimization

An experimental rule-based system for optimizing user spacecraft communications configurations was developed at NASA to support mission planning for spacecraft that obtain telecommunications services through NASA's Tracking and Data Relay Satellite System. Designated Expert for Communications Configuration Optimization (ECCO), and implemented in the OPS5 production system language, the system has shown the validity of a rule-based systems approach to this optimization problem. The development of ECCO and the incremental optimization method on which it is based are discussed. A test case using hypothetical mission data is included to demonstrate the optimization concept.

Rash, James L.↗