SEARCH · Engineering Papers

Results for “error impact analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 505 records · Page 28

All sources NASA NTRS DOE OSTI

NASA NTRSDate not supplied

T2M Forecasts at Subseasonal Leads: Do Different Soil Moisture Initial States Have Different Impacts?

Soil moisture (W) helps control evapotranspiration (ET), and ET variations can in turn have a distinct impact on 2-m air temperature (T2M), given that increases in evaporative cooling encourage reduced temperatures. Soil moisture is accordingly linked to T2M, and realistic soil moisture initialization has, in previous studies, been shown to improve the skill of subseasonal T2M forecasts. The relationship between soil moisture and evapotranspiration, however, is distinctly nonlinear, with ET tending to increase with soil moisture in drier conditions and to be insensitive to soil moisture variations in wetter conditions. Here, through an extensive analysis of subseasonal forecasts produced with a state-of-the-art seasonal forecast system, this nonlinearity is shown to imprint itself on T2M forecast error in the conterminous United States in two unique ways: (i) the T2M forecast bias (relative to independent observations) induced by a negative precipitation bias tends to be larger for dry initializations, and (ii) on average, the unbiased root-mean-square error (ubRMSE) tends to be larger for dry initializations. Such findings can aid in the identification of forecasts of opportunity; taken a step further, they suggest a pathway for improving bias correction and uncertainty estimation in subseasonal T2M forecasts by conditioning each on initial soil moisture state.

2-meter Temperature↗

DOE OSTI2023

Accuracy of hourly energy predictions for demand flexibility applications

Decarbonization goals in the United States electricity sector are increasing the levels of renewable energy generation in the electricity supply system, and are driving increased attention to building electrification, which will increase the magnitude and shift the timing of the electricity system peak. These changes are motivating new approaches to coordinate building electricity demand with low-carbon renewable generation, elevating the importance of demand flexibility (DF) in buildings and the need to quantify the temporal impacts of DF. In this paper, we first characterize the hourly predictive accuracy of six commonly used baseline models in an application context of quantifying building-level load shift. Our analysis revealed insights such as hours of the day (afternoons), periods of the week (weekends), and seasons (summer) that were predicted with more accuracy than other time periods. In addition, the analysis showed tendencies toward overprediction or underprediction of load. Secondly, we provide the first published investigation of baseline erosion from repeated dispatch of building load shifting. We observed that as the baseline period is pushed back further from the prediction day, the distribution of errors across baseline model predictions increases, with notable inflection points near the three-week erosion point for two of the three models.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

NASA NTRS1986

Impact of mismodeled idle engine performance on calculation and tracking of optimal 4-D descent trajectories

Advanced flight management systems are being developed which are capable of calculating optimal 3-D and 4-D flight trajectories for arbitrary fuel and time costs. These systems require mathematical models of airplane performance in order to compute the optimal profiles. Mismodeled idle engine characteristics can result in descent trajectories requiring excessive throttle and/or speedbrake activity in order to achieve the desired end conditions. This paper evaluates the cost and fuel penalties, trajectory variations, and flight control requirements associated with typical idle engine modeling errors for a twin-jet transport airplane. Variations in idle power setting, thrust, fuel flow, and surge bleed operation were evaluated for a cruise/descent flight segment. The results of this analysis provide insight into the penalties associated with uncertainties in idle engine performance and suggest methods of modeling which minimize these penalties.

Williams, D. H.↗

NASA NTRS1990

Probabilistic high cycle fatigue failure analysis with application to liquid propellant rocket engines

A probabilistic high cycle fatigue (HCF) failure analysis of a welded duct in a rocket engine of the Space Shuttle main engine class is described. A state-of-the-art HCF failure prediction method was used in a Monte Carlo simulation to generate a distribution of failure lives. A stochastic stress/life model is used for material characterization, and a composite stress history is generated for accurately deriving the stress cycles for the fatigue-damage calculations. The HCF failure model expresses fatigue life as a function of stochastic parameters including environment, loads, material properties, geometry, and model specification errors. A series of HCF failure life analyses were performed to study the impact of a fixed parameter and to assess the importance of each stochastic input parameter through marginal analyses.

Sutharshana, S.↗

NASA NTRSDate not supplied

Exploring Unstructured Mesh Adaptation for Hybrid Reynolds-Averaged Navier–Stokes/Large Eddy Simulation

Mesh adaptation methods for the Reynolds-averaged Navier–Stokes (RANS) equations are rapidly maturing and beginning to impact the design of aerospace vehicles. RANS turbulence modeling improvements have slowed and may stagnate. Wall-modeled large eddy simulation (LES) and hybrid RANS/LES (HRLES) may provide an improved modeling capability but require specialized expertise to construct appropriate meshes and are considered be too ex-pensive for routine practical use. The realization of the CFD Vision 2030 Study includes improving geometry linkage, mesh generation/adaptation, and turbulence modeling/resolving methods for automated management of errors and uncertainties of physics-based, predictive modeling that can set the stage for ensuring a vehicle is in compliance with a regulation or specification (i.e., certification or qualification by analysis). An exploration of mesh adaptation for HRLES is performed to document synergies and challenges between mesh adaptation and HRLES. Vortex breakdown over a delta wing is examined to show the improvement of HRLES over RANS turbulence modeling approaches. A high lift configuration is shown to demonstrate complex geometry capability. Research and development opportunities are identified to advocate for continuing investments that may allow HRLES to enter routine practical use as a tool for aerospace vehicle analysis and design.

Michael A Park↗

DOE OSTI2026

Evaluating radiation impact on transmon qubits in above and underground facilities

Superconducting qubits can be sensitive to energy deposits caused by cosmic rays and ambient radioactivity. While previous studies have explored correlated effects in time and space due to cosmic ray interactions, we present the first direct comparison of a transmon qubit’s performance measured at two distinct sites: the above-ground SQMS facility (Fermilab, US) and the deep-underground Gran Sasso Laboratory (Italy). Despite the stark difference in radiation levels, we observe a similar average qubit relaxation time of approximately 80 microseconds at both locations. To investigate radiation-induced events, we employ a fast decay detection protocol, comparing the relative rates of events between the two environments. Although intrinsic noise remains the dominant source of errors in superconducting qubits, our analysis revealed a significant excess of radiation-induced events for high-coherence transmon qubits operated above-ground. Finally, using γ-ray sources with increasing activity levels, we evaluate the qubit response in a controlled low-background environment.

De Dominicis, Francesco [GSSI, Aquila; INFN, LNS]↗

NASA NTRS1984

The seasonal response of the Held-Suarez climate model to prescribed ocean temperature anomalies. II - Dynamical analysis

The heating associated with equatorial, subtropical, and midlatitude ocean temperature anamolies in the Held-Suarez climate model is analyzed. The local and downstream response to the anomalies is analyzed, first by examining the seasonal variation in heating associated with each ocean temperature anomaly, and then by combining knowledge of the heating with linear dynamical theory in order to develop a more comprehensive explanation of the seasonal variation in local and downstream atmospheric response to each anomaly. The extent to which the linear theory of propagating waves can assist the interpretation of the remote cross-latitudinal response of the model to the ocean temperature anomalies is considered. Alternative hypotheses that attempt to avoid the contradictions inherent in a strict application of linear theory are investigated, and the impact of sampling errors on the assessment of statistical significance is also examined.

Phillips, T. J.↗

NASA NTRS2012

The Effect of Geocenter Motion on Jason-2 and Jason-1 Orbits and the Mean Sea Level

We have investigated the impact of geocenter motion on Jason-2 orbits. This was accomplished by computing a series of Jason-1, Jason-2 GPS-based and SLR/DORIS-based orbits using ITRF2008 and the IGS repro1 framework based on the most recent GSFC standards. From these orbits, we extract the Jason-2 orbit frame translational parameters per cycle by the means of a Helmert transformation between a set of reference orbits and a set of test orbits. The fitted annual and seasonal terms of these time-series are compared to two different geocenter motion models. Subsequently, we included the geocenter motion corrections in the POD process as a degree-1 loading displacement correction to the tracking network. The analysis suggested that the GSFC's Jason-2 std0905 GPS-based orbits are closely tied to the center of mass (CM) of the Earth whereas the SLR/DORIS std0905 orbits are tied to the center of figure (CF) of the ITRF2005 (Melachroinos et al., 2012). In this study we extend the investigation to the centering of the GPS constellation and the way those are tied in the Jason-1 and Jason-2 POD process. With a new set of standards, we quantify the GPS and SLR/DORIS-based orbit centering during the Jason-1 and Jason-2 inter-calibration period and how this impacts the orbit radial error over the globe, which is assimilated into mean sea level (MSL) error, from the omission of the full term of the geocenter motion correction.

Melachroinos, Stavros A.↗

DOE OSTI2021

Kinetic equilibrium reconstruction and the impact on stability analysis of KSTAR plasmas

High fidelity kinetic plasma equilibrium reconstructions are an essential requirement for accurate stability and disruption prediction analyses to support continuous operation of high beta tokamak plasmas. The present kinetic equilibrium reconstructions of plasmas in the KSTAR device include plasma density and temperature profiles from Thomson scattering and ion temperature from charge exchange spectroscopy diagnostics, and allowance for fast particle pressure. In addition, up to 25 channels of motional Stark effect diagnostic data are used to constrain the magnetic field pitch angle profile in the plasma to produce a reliable computation of the safety factor, q, profile. In this work, H-mode plasmas exhibit clear pedestal characteristics in the reconstructed pressure profile compared to internal transport barrier or L-mode plasmas. The plasma configuration and vertical position of inner strike points are validated by CCD and infrared camera images. Ideal and resistive magnetohydrodynamic (MHD) stability analyses using the DCON and resistive DCON codes utilize these kinetic equilibrium reconstructions to compare to experimental plasma stability. Equilibria with sufficiently low convergence error can provide reliable computation of ideal and resistive MHD stability analysis.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

DOE OSTI2024

Fine Temperature Grid Continuous Energy Cross Section Generation for Monte Carlo Analysis of Xe-100 Design

The standard “A Compact ENDF (ACE)” data libraries used by Monte Carlo based reactor physics codes calculations are provided by Los Alamos National Laboratory (LANL) with a temperature interval mostly of 300 K (e.g. 300 K, 600 K, 900 K) for the cross sections and between 100 K and 200 K for the thermal scattering libraries (TSL). However, some codes such as MCNP lack capability to perform on-the-fly temperature interpolation during simulation both for neutron and TSL cross-sections. To evaluate the impact related to Doppler broadening and spectrum shift associated with TSL changes, this paper explores the potential of adopting a temperature grid finer than the ones contained in the standard data libraries. A 50 K temperature grid was employed to quantify the error in neutronics calculations due to temperature grid resolution. This was achieved by comparing the results of this study (50 K temperature interval) against the results obtained with standard data libraries (>100 K temperature interval). While the adopted grid primarily relies on the ENDF/B-VII.1 library, for neutron cross-sections, it utilizes ENDF/B-VIII.0 library for TSL. The analyses confirmed that the accuracy of neutronics calculations is satisfactory when using a 50 K temperature grid. Notably, adopting a 50 K temperature grid, as opposed to standard libraries or coarser temperature grids, could lead to a difference of no more than a few hundred pcm in dk for both fresh fuel and burnt fuel. The most sensitive reaction type to the temperature grid was as expected identified as the capture cross-section of U-238.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2022

Demonstration and Evaluation of the Human-Technology Integration Function Allocation Methodology

There is an imminent need for the existing nuclear power plants to reduce their operating and maintenance (O&M) costs to remain economically viable. Digital technology, including automation, provides a significant opportunity for the existing nuclear power plant fleet to transform the way in which work is accomplished, reducing O&M costs, and allowing the fleet to remain economically competitive. One notable opportunity to significantly reduce O&M costs pertains to modifications to the plant equipment and main control room (MCR). Existing instrumentation and control (I&C) technologies in the MCR are highly analog, costly to operate and maintain, and demand a high cognitive and physical workload from plant staff (i.e., operators). Digitalizing the MCR has a range of broad economic benefits, including improved plant performance and reduced manual work. Further, digital I&C systems can fundamentally change the way in which plant staff operate the plant; this is the concept of operation. Human-technology integration is important to ensure that impacts to the concept of operation are done in a way that account for capabilities of people and technology. Human-technology integration employs human factors engineering (HFE) methods and principles to maximize the benefits of digital technology, reducing human error, improving overall decision-making and usability. The U.S. Department of Energy Light Water Reactor Sustainability Program is applying human-technology integration research to ensure digital technologies are safe, reliable, and efficient. This paper documents the demonstration of the human-technology guidance developed by the Light Water Reactor Sustainability Program from a first-of-a-kind digital I&C upgrade, specifically addressing function analysis and allocation for a new digital I&C system that included changes in automation levels. The program’s specific approach is included in this work, following lessons learned. This document serves as a resource for industry to follow in applying human-technology integration and HFE to digital modifications, specific to function analysis and allocation. The lessons learned should be considered in the planning and execution of HFE activities that support such digital modifications.

99 GENERAL AND MISCELLANEOUS↗

NASA NTRS2018

Insight and Evidence Motivating the Simplification of Dual-Analysis Hybrid Systems into Single-Analysis Hybrid Systems

Many hybrid data assimilation systems currently used for NWP employ some form of dual-analysis system approach. Typically a hybrid variational analysis is responsible for creating initial conditions for high-resolution forecasts, and an ensemble analysis system is responsible for creating sample perturbations used to form the flow-dependent part of the background error covariance required in the hybrid analysis component. In many of these, the two analysis components employ different methodologies, e.g., variational and ensemble Kalman filter. In such cases, it is not uncommon to have observations treated rather differently between the two analyses components; recentering of the ensemble analysis around the hybrid analysis is used to compensated for such differences. Furthermore, in many cases, the hybrid variational high-resolution system implements some type of four-dimensional approach, whereas the underlying ensemble system relies on a three-dimensional approach, which again introduces discrepancies in the overall system. Connected to these is the expectation that one can reliably estimate observation impact on forecasts issued from hybrid analyses by using an ensemble approach based on the underlying ensemble strategy of dual-analysis systems. Just the realization that the ensemble analysis makes substantially different use of observations as compared to their hybrid counterpart should serve as enough evidence of the implausibility of such expectation. This presentation assembles numerous anecdotal evidence to illustrate the fact that hybrid dual-analysis systems must, at the very minimum, strive for consistent use of the observations in both analysis sub-components. Simpler than that, this work suggests that hybrid systems can reliably be constructed without the need to employ a dual-analysis approach. In practice, the idea of relying on a single analysis system is appealing from a cost-maintenance perspective. More generally, single-analysis systems avoid contradictions such as having to choose one sub-component to generate performance diagnostics to another, possibly not fully consistent, component.

Todling, Ricardo↗

DOE OSTI2026

Object-Based Evaluation of Dynamical and Statistical Downscaled Precipitation Products over CONUS

High-resolution precipitation data, generated through dynamical downscaling (DD) or statistical downscaling (SD) of global climate model output, provide critical information for regional climate assessment and adaptation planning. Most downscaling development and validation have focused on accurate gridscale precipitation construction and ignored the spatial structure of precipitation across model grids and at the event scale. However, many applications, e.g., hydrologic modeling and the analysis using the downscaled precipitation, require a reasonable representation of the spatial structure of precipitation within watersheds. Therefore, a set of standard metrics to evaluate the representation of the spatial structure of individual storms across diverse downscaled precipitation products is desired. To address this need, we conducted an object-based evaluation of precipitation in decades-long DD and SD products over the contiguous United States (CONUS). Specifically, we evaluate their ability to reproduce various features of precipitation objects in the observations: total volume, precipitation area, peak intensity, and spatial structure. Multiple metrics (bias, Perkins score, and nonparametric statistical tests) are used to quantify model performance. Our evaluation reveals notable variations in performance among individual products across different climate zones and seasons, as well as between extreme and nonextreme events. In general, most DD products exhibit balanced performance across the four precipitation object features, while SD products vary more significantly in their performance across products. Based on this comprehensive evaluation, we provide guidance on choosing downscaled products for specific regions, seasons, and precipitation object features. These findings and recommendations can inform precipitation-relevant modeling and analysis over CONUS, guide future downscaling technique developments, and provide actionable information for climate impact assessment and adaptation.

Downscaling↗

DOE OSTI2021

Evaluation of CMIP6 models in simulating the statistics of extreme precipitation over Eastern Africa

We report the Eastern Africa region experiences frequent extreme precipitation events that can cause destruction of property and environment, and loss of lives. Thus, there is a need to understand how these events may change in the future and how well the global climate models that are used to make projections can simulate precipitation extremes in this region before they can be used in downscaling or flood and drought impact assessment studies. In this work, we evaluated the ability of sixteen Coupled Model Intercomparison Project Phase 6 (CMIP6) models to simulate present-day precipitation extremes over the Eastern Africa region during the two rainy seasons (March–May and September–November). We used nine extreme precipitation indices (including seven (one) indices of wet (dry) extremes) defined by the Expert Team on Climate Change Detection and Indices. The CMIP6 models were evaluated against two gridded observation datasets: Global Precipitation Climatology Project One-Degree Daily Dataset and Tropical Rainfall Measuring Mission Multi-satellite Precipitation Analysis 3B42. Three model performance metrics (percentage bias, normalized root-mean-square error, and pattern correlation coefficient) were employed to further assess the strengths and weakness of the models. Our results show that the multi-model ensemble mean generally provides a better representation of observed precipitation and related extremes compared to individual models when considering all metrics and seasons. Several consistent biases are evident across CMIP6 models, which tend to overestimate the total-wet day precipitation and consecutive wet days, and underestimate very wet days and maximum 5-day precipitation in both seasons. Furthermore, no single model consistently performs best, model performance varies with the season and index under consideration and is generally independent of horizontal resolution.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2024

Phase Identification in Synchrotron X-ray Diffraction Patterns of Ti–6Al–4V Using Computer Vision and Deep Learning

X-ray diffraction patterns contain information about the atomistic structure and microstructure (defect population) of materials, extracting detailed information from diffraction patterns is complex, demanding and relies on prior knowledge. Here, we hypothesize that deep-learning techniques can help to perform an effective and accurate analysis with high throughput rates. To demonstrate this concept, we applied a novel deep learning framework to determine the evolution of the β-phase volume fraction in a Ti–6Al–4V alloy during heat-treatment from video sequences of 2D diffraction patterns recorded in transmission and with highly monochromatic radiation in a synchrotron beamline. In particular, we studied the impact of network design on prediction reliability and computational performance. Networks of different architectures were trained using 3008 experimental 2D patterns. A well-tuned model was found to reproduce the phase fractions of another experimental data set, consisting of 1100 diffraction patterns, with a mean-square error as small as 2.6 x 10 -4 . The average prediction error of β-phase volume fraction was within 1.6 x 10 -2 (in each diffraction pattern) of the values obtained by conventional methods. Our work demonstrates that convolutional neural networks can evaluate high energy X-ray diffraction patterns with a remarkable level of reliability. Furthermore, it demonstrates the significance of network design on the reliability of predictions and computational performance. The most complex models do not necessarily result in highest accuracy and may even fail to learn from the data.

36 MATERIALS SCIENCE↗

DOE OSTI2023

Connecting Large‐Scale Meteorological Patterns to Extratropical Cyclones in CMIP6 Climate Models Using Self‐Organizing Maps

Abstract Extratropical cyclones (ETCs) are responsible for the majority of cool‐season extreme events in the northeastern United States (NEUS), often leading to high‐impact weather conditions that can have wide‐ranging socioeconomic impacts. Evaluating the ability of climate models to adequately simulate ETC dynamics is essential for improving model performance and increasing confidence in future projections used by stakeholders and policymakers. ETCs are traditionally studied using techniques such as case studies and synoptic typing, however, these approaches can be time‐consuming, require subjective analysis, and do not necessarily identify the coincident large‐scale meteorological patterns (LSMPs). Here, we apply self‐organizing maps (SOMs) as an automated machine‐learning approach to characterize the LSMPs and associated frequency and intensity of discrete ETC events over NEUS. The dominant patterns of geopotential height variability are identified through SOM analysis of five reanalysis products during the last four decades. ETC events are tracked using TempestExtremes and are integrated with SOMs to classify the accumulated cyclone activity (ACA) associated with each pattern. We then evaluate the skill of CMIP6 historical experiments in simulating the LSMPs and ETC events identified in the SOM. Our results identify a robust bias toward more zonal patterns, with models struggling to reproduce the more amplified patterns typically associated with the highest cyclone activity. While model resolution has some impact on simulation credibility, model configuration appears to be more important in LSMP representation. The vast majority of CMIP6 models produce too few ETCs, although model errors are distributed around historical reanalyses when ACA is normalized by storm frequency.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2025

Using the optimal combined index weight ratio to improve the probability of anomaly detection in big area additive manufacturing

Big Area Additive Manufacturing (BAAM) of composites requires significant time, energy, and material, so it is critical to reduce production inefficiencies to make functional parts without multiple iterations. Statistical process control coupled with Principal Component Analysis (PCA) is a powerful technique that provides a quick, computationally inexpensive, and intuitive way for operators to detect defects that form in a manufacturing process without massive datasets. Recently, a combined index that is a weighted sum of the Hotelling's T 2 and squared residual error statistics has been proposed that can be monitored in one chart, improving interpretation accuracy and simplicity. However, the literature does not offer a formal method to optimise the weights. Here, we introduce two new approaches to the traditional weight selection approach using simulated and BAAM image data. Approach 1 uses a theoretically motivated optimum inspired by probabilistic principal component analysis. Approach 2 systematically varies the ratio of the weights to find the optimum. We show that approach 1 delivers optimal anomaly detection performance in select cases while approach 2 fares better in practice. Surprisingly, we also show that choosing a more complex PCA model has a minimal negative impact on anomaly detection performance compared to a more simplistic model.

3-dimensional printing↗

NASA NTRS2005

CRYOGENIC UPPER STAGE SYSTEM SAFETY

NASA s Exploration Initiative will require development of many new systems or systems of systems. One specific example is that safe, affordable, and reliable upper stage systems to place cargo and crew in stable low earth orbit are urgently required. In this paper, we examine the failure history of previous upper stages with liquid oxygen (LOX)/liquid hydrogen (LH2) propulsion systems. Launch data from 1964 until midyear 2005 are analyzed and presented. This data analysis covers upper stage systems from the Ariane, Centaur, H-IIA, Saturn, and Atlas in addition to other vehicles. Upper stage propulsion system elements have the highest impact on reliability. This paper discusses failure occurrence in all aspects of the operational phases (Le., initial burn, coast, restarts, and trends in failure rates over time). In an effort to understand the likelihood of future failures in flight, we present timelines of engine system failures relevant to initial flight histories. Some evidence suggests that propulsion system failures as a result of design problems occur shortly after initial development of the propulsion system; whereas failures because of manufacturing or assembly processing errors may occur during any phase of the system builds process, This paper also explores the detectability of historical failures. Observations from this review are used to ascertain the potential for increased upper stage reliability given investments in integrated system health management. Based on a clear understanding of the failure and success history of previous efforts by multiple space hardware development groups, the paper will investigate potential improvements that can be realized through application of system safety principles.

Smith, R. Kenneth↗