Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Errors”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 433 records · Page 24

A Comprehensive Radial Velocity Error Budget for Next Generation Doppler Spectrometers

We describe a detailed radial velocity error budget for the NASA-NSF Extreme Precision Doppler Spectrometer instrument concept NEID (NN-explore Exoplanet Investigations with Doppler spectroscopy). Such an instrument performance budget is a necessity for both identifying the variety of noise sources currently limiting Doppler measurements, and estimating the achievable performance of next generation exoplanet hunting Doppler spectrometers. For these instruments, no single source of instrumental error is expected to set the overall measurement floor. Rather, the overall instrumental measurement precision is set by the contribution of many individual error sources. We use a combination of numerical simulations, educated estimates based on published materials, extrapolations of physical models, results from laboratory measurements of spectroscopic subsystems, and informed upper limits for a variety of error sources to identify likely sources of systematic error and construct our global instrument performance error budget. While natively focused on the performance of the NEID instrument, this modular performance budget is immediately adaptable to a number of current and future instruments. Such an approach is an important step in charting a path towards improving Doppler measurement precisions to the levels necessary for discovering Earth-like planets.

NASA-NSF Extreme Precision Doppler Spectrometer in↗

Accounting for the Speed-Accuracy Trade-Off in Quantifying Human-In-The-Loop Error Probabilities

Human-in-the-loop (HITL) simulations cannot collect enough data from human operators to validate estimates of error probabilities for task components. Error rates for tasks have been estimated by using laboratory data for error rates depending on variables such as the cognitive complexity of the task. The limited channel capacity of human operators compels error rates to be strongly related to the time available for the task, the speed-accuracy trade-off. HITL simulations can provide valuable data on the time available for the operator's tasks. We propose that the response times be used in conjunction with measured speed-accuracy curves to estimate the operator error rates contributing to mission failure. Such analyses should be especially important in the estimation of error rates in off-nominal situations.

probability↗

Assessment of the Impact of Spatial Heterogeneity on Microwave Satellite Soil Moisture Periodic Error

An accurate temporal and spatial characterization of errors is required for the efficient processing, evaluation, and assimilation of remotely-sensed surface soil moisture retrievals. However, empirical evidence exists that passive microwave soil moisture retrievals are prone to periodic artifacts which may complicate their application in data assimilation systems (which commonly treat observational errors as being temporally white). In this paper, the link between such temporally-periodic errors and spatial land surface heterogeneity is examined. Both the synthetic experiment and site-specified cases reveal that, when combined with strong spatial heterogeneity, temporal periodicity in satellite sampling patterns (associated with exact repeat intervals of the polar-orbiting satellites) can lead to spurious high frequency spectral peaks in soil moisture retrievals. In addition, the global distribution of the most prominent and consistent 8-day spectral peak in the Advanced Microwave Scanning Radiometer - Earth Observing System soil moisture retrievals is revealed via a peak detection method. Three spatial heterogeneity indicators - based on microwave brightness temperature, land cover types, and long-term averaged vegetation index - are proposed to characterize the degree to which the variability of land surface is capable of inducing periodic error into satellite-based soil moisture retrievals. Regions demonstrating 8-day periodic errors are generally consistent with those exhibiting relatively higher heterogeneity indicators. This implies a causal relationship between spatial land surface heterogeneity and temporal periodic error in remotely-sensed surface soil moisture retrievals.

Fangni Lei↗

Addressing Human Error in International Space Station Flight Control Teams: Advances in Ground Training for Science Operators

In flight control, as with any human in the loop system, operator error is an inevitable reality. On the International Space Station (ISS) where crew time and physical resources are precious and often irreplaceable, operator errors can result in significant, irreversible consequences. Flight controllers at the Payload Operations Integration Center (POIC) located at NASA's Marshall Space Flight Center (MSFC) in Huntsville, Alabama know this reality well. At the POIC, operator errors can be caused by a variety of factors, from poor hardware or software design to environmental factors such as time pressure or fatigue. The most difficult errors to address, however, are those which result from ineffective teamwork. To address these teamwork errors, trainers at the POIC have drawn best practices from high reliability industries as well as from our sister ISS control center at the Johnson Space Center (JSC) in Houston, Texas, to develop and implement a new training program focused specifically on teamwork skills. This training program, called Team Skills Training, is inspired by modern and historical training programs developed by NASA and is specifically tailored to the needs of the payload operations flight control team at the POIC. The program consists of training for both certified and trainee flight controllers, and covers team skills topics such as situational awareness, leadership, and communication skills. To maximize effectiveness, the program uses novel instructional techniques which extend beyond the classroom to encourage students to apply what they have learned to their day to day work. Minimizing operator errors in flight control is an endeavor which requires constant vigilance and continuous improvement. At the POIC, Team Skills Training is an important step in this journey.

Harris, Samantha S.↗

Regional Replay: A Unique Reanalysis-Based Tool for Addressing Model Error

Understanding and correcting errors in general circulation and climate models has long been part intuition and part trial and error. Efforts to diagnose the errors and provide some guidance to developers have been of some value, though such efforts, with few exceptions, have been more successful in identifying and documenting the errors in the model simulations rather than the model deficiencies that produced them. Modern atmospheric reanalyses such as MERRA-2 provide much-improved estimates of our climate system at hourly to interannual and longer time scales and have become an important tool for assessing model performance. Here we use MERRA-2 to address biases in the NASA/GMAO GEOS model by employing a "regional replay" approach developed in the GMAO. The regional replay approach constrains the model to remain close to the reanalysis over arbitrary regions and selected model variables, thus allowing us to examine how model error generated over one area is spatially translated across the globe. Several examples are given including an assessment of the global impact of errors produced over the Tibet region.

Tibet Region↗

Reducing Errors in Velocity–Azimuth Display (VAD) Wind and Deformation Retrievals from Airborne Doppler Radars in Convective Environments

The present study describes methods to reduce the uncertainty of velocity–azimuth display (VAD) wind and deformation retrievals from downward-pointing, conically scanning, airborne Doppler radars. These retrievals have important applications in data assimilation and real-time data processing. Several error sources for VAD retrievals are considered here, including violations to the underlying wind field assumptions, Doppler velocity noise, data gaps, temporal variability, and the spatial weighting function of the VAD retrieval. Specific to airborne VAD retrievals, we also consider errors produced due to the radar scans occurring while the instrument platform is in motion. While VAD retrievals are typically performed using data from a single antenna revolution, other strategies for selecting data can be used to reduce retrieval errors. Four such data selection strategies for airborne VAD retrievals are evaluated here with respect to their effects on the errors. These methods are evaluated using the second hurricane nature run numerical simulation, analytic wind fields, and observed Doppler radar radial velocities. The proposed methods are shown to reduce the median absolute error of the VAD wind retrievals, especially in the vicinity of deep convection embedded in stratiform precipitation. The median absolute error due to wind field assumption violations for the along-track and for the across-track wind is reduced from 0.36 to 0.08 m s−1 and from 0.35 to 0.24 m s−1, respectively. Although the study focuses on Doppler radars, the results are equally applicable to conically scanning Doppler lidars as well.

Charles N Helms↗

A comprehensive line spread function error for the Off-plane Grating Rocket Experiment

The Off-plane Grating Rocket Experiment (OGRE) is a soft X-ray grating spectrometer to be flown on a suborbital rocket. The payload is designed to obtain the highest-resolution soft X-ray spectrum of Capella to date with a resolution goal of R(lambda/delta lambda) > 2000 at select wavelengths in its 10 - 55 A bandpass of interest. The optical design of the spectrometer realizes a maximum resolution of R 5000 with all components performing optimally, in perfect alignment, and not considering in-flight pointing errors; however, performance errors, misalignments, and in-flight pointing errors work to degrade this performance. A comprehensive line spread function (LSF) error budget has been constructed for the spectrometer to identify errors contributing to the LSF, to determine how each affects the LSF, and to inform performance requirements and alignment tolerances for the spectrometer. In this document, the comprehensive LSF error budget for the OGRE spectrometer is presented and its implications are discussed.

Benjamin D Donovan↗

Logical Shadow Tomography: Efficient Estimation of Error-mitigated Observables

In near-term quantum applications, reducing errors and improving device reliability is an essential task. Towards these ends, various techniques have been introduced in recent literature, collectively referred to as quantum error mitigation techniques, for reducing errors in pre-fault-tolerant devices. Here, we introduce logical shadow tomography as a versatile error mitigation method. Our technique uses a stabilizer code to encode information in a logical state. Instead of doing active error correction, quantum states will be measured at the end of computation via shadow tomography and non-logical errors are projected out in the classical post-processing. Relative to quantum subspace expansion which requires O(2(M-1)L) experiments to estimate an logical Pauli observable encoded by an [[M, L, d]] code, our technique only requires 2L experiments, an important practical reduction in resources.

Hong-Ye Hu↗

Exploring the Relationship Between Temperature Forecast Errors and Earth System Variables

Accurate subseasonal weather forecasts, from two weeks up to a season, can help reduce costs and impacts related to weather and corresponding extremes. The quality of weather forecasts has improved considerably in recent decades as models represent more details of physical processes, and they benefit from assimilating comprehensive Earth observation data as well as increasing computing power. However, with ever–growing model complexity, it becomes increasingly difficult to pinpoint weaknesses in the forecast models’ process representations which is key to improving forecast accuracy. In this study, we use a comprehensive set of observation–based ecological, hydrological and meteorological variables to study their potential for explaining temperature forecast errors at the weekly time scale. For this purpose, we compute Spearman correlations between each considered variable and the forecast error obtained from the ECMWF subseasonal–to–seasonal (S2S) reforecasts at lead times of 1–6 weeks. This is done across the globe for the time period 2001–2017. The results show that temperature forecast errors globally are most strongly related with climate–related variables such as surface solar radiation and precipitation, which highlights the model’s difficulties in accurately capturing the evolution of the climate–related variables during the forecasting period. At the same time, we find particular regions in which other variables are more strongly related to forecast errors. For instance, in central Europe, eastern North America and southeastern Asia, vegetation greenness and soil moisture are relevant, while in western South America and central North America, circulation–related variables such as surface pressure relate more strongly with forecast errors. Overall, the identified relationships between forecast errors and independent Earth observations reveal promising variables on which future forecasting system development could focus by specifically considering related process representations and data assimilation.

Temperature↗

Quantifying Human Behavior and Decision Errors in Security Screening Operations

The potential for human errors in conducting security related screening operations can lead to inadvertent and adverse decision outcomes. This paper overviews an initial mathematical framework designed to model and quantify the various human factors and decision outcomes that may occur in conducting security screening operations, such as U.S. port of entry radiological and nuclear (rad/nuc) security screening. This framework is based on the Human Error Assessment and Reduction (HEART) technique. As applied here, the framework incorporates a set of rules for human engagement, including a prescribed concept of operations (CONOPS) and deviations that may occur from this established CONOPS due to inadvertent personnel decision errors. We also review some of the various factors that may adversely influence such decisions by security screening personnel. Some of these factors include current workload, environmental conditions, training, and various other intangible factors. Using the HEART methodology, we translate each of these factors into error producing conditions, their effects on error, an assessed proportion of effects, and finally the overall probability of human error at each stage of the screening process. We then include a small scale example to demonstrate the methodology and results based on an assumed set of input conditions at a notional port of entry.

Brigantic, Robert T.↗

Assessing the Optical Performance Impact of Tracking Error in an Operational Concentrated Solar Power Plant Using Monte Carlo Ray-Tracing Simulation

Concentrating Solar Power (CSP) provides firm and dispatchable electricity due to its thermal storage and hybridization capabilities, which supports the decarbonization of our energy supply. Of the various CSP technologies, parabolic trough collectors are the most mature, with over 500 MW operating worldwide. The optical performance of parabolic trough systems is sensitive to tracking error, which is defined as the angular offset of a collector away from the sun position in the transversal plane. Tracking error commonly occurs due to non-continuous adjustment of the trough angle to point toward the sun, but other factors such as gravity, heating, and wind loading can also contribute to tracking error. Researchers have explored the impact of tracking error on optical performance both numerically and experimentally, but existing studies do not include measurements from operational utility-scale power plants. Tilt angle measurements of parabolic troughs at operational utility-scale power plants illustrate spatial variations in optical performance and include various sources of tracking error such as gravity, heating, and wind loading. To fully characterize wind driven loads on parabolic troughs, we are conducting a long-term field measurement campaign at the Nevada Solar One CSP plant located in Boulder City, NV, which has a nominal capacity of 72 MW and 0.5 hours of full-load storage. We record load measurements on four outer trough rows, collecting support structure bending moments, drive torque moments, dynamic accelerations of the spaceframe, mirror displacement, and tilt angles. Using the tilt measurements acquired at 20 Hz frequency, we calculate the deviation between the nominal sun position and the tracker angle. Using a Monte-Carlo ray-tracing simulation software, we assess the impact of the tracker angle deviation on optical performance throughout the diurnal cycle at various spatial locations within the CSP plant. In our view, this first-of-a-kind study will provide important guidance for future trough designs that reduce the impact of various sources of tracking error on performance.

concentrating solar power↗

Liveness as a factor to evaluate memory vulnerability to soft errors

Memory, used by a computer to store data, is generally prone to faults, including permanent faults (i.e. relating to a lifetime of the memory hardware), and also transient faults (i.e. relating to some external cause) which are otherwise known as soft errors. Since soft errors can change the state of the data in the memory and thus cause errors in applications reading and processing the data, there is a desire to characterize the degree of vulnerability of the memory to soft errors. In particular, once the vulnerability for a particular memory to soft errors has been characterized, cost/reliability trade-offs can be determined, or soft error detection mechanisms (e.g. parity) may be selectively employed for the memory. In some cases, memory faults can be diagnosed by redundant execution and a diagnostic coverage may be determined.

Bramley, Richard Gavin↗

\texttt{qec\_code\_sim}: An open-source Python framework for estimating the effectiveness of quantum-error correcting codes on superconducting qubits

Quantum computers are highly susceptible to errors due to unintended interactions with their environment. It is crucial to correct these errors without gaining information about the quantum state, which would result in its destruction through back-action. Quantum Error Correction (QEC) provides information about occurred errors without compromising the quantum state of the system. However, the implementation of QEC has proven to be challenging due to the current performance levels of qubits -- break-even requires fabrication and operation quality that is beyond the state-of-the-art. Understanding how qubit performance factors into the success of a QEC code is a valuable exercise for tracking progress towards fault-tolerant quantum computing. Here we present \texttt{qec\_code\_sim}, an open-source, lightweight Python framework for studying the performance of small quantum error correcting codes under the influence of a realistic error model appropriate for superconducting transmon qubits, with the goal of enabling useful hardware studies and experiments. \texttt{qec\_code\_sim} requires minimal software dependencies and prioritizes ease of use, ease of change, and pedagogy over execution speed. As such, it is a tool well-suited to small teams studying systems on the order of one dozen qubits.

Lopez, Santiago↗

Uncertainty-Aware and Explainable Human Error Detection in the Operation of Nuclear Power Plants

The timely and accurate identification of incidents, such as human factor error, is important to restore nuclear power plants (NPPs) to a stable state. However, the identification of abnormal operating conditions is difficult because of the existence of multiple scenarios. In addition, to implement mitigation actions rapidly after an incident occurs, operators must accurately identify an incident by monitoring the trends of many variables. The mental burden posed by this can increase human error and cause failure in identifying incidents. Failure to identify incidents directly results in erroneous mitigation measures, which are detrimental to NPPs. In this study, we leverage uncertainty-aware models to identify such errors and thereby increase the chances of mitigating them. We use the data collected from a physical test bed. The goal is to identify both certain and accurate models. For this, the two main aspects of focus in this study are explainable artificial intelligence (XAI) and uncertainty quantification (UQ). While XAI elucidates the decision pathway, UQ evaluates decision reliability. Their integration paints a comprehensive picture, signifying that understanding decisions and their confidence should be interlinked. Thus, in this study we leverage UQ measures (e.g. entropy and mutual information) along with Shapley additive explanations to gain insights into the features contributing to both accuracy and uncertainty in error identification. Furthermore, our results show that uncertainty-aware models combined with XAI tools can explain the artificial intelligence–prescribed decisions, with the potential of better explaining errors for the operators.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Power Spectrum of Uplink Array Signals with Random Phase and Delay Errors

Link Array signals emanating from different antennas must be compensated for Doppler and delay in order to achieve the N(sup 2) array gain predicted by theory. However compensation is never perfect, leaving residual errors that cause losses in array gain and degradation in signal quality. Here we develop a mathematical model for Uplink Array signals in the presence of phase and delay errors, similar to well-known multipath analyses but with features unique to this problem. The resulting losses and distortions are described, and the power spectral density of the array signal derived first conditioned on a given error vector, then averaged over distributions deemed suitable for Uplink Array applications. The impact of phase and delay errors on array gain and signal distortion are addressed, and the maximum data throughput is quantified in terms of the assumed error statistics.

uplinks arrays↗

Understanding Calibration and Error Propagation in Longitudinal and Lateral Manganin Gauge Shock Experiments

Soda-lime glass remains elastic under shock pressures up to approximately 6.5 GPa. In this paper, soda lime glass shock experiments are used to understand the calibration and error propagation in longitudinal and lateral manganin gauge experiments. The errors in the calibration process for both longitudinal and lateral manganin gauge experiments are identified and discussed. Five soda-lime glass experiments up to 3 GPa are analyzed using this refined technique. The results show good agreement between the experimental data and the published calibration by Rosenberg and Moshel. Errors are propagated from the experimental data measurements and the assumptions that are made in the calibration, where the bulk of the error seems to come from uncertainty in the dynamic yield strength of manganin. Finally, the method presented in this paper allows for analysis of dynamic shock experiments with longitudinal and lateral manganin gauges including error propagation.

36 MATERIALS SCIENCE↗

Combined selection of the dynamic model and modeling error in nonlinear aeroelastic systems using Bayesian Inference

Here, we report a Bayesian framework for concurrent selection of physics-based models and (modeling) error models. We investigate the use of colored noise to capture the mismatch between the predictions of calibrated models and observational data that cannot be explained by measurement error alone within the context of Bayesian estimation for stochastic ordinary differential equations. Proposed models are characterized by the average data-fit, a measure of how well a model fits the measurements, and the model complexity measured using the Kullback–Leibler divergence. The use of a more complex error models increases the average data-fit but also increases the complexity of the combined model, possibly over-fitting the data. Bayesian model selection is used to find the optimal physical model as well as the optimal error model. The optimal model is defined using the evidence, where the average data-fit is balanced by the complexity of the model. The effect of colored noise process is illustrated using a nonlinear aeroelastic oscillator representing a rigid NACA0012 airfoil undergoing limit cycle oscillations due to complex fluid–structure interactions. Several quasi-steady and unsteady aerodynamic models are proposed with colored noise or white noise for the model error. The use of colored noise improves the predictive capabilities of simpler models.

42 ENGINEERING↗

Quantifying local and global mass balance errors in physics-informed neural networks

Physics-informed neural networks (PINN) have recently become attractive for solving partial differential equations (PDEs) that describe physics laws. By including PDE-based loss functions, physics laws such as mass balance are enforced softly in PINN. This paper investigates how mass balance constraints are satisfied when PINN is used to solve the resulting PDEs. We investigate PINN’s ability to solve the 1D saturated groundwater flow equations (diffusion equations) for homogeneous and heterogeneous media and evaluate the local and global mass balance errors. We compare the obtained PINN’s solution and associated mass balance errors against a two-point finite volume numerical method and the corresponding analytical solution. We also evaluate the accuracy of PINN in solving the 1D saturated groundwater flow equation with and without incorporating hydraulic heads as training data. We demonstrate that PINN’s local and global mass balance errors are significant compared to the finite volume approach. Tuning the PINN’s hyperparameters, such as the number of collocation points, training data, hidden layers, nodes, epochs, and learning rate, did not improve the solution accuracy or the mass balance errors compared to the finite volume solution. Mass balance errors could considerably challenge the utility of PINN in applications where ensuring compliance with physical and mathematical properties is crucial.

54 ENVIRONMENTAL SCIENCES↗