Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “error metric”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 451 records · Page 25
All sourcesNASA NTRSDOE OSTI
NASA NTRSDate not supplied

Effect of anisotropic mesh adaptation on surface pressure predictions for atmospheric entry simulations.

Recently, a metric-based mesh adaptation capability has been developed for the advanced compressible flow solver US3D. Metric-based mesh adaptation is a solution informed mesh adaptation strategy that typically improves the resolution of the mesh along anisotropic flow features, like strong shock waves or shear layers. An anisotropic error indicator is reconstructed based on a provided Computational Fluid Dynamics (CFD) solution which prescribes the locally desired element size and orientation. The benefits of this mesh adaptation strategy is twofold: first, it simplifies the manual meshing labor that typically needs to be carried out by the CFD engineer because the mesh adaptation is informed by the provided solution. Second, the computational cost is kept to a minimum while improving the resolution of the simulation. The aim here is to demonstrate how anisotropic mesh adaptation can be employed to improve the predictions of surface pressure for atmospheric entry vehicles. In this work, we compare CFD simulations that use this newly developed anisotropic mesh adaptation capability for US3D with pressure data that was collected by Mars Entry, Descent, and Landing Instrumentation 2 (MEDLI2) during the atmospheric entry phase of Mars2020.

D. Ekelschot↗
NASA NTRS2000

Safety Metrics for Human-Computer Controlled Systems

The rapid growth of computer technology and innovation has played a significant role in the rise of computer automation of human tasks in modem production systems across all industries. Although the rationale for automation has been to eliminate "human error" or to relieve humans from manual repetitive tasks, various computer-related hazards and accidents have emerged as a direct result of increased system complexity attributed to computer automation. The risk assessment techniques utilized for electromechanical systems are not suitable for today's software-intensive systems or complex human-computer controlled systems.This thesis will propose a new systemic model-based framework for analyzing risk in safety-critical systems where both computers and humans are controlling safety-critical functions. A new systems accident model will be developed based upon modem systems theory and human cognitive processes to better characterize system accidents, the role of human operators, and the influence of software in its direct control of significant system functions Better risk assessments will then be achievable through the application of this new framework to complex human-computer controlled systems.

Leveson, Nancy G↗
NASA NTRS2019

Impact of GMI All-Sky Radiance Assimilation in the NASA GEOS Forecast System

The assimilation of cloud- and precipitation-affected ("all-sky") radiances has become an important focus of development at most numerical weather prediction centers. Efforts at the Global Modeling and Assimilation Office (GMAO) have focused on all-sky assimilation of GPM Microwave Imager (GMI) radiances, which became operational in the GEOS real-time production system in July 2018. Implementation of the all-sky capability required several upgrades to the GEOS hybrid 4D-EnVar assimilation infrastructure including the addition of control variables for cloud liquid, cloud ice, rain and snow, enhancements to the radiative transfer model, new hybrid background and observational error models, and modified quality control and bias correction procedures. This talk describes the impact of GMI all-sky radiance assimilation on GEOS analyses and forecasts as determined from examination of various metrics including statistics of background departures and analysis increments, forecast skill scores, and forecast sensitivity observation impact (FSOI) calculations. It is shown that in addition to the hydrometeors themselves, the initial wind, temperature and pressure fields all undergo significant dynamic adjustment in response to the analyzed cloud and precipitation features. Assimilation of GMI radiances leads to improved forecasts of lower tropospheric wind, temperature and humidity, especially in the tropics. The largest forecast improvements occur during the first 48 hours, with diminishing impact thereafter. However, combining GMI all-sky assimilation with improvements to the GEOS model physics as in the recent implementation of the real-time production system, extends these forecast improvements well in to the medium range. FSOI results based on a 24-hr moist global energy norm show that GMI radiances provide nearly uniform beneficial impact throughout the tropics, with more mixed impacts in the subtropics. While the overall impact of GMI is smaller than that of other, much more numerous microwave and hyperspectral infrared radiance types, its impact is among the largest of all radiance types on a per-observation basis.

Gelaro, Ron↗
NASA NTRS2021

Probabilistic Processing of Asynchronous Geiger-Mode Avalanche Photodiode Arrays for Background Rate Measurements

A system-level performance evaluation of Geiger-mode avalanche photodiode (GmAPD) arrays requires accurate measurement and prediction of the background rate of the device due to dark counts and other spurious detection events. Since a GmAPD detector reports only a binary value and timestamp associated with an avalanche event, dark count rates are typically measured by averaging thousands of frames to support a statistically significant measurement. For both synchronous and asynchronous detector, the Poisson distributed background rates are referenced to the time each pixel is armed. Unlike for synchronous GmAPD imagers where all the pixels are armed to an array-wide arm signal, an asynchronous pixel operates independently from its neighboring pixels; requiring the background rates to be calculated using an interarrival histogram. For both types of imagers, the background rate is typically evaluated by fitting an exponential distribution to a fixed window within a measured histogram of time intervals between detection events However, if the statistics of the background rate are insufficient – whether that is due to low population sizes, saturation, or a large dynamic range of population size across the array, the pixel, or array-wide, performance metrics may report results with varying accuracy. This paper reports on an implementation of an algorithm that evaluates GmAPD background rates based on statistical metrics rather than fixed windows. The algorithm functions by determining the appropriate integration window within the interarrival time histogram based on a per-pixel count rate set by a predetermined tolerable measurement error. The implementation of the algorithm allows us to characterize GmAPD arrays with orders of magnitude spread in background rates across the detector using common statistical parameters.

Mumolo, J.↗
DOE OSTI2025

A tweezer array with 6,100 highly coherent atomic qubits

Optical tweezer arrays have transformed atomic and molecular physics, now forming the backbone for a range of leading experiments in quantum computing, simulation and metrology. Typical experiments trap tens to hundreds of atomic qubits and, recently, systems with around 1,000 atoms were realized without defining qubits or demonstrating coherent control. However, scaling to thousands of atomic qubits with long coherence times and low-loss and high-fidelity imaging is an outstanding challenge and critical for progress in quantum science, particularly towards quantum error correction (QEC). Here we experimentally realize an array of optical tweezers trapping more than 6,100 neutral atoms in around 12,000 sites, simultaneously surpassing state-of-the-art performance for several metrics that underpin the success of the platform. Specifically, while scaling to such a large number of atoms, we demonstrate a coherence time of 12.6(1) s, a record for hyperfine qubits in an optical tweezer array. We show room-temperature trapping lifetimes of about 23 min, enabling record-high imaging survival of 99.98952(1)% with an imaging fidelity of more than 99.99%. We present a plan for zone-based quantum computing and demonstrate necessary coherence-preserving qubit transport and pick-up/drop-off operations on large spatial scales, characterized through interleaved randomized benchmarking. Our results, along with recent developments, indicate that universal quantum computing and QEC with thousands to tens of thousands of physical qubits could be a near-term prospect.

atomic and molecular physics↗
DOE OSTI2022

A Summary of Validation Studies for the Integrated TIGER Series Performed on ACORN Plus-up 218468/99

The Integrated TIGER Series (ITS) transport code is a valuable tool for photon-electron transport. A seven-problem validation suite exists to make sure that the ITS transport code works as intended. It is important to ensure that data from benchmark problems is correctly compared to simulated data. Additionally, the validation suite did not previously make use of a consistent quantitative metric for comparing experimental and simulated datasets. To this end, the goal of this long-term project was to expand the validation suite both in problem type and in the quality of the error assessment. To accomplish that, the seven validation problems in the suite were examined for potential drawbacks. When a drawback was identified, the problems were ranked based on severity of the drawback and approachability of a solution. We determined that meaningful improvements could be made to the validation suite by improving the analysis for the Lockwood Albedo problem and by introducing the Ross dataset as an eighth problem to the suite. The Lockwood error analysis has been completed and will be integrated in the future. The Ross data is unfinished, but significant progress has been made towards analysis.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS1978

A demonstration of dual spacecraft tracking conducted with the Viking spacecraft during the approach phase

The potential improvements in navigation capability of dual spacecraft tracking were demonstrated using Viking approach data. Under unfavorable conditions of large plasma noise, low spacecraft declination and large earth-spacecraft distance, the dual spacecraft tracking technique improved the Viking B approach accuracy based on short-arc radio metric data, by a factor of 7, to less than 200 km at Mars orbit insertion minus 3 days. From the results of an analytical expansion and the Viking demonstration with a large intentional error in Mars ephemeris, that dual spacecraft data types are shown to be insensitive to ephemeris error. Results also reveal the potential reduction of tracking time requirements during planet approach.

Chao, C. C.↗
DOE OSTI2021

Meta-uncertainty for particle image velocimetry

Uncertainty quantification for Particle Image Velocimetry (PIV) is critical for comparing experimentally measured flow fields with Computational Fluid Dynamics (CFD) results, and model design and validation. However, PIV features a complex measurement chain with coupled, non-linear error sources, and quantifying the uncertainty is challenging. Multiple assessments show that none of the current methods can reliably measure the actual uncertainty across a wide range of experiments, and estimates can vary. Because the current methods differ in assumptions regarding the measurement process and calculation procedures, it is not clear which method is best to use for an experiment where the error distribution is unknown. To address this issue, we propose a method to estimate an uncertainty method's sensitivity and reliability, termed the Meta-Uncertainty. The novel approach is automated, local, and instantaneous, and based on perturbation of the recorded particle images. We developed an image perturbation scheme based on adding random unmatched particles to the interrogation window pair considering the signal-to-noise (SNR) of the correlation plane. Each uncertainty scheme's response to several trials of random particle addition is used to estimate a reliability metric, defined as the rate of change of the inter-quartile range (IQR) of the uncertainties with increasing levels of particle addition. We also propose applying the meta-uncertainty as a weighting metric to combine uncertainty estimates from individual schemes, based on ideas from the consensus forecasting literature. We use planar and stereo PIV measurements across a range of canonical flows to assess the performance of the uncertainty schemes. Further, a novel method is introduced to assess an uncertainty scheme's performance based on a quantile comparison of the error and uncertainty distributions, generalizing the current method of comparing the RMS of the two distributions. Here, the results show that the combined uncertainty method outperforms the individual methods, and this work establishes the meta-uncertainty as a useful reliability assessment tool for PIV uncertainty quantification.

47 OTHER INSTRUMENTATION↗
DOE OSTI2021

Assessment of Model Hub Height Wind Speed Performance Using DOE Lidar Buoy Data

As the offshore wind industry continues to gain momentum both in the U.S. and globally, reanalysis products remain essential tools for the lifecycle of a wind farm. From project siting and production estimates to determining construction and maintenance windows, reanalysis products play an important role. These regional and global long-term models also serve as inputs to higher resolution models. With such wide-ranging impacts on the offshore wind industry, the need for validation of reanalysis products is strong, particularly at typical turbine hub heights. Pacific Northwest National Laboratory (PNNL) operates two AXYS WindSentinelTM buoys for the U.S. Department of Energy (DOE) in order to collect meteorological and oceanographic data, including hub height wind speed, in areas of interest for offshore wind development. This work uses DOE buoy observations off the coasts of New Jersey and Virginia to evaluate the performance of Modern Era Retrospective Analysis for Research and Applications-2 (MERRA-2), the North American Regional Reanalysis (NARR), the European Center for Medium-Range Weather Forecasts (ECMWF) Reanalysis 5th generation (ERA5), and the National Oceanic and Atmospheric Administration (NOAA) assimilation system Rapid Refresh (RAP). Biases and degrees of correspondence are determined for each reanalysis product in order to provide insights on the performance and uncertainty for long-term wind resource characterization. With the baseline metrics determined, this work proceeds with an investigation into the sources of large deviations between the modeled and observed hub height wind speeds during the East Coast lidar buoy deployments. Consistent sources of reanalysis model error include stably stratified flow conditions, high wind shear, flow parallel to the coastline, and tropical and winter storms. For the near shore New Jersey location, offshore winds (i.e. blowing from land to water) tend to be associated with model overestimation of observed hub height wind speed, while winds parallel to the coastline are correlated with model underestimation of wind speed. Similarly, near the Virginia buoy, during southerly winds (parallel to the coastline) models underestimate the observed wind speed due to coastal upwelling. Reanalysis model wind speeds underestimate the hub height winds with increasing stable atmospheric stratification. Reanalysis model biases are seen when the observed wind speeds approach or exceed typical turbine cut-out speeds (around 20 m s-1). Large model errors during winter and tropical storm events, high wind speed events, and ramp events are often the result of wind speed timing and magnitude offsets. Overall, ERA5 provides the most successful representation of observed offshore hub height wind speeds at the U.S. East Coast buoy locations and is therefore best suited as an input boundary condition for model case studies. ERA5 performs well for a variety of atmospheric phenomena, including storms and sea breezes, however RAP, the next most successful reanalysis model, performs best in capturing the frequency of ramp events.

17 WIND ENERGY↗
NASA NTRS1990

Assessment of proposed fighter agility metrics

This paper presents the results of an analysis of proposed metrics to assess fighter aircraft agility. A novel framework for classifying these metrics is developed and applied. A set of transient metrics intended to quantify the axial and pitch agility of fighter aircraft is evaluated with a high fidelity, nonlinear F-18 simulation. Test techniques and data reduction method are proposed, and sensitivities to pilot introduced errors during flight testing is investigated. Results indicate that the power onset and power loss parameters are promising candidates for quantifying axial agility, while maximum pitch up and pitch down rates are for quantifying pitch agility.

Liefer, Randall K.↗
NASA NTRSDate not supplied

Space-borne Doppler Weather Radar Modeling for Radar Design Evaluation

A model has been developed to predict the reflectivity and Doppler performance of a spaceborne weather radar for atmospheric aerosol and cloud monitoring. The goal is to predict radar sensitivity, resolution, uncertainties and other key performance metrics vs. radar design parameters and hardware nonidealities. Analytical formulas are readily available to predict key performance metrics of a space-borne radar system as a function of design parameters such as antenna size, spacecraft velocity, transmit power, and receive noise figure. Effects of some system nonidealities such as antenna pointing errors, power amplifier nonlinearity and phase noise can be estimated using idealized methods. These analytical formulas use idealized forms of the antenna radiation pattern and weather statistics to predict system performance. However, it is desirable to have a more physical model based on discretized weather volumes in which the particle size distribution, Doppler distribution, and other parameters can be varied to study how the radar hardware design parameters and nonidealities affect the measurement of the weather reflectivity and Doppler characteristics. This would allow the radar designers to have more insight into what is being measured and the hardware parameters and errors that need to be carefully controlled to achieve best radar performance, as well as potential methods to calibrate the system or correct errors. This presentation will demonstrate some proof-of-concept Ka-band simulations where the discretized model agrees with the analytical formulas for a simple case where the elements in the discretized weather volume are defined by a constant reflectivity and simple velocity vectors. In particular, the system sensitivity and Doppler uncertainty are evaluated by analytical formulas as well as the discretized model. Future work will expand on this to include more complex weather scenarios and the addition of system nonidealities.

Sara Tucker↗
DOE OSTI2024

NuQKD: A Modular Quantum Key Distribution Simulation Framework for Engineering Applications

Abstract An experimental Quantum Key Distribution (QKD) implementation requires advanced costly hardware, unavailable in most research environments, making protocol testing and performance evaluation complicated. This has been a major motivation for the development of QKD simulation frameworks, to allow researchers to obtain insight before proceeding into practical implementations. Several simulators have been introduced over the recent years. However, only four are publicly available, only one of which models equipment imperfections. Currently, no open‐source simulator includes all following capabilities: channel attenuation modelling, equipment imperfections and effects on key rates, estimation of elapsed time during classical and quantum‐ channel processes, use of truly random binary sequences for qubits and measurement bases, shared ‐bit fraction customization. In this paper, we present NuQKD, an open‐ source modular, intuitive simulator, featuring all the above capabilities. NuQKD establishes communication between two computer terminals, accepts custom user inputs (iterations, raw key size, attacker interception rate etc.) and evaluates the sifted key, Quantum Bit Error Rate (QBER), elapsed communication time, and more. NuQKD capabilities include optical fiber and free ‐space simulation, modeling of equipment/channel imperfections, bitstrings from True Random Number Generators, decoy‐state protocol support, and automated evaluation of performance metrics. We expect NuQKD to enable convenient and accurate representation of actual experimental conditions.

Gkouliaras, Konstantinos↗
DOE OSTI2022

The Illumination of Thunderclouds by Lightning: 3. Retrieving Optical Source Altitude

Abstract Optical space‐based lightning sensors such as the Geostationary Lightning Mapper (GLM) detect and geolocate lightning by recording rapid changes in cloud top illumination. While lightning locations can be determined to within a pixel on the GLM imaging array, these instruments are not individually able to natively report lightning altitude. It has previously been shown that thunderclouds are illuminated differently based on the altitude of the optical source. In this study, we examine how altitude information can be extracted from the spatial distributions of GLM energy recorded from each optical pulse. We match GLM “groups” with Lightning Mapping Array (LMA) source data that accurately report the 3‐D positions of coincident Radio‐Frequency (RF) emitters. We then use machine learning methods to predict the mean LMA source altitudes matched to GLM groups using metrics from the optical data that describe the amplitude, breadth, and texture of the group spatial energy distribution. The resulting model can predict the LMA mean source altitude from GLM group data with a median absolute error of <1.5 km, which is sufficient to determine the location of the charge layer where the optical energy originated. This model is able to capture changes to the source altitude distribution in response to convective processes in the thunderstorm, and the GLM predictions can reveal the vertical structure of individual flashes ‐ enabling 3‐D flash geolocation with GLM for the first time. Future work will account for differences in thunderstorm charge/precipitation structures and viewing angle across the GLM Field of View.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Machine Learning-Based Process Control for Injection Molding of Recycled Polypropylene

The increased interest in artificial intelligence in manufacturing has driven the adoption of machine learning to optimize processes and improve efficiency. A key challenge in injection molding is the variability of recycled materials, which affects part quality and processing stability. This study presents a novel closed-loop process control approach for injection molding, leveraging machine learning to adaptively predict processing inputs and quality outcomes. The methodology was tested on five blends of recycled polypropylene (rPP), using artificial neural networks (ANNs), linear regression, and polynomial regression to model the relationships between material properties and process parameters. The dataset was split 80/20 into training and testing sets. The ANN model was implemented using TensorFlow and Keras, with six hidden layers of 32 neurons per layer, ReLU activation, and an Adam optimizer. Empirical tuning and early stopping were used to optimize performance and prevent overfitting. Predictions were evaluated based on mean absolute error (MAE), mean squared error (MSE), and percentage error. The results showed that yield stress, ultimate elongation, and part weight were accurately predicted within a 5% error for linear and polynomial regression models and within a 10% error for the ANN. However, modulus predictions were less reliable, with errors of ~11% for ANN and linear regression and ~40% for polynomial regression, reflecting the inherent variability of this property in rPP blends. Predictions of processing inputs had errors ranging from 3% to 25%, depending on the model and response variable. No single modeling approach was consistently superior across all responses, highlighting the complexity of the relationship between material properties, process parameters, and quality metrics. Overall, the work demonstrates that closed-loop process control, powered by machine learning, can effectively predict key quality parameters in injection molding of recycled materials. The proposed approach can improve process stability and material utilization, facilitating increased adoption of sustainable materials.

Krantz, Joshua↗
NASA NTRS2011

Terminal - Tactical Separation Assured Flight Environment (T-TSafe)

The Tactical Separation Assured Flight Environment (TSAFE) has been previously tested as a conflict detection and resolution tool in the en-route phase of flight. Fast time simulations of a terminal version of this tool called Terminal TSAFE (T-TSAFE) have shown promise over the current conflict detection tools. It has shown to have fewer false alerts (as low as 2 per hour) and better prediction to conflict time than Conflict Alert. The tool will be tested in the simulated terminal area of Los Angeles International Airport, in a Human-in-the-loop experiment to identify controller procedures and information requirements. The simulation will include comparisons of T-TSAFE with NASA's version of Conflict Alert. Also, some other variables such as altitude entry by the controller, which improve T-TSAFE's predictions for conflict detection, will be tested. T-TSAFE integrates features of current conflict detection tools such as Automated Terminal Proximity Alert used to alleviate compression errors in the final approach phase. Based on fast-time simulation analysis, the anticipated benefits of T-TSAFE over Conflict Alert include reduced false/missed alerts and increased time to predicted loss of separation. Other metrics that will be used to evaluate the tool's impact on the controller include controller intervention, workload, and situation awareness.

Verma, Savita Arora↗
NASA NTRSDate not supplied

WFIRST CGI: Prism and Polarizer Characterization Modes

As part of its technology demonstration, the WFIRST coronagraph instrument (CGI) will demonstrate point source spectroscopy and polarization measurements of disks. The specific implementation of spectroscopy is a zero-deviation Amici prism and slit to be placed on the planet after high contrast has been achieved by CGI. The polarization optics are a set of Wollaston prisms so that orthogonal polarization states can be measured simultaneously. The CGI spectral characterization mode, being designed and built and Goddard Space Flight Center (GSFC), has a spectral resolution of R50 and is designed to accommodate a 15% bandpass spanning 610-785nm. In order to recover Stokes information, there are two sets of Wollaston prisms clocked 45 degrees with respect to one another with each measurement taken in series. The Wollaston design and optical elements are a contribution by the Japanese Aerospace Exploration Agency, with final alignment and testing being done at GSFC. The spectroscopy mode is designed to target Methane absorption features around 730nm, keeping the spectral resolution as low as possible to improve the signal-to-noise ratio and hence reduce detection time. We highlight the requirements for these modes and address the challenge of on-orbit spectral calibration for a deployable slit in the presence of pointing drifts. Of unique interest is how the observatory error budget couples into good stellar spectrum calibration and subsequent speckle subtraction. We also provide further detail on the optomechanical design, its stability based on thermal and structural predictions, modeled performance, and operations concept. These performance metrics are simulated to demonstrate how a slit located at an arbitrary field point is homed onto the planet and converted to a calibrated spectrum.

Tyler D Groff↗
NASA NTRSDate not supplied

Strategies for Quantifying Human Space Flight Performance in the Crew Health and Performance System

The Crew Health and Performance-Probabilistic Risk Assessment (CHP-PRA) team at NASA Glenn Research Center is planning a customized approach to quantify human spaceflight performance changes with respect to changes to the CHP system functions and capabilities. Using the Directed Acyclic Graphs (DAG) initiated by NASA’s Human Systems Risk Board (HSRB) [1], the team is surveying potential candidate models and novel strategies that generate metrics suitable for supporting decision making related to how the CHP system may influence human system performance risk. One such investigation includes classic Human Reliability Analysis (HRA) models. Traditionally, HRA methods estimate the occurrence of human errors and their impact on the success of an activity when designing and operating a system. While humans perceive, interpret, decide on, and carry out a course of action, the factors affecting performance and error likelihood are commonly referred to as performance shaping factors (PSFs). Originally developed to alleviate safety concerns related to nuclear power plant operations, HRA methods such as THERP [2] and CREAM [3] dismantle an activity into tasks, requiring elemental steps to be executed, and assess their failure due to predefined PSFs. In this study, we compare generic HRA methods and those that incorporate some human spaceflight aspects, such as sleep conditions (SCREAM [4]), with respect to how they may be adopted to capture performance with an intention to mitigate detrimental outcomes elucidated by the HSRB DAGs. We suggest strategies to quantify astronaut performance specific to spaceflight activities and illustrate how such concepts may help in optimizing the CHP system capabilities with respect to Artemis missions.

dag↗
NASA NTRSDate not supplied

Enhanced Simulation Techniques in Predicting Sonic Boom Loudness Using CFD

This paper outlines advancements in predicting sonic boom loudness within the Launch, Ascent, and Vehicle Aerodynamics (LAVA) computational framework. Traditionally, a two step process consisting of a steady state computational fluid dynamics problem for near-field analysis and a far-field propagation solver for calculation of loudness metrics has been used. Improvements to this process made in this work include utilizing a high-order space marching method for mid-field computations, developing a novel output-based mesh adaptation method targeting error in near-field pressure sig-natures, and developing a robust scripting system using curvilinear grids to increase robustness and simplify the process of running large databases of simulation cases. These advancements are detailed and applied to the simulation of the X-59, presenting comparative cost and timing analyses between the prior two step workflow and the current three step procedure. We achieve increased accuracy and robustness for loudness predictions with at least a50%computational cost reduction.

CST↗