SEARCH · Engineering Papers

Results for “accurate quantification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 307 records · Page 17

All sources NASA NTRS DOE OSTI

DOE OSTI2022

Retrieval of the sea spray aerosol mode from submicron particle size distributions and supermicron scattering during LASIC

Abstract. Improved quantification of sea spray aerosol concentration and size is important for determining aerosol effects on clouds and the climate, though attempts to accurately capture the size distribution of the sea spray mode remain limited by the availability of supermicron size distributions. In this work, we introduce a new approach to retrieving lognormal mode fit parameters for a sea spray aerosol mode by combining submicron size distributions with supermicron scattering measurements using a Mie inversion. Submicron size distributions were measured by an ultra-high-sensitivity aerosol spectrometer (UHSAS), and supermicron scattering was taken as the difference between <10 µm and <1 µm three-wavelength integrating nephelometer measurements (NEPH). This UHSAS-NEPH method was applied during background marine periods of the Department of Energy Atmospheric Radiation Measurement Layered Atlantic Smoke Interactions with Clouds (LASIC) campaign on Ascension Island (November 2016–May 2017), when the contribution of sea spray aerosol was expected to represent a large fraction of the aerosol mass and total scattering. Lognormal sea spray modal parameters were retrieved from comparisons between nephelometer measurements and a lookup table of Mie theory-simulated scattering coefficients for low-error solutions that minimized the 0.4–1 µm residual in the UHSAS size distribution. We evaluated the UHSAS-NEPH method with a set of clean marine measurements in the North Atlantic that included supermicron size and chemical measurements, showing that measured supermicron size distributions are needed to constrain the sea spray number concentration but that mass concentration was reasonably characterized using supermicron scattering. For LASIC, the UHSAS-NEPH method retrieved sea spray mode properties for approximately 88 % of the background marine times when the scattering variability and total particle concentration were low (<± 5 Mm−1 and <400 cm−3, respectively), with mass mean diameter ranging from 0.6 to 1.9 µm (1.47 ± 0.17 µm), modal width ranging from 1.1 to 3.97 (2.4±0.3), and mass concentration ranging from 0.18 to 23.0 µg m−3 (8.37. ± 4.1 µg m−3). The measured nephelometer scattering at three wavelengths was found to constrain the mode width marginally at the largest particle sizes in the absence of additional size and chemical measurements for defining parameters for the Mie solutions. Comparing UHSAS-NEPH retrievals to those of a fitting algorithm applied only to the submicron UHSAS number size distribution showed that correlations between retrieved mass concentration and the available mass-based sea spray tracers (coarse scattering, wind speed, and chloride) are low when supermicron measurements are not considered. This work demonstrates the added value of supermicron scattering measurements for retrieving reasonable sea spray mass concentrations, providing the best-available observationally constrained estimate of the sea spray mode properties when supermicron size distribution measurements are not available.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2024

Hierarchical Bayesian modeling for Inverse Uncertainty Quantification of system thermal-hydraulics code using critical flow experimental data

The best estimate plus uncertainty methodology in nuclear system thermal-hydraulic studies necessitates a comprehensive understanding of uncertainties in system code predictions. The forward uncertainty quantification (UQ) process involves the propagation of input uncertainties through the computational models to obtain uncertainties in the outputs. To this end, achieving an accurate estimation of input uncertainties is important, which is the focus of inverse UQ (IUQ). Traditionally, research in Bayesian IUQ within the nuclear engineering domain has largely relied on single-level Bayesian inference. While being effective for relatively small datasets, this approach encounters limitations for cases with large datasets. The use of a single-level model may prove inefficient, as the resultant posterior distributions can significantly differ when distinct subsets of data are employed. To address this issue, we employ an hierarchical Bayesian model for IUQ. Furthermore, this approach involves organizing observations into different groups based on the test conditions, thereby accommodating varying calibration parameters across these distinct groups. In this study, we developed and implemented a hierarchical Bayesian IUQ method to consider the grouping effect of critical flow measurement data from various geometries. Comparing the outcomes of IUQ under different selections of test data using hierarchical Bayesian IUQ against those obtained from single-level Bayesian IUQ, the forward propagation of hierarchical Bayesian IUQ results demonstrates a notably improved agreement with the experimental data.

42 ENGINEERING↗

NASA NTRS1990

A quantification of errors in surface albedo due to common assumptions

A study comparing the performance of three approaches to estimating the spectral albedo of a typical land surface is presented. The most accurate albedo estimates under all atmospheric situations are those for which the scattering properties of the atmosphere can be used. Simply utilizing the direct-to-total ratio as a weight between direct and Lambertian albedos reduced the errors in broadband albedo to less than one percent for almost all simulated atmospheric conditions.

Arduini, Robert F.↗

NASA NTRSDate not supplied

Development Strategies for Uncertainty Quantification to Enable Aircraft Certification by Analysis

Aircraft Certification by Analysis (CbA) is a broad term that describes the process by which engineering analysis tools are used to supplement flight testing to demonstrate compliance with regulatory requirements. For each requirement that is to be met through this process, the analysis tools must be sufficiently accurate to ensure that an equivalent level of safety is obtained as if the aircraft to be certified had been flight tested for the requirement. In recent decades, the ability of analysis tools to accurately predict aircraft performance has improved dramatically, leading to increasing interest and limited early adoption of Certification by Analysis across the aerospace industry. However, rigorously demonstrating the credibility of analysis tools remains a challenge for many types of certification requirements, yet is necessary for widespread adoption of CbA approaches in the future. The field of uncertainty quantification is well-suited to address this problem, but will require substantial advances in order to achieve the ambitious industry goals for Certification by Analysis. The objective of this position paper is to highlight gaps in the current technical and programmatic state of uncertainty quantification. Four main categories – Mindset & Awareness, Tools & Capabilities, Data and Benchmarks for V&V, and Applied Research & Established Processes – will be introduced. Each of these categories contains several shortcomings and impediments which, if overcome, will enable more widespread possibilities for Certification by Analysis in the 2040-2050 timeframe.

Uncertainty Quantification↗

DOE OSTI2025

An Optothermal Raman Model Accounting for Convection, Radiation, and Substrate Effects for Evaluation of the Thermal Conductivity of Two‐Dimensional Coatings

Thermal conductivity of two‐dimensional (2D) materials is important to characterize as this will govern thermal transport physics in the various thermal and energy applications benefitting from the unique properties of these materials. Here, analytical and numerical techniques are presented to determine the thermal conductivity and interfacial conductance of a 2D material coating using confocal micro‐Raman spectroscopy as a noncontact diagnostic. While several methods have been proposed for calculating the values of thermal conductivity, interfacial conductance, and spatial temperature profile, these models often do not consider effects of radiation, convection, and substrate resistance on the temperature and heat flux profiles. We present a model to calculate the thermal conductivity and interfacial conductance which accounts for convection, radiation, and substrate effects to characterize a variety of 2D material coatings, which is demonstrated using large area graphene transferred onto copper and nickel substrates. Convection and radiation effects are found to have a negligible effect on the temperature profile of supported coatings, while the substrate effects have a considerable effect and therefore impact the quantification of thermal conductivity and interfacial conductance in addition to limiting the spatial resolution of the technique. These findings will allow for more accurate and reproducible extraction of the thermal conductivity of graphene and other 2D material coatings when employing noncontact optothermal Raman spectroscopy methods.

2D coatings↗

DOE OSTI2025

Model-free estimation of completeness, uncertainties, and outliers in atomistic machine learning using information theory

Abstract An accurate description of information is relevant for a range of problems in atomistic machine learning (ML), such as crafting training sets, performing uncertainty quantification (UQ), or extracting physical insights from large datasets. However, atomistic ML often relies on unsupervised learning or model predictions to analyze information contents from simulation or training data. Here, we introduce a theoretical framework that provides a rigorous, model-free tool to quantify information contents in atomistic simulations. We demonstrate that the information entropy of a distribution of atom-centered environments explains known heuristics in ML potential developments, from training set sizes to dataset optimality. Using this tool, we propose a model-free UQ method that reliably predicts epistemic uncertainty and detects out-of-distribution samples, including rare events in systems such as nucleation. This method provides a general tool for data-driven atomistic modeling and combines efforts in ML, simulations, and physical explainability.

36 MATERIALS SCIENCE↗

DOE OSTI2025

Electronic structure prediction of medium and high entropy alloys across composition space

We propose machine learning (ML) models to predict the electron density — the fundamental unknown of a material’s ground state — across the composition space of concentrated alloys. From this, other physical properties can be inferred, enabling accelerated exploration. A significant challenge is that the number of descriptors and sampled compositions required for accurate prediction grows rapidly with species. To address this, we employ Bayesian Active Learning (AL), which minimizes training data requirements by leveraging uncertainty quantification capabilities of Bayesian Neural Networks. Compared to the strategic tessellation of the composition space, Bayesian-AL reduces the number of training data points by a factor of 2.5 for ternary (SiGeSn) and 1.7 for quaternary (CrFeCoNi) systems. We also introduce easy-to-optimize, body-attached-frame descriptors, which respect physical symmetries while keeping descriptor-vector size nearly constant as alloy complexity increases. Our ML models demonstrate high accuracy and generalizability in predicting both electron density and energy across composition space.

materials science↗

DOE OSTI2021

Free-moving Quantitative Gamma-ray Imaging

The ability to map and estimate the activity of radiological source distributions in unknown three-dimensional environments has applications in the prevention and response to radiological accidents or threats as well as the enforcement and verification of international nuclear non-proliferation agreements. Such a capability requires well-characterized detector response functions, accurate time-dependent detector position and orientation data, a digitized representation of the surrounding 3D environment, and appropriate image reconstruction and uncertainty quantification methods. We have previously demonstrated 3D mapping of gamma-ray emitters with free-moving detector systems on a relative intensity scale using a technique called Scene Data Fusion (SDF). Here we characterize the detector response of a multi-element gamma-ray imaging system using experimentally benchmarked Monte Carlo simulations and perform 3D mapping on an absolute intensity scale. We present experimental reconstruction results from hand-carried and airborne measurements with point-like and distributed sources in known configurations, demonstrating quantitative SDF in complex 3D environments.

47 OTHER INSTRUMENTATION↗

DOE OSTI2023

Comparison of methods to estimate aerosol effective radiative forcings in climate models

Abstract. Uncertainty in the effective radiative forcing (ERF) of climate primarily arises from the unknown contribution of aerosols, which impact radiative fluxes directly and through modifying cloud properties. Climate model simulations with fixed sea surface temperatures but perturbed atmospheric aerosol loadings allow for an estimate of how strongly the planet's radiative energy budget has been perturbed by the increase in aerosols since pre-industrial times. The approximate partial radiative perturbation (APRP) technique further decomposes the contributions to the direct forcing due to aerosol scattering and absorption and to the indirect forcing due to aerosol-induced changes in cloud scattering, amount, and absorption, as well as the effects of aerosols on surface albedo. Here we evaluate previously published APRP-derived estimates of aerosol effective radiative forcings from these simulations conducted in the sixth phase of the Coupled Model Intercomparison Project (CMIP6) and find that they are biased as a result of two large coding errors that – in most cases – fortuitously compensate. The most notable exception is the direct radiative forcing from absorbing aerosols, which is more than 40 % larger averaged across CMIP6 models in the present study. Correcting these biases eliminates the residuals and leads to better agreement with benchmark estimates derived from double calls to the radiation code. The APRP method – when properly implemented – remains a highly accurate and efficient technique for diagnosing aerosol ERF in cases where double radiation calls are not available, and in all cases it provides quantification of the individual contributors to the ERF that are highly useful but not otherwise available.

58 GEOSCIENCES↗

DOE OSTI2025

Huge ensembles – Part 2: Properties of a huge ensemble of hindcasts generated with spherical Fourier neural operators

Abstract. In Part 1, we created an ensemble based on spherical Fourier neural operators. As initial condition perturbations, we used bred vectors, and as model perturbations, we used multiple checkpoints trained independently from scratch. Based on diagnostics that assess the ensemble's physical fidelity, our ensemble has comparable performance to operational weather forecasting systems. However, it requires orders-of-magnitude fewer computational resources. Here in Part 2, we generate a huge ensemble (HENS), with 7424 members initialized each day of summer 2023. We enumerate the technical requirements for running huge ensembles at this scale. HENS precisely samples the tails of the forecast distribution and presents a detailed sampling of internal variability. HENS has two primary applications: (1) as a large dataset with which to study the statistics and drivers of extreme weather and (2) as a weather forecasting system. For extreme climate statistics, HENS samples events 4σ away from the ensemble mean. At each grid cell, HENS increases the skill of the most accurate ensemble member and enhances coverage of possible future trajectories. As a weather forecasting model, HENS issues extreme weather forecasts with better uncertainty quantification. It also reduces the probability of outlier events, in which the verification value lies outside the ensemble forecast distribution.

Mahesh, Ankur↗

DOE OSTI2025

What Is the Limit of Quantification for the Minor Phase in Time-of-Flight Neutron Diffraction? A Case Study on Fe and Ni Powder Mixtures at VULCAN

A phase present in small quantities within materials may not simply serve as a secondary component; it can play a crucial role in determining the integrity, properties, and performance of the material. These minor but important phases usually draw attention in material design and processing for fundamental understanding as well as material quality control. Accurately quantifying a minor phase amid a majority phase, especially at extremely low fractions, remains a challenging task. Time-of-flight neutron diffraction, coupled with advanced pattern analysis techniques like Rietveld refinement, is a powerful tool for crystal structure identification and phase quantification. The deep penetrating capability of neutrons enables the detection and quantification of trace phases within materials. In this study, the quantification limits of time-of-flight neutron diffraction were explored using the VULCAN diffractometer at the Spallation Neutron Source, using Fe–Ni powder mixtures as a sample system. By comparing the refinement results to the known weighed values, it was determined that the reliable quantification of a minor Ni phase is achievable down to about 0.1 wt% while a Ni fraction as low as 0.02 wt% is difficult to trace. Effective control of the refinement parameters, especially the profile function parameters, are found to significantly influence the convergence of fittings and the accuracy of phase quantification.

Rietveld refinement↗

DOE OSTI2024

Accurate field-level weak lensing inference for precision cosmology

We present miko, a catalog-to-cosmology pipeline for general flat-sky field-level inference, which provides access to cosmological information beyond the two-point statistics. In the context of weak lensing, we identify several new field-level analysis systematics (such as aliasing, Fourier mode-coupling, and density-induced shape noise), quantify their impact on cosmological constraints, and correct the biases to a percent level. Next, we find that model misspecification can lead to both absolute bias and incorrect uncertainty quantification for the inferred cosmological parameters in realistic simulations. The Gaussian map prior infers unbiased cosmological parameters, regardless of the true data distribution, but it yields overconfident uncertainties. The log-normal map prior quantifies the uncertainties accurately, although it requires careful calibration of the shift parameters for unbiased cosmological parameters. Here, we demonstrate systematics control down to the 2% level for both models, making them suitable for ongoing weak lensing surveys.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

DOE OSTI2020

A computationally-efficient method for flamelet calculations

A new open-source code for the simulation of the diffusion flamelet equations is proposed. Emphasis is placed on using an approximate Jacobian to reduce the computational cost of the matrix operations. Performance of the proposed solvers is tested by performing flamelet calculations with kinetic mechanisms of varying sizes. For the unity Lewis number equations, the present iterative Newton solver using an approximate Jacobian greatly outperforms direct Newton solvers using exact Jacobians. The computation cost scales linearly with the number of species, leading to a reduction in solution times by two orders of magnitude for mechanisms containing thousands of species. The applicability of the Jacobian approximations to the solution of the non-unity Lewis number flamelet equations is assessed. The approximations are generally inadequate to solve the full non-unity Lewis number equations but can be used in some applications depending on the balance of terms in the flamelet equations. As an example, the flamelet solver is applied to the study of sooting tendencies in laminar co-flow diffusion flames where modified non-unity Lewis number flamelet equations, previously shown to accurately reproduce experimentally-measured Yield Sooting Indices (YSI), are solved. Here, the accelerated flamelet solver is well suited for sensitivity analysis and uncertainty quantification with large detailed kinetic mechanisms, tasks for which the computational cost was previously prohibitive.

42 ENGINEERING↗

DOE OSTI2025

Assessing the numerical stability of physics models to equilibrium variation through database comparisons on DIII-D

High fidelity kinetic equilibria are crucial for tokamak modeling and analysis. Manual workflows for constructing kinetic equilibria are time consuming and subject to user error, motivating development of automated equilibrium reconstruction tools to provide accurate and consistent reconstructions for downstream physics analysis. These automated tools also provide access to kinetic equilibria at large database scales, which enables the quantification of general uncertainties arising from equilibrium reconstruction techniques. In this paper, we compare a large database of DIII-D kinetic equilibria generated manually by physics experts to equilibria from automated kinetic reconstruction tools, assessing the impact of reconstruction method on equilibrium parameters and resulting magnetohydrodynamic stability calculations. We find agreement among scalar parameters, whereas profile quantities, such as the bootstrap current, show larger disagreements. We analyze ideal kink and classical tearing stability with DCON and STRIDE respectively, finding that the kink stability calculation is generally more robust than the tearing index Δ' calculation. We find that in 90% of cases, both kink stability classifications are unchanged between the manual expert and automated kinetic equilibria.

CAKE↗

NASA NTRS2022

MLtool: Universal Supervised Machine Learning Tool to Model Tabulated Data

Machine Learning (ML) is a subfield of Artificial Intelligence that gives computers the ability to learn from past data without being explicitly programmed. The predictive capabilities of ML models have already been used to facilitate several scientific breakthroughs. However, the practical application of ML is often limited due to the gaps in technical knowledge of its users. The common issue faced by many scientific researchers is the inability to choose the appropriate ML pipelines that are needed to treat real-world data, which is often sparse and noisy. To solve this problem, we have developed an automated Machine Learning tool (MLtool) that includes a set of ML algorithms and approaches to aid scientific researchers. The current version of MLtool is implemented as an object-oriented Python code that is easily extensible. It includes 44 different regression algorithms used to model data. MLtool helps users select the best model for their data, based on the scoring metrics used. Besides regression algorithms, MLtool also includes a suite of pre- and post-processing techniques such as missing value imputation, categorical variable encoding, input feature normalization, uncertainty quantification, exploratory data analysis (EDA), etc. MLtool was tested on several publicly available multi-dimensional data sets and was found capable of making accurate predictions.

Machine learning↗

NASA NTRS2022

How Well do Multisatellite Products Capture the Space-Time Dynamics of Precipitation? Part II: Building an Error Model Through Spectral System Identification

Satellite precipitation products, as all quantitative estimates, come with some inherent degree of uncertainty. To associate a quantitative value of the uncertainty to each individual estimate, error modeling is necessary. Most of the error models proposed so far compute the uncertainty as a function of precipitation intensity only, and only at one specific spatio-temporal scale. We propose a spectral error model which accounts for the neighboring space-time dynamics of precipitation into the uncertainty quantification. Systematic distortions of the precipitation signal and random errors are characterized distinctively in every frequency-wavenumber band in the Fourier domain, to accurately characterize error across scales. The systematic distortions are represented as a deterministic space-time linear filtering term. The random errors are represented as a non-stationary additive noise. The spectral error model is applied to the IMERG multi satellite precipitation product and its parameters are estimated empirically through a system identification approach using the GV-MRMS gauge-radar measurements as reference (“truth”) over the eastern United States. The filtering term is found to be essentially low-pass. While traditional error models attribute most of the error variance to random errors, it is found here that the systematic filtering term explains 48% of the error variance at the native resolution of IMERG. This fact confirms that, at high resolution, filtering effects in satellite precipitation products cannot be ignored, and that the error cannot be represented as a purely random additive or multiplicative term. An important consequence is that precipitation estimates derived from totally different sources shall not be expected to automatically have statistically independent errors.

Precipitation↗

NASA NTRSDate not supplied

CFD Validation Study of a Hypersonic Cone-Slice-Flap Variable Geometry Configuration

Model validation is the process of determining the degree of accuracy between physical reality and the model. The result of model validation can either be used to improve the model through calibration or quantify the model-form uncertainty. This work focuses on providing the model-form uncertainty through an area metric for a hypersonic cone-slice-flap variable geometry configuration given uncertainty in both the simulation and experimental data. The research here compares two different turbulence models for the simulations. For a variable geometry, performing uncertainty quantification to capture the model-form uncertainty on every configuration is computationally challenging. This work lays out a procedure that can give an accurate representation of the model-form uncertainty using a small number of high-fidelity runs and many low-fidelity runs on multiple configurations. Running this comparison provides a quantifiable measurement for the accuracy of each turbulence model for this type of design. The high-fidelity CFD solver used was VULCAN-CFD and the low-fidelity results came from Cart3D. The experimental data came from the 20-Inch Mach 6 Tunnel located at NASA Langley Research Center. The present work showed that the using both the Spalart and Allamaras and Menter Shear-Stress Transport turbulence models overpredicted the drag and lift coefficient, while underpredicting the pitching moment coefficient. The model-form uncertainty estimate resulted in up to a 13.6% change in the total uncertainty for the drag coefficient, up to a 57.4% change in total uncertainty for the lift coefficient, and up to a 100% change in total uncertainty for the pitching moment coefficient.

Laura M. White↗

NASA NTRS2022

MLtool Python Code

Machine Learning↗