SEARCH · Engineering Papers

Results for “Performance benchmark”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14

All sources NASA NTRS DOE OSTI

DOE OSTI2025

Exxon Mobil-NETL Testing of DAC Materials

This joint initiative is aimed at extending our understanding of real DAC testing conditions at the NETL DAC testbed facility. Of particular focus will be: • Small Scale testing of powdered and formulated materials (supplied by ExxonMobil) to evaluate various performance metrics under DAC process cycles • Pilot scale testing of formulated materials at larger scales ExxonMobil will work with NETL to shake down equipment, validate testing methods, and define best practices for data analysis. Three tasks are proposed: 1. Validation of multi-cycle test data on powdered and formulated materials to benchmark various performance metrics of these materials. 2. Steam regeneration of powdered samples at small scale to define baseline performance under commercially relevant conditions. 3. Pilot scale testing of larger formulated materials to test commercially relevant samples under actual process cycles.

36 MATERIALS SCIENCE↗

NASA NTRS2004

Integrated Modeling Activities for the James Webb Space Telescope: Structural-Thermal-Optical Analysis

The James Web Space Telescope (JWST) is a large, infrared-optimized space telescope scheduled for launch in 2011. This is a continuation of a series of papers on modeling activities for JWST. The structural-thermal-optical, often referred to as STOP, analysis process is used to predict the effect of thermal distortion on optical performance. The benchmark STOP analysis for JWST assesses the effect of an observatory slew on wavefront error. Temperatures predicted using geometric and thermal math models are mapped to a structural finite element model in order to predict thermally induced deformations. Motions and deformations at optical surfaces are then input to optical models, and optical performance is predicted using either an optical ray trace or a linear optical analysis tool. In addition to baseline performance predictions, a process for performing sensitivity studies to assess modeling uncertainties is described.

Johnston, John D.↗

NASA NTRS1983

Evaluation of the synoptic and mesoscale predictive capabilities of a mesoscale atmospheric simulation system

The overall performance characteristics of a limited area, hydrostatic, fine (52 km) mesh, primitive equation, numerical weather prediction model are determined in anticipation of satellite data assimilations with the model. The synoptic and mesoscale predictive capabilities of version 2.0 of this model, the Mesoscale Atmospheric Simulation System (MASS 2.0), were evaluated. The two part study is based on a sample of approximately thirty 12h and 24h forecasts of atmospheric flow patterns during spring and early summer. The synoptic scale evaluation results benchmark the performance of MASS 2.0 against that of an operational, synoptic scale weather prediction model, the Limited area Fine Mesh (LFM). The large sample allows for the calculation of statistically significant measures of forecast accuracy and the determination of systematic model errors. The synoptic scale benchmark is required before unsmoothed mesoscale forecast fields can be seriously considered.

Koch, S. E.↗

DOE OSTI2020

Validation of Continuous-Energy ENDF/B-VIII.0 16 O, 56 Fe, and 63,65 Cu Cross Sections for Nuclear Criticality Safety Applications

Recently completed cross-section evaluations sponsored in part by the Nuclear Criticality Safety Program were incorporated into the 2018 release of the ENDF/B-VIII.0 cross-section library. Evaluated isotopes of interest to the nuclear data and criticality safety community include 16 O, 56 Fe, and 63,65 Cu. For performance validation, benchmark models defined in the International Criticality Safety Benchmark Evaluation Project Handbook were selected based on energy-integrated k eff sensitivities to total cross sections of interest and compared with experimental values. Of the 102 benchmark configurations that were utilized, 63 are sensitive to 16 O, 32 sensitive to 63,65 Cu, and 25 sensitive to 56 Fe. Selected benchmarks were modeled in SCALE 6.2.3 Criticality Safety Analysis Sequence (CSAS) continuous-energy Monte Carlo k eff calculations with ENDF/B-VII.1, with a hybrid ENDF/B-VII.1 with ENDF/B-VIII.0 data substituted for individual isotopes of interest, and with ENDF/B-VIII.0. ENDF/B-VIII.0 showed improved agreement with experimental k eff for 56 Fe, 63 Cu, elemental copper, and full library substitution while producing lessened agreement for 16 O and 65 Cu. Furthermore, with full library and isotope-specific ENDF/B-VIII.0 performance, a best-case ENDF library was formed by excluding underperforming isotopes’ ENDF/B-VIII.0 data, reverting 16 O and 65 Cu cross sections to ENDF/B-VII.1. This resulted in the average relative deviation between calculated and experimental data improving from 1.45σ for the ENDF/B-VIII.0 library to 1.32σ for the best-case library, relative to benchmark uncertainty.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2026

Informing Robust Functional Relationship Benchmarks: An Evaluation of the Temperature Sensitivity of Ecosystem Respiration Across the Arctic-Boreal Region

During land model development, simulated carbon dynamics are often benchmarked against observational data sets to evaluate model performance. Functional relationship benchmarks are the relationship between a driving variable (e.g., temperature) and a response variable (e.g., ecosystem respiration) and are a promising tool for assessing model performance by evaluating modeled sensitivities to changing environmental conditions. However, observed functional relationships can be influenced by choices made during data collection and throughout the benchmarking process, impacting the inferred skill of land models. To avoid misrepresenting a model's true performance, it is necessary to systematically evaluate best practices when constructing functional relationship benchmarks. We developed a set of guidelines for constructing functional relationship benchmarks, considering the choice of data set, number of daily observations, temporal extent, and temporal resolution across Alaska and Canada over a 20-year period from 2001 to 2020. The temperature sensitivity of ecosystem respiration from observations, evaluated through an apparent Q 10 , is highly variable both spatially and as a result of the data processing approach applied in the benchmark formation. When benchmarking 13 models from the Warming Permafrost Model Intercomparison Project (WrPMIP), the range in inferred model skill is substantially impacted by the choices applied in constructing functional relationship benchmarks. The inferred performance of a given model is most sensitive to the number of daily observations and temporal extent, followed by choice of benchmark data set and temporal averaging. Results from this analysis can guide the development of consistent and robust functional relationships for future model evaluation studies.

Poe, Jeralyn [Northern Arizona University, Flagsta↗

DOE OSTI2021

Cladding Profilometry Analysis of Experimental Breeder Reactor-II Metallic Fuel Pins with HT9, D9, and SS316 Cladding

BISON finite element method fuel performance simulations were conducted using an existing automated process that couples the Fuels Irradiation & Physics Database (FIPD) and the Integral Fast Reactor Materials Information System database by writing input files and comparing the BISON output to post-irradiation fuel pin profilometry measurements contained within the databases. The importance of this work is to demonstrate the ability to benchmark fuel performance metallic fuel models within BISON using Experimental Breeder Reactor-II fuel pin data for a number of similar pins, while building off previous modeling efforts. Changes to the generic BISON input file include implementing pin specific axial power and flux profiles, pin specific fluences, frictional contact, and irradiation-induced volumetric swelling models for cladding. A statistical analysis of irradiation-induced volumetric swelling models for HT9, D9, and SS316 was performed for experiments X421/X421A, X441/X441A, and X486. Between these three experiments, there were 174 post-irradiation examination (PIE) profilometries used for validating the swelling models presented using a standard error of the estimate (SEE) method. Implementation of the volumetric swelling models for D9 and SS316 claddings was found to have a significant impact on the BISON profilometry simulated, where HT9 clad pins had an insignificant change due to low fluence values. BISON profilometry simulated for HT9, D9, and SS316 fuel pins agreed with PIE profilometry measurements, with assembly SEE values being 4.4 × 10−3 for X421A, 2.0 × 10−3 for X441A, and 2.8 × 10−3 for X486. D9 clad pins in X421/X421A had the highest SEE values, which is due to the BISON simulated profilometry being shifted axially. While this work accomplished its purpose to demonstrate the modeling of multiple fuel pins from the databases to help validate models, the results suggest that the continued development of metallic fuel models is necessary for qualifying new metallic fuel systems to better capture some physical performance phenomena, such as the hot pressing of U-Pu-Zr and the fuel cladding chemical interaction.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

DOE OSTI2022

The parameter-level performance of covariance matrix conditioning in cosmic microwave background data analyses

Empirical estimates of the band power covariance matrix are commonly used in cosmic microwave background (CMB) power spectrum analyses. While this approach easily captures correlations in the data, noise in the resulting covariance estimate can systematically bias the parameter fitting. Conditioning the estimated covariance matrix, by applying prior information on the shape of the eigenvectors, can reduce these biases and ensure the recovery of robust parameter constraints. In this work, we use simulations to benchmark the performance of four different conditioning schemes, motivated by contemporary CMB analyses. The simulated surveys measure the TT, TE, and EE power spectra over the angular multipole range 300 ≤ ℓ ≤ 3500 in Δℓ = 50 wide bins, for temperature map-noise levels of 10, 6.4, and $2\, \mu$K arcmin. We divide the survey data into N real = 30, 50, or 100 uniform subsets. We show the results of different conditioning schemes on the errors in the covariance estimate, and how these uncertainties on the covariance matrix propagate to the best-fitting parameters and parameter uncertainties. The most significant effect we find is an additional scatter in the best-fitting point, beyond what is expected from the data likelihood. For a minimal conditioning strategy, N real = 30, and a temperature map-noise level of 10$\, \mu$K arcmin, we find the uncertainty on the recovered best-fitting parameter to be ×1.3 larger than the apparent posterior width from the likelihood (×1.2 larger than the uncertainty when the true covariance is used). Stronger priors on the covariance matrix reduce the misestimation of parameter uncertainties to $\lt 1{{\ \rm per\ cent}}$. As expected, empirical estimates perform better with higher N real , ameliorating the adverse effects on parameter constraints.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2025

Uncertainty-Guided Prediction Horizon of Phase-Resolved Ocean Wave Forecasting Under Data Sparsity: Experimental and Numerical Evaluation

Accurate short-term wave forecasting is critical for the safe and efficient operation of marine structures that rely on real-time, phase-resolved ocean wave information for control and monitoring purposes (e.g., digital twins). These systems often depend on environmental sensors (e.g., waverider buoys, wave-sensing LIDAR). Challenges arise when upstream sensor data are missing, sparse, or phase-shifted due to drift. This study investigates the performance of two machine learning models, time-series dense encoder (TiDE) and long short-term memory (LSTM), for forecasting phase-resolved ocean surface elevations under varying degrees of data degradation. We introduce the τ-trimming algorithm, which adapts the prediction horizon based on uncertainty thresholds derived from historical forecasts. Numerical wave tank (NWT) and wave basin experiments are used to benchmark model performance under short- and long-term data masking, spatially coarse sensor grids, and upstream phase shifts. Results show under a 50% probability of upstream data loss, the τ-trimmed TiDE model achieves a 46% reduction in error at the most upstream target, compared to 22% for LSTM. Furthermore, phase misalignment in upstream data introduces a near-linear increase in forecast error. Under moderate model settings, a ±3 s misalignment increases the mean absolute error by approximately 0.5 m, while the same error is accumulated at ±4 s using the more conservative approach. These findings inform the design of resilient, uncertainty-aware wave forecasting systems suited for realistic offshore sensing environments.

42 ENGINEERING↗

DOE OSTI2022

Simulation, Challenge Testing and Validation of Solutions for Residential and Commercial Occupancy Sensing/Counting and CO2 Sensing (Final Report)

Carbon dioxide sensors used for monitoring and control applications in buildings are known to be sensitive to long term drift and can be affected by variations in temperature, humidity, other gas interferents, pressure and other factors that cannot be corrected through the typical auto-calibration methods often embedded in the sensor electronics. This investigation was part of the Category D defined in the ARPA-E Saving Energy Nationwide in Structures With Occupancy Recognition (SENSOR) Financial Assistance Funding Opportunity Announcement No. DE-FOA-0001737, FFDA No. 81.135, January 18, 2017. The FOA defined target criteria for the evaluation of the Category C commercial CO2 sensors selected for review and development through the ARPA-E SENSOR program and charged the Iowa State Category D team with developing an evaluation methodology for Category C sensors in accordance with these criteria. As part of the work, the Iowa State team chose to engage the standards community in the development of the evaluation methodology. Standard development work in the D22.05 Indoor Air and D22.03 Ambient Atmospheres and Source Emissions subcommittees of ASTM International Committee D22 on Air Quality on the evaluation of low cost sensors and provision of guidance for using indoor carbon dioxide concentrations to evaluate indoor air quality and ventilation is of particular relevance to the Category D efforts. To date, three draft standards with specific input by the Iowa State Category D team have passed the subcommittee balloting stage and are being balloted in December 2022 and January 2023 in the main D22 committee. In addition to the aforementioned standards to which the PI was a contributing author, intellectual property developed in this project pertaining to “An Automated System for Evaluation of the Long Term Performance of Carbon Dioxide Sensors” and “An Automated Ground Truth System for Real-Time Reliability Assessment, Capture of Control Decisions and Energy Savings Measurements for Occupancy Recognition Systems and Other Applications” are the other major deliverables of the project. These standards and the developed intellectual property are expected to benefit the public in a number of ways stemming from their provision of means to benchmark the performance of carbon dioxide and other sensor systems. In particular, there is high interest in techniques to demonstrate the performance of low-cost carbon dioxide sensors which can be used for typical HVAC applications (e.g., demand controlled ventilation, outdoor and indoor air monitoring, estimation of occupancy, etc.).

42 ENGINEERING↗

DOE OSTI2024

Visualization of post-detonation fireball flowfields and comparison to CFD modeling

Visualization of flow structures within post-detonation fireballs has been performed for benchmark validation of numerical simulations. Custom pressed PETN explosives with a 12-mm diameter hemispherical form factor were used to produce a spherically symmetric post-detonation flow with low soot yield. Hydroxyl-radical planar laser induce fluorescence (OH-PLIF) was employed to visualize the structure ranging from approximately 10 μs to 35 μs after shock breakout from the explosive pellet. Fireball simulations were performed using the HyBurn Computational Fluid Dynamics (CFD) package. Experimental OH-PLIF results were compared to synthetic OH-PLIF from post-processing of CFD simulations. From the comparison of experimental and synthetic OH-PLIF images, CFD is shown to replicate much of the flow structure observed in the experiments, revealing potential differences in turbulent length scales and OH kinetics. Furthermore, results provide significant advancement in experimental resolution of these harsh turbulent combustion environments and validate physical models thereof.

Detonator↗

DOE OSTI2021

Performance of three-dimensional printed nasopharyngeal swabs for COVID-19 testing

At the start of the COVID-19 pandemic, the US faced nationwide shortages of nasopharyngeal swabs due to both overwhelmed supply chains and an increase in demand. To address this shortfall, multiple 3D printed swabs were ultimately produced and sold for COVID-19 testing. In this work, we present a framework for mechanical and functional bench-testing of nasopharyngeal swabs using standard and widely available material testing equipment. Using this framework, we offer a comprehensive, quantitative comparison of the 3D printed swabs to benchmark their performance against traditional flocked swabs. The test protocols were designed to emulate the clinical use of the nasopharyngeal swabs and to evaluate potential failure modes. Overall, the 3D printed swabs performed comparably to, or outperformed, the traditional swabs in all mechanical tests. While traditional swabs outperformed some of the new 3D printed swabs in terms of sample uptake and retention, similar amounts of RNA were recovered from both 3D printed and traditional swabs.

3D printing↗

DOE OSTI2025

Ansatz-Free Hamiltonian Learning with Heisenberg-Limited Scaling

Learning the unknown interactions that govern a quantum system is crucial for quantum information processing, device benchmarking, and quantum sensing. The problem, known as Hamiltonian learning, is well understood under the assumption that interactions are local, but this assumption may not hold for arbitrary Hamiltonians. Previous methods all require high-order inverse polynomial dependency with precision, unable to surpass the standard quantum limit and reach the gold-standard Heisenberg-limited scaling. Whether Heisenberg-limited Hamiltonian learning is possible without prior assumptions about the interaction structures, a challenge we term ansatz-free Hamiltonian learning , remains an open question. In this work, we present a quantum algorithm to learn arbitrary sparse Hamiltonians without any structure constraints using only black-box queries of the system’s real-time evolution and minimal digital controls to attain Heisenberg-limited scaling in estimation error. Our method is also resilient to state-preparation-and-measurement errors, enhancing its practical feasibility. We numerically demonstrate our ansatz-free protocol for learning physical Hamiltonians and validating analog quantum simulations, benchmarking our performance against the state-of-the-art Heisenberg-limited learning approach. Moreover, we establish a fundamental trade-off between total evolution time and quantum control on learning arbitrary interactions, revealing the intrinsic interplay between controllability and total evolution-time complexity for any learning algorithm. These results pave the way for further exploration into Heisenberg-limited Hamiltonian learning in complex quantum systems under minimal assumptions, potentially enabling new benchmarking and verification protocols.

machine learning↗

NASA NTRSDate not supplied

Hot Water, Cold Reality: Experimental Analysis of Sorption Constraints in Iodine Filtration Media Under Heated-Water Conditions

Iodine has been widely employed as a residual biocide in potable water applications during crewed missions. Unlike other biocides, it is essential to remove iodine from drinking water prior to consumption, as its biocidal concentration raises health concerns. Consequently, effectively removing iodine species from water is a critical step in potable water processing. Although the non-biocided heated leg has not violated microbial specifications on the International Space Station, any wetted volume lacking biocide presents potential risks for long‑duration exploration missions and for systems that are sensitive to microbial growth/contamination. Recent assessments indicate, however, that iodine‑removal performance may degrade under elevated temperature conditions, such as those required for dispensing hot water for food preparation. This reduction in efficacy appears to stem from both the potential physical degradation of filtration media and the temperature‑dependent behavior of adsorption processes. To investigate the influence of water temperature on the efficacy of filtration media for iodine removal, a series of adsorption capacity tests were conducted at both room temperature and elevated temperatures (90 °C). These experiments aimed to benchmark the performance of the adsorbents that constitute the ACTEX filter in the ISS’s potable water dispenser. The findings of this study provide critical insights into the iodine filtration process, verify the potential performance shortfall under elevated temperature conditions, and establish the basis for defining new absorbent requirements to ensure reliable iodine removal in future mission architectures.

iodine↗

NASA NTRSDate not supplied

Hot Water, Cold Reality: Experimental Analysis of Sorption Constraints in Iodine Filtration Media Under Heated-Water Conditions

drinking water↗

DOE OSTI2024

Hybrid programming-model strategies for GPU offloading of electronic structure calculation kernels

To address the challenge of performance portability and facilitate the implementation of electronic structure solvers, we developed the basic matrix library (BML) and Parallel, Rapid O(N), and Graph-based Recursive Electronic Structure Solver (PROGRESS) library. The BML implements linear algebra operations necessary for electronic structure kernels using a unified user interface for various matrix formats (dense and sparse) and architectures (CPUs and GPUs). Focusing on density functional theory and tight-binding models, PROGRESS implements several solvers for computing the single-particle density matrix and relies on BML. In this paper, we describe the general strategies used for these implementations on various computer architectures, using OpenMP target functionalities on GPUs, in conjunction with third-party libraries to handle performance critical numerical kernels. In this study, we demonstrate the portability of this approach and its performance in benchmark problems.

36 MATERIALS SCIENCE↗

NASA NTRS1991

Infrared cooling rate calculations in operational general circulation models - Comparisons with benchmark computations

The performance of several parameterized models is described with respect to numerical prediction and climate research at GFDL, NCAR, and GISS. The radiation codes of the models were compared to benchmark calculations and other codes for the intercomparison of radiation codes in climate models (ICRCCM). Cooling rates and fluxes calculated from the models are examined in terms of their application to established general circulation models (GCMs) from the three research institutions. The newest radiation parameterization techniques show the most significant agreement with the benchmark line-by-line (LBL) results. The LBL cooling rates correspond to cooling rate profiles from the models, but the parameterization of the water vapor continuum demonstrates uncertain results. These uncertainties affect the understanding of some lower tropospheric cooling, and therefore more accurate parameterization of the water vapor continuum, as well as the weaker absorption bands of CO2 and O3 is recommended.

Kiehl, J. T.↗

NASA NTRS2004

Integrated Modeling Activities for the James Webb Space Telescope (JWST): Structural-Thermal-Optical Analysis

This is a continuation of a series of papers on modeling activities for JWST. The structural-thermal- optical, often referred to as "STOP", analysis process is used to predict the effect of thermal distortion on optical performance. The benchmark STOP analysis for JWST assesses the effect of an observatory slew on wavefront error. The paper begins an overview of multi-disciplinary engineering analysis, or integrated modeling, which is a critical element of the JWST mission. The STOP analysis process is then described. This process consists of the following steps: thermal analysis, structural analysis, and optical analysis. Temperatures predicted using geometric and thermal math models are mapped to the structural finite element model in order to predict thermally-induced deformations. Motions and deformations at optical surfaces are input to optical models and optical performance is predicted using either an optical ray trace or WFE estimation techniques based on prior ray traces or first order optics. Following the discussion of the analysis process, results based on models representing the design at the time of the System Requirements Review. In addition to baseline performance predictions, sensitivity studies are performed to assess modeling uncertainties. Of particular interest is the sensitivity of optical performance to uncertainties in temperature predictions and variations in metal properties. The paper concludes with a discussion of modeling uncertainty as it pertains to STOP analysis.

Johnston, John D.↗

DOE OSTI2021

Steepest-descent algorithm for simulating plasma-wave caustics via metaplectic geometrical optics

The design and optimization of radiofrequency-wave systems for fusion applications is often performed using ray-tracing codes, which rely on the geometrical-optics (GO) approximation. However, GO fails at wave cutoffs and caustics. To accurately model the wave behavior in these regions, more advanced and computationally expensive “full-wave” simulations are typically used, but this is not strictly necessary. A new generalized formulation called metaplectic geometrical optics (MGO) has been proposed that reinstates GO near caustics. The MGO framework yields an integral representation of the wavefield that must be evaluated numerically in general. We present an algorithm for computing these integrals using Gauss-Freud quadrature along the steepest-descent contours. Benchmarking is performed on the standard Airy problem, for which the exact solution is known analytically. Furthermore, the numerical MGO solution provided by the new algorithm agrees remarkably well with the exact solution and significantly improves on previously derived analytical approximations of the MGO integral.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗