Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Benchmark testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 991 records · Page 55

Transport in Stochastic Media with Random Chord Length Distributions

Thermal radiation transport computations in binary Markovian random mixtures rely almost exclusively on the Levermore-Pomraning (LP) model which is obtained by applying a heuristic closure to the ensemble averaged random medium transport equation. The validity of this model has been extensively tested by comparing numerical results over a broad parameter range (material types and mixing parameters) against benchmark solutions in planar geometry. The conditions under which the LP-model provides useful results and when it breaks down are now well established, but work to date has been largely restricted to homogeneous mixing statistics, i.e., the mean chord lengths of both materials are taken to be spatially constant. In recent work, this limitation was relaxed by allowing the mean chord lengths and, in a consistent fashion, the volume fractions in the LP-model to vary spatially and in a follow-up investigation benchmark solutions were obtained by ensemble averaging results over material realizations sampled from a nonhomogeneous Poisson process (NHPP). Numerical experiments in rod geometry with specifically linear and quadratic spatial dependence of chord lengths showed that the material averaged radiation intensities vary nonmonotonically with depth into the medium, in stark contrast to solutions obtained assuming uniform chord lengths. Moreover, depending on the local optical thickness and strength of scattering, the LP-model results showed locally more nuanced deviations from the benchmark solutions than was the case with constant chord lengths. These limited numerical investigations highlight the nontrivial qualitative and quantitative consequences of nonhomogeneous mixing statistics, in particular that closure approximations may not be uniformly valid or invalid over the problem domain.

42 ENGINEERING↗

An Evaluation of Co-Simulation for Modeling Coupled Natural Gas and Electricity Networks

Reliance on natural gas for power generation has increased the coupling between gas and power networks. While this coupling can bring operational and economic benefits, it can also yield challenges, as the constraints in one system can impact the other. Co-simulation can capture the constraints and interactions between these systems, but so far, there has been limited comparison of co-simulation results to those of an integrated model. In this work, we develop a new co-simulation framework using the HELICS platform and the SAInt tool for modeling transient gas and AC optimal power flow. We evaluate this co-simulation framework against a fully integrated version of the SAInt power and gas simulators, thus providing a benchmarking of the co-simulation approach. We compare results across the two approaches for two test networks and a network representing the Belgian power and gas networks, testing both normal operating conditions and cases with compressor disruptions. In each of the cases tested, we find nearly identical results from the two approaches across various metrics of interest, such as nodal pressure, gas flow rates, and active power generation. This alignment suggests that co-simulation can yield comparable results to fully integrated models for modeling coupled gas and electricity networks.

03 NATURAL GAS↗

Image-Driven Hybrid Structural Analysis Based on Continuum Point Cloud Method with Boundary Capturing Technique

Conventional approaches for the structural health monitoring of infrastructures often rely on physical sensors or targets attached to structural members, which require considerable preparation, maintenance, and operational effort, including continuous on-site adjustments. This paper presents an image-driven hybrid structural analysis technique that combines digital image processing (DIP) and regression analysis with a continuum point cloud method (CPCM) built on a particle-based strong formulation. Polynomial regressions capture the boundary shape change due to the structural loading and precisely identify the edge and corner coordinates of the deformed structure. The captured edge profiles are transformed into essential boundary conditions. This allows the construction of a strongly formulated boundary value problem (BVP), classified as the Dirichlet problem. Capturing boundary conditions from the digital image is novel, although a similar approach was applied to the point cloud data. It was shown that the CPCM is more efficient in this hybrid simulation framework than the weak-form-based numerical schemes. Unlike the finite element method (FEM), it can avoid aligning boundary nodes with regression points. A three-point bending test of a rubber beam was simulated to validate the developed technique. The simulation results were benchmarked against numerical results by ANSYS and various relevant numerical schemes. The technique can effectively solve the Dirichlet-type BVP, yielding accurate deformation, stress, and strain values across the entire problem domain when employing a linear strain model and increasing the number of CPCM nodes. In addition, comparative analysis with conventional displacement tracking techniques verifies the developed technique’s robustness. The proposed technique effectively circumvents the inherent limitations of traditional monitoring methods resulting from the reliance on physical gauges or target markers so that a robust and non-contact solution for remote structural health monitoring in real-scale infrastructures can be provided, even in unfavorable experimental environments.

Chemistry↗

Aerothermal modeling, phase 1. Volume 1: Model assessment

Phase 1 was conducted as part of the overall NASA Hot Section Technology (HOST) Program. The purpose of this effort was to determine the predictive accuracy of and the deficiencies within the various analytical modules comprising the overall combustor aerothermal model used at General Electric, as well as to formulate recommendations for improvement where needed. This effort involved the assembly of a benchmark quality data base from selected available literature, and from General Electric engine and combustor component test data. This data base was supplemented with additional definitive data obtained from an experimental test program conducted as part of the Phase 1 effort. Using selections from this data base, assessment studies were conducted to evaluate the various modules. Assessment of the internal flow module was conducted using 2-D parabolic and ellipitic, as well as 3-D elliptic internal flow calculations of definitive test data selected from the assembled data base. The 2-D assessment provided methodical examination of the mathematical techniques and the physical submodules, while the 3-D assessment focused on usefulness as a design tool. Calculations of combustor linear metal temperatures, pressure loss performance, and airflow distribution were performed using aerothermal modules which were in general use for many years at General Electric. The results of these assessment provided for the identification of deficiencies within the modules. The deficiencies were addressed in some detail providing a foundation on which to formulate a prioritized list of recommendations for improvement.

Kenworthy, M. J.↗

Basin-scale estimates of oceanic primary production by remote sensing - The North Atlantic

The monthly averaged CZCS data for 1979 are used to estimate annual primary production at ocean basin scales in the North Atlantic. The principal supplementary data used were 873 vertical profiles of chlorophyll and 248 sets of parameters derived from photosynthesis-light experiments. Four different procedures were tested for calculation of primary production. The spectral model with nonuniform biomass was considered as the benchmark for comparison against the other three models. The less complete models gave results that differed by as much as 50 percent from the benchmark. Vertically uniform models tended to underestimate primary production by about 20 percent compared to the nonuniform models. At horizontal scale, the differences between spectral and nonspectral models were negligible. The linear correlation between biomass and estimated production was poor outside the tropics, suggesting caution against the indiscriminate use of biomass as a proxy variable for primary production.

Platt, Trevor↗

A Benchmark Problem for Development of Autonomous Structural Modal Identification

This paper summarizes modal identification results obtained using an autonomous version of the Eigensystem Realization Algorithm on a dynamically complex, laboratory structure. The benchmark problem uses 48 of 768 free-decay responses measured in a complete modal survey test. The true modal parameters of the structure are well known from two previous, independent investigations. Without user involvement, the autonomous data analysis identified 24 to 33 structural modes with good to excellent accuracy in 62 seconds of CPU time (on a DEC Alpha 4000 computer). The modal identification technique described in the paper is the baseline algorithm for NASA's Autonomous Dynamics Determination (ADD) experiment scheduled to fly on International Space Station assembly flights in 1997-1999.

Pappa, Richard S.↗

Core-Noise

This presentation is a technical progress report and near-term outlook for NASA-internal and NASA-sponsored external work on core (combustor and turbine) noise funded by the Fundamental Aeronautics Program Subsonic Fixed Wing (SFW) Project. Sections of the presentation cover: the SFW system level noise metrics for the 2015, 2020, and 2025 timeframes; the emerging importance of core noise and its relevance to the SFW Reduced-Noise-Aircraft Technical Challenge; the current research activities in the core-noise area, with some additional details given about the development of a high-fidelity combustion-noise prediction capability; the need for a core-noise diagnostic capability to generate benchmark data for validation of both high-fidelity work and improved models, as well as testing of future noise-reduction technologies; relevant existing core-noise tests using real engines and auxiliary power units; and examples of possible scenarios for a future diagnostic facility. The NASA Fundamental Aeronautics Program has the principal objective of overcoming today's national challenges in air transportation. The SFW Reduced-Noise-Aircraft Technical Challenge aims to enable concepts and technologies to dramatically reduce the perceived aircraft noise outside of airport boundaries. This reduction of aircraft noise is critical for enabling the anticipated large increase in future air traffic. Noise generated in the jet engine core, by sources such as the compressor, combustor, and turbine, can be a significant contribution to the overall noise signature at low-power conditions, typical of approach flight. At high engine power during takeoff, jet and fan noise have traditionally dominated over core noise. However, current design trends and expected technological advances in engine-cycle design as well as noise-reduction methods are likely to reduce non-core noise even at engine-power points higher than approach. In addition, future low-emission combustor designs could increase the combustion-noise component. The trend towards high-power-density cores also means that the noise generated in the low-pressure turbine will likely increase. Consequently, the combined result from these emerging changes will be to elevate the overall importance of turbomachinery core noise, which will need to be addressed in order to meet future noise goals.

Hultgren, Lennart S.↗

Hot Water, Cold Reality: Experimental Analysis of Sorption Constraints in Iodine Filtration Media Under Heated-Water Conditions

Iodine has been widely employed as a residual biocide in potable water applications during crewed missions. Unlike other biocides, it is essential to remove iodine from drinking water prior to consumption, as its biocidal concentration raises health concerns. Consequently, effectively removing iodine species from water is a critical step in potable water processing. Although the non-biocided heated leg has not violated microbial specifications on the International Space Station, any wetted volume lacking biocide presents potential risks for long‑duration exploration missions and for systems that are sensitive to microbial growth/contamination. Recent assessments indicate, however, that iodine‑removal performance may degrade under elevated temperature conditions, such as those required for dispensing hot water for food preparation. This reduction in efficacy appears to stem from both the potential physical degradation of filtration media and the temperature‑dependent behavior of adsorption processes. To investigate the influence of water temperature on the efficacy of filtration media for iodine removal, a series of adsorption capacity tests were conducted at both room temperature and elevated temperatures (90 °C). These experiments aimed to benchmark the performance of the adsorbents that constitute the ACTEX filter in the ISS’s potable water dispenser. The findings of this study provide critical insights into the iodine filtration process, verify the potential performance shortfall under elevated temperature conditions, and establish the basis for defining new absorbent requirements to ensure reliable iodine removal in future mission architectures.

iodine↗

Hot Water, Cold Reality: Experimental Analysis of Sorption Constraints in Iodine Filtration Media Under Heated-Water Conditions

Iodine has been widely employed as a residual biocide in potable water applications during crewed missions. Unlike other biocides, it is essential to remove iodine from drinking water prior to consumption, as its biocidal concentration raises health concerns. Consequently, effectively removing iodine species from water is a critical step in potable water processing. Although the non-biocided heated leg has not violated microbial specifications on the International Space Station, any wetted volume lacking biocide presents potential risks for long‑duration exploration missions and for systems that are sensitive to microbial growth/contamination. Recent assessments indicate, however, that iodine‑removal performance may degrade under elevated temperature conditions, such as those required for dispensing hot water for food preparation. This reduction in efficacy appears to stem from both the potential physical degradation of filtration media and the temperature‑dependent behavior of adsorption processes. To investigate the influence of water temperature on the efficacy of filtration media for iodine removal, a series of adsorption capacity tests were conducted at both room temperature and elevated temperatures (90 °C). These experiments aimed to benchmark the performance of the adsorbents that constitute the ACTEX filter in the ISS’s potable water dispenser. The findings of this study provide critical insights into the iodine filtration process, verify the potential performance shortfall under elevated temperature conditions, and establish the basis for defining new absorbent requirements to ensure reliable iodine removal in future mission architectures.

drinking water↗

The Importance of Being Adaptable: An Exploration of the Power and Limitations of Domain Adaptation for Simulation-Based Inference with Galaxy Clusters

The application of deep machine learning methods in astronomy has exploded in the last decade, with new models showing remarkably improved performance on benchmark tasks. Not nearly enough attention is given to understanding the models' robustness, especially when the test data are systematically different from the training data, or "out of domain." Domain shift poses a significant challenge for simulation-based inference, where models are trained on simulated data but applied to real observational data. In this paper, we explore domain shift and test domain adaptation methods for a specific scientific case: simulation-based inference for estimating galaxy cluster masses from X-ray profiles. We build datasets to mimic simulation-based inference: a training set from the Magneticum simulation, a scatter-augmented training set to capture uncertainties in scaling relations, and a test set derived from the IllustrisTNG simulation. We demonstrate that the Test Set is out of domain in subtle ways that would be difficult to detect without careful analysis. We apply three deep learning methods: a standard neural network (NN), a neural network trained on the scatter-augmented input catalogs, and a Deep Reconstruction-Regression Network (DRRN), a semi-supervised deep model engineered to address domain shift. Although the NN improves results by 17% in the Training Data, it performs 40% worse on the out-of-domain Test Set. Surprisingly, the Scatter-Augmented Neural Network (SANN) performs similarly. While the DRRN is successful in mapping the training and Test Data onto the same latent space, it consistently underperforms compared to a straightforward Yx scaling relation. These results serve as a warning that simulation-based inference must be handled with extreme care, as subtle differences between training simulations and observational data can lead to unforeseen biases creeping into the results.

Ntampaka, Michelle [Baltimore, Space Telescope Sci↗

Benchmarking quantum trial wavefunctions for phaseless auxiliary-field quantum Monte Carlo

The phaseless auxiliary-field quantum Monte Carlo (ph-AFQMC) method is a stochastic imaginary-time projection technique for computing ground-state properties of strongly correlated quantum systems, with accuracy that depends critically on the choice of trial wavefunction. Here, we investigate ph-AFQMC with trial states prepared using parameterized quantum circuits. In this work, we present a comprehensive benchmarking study of quantum trial wavefunctions spanning unitary coupled-cluster, Hamiltonian-informed, Jastrow-inspired, and adaptively constructed ansatze. The benchmarking evaluates accuracy, expressibility, and scalability of these ansatze within the QC-AFQMC framework. We test these ansatze on linear hydrogen chains under bond stretching and find that several ansatz families produce chemically accurate ph-AFQMC energies across the dissociation curve. We have performed simulations using the CUDA-Q quantum development platform on the GPU partition of the Perlmutter supercomputer. When comparing ansatze at similar numbers of variational parameters, we find that different ansatz families yield comparable ph-AFQMC results despite exhibiting substantially different variational energies, optimization costs, and circuit depths. Our results indicate that the variational energy of an ansatz is not always a reliable indicator of its quality for ph-AFQMC and reveal instances of over-parameterization. In the strongly correlated regime, trial wavefunctions obtained from adaptive ansatze, exemplified here by ADAPT-VQE with the UCCSD operator pool, can outperform their fixed-ansatz counterparts (UCCSD) in terms of projected energies while using substantially more compact circuits, providing a flexible route to optimize quantum resources within the ph-AFQMC framework.

Rofougaran, Rod [LBNL, Berkeley; Columbia U.; PNL,↗

Synthetic, Realistic Transmission and Distribution Co-Simulation for Voltage Control Benchmarking

As distributed energy resources (DERs) play an increasing role in generation and grid services, control and market paradigms will need to be tested with models that incorporate transmission and distribution systems. The test systems will need to be realistic and accessible for researchers to form conclusions about realistic behaviors and maintain comparability and repeatability of results. These test systems also must have high resolution models of sufficient size for realistic distribution and transmission interaction. This paper demonstrates the tightly coupled HELICS-based co-simulation of realistic synthetic distribution and transmission models for the Austin metropolitan area and how this framework can be used to analyze resultant behaviors from distributed resources and their controls. These results are compared to the same distribution system run without co-simulation using a fixed feed-in voltage. Results show that even without advanced voltage controls, the feed-in voltage response when coupled to the transmission system results a lower level of voltage excursions, suggesting the importance of using this type of realistic, tightly coupled, transmission and distribution cosimulation when assessing DERs.

27 ARPA - Advanced Research Projects Agency-Energy↗

Synthetic, Realistic Transmission and Distribution Co-Simulation for Voltage Control Benchmarking

As distributed energy resources (DERs) play an increasing role in generation and grid services, control and market paradigms will need to be tested with models that incorporate transmission and distribution systems. The test systems will need to be realistic and accessible for researchers to form conclusions about realistic behaviors and maintain comparability and repeatability of results. These test systems also must have high resolution models of sufficient size for realistic distribution and transmission interaction. This paper demonstrates the tightly coupled HELICS-based co-simulation of realistic synthetic distribution and transmission models for the Austin metropolitan area and how this framework can be used to analyze resultant behaviors from distributed resources and their controls. These results are compared to the same distribution system run without co-simulation using a fixed feed-in voltage. Results show that even without advanced voltage controls, the feed-in voltage response when coupled to the transmission system results a lower level of voltage excursions, suggesting the importance of using this type of realistic, tightly coupled, transmission and distribution co-simulation when assessing DERs.

27 ARPA - Advanced Research Projects Agency-Energy↗

Verification benchmarks for single-phase flow in three-dimensional fractured porous media

Flow in fractured porous media occurs in the earth’s subsurface, in biological tissues, and in man-made materials. Fractures have a dominating influence on flow processes, and the last decade has seen an extensive development of models and numerical methods that explicitly account for their presence. To support these developments, four benchmark cases for single-phase flow in three-dimensional fractured porous media are presented. Furthermore, the cases are specifically designed to test the methods’ capabilities in handling various complexities common to the geometrical structures of fracture networks. Based on an open call for participation, results obtained with 17 numerical methods were collected. This paper presents the underlying mathematical model, an overview of the features of the participating numerical methods, and their performance in solving the benchmark cases.

97 MATHEMATICS AND COMPUTING↗

Flowfield Analysis of a Small Entry Probe (SPRITE) Tested in an Arc Jet

Results of simulations of flow of an arc-heated stream around a 14-inch diameter 45 sphere-cone configuration are presented. Computations are first benchmarked against pressure and heat flux measurements made using copper slug calorimeters of different shapes and sizes. The influence of catalycity of copper on computed results is investigated. Good agreements between predictions and measurements are obtained by assuming the copper slug to be partially catalytic to atomic recombination. With total enthalpy estimates obtained from these preliminary computations, calculations are then performed for the test article, with the nozzle and test article considered as an integrated whole the same procedure adopted for calorimeter simulations. The resulting heat fluxes at select points on the test article (points at which fully instrumented plugs were placed) are used in material thermal response code calculations. Predicted time histories of temperature are compared against thermocouple data from the instrumented plugs, and recession determined. Good agreement is obtained for in-depth thermocouples.

Prabhu, Dinesh K.↗

A New Era of Nuclear Criticality Experiments: The First 10 Years of Radiation Test Object Operations at NCERC

The work presented in this paper focuses on the first 10 years (2011–2020) of radiation test object (RTO) operations at the National Criticality Experiments Research Center. RTOs are subcritical configurations of special nuclear material that are built by hand. These configurations are utilized for benchmark experiments, detector testing/characterization, and training. An overview of the types of measurements used in RTO operations is given as well as a history of RTO operations at Los Alamos National Laboratory from 1944–2011.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Quenching Combustible Dust Mixtures Using Electric Particulate Suspensions (EPS): A New Testing Method For Microgravity

The Electric Particulate Suspension (EPS) is a combustion ignition system being developed at Iowa State University for evaluating quenching effects of powders in microgravity (quenching distance, ignition energy, flammability limits). Because of the high cloud uniformity possible and its simplicity, the EPS method has potential for "benchmark" design of quenching flames that would provide NASA and the scientific community with a new fire standard. Microgravity is expected to increase suspension uniformity even further and extend combustion testing to higher concentrations (rich fuel limit) than is possible at normal gravity. Two new combustion parameters are being investigated with this new method: (1) the particle velocity distribution and (2) particle-oxidant slip velocity. Both walls and (inert) particles can be tested as quenching media. The EPS method supports combustion modeling by providing accurate measurement of flame-quenching distance as a parameter in laminar flame theory as it closely relates to characteristic flame thickness and flame structure. Because of its design simplicity, EPS is suitable for testing on the International Space Station (ISS). Laser scans showing stratification effects at 1-g have been studied for different materials, aluminum, glass, and copper. PTV/PIV and a leak hole sampling rig give particle velocity distribution with particle slip velocity evaluated using LDA. Sample quenching and ignition energy curves are given for aluminum powder. Testing is planned for the KC-135 and NASA s two second drop tower. Only 1-g ground-based data have been reported to date.

Colver, Gerald M.↗

Shock Tube Measurements of Radiative Heating for Titan and Nitrogen

Detailed spectrally and spatially resolved radiance has been measured in the Electric Arc Shock Tube at NASA Ames Research Center for conditions relevant to Titan entry, with varying atmospheric composition, free-stream density (equivalently, altitude) and shock velocity. The test campaign measured radiation at velocities from 4.7 km/s to 8 km/s and free-stream pressures of 0.1, 0.28 and 0.47 Torr with a variety of compositions. Radiances measured in this work are substantially larger compared to that reported both in past EAST test campaigns and in other shock tube facilities. Depending on the metric used for comparison, the discrepancy can be as high as an order of magnitude. Due to the difference with previously reported data, a substantial effort was undertaken to provide confidence in the new results. The present work provides a new benchmark set of data to replace those published in previous studies. The effect of gas impurities identified in previous shock tube studies was also examined by testing in pure N2 and deliberate addition of air to the CH4/N2 mixtures. Furthermore, a test campaign in pure N2 was also conducted with the aim of providing data for improving fundamental understanding of high enthalpy flows containing N2, such as high-speed entries into Earth or Titan. These experiments cover conditions from approximately 6 km/s to 11 km/s at an initial pressure of 0.2 Torr. It is the intention of this paper to motivate code comparisons benchmarked against this data set.

Radiation↗