SEARCH · Engineering Papers

Results for “Benchmark testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,207 records · Page 67

All sources NASA NTRS DOE OSTI

NASA NTRS1992

Preliminary efforts toward development of data handling and analysis software for unsteady flow measurements: An application for aeroelastic transonic flow configurations

A few years ago the Structural Dynamics Division at LaRC started ambitious experimental research efforts known as the Benchmark Models Program. The primary objective of this program was to provide experimental data that may serve as a calibration source for computational fluid dynamics (CFD) efforts that deal with aeroelastic unsteady flow configurations. It also focuses on the understanding of complex flow phenomenon associated with unsteady flow developments. The overall plan for the program has been described by Bennett, including a presentation of initial test results of flutter of a rigid wing mounted on flexible supports. An example of a test model employed to measure the dynamic response along with corresponding pressure distributions is shown. This model incorporates eighty pressure transducers distributed along two spanwise stations. In addition, the models are equipped with four accelerometers and two strain gages. The data handling system for the Benchmark Model Program is under development. Several interactive computer routines designed for the user interface, dynamic memory allocation, unsteady flow measurements data extraction, and further data processing were developed. To present a few examples of measured data, the unsteady pressure distributions and the wing model dynamic response were plotted.

Finaish, Fathi↗

DOE OSTI2020

Experiments at Sandia to Measure the Effect of Temperature on Critical Systems

Estimation of the uncertainty in a critical experiment attributable to uncertainties in the measured experiment temperature is done by calculating the variation of the eigenvalue of a benchmark configuration as a function of temperature. In the low-enriched water-moderated critical experiments performed at Sandia, this is done by 1) estimating the effects of changing the water temperature while holding the UO 2 fuel temperature constant, 2) estimating the effects of changing the UO 2 temperature while holding the water temperature constant, and 3) combining the two results. This assumes that the two effects are separable. The results of such an analysis are nonintuitive and need experimental verification. Critical experiments are being planned at Sandia National Laboratories (Sandia) to measure the effect of temperature on critical systems and will serve to test the methods used in estimating the temperature effects in critical experiments.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2020

Experiments at Sandia to Measure the Effect of Temperature on Critical Systems [Slides]

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2022

Evaluation of an in vitro three-dimensional HepaRG spheroid model for genotoxicity testing using the high-throughput CometChip platform

Three-dimensional (3D) culture systems are increasingly being used for genotoxicity studies due to improved cell-to-cell interactions and tissue-like structures that are limited or lacking in 2D cultures. The present study optimized a 3D culture system using metabolically competent HepaRG cells for in vitro genotoxicity testing. 3D HepaRG spheroids, formed in 96- or 384-well ultra-low attachment plates, were exposed to various concentrations of 34 test articles, including 8 direct-acting and 11 indirect-acting genotoxicants/carcinogens as well as 15 compounds that show different genotoxic responses in vitro and in vivo. DNA damage was evaluated using the high-throughput CometChip assay with concurrent cytotoxicity assessment by the ATP assay in both 2D and 3D cultures. 3D HepaRG spheroids maintained a stable phenotype for up to 30 days with higher levels of albumin secretion, cytochrome P450 gene expression, and enzyme activities compared to 2D cultures. 3D spheroids also demonstrated a higher sensitivity than 2D cultures for detecting both direct- and indirect-acting genotoxicants/carcinogens, indicating a better prediction of in vivo genotoxicity responses. When DNA damage dose-response data were quantified using PROAST software, 3D spheroids generally had lower or similar benchmark dose values compared to 2D HepaRG cells and were more comparable with primary human hepatocytes. These results demonstrate that 3D models can be adapted to the CometChip technology for high-throughput genotoxicity testing and that 3D HepaRG spheroids may be used as a reliable and pragmatic in vitro approach to better support the hazard identification and risk assessment of potential human genotoxic carcinogens.

60 APPLIED LIFE SCIENCES↗

DOE OSTI2024

Battery Electrolyte Design for Electric Vertical Takeoff and Landing (eVTOL) Platforms

Here, the development of robust and high-performance battery systems is crucial for the advancement of Electric Vertical Takeoff and Landing (eVTOL) vehicles for urban air mobility. This study evaluates the performance of different lithium-ion battery chemistries under Electric Vertical Takeoff and Landing (eVTOL) load profiles. The actual flight data coupled with physical models is used to create discharge profiles for testing on developed lithium-ion cells for eVTOLs. The performance of a standard liquid electrolyte (1.2 M LiPF 6 in EC:EMC), labeled Gen-2, is benchmarked and compared with a fast-charging electrolyte (1.2 M LiFSI in EC:EMC), labeled XFC. Cell analysis involves the use of various techniques, such as impedance spectroscopy, polarization curves, and capacity retention measurements. Capacity retention is stable for both systems over 500 cycles, but unique discharge capacity trends are observed for different mission segments. During the initial takeoff hover stages, Gen-2 electrolytes experience substantial voltage fade, while XFC electrolytes maintain consistent behavior. In general, the Gen-2 electrolyte demonstrated lower discharge overpotentials and higher decay during cycling compared to the XFC electrolyte. This work highlights the complexity of eVTOL battery behavior and provides insights into battery system design, contributing to the advancement of battery energy storage solutions for urban air mobility.

25 ENERGY STORAGE↗

DOE OSTI2025

Thermal and mechanical performance of gypsum composites containing fly ash cenosphere encapsulated phase change materials

Utilizing phase change materials (PCMs) within construction materials improves the thermal energy storage capabilities in the built environment. Notably, integrating PCMs into drywalls presents a promising avenue to reduce building energy use. However, incorporating PCMs into drywalls poses challenges, particularly reduced mechanical properties and workability limitations as it can adversely affect the hardening and cohesiveness of gypsum composites. To address these challenges, this study explores a novel strategy to incorporate PCMs into gypsum composites through fly ash cenosphere-encapsulated PCM, namely CenoPCM, aiming to enhance the mechanical properties and thermal conductivity over existing commercial counterparts. An experimental program was conducted to study the impact of the inclusion of CenoPCM on the mechanical and thermal performance of gypsum composites, and the results were compared to those of commercially available polymerencapsulated PCM benchmark (Micronal). The findings highlighted that PCM-charged samples exhibited up to 95.90 J/g (CenoPCM) of latent heat with 70 % CenoPCM loading. The results of mechanical tests also showed that CenoPCM outperformed its polymer-encapsulated counterpart, achieving 55 % higher mechanical strength on average. Here, this improvement is attributed to the rigid shell of fly ash cenosphere (FAC) serving as a PCM carrier, providing a skeleton-like structure to gypsum composites for higher load-bearing capacity. Additionally, hotbox tests demonstrated that the CenoPCM-charged wall panels yielded a 20 % higher thermal conductivity and a 22 % increased time lag compared to Micronal PCM-charged panels, indicating its potential to shift the peak load in buildings.

Ceno PCM↗

DOE OSTI2020

Local Phasor-Based Control of DER Inverters for Voltage Regulation on Distribution Feeders

We introduce a new control paradigm termed Phasor-Based Control (PBC) to coordinate Distributed Energy Resources (DER) for improved voltage regulation and other objectives. PBC is a multi-layer control framework where the state of the distribution grid is represented by voltage phasors, and Phasor Measurement Units (PMUs) measure the state at critical points in the distribution grid. In the PBC paradigm, a supervisory controller (S-PBC) sets phasor targets which local controllers track. In this paper, we propose a Proportional Integral (PI) implementation for the local control layer (LPBC), to regulate real and reactive power output of distributed inverters to track a voltage phasor target computed by the supervisory layer. We tune the PI controller gains offline with a genetic algorithm that yields better performance than the Ziegler-Nichols method. We benchmark the proposed L-PBC controller against droop volt-var control (DVVC) and observe improved voltage regulation in simulation on the IEEE 13 node unbalanced test feeder (IEEE 13NF). Furthermore, by means of numerical simulation we observe the response of the L-PBC controllers to small and large grid disturbances. Simulations on larger feeders, IEEE 123-node and 647-node, demonstrate challenges with tuning controllers in setups with different amounts of power-voltage coupling.

42 ENGINEERING↗

DOE OSTI2025

Scaling laws in jet classification

We demonstrate the emergence of scaling laws in the benchmark top versus QCD jet classification problem in collider physics. Six distinct physically-motivated classifiers exhibit power-law scaling of the binary cross-entropy test loss as a function of training set size, with distinct power law indices. This result highlights the importance of comparing classifiers as a function of dataset size rather than for a fixed training set, as the optimal classifier may change considerably as the dataset is scaled up. We speculate on the interpretation of our results in terms of previous models of scaling laws observed in natural language and image datasets.

Batson, Joshua↗

DOE OSTI2025

CRCNS22 Learning Rules in the Hippocampus and their Mapping to Neuromorphic Systems (Final Technical Report)

Large scale biologically-realistic computational models are key to investigating the interplay between structure and function in nervous systems, thus paving the way to new clinical methods and neuro-inspired computing solutions. This project focuses on the hippocampus, in particular the CA3-CA1 regions, due to their role in associative learning and memory, pattern separation and completion, and spatial navigation. Investigations into the neuronal organization and learning rule(s) of this circuit can shed light into how declarative memories are formed, stored, recalled and forgotten and inform computational, experimental and clinical neuroscience work. Our project aims at developing a novel data-driven methodology supported by a broad heterogeneous base of neuroscience experimental knowledge and inspired from advances in computer science and engineering. Specifically, this work will benchmark existing and new learning rules within a full-scale spiking neural network simulation of the CA3-CA1 region. The model will be based on an open-source repository, called the Hippocampome, which contains neuronal morphologies, firing patterns, synapse probabilities, and most other required parameters for all known neuron types in the rodent hippocampal formation. The model will be first trained in a supervised fashion for associative memory tasks using backpropagation through time traditionally used in computer science, enhanced with a new technique called the surrogate gradient method. This optimization method will be used to obtain a global loss minimization, but it is not biologically inspired as it assumes the use of data not locally available to the synapses. However, we propose its use as a benchmarking tool, to compare the training performance of local biologically plausible and hardware-mappable learning rules at scale. New rules or combinations will be proposed and tested as needed, based on the obtained results. Progress in this area will also drive the development of novel hardware-mappable algorithms for continual lifelong learning and categorization of new events from few presented examples. This project goes beyond the existing state-of-the-art by looking at large scale realistic neuronal circuits as networks trainable via global optimization methods such as surrogate gradient descent. The objective function of the brain that supports learning is largely unknown, but it is likely that it operates through local learning rules. Studying network trajectories around local minima as proposed in this work represents a useful strategy for understanding whether a network is training by using a specific (set of) learning rule(s). Starting from a completely untrained network is a challenging test since it is difficult to determine how the learning rule affects the trajectory of the network. This interdisciplinary project will help understand what rule governs learning in these regions or if multiple learning rules are involved. The work will develop a robust methodology to measure if the network is converging to the target solution, oscillating around it, or diverging away.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2021

Construction, installation and operation of ProtoDUNE-SP

The single-phase liquid argon TPC at CERN (ProtoDUNE-SP) is an engineering prototype for the first module of the DUNE far detector. This prototype, which has dimensions of a cube of about 10 m edge, provides full validation of the use of the membrane tank technology for large dimension cryostats. Furthermore, the very high performance of the protoDUNE-SP TPC with more than 500 days of continuous and stable operation, demonstrated the reliability of the LAr detection technology at a scale never tested before. In this talk we will review the main characteristics and milestones of the construction and installation of protoDUNE-SP which provide a series of benchmarks for DUNE. The performance for several different detector working points will also be discussed.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

NASA NTRS1986

Benchmarks of programming languages for special purposes in the space station

Although Ada is likely to be chosen as the principal programming language for the Space Station, certain needs, such as expert systems and robotics, may be better developed in special languages. The languages, LISP and Prolog, are studied and some benchmarks derived. The mathematical foundations for these languages are reviewed. Likely areas of the space station are sought out where automation and robotics might be applicable. Benchmarks are designed which are functional, mathematical, relational, and expert in nature. The coding will depend on the particular versions of the languages which become available for testing.

Knoebel, Arthur↗

DOE OSTI2025

wa-hls4ml and lui-gnn: A benchmark and GNN-based surrogate model for hls4ml resource and latency estimation

As machine learning (ML) increasingly serves as a tool for addressing real-time challenges in scientific applications, the development of advanced tooling has significantly reduced the time required to iterate on various designs. These advancements have solved major obstacles, but also exposed new challenges. For example, processes that were not previously considered bottlenecks, such as model synthesis, are now becoming limiting factors in the rapid iteration of designs. To reduce these emerging constraints, multiple efforts are being launched toward designing an ML-based surrogate model that estimates resource usage of synthesized accelerator architectures. This model would reduce the design iteration time, especially when designing within a set of given hardware constraints. This approach shows considerable potential, but as it stands, the effort is early and would benefit from coordination and standardization to assist future work as it emerges. We introduce wa-hls4ml, a benchmark for ML accelerator resource and latency estimation, and its corresponding initial dataset of more than 100,000 fully connected neural networks, all synthesized using hls4ml and targeting Xilinx FPGAs. In addition to the resource utilization and latency data provided, the dataset includes generated artifacts and log files for many of the synthesized neural networks, in order to support future research in ML-based code generation. The benchmark evaluates the performance of resource and latency predictors against several common ML model architectures, primarily originating from scientific domains, as exemplar models, as well as the average performance across a subset of the dataset. We measure the performance of a given predictor model through multiple metrics, including $R^2$ score and SMAPE on regression tasks, as well as inference time to further characterize the estimator under test. Additionally, we introduce the latency/utilization inference graph neural network (lui-gnn), a surrogate model that uses a graph neural network to represent input architectures in the form of a directed graph. This graph representation allows for a diverse set of model architectures to all be effectively handled by a surrogate model. We present the architecture and performance of the model, as evaluated by the new proposed benchmark, including SMAPE, $R^2$ score, and inference times, and find that lui-gnn generally predicts latency and utilization for the 75\% quantile within several percent of the synthesized resources on the synthetic test dataset, indicating that this approach of estimating resource and latency via a surrogate models has promise and warrants further research.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

NASA NTRS2010

Blade Deflection Measurements of a Full-Scale UH-60A Rotor System

Blade deflection (BD) measurements using stereo photogrammetry have been made during the individual blade control (IBC) testing of a UH-60A 4-bladed rotor system in the 40 by 80-foot test section of the National Full-Scale Aerodynamic Complex (NFAC). Measurements were made in quadrants one and two, encompassing advance ratios from 0.15 to 0.40, thrust coefficient/solidities from 0.05 to 0.12 and rotor-system drive shaft angles from 0.0 to -9.6 deg. The experiment represents a significant step toward providing benchmark databases to be utilized by theoreticians in the development and validation of rotorcraft prediction techniques. In addition to describing the stereo measurement technique and reporting on preliminary measurements made to date, the intent of this paper is to encourage feedback from the rotorcraft community concerning continued analysis of acquired data and to solicit suggestions for improved test technique and areas of emphasis for measurements in the upcoming UH-60A Airloads test at the NFAC.

Olson, Lawrence E.↗

NASA NTRS1992

An investigation of DTNS2D for use as an incompressible turbulence modelling test-bed

This paper documents an investigation of a two dimensional, incompressible Navier-Stokes solver for use as a test-bed for turbulence modelling. DTNS2D is the code under consideration for use at the Center for Modelling of Turbulence and Transition (CMOTT). This code was created by Gorski at the David Taylor Research Center and incorporates the pseudo compressibility method. Two laminar benchmark flows are used to measure the performance and implementation of the method. The classical solution of the Blasius boundary layer is used for validating the flat plate flow, while experimental data is incorporated in the validation of backward facing step flow. Velocity profiles, convergence histories, and reattachment lengths are used to quantify these calculations. The organization and adaptability of the code are also examined in light of the role as a numerical test-bed.

Steffen, Christopher J., Jr.↗

DOE OSTI2023

Direct Estimation of Parameters in ODE Models Using WENDy: Weak-Form Estimation of Nonlinear Dynamics

Abstract We introduce the Weak-form Estimation of Nonlinear Dynamics (WENDy) method for estimating model parameters for non-linear systems of ODEs. Without relying on any numerical differential equation solvers, WENDy computes accurate estimates and is robust to large (biologically relevant) levels of measurement noise. For low dimensional systems with modest amounts of data, WENDy is competitive with conventional forward solver-based nonlinear least squares methods in terms of speed and accuracy. For both higher dimensional systems and stiff systems, WENDy is typically both faster (often by orders of magnitude) and more accurate than forward solver-based approaches. The core mathematical idea involves an efficient conversion of the strong form representation of a model to its weak form, and then solving a regression problem to perform parameter inference. The core statistical idea rests on the Errors-In-Variables framework, which necessitates the use of the iteratively reweighted least squares algorithm. Further improvements are obtained by using orthonormal test functions, created from a set of $$C^{\infty }$$ C ∞ bump functions of varying support sizes.We demonstrate the high robustness and computational efficiency by applying WENDy to estimate parameters in some common models from population biology, neuroscience, and biochemistry, including logistic growth, Lotka-Volterra, FitzHugh-Nagumo, Hindmarsh-Rose, and a Protein Transduction Benchmark model. Software and code for reproducing the examples is available at https://github.com/MathBioCU/WENDy .

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2023

Proposed Updates to Pu Evaluation for ENDF/B-VIII.0β 2 [Slides]

This presentation shows current status of in ENDF/B-VIII.0 and ENDF/B-VIII.0β 1 Pu evaluations. With a focus on the Pu thermal solutions (PST) and sanity check on fast metal assemblies (PMF). Pu ENDFβ 1 file in the low-energy region included updates in RRR (up to 2.5 keV), TNC and PFNS. Discussed are improvements over ENDF/B-VIII.0 in the C/E benchmarks (PST 81 cases) with preliminary ν p and cross section covariance generation for the resolved resonance energy range up to 2.25 keV. Highlighted are proposed updates for ENDFβ 2 with an extension of the RRR evaluation up to 5 keV, inclusion of Mosby’s data including proper resolution function (thanks to Marian J.), and a particular focus on η energy dependence from thermal up to 10 eV with the impact of the capture-to-fission ratio at 0.29 eV. This presentation concludes with an updated ν p and cross section covariance generation for the resolved resonance energy range up to 5 keV. And additional validation to test performance at about 2 eV and in the keV region.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2024

Assessing and benchmarking the fidelity of posterior inference methods for astrophysics data analysis

In this era of large and complex astronomical survey data, interpreting, validating, and comparing inference techniques becomes increasingly difficult. This is particularly critical for emerging inference methods like Simulation-Based Inference (SBI), which offer significant speedup potential and posterior modeling flexibility, especially when deep learning is incorporated. We present a study to assess and compare the performance and uncertainty prediction capability of Bayesian inference algorithms – from traditional MCMC sampling of analytic functions to deep learning-enabled SBI. We focus on testing the capacity of hierarchical inference modeling in those scenarios. Before we extend this study to cosmology, we first use astrophysical simulation data to ensure interpretability. We demonstrate a probabilistic programming implementation of hierarchical and non-hierarchical Bayesian inference using simulations derived from the DeepBench software library, a benchmarking tool developed by our group that generates simple and controllable astrophysical objects from first principles. This study will enable astronomers and physicists to harness the inference potential of these methods with confidence.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

DOE OSTI2023

Towards operational atmospheric correction of airborne hyperspectral imaging spectroscopy: Algorithm evaluation, key parameter analysis, and machine learning emulators

Atmospheric correction of airborne hyperspectral imaging spectroscopy (AHIS) to obtain high-quality surface reflectance is the prerequisite for remote sensing applications. Over the last decades, different atmospheric correction methods have been developed based on radiative transfer models (RTMs), however, the relative performances of different algorithms are unclear. Automated operational atmospheric correction methods to process large-volume AHIS data in a high-accurate and high-throughput manner are still lacking. Therefore, this study proposed an operational atmospheric correction pipeline for deriving surface reflectance from AHIS data. To ensure the accuracy and efficiency of the pipeline, we focused on three specific aspects: (1) selecting a suitable RTM for the development of atmospheric lookup tables (LUTs) by comparing the commercial MODerate resolution atmospheric TRANsmission (MODTRAN) and open-sourced Library for Radiative TRANsfer (LibRadTRAN) models, where the widely-used software, Atmospheric/Topographic Correction for Airborne Imagery (ATCOR), was used as benchmarks; (2) identifying key atmospheric correction parameters and determining suitable sources for parameter retrievals including AHIS, Moderate Resolution Imaging Spectroradiometer (MODIS), and AErosol RObotic NETwork (AERONET); and (3) testing the performance of using machine learning emulators to speed up the RTM-based atmospheric correction. Results indicate that (1) atmospheric correction based on MODTRAN LUTs can produce surface reflectance accurately with mean absolute errors < 0.05 and cosine similarities > 0.98 compared to field measurements, which is comparable to the software ATCOR and slightly outperforms the LibRadTRAN LUTs; (2) sobol global sensitivity analysis demonstrates that in the atmospheric correction, visibility and water vapor are two key parameters that can be accurately derived from AHIS in contrast to MODIS or AERONET data; and (3) Random Forest emulators can produce accurate estimations of surface reflectance with mean absolute errors < 0.03 and cosine similarities > 0.98 for higher processing efficiency and determine a suitable set of wavelengths for retrieving atmospheric visibility and water vapor. In conclusion, the proposed atmospheric correction pipeline also improved the four-stream radiative transfer theory for airborne applications by considering adjacent effects from airborne surrounding pixels and can also be applied for atmospheric correction of hyperspectral data from spaceborne missions.

47 OTHER INSTRUMENTATION↗