SEARCH · Engineering Papers

Results for “Critical Benchmarks”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,459 records · Page 81

All sources NASA NTRS DOE OSTI

DOE OSTI2019

Benchmarking Parametric and Machine Learning Models for Genomic Prediction of Complex Traits

The usefulness of genomic prediction in crop and livestock breeding programs has prompted efforts to develop new and improved genomic prediction algorithms, such as artificial neural networks and gradient tree boosting. However, the performance of these algorithms has not been compared in a systematic manner using a wide range of datasets and models. Using data of 18 traits across six plant species with different marker densities and training population sizes, we compared the performance of six linear and six non-linear algorithms. First, we found that hyperparameter selection was necessary for all non-linear algorithms and that feature selection prior to model training was critical for artificial neural networks when the markers greatly outnumbered the number of training lines. Across all species and trait combinations, no one algorithm performed best, however predictions based on a combination of results from multiple algorithms (i.e., ensemble predictions) performed consistently well. While linear and non-linear algorithms performed best for a similar number of traits, the performance of non-linear algorithms vary more between traits. Although artificial neural networks did not perform best for any trait, we identified strategies (i.e., feature selection, seeded starting weights) that boosted their performance to near the level of other algorithms. Our results highlight the importance of algorithm selection for the prediction of trait values.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2019

Benchmarking parametric and machine learning models for genomic prediction of complex traits

The usefulness of genomic prediction in crop and livestock breeding programs has prompted efforts to develop new and improved genomic prediction algorithms, such as artificial neural networks and gradient tree boosting. However, the performance of these algorithms has not been compared in a systematic manner using a wide range of datasets and models. Using data of 18 traits across six plant species with different marker densities and training population sizes, we compared the performance of six linear and six non-linear algorithms. First, we found that hyperparameter selection was necessary for all non-linear algorithms and that feature selection prior to model training was critical for artificial neural networks when the markers greatly outnumbered the number of training lines. Across all species and trait combinations, no one algorithm performed best, however predictions based on a combination of results from multiple algorithms (i.e. ensemble predictions) performed consistently well. While linear and non-linear algorithms performed best for a similar number of traits, the performance of non-linear algorithms vary more between traits. Although artificial neural networks did not perform best for any trait, we identified strategies (i.e. feature selection, seeded starting weights) that boosted their performance to near the level of other algorithms. Our results highlight the importance of algorithm selection for the prediction of trait values.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2022

Disruptive neoclassical tearing mode seeding in DIII-D with implications for ITER

New studies identify the critical parameters and physics governing disruptive neoclassical tearing mode (NTM) onset. An m/n = 2/1 mode in DIII-D that begins to grow robustly after a seeding event (edge localized mode ELM or sawtooth precursor and crash) causes the mode rotation to drop close to the plasma's Er = 0 rest frame; this condition opens the stabilizing ion-polarization current 'gate' and destabilizes an otherwise marginally stable NTM. Our new experimental and theoretical insights and novel toroidal theory-based modeling are benchmarked and scalable to ITER and other future experiments. Here, the nominal ITER rotation at q = 2 is found to be stabilizing ('gate closed') except for MHD-induced transients that could 'open the gate'. Extrapolating from the DIII-D ITER baseline scenario (IBS) discharges, MHD transients are much more likely to destabilize problematic robustly growing 2/1 NTMs in ITER; this makes predictions of seeding and control of both ELMs and sawteeth imperative for more than just minimizing divertor pulsed-heat loading.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

DOE OSTI2025

PickerXL, A Large Deep Learning Model to Measure Arrival Times from Noisy Seismic Signals

Precisely measuring seismic arrival times is a labor-intensive task but is critical for both earthquake monitoring and subsurface imaging. Recently published deep learning models have demonstrated superior performance compared to traditional automatic approaches for picking arrival times. Although existing deep learning models have shown promising results, further advancements are necessary as their performance is not yet satisfactory especially when applied to new regions and station networks. Increasing model size has led to improved performance in other machine learning applications. Here, we aimed to investigate whether enlarging deep learning models can increase performance on accepted benchmarks. We trained three models of varying sizes, small (1X), medium (4X), and large (16X), using globally distributed local and regional earthquake signals and background noise waveforms from a benchmark dataset, Stanford Earthquake Dataset. Our results indicate that the largest model (PickerXL) outperforms both the smaller models and Seisbench implementation of the PhaseNet model, which has the same number of parameters as our small model. The PickerXL model’s enhanced capacity to extract complex patterns from seismograms contributes to its superior arrival picking abilities compared to the smaller model.

Chai, Chengping [Oak Ridge National Laboratory (OR↗

DOE OSTI2026

Reassessment of PHDS Fulcrum40h High Purity Germanium (HPGe) Detector System Performance

This report presents a comprehensive evaluation of the updated PHDS Fulcrum40h High Purity Germanium (HPGe) detector system, benchmarking its performance, usability, and software capabilities against the current National Nuclear Security Administration (NNSA) Nuclear Emergency Support Team (NEST) HPGe Detector System Requirements Document. Systematic measurements were conducted using a single Fulcrum40h detector to assess key parameters including gamma efficiency and resolution, neutron detection efficiency, gamma pulse-pileup response, and gamma-to-neutron crosstalk. The Fulcrum40h system, acquired in August 2022, has undergone recent updates by PHDS to address deficiencies identified following the initial NEST requirements release. The results provide critical insights into the detector’s operational capabilities and compliance with NNSA NEST standards.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

DOE OSTI2024

HGQ: High Granularity Quantization for Real-time Neural Networks on FPGAs

Neural networks with sub-microsecond inference latency are required by many critical applications. Targeting such applications deployed on FPGAs, we present High Granularity Quantization (HGQ), a quantization-aware training framework that optimizes parameter bit-widths through gradient descent. Unlike conventional methods, HGQ determines the optimal bit-width for each parameter independently, making it suitable for hardware platforms supporting heterogeneous arbitrary precision arithmetic. In our experiments, HGQ shows superior performance compared to existing network compression methods, achieving orders of magnitude reduction in resource consumption and latency while maintaining the accuracy on several benchmark tasks. These improvements enable the deployment of complex models previously infeasible due to resource or latency constraints. HGQ is open-source and is used for developing next-generation trigger systems at the CERN ATLAS and CMS experiments for particle physics, enabling the use of advanced machine learning models for real-time data selection with sub-microsecond latency.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

NASA NTRS2021

Contextual Segmentation of Fire Spotting Regions Through Satellite-Augmented Autonomous Modular Sensor Image

Globally, forest fires remain a significant threat to human and environmental wellbeing. Towards mitigating the impacts of forest fires, it is critical that accurate and updated information regarding not only the fire line, but also nearby human settlements, vegetation, and water sources is reported quickly to emergency services. However, while existing UAS-based fire detection methods are effective, they largely do not report the contextual environmental information necessary to best serve nearby communities in disaster response. Additionally, modern advancements in deep learning offer new approaches for image segmentation which may improve classification accuracy beyond current pixel-wise indices. In this work, we benchmark the performance of these modern segmentation techniques in locating both fire lines and environmental features in historical Autonomous Modular Sensor imagery. Furthermore, we augment these outputs with satellite imagery segmentation towards developing a robust contextual mapping tool for rapid emergency fire response and decision making.

Nikhil Behari↗

NASA NTRSDate not supplied

AssistTaxi: A Comprehensive Dataset for Taxiway Analysis and Autonomous Operations

The availability of high-quality datasets play a crucial role in advancing research and development especially, for safety critical and autonomous systems. This poster presents AssistTaxi, which is a comprehensive novel dataset which is a collection of images for runway and taxiway analysis. The dataset comprises of more than 300,000 frames of diverse and carefully collected data, gathered from Melbourne (MLB) and Grant-Valkaria (X59) general aviation airports. The importance of AssistTaxi lies in its potential to advance autonomous operations, enabling researchers and developers to train and evaluate algorithms for efficient and safe taxiing. Researchers can utilize AssistTaxi to benchmark their algorithms, assess performance, and explore novel approaches for runway and taxiway analysis. Additionally, the dataset serves as a valuable resource for validating and enhancing existing algorithms as well as facilitating innovation in autonomous operations for aviation. We also propose an initial approach to label the dataset using a contour based detection and line extraction technique.

Data Collection↗

DOE OSTI2017

Simulation of the RPI Reactor Critical Facility Core Using High-Fidelity Neutronics Code PROTEUS

The PROTEUS code is a high-fidelity three-dimensional (3D) deterministic neutron transport code developed by ANL under the DOE Nuclear Energy Advanced Modeling and Simulation (NEAMS) program. The code contains the SN2ND (second order discrete ordinates method) and two MOC transport solvers, MOCFE and MOCEX (first order methods of characteristics), based on unstructured finite element meshes which allow users to model complex or unconventional geometry reactor problems. Among the two MOC solvers which normally perform better than SN for heterogeneous geometry problems, MOCEX is based on a rigorous formulation using the two-dimensional (2D) MOC radially and the discontinuous Galerkin finite element method axially to overcome the drawbacks of MOCFE with the full 3D MOC representation which requires enormous memory and computational efforts. The Reactor Critical Facility (RCF), an open tank research reactor at the Rensselaer Polytechnic Institute (RPI), became operational in 1956 under the American Locomotive company and has been operating using low-enriched uranium fuel pins, which makes it the only university research facility to use fuel rods similar to operating commercial light water reactors (LWRs). This paper presents modeling and simulation results of the RCF using PROTEUS for code verification and validation which also supports an ongoing NEUP project in which a set of benchmark validation experiments for multiphysics coupling is being developed.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

DOE OSTI2016

High thermal stability and sluggish crystallization kinetics of high-entropy bulk metallic glasses

Metallic glasses are metastable and their thermal stability is critical for practical applications, particularly at elevated temperatures. The conventional bulk metallic glasses (BMGs), though exhibiting high glass-forming ability (GFA), crystallize quickly when being heated to a temperature higher than their glass transition temperature. This problem may potentially be alleviated due to the recent developments of high-entropy (or multi-principle-element) bulk metallic glasses (HE-BMGs). In this work, we demonstrate that typical HE-BMGs, i.e., ZrTiHfCuNiBe and ZrTiCuNiBe, have higher kinetic stability, as compared with the benchmark glass Vitreoy1 (Zr{sub 41.2}Ti{sub 13.8}Cu{sub 12.5}Ni{sub 10}Be{sub 22.5}) with a similar chemical composition. The measured activation energy for glass transition and crystallization of the HE-BMGs is nearly twice that of Vitreloy 1. Moreover, the sluggish crystallization region ΔT{sub pl-pf}, defined as the temperature span between the last exothermic crystallization peak temperature T{sub pl} and the first crystallization exothermic peak temperature T{sub pf}, of all the HE-BMGs is much wider than that of Vitreloy 1. In addition, high-resolution transmission electron microscopy characterization of the crystallized products at different temperatures and the continuous heating transformation diagram which is proposed to estimate the lifetime at any temperature below the melting point further confirm high thermal stability of the HE-BMGs. Surprisingly, all the HE-BMGs show a small fragility value, which contradicts with their low GFA, suggesting that the underlying diffusion mechanism in the liquid and the solid of HE-BMGs is different.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

DOE OSTI2023

Fission Product Yields: SCALE/ORNL Perspective [Slides]

This presentation covers a few key points. First and foremost, that ORIGEN is a consumer of FPY data. Secondly, TRITON and POLARIS are assets which can be used to validate new FPY data, e.g., from existing radiochemical benchmarks and new irradiation experiments. Lastly, this presentation finds that new capabilities with covariance data should be developed, and V and V methods and analysis are also needed for the covariance data.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2024

Cell-free bioelectrocatalytic platform for carbon dioxide reduction (Final Technical Report)

The University of Minnesota (UMN) EcoSynBio Team aimed to develop a cell-free, enzyme-based platform for the electro- biocatalytic conversion of CO2 into formate as a platform chemical for further upgrading. This type of bio electrocatalytic process delivers a clean product stream without the need for extensive separation from the electrolyte as in electrochemical synthesis and microbial processes. The reduction reaction is catalyzed by metal-dependent formate dehydrogenases (mFDHs) that are capable of efficient electrocatalytic CO2 reduction without the need of costly co-factors. The development of an efficient, scalable electrobiocatalytic process with high total turnover numbers and viable space time yields, however, was not without its challenges. The UM team has developed a protein-based scaffolding system that facilitates enzyme stabilization and attachment to electrodes along with electron transfer. Yet, although FDHs are highly promising enzymes for cell-free, electrobiochemical CO2 reduction, they are also greatly understudied and especially for applications in electrocatalysis. The UM team used the best described mFDH from Clostridium as its benchmark system and spent significant time and effort in attempting to replicate published data and finally, redesigned a recombinant production system for proper metal co-factor incorporation. The UM team has also identified a small set of new enzyme homologs from extreme microorganisms with superior stabilities that have yielded initial structural data for further engineering. In addition, a new bioelectrocatalytic reactor system has been developed that can be 3D printed and used for enzyme attachment to electrodes. In summary the project has generated critical basic information for the further development of this class of enzymes for the electricity driven reduction of CO2 into formate as platform chemical for upgrading into various other chemicals, including fuels.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2015

Advancing Inverse Sensitivity/Uncertainty Methods for Nuclear Fuel Cycle Applications

The inverse sensitivity/uncertainty quantification (IS/UQ) method has recently been implemented in the Inverse Sensitivity/UnceRtainty Estimator (INSURE) module of the AMPX cross section processing system [M.E. Dunn and N.M. Greene, “AMPX-2000: A Cross-Section Processing System for Generating Nuclear Data for Criticality Safety Applications,” Trans. Am. Nucl. Soc. 86, 118–119 (2002)]. The IS/UQ method aims to quantify and prioritize the cross section measurements along with uncertainties needed to yield a given nuclear application(s) target response uncertainty, and doing this at a minimum cost. Since in some cases the extant uncertainties of the differential cross section data are already near the limits of the present-day state-of-the-art measurements, requiring significantly smaller uncertainties may be unrealistic. Therefore, we have incorporated integral benchmark experiments (IBEs) data into the IS/UQ method using the generalized linear least-squares method, and have implemented it in the INSURE module. We show how the IS/UQ method could be applied to systematic and statistical uncertainties in a self-consistent way and how it could be used to optimize uncertainties of IBEs and differential cross section data simultaneously. We itemize contributions to the cost of differential data measurements needed to define a realistic cost function.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2024

Characterizing the multisectoral impacts of future global hydrologic variability

There is significant uncertainty in how global water supply will evolve in the future, due to uncertain climate, socioeconomic, and land use change drivers and variability of hydrologic processes. It is critical to characterize the potential impacts of uncertainty in future water supply given its importance for food and energy production. In this work, we introduce a framework that integrates stochastic hydrology and human-environmental systems to characterize uncertainty in future water supply and its multisector impacts. We develop a global stochastic watershed model and demonstrate that this model can generate a large ensemble of realizations of basin-scale runoff with global coverage that preserves the mean, variance, and spatial correlation of a historical benchmark. We couple this model with a well-known human-environmental systems model to explore the impacts of runoff variability on the water and agricultural sectors across spatial scales. We find that the impacts of future hydrologic variability vary across sectors and regions. Impacts are felt most strongly in the water and agricultural sectors for basins that are expected to have unsustainable water use in the future, such as the Indus River basin. For this basin, we find that the variability in future irrigation water withdrawals and irrigated cropland increase over time due to uncertainty in renewable water supply. We also use the Indus basin to show how our stochastic ensemble can be leveraged to explore the global multisector consequences of local extreme runoff conditions. This work introduces a novel technique to explore the propagation of future hydrologic variability across human and natural systems and spatial scales.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2017

UMAMI: A Recipe for Generating Meaningful Metrics through Holistic I/O Performance Analysis

I/O efficiency is essential to productivity in scientific computing, especially as many scientific domains become more data-intensive. Many characterization tools have been used to elucidate specific aspects of parallel I/O performance, but analyzing components of complex I/O subsystems in isolation fails to provide insight into critical questions: how do the I/O components interact, what are reasonable expectations for application performance, and what are the underlying causes of I/O performance problems? To address these questions while capitalizing on existing component-level characterization tools, we propose an approach that combines on-demand, modular synthesis of I/O characterization data into a unified monitoring and metrics interface (UMAMI) to provide a normalized, holistic view of I/O behavior. We evaluate the feasibility of this approach by applying it to a month-long benchmarking study on two distinct largescale computing platforms. We present three case studies that highlight the importance of analyzing application I/O performance in context with both contemporaneous and historical component metrics, and we provide new insights into the factors affecting I/O performance. By demonstrating the generality of our approach, we lay the groundwork for a production-grade framework for holistic I/O analysis.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2026

High Temperature High Vacuum Mechanical Property Assessment of Zirconium Nuclear Fuel Cladding

This report presents the mechanical characterization of a specific Zry-4 cladding batch serving as the foundation for a diverse range of fuel performance research at Oak Ridge National Laboratory (ORNL). This effort supports research needs for the U.S. Department of Energy (DOE), particularly regarding evaluating accident tolerant fuel (ATF) cladding coating concepts, expanding understanding of cladding response to loss-of-coolant accidents (LOCA) transients, refining post-critical heat flux (CHF) limits (t@T), and upcoming irradiation campaigns. The central objective was to define the baseline performance of the substrate Zircaloy-4 (Zry-4) material leveraged across ORNL Advanced Fuel Campaign (AFC) efforts through controlled high-temperature vacuum tensile testing. This work begins to address gaps in existing models where implementation based on nominal heat-treatment labels, such as stress relief annealed (SRA), often fail to capture the interplay of recovery, recrystallization, and grain growth. To quantify this, data was benchmarked against the Pacific Northwest National Laboratory (PNNL) stress strain model to determine where this material falls in comparison to assumed values for materials in the same heat treatment regime. Analysis of the tensile data revealed that this specific SRA batch exhibits a transitional microstructural state best described by an effective cold-work (CW) parameter of 0.09, diverging from the previous estimation of 0.5 for SRA materials. Additionally, comparative testing of Cr coated specimens demonstrated no distinct difference in axial strength relative to the bare substrate. This suggests that the strengthening benefits of Cr coatings observed in burst scenarios are driven by residual stress mechanisms acting solely in the hoop direction.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

DOE OSTI2022

Comprehensive Evaluation for Protective Coatings: Optical, Electrical, Photoelectrochemical, and Spectroscopic Characterizations

Numerous efficient semiconductors suffer from instability in aqueous electrolytes. Strategies utilizing protective coatings have thus been developed to protect these photoabsorbers against corrosion while synergistically improving charge separation and reaction kinetics. Recently, various photoelectrochemical (PEC) protective coatings have been reported with suitable electronic properties to ensure low charge transport loss and reveal the fundamental photoabsorber efficiency. However, protocols for studying the critical figures of merit for protective coatings have yet to be established. For this reason, we propose four criteria for evaluating the performance of a protective coating for PEC water-splitting: stability, conductivity, optical transparency, and energetic matching. We then propose a flow chart that summarizes the recommended testing protocols for quantifying these four performance metrics. In particular, we lay out the stepwise testing protocols to evaluate the energetics matching at a semiconductor/coating/(catalyst)/liquid interface. Finally, we provide an outlook for the future benchmarking needs for coatings.

36 MATERIALS SCIENCE↗

DOE OSTI2024

The Completion of Surrogate Testing for Low-Temperature TEX and a Look Towards the Future

To address the mounting need for below room temperature nuclear data validation, the Low-Temperature Thermal Epithermal eXperiments (LT-TEX) have been designed. Validation of low-temperature neutron cross sections is necessary to verify any operation at temperatures below room temperature which is typically observed in environments far from the equator. For example, a fissile material transportation truck may routinely observe ambient temperatures down to -40°C, which is the lower temperature bound of the normal conditions of transportation defined in the United States Title 10 Code of Federal Regulations §71.71c2. Additionally, sub-room temperature benchmarks can validate newly produced cross sections, that include novel thermal scattering laws, from North Carolina State University.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗