Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Benchmarking Software”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

RAG for FLAG: AI Assistance for a Physics Code

Artificial intelligence (AI) has quickly become an important tool in scientific research, where significant efforts are underway to develop tools that will expedite the research process. One area of particular impact is scientific software, which can be particularly complex, and therefore time consuming to learn and use effectively. AI assistants are increasingly helping to streamline the process by performing tasks such as interactively answering user questions or suggesting solutions. Los Alamos National Laboratory (LANL) develops several advanced scientific codes, such as FLAG, which can be used to run multiphysics simulations. With this study, our goal was to develop an AI assistant for FLAG that could help make the process of understanding the software and running physics simulations more efficient. To develop an AI assistant for FLAG, we used a method called retrieval-augmented generation (RAG), which is a technique that uses information from relevant data sources to enhance the accuracy of large language models (LLMs). We used the FLAG user manual and other FLAG documentation as the knowledge base for the RAG system. When a user provides a query, RAG retrieves relevant sections from the knowledge base in response, then uses those excerpts to generate grounded and contextually rich answers. We found that our AI assistant was able to provide context aware answers and source references to user queries. To evaluate performance, we developed a set of 40 benchmark questions and compared the accuracy of the responses to those of two standard LLMs without retrieval. Our AI assistant significantly outperformed the standard LLMs at answering FLAG-related questions, with an 82.5% accuracy rate, compared to 47.5% for both of the standard LLMs. This has the potential to make the process of learning and using FLAG much easier, especially for new users. Ultimately, it supports LANL’s broader mission by empowering scientists and engineers to focus more on discovery and analysis rather than on navigating complex software systems.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Verification and validation of the Alternative Nonlinear Two-phase Subchannel (ANTS) code

The Alternative Nonlinear Two-phase Subchannel solver (ANTS) code was written to provide a fast-running, steady-state, pin-resolved modeling and simulation tool for analysis of common boiling water reactor (BWR) geometry and common operating conditions. ANTS has been integrated into the Virtual Environment for Reactor Application (VERA) core simulator software, where it can be used to provide a thermal/hydraulic (T/H) subchannel solution that is then used to provide neutronic feedback as well as perform the fuel depletion and temperature solution. Herein, this paper presents the rigorous analysis performed on the ANTS code, which includes both code and solution verification testing, benchmarking with the existing two-phase subchannel capability in VERA, CTF, and validation testing using popular two-phase experiments such as PWR Sub-channel and Bundle Tests (PSBT), BWR Full-size Fine-mesh Bundle Tests (BFBT), Risø, and FRIGG. This assessment was used to qualify ANTS for its intended applications before its use for core-scale, multiphysics BWR simulations. In general, it was found that agreement with experimental data was good; errors were within the range of experimental data uncertainty. Furthermore, code and solution verification confirmed that the governing equations and the most important closure terms were correctly implemented and behaving as expected.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2021

Accelerating End-to-End Deep Learning for Particle Reconstruction using CMS open data

Machine learning algorithms are gaining ground in high energy physics for applications in particle and event identification, physics analysis, detector reconstruction, simulation and trigger. Currently, most data-analysis tasks at LHC experiments benefit from the use of machine learning. Incorporating these computational tools in the experimental framework presents new challenges. This paper reports on the implementation of the end-to-end deep learning with the CMS software framework and the scaling of the end-to-end deep learning with multiple GPUs. The end-to-end deep learning technique combines deep learning algorithms and low-level detector representation for particle and event identification. We demonstrate the end-to-end implementation on a top quark benchmark and perform studies with various hardware architectures including single and multiple GPUs and Google TPU.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2021

Accurate frozen core approximation for all-electron density-functional theory

We implement and benchmark the frozen core approximation, a technique commonly adopted in electronic structure theory to reduce the computational cost by means of mathematically fixing the chemically inactive core electron states. The accuracy and efficiency of this approach are well controlled by a single parameter, the number of frozen orbitals. Explicit corrections for the frozen core orbitals and the unfrozen valence orbitals are introduced, safeguarding against seemingly minor numerical deviations from the assumed orthonormality conditions of the basis functions. A speedup of over twofold can be achieved for the diagonalization step in all-electron density-functional theory simulations containing heavy elements, without any accuracy degradation in terms of the electron density, total energy, and atomic forces. This is demonstrated in a benchmark study covering 103 materials across the Periodic Table and a large-scale simulation of CsPbBr3 with 2560 atoms. Our study provides a rigorous benchmark of the precision of the frozen core approximation (sub-meV per atom for frozen core orbitals below −200 eV) for a wide range of test cases and for chemical elements ranging from Li to Po. The algorithms discussed here are implemented in the open-source Electronic Structure Infrastructure software package.

Yu, Victor Wen-zhe↗
DOE OSTI2020

An automatically curated first-principles database of ferroelectrics

Ferroelectric materials have technological applications in information storage and electronic devices. The ferroelectric polar phase can be controlled with external fields, chemical substitution and size-effects in bulk and ultrathin film form, providing a platform for future technologies and for exploratory research. In this work, we integrate spin-polarized density functional theory (DFT) calculations, crystal structure databases, symmetry tools, workflow software, and a custom analysis toolkit to build a library of known, previously-proposed, and newly-proposed ferroelectric materials. With our automated workflow, we screen over 67,000 candidate materials from the Materials Project database to generate a dataset of 255 ferroelectric candidates, and propose 126 new ferroelectric materials. We benchmark our results against experimental data and previous first-principles results. The data provided includes atomic structures, output files, and DFT values of band gaps, energies, and the spontaneous polarization for each ferroelectric candidate. Finally, we contribute our workflow and analysis code to the open-source python packages atomate and pymatgen so others can conduct analogous symmetry driven searches for ferroelectrics and related phenomena.

36 MATERIALS SCIENCE↗
DOE OSTI2021

blocks_3d: software for general 3d conformal blocks

We introduce the software blocks_3d for computing four-point conformal blocks of operators with arbitrary Lorentz representations in 3d CFTs. It uses Zamolodchikov-like recursion relations to numerically compute derivatives of blocks around a crossing-symmetric configuration. It is implemented as a heavily optimized, multi-threaded, C++ application. We give performance benchmarks for correlators containing scalars, fermions, and stress tensors. As an example application, we recompute bootstrap bounds on four-point functions of fermions and study whether a previously observed sharp jump can be explained using the “fake primary” effect. We conclude that the fake primary effect cannot fully explain the jump and the possible existence of a “dead-end” CFT near the jump merits further study.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2024

Integration of pH Control into Chi.Bio Reactors and Demonstration with Small-Scale Enzymatic Poly(ethylene terephthalate) Hydrolysis

Small-scale bioreactors that are affordable and accessible would be of major benefit to the research community. In previous work, an open-source, automated bioreactor system was designed to operate up to the 30 mL scale with online optical monitoring, stirring, and temperature control, and this system, dubbed Chi.Bio, is now commercially available at a cost that is typically 1–2 orders of magnitude less than commercial bioreactors. In this work, we further expand the capabilities of the Chi.Bio system by enabling continuous pH monitoring and control through hardware and software modifications. For hardware modifications, we sourced low-cost, commercial pH circuits and made straightforward modifications to the Chi.Bio head plate to enable continuous pH monitoring. For software integration, we introduced closed-loop feedback control of the pH measured inside the Chi.Bio reactors and integrated a pH-control module into the existing Chi.Bio user interface. We demonstrated the utility of pH control through the small-scale depolymerization of the synthetic polyester, poly(ethylene terephthalate) (PET), using a benchmark cutinase enzyme, and compared this to 250 mL bioreactor hydrolysis reactions. The results in terms of PET conversion and rate, measured both by base addition and product release profiles, are statistically equivalent, with the Chi.Bio system allowing for a 20-fold reduction of purified enzyme required relative to the 250 mL bioreactor setup. Through inexpensive modifications, the ability to conduct pH control in Chi.Bio reactors widens the potential slate of biochemical reactions and biological cultivations for study in this system, and may also be adapted for use in other bioreactor platforms.

09 BIOMASS FUELS↗
DOE OSTI2024

A Framework for Integrating Quantum Simulation and High Performance Computing

Scientific applications are starting to explore the viability of quantum computing. This exploration typically begins with quantum simulations that can run on existing classical platforms, albeit without the performance advantages of real quantum resources. In the context of high-performance computing (HPC), the incorporation of simulation software can often take advantage of the powerful resources to help scale-up the simulation size. The configuration, installation and operation of these quantum simulation packages on HPC resources can often be rather daunting and increases friction for experimentation by scientific application developers. We describe a framework to help streamline access to quantum simulation software running on HPC resources. This includes an interface for circuit-based quantum computing tasks, as well as the necessary resource management infrastructure to make effective use of the underlying HPC resources. The primary contributions of this work include a classification of different usage models for quantum simulation in an HPC context, a review of the software architecture for our approach and a detailed description of the prototype implementation to experiment with these ideas using two different simulators (TNQVM & NWQ-Sim). We include initial experimental results running on the Frontier supercomputer at the Oak Ridge Leadership Computing Facility (OLCF) using a synthetic workload generated via the SupermarQ quantum benchmarking framework.

Shehata, Amir [ORNL] (ORCID:0000000224531426)↗
DOE OSTI2021

VERIFICATION MEASUREMENTS OF THE MASS AND ENRICHMENT OF URANIUM OXIDE CARD SOURCES

Measurements were performed to determine the mass and enrichment of 10 uranium oxide (U3O8) card sources. The measurements and analysis were completed as a verification of the card sources in support of Oak Ridge National Laboratory’s nuclear material control and accountability program. Although these cards are not nationally accredited as a nuclear standard, they are used as a working reference for measurements, such as holdup. The uranium card source measurements were taken with a broad energy germanium detector and the Genie 2000 Gamma Acquisition and Analysis software. A complete characterization of each of the 10 uranium card sources was performed using the 4 characteristic full energy peaks of 235U. Using the In Situ Object Counting System software to determine the mathematical efficiency of the measurement, the mass of 235U in each card was determined. The 235U mass in each card ranged from 10.42 to 12.63 g with a systematic error between 0.76 and 0.95 g and a random error of 0.01 g for each card source. The Multi-Group Analysis for Uranium (MGAU) software and the Fixed-Energy, Response Function Analysis with Multiple Efficiency (FRAM) isotopic analysis software were used to determine the isotopic composition of the uranium cards. The measured enrichment was compared to the declared enrichment for each card, with uncertainties ranging from 2.7% to 4.3% for the MGAU analysis and 2.3% to 4.1% for the FRAM analysis. This is a good example of how a well-benchmarked mathematical calibration method can be useful in characterizing uranium sources.

Hunneke, Rachel↗
DOE OSTI2026

MixPI: Mixed-time slicing path integral software for quantized molecular dynamics simulations

We introduce the MixPI software to implement path integral molecular dynamics (PIMD) simulations for the study of condensed phase systems where nuclear quantum effects (NQEs) are important. In contrast to existing PIMD simulation software, MixPI enables the implementation of mixed quantum–classical path integral simulations where only a subset of system degrees of freedom (dofs) are treated quantum mechanically in an extended phase space while the remaining dofs are described classically. We expect this software to be particularly useful for simulations of electron and proton transfer in condensed phase systems, as well as for the study of biological and material systems where only a handful of dofs contribute significantly to the observed NQEs. We demonstrate the use of MixPI in two different systems. The first is a simple water model where we implement a set of mixed quantum–classical simulations to compute average energy and radial distribution functions. We use these simulations to benchmark the effectiveness of MixPI and to demonstrate how it enables systematic investigation into the origin of observed NQEs. We then compute radial distribution functions for a system where MixPI is essential: a solvated metal (M 2+ ) cation described using an explicit quantized electron localized on an M 3+ ion in water.

chemical physics↗
DOE OSTI2023

Abrasion-fission reactions at intermediate energies

The availability of high-intensity, heavy-ion beams coupled to sensitive, large solid-angle acceptance spectrometers has enabled a detailed examination of the fission fragments produced in induced-fission reactions. The abrasion fission process involves the formation of projectile-like prefragments in violent nuclear collisions at relative energies in excess of 100 MeV/u. At intermediate energies below this threshold, experiments suggest a change in the prefragment kinematic qualities. Information regarding the influence of this transitional phase upon the evolution of nuclei approaching the point of scission is scarce. In this article, data are presented for over 200 nuclei from nickel to palladium produced in abrasion-fission reactions of a 80 MeV/u 238 U beam. Cross sections were obtained following yield measurements performed for the principal charge states of the identified fission fragments and a detailed analysis of the ion transmission. A full kinematic analysis of the fission fragments has been performed using the LISE ++ software package, where the trajectory of an ion passing through a spectrometer can be reconstructed based upon measurements at the focal plane. Furthermore, the results obtained at the S800 spectrograph are compared with predictions obtained with a three-fission progenitor (3EER) model. Systematic studies of fission-fragment properties continue to provide a valuable experimental benchmark for theoretical efforts directed toward describing this complex decay channel, that is important in the context of planning experiments to explore the neutron-rich region of the nuclear chart at rare-isotope beam facilities.

59 ≤ A ≤ 8990 ≤ A ≤ 149↗
DOE OSTI2024

Status of SAS4A/SASSYS-1 Software Development and Application (FY2024)

SAS4A/SASSYS-1 is a simulation tool used to perform deterministic analysis of anticipated events as well as design basis and beyond design basis accidents for advanced liquid-metal-cooled nuclear reactors. With its origin as SAS1A in the late 1960s, the SAS series of codes has been under continuous use and development for over fifty years. It has been identified as a critical element of safety analysis capabilities for the U.S. Department of Energy and is utilized within industry to perform the transient safety analyses required to support the licensing of Liquid Metal-cooled Fast Reactors (LMFRs). This report summarizes the code development and update activities carried out during FY2024. In FY2024, programmatic activities focused on key improvements to software useability, such as enhanced user interfaces for reactivity feedback modeling, improvements in stability/useability of the Code Manual, and improvements to the acceptance testing infrastructure, including automation of acceptance testing and generation of the Acceptance Testing Report. To support end user applications, an open training was held, a semi-public forum was maintained, and a practical benchmarking and validation matrix was developed which allowed limitations of existing testing capabilities to be assessed. The existing fuel models were also enhanced with improved modeling capabilities and testing for the oxide and annular fuel models.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2020

Logic in Memory Emulator

Logic in Memory Emulator (LiME) is a hardware/software tool specially designed for memory system evaluation and experiment. Emerging memories display a wide range of bandwidths, latencies, and capacities, making it challenging for the computer architect to navigate the design space of potential memory configurations, and for the application developer to assess performance implications of using such memories. With the LiME framework, architectural ideas can be prototyped in great detail yet with sufficient performance to support realistic evaluation on long running applications. LiME consists of two fundamental components: 1) the hardware and OS infrastructure for the emulator, and 2) a suite of benchmark applications to assist in characterizing the performance of current and future computer architectures. Some of the applications have been collected from other open source projects. Uses: Logging, replay and analysis of an application's memory behavior Evaluate impact of emerging memory technology on application performance. Emulate complex memory interactions in whole applications orders of magnitude faster than software simulation. Emulate acceleration hardware co-located with the memory subsystem. Features: Capture and log external memory accesses to a separate off-chip memory device without affecting application execution. Memory traces include the address, length, timestamp, and optionally the data for each transaction. Captured trace data can be saved to an SD card for off-line analysis. Configure a wide range of memory latencies in sub-nanosecond increments that encompass highbandwidth and storage class memories. Specify regions of interest (ROI) in applications to reduce the amount of trace data captured for analysis. Currently supports execution on Xilinx Zynq SoC which integrates an ARM processor with FPGA logic on a single device. Applications can be run under Linux or in bare metal mode on the ARM cores.

Jain, AbhishekK↗
DOE OSTI2021

Efficient exascale discretizations: High-order finite element methods

Efficient exploitation of exascale architectures requires rethinking of the numerical algorithms used in many large-scale applications. These architectures favor algorithms that expose ultra fine-grain parallelism and maximize the ratio of floating point operations to energy intensive data movement. One of the few viable approaches to achieve high efficiency in the area of PDE discretizations on unstructured grids is to use matrix-free/partially assembled high-order finite element methods, since these methods can increase the accuracy and/or lower the computational time due to reduced data motion. In this paper we provide an overview of the research and development activities in the Center for Efficient Exascale Discretizations (CEED), a co-design center in the Exascale Computing Project that is focused on the development of next-generation discretization software and algorithms to enable a wide range of finite element applications to run efficiently on future hardware. CEED is a research partnership involving more than 30 computational scientists from two US national labs and five universities, including members of the Nek5000, MFEM, MAGMA and PETSc projects. We discuss the CEED co-design activities based on targeted benchmarks, miniapps and discretization libraries and our work on performance optimizations for large-scale GPU architectures. We also provide a broad overview of research and development activities in areas such as unstructured adaptive mesh refinement algorithms, matrix-free linear solvers, high-order data visualization, and list examples of collaborations with several ECP and external applications.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Benchmarking state-of-the-art theory and empirical models of pionless neutrino-argon scattering in GENIE

Upcoming experiments need improved simulations of neutrino scattering. This work uses the popular GENIE event generator to test a variety of neutrino interaction models against recent MicroBooNE measurements of pionless charged-current interactions. The GENIE code can easily interchange model components, including nucleon form factor parameterizations, quasielastic cross-section calculations, treatments of the nuclear ground state and hadronic final-state interactions. Leveraging this software capability in comparisons with MicroBooNE data, the performance of some of GENIE’s most theoretically sophisticated model components is evaluated and contrasted with more empirically-driven alternatives.

Neutrino cross section↗
DOE OSTI2021

A Step Towards the Final Frontier: Lessons Learned from Acceptance Testing of the First HPE/Cray EX 3000 System at ORNL

In this paper, we summarize the deployment of the Air Force Weather (AFW) HPC11 system at Oak Ridge National Laboratory (ORNL) including the process followed to successfully complete acceptance testing of the system. HPC11 is the first HPE/Cray EX 3000 system that has been successfully released to its user community in a federal facility. HPC11 consists of two identical 800-node supercomputers, Fawbush and Miller, with access to two independent and identical Lustre parallel file systems. HPC11 is equipped with Slingshot 10 interconnect technology and relies on the HPE Performance Cluster Manager (HPCM) software for system configuration. ORNL has a clearly defined acceptance testing process used to ensure that every new system deployed can provide the necessary capabilities to support user workloads. We worked closely with HPE and AFW to develop a set of tests that used the United Kingdom’s Meteorological Office’s Unified Model (UM) and 4DVAR. We also included benchmarks and applications from the Oak Ridge Leadership Computing Facility (OLCF) portfolio to fully exercise the HPE/Cray programming environment and evaluate the functionality and performance of the system. Acceptance testing of HPC11 required parallel execution of each element on Fawbush and Miller. In addition, careful coordination was needed to ensure successful acceptance of the newly deployed Lustre file systems alongside the compute resources. In this work, we present test results from specific system components and provide an overview of the issues identified, challenges encountered, and the lessons learned along the way.

Melesse Vergara, Veronica↗
DOE OSTI2023

TRANSLATE - a Monte Carlo simulation of electron transport in liquid argon

Here, the microphysics of electron and photon propagation in liquid argon is a key component of detector design and calibrations needed to construct and perform measurements within a wide range of particle physics experiments. As experiments grow in scale and complexity, and as the precision of their intended measurements increases, the development of tools to investigate important microphysics effects impacting such detectors becomes necessary. In this paper we present a new time-domain Monte Carlo simulation of electron transport in liquid argon. The simulation models the TRANSport in Liquid Argon of near-Thermal Electrons (TRANSLATE) with the aim of providing a multi-purpose software package for the study and optimization of detector environments, with a particular focus on ongoing and next generation liquid argon neutrino experiments utilizing the time projection chamber technology. TRANSLATE builds on previous work of Wojcik and Tachiya, amongst others, introducing additional processes, including ionization, thus modeling the full range of drift electron scattering interactions. The simulation is validated by benchmarking its performance with swarm parameters from data collected in experimental setups operating in gas and liquid.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2024

From Sim to Real: A Pipeline for Training and Deploying Traffic Smoothing Cruise Controllers

Designing and validating controllers for connected and automated vehicles to enhance traffic flow presents significant challenges, from the complexity of replicating real-world stop-and-go traffic dynamics in simulation, to the intricacies involved in transitioning from simulation to actual deployment. In this work, we present a full pipeline from data collection to controller deployment. Specifically, we collect 772 km of driving data from the I-24 in Tennessee, and use it to build a one-lane simulator, placing simulated vehicles behind real-world trajectories. Using policy-gradient methods with an asymmetric critic, we improve fuel efficiency by over 10% when simulating congested scenarios. Our comprehensive approach includes reinforcement learning for controller training, software verification, hardware validation and setup, and navigating various sim-to-real challenges. Furthermore, we analyze the controller's behavior and wave-smoothing properties, and deploy it on four Toyota Rav4’s in a real-world validation experiment on the I-24. Lastly, we release the driving dataset, the simulator and the trained controller, to enable future benchmarking and controller design.

42 ENGINEERING↗