Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “virtual laboratories”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 505 records · Page 28

Final Reports of the 2021 Los Alamos National Laboratory Computational Physics Student Summer Workshop

Since 2011, the Los Alamos National Laboratory Computational Physics Student Summer Workshop has been bringing together a highly talented and diverse group of students every summer. Students work in teams of two, alongside typically two mentors, on research projects reflecting a broad range of topics within computational physics. In addition, students attend a series of lectures on topics within computational physics, facility tours, and networking events. The program lasts ten weeks, with this year’s workshop running from June 7 to August 13. At the end of the summer, students give a final presentation, along with a written report. Those reports are what make up the remaining sections of this document. Admission to the workshop is by a competitive process, with the mentors forming the selection committee. One of the important accomplishments of the workshop has been to create a student pipeline from diverse schools that sometimes are not normally tapped by LANL recruiting. Many workshop students maintain a continuing relationship with LANL, returning as student interns, post-doctoral researchers, and staff members. Additionally, workshop alumni act as ambassadors for LANL. The result is a wider awareness both of LANL as a potential employer, and of the technical work that happens at LANL. This year, the workshop was once again in an off-site, virtual format. Students worked on LANL virtual desktop systems remotely, also accessing LANL HPC resources. In order to facilitate communication, student were given accounts on both Webex, a video teleconferencing platform, and Mattermost, an online team collaboration and chat platform, similar to Slack. Daily communication between students and mentors was primarily on Mattermost, with Webex conferencing as needed. The lectures were all done on Webex. Given the difficulty of the virtual format, and a concern that students might have video teleconferencing burn-out, all lectures were optional this year. In spite of this, the attendance was generally high. Lecturers were asked to try to move to a more high-level, ”What is it?,” format. Once again, the students did a tremendous job. Over the course of ten weeks, they did important research across a staggering array of disciplines. The following pages contain the final report for each team’s research efforts. Enjoy!

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

Small-𝑥 gluon GPD constrained from deeply virtual 𝐽/𝜓 production and gluon PDF through universal-moment parametrization

We phenomenologically constrain the small-𝑥 and small-𝜉 gluon generalized parton distributions (GPDs) with the deeply virtual 𝐽/𝜓 production (DV⁢𝐽/𝜓⁢P) in the framework of GPDs through universal moment parameterization (GUMP). We use a hybrid cross-section formula combining collinear factorization to the next-to-leading order (NLO) accuracy of the strong coupling 𝛼 𝑠 , with corrections from nonrelativistic QCD to account for the power corrections due to the heavy 𝐽/𝜓 mass. We reach reasonable fit to the measured differential cross sections of DV⁢𝐽/𝜓⁢P by H1 at the Hadron-Electron Ring Accelerator as well as forward gluon parton distribution functions (PDFs) from JAM22 global analysis. We find that both NLO and nonrelativistic corrections are significant for heavy vector meson productions. Of course, the gluon GPD we obtain still contains considerable freedom in need of inputs from other constraints, particularly in the distribution-amplitude-like region.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

IRMA

IRMA (In)elastic Representation of Materials As S(α,β) evaluations IRMA turns one phonon model into three outputs that usually require three separate tool chains: an evaluated nuclear-data file, predicted neutron-scattering spectra, and scattering kernels for Monte Carlo transport. The three outputs draw on a single, consistent description of the material, so the evaluation, the spectroscopy that can validate it, and the transport that uses it always agree about the physics. Nuclear data. IRMA writes ENDF-6 File 7 thermal scattering evaluations on automatically constructed (α, β) grids. This part reimplements and generalizes NJOY's LEAPR: the classic kernels reproduce freshly generated NJOY2016 tapes digit for digit and published reference tapes to about 1e-4, and the generalized paths add the exact coherent one-phonon term, anisotropic Debye-Waller tensors, coherent elastic for arbitrary crystals, and a per-species partition for polyatomic materials. The tapes feed NJOY, AMPX, FUDGE, and every transport code downstream of them. Neutron spectroscopy. The irma.spectra forward model projects the same physics onto an instrument's kinematics and resolution: INS spectra for VISION and generic indirect geometries, and 2-D S(Q,E) powder maps for direct-geometry spectrometers, from a phonopy model or straight from a phonon DOS. It can be used to predict a proposed measurement before beam time; in analysis, it supplies the calculated single-scattering counterpart of a measured spectrum, from the same material description the evaluation was built from. Monte Carlo transport. The irma.ncrystal exporter writes per-temperature scattering kernels for the companion NCrystal plugin, so McStas, OpenMC, and other NCrystal-aware codes sample the same physics. The exported kernels carry the per-site anisotropic Debye-Waller tensors, keeping directional coherent-elastic physics that NCrystal's standard scalar treatment does not represent. With the same physics inside a transport code, an entire beamline becomes a virtual experiment: IRMA's end-to-end validation ran a custom McStas implementation of the ARCS spectrometer, assembled from the existing McVine and McStas models, against measured data. From a bare crystal structure. The irma mlip front end builds the phonon model itself: a structure file and a choice of potential are enough. Nine pretrained machine-learned interatomic potentials are supported, on a laptop CPU, with no first-principles calculation; an approximate phonon model for a new material costs minutes, not a DFT campaign, and the build emits prefilled inputs for all three outputs. The result is a good starting point rather than a finished evaluation: survey-quality physics with every parameter exposed for review. A converged atomistic calculation enters the same way, as a phonopy model, when higher fidelity is needed.

Ramic, Kemal [Oak Ridge National Laboratory (ORNL)↗

Zooming in on virtual commutes: Telecommuting impacts on mobility and sustainability

Motivated by a societal shift towards remote work and rapid advancement in information and communication technologies, this study examines the impact of telecommuting on urban mobility across the nine counties of the San Francisco Bay Area, California. Utilizing a behaviorally realistic integrated agent-based transportation model and recent data on telecommuting patterns, we simulate the impact of multiple telecommuting scenarios on transportation system outcomes. This provides a comprehensive picture of the impact of remote work on travel costs and accessibility of all travelers, factoring in changes in mode use and congestion. We analyze how telecommuting influences broader societal factors such as transportation energy consumption. Our findings indicate that increased telecommuting reduces overall person miles traveled and transportation energy consumption. Furthermore, telecommuting results in externality benefits by improving accessibility and reducing commute times for non-telecommuters.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Metal–bicarbonate ion pairing in alkaline aqueous solutions from multilevel embedded correlated wavefunction theory and molecular dynamics

In this work, we examine ion-pairing mechanisms of bicarbonates in alkaline aqueous solutions with the divalent metal ions most abundantly present in seawater, namely, Ca 2+ and Mg 2+ . We employ a rare-event enhanced sampling approach within first-principles molecular dynamics to explore regions of phase space spanning solvent-shared to contact ion pairs. Second-order Møller–Plesset perturbation theory (MP2) corrections are subsequently applied in an embedding framework (EMB) to refine the electronic structure of stationary states and associated reaction barriers along the free-energy profiles while retaining the extended solvent effects at the density functional theory (DFT) level. Ca 2+ –HCO 3 − was previously hypothesized to exist in a solvent-shared ion pair (SSHIP) by DFT studies with an endergonic contact ion pair (CIP) formation; however, our EMB-MP2 refinement of the DFT ion-pairing pathways reveals that Ca 2+ and HCO 3 − form a virtually barrier-free CIP in alkaline solutions, with even more energetic ease than the widely studied Ca–CO 3 ion pair. We find qualitative agreement between DFT and EMB-MP2 for Mg 2+ —unlike Ca 2+ , Mg 2+ refuses to shed its strong hydration shell, thereby preferring a SSHIP state with a significant activation barrier to crossover to the CIP forms—a trait reminiscent of ion pairing in Mg–CO 3 and closely related to the kinetic limitations underlying the famous subject of the dolomite problem. Our study highlights the importance of improved electronic structure descriptions of liquids, modeled as a condensed phase of matter lacking in long-range crystalline order. It also strongly suggests that Ca 2+ –HCO 3 − CIPs are likely precursors involved in prenucleation of CaCO 3 mineral formation in seawater.

Sharma, Vidushi [Princeton Plasma Physics Laborato↗

A strategy for automated core design to increase economic viability and minimize fuel fragmentation, relocation, and dispersal susceptibility in high-burnup cores

The nuclear industry aims to increase the cycle length of pressurized water reactors from 18 to 24 months to increase power plant capacity factors and economic viability. These cycle length extensions will inherently require fuel rods to exceed the current peak rod average burnup limit of 62 GWd/MTU. A chief concern of operating beyond the current burnup limit is the fuel fragmentation, relocation, and dispersal (FFRD) phenomenon in which pulverized fuel fragments can axially relocate and escape through a burst in the cladding formed during a loss-of-coolant accident. In this work, we demonstrate an approach for automating core design employing an optimization tool based on a penalty-free, parallel simulated annealing algorithm to produce pressurized water reactor core designs with two different optimization objectives. The two objectives were to produce core designs with (1) mitigated FFRD susceptibility while achieving 24-month cycle lengths (2) maximum cycle length with no regard for the likelihood of FFRD. Batch size was considered in tandem with both cases to maximize economic viability. The PARCS nodal model was the primary reactor physics tool used in the optimizations and used nuclear cross sections calculated with 2D Polaris lattice physics models. Reactor performance and safety characteristics of the optimized cores were verified using high-fidelity Virtual Environment for Reactor Applications models. The core designs produced by the optimization tool are compared with each other and to a high-burnup core design produced and analyzed in previous works to highlight the fuel management strategies that may enhance high-burnup reactor safety and economic viability. The optimized cores satisfied their respective objective functions, producing a maximum cycle length of 720 effective full-power days in one core design and one that may reduce FFRD susceptibility by up to 50% based on the first-order approximation to FFRD risk formulated in this work. The optimized cores met most constraints but exceeded the hot channel factor limit, especially in FFRD cases where fresh fuel carried more power. Furthermore, this highlights the need for future lattice-level optimizations and broader assembly options.

Cycle length↗

Distribution System Blackstart and Restoration Using DERs and Dynamically Formed Microgrids

Extreme weather events have led to long-duration outages in the distribution system (DS), necessitating novel approaches to blackstart and restore the system. Existing blackstart solutions utilize blackstart units to establish multiple microgrids (MGs), sequentially energize non-blackstart units, and restore loads. However, these approaches often result in isolated MGs. In DERs-aided blackstart, the continuous operation of these MGs is limited by the finite energy capacity of commonly used blackstart units like battery energy storage (BES)-based gridforming inverters (GFMIs). To address this issue, this article proposes a holistic blackstart and restoration framework that incorporates synchronization between dynamic MGs and the entire DS with the transmission grid (TG). To support synchronization, we leveraged virtual synchronous generator-based control for GFMIs to estimate their frequency response to load pick-up events using only initial/final quasi-steady-state points. Subsequently, a synchronization switching condition is developed to model synchronizing switches, aligning them seamlessly with a linearized branch flow problem. Finally, we designed a bottomup blackstart and restoration framework that considers the switching structure of the DS, energizing/synchronizing switches, DERs with grid-following inverters, and BES-based GFMIs with frequency security constraints. In conclusion, the proposed framework is validated in IEEE-123-bus system, considering cases with two and four GFMIs under various TG recovery instants.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Mass Spectrometer Transient Analysis

This software implements a complete preprocessing pipeline for transient mass spectrometry (MS) data collected during TAP (Temporal Analysis of Products) experiments. It is designed to extract chemically meaningful fluxes from overlapping ion signals by applying a calibrated defragmentation matrix and solving the resulting linear system using non-negative least squares (NNLS) regression. The core script, preprocess_mass_spec.py, performs the following operations: Gain correction: Applies amplifier gain scalars derived from inert-packed calibration pulses to normalize signal intensities across AMUs and acquisition settings. Background subtraction: Removes experiment baselines using user-defined time windows, ensuring compatibility with slow-diffusing species and preventing negative values that would interfere with NNLS. Options to subtract before and after defragmentation. Defragmentation: Constructs a fragmentation matrix A from zeroth moments of calibration pulses (equal molar gas:inert mixtures) and solves Ax=b at each time point, where b is the raw MS signal and x is the estimated species flux. The matrix is normalized to inert signals and accounts for instrument-specific fragmentation behavior. Pulse-mode handling: Supports both averaged and individual pulse modes, enabling statistical treatment of fluxes and calculation of standard deviations. Integration and output: Computes zeroth moments (integrated fluxes) and exports time-resolved and integrated data in CSV format, suitable for downstream kinetic modeling. The software is validated using both virtual TAP simulations (VTAP) and experimental data from propane dehydrogenation (PDH) on CrOx/Al2O3 catalysts. It preserves temporal resolution by applying NNLS point-by-point across the pulse duration (typically 6,000+ time slices per pulse), leveraging the linear superposition principle to reconstruct full flux profiles. The defragmented outputs are compatible with kinetic extraction methods such as the G and Y procedures, which are used to derive rate–concentration relationships from TAP data. The details of these validations are discussed in detail in the supporting manuscript and supporting information. Example data and output files are also included. The methodology is robust to experimental noise and drift, with calibration protocols that account for pulse size effects, MS aging, and inert gas normalization. The software is modular, reproducible, and tailored for high-throughput TAP-MS workflows in catalysis research.

Kristy, Stephen [Idaho National Laboratory (INL), ↗

Bayesian inference analysis of jet quenching using inclusive jet and hadron suppression measurements

The JETSCAPE Collaboration reports a new determination of the jet transport parameter $\hat{q}$ in the quark-gluon plasma (QGP) using Bayesian inference, incorporating all available inclusive hadron and jet yield suppression data measured in heavy-ion collisions at the BNL Relativistic Heavy Ion Collider (RHIC) and the CERN Large Hadron Collider (LHC). This multi-observable analysis extends the previously published JETSCAPE Bayesian inference determination of $\hat{q}$, which was based solely on a selection of inclusive hadron suppression data. jetscape is a modular framework incorporating detailed dynamical models of QGP formation and evolution, and jet propagation and interaction in the QGP. Virtuality-dependent partonic energy loss in the QGP is modeled as a thermalized weakly coupled plasma, with parameters determined from Bayesian calibration using soft-sector observables. This Bayesian calibration of $\hat{q}$ utilizes active learning, a machine-learning approach, for efficient exploitation of computing resources. The experimental data included in this analysis span a broad range in collision energy and centrality, and in transverse momentum. In order to explore the systematic dependence of the extracted parameter posterior distributions, several different calibrations are reported, based on combined jet and hadron data; on jet or hadron data separately; and on restricted kinematic or centrality ranges of the jet and hadron data. Tension is observed in comparison of these variations, providing new insights into the physics of jet transport in the QGP and its theoretical formulation.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Toward virtual thin-beam 𝜈 cross-section measurements: A feasibility study of 𝜈-Ar interaction analysis with DUNE-PRISM

Neutrino-nucleus cross section measurements are critical for future neutrino oscillation analyses. However, our models to describe them require further refinement, and a deeper understanding of the underlying physics is essential for future neutrino oscillation experiments to realize their ambitious physics goals. Current neutrino cross section measurements provide clear deficiencies in neutrino interaction modeling, but almost all are reported averaged over broad neutrino fluxes, rendering their interpretation challenging. Using the concept of deep underground neutrino experiment-precision reaction independent spectrum measurement (DUNE-PRISM)—a movable near detector that samples multiple off axis positions—neutrino interaction measurements can be used to construct narrow virtual fluxes (less than 100 MeV wide). These fluxes can be used to extract charged-current neutrino-nucleus cross sections as functions of outgoing lepton kinematics within specific neutrino energy ranges. Based on a dedicated simulation with realistic event statistics and flux-related systematic uncertainties, but assuming an almost-perfect detector, we run a feasibility study demonstrating how DUNE-PRISM data can be used to measure muon neutrino charged-current integrated and differential cross sections over narrow fluxes. We find that this approach enables a largely model-independent reconstruction of powerful observables, including energy transfer, typically accessible only in electron scattering measurements, but that large exposures may be required for differential cross section measurements with few-percentage statistical uncertainties.

Neutrino interactions↗

EPCAPE-PT-LANL Measurements: Scanning Mobility Particle Sizer

Coastal cities offer a unique environment for studying aerosol-cloud interactions and the effects of urban emissions on cloud properties. As part of the Eastern Pacific Cloud Aerosol Precipitation Experiment (EPCAPE), the Partitioning Thrust by Los Alamos National Laboratory (EPCAPE-PT-LANL) was conducted. Our campaign focused on measuring the optical and chemical properties of aerosols and their interactions within marine stratocumulus clouds in La Jolla, California. EPCAPE-PT-LANL enhances the primary goals of EPCAPE through innovative observations of vapor-phase transitions between aerosols and cloud droplets, the impact of black carbon on aerosol-cloud dynamics, and the effects of cloud processing on aerosol optical properties. Instrument: Scanning Mobility Particle Sizer (TSI), DMA Classifier Model 3082 + CPC Detector Model 3752. Data Notes: The SMPS dataset is limited due to necessary instrument maintenance and subsequent extensive downtime. Data is only available from October 21 to November 8, 2023. Post November 22, 2023, the NanoScan instrument provided coverage for the latter half of the campaign. To ensure consistency, the data was resampled into uniform size bins ranging from 15 nm to 667 nm. This adjustment was required due to changes in size bins and the maximum diameter that occurred after maintenance and repairs. Multiple Charge Correction applied, Nanoparticle Agglomerate Mobility Analysis not applied, and Diffusion Correction applied. Header: - List [15 nm to 667 nm] middle of the size bin in nanometers: Data reports the concentration particles in this size bin per cubic centimeter, dN/dLog(dp). - CVI_Flag[bool]: A boolean flag indicating whether the Counterflow Virtual Impactor (CVI) was active (true) or inactive (false) during the measurement.

54 ENVIRONMENTAL SCIENCES↗

Computing virtual dark-field X-ray microscopy images of complex discrete dislocation structures from large-scale molecular dynamics simulations

Dark-field X-ray microscopy (DFXM) is a novel diffraction-based imaging technique that non-destructively maps the local deformation from crystalline defects in bulk materials. While studies have demonstrated that DFXM can spatially map 3D defect geometries, it is still challenging to interpret DFXM images of the high-dislocation-density systems relevant to macroscopic crystal plasticity. This work develops a scalable forward model to calculate virtual DFXM images for complex discrete dislocation structure(s) (DDS) obtained from atomistic simulations. Our new DDS-DFXM model integrates a non-singular formulation for calculating the local strain from the DDS and an efficient geometrical optics algorithm for computing the DFXM image from the strain field. We apply the model to complex DDS obtained from a large-scale mol­ecular dynamics simulation of compressive loading on single-crystal silicon. Simulated DFXM images exhibit prominent contrast for dislocation features between the multiple slip systems, demonstrating the potential of DFXM to resolve features from dislocation multiplication. In conclusion, the integrated DDS-DFXM model provides a toolbox for DFXM experimental design and image interpretation in the context of bulk crystal plasticity for a range of measurements across shock plasticity and the broader materials science community.

X-ray imaging↗

Risk Importance Ranking of Fire Data Parameters to Enhance Fire PRA Model Realism

Fire is historically and analytically a significant contributor to nuclear power plant risk. The level of fire risk and the methods, tools and data for modeling this risk is highly debated by experts. One area of debate is the input data used in fire modeling and how to deal with this data’s high uncertainty. This report outlines initial work performed for determining the key parameters causing this uncertainty and how it propagates into nuclear power plant models. This research paves the way for the development of methods to reduce fire data uncertainty used in modeling. The Nuclear Regulatory Commission has mandated that nuclear power plants perform fire risk modeling. However, there are several issues with the current risk modeling implementation that affect the results. Approved modeling methods can be overly conservative and often do not match plant experience. Also, the data used in the modeling can have high uncertainties and is influenced by expert judgement. To evaluate input data uncertainty, researchers performed an initial review of several fire experiments done at Sandia National Laboratories. Uncertainties for fire data can come from many sources, such as experiment design constraints, environmental conditions, or other plant-specific aspects. There are many different significant and insignificant parameters driving the uncertainty. Additionally, the uncertainty of the different input data used in the fire modeling could have a significant or insignificant effect on the entire plant risk. A four-step methodology was developed to perform Integrated Probabilistic Risk Assessment Importance Ranking. A demonstration case using these steps was set up and three of the four steps were completed in fiscal year (FY) 2019 and the fourth step done FY 2020. These steps are: 1. The qualitative analysis of potential sources was conducted with the following items identified for the demonstration. • Maximum heat release rate • Time to maximum heat release rate • Duration of max heat release rate • Time to decay • Thermal conductivity of concrete • Specific heat of concrete • Density of concrete • Cable jacket thickness 2. A quantitative characterization of dominant sources of uncertainty was performed. A list of distributions and determined values of the dominant sources is shown in Appendix A. 3. A quantitative screening of the potential sources of uncertainty using Morris Elementary Effects Analysis was completed. An experimental model using the physics-based fire modeling tool Fire Dynamics Simulator was developed and coupled with the Risk Analysis Virtual Environment. The Morris analysis identified at least two parameters that can be eliminated as significant contributors (specific heat of concrete and cable jacket thickness). 4. Global importance measure (Global IM) analysis to generate a comprehensive ranking based on their influence on the plant risk. In this research, a moment-independent Global IM is used since it can address (a) uncertainty in the input parameters of the fire model, (b) uncertainty in the risk outputs, and (c) non-linearity and interactions among input parameters in the fire model, more accurately than the correlation-based and variance-based global methods. The observations from the research showed that, depending on the initial and boundary conditions of the fire scenarios, fire-induced damage could have a very small probability and could be dominated by the tail of the uncertainty distribution; hence, the accuracy of the correlation-based and variance-based methods is questionable. The moment-independent Global IM analysis in this research provides a better understanding of how experimental uncertainty data affects industry’s plant models and where improvements in that data will have the largest benefit for improving fire modeling accuracy in causing core damage. Among the five unscreened parameters obtained from the Morris EE analysis, the Global IM analysis results for the case study indicated that max heat release rate and fire location are the most important parameters. The report also outlines benefits of using a unified computational platform that integrates the underlying simulations (e.g., a fire progression model), quantitative screening (using the Morris EE method), and the Global IM analysis. A unified platform can (i) facilitate the ranking of input parameters considering multiple key fire scenarios simultaneously, rather than considering one scenario at a time, (ii) contribute to more explicit and accurate treatment of dependencies at multiple levels of Fire PRA, (iii) facilitate the sampling-based uncertainty quantification for Fire PRA, and (iv) help generating both “industry-wide” and "plant-specific" ranking of uncertainty sources in Fire PRA. Future research should be done to include additional parameters such as detection/suppression or cable fire spread. Adding a PRA software such as SAPHIRE to the RAVEN platform would help with plant model integration and improve treatment of fire-induced dependency. The I-PRA risk importance ranking methodology offered in this report can provide valuable information for efficiently (a) enhancing the realism of Fire PRA for existing plants and (b) supporting the development of Dynamic Fire PRA for advanced reactors and new plants.

97 MATHEMATICS AND COMPUTING↗

AI Model Benchmarking for Nonproliferation Applications: Steel Thread Benchmarking Task Force Technical Report (Rev. 2)

Steel Thread is a NA-22 venture that seeks to build trustworthy, reliable AI models that can be used in a wide variety of nonproliferation tasks. A key aspect of building these models is developing appropriate benchmarks and evaluation methods, which will enable the venture to identify and adapt models to provide the most value in the nonproliferation domain. Benchmarks must be relevant to key tasks in this domain, such as question answering, information retrieval, document summarization and classification, consensus analysis, and image and data analysis. This report 1) provides an overview of benchmark design, evaluation, and challenges; 2) reviews a variety of open benchmarks, with a focus on language models and tasks; and 3) identifies benchmarks that are most relevant to Steel Thread. This report is intended to serve as a basis for further efforts to classify and evaluate benchmarks and their correlation with success on nonproliferation-specific tasks. The Steel Thread venture has defined benchmarks to be a particular combination of a dataset (or datasets) and a metric (or metrics) conceptualized as representing one or more specific tasks or sets of abilities for a specific modality. It is adopted by a research community as a shared framework for comparing methods.1 It includes 1) Data: Labeled (a designated subset not used for training, which could be all the data), 2) Metric: A way to quantify performance, 3) Task/Ability: What the benchmark is testing, 4) Protocol: A structured and repeatable evaluation process, 5) Baseline/Reference Model: For comparison; could be statistical, rule-based, SME-derived, or another model, and 6) Maintenance Plan: to update with new information over time; important for long-term utility. For further clarity, the definition includes what a benchmark, in this context, is not. It is not a corpus of training data, specific to a model (it is intended to apply to a range of models), a universal evaluation of performance, a guarantee that the ‘top’ model on the leaderboard will be the best fit for every specific use case, an all-encompassing proof of a model’s universal quality, nor is it a one-size-fits-all measure of success. It does not cover every real-world constraint (like operational, ethical, or cost considerations), a systems integration test, or a unit test. This definition was inspired by and resulted from discussions within the Steel Thread Benchmarking Task Force. This group was formed to define what we would mean as a benchmark within Steel Thread but persisted as the need to develop a thorough understanding of the large and expanding existing benchmarking space. This technical report is a result of the group’s divide and conquer approach to exploring this space. The release of benchmarks might not be progressing as quickly as model development, but it is moving very fast, as many benchmarks quickly become saturated, when state-of-the-art models score so close to the benchmark’s ceiling that their results are virtually indistinguishable. At that point, the test no longer differentiates between new systems, so researchers usually stop reporting scores as the benchmark no longer informs about improvements from the next generation of models. In the OpenAI announcement of GPT-5, they reported results on six flagship public benchmarks (AIME 2025, SWE-bench Verified, Aider Polyglot, MMMU, HealthBench Hard, GPQA) but the full system-card covers roughly thirty-five separate evaluations, comprising hundreds of test task items in total. There have been some efforts to summarize benchmarks in specific fields, like for text-to-image generation, but these surveys have had a narrow methodology scope. Therefore, a comprehensive survey of all benchmarks or even all benchmarks that could be relevant to Steel Thread is outside of the scope of this report. We chose some specific benchmarks to investigate in detail.

97 MATHEMATICS AND COMPUTING↗

The Next Stage for Smart Cities: Metrics to Spur an Evolution from Technology for Efficiency to Technology for People's Needs

The Smart Cities movement is about a decade old, energized by the USDOT Smart Cities grant that sparked cities to dream big. Now, 10 years later, and multitudes of conferences and papers later, the biggest question regarding Smart Cities is whether any progress has been made? Smart Cities forums are typically led by the technology sector, either telecommunications, internet access, or most recently artificial intelligence (AI) concerns. Each of these areas have grown and found new applications in the context of Smart Cities, however, these technology applications are just tools toward ends. Do digital communications and assistance enable or foster improved access to real, tactile, non-virtual goods and services such as transportation, food, housing, trash removal, health care, education, social interaction? These and other topics are not 'big tech', but are each critical to quality of life outcomes and are day-to-day necessities, comprising many of the touch points through which citizens interact with municipal agencies. Regarding Smart Cities, relationships have not been fully refined as to how best to merge the emerging generation of technology and related trends with more mundane but essential requirements of tactile services. How should municipal managers and operators bring the range of new technology tools (e.g. on-demand transit, automated vehicles, digital connectivity) to bear to improve functions serving real- physical- non-virtual needs? How do we make cities more efficient in providing access to services and opportunities for improved quality of life? This paper examines the current Smart City movement, emerging trends, and the need to put metrics with respect to the delivery, access, and provision of real-life needs. Using a few case studies of past, present, and projected future scenarios, this paper attempts to bring Smart Cities into the real cities domain, perhaps pushing the moniker away from 'Smart' to 'Efficient' - something that can be measured, counted, and assessed. Through the consideration of the next stage of the evolution of cities from 'Smart' to 'Efficient', the combined efforts and experience of multiple researchers at the NREL and their network of collaborators highlights the need for updates metrics that can be used to start guiding efforts toward productive initiatives to improve quality of life.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Digital Twin Technology for Safety, Security, and Training in Spent Nuclear Fuel Handling

The increasing complexity of spent nuclear fuel handling requires significant resources to ensure safety, security, and personnel training. As nuclear facilities have continued to advance in scale and technology, the integration of digital tools has become indispensable. Among these tools, digital twins, which are virtual models of physical systems, are emerging as invaluable tools for enhancing safety protocols, security measures, and training in the nuclear sector. These models were conceptualized in the Industry 4.0 revolution. Digital twins can process data from physical systems in real time (by using sensors), include multiple code packages to enable simulations of different physics applications, and even implement artificial intelligence or machine learning techniques for advanced data processing. Despite the advantages that digital twins provide, challenges still exist regarding their widespread implementation. For instance, data used by a digital twin must be accurate to ensure that the digital twin is accurately tuned. Furthermore, if insecure digital twins are targeted by hackers, then they can pose serious risks to the security and safety of nuclear facilities.

Digital twins↗

FORCE Update 2024

The Framework for Optimization of Resources and Economics (FORCE) tool suite is the U.S. Department of Energy’s Nuclear Integrated Energy Systems (IES) Program flagship tool suite for technoeconomic IES analysis of IES. This tool suite is useful for analysis designed to evaluate and improve the technoeconomics of energy production systems, particularly for systems including nuclear technology. In this report, we document the development activity for the FORCE tool suite to extend its capabilities as performed during fiscal year 2024. In addition to reliability and accessibility, capability is one of the three standards guiding the development of the FORCE tool suite and the software codes that are its constituent parts. Extending the capabilities of the FORCE tool suite allows analysis both within the IES program as well as industry, university, and laboratory partners to perform analysis with more accuracy, insight, and impactful narrative. Four areas of capability development were the focus of activity this year: economic parameter uncertainty quantification, multiresolution analysis, components-to-optimization workflow automation, and statespace construction workflows for real-time optimal control. In economic parameter uncertainty quantification, the ability of HERON to capture risk due to scenarios (weather and energy demand uncertainty) was expanded to also include uncertainties in financial parameters such as capital cost or operation and maintenance costs. By including these sources of uncertainty, which are sometimes very large compared with scenario uncertainty, HERON is better able to capture the risk posed by investment in various IES technology. Because of this, analysts can also consider the reduction in risks that can be realized by choice of some technologies. In multiresolution analysis, development activity extended on work completed previously. In fiscal year 2023, methods for decomposing time series signals, such as demand, solar and wind availability, and price profiles, were analyzed and down-selected to those most effective at splitting signals into different resolutions. These resolutions allow considering the influence of different energy demand and supply behaviors across different time scales. For example, energy demand might be divided into seasonal, weekly, and hourly profiles. In fiscal year 2024, this preliminary work was extended and implemented within the Risk Analysis Virtual Environment (RAVEN) risk and uncertainty analysis platform, which is used throughout the FORCE framework. This development of the “multi-resolution time series analysis” (MR-TSA) module in RAVEN allows training synthetic history generators on complex time series. These synthetic history generators can then be used in HERON for generating scenarios that represent possible market and weather scenarios that can be analyzed on different time scales. We envision completing this work in the future, implementing multiresolution dispatch optimization strategies that can make the most beneficial use of these stratified time histories. In components-to-optimization workflow development, workflows for translating user inputs of components into algorithms for algebraic optimization were selected and implemented. Similar algorithms within the Holistic Energy Resource Optimization Network (HERON) were separated from the main code base of HERON and gathered with the components-to-optimization workflows in the new Dispatch Optimization Variable Engine (DOVE) software library. This modularization allows FORCE users to analyze dispatch optimization and energy system duty cycles independently of HERON, which previously was a burdensome task. Additionally, these dispatch optimization algorithms, set up in an independent library, can now be used across all software applications within FORCE, especially including the real-time optimal control software Optimization of Real-time Capacity Allocation (ORCA). Allowing FORCE software to share dispatch optimization algorithms within a single library allows for improved software maintenance and reliability. In statespace characterization workflow development, alternative workflows for optimizing dispatch with additional technical accuracy was the focus, particularly to improve the real-time optimization decision making in ORCA. Using algorithms and workflows initially developed for the Feasible Actuator Range Modifier (FARM), workflows for determining the statespace representation of IES were identified and demonstrated. The resulting dispatch optimization required a more robust optimization algorithm than that originally used in HERON (and moved to DOVE), which required adding an alternate workflow to DOVE that can more accurately match the behavior of physical systems using a partial differential equation representation. In conclusion, capability developments in the FORCE tool suite in fiscal year 2024 have improved the ability of the FORCE tool suite to perform

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Develop a new integrated macro→micro←nano (MMN) multiscale modeling framework to optimize high strength aluminum alloys and processes for vehicle light-weighting​

Bending tests provide a means to study plane strain fracture performance of 6000 series aluminum alloys. Metrics from bending tests have been correlated with self-pierce riveting (SPR) performance of a high strength AA6111 automotive aluminum alloy in previous works. Using the ORNL HPC resources, this project developed an innovative macro→micro←nano (MMN) multiscale microstructure-based finite element (FE) code to further understanding of the relationship between microstructure and fracture properties of high-strength 6000-series alloys. This work started with microstructural characterization in both mesoscale and nanoscale and bending performance characterization of AA6111 HS2-T6 alloy at Ford, the MMN framework was applied to this alloy to simulate 3-point VDA bending. From the results of the macro-modeling of 3-point VDA bending, the critical region of fracture was identified, and the region geometry was used to construct the micro-model. The fracture criterion of micron-scale precipitates and aluminum matrix which contains submicron and nano particles (AL-SMP-NP) in the micro-model was calibrated and validated by comparing simulated and measured bending results. With the AL-SMP-NP fracture strain obtained, the fracture strain of Al-matrix containing nano particles (ALNP) will similarly be determined by a submicron scale-model using an edge-constrained FE modeling approach developed by Hu et al. With the ALNP fracture strain obtained, the fracture strain of Al-matrix containing no particles will similarly be determined by a nano scale-model using an edge-constrained FE modeling approach. After the MMN framework is built and fracture criterion calibrated, nano-model FE simulations with virtual microstructures was performed to obtain a reduced order model (ROM) of the fracture criterion of the ALNP as a function of volume fraction, size, and distribution of the nanoparticle. This nano→submicron→micro modeling part allows exploration of the influence of different material nanostructures from different process conditions on the bending properties within the multiscale bending simulation framework and the ROM of material bendability as a function of nanoparticle size and shape was established. This obtained reduced order model (ROM) could help guide the design and selection of materials to improve existing SPR process models that could replace trial-and-error rivet/die selection and help to design new rivet/die combinations capable of robustly joining new higher strength 6000 5 series alloys in automotive body structures. This would enable lightweighting of Ford vehicles leading to greater fuel efficiency and reduce manufacturing time and energy.

36 MATERIALS SCIENCE↗