Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “evaluation framework”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 379 records · Page 21
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

DeepThermo: Deep Learning Accelerated Parallel Monte Carlo Sampling for Thermodynamics Evaluation of High Entropy Alloys

Since the introduction of Metropolis Monte Carlo (MC) sampling, it and its variants have become standard tools used for thermodynamics evaluations of physical systems. However, a long-standing problem that hinders the effectiveness and efficiency of MC sampling is the lack of a generic method (a.k.a. MC proposal) to update the system configurations. Consequently, current practices are not scalable. Here we propose a parallel MC sampling framework for thermodynamics evaluation—DeepThermo. By using deep learning–based MC proposals that can globally update the system configurations, we show that DeepThermo can effectively evaluate the phase transition behaviors of high entropy alloys, which have an astronomical configuration space. For the first time, we directly evaluate a density of states expanding over a range of ~e 10,000 for a real material. We also demonstrate DeepThermo’s performance and scalability up to 3,000 GPUs on both NVIDIA V100 and AMD MI250X-based supercomputers.

Yin, Junqi↗
DOE OSTI2026

Techno-Economic Evaluation of Electrified Vehicle Options in Drayage Fleets

The electrification of drayage fleets offers potential economic and operational benefits, but the financial viability of electrified vehicles remains sensitive to battery cost, energy price, and fleet usage patterns. While total cost of ownership (TCO) is a useful benchmark, fleet operators and investors are equally concerned with investment performance metrics such as payback period (PB) and Internal Rate of Return (IRR), which better reflect financial risks and investment return timelines. This study develops a unified techno-economic framework that jointly evaluates TCO, PB, and IRR to determine when electrified trucks become cost-effective alternatives to diesel trucks. Building on a previously developed cost modeling tool and using real-world telematics data from a Class 8 drayage fleet at the Port of Savannah, the analysis incorporates projected battery cost trajectories, electricity and diesel price trends, vehicle efficiency improvements, and multiple battery capacities. Parameter ranges reflect widely cited projections and observed drayage-duty-cycle variability. A surrogate-modeling method approximates economic performance across thousands of battery cost–electricity price combinations, enabling high-resolution identification of conditions that achieve TCO parity, acceptable PB thresholds, and target IRR levels. Additionally, the study estimates the evolving share of the fleet that can feasibly electrify over time under multiple economic metrics. This integrated framework offers a novel, data-driven approach to inform risk-aware decision-making for fleet electrification and supports investment planning under evolving cost and operational conditions.

Sun, Ruixiao [ORNL] (ORCID:0000000341768676)↗
DOE OSTI2024

Leveraging BERT and Network-Based Attention Analysis for Identifying Treatment Milestones in EHRs

This study introduces a sophisticated data-driven framework for analyzing Electronic Health Records (EHRs) using transformer-based models to identify and disentangle overlapping treatment contexts. The framework leverages a preprocessing pipeline that transforms structured procedural codes into semantically enriched descriptive text, enabling the use of attention mechanisms to cluster medical events into treatment milestones—cohesive and distinct components of care processes. The methodology is rigorously validated using synthetic datasets derived from the MIMIC-III database, designed to simulate the heterogeneity and overlapping procedural contexts characteristic of real-world EHR scenarios. Quantitative evaluation highlights the framework’s robustness in disentangling concurrent care pathways, with attention metrics and unsupervised clustering approaches demonstrating the ability to preserve intra-context relationships while distinguishing inter-context dependencies. By addressing challenges inherent in data heterogeneity, this approach provides a foundation for uncovering complex treatment patterns, advancing clinical decision-making, and optimizing resource allocation in diverse healthcare environments.

Kim, Minsu [ORNL] (ORCID:0000000224185535)↗
DOE OSTI2020

CE ABM (Circular Economy Agent-Based Model) [SWR 20-113]

The CE ABM framework aims to evaluate the techno-economic, market, and social conditions that maximize the value retention and minimize raw material inputs of different circular economy (CE) strategies. Several types of agents are defined in the model, such as asset owners, service providers, recyclers, and manufacturers and modeled CE strategies are design-for-circularity, products and components reuse, and recycling. In addition to techno-economic relations, the CE ABM framework accounts for behavioral factors such as social norms and trust. (Title previously known as "ABSiCE (Agent-Based Simulations of the Circular Economy)". Updated Oct 27, 2023)

Walzberg, Julien↗
DOE OSTI2022

Case Study: Resilience Benefits of Distributed Wind Against Fuel and Weather Hazards in Alaska

In this case study of St. Mary’s Village, Alaska, we present a resilience evaluation exercise. A resilience framework is employed to identify system characteristics, relevant metrics, and resilience hazards and to assess the performance against the hazards with and without a distributed wind system installed. The results show the resilience benefits provided by the distributed wind installation against fuel shortage hazards and cold weather hazards. The resilience benefits can be assigned monetary values, which will be highly dependent on actual circumstances of the hazard, but provide insight into value streams of distributed wind that are not usually considered. For example, the single 900 kW turbine was found to prevent an average of 14,643 kWh of load from being dropped during a two-day diesel fuel shortage event, which saved the community $447,592 from the prevented outages. This case study serves as an example for novel power system resilience analysis and builds understanding of resilience hazards that are common across many power systems.

Culler, Megan J.↗
DOE OSTI2025

SigTime: Learning and Visually Explaining Time Series Signatures

Understanding and distinguishing temporal patterns in time series data is essential for scientific discovery and decision-making. For example, in biomedical research, uncovering meaningful patterns in physiological signals can improve diagnosis, risk assessment, and patient outcomes. However, existing methods for time series pattern discovery face major challenges, including high computational complexity, limited interpretability, and difficulty in capturing meaningful temporal structures. Here, to address these gaps, we introduce a novel learning framework that jointly trains two Transformer models using complementary time series representations: shapelet-based representations to capture localized temporal structures and traditional feature engineering to encode statistical properties. The learned shapelets serve as interpretable signatures that differentiate time series across classification labels. Additionally, we develop a visual analytics system—SigTime—with coordinated views to facilitate exploration of time series signatures from multiple perspectives, aiding in useful insights generation. We quantitatively evaluate our learning framework on eight publicly available datasets and one proprietary clinical dataset. Additionally, we demonstrate the effectiveness of our system through two usage scenarios along with the domain experts: one involving public ECG data and the other focused on preterm labor analysis.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Revisiting Competitive Adsorption of Small Molecules in the Metal–Organic Framework Ni-MOF-74

To precisely evaluate the potential of metal-organic frameworks (MOFs) for gas separation and purification applications, it is crucial to understand how various molecules competitively adsorb inside MOFs. In this paper, we combine in situ infrared spectroscopy with ab initio calculations to investigate the mechanisms associated with co-adsorption of a number of small molecules including CO, NO, and CO 2 inside the prototypical framework Ni-MOF-74. Surprisingly, we find that the displacement of CO bound inside Ni-MOF-74 (binding energy of 53 kJ/mol) is readily driven by CO 2 exposure, even though CO 2 has a noticeably weaker binding energy of only 41 kJ/mol; meanwhile, the significantly more strongly binding NO molecule (90 kJ/mol) is not able to easily displace bound CO inside Ni-MOF74. These results show that single-phase binding energies of a molecule inside the MOF cannot completely describe their interaction with the MOF in the presence of other guest molecules. Here, we unveil a number of crucial factors such as the kinetic barrier, partial pressure, secondary binding sites, and guest-host/lateral interactions that control the co-adsorption process and combined with the binding energy are better descriptors of the behavior and adsorption of gas mixtures inside MOFs.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2026

Analytical small-signal stability analysis of low-inertia power system frequency response considering secondary frequency regulation

Modern power systems are increasingly vulnerable to frequency instability as inverter-based resources (IBRs) replace synchronous machines and reduce system rotational inertia. Existing small-signal frequency stability assessment methods are either computationally intensive, relying on simulation-driven approaches, or lack analytical stability regions that explicitly account for secondary frequency response (SFR). This paper introduces new analytical frameworks that enable evaluation small-signal frequency stability while explicitly incorporating tunable IBR and SFR parameters. Using Kharitonov’s theorem with an overbounding approach, explicit small-signal stability criteria are derived. In addition, based on Białas’ criterion and Hurwitz matrix, analytical stability regions are established to reveal feasible design spaces for SFR and IBR parameters tuning. Extensive Matlab/Simulink-based simulations validate the accuracy and computational efficiency of the proposed methods, demonstrating that coordinated tuning of SFR and IBR parameters can substantially enhance system resilience. By bridging analytical rigor with practical tunability, this work provides an analytical framework for assessing small-signal frequency stability in low-inertia grids, supporting the real-time, scalable, and resilient operation of sustainable power systems.

14 SOLAR ENERGY↗
DOE OSTI2022

Multi-objective materials bayesian optimization with active learning of design constraints: Design of ductile refractory multi-principal-element alloys

We report Bayesian Optimization (BO) has emerged as a powerful framework to efficiently explore and exploit materials design spaces. To date, most BO approaches to materials design have focused on the materials discovery problem as if it were a single expensive-to-query ‘black box’ in which the target is to optimize a single objective (i.e., material property or performance metric). Also, such approaches tend to be constraint agnostic. Here, we present a novel multi-information BO framework capable of actively learning materials design as a multiple objectives and constraints problem. We demonstrate this framework by optimally exploring a Refractory Multi-Principal-Element Alloy (MPEA) space, here specifically, the system Mo-Nb-Ti-V-W. The MPEAs are explored to optimize two density-functional theory (DFT) derived ductility indicators (Pugh’s Ratio and Cauchy pressure) while learning design constraints relevant to the manufacturing of high-temperature gas-turbine components. Alloys in the BO Pareto-front are analyzed using DFT to gain an insight into fundamental atomic and electronic underpinning for their superior performance, as evaluated within this framework.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Design, Preparation, and Execution of the 100-AV Field Test for the CIRCLES Consortium: Methodology and Implementation of the Largest Mobile Traffic Control Experiment to Date

This article presents the comprehensive design, setup, execution, and evaluation of the MegaVanderTest (MVT) experiment conducted by the Congestion Impacts Reduction via CAV-in-the-Loop Lagrangian Energy Smoothing (CIRCLES) Consortium, which aimed to mitigate traffic congestion using partially autonomous vehicles (AVs) (see “Summary”). The experiment involved 100 vehicles on Nashville’s Interstate 24 (I-24) highway, utilizing various control algorithms to smooth stop-and-go traffic waves. The execution of the MVT experiment required a coordinated effort from multiple teams. This article details the meticulous planning process, the coordinated efforts of multiple teams, and the innovative use of a dynamic agent-based simulation framework for traffic evaluation. Here, the contributions of this work include demonstrating and providing a detailed roadmap for large-scale live traffic experiments, illustrating the lessons learned from the MVT experiment, and introducing the other articles in this issue and their complementary relationship in the MVT experiment.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2020

An empirical study of I/O separation for burst buffers in HPC systems

To meet the exascale I/O requirements for the High-Performance Computing (HPC), a new I/O subsystem, Burst Buffer, based on solid state drives (SSD), has been developed. However, the diverse HPC workloads and the bursty I/O pattern cause severe data fragmentation that requires costly garbage collection (GC) and increases the number of bytes written to the SSD. To address this data fragmentation challenge, a new multi-stream feature has been developed for SSDs. In this work, we develop an I/O Separation scheme called BIOS to leverage this multi-stream feature to group the I/O streams based on the user IDs. We propose a stream-aware scheduling policy based on burst buffer pools in the workload manager, and integrate the BIOS with the workload manager to optimize the I/O separation scheme in burst buffer. We evaluate the proposed framework with a burst buffer I/O traces from Cori Supercomputer including a diverse set of applications. Experimental results show that the BIOS could improve the performance by 1.44x on average and reduce the Write Amplification Factor (WAF) by up to 1.20x. Finally, these demonstrate the potential benefits of the I/O separation scheme for solid state storage systems.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Literature Review for Sensor Impact Evaluation and Verification Use Cases - Building Controls and Fault Detection and Diagnosis (FDD)

This report summarizes a comprehensive literature review for the selected sensor suites used in building controls and fault detection and diagnostics (FDD), which is a Q2 deliverable of the Sensor Impact Evaluation and Verification project. The project’s overarching goal is to develop a framework for investigating the impact of sensor deployment and configuration for building energy optimization, fault detection and diagnosis (FDD), occupants’ thermal comfort, and potential grid efficiency. While the first phase of the literature review performed in Q1 reviewed the current methods of various sensor selection and placements and their impact, this report focuses on high impactful potential use cases for the selected sensor suites in building control and FDD. The use cases identified in this literature review will be further investigated and be included in the final sensor impact evaluation framework. For the review, the multi-laboratory team reviewed 241 research papers, technical reports, and books to identify existing technologies, the potential impact on energy savings and thermal comfort, and future research opportunities for the selected use cases in building controls and FDD. Along with the literature review, the team conducted a series of interviews with experts in sensors and controls area to identify the state-of-art sensor technologies, and the most impactful use cases in controls and FDD areas. The interview results will also be incorporated with the findings from the literature review in the next quarter, and the final use cases to be evaluated will be selected.

47 OTHER INSTRUMENTATION↗
DOE OSTI2023

Effect of sample size on the maximum value distribution of fatigue driving forces in metals and alloys

An analytical framework is presented to predict the effects of sample size on the maximum value distribution (MVD) of the driving forces for fatigue crack formation in metals and alloys. The distribution of the maximum driving force for fatigue crack formation over the domain follows the generalized extreme value theory in the limit as the domain size increases to infinity. Here, a simulation-based analysis of microstructure influences on fatigue resistance for polycrystalline metals and alloys is very costly, and reaching those limits is intractable. This work models the MVD of Fatigue Indicator Parameters (FIPs), which serve as surrogate measures for the driving force for fatigue crack formation, at finite sample sizes prior to their convergence to a limiting extreme value distribution. Large-scale crystal plasticity finite element (CPFE) simulations of FCC Al 7075-T6 with microstructure realizations of various sizes are incorporated to calibrate and evaluate the developed framework, and a total of ∼6.5 million grains of Al 7075-T6 are examined. The calibrated analytical solution agrees well with the brute force Monte Carlo simulation results extracted from the CPFE simulations. Furthermore, the developed formulation can predict the MVD of FIPs for different sample sizes using a size-dependent parameter, and it is capable of accurately extrapolating the MVD of FIPs for much larger microstructure sample sizes than the size used for its calibration.

Crystal plasticity↗
DOE OSTI2023

FAIR AI models in high energy physics

Abstract The findable, accessible, interoperable, and reusable (FAIR) data principles provide a framework for examining, evaluating, and improving how data is shared to facilitate scientific discovery. Generalizing these principles to research software and other digital products is an active area of research. Machine learning models—algorithms that have been trained on data without being explicitly programmed—and more generally, artificial intelligence (AI) models, are an important target for this because of the ever-increasing pace with which AI is transforming scientific domains, such as experimental high energy physics (HEP). In this paper, we propose a practical definition of FAIR principles for AI models in HEP and describe a template for the application of these principles. We demonstrate the template’s use with an example AI model applied to HEP, in which a graph neural network is used to identify Higgs bosons decaying to two bottom quarks. We report on the robustness of this FAIR AI model, its portability across hardware architectures and software frameworks, and its interpretability.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2026

Benchmarking Cylindrical Blast Wave Theory Against the OSIRIS-REx Sample Return Capsule Reentry

Weak shock theory based on cylindrical blast waves has been used to interpret meteor infrasound, but it has not been systematically benchmarked against a non-ablating hypersonic source with independently known parameters. The objective of this study is not to propose a new theoretical framework, but to evaluate the operational validity of the existing suite of blast radius formulations against a high-fidelity ground truth dataset. The OSIRIS-REx Sample Return Capsule reentry on 24 September 2023 provides such a benchmark because the capsule geometry, trajectory, and infrasound emission points are constrained from mission data and ray tracing, reducing source-side uncertainty associated with ablation. Using observations from 39 infrasound stations, this benchmarking study evaluates six published blast radius (${R}_{0}$ ) formulations and three weak-shock transition coefficients ( C ) within a stratified atmospheric propagation model to predict signal period and peak overpressure. The benchmarking identifies the Sakurai formulation as the best-performing formulation for non-ablating bodies, with the Jones/Plooster formulation performing comparably when a physically appropriate C is adopted. Sakurai and Jones/Plooster yield linear-period median absolute percentage residuals of 9% and 11%, respectively. The period predictions show only weak sensitivity to C at these propagation distances. The Mach-diameter approximation commonly used in meteor studies overestimates ${R}_{0}$ by more than a factor of 3 in the absence of ablation. Finally, these results establish a performance baseline for applying cylindrical blast wave theory to effectively non-ablating hypersonic bodies and demonstrate that the signal period is a robust observable for constraining ${R}_{0}$.

atmospheric entry↗
DOE OSTI2023

Pseudo-rapidity distributions of charged particles in asymmetric collisions using Tsallis thermodynamics

Abstract The pseudo-rapidity distributions of the charged particles produced in the asymmetric collision systems p+Al, p+Au and$$^3$$ 3 He+Au at$$\sqrt{s_\text {NN}} = 200$$ s NN = 200 GeV are evaluated in the framework of a fireball model with Tsallis thermodynamics. The fireball model assumes that the experimentally measured particles are produced by fireballs following the Tsallis distribution and it can effectively describe the experimental data. Our results as well as previous results for d+Au collisions at$$\sqrt{s_\text {NN}} = 200$$ s NN = 200 GeV and p+Pb collisions at$$\sqrt{s_\text {NN}} = 5.02$$ s NN = 5.02 TeV validate that the fireball model based on Tsallis thermodynamics can provide a universal framework for pseudo-rapidity distribution of the charged particles produced in asymmetric collision systems. We predict the centrality dependence of the total charged particle multiplicity in the p+Al, p+Au and$$^3$$ 3 He+Au collisions. Additionally, the dependences of the fireball model parameters ($$y_{0a}$$ y 0 a ,$$y_{0A}$$ y 0 A ,$$\sigma _{a}$$ σ a and$$\sigma _{A}$$ σ A ) on the centrality and system size are studied.

Nuclear Science & Technology↗
DOE OSTI2020

Topographic Controls on the Distribution of Summer Monsoon Precipitation over South Asia

In this work, we use a high-resolution (9 km) one-way nested regional climate modeling framework to systematically evaluate individual and aggregate roles of various components of topography in the precipitation distribution during South Asian Summer Monsoon (SASM). While it is not the arrival but the north-northwestward extent of summer monsoon precipitation that is regulated by the presence of elevated surfaces in South Asia, both the thermal and mechanical topographic forcing play a role. Topography not only provides mechanical uplifting and prevents dry air entrainment, it also helps regulate the strength of upper level anticyclone and tropical easterly jet, all of which are necessary to sustain a conducive environment for monsoon precipitation in the South Asian summer. In turn, precipitation feedbacks positively by accelerating the tropospheric diabatic warming through atmospheric latent heating and by maintaining the moisture supply through local recycling. Modifications in the topography, particularly the removal of the Tibetan Plateau, substantially modulates the moist flow in the lower troposphere and the anticyclonic circulation in the upper troposphere to an extent that the northern branch of SASM becomes substantially weaker. These changes give way to negative precipitation anomalies and eventually to an environment where the cycle of feedbacks that runs the process of monsoon progression over land becomes inefficient. The design of topographic modification experiments can influence precipitation response; therefore, we advise caution in the interpretation of these and previously reported results.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Enhanced pozzolanic reactivity in hydrogen-form zeolites as supplementary cementitious materials

Pozzolans rich in silica and alumina react with lime to form cementing compounds and are incorporated into portland cement as supplementary cementitious materials (SCMs). However, pozzolanic reactions progress slower than portland cement hydration, limiting their use in modern construction due to insufficient early-age strength. Hence, alternative SCMs that enable faster pozzolanic reactions are necessary including synthetic zeolites, which have high surface areas and compositional purity that indicate the possibility of rapid pozzolanic reactivity. Synthetic zeolites with varying cation composition (Na-zeolite, H-zeolite), SiO 2 /Al 2 O 3 ratio, and framework type were evaluated for pozzolanic reactivity via Ca(OH) 2 consumption using ion exchange and in-situ X-ray diffraction experiments. Na-zeolites exhibited limited exchange reactions with KOH and Ca(OH) 2 due to the occupancy of acid sites by Na + and hydroxyl groups. Meanwhile, H-zeolites readily adsorbed K + and Ca 2+ from a hydroxide solution by exchanging cations with H + at Brønsted acid sites or cation adsorption at vacant acid sites. By adsorbing cations, the H-zeolite reduced the pH and increased Ca 2+ solubility to promote pozzolanic reactions in a system where Ca(OH) 2 dissolution/diffusion was a rate limiting factor. High H-zeolite reactivity resulted in 0.8 g of Ca(OH) 2 consumed per 1 g of zeolites after 16 h of reaction versus 0.4 g of Ca(OH) 2 consumed per 1 g of Na-zeolite. The H-zeolite modulated the pore fluid alkalinity and created a low-density amorphous silicate phase via mechanisms analogous to two-step C-S-H nucleation experiments. Finally, controlling these reaction mechanisms is key to developing next generation pozzolanic cementitious systems with comparable hydration rates to portland cement.

36 MATERIALS SCIENCE↗