Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Evaluation Framework”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 343 records · Page 19

Role of Oxidizing Conditions in the Dispersion of Supported Platinum Nanoparticles Explored by Ab Initio Modeling

Achieving fine control over the dispersion of supported platinum nanoparticles (Pt) is a promising avenue to enhancing their catalytic activity and selectivity. Experimental observations suggest that exposing ceria-supported Pt nanoparticles to O 2 at 500 °C promotes their dispersion into smaller particles and eventually single atoms. The exact role of oxygen in this process is not yet well understood. Past density functional theory studies of ceria-supported Pt have typically narrowed their scope to single atoms and clusters of a few atoms. Herein, we combine several approaches and types of models in a consistent atomistic framework to evaluate the relative stability of ceria-supported Pt as a function of the degree of oxidation of Pt and of the particle size, ranging from single atoms to nanoparticles 1.5 nm of diameter. Finally, we find that the largest nanoparticles remain the thermodynamically most stable species on the lowest energy facet of ceria even under oxidizing conditions, suggesting that stronger adsorption sites are required to stabilize smaller clusters and single atoms and promote oxidative dispersion.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

A Comprehensive Framework for Assessing Terrestrial Analogue Field Sites for Ocean Worlds

Field studies at terrestrial analogue sites represent an important contribution to the science of ocean worlds. The value of the science and technology investigations conducted at field analogue sites depends on the relevance of the analogue environment to the target ocean world. We accept that there are no perfect analogues for many of the unique environments represented by ocean worlds but suggest that a one‐to‐one matching of environmental characteristics and conditions is not crucial to the success or impact of the work. Instead, we must determine which processes and parameters are required to map directly to the target ocean world environment with high fidelity to address the science question. In this review paper, we discuss the outcomes of a workshop aimed at developing a new framework for evaluating the suitability of analogue field locations for ocean worlds research. Here we present a two‐step approach to (a) identify the most crucial processes and parameters associated with a given science question and (b) assess the fidelity of these processes and parameters at a proposed field site to those expected for the target ocean world. We demonstrate this approach in a test case evaluating three types of ocean world analogue environments with respect to a science question. The consensus document presented here equips veteran and new investigators with valuable tools to better assess and justify their analogue site selections.

58 GEOSCIENCES↗

Leveraging unlabeled SEM datasets with self-supervised learning for enhanced particle segmentation

Scanning Electron Microscopes (SEMs) are widely used in experimental science laboratories, often requiring cumbersome and repetitive user analysis. Automating SEM image analysis processes is highly desirable to address this challenge. In particle sample analysis, Machine Learning (ML) has emerged as the most effective approach for particle segmentation. However, the time-intensive process of manually annotating thousands of SEM images limits the applicability of supervised learning approaches. Self-Supervised Learning (SSL) offers a promising alternative by enabling knowledge extraction from raw, unlabeled data. This study presents a framework for evaluating SSL techniques in SEM image analysis, focusing on novel methods leveraging the ConvNeXtV2 architecture for particle detection. A dataset comprising 25,000 SEM images is curated to benchmark these proposed SSL methods. The results demonstrate that ConvNeXtV2 models, with varying parameter counts, consistently outperform other techniques in particle detection across different length scales, achieving up to a 34% reduction in relative error compared to established SSL methods. Furthermore, an ablation study explores the relationship between dataset size and SSL performance, providing actionable insights for practitioners regarding model selection and resource efficiency. This research advances the integration of SSL into autonomous analysis pipelines and supports its application in accelerating materials science discovery.

Rettenberger, Luca↗

Light-powered end-to-end neutron detection and imaging with an edge-deployed optical AI chip

Neutron detection is widely used in many applications including nuclear physics, nuclear energy, nuclear technologies and nuclear safeguards. Developing an end-to-end neutron detection and imaging workflow paves way towards fully automated processes for many applications. We implemented an automated workflow for neutron detection experiments which use a solid state image sensor to capture neutron hits as a digital image. We deploy the workflow to an edge-based optical neural network (ONN) to increase the radiation-hardness and lifetime of neutron detection instruments. We present a two-stage neural network framework for detection of neutrons at sub-pixel resolution. The first stage uses a region proposal network to efficiently detect and extract neutron hits from the input camera image. The second stage feeds the extracted hits into a fully connected neural network to predict the sub-pixel hit position. The performance of the two-stage framework is evaluated using the edge-based ONN. The results show that we can achieve above 96% neutron detection accuracy as well as sub-pixel and sub-micron position resolution, while enjoying the advantages of the ONN hardware including radiation-hardness, low energy consumption and high computing speed for integrated edge camera and hardware deployment, when compared with electronic counterparts.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

A density-based continuous local symmetry measure

Although continuous symmetry theory has attracted increasing attention in modern chemistry, local symmetry remains under-investigated. As a consequence, the relationship between symmetry and chemical behavior is often obscured, limiting the practical use of fuzzy symmetry measures. Here, in this study, we introduce a novel framework for evaluating local symmetry based on electron density localization and present continuous symmetry representations for several representative molecules. Our approach not only quantitatively captures global symmetry but also reveals distinctive features of symmetry in a local chemical environment. The related concept, local chirality or chirotopicity, is also discussed. Overall, the proposed local symmetry and chirality measures provide valuable insights into molecular structure and structure–property relationships.

Lai, Duc Anh [Southern Methodist Univ., Dallas, TX↗

A Discrete Hankel Transform Approach to Nuclear Data Processing for Fusion Applications

This study introduces advancements to the numerical solutions employed in the processing of nuclear data for fusion applications. It leverages the convolution theorem and Fourier transform techniques to enhance computational efficiency and broaden applicability. Building upon a previously reported discrete Hankel transform approach for Doppler broadening, this work refines the solution of convolution integrals central to these applications. The methodology provides a general and unified framework for evaluating any convolution operation, regardless of whether the underlying problem involves temperature effects in nuclear reactions. The applicability to the nuclear data processing for fusion is demonstrated by deriving the convolution integrals for some of the fusion-related quantities. As before, the convolution operation utilizes a Gaussian-based kernel; however, the discrete Hankel transform of order $𝛼$ = $\frac{1}{2}$ is now applied to the forward Fourier transform of the nonkernel argument, rather than the inverse Fourier transform. This modification eliminates the need for the integration of the nonkernel, cross section–based function, which is a step that posed challenges for certain pointwise cross-section representations. It also removes the requirement for cross-section linearization. Optimized for graphics processing unit architectures, the approach significantly improves computational performance. These advancements are currently under evaluation as the foundation for the next-generation thermonuclear data file processing codes being developed at Lawrence Livermore National Laboratory.

Nuclear science and engineering↗

Landmark-embedded Gaussian process with applications for functional data modeling

In practice, we often need to infer the value of a target variable from functional observation data. A challenge in this task is that the relationship between the functional data and the target variable is very complex: the target variable not only influences the shape but also the location of the functional data. In addition, due to the uncertainties in the environment, the relationship is probabilistic, that is, for a given fixed target variable value, we still see variations in the shape and location of the functional data. To address this challenge, we present a landmark-embedded Gaussian process model that describes the relationship between the functional data and the target variable. A unique feature of the model is that landmark information is embedded in the Gaussian process model so that both the shape and location information of the functional data are considered simultaneously in a unified manner. Gibbs-Metropolis-Hasting algorithm is used for model parameters estimation and target variable inference. The performance of the proposed framework is evaluated by extensive numerical studies and a case study of nano-sensor calibration.

42 ENGINEERING↗

Local, regional, and global adaptations to a compound pandemic-weather stress event

Global food security can be threatened by short-term extreme events that negatively impact food production, food purchasing power, and agricultural economic activity. At the same time, environmental pollutants like greenhouse gases (GHGs) can be reduced due to the same short-term extreme stressors. Stress events include pandemics like COVID-19 and widespread droughts like those experienced in 2015. Here we consider the question: what if COVID-19 had co-occurred with a 2015-like drought year? Using a coupled biophysical-economic modeling framework, we evaluate how this compound stress would alter both agricultural sector GHG emissions and change the number of undernourished people worldwide. We further consider three interdependent adaptation options: local water use for crop production, regional shifts in cropland area, and global trade of agricultural products. We find that GHG emissions decline due to reduced economic activity in the agricultural sector, but this is paired with large increases in undernourished populations in developing nations. Local and regional adaptations that make use of natural resources enable global-scale reductions in impacted populations via increased global trade.

54 ENVIRONMENTAL SCIENCES↗

Metrics for quantifying the efficiency of atmospheric CO 2 reduction by marine carbon dioxide removal (mCDR)

Abstract Marine carbon dioxide removal (mCDR) is gaining interest as a tool to meet global climate goals. Because the response of the ocean–atmosphere system to mCDR takes years to centuries, modeling is required to assess the impact of mCDR on atmospheric CO 2 reduction. Here, we use a coupled ocean–atmosphere model to quantify the atmospheric CO 2 reduction in response to a CDR perturbation. We define two metrics to characterize the atmospheric CO 2 response to both instantaneous ocean alkalinity enhancement (OAE) and direct air capture (DAC): the cumulative additionality ( α ) measures the reduction in atmospheric CO 2 relative to the magnitude of the CDR perturbation, while the relative efficiency ( ϵ ) quantifies the cumulative additionality of mCDR relative to that of DAC. For DAC, α is 100% immediately following CDR deployment, but declines to roughly 50% by 100 years post-deployment as the ocean degasses CO 2 in response to the removal of carbon from the atmosphere. For instantaneous OAE, α is zero initially and reaches a maximum of 40%–90% several years to decades later, depending on regional CO 2 equilibration rates and ocean circulation processes. The global mean ϵ approaches 100% after 40 years, showing that instantaneous OAE is nearly as effective as DAC after several decades. However, there are significant geographic variations, with ϵ approaching 100% most rapidly in the low latitudes while ϵ stays well under 100% for decades to centuries near deep and intermediate water formation sites. These metrics provide a quantitative framework for evaluating sequestration timescales and carbon market valuation that can be applied to any mCDR strategy.

Yamamoto, Kana (ORCID:0009000731519234)↗

Tropical Cyclone Super Resolution using conditional diffusion denoising probabilistic model from mesoscale simulation to LES

Accurate modeling of tropical cyclone wind fields is essential for the design, risk assessment, and operational planning of offshore energy infrastructure. While mesoscale simulations are widely used thanks to their computational efficiency, they lack the necessary resolution to capture key features such as wind shear and veer profiles as well as the distribution turbulent kinetic energy (TKE). High-fidelity large-eddy simulation (LES) models on the other hand, can resolve turbulent structures and provide a more accurate representation of the complex wind field, albeit at a higher computational cost. To address this modeling gap, we introduce a two-part generative framework to enhance the resolution and physics-capturing ability of mesoscale simulations. First, a reduced-order model based on Karhunen–Loève (KL) decomposition is used to extract dominant spatial modes from one-dimensional mean wind profiles. A multilayer perceptron (MLP) is trained to map mesoscale mode weights to their LES counterparts, enabling accurate reconstruction of vertical velocity profiles. Second, a conditional Diffusion Denoising Probabilistic Model (DDPM) is developed to super-resolve coarse and low-fidelity mesoscale velocity fields, recovering fine-scale turbulence structures and stress distributions. The framework is evaluated across different tropical cyclone intensity categories defined by the Saffir–Simpson scale and demonstrates strong performance in both interpolation and extrapolation tasks. The generated fields accurately reproduce spatial coherence, stress distributions, and spectral energy characteristics observed in LES data. By bridging the fidelity gap between mesoscale and LES outputs, this approach offers a scalable, data-driven solution for enhancing the representation of tropical cyclone wind fields, enabling more robust offshore energy infrastructure systems design in tropical-cyclone-prone areas.

17 WIND ENERGY↗

Impacts of benchmarking choices on inferred model skill of the Arctic–Boreal terrestrial carbon cycle

Abstract Land surface models require continuous validation against observations to improve and reduce simulation uncertainty. However, inferred model performance can be heavily influenced by subjective choices made in the selection and application of observational data products. A key area often misrepresented by models is the Arctic–Boreal region, which is a potential tipping point region in Earth’s climate system due to large permafrost carbon stocks that are vulnerable to release with climate warming. We use the International Land Model Benchmarking (ILAMB) framework to evaluate how the model skill of TRENDY-v9 models varies based on the choice of observational-based benchmark and how benchmarks are applied in model evaluation. This analysis uses global datasets integrated into ILAMB and new, regionally-specific observational products from the Arctic–Boreal Vulnerability Experiment. Our results cover the overall time period of 1979–2019 and show that model scores can vary substantially depending on the data product applied, with higher model scores indicating better model performance against observations. The lowest model scores occur when benchmarked against regional, compared to global, datasets. We also evaluate observed and modeled functional relationships between ecosystem respiration and air temperature and between gross primary production and precipitation. Here, we find that the magnitude and shape of the responses are strongly impacted by the choice of observational dataset and the approach used to construct the functional relationship benchmark. These results suggest that model evaluation studies could conclude a false sense of model skill if only using a single benchmark data product or if not applying regional data products when performing a regional model analysis. Collectively, our findings highlight the influence of benchmarking choices on model evaluation and point to the need for benchmarking guidelines when assessing model skill.

Poe, Jeralyn (ORCID:0000000318495278)↗

Collins-Soper kernel in the QCD instanton vacuum

We outline a general framework for evaluating the nonperturbative soft functions in the quantum chromodynamics (QCD) instanton vacuum. In particular, from the soft function we derive the Collins-Soper (CS) kernel, which drives the rapidity evolution of the transverse-momentum-dependent parton distributions. The resulting CS kernel, when supplemented with the perturbative contribution, agrees well with recent lattice results and some phenomenological parametrizations. Moreover, our CS kernel depends logarithmically on the large quark transverse separation, providing a key constraint on its phenomenological parametrization. Finally, a lattice calculation can be directly compared to our generic results in Euclidean signature, thus providing a new approach for evalulating the soft function and extracting the CS kernel by analytical continuation.

QCD phenomenology↗

Lagrangian and Eulerian drag models that are consistent between Euler-Lagrange and Euler-Euler (two-fluid) approaches for homogeneous systems

The undisturbed flow of a particle is of fundamental importance since it controls both the undisturbed flow force and the perturbation force (which includes quasisteady, added-mass, and history forces). Here we use the pairwise interaction extended point particle framework to evaluate the undisturbed flow of each particle through superposition of the perturbation flow induced by all its neighbors. This approach allows calculation of various statistics related to undisturbed fluid velocity under conditions of both stationary and nonstationary particles. In a random distribution of stationary particles, while the macroscale undisturbed flow is slowly varying, the microscale undisturbed flow that arises due to the perturbation flow of neighbors varies substantially from one particle to another and this in turn leads to large variation in the hydrodynamic force exerted on the particles. The effect of particle motion is generally to increase the particle-to-particle variation in the undisturbed fluid velocity of the particles. We observe that this increase is greater for the transverse component than for the streamwise component. As a result, with increasing random particle motion, the distribution of undisturbed fluid-velocity fluctuation becomes isotropic. Three different normalized forces are defined: $Φ^L$ is the Lagrangian normalized force on an individual particle suitable for application in a microscale-informed Euler-Lagrange simulation, $Φ^E$ is the Eulerian normalized average force suitable for application in an Euler-Euler simulation, and $Φ^{LE}$ is the Lagrangian normalized force on an individual particle suitable for application in the standard Euler-Lagrange simulation. In this work, we establish precise relations between these different definitions. The drag laws developed based on particle-resolved direct numerical simulation results and experiments are appropriate for application only as the Eulerian normalized average force. We introduce the force consistency relation and use it to obtain an expression for $Φ^L$, which when applied to each particle and averaged over all the particles equals $Φ^E$. The results are first obtained in the limit of stationary particles and then extended to the general case of nonstationary particles.

42 ENGINEERING↗

Consequence Based Framework for Deployment of Cloud Solutions in the Digital Energy Transition

This study proposes a framework for evaluating cloud computing deployment in the electric sector, focusing on the digital transition of energy systems. It assesses the implications of cloud technology adoption, particularly in terms of security, operational resilience, and efficiency. The paper introduces a method for consequence-driven risk analysis, enabling utilities to prioritize and mitigate potential threats effectively. It also discusses the shared responsibility model in cloud computing, highlighting the need for collaborative security efforts. The research aims to provide utilities with a strategic assessment tool for cloud adoption, emphasizing the importance of security culture in enhancing cloud computing's role in critical infrastructure.

99 GENERAL AND MISCELLANEOUS↗

Automated Controller Hardware-In-The-Loop Testbed for EV Charger Resilience Analysis

This paper focuses on the development of a tool that includes an automated testbed with controls, protection, and communications integrated into a real-time system to provide a platform to generate data sets for failure modes and effects analysis. This tool establishes a value for automation of data generation for different scenarios and addresses the gap of nonexistent field data for different applications and use cases. The features of this tool can further be expanded to include multiple power electronics models, communication protocols, and scaled system architectures. This general framework was evaluated for a DC fast charger system use case to provide quantitative solution for resiliency.

Starke, Michael↗

Exploring the Utility-Privacy Trade-Off: Impacts of Semantic and Visit Types Ambiguities on Human Mobility Simulation

Humans are in perpetual movement, constantly traversing buildings, cities, waters, oceans, and countries. Mobility stands out as a major driving force shaping our modern societies. Capturing and explaining human behavior in a world of eight billion distinct mobility agendas is a complex challenge. With the rise of interconnected devices and platforms, such as smartphones, wearables, and point-of-interest data, largescale behavioral data has become more accessible, enabling rich insights into mobility patterns. However, the widespread availability of such data introduces significant ethical challenges. Detailed mobility data can inadvertently reveal sensitive personal information, including individuals' locations, habits, social interactions, and even political or religious affiliations. Beyond privacy breaches, the ethical implications of uncovering and potentially manipulating underlying behavioral patterns demand attention. Striking a balance between the utility of mobility models and the protection of individual privacy is therefore paramount. This paper explores the utility-privacy trade-offs in human mobility modeling, focusing on the impacts of introducing semantic and visit type ambiguities. By systematically examining how these ambiguities affect the fidelity of simulated trajectories and privacy risks, we provide a framework for evaluating ethical and privacy-conscious modeling practices. Our findings emphasize the need for methods that safeguard privacy without undermining the usefulness of mobility models, contributing to the responsible advancement of mobility science in alignment with ethical standards and societal expectations.

Amichi, Licia [ORNL] (ORCID:0000000177631394)↗

Load Matching Potential of Urban Renewables during Extreme Heat in New York City

Integration of renewable resources to meet growing energy demand is becoming a global priority under decarbonization mandates. This study contributes to ongoing efforts on the matter by assessing the feasibility of using offshore wind and rooftop photovoltaic systems to meet electricity demand during a period of thermal stress in New York City—August 2019. A unified modelling framework, based on the Urbanized Weather Research and Forecasting model, is used to simulate climate, renewable resources and energy demand variables. Findings show significant energy load miss-match, ranging from 3 to 5 GW, between the demand and the composite renewable generation outcome. This study provides a transferable framework for evaluating renewable integration in dense urban regions and highlights the need for additional strategies to support grid resilience during extreme heat events, while clarifying the role of local resources in fully managing NYC’s load.

54 ENVIRONMENTAL SCIENCES↗

A CHIL Validation of Machine Learning-Assisted Methods for Real-Time Controls of Solar PV for Grid Services

Recent research has highlighted the potential for solar to act as a zero-marginal-cost and zero-emission flexibility resource on the bulk power system when operated with advanced control systems. To increase the performance of these systems, leading technologies, including machine learning (ML) and hierarchical inverter set point allocation, have been proposed; however, these technologies lack comprehensive validation under real-world application scenarios. This paper addresses this gap by designing and developing a controller-hardware-in-the-loop framework to evaluate the performance of different flexible solar technologies in responding to automatic generation control signals in a closed-loop fashion. Simulation results indicate the superior performance of an ML-based approach compared to the conventional reference-control grouping-based approach, showcasing its potential to support grid stability and operational efficiency.

closed-loop validation↗