Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “EVALUATION”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Comparative evaluation of deep learning workloads for leadership-class systems

Deep learning (DL) workloads and their performance at scale are becoming important factors to consider as we design, develop and deploy next-generation high-performance computing systems. Since DL applications rely heavily on DL frameworks and underlying compute (CPU/GPU) stacks, it is essential to gain a holistic understanding from compute kernels, models, and frameworks of popular DL stacks, and to assess their impact on science-driven, mission-critical applications. At Oak Ridge Leadership Computing Facility (OLCF), we employ a set of micro and macro DL benchmarks established through the Collaboration of Oak Ridge, Argonne, and Livermore (CORAL) to evaluate the AI readiness of our next-generation supercomputers. In this paper, we present our early observations and performance benchmark comparisons between the Nvidia V100 based Summit system with its CUDA stack and an AMD MI100 based testbed system with its ROCm stack. We take a layered perspective on DL benchmarking and point to opportunities for future optimizations in the technologies that we consider.

Yin, Junqi↗
DOE OSTI2025

Evaluation of E3SM Simulated Aerosols and Aerosol‐Cloud Interactions Across GCM and Convection‐Permitting Scales

This paper introduces an Earth system modeling testbed for predicting aerosols and aerosol‐cloud interactions (ACIs) at convection‐permitting scales. Using the Energy Exascale Earth System Model (E3SM) version 2 with a four‐mode Modal Aerosol Module, we conduct simulations at 3.25 km resolution on a regionally refined mesh (RRM) across four regions with distinct aerosol and cloud regimes. Results are compared with the standard 100 km E3SM configuration and evaluated against satellite, aircraft, and ground‐based observations. We find that increasing model resolution improves heavy precipitation simulation but amplifies positive bias in light drizzle at coarse resolution. These resolution‐induced changes affect cloud and aerosol properties to varying degrees across regions. Generally, cloud cover and liquid water path (LWP) show better agreement with satellite retrievals at 3.25 km, though surface‐based comparisons suggest otherwise. Aerosol composition remains poorly represented at both resolutions. The RRM increases Aitken mode aerosol number concentrations via enhanced new particle formation. However, accumulation mode aerosols are decreased at higher resolution as aerosol removals become more efficient. This partially contributes to fewer cloud condensation nuclei (CCN) and lower cloud droplet number concentrations (N d ), which produces larger model biases in some scenarios. These findings suggest that solely increasing horizontal resolution to kilometer scales is insufficient to broadly improve aerosol and cloud predictions without concurrent advancements in physical and chemical process representations. Nonetheless, the RRM moderately improves key ACI relationships such as CCN‐N d correlation, reflecting enhanced aerosol activation representation. The LWP‐N d relationship is also better captured by RRM, suggesting a better characterization of LWP adjustment.

Huang, Meng [Pacific Northwest National Laboratory↗
DOE OSTI2021

Computational Evaluation of Thermal Response of Open-Cell Foam With Circular Pore (Computional Evaluation of Thermal Response of Open-Cell Foam with Circular Pore)

The evaluation of effective material properties in heterogeneous materials (e.g., composites or multicomponent structures) critically relevant to a wide spectrum of applications, including nuclear power, electronic packaging, flame retardants, hypersonics, and gas turbine power. The work described in this paper is centered around the numerical assessment of the thermal behavior of porous materials obtained from finite element thermal modeling and simulation. Here, two-dimensional, steady state analyses were performed on unit cells with centered, circular pores using a second order accurate Galerkin finite element method (FEM). The effective thermal conductivities of the porous systems were examined, encompassing a range of porosities from 4.9% to 60.1%. The geometries of the models were generated based on ordered circular pores for each modeled porosity level. The system response quantity (SRQ) under investigation was the dimensionless effective thermal conductivity across the unit cell. The dimensionless effective thermal conductivity was compared across all simulated cases, producing a trend between porosity and effective thermal conductivity. In the presented investigation, the method of manufactured solutions (MMS) was used to perform code verification, and the grid convergence index (GCI) was employed to estimate discretization uncertainty as solution verification. Code verification concluded an approximately second order accurate Galerkin FEM solver. It was found that the introduction of porosity to the unit cell material structure reduces effective thermal conductivity, as anticipated. Numerical results obtained in this study are compared to an analytical solution and to a sample of empirical data.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Evaluating Entrainment–Mixing Characteristics through Direct Comparisons of Drop Size Distributions Using In Situ Observations from ACE-ENA

Abstract Constraining the impacts of entrainment and associated mixing (i.e., entrainment–mixing) on cloud properties continues to be difficult, partly due to observational uncertainties as well as a lacking consensus of which methodologies for diagnosing entrainment–mixing are most appropriate. This study introduces a novel method to evaluate the presence and degree of inhomogeneous and homogeneous mixing using ∼100 h of in situ observations from a research aircraft over the northeastern Atlantic. Specifically, drop size distributions are compared between regions containing negligible and significant entrainment for select flight legs, making a direct characterization of the degree of homogeneous and inhomogeneous mixing possible. A measure of drop concentration variance is used as a proxy variable to diagnose entrainment–mixing. Results correspond well with entrainment–mixing metrics, showing lower Damköhler numbers where drop size distributions shift toward smaller drop sizes (i.e., inhomogeneous mixing) and greater transition length scales where drop size distributions do not (i.e., homogeneous mixing). Inhomogeneous mixing occurs in most samples from Aerosol and Cloud Experiment in the Eastern North Atlantic (ACE-ENA) (regardless of homogeneous mixing frequencies increasing with increasing spatial resolution from ∼100 to ∼10 m) and is associated with decreased drop size relative dispersion and both greater aerosol and drop concentrations compared with homogeneous mixing. Precipitating clouds have a greater frequency of homogeneous mixing compared with nonprecipitating clouds. The proposed methodology is similarly applied to in situ observations of southeast Pacific stratocumulus, shallow convective clouds over central Oklahoma and low-level clouds over the Southern Ocean. All four locations are primarily dominated by inhomogeneous mixing with minimal variability among each region.

Clouds↗
DOE OSTI2024

SMART Task 6: Evaluation of the Costs of Geologic CO2 Storage for the Illinois Basin Decatur Project Site Using the NRAP/SMART Technoeconomic and Liability Evaluation for Storage (TALES) Model

This is a presentation featuring an analysis related to SMART Task 6 in which CO2 storage costs are presented. The National Energy Technology Laboratory has developed the NRAP/SMART Technoeconomic and Liability Evaluation for Storage (TALES) model to provide quantitative cost-based insights to support developers planning CO2 injection and storage projects. TALES calculates the revenues, costs, and financial performance of candidate CO2 saline storage project based on site-specific activity costs and financial parameters. TALES is being integrated as a module pertaining to storage cost as part of the broader SMART Visualization and Decision Support Platform (SVDSP). In this study, the TALES model was applied using real activity cost data associated with the development and operations at the Illinois Basin Decatur Project (IBDP) CO2 storage project site. Scenario analysis was implemented in which crucial operational and cost attributes were varied and the associated cost implications observed. Key results data and project cost summary metrics like first-year breakeven price of CO2 ($/tonne) and net present value (NPV) are presented in similar fashion to how they will appear in the SVDSP.

Vikara, Derek↗
DOE OSTI2021

Evaluating Probability of Containment Effectiveness at a GCS Sites using integrated assessment modeling approach with Bayesian decision Networks

Improved scientific and engineering understanding of the behavior of geologic CO2 storage together with established regulatory framework and incentive structures raise the prospects for accelerated, large-scale deployment of this greenhouse gas emissions reduction approach. Incentive structures call for the establishment of appropriate verification and accounting approaches to support claims of the integrity of a geologic storage complex and to justify taking credit for long-term storage. In this study, we present a framework for assessing the probability of containment effectiveness over the lifetime of a geologic carbon storage site (e.g., after 70 years of injection and post-injection site performance) using forward stochastic model realizations based on site characterization data and using a monitoring-informed Bayesian network based on hypothetical detectability from surface seismic surveys over the site injection and post-injection phases. The National Risk Assessment Partnership’s open-source Integrated Assessment Model (NRAP-Open-IAM) was utilized to develop an ensemble of 10,000 a priori stochastic forecasts of CO2 containment. Those simulations were used to train the Bayesian network model to estimate the prior probabilities of the CO2 leakage mass into overlying, monitorable aquifers considering the uncertainties in the reservoir properties, permeability of potentially leaky wells and the overlying aquifers. The conditional probabilities in the Bayesian network were either learned from the NRAP-Open-IAM simulations or derived from the predefined detection thresholds for the monitoring method. Observations obtained from monitoring, over time during the site operation phases were then used to generate updated posterior probabilities of containment (and any loss from containment) in the Bayesian network by propagating the prior probabilities through the conditional probabilities. We demonstrate how to construct and use the Bayesian network for verifying the long-term storage complex effectiveness informed by monitoring based on the NRAP-Open-IAM simulations previously developed for the FutureGen 2.0 site. This approach may have relevance for stake holders to demonstrate secure geologic storage, provide a defensible, probabilistic approach to claim credit for geologic storage, and to estimate the likelihood that any fraction of the claimed credit may need to be refunded to the creditor based on available monitoring information.

Bayesian network, Risk assessment, Monitoring, car↗
DOE OSTI2020

Evaluating the impact of functional groups on membrane‐mediated CO 2 / N 2 gas separations using a common polymer backbone

Abstract Polymeric membranes have shown tremendous promise for the separation of CO 2 from flue gas streams. However, few systematic studies have been conducted to better understand the impact that chemical functionalities have on membrane‐based gas separation performance. To address this gap, we herein describe the synthesis and gas separation performance of a series of vinyl‐addition polynorbornenes bearing various CO 2 ‐philic functional groups. To facilitate direct comparison between functional groups, each material was designed to maintain a common polymer backbone. Though the incorporation of CO 2 ‐philic moieties within a dense polymeric membrane is frequently hypothesized to enhance CO 2 solubility, and thereby increase CO 2 /N 2 selectivity, our results demonstrate that the incorporation of CO 2 ‐philic groups onto a common polymer backbone do not necessarily result in increased gas separation performance. Experimental and computational results demonstrate that the incorporation of amidoxime groups onto a polynorbornene backbone increase CO 2 /N 2 selectivity, whereas commonly employed ethereal side chains only increased permeability.

Higgins, Morgan A.↗
DOE OSTI2022

Evaluating Grid Strength under Uncertain Renewable Generation

The increasing displacement of synchronous generators with renewable resources such as wind and solar via power electronic interfaces causes a reduction in short-circuit strength and weak grid issues. The variation and uncertainty of renewable energy increase challenges for identifying weak grid conditions. This paper proposes an efficient method to analyze the impact of uncertain renewable energy on grid strength. The proposed method uses the probabilistic collocation method (PCM) to approximate the results of grid strength assessment under uncertain renewable generation, in order to reduce computational burden without compromising result accuracy when compared with traditional Monte Carlo simulation (MCS). To improve the accuracy of the approximation results, the proposed method integrates the K-means clustering technique with PCM to select the approximation samples of input variables. The efficacy of the proposed method is demonstrated by comparison with MCS on the modified IEEE 9-bus system and modified IEEE 39-bus system with multiple renewable generators.

grid strength↗