Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “evaluation framework”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,243 records · Page 69
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

U.S. DOE Special Session: National Energy Technology Laboratory LCA Update

This work was presented at the American Center for Life Cycle Assessment 2023 Conference in Burlington, VT on September 28, 2023. The evaluation of the environmental advantages and disadvantages of energy technology and policy options requires the comparison of those options on a common basis, and as such, it needs to include not only obvious impacts like converting fuel to useful energy via combustion, but of infrastructure construction, extraction, processing and transportation of fuels, and transport of the final energy product to an end user. Further, it requires comparison across multiple categories of impacts, as single metric perspectives can miss important cross-media tradeoffs. At the Department of Energy’s National Energy Technology Laboratory, life cycle analysis is used as a tool and framework for undertaking a broad range of these types of evaluations. This overview will describe the NETL LCA work over the past year.

Jamieson, Matthew↗
DOE OSTI2026

Development of a Framework and Methodology for an Advanced Reactor Materials Environmental Effects Design Guide

Advanced non-light-water reactor components may operate at elevated temperature while experiencing cyclic loading, significant neutron irradiation, and exposure to reactor coolant. ASME Boiler and Pressure Vessel Code, Section III, Division 5, provides design rules for elevated-temperature service but does not include specific procedures to account for environmental effects on material properties. This report develops an initial framework and methodology for an Environmental Effects Design Guide (EEDG) focused on neutron irradiation; coolant-environment effects are reserved for future work. The proposed approach treats irradiation as a property-based overlay on the existing Division 5 design process, with two routes: a sparse-data route applying two reduction factors — FCR on creep-rupture strength and FF on fatigue life — for the creep-fatigue evaluations that typically control the design of advanced high-temperature reactor components, and a fuller framework developing the property-to-rule chain across the four Division 5 checks (primary load, strain limits and ratcheting, creep-fatigue, and buckling), together with swelling and weldments as scope items. Both routes are scoped by an in-pile qualification that restricts the use of post-irradiation-examination-derived properties in regimes where an in-pile mechanism could control the design outcome. Illustrative outputs derived on a compiled annealed Type 316 database — FCR ≈ 0.78–0.86 and FF ≈ 0.4 — demonstrate the calculation method within that specific dataset. The framework is an initial, testable design-rule concept; it identifies a practical path for preliminary design evaluations under sparse data and the material data and testing needed to develop the framework further.

Barua, Bipul (ORCID:0000000247184113)↗
DOE OSTI2021

Resilience Metrics and Framework for Distributed Wind Presentation

This presentation communicates information about the MIRACL project Resilience Metrics report and Resilience Framework report. It was created for the 2021 MIRACL advisory board meeting. We propose a three-tiered approach for the resilience framework. At the top level, we consider the time horizons on which resilience will be evaluated and executed. At the middle level, we consider the core functions of resilience, which span across the time horizons. At the lower level, we consider the process steps that correspond to implementing practices for resilience in each of the core functions. The framework considers three time horizons in order to enable organizations to assess and improve their system’s resilience throughout its lifecycle. We call these time horizons the planning, operational, and future stages. The planning stage uses organizational needs and current system evaluation to prepare for potential hazards. The operational stage seeks to execute responses to hazards as prudently and efficiently as possible to maintain system resilience. The future stage seeks to improve on current system resilience and feeds back into the planning stage to promote continuous improvement. While all three time horizons are important when considering a specific topic, the planning and evaluation phase (i.e., what is done in advance of the event) is critical in defining a system’s resilience characteristics and in outlining how a system responds to an event. This framework intentionally emphasizes the planning stage to highlight the overarching emphasis of this effort, not to imply that the other two time-related horizons (i.e., operational and change the future) are less important. The core functions in the framework are identify, prepare, detect, adapt, and recover. These five functions stem from a rigorous analysis of definitions used across the industry, and they represent the core capabilities that an organization must have to enable lifecycle resilience. Within each core function, process steps are described that help walk an organization through the information gathering, evaluation, decision-making, and implementation processes they will need to ensure their resilience goals are maintained throughout the system and the system lifecycle. Also highlighted in the figure is the concept that a resilience framework should be cyclical in nature. Because a system’s resilience is based on finite resources and time, it must continually evolve through this framework’s risk management and capital investment steps at an appropriate level of scope and pace.

17 WIND ENERGY↗
DOE OSTI2014

Assessing the CAM5 Physics Suite in the WRF-Chem Model: Implementation, Resolution Sensitivity, and a First Evaluation for a Regional Case Study

A suite of physical parameterizations (deep and shallow convection, turbulent boundary layer, aerosols, cloud microphysics, and cloud fraction) from the global climate model Community Atmosphere Model version 5.1 (CAM5) has been implemented in the regional model Weather Research and Forecasting with chemistry (WRF-Chem). A downscaling modeling framework with consistent physics has also been established in which both global and regional simulations use the same emissions and surface fluxes. The WRF-Chem model with the CAM5 physics suite is run at multiple horizontal resolutions over a domain encompassing the northern Pacific Ocean, northeast Asia, and northwest North America for April 2008 when the ARCTAS, ARCPAC, and ISDAC field campaigns took place. These simulations are evaluated against field campaign measurements, satellite retrievals, and ground-based observations, and are compared with simulations that use a set of common WRF-Chem Parameterizations. This manuscript describes the implementation of the CAM5 physics suite in WRF-Chem provides an overview of the modeling framework and an initial evaluation of the simulated meteorology, clouds, and aerosols, and quantifies the resolution dependence of the cloud and aerosol parameterizations. We demonstrate that some of the CAM5 biases, such as high estimates of cloud susceptibility to aerosols and the underestimation of aerosol concentrations in the Arctic, can be reduced simply by increasing horizontal resolution. We also show that the CAM5 physics suite performs similarly to a set of parameterizations commonly used in WRF-Chem, but produces higher ice and liquid water condensate amounts and near-surface black carbon concentration. Further evaluations that use other mesoscale model parameterizations and perform other case studies are needed to infer whether one parameterization consistently produces results more consistent with observations.

CAM5 physics suite↗
DOE OSTI2019

Fingerprinting Anomalous Computation with RNN for GPU-accelerated HPC Machines

This paper presents a workload classification framework that discriminates illicit computation from authorized workloads on GPU-accelerated HPC systems. As such systems become more and more powerful, they are exploited by attackers to run malicious and for-profit programs that typically require extremely high computing ability to be successful. Our classification framework leverages the distinctive signatures between illicit and authorized workloads, and explore machine learning methods to learn the workloads and classify them. The framework uses lightweight, non-intrusive workload profiling to collect model input data, and explores multiple machine learning methods, particularly recurrent neural network (RNN) that is suitable for online anomalous workload detection. Evaluation results on four generations of GPU machines demonstrate that the workload classification framework can tell apart the illicit authorized workloads with a high accuracy of over 95%.

Zou, Pengfei↗
DOE OSTI2020

Detecting Anomalous Computation with RNNs on GPU-Accelerated HPC Machines

This paper presents a workload classification framework that discriminates illicit computation from authorized workloads on GPU-accelerated HPC systems. As such systems become more and more powerful, they are exploited by attackers to run malicious and for-profit programs that typically require extremely high computing ability to be successful. Our classification framework leverages the distinctive signatures between illicit and authorized workloads, and explore machine learning methods to learn the workloads and classify them. The framework uses lightweight, non-intrusive workload profiling to collect model input data, and explores multiple machine learning methods, particularly recurrent neural network (RNN) that is suitable for online anomalous workload detection. Evaluation results on three generations of GPU machines demonstrate that the workload classification framework can tell apart the illicit authorized workloads with a high accuracy of over 95%.

Pengfei, Zou↗
DOE OSTI2026

High-Resolution WRF-Based Downscaling of Earth System Model Projections for Energy Applications across CONUS

Evaluating energy resources under future scenarios requires meteorological information that adequately resolves regional-scale variability and is suitable for regional energy system studies. Although Earth system model (ESM) outputs provide essential large-scale context, their coarse resolution and inherent biases limit direct use in energy system applications. This work presents a high-resolution dynamical downscaling framework using the Weather Research and Forecasting (WRF) model to generate energy-relevant regional fields for future scenarios over the contiguous United States (CONUS). The framework first identifies an optimal WRF configuration through sensitivity experiments, then evaluates raw and bias-corrected ESM initial and boundary conditions, with soil moisture and soil temperature bias correction implemented as an integral component of the bias-corrected ESM atmospheric forcing prior to WRF dynamical downscaling to improve land-atmosphere interactions. Simulations performed at 4-km resolution show that uncorrected ESM forcing leads to systematically dry and cold soil states, which propagate into elevated near-surface air temperature and solar irradiance biases, particularly during summer for the period 2000-2014. Incorporating bias-corrected atmospheric forcing together with soil state bias correction substantially reduces these errors and improves the representation of surface energy processes in WRF simulations. The results highlight the importance of bias-aware initialization strategies in high-resolution dynamical downscaling for future energy system analysis and planning.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2013

Simulating Collisions for Hydrokinetic Turbines

Evaluations of blade-strike on an axial-flow Marine Hydrokinetic turbine were conducted using a conventional methodology as well as an alternative modeling approach proposed in the present document. The proposed methodology integrates the following components into a Computational Fluid Dynamics (CFD) model: (i) advanced eddy-resolving flow simulations, (ii) ambient turbulence based on field data, (iii) moving turbine blades in highly transient flows, and (iv) Lagrangian particles to mimic the potential fish pathways. The sensitivity of blade-strike prob- ability to the following conditions was also evaluated: (i) to the turbulent environment, (ii) to fish size and (iii) to mean stream flow velocity. The proposed methodology provided fraction of collisions and offered the capability of analyzing the causal relationships between the flow environment and resulting strikes on rotating blades. Overall, the conventional methodology largely overestimates the probability of strike, and lacks the ability to produce potential fish and aquatic biota trajectories as they interact with the rotating turbine. By using a set of experimental correlations of exposure-response of living fish colliding on moving blades, the occurrence, frequency and intensity of the particle collisions was next used to calculate the survival rate of fish crossing the MHK turbine. This step indicated survival rates always greater than 98%. Although the proposed CFD framework is computationally more expensive, it provides the advantage of evaluating multiple mechanisms of stress and injury of hydrokinetic turbine devices on fish.

CFD↗
DOE OSTI2022

Use Cases and Model Development of Thermal Storage Coupling for Advanced Nuclear Reactors

This report discusses the different options for coupling thermal energy storage (TES) systems to advanced nuclear power plants (A-NPPs) in order to enable flexible and hybrid plant operation. An advanced light-water reactor (ALWR) and a high-temperature gas-cooled reactor (HTGR) were selected as the initial use cases for demonstrating a thermally balanced energy storage coupling design for thermal power extraction. Cost functions for the A-LWR were derived from the fully balanced models that were developed based on three different coupling options with three different thermal energy bypass ratios. For the next steps, cost functions for the HTGR will also be derived, and additional nuclear reactors (e.g., a liquid-cooled fast reactor [LFR] or molten-salt reactor [MSR]) will be evaluated for coupling with TES in similar fashion, including the evaluation of their steady-state condition models and cost functions. The models presented herein showcase several design considerations, focusing on optimal deployment methodologies for achieving steady-state operation with minimum disruption to the nuclear power generation cycle. This report presents the results of steady state models developed using Aspen HYSYS®, wherein the thermal energy bypass for an NPP-TES coupling was varied up to 50%. The various components were sized using Aspen Process Economic Analyzer (APEA) and Aspen Exchanger Design and Rating (EDR), when applicable. Cost functions from these models were developed using the latest publicly available data obtained from APEA V11. The current steady-state models and cost functions provide a baseline for additional work focusing on dynamic operation and process optimization by using Idaho National Laboratory (INL)’s Framework for Optimization of Resources and Economics (FORCE) tools to evaluate the technoeconomic viability and transient operations of TES-coupled A-NPPs.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2023

Dynamic Bayesian Networks for Fault Prognosis

A dynamic Bayesian Network (DBN)-based fault prognosis framework is proposed in this study to predict the future fault probabilities of gradual faults. The proposed framework utilizes the trend in prediction error generated from data driven forecasting models to estimate the future fault beliefs. The accuracy and scalability of the proposed method is evaluated using the data from a Modelica-based virtual testbed. Overall, the developed framework demonstrates good potential in estimating future fault probabilities of gradual faults.

Pradhan, Ojas↗
DOE OSTI2026

Evaluating the limitations of Bayesian metabolic control analysis

Bayesian Metabolic Control Analysis (BMCA) is a promising framework for inferring metabolic control coefficients in data-limited scenarios, combining Bayesian inference with linear-logarithmic (lin-log) rate laws. These metabolic control coefficients quantify how changes in enzyme activities affect steady-state fluxes and metabolite concentrations across a metabolic network. However, its predictive accuracy and limitations remain underexplored. This study systematically evaluates BMCA’s ability to infer elasticity values, flux control coefficients (FCC), and concentration control coefficients (CCC) under varying data availability conditions using three synthetic metabolic network models. We demonstrate that BMCA predictions are highly dependent on the inclusion of flux and enzyme concentration data, with the omission of these datasets leading to severe inaccuracies. In our synthetic, enzyme-perturbation datasets, external metabolite concentrations had minimal impact and, in some cases, their exclusion improved predictions; when external-nutrient perturbations were introduced and those concentrations were observed, gains were at most modest. Additionally, we find that posterior estimation with both ADVI and HMC can underestimate large-magnitude elasticities in our synthetic settings, with ADVI showing somewhat higher variance under strong up-regulation; thus, recovering |elasticity| ≳ 1.5 remains challenging regardless of the inference engine. ADVI also fails to accurately infer allosteric interactions, even when regulatory effects are strong. While BMCA maintains reasonable accuracy in partially recovering the rankings of the highest FCC values, its estimates of absolute values remain constrained by prior assumptions and data limitations. Our findings reveal the BMCA algorithm’s strengths and weaknesses, providing guidance on its application in metabolic engineering, and highlighting the need for methodological refinements to enhance its predictive capabilities.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2015

Evaluation of New and Proposed Organic Aerosol Sources and Mechanisms using the Aerosol Modeling Testbed: MILAGRO, CARES, CalNex, BEACHON, and GVAX

This work investigated the formation and evolution of organic aerosols (OA) arising from anthropogenic and biogenic sources in a framework that combined state-of-the-science process and regional modeling, and their evaluation against advanced and emerging field measurements. Although OA are the dominant constituents of submicron particles, our understanding of their atmospheric lifecycle is limited, and current models fail to describe the observed amounts and properties of chemically formed secondary organic aerosols (SOA), leaving large uncertainties on the effects of SOA on climate. Our work has provided novel modeling constraints on sources, formation, aging and removal of SOA by investigating in particular (i) the contribution of trash burning emissions to OA levels in a megacity, (ii) the contribution of glyoxal to SOA formation in aqueous particles in California during CARES/CalNex and over the continental U.S., (iii) SOA formation and regional growth over a pine forest in Colorado and its sensitivity to anthropogenic NOx levels during BEACHON, and the sensitivity of SOA to (iv) the sunlight exposure during its atmospheric lifetime, and to (v) changes in solubility and removal of organic vapors in the urban plume (MILAGRO, Mexico City), and over the continental U.S.. We have also developed a parameterization of water solubility for condensable organic gases produced from major anthropogenic and biogenic precursors based on explicit chemical modeling, and made it available to the wider community. This work used for the first time constraints from the explicit model GECKO-A to improve SOA representation in 3D regional models such as WRF-Chem.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Evaluating Portable Parallelization Strategies for Heterogeneous Architectures in High Energy Physics

High-energy physics (HEP) experiments have developed millions of lines of code over decades that are optimized to run on traditional x86 CPU systems. However, we are seeing a rapidly increasing fraction of floating point computing power in leadership-class computing facilities and traditional data centers coming from new accelerator architectures, such as GPUs. HEP experiments are now faced with the untenable prospect of rewriting millions of lines of x86 CPU code, for the increasingly dominant architectures found in these computational accelerators. This task is made more challenging by the architecture-specific languages and APIs promoted by manufacturers such as NVIDIA, Intel and AMD. Producing multiple, architecture-specific implementations is not a viable scenario, given the available person power and code maintenance issues. The Portable Parallelization Strategies team of the HEP Center for Computational Excellence is investigating the use of Kokkos, SYCL, OpenMP, std::execution::parallel and alpaka as potential portability solutions that promise to execute on multiple architectures from the same source code, using representative use cases from major HEP experiments, including the DUNE experiment of the Long Baseline Neutrino Facility, and the ATLAS and CMS experiments of the Large Hadron Collider. This cross-cutting evaluation of portability solutions using real applications will help inform and guide the HEP community when choosing their software and hardware suites for the next generation of experimental frameworks. We present the outcomes of our studies, including performance metrics, porting challenges, API evaluations, and build system integration.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2019

A Framework for Quantifying Energy and Productivity Benefits of Smart Manufacturing Technologies

The transformative possibilities of smart manufacturing, which is defined by digitization, enhanced connectivity, advanced analytics, and integrated cyber-physical systems in manufacturing processes and systems, have been extensively discussed in the literature. Potential benefits underscored include cost reduction, production flexibility, shorter product times-to-market, energy efficiency, environmental impact reduction, and increased productivity. Scant attention has been given to formal methods for quantifying and analyzing energy productivity to aid a broad range of manufacturing industries in evaluating the merits of adoption. Here we present a strategic analysis framework to estimate cost-effective improvements in energy efficiency and productivity that may be realized through smart manufacturing. The framework uses the cost of conserving energy (CCE) as a complementary measure to determine the feasibility of a set of smart manufacturing interventions in the context of a specific factory, firm, or entire industry. Guided by a function-driven approach based on key performance indicators, the CCE measure accounts for system-wide changes in direct and indirect costs and total energy use relative to the same manufacturing system without smart manufacturing interventions. These changes include cost of cyber-physical systems, which include components such as sensors, controllers, smart equipment, and information and communication technology (ICT) equipment. Additionally, cost and savings are accounted from changes in primary and intermediate inputs, production time, off-spec production, and waste. Energy calculations include upstream energy use of the cyber-physical systems. For complex processes with significant circularity and/or feedbacks, we propose the use of input-output models to characterize elements of the CCE. The framework is discussed in the context of recent efforts in craft breweries to use smart manufacturing for reducing energy intensity and increasing product yield.

Supekar, Sarang D.↗
DOE OSTI2016

Enhanced Performance Assessment Models for Generic Deep Geologic Repositories for High-Level Waste and Spent Nuclear Fuel - 16223

Development of an enhanced performance assessment (PA) capability for geologic disposal of spent nuclear fuel and high-level waste has been ongoing for several years in the U.S. repository program. The new Generic Disposal System Analysis (GDSA) modeling and software framework is intended to be flexible enough to evolve through the various phases of repository activities, beginning with generic PA activities in the current Concept Evaluation phase to site-specific PA modeling in the Repository Development phase. The GDSA Framework utilizes modern software and hardware capabilities by being based on open-source software architecture and being configured to run in a massively parallel, high-performance computing (HPC) environment. It consists of two main components, the open-source Dakota uncertainty sampling and analysis software and the PFLOTRAN reactive multi-phase flow and transport simulator. Reference cases or 'generic repositories' have been, and are being developed, based on typical properties for potential salt, clay, and granite host-rock formations and corresponding engineered design concepts for each medium. Past simulations have focused on a generic repository in bedded-salt host rock, while the most recent research has focused on a reference case for a typical clay/shale host rock. A variety of single-realization (i.e., deterministic) and multi-realization (probabilistic) results for the new clay reference case are presented, including an analysis of the effects of heat generation on repository performance, assuming a 100-year out-of-reactor commercial SNF waste form. Order-of-magnitude differences between predicted radionuclide concentrations in thermal versus isothermal simulations imply that mechanistic, coupled-process modeling in three-dimensional (3-D) domains can be important for building confidence in post-closure performance assessments. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2021

Decreased land use intensity improves surface soil quality on marginal lands

The Conservation Reserve Program (CRP) has been a major factor in land transitions out of intensive row-crop management on marginally productive lands in the central United States. While CRP can protect these more environmentally sensitive lands against erosion and potential nutrient loss, information on how CRP affects soil quality over time is limited. Using a chronosequence with 0–40 yr of CRP conversion history, we evaluated soil quality under different land use intensities (CRP, pasture, row crop) using the Soil Management Assessment Framework (SMAF). Effects of slope classes (higher [14–25%] and lower [2–14%]) and soil depth (0–120 cm) were also evaluated. Our results show that the soils were functioning at 84 and 78% of their theoretical capacity under CRP and row crop, respectively. Conversion to CRP enhanced overall soil quality by increasing soil biological, physical, and chemical attributes, but soil nutrient availability decreased due to the absence of fertilizer application. Increasing soil organic C (SOC) enhanced overall soil quality because of its impact on soil biological, physical, chemical, and nutrient conditions. Conversion to CRP will likely have greater benefits for more environmentally sensitive soils (i.e., higher slope) as demonstrated by structural equation modeling. Land use effects were also depth dependent, with more prominent effects within the 0-to-5-cm than the 5-to-15-cm depth increment. Overall, our methods focused on key soil quality indicators, confirmed ecological benefits of CRP conversion, and provided guidance for improved and simplified land management recommendations.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Bayesian-Motivated Probabilistic Model of Hurricane-Induced Multimechanism Flood Hazards

Multimechanism floods (MMFs) are caused by the simultaneous occurrence of more than one flood mechanism such as storm surge, precipitation, tides, and waves. MMFs can lead to more severe or differing impacts than single-mechanism floods. As a result, comprehensive risk assessments require the ability to assess the multivariate probabilistic behaviors of hazards from MMFs. Here this study introduces a novel Bayesian-motivated approach for the probabilistic assessment of hurricane-induced hazards from the combination of the surge, precipitation, tides, and river antecedent flow. A Bayesian network (BN) is developed to capture the physical (conditional) relationship between variables and facilitate the generation of a hazard curve for river discharge that captures the contributions from multiple flood drivers. A case study located along the Delaware River is used to illustrate the proposed approach. Five computationally efficient representative predictive models are developed to estimate the conditional distributions required for the BN as a means of demonstrating the overall framework. The predictive models used in this study act as placeholders and can be replaced with more sophisticated and high-fidelity models depending on the desired accuracy level. While the predictive models are intended to be representative and illustrative, the model performance is evaluated using three historical storms that affected the area. Overall, the proposed framework is shown to be transparent, effective, and adaptable.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2015

Replica-exchange Wang Landau sampling: pushing the limits of Monte Carlo simulations in materials sciences

We describe the study of thermodynamics of materials using replica-exchange Wang Landau (REWL) sampling, a generic framework for massively parallel implementations of the Wang Landau Monte Carlo method. To evaluate the performance and scalability of the method, we investigate the magnetic phase transition in body-centered cubic (bcc) iron using the classical Heisenberg model parameterized with first principles calculations. We demonstrate that our framework leads to a significant speedup without compromising the accuracy and precision and facilitates the study of much larger systems than is possible with its serial counterpart.

Perera, Meewanage Dilina N↗