Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “evaluation framework”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,621 records · Page 90
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

From Cell to System: Accelerated hpc Simulations of BESS Aging under Frequency Regulation and Arbitrage use cases

Lithium-ion battery energy storage systems (BESS) packs have emerged as a leading solution for grid-scale energy storage, enhancing resiliency and balancing load fluctuations. Yet, experimental characterization of large-format LIB packs-particularly to assess performance and degradation over hundreds of cycles - demands substantial hardware investment and multi-year testing campaigns. In this work, we couple a hierarchical, physics-based modeling framework agnostic to electrode chemistries with high-performance computing to accelerate systems level evaluation by upto two orders of magnitude. Building on the open-source liionpack platform, we implement cell, module, and pack-scale electrochemical models enriched with mechanistic aging mechanisms and deploy them on an HPC cluster to simulate 150−200kWh systems over 500 - 1,000 cycles with in days. We subject these virtual B ESS to both constant-current cycling and realistic grid service profiles spanning frequency regulation, ramp-rate support, and energy arbitrage-and quantify the resulting degradation patterns. Our results reveal that localized cell aging can induce substantial nonuniformity at module and pack levels, with service-specific cycling protocols driving distinct aging modes. This rapid, multiscale modeling approach provides a powerful design-space exploration tool for optimizing electrical architecture, control strategies, and operational schedules to prolong pack lifetime and lower total cost of ownership.

Ayalasomayajula, Surya [ORNL] (ORCID:0009000860788↗
DOE OSTI2024

Community-Based Transactive Coordination Mechanism for Enabling Grid Edge Systems

The changing landscape of the electricity industry, characterized by a surge in distributed energy resources (DERs) and proactive customers, necessitates practical solutions for coordinated operations especially at the distribution-level. This paper introduces a community-based transactive coordination mechanism designed to incentivize customers for providing localized and system-level services reflected through real-time prices. The work presents a bidding approach for communities with DERs, such as solar photovoltaic (PV) and battery energy storage systems (BESS), to formulate their price-responsiveness for retail energy coordination, emphasizing a community-centric model. By sending bidding curves to a third-party, the mechanism enables customers with DER assets to actively participate in localized coordination with the load serving entity (LSE), thereby supplementing each other’s and even the utilities needs through a shared energy economy. The proposed transactive mechanism is implemented leveraging a co-simulation framework that integrates a distribution grid simulator and Python-based agents for performance evaluation. Collaboration with a local utility to access real distribution feeder models and consumption profiles yields simulation results demonstrating the potential to reduce costs by 12\% for communities with DERs like PV and BESS.

Community-based coordination, grid-edge systems, R↗
DOE OSTI2010

Interactive Exploration and Analysis of Large-Scale Simulations Using Topology-Based Data Segmentation

Large-scale simulations are increasingly being used to study complex scientific and engineering phenomena. As a result, advanced visualization and data analysis are also becoming an integral part of the scientific process. Often, a key step in extracting insight from these large simulations involves the definition, extraction, and evaluation of features in the space and time coordinates of the solution. However, in many applications, these features involve a range of parameters and decisions that will affect the quality and direction of the analysis. Examples include particular level sets of a specific scalar field, or local inequalities between derived quantities. A critical step in the analysis is to understand how these arbitrary parameters/decisions impact the statistical properties of the features, since such a characterization will help to evaluate the conclusions of the analysis as a whole. We present a new topological framework that in a single-pass extracts and encodes entire families of possible features definitions as well as their statistical properties. For each time step we construct a hierarchical merge tree a highly compact, yet flexible feature representation. While this data structure is more than two orders of magnitude smaller than the raw simulation data it allows us to extract a set of features for any given parameter selection in a postprocessing step. Furthermore, we augment the trees with additional attributes making it possible to gather a large number of useful global, local, as well as conditional statistic that would otherwise be extremely difficult to compile. We also use this representation to create tracking graphs that describe the temporal evolution of the features over time. Our system provides a linked-view interface to explore the time-evolution of the graph interactively alongside the segmentation, thus making it possible to perform extensive data analysis in a very efficient manner. We demonstrate our framework by extracting and analyzing burning cells from a large-scale turbulent combustion simulation. In particular, we show how the statistical analysis enabled by our techniques provides new insight into the combustion process.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Optimization of District Heating Network Parameters in Steady-State Operation

Here we examine the modeling, simulation, and optimization of district heating systems, which are widely used for thermal transport using steam or hot water as a carrier. We propose a generalizable framework to specify network models and scenario parameters, and develop an optimization method for evaluating system states including pressures, fluid flowrates, and temperatures throughout the network. The network modeling includes pipes, thermal plants, pumps, and passive or controllable loads as system components. We propose basic models for thermodynamic fluid transport and enforce the balance of physical quantities in steady-state flow over co-located outgoing and return networks. We formulate an optimization problem with steam and hot water as the outgoing and return carriers, as in legacy twentieth century systems. The physical laws and engineering limitations are specified for each component type, and the thermal network flow optimization problem is formulated and solved for a realistic test network under several scenarios.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2025

Temperature Field Reconstruction of Surfaces Heated Through Radiative Heat Transfer Using Convolutional Neural Networks

Microreactors could play a crucial role in decarbonizing our energy portfolio. However, their development and implementation come with specific challenges, particularly regarding cost. Due to their compact size and the harsh operational environment, collecting real-time data on reactor operation can be challenging. Many probe designs are unable to withstand extreme conditions (e.g., temperature, radiation) in the reactor. In this context, using convolutional neural networks (CNNs) can pave the way for developing a nonintrusive approach that relies solely on ex-core sensors. A well-trained physics-informed CNN can reconstruct the distribution of a given physical quantity over a domain using only a few sensors, allowing us to reconstruct the desired field distribution even in a limited space or complex geometries where a large array of sensors is impractical. In this work, we present the initial steps toward developing a real-time tool for monitoring the thermal behavior of nuclear reactor pressure vessels. Based on an experimental setup, a computational model using the Multiphysics Object-Oriented Simulation Environment (moose) framework was built, where the Ray Tracing and Heat Conduction modules were used to evaluate the temperature distribution over a convex metal surface heated through radiative heat transfer. This metal surface represents a section of a heated nuclear reactor vessel wall. The model also accounts for solid mechanics physics through the moose Solid Mechanics module. In situ experimental data, acquired from a Texas A&M facility, were used to validate the computational model. Part of the data generated by the moose model was used to train the convolutional neural network to reconstruct the vessel wall's outer surface temperature. The CNN generalization was then compared against the experimental and computational data.

Aldeia Machado, Luiz Carlos↗
DOE OSTI2025

FEMP Cybersecurity Arsenal

The FEMP Cyber Security Arsenal is a family of cyber security tools for the federal facility owners and operators. Using these tools, facility owners can evaluate their overall cybersecurity posture. These tools are web-based front-end tools. The tools are meant to help federal owners and operators to evaluate their overall cybersecurity posture. These tools are developed based on the NIST Cybersecurity framework, risk management framework, and DOE C2M2 architectures. Version 3 provides significant updates and features in ten areas

Ashley, Travis [Pacific Northwest National Laborat↗
DOE OSTI2019

An Investigation of Plume Response to Soil Vapor Extraction and Hypothetical Drum Failure

Core Ideas Soil vapor extraction (SVE) wells are an effective interim remediation technique. Flow and transport modeling assists in evaluation of vapor plume behavior. Plume simulations assuming drum failure and SVE provide a framework for remediation planning. A small borehole subset could be monitored for detection of VOC releases due to drum failure. Soil vapor extraction (SVE) has been used at sites across the Department of Energy complex, including sites where legacy subsurface wastes represent a potential source of groundwater contamination. At Los Alamos National Laboratory (LANL), leakage from waste drums buried at an inactive chemical waste site has created a subsurface vapor plume of volatile organic compounds (VOCs). Soil vapor extraction operation in 2015 and rebound testing through 2017 were successful in reducing the plume's mass and mitigating VOC migration toward the water table. However, the possibility that waste drums could fail and release VOCs could pose a challenge in the future. To explore the impacts of drum failure, as well as the capabilities of SVE remediation, we simulated hypothetical contaminant release scenarios and subsequent SVE remediation. Three‐dimensional subsurface VOC behavior, including advection, diffusion, and plume interactions with topography, were simulated using the porous flow simulator Finite Element Heat and Mass Transfer. Simulations of future site conditions have allowed identification of “sentry” boreholes that can be monitored for early detection in case of drum failure. Sentry boreholes can also be used to set concentration thresholds above which SVE should be initiated. For the LANL site, simulations show that SVE can be started 3 yr following drum failure and remain a viable remediation tool. More broadly, the principles outlined in this work can be used to support remediation planning at other subsurface waste sites. Predictive models of future releases can be analyzed to set concentration threshold values, guide selection of sentry boreholes, and increase operational efficiency.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2017

FY17 Status Report on the Initial Development of a Constitutive Model for Grade 91 Steel

Grade 91 is a candidate structural material for high temperature advanced reactor applications. Existing ASME Section III, Subsection HB, Subpart B simplified design rules based on elastic analysis are setup as conservative screening tools with the intent to supplement these screening rules with full inelastic analysis when required. The Code provides general guidelines for suitable inelastic models but does not provide constitutive model implementations. This report describes the development of an inelastic constitutive model for Gr. 91 steel aimed at fulfilling the ASME Code requirements and being included into a new Section III Code appendix, HBB-Z. A large database of over 300 experiments on Gr. 91 was collected and converted to a standard XML form. Five families of Gr. 91 material models were identified in the literature. Of these five, two are potentially suitable for use in the ASME code. These two models were implemented and evaluated against the experimental database. Both models have deficiencies so the report develops a framework for developing and calibrating an improved model. This required creating a new modeling method for representing changes in material rate sensitivity across the full ASME allowable temperature range for Gr. 91 structural components: room temperature to 650° C. On top of this framework for rate sensitivity the report describes calibrating a model for work hardening and softening in the material using genetic algorithm optimization. Future work will focus on improving this trial model by including tension/compression asymmetry observed in experiments and necessary to capture material ratcheting under zero mean stress and by improving the optimization and analysis framework.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Development of Novel Materials for Direct Air Capture of CO 2 : MIL-101(Cr)-Amine Sorbents Evaluation Under Realistic Direct Air Capture Conditions (Final Report)

The overarching goal of this project is to evaluate the CO 2 adsorption properties of a small family of metal-organic framework (MOFs) materials functionalized with amines at sub-ambient conditions. Our goal is to develop capabilities to measure CO 2 adsorption at conditions more relevant to the weather of the planet. For this purpose, Georgia Tech is constructing a “sub-ambient adsorption facility” in partnership with ZCP Sorbent Development, LLC, aimed specifically at rapidly and deeply characterizing the performance of DAC candidate materials in this important operational range (adsorption at -20 to 20 °C and RH of 0-100%). Here, we use the sub-ambient lab instrumentation designed or adapted to study the behavior of the pristine metal organic framework (MOF) MIL-101(Cr) and the MOF in the presence of amines ranging from small molecules (e.g. TREN, tris(2-aminoethylamine)) to oligomers (e.g. PEI, poly(ethyleneimine)). Any DAC sorbent must be amenable to deployment in practical contactors for gas-solid contacting (traditional pellet-based fixed beds are impossible at scale). To this end, we developed and tested these DAC materials in the forms of composite polymer/MOF fibers and custom 3D-printed monolith structures containing MOF DAC sorbents. The proposed studies advance these materials from technology readiness level (TRL) 2 to TRL 3.

01 COAL, LIGNITE, AND PEAT↗
DOE OSTI2022

Countering Weapons of Mass Destruction (CWMD) Device Cybersecurity Characterization Process and Profile

Countering Weapons of Mass Destruction (CWMD) recognizes that threats in the cyberspace domain continue to grow, which requires CWMD devices and supporting systems to be both cybersecure (ability to protect or defend from cyber-attacks) and resilient (ability to maintain required capability in the face of adversity) to cyber threats. The CWMD cybersecurity characterization approach in this document supports existing cyber resilience activities within the Acquisition Lifecycle Framework. Similarly, this process supports existing Department of Homeland Security Cyber Resilience Test and Evaluation activities, which consist of iterative processes, starting at the initiation of system acquisition and continuing throughout the entire device and system life cycle. Cyber resilience is the ability of an information system to continue to operate while under attack, even if in a degraded or debilitated state, and to rapidly recover operational capabilities for essential functions after a successful attack. The goal of the security characterization task for CWMD is to support the development of a CBRN device-dependent profile that aligns with device network capabilities and maps to recommended security controls to create a characterization security profile impact levels. The impact levels for CWMD devices should be characterized as Low (L), Moderate (M), High (H) to align with the low, moderate, high control baselines. To estimate the impact levels, the device’s security-related attributes are translated into the security objectives: Confidentiality (C), Integrity (I), and Availability (A), known as the CIA triad. The potential impact for each device can be L, M, H, for devices that connect and transmit different types of data and may have different impact levels. National Institute of Standards and Technology Federal Information Processing Standards Publication 199 states, “the potential impact values assigned to the respective security objectives shall be the highest value from among those security categories that have been determined for each type of information resident on the information system.” As CWMD is determining the cybersecurity impact levels of CBRN devices based on network connections and data transfers, the impact levels are aligned with the associated attributes of network connections and communications. For example, if the device system is connected to a wireless network and transmits different data types based on the confidentiality of the data, the highest impact value for each security objective should represent the device’s CIA impact level. This document is intended to be used by test managers, test team, and program managers.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗
DOE OSTI2024

Countering Weapons of Mass Destruction (CWMD) Device Cybersecurity Characterization Process and Profile

Countering Weapons of Mass Destruction (CWMD) recognizes that threats in the cyberspace domain continue to grow, which requires CWMD devices and supporting systems to be both cybersecure (ability to protect or defend from cyber-attacks) and resilient (ability to maintain required capability in the face of adversity) to cyber threats. The CWMD cybersecurity characterization approach in this document supports existing cyber resilience activities within the Acquisition Lifecycle Framework. Similarly, this process supports existing Department of Homeland Security Cyber Resilience Test and Evaluation activities, which consist of iterative processes, starting at the initiation of system acquisition and continuing throughout the entire device and system life cycle. Cyber resilience is the ability of an information system to continue to operate while under attack, even if in a degraded or debilitated state,1 and to rapidly recover operational capabilities for essential functions after a successful attack.2 The goal of the security characterization task for CWMD is to support the development of a CBRN device-dependent profile that aligns with device network capabilities and maps to recommended security controls to create a characterization security profile impact levels. The impact levels for CWMD devices should be characterized as Low (L), Moderate (M), High (H) to align with the low, moderate, high control baselines. To estimate the impact levels, the device’s security-related attributes are translated into the security objectives: Confidentiality (C), Integrity (I), and Availability (A), known as the CIA triad. The potential impact for each device can be L, M, H, for devices that connect and transmit different types of data and may have different impact levels. National Institute of Standards and Technology Federal Information Processing Standards Publication 199 states, “the potential impact values assigned to the respective security objectives shall be the highest value from among those security categories that have been determined for each type of information resident on the information system.”3 As CWMD is determining the cybersecurity impact levels of CBRN devices based on network connections and data transfers, the impact levels are aligned with the associated attributes of network connections and communications. For example, if the device system is connected to a wireless network and transmits different data types based on the confidentiality of the data, the highest impact value for each security objective should represent the device’s CIA impact level. This document is intended to be used by test managers, test team, and program managers.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗
DOE OSTI2025

NeuroSymbolic Approaches as a Vector for Assured Artificial Intelligence

The deployment of artificial intelligence systems in critical applications requires higher levels of assurance for safety, security, and interpretability. While neurosymbolic (NESY) approaches combining neural networks with symbolic reasoning offer potential advantages for assured AI, existing differentiable neurosymbolic frameworks face significant limitations including computational overhead and performance constraints. This report investigates the ISED (InferSampleEstimateDescend) framework as an alternative approach that enables neurosymbolic learning without requiring endtoend differentiability. We evaluate ISED’s utility for geointelligence applications by comparing neurosymbolic models against standard neural networks on aircraft classification tasks using the RarePlanes and MTARSI imagery datasets. Our results demonstrate that while ISEDbased models achieve slightly lower accuracy (89.7% vs 92.1% on RarePlanes; 91.1% vs 92.5% on MTARSI), they provide critical explainability capabilities that enable tracing incorrect predictions back to specific attribute misclassifications. We also present an automated pipeline that generates both attributeclass mappings and neurosymbolic model architectures from natural language descriptions, significantly reducing the manual effort required for NESY model deployment. These findings suggest that ISED offers a promising direction for developing assured AI systems where interpretability and reasoning transparency are prioritized alongside performance.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

An Accuracy-Maximization Approach for Claims Classifiers in Document Content Analytics for Cybersecurity

This paper presents our research approach and findings towards maximizing the accuracy of our classifier of feature claims for cybersecurity literature analytics, and introduces the resulting model ClaimsBERT. Its architecture, after extensive evaluations of different approaches, introduces a feature map concatenated with a Bidirectional Encoder Representation from Transformers (BERT) model. We discuss deployment of this new concept and the research insights that resulted in the selection of Convolution Neural Networks for its feature mapping aspects. We also present our results showing ClaimsBERT to outperform all other evaluated approaches. This new claims classifier represents an essential processing stage within our vetting framework aiming to improve the cybersecurity of industrial control systems (ICS). Furthermore, in order to maximize the accuracy of our new ClaimsBERT classifier, we propose an approach for optimal architecture selection and determination of optimized hyperparameters, in particular the best learning rate, number of convolutions, filter sizes, activation function, the number of dense layers, as well as the number of neurons and the drop-out rate for each layer. Fine-tuning these hyperparameters within our model led to an increase in classification accuracy from 76% obtained with BertForSequenceClassification’s original model to a 97% accuracy obtained with ClaimsBERT.

Ameri, Kimia (ORCID:0000000328791871)↗
DOE OSTI2018

System-level risk assessment of carbon sequestration into a naturally fractured aquifer at Kevin Dome, Montana

As actual CO2 injection is unlikely to take place at Kevin Dome, Montana, the Big Sky Carbon Sequestration Partnership has turned to maximizing the value of existing data acquired at the site. We present the risk assessment work done using the National Risk Assessment Partnership (NRAP) to Kevin Dome, Montana. Geologic CO2 sequestration in saline aquifers poses certain risks including CO2/brine leakage through wells or non-sealing faults into ground water or land surface. These risks are difficult to quantify due to data availability and uncertainty. One solution is running large numbers of numerical simulations on the primary CO2 injection reservoir, shallow reservoirs/aquifers, faults, and wells to assess leakage risks and uncertainties. However, a full-physics simulation is usually too computationally expensive. NRAP integrated assessment model (NRAP-IAM) uses reduced order models (ROMs) developed from numerical reservoir simulations of a primary CO2 injection reservoir to address this issue. A powerful stochastic framework allows NRAP-IAM to explore complex interactions among many uncertain variables and evaluate the likely performance of potential sequestration sites. In this study, we investigate the sensitivity of a variety of uncertain parameters to CO2/brine leakage through (1) legacy wellbore and (2) fault pathways. We found major uncertain parameters to which the potential CO2 leakage through legacy wellbore is sensitive including values of fracture permeability, end-point CO2 relative permeability, capillary pressure, and permeability of confining rocks. CO2 and brine leakage through fault pathways is sensitive to fracture permeability, length of the faults, and fault displacement.

Nguyen, Minh↗
DOE OSTI2019

REopt: Enabling Renewable Energy, Storage, and Combined Heat and Power

Deployment of distributed energy resources including combined heat and power (CHP), photovoltaics (PV), and battery storage is growing as building and campus owners seek to reduce energy costs and increase resilience to grid outages. While deployment of a single technology is widespread, integrated systems of multiple technologies are also becoming more common to provide maximum economic and resilience benefits. To accelerate deployment, decision makers require tools to evaluate the technical and economic feasibility of these integrated systems. This paper presents a framework for optimizing the size and dispatch strategy of CHP with PV and battery storage to minimize life-cycle cost of energy. The modeling methodology is presented, with a particular focus on the linearization of cost and performance metrics required for implementation in a mixed integer linear program. A case study is used to examine the technical and economic viability of integrated CHP, PV, and battery systems, compared to CHP-only or PV+battery storage systems. In the case study we show how the integrated systems can provide increased economic and resilience benefits compared to single technologies on their own. The case study presented shows the combined CHP, PV, and battery system resulted in a 7% lower life cycle cost than CHP only, and a 22% lower life cycle cost than PV+battery storage. The life cycle emissions for CHP, PV, and battery storage resulted in a 24% reduction than CHP only and a 17% increase than PV+battery storage.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2019

Development of a Real-Time Mobility Control and Visualization System with Predictive Vehicle Speed Control for Connected and Automated Vehicles (CAVs)

The Oak Ridge National Laboratory is developing a cloud-based platform for the deployment and evaluation of mobility- and efficiency-oriented connected and automated vehicles (CAVs) applications that will include fundamental data management, communications and visualization elements. This system will serve as a data portal, providing indirect communications that are relevant to efficiency applications, and can be used for both real world CAVs deployments and virtual systems that allow evaluation of new CAVs applications and algorithms. Predictive vehicle speed control algorithms have been developed and will be integrated with the real-time queryable transportation database and geospatial platform to achieve optimized energy efficiency and improved traffic flow in off-freeway driving. This paper describes the technology and summarizes evaluations being conducted for a corridor in Chattanooga, Tennessee, where the technology is expected to be initially deployed. To evaluate the fuel savings resulting from the vehicle speed control and the RTMCS data framework, vehicle powertrain simulations will be completed using results from a calibrated microscopic traffic model.

Laclair, Tim↗
DOE OSTI2025

Trustworthiness and Trust: Identifying Factors that Drive Successful Human-AI Interaction in Nuclear Power Plant Applications

Emerging technologies such as artificial intelligence (AI) and machine learning (ML) are rapidly evolving and considered a promising tool for efficient and continued safe operations of the U.S. nuclear power plants (NPPs). Emerging AI techniques like large language models (LLMs) are one such technology that may support personnel at existing NPPs perform work more efficiently. For example, operators may query the current operational status of a power plant via a chat interface leveraging LLMs to access plant-related information in an interactive manner rather than manually collecting various sensor data for tasks such as surveillances or completing work orders. This is a fundamental shift in the way operators currently perform their tasks today. The literature of human-automation interaction indicates that trust is a crucial factor that drives successful interaction between a human operator and an automated system, like an AI-infused NPP application. This work presents the results of a literature review on key factors that relate to trust in AI/LLM technologies for NPP applications. The relevant literature of human factors and cognitive engineering has identified various factors related to trust including trustworthiness, performance characteristics, operator skill and perceived risk. This preliminary literature review will guide development and evaluation of models involving the identified factors influencing trust in AI and develop a framework for human-centered design for interface between humans and AI. By addressing trust, this work supports developing a technical basis for designing key characteristics of AI/LLM to support calibrated trust, which will ultimately support wide-scale adoption of AI/LLM technologies, as well as ensure safe, effective, and reliable use.

99 - GENERAL AND MISCELLANEOUS↗