Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “evaluation framework”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 523 records · Page 29
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Establishing and Maintaining Engagement for a Distributional Equity Analysis [Slides]

The Distributional Equity Analysis (DEA) is an analytical framework that allows for the evaluation of the distributional equity of utility resource investments in combination with benefit-cost analysis. This guide serves as a resource for organizations to develop an engagement strategy for a DEA that is accessible, inclusive, and grounded in community interests. It is organized by the guiding principles of engagement for a DEA, summarized in the figure on the right, and offers a compendium of resources for further support and learning.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

Comprehensive Life Cycle Analysis of Methanol Production and Methanol-to-Diesel Conversion

Methanol is a strategic chemical and intermediate in the manufacture of synthetic diesel, due to its versatility, diesel’s compatibility with existing infrastructure, and their role in industrial and transport applications. Conventional production methods for methanol, primarily steam methane reforming (SMR), rely on natural gas and are subject to the price variability due to market conditions and geopolitical events. They are also associated with greenhouse gas (GHG) emissions. Methanol and synthetic diesel production could be integrated with nuclear energy to stabilize fuel prices and insulate pricing from outside geopolitical events due to the relative stability of nuclear fuel as compared to natural gas. This could lead to increased transportation fuel security, reliability and resilience. An added benefit is the abatement of emissions when substituting nuclear energy for conventional energy from natural gas. This report presents a comprehensive life cycle analysis(LCA) framework which was developed to evaluate the GHG emissions reduction potential associated with nuclear integrated methanol production, methanol-to-diesel upgrading, and end-use combustion. Gate-to-gate methanol production and cradle-to-grave emissions were evaluated in, starting with a business-as-usual (BAU) SMR-based methanol plant, and then considering stepwise nuclear integration. Methanol-to-diesel (MTD) conversion was evaluated accounting for nuclear energy integration and hydrogen production via high-temperature steam electrolysis (HTSE) using electricity either from the grid or from a dedicated nuclear power system. This multi-step process diverts stable and reliable nuclear energy into the transportation sector by upgrading low energy dense natural gas into liquid fuels fully compatible with existing infrastructure.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2026

Reliability of Digital Communications in Nuclear Facilities and Operations

A comprehensive evaluation of methods to compare the reliability of wired and wireless digital communication networks for use in nuclear power plants. The study underscores the critical role of communication reliability in ensuring operational safety in nuclear power plants. Key objectives include developing a methodology to assess communication technologies’ reliability, particularly for comparing wireless and wired networks, for nuclear facility applications. The framework focuses on technology-agnostic evaluations and emphasizes the importance of reliability metrics spanning safety, security, and monitoring functions. The framework emphasizes that the key performance indicators are application dependent and provides a hierarchy of different network types that will have different reliability requirements. The report considers both existing plants and advanced reactors, including small modular reactors.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2026

Evaluating Technology Adoption Risks in Early-Stage Materials Research

Development of new technologies often begins with fundamental materials science research. Decisions at this stage can shape factors related to the eventual adoption readiness of the technology, such as process scalability or materials availability. Here we present the early-Stage Technology Evaluation for Adoption Risks (STEAR) framework as a method for qualitatively assessing metrics spanning four categories of adoption risks: value proposition, market acceptance, resource maturity, and license to operate. We conduct a case study applying STEAR to different methanol production processes at a range of technology readiness levels and demonstrate how the assessment identifies key challenges related to adoption readiness. Finally, we discuss efforts to expand the applicability and utility of STEAR, including focus group feedback and complementary quantitative analysis methods.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Insights from PPL's DERMS Implementation

PPL Electric Utilities’ Keystone Solar Future Project (KSFP) is part of the U.S. Department of Energy’s Office of Energy Efficiency and Renewables, Energy Enabling Extreme Real-time Grid Integration of Solar Energy (ENERGISE) grant. The three-year project, beginning in October, 2017, funded an innovative pilot program to develop and evaluate a technology platform and framework for managing high levels of distributed energy resources (DER), and improving future DER interconnection. The KSFP aimed to bridge gaps between existing and future technology, including Distributed Energy Resource Management Systems (DERMS), by monitoring, managing, and optimizing a system with high penetration of solar and other DER. Specifically, the project worked to make Demand Management Systems (DMS) applications, devices, and real-time communications technology DER-aware to allow for advanced applications for utility operations. Here, by installing and implementing a DERMS, project designers transformed how DERs interact with PPL’s distribution system, offering learnings and results worth sharing industry-wide.

Leader, Jared↗
DOE OSTI2025

Optimizing Power Line Undergrounding Decisions under Varying Wildfire Risk and Weather Scenarios

Abstract—The threat of wildfire ignitions from electric power equipment has led utilities to increasingly turn to preemptive power shutoffs, which, while effective in reducing grid-induced wildfire risk, can cause significant load loss. Undergrounding power lines is an alternative strategy for preventing grid-induced wildfires. However, undergrounding lines is costly, so an efficient undergrounding plan must balance reductions in wildfire risk and load loss with the cost of undergrounding lines. We propose a robust optimization model to identify which power lines to underground to maximize load served while limiting wildfire risk across a range of wildfire risk and weather scenarios. Since solving this problem may be computationally heavy for large power grids and many operating scenarios, we present a delayed constraint generation algorithm to iteratively add scenarios until an optimal solution is found. We evaluate the performance of this framework on the RTS-GMLC with scenarios representing a year of operating conditions and compare it with a stochastic programming formulation. Our results indicate that our undergrounding model is successful in reducing load shed and risk compared to baseline cases in which no mitigation action is taken and only power shutoffs are implemented (no undergrounding). The robust formulation also reduces more load shed than the stochastic formulation in the most extreme scenarios. Index Terms—grid resilience, optimization, transmission systems, underground power lines, wildfire risk.

Taylor, S. [Department of Electrical and Computer ↗
DOE OSTI2026

Cost-Benefit Assessment of Additive Manufacturing for Injection Molds

This report presents an additive-manufacturing (AM) technology, where AM Cyclic Olefin Resin (COR) molds would be used for injection molding. The National Laboratory of the Rockies (NLR) team has focused on the costs and economics of this developing technology. This report presents a cost-benefit analysis of using the polySpectra AM COR molds made of COR, at the start of the project (Present') and the potential lifetime, cost-effectiveness, and performance by the end of the project period (Period 3'). The analysis of the AM COR molds is compared to traditional Computer Numerical Control (CNC) machined aluminum molds across the time periods. A cost-benefit model framework has been developed to evaluate AM COR molds. This model accounts for mold delivery to customers, current and future levels of technology readiness, the type of material injected, and various business cases. AM COR molds offer a major advantage in lead time, reducing production setup from weeks or months (with CNC machining) to as little as two to five days. This enables faster prototyping, quicker design cycles, and accelerated time-to-market, critical in industries like electronics, aerospace, medical devices, and automotive. Even modest improvements in the durability of polySpectra AM COR molds show the potential for these molds to complement traditional tooling. With further development, AM COR mold technology could provide significant time and cost savings while supporting increased domestic manufacturing capacity.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2022

Case Study: Applying the Idaho National Laboratory Resilience Framework to St. Mary’s, Alaska

The Idaho National Laboratory (INL) resilience framework has been developed to broadly apply to EEDS so that all elements of systems that contain distributed wind can be part of the resilience evaluation. The users or audience for this framework can include any stakeholders associated with the EEDS. Not all electrical energy systems have the same stakeholders; customers, owners, and operators are generally present but have different interests. Considering the broad electrical grid, customers, regulators, investors, utility planners, engineers, and operators each have an interest in system resilience driven from different motivating factors. This document focuses on the planning stage of the framework. In this document, each step is explained briefly before demonstrating its application to the St. Mary’s-Mt. Village system. The framework can be used for many types of resilience planning. It can be used to evaluate current overall resilience, or the resilience of certain subsystems. It can be used to explore existing resilience weak points and propose mitigations. It can also be used to evaluate the resilience benefits of a new investment. We use the latter application for this case study. Although the wind turbine in St. Mary’s has already been installed, the resilience benefits that the turbine provided were not well defined. It was installed with the main objective to generate electric power from a renewable resource in an effort to reduce the local dependency on fuel oil as the sole source of electric power generation, which is a resilience goal on its own, but there are other ways in which the turbine can add resilience to the system, as well as scenarios of interest to analyze how resilient the wind turbine itself is against different hazards. In this case study, we analyze the operation of the St. Mary’s power system both with the wind installed and without the wind installed during different resilience hazards of interest. This allows us to compare the performance with wind and without wind and to quantify the resilience benefits provided by wind. Our MIRACL partners at PNNL will then take the resilience benefits and assign value to the resilience provided by wind based on costs and costs avoided in the different scenarios.

17 WIND ENERGY↗
DOE OSTI2020

Reliability-Informed Life-Cycle Warranty Cost Analysis: A Case Study on a Transmission in Agricultural Equipment

In agricultural and industrial equipment, both new and remanufactured systems are often available for warranty coverage. In such cases, it may be challenging for equipment manufacturers to properly trade-off between the system reliability and the cost associated with a replacement option (e.g., replace with a new or remanufactured system). To address this problem, we present a reliability-informed life-cycle warranty cost (LCWC) analysis framework that enables equipment manufacturers to evaluate different warranty policies. These warranty policies differ in whether a new or remanufactured system is used for replacement in the case of product failure. The novelty of this LCWC analysis framework lies in its ability to incorporate real-world field reliability data into warranty policy assessment using probabilistic warranty cost models that consider multiple life cycles. First, the reliability functions for the new and remanufactured systems are built as the time-to-failure distributions that provide the best-fit to the field reliability data. Then, these reliability functions and their corresponding warranty policies are used to build the LCWC models according to the specific warranty terms. Finally, Monte Carlo simulation is used to propagate the time-to-failure uncertainty of each system, modeled by its reliability function, through each LCWC model to produce a probability distribution of the LCWC. The effectiveness of the proposed reliability-informed LCWC analysis framework is demonstrated with a real-world case study on a transmission used in some agricultural equipment.

agricultural equipment↗
DOE OSTI2021

Modeling and Evaluation of Cyber-Attacks on Grid-Interactive Efficient Buildings

Grid-interactive efficient buildings (GEBs) are not only exposed to passive threats (e.g., physical faults) but also active threats such as cyber-attacks launched on the network-based control systems. The impact of cyber-attacks on GEB operation are not yet fully understood, especially as regards the performance of grid services. To quantify the consequences of cyber-attacks on GEBs, this paper proposes a modeling and simulation framework that includes different cyber-attack models and key performance indexes to quantify the performance of GEB operation under cyber-attacks. The framework is numerically demonstrated to model and evaluate cyber-attacks such as data intrusion attacks and Denial-of-Service attacks on a typical medium-sized office building that uses the BACnet/IP protocol for communication networks. Simulation results show that, while different types of attacks could compromise the building systems to different extents, attacks via the remote control of a chiller yield the most significant consequences on a building system’s operation, including both the building service and the grid service. It is also noted that a cyber-attack impacts the building systems during the attack period as well as the post-attack period, which suggests that both periods should be considered to fully evaluate the consequences of a cyber-attack.

Fu, Yanyang↗
DOE OSTI2026

scPlantAnnotate: an accurate and robust transformer-based model for plant cell type annotation

Accurate cell type annotation remains a major bottleneck in plant single-cell RNA sequencing (scRNA-seq), where existing tools are often adapted from animal studies and perform sub-optimally on plant data. The lack of plant-specific computational frameworks limits the construction of plant cell atlases and downstream biological discovery. We develop and evaluate scPlantAnnotate, a Transformer-based reference annotation framework tailored for plant scRNA-seq data, and benchmark it against state-of-the-art deep learning and conventional methods across multiple plant species. Species-specific scPlantAnnotate models were trained using curated datasets from Arabidopsis thaliana, Zea mays, Oryza sativa, and Glycine max. We compared scPlantAnnotate with leading baselines under both standard random-split evaluation and a more stringent leave-one-dataset-out setting, which tests robustness to completely unseen datasets and tissue types. scPlantAnnotate consistently outperforms existing approaches across all four species under random-split evaluation. In the leave-one-dataset-out setting for A. thaliana, where performance drops markedly for all methods due to strong batch effects and dataset heterogeneity, scPlantAnnotate nonetheless achieves the highest Accuracy, Macro-F1, Balanced Accuracy, and Macro-AUROC on average and ranks first on most held-out datasets. These results demonstrate improved robustness to dataset shifts, a critical yet underexplored challenge in plant scRNA-seq analysis. A freely accessible web server enables users to annotate their own datasets using pretrained models. scPlantAnnotate provides a plant-specific, Transformer-based framework for single-cell annotation that delivers state-of-the-art performance and enhanced robustness to unseen datasets. By addressing limitations of existing tools and enabling scalable reference-based annotation, scPlantAnnotate supports the development of comprehensive plant cell atlases and facilitates broader use of single-cell genomics in plant biology.

Bioinformatics↗
DOE OSTI2022

Case Study: Applying the INL Resilience Framework to Iowa Lakes Electric Cooperative Distributed Wind Systems

Traditional metrics and evaluation methods for resiliency are not sufficient to evaluate the effect that distributed wind systems will have, particularly in light of the challenges described above. While the concept of resiliency is not new, its application to the electric grid is neither standardized nor well-defined, and there is little to no guidance on how to evaluate resilience specifically for distributed wind systems. To fill this gap, the Idaho National Laboratory (INL), as part of the multi-laboratory Microgrids, Infrastructure Resilience, and Advanced Controls Launchpad (MIRACL) project, has developed a resilience framework for electric energy delivery systems (EEDS). The framework provides detailed steps for evaluating resiliency in the planning, operational, and future stages, and encompasses five core functions of resilience. It allows users to evaluate the resilience of distributed wind, taking into consideration the resilience of the wind systems themselves, as well as the effect they have on the resiliency of any systems they are connected to. In this study, we evaluate the resilience of the distributed wind systems at Iowa Lakes Electric Cooperative to cybersecurity hazards. We show that the wind resource can benefit the overall system resilience during some hazards. We show that the practices in place make the wind subsystems resilient against some cybersecurity hazards but that there are still significant risks associated with other cybersecurity hazards

17 WIND ENERGY↗
DOE OSTI2022

GCS site selection in saline Miocene formations in South Louisiana

One of the key requirements of a commercial scale geologic carbon sequestration (GCS) site selection process is identifying injection sites to safely inject and retain injected CO 2 over extended time scales. This requires thorough evaluation of site-specific surface and subsurface features. A site screening and selection framework was developed and used to identify potential sites in South Louisiana, incorporating surface data including site proximity to large CO 2 stationary sources, vicinity of large population centres and state lands, land usage, legacy oil and gas wells, and local/regional geologic trends. Regionally the Miocene sediments thicken and dip towards the south, reflecting a prograding deltaic environment during the Miocene which resulted in the deposition of thick packages of fine-grained sandstones suitable for CO 2 storage. The results of three example selected sites that are spatially separated with varying subsurface and surface features are presented in this study. The multiple stacked sand zones at these sites provide ample amount of pore volume for CO 2 storage with varying degree of stratigraphic/structural traps for long terms storage containment. Here, the screening framework presented in this study and the detailed evaluation of three specific sites in South Louisiana provides a process to screen and characterize sites for GCS projects and the suitability of these Miocene sediments for commercial scale CO 2 storage projects. It is envisioned that the analysis described in this paper will be beneficial for a large number of audiences involved in GCS work and aid in the site selection process.

58 GEOSCIENCES↗
DOE OSTI2021

A Decision Support Framework for Grid-Aware Electric Bus Charge Scheduling

While there are many advantages to electric public transit vehicles, they also pose new challenges for fleet operators. One key challenge is defining a charge scheduling policy that minimizes operating costs and power grid disruptions while maintaining schedule adherence. An uncoordinated policy could result in some buses running out of charge before completing their trip, while a grid agnostic policy might incur higher energy costs or cause an adverse impact on the grid’s distribution system. We present a grid aware decision-theoretic framework for electric bus charge scheduling that accounts for energy price, grid load, and bus status. The framework connects environmental models for traffic (SUMO) and the electric grid (GridLAB-D) to a planner, which evaluates bus charging decisions with regard to their long-term effect on grid reliability and cost. The framework has been evaluated on a simulation of Richland, WA’s bus and grid network, and compared to greedy methods.

EV, machine leaning, EV-Grid, Transportation, Grid↗
DOE OSTI2021

Analytical Framework for Homeowner-Focused Computational Cost-Benefit Mitigation Decision Making

As a result of increasing windstorm losses in the United States over the past 50 years, a variety of residential wind hazard mitigation strategies have been recommended. Wind hazard mitigation undoubtedly reduces windstorm losses; however, little customized information is available to support the economic decision-making process for individual stakeholders, especially at the consumer level. Therefore, there is a need for decision support tools to calculate, evaluate, and present the economic benefits of mitigation over variable decision-making time horizons for unique building characteristics in specific geographical locations. This paper presents a cost-benefit computational decision-making recommendation framework that evaluates and presents the cost effectiveness of mitigation, customized based on location, years of interest, and building characteristics. The decision-making framework consists of two cores. The user-independent core and user-dependent core which consists of eight steps, divided into four subprocesses: (1) data acquisition, (2) data evaluation, (3) cost-benefit calculation, and (4) results comparison and decision making. To demonstrate the framework, a wood-framed single-family home in light suburban terrain in Golden Meadow, Louisiana, is used as a case study, considering retrofit mitigation with a $15,000 budget and a decision-making time horizon of 30 years. The case study provides six mitigation options, with cost ranging between approximately $2,000 and $15,000 and net benefit/cost ratios ranging from 2.4 to 13. Once fully implemented in a decision making information tool, the developed mitigation recommendation framework will provide valuable information that can be used by home designers, builders, owners, and other stakeholders to better understand the economic facets of wind hazard mitigation, providing critical information as part of the overall decision-making process.

Orooji, Fatemeh↗
DOE OSTI2023

Electrolyzers in the System Advisor Model (SAM): A Techno-Economic Potential Study

A technoeconomic analysis of grid to low temperature electrolysis (Grid-LTE), photovoltaic to low temperature electrolysis (PV-LTE), concentrating solar power to high temperature electrolysis (CSP-HTSE) and a concentrating solar power with PV to high temperature electrolysis (CSP-PV-HTSE) centralized hydrogen production systems are analyzed to assess the economics of system and to provide a baseline for comparing these technologies against hydrogen production cost targets. A framework integrating the system advisor model (SAM) and US Department of Energy hydrogen production models (H2A) is developed to assess these systems. The hydrogen levelized cost given current and future assumptions for technology cost and performance is evaluated at optimal system configurations. The framework described in this report integrates SAM with H2A electrolyzer technologies and provides analysts a detailed technoeconomic method to analyze concentrating and photovoltaic solar technologies to produce energy that are directly coupled to LTE and HTSEs that use that energy to split water into hydrogen and oxygen. The baseline hydrogen levelized cost (HLCs) for the GRID-LTE, PV-LTE, CSP-HTSE, and CSP-PV-HTSE systems in Daggett, CA are 2.82, 3.86, 3.68, and 2.90 $\$$USD 2016/kg H2 and 2.50, 2.13, 2.84, 2.15 $\$$USD 2016/kg H2 in the 2020 and 2050 scenarios respectively. To achieve the $\$$2/kg H2 target in locations with excellent solar resources, cost parameters values aligned with aggressive R&D targets will need to be achieved for all the systems configurations. In Daggett, PV costs of $\$$0.68 /Wac or moderate ATB PV CAPEX projections result in HLCs of $\$$2 /kg H2. Similarly for PV-MSALT-HTSE systems, $\$$0.60 /Wac result in $\$$2/kg H2. For the MSALT-HTSE systems, better than aggressive 2050 ATB salt tower CAPEX projections would be needed to reach $\$$2/kg H2. Molten salt tower capital costs of $\$$2400/kW would enable $\$$2/kg H2 in 2050.

08 HYDROGEN↗