Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “evaluation framework”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 325 records · Page 18

Computational materials reliability assessment of hydrogen fueled gas turbine power generation engines

The use of blended fuel sources in land based gas turbine engines drives variations in the resulting operational profile (temperatures and pressures) which can impact engine reliability. Furthermore, variability in the manufacture of components affects the resulting microstructure which directly impacts material performance and reliability. Currently, data-driven models are typically used for maintaining and inspecting fleets of engines. Without explicitly capturing material and operational sources of variability conservatism must be used in developing component-level reliability models. Therefore, there exists an opportunity to use information from materials-scale physics models to better inform reliability modeling and reduce conservatism; the impact is more cost-efficient operation and maintenance of current and future fleets. Specifically, this work establishes a computational framework for evaluating the probabilistic high temperature creep performance of hot-section Ni-based superalloys where uncertainty comes from both microstructural and operational variability. A novel high-fidelity physics model which phenomenologically captures grain-boundary sensitive phenomena has been established. A probabilistic calibration procedure was used to calibrate the model and capture uncertainty in the parameterized model coefficients. A design of experiments methodology was established for identifying informative microstructural digital representations for suitable for forward model evaluation. Results show that training a machine-learning surrogate using this design criteria outperforms random selection of microstructural representations. Finally, two surrogate models were developed: (1) a deterministic surrogate model which predicts the local field response given microstructure, constitutive model parameters, and operating conditions (stress, temperature) and (2) a probabilistic model, where uncertainty comes from constitutive law uncertainty, built using denoising diffusion probabilistic models which samples responses given (1) microstructure and (2) operating conditions. These surrogate models enable partner Siemens Energy to rapidly perform UQ analysis specific to creep deformation across a range of microstructures and operating conditions. The impact is that these ML and physics codes can be used to establish more advanced reliability models for the inspection, servicing, and maintenance of land based gas turbine engines.

36 MATERIALS SCIENCE↗

Agent-based Modeling for the Multi-objective Optimization of Energy Production Pathways: Integrated Techno-Economics and Life Cycle Assessment

This project developed an integrated modeling framework to evaluate how purpose-grown bioenergy feedstocks could support large-scale sustainable aviation fuel production in the United States. Led by Colorado State University with project partners, the work combined geographically resolved analysis, techno-economic assessment, life cycle assessment, multi-objective optimization, and agent-based modeling to examine feedstock performance, deployment potential, land-use implications, and adoption dynamics. The overall goal was to identify practical and sustainable pathways for producing aviation fuel from feedstocks such as energy crops, woody crops, oilseeds, and algae while helping inform policy, investment, and research needs tied to national SAF goals. In essence, the project provides a systems-level assessment of the opportunities and constraints associated with scaling bioenergy-based aviation fuels in the U.S.

09 BIOMASS FUELS↗

Uncertainty and Sensitivity Analysis Methods and Applications in the GDSA Framework (FY2024)

The Spent Fuel and Waste Science and Technology Campaign (SFWST) of the U.S. Department of Energy (DOE) Office of Nuclear Energy (NE) is conducting research and development on geologic disposal of spent nuclear fuel (SNF) and high-level nuclear waste (HLW). Two priorities for SFWST are design concept development and disposal system modeling. These priorities are directly addressed in the Geologic Disposal Safety Assessment (GDSA) control account, which is charged with developing a geologic repository system modeling and analysis capability, and the associated software, GDSA Framework, for evaluating disposal system performance for nuclear waste in geologic media.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Superstructure Optimization for Brine Valorization from Brackish Water Desalination

This poster presents preliminary results from a superstructure optimization framework developed to identify cost-optimal brine valorization configurations for brackish water desalination plants across diverse U.S. regional feed chemistries. The study uses brackish groundwater compositions from Arizona, California, Florida, New Mexico, and Texas. Using Pyomo Generalized Disjunctive Programming (GDP) within the WaterTAP modeling environment, the optimization framework simultaneously evaluates thousands of candidate treatment configurations, spanning nanofiltration, reverse osmosis, and chemical precipitation, to minimize the levelized cost of water (LCOW) while meeting water recovery targets and product recovery constraints. Results across eight representative feed clusters demonstrate water recovery rates of 57–87% and net LCOW values ranging from -$0.032/m³ (net revenue-positive) to $0.80/m. Notably, no single process configuration was optimal across all feed types, underscoring the necessity of feed-specific optimization. Products targeted include calcium carbonate (CaCO₃) at $0.01/kg and sodium chloride (NaCl) at $0.10/kg, both at 95% purity, with product revenues offsetting treatment costs in several scenarios. The work advances NAWI's process systems engineering capabilities for multi-configuration screening.

58 GEOSCIENCES↗

Flexible AI Models for Grid Resilience

The rapid growth in size and complexity of artificial intelligence (AI) and machine learning (ML) models has led to increased energy demands, posing a threat to the reliability of the existing power grid. This project addresses the challenge of highly intermittent and energy-intensive inference workloads by (1) developing fidelity-adaptive neural networks capable of dynamic response to grid conditions and (2) integrating these networks with power flow simulations to assess their impact on power grid reliability. We will explore both top-down and bottom-up approaches to create hierarchies of submodels that provide a controlled trade-off between power draw and prediction accuracy. The top-down method utilizes NN pruning to reduce a flagship model into progressively smaller, energy-efficient variants. The bottom-up approach employs geometrically principled weight setting strategies to construct depth-efficient models from the ground up. A real-time hardware-in-the-loop (HIL) platform will be developed to simulate a scaled AC power grid, integrating live AI workload power draw and enabling dynamic model switching in response to grid feedback. This work will provide a novel framework for evaluating the impact of flexible AI/ML workloads on grid performance and establish new methodologies for energy-aware computing in data centers. The outcomes will demonstrate that adaptive AI/ML can play a critical role in improving grid stability while advancing NREL's leadership in energy-efficient computing research.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Resilience Metrics for Solar Photovoltaics

This workshop presentation proposes the development of solar photovoltaic (PV) system resilience metrics and a methodology and framework for evaluation of PV resilience metrics. PV resilience metrics are needed to establish a consistent basis for reporting, evaluation, and data collection by industry, evaluate performance of PV systems that have been subject to natural hazards, correlating resilience to system attributes, and predicting resilience for any PV system. PV resilience metrics can guide improved system design, standards, and insurance coverage. Establishing consistent metrics can foster data collection on impacts of natural hazards on PV systems.

14 SOLAR ENERGY↗

The ABCs of On-Demand Transit (ODT)

On-demand mobility - also referred to as on-demand transit (ODT) - is a form of public mobility that is flexible with respect to where and when service is provided, and ODT deployments have increased significantly in recent years. Transit agencies are becoming increasingly interested in ODT, and due to differing definitions and various service design and business model options, it can be difficult to learn about the emerging industry. This work provides an overview of the definitions of ODT, recent trends internationally and in the U.S., ODT's benefits and challenges (particularly compared to fixed-route transit), three primary service design options, system costs and funding considerations, and a metrics framework for evaluating ODT systems to ensure continued successful performance. Identified benefits include increased service areas, short ride and wait times, increased user flexibility, potential to reduce energy consumption and emissions through shared trips and smaller, right-sized vehicles, increased safety and comfort through door-to-door service, and rich data streams including granular spatio-temporal data that can be analyzed to continuously improve the service. Challenges include scaling ODT service up as small increases in ridership require additional supply to keep service quality high, serving peak times including keeping low wait times, the lack of fixed schedule being challenging for commuters, integrating ODT services with nearby transit systems, and equity for riders without smartphones who cannot track the vehicle in a mobile app. Finally, an overview of seven ODT case studies (in Texas, Missouri, New York, and Ontario, Canada) performed by NREL and related analysis of travel time, energy and emissions, costs, and equity are presented. Initial key findings include: ODT can be cost- and energy-effective compared to fixed-route transit, ODT serves more people than other transit options, and ODT system deployments can be followed by rapid growth.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Atmospheric Modeling and Denoising for Millimeter-Wave Line Intensity Mapping

Line-intensity mapping (LIM) offers a promising approach to mapping large-scale cosmic structure, and the greatest obstacle for ground-based observations at millimeter wavelengths is foreground contamination from atmospheric emission. In this work, we present a simulation and denoising framework designed to isolate and subtract atmospheric fluctuations from LIM data, modeled after the instrument parameters of the South Pole Telescope Summertime Line Intensity Mapper (SPT-SLIM). We generate mock observations spanning 125-175 GHz containing cosmic signals, precipitable water vapor screens, ice crystal fluctuations, and photon noise. We then implement a spatial-spectral atmospheric removal pipeline combining per-pixel linear template regression with a two-dimensional Fourier-domain filter. The framework is evaluated under simulated conditions in the South Pole and the Atacama Desert across three key metrics: cosmic signal preservation, foreground subtraction efficiency, and instrument noise injection. Our pipeline achieves atmospheric suppression at large spatial scales, and these results establish a physically grounded foundation for atmosphere removal in ground-based LIM data collection.

Saye, Laney [UC, Berkeley (main)] (ORCID:000900078↗

Utilizing Reinforcement Learning to Continuously Improve a Primitive-Based Motion Planner

We report in this paper describes how the performance of motion primitive-based planning algorithms can be improved using reinforcement learning. Specifically, we describe and evaluate a framework that autonomously improves the performance of a primitive-based motion planner. The improvement process consists of three phases: exploration, extraction, and reward updates. This process can be iterated continuously to provide successive improvement. The exploration step generates new trajectories, and the extraction step identifies new primitives from these trajectories. These primitives are then used to update rewards for continued exploration. This framework required novel shaping rewards, development of a primitive extraction algorithm, and modification of the Hybrid A* algorithm. The framework is tested on a navigation task using a nonlinear F-16 model. The framework autonomously added 91 motion primitives to the primitive library and reduced average path cost by 21.6 seconds, or 35.75% of the original cost. The learned primitives are applied to an obstacle field navigation task, which was not used in training, and reduced path cost by 16.3 seconds, or 24.1%. Additionally, two heuristics for the modified Hybrid A* algorithm are designed to improve effective branching factor.

42 ENGINEERING↗

Design of solvent-assisted plastics recycling: Integrated economics and environmental impacts analysis

In 2018, the United States generated over 35. 7 million tons of plastic waste, with only 8.4% being recycled and the other 91.6% incinerated or disposed of in a landfill. The continued growth of the polymer market has raised concerns over the end of life of plastics. Currently, the waste management system is faced with issues of inefficient sorting methods and low-efficiency recycling methods when it comes to plastics recycling. Mechanical recycling is the commonest recycling method but presents a lower-valued recycled material due to the material incompatibilities introduced via the inefficient sorting methods. Chemical recycling offers a promising alternative as it potentially allows for plastics to maintain their original properties. To that end, there is the need to investigate feasible chemical recycling methods to help mitigate the challenging problem posed by plastics at the end-of-life stage. This work proposes a conceptual solvent-assisted plastics recycling framework based on a superstructure optimization approach. This framework is evaluated using a representative case study to recover Polyethylene Terephthalate (PET). In this case study, it is found that polymer recovery is both economically and environmentally favorable when compared to traditional methods of disposal such as incineration.

Lehr, Austin L.↗

Farm Practice Typologies as a Strategy for Management-Relevant Land Use and Land Cover Mapping in the Great Lakes Region (Version 1) [Dataset]

Dataset overview and development This dataset provides spatially explicit agricultural land-use and land-management typologies developed for the Great Lakes Region (GLR) at the farm-parcel level. The typologies were designed to characterize not only the land-use and land-cover (LULC) associated with individual agricultural farm parcels, but also the land-management practices (LMPs), including irrigation, tile drainage, and conservation easements, occurring within those parcels and how these characteristics change through time. The dataset contains four related typology products: Annual integrated typology – describes the combined LULC and land-management characteristics for each farm parcel for individual years. LULC transition typology – describes the temporal pattern of LULC change for each farm parcel across the study period (2008-2023). LMP trend typology – describes the temporal pattern in the occurrence of LMPs for each farm parcel across the study period. Multi-year integrated typology – combines the LULC transition typology and LMP trend typology to provide an integrated characterization of long-term land-use and management patterns. Purpose of the dataset The purpose of these products is to provide a management-relevant integrated and consistent framework for evaluating the spatial and temporal organization of agricultural landscapes across the GLR. The resulting typologies can: support landscape-scale environmental and land-use analysis; provide spatial information relevant to land-management strategies, conservation planning, policy development, and program evaluation; characterize spatial patterns of agricultural land use and management; examine changes in agricultural landscapes through time; and identify persistent, transitional, and changing agricultural systems. Please refer to the README file provided in Files for more details.

Agriculture↗

OpenCGRA: An Open-Source Unified Framework for Modeling,Testing, and Evaluating CGRAs

Coarse-grained reconfigurable arrays (CGRAs),loosely defined as arrays of functional units (e.g, adder, sub-tractor, multiplier, divider, or larger multi-operation units, butsmaller than a general-purpose core) interconnected through aNetwork-on-Chip, provide higher flexibility than domain-specificASIC accelerators while offering increased hardware efficiencywith respect to fine-grained reconfigurable devices, such as FieldProgrammable Gate Arrays (FPGAs). The fast evolving fieldsof machine learning and edge computing, which are seeing acontinuous flow of novel algorithms and larger models, makeCGRAs ideal target architectures to allow domain specializationwithout loosing too much generality. They also generally offerquicker and more effective reconfigurability than FPGAs, po-tentially allowing adaptation during actual algorithm execution,and implement a dataflow programming paradigm that adaptswell to these emerging workloads. Designing and generating aCGRA, however, still requires to define the type and number ofthe specific functional units, implement their interconnect andthe network topology, and perform its simulation and validation,given a variety of workloads of interest.In this paper, we propose OpenCGRA, a Python-based unifiedframework that integrates generation, modeling, testing and eval-uation for CGRAs. OpenCGRA is the first open-source integratedframework able to support the full top-to-bottom design flow forspecializing and implementing CGRAs: modeling at different ab-straction levels (functional level, cycle level, register-transfer level),generation, simulation, testing at different granularities (unit test-ing, integration testing, property-based testing), and characteriza-tion (area, power, and timing). OpenCGRAs will be made availableon GitHub.

CGRA, synthesis↗

Developing Metrics to Assess Justice and Equity Implications of Early-Stage Research

Physics is a central component of early-stage research and development of virtually all technologies. But as much as scientific breakthroughs often hold the key to high efficiencies, long lifetimes, and high stability in devices for countless applications, early-stage choices research choices, such as those around materials or processing, can also serve to lock in long-term social and equity impacts of deployed technologies. This talk will explore how scientists can start to consider these impacts, with a focus on the energy sector and achieving a just and sustainable energy transition. We discuss development of the Justice Underpinning Science and Technology Research (JUST-R) metrics framework - a suite of metrics targeted at early-stage researchers to assess justice considerations in their work. The framework is evaluated for its appeal to researchers and effectiveness at promoting integration of justice considerations into research through case studies, which reveal its ability to broaden researcher perspectives and key avenues for future improvement.

energy equity↗

A CHIL Validation of Machine Learning-Assisted Methods for Real-Time Controls of Solar PV for Grid Services: Preprint

Recent research has highlighted the potential for solar to act as a zero-marginal-cost and zero-emission flexibility resource on the bulk power system when operated with advanced control systems. To increase the performance of these systems, leading technologies, including machine learning (ML) and hierarchical inverter set point allocation, have been proposed; however, these technologies lack comprehensive validation under real-world application scenarios. This paper addresses this gap by designing and developing a controller-hardware-in-the-loop framework to evaluate the performance of different flexible solar technologies in responding to automatic generation control signals in a closed-loop fashion. Simulation results indicate the superior performance of an ML-based approach compared to the conventional reference-control grouping-based approach, showcasing its potential to support grid stability and operational efficiency.

closed-loop validation↗

NE-COST plug-in: Expanding ACCERT's Capabilities for Life-Cycle Cost Modeling

The Algorithm for the Capital Cost Estimation of Reactor Technologies (ACCERT) is a structured methodology and software tool designed to simplify and standardize cost estimation for nuclear reactor technologies [1]. By utilizing a relational database structure and modular cost estimation algorithms, ACCERT delivers a robust, flexible, and scalable framework for evaluating costs across various reactor types and configurations [2]. The recent integration of the NE-COST plugin further expands ACCERT’s scope by introducing detailed life-cycle cost modeling and probabilistic analysis of uncertainties. This addition enables users to evaluate costs across front-end processes such as uranium enrichment and fabrication, as well as back-end activities including waste disposal and geologic storage. Through Monte Carlo statistical cost simulations, the plugin provides probabilistic insights into cost ranges, offering critical decision-making support for stakeholders including reactor developers, policymakers, and researchers.

Zhou, Jia↗

Oversizing and Part-Load Problems

Oversizing, the common engineering practice of specifying devices with capacity exceeding the actual load requirement, is a widespread practice across virtually all building technologies end-use categories, including HVAC, electrical systems, lighting, appliances, and plug loads. This practice, driven by factors like design uncertainty, institutional pressures, and risk aversion, results in wasted capital investment, control difficulties, and excessive energy consumption due to inefficient part-load operation. Part-load operation, where devices run below maximum capacity, is the dominant operating mode in most energy systems and presents a complex design challenge. Solutions to match output to load fall into three broad categories: constraining the output, adjusting the device’s internal behavior, and linking output to energy storage or other waste-heat reuse applications. The energy implications of part-load are critical, as efficiency often drops sharply as load decreases across a wide diversity of devices. To quantify the extent of this problem, we derive a dimensionless Part-Load Metric (PLM) based on device efficiency and its frequency distribution of operating hours at various output levels. The PLM quantifies the deviation of a device's actual efficiency from its maximum design efficiency. This metric also serves as a measure of "capital inefficiency," enabling engineers to compare the impact of different part-load solutions and providing a unified framework for evaluating performance across various devices and systems.

Meier, Alan↗

Atmospheric Modeling and Denoising for Millimeter-Wave Line Intensity Mapping

Line-intensity mapping (LIM) offers a promising approach to mapping large-scale cosmic structure, and the greatest obstacle for ground-based observations at millimeter wavelengths is foreground contamination from atmospheric emission. In this work, we present a simulation and denoising framework designed to isolate and subtract atmospheric fluctuations from LIM data, modeled after the instrument parameters of the South Pole Telescope Summertime Line Intensity Mapper (SPT-SLIM). We generate mock observations spanning 125-175 GHz containing cosmic signals, precipitable water vapor screens, ice crystal fluctuations, and photon noise. We then implement a spatial-spectral atmospheric removal pipeline combining per-pixel linear template regression with a two-dimensional Fourier-domain filter. The framework is evaluated under simulated conditions in the South Pole and the Atacama Desert across three key metrics: cosmic signal preservation, foreground subtraction efficiency, and instrument noise injection. Our pipeline achieves atmospheric suppression at large spatial scales, and these results establish a physically grounded foundation for atmosphere removal in ground-based LIM data collection.

Saye, L. K. [UC, Berkeley (main)] (ORCID:000900078↗