Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Evaluation Framework”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Cross-cutting concepts to transform agricultural research

Agriculture is an important link to many issues that challenge society today, including adaptation to and mitigation of climate change, food security, and communicable and non-communicable diseases in animals and humans. Transformation of agriculture and food systems has become a priority for a range of federal agencies and global organizations. It is imperative that food and agricultural researchers effectively harness the global convergence of priorities to overcome research “silos” through deep and sustained systemic change. Herein, we identify intersections in federal and global initiatives encompassing climate adaptation and mitigation; human health and nutrition; animal health and welfare; food safety and security; and equity and inclusion. Many agencies and organizations share these priorities, but efforts to address them remain uncoordinated and opportunities for collaboration untapped. Based on the interconnectedness of the identified priority areas, we present a research framework to catalyze agricultural transformation, beginning with the research enterprise. We propose that transformation in agricultural research should incorporate (1) innovation, (2) integration, (3) implementation, and (4) evaluation. This framework provides approaches for food and agricultural research to contribute to sustainable, flexible, and coordinated transformation in the agricultural sector.

60 APPLIED LIFE SCIENCES↗
NASA NTRS2024

Harmonizing Food Systems Emissions Accounting for More Effective Climate Action

Food systems—encompassing activities in food production, land-use change, supply chains and waste management—contribute significantly to climate change. Recent estimates indicate that food systems produce over 30% of annual anthropogenic greenhouse gas (GHG) emissions (about 20% of CO 2 , 50% of CH 4 , and 75% of N 2 O), with the Intergovernmental Panel on Climate Change (IPCC) estimating a notably broad range of 23%–42% of global GHG emissions. This paper synthesizes current research on the contributions of food systems to climate change, highlights challenges in quantifying their impact and proposes a harmonized accounting framework for more effective climate action. We recommend that an expert committee aligned with the IPCC develop guidance for food systems emissions accounting in four key areas, including: (1) defining system boundaries and nomenclature; (2) developing protocols to allocate broader sectoral emissions to food systems; (3) prioritizing critical areas for research into activity data and emissions factors; and (4) developing a balanced framework for evaluating the impact of mitigation interventions in light of other food systems imperatives. The committee should be integrated into two key international policy processes—the United Nations Framework Convention on Climate Change and the United Nations Food Systems Summit—to support coordinated action towards global net-zero goals. Guidance from the committee could significantly improve the ability of governments, companies, and researchers to estimate, report, monitor and ultimately reduce the climate impacts of food systems.

GHG accounting↗
DOE OSTI2022

Integrating Concentrating Solar Power Technologies into the Hybrid Optimization and Performance Platform (HOPP)

As the world increases renewable energy deployment, there is an increasing interest in hybridizing various generation and storage technologies to maximize net benefit to the developer and/or off-taker. A particularly interesting combination of renewable technologies is concentrating solar power (CSP) with thermal energy storage (TES), photovoltaics (PV), and electrochemical battery energy storage (BESS). Due to the system complexity of CSP technology, it is difficult to evaluate the technological and financial performance of a CSP-PV hybrid system without detailed modeling of annual operations. To address this challenge, we have developed a modeling framework for evaluating the performance and financial viability of CSP systems hybridized with PV and battery technologies. This modeling effort incorporates CSP tower and trough systems into an existing modeling tool recently developed by NREL referred to as the Hybrid Optimization and Performance Platform (HOPP). This report outlines the modeling methodology as well as preliminary results from example case studies conducted using the model. The methodology describes: (i) the integration of CSP tower and troughs into HOPP using python interfaces to access System Advisor Model (SAM) underlining technology models, (ii) the mathematical formulation of the mixed integer linear program dispatch optimization model which optimizes operations of storage asset to either maximize system revenue or minimize operating cost while load following, (iii) the design analysis methods implemented within HOPP, and (iv) simulation clustering for the purposes of reducing computational expense. We exercise the model using a case study of a future scenario where we assume (i) CSP and PV technologies achieve the 2030 cost targets provided by the Solar Energy Technologies Office (SETO), (ii) battery costs reduce to the 2030 mid cost projection presented by NREL. Lastly, (iii) electricity prices for southern California in 2030 are provided by NREL's Cambium database, and (iv) a capacity payment of $150/kW-yr based on the system capacity factor during the to 100 net-load hours.

14 SOLAR ENERGY↗
DOE OSTI2023

Modelling and Optimizing CSP-PV Hybrid Systems Using the Hybrid Optimization and Performance Platform (HOPP)

The hybridization of concentrating solar power (CSP) with thermal energy storage (TES), photovoltaics (PV), and electrochemical battery energy storage systems (BESS) has the potential to provide continuous, high-capacity-factor energy production at a lower cost than a PV-BESS or CSP with TES alone. Because of the system complexity of CSP technology, it is challenging to evaluate the technological and financial performance of a CSP-PV hybrid system without detailed modeling of annual operations. To address this challenge, we have developed a modeling framework for evaluating the performance and financial viability of CSP systems hybridized with PV and BESS technologies. This modeling effort incorporates CSP tower and trough configurations into an existing modeling tool recently developed by NREL, the Hybrid Optimization and Performance Platform (HOPP). This paper provides a brief overview of our methodology, as well as an example case study. CSP with TES hybridized with PV provides the best benefit-to-cost ratio compared to the other simulated technology combinations. However, for the conditions considered, this configuration only increases the benefit-to-cost ratio by about 1% compared to the CSP with TES configuration. The PV-BESS system provides the lowest benefit-to-cost ratio compared to the other configurations explored because of the relatively low capacity credit received by the system.

Hamilton, William (ORCID:0000000244654239)↗
DOE OSTI2023

Performance Evaluation of Heterogeneous GPU Programming Frameworks for Hemodynamic Simulations

Preparing for the deployment of large scientific and engineering codes on upcoming exascale systems with GPU-dense nodes is made challenging by the unprecedented diversity of device architectures and heterogeneous programming models. In this work, we evaluate the process of porting a massively parallel, fluid dynamics code written in CUDA to SYCL, HIP, and Kokkos with a range of backends, using a combination of automated tools and manual tuning. We use a proxy application along with a custom performance model to inform the results and identify additional optimization strategies. At scale performance of the programming model implementations are evaluated on pre-production GPU node architectures for Frontier and Aurora, as well as on current NVIDIA device-based systems Summit and Polaris. Real-world workloads representing 3D blood flow calculations in complex vasculature are assessed. Our analysis highlights critical trade-offs between code performance, portability, and development time.

Martin, Aristotle↗
DOE OSTI2026

Beam-beam backgrounds for the Cool Copper Collider

In this paper, we present a comprehensive characterization of beam-beam backgrounds for the Cool Copper Collider (C 3 ), a proposed linear e + e - collider designed for precision Higgs studies at center-of-mass energies of 250 and 550 GeV. Using a simulation pipeline based on the Key4hep framework, we evaluate incoherent pair production and hadron photoproduction backgrounds through the SiD detector for baseline, power-efficiency, and high-luminosity C 3 operating scenarios. The occupancy induced by the beam-beam background is evaluated for each scenario, validating the compatibility of the existing SiD detector design with operations at C 3 without substantial modifications. Furthermore, at the same time, the modular simulation framework and analysis methodology presented in this paper offer a versatile toolkit for background studies in future collider proposals, contributing to a common platform for different machine designs.

Analysis and statistical methods↗
NASA NTRS2011

Pilot/Controller Coordinated Decision Making in the Next Generation Air Transportation System

Introduction: NextGen technologies promise to provide considerable benefits in terms of enhancing operations and improving safety. However, there needs to be a thorough human factors evaluation of the way these systems will change the way in which pilot and controllers share information. The likely impact of these new technologies on pilot/controller coordinated decision making is considered in this paper using the "operational, informational and evaluative disconnect" framework. Method: Five participant focus groups were held. Participants were four experts in human factors, between x and x research students and a technical expert. The participant focus group evaluated five key NextGen technologies to identify issues that made different disconnects more or less likely. Results: Issues that were identified were: Decision Making will not necessarily improve because pilots and controllers possess the same information; Having a common information source does not mean pilots and controllers are looking at the same information; High levels of automation may lead to disconnects between the technology and pilots/controllers; Common information sources may become the definitive source for information; Overconfidence in the automation may lead to situations where appropriate breakdowns are not initiated. Discussion: The issues that were identified lead to recommendations that need to be considered in the development of NextGen technologies. The current state of development of these technologies provides a good opportunity to utilize recommendations at an early stage so that NextGen technologies do not lead to difficulties in resolving breakdowns in coordinated decision making.

Bearman, Chris↗
DOE OSTI2020

Technical and Licensing Considerations for Micro-Reactors

The U.S. Nuclear Regulatory Commission (NRC) has interacted with vendors pursuing the commercialization of micro-reactors (i.e., reactors capable of producing about 1 MW(th) to 20 MW(th) of energy from nuclear fission). It is envisioned that micro-reactors could be assembled and fueled in a factory and shipped to a site. Many of the sites are expected to be remote locations requiring off-grid power or in some cases military bases. The objective of this effort is to explore the technical issues and the approach required to reach a finding of "reasonable assurance of public health and safety" for this new and different class of reactors. The analysis performed here leverages available micro-reactor design and testing data available from national laboratory experience as well as commercial design information to explore technical issues. Some factors considered include source term, accidents that would need to be analyzed, and the extent of the probabilistic risk assessment (PRA). The technical evaluation was performed within the framework of the Licensing Modernization Project (LMP) to identify licensing basis events, classification of structures, systems and components, and defense-in-depth needed to provide regulatory certainty. With this framework and technical evaluation in mind, the scope and content of a micro-reactor licensing application is discussed.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2024

Simulation of Compound Flooding Using River‐Ocean Two‐Way Coupled E3SM Ensemble on Variable‐Resolution Meshes

Abstract Coastal zone compound flooding (CF) can be caused by the interactive fluvial and oceanic processes, particularly when coastal backwater propagates upstream and interacts with high river discharge. The modeling of CF is limited in existing Earth System Models (ESMs) due to coarse mesh resolutions and one‐way coupled river‐ocean components. In this study, we present a novel multi‐scale coupling framework within the Energy Exascale Earth System Model (E3SM), integrating global atmosphere and land with interactively coupled river and ocean models using different meshes with refined resolutions near the coastline. To evaluate this framework, we conducted ensemble simulations of a CF event (Hurricane Irene in 2011) in a Mid‐Atlantic estuary. The results demonstrate that the novel E3SM configuration can reasonably reproduce river discharge and sea surface height variations. The two‐way river‐ocean coupling improves the representation of coastal backwater effects at the terrestrial‐aquatic interface that are caused by the combined actions of tide and storm surge during the CF event, thus providing a valuable modeling tool for better understanding the river‐estuary‐ocean dynamics in extreme events under climate change. Notably, our results show that the most significant CF impacts occur when the highest storm surge generated by a tropical cyclone meets with a moderate river discharge. This study highlights the state‐of‐the‐art advancements developed within E3SM for simulating multi‐scale coastal processes.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Evaluating the Impact of Managed EV Charging for Reliable Operation of Bulk Power Systems with High Non-Dispatchable Generation

The growth of electric vehicles (EVs) and variable-generation (VG) sources introduces new challenges for power-system operations. This study introduces a modeling framework and evaluates five EV charging strategies under projected 2040 grid conditions in the Evergy service territory with high non-dispatchable generation. Using realistic EV behavior and generation models, their impacts on system peak demand, ramp rate, and reserve capacity are evaluated. Results show that only the peak-avoidance strategy effectively reduces system peak demand, while decentralized strategies-particularly cost based dynamic charging-can exacerbate peaks due to synchronized user behavior. However, ramp-rate minimization strategy significantly reduce the stress on dispatchable generation achieving the lowest maximum absolute ramp rate (MARR) (56.81 MW) and lowest reserve requirement (2.39 GW). In contrast, unmanaged and TOU random strategies increase the stress on dispatchable generation sources with increased MARR and reserve requirements. These findings highlight the importance of coordinated, system-aware managed charging strategies to ensure reliable and affordable grid operation in the presence of EVs and VG sources.

14 - SOLAR ENERGY↗
DOE OSTI2024

Evaluating offshore legacy wells for geologic carbon storage: A case study from the Galveston and Brazos areas in the Gulf of Mexico

In this article, federal offshore waters in the Gulf of Mexico are of interest for large-scale geologic carbon storage (GCS). However, more than 80,000 offshore oil and gas wells exist in the region, which could impact the integrity of sealing intervals. In this study, we propose a screening methodology for ranking offshore legacy wells based on the challenge they may present to GCS. The methodology relies on the review of well regulatory records to 1) identify leakage pathways and assess the potential hazards that wells pose to planned GCS operations, 2) evaluate well features that impact the accessibility of wells to determine the feasibility of potential corrective actions, and 3) rank wells based on the overall challenge they may pose for GCS. We demonstrate our framework by evaluating the construction and abandonment of 156 wells across eight areas of interest (AOIs) in shallow federal waters along the Texas Gulf Coast. The majority (99.3 %) of wells considered were constructed and plugged in a manner that did not isolate prospective GCS targets in the Upper and Lower Miocene formations and may potentially require a challenging or uncertain corrective action prior to GCS. Dataset trends suggest that the observed well construction and plugging designs may be common in shallow offshore federal waters along the Texas Gulf Coast. Consequently, operators pursuing offshore GCS projects in the region may consider selecting areas that avoid challenging wells or performing robust evaluations of legacy well leakage risks to plan corrective action prior to CO 2 injection.

58 GEOSCIENCES↗
DOE OSTI2023

Environmental and Social Justice Implications of a Circular Plastics Economy

A consideration of environmental justice (EJ) and social justice (SJ) is critical to minimize the impacts of technology deployment on local communities. SJ and EJ impacts occur in specific geographic locations but can cover a wide range of effects (e.g., air pollution, access to clean water, jobs, wages, and education), making it challenging to determine which metrics are appropriate to evaluate and which data are required. Thus, there is currently a gap in the analysis community's ability to provide useful and universal EJ and SJ metrics for emerging technologies. Here, we present a draft framework for evaluating the human health, local environment, and job implications of processes that are at an early or middle technology readiness level (TRL). Using a case study on enzymatic polyethylene terephthalate (PET) recycling (middle TRL), we demonstrate how to qualitatively and quantitatively assess these EJ and SJ metrics for a circular economy context and how to communicate the results in a manner beneficial to both researchers and local communities.

circular economy↗
DOE OSTI2023

An AI-driven microstructure optimization framework for elastic properties of titanium beyond cubic crystal systems

Materials design aims to identify the material features that provide optimal properties for various engineering applications, such as aerospace, automotive, and naval. One of the important but challenging problems for materials design is to discover multiple polycrystalline microstructures with optimal properties. This paper proposes an end-to-end artificial intelligence (AI)-driven microstructure optimization framework for elastic properties of materials. In this work, the microstructure is represented by the Orientation Distribution Function (ODF) that determines the volume densities of crystallographic orientations. The framework was evaluated on two crystal systems, cubic and hexagonal, for Titanium (Ti) in Joint Automated Repository for Various Integrated Simulations (JARVIS) database and is expected to be widely applicable for materials with multiple crystal systems. The proposed framework can discover multiple polycrystalline microstructures without compromising the optimal property values and saving significant computational time.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Methodology for Generating Covariance Data of Thermal Neutron Scattering Cross Sections

This paper details and implements a framework for evaluating thermal neutron scattering cross sections that provide S(α,β) data and covariance data for hydrogen in light water. This methodology involves perturbing model parameters of molecular dynamics potentials and fitting the simulation results to experimental data. The framework is general and can be applied to any material or simulation method. The fit is made using the Unified Monte Carlo method to experimentally measure double-differential scattering cross sections of light water at the Spallation Neutron Source at Oak Ridge National Laboratory. Mean values and covariance data were generated for model parameters, phonon density of states, double-differential cross sections, and total scattering cross sections. These posterior parameter values were very similar to their prior values with a maximum relative error of 0.54%. This falls within in the Unified Monte Carlo–calculated uncertainties on the order of 2.7%. Additionally, posterior double-differential cross sections agree favorably with ENDF/B-VIII.0 cross sections. The new thermal scattering law was tested by comparing it against benchmarks from the International Criticality Safety Benchmark Evaluation Project Handbook, which showed a slight improvement over the ENDF/B-VIII.0 library. Additionally, the covariance matrix of the phonon density of states was validated to confirm that the spread of k eff from the density of states used to generate the covariance matrix was similar to the spread of k eff from the density of states of the sampled covariance matrix.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
NASA NTRS2011

The First Flight Decision for New Human Spacecraft Vehicles - A General Approach

Determining when it is safe to fly a crew on a launch vehicle/spacecraft for the first time, especially when the test flight is a part of the overall system certification process, has long been a challenge for program decision makers. The decision on first flight is ultimately the judgment of the program and agency management in conjunction with the design and operations team. To aid in this decision process, a NASA team undertook the task to develop a generic framework for evaluating whether any given program or commercial provider has sufficiently complete and balanced plans in place to allow crewmembers to safely fly on human spaceflight systems for the first time. It was the team s goal to establish a generic framework that could easily be applied to any new system, although the system design and intended mission would require specific assessment. Historical data shows that there are multiple approaches that have been successful in first flight with crew. These approaches have always been tailored to the specific system design, mission objectives, and launch environment. Because specific approaches may vary significantly between different system designs and situations, prescriptive instructions or thorough checklists cannot be provided ahead of time. There are, however, certain general approaches that should be applied in thinking through the decision for first flight. This paper addresses some of the most important factors to consider when developing a new system or evaluating an existing system for whether or not it is safe to fly humans to/from space. In the simplest terms, it is time to fly crew for the first time when it is safe to do so and the benefit of the crewed flight is greater than the residual risk. This is rarely a straight-forward decision. The paper describes the need for experience, sound judgment, close involvement of the technical and management teams, and established decision processes. In addition, the underlying level of confidence the manager has in making the decision will also be discussed. By applying the outlined thought processes and approaches to a specific design, test program and mission objectives, a project team will be better able to focus the debate and discussion on critical areas for consideration and added scrutiny -- allowing decision makers to adequately address the first crewed flight decision.

Schaible, Dawn M.↗
DOE OSTI2023

Environmental and Social Justice Considerations in a Circular Economy

A consideration of environmental justice (EJ) and social justice (SJ) is critical to minimize the impacts of technology deployment on local communities. SJ and EJ impacts occur in specific geographic locations but can cover a wide range of effects (e.g., air pollution, access to clean water, jobs, wages, and education), making it challenging to determine which metrics are appropriate to evaluate and which data are required for qualitative or quantitative analysis. This issue is only exacerbated when the technology in question is at an early technology readiness level (TRL) without community specific data. Here, we present a framework for evaluating the human health, local environment, and job implications of processes that are at early to middle TRLs. Using a case study on enzymatic polyethylene terephthalate (PET) recycling (middle TRL), we demonstrate how to qualitatively and quantitatively assess these EJ and SJ metrics for a circular economy context and how to communicate the results in a manner beneficial to both researchers and local communities.

circular economy↗
DOE OSTI2025

Consequence Based Framework for Deployment of Cloud Solutions in the Digital Energy Transition

This study proposes a framework for evaluating cloud computing deployment in the electric sector, focusing on the digital transition of energy systems. It assesses the implications of cloud technology adoption, particularly in terms of security, operational resilience, and efficiency. The paper introduces a framework for consequence-driven applied risk analysis, enabling utilities to prioritize and mitigate potential threats effectively, and responsibly deploy cloud applications. It also discusses the shared responsibility model in cloud computing, highlighting the need for collaborative security efforts. The research aims to provide utilities with a strategic assessment tool for cloud adoption, emphasizing the importance of security culture in enhancing cloud computing's role in critical infrastructure.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
NASA NTRSDate not supplied

New Solid Propellant Additives: Evaluation for NASA Mission Use Cases

Researchers and small companies have been investigating and developing new solid rocket motor propellant ingredients with renewed vigor. Lithium-aluminum alloy is an ingredient of particular interest, but most of the advertisement about its benefits are focused on defense tactical rocket applications. This paper develops a framework to evaluate this and other propellants against standard aluminized composite propellant for mass-limited missions like many NASA in-space applications. It shows a way to estimate density’s effect with an exponent less than 1 depending on mission and technology parameters, and an algorithm for directly calculating delta-velocity or payload performance improvement.

Lithium-aluminum↗