Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “evaluation framework”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

A Co-Simulation Framework for Steady-State Analyses of Multiple Droop-based MTdc Grids in Continental-Scale Systems

The growing scale and complexity of planning continental hybrid ac and multi-terminal dc (MTdc) systems require scalable steady-state modeling and analysis approaches not currently available in commercial tools. This paper presents a comprehensive multi-fidelity model-conversion framework that enables the efficient transition of MTdc grid models from production cost modeling (PCM) and approximated ac power flow to detailed ac–MTdc power flow for large-scale planning studies. The core of this framework is a scalable co-simulation approach that, for the first time, enables power flow analysis in continental-scale ac–MTdc systems. It seamlessly couples commercial ac solvers with a detailed MTdc grid model that incorporates droop-based control and current-limiting strategies of multiple meshed MTdc grids. Leveraging this capability, an evaluation framework to systematically assess and compare different MTdc power redispatch strategies under ac and dc contingencies is introduced. The proposed framework and algorithm are evaluated using a combined Western and Eastern Interconnection system with 11 MTdc grids of various sizes, showing a coherent transition from PCM to detailed ac–MTdc power flow and improved system performance in voltage regulation and line overload mitigation following typical contingencies.

Nguyen, Quan H.↗

Evaluation of CMIP6 GCMs Over the CONUS for Downscaling Studies

Despite the necessity of Global Climate Models (GCMs) sub-selection in downscaling studies, an objective approach for their selection is currently lacking. Building on the previously established concepts in GCMs evaluation frameworks, we develop a weighted averaging technique to remove the redundancy in the evaluation criteria and rank 37 GCMs from the sixth phase of the Coupled Models Intercomparison Project over the contiguous United States. GCMs are rated based on their average performance across 66 evaluation measures in the historical period (1981–2014) after each metric is weighted between zero and one, depending on its uniqueness. The robustness of the outcome is tested by repeating the process with the empirical orthogonal function analysis in which each GCM is ranked based on its sum of distances from the reference in the principal component space. The two methodologies work in contrasting ways to remove the metrics redundancy but eventually develop similar GCMs rankings. A disparity in GCMs' behavior related to their sensitivity to the size of the evaluation suite is observed, highlighting the need for comprehensive multi-variable GCMs evaluation at varying timescales for determining their skillfulness over a region. The sub-selection goal is to use a representative set of skillful models over the region of interest without substantial overlap in their future climate responses and modeling errors in representing historical climate. Additional analyses of GCMs' independence and spread in their future projections provide the necessary information to objectively select GCMs while keeping all aspects of necessity in view.

54 ENVIRONMENTAL SCIENCES↗

An Evaluation of the Economic and Resilience Benefits of a Microgrid in Northampton, Massachusetts

Recent developments and advances in distributed energy resource (DER) technologies make them valuable assets in microgrids. This paper presents an innovative evaluation framework for microgrid assets to capture economic benefits from various grid and behind-the-meter services in grid-connecting mode and resilience benefits in islanding mode. In particular, a linear programming formulation is used to model different services and DER operational constraints to determine the optimal DER dispatch to maximize economic benefits. For the resiliency analysis, a stochastic evaluation procedure is proposed to explicitly quantify the microgrid survivability against a random outage, considering uncertainties associated with photovoltaic (PV) generation, system load, and distributed generator failures. Optimal coordination strategies are developed to minimize unserved energy and improve system survivability, considering different levels of system connectedness. The proposed framework has been applied to evaluate a proposed microgrid in Northampton, Massachusetts that would link the Northampton Department of Public Works, Cooley Dickenson Hospital, and Smith Vocational Area High School. The findings of this analysis indicate that over a 20-year economic life, a 441 kW/441 kWh battery energy storage system, and 386 kW PV solar array can generate $2.5 million in present value benefits, yielding a 1.16 return on investment ratio. Results of this study also show that forming a microgrid generally improves system survivability, but the resilience performance of individual facilities varies depending on power-sharing strategies.

25 ENERGY STORAGE↗

Microstructure-Based Estimation of Strength and Ductility Distributions for \(\alpha +\beta \) Titanium Alloys

Titanium alloys are processed to develop a wide range of microstructure configurations and therefore material properties. While these properties are typically measured experimentally, a framework for property prediction could greatly enhance alloy design and manufacturing. In this work, a microstructure-sensitive framework is presented for the prediction of strength and ductility as well as estimates of the bounds in variability for these properties. The framework explicitly considers distributions of microstructure via new approaches for instantiation of structure in synthetic samples. The parametric evaluation strategy, including the finite element simulation package FEpX, is used to create and test virtual polycrystalline samples to evaluate the variability bounds of mechanical properties in Ti-6Al-4V. Critical parameters for the property evaluation framework are provided by measurements of single crystal properties and advanced characterization of microstructure and slip system strengths in 2D and 3D. Property distributions for yield strength and ductility are presented, along with the validation and verification steps undertaken. Comparisons between strain localization and slip activity in virtual samples and in experimental grain-scale strain measurements are also discussed.

36 MATERIALS SCIENCE↗

Livability Assessment of Urban Communities considering the Preferences of Different Age Groups

Livability is one of the major guiding principles for urban planning and policymaking, of which the definition and evaluation have become the crucial research topic. As the progress in socioeconomic development accelerates, the microscale living conditions require more urgent attention. However, few researchers have addressed the assessment of urban livability at a finer spatial scale such as the community scale. Thus, this article aims to evaluate the urban environmental quality at the community level given the residential community as the basic unit of urban living areas. We select eighteen objective indicators from five dimensions to establish an objective indicator system. Taking the preferences of different age groups into account, a comprehensive evaluation framework for the livability of communities combining both subjective perceptions and objective indicator is constructed. Then, it is applied to evaluate the livability of 1,394 residential communities in Ningbo City. There are three significant results from the study. First, different age groups have diverse preferences of demands to the livability of an urban community. The indicators they valued most concentrated in the following two dimensions: the convenience of transportation and the completeness of supporting facilities. Second, there exists significant heterogeneity in the livability of communities among districts. Third, the livability of communities shows a decreasing spatial pattern from the city center to the surroundings. These empirical results can be advantageous to urban planning departments and other relevant stakeholders.

Liang, Xiaojin↗

Passive Microwave Brightness Temperature Assimilation to Improve Snow Mass Estimation across Complex Terrain in Pakistan, Afghanistan, and Tajikistan

An ensemble Kalman filter is used to assimilate Advanced Microwave Scanning Radiometer-2 (AMSR2) observations of passive microwave (PMW) brightness temperatures (spectral differences, ΔT b ) into land surface model estimates of snow mass over northwestern high mountain Asia (HMA). Trained support vector machines serve as the observation operator and map the geophysical modeled variables into ΔT b space within the assimilation framework. Evaluation of the assimilation routine is carried out through comparison of assimilated snow mass estimates with an in situ dataset. The assimilation framework helps improve the land surface model estimates through PMW ΔT b assimilation, particularly in terms of decreasing the domain-wide bias. The assimilation framework proved more effective during the (dry) snow accumulation season and decreased the bias and root-mean-square error (RMSE) in snow mass estimates at 76% and 58% of the comparative pixels, respectively. During the snow ablation season, the PMW brightness temperature signal contained less information related to snow mass due to the presence of other concurrent geophysical features that effectively serve as noise during the snow mass update. The utilization of PMW ΔT b for accurate snow mass estimation in complex terrain such as HMA is dependent on a multitude of factors for optimal results; however, it does add utility to the land surface model if the relevant pitfalls are taken into consideration prior to the state variable update.

Jawairia Ahmad↗

Extension of Clad Damage Propagation Model for Fission Gas Dispersal and Two-Phase Flow Effects in MOOSE SubChannel Module

This report presents an extension of the Clad Damage Propagation (CDAP) model implemented in the MOOSE SubChannel Module (SCM) to capture post-failure fission-gas dispersal and two-phase flow effects in sodium-cooled fast reactor assemblies. The extended model tracks discharged gas axially and radially, computes channel-averaged flow quality and void fraction using a Lockhart–Martinelli framework, evaluates two-phase frictional pressure-drop multipliers, determines inlet mass-flow degradation under fixed core pressures, and applies an intensified-void-based heat-transfer degradation to affected fuel pins. Radial plume expansion is parameterized using mineral-oil jet experiments mapped to sodium conditions via Reynolds–Weber similarity. Implementation details are documented, along with the new methods and user inputs needed to control plume mapping and two-phase behavior. Demonstration simulations for 19- and 37-pin bundles show that breach size and inlet velocity strongly influence propagation potential: small breaches (≤0.5 mm) produce limited degradation while larger breaches (~1 mm) can drive oscillatory temperature spikes and enhanced failure propagation, especially at higher velocities. These results demonstrate that the extended CDAP model provides a more complete framework for quantifying cladding damage propagation and evaluating propagation potential in transient scenarios. The approach remains computationally efficient, consistent with subchannel-level analysis, yet incorporates sufficient physics to bridge localized post-failure effects with bundle- and assembly-scale degradation.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Trustworthiness modeling and evaluation for a nearly autonomous management and control system

The Nearly Autonomous Management and Control (NAMAC) system supports the advanced reactor operation by recommending control actions to operators based on real-time measurements and digital twins (DTs) learning from the knowledge base. To enable the safe and reliable use of autonomous technologies, NAMAC and its recommendations should be trustworthy to operators and regulators at both the design and operation stages. This study proposes a NAMAC trustworthiness modeling and evaluation framework supported by trustworthiness ontologies and evidence-based approaches. The development-time and run-time ontologies are separately constructed and then converted to Bayesian networks to quantitatively evaluate the NAMAC trustworthiness. This evaluation is demonstrated by collecting and characterizing evidence from NAMAC practices, such as the development and assessment of the NAMAC system, data coverage assessment, and the training and optimizations of neural-network-based DTs. Our proposed approach can aggregate various trustworthiness attributes of complex artificial-intelligence-supported systems for safety-critical applications. It also considers the interaction between different DTs and extends beyond the trustworthiness evaluation of a single DT. In conclusion, the evidence-based method enhances the transparency of the trustworthiness modeling and evaluation processes and helps identify uncertainties and subjectivity involved in the processes.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Long-Duration Energy Storage Grid Integration-Valuation Framework and Incentive Gaps

Given these challenges and current modeling gaps on Long Duration Energy Storage (LDES), enhancing the structure and design of existing planning, operations, and organized wholesale markets can better characterize the value of LDES to the power system. To more thoroughly assess the gaps and barriers to LDES investment and readiness for integration into a future grid, we conducted stakeholder outreach through an online survey, interviews with individual independent system operators/regional transmission organizations, and a literature review. Based on this assessment, we identified a set of opportunities for LDES focused development, including a framework to quantify the contributions of LDES on resource adequacy, reliability, and resiliency. Specifically, we identify the potential demand for and benefits of an open-source, LDES-centric evaluation framework that can guide future planning, operations, market design, and policy reforms.

24 POWER TRANSMISSION AND DISTRIBUTION↗

New framework for benchmarking decadal predictions leveraging the PCMDI Metric Package with interactive visualization

Reliable climate predictions across multiple timescales are increasingly critical as climate-related risks continue to rise. With the growing number and diversity of climate prediction systems, systematic intercomparison has become essential. Here, we present a comprehensive evaluation framework based on the PCMDI Metric Package to assess the performance of multiple decadal climate prediction systems. Unlike uninitialized simulations, initialized predictions exhibit bias and predictive skill that evolve with forecast lead time. To address this, we introduce (1) model-by-lead-time portrait plots, which efficiently summarize metrics of global temperature, precipitation, and Arctic/Antarctic sea-ice extent, and (2) an HTML-based interactive visualization platform that provides detailed regional and seasonal diagnostics of model bias, skill scores, and ensemble spread for each model and lead time. Comparisons with uninitialized simulations further quantify the relative impacts of initialization and external forcing on prediction skill. The proposed framework provides a scalable and transparent approach for multi-model climate prediction assessments and can be readily extended to a wide range of operational and research forecasting systems.

54 ENVIRONMENTAL SCIENCES↗

Design and optimization of processes for recovering rare earth elements from end‐of‐life permanent magnets

Recovery of rare earth elements (REEs) from end-of-life (EOL) products represents a strategic opportunity to strengthen the domestic supply chain for rare earth elements. This work presents a superstructure-based optimization framework for finding the most economical processing pathway for different EOL rare earth permanent magnets (REPMs). The framework evaluates state-of-the-art technologies across four processing stages—disassembly, demagnetization, leaching and extraction, and precipitation and calcination—using net present value (NPV) maximization and cost of recovery (COR) minimization objectives. A novel bottom-up costing framework for hydrogen decrepitation is also introduced. Two feedstocks were considered: REPMs from EOL hard disk drives (HDDs), and electric and hybrid electric vehicles (EVs and HEVs). While HDD recycling proved unprofitable due to limited feedstock availability, EVs/HEVs were profitable across a range of parameters and cost estimates. Therefore, our findings suggest that the proposed EOL EV/HEV recycling process may be economical and is worthy of further investigation.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Simplified Approach for Scoping Assessment of Non-LWR Source Terms

This report describes a structure to aid in evaluation of release mitigation strategies across a range of reactor technologies. The assessment performed for example reactor concepts utilizes previous studies of postulated accident sequences for each reactor concept. This simplified approach classifies release mitigation strategies based on a range of barriers, physical attenuation processes, and system performance. It is not, however, intended to develop quantitative estimates of radiological release magnitudes and compositions to the environment. Rather, this approach is intended to identify the characteristics of a reactor design concepts release mitigation strategies that are most important to different classes of accident scenarios. It uses a scoping methodology to provide an approximate, order-of-magnitude, estimate of the radiological release to the environment and associated off-site consequences. This scoping method is applied to different reactor concepts, considering the performance of barriers to fission product release for these concepts under sample accident scenarios. The accident scenarios and sensitivity evaluations are selected in this report to evaluate the role of different fission product barriers in ameliorating the source term to the environment and associated off-site consequences. This report applies this structure to characterize how release mitigation measures are integrated to define overall release mitigation strategies for High Temperature Gas Reactors (HTGRs), Sodium Fast Reactors (SFRs), and liquid fueled Molten Salt Reactors (MSRs). To support this evaluation framework, factors defining a chain of release attenuation stages, and thus an overall mitigation strategy, must be established through mechanistic source term calculations. This has typically required the application of an integral plant analysis code such as MELCOR. At present, there is insufficient evidence to support a priori evaluation of the effectiveness of a release mitigation strategy for advanced reactor concepts across the spectrum of events that could challenge the radiological containment function. While it is clear that these designs have significant margin to radiological release to the environment for the scenarios comprising the design basis, detailed studies have not yet been performed to assess the risk profile for these plants. Such studies would require extensive evaluation across a reasonably complete spectrum of accident scenarios that could lead to radiological release to the environment.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Modelling the Risks Remotely Piloted Aircraft Pose to People on the Ground

Worldwide there is much e ort being directed towards the development of a framework of air- worthiness regulations for remotely piloted aircraft systems (RPAS). It is now broadly accepted that regulations should have a strong foundation in, and traceability to, the management of the safety risks. Existing risk models for RPAS operations do not provide a simple means for incorporating the wide range of technical and operational controls into the risk analysis and evaluation processes. This paper describes a new approach for modelling and evaluating the risks associated with RPAS operations near populous areas based on the barrier bow tie (BBT) model. A BBT model is used to structure the underlying risk management problem. The model focuses risk analysis, evaluation, and decision making activities on the devices, people, and processes that can be employed to reduce risk. The BBT model and a comprehensive set of example risk controls are presented. The general model can be applied to any RPAS operation. The foundations for quantitative and qualitative assessments using a BBT model are also presented. The modelling and evaluation framework is illustrated through its application to a case-study rotary wing RPAS for two operational scenarios. The model can be used as a basis for determining airworthiness certification requirements for RPAS.

Barrier bow tie model↗

Preventive Power Outage Estimation Based on A Novel Scenario Clustering Strategy: Preprint

The increasing occurrence of extreme weather events is challenging the power grid operation. In front of the extreme weather, the system operator is responsible for estimating the power outage and scheduling the restoration resources. This paper proposes an outage evaluation framework to identify the possible unserved load profiles, vulnerable areas, and mobile energy adequacy. The predicted vulnerable lines of an outage prediction model tool are utilized to generate numerous faulted line scenarios. Next, each scenario's nodal unserved load profile is obtained by solving a three-phase restoration model that considers the schedule of repair crews and mobile energy resources. Then, a novel scenario clustering strategy is developed to cluster the unserved load profiles into multiple representative ones for straightforward analysis. Finally, case studies on a distribution system evaluate the damage level brought by extreme weather and verify the effectiveness of the proposed scenario clustering strategy.

mobile energy resources↗

Multidisciplinary Design Technology Development: A Comparative Investigation of Integrated Aerospace Vehicle Design Tools

This research effort is a joint program between the Departments of Aerospace and Mechanical Engineering and the Computer Science and Engineering Department at the University of Notre Dame. The purpose of the project was to develop a framework and systematic methodology to facilitate the application of Multidisciplinary Design Optimization (MDO) to a diverse class of system design problems. For all practical aerospace systems, the design of a systems is a complex sequence of events which integrates the activities of a variety of discipline "experts" and their associated "tools". The development, archiving and exchange of information between these individual experts is central to the design task and it is this information which provides the basis for these experts to make coordinated design decisions (i.e., compromises and trade-offs) - resulting in the final product design. Grant efforts focused on developing and evaluating frameworks for effective design coordination within a MDO environment. Central to these research efforts was the concept that the individual discipline "expert", using the most appropriate "tools" available and the most complete description of the system should be empowered to have the greatest impact on the design decisions and final design. This means that the overall process must be highly interactive and efficiently conducted if the resulting design is to be developed in a manner consistent with cost and time requirements. The methods developed as part of this research effort include; extensions to a sensitivity based Concurrent Subspace Optimization (CSSO) NMO algorithm; the development of a neural network response surface based CSSO-MDO algorithm; and the integration of distributed computing and process scheduling into the MDO environment. This report overviews research efforts in each of these focus. A complete bibliography of research produced with support of this grant is attached.

Renaud, John E.↗

Multidisciplinary Design Technology Development: A Comparative Investigation of Integrated Aerospace Vehicle Design Tools

This research effort is a joint program between the Departments of Aerospace and Mechanical Engineering and the Computer Science and Engineering Department at the University of Notre Dame. Three Principal Investigators; Drs. Renaud, Brockman and Batill directed this effort. During the four and a half year grant period, six Aerospace and Mechanical Engineering Ph.D. students and one Masters student received full or partial support, while four Computer Science and Engineering Ph.D. students and one Masters student were supported. During each of the summers up to four undergraduate students were involved in related research activities. The purpose of the project was to develop a framework and systematic methodology to facilitate the application of Multidisciplinary Design Optimization (N4DO) to a diverse class of system design problems. For all practical aerospace systems, the design of a systems is a complex sequence of events which integrates the activities of a variety of discipline "experts" and their associated "tools". The development, archiving and exchange of information between these individual experts is central to the design task and it is this information which provides the basis for these experts to make coordinated design decisions (i.e., compromises and trade-offs) - resulting in the final product design. Grant efforts focused on developing and evaluating frameworks for effective design coordination within a MDO environment. Central to these research efforts was the concept that the individual discipline "expert", using the most appropriate "tools" available and the most complete description of the system should be empowered to have the greatest impact on the design decisions and final design. This means that the overall process must be highly interactive and efficiently conducted if the resulting design is to be developed in a manner consistent with cost and time requirements. The methods developed as part of this research effort include; extensions to a sensitivity based Concurrent Subspace Optimization (CSSO) MDO algorithm; the development of a neural network response surface based CSSO-MDO algorithm; and the integration of distributed computing and process scheduling into the MDO environment. This report overviews research efforts in each of these focus. A complete bibliography of research produced with support of this grant is attached.

Renaud, John E.↗

RAVEN Theory Manual

RAVEN is a software framework able to perform parametric and stochastic analysis based on the response of complex system codes. The initial development was aimed at providing dynamic risk analysis capabilities to the thermohydraulic code RELAP-7, currently under development at Idaho National Laboratory (INL). Although the initial goal has been fully accomplished, RAVEN is now a multi-purpose stochastic and uncertainty quantification platform, capable of communicating with any system code. In fact, the provided Application Programming Interfaces (APIs) allow RAVEN to interact with any code as long as all the parameters that need to be perturbed are accessible by input files or via python interfaces. RAVEN is capable of investigating system response and explore input space using various sampling schemes such as Monte Carlo, grid, or Latin hypercube. However, RAVEN strength lies in its system feature discovery capabilities such as: constructing limit surfaces, separating regions of the input space leading to system failure, and using dynamic supervised learning techniques. The development of RAVEN started in 2012 when, within the Nuclear Energy Advanced Modeling and Simulation (NEAMS) program, the need to provide a modern risk evaluation framework arose. RAVEN’s principal assignment is to provide the necessary software and algorithms in order to employ the concepts developed by the Risk Informed Safety Margin Characterization (RISMC) program. RISMC is one of the pathways defined within the Light Water Reactor Sustainability (LWRS) program. In the RISMC approach, the goal is not just to identify the frequency of an event potentially leading to a system failure, but the proximity (or lack thereof) to key safety-related events. Hence, the approach is interested in identifying and increasing the safety margins related to those events. A safety margin is a numerical value quantifying the probability that a safety metric (e.g. peak pressure in a pipe) is exceeded under certain conditions. Most of the capabilities, implemented having RELAP-7 as a principal focus, are easily deployable to other system codes. For this reason, several side activates have been employed (e.g. RELAP5-3D, any MOOSE-based App, etc.) or are currently ongoing for coupling RAVEN with several different software. The aim of this document is to provide a set of commented examples that can help the user to become familiar with the RAVEN code usage.

97 MATHEMATICS AND COMPUTING↗

RAVEN User Manual

RAVEN is a generic software framework to perform parametric and probabilistic analysis based on the response of complex system codes. The initial development was aimed to provide dynamic risk analysis capabilities to the Thermo-Hydraulic code RELAP-7, currently under development at the Idaho National Laboratory (INL). Although the initial goal has been fully accomplished, RAVEN is now a multi-purpose probabilistic and uncertainty quantification platform, capable to agnostically communicate with any system code. This agnosticism includes providing Application Programming Interfaces (APIs). These APIs are used to allow RAVEN to interact with any code as long as all the parameters that need to be perturbed are accessible by inputs files or via python interfaces. RAVEN is capable of investigating the system response, and investigating the input space using Monte Carlo, Grid, or Latin Hyper Cube sampling schemes, but its strength is focused to- ward system feature discovery, such as limit surfaces, separating regions of the input space leading to system failure, using dynamic supervised learning techniques. The development of RAVEN has started in 2012, when, within the Nuclear Energy Advanced Modeling and Simulation (NEAMS) program, the need to provide a modern risk evaluation framework became stronger. RAVEN principal assignment is to provide the necessary software and algorithms in order to employ the concept developed by the Risk Informed Safety Margin Characterization (RISMC) program. RISMC is one of the pathways defined within the Light Water Reactor Sustainability (LWRS) program. In the RISMC approach, the goal is not just the individuation of the frequency of an event potentially leading to a system failure, but the closeness (or not) to key safety-related events. Hence, the approach is interested in identifying and increasing the safety margins related to those events. A safety margin is a numerical value quantifying the probability that a safety metric (e.g. for an important process such as peak pressure in a pipe) is exceeded under certain conditions. The initial development of RAVEN has been focused on providing dynamic risk assessment capability to RELAP-7, currently under development at the INL and, likely, future replacement of the RELAP5-3D code. Most the capabilities that have been implemented having RELAP-7 as principal focus are easily deployable for other system codes. For this reason, several side activates are currently ongoing for coupling RAVEN with soft- ware such as RELAP5-3D, etc. The aim of this document is the explanation of the input requirements, focalizing on the input structure.

97 MATHEMATICS AND COMPUTING↗