Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “evaluation framework”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 703 records · Page 39
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

"Reducing Detailed Vehicle Energy Dynamics to Physics-Like Models"

The energy demand of vehicles, particularly in unsteady drive cycles, is affected by complex dynamics internal to the engine and other powertrain components. Yet, in many applications, particularly macroscopic traffic flow modeling and optimization, structurally simple approximations to the complex vehicle dynamics are needed that nevertheless reproduce the correct effective energy behavior. This work presents a systematic model reduction pipeline that starts from complex vehicle models based on the Autonomie software and derives a hierarchy of simplified models that are fast to evaluate, easy to disseminate in open-source frameworks, and compatible with optimization frameworks. The pipeline, based on a virtual chassis dynamometer and subsequent approximation strategies, is reproducible and is applied to six different vehicle classes to produce concrete explicit energy models that represent an average vehicle in each class and leverage the accuracy and validation work of the Autonomie software.

Khoudari, Nour↗
DOE OSTI2024

Development and Validation of a Scoring System for Abnormalities in the Gopher Frog (Rana capito)

Headstarting efforts are thought to be critical in supplementing populations of the at-risk Gopher Frog (Rana capito); however, recent efforts have occasionally resulted in juveniles with developmental abnormalities. In response, we developed a scoring system to collect quantitative data on the presence and severity of these developmental abnormalities. Our objective was to describe and validate the abnormality scoring system so that it can be used by all Gopher Frog headstarting facilities. The scoring system covers five primary conditions encompassing commonly observed abnormalities. Two groups of participants with different levels of prior experience working with Gopher Frogs assigned scores to a set of images presented to them for each condition. We used intra-class correlation coefficients (ICC) to test the scoring system for inter- and intra-rater agreement as well as agreement with the benchmark standard (established by the authors). We found high ICC values for inter-rater agreement, intra-rater agreement, and agreement to the benchmark standard indicating either excellent or good reliability for all five conditions and for all raters when grouped together. These findings support the reliability and validity of the proposed developmental abnormality scoring system. Gopher Frog headstarting facilities can implement this scoring system to assist in tracking the frequency and severity of abnormalities observed in future headstarting efforts. We hope that by creating a reliable scoring system for Gopher Frogs, it can provide an overall framework and serve as a valuable resource to evaluate abnormalities across any amphibian species.

abnormality↗
DOE OSTI2026

Space Cooling: Recovery, Reuse, Recycling and Supply Chain Impacts

The global cooling sector has undergone tremendous growth in recent years, and cooling demand is projected to double or triple by 2050. Surging air conditioning demand will continue to be driven by increased populations, incomes and occurrences of extreme heat and humidity events. Cooling equipment growth has important pollution and material implications as they are made up of critical metals and precious raw materials - including ferrous metals, copper, aluminum and printed circuit boards composed of copper, silver, gold and palladium - that generate significant electronic waste at end-of-life. Air conditioning equipment also contains fluorinated gas (F-gas) refrigerants, which are potent gases that are thousands of times more heat-trapping than carbon dioxide (CO2). While recovery, reuse, and recycling strategies have been assessed for cold chain and refrigeration, there is currently limited analysis on how these strategies could be adopted for the global space cooling industry and potential supply chain implications. This paper aims to address this research gap by qualitatively evaluating product and material recovery, reuse and recycling frameworks from both demand and supply-side perspectives and with the support of cooling-specific case studies. It also focuses on quantitatively assessing potential energy, emissions and resource benefits of such strategies for space cooling equipment. This paper first analyzes how existing recovery, reuse and recycling frameworks can be applied to space cooling, with emphasis on the demand-side enablers (e.g., innovative business models, supporting policies and regulations) and changes in supply-side production network throughout the supply chain (e.g., design, production and distribution, end-of-life recovery) needed to overcome existing barriers. It will present case studies of innovative business models for space cooling technologies, including reuse and recycling, and how effective refrigerant reclamation and recovery programs have been operationalized. Lastly, the paper will highlight global modeling results of energy, emissions and material recovery from scenario analysis of selected strategies for air conditioners. The findings of this paper are intended to inform the development of product and material recovery, reuse and recycling strategies for a rapidly growing stock of space conditioning equipment by addressing existing organizational, economic and regulatory barriers and potential supply-chain bottlenecks.

Khanna, Nina↗
DOE OSTI2021

A Network-Aware Distributed Energy Resource Aggregation Framework for Flexible, Cost-Optimal, and Resilient Operation

To efficiently use the ubiquitous behind-the-meter distributed energy resources (DERs) in distribution systems for providing grid services, this paper presents a hierarchical control framework for DER optimal aggregation and control. We first develop a convex optimization model to evaluate the DER flexibility, and then use a convex model-predictive-control based approach to dispatch those DERs. The hierarchical control framework consists of a utility controller, community aggregators and multiple home energy management systems. The flexibility of the DERs is evaluated by each controller in the hierarchy such that the resultant flexibility is feasible given its operational domain. Based on the determined flexibility, the hierarchical controllers then compute optimal setpoints for the DERs to help the distribution system regulate node voltages and provide other distribution grid services. Numerical simulations performed on a model of a real distribution feeder in Colorado, using actual DER data in a residential community demonstrate that the proposed approach can effectively alleviate voltage issues and support resilient operation.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2023

Framework for Characterizing the Performance of High-Early Strength, High-Volume Fly Ash (HVFA) Concrete Structures

This presentation will highlight the development of a comprehensive framework to characterize the performance of high-volume fly ash (HVFA) concretes at early ages and discuss the resulting implications for concrete structures built using such materials. Achieving high-early compressive and/or flexural strength is often of particular importance for precast and/or prestressed concrete components – due to early age loading demands resulting from lifting, handling, or application of initial prestress – or other types of concrete structures that can significantly benefit from rapid strength development - such as for bridge deck repairs. The framework first includes a methodology for optimizing the strength of HVFA cementitious binders before subsequently scaling up the technology to evaluation of fresh and hardened HVFA concrete performance. A series of trial mix designs will be presented to demonstrate the effectiveness of the framework to achieve not only the desired high-early strength targets but also satisfactory workability, often in the form of self-consolidating concrete. Mechanical performance was evaluated at several age-dependent milestones and, in conjunction with estimating concrete strength using the maturity method, was ultimately used to facilitate the development of novel strength development history curves. By way of these datasets, concrete mechanical properties were utilized in the design of prototype structural components, such as beams and wall panels, for subjection to larger-scale experimental testing. Implications for other pertinent HVFA concrete performance attributes, such as shrinkage or creep, will also be discussed. The framework also includes a comprehensive methodology for evaluating the environmental life-cycle performance of HVFA concrete structures focused on mitigating any unwarranted environmental consequences resulting from beneficial HVFA reuse in concrete. Strategies for more widespread implementation of HVFA concrete materials into construction practice will also be presented. Lastly, the role of the HVFA concrete framework towards the development of new provisions for building codes and/or design standards, and recommendations for future research needs will also be discussed.

01 COAL, LIGNITE, AND PEAT↗
DOE OSTI2023

Stochastic Framework for Optimal Control of Planetary Reentry Trajectories Under Multilevel Uncertainties

We present a novel stochastic optimal control framework that accounts for various types of uncertainties, with application to reentry trajectory planning. The formulation of the optimal trajectory control problem is presented in the context of an indirect method where a functional objective associated with the terminal vehicle speed is to be minimized. Uncertain input parameters in the optimal trajectory control model, including aerodynamic parameters and initial and terminal conditions, are modeled as aleatory random variables, while the statistical parameters of these aleatory distributions are themselves random variables. The parametric and model uncertainties are simultaneously propagated through an extended polynomial chaos expansion (EPCE) formalism. Several metrics are described to evaluate response statistics and presented as insightful tools for robust decision making. Specifically, the response probability density function (PDF) reflecting influence of both epistemic and aleatory uncertainties is obtained. By sampling over the random variables representing model error, an ensemble of response PDFs is generated and the associated failure probability is estimated as a random variable with its own polynomial chaos expansion. Besides, the sensitivity index functions of response PDF with respect to the statistical parameters are evaluated. Coupling parametric and model uncertainties within the EPCE framework leads to a robust and efficient paradigm for multilevel uncertainty propagation and PDF characterization in general optimal control problems.

Engineering↗
DOE OSTI2020

Modernization of Technical Requirements for Licensing of Advanced Non-Light Water Reactors: Risk-Informed and Performance-Based Evaluation of Defense-in-Depth Adequacy

This document supports the work contained in Nuclear Energy Institute (NEI) 18-04 “Risk-Informed Performance-Based Technology Inclusive Guidance for Advanced Reactor Licensing Basis Development” Revision 0. NEI 18-04 presents a modern, technology-inclusive, risk-informed, and performance-based (TI-RIPB) process for selection of Licensing Basis Events (LBEs); safety classification of structures, systems, and components (SSCs) and associated risk-informed special treatments; and determination of defense-in-depth (DID) adequacy for non-LWRs. The NEI guidance document provides one acceptable means for addressing the aforementioned topics as part of demonstrating a specific design provides reasonable assurance of adequate radiological protection. This report provides the framework and associated methodology guidelines and discussion for establishing, then evaluating, confirming, and documenting the adequacy of defense-in-depth (DID) for advanced non-light-water reactor technologies. It was developed as part of the Licensing Modernization Project led by Southern Company and cost-shared by the United States Department of Energy and has benefited from considerable NRC formal reviews and public workshops. The methodology converts the DID philosophy into a structured process that is implementable, embraces existing United States and international definitions and philosophies of DID that set the foundation for the process. It builds on the DID framework developed in the Department of Energy Next Generation Nuclear Plant Project and earlier works on this subject. The approach to establishing DID adequacy involves the incorporation of DID attributes into the plant capabilities and programmatic elements of DID. The integrated evaluation of DID adequacy includes both quantitative elements to incorporate risk-informed and performance-based (RIPB) considerations and qualitative elements that address uncertainties and limitations in the quantitative models and supporting data. Demonstration of DID adequacy ensures that there are multiple layers of defense for risk-significant challenges to the design and that the plant capabilities and programs that support each layer are provided in a manner that minimizes dependencies among these layers. The focus of this report is assurance of DID adequacy with respect to protection of the public from radiological exposures resulting from accidental releases of radioactive material. While other hazards are not specifically addressed, this methodology is expected to be beneficial for determining DID adequacy for them as well. Risk-informed evaluation of DID considers the integrated performance of all plant SSCs and associated programs to manage daily operational activities, transients, and accidents, including the evaluation of strategies for accident prevention and mitigation. The RIPB LBE scenario methodology used in this evaluation defines the challenges to the plant safety features included in the plant design basis and beyond, and the scope of all deterministic and probabilistic safety evaluations. By examining event sequences across the whole spectrum of LBEs, a systematic assessment of DID can be accomplished.

42 ENGINEERING↗
DOE OSTI2026

From Rules to Reasoning: A Survey of Large Language Model-Based Approaches to Scientific Hypothesis and Idea Generation

Scientific hypothesis generation represents a fundamental challenge in contemporary research due to exponentially expanding literature volumes and increasing disciplinary specialization. Large language models (LLMs) have emerged as transformative tools for automated scientific discovery, moving beyond traditional rule-based and literature-mining approaches. Four paradigmatic approaches define current LLM-driven hypothesis generation: direct prompting and fine-tuning methods, knowledge-enhanced frameworks integrating retrieval-augmented generation (RAG), multi-agent collaborative systems simulating research teams, and reasoning-focused approaches implementing cognitive architectures. Domain-specific applications demonstrate statistical equivalence to human expert performance in social psychology, experimental validation in biomedical research, and near-expert quality in astronomy. Evaluation methodologies encompass human expert assessment, LLM-as-judge frameworks, and comprehensive benchmarking systems. Technical challenges include hallucination management, knowledge integration limitations, and balancing novelty with feasibility. Future directions emphasize hybrid neural-symbolic architectures and sophisticated human-AI collaboration models for responsible scientific discovery acceleration.

AI-driven discovery↗
DOE OSTI2020

A Comprehensive Monte Carlo Framework for Jet-Quenching

This article presents the motivation for developing a comprehensive modeling framework in which different models and parameter inputs can be compared and evaluated for a large range of jet-quenching observables measured in relativistic heavy-ion collisions at RHIC and the LHC. Here, the concept of a framework is discussed within the context of recent efforts by the JET Collaboration, the authors of JEWEL, and the JETSCAPE collaborations. The framework ingredients for each of these approaches is presented with a sample of important results from each. The role of advanced statistical tools in comparing models to data is also discussed, along with the need for a more detailed accounting of correlated errors in experimental results.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2026

Insights into mixing of non-isothermal multi-polymer melts for complex plastics recycling

Catalytic recycling or upcycling of plastics is often limited not by catalyst performance, but by transport, arising from highly viscous, non-Newtonian polymer melts. In this work, we develop a reactor-scale framework that integrates rheological measurements, constitutive modeling, computational fluid dynamics (CFD), and experiments to quantify mixing, heat transfer, and dispersion in surrogate hydrocarbon melts representing mixed plastics systems. Temperature- and shear rate-dependent viscosity of low-density polyethylene (LDPE) and high-density polyethylene (HDPE) is measured to create two surrogate polymers (PLD and PHD) that capture the dominant shear-thinning flow behavior while neglecting strong elastic effects, enabling tractable simulation of non-isothermal, polymer-melt mixing using a Carreau-Arrhenius generalized Newtonian framework. Three-dimensional CFD simulations are employed to evaluate impeller performance in PLD using mixing time, cavern volume, thermal uniformity, and interfacial area for regimes in which viscoelastic effects are not dominant. We show that magnetic stir bars commonly used in lab-scale studies produce large thermal gradients (~60 °C) and poor mixing, even under idealized power delivery and polymer flow conditions. In contrast, close-clearance anchor impellers achieve near-isothermal operation, reduce mixing times by up to 5×, and provide >90% active circulation volume. We further demonstrate that, at low pseudo-Deborah number (De*), motor power requirements can be predicted directly from shear rate-dependent rheology using the Carreau-Arrhenius framework, enabling rational selection of operating conditions. Extension to surrogate immiscible multi-polymer systems based on PLD and PHD shows that interfacial area is highly sensitive to operating conditions and impeller design, with coaxial anchor-turbine configurations enhancing dispersion by up to 4 × .

Close-clearance impellers↗
DOE OSTI2021

Development of an Efficient Conjugate Heat Transfer Modeling Framework to Optimize Mixing-Limited Combustion of Ethanol in a Diesel Engine

Mixing controlled combustion of alcohol fuels has been identified as a promising technology based on their low propensity for particulate and NOx production, but the higher heats of vaporization and auto-ignition temperatures of these fuels make their direct use in diesel engine architectures a challenge. To realize the potential of alcohol-fueled combustion, a computational fluid dynamics (CFD) modeling framework is developed, validated, and exercised to identify designs that maximize engine thermal efficiency. To evaluate the use of thermal barrier coatings (TBCs), a simplified one-dimensional (1D) conjugate heat transfer (CHT) modeling framework is employed. The addition of the 1D CHT model only increases the computational expense by 15% relative to traditional approaches, yet offers more accurate heat transfer predictions over constant temperature boundary conditions. The validated model is then used to explore a range of injector orientations and piston bowl geometries. Using a design of experiments (DoE) approach, several designs were identified that improved fuel-air mixing, shortened the combustion duration, and increased thermal efficiency. The most promising design was fabricated and tested in a Caterpillar 1Y3700 single-cylinder oil test engine (SCOTE). Engine testing confirmed the findings from the CFD simulations and found that the co-optimized injector and piston bowl design yielded over 2-percentage point increase in thermal efficiency at the same equivalence ratio (0.96) and over 6-percentage point increase at the same engine load (10.1 bar indicated mean effective pressure (IMEP)), while satisfying design constraints for peak pressure and maximum pressure rise rate.

Magnotti, Gina M.↗
DOE OSTI2025

On the validity and limitations of 1D model for heat and mass transfer performance evaluation in a multilayer binder-free desiccant dehumidifier: isothermal dehumidification with internal cooling

Efficient humidity control is essential for maintaining indoor thermal comfort, yet conventional vapor-compression-based dehumidifiers are energy-intensive. Employing separate sensible and latent cooling through desiccant-coated heat exchangers (DCHEs) combined with evaporative coolers offers energy savings of up to 80 % compared to conventional systems. However, the dehumidification performance of DCHEs remains limited due to the use of polymer binders for coating desiccant materials onto heat exchange surfaces. In our previous study, we developed a multilayer fixed-bed binder-free desiccant dehumidifier (MFBDD) that demonstrated high dehumidification capacity and low pressure drop compared to rotary desiccant wheels. Nevertheless, its potential for further enhancement through internal cooling and the use of step-shaped adsorption isotherms has not been explored. In this study, a physics-based one-dimensional (1D) transient model is developed and validated to capture the coupled heat and mass transfer processes in the MFBDD and extended to simulate internal cooling using a high-capacity composite metal–organic framework, MIL-101/GO-6 (water uptake ≈1.6 g/g within 35–47 % RH). The model enables detailed analysis of local air and bed temperature dynamics and quantifies how internal cooling affects the dehumidification performance under a wide range of operating conditions. Results show that integrating internal cooling and using MIL-101/GO-6 enhance mass adsorbed, moisture removal capacity, and dehumidification effectiveness by 50 %–99 % compared with the M.S. Gel baseline. The study further reveals that achieving near-isothermal operation requires simultaneous enhancement of the convective heat transfer coefficient and heat exchange surface area. In conclusion, this work provides the first detailed physical insight into the interplay between internal cooling and step-shaped isotherms in a binder-free desiccant device and establishes a validated modeling framework for scaling up and system-level performance evaluation of next-generation energy-efficient dehumidification systems.

Heat and mass transfer↗
DOE OSTI2023

LOCOMOTIVES - Comprehensive Impact and Cost Assessment Framework of Carbon Lowering Approaches for the US Rail Freight System

The goal of this project is to develop a tool to aid railroads and other stakeholders assess and approach the decarbonization of freight rail operations by identifying new, viable low-carbon energy storage and conversion systems for future locomotive systems and how they should be deployed on the existing US freight rail network. In the first quarter, the project focused on collecting data, establishing a simulation workflow, and engaging industry through the creation of the Industry Advisory Board (IAB). In the second quarter, the project focused on selecting fuel pathways and powertrain technologies, setting performance targets, conducting a techno-economic analyses, and developing the simulation framework that would serve as the backbone of the future toolhead. The third quarter involved developing an industry-oriented interactive dashboard powered by a five-step sequential framework, as well as holding industry advisory board meetings as per the initial technology-to-market plan. In the remaining project quarters, the NUFRIEND dashboard were fine-tuned with the help of IAB member feedback and in-depth scenario analyses were conducted to support the techno-economic analysis of energy sources. Additionally, dashboard documentation, project insights, and open-source code on GitHub were prepared and released. Throughout the project, the team completed testing and analysis of all model components, integrated all initial test scenarios, and conducted stakeholder engagement. Lower-carbon drop-in fuels can be deployed as admixtures and are considered uniform across the network at a desired penetration rate, while hydrogen and battery-electric technology deployment poses a more complex problem as they require significant investments to be made in the siting of refueling/charging facilities and the replacement of locomotive fleets. Thus, strategies for locating and sizing refueling/charging facilities on a railroad’s network to meet their energy demands were developed to inform deployment decisions. To address this challenge, the Northwestern University Freight Rail Infrastructure & Energy Network Decarbonization (NUFRIEND) framework presents a five-step sequential framework to select O-D paths, locate facilities, reroute flows, size facilities, and evaluate the deployment for alternative energy sources that require locomotive powertrains to be converted and new refueling infrastructure to be deployed. The NUFRIEND Framework is an industry-oriented tool for simulating the deployment of new energy technologies across the US freight rail network. The framework provides a comprehensive network-level optimization and scenario simulation tool for decarbonizing the freight rail sector, addressing the uncertainties surrounding technological developments by supporting sensitivity analyses for different operational and technological parameters through a transparent and flexible input module. It offers practical alternatives to diesel locomotives and can be applied for any railroad considering the specific network structure and freight demand, outputting evaluation metrics for the associated emissions and costs relative to diesel operations. A number of relevant simulation scenarios were run and analyzed for key insights on the value of different alternative technologies for freight rail decarbonization. The project developments and findings have been presented at numerous conferences and events.

08 HYDROGEN↗
DOE OSTI2026

Particle Filter Based Inference Testing

The primary intent of PAR-FIT (Particle Filter based Inference Testing) is to provide hard inductive evidence that a machine learning model is capable and proven for an individual test input. By examining training data used to form the underlying model functional correlation, an estimate of the reliability that a model will make the correct prediction can be made. The Sequential Probability Ratio Test is used to derive a qualitative evaluation for reliability based on hypothesis testing. The PAR-FIT framework achieves this by implementing a particle filter and the sequential probability ratio test algorithms on the machine learning model training data to determine relevancy of new individual test samples to the training dataset. The kernel function evaluates the local proximity and density of training data used to derive a prediction outcome. Particles are used to probabilistically determine which training data to evaluate for proximity. For test samples that are within a close proximity to and surrounded by multiple training data points, the evaluated reliability of the prediction is high. For test samples that are anomalies not represented by the training dataset, in low density data clusters, or are far from existing data points, the evaluated reliability is low as insufficient training evidence exists to suggest the model is capable of making the correct prediction. Sequential Probability Ratio Test is further used to determine when a hypothesis on whether a signal can be rejected or accepted for use. The ratio test collects sequence information from the particle filter to test whether the signal is anomalous or normal via hypothesis testing of the underlying distributions.

Chen, Edward [Idaho National Laboratory (INL), Ida↗
DOE OSTI2022

An Evaluation of Co-Simulation for Modeling Coupled Natural Gas and Electricity Networks

Reliance on natural gas for power generation has increased the coupling between gas and power networks. While this coupling can bring operational and economic benefits, it can also yield challenges, as the constraints in one system can impact the other. Co-simulation can capture the constraints and interactions between these systems, but so far, there has been limited comparison of co-simulation results to those of an integrated model. In this work, we develop a new co-simulation framework using the HELICS platform and the SAInt tool for modeling transient gas and AC optimal power flow. We evaluate this co-simulation framework against a fully integrated version of the SAInt power and gas simulators, thus providing a benchmarking of the co-simulation approach. We compare results across the two approaches for two test networks and a network representing the Belgian power and gas networks, testing both normal operating conditions and cases with compressor disruptions. In each of the cases tested, we find nearly identical results from the two approaches across various metrics of interest, such as nodal pressure, gas flow rates, and active power generation. This alignment suggests that co-simulation can yield comparable results to fully integrated models for modeling coupled gas and electricity networks.

03 NATURAL GAS↗
DOE OSTI2021

Ammonia separation from N 2 and H 2 over LTA zeolitic imidazolate framework membranes

LTA type zeolitic imidazolate framework membranes denoted as ZIF-21 were synthesized and evaluated for the separation of a commodity chemical, ammonia, from nitrogen and hydrogen. Membranes were grown using secondary seeded growth. Ammonia permeances were as high as 1727 GPU, with NH 3 /N 2 , and NH 3 /H 2 ideal selectivities of 35, and 12 respectively. ZIF-21 membranes were also evaluated for gas mixtures composed of 13.8:86.2 NH 3 /N 2 and NH 3 /H 2 , with mixture separation selectivities as high as 7.6 for NH 3 /N 2 . Differences in adsorption, and diffusivities were identified as the key separation mechanisms. Specifically, for both gas pairs the polar-polar interaction between ammonia and the linker polar channels, led to the preferential adsorption of ammonia, and therefore favored thermodynamically the separation of ammonia from nitrogen and hydrogen. In addition, for NH 3 /N 2 gas pair, differences in diffusivities was a contributing separation mechanism. For NH 3 /H 2 gas pair, due to the faster hydrogen diffusivity, the kinetic contribution was a strong competing separation mechanism.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

Statistical framework to assess long-term spatio-temporal climate changes: East River mountainous watershed case study

Abstract Evaluation of long-term temporal and spatial climatic change in mountainous regions is a critical challenge because of the interactive effects of multiple land and climatic factors and processes. Here we present the application of the statistical framework to the assessment of changes of climatic conditions, using data from 17 meteorological stations across the East River watershed near Crested Butte, Colorado, USA, and spanning the period from 1966 to 2021. The framework is developed based on (1) a time-series analysis of daily, monthly, and yearly averaged meteorological parameters (temperature, relative humidity, precipitation, wind speed, etc.), (2) evaluation and time series analysis of potential evapotranspiration (ET o ), actual evapotranspiration (ET), aridity index (AI), standard precipitation index (SPI) and standard precipitation-evapotranspiration index (SPEI), and (3) a temporal-spatial climatic zonation of the studied area based on the hierarchical clustering and PCA analysis of the SPEI, because the SPEI can be considered an integrative characteristic of the changes of climatic conditions. The Budyko model, with the application of the Penman–Monteith equation for the estimation of ET o , was used to determine the ET. The time series analysis of the AI is used to identify the periods with energy limited and water limited conditions. Hierarchical clustering of site locations for the three temporal segments of the SPEI showed a significant temporal-spatial shifts, indicating that dynamic climatic processes drive zonation patterns. Therefore, the watershed climatic zonation requires periodic re-evaluation based on the structural time series analysis of meteorological and water balance data.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Novel Earned Value Management System Maturity Framework and Its Relation to Project Performance

Earned value management systems (EVMS) are used by industry practitioners to successfully manage projects and programs; however, there has been no past study to characterize and evaluate the impact of EVMS maturity on project performance. This paper introduces a novel framework, developed to measure the EVMS maturity, composed of 56 attributes arrayed across ten subprocesses, which together make up an integrated project/program management system. This paper describes how the framework was conceived and developed, based on literature review and data collected from industry workshops. Then, it examines the relationship between EVMS maturity and ten project performance metrics through statistical analyses. The study analyzed project data from 35 projects and programs worth over $21.8 billion in total cost. For this sample, results showed statistically significant differences between projects with high and low EVMS maturity; on average, projects exhibiting high EVMS maturity have 54% less cost overruns and 19% less change orders versus their performance measurement baseline. Higher maturity projects and programs also achieve better customer satisfaction, meet business objectives more often, and are more often in compliance with EVMS standards and guidelines. This paper contributes to the body of knowledge by providing a practical and novel framework for assessing the maturity of earned value management systems. Practitioners can use the framework to improve their integrated project and program management.

99 GENERAL AND MISCELLANEOUS↗