Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “COMPARATIVE EVALUATIONS”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 937 records · Page 52

Evaluation of pressure reconstruction techniques for Model Order Reduction in incompressible convective heat transfer

This paper compares pressure reconstruction strategies in Model Order Reduction for incompressible flows with convective heat transfer. The Navier-Stokes equation are reduced along with the passive scalar transport equation for the temperature using the POD-Galerkin technique. Six different pressure reconstruction methods are evaluated, two of which are novel to the best of the authors’ knowledge. Accurate pressure reconstruction is key to avoid error buildup in when solving for the conservation of linear momentum at the reduced level. The six approaches are compared using Direct Numerical Simulations of convective heat exchange processes in a 3D Backward Facing Step with a heated cylinder. Additionally, when comparing time-averaged metrics, we observe that the reconstruction methods that approximate the reduced pressure field using techniques borrowed from full order models (mechanical analogy, pressure Poisson, and velocity supremizers) yield higher errors than the methods that seek to stabilize the reduced systems (reduced residual stabilization, artificial divergence, and Uzawa operator).

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Quantitative evaluations of subtropical westerly jet simulations over East Asia based on multiple CMIP5 and CMIP6 GCMs

As a salient feature of the Asian monsoon system, the East Asian subtropical westerly jet (EASWJ) exerts significant impacts on weather and climate changes in China and even throughout East Asia. In this paper, we applied a new self-adaptive algorithm to detect the EASWJ, identify its boundaries, and then represent its characteristics by defining three indices: the intensity index, meridional displacement index, and width index. Compared to the reanalysis data, we carried out a comprehensive, objective, and quantitative EASWJ evaluation using historical experiments from multiple global climate models (GCMs) in the Coupled Model Intercomparison Project Phases 5 and 6 (CMIP5 and CMIP6). The results show that the multimodel ensemble mean (MME) of both CMIP5 and CMIP6 can simulate the characteristics of winter EASWJ well. While for the other three seasons, the MME of both phase models underestimate the 200-hPa zonal wind (U200) strength in the jet coverage area and overestimate the U200 outside the jet area, such simulation results weaken the meridional shear of the wind field. The EASWJ simulations from the CMIP5 GCMs had no consistent intensity or location characteristic tendencies, and most CMIP5 GCMs tended to simulate relatively wide-coverage jets. In contrast, most CMIP6 GCMs are inclined to simulate significantly weaker, wider, and more-northward jets. Compared to the predecessors in CMIP5, about half of CMIP6 GCMs significantly minimized the jet intensity bias, but remarkable errors were still observed in their jet location and coverage representations. Furthermore, the comparative analysis performed by classifying models based on their evaluated simulation results suggested that the simulated performance of the meridional temperature gradient was important for capturing the EASWJ characteristics. Further in-depth study of the causes of model differences is warranted to improve simulation results.

54 ENVIRONMENTAL SCIENCES↗

Feature review of photovoltaic modeling software utilizing blind performance assessment

While confidence in photovoltaic (PV) modeling software has always been essential, the rapid pace of new PV plant developments makes accuracy and credibility more critical than ever. Independent assessments, particularly through blind modeling comparisons, are therefore necessary to ensure unbiased benchmarking across PV modeling software. Previous studies have been limited by a narrow range of models compared, anonymized results, or system size. This study presents results from the first-ever onymous blind modeling comparison, evaluated using both lab- and utility-scale fixed-tilt, monofacial, south-facing systems at sub-hourly time intervals. Seven commercially used PV software tools were compared: 3E SynaptiQ, PlantPredict, PVsyst, RatedPower, SAM, SolarFarmer, and Solargis Evaluate. Predictions were submitted directly by software representatives, providing unique insights into each software’s implementation and resulting prediction behavior. Notable features, including plane-of-array (POA) transposition model, module temperature model, shading model, and performance model were analyzed and compared. Four summary tables compile these features of the software, serving as a resource to help users understand the methodological differences and select the most suitable software for their applications. The software tools show deviations from mean error in annual yield up to 2.5 % in the lab-scale system, increasing to 6.0 % for the utility-scale system. These differences arise from a combination of user decisions and the inherent behavior of the software, indicating the need for continuous and rigorous validation of modeling methods using these software tools against complex, real-world systems.

14 SOLAR ENERGY↗

Thermocatalytic Heat Pipes for Geothermal Resource Recovery

Heat pipes are an important technology that allow orders of magnitude faster heat transfer than simple conduction. However, operating principles in heat pipes place fundamental bounds on their performance (critical heat flux and efficiency). Conventional heat pipe functionality is inherently tied to vaporization and condensation of the working fluid charged in the heat pipe. These fluids each have different operating temperature ranges based on the capillary, entrainment, sonic, and boiling limits of the heat pipe design. These limits, typically the capillary limit, dictate the maximum heat flux a heat pipe can carry, and most importantly for geothermal systems, the distance over which the pipes can operate (100 to 200 m maximum under optimum conditions). A thermocatalytic heat pipe breaks the inherent limitations of phase change thermo- and hydrodynamics and can transform heat pipe technology as a potentially more efficient means of extracting heat from a geothermal resource. The thermocatalytic heat pipe uses a working fluid to transport both sensible and chemical heat. An endothermic chemical reaction at depth removes heat from the reservoir and produces reactive intermediates, which are transported to the surface and used to run a reverse exothermic reaction that releases heat for use in power generation or other useful purposes. This technology offers two distinct advantages over conventional geothermal heat recovery technologies: (1) lower heat loss to the rock outside of the geothermal reservoir, and (2) higher heat transfer rates to the well field within the geothermal reservoir. Both advantages offer opportunity to reduce risks and lower costs of geothermal energy recovery. In this report, we discuss an initial effort to assess the efficacy and limitations of this technology for extracting heat from both porous/permeable and nominally impermeable geothermal reservoirs. Numerical simulation capabilities of the STOMP-GT code were enhanced to enable simulations of thermochemical heat pipes traversing geothermal reservoirs. An array of potential thermochemical reaction systems was evaluated and screened. Of these, an ethanol dehydration reaction was most promising in the vapor-liquid reaction set. A solid-phase dehydration reaction (CuSO4·5H2O) showed the highest reaction enthalpy per unit volume but would require development of a nonaqueous carrier fluid to implement it in a heat pipe. Subsurface reservoir simulations predicted long-term performance of the heat pipes for each geothermal reservoir type. The performance of U-shaped wells and coaxial wells was evaluated for a suite of reactions for both hydrothermal and hot dry rock reservoirs and was compared with a baseline case of simply pumping water through the wells. The heat pipe technology was additionally evaluated for an enhanced geothermal system (EGS) with an injection borehole, production borehole, and intervening hydraulically conductive fracture. All reservoir types showed significant improvement in heat recovered over a 20-year operating period ranging from a 1.8X increase for the hot dry rock case to more than 2.5X more energy recovered for the EGS case.

15 GEOTHERMAL ENERGY↗

Evaluation of the CAM6 Climate Model Using Cloud Observations at McMurdo Station, Antarctica

A comparative analysis between observational data from McMurdo Station, Antarctica and the Community Atmosphere Model version 6 (CAM6) simulation is performed focusing on cloud characteristics and their thermodynamic conditions. Ka-band Zenith Radar (KAZR) and High Spectral Resolution Lidar (HSRL) retrievals are used as the basis of cloud fraction and cloud phase identifications. Radiosondes released at 12-hour increments provide atmospheric profiles for evaluating the simulated thermodynamic conditions. Our findings show that the CAM6 simulation consistently overestimates (underestimates) cloud fraction above (below) 3 km in four seasons of a year. Normalized by total in-cloud samples, ice and mixed phase occurrence frequencies are underestimated and liquid phase frequency is overestimated by the model at cloud fractions above 0.6, while at cloud fractions below 0.6 ice phase frequency is overestimated and liquid-containing phase frequency is underestimated by the model. The cloud fraction biases are closely associated with concurrent biases in relative humidity (RH), i.e., high (low) RH biases above (below) 2 km. Frequencies of correctly simulating ice and liquid-containing phase increase when the absolute biases of RH decrease. Cloud fraction biases also show a positive correlation with RH biases. Water vapor mixing ratio biases are the primary contributor to RH biases, and hence, likely a key factor controlling the cloud biases. Finally, this diagnosis of the evident shortfalls of representations of cloud characteristics in CAM6 simulation at McMurdo Station brings new insight in improving the governing model physics therein.

54 ENVIRONMENTAL SCIENCES↗

Comparing plant litter molecular diversity assessed from proximate analysis and 13 C NMR spectroscopy

Accurate representation of the chemical diversity of litter in ecosystem-scale models is critical for improving predictions of decomposition rates and stabilization of plant material into soil organic matter. In this contribution, we conducted a systematic review to evaluate how conventional characterization of plant litter quality using proximate analysis compares with molecular-scale characterization using 13 C NMR spectroscopy. Using a molecular mixing model, we converted chemical shift regions from NMR into fractions of carbon (C) in five organic compound classes that are major constituents of plant material: carbohydrates, proteins, lignins, lipids, and carbonylic compounds. We found positive correlations between the acid soluble fraction and carbohydrates, and between the acid insoluble fraction and lignins. However, the acid-soluble fraction underestimated carbohydrates, and the acid insoluble fraction overestimated lignins by 243%. We identified two sources of uncertainties: i) disparities between litter chemical composition based on hydrolysability and actual chemical composition obtained from NMR and ii) conversion factors to translate proximate fractions into organic constituents. Both uncertainties are critical, potentially leading to misinterpretations of decay rates in litter decomposition models. Consequently, we recommend including explicit substrate chemistry data in the next generation of litter decomposition models.

59 BASIC BIOLOGICAL SCIENCES↗

Comparison of Simulation of Dual-Active Bridge in Different Simulators and Using Different Simulation Methods

The accuracy of states measured from simulation of a dual-active bridge (DAB) converter with an open-loop controller has been used for comparing simulation software and algorithms. The accuracy of the measured states is sensitive to simulation settings and parameters chosen. In this paper, the simulation of the DAB converter with open-loop control is run in the MATLAB/Simscape Electrical, PLECS, and PSCAD software environments, with various simulation settings. The simulation results are also compared with a new simulation algorithm proposed for DAB simulations. Different simulation settings are evaluated, including different solver types, operating conditions, and the on-state resistance values of the MOSFET switches. The simulation results are compared with the theoretical calculations. It is shown that unexpected divergence and DC offset may occur in some cases. This paper provides guidelines to simulate the DAB converter with open-loop control.

Yin, Shiyuan↗

Developing Metrics to Evaluate the Skill and Credibility of Downscaling

Major activities for this project consisted of three related elements: Comparing results using statistical downscaling to the dynamical downscaling performed by the UCLA (Dr. Alex Hall) team in the proposal Developing statistical downscaling methods for wind and near-surface humidity Evaluating differences in extremes across downscaling methods.

17 WIND ENERGY↗

The MUSIC Critical Benchmark and Nuclear Data

The Measurement of Uranium Subcritical and Critical (MUSIC) experiment was a series of measurements of critical and subcritical configurations of bare highly enriched uranium. The goal was to compare measurement methods, analysis techniques, and simulation methods across regimes of criticality and to provide high-quality validation of 235 U nuclear data. A benchmark evaluation of the two critical configurations of the MUSIC experiments will soon be published in the release of the International Criticality Safety Benchmark Evaluation Project Handbook. The recent execution of the experiment aids in proper quantification of model simplifications and all uncertainties associated with the experiment. Historical benchmark evaluations are heavily relied on for uranium nuclear data validation despite the fact that the same level of documentation and comparable uncertainty analysis may not be present. The MUSIC evaluation is less likely to include “unknown unknowns” that could impede accurately modeling the system. Presented are both highly detailed and very simplified models, which represent the experimental configurations accurately, aiding the users of the benchmark for nuclear data or transport code validation. The sensitivities of k eff to nuclear data and nuclear data–related uncertainties are very similar between this experiment and previous bare uranium sphere experiments. In addition, the nuclear data uncertainties to any nuclides other than 235 U are small. For all these reasons, the recently evaluated MUSIC benchmark critical configurations could prove very useful for 235 U nuclear data validation. Currently, major libraries have good agreement with the experimental results, within 200 pcm for all nuclear data libraries, and within one standard deviation of the experimental result for most. Suggested nuclear data adjustments based on MUSIC and Lady Godiva are also presented, with posterior improvements to both the agreement in k eff and the uncertainty associated with the nuclear data.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Evaluation of coated steels in supercritical CO 2

The carburizing supercritical CO 2 (sCO 2 ) environment limits the use of lower cost steels in the lower temperature (450–650°C) portions of the sCO 2 Brayton cycle because of concerns about internal carburization and embrittlement. Results on a ferritic–martensitic steel and conventional and advanced austenitic steels at 450–650°C in 30 MPa sCO 2 with and without 1% O 2 and 0.1% H 2 O additions have indicated that sCO 2 environments will have lower maximum operating temperatures compared to steam plants. Pack Al and Cr coatings were evaluated at 650°C on T91 and 316H substrates and showed some benefit for up to 2000 h at 650°C, especially without impurities. However, characterization indicated Al 2 O 3 was not formed and Cr-rich carbides formed in the Cr coatings. With the addition of impurities in the sCO 2 , the coatings were less protective at 650°C. Subsequent exposures at 600°C in sCO 2 showed similar behavior. Postexposure evaluations included measuring the bulk C content and room temperature tensile properties. Finally, improvements were indicated but the tensile results were complicated by the high temperature pack coating process affecting the substrate properties.

36 MATERIALS SCIENCE↗

Monthly hydropower generation data for Western Canada to support Western-US interconnect power system studies

Hydroelectric power generation in Western Canada significantly contributes to power grid operations of the North American Western Interconnection through substantial generation, some of which is exported to the United States (U.S.). However, the lack of publicly available hydropower generation datasets poses challenges for future market projections and resource adequacy evaluations. We present a simulation-based monthly power system model-ready hydropower generation dataset for 110 facilities in British Columbia and Alberta from 1981 to 2019. These monthly hydropower generation estimates are developed from integrated hydrologic model simulations of runoff and reservoir-operated streamflow, followed by scaling that considers diversion inflow constraints based on hydropower water license information. To address the lack of comparable hydropower generation records, we conduct step-by-step evaluations for simulated runoff, regulated streamflow, and hydropower generation using available observations or estimates. The presented hydropower dataset aims to enhance the representation of hydropower resources in Western Canada, supporting power grid system studies for the Western Interconnection of the U.S. and Canada.

13 HYDRO ENERGY↗

Benchmarking graph neural networks for materials chemistry

Graph neural networks (GNNs) have received intense interest as a rapidly expanding class of machine learning models remarkably well-suited for materials applications. To date, a number of successful GNNs have been proposed and demonstrated for systems ranging from crystal stability to electronic property prediction and to surface chemistry and heterogeneous catalysis. However, a consistent benchmark of these models remains lacking, hindering the development and consistent evaluation of new models in the materials field. Here, we present a workflow and testing platform, MatDeepLearn, for quickly and reproducibly assessing and comparing GNNs and other machine learning models. We use this platform to optimize and evaluate a selection of top performing GNNs on several representative datasets in computational materials chemistry. From our investigations we note the importance of hyperparameter selection and find roughly similar performances for the top models once optimized. We identify several strengths in GNNs over conventional models in cases with compositionally diverse datasets and in its overall flexibility with respect to inputs, due to learned rather than defined representations. Meanwhile several weaknesses of GNNs are also observed including high data requirements, and suggestions for further improvement for applications in materials chemistry are discussed.

36 MATERIALS SCIENCE↗

Chapter 8 - Testing and Evaluation Methods for Protection Systems

In this chapter, we aim to present different approaches used formally and informally for the evaluation of protection devices and schemes. This chapter starts with presenting background on generalization of protection device components, followed by the resources necessary to evaluate the protection system. Further, this chapter presents the different approaches used in protection evaluation with their advantages and disadvantages. Finally, this chapter closes by presenting background on technology readiness level metrics. Technology readiness level metric is borrowed from the space industry for the purpose of comparing the maturity of the different protection technologies and using the appropriate evaluation methods from the list presented here.

power systems↗

A Review of the Evaluation of Building Energy Code Compliance in the United States

Building energy codes are essential tools for achieving energy efficiency in buildings. However, the full energy savings potential of these codes can only be realized if buildings are constructed in compliance with them. Therefore, evaluating building energy code compliance is crucial in bridging the gap between the energy efficiency requirements set by energy codes and the actualized energy savings achieved. An energy code compliance evaluation serves as a mechanism to assess construction practices, evaluate the effectiveness of code enforcement, identify gaps in compliance, and guide strategies for improvement through training and education. Conducting code compliance evaluation activities involves field studies that require careful design and significant resources. Historically, more emphasis has been placed on developing and adopting building energy codes, while efforts to evaluate compliance have been relatively limited and lacking consistent approaches. The passage of the 2009 American Recovery and Reinvestment Act (ARRA), which mandated that states create plans for achieving 90% compliance within eight years, stimulated the need for an energy code compliance evaluation. As a result, federal, state, and local governments, and utilities have invested in the development of methodologies and tools for code compliance evaluation studies. This paper reviews the code compliance evaluation studies conducted in the United States over the past three decades. It describes and compares the methodologies and metrics used to assess building energy code compliance, summarizes the general elements and steps involved in the evaluation process, and discusses common issues in these studies. Over time, code compliance evaluation methodologies have evolved from isolated development within individual states, regions, and utilities, to widely accepted protocols applicable across different states and local jurisdictions. There has been a transition in compliance metrics, shifting from historical compliance rates to energy-consumption-oriented approaches.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

A new method for predicting hurricane rapid intensification based on co-occurring environmental parameters

Abstract Tropical cyclones (TCs) that undergo Rapid Intensification (RI) can pose serious socioeconomic threats and can potentially result in major damaging impacts along coastal areas. Considering the complexity of various physical mechanisms that play a role in RI and its relatively low probability of occurrence, predicting RI remains a major operational challenge. In this study, we propose a simple deterministic binary classification model based on the co-occurrence of environmental parameters (MCE) to predict an RI event. More specifically, the model determines the possibility of RI based on a simple count of the number of environmental predictors deemed favorable and unfavorable. We compare our model results to logistic regression (LR) and decision tree (DT) models, well-trained using the same set of environmental predictors. Results reveal that at an RI threshold of 30 kt, the MCE exhibits a critical success index score of 0.233 which is 14% higher than DT and LR model performances. When tested at multiple RI thresholds, the MCE displays relatively higher skill scores across multiple metrics. By simultaneously evaluating the favorability of predictors, the MCE is able to comparatively reduce the number of false alarms predicted when certain predictors are unfavorable toward RI. Interpreting these model results to gain a physical understanding of how co-occurring environmental parameters can affect RI, we highlight future directions for using models based on the MCE approach to understand and predict TC RI as well as other meteorological extremes.

54 ENVIRONMENTAL SCIENCES↗

Molten Salt Corrosion Tests of Additively Manufactured Stainless Steel 316H

Molten salt reactors (MSRs) have drawn considerable interest due to their favorable safety features, high thermal efficiency, and compatibility with different fuel cycles. Yet, the success of MSRs hinges critically on the performance of structural materials to be used in these aggressive molten salt environments, where corrosion and material compatibility remain primary challenges to long-term reliability. Additively manufactured (AM) nuclear structural materials prompt the use of novel geometries and compositions to enhance material performance and reduce costs of constructing MSRs. The rapid solidification conditions inherent to AM processing impart distinctive microstructural features, including cellular sub-structures, dislocation densities, residual stress, and oxide inclusions, which can influence material performance in MSR components. While the mechanical properties of AM stainless steels have been widely studied, their corrosion behavior, particularly in molten salt environments, has received far less attention. Addressing these needs, the Advanced Materials and Manufacturing Technologies (AMMT) program provides a framework for systematically evaluating how unique microstructures produced by AM processes influence the performance of these materials in these demanding environments and for developing reproducible testing workflows that can support future code qualification efforts and standards development. Bridging this knowledge gap is essential for assessing the viability of AM alloys in MSRs and informing qualification strategies. A further challenge is the absence of standardized protocols for molten salt corrosion testing. Accordingly, this report provides an account of the corrosion evaluation of AM 316H stainless steel in NaCl 2 -MgCl 2 molten salt at 550 °C, with exposure times of 100 and 500 hours. It documents the experimental procedures implemented under the AMMT program, including salt preparation, exposure protocols, and post-test characterization methods, to establish reproducibility and transparency. Importantly, the study examines AM 316H samples in the as-fabricated condition, directly reflecting the surface state most relevant to engineering applications, and compares their behavior to machine-cut surfaces. Overall, preliminary evaluations have noted that surface conditions (e.g. morphology, contamination, etc.) have a noticeable impact on the corrosion resiliency. The impact of the corrosion is difficult to detect at 100h, unless, in the case of AM 316H, the specimen surface is decontaminated. After 500 h, as-fabricated surfaces of AM and wrought 316H display evidence of general versus preferential corrosion attack, respectively. Both AM and wrought 316H machine-cut surfaces exhibit a continuous Cr depletion zone, evident of general corrosion. While the estimated extent of corrosion appears within the same order of magnitude regardless of the surface condition, it is apparent that more predictable behavior is observed on machine-cut surfaces. Nonetheless, further investigation is necessary to fully elucidate the corrosion mechanism under these conditions.

36 - MATERIALS SCIENCE↗

Investigation of the Impact of TSL Data Libraries and Geometry Variations on the MSRE Benchmark

The increasing demand for green, low-carbon energy solutions has amplified the focus on advanced nuclear reactor technologies. Among these, Molten Salt Reactors (MSRs) have been spotlighted because of their special features. Historically, Oak Ridge National Laboratory (ORNL) started the Molten Salt Reactor Experiment (MSRE) in 1956. Later, ORNL and the University of California, Berkeley (UCB) jointly developed the MSRE benchmark. This was then reviewed by the International Reactor Physics Experiment Evaluation Project (IRPhEP) committee and added to their 2019 handbook. In the current study, the benchmark model was recreated via the Serpent code. The calculated effective multiplication factor was 1.02087 ± 0.00019, which gives a deviation of about 2000 pcm compared to the benchmark/experimental result. At North Carolina State University (NCSU), recent evaluations were conducted on thermal scattering cross sections for molten salt FLiBe and 20% porous nuclear graphite, anticipated for incorporation in the ENDF/B-VIII.1 library. The influences of these thermal scattering law (TSL) data and geometry changes on the multiplication factor were examined using the ENDF/B-VII.1 and ENDF/B-VIII.0 libraries. Introducing the TSL data for FLiBe and 20% porous graphite resulted in an effective multiplication factor of +270 pcm compared to the reference value obtained with ENDF/B-VII.1 in this study. The adjustment of the reactor vessel dimensions resulted in decrease of -448 pcm in the calculated effective multiplication factor.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

End-to-end Analytics for Grid Arch Design & All-hazard Assessment

Resiliency, reliability, and security of the next-generation smart grid depend upon leveraging advanced communication and computing technologies, integrating them with physical power systems, and developing real-time, fast, data-based applications to help in wide-area monitoring and control of the grid. Using a high sampling data rate from phasor measurement units (PMUs) to develop applications has opened the door to achieving the next-generation grid requirements. The North American Synchrophasor Initiative Network (NASPlnet) was developed in 2007-09 to create a standard and guide for PMU data exchanges. With the advancement in both networking and grid requirements, it is necessary to evaluate the performance of different NASPInet versions and their impact on applications. Therefore, we need a cyber-power cosimulation framework that supports very large-scale co-simulation capable of running in parallel, high-performance computing platforms and capturing real-life network behavior. This work presents a cyber-physical co-simulation testbed using NS3 to model the communication network, GridPACK to model the power grid, and HELICS as a co-simulation engine. Comparative analysis of latency in synchrophasor networks and a performance evaluation of a power system stabilizer application based on PMU data in an Institute of Electrical and Electronics Engineers 39-bus test system is presented using this co-simulation testbed.

24 POWER TRANSMISSION AND DISTRIBUTION↗