Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

What you get is not always what you see—pitfalls in solar array assessment using overhead imagery

Effective integration planning for small, distributed solar photovoltaic (PV) arrays into electric power grids requires access to high quality data: the location and power capacity of individual solar PV arrays. Unfortunately, national databases of small-scale solar PV do not exist; those that do are limited in their spatial resolution, typically aggregated up to state or national levels. While several promising approaches for solar PV detection have been published, strategies for evaluating the performance of these models are often highly heterogeneous from study to study. The resulting comparison of these methods for practical applications for energy assessments becomes challenging and may imply that the reported performance evaluations overly optimistic. The heterogeneity comes in many forms, each of which we explore in this work: the degree of diversity of the locations and sensors (e.g. different satellites, aerial photography) from which the training and validation data originate, the validation of ground truth (manual annotation of imagery vs known solar PV locations), the level of spatial aggregation (e.g. array-level vs regional estimates), and inconsistencies in the training and validation datasets (e.g. different datasets are used for each study and those data are not always made accessible). For each, we discuss emerging practices from the literature to address them or suggest directions of future research. As part of our investigation, we evaluate solar PV identification performance in two large regions: the entire state of Connecticut and the city of San Diego, CA. In Connecticut, we also use 33,114 known parcel-level solar PV installations from Berkeley Lab’s Tracking the Sun dataset to evaluate parcel-level performance and evaluate capacity estimates using 169 municipalities. We also make our code (which we call SolarMapper), pre-trained models, training data, and predictions publicly available and provide a web portal for interactively inspecting each prediction that was made. Here our findings suggest that traditional performance evaluation of the automated identification of solar PV from satellite imagery may be optimistic due to common limitations in the validation process. The takeaways from this work are intended to inform and catalyze the large-scale practical application of automated solar PV assessment techniques by energy researchers and professionals.

14 SOLAR ENERGY↗

Development of a Metocean Reference Site near the Massachusetts and Rhode Island Wind Energy Areas

This project developed the first long-term U.S.-based offshore MetOcean Reference Site (MORS-1) by capitalizing on a unique combination of one of the few existing publicly available offshore wind energy metocean observational campaigns in the United States and the only existing research-grade offshore fixed tower. Data collected at MORS-1 has facilitated improved wind resource assessments, improved short-term power production estimates, and reduced costs for sensor validation and calibration efforts, which translate into reduced overall wind energy project risk and cost for developers. Now operational, MORS-1 serves the needs of both industry and researchers using a nonprofit, joint industry-academic partnership model. Led by the Woods Hole Oceanographic Institution, the MORS-1 development effort focused on creating both a recognized organizational structure that will ensure support of the MORS-1 by the wider wind energy industry and research community, and a highly validated data collection and sensor validation facility that will serve as the premier location for cost- and uncertainty-reducing resource characterization and research efforts.

17 WIND ENERGY↗

Validation Assessment of Turbulent Reacting Flow Model Using The Area-Validation Metric on Medium-Scale Methanol Pool Fire Results

Accident analysis and ensuring power plant safety are pivotal in the nuclear energy sector. Significant strides have been achieved over the past few decades regarding fire protection and safety, primarily centered on design and regulatory compliance. Yet, after the Fukushima accident a decade ago, the imperative to enhance measures against fire, internal flooding, and power loss has intensified. Hence, a comprehensive, multilayered protection strategy against severe accidents is needed. Consequently, gaining a deeper insight into pool fires and their behavior through extensive validated data can greatly aid in improving these measures using advanced validation techniques. A model validation study was performed at Sandia National Laboratories in which a 30-cm diameter methanol pool fire was modeled using the SIERRA/Fuego turbulent reacting flow code. This validation study used a standard validation experiment to compare model results against, and conclusions have been published. The fire was modeled with a Large Eddy Simulation (LES) turbulence model with subgrid turbulent kinetic energy closure. Combustion was modeled using a strained laminar flamelet library approach. Radiative heat transfer was accounted for with a model utilizing the gray-gas approximation. In the present study, additional validation analysis is performed using the area validation metric (AVM). These activities are done on multiple datasets involving different variables and temporal/spatial ranges and intervals. In conclusion, the results provide insight into the use of the area validation metric on such temporally varying datasets and the importance of physics-aware use of the metric for proper analysis.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

Development and Experimental Validation of a Heat Transfer Model for Spilled Molten Salt Pools

A spill of radionuclide-bearing molten salt is one of the major postulated events that needs to be analyzed for liquid fluorine salt-cooled high-temperature reactor (FHR) or molten salt reactor licensing purposes. In this postulated event, radioactive source term materials (RSTMs) in the molten salt are discharged from the reactor vessel to the reactor building. The release of RSTMs from the spilled salt pool to the gas space in the reactor building is expected to be controlled by the cooling behavior of the spilled salt, including the growth and shrinkage of the solid crust on the surface of the spilled salt pool. This paper presents a simulation model for spilled salt pool heat transfer and validation efforts. The validation data come from two molten salt spill tests that were performed recently: the PELE2 test by the Rapid Experimental Laboratory of Kairos Power LLC (KP) and the Argonne salt cooling test conducted by Argonne National Laboratory. The former was a large-scale test involving kilograms of molten spilled FLiNaK salt, and the latter was a relatively smaller-scale test targeting various processes associated with a salt spill event. Both tests generated valuable data sets that can be used to assess salt cooling and validate evaluation models. This paper provides a new one-dimensional model that can simulate the cooling process of a spilled salt pool as well as the thermal responses of heat structures, such as the stainless steel liner and the concrete below the salt. The model has been implemented as part of KP-SAM code, which is a branch of the systems code SAM specific to KP FHR. In conclusion, the simulation results of the model are compared with the data of the PELE2 and Argonne tests, and reasonable agreements are observed between the model and test data.

heat transfer model↗

Development of Digital Twin Predictive Model for PWR Components: Updates on Multi Times Series Temperature Prediction Using Recurrent Neural Network, DMW Fatigue Tests, System Level Thermal-Mechanical-Stress Analysis

The long-term operation (LTO) of nuclear power plant (NPP) beyond their original design life of 40 years, can lead to more material damage associated with cyclic fatigue under thermal-mechanical loading cycles and associated long-term exposure of reactor material to the deleterious reactor-coolant environments. However, under this LTO condition the reactor components can still safely operate but may require more frequent Nondestructive Evaluation (NDE) of reactor components. Frequent NDE requirement may lead to frequent shutdown of the NPP. This in turn can lead to power outage and additional NDE-inspection-cost related economic loss. The economic loss can be minimized by reducing uncertainty in life estimation of safety-critical pressure boundary components and by implementing more digital approach such as by using upcoming digital-twin (DT) technology for predicting the structural states (e.g., time and location dependent inside/outside thickness temperature, stress, strain, plastic deformation, etc.) and associated fatigue life of a component in real time. Towards this goal Argonne National Laboratory (ANL) with the sponsorship of DOE Light Water Reactor Sustainability (LWRS) program is working on the development of a DT framework that can be used for real time environmental fatigue prediction of reactor components. The DT framework is based on limited experiment-data, Artificial-intelligence (AI) – Machine-Learning (ML) - Deep-Learning (DL) based techniques and Multiphysics-computational-mechanics such as finite element (FE) based modeling tools. Towards this overall goal, following are some of the major contributions made during the FY21: 1) Multiple 82/182 dissimilar metal weld (DMW) specimens (both solid-weld and joint-weld representing the actual reactor multi-metal nozzles) were fatigue tested. The resulting fatigue lives were compared to the NUREG-6909 based best-fit and design fatigue curves. Additionally, the results of 52/152 DMW fatigue specimens (which were recently tested at Republic of Korea under the sponsorship of International Nuclear Energy Research Initiative - INERI program) were compared to the NUREG-6909 based best-fit and design fatigue curves. From the comparison of 82/182 and 52/152 DMW test data with NUREG-6909 best-fit curve, most of the reported test data fall way away from the NUREG-6909 suggested best-fit or mean curve. The NUREG-6909 suggested best-fit curve is the best-fit curve of austenitic stainless steel and due to lack of enough data on Nickel-based welds, this is currently being used for predicting the life of Nickel-alloy-based welded components. However, the above observation may require higher scaling factor (e.g., ASME suggested factor of 20 on cycles rather than the current NUREG-6909 suggested factor of 12 on cycles) for scaling the austenitic-stainless-steel best-fit-curve for estimating the design or safe-life of a welded component. Accordingly, for example, if a DMW component experience a strain amplitude of 0.6% the PWR-water life of the component would be 52 cycles instead of 85 cycles. However, more DMW tests are required to further ascertain the above-mentioned observations. 2) A system level CAD and finite element model were developed which consists of reactor pressure vessel (RPV), part of steam generator (SG), part of pressurizer (PRZ), hot leg (HL), and surge line (SL). This is with detailed nozzle geometry and thermal-mechanical material properties of different metals to simulate realistic thermal-mechanical stress under connected system global thermal-mechanical boundary conditions. 3) Different system level heat transfer analyses were performed with estimation of relevant heat transfer coefficients. The resulting data were used in subsequent system level thermal-mechanical stress analysis and for generating spatial-temporal training and validation data for a system level digital-twin based temperature predictor. Transient heat transfer analyses were performed considering thermal boundary condition under design-basis (DB) loading and EDF (Électricité de France) data-based grid-load-following (EDF-GLF) loading cycles. 4) System level thermal-mechanical stress analysis was performed for identifying damage-prone hotspots and for future extension of the model for cyclic state prediction. From the system-level model simulation under DB loading cycle it is found that HL and the SL nozzle that connect to the HL can experience significant stress and strain and could be one of the weakest links in the overall reactor coolant system (RCS). 5) An AI/ML based DT model was developed for multi-time-series temperature prediction at any inside/outside thickness locations of PWR pressure boundary components. This is by using Recurrent-neural-network (RNN) and keras machine learning libraries. The RNN model was validated against two laboratory test-based data sets with one obtained through ANL’s in-air fatigue test system and other through PWR-water test loop. The experimentally validated DT model further validated against FE model results to predict thermal scarification related spatialtemporal temperatures at random locations of a component. The well validated DT model was then used for demonstrating spatial-temporal temperature prediction under 100+ years of reactor operation subjected to combined DB, EDF-GLF and randomized grid-load-following (RANDOMGLF) loading Cycles. The expert-elicitation DT model framework was developed assuming field/input/process measurements can be available from a few existing plant sensors and can readily be used by the NPP operators. The above temperature prediction model will feed to the next-step stress analysis model based on which the life of a component can be predicted in realtime, which is one of our future works.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Hyperspectral Infrared Observations of Arctic Snow, Sea Ice, and Non-Frozen Ocean from the RV Polarstern during the MOSAiC Expedition October 2019 to September 2020

This study highlights hyperspectral infrared observations from the Marine-Atmospheric Emitted Radiance Interferometer (M-AERI) collected as part of the Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) Mobile Facility (AMF) deployment on the icebreaker RV Polarstern during the Multidisciplinary drifting Observatory for the Study of Arctic Climate (MOSAiC) expedition from October 2019 to September 2020. The ARM M-AERI directly measures the infrared radiance emission spectrum between 520 cm –1 and 3000 cm –1 (19.2–3.3 μm) at 0.5 cm –1 spectral resolution. These ship-based observations provide a valuable set of radiance data for the modeling of snow/ice infrared emission as well as validation data for the assessment of satellite soundings. Remote sensing using hyperspectral infrared observations provides valuable information on sea surface properties (skin temperature and infrared emissivity), near-surface air temperature, and temperature lapse rate in the lowest kilometer. Comparison of the M-AERI observations with those from the DOE ARM meteorological tower and downlooking infrared thermometer are generally in good agreement with some notable differences. Operational satellite soundings from the NOAA-20 satellite were also assessed using ARM radiosondes launched from the RV Polarstern and measurements of the infrared snow surface emission from the M-AERI showing reasonable agreement.

54 ENVIRONMENTAL SCIENCES↗

Design Optimization and Measurement Uncertainty of an Electromagnetic Level Sensor for Liquid Metal Reactors

Here, this article describes the design and operation of a prototype mutual inductance level sensor (MILS) and the development and validation of a finite-element analysis (FEA) model describing its behavior. The MILS was designed for use in liquid sodium up to temperatures of 650 °C in the Mechanisms Engineering Test Loop (METL) at Argonne National Laboratory (ANL). Preliminary testing was performed in a room temperature test stand with aluminum acting as an analog for the sodium to better understand sensor performance and provide accurate code validation data. This experimental data, along with material properties found in literature, were used to validate an FEA model in ANSYS Maxwell. The validated ANSYS Maxwell model was used to examine the performance of the MILS in various environments and under various operating conditions. Simulations suggest the following: The MILS will perform adequately in liquid sodium and liquid lead at temperatures up to 650 °C . The temperature dependence of electrical conductivity imposes a temperature dependence on the sensor that requires proper compensation. The MILS signal sensitivity is maximized when mutual inductance between sensor coils is maximized, and sensor geometry should be selected to account for this factor. The operating frequency of the MILS can be optimized and is dependent on process fluid material, operating temperature, and materials/geometry of sensor system. Finally, the use of a stainless-steel isolating thimble does not adversely affect the sensor signal. The primary sources of error for this MILS system are the accuracy of the calibration standard against which the sensor is calibrated, and the temperature dependence of the sensor. This work contains all the necessary details to recreate the FEA model and results. This model can be used to optimize the performance of a MILS in any operating environment to read any electrically conductive working fluid.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Preliminary Design of a New Pulsed-Neutron Die-Away Experimental Testbed for Thermal Scattering Law Benchmarks (PNDA) (IER-501 CED-1)

This report presents the preliminary design (CED-1) of IER-501, a new testbed for pulsed-neutron die-away (PNDA) experiments at Lawrence Livermore National Laboratory (LLNL). The PNDA experiments will be high-quality benchmarks that serve to optimize and validate thermal scattering laws (TSLs), which are high-priority nuclear data for the Department of Energy’s Criticality Safety Program (NCSP). PNDA experiments can be used to generate nuclear data validation benchmarks quickly and cheaply, as they do not require fissile material or a nuclear facility to conduct them.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Raw tensiometer soil matric potential data, from Oct 2017-Jun 2020 in Manaus, Brazil

This data package contains raw output from two Campbell Scientific CR1000 data loggers each connected to three UMS T4e tensiometer sensors in Manaus, Brazil. Tensiometers at each data logger location were installed to depths of 10 cm, 20 cm and 50 cm below the ground surface for the purpose of measuring soil matric potential at each depth. “Station 3” tensiometers were installed at approximately 2°36'31.68"S, 60°12'34.70"W. “Station 4” tensiometers were installed at approximately 2°36'32.46"S, 60°12'34.92"W. The files “tensio3.edit.202109.csv” and “tensio4.edit.202109.csv” contain raw data (with invalid data removed). A text editor will be required to view the raw files in .csv (comma-separated values) format. Data processing was limited to: 1) Editing column headers for clarity; 2) Applying a correction that converts voltage read by the data loggers to pressure units (kPa); 3) removing all data greater than 50 kPa and less than -115 kPa; 4) Adding columns entitled “Caution.10cm”, “Caution.20cm” and “Caution.50cm” that contains values of either “NA” or “Caution”, the latter of which is applied when data exceeds the manufacturer reported data validity range of less than -85 kPa to suggest use of these data with caution; 5) Adding columns entitled “Invalid.10cm”, “Invalid.20cm”, and “Invalid.50cm” that contains values of either “NA” or “Invalid”, the latter of which is applied when data accuracy is deemed compromised due to the introduction of air bubbles into the instrument. Data marked “Invalid” may still indicate general trends of wet/high matric potential and dry/low matric potential, but values are inaccurate and dry/low matric potential values are likely not low enough. Wet/high matric potential values are likely to be more accurate than dry/low matric potential values; 6) Data format changed from .dat to .csv. This research was performed as a part of the NGEE Tropics project, which aims to advance model predictions of tropical forest carbon cycle responses to a changing climate over the 21st Century.

54 ENVIRONMENTAL SCIENCES↗

Evidence of Completion of Milestone 4: Simulation Testbed Validated with Experimental Data

Milestone 4 is given in the SOPO as being due in quarter 5 (ending 9/11/2020) and is described thus: Milestone 4: Enhanced Simulation Testbed Validated with Experimental Data (UM, Mathieu). Simulation testbed validated with data obtained from experimental testbed, specifically, nonlinear load behaviors and communication network issues observed in the experimental testbed will be modeled in the simulation testbed. The simulation testbed should accurately capture TCL real and reactive power consumption (including during extreme events associated with nonlinear behaviors and communication network failures) to within 5% RMSE error with respect to data obtained from the experimental testbed. The Tasks comprising the work to achieve Milestone 4 are outlined here.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Evidence of Completion of Milestone 4: Simulation Testbed Validated with Experimental Data

Milestone 4 is given in the SOPO as being due in quarter 5 (ending 9/11/2020) and is described thus: Milestone 4: Enhanced Simulation Testbed Validated with Experimental Data (UM, Mathieu) Simulation testbed validated with data obtained from experimental testbed, specifically, nonlinear load behaviors and communication network issues observed in the experimental testbed will be modeled in the simulation testbed. The simulation testbed should accurately capture TCL real and reactive power consumption (including during extreme events associated with nonlinear behaviors and communication network failures) to within 5% RMSE error with respect to data obtained from the experimental testbed.

99 GENERAL AND MISCELLANEOUS↗

A comparative analysis of green building rating systems in China and the United States

Several studies have compared green building rating systems (GBRSs) in China and the United States, Nonetheless, few studies included in-depth analysis on specific rating tools with project specific data validating green building technologies and actual performance. This study conducted a comprehensive data-driven comparison of the GBRSs of China and the United States. The goal was to understand the current status and further improve China's GBRS and promote green building technologies. The study first conducted thorough comparisons of GBRSs in China and the U.S. by selecting a series of distinct rating tools. Then, it analyzed each tool's development objectives, contents, and rating score settings. Further, the comparison concludes the future development needs for China's GBRS. In addition to standard comparison, green building technologies applied in certified projects were also summarized. The results demonstrated that GBRSs in both China and the U.S. reflect well the technical paths to achieve green building sustainable development. By analyzing certified projects, it was also found that the incremental costs of green building technologies were controllable. Finally, based on the comparison and case analysis, the study provide a set of policy recommendations to further improve China's green building standards.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

dlppi2 (b1)

The Doppler lidar (DL) is an active remote-sensing instrument that provides range- and time-resolved measurements of the line-of-sight component of air velocity (i.e., radial velocity) and attenuated aerosol backscatter. The DL operates in the near-infrared and is sensitive to backscatter from atmospheric aerosol, which are assumed to be ideal tracers of atmospheric wind fields. The DL works by transmitting short pulses of infrared laser light into the atmosphere. Atmospheric aerosols scatter a small fraction of that light energy back to the transceiver, where it is collected and recorded as a time-resolved signal. From the delay between the outgoing pulse and the backscattered signal, the instrument infers the distance to the scattering volume. Coherent detection is used to measure the Doppler frequency shift of the backscatter signal. This is accomplished by mixing the backscatter signal with a reference laser beam (i.e., local oscillator) of known frequency. The onboard signal processor then determines the Doppler frequency shift from the spectrum of the mixed signal. The Doppler frequency shift and thus the radial air velocity is determined from the peak of the Doppler spectrum. The attenuated backscatter is determined from the energy content of the Doppler spectra. The DL provides accurate measurements of radial velocity in regions of the atmosphere where aerosol concentrations are high enough to ensure good signal-to-noise ratio. Thus, valid data are usually limited to the atmospheric boundary layer where aerosol is ubiquitous. Valid measurements can also be obtained in elevated aerosol layers or in optically thin clouds above the boundary layer. Most of the ARM DLs have full upper-hemispheric scanning capability, enabling 3D mapping of turbulent flows in the atmospheric boundary layer. With the scanner pointed vertically, the DL provides height- and time-resolved measurements of vertical velocity.

54 ENVIRONMENTAL SCIENCES↗

Progress on Understanding Rayleigh–Taylor Flow and Mixing Using Synergy Between Simulation, Modeling, and Experiment

Simultaneous advances in numerical methods and computing, theoretical techniques, and experimental diagnostics have all led independently to better understanding of Rayleigh–Taylor (RT) instability, turbulence, and mixing. In particular, experiments have provided significant motivation for many simulation and modeling studies, as well as validation data. Numerical simulations have also provided data that is not currently measurable or very difficult to measure accurately in RT unstable flows. Thus, simulations have also motivated new measurements in this class of buoyancy-driven flows. This overview discusses simulation and modeling studies synergistic with experiments and examples of how experiments have motivated simulations and models of RT instability, flow, and mixing. First, a brief summary of measured experimental and calculated simulation quantities, of experimental approaches, and of issues and challenges in the simulation and modeling of RT experiments is presented. Implicit large-eddy, direct numerical, and large-eddy simulations validated using RT experimental data are then discussed. This is followed by a discussion of modeling using analytical, modal, buoyancy–drag, and turbulent transport models of RT mixing experiments. The discussion will focus on three-dimensional RT mixing arising from multimode perturbations. Finally, this focused review concludes with a perspective on future simulation, modeling, and experimental directions for further research. Research in simulation and modeling of RT unstable flows, coupled with experiments, has made significant progress over the past several decades. This overview serves as an opportunity to both discuss progress and to stimulate future research on simulation and modeling of this unique class of hydrodynamically unstable turbulent flows.

42 ENGINEERING↗

Nuclear Data Sensitivity/Uncertainty Studies of Tantalum-Reflected Systems

Tantalum (Ta) is a refractory metal with high melting point and high corrosion resistance. This makes it useful as a mold material for plutonium casting operations. Unfortunately, there are few criticality benchmarks with high nuclear data sensitivities. Given that, it is desirable to design new experiments to provide additional validation data for nuclear criticality safety, which is the objective of the Thales project. Multiple application models were used to represent process conditions (either normal conditions or credible upset conditions) both at Los Alamos National Laboratory (LANL) and Savannah River Site (SRS). A total of 40 application models were obtained. Given this, it was useful to down-select the number of needed application models. This work documents the down-selection based on several nuclear data sensitivity/uncertainty metrics. In addition to showing the result of the specific down-selection used for the Thales project, this work discusses potential ways to represent a large number of application models with a smaller number of proposed experiment designs.

42 ENGINEERING↗

HYBRID Modeling Validation and Verification Status Matrix

The HYBRID modeling repository is a premier resource for integrated energy systems modeling. HYBRID models have been developed since 2015 to describe the physical operation of tightly coupled thermal systems including power generators, thermal transport systems, thermal storage, thermal-to-electric conversion systems, and other thermal applications. Due to the increased size of the repository, a concise summary matrix of available models is desired. This matrix will consolidate not only the list of available models but also indicate original information sources, publications that have model examples, and level of validation and verification that exists for the models. Validation and verification (V&V) levels begin from simplified algebraic relationship and advance to dynamic data validation. Moving forward, as new models are contributed to HYBRID, their V&V level will be included, updating this matrix.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗