Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 739 records · Page 41

Performance Comparison of Clipping Detection Techniques in AC Power Time Series

In this research, a variety of methods were developed to detect clipping periods in AC power time series. AC power data streams associated with 36 unique systems across the United States were collected, and data points representing clipping periods were manually labeled by experts. Using this data set for training and validation, novel logic-based and machine learning (ML) approaches were developed to classify time series values as clipping or non-clipping. These approaches were compared to the RdTools method for detecting clipping periods. The logic-based and ML XGBoost approaches achieved F-scores of 85.0 and 77.6, respectively, when cross-validated against the manually labeled data, as compared to the current RdTools approach (F-score of 56.4), indicating a significant improvement at detecting clipping periods. Additionally, the effects of each clipping filter when evaluating system degradation rates were assessed, using 31 unique systems across the United States. Results indicate that estimated system degradation rate can vary based on the type of clipping filter used, by up to 0.6% degradation rate for some cases.

clipping↗

Identifying Controlling Variables for Mercury Vapors in Alpha-4 at Y-12: Two Year Data Collection Update

Multiple sensor packages were deployed at Alpha-4 by SRNL, in collaboration with United Cleanup Oak Ridge LLC (UCOR), to monitor mercury vapor concentrations and meteorological parameters. These sensors collected data, inside and outside of the legacy-use facility, for approximately two years. Though data gaps still exist, particularly in colder months, several controlling variables were identified that govern mercury vapor concentrations within Alpha-4. Temperature, barometric pressure gradients, humidity, and wind speed have been identified as controlling variables. A strong positive correlation was seen between mercury vapor concentrations and temperature which generally followed diurnal fluctuations. Temperatures below approximately 10 degrees Celsius did not show any spikes above the PEL, indicating more work can be performed at any time during the winter months – more data should be collected to confirm consistency in this finding. Additionally, spikes in mercury vapor concentrations above that of the permissible exposure limit (PEL; 100 µg/m 3 ) occurred primarily in late afternoon or evening/overnight hours (between 3 PM and 6 AM), which suggests D&D operations might be best scheduled during morning or daytime hours prior to the late afternoon. However, a limited number of spikes did occur outside of the identified window, although this may be attributed to disturbances in air flow and mercury vapor release from work activities performed inside of the Alpha-4 building. The analysis conducted allows for a strong predictive capability for estimating mercury vapor concentrations based upon accurate meteorological parameters. Still, additional data collection, particularly in the winter months, could help to strengthen the predictive power and validate the identified data trends. Further, increased temporal resolution could also help to better characterize the incipient stages of the increases and decreases in the mercury vapor concentration. Continued monitoring support by SRNL at Y-12 is underway at Alpha-4 to further close remaining data gaps and support deactivation and decommissioning work. Within a collaborative effort with UCOR, the SRNL team is collecting mercury vapor data to study the efficacy of a novel mercury suppressant, FerroBlack® which was recently deployed at Alpha-4. In addition, modifications to the current monitoring setup to increase measurement resolution is also being investigated.

54 ENVIRONMENTAL SCIENCES↗

Predicting Building Envelope Construction from In-Situ Thermal Testing

When embarking on a retrofit of a building envelope, it is critical to understand the composition of its assembly. This practice is currently done by destructive and invasive material testing or demolition, which is sometimes not possible when in historic or protected buildings. To address this problem, in-situ thermal testing can be utilized along with machine learning classification algorithms to infer the composition of an assembly. In this paper, a proof-of-concept K-nearest neighbors classification model is developed to classify assembly composition from effective thermal resistance, effective thermal mass, and assembly cladding. This model was trained and tested utilizing a synthetic dataset producing an F1-score of 94.6%. This model was also validated with experimental data from a 100-year old wall assembly, confirming the model’s real-world validity. The paper presents a framework for inferring as-built envelope assemblies, all without having to damage or disturb the building and its occupants.

Pilet, Tyler J.↗

Ideas and perspectives: Enhancing research and monitoring of carbon pools and land-to-atmosphere greenhouse gases exchange in developing countries

Carbon (C) and greenhouse gas (GHG) research has traditionally required data collection and analysis using advanced and often expensive instruments, complex and proprietary software, and highly specialized research technicians. Partly as a result, relatively little C and GHG research has been conducted in resource-constrained developing countries. At the same time, these are often the same countries and regions in which climate change impacts will likely be strongest and in which major science uncertainties are centered, given the importance of dryland and tropical systems to the global C cycle. Increasingly, scientific communities have adopted appropriate technology and approach (AT&A) for C and GHG research, which focuses on low-cost and low-technology instruments, open-source software and data, and participatory and networking-based research approaches. Adopting AT&A can mean acquiring data with fewer technical constraints and lower economic burden and is thus a strategy for enhancing C and GHG research in developing countries. However, AT&A can have higher uncertainties; these can often be mitigated by carefully designing experiments, providing clear protocols for data collection, and monitoring and validating the quality of obtained data. For implementing this approach in developing countries, it is first necessary to recognize the scientific and moral importance of AT&A. At the same time, new AT&A techniques should be identified and further developed. All these processes should be promoted in collaboration with local researchers and through training local staff and encouraged for wide use and further innovation in developing countries.

Kim, Dong-Gill↗

Ambient-Frequency-Data Based System-Level Inertia Estimation Using Physical Equation and its Practice on Hawaii Islands

Here, in this paper, a practical ambient-frequency-data-based inertia estimation method using a physical equation is proposed and validated by real measurement data from Hawaii island grids. With high renewable penetration, accurate inertia estimation is important and urgent. Ambient frequency oscillation always exists in power grids, so the proposed method has advantages of real-time inertia estimation and no need for additional disturbances. This paper first developed the physical equation for inertia estimation to offer a clear mechanism for easy implementation in practice. To apply the proposed method in actual grids, a practical method to extract the ambient frequency oscillation from frequency measurement is further proposed. The inertia estimation using the physical equation is validated by KIUC simulation data and HECO field data, in which error rates are around 2% and 8%, respectively. Practical inertia estimation is challenging due to the large amounts of resources contributing to the power grid's effective inertia, but the method provided in this paper can offer a novel way for practical inertia estimation, which can help renewable penetration to boost carbon-free grid.

14 SOLAR ENERGY↗

The DECADE cosmic shear project III: validation of analysis pipeline using spatially inhomogeneous data

We present the pipeline for the cosmic shear analysis of the Dark Energy Camera All Data Everywhere (DECADE) weak lensing dataset: a catalog consisting of 107 million galaxies observed by the Dark Energy Camera (DECam) in the northern Galactic cap. The catalog derives from a large number of disparate observing programs and is therefore more inhomogeneous across the sky compared to existing lensing surveys. First, we use simulated data-vectors to show the sensitivity of our constraints to different analysis choices in our inference pipeline, including sensitivity to residual systematics. Next we use simulations to validate our covariance modeling for inhomogeneous datasets. Finally, we show that our choices in the end-to-end cosmic shear pipeline are robust against inhomogeneities in the survey, by extracting relative shifts in the cosmology constraints across different subsets of the footprint/catalog and showing they are all consistent within 1σ to 2σ. This is done for forty-six subsets of the data and is carried out in a fully consistent manner: for each subset of the data, we re-derive the photometric redshift estimates, shear calibrations, survey transfer functions, the data vector, measurement covariance, and finally, the cosmological constraints. Our results show that existing analysis methods for weak lensing cosmology can be fairly resilient towards inhomogeneous datasets. This also motivates exploring a wider range of image data for pursuing such cosmological constraints.

79 ASTRONOMY AND ASTROPHYSICS↗

Development of HELIOS/BIPR/PARCS/MCNP6 Computation Route for WWER RPV Neutron Fluence Analysis and Validation Against Ex-Vessel Detector Measurement Data

Here, a computational route was developed for precise calculation of fast neutron fluence on a WWER-type reactor pressure vessel (RPV). The method is based on the transfer of neutronics data from HELIOS-2 lattice calculations and nodal diffusion neutronics data (power, density, and temperature) from BIPR7.1 and PARCS 3.36/PATHS core calculations into a three-dimensional (pinwise axially distributed) fixed neutron source for modeling of transport of fast neutrons from the reactor core to the outer surface of the RPV using MCNP6.2. Validation of the proposed computational method was carried out based on comparative analysis of MCNP6.2-predicted and neutron dosimetry–measured reaction rates [ 54 Fe(n,p) 54 Мn, 93 Nb(n,n') 93 mNb, and 58 Ni(n,р) 58 Со] on the outer surface of the Armenian Nuclear Power Plant (ANPP) Unit 2 RPV. Validation revealed that the MCNP6.2-predicted fast neutron fluence results are very sensitive to the ENDF-B neutron data. Particularly, MCNP6.2 with ENDF/B-VIII.0 significantly underpredicts (20% to 30%) fast neutron fluence while using ENDF/B-VII.1 data overpredicts it. Adding revised beta-released evaluations of 54 Fe, 56 Fe, 57 Fe, and 16 O from the International Nuclear Data Evaluation Network (INDEN) to ENDF/B-VIII.0 allows one to obtain reasonable agreement with measurement results for all types of measured reaction rates.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Modeling Air Handling Units to Create a Diverse Fault Dataset for FDD Innovation: Lessons Learned and Recommendations

As energy management and information systems (e.g., automated fault detection and diagnostics [AFDD] tools) become more prevalent in the commercial building stock, it is important to determine the effectiveness of these technologies by benchmarking their performance. The authors have been working to develop the largest publicly available dataset of HVAC fault datasets for performance benchmarking applications, covering the most common HVAC systems and designs including chiller plants, rooftop packaged units, dual duct air handling unit and single duct air handling units. This study covers the development, modeling, and validation of a synthetic fault dataset for the air handling unit (AHU), one of the most common HVAC configurations found in the commercial building stock. Despite this being a common system, real-world time series data are scarce and usually do not span a wide range of weather conditions. Due to this limitation, two detailed AHU models, which included the single duct AHU and dual duct AHU developed in the Modelica language and HVACSIM+ were employed to carry out annual simulations of numerous common sensor faults, mechanical faults, and control sequence faults. The fault inclusive data were then validated by comparing fault effects on system performance to expected symptoms. We summarize the nature of each fault and their impacts under different weather and operation conditions. We report some lessons learnt during the efforts of validating the high volumes of the FDD data sets. Finally, we highlight considerations for FDD developers that may want to use this dataset to assess their algorithms’ performance and their improvement over time.

Casillas, Armando↗

Sockeye Validation Support Using the SPHERE Facility

The engineering-scale heat pipe application Sockeye, being developed through the Nuclear En- ergy Advanced Modeling and Simulation program is concurrently undergoing code development and verification and validation activities. The Single Primary Heat Extraction and Removal Emu- lator (SPHERE) facility at Idaho National Laboratory has performed numerous sodium heat pipe experiments, one of which is modeled in this work to support Sockeye validation. Heat pipe data produced by the SPHERE facility was found to be very useful not only for Sockeye validation but also as a useful resource for model development. A Sockeye simulation performed using Sockeye’s conduction model modeled an experimental run at SPHERE and was found to be able to accurately reproduce the steady temperature distribution but revealed discrepancies in transient behavior after shutoff of the power. This effort also revealed a number of challenges of modeling an experimental setup such as SPHERE, for example, the importance of details in the setup such as possible gaps in insulation. Also, continuous collaboration between Sockeye developers and SPHERE experimentalists has been established, which allows future experiments to be refined in response to questions and challenges found by simulating earlier experiments.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

A Review of TSUNAMI Applications

The TSUNAMI-1D and TSUNAMI-3D sequences for generating k eff sensitivity coefficients were first released in SCALE 5 in 2004. Several other tools were introduced in the same release, including primarily the TSUNAMI-IP code for uncertainty analysis and similarity assessments. The TSUNAMI sequences added capabilities for identifying important reactions and data for systems using sensitivity coefficients and also introduced new quantitative tools for rigorously assessing the similarity of systems. Over time, the capabilities of these tools have grown, and their use has expanded into other areas such as nuclear data assessment and nuclear covariance data testing. This paper discusses applications of the TSUNAMI tools for sensitivity calculations, sensitivity/uncertainty (S/U)-based validation, and nuclear data testing. This paper is one of a series of papers at this conference on the development and use of TSUNAMI tools. The other papers address the development of the TSUNAMI methods and the use of TSUNAMI for critical experiment design and optimization.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

MOSCATO Development and Integration in Fiscal Year 2024

MOSCATO (Molten Salt Chemistry and Transport) is a multiphysics code that provides high-fidelity, coupled simulations of fluid flow, heat transfer, mass transfer, chemistry, electrochemical phenomena, and alloy evolution for molten salt equipment. In FY24, significant developments were made to the code package, enhancing its capabilities in many aspects. The improvements and advancements can be summarized as follows: 1. Implementation of tritium transport capabilities and validation with experimental data: To enable modeling of tritium and other fission gases within MSRs, we implemented gas transport within MOSCATO via inclusion of couple mass transport equations within the salt and structural alloys. Comparisons to experimental data from literature showed good agreement with respect to tritium release rates. 2. Preliminary implementation of two-phase flow models in MOSCATO: To model tritium and other gases above their solubility limits, we implemented preliminary two-phase flow models within MOSCATO to account for bubble transport. The first model adopted was the Level-Set approach, which can handle the high void fraction regime, but with a requirement for high mesh resolution thus high computational expense. In this report, we present a verification of the Level-Set method using a simple benchmark case. We also performed a demonstration of the code as applied to an experimental case involving cover gas flow through salt in an experimental vessel. The second model adopted was the Eulerian-Eulerian dispersed flow model, which is computationally cheaper but limited to low void fraction regimes, such as bubbly flow. Validation and verification have not yet been performed for the Eulerian-Eulerian approach, but a preliminary implementation was completed. 3. Validation with static corrosion experiments: Static corrosion experimental data for stainless steel coupons within molten salts was used to further validate the corrosion model in MOSCATO. To do so, we leveraged the existing models in MOSCATO and simulated the sample mass loss and mass gain phenomena. Several ion species, including Cr 2+ , Fe 2+ and H + , were simulated in salt using the PNP solver, while Cr 0 and Fe 0 were simulated with a diffusion solver in stainless steel. The mass loss of the samples was compared with experimental data, and good agreement was achieved. These combined activities served to further expand the capabilities of MOSCATO and make it more generally applicable to the full range of phenomena that can control chemistry and corrosion in molten salt reactors.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

SCALE 6.3 Validation: Spent Nuclear Fuel

This report is the fifth volume in a series documenting the validation of SCALE 6.3 with ENDF/B-VII.1 libraries for nuclear criticality safety, reactor physics, radiation shielding, and spent nuclear fuel applications. This fifth volume, which focuses on validating SCALE capabilities that impact spent nuclear fuel applications, provides an update of the similar validation reported for SCALE 6.2.4. The experimental data used as basis for validation herein consist of measurement data for nuclide inventories and decay heat, including the following: 1. radiochemical assay (RCA) measurements of nuclides important to burnup credit, decay heat, and radiation shielding in 205 light-water reactor (LWR) spent nuclear fuel samples that cover burnups ranging up to 80 GWd/MTU and initial fuel enrichments up to 4.9% 235U; 2. full-assembly decay heat measurements for 236 LWR assemblies with initial fuel enrichments ranging up to 4% 235 U, assembly burnups of 5–51 GWd/MTU, and decay times after fuel discharge in the 2- to 27-year range (of importance to spent nuclear fuel storage, transportation, and disposal); and 3. pulse fission irradiations for fissionable materials at cooling times of interest to severe accident analyses (<10 5 s).

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Bifacial Vertical Testbed and Ground Irradiance Data in Golden, Colorado

This data was collected for Tonita et al., “Vertical bifacial photovoltaic system model validation: study with field data, various orientations, and latitudes,” for validation of optical models for vertically-oriented photovoltaics under high albedo. Ground irradiance data for vertical PV arrays modeling in agrivoltaics is also provided. The dataset is provided for further use or study as open source. For any questions on the dataset, email silvana.ovaitt@nlr.gov.

14 SOLAR ENERGY↗

CALPHAD Uncertainty Quantification and TDBX

CALPHAD uncertainty quantification (UQ) is the foundation of materials design with quantified confidence. We report a framework and software packages to enable CALPHAD UQ assessment and calculation using commercial CALPHAD software (Thermo-Calc). This Bayesian inference framework is coupled with a Markov chain Monte Carlo algorithm to establish uncertainty traces with a given thermodynamic database file (TDB) and corresponding experimental data points. This general framework is demonstrated with the Ni–Cr binary system. The algorithm is firstly validated on synthetic data with known ground truth. Then it is applied to real experimental data to generate posterior traces. We develop a file format named TDBX, which provides a single source of truth by combining the original TDB content and the traces for each assessed Gibbs energy parameter. CALPHAD UQ calculations are performed based on the TDBX file, from which uncertainties for phase boundaries, enthalpy curves, and solidification range are collected as examples of basic design parameters. This TDBX file with corresponding scripts are made open-source. Finally, the combination of CALPHAD UQ assessments and calculations connected by TDBX supports uncertainty-assisted modeling, enabling the integrated application of modern design with uncertainty methodologies to computational materials design.

36 MATERIALS SCIENCE↗

Three-dimensional full-field velocity measurements in shock compression experiments using stereo digital image correlation

Shock compression plate impact experiments conventionally rely on point-wise velocimetry measurements based on laser-based interferometric techniques. This study presents an experimental methodology to measure the free surface full-field particle velocity in shock compression experiments using high-speed imaging and three-dimensional (3D) digital image correlation (DIC). The experimental setup has a temporal resolution of 100 ns with a spatial resolution varying from 90 to 200 μm/pixel. Experiments were conducted under three different plate impact configurations to measure spatially resolved free surface velocity and validate the experimental technique. First, a normal impact experiment was conducted on polycarbonate to measure the macroscopic full-field normal free surface velocity. Second, an isentropic compression experiment on Y-cut quartz–tungsten carbide assembly is performed to measure the particle velocity for experiments involving ramp compression waves. To explore the capability of the technique in multiaxial loading conditions, a pressure shear plate impact experiment was conducted to measure both the normal and transverse free surface velocities under combined normal and shear loading. The velocities measured in the experiments using digital image correlation are validated against previous data obtained from laser interferometry. Numerical simulations were also performed using established material models to compare and validate the experimental velocity profiles for these different impact configurations. The novel ability of the employed experimental setup to measure full-field free surface velocities with high spatial resolutions in shock compression experiments is demonstrated for the first time in this work.

47 OTHER INSTRUMENTATION↗

Product Consistency Test Results for the HFG1 Glasses

The U.S. Department of Energy (DOE) is responsible for building the Hanford Tank Waste Treatment and Immobilization Plant (WTP) at the Hanford site in Washington to remediate 55 million gallons of radioactive waste that is temporarily stored in 177 underground tanks. The Office of River Protection (ORP) has requested that the Savannah River National Laboratory (SRNL) contribute in areas of recognized capabilities and expertise for glass waste form development to support successful startup of the WTP. As part of this effort, the Pacific Northwest National Laboratory (PNNL) is developing, batching, and fabricating simulated high-level waste (HLW) glasses to generate the associated property data needed to validate or identify areas of potential characterization improvement in the current glass property/composition models. Currently, the models cover only a small fraction of the waste compositions projected in the Hanford tank farm; therefore, the models must be expanded to include high fluoride compositions to successfully complete the WTP mission. SRNL support of this work is defined in the Task Technical and Quality Assurance Plan (TTQAP). This report provides the results of the Product Consistency Test (PCT) leachates from the High Fluoride Glasses-1 (HFG1), a series of simulated nuclear waste glasses fabricated at PNNL. The series included quenched (Q) and canister-centerline cooled (CCC) versions of the glasses. The glasses were selected as part of a broader study of the influence of glass composition on chemical durability, sulfur retention, and other properties. These data will be used to validate or identify areas of potential characterization improvements in the current glass property/composition models.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Validation of the Sentinel-5 Precursor TROPOMI cloud data with Cloudnet, Aura OMI O 2 –O 2 , MODIS, and Suomi-NPP VIIRS

Accurate knowledge of cloud properties is essential to the measurement of atmospheric composition from space. In this work we assess the quality of the cloud data from three Copernicus Sentinel-5 Precursor (S5P) TROPOMI cloud products: (i) S5P OCRA/ROCINN_CAL (Optical Cloud Recognition Algorithm/Retrieval of Cloud Information using Neural Networks;Clouds-As-Layers), (ii) S5P OCRA/ROCINN_CRB (Clouds-as-Reflecting Boundaries), and (iii) S5P FRESCO-S (Fast Retrieval Scheme for Clouds from Oxygen absorption bands – Sentinel). Target properties of this work are cloud-top height and cloud optical thickness (OCRA/ROCINN_CAL), cloud height (OCRA/ROCINN_CRB and FRESCO-S), and radiometric cloud fraction (all three algorithms). The analysis combines (i) the examination of cloud maps for artificial geographical patterns, (ii) the comparison to other satellite cloud data (MODIS, NPP-VIIRS, and OMI O2–O2), and (iii) ground-based validation with respect to correlative observations (30 April 2018 to 27 February 2020) from the Cloudnet network of ceilometers, lidars, and radars. Zonal mean latitudinal variation of S5P cloud properties is similar to that of other satellite data. S5P OCRA/ROCINN_CAL agrees well with NPP VIIRS cloud-top height and cloud optical thickness and with Cloudnet cloud-top height, especially for the low (mostly liquid) clouds. For the high clouds, S5P OCRA/ROCINN_CAL cloud-top height is below the cloud-top height of VIIRS and of Cloudnet, while its cloud optical thickness is higher than that of VIIRS. S5P OCRA/ROCINN_CRB and S5P FRESCO cloud height are well below the Cloudnet cloud mean height for the low clouds but match on average better with the Cloudnet cloud mean height for the higher clouds. As opposed to S5P OCRA/ROCINN_CRB and S5P FRESCO, S5P OCRA/ROCINN_CAL is well able to match the lowest CTH mode of the Cloudnet observations. Peculiar geographical patterns are identified in the cloud products and will be mitigated in future releases of the cloud data products.

54 ENVIRONMENTAL SCIENCES↗

A Summary of Validation Studies for the Integrated TIGER Series Performed on ACORN Plus-up 218468/99

The Integrated TIGER Series (ITS) transport code is a valuable tool for photon-electron transport. A seven-problem validation suite exists to make sure that the ITS transport code works as intended. It is important to ensure that data from benchmark problems is correctly compared to simulated data. Additionally, the validation suite did not previously make use of a consistent quantitative metric for comparing experimental and simulated datasets. To this end, the goal of this long-term project was to expand the validation suite both in problem type and in the quality of the error assessment. To accomplish that, the seven validation problems in the suite were examined for potential drawbacks. When a drawback was identified, the problems were ranked based on severity of the drawback and approachability of a solution. We determined that meaningful improvements could be made to the validation suite by improving the analysis for the Lockwood Albedo problem and by introducing the Ross dataset as an eighth problem to the suite. The Lockwood error analysis has been completed and will be integrated in the future. The Ross data is unfinished, but significant progress has been made towards analysis.

97 MATHEMATICS AND COMPUTING↗