SEARCH · Engineering Papers

Results for “Cross-validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10

All sources NASA NTRS DOE OSTI

DOE OSTI2023

Partial Least Squares, Experimental Design, and Near-Infrared Spectrophotometry for the Remote Quantification of Nitric Acid Concentration and Temperature

Near-infrared spectrophotometry and partial least squares regression (PLSR) were evaluated to create a pleasantly simple yet effective approach for measuring HNO3 concentration with varying temperature levels. A training set, which covered HNO3 concentrations (0.1–8 M) and temperature (10–40 °C), was selected using a D-optimal design to minimize the number of samples required in the calibration set for PLSR analysis. The top D-optimal-selected PLSR models had root mean squared error of prediction values of 1.4% for HNO 3 and 4.0% for temperature. The PLSR models built from spectra collected on static samples were validated against flow tests including HNO 3 concentration and temperature gradients to test abnormal conditions (e.g., bubbles) and the model performance between sample points in the factor space. Based on cross-validation and prediction modeling statistics, the designed near-infrared absorption approach can provide remote, quantitative analysis of HNO 3 concentration and temperature for production-oriented applications in facilities where laser safety challenges would inhibit the implementation of other optical techniques (e.g., Raman spectroscopy) and in which space, time, and/or resources are constrained. The experimental design approach effectively minimized the number of samples in the training set and maintained or improved PLSR model performance, which makes the described chemometric approach more amenable to nuclear field applications.

07 ISOTOPE AND RADIATION SOURCES↗

DOE OSTI2021

Summertime Continental Shallow Cumulus Cloud Detection Using GOES-16 Satellite and Ground-Based Stereo Cameras at the DOE ARM Southern Great Plains Site

Summertime continental shallow cumulus clouds (ShCu) are detected using Geostationary Operational Environmental Satellite (GOES)-16 reflectance data, with cross-validation by observations from ground-based stereo cameras at the Department of Energy Atmospheric Radiation Measurement Southern Great Plains site. A ShCu cloudy pixel is identified when the GOES reflectance exceeds the clear-sky surface reflectance by a reflectance detection threshold of ShCu, ΔR. We firstly construct diurnally varying clear-sky surface reflectance maps and then estimate the ΔR. A GOES simulator is designed, projecting the clouds reconstructed by stereo cameras towards the surface along the satellite’s slanted viewing direction. The dynamic ShCu detection threshold ΔR is determined by making the GOES cloud fraction (CF) equal to the CF from the GOES simulator. Although there are temporal variabilities in ΔR, cloud fractions and cloud size distributions can be well reproduced using a constant ΔR value of 0.045. The method presented in this study enables daytime ShCu detection, which is usually falsely reported as clear sky in the GOES-16 cloud mask data product. Using this method, a new ShCu dataset can be generated to bridge the observational gap in detecting ShCu, which may transition into deep precipitating clouds, and to facilitate further studies on ShCu development over heterogenous land surface.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2022

Factors Controlling a Synthetic Aperture Radar (SAR) Derived Root-Zone Soil Moisture Product over The Seward Peninsula of Alaska

Root-zone soil moisture exerts a fundamental control on vegetation, energy balance, and the carbon cycle in Arctic ecosystems, but it is still not well understood in vast, remote, and understudied regions of discontinuous permafrost. The root-zone soil moisture product (30 m resolution) used in this analysis was retrieved from a time-series P-Band (420–440 MHz) synthetic aperture radar (SAR) backscatter observations (August 2017 & October 2017). While similar approaches have been taken to retrieve surface (0 cm to 5 cm) soil moisture from L-Band (1.2 GHz) SAR backscatter, this is one of the first known attempts at reaching the root-zone in permafrost regions. Here, we analyze secondary factors (excluding primary factors, such as precipitation) controlling summer (August) soil moisture at depths of 6 cm, 12 cm, and 20 cm over a 4500 km2 area on the Seward Peninsula of Alaska. Using a random forest model, we quantify the impact of topography, vegetation, and meteorological factors on soil moisture distributions. In developing the random forest model, we explore a variety of feature scales (30 m, 60 m, 90 m, 120 m, 180 m, and 240 m), tune hyperparameters (the structure of individual decision trees making up the ensemble including the number and depth of trees), and perform the final feature selection using cross-validated recursive feature elimination. Results suggest that root-zone soil moisture on the Seward Peninsula is primarily controlled by vegetation at 6 cm, but deeper in the soil column topography and meteorological factors, such as predominant winter wind direction and summer insolation, play a larger role. The random forest model accounts for 40% to 60% of the variation observed (R2 = 0.44 at 6 cm, R2 = 0.52 at 12 cm, R2 = 0.58 at 20 cm). These results indicate that vegetation is the dominant control on soil moisture shallow in the soil column, but the impact of vegetation does not extend to deeper layers retrieved from P-Band SAR backscatter.

Dann, Julian↗

DOE OSTI2023

Di-CNN: Domain-Knowledge-Informed Convolutional Neural Network for Manufacturing Quality Prediction

In manufacturing, convolutional neural networks (CNNs) are widely used on image sensor data for data-driven process monitoring and quality prediction. However, as purely data-driven models, CNNs do not integrate physical measures or practical considerations into the model structure or training procedure. Consequently, CNNs’ prediction accuracy can be limited, and model outputs may be hard to interpret practically. This study aims to leverage manufacturing domain knowledge to improve the accuracy and interpretability of CNNs in quality prediction. A novel CNN model, named Di-CNN, was developed that learns from both design-stage information (such as working condition and operational mode) and real-time sensor data, and adaptively weighs these data sources during model training. It exploits domain knowledge to guide model training, thus improving prediction accuracy and model interpretability. A case study on resistance spot welding, a popular lightweight metal-joining process for automotive manufacturing, compared the performance of (1) a Di-CNN with adaptive weights (the proposed model), (2) a Di-CNN without adaptive weights, and (3) a conventional CNN. The quality prediction results were measured with the mean squared error (MSE) over sixfold cross-validation. Model (1) achieved a mean MSE of 6.8866 and a median MSE of 6.1916, Model (2) achieved 13.6171 and 13.1343, and Model (3) achieved 27.2935 and 25.6117, demonstrating the superior performance of the proposed model.

47 OTHER INSTRUMENTATION↗

DOE OSTI2022

In Silico Prediction of the Toxicity of Nitroaromatic Compounds: Application of Ensemble Learning QSAR Approach

In this work, a dataset of more than 200 nitroaromatic compounds is used to develop Quantitative Structure–Activity Relationship (QSAR) models for the estimation of in vivo toxicity based on 50% lethal dose to rats (LD 50 ). An initial set of 4885 molecular descriptors was generated and applied to build Support Vector Regression (SVR) models. The best two SVR models, SVR_A and SVR_B, were selected to build an Ensemble Model by means of Multiple Linear Regression (MLR). The obtained Ensemble Model showed improved performance over the base SVR models in the training set (R 2 = 0.88), validation set (R 2 = 0.95), and true external test set (R 2 = 0.92). The models were also internally validated by 5-fold cross-validation and Y-scrambling experiments, showing that the models have high levels of goodness-of-fit, robustness and predictivity. The contribution of descriptors to the toxicity in the models was assessed using the Accumulated Local Effect (ALE) technique. The proposed approach provides an important tool to assess toxicity of nitroaromatic compounds, based on the ensemble QSAR model and the structural relationship to toxicity by analyzed contribution of the involved descriptors.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2025

A Scalable Gaussian Process Approach to Shear Mapping with MuyGPs

Analysis of cosmic shear is an integral part of understanding structure growth across cosmic time, which in turn provides us with information about the nature of dark energy. Conventional methods generate shear maps from which we can infer the matter distribution in the universe. Current methods (e.g., Kaiser–Squires inversion) for generating these maps, however, are tricky to implement and can introduce bias. Recent alternatives construct a spatial process prior for the lensing potential, which allows for inference of the convergence and shear parameters given lensing shear measurements. Realizing these spatial processes, however, scales cubically in the number of observations—an unacceptable expense as near-term surveys expect billions of correlated measurements. Therefore, we present a linearly scaling shear map construction alternative using a scalable Gaussian process prior called MuyGPs. MuyGPs avoids cubic scaling by conditioning interpolation on only nearest neighbors and fits hyperparameters using batched leave-one-out cross-validation. This work is the first step toward a full, scalable mass mapping method. We work in a simplified regime where we validate our method by interpolating and analyzing maps given noisy point-estimate data from all three shear fields, taken from a suite of N -body ray-tracing simulations. We also show that we can perform these operations at the scale of billions of galaxies on high-performance computing platforms.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2025

Window observables for benchmarking parton distribution functions

Global analysis of collider and fixed-target experimental data and calculations from lattice quantum chromodynamics (QCD) are used to gain complementary information on the structure of hadrons. We propose novel ``window observables'' that allow for higher precision cross-validation between the different approaches, a critical step for studies that wish to combine the datasets. Global analyses are limited by the kinematic regions accessible to experiment, particularly in a range of Bjorken-x, and lattice QCD calculations also have limitations requiring extrapolations to obtain the parton distributions. We provide two different ``window observables'' that can be defined within a region of x where extrapolations and interpolations in global analyses remain reliable and where lattice QCD results retain sensitivity and precision.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

DOE OSTI2021

Revisiting matrix-based inversion of scanning mobility particle sizer (SMPS) and humidified tandem differential mobility analyzer (HTDMA) data

Abstract. Tikhonov regularization is a tool for reducing noise amplification during data inversion. This work introduces RegularizationTools.jl, a general-purpose software package for applying Tikhonov regularization to data. The package implements well-established numerical algorithms and is suitable for systems of up to ∼ 1000 equations. Included is an abstraction to systematically categorize specific inversion configurations and their associated hyperparameters. A generic interface translates arbitrary linear forward models defined by a computer function into the corresponding design matrix. This obviates the need to explicitly write out and discretize the Fredholm integral equation, thus facilitating fast prototyping of new regularization schemes associated with measurement techniques. Example applications include the inversion involving data from scanning mobility particle sizers (SMPSs) and humidified tandem differential mobility analyzers (HTDMAs). Inversion of SMPS size distributions reported in this work builds upon the freely available software DifferentialMobilityAnalyzers.jl. The speed of inversion is improved by a factor of ∼ 200, now requiring between 2 and 5 ms per SMPS scan when using 120 size bins. Previously reported occasional failure to converge to a valid solution is reduced by switching from the L-curve method to generalized cross-validation as the metric to search for the optimal regularization parameter. Higher-order inversions resulting in smooth, denoised reconstructions of size distributions are now included in DifferentialMobilityAnalyzers.jl. This work also demonstrates that an SMPS-style matrix-based inversion can be applied to find the growth factor frequency distribution from raw HTDMA data while also accounting for multiply charged particles. The outcome of the aerosol-related inversion methods is showcased by inverting multi-week SMPS and HTDMA datasets from ground-based observations, including SMPS data obtained at Bodega Marine Laboratory during the CalWater 2/ACAPEX campaign and co-located SMPS and HTDMA data collected at the US Department of Energy observatory located at the Southern Great Plains site in Oklahoma, USA. Results show that the proposed approaches are suitable for unsupervised, nonparametric inversion of large-scale datasets as well as inversion in real time during data acquisition on low-cost reduced-instruction-set architectures used in single-board computers. The included software implementation of Tikhonov regularization is freely available, general, and domain-independent and thus can be applied to many other inverse problems arising in atmospheric measurement techniques and beyond.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2024

A robust approach to Gaussian process implementation

Abstract. Gaussian process (GP) regression is a flexible modeling technique used to predict outputs and to capture uncertainty in the predictions. However, the GP regression process becomes computationally intensive when the training spatial dataset has a large number of observations. To address this challenge, we introduce a scalable GP algorithm, termed MuyGPs, which incorporates nearest-neighbor and leave-one-out cross-validation during training. This approach enables the evaluation of large spatial datasets with state-of-the-art accuracy and speed in certain spatial problems. Despite these advantages, conventional quadratic loss functions used in the MuyGPs optimization, such as root mean squared error (RMSE), are highly influenced by outliers. We explore the behavior of MuyGPs in cases involving outlying observations and, subsequently, develop a robust approach to handle and mitigate their impact. Specifically, we introduce a novel leave-one-out loss function based on the pseudo-Huber function (LOOPH) that effectively accounts for outliers in large spatial datasets within the MuyGPs framework. Our simulation study shows that the LOOPH loss method maintains accuracy despite outlying observations, establishing MuyGPs as a powerful tool for mitigating unusual observation impacts in the large data regime. In the analysis of US ozone data, MuyGPs provides accurate predictions and uncertainty quantification, demonstrating its utility in managing data anomalies. Through these efforts, we advance the understanding of GP regression in spatial contexts.

Mukangango, Juliette↗

DOE OSTI2022

A graph neural network (GNN) approach to basin-scale river network learning: the role of physics-based connectivity and data fusion

Abstract. Rivers and river habitats around the world are under sustained pressure from human activities and the changing global environment. Our ability to quantify and manage the river states in a timely manner is critical for protecting the public safety and natural resources. In recent years, vector-based river network models have enabled modeling of large river basins at increasingly fine resolutions, but are computationally demanding. This work presents a multistage, physics-guided, graph neural network (GNN) approach for basin-scale river network learning and streamflow forecasting. During training, we train a GNN model to approximate outputs of a high-resolution vector-based river network model; we then fine-tune the pretrained GNN model with streamflow observations. We further apply a graph-based, data-fusion step to correct prediction biases. The GNN-based framework is first demonstrated over a snow-dominated watershed in the western United States. A series of experiments are performed to test different training and imputation strategies. Results show that the trained GNN model can effectively serve as a surrogate of the process-based model with high accuracy, with median Kling–Gupta efficiency (KGE) greater than 0.97. Application of the graph-based data fusion further reduces mismatch between the GNN model and observations, with as much as 50 % KGE improvement over some cross-validation gages. To improve scalability, a graph-coarsening procedure is introduced and is demonstrated over a much larger basin. Results show that graph coarsening achieves comparable prediction skills at only a fraction of training cost, thus providing important insights into the degree of physical realism needed for developing large-scale GNN-based river network models.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2023

Using light and X-ray scattering to untangle complex neuronal orientations and validate diffusion MRI

Disentangling human brain connectivity requires an accurate description of nerve fiber trajectories, unveiled via detailed mapping of axonal orientations. However, this is challenging because axons can cross one another on a micrometer scale. Diffusion magnetic resonance imaging (dMRI) can be used to infer axonal connectivity because it is sensitive to axonal alignment, but it has limited spatial resolution and specificity. Scattered light imaging (SLI) and small-angle X-ray scattering (SAXS) reveal axonal orientations with microscopic resolution and high specificity, respectively. Here, we apply both scattering techniques on the same samples and cross-validate them, laying the groundwork for ground-truth axonal orientation imaging and validating dMRI. We evaluate brain regions that include unidirectional and crossing fibers in human and vervet monkey brain sections. SLI and SAXS quantitatively agree regarding in-plane fiber orientations including crossings, while dMRI agrees in the majority of voxels with small discrepancies. We further use SAXS and dMRI to confirm theoretical predictions regarding SLI determination of through-plane fiber orientations. Scattered light and X-ray imaging can provide quantitative micrometer 3D fiber orientations with high resolution and specificity, facilitating detailed investigations of complex fiber architecture in the animal and human brain.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2021

Nuclear Power Fault Diagnostics and Preventative Maintenance Optimization

The nuclear industry is beginning to see reactors shut down—even after their operating licenses have been extended—because they are not economically competitive with other energy sources. These early closures happen primarily due to economic reasons, despite excellent safety records. Therefore, it is imperative to reduce costs in order to prevent these early closures. One of the contributors to these economic reasons is the large operations and maintenance costs. This paper showcases recent research on advanced fault diagnostics techniques and preventative maintenance optimization (PMO) for reducing NPP maintenance costs. Specifically, it focuses on the feedwater and condensate system (FWCS) for both pressurized- and boiling-water reactor (BWR) systems. The computerized maintenance management system (CMMS), which contains the plant’s digital record of all corrective maintenance (CM) and preventative maintenance (PM) work orders, provided the ground truth for locating potential faults and labeling the process data as either healthy or faulted. Various feature extraction techniques were used to further differentiate the faulted data from the healthy data. Through a cross-validation procedure, support vectors machines were used to label other test sets of process data as either healthy or faulted. With relatively few faults identified in the BWR system, the potential for PMO opens up, since an unnecessary amount of PM leads to inflated maintenance costs. The steps for PMO are summarized, from component health determinations to recommendations for action. An example of PMO assessment is presented for condensate pumps, condensate booster pumps, and the respective motors that drive them.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

DOE OSTI2021

Nuclear Power Fault Diagnostics and Preventative Maintenance Optimization NPIC presentation

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

DOE OSTI2021

Automated Parameterized CFD Simulations of Phase-Change Material Embedded Heat Exchangers

Thermal storage can be implemented using Phase-Change Materials (PCM), which absorb significant latent heat with a relatively small temperature change. PCM phase-change processes are transient and are driven by thermal diffusion and natural convection – the latter, especially for melting process. Modeling and simulation of PCM heat exchangers is typically computationally intensive due to the relative complex time-dependent underlying physics. This paper presents a study investigating a single straight tube with circular transverse fins in the vertical orientation, using PCM’s with 37oC nominal melting temperature, leveraging automated parametric CFD simulations. The computational domain is reduced to 2D axisymmetric for a segment of the HX comprising a region in between two fins with constant wall temperature as boundary condition. This approach allows for faster evaluations of the transient thermal characteristics for a given design space of interest. Correlations and reduced order models (ROM’s) are developed. Results indicate that the ROM’s reproduce the CFD simulations with high accuracy for designs from the training data set, however, designs from cross-validation and test sets do not always have good agreement. The limited number of designs in the training set is a possible cause for the lack of robustness of the ROM’s and thus additional training designs will be added in future work. The ROM’s solve the simulations on average 500,000 times faster than CFD.

25 ENERGY STORAGE↗

DOE OSTI2021

Detection, monitoring, and determination of location of changes in metallic structures using multimode acoustic signals

Acoustic transducers generate and receive acoustic signals at multiple locations along a surface of rigid structure, wherein longitudinal spacing between transducer locations define measurement zones. Acoustic signals with chosen amplitude-time-frequency characteristics excite multiple vibration modes in the structure within each zone. Small mechanical changes in inspection zones lead to scattering and attenuation of broadband acoustic signals, which are detectable as changes in received signal characteristics as part of a through-transmission technique. Additional use of short, narrowband pulse acoustic signals as part of a pulse-echo technique allows determination of the relative location of the mechanical change within each zone based on the differential delay profiles. For accurate acoustic modeling and simulation, the mesh size, time step, time delay, and time-window size are optimized. Frequency normalization of the Short-Time Fourier Transform of acoustic response output improves experiment-simulation cross-validation. Applications of the method to structures with arbitrarily complex geometries are also demonstrated.

Findikoglu, Alp Tugrul↗

DOE OSTI2022

Spatiotemporal Modeling of Real World Backsheets Field Survey Data: Hierarchical (Multilevel) Generalized Additive Models: Preprint

Assessing photovoltaic module backsheet durability is critical to increasing module lifetime. Lab based accelerating testing has recently failed to predict large scale failures of widely adopted polymeric materials. Field surveyed data is critical to assess the performance of component lifetime. Using a documented field survey protocol, 13 field surveys where conducted. Each measurement is encoded with it's spatial location in respect to the other modules. By combining field survey data on degradation predictors with real time satellite weather data, data-driven predictive models of backsheet degradation were trained. LOESS models were constructed to investigate the spatial dependence of measurements. It was found that micro-climatic effects like treelines, ground surface changes, and elevation changes effected the magnitude and variance of the measurements. A GAM model was created to predict the value of degradation based on measured predictors. The model includes variables on the climate of the system and the location of each measurement in the PV mounting structure. The model performed well with an adj:R2 of 0:95 for yellowness index prediction. The model was cross-validated using k-folds.

backsheet↗

DOE OSTI2022

Reduced Order Models Generation for HTGRs Pebble Shuffling Procedure Optimization Studies

This report provides an initial study for producing reduced-order models (ROMs) of pebble-bed high temperature gas reactor (HTGR) models for the purposes of design optimization. As an initial study, this work is meant to be exploratory---identifying useful workflows and methods for ROM generation---and not meant to be a catch-all analysis of HTGR ROM generation and usage for optimization. This report summarizes three tasks performed in Fiscal Year 2022: 1) the creation of HTGR model, 2) the sensitivity analysis of model design parameters, and 3) an introduction to ROM generation techniques. The representative HTGR model created in this work is a multiphysics equilibrium-core using the BlueCRAB (comprehensive reactor analysis bundle) reactor analysis application, coupling four physical phenomena: neutronics, streamline depletion, porous flow thermal hydraulics, and pebble heat conduction. Part of the model creation was identifying some design parameters and quantities of interest that are relevant in an optimization analysis and adjustable in the model. The sensitivity analysis utilized a polynomial chaos expansion methodology to compute global sensitivity metrics. This analysis showed that thermal hydraulics parameters and quantities of interest had a relatively small impact on simulation results. Finally, the ROM generation work involved exploring three different ROM methodologies: polynomial regression, a Gaussian process, and artificial neural networks. Using a cross-validation technique to characterize ROM performance, the Gaussian process and single-layer artificial neural networks showed the most promising results. Overall, this study was insightful and the lessons learned will be invaluable for the eventual development of an HTGR design optimization workflow.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2022

Decoding Golden Eagle Movement Behavior from High-Resolution, Variable-Rate Telemetry Data Through Bayesian Filtering

The recent advances in animal tracking technology have enabled the collection of a vast amount of in situ data regarding the movement of wildlife at high spatiotemporal resolution. These data are usually available at variable time resolutions and contains noise (error) originating from GPS fixes. Decoding movement characteristics, particularly of flying animals, from telemetry data while handling these factors is a challenging yet important task for conservation purposes. Typically, this task is broken into two subtasks: resampling, and model calibration. The resampling subtask converts the variable rate positional data into a constant time interval data, while the model calibration subtask uses the resampled data to tune time-invariant parameters of the proposed models. For telemetry data at high temporal resolutions (order of 1 second), it is very challenging to decouple noise from actual movements using interpolation-based resampling techniques. Any errors introduced during resampling can significantly alter the the calibration and prediction attributes of the movement model. We address this problem through a unified Bayesian state-space framework that can handle both the resampling and calibration tasks in a single step. In addition, we use the speed and heading of the bird from telemetry data to regularize the position information of the bird. We use a Kalman filtering approach to include these nonlinearly related motion parameters within the state space framework. We cross-validated to quantify how this inclusion affects the model performance in estimating true bird movements. The relationship between the true state of the bird and environmental and topographical covariates is then represented parametrically. These parameters are then tuned using stochastic sampling strategies like Markov Chain Monte Carlo (MCMC). We use the telemetry data collected from golden eagles in the western USA to demonstrate the applicability of this approach to build a predictive, probabilistic movement model. Our preliminary results show that this approach provides improved predictive performance in terms of capturing higher-order motion parameters such as angular and horizontal accelerations, which may have simpler and more direct relationships with environmental covariates than corresponding speeds. In this talk, we will demonstrate how this state-space approach benefits the prediction capabilities of a movement model in simulating golden eagle paths through a wind power plant in Wyoming given certain atmospheric conditions. The model outcomes are aimed at informing mitigation strategies that can minimize the potential for collisions of golden eagles with wind turbines.

Bayesian methods↗