SEARCH · Engineering Papers

Results for “training data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 757 records · Page 42

All sources NASA NTRS DOE OSTI

DOE OSTI2016

Statistical-learning strategies generate only modestly performing predictive models for urinary symptoms following external beam radiotherapy of the prostate: A comparison of conventional and machine-learning methods

Purpose: Given the paucity of available data concerning radiotherapy-induced urinary toxicity, it is important to ensure derivation of the most robust models with superior predictive performance. This work explores multiple statistical-learning strategies for prediction of urinary symptoms following external beam radiotherapy of the prostate. Methods: The performance of logistic regression, elastic-net, support-vector machine, random forest, neural network, and multivariate adaptive regression splines (MARS) to predict urinary symptoms was analyzed using data from 754 participants accrued by TROG03.04-RADAR. Predictive features included dose-surface data, comorbidities, and medication-intake. Four symptoms were analyzed: dysuria, haematuria, incontinence, and frequency, each with three definitions (grade ≥ 1, grade ≥ 2 and longitudinal) with event rate between 2.3% and 76.1%. Repeated cross-validations producing matched models were implemented. A synthetic minority oversampling technique was utilized in endpoints with rare events. Parameter optimization was performed on the training data. Area under the receiver operating characteristic curve (AUROC) was used to compare performance using sample size to detect differences of ≥0.05 at the 95% confidence level. Results: Logistic regression, elastic-net, random forest, MARS, and support-vector machine were the highest-performing statistical-learning strategies in 3, 3, 3, 2, and 1 endpoints, respectively. Logistic regression, MARS, elastic-net, random forest, neural network, and support-vector machine were the best, or were not significantly worse than the best, in 7, 7, 5, 5, 3, and 1 endpoints. The best-performing statistical model was for dysuria grade ≥ 1 with AUROC ± standard deviation of 0.649 ± 0.074 using MARS. For longitudinal frequency and dysuria grade ≥ 1, all strategies produced AUROC>0.6 while all haematuria endpoints and longitudinal incontinence models produced AUROC<0.6. Conclusions: Logistic regression and MARS were most likely to be the best-performing strategy for the prediction of urinary symptoms with elastic-net and random forest producing competitive results. The predictive power of the models was modest and endpoint-dependent. New features, including spatial dose maps, may be necessary to achieve better models.

60 APPLIED LIFE SCIENCES↗

NASA NTRS2000

BOREAS TE-18 Landsat TM Physical Classification Image of the NSA

The BOREAS TE-18 team focused its efforts on using remotely sensed data to characterize the successional and disturbance dynamics of the boreal forest for use in carbon modeling. The objective of this classification is to provide the BOREAS investigators with a data product that characterizes the land cover of the NSA. A Landsat-5 TM image from 21-Jun-1995 was used to derive the classification. A technique was implemented that uses reflectances of various land cover types along with a geometric optical canopy model to produce spectral trajectories. These trajectories are used in a way that is similar to training data to classify the image into the different land cover classes. The data are provided in a binary, image file format. The data files are available on a CD-ROM (see document number 20010000884), or from the Oak Ridge National Laboratory (ORNL) Distributed Active Archive Center (DAAC).

Hall, Forrest G.↗

DOE OSTI2023

Multifidelity Neural Network Formulations for Prediction of Reactive Molecular Potential Energy Surfaces

Here, this paper focuses on the development of multifidelity modeling approaches using neural network surrogates, where training data arising from multiple model forms and resolutions are integrated to predict high-fidelity response quantities of interest at lower cost. We focus on the context of quantum chemistry and the integration of information from multiple levels of theory. Important foundations include the use of symmetry function-based atomic energy vector constructions as feature vectors for representing structures across families of molecules and single-fidelity neural network training capabilities that learn the relationships needed to map feature vectors to potential energy predictions. These foundations are embedded within several multifidelity topologies that decompose the high-fidelity mapping into model-based components, including sequential formulations that admit a general nonlinear mapping across fidelities and discrepancy-based formulations that presume an additive decomposition. Methodologies are first explored and demonstrated on a pair of simple analytical test problems and then deployed for potential energy prediction for C 5 H 5 using B2PLYP-D3/6-311++G(d,p) for high-fidelity simulation data and Hartree–Fock 6-31G for low-fidelity data. For the common case of limited access to high-fidelity data, our computational results demonstrate that multifidelity neural network potential energy surface constructions achieve roughly an order of magnitude improvement, either in terms of test error reduction for equivalent total simulation cost or reduction in total cost for equivalent error.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2021

Optimizing a magnitude-limited spectroscopic training sample for photometric classification of supernovae

ABSTRACT In preparation for photometric classification of transients from the Legacy Survey of Space and Time (LSST) we run tests with different training data sets. Using estimates of the depth to which the 4-m Multi-Object Spectroscopic Telescope (4MOST) Time Domain Extragalactic Survey (TiDES) can classify transients, we simulate a magnitude-limited sample reaching rAB ≈ 22.5 mag. We run our simulations with the software snmachine, a photometric classification pipeline using machine learning. The machine-learning algorithms struggle to classify supernovae when the training sample is magnitude limited, in contrast to representative training samples. Classification performance noticeably improves when we combine the magnitude-limited training sample with a simulated realistic sample of faint high-redshift supernovae observed from larger spectroscopic facilities; the algorithms’ range of average area under receiver operator characteristic curve (AUC) scores over 10 runs increases from 0.547–0.628 to 0.946–0.969 and purity of the classified sample reaches 95 per cent in all runs for two of the four algorithms. By creating new, artificial light curves using the augmentation software avocado, we achieve a purity in our classified sample of 95 per cent in all 10 runs performed for all machine-learning algorithms considered. We also reach a highest average AUC score of 0.986 with the artificial neural network algorithm. Having ‘true’ faint supernovae to complement our magnitude-limited sample is a crucial requirement in optimization of a 4MOST spectroscopic sample. However, our results are a proof of concept that augmentation is also necessary to achieve the best classification results.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2022

Assessments of epistemic uncertainty using Gaussian stochastic weight averaging for fluid-flow regression

Here, we use Gaussian stochastic weight averaging (SWAG) to assess the epistemic uncertainty associated with neural-network-based function approximation relevant to fluid flows. SWAG approximates a posterior Gaussian distribution of each weight, given training data, and a constant learning rate. Having access to this distribution, it is able to create multiple models with various combinations of sampled weights, which can be used to obtain ensemble predictions. The average of such an ensemble can be regarded as the 'mean estimation', whereas its standard deviation can be used to construct 'confidence intervals', which enable us to perform uncertainty quantification (UQ) with regard to the training process of neural networks. We utilize representative neural-network-based function approximation tasks for the following cases: (i) a two-dimensional circular-cylinder wake; (ii) the DayMET dataset (maximum daily temperature in North America); (iii) a three-dimensional square-cylinder wake; and (iv) urban flow, to assess the generalizability of the present idea for a wide range of complex datasets. SWAG-based UQ can be applied regardless of the network architecture, and therefore, we demonstrate the applicability of the method for two types of neural networks: (i) global field reconstruction from sparse sensors by combining convolutional neural network (CNN) and multi-layer perceptron (MLP); and (ii) far-field state estimation from sectional data with two-dimensional CNN. We find that SWAG can obtain physically-interpretable confidence-interval estimates from the perspective of epistemic uncertainty. This capability supports its use for a wide range of problems in science and engineering.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2019

Radiomics-based prediction of microsatellite instability in colorectal cancer at initial computed tomography evaluation

Purpose: To predict microsatellite instability (MSI) status of colon cancer on preoperative CT imaging using radiomic analysis. Methods: This retrospective study involved radiomic analysis of preoperative CT imaging of patients who underwent resection of stage II–III colon cancer from 2004 to 2012. A radiologist blinded to MSI status manually segmented the tumor region on CT images. 254 Intensity-based radiomic features were extracted from the tumor region. Three prediction models were developed with (1) only clinical features, (2) only radiomic features, and (3) “combined” clinical and radiomic features. Patients were randomly separated into training (n = 139) and test (n = 59) sets. The model was constructed from training data only; the test set was reserved for validation only. Model performance was evaluated using AUC, sensitivity, specificity, PPV, and NPV. Results: Of the total 198 patients, 134 (68%) patients had microsatellite stable tumors and 64 (32%) patients had MSI tumors. The combined model performed slightly better than the other models, predicting MSI with an AUC of 0.80 for the training set and 0.79 for the test set (specificity = 96.8% and 92.5%, respectively), whereas the model with only clinical features achieved an AUC of 0.74 and the model with only radiomic features achieved an AUC of 0.76. The model with clinical features alone had the lowest specificity (70%) compared with the model with radiomic features alone (95%) and the combined model (92.5%). Conclusions: Preoperative prediction of MSI status via radiomic analysis of preoperative CT adds specificity to clinical assessment and could contribute to personalized treatment selection.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

DOE OSTI2025

Temporally-consistent koopman autoencoders for forecasting dynamical systems

Absence of sufficiently high-quality data often poses a key challenge in data-driven modeling of high-dimensional spatio-temporal dynamical systems. Koopman Autoencoders (KAEs) harness the expressivity of deep neural networks (DNNs), the dimension reduction capabilities of autoencoders, and the spectral properties of the Koopman operator to learn a reduced-order feature space with simpler, linear dynamics. However, the effectiveness of KAEs is hindered by limited and noisy training datasets, leading to poor generalizability. To address this, we introduce the Temporally-Consistent Koopman Autoencoder (tcKAE), designed to generate accurate long-term predictions even with limited and noisy training data. This is achieved through a consistency regularization term that enforces prediction coherence across different time steps, thus enhancing the robustness and generalizability of tcKAE over existing models. We provide analytical justification for this approach based on Koopman spectral theory and empirically demonstrate tcKAE’s superior performance over state-of-the-art KAE models across a variety of test cases, including simple pendulum oscillations, kinetic plasma, and fluid flow data.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

DOE OSTI2023

EXSCLAIM!: Harnessing materials science literature for self-labeled microscopy datasets

This work introduces the EXSCLAIM! toolkit for the automatic extraction, separation, and caption-based natural language annotation of images from scientific literature. EXSCLAIM! is used to show how rule-based natural language processing and image recognition can be leveraged to construct an electron microscopy data set containing thousands of keyword-annotated nanostructure images. Moreover, it is demonstrated how a combination of statistical topic modeling and semantic word similarity comparisons can be used to increase the number and variety of keyword annotations on top of the standard annotations from EXSCLAIM! With large-scale imaging datasets constructed from scientific literature, users are well positioned to train neural networks for classification and recognition tasks specific to microscopy-tasks often otherwise inhibited by a lack of sufficient annotated training data.

36 MATERIALS SCIENCE↗

DOE OSTI2025

Enhancing Drinking Water Quality Modeling: Leveraging Physics Informed Neural Networks for Learning with Imperfect Reaction Models and Partial Data

Chemical kinetics models, typically formulated as systems of ordinary or partial differential equations, are valuable tools for simulating drinking water quality. However, these models often face inaccuracies due to discrepancies between the laboratory and the real-world conditions, as well as limitations in experimental analytical methods, hindering the accurate representation of the true underlying chemical mechanisms. In this study, we propose a Physics Informed Neural Network (PINN), using the eXtreme Theory of Functional Connections, to improve the prediction of chemical concentrations over time. The PINN method accounts for imperfect chemical models and incorporates partial data to improve predictions. Focusing on reactions describing water disinfection residual and disinfectant byproduct formation, which are crucial for public health and regulatory compliance, we demonstrate that the PINN model is able to accurately predict the concentrations of chemical species across various pH values. Notably, the model extends its accuracy to predict concentrations of chemical species not originally included in its training data. The developed method can be extended to a variety of chemical systems, offering a wide array of potential applications.

13 HYDRO ENERGY↗

DOE OSTI2015

CLASSIFYING X-RAY BINARIES: A PROBABILISTIC APPROACH

In X-ray binary star systems consisting of a compact object that accretes material from an orbiting secondary star, there is no straightforward means to decide whether the compact object is a black hole or a neutron star. To assist in this process, we develop a Bayesian statistical model that makes use of the fact that X-ray binary systems appear to cluster based on their compact object type when viewed from a three-dimensional coordinate system derived from X-ray spectral data where the first coordinate is the ratio of counts in the mid- to low-energy band (color 1), the second coordinate is the ratio of counts in the high- to low-energy band (color 2), and the third coordinate is the sum of counts in all three bands. We use this model to estimate the probabilities of an X-ray binary system containing a black hole, non-pulsing neutron star, or pulsing neutron star. In particular, we utilize a latent variable model in which the latent variables follow a Gaussian process prior distribution, and hence we are able to induce the spatial correlation which we believe exists between systems of the same type. The utility of this approach is demonstrated by the accurate prediction of system types using Rossi X-ray Timing Explorer All Sky Monitor data, but it is not flawless. In particular, non-pulsing neutron systems containing “bursters” that are close to the boundary demarcating systems containing black holes tend to be classified as black hole systems. As a byproduct of our analyses, we provide the astronomer with the public R code which can be used to predict the compact object type of XRBs given training data.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2025

Non-intrusive reduced-order modeling for dynamical systems with spatially localized features

This work presents a non-intrusive reduced-order modeling framework for dynamical systems with spatially localized features characterized by slow singular value decay. The proposed approach builds upon two existing methodologies for reduced and full-order non-intrusive modeling, namely Operator Inference (OpInf) and sparse Full-Order Model (sFOM) inference. We decompose the domain into two complementary subdomains that exhibit fast and slow singular value decay. The dynamics of the subdomain exhibiting slow singular value decay are learned with sFOM while the dynamics with intrinsically low dimensionality on the complementary subdomain are learned with OpInf. The resulting, coupled OpInf-sFOM formulation leverages the computational efficiency of OpInf and the high resolution of sFOM, and thus enables fast non-intrusive predictions for conditions beyond those sampled in the training data set. A novel regularization technique with a closed-form solution based on the Gershgorin disk theorem is introduced to promote stable sFOM and OpInf models. We also provide a data-driven indicator for subdomain selection and ensure solution smoothness over the interface via a post-processing interpolation step. We evaluate the efficiency of the approach in terms of offline and online speedup through a quantitative, parametric computational cost analysis. We demonstrate the coupled OpInf-sFOM formulation for two test cases: a one-dimensional Burgers’ model for which accurate predictions beyond the span of the training snapshots are presented, and a two-dimensional parametric model for the Pine Island Glacier ice thickness dynamics, for which the OpInf-sFOM model achieves an average prediction error on the order of 1% with an online speedup factor of approximately 8$\times$ compared to the numerical simulation.

42 ENGINEERING↗

DOE OSTI2025

Data-driven emulation of modal aerosol microphysics via neural operator-based modeling

The complexity and the small characteristic scales of aerosol microphysical processes pose a big challenge for accurate and efficient Earth system simulations at regional and global scales. In this work, we construct and evaluate a surrogate model: the aerosol deep operator network (ADON), a physics-inspired dual-net architecture for emulating the aerosol microphysics parameterization suite in the version 2 of the Energy Earth System Model (E3SMv2). The current version of the surrogate model is trained on a dataset comprising 9.8 million samples obtained from a global E3SMv2 simulation with the horizontal resolution of about one degree under cloud-free conditions. Incorporating domain spatial and temporal coordinates, as well as principle components extracted from training data, the dual-net surrogate model effectively captures the intricate representations of aerosol and the relationship with atmospheric state variables, achieving an R-squared score over $$95.7\%$$ for all the lognormal aerosol modes in the extrapolated regime. The validated model provides feature importance of input variables and their impact on the predictive capacity of the surrogate model in relation to the E3SM. The computational cost of online inference time deployed on CPUs and GPUs with lower precisions highlights ADON’s efficiency and potential in robust predictive modeling for large-scale Earth system computations.

Bai, Zhe↗

DOE OSTI2019

Multiscale Based Characterization and Classification of Urban Land-Use

Machine learning and deep learning provide a means for generating urban land-use maps with relatively little human effort compared to manually digitizing images. This is especially important for supporting global and regional initiatives focused on sustainability, planning, health, pro-poor policy, infrastructure, and population distribution estimates. Many of these initiatives work in areas where geospatial data is scarce, such as the global south, and often use land-use maps to help achieve their goals. In this study, we develop a typology for automated labeling of urban land-use data that captures the variation in structural patterns within cities. A comparison of classification accuracy between convolutional neural networks (CNNs) and support vector machines (SVMs) coupled with handcrafted features is conducted. Through experimental validation on two highly dense cities in Africa, we report on new insights and the potential benefits offered by both multiscale handcrafted features and multiscale-CNNs even with limited training data.

Arndt, Jacob↗

DOE OSTI2015

WE-AB-204-06: Pseudo-CT Generation Using Undersampled, Single-Acquisition UTE-MDixon and Direct-Mapping Artificial Neural Networks for MR-Based Attenuation Correction and Radiation Therapy Planning

Purpose: Emerging technologies such as dedicated PET/MRI and MR-therapy systems require robust and clinically practical methods for determining photon attenuation. Herein, we propose using novel MR acquisition methods and processing for the generation of pseudo-CTs. Methods: A single acquisition, 190-second UTE-mDixon sequence with 25% (angular) sampling density and 3D radial readout was performed on nine volunteers. Three water-filled tubes were placed in the FOV for trajectory-delay correction. The MR data were reconstructed to generate three primitive images acquired at TEs of 0.1, 1.5 and 2.8 ms. In addition, three derived MR images were generated, i.e. two-point Dixon water/fat separation and R2* (1/T2*) map. Furthermore, two spatial features, i.e. local binary pattern (S-1) and relative spatial coordinates (S-2), were incorporated. A direct-mapping operator was generated using Artificial Neural Networks (ANNs) for transforming the MR features to a pseudo-CT. CT images served as the training data and, using a leave-one-out method, for performance evaluation using mean prediction deviation (MPD), mean absolute prediction deviation (MAPD), and correlation coefficient (R). Results: The errors between measured CT and pseudo-CT declined dramatically when the spatial features, i.e. S-1 and S-2, were included. The MPD, MAPD, and R were, respectively, 5±57 HU, 141±41 HU, and 0.815±0.066 for results generated by the ANN trained without the spatial features and were 32±26 HU, 115±18 HU, and 0.869±0.035 with the spatial features. The estimation errors of the pseudo-CT were smaller when both the S-1 and S-2 were used together than when either the S-1 or the S-2 was used. Pseudo-CT generation (256×256×256 voxels) by ANN took < 0.5 s using a computer having an Intel i7 3.4GHz CPU and 16 GB RAM. Conclusion: The proposed direct-mapping ANN approach is a technically accurate, clinically practical method for pseudo-CT generation and can potentially help improve the accuracy of MR-AC and MR-RTP applications. Please note that the project was completed with partial funding from the Ohio Department of Development grant TECH 11-063 and a sponsored research agreement with Philips Healthcare that is managed by Case Western Reserve University. As noted in the affiliations, some of the authors are Philips employees.

60 APPLIED LIFE SCIENCES↗

NASA NTRS1991

Pattern-recognition techniques applied to performance monitoring of the DSS 13 34-meter antenna control assembly

The results of applying pattern recognition techniques to diagnose fault conditions in the pointing system of one of the Deep Space network's large antennas, the DSS 13 34-meter structure, are discussed. A previous article described an experiment whereby a neural network technique was used to identify fault classes by using data obtained from a simulation model of the Deep Space Network (DSN) 70-meter antenna system. Described here is the extension of these classification techniques to the analysis of real data from the field. The general architecture and philosophy of an autonomous monitoring paradigm is described and classification results are discussed and analyzed in this context. Key features of this approach include a probabilistic time-varying context model, the effective integration of signal processing and system identification techniques with pattern recognition algorithms, and the ability to calibrate the system given limited amounts of training data. Reported here are recognition accuracies in the 97 to 98 percent range for the particular fault classes included in the experiments.

Mellstrom, J. A.↗

NASA NTRSDate not supplied

Quantifying Emergent Fluid Dynamics Using Reynolds-Interpolated Fluid Reduced-order Models

Fluid reduced-order models (ROMs) which capture the flow physics within the problem's physical domain are usually constrained in accuracy to only the parameter points, e.g. Reynolds and Mach numbers, at which reference data was provided. Interpolation-focused quantity-of-interest ROMs are often structured differently and fail to provide flow volume data with the same quality - if at all. In this paper, techniques which reside at the intersection of these two ROM schools - flow physics ROMs which can be interpolated within a parameter space of interest - are explored. Using a combination of existing and novel techniques, emergent physics are identified using a fluid ROM at parameter points which are not provided in the ROM's training data.

uncertainty quantification↗

NASA NTRSDate not supplied

Quantifying Emergent Fluid Dynamics Using Reynolds-Interpolated Fluid Reduced-order Models

uncertainty quantification↗

DOE OSTI2022

Applying Infrared Thermography as a Method for Online Monitoring of Turbine Blade Coolant Flow

As gas turbine engine manufacturers strive to implement condition-based operation and maintenance, there is a need for blade monitoring strategies capable of early fault detection and root-cause determination. Given the importance of blade cooling flows to turbine blade health and longevity, there is a distinct lack of methodologies for coolant flowrate monitoring. The present study addresses this identified opportunity by applying an infrared thermography system on an engine-representative research turbine to generate data-driven models for prediction of blade coolant flowrate. Thermal images were used as inputs to a linear regression and regularization algorithm to relate blade surface temperature distribution with blade coolant flowrate. Additionally, this study investigates how coolant flowrate prediction accuracy is influenced by the number and breadth of diagnostic measurements. Here, the results of this study indicate that a source of high-fidelity training data can be used to predict blade coolant flowrate within about six percent error. Furthermore, identification of prioritized sensor placement supports application of this technique across multiple sensor technologies capable of measuring blade surface temperature in operating gas turbine engines, including spatially resolved and point-based measurement techniques.

42 ENGINEERING↗