Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Distance Learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 379 records · Page 21

Improving materials property predictions for graph neural networks with minimal feature engineering *

Graph neural networks (GNNs) have been employed in materials research to predict physical and functional properties, and have achieved superior performance in several application domains over prior machine learning approaches. Recent studies incorporate features of increasing complexity such as Gaussian radial functions, plane wave functions, and angular terms to augment the neural network models, with the expectation that these features are critical for achieving a high performance. Here, we propose a GNN that adopts edge convolution where hidden edge features evolve during training and extensive attention mechanisms, and operates on simple graphs with atoms as nodes and distances between them as edges. As a result, the same model can be used for very different tasks as no other domain-specific features are used. With a model that uses no feature engineering, we achieve performance comparable with state-of-the-art models with elaborate features for formation energy and band gap prediction with standard benchmarks; we achieve even better performance when the dataset size increases. Although some domain-specific datasets still require hand-crafted features to achieve state-of-the-art results, our selected architecture choices greatly reduce the need for elaborate feature engineering and still maintain predictive power in comparison.

42 ENGINEERING↗

Physics-Based Machine Learning Methods for U-235 Forensics Signatures

Signatures of low-intensity U-235 sources have been recently studied by utilizing a variety of machine learning (ML) classifiers using features derived from gamma spectral measurements collected under structured campaigns. Several ML classifiers, such as ensemble of tress and classification trees, revealed misleadingly-optimistic training error due to over-fitting, and furthermore, their performance is not directly relatable to the physical properties due to their data-driven, opaque designs. We present a regression-based ML method that first estimates the inverse distance to the source and then utilizes a threshold to infer its presence, by representing the background as a source located at an infinite distance. For the inverse distance estimation, we study the ensemble of trees and Gaussian process regression methods, and a hyper parameter auto-tuning and selection method that employs five regression estimators. These methods avoid the over-fitting observed in several ML classifiers, while providing the classification error nearly comparable to them based on independent test data. Their error is directly related to estimates of the inverse physical distance to source, and the precision of error determines the seperability property that determines the false alarm and missed detection rates. The property of monotonic decrease of the source strength with increasing detector distance combined with Poisson distribution of measurements is utilized to analytically validate these methods by deriving the generalization equations of underlying regression methods.

Rao, Nageswara↗

SU-C-BRA-05: Delineating High-Dose Clinical Target Volumes for Head and Neck Tumors Using Machine Learning Algorithms

Purpose: To develop and test population-based machine learning algorithms for delineating high-dose clinical target volumes (CTVs) in H&N tumors. Automating and standardizing the contouring of CTVs can reduce both physician contouring time and inter-physician variability, which is one of the largest sources of uncertainty in H&N radiotherapy. Methods: Twenty-five node-negative patients treated with definitive radiotherapy were selected (6 right base of tongue, 11 left and 9 right tonsil). All patients had GTV and CTVs manually contoured by an experienced radiation oncologist prior to treatment. This contouring process, which is driven by anatomical, pathological, and patient specific information, typically results in non-uniform margin expansions about the GTV. Therefore, we tested two methods to delineate high-dose CTV given a manually-contoured GTV: (1) regression-support vector machines(SVM) and (2) classification-SVM. These models were trained and tested on each patient group using leave-one-out cross-validation. The volume difference(VD) and Dice similarity coefficient(DSC) between the manual and auto-contoured CTV were calculated to evaluate the results. Distances from GTV-to-CTV were computed about each patient’s GTV and these distances, in addition to distances from GTV to surrounding anatomy in the expansion direction, were utilized in the regression-SVM method. The classification-SVM method used categorical voxel-information (GTV, selected anatomical structures, else) from a 3×3×3cm3 ROI centered about the voxel to classify voxels as CTV. Results: Volumes for the auto-contoured CTVs ranged from 17.1 to 149.1cc and 17.4 to 151.9cc; the average(range) VD between manual and auto-contoured CTV were 0.93 (0.48–1.59) and 1.16(0.48–1.97); while average(range) DSC values were 0.75(0.59–0.88) and 0.74(0.59–0.81) for the regression-SVM and classification-SVM methods, respectively. Conclusion: We developed two novel machine learning methods to delineate high-dose CTV for H&N patients. Both methods showed promising results that hint to a solution to the standardization of the contouring process of clinical target volumes. Varian Medical Systems grant.

60 APPLIED LIFE SCIENCES↗

From Cosmological Observations to Fundamental Interactions (Final Report)

This research has focused on exploring how to learn about what happened at the beginning of the universe and about the fundamental laws of physics from cosmological observations. In particular, it has focused on understanding the possible observable consequence of the theory of inflation, which is an epoch of extremely rapid expansion that is supposed to have happened at the very beginning of the universe. Additionally, it has explored how to describe the clustering of galaxies at the longest distances in the universe, using simple equations that can be solved with simple calculus methods. These provide a useful tool to imagine to evolve the universe backwards and understand what were the initial conditions from which it started.

79 ASTRONOMY AND ASTROPHYSICS↗

Machine Learning for Daily Forecasts of Arctic Sea Ice Motion: An Attribution Assessment of Model Predictive Skill

Physics-based simulations of Arctic sea ice are highly complex, involving transport between different phases, length scales, and time scales. Resultantly, numerical simulations of sea ice dynamics have a high computational cost and model uncertainty. We employ data-driven machine learning (ML) to make predictions of sea ice motion. The ML models are built to predict present-day sea ice velocity given present-day wind velocity and previous-day sea ice concentration and velocity. Models are trained using reanalysis winds and satellite-derived sea ice properties. We compare the predictions of three different models: persistence (PS), linear regression (LR), and a convolutional neural network (CNN). We quantify the spatiotemporal variability of the correlation between observations and the statistical model predictions. Additionally, we analyze model performance in comparison to variability in properties related to ice motion (wind velocity, ice velocity, ice concentration, distance from coast, bathymetric depth) to understand the processes related to decreases in model performance. Results indicate that a CNN makes skillful predictions of daily sea ice velocity with a correlation up to 0.81 between predicted and observed sea ice velocity, while the LR and PS implementations exhibit correlations of 0.78 and 0.69, respectively. The correlation varies spatially and seasonally: lower values occur in shallow coastal regions and during times of minimum sea ice extent. LR parameter analysis indicates that wind velocity plays the largest role in predicting sea ice velocity on 1-day time scales, particularly in the central Arctic. Regions where wind velocity has the largest LR parameter are regions where the CNN has higher predictive skill than the LR.

54 ENVIRONMENTAL SCIENCES↗

Spatiotemporal Dynamics of the Relative Abundance of Soil Nutrient‐Degrading Enzyme‐Encoding Genes Across Continental US Ecoregions

Understanding the spatiotemporal patterns in the relative abundance of soil extracellular enzyme‐encoding genes is critical for predicting microbial responses to environmental change and their potential role in nutrient cycling. Yet, integrating novel metagenomic observations with spatiotemporal environmental gradients to infer regional patterns and future trajectories has remained unclear. To address this gap, we applied a machine learning (ML) approach, integrating soil metagenomic data with environmental variables—soil properties, topography, vegetation, and climate—to predict the relative abundance of enzyme‐encoding genes for soil carbon (C), nitrogen (N), and phosphorus (P) across surface soils of the continental United States. We assessed potential responses under future emission scenarios (SSP2‐4.5 and SSP5‐8.5) by comparing a baseline (1985–2014) to a future period (2071–2100). The ML model explained 57%–63% of baseline variation. Precipitation was identified as the most influential factor for the relative abundance of C‐ and N‐degrading enzyme‐encoding genes, while slope length, representing horizontal distance that water can travel downslope, was the primary driver for P‐degrading enzyme‐encoding genes abundance. Projections revealed spatially heterogeneous shifts across continental US ecoregions: the relative abundance of C‐ and N‐degrading enzyme‐encoding genes decreased in wetter ecoregions and increased in drier ecoregions under future climate, while P‐degrading enzyme‐encoding genes abundance decreased significantly in semiarid and Mediterranean ecoregions. This study demonstrates the utility of metagenomic data for mapping soil genetic potential and predicting its regional response to environmental change, to inform ecosystem management strategies.

extracellular enzyme-encoding genes↗

ESTIMATING PHOTOMETRIC REDSHIFTS OF QUASARS VIA THE k-NEAREST NEIGHBOR APPROACH BASED ON LARGE SURVEY DATABASES

We apply one of the lazy learning methods, the k-nearest neighbor (kNN) algorithm, to estimate the photometric redshifts of quasars based on various data sets from the Sloan Digital Sky Survey (SDSS), the UKIRT Infrared Deep Sky Survey (UKIDSS), and the Wide-field Infrared Survey Explorer (WISE; the SDSS sample, the SDSS-UKIDSS sample, the SDSS-WISE sample, and the SDSS-UKIDSS-WISE sample). The influence of the k value and different input patterns on the performance of kNN is discussed. kNN performs best when k is different with a special input pattern for a special data set. The best result belongs to the SDSS-UKIDSS-WISE sample. The experimental results generally show that the more information from more bands, the better performance of photometric redshift estimation with kNN. The results also demonstrate that kNN using multiband data can effectively solve the catastrophic failure of photometric redshift estimation, which is met by many machine learning methods. Compared with the performance of various other methods of estimating the photometric redshifts of quasars, kNN based on KD-Tree shows superiority, exhibiting the best accuracy.

79 ASTRONOMY AND ASTROPHYSICS↗

A Comparison of Adaptive and Template Matching Techniques for Radio-Isotope Identification

We compare and contrast the effectiveness of a set of adaptive and non-adaptive algorithms for isotope identi cation based on gamma-ray spectra. One dimensional energy spectra are simulated for a variety of dwell-times and source to detector distances in order to reflect conditions typically encountered in radiological emergency response and environmental monitoring applications. We nd that adaptive methods are more accurate and computationally efficient than non-adaptive in cases of operational interest.

97 MATHEMATICS AND COMPUTING↗

Explaining drivers of housing prices with nonlinear hedonic regressions

Housing markets play a critical role in shaping the spatial and demographic evolution of urban areas. Simulating housing price dynamics can enhance projections of future urban development outcomes. However, traditional hedonic regressions for housing prices, which neglect nonlinear interactions among explanatory variables, often exhibit limited predictive performance. While machine learning (ML) methods can provide a more flexible representation of the relationships between predictors, they are often regarded as “black boxes” due to their complexity and lack of transparency. Interpretable ML techniques provide a promising route by combining the flexibility of ML methods with approaches to analyze the relationships between inputs and outputs. In this study, we employ interpretable ML to analyze the patterns driving the housing market in Baltimore, Maryland, USA. We train an Artificial Neural Network (ANN) to predict Baltimore housing prices based on structural characteristics (e.g., home size, number of stories) and locational attributes (e.g., distance to the city center). We then conduct sensitivity and Partial Dependence Plot (PDP) analyses to interpret the fitted ANN model. We find that the ML model achieves higher predictive accuracy and explains 16 % more of housing price variance than a traditional linear regression model. The interpretable ML model also reveals more nuanced and realistic nonlinear relationships between housing sales price and predictors as well as interactive effects underlying Baltimore home price dynamics. For instance, while the linear model indicates a steady housing price increase over time, our interpretable ML model detects a post-2008 decline, with smaller properties experiencing the sharpest drop.

97 MATHEMATICS AND COMPUTING↗

29 th International Training Course on the Physical Protection of Nuclear Materials and Nuclear Facilities (Project Summary)

Sandia National Laboratories (Sandia) has hosted the International Training Course on the Physical Protection of Nuclear Materials and Nuclear Facilities since 1978. This course is the flagship training course of the International Atomic Energy Agency (IAEA). On behalf of the National Nuclear Security Administration (NNSA), Sandia manages, develops, and coordinates all course materials, and works closely with the IAEA to arrange all logistical details for the course ITC-29 incorporated some updates to the facility models, based on feedback received in ITC-28 and the ITC-29 dry run. In addition, all the graphics were refreshed after ITC-28 and implemented in the posters, data handbooks, etc. As in ITC-28, the ITC-29 staff worked closely with the IAEA on course materials, including a peer review process to ensure all course materials were aligned with Nuclear Security Series No. 13 and other relevant international guidance documentation from the IAEA. Due to the COVID-19 pandemic, ITC-29 was postponed twice and eventually took place in the late summer/early fall of 2022. Due to ongoing COVID-19 restrictions and safety requirements, the number of participants was reduced by about 31 percent from 59 participants in ITC-28 to 41 in ITC-29. As a result, the number of subgroups also decreased from eight in ITC-28 to six for ITC-29. This enabled the Sandia team to implement more opportunities for social distancing, particularly in the large classrooms. Despite the challenges, ITC-29 still passed a significant milestone, with the one-thousandth participant of the international training course attending during this event. Finally, the ITC staff continued the use of its improved method of evaluation to capture participants’ satisfaction with the updated course and to gather feedback concerning future improvements. This document provides a brief description of ITC-29, including a summary of lessons learned and key recommendations for future development efforts.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

Through the Windshield Driver Recognition

Biometric recognition of vehicle occupants in unconstrained environments is rife with a host of challenges. In particular, the complications arising from imaging through vehicle windshields provide a significant hurdle. Distance to target, glare, poor lighting, head pose of occupants, and speed of vehicle are some of the challenges. We explore the construction of a multi-unit computational camera system to mitigate these challenges in order to obtain accurate and consistent face recognition results. This paper documents the hardware components and software design of the computational imaging system. Also, we document the use of RCNN for face detection and GAN for machine learning-inspired High Dynamic Range Imaging, artifact removal, and image fusion.

Cornett, David↗

Selection of Training Sets for 235U Source Detection Classifiers Using Gamma Signatures

The machine learning methods for classifiers to detect low level radiation sources are of interest when suitable training data sets are available. Their application and performance assessment, however, involves the aspects of over-fitting and training data selection that are somewhat uncommon in other existing methods for this task.We study U-235 gamma signatures using data sets collected by 21 NaI detectors under controlled conditions. The gamma spectra are collected by the detectors located at different distances from the source, and we study their choice as training sets for classifiers to detect a source. The detectors form the near, middle and outer groups based on the distance to source. The classifiers based on the outer group are susceptible to over-fitting, that is, they achieve low training error but incur much higher testing error in independent tests. The other two groups achieve lower training error and comparable testing error, and the near group achieves the overall lowest error. In detecting a source at an unknown distance, the farther detectors in the middle group achieve the overall lowest testing error with limited over-fitting, thereby indicating the complex dependencies between the training and classifier performance.

Rao, Nageswara↗

Computational and Experimental Examination of Simulated Core Damage and Relocation Dynamics of a BWR Fuel Assembly - 16013

The Japan Atomic Energy Agency (JAEA) plans a large-scale test to evaluate damage and relocation behavior of Boiling Water Reactor (BWR) core materials consisting of fuel rods (zirconia as fuel simulant), channel boxes, control blade assemblies as well as lower core-support structures. Its purpose is to contribute to the understanding of the core material relocation behavior in the event of severe accidents with the BWR design conditions for which existing experimental database is quite limited. Prior to large-scale testing anticipated at JAEA in the future, JAEA desires preliminary investigations to examine melting test pieces, being composed of a mixture of zirconia and metals by a non-transferred thermal plasma heating system. The purpose of such tests is to verify the materials and test piece will be heated by plasma as a primary heat source to the target temperature of ca. 2900 K and to collect data about the relocation behavior of the high-temperature materials. This paper describes the first in a series of tests demonstrating the effective use of thermal plasma technology to recreate the dynamics of a typical fuel core bundle channel assembly section. Results from preliminary computational simulations of simplified fuel bundle assemblies are presented illustrating the effectiveness of a 150 kW, non transferred (NTR) configuration of a thermal plasma argon jet to heat the assembly within a highly-insulated containment vessel. An experimental test program using the computational analyses as a basis and a Phoenix Solutions Co (PSC) commercial model PT150, 150 kW plasma torch is described and the test results are presented illustrating the time versus temperature history of the fuel bundle assembly melting dynamics. Details on plasma operation are discussed including: power requirements, current flow, voltage levels achieved, argon gas flow rates, processing times and standoff distances of the torch discharge from the top of the fuel bundle assembly (achieved with remote control of the axial (vertical) translation of the torch within the containment processing chamber). Photos taken from the top of the processing chamber are presented illustrating the various phases of melting characteristics of the zircaloy-clad, zirconium oxide filled fuel tubes, all within a stainless steel tube bundle channel centered within an insulated zirconia crucible. Based on lessons learned from this initial test campaign, a brief discussion of the requirements and features of a follow-on Phase II test program is provided. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Autonomous Molecular Structure Imaging with High-Resolution Atomic Force Microscopy for Molecular Mixture Discovery

Due to its single-molecule sensitivity, high-resolution atomic force microscopy (HR-AFM) has proved to be a valuable and uniquely advantageous tool to study complex molecular mixtures, which hold promise for developing clean energy and achieving environmental sustainability. However, significant challenges remain to achieve the full potential of the sophisticated and time-consuming experiments. Automation combined with machine learning (ML) and artificial intelligence (AI) is key to overcoming these challenges. Here we present Auto-HR-AFM, an AI tool to automatically collect HR-AFM images of petroleum-based mixtures. In this study, we trained an instance segmentation model to teach Auto-HR-AFM how to recognize features in HR-AFM images. Auto-HR-AFM then uses that information to optimize the imaging by adjusting the probe-molecule distance for each molecule in the run. Auto-HR-AFM is the initial tool that will lead to fully automated scanning probe microscopy (SPM) experiments, from start to finish. This automation will allow SPM to become a mainstream characterization technique for complex mixtures, an otherwise unattainable target.

36 MATERIALS SCIENCE↗

Search for brown dwarfs in IC 1396 with Subaru HSC: interpreting the impact of environmental factors on substellar population

ABSTRACT Young stellar clusters are predominantly the hub of star formation and hence, ideal to perform comprehensive studies over the least explored substellar regime. Various unanswered questions like the mass distribution in brown dwarf regime and the effect of diverse cluster environment on brown dwarf formation efficiency still plague the scientific community. The nearby young cluster, IC 1396 with its feedback-driven environment, is ideal to conduct such study. In this paper, we adopt a multiwavelength approach, using deep Subaru HSC along with other data sets and machine learning techniques to identify the cluster members complete down to ∼ 0.03 M⊙ in the central 22 arcmin area of IC 1396. We identify 458 cluster members including 62 brown dwarfs which are used to determine mass distribution in the region. We obtain a star-to-brown dwarf ratio of ∼ 6 for a stellar mass range 0.03–1 M⊙ in the studied cluster. The brown dwarf fraction is observed to increase across the cluster as radial distance from the central OB-stars increases. This study also compiles 15 young stellar clusters to check the variation of star-to-brown dwarf ratio relative to stellar density and ultraviolet (UV) flux ranging within 4–2500 stars pc−2 and 0.7–7.3 G0, respectively. The brown dwarf fraction is observed to increase with stellar density but the results about the influence of incident UV flux are inconclusive within this range. This is the deepest study of IC 1396 as of yet and it will pave the way to understand various aspects of brown dwarfs using spectroscopic observations in future.

Gupta, Saumya (ORCID:0000000161843958)↗

High-precision inversion of dynamic radiography using hydrodynamic features

While radiography is routinely used to probe complex, evolving density fields in research areas ranging from materials science to shock physics to inertial confinement fusion and other national security applications, complications resulting from noise, scatter, complex beam dynamics, etc. prevent current methods of reconstructing density from being accurate enough to identify the underlying physics with sufficient confidence. In this work, we show that using only features that are robustly identifiable in radiographs and combining them with the underlying hydrodynamic equations of motion using a machine learning approach of a conditional generative adversarial network (cGAN) provides a new and effective approach to determine density fields from a dynamic sequence of radiographs. In particular, we demonstrate the ability of this method to outperform a traditional, direct radiograph to density reconstruction in the presence of scatter, even when relatively small amounts of scatter are present. Our experiments on synthetic data show that the approach can produce high quality, robust reconstructions. We also show that the distance (in feature space) between a testing radiograph and the training set can serve as a diagnostic of the accuracy of the reconstruction.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Lessons Learned Using Iridium to Communicate with a CubeSat in Low Earth Orbit

This paper presents the design and approval process for operating an Iridium transceiver on orbit and provide on-orbit performance data obtained from a CubeSat platform in Low Earth Orbit (LEO) (500 km orbit). On-orbit data demonstrates that use of a commercial, low-cost Iridium transceiver can serve as a valuable communication approach for low volume telemetry with less than a 30-minute lag for approximately 90% of the time. In this work, we also demonstrate that a radial differential velocity of 7 km/sec corresponding to about a 37.5kHz doppler shift and a distance of less than 2,000 km can be used for mission planning.

42 ENGINEERING↗

Citizen science coupled with machine learning to quantify green-blue infrastructure cooling potential in Maricopa County, Arizona

Here, this study investigates the spatiotemporal cooling performance of green and blue infrastructure (GBI) in the Dobson Ranch urban neighborhood in Phoenix, Arizona. We leveraged citizen science near-surface (2 m) air temperature (Tair) measurements to train a highly accurate Tair predicting LightGBM machine learning model (R 2 : 0.986, MAE: 0.251 °C, RMSE: 0.585 °C). On June 16, 2024, the park area exhibited approximately 1 °C cooling effect (relative to the neighborhood mean) during both day and night. In contrast, the nearby artificial lake exhibited a stronger cooling effect of 2.4 °C during the day but a slight warming of 0.3 °C at night. At 00:00, locations 50 m downwind of the park were 0.3 °C warmer than the park, while locations 50 m upwind were 0.8 °C warmer. At 11:00, we observed that the downwind area is 0.8 °C cooler and the upwind area is 0.6 °C warmer—at the same 50 m distances relative to the park. We also observed 1 °C cooler and warmer effects respectively at the same 50 m downwind and upwind locations at 19:00 on June 17, 2024. Our data-driven analysis highlights potential limitations of car-traverse measurements, showing that failure to account for temporal variations during the traverse can lead to overestimation of Tair at night and underestimation during the day. Our analysis also showed only a weak correlation (coefficient: 0.48) between Landsat-derived land surface temperature (LST) and model predicted Tair at the time of the local Landsat overpass (∼11.00). This highlights the potential error of relying solely on LST for human thermal exposure analysis—particularly within the heterogenous built-environment.

54 ENVIRONMENTAL SCIENCES↗