Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Distance Learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10

Geodesic-based relaxation for deep canonical correlation analysis

Deep canonical correlation analysis (DCCA) is often applied to paired data samples from diverse sources to extract meaningful common information. However, when the data sources are heterogeneous, some of the useful information may be complementary but not exactly common. In spite of this fact, existing techniques learn maximally correlated representations from multiple views and are formulated so that they aim to yield identical latent subspaces for each view. This approach is sub-optimal in estimating the true signal subspaces for heterogeneous data sources. We propose a residual relaxation for deep canonical correlation analysis (RDCCA) based on a subspace distance metric, which generalizes the existing problem formulation and extracts representations that are better estimates of the actual, non-identical subspaces. We demonstrate that when using such a relaxation, the learned representations are closer to the true ones and that RDCCA outperforms CCA and DCCA in scenarios with heterogeneous data.

Kuschel, Maurice↗

Dark Energy Survey Year 1 results: measurement of the baryon acoustic oscillation scale in the distribution of galaxies to redshift 1

ABSTRACT We present angular diameter distance measurements obtained by locating the baryon acoustic oscillations (BAO) scale in the distribution of galaxies selected from the first year of Dark Energy Survey data. We consider a sample of over 1.3 million galaxies distributed over a footprint of 1336 deg2 with 0.6 < $z$photo < 1 and a typical redshift uncertainty of 0.03(1 + $z$). This sample was selected, as fully described in a companion paper, using a colour/magnitude selection that optimizes trade-offs between number density and redshift uncertainty. We investigate the BAO signal in the projected clustering using three conventions, the angular separation, the comoving transverse separation, and spherical harmonics. Further, we compare results obtained from template-based and machine-learning photometric redshift determinations. We use 1800 simulations that approximate our sample in order to produce covariance matrices and allow us to validate our distance scale measurement methodology. We measure the angular diameter distance, DA, at the effective redshift of our sample divided by the true physical scale of the BAO feature, rd. We obtain close to a 4 per cent distance measurement of DA($z$eff = 0.81)/rd = 10.75 ± 0.43. These results are consistent with the flat Λ cold dark matter concordance cosmological model supported by numerous other recent experimental results.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Environmentally Adaptive, Multiband Software-Defined-Radar for Monitoring of Item of Interest in a Dynamically Cluttered Room

High-resolution multi-frequency radars when networked together, form a robust and seamless monitoring system for high-valued items. The multi-look-direction radar network investigated by LLNL and DSI, operates at 77 GHz and 5.8GHz, and is capable of detection at centimeter resolution movement of objects of interest. This dual frequency radar (unlike optical methods) can operate under various environments with conditions such a smoke, dust, and other natural or manmade obscurations. In addition, the multiband network radar is based on low-cost FCC approved EM specifications and can be scaled with the dimensions of the room and objects under consideration by user-defined inputs. Furthermore, the underlying radar signal processing based on software-defined radar engine is adaptive to its operational environment, where operators can input the size of the facility and object of interest and the distance between the object and radar. Finally, this multi-frequency radar employs a host of change detection and machine learning algorithms to reach performance levels in terms of high probability of detection and low false alarm rates while the monitoring state of the object can be reported remotely.

42 ENGINEERING↗

An improved dataset for predicting mammal infecting viruses from genetic sequence information

There have been several attempts to develop machine learning (ML) models to identify human infecting viruses from their genomic sequences, with varying degrees of success. Direct comparison between models is problematic, because these models are typically trained and evaluated on different datasets with alternative data splitting schemes, features, and model performance metrics. In this paper we present a standardized dataset of mammal infecting and non-infecting viral pathogens, refined from the previous work of Mollentze et al. to include the latest literature evidence, roughly doubling the number of curated host-virus records available to the community, and new host target labels, primate and mammal. The new host labels were included for several reasons, including previous reports that classification performance is better at broader taxonomic ranks and the idea that there may be more data for primate infection that might serve as a suitable proxy for zoonotic potential and avoidance of false positives for human infection due to absence of evidence. On this dataset, we report the performance of eight machine learning models for predicting mammal-infecting viruses from their genomic sequences. We find that randomly assigning cases in our improved dataset to training/testing sets, when compared to the original assignments into training/testing in Mollentze et al., increases the overall average ROC AUC of prediction of human infection from 0.663 ± 0.070 to 0.784 ± 0.013, consistent with the reduction in phylogenetic distance between train and test sets (relative entropy change from 3.00 to 0.08). The broadest host category of mammal infection can be predicted most reliably at 0.850 ± 0.020. We share our improved dataset and code to enable standardized comparisons of machine learning methods to predict human host infections. Overall, we have presented preliminary evidence that classification of virus host infection is more tractable at higher taxonomic ranks, that unsurprisingly reducing the phylogenetic distance between training and test sets can improve predictive performance, that peptide kmer features appear to be harmful to out of sample model performance, and we are left with the question of whether models for virus host prediction can reasonably be expected to perform well in out of sample scenarios given the likelihood that viruses do not share a common ancestor. Consistent with this concern, when the data is resampled such that there is no overlap between viral families in training and test sets (relative entropy > 24), models perform no better than random chance at prediction of human infection regardless of whether kmers are included (ROC AUC 0.50 ± 0.08) or not (ROC AUC 0.50 ± 0.04).

59 BASIC BIOLOGICAL SCIENCES↗

Physics-Informed Deep Learning for Reconstruction of Spatial Missing Climate Information in the Antarctic

Understanding the influence of the Antarctic on the global climate is crucial for the prediction of global warming. However, due to very few observation sites, it is difficult to reconstruct the rational spatial pattern by filling in the missing values from the limited site observations. To tackle this challenge, regional spatial gap-filling methods, such as Kriging and inverse distance weighted (IDW), are regularly used in geoscience. Nevertheless, the reconstructing credibility of these methods is undesirable when the spatial structure has massive missing pieces. Inspired by image inpainting, we propose a novel deep learning method that demonstrates a good effect by embedding the physics-aware initialization of deep learning methods for rapid learning and capturing the spatial dependence for the high-fidelity imputation of missing areas. We create the benchmark dataset that artificially masks the Antarctic region with ratios of 30%, 50% and 70%. The reconstructing monthly mean surface temperature using the deep learning image inpainting method RFR (Recurrent Feature Reasoning) exhibits an average of 63% and 71% improvement of accuracy over Kriging and IDW under different missing rates. With regard to wind speed, there are still 36% and 50% improvements. In particular, the achieved improvement is even better for the larger missing ratio, such as under the 70% missing rate, where the accuracy of RFR is 68% and 74% higher than Kriging and IDW for temperature and also 38% and 46% higher for wind speed. In addition, the PI-RFR (Physics-Informed Recurrent Feature Reasoning) method we proposed is initialized using the spatial pattern data simulated by the numerical climate model instead of the unified average. Compared with RFR, PI-RFR has an average accuracy improvement of 10% for temperature and 9% for wind speed. When applied to reconstruct the spatial pattern based on the Antarctic site observations, where the missing rate is over 90%, the proposed method exhibits more spatial characteristics than Kriging and IDW.

54 ENVIRONMENTAL SCIENCES↗

Deep transfer operator learning for partial differential equations under conditional shift

Transfer learning enables the transfer of knowledge gained while learning to perform one task (source) to a related but different task (target), hence addressing the expense of data acquisition and labelling, potential computational power limitations and dataset distribution mismatches. Here, we propose a new transfer learning framework for task-specific learning (functional regression in partial differential equations) under conditional shift based on the deep operator network (DeepONet). Task-specific operator learning is accomplished by fine-tuning task-specific layers of the target DeepONet using a hybrid loss function that allows for the matching of individual target samples while also preserving the global properties of the conditional distribution of the target data. Inspired by conditional embedding operator theory, we minimize the statistical distance between labelled target data and the surrogate prediction on unlabelled target data by embedding conditional distributions onto a reproducing kernel Hilbert space. We demonstrate the advantages of our approach for various transfer learning scenarios involving nonlinear partial differential equations under diverse conditions due to shifts in the geometric domain and model dynamics. Our transfer learning framework enables fast and efficient learning of heterogeneous tasks despite considerable differences between the source and target domains.

42 ENGINEERING↗

A Data-Fusion Method using Bayesian Approach to Enhance Raw Data Accuracy of Position and Distance Measurements for Connected Vehicles

Accurate positioning of vehicles is a critical element of autonomous and connected vehicle systems. Most of other studies heavily focused on enhancing simultaneous localization and mapping (SLAM) methods, i.e., constructing or updating a map of an unknown environment and tracking an object within the map. This paper provides a method that can, in addition to existing SLAM or relevant methods, enhance the raw measurements of position and distance. The basic idea of this study is to identify and update the error distribution of each data source by combining all available information. A Bayesian approach was incorporated to estimate and update the error distribution of individual data sources or sensors. The proposed method can be conducted in real-time environments, and a self-learning scheme determines whether enough data has been collected to further improve the accuracy of such measurements. The simulated experiments show that the proposed model noticeably improves the accuracy of position and distance measurements. Especially, the estimated biases of position coordinates and distance measures are very close to the biases of true error distributions, with the R-squared over 0.98. A similar approach can also be utilized to enhance accuracy of other sensors or measurements in connected vehicle or relevant systems, where multi-data sources are available.

Lim, Hyeonsup↗

Toward active disruption avoidance via real-time estimation of the safe operating region and disruption proximity in tokamaks

This paper describes a real-time capable algorithm for identifying the safe operating region around a tokamak operating point. The region is defined by a convex set of linear constraints, from which the distance of a point from a disruptive boundary can be calculated. The disruptivity of points is calculated from an empirical machine learning predictor that generates the likelihood of disruption. While the likelihood generated by such empirical models can be compared to a threshold to trigger a disruption mitigation system, the safe operating region calculation enables active optimization of the operating point to maintain a safe margin from disruptive boundaries. The proposed algorithm is tested using a random forest disruption predictor fit on data from DIII-D. The safe operating region identification algorithm is applied to historical data from DIII-D showing the evolution of disruptive boundaries and the potential impact of optimization of the operating point. Real-time relevant execution times are made possible by parallelizing many of the calculation steps and implementing the algorithm on a graphics processing unit. Lastly, a real-time capable algorithm for optimizing the target operating point within the identified constraints is also proposed and simulated.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Dynamical Mass Measurements of Contaminated Galaxy Clusters Using Machine Learning

We study dynamical mass measurements of galaxy clusters contaminated by interlopers and show that a modern machine learning algorithm can predict masses by better than a factor of two compared to a standard scaling relation approach. We create two mock catalogs from Multidark's publicly available N-body MDPL1 simulation, one with perfect galaxy cluster membership information and the other where a simple cylindrical cut around the cluster center allows interlopers to contaminate the clusters. In the standard approach, we use a power-law scaling relation to infer cluster mass from galaxy line-of-sight (LOS) velocity dispersion. Assuming perfect membership knowledge, this unrealistic case produces a wide fractional mass error distribution, with a width of ${\rm{\Delta }}\epsilon \approx 0.87$. Interlopers introduce additional scatter, significantly widening the error distribution further (${\rm{\Delta }}\epsilon \approx 2.13$). We employ the support distribution machine (SDM) class of algorithms to learn from distributions of data to predict single values. Applied to distributions of galaxy observables such as LOS velocity and projected distance from the cluster center, SDM yields better than a factor-of-two improvement (${\rm{\Delta }}\epsilon \approx 0.67$) for the contaminated case. Remarkably, SDM applied to contaminated clusters is better able to recover masses than even the scaling relation approach applied to uncontaminated clusters. We show that the SDM method more accurately reproduces the cluster mass function, making it a valuable tool for employing cluster observations to evaluate cosmological models.

79 ASTRONOMY AND ASTROPHYSICS↗

Cataclysmic Variables in the Second Year of the Zwicky Transient Facility

Using a filter in the GROWTH Marshal based on color and the amplitude and timescale of variability, we have identified 372 objects as known or candidate cataclysmic variables (CVs) during the second year of the operation of the Zwicky Transient Facility. From the available difference imaging data, we found that 93 are previously confirmed CVs and 279 are strong candidates. Spectra of four of the candidates confirm them as CVs by the presence of Balmer emission lines, while one of the four has prominent He ii lines indicative of containing a magnetic white dwarf. Gaia EDR3 parallaxes are available for 154 of these systems, resulting in distances from 108–2096 pc and absolute magnitudes in the range of 7.5–15.0, with the largest number of candidates between 10.5 and 12.5. The total numbers are 21% higher than from the previous year of the survey with a greater number of distances available but a smaller percentage of systems close to the Galactic plane. Comparison of these findings with a machine-learning method of searching all the light curves reveals large differences in each data set related to the parameters involved in the search process.

79 ASTRONOMY AND ASTROPHYSICS↗

Energy efficient integrated photonic systems based on inverse design

The energy footprint of modern information processing and communications systems is immense and utilizes a significant fraction of total global energy usage. Data centers alone consume over 70 billion kilowatt-hours per year. Much of this energy usage is intrinsic to the use of electronic wiring, making optical-based technologies a necessary and promising route to mitigating energy consumption in short- to medium-distance communication links. In this project, we developed and implemented a framework for the design of optical components, based on machine learning, which enables optical components relevant to optical information processing to be realized at their physical performance limits.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Treatment of Chlorinated Solvents in Groundwater Beneath an Occupied Building at the Young-Rainey STAR Center, Pinellas, FL

Groundwater contamination, consisting of two dissolved-phase plumes originating from chlorinated solvent source areas, in the southeastern portion of the Young- Rainey Star Center (also known as the Pinellas County, Florida, Site) in Largo, Florida, has migrated beyond the property boundary, beneath the roadways, and beneath adjacent properties to the south and east. Groundwater contamination will persist as long as the onsite contaminant source remains. The origin of the contamination appears to be multiple long-term point sources beneath Building 100, a 4.5 ha (11 acre) building that housed manufacturing facilities during US DOE operations at the site. The site is now owned by Pinellas County, and most of the space inside the building is leased to private companies, so DOE chose not to conduct characterization or remediation through the floor of the building, instead choosing to conduct all work from outside the building. Injection of emulsified soybean oil and a microbial culture has been used at other areas of the site to accelerate naturally occurring bacterial processes that degrade groundwater contaminants to harmless compounds, and that same approach was chosen for this task. The technical approach consisted of installing horizontal wells from outside the building footprint, extending through and around the identified subsurface treatment areas, and terminating beneath the building. Two 107 m (350 ft) long wells, two 122 m (400 ft) long wells, and four 137 m (450 ft) long wells have been installed to intersect the inferred source areas and confirmed contaminant plumes beneath the building. DOE then injected emulsified vegetable oil and a microbial culture into the horizontal wells at each of several target areas beneath the building where the highest groundwater contaminant concentrations have been detected. The target areas are the northwest corner of the building between the old drum storage pad locations and monitoring well PIN12-S35B, the vicinity of former monitoring well PIN12-S57B, and hydraulically upgradient from the south plume and the east plume at the points where they exit from beneath the building. We describe the details of designing and constructing horizontal injection wells for bioremediation beneath a large, occupied industrial production facility, including lessons learned; technical, logistical, and environmental challenges; community relations; and regulatory relations. Because of the expected lag in biological acclimation and response, distance between the treatment areas and associated monitoring points, and low groundwater velocity, it will likely be years before the full impact of the project will be realized.

54 ENVIRONMENTAL SCIENCES↗

Treatment of Chlorinated Solvents in Groundwater Beneath an Occupied Building at The Young - Rainey STAR Center (Science, Technology, and Research Center) - 16342

Groundwater contamination, consisting of two dissolved-phase plumes originating from chlorinated solvent source areas, in the southeastern portion of the Young- Rainey Star Center (also known as the Pinellas County, Florida, Site) in Largo, Florida, has migrated beyond the property boundary, beneath the roadways, and beneath adjacent properties to the south and east. Groundwater contamination will persist as long as the onsite contaminant source remains. The origin of the contamination appears to be multiple long-term point sources beneath Building 100, a 4.5 ha (11 acre) building that housed manufacturing facilities during US DOE operations at the site. The site is now owned by Pinellas County, and most of the space inside the building is leased to private companies, so DOE chose not to conduct characterization or remediation through the floor of the building, instead choosing to conduct all work from outside the building. Injection of emulsified soybean oil and a microbial culture has been used at other areas of the site to accelerate naturally occurring bacterial processes that degrade groundwater contaminants to harmless compounds, and that same approach was chosen for this task. The technical approach consisted of installing horizontal wells from outside the building footprint, extending through and around the identified subsurface treatment areas, and terminating beneath the building. Two 107 m (350 ft) long wells, two 122 m (400 ft) long wells, and four 137 m (450 ft) long wells have been installed to intersect the inferred source areas and confirmed contaminant plumes beneath the building. DOE then injected emulsified vegetable oil and a microbial culture into the horizontal wells at each of several target areas beneath the building where the highest groundwater contaminant concentrations have been detected. The target areas are the northwest corner of the building between the old drum storage pad locations and monitoring well PIN12-S35B, the vicinity of former monitoring well PIN12-S57B, and hydraulically up-gradient from the south plume and the east plume at the points where they exit from beneath the building. We describe the details of designing and constructing horizontal injection wells for bioremediation beneath a large, occupied industrial production facility, including lessons learned; technical, logistical, and environmental challenges; community relations; and regulatory relations. Because of the expected lag in biological acclimation and response, distance between the treatment areas and associated monitoring points, and low groundwater velocity, it will likely be years before the full impact of the project will be realized. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Effect of particle size and moisture on flow performance of loblolly pine anatomical fractions: Experimental findings and model predictions

The rising energy demand has highlighted biomass as a promising next-generation energy source. However, commercializing biomass-derived energy faces challenges, particularly in handling biomass feedstock. Factors like particle size, shape, moisture content, and surface roughness significantly impact biomass flowability. This study addresses a crucial knowledge gap by examining the effects of particle size and moisture content on the flow behavior and shear properties of different anatomical fractions of loblolly pine (Pinus taeda). The bulk shear behavior was examined using a Schulze ring shear tester, while flow performance was tested through gravity-driven flow experiments in a variable wedge-shape hopper. Results were incorporated into empirical and machine learning-based flow prediction models to evaluate their accuracy and limitations. The study found that samples with higher moisture content show higher unconfined yield strength. The critical arching distance increased with particle size, e.g., from approximately 13 and 33 mm for 2- and 6-mm whole chips, respectively at a 32-degree inclination angle. Conversely, the flow rate decreased for a given hopper opening as particle size increased. For instance, at a 60-mm hopper opening and a 32-degree inclination angle, the mass flow rates for 2- and 6-mm whole chips were 7.83 and 6.42 tonne/h, respectively. The empirical model consistently overpredicted the mass flow rate for all anatomical fractions, while the machine learning model more accurately predicted the central tendency of flow rate but was insensitive to varying tissue proportions. These novel findings provide comprehensive characterization of anatomical fractions, reveal significant combined effects of particle size and moisture content on biomass flow behavior, and demonstrate a better predictive accuracy of a machine learning model, all of which are useful for optimizing material handling strategies and biomass utilization technologies in the industry.

09 - BIOMASS FUELS↗

A generalized deep learning approach for local structure identification in molecular simulations

Identifying local structure in molecular simulations is of utmost importance. The most common existing approach to identify local structure is to calculate some geometrical quantity referred to as an order parameter. In simple cases order parameters are physically intuitive and trivial to develop (e.g., ion-pair distance), however in most cases, order parameter development becomes a much more difficult endeavor (e.g., crystal structure identification). Using ideas from computer vision, we adapt a specific type of neural network called a PointNet to identify local structural environments in molecular simulations. A primary challenge in applying machine learning techniques to simulation is selecting the appropriate input features. This challenge is system-specific and requires significant human input and intuition. In contrast, our approach is a generic framework that requires no system-specific feature engineering and operates on the raw output of the simulations, i.e., atomic positions. We demonstrate the method on crystal structure identification in Lennard-Jones (four different phases), water (eight different phases), and mesophase (six different phases) systems. The method achieves as high as 99.5% accuracy in crystal structure identification. The method is applicable to heterogeneous nucleation and it can even predict the crystal phases of atoms near external interfaces. We demonstrate the versatility of our approach by using our method to identify surface hydrophobicity based solely upon positions and orientations of surrounding water molecules. Our results suggest the approach will be broadly applicable to many types of local structure in simulations.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Deep Learning and Photogrammetric Reconstruction for Automated Crack Detection and Dimensional Measurement in Mining Operations

Surface crack detection and dimensional measurement at active mining sites present significant safety and operational challenges. Manual inspection methods are labor-intensive, spatially incomplete, and expose personnel to hazardous environments, while existing automated approaches have been developed primarily for concrete civil infrastructure and have not been validated on the complex, variable surfaces characteristic of mining environments. This dissertation presents an automated pipeline that integrates deep learning semantic segmentation with Structure-from-Motion photogrammetry to detect surface cracks and measure their aperture, length, and vertical displacement from standard RGB imagery acquired during routine Uncrewed Aerial Vehicle (UAV) survey operations, without requiring additional sensor hardware or manual measurement. The pipeline combines a U-Net architecture with an EfficientNet-B0 encoder, pretrained on the SDNET2018 concrete crack dataset and fine-tuned on a mining-specific dataset spanning laboratory concrete specimens, coal refuse impoundment embankments, and post-blast limestone quarry benches. Photogrammetric reconstruction is performed using COLMAP Structure-from-Motion and Multi-View Stereo, with crack segmentation masks projected into the reconstructed point cloud to enable three-dimensional vertical displacement measurement through local plane fitting and bimodal surface detection. The pipeline was validated across 36 controlled laboratory specimens at three imaging distances and four vertical displacement levels, achieving aperture measurement RMSE of 0.047 cm and R² of 0.954, and vertical displacement RMSE of 0.140 cm and R² of 0.966, against independent caliper measurements. Field application at a coal refuse impoundment in southwestern Pennsylvania detected 71 crack components across the embankment crest, with a dominant longitudinal crack exhibiting aperture values reaching 28 cm and a 95th percentile vertical displacement of 35.53 cm, consistent in magnitude and spatial distribution with simultaneously acquired LiDAR-derived estimates. Application across four post-blast limestone quarry bench datasets in California successfully characterized blast-induced fracture networks at ground sampling distances ranging from 0.59 to 1.23 cm/pixel, with detected crack geometries physically consistent with observable surface conditions at each site. The results demonstrate that deep learning-based crack detection and photogrammetric measurement can be integrated into routine UAV inspection workflows at mining sites, providing repeatable, scalable, and quantitative crack characterization across surface types, crack scales, and displacement magnitudes not previously addressed in the literature. The pipeline requires no dedicated surveying equipment beyond the UAV platforms already deployed at mine sites for survey and monitoring purposes, supporting practical adoption within existing operational workflows.

Crack detection, Dimensional Measurement↗

Density streams in the disc winds of Classical T Tauri stars

ABSTRACT Spectral and photometric variability of the Classical T Tauri stars RY Tau and SU Aur from 2013 to 2022 is analysed. We find that in SU Aur the H α line’s flux at radial velocity RV = −50 ± 7 km s−1 varies with a period P = 255 ± 5 d. A similar effect previously discovered in RY Tau is confirmed with these new data: P = 21.6 d at RV = −95 ± 5 km s. In both stars, the radial velocity of these variations, the period, and the mass of the star turn out to be related by Kepler’s law, suggesting structural features on the disc plane orbiting at radii of 0.2 au in RY Tau and 0.9 au in SU Aur, respectively. Both stars have a large inclination of the accretion disc to the line of sight – so that the line of sight passes through the region of the disc wind. We propose there is an azimuthal asymmetry in the disc wind, presumably in the form of ‘density streams,’ caused by substructures of the accretion disc surface. These streams cannot dissipate until they go beyond the Alfven surface in the disc’s magnetic field. These findings open up the possibility to learn about the structure of the inner accretion disc of CTTS on scales less than 1 au and to reveal the orbital distances related to the planet’s formation.

Petrov, P. P. (ORCID:0000000155514963)↗