Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “supervised learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 397 records · Page 22

deadtrees.earth — An open-access and interactive database for centimeter-scale aerial imagery to uncover global tree mortality dynamics

Excessive tree mortality is a global concern and remains poorly understood as it is a complex phenomenon. We lack global and temporally continuous coverage on tree mortality data. Ground-based observations on tree mortality, e.g., derived from national inventories, are very sparse, and may not be standardized or spatially explicit. Earth observation data, combined with supervised machine learning, offer a promising approach to map overstory tree mortality in a consistent manner over space and time. However, global-scale machine learning requires broad training data covering a wide range of environmental settings and forest types. Low altitude observation platforms (e.g., drones or airplanes) provide a cost-effective source of training data by capturing high-resolution orthophotos of overstory tree mortality events at centimeter-scale resolution. Here, we introduce deadtrees.earth, an open-access platform hosting more than two thousand centimeter-resolution orthophotos, covering more than 1,000,000 ha, of which more than 58,000 ha are manually annotated with live/dead tree classifications. This community-sourced and rigorously curated dataset can serve as a comprehensive reference dataset to uncover tree mortality patterns from local to global scales using space-based Earth observation data and machine learning models. This will provide the basis to attribute tree mortality patterns to environmental changes or project tree mortality dynamics to the future. The open nature of deadtrees.earth, together with its curation of high-quality, spatially representative, and ecologically diverse data will continuously increase our capacity to uncover and understand tree mortality dynamics.

Citizen science↗

Probing Sulfur Chemical and Electronic Structure with Experimental Observation and Quantitative Theoretical Prediction of Kα and Valence-to-Core Kβ X-ray Emission Spectroscopy

An extensive experimental and theoretical study of the Kα and Kβ high-resolution X-ray emission spectroscopy (XES) of sulfur-bearing systems is presented here. This study encompasses a wide range of organic and inorganic compounds, including numerous experimental spectra from both prior published work and new measurements. Employing a linear-response time-dependent density functional theory (LR-TDDFT) approach, strong quantitative agreement is found in the calculation of energy shifts of the core-to-core Kα as well as the full range of spectral features in the valence-to-core Kβ spectrum. The ability to accurately calculate the sulfur Kα energy shift supports the use of sulfur Kα XES as a bulk-sensitive tool for assessing sulfur speciation. The fine structure of the sulfur Kβ spectrum, in conjunction with the theoretical results, is shown to be sensitive to the local electronic structure including effects of symmetry, ligand type and number, and, in the case of organosulfur compounds, to the nature of the bonded organic moiety. This agreement between theory and experiment, augmented by the potential for high-access XES measurements with the latest generation of laboratory-based spectrometers, demonstrates the possibility of broad analytical use of XES for sulfur and nearby third-row elements. The effective solution of the forward problem, i.e., successful prediction of detailed spectra from known molecular structure, also suggests future use of supervised machine learning approaches to experimental inference, as has seen recent interest for interpretation of X-ray absorption near-edge structure (XANES).

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Enhancing Nanoparticle Detection in Interferometric Scattering (iSCAT) Microscopy Using a Mask R-CNN

Interferometric scattering microscopy (iSCAT) is a label-free optical microscopy technique that enables imaging of individual nano-objects such as nanoparticles, viruses, and proteins. Essential to this technique is the suppression of background scattering and identification of signals from nano-objects. In the presence of substrates with high roughness, scattering heterogeneities in the background, when coupled with tiny stage movements, cause features in the background to be manifested in background-suppressed iSCAT images. Traditional computer vision algorithms detect these background features as particles, limiting the accuracy of object detection in iSCAT experiments. Here, in this paper, we present a pathway to improve particle detection in such situations using supervised machine learning via a mask region-based convolutional neural network (mask R-CNN). Using a model iSCAT experiment of 19.2 nm gold nanoparticles adsorbing to a rough layer-by-layer polyelectrolyte film, we develop a method to generate labeled datasets using experimental background images and simulated particle signals and train the mask R-CNN using limited computational resources via transfer learning. We then compare the performance of the mask R-CNN trained with and without inclusion of experimental backgrounds in the dataset against that of a traditional computer vision object detection algorithm, Haar-like feature detection, by analyzing data from the model experiment. Results demonstrate that including representative backgrounds in training datasets improved the mask R-CNN in differentiating between background and particle signals and elevated performance by markedly reducing false positives. The methodology for creating a labeled dataset with representative experimental backgrounds and simulated signals facilitates the application of machine learning in iSCAT experiments with strong background scattering and thus provides a useful workflow for future researchers to improve their image processing capabilities.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Maximum Entropy Theory of Multiscale Coarse-Graining via Matching Thermodynamic Forces: Application to a Molecular Crystal (TATB)

The MSCG/FM (multiscale coarse-graining via force-matching) approach is an efficient supervised machine learning method to develop microscopically informed coarse-grained (CG) models. Here we present a theory based on the principle of maximum entropy (PME) enveloping the existing MSCG/FM approaches. This theory views the MSCG/FM method as a special case of matching the thermodynamic forces from the extended ensemble described by the set of thermodynamic (relevant) system coordinates. This set may include CG coordinates, the stress tensor, applied external fields, and so forth, and may be characterized by nonequilibrium conditions. Following the presentation of the theory, we discuss the consistent matching of both bonded and nonbonded interactions. The proposed PME formulation is used as a starting point to extend the MSCG/FM method to the constant strain ensemble, which together with the explicit matching of the bonded forces is better suited for coarse-graining anisotropic media at a submolecular resolution. The theory is demonstrated by performing the fine coarse-graining of crystalline 1,3,5-triamino-2,4,6-trinitrobenzene (TATB), a well-known insensitive molecular energetic material, which exhibits highly anisotropic mechanical properties.

1,3,5-triamino-2,4,6-trinitrobenzene↗

PreMevE Update: Forecasting Ultra-Relativistic Electrons Inside Earth's Outer Radiation Belt

Energetic electrons inside Earth's Van Allen belts pose a major radiation threat to spaceborne electronics that often play vital roles in modern society. Ultra-relativistic electrons with energies greater than or equal to two megaelectron-volt (MeV) are of particular interest, and thus forecasting these ≥2 MeV electrons has a significant meaning to all space sectors. Here, we update the latest development of the predictive model for MeV electrons in the outer radiation belt. The new version, called PREdictive MEV Electron (PreMevE)-2E, forecasts ultra-relativistic electron flux distributions across the outer belt, with no need for in situ measurements of the trapped MeV electron population except at the geosynchronous orbit (GEO). Model inputs include precipitating electrons observed in low-Earthorbits by NOAA satellites, upstream solar wind speeds and densities from solar wind monitors, as well as ultra-relativistic electrons measured by one Los Alamos GEO satellite. We evaluated 32 supervised machine learning models that fall into four different classes of linear and neural network architectures, and successfully tested ensemble forecasting by using groups of top-performing models. All models are individually trained, validated, and tested by in situ electron data from NASA's Van Allen Probes mission. It is shown that the final ensemble model outperforms individual models at most L-shells, and this PreMevE-2E model can provide 25-h (~1-day) and 50-h (~2-day) forecasts with high mean performance efficiency and correlation values. Our results also suggest that this new model is dominated by nonlinear components at L-shells <~4 for ultra-relativistic electrons, different from the dominance of linear components for 1 MeV electrons as previously discovered.

79 ASTRONOMY AND ASTROPHYSICS↗

Neural Network‐Based Methods for Ocean Surface Wave Measurement Using Submarine Distributed Acoustic Sensing (DAS)

Two new data-driven models for estimating ocean surface waves from distributed acoustic sensing (DAS) submarine cable strain rate are developed using supervised machine learning on a 10-day data set collected offshore of Oliktok Point, Alaska. The new models were trained on target data from seafloor pressure moorings at three sites spaced evenly along 27.1 km of cable and were benchmarked against an empirical transfer function method previously used to estimate waves from DAS. A model which uses convolutional neural networks to transform 2-km frequency-wavenumber strain spectra to seafloor pressure spectra outperforms the benchmark in wave height prediction (RMSE of 0.15 vs. 0.41 m) and period prediction (0.29 vs. 0.37 s) when evaluated on a held-out test data set. When applied to a DAS data set collected on the same cable 2 years prior, the CNN-based model maintained similar significant wave height performance (RMSE = 0.23 m) relative to available satellite altimetry data. A two-hidden-layer, fully connected neural network which transforms 1-D strain spectra to seafloor pressure spectra also outperforms the benchmark in wave height prediction (RMSE of 0.19 vs. 0.41 m), but does not generalize as well to the prior data. Regression-based machine learning is useful for estimating waves from DAS data when the pressure-strain relationship varies temporally and spatially across different wave conditions. Models can be applied to DAS data to measure waves with higher spatial resolution and longer temporal coverage than traditional methods, which often measure waves only at a single point.

Davis, Jacob R. [Univ. of Washington, Seattle, WA ↗

Label-free nanoscopy of cell metabolism by ultrasensitive reweighted visible stimulated Raman scattering

Nanoscopic imaging of cell metabolism is hindered by the incompatibility of small metabolites with fluorescent dyes and the limited resolution of imaging mass spectrometry. We present ultrasensitive reweighted visible stimulated Raman scattering (URV-SRS), a label-free vibrational nanoscopy technique that enables multiplexed detection of metabolic nanostructures within cells. We developed an extensively chirped spectral focusing visible SRS microscope that achieves a detection limit of 4,000 molecules and introduced a self-supervised learning-based denoiser to robustly suppress non-independent SRS noise by over 7.2 dB. The instrumentation-based signal enhancement and computation-based noise suppression synergistically improved the detection sensitivity by 50 times over near-infrared SRS. Leveraging this enhanced sensitivity, we further pushed the resolution to nanoscopic levels by introducing Fourier reweighting to amplify sub-100 nm spatial frequencies previously overwhelmed by noise. Validated by Fourier ring correlation, URV-SRS achieves a lateral resolution of 86 nm in cellular imaging. Here, we applied URV-SRS to elucidate the reprogramming of metabolic nanostructures associated with virus replication in Vero E6 host cells and to compositionally delineate subcellular fatty acid synthesis in engineered Escherichia coli, demonstrating its capability towards nanoscopic spatial metabolomics.

59 BASIC BIOLOGICAL SCIENCES↗

Structure of chalcogen overlayers on Au(111): Density functional theory and lattice-gas modeling

Ordering of different chalcogens, S, Se, and Te, on Au(111) exhibit broad similarities but also some distinct features, which must reflect subtle differences in relative values of the long-range pair and many-body lateral interactions between adatoms. We develop lattice-gas (LG) models within a cluster expansion framework, which includes about 50 interaction parameters. These LG models are developed based on density functional theory (DFT) analysis of the energetics of key adlayer configurations in combination with the Monte Carlo (MC) simulation of the LG models to identify statistically relevant adlayer motifs, i.e., model development is based entirely on theoretical considerations. The MC simulation guides additional DFT analysis and iterative model refinement. Given their complexity, development of optimal models is also aided by strategies from supervised machine learning. The model for S successfully captures ordering motifs over a broader range of coverage than achieved by previous models, and models for Se and Te capture the features of ordering, which are distinct from those for S. More specifically, the modeling for all three chalcogens successfully explains the linear adatom rows (also subtle differences between them) observed at low coverages of ~0.1 monolayer. The model for S also leads to a new possible explanation for the experimentally observed phase with a (5 × 5)-type low energy electron diffraction (LEED) pattern at 0.28 ML and to predictions for LEED patterns that would be observed with Se and Te at this coverage.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Waveform retrieval for ultrafast applications based on convolutional neural networks

Electric field waveforms of light carry rich information about dynamical events on a broad range of timescales. The insight that can be reached from their analysis, however, depends on the accuracy of retrieval from noisy data. In this article, we present a novel approach for waveform retrieval based on supervised deep learning. We demonstrate the performance of our model by comparison with conventional denoising approaches, including wavelet transform and Wiener filtering. The model leverages the enhanced precision obtained from the nonlinearity of deep learning. The results open a path toward an improved understanding of physical and chemical phenomena in field-resolved spectroscopy.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Extended Fayans energy density functional: optimization and analysis

The Fayans energy density functional (EDF) has been very successful in describing global nuclear properties (binding energies, charge radii, and especially differences of radii) within nuclear density functional theory. In a recent study, supervised machine learning methods were used to calibrate the Fayans EDF. Building on this experience, in this work we explore the effect of adding isovector pairing terms, which are responsible for different proton and neutron pairing fields, by comparing a 13D model without the isovector pairing term against the extended 14D model. At the heart of the calibration is a carefully selected heterogeneous dataset of experimental observables representing ground-state properties of spherical even–even nuclei. To quantify the impact of the calibration dataset on model parameters and the importance of the new terms, we carry out advanced sensitivity and correlation analysis on both models. The extension to 14D improves the overall quality of the model by about 30%. The enhanced degrees of freedom of the 14D model reduce correlations between model parameters and enhance sensitivity.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

A Morphological Model to Separate Resolved–Unresolved Sources in the DESI Legacy Surveys: Application in the LS4 Alert Stream

Separating resolved and unresolved sources in large imaging surveys is a fundamental step to enable downstream science, such as searching for extragalactic transients in wide-field time-domain surveys. Here we present our method to effectively separate point sources from the resolved, extended sources in the Dark Energy Spectroscopic Instrument (DESI) Legacy Surveys (LS). We develop a supervised machine learning model based on the Gradient Boosting algorithm XGBoost. The features input to the model are purely morphological and are derived from the tabulated LS data products. We train the model using ∼2 × 10 5 LS sources in the COSMOS field with HST morphological labels and evaluate the model performance on LS sources with spectroscopic classification from the DESI Data Release 1 (∼2 × 10 7 objects) and the Sloan Digital Sky Survey Data Release 17 (∼3 × 10 6 objects), as well as on ∼2 × 10 8 Gaia stars. A significant fraction of LS sources are not observed in every LS filter, and we therefore build a “Hybrid” model as a linear combination of two XGBoost models, each containing features combining aperture flux measurements from the “blue” (gr) and “red” (iz) filters. The Hybrid model shows a reasonable balance between sensitivity and robustness, and achieves higher accuracy and flexibility compared to the LS morphological typing. With the Hybrid model, we provide classification scores for ∼3 × 10 9 LS sources, making this the largest ever machine learning catalog separating resolved and unresolved sources. The catalog has been incorporated into the real-time pipeline of the La Silla Schmidt Southern Survey (LS4), enabling the identification of extragalactic transients within the LS4 alert stream.

astrostatistics↗

Discovery of two bright high-redshift gravitationally lensed quasars revealed by Gaia

We present the discovery and preliminary characterisation of two high-redshift gravitationally lensed quasar systems in Gaia Data Release 2 (DR2). Candidates with multiple close-separation Gaia detections and quasar-like colours in WISE, Pan-STARRS, and DES are selected for follow-up spectroscopy with the New Technology Telescope. We confirm DES J215028.71-465251.3 as a $z$ = 4.130 ± 0.006 asymmetric, doubly imaged lensed quasar system and model the lensing mass distribution as a singular isothermal sphere. The system has an Einstein radius of 1.202 ± 0.005 arcsec and a predicted time delay of ~122.0 d between the quasar images, assuming a lensing galaxy redshift of $z$ = 0.5, making this a priority system for future optical monitoring. We confirm PS J042913.17+142840.9 as a $z$ = 3.866 ± 0.003 four-image quasar system in a cusp configuration, lensed by two foreground galaxies. The system is well modelled using a singular isothermal ellipsoid for the primary lens and a singular isothermal sphere for the secondary lens with Einstein radii 0.704 ± 0.006 and 0.241 ± 0.030 arcsec, respectively. A maximum predicted time delay of 9.6 d is calculated, assuming lensing galaxy redshifts of $z$ = 1.0. Furthermore, PS J042913.17+142840.9 exhibits a large flux ratio anomaly, up to a factor of 2.66 ± 0.37 in i band, that varies across optical and near-infrared wavelengths. We discuss LSST and its implications for future high-redshift lens searches and outline an extension to the search using supervised machine learning techniques.

Astronomy & Astrophysics↗

Pushing automated morphological classifications to their limits with the Dark Energy Survey

ABSTRACT We present morphological classifications of ∼27 million galaxies from the Dark Energy Survey (DES) Data Release 1 (DR1) using a supervised deep learning algorithm. The classification scheme separates: (a) early-type galaxies (ETGs) from late-type galaxies (LTGs); and (b) face-on galaxies from edge-on. Our convolutional neural networks (CNNs) are trained on a small subset of DES objects with previously known classifications. These typically have mr ≲ 17.7 mag; we model fainter objects to mr < 21.5 mag by simulating what the brighter objects with well-determined classifications would look like if they were at higher redshifts. The CNNs reach 97 per cent accuracy to mr < 21.5 on their training sets, suggesting that they are able to recover features more accurately than the human eye. We then used the trained CNNs to classify the vast majority of the other DES images. The final catalogue comprises five independent CNN predictions for each classification scheme, helping to determine if the CNN predictions are robust or not. We obtain secure classifications for ∼87 per cent and 73 per cent of the catalogue for the ETG versus LTG and edge-on versus face-on models, respectively. Combining the two classifications (a) and (b) helps to increase the purity of the ETG sample and to identify edge-on lenticular galaxies (as ETGs with high ellipticity). Where a comparison is possible, our classifications correlate very well with Sérsic index (n), ellipticity (ϵ), and spectral type, even for the fainter galaxies. This is the largest multiband catalogue of automated galaxy morphologies to date.

79 ASTRONOMY AND ASTROPHYSICS↗

Optimal transport for 𝑒/𝜋 0 particle classification in LArTPC neutrino experiments

The efficient classification of electromagnetic activity from 𝜋 0 and electrons remains an open problem in the reconstruction of neutrino interactions in liquid argon time projection chamber (LArTPC) detectors. We address this problem using the mathematical framework of optimal transport (OT), which has been successfully employed for event classification in other high energy physics contexts and is ideally suited to the high-resolution calorimetry of LArTPCs. Using a publicly available simulated dataset from the MicroBooNE Collaboration, we show that OT methods achieve state-of-the-art reconstruction performance in 𝑒/𝜋 0 classification. The success of this first application indicates the broader promise of OT methods for LArTPC-based neutrino experiments.

Neutrino detection↗

Autonomous Tuning and Charge-State Detection of Gate-Defined Quantum Dots

Defining quantum dots in semiconductor-based heterostructures is an essential step in initializing solid-state qubits. With growing device complexity and increasing number of functional devices required for measurements, a manual approach to finding suitable gate voltages to confine electrons electrostatically is impractical. Here, we implement a two-stage device characterization and dot-tuning process, which first determines whether devices are functional and then attempts to tune the functional devices to the single or double quantum-dot regime. We show that automating well-established manual-tuning procedures and replacing the experimenter’s decisions by supervised machine learning is sufficient to tune double quantum dots in multiple devices without premeasured input or manual intervention. The quality of measurement results and charge states are assessed by four binary classifiers trained with experimental data, reflecting real device behavior. We compare and optimize eight models and different data preprocessing techniques for each of the classifiers to achieve reliable autonomous tuning, an essential step towards scalable quantum systems in quantum-dot-based qubit architectures.

Darulova, J↗

VoroClust: Scalable Clustering for Remote Sensing

Although supervised machine learning provides a powerful framework for image classification and segmentation, it requires comprehensive consistent datasets, which are not available for many remote-sensing applications. Remote-sensing datasets are expensive to collect, and each is acquired under different environmental conditions or with significant variations in system operating parameters. Unsupervised clustering algorithms analyze the structure of each dataset independently, rather than drawing on similarities with existing “training” examples, and are thus well suited for practical remote-sensing applications. We introduce VoroClust, a fast density-based unsupervised clustering algorithm applicable to high-resolution and high-dimensional data. VoroClust runs as fast as distance-based clustering methods, while capturing complex regional geometries at least as well as current-density-based methods. It uses a data-centered sphere cover to reduce computational demands, while still capturing data topology. It then propagates clusters outward from local peaks in density. We show that VoroClust provides fast state-of-the-art clustering for both high-resolution polarimetric synthetic aperture radar and high-dimensional hyperspectral imaging datasets.

42 ENGINEERING↗

Hierarchical Convolutional Neural Networks for Event Classification on PMU Measurements

Event classification is one of the central components of automated disturbance analysis based on PMU measurements. Obtaining high-quality event labels remains a challenge for supervised learning-based classification of local and system-wide events in power grids due to its labor-intensive requirement. We present a sensitivity study considering rapidly refined, partially and fully inspected event labels that leads to evidence that hierarchical convolutional neural networks (HCNNs) outperform traditional classification models regardless of the quality of the available event labels. Furthermore, it is demonstrated that performance similar to the one obtained using entirely domain-driven labeling can be achieved as long as the involved expert does not mislabel more than ~5% of the event data captured by PMU measurements.

47 OTHER INSTRUMENTATION↗