SEARCH · Engineering Papers

Results for “Feature Space”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

All sources NASA NTRS DOE OSTI

DOE OSTI2022

Nonlocal Kernel Network (NKN): a Stable and Resolution-Independent Deep Neural Network.

Neural operators have recently become popular tools for designing solution maps between function spaces in the form of neural networks. Differently from classical scientific machine learning approaches that learn parameters of a known partial differential equation (PDE) for a single instance of the input parameters at a fixed resolution, neural operators approximate the solution map of a family of PDEs [6, 7]. Despite their success, the uses of neural operators are so far restricted to relatively shallow neural networks and confined to learning hidden governing laws. In this work, we propose a novel nonlocal neural operator, which we refer to as nonlocal kernel network (NKN), that is resolution independent, characterized by deep neural networks, and capable of handling a variety of tasks such as learning governing equations and classifying images. Our NKN stems from the interpretation of the neural network as a discrete nonlocal diffusion reaction equation that, in the limit of infinite layers, is equivalent to a parabolic nonlocal equation, whose stability is analyzed via nonlocal vector calculus. The resemblance with integral forms of neural operators allows NKNs to capture long-range dependencies in the feature space, while the continuous treatment of node-to-node interactions makes NKNs resolution independent. The resemblance with neural ODEs, reinterpreted in a nonlocal sense, and the stable network dynamics between layers allow for generalization of NKN’s optimal parameters from shallow to deep networks. This fact enables the use of shallow-to-deep initialization techniques [8]. Our tests show that NKNs outperform baseline methods in both learning governing equations and image classification tasks and generalize well to different resolutions and depths.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2023

Explainability and extrapolation of machine learning models for predicting the glass transition temperature of polymers

Abstract Machine learning (ML) offers promising tools to develop surrogate models for polymers' structure–property relations. Surrogate models can be built upon existing polymer data and are useful for rapidly predicting the properties of unknown polymers. The accuracy of such ML models appears to depend on the feature space representation of polymers, the range of training data, and learning algorithms. Here, we establish connections between these factors for predicting the glass transition temperature (T g ) of polymers. Our analysis suggests linear models with fewer fitting parameters are as accurate as nonlinear models with many hidden and unexplainable parameters. Also, the performance of a monomer topology‐based ML model is found to be qualitatively identical to that of a physicochemical descriptor‐based ML model. We find that the ML models's performance in the extrapolative region is enhanced as the property range of the training data increases. Moreover, we establish newT g – polymer chemistry correlations via ML. Our work illustrates how ML can advance the fundamental understanding of polymer structure–property correlations and its efficacy for extrapolation problems.

Polymer Science↗

DOE OSTI2023

Uncovering acoustic signatures of pore formation in laser powder bed fusion

Abstract We present a machine learning workflow to discover signatures in acoustic measurements that can be utilized to create a low-dimensional model to accurately predict the location of keyhole pores formed during additive manufacturing processes. Acoustic measurements were sampled at 100 kHz during single-layer laser powder bed fusion (LPBF) experiments, and spatio-temporal registration of pore locations was obtained from post-build radiography. Power spectral density (PSD) estimates of the acoustic data were then decomposed using non-negative matrix factorization with custom $$\varvec{k}$$ k -means clustering (NMF $$\varvec{k}$$ k ) to learn the underlying spectral patterns associated with pore formation. NMF $$\varvec{k}$$ k returned a library of basis signals and matching coefficients to blindly construct a feature space based on the PSD estimates in an optimized fashion. Moreover, the NMF $$\varvec{k}$$ k decomposition led to the development of computationally inexpensive machine learning models which are capable of quickly and accurately identifying pore formation with classification accuracy of supervised and unsupervised label learning greater than 95% and 90%, respectively. The intrinsic data compression of NMF k , the relatively light computational cost of the machine learning workflow, and the high classification accuracy makes the proposed workflow an attractive candidate for edge computing toward in-situ keyhole pore prediction in LPBF.

36 MATERIALS SCIENCE↗

DOE OSTI2022

Efficient machine-learning model for fast assessment of elastic properties of high-entropy alloys

We combined descriptor-based analytical models for stiffness-matrix and elastic-moduli with mean-field methods to accelerate assessment of technologically useful properties of high-entropy alloys, such as strength and ductility. Model training for elastic properties uses Sure-Independence Screening (SIS) and Sparsifying Operator (SO) method yielding an optimal analytical model, constructed with meaningful atomic features to predict target properties. Computationally inexpensive analytical descriptors were trained using a database of elastic properties determined from density functional theory for binary and ternary subsets of Nb-Mo-Ta-W-V refractory alloys. The optimal Elastic-SISSO models, extracted from an exponentially large feature space, give an extremely accurate prediction of target properties, similar to or better than other models, with some verified from existing experiments. Here we also show that electronegativity variance and elastic-moduli can directly predict trends in ductility and yield strength of refractory HEAs, and reveals promising alloy concentration regions.

36 MATERIALS SCIENCE↗

DOE OSTI2021

Machine learning elastic constants of multi-component alloys

The present manuscript explores application of machine learning methods for determining elastic constants and other derived mechanical properties of multi-component alloys. Here, a number of machine learning models, including linear regression, neural network and random forest based models, are trained and tested on a dataset of binary alloys generated using density functional theory (DFT) calculations and spanning over a large number of elemental species in the periodic table. Starting with a wide range of simple and easily accessible compositionally-averaged elemental features, a correlation-based feature selection strategy was used to systematically down-select a set of most relevant features towards the prediction of the elasticity tensor components. The true predictive performance and the associated uncertainties of the models were established by testing on unseen data and bootstrapping, respectively. A single and pair-wise feature partial dependence analysis was performed to visualize the average property trends in the multi-dimensional feature space in order to further understand the achieved predictive performance. The utility of the trained model is further demonstrated by obtaining sufficiently accurate yet highly efficient approximations for bulk modulus, Young’s modulus, shear modulus and Poisson’s ratio for alloys beyond the binary space (i.e., two-component alloys) on which the model was originally trained. More importantly, we test and validate the predictive performance of the developed model directly against the experimentally measured elastic constants of technologically relevant multi-component alloys (such as, Ni- and Ti-based alloys). Finally, utility of such a data-enabled route is demonstrated by predicting the possible range of various elastic properties for vast composition space available within the five component Ni-Cr-Fe-Mo-W alloy system in a high-throughput manner.

36 MATERIALS SCIENCE↗

DOE OSTI2026

A two-stage optical fusion framework for wildfire severity mapping across the conterminous United States

Accurate wildfire severity mapping (WSM) is essential for post-fire recovery planning, erosion risk assessment, ecosystem monitoring, and disaster risk reduction. Although Landsat and Sentinel optical imagery have been widely used for burn severity assessment, the added value of fusing multiple optical sensors has not been sufficiently quantified across diverse fire events, particularly since the launch of Landsat-9. This study evaluates whether multisensor optical fusion improves wildfire severity mapping relative to single-sensor baselines using Sentinel-2, Landsat-8, and Landsat-9 imagery across 40 wildfire events in the conterminous United States. We tested a two-stage fusion framework that combines feature-level fusion with pixel-level dimensionality reduction. First, feature-level fused datasets were created through early fusion by combining standardized post-fire bands from each sensor into a single predictor stack. Both raw reflectance bands and pairwise spectral transforms were retained to capture within- and cross-sensor spectral interactions. Second, Linear Discriminant Analysis was applied to both single-sensor and fused datasets to produce comparable low-dimensional feature spaces. Six machine-learning classifiers were then used to benchmark model performance with repeated spatially buffered train–test splits. Results show that Landsat-9 was the strongest single-sensor baseline. Among the fusion strategies, Sentinel-2 + Landsat-9 produced the most consistent improvement and reduced performance variability. Landscape-condition analysis further showed that this fusion was most beneficial in shrubland-dominated and high-terrain fires, where it achieved the highest overall mean accuracy and the fewest failures. In contrast, its benefits were less reliable in evergreen forests, mixed vegetation, and low- to moderate-elevation terrain. In operational settings, the Sentinel-2 + Landsat-9 configuration offers a practical solution for post-fire recovery planning, erosion-risk assessment, watershed management, and ecological monitoring when field observations are available and timely satellite-based information is needed.

Landsat↗

DOE OSTI2025

Temporally-consistent koopman autoencoders for forecasting dynamical systems

Absence of sufficiently high-quality data often poses a key challenge in data-driven modeling of high-dimensional spatio-temporal dynamical systems. Koopman Autoencoders (KAEs) harness the expressivity of deep neural networks (DNNs), the dimension reduction capabilities of autoencoders, and the spectral properties of the Koopman operator to learn a reduced-order feature space with simpler, linear dynamics. However, the effectiveness of KAEs is hindered by limited and noisy training datasets, leading to poor generalizability. To address this, we introduce the Temporally-Consistent Koopman Autoencoder (tcKAE), designed to generate accurate long-term predictions even with limited and noisy training data. This is achieved through a consistency regularization term that enforces prediction coherence across different time steps, thus enhancing the robustness and generalizability of tcKAE over existing models. We provide analytical justification for this approach based on Koopman spectral theory and empirically demonstrate tcKAE’s superior performance over state-of-the-art KAE models across a variety of test cases, including simple pendulum oscillations, kinetic plasma, and fluid flow data.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

DOE OSTI2025

Building workflows for an interactive human-in-the-loop automated experiment (hAE) in STEM-EELS

Exploring the structural, chemical, and physical properties of matter on the nano- and atomic scales has become possible with the recent advances in aberration-corrected electron energy-loss spectroscopy (EELS) in scanning transmission electron microscopy (STEM). However, the current paradigm of STEM-EELS relies on the classical rectangular grid sampling, in which all surface regions are assumed to be of equal a priori interest. However, this is typically not the case for real-world scenarios, where phenomena of interest are concentrated in a small number of spatial locations, such as interfaces, structural and topological defects, and multi-phase inclusions. One of the foundational problems is the discovery of nanometer- or atomic-scale structures having specific signatures in EELS spectra. Herein, we systematically explore the hyperparameters controlling deep kernel learning (DKL) discovery workflows for STEM-EELS and identify the role of the local structural descriptors and acquisition functions in experiment progression. In agreement with the actual experiment, we observe that for certain parameter combinations the experiment path can be trapped in the local minima. We demonstrate the approaches for monitoring the automated experiment in the real and feature space of the system and knowledge acquisition of the DKL model. Based on these, we construct intervention strategies defining the human-in-the-loop automated experiment (hAE). This approach can be further extended to other techniques including 4D STEM and other forms of spectroscopic imaging. The hAE library is available on Github at https://github.com/utkarshp1161/hAE/tree/main/hAE.

Pratiush, Utkarsh [Univ. of Tennessee, Knoxville, ↗

DOE OSTI2024

Wavefront distortion correction in scanning tunneling microscope image

Here, we report an algorithm to identify and correct distorted wavefronts in atomic resolution scanning tunneling microscope images. This algorithm can be used to correct nonlinear in-plane distortions without prior knowledge of the physical scanning parameters, the characteristics of the piezoelectric actuator, or individual atom positions. The 2D image is first defined as a sum of sinusoidal plane waves, where a nonlinear distortion renders a curve for an otherwise ideal linear wavefront. Using the Fourier transforms of local areas of the image, the algorithm generates a wavefront vector field. The identified wavefronts are subsequently linearized for each plane wave without changing lattice orders, giving rise to distortion corrections. Our algorithm is complementary to conventional post-processing algorithms that require prior detection of real space features, which can also be used to correct nonlinear distortions in 2D images acquired by other microscopy techniques.

47 OTHER INSTRUMENTATION↗

DOE OSTI2026

Suppressing proximity effects during rapid serial two-photon lithography through tuning of reaction–diffusion kinetics

The ability of two-photon lithography (TPL) to print deterministic nanoporous 3D structures is highly valuable for many applications. However, it is challenging to print such structures rapidly due to the proximity effects that cause closely spaced features to enlarge and merge. A key challenge is the limited understanding of the origins and spatiotemporal dynamics of the long-range proximity effects that extend beyond the optical focal spot. Here, we empirically investigate these proximity effects in serial TPL using custom-made acrylate-based photoresists. We demonstrate that the complex spatiotemporal dynamics of the proximity effects can be explained through the kinetics of the reaction–diffusion photopolymerization mechanisms that underlie the curing process. Specifically, we show that the proximity effects arise due to comparable timescales of reaction and diffusion of oxygen. Furthermore, we demonstrate that long-range proximity effects can be suppressed by introducing phenolic inhibitors, which reduce oxygen consumption through non-inhibiting side reactions and promote faster termination of curing reactions. These insights enabled improving the linewidths from >400 to 260 nm during printing of nanoporous 3D woodpiles at scanning speeds of 50 mm s −1 . Thus, the knowledge generated here can be applied to deterministically tune the proximity effects and enable rapid printing of high-resolution nanoporous 3D structures.

36 MATERIALS SCIENCE↗

DOE OSTI2025

Achievement of highly radiating plasma in negative triangularity and effect of reactor-relevant seeded impurities on confinement and transport

The first achievement of highly radiating plasmas in negative triangularity (NT) is shown with an operational space featuring high core radiation at high Greenwald fraction obtained with the injection of reactor-relevant seeded gases. These NT shape diverted discharges reach high values of normalized plasma pressure ( β N > 2) at high radiation fraction with no edge localized modes (ELMs) and a simultaneous reduction of the divertor heat flux. Here, we demonstrate that as long as the impurity level in the core is kept low to avoid excessive fuel dilution and impurity accumulation, integration of NT configuration with high radiation fraction not only is achievable but it can lead to confinement improvement with stabilization effects originating from collisionality, E × B shear and profiles changes due to impurity radiation cooling. The underlying physics mechanism is robust and reproducible and holds for a variety of impurity species. The absence of the requirement to stay in H-mode translates in a higher core radiation fraction potentially allowed in NT shape effectively mitigating the power exhaust issue. The results presented here demonstrate a path to high performance, ELM free and highly radiative regime with reactor-relevant seeding gases making this regime a potential new scenario for reactor design.

confinement improvement↗

DOE OSTI2023

Deep Multimodal Networks for M-type Star Classification with Paired Spectrum and Photometric Image

Abstract Traditional stellar classification methods include spectral and photometric classification separately. Although satisfactory results can be achieved, the accuracy could be improved. In this paper, we pioneer a novel approach to deeply fuse the spectra and photometric images of the sources in an advanced multimodal network to enhance the model’s discriminatory ability. We use Transformer as the fusion module and apply a spectrum–image contrastive loss function to enhance the consistency of the spectrum and photometric image of the same source in two different feature spaces. We perform M-type stellar subtype classification on two data sets with high and low signal-to-noise ratio (S/N) spectra and corresponding photometric images, and the F1-score achieves 95.65% and 90.84%, respectively. In our experiments, we prove that our model effectively utilizes the information from photometric images and is more accurate than advanced spectrum and photometric image classifiers. Our contributions can be summarized as follows: (1) We propose an innovative idea for stellar classification that allows the model to simultaneously consider information from spectra and photometric images. (2) We discover the challenge of fusing low-S/N spectra and photometric images in the Transformer and provide a solution. (3) The effectiveness of Transformer for spectral classification is discussed for the first time and will inspire more Transformer-based spectral classification models.

Astronomy & Astrophysics↗

DOE OSTI2024

Simultaneous access to high normalized density, current, pressure, and confinement in strongly-shaped diverted negative triangularity plasmas

Strongly-shaped diverted negative triangularity (NT) plasmas in the DIII-D tokamak demonstrate simultaneous access to high normalized density, current, pressure, and confinement. NT plasmas are shown to exist across an expansive parameter space compatible with high fusion power production, revealing surprisingly good core stability properties that compare favorably to conventional positive triangularity plasmas in DIII-D. Non-dimensionalizing the key parameters, expanded operating spaces featuring edge safety factors below 3, normalized betas above 3, Greenwald density fractions above 1, and high-confinement mode (H-mode) confinement qualities above 1 are observed, even simultaneously, and all with a robustly stable edge free from deleterious edge-localized mode instabilities. Scaling of the confinement time with engineering parameters reveals at least a linear dependence on plasma current although with significant power degradation, both in excess of expected H-mode scalings. These results increase confidence that NT plasmas are a viable approach to realize fusion power and open directions for future detailed study.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

DOE OSTI2024

Human-in-the-Loop: The Future of Machine Learning in Automated Electron Microscopy

Machine learning (ML) methods are progressively gaining acceptance in the electron microscopy community for de-noising, semantic segmentation, and dimensionality reduction of data post-acquisition. The introduction of the application programming interfaces (APIs) by major instrument manufacturers now allows the deployment of ML workflows in microscopes, not only for data analytics but also for real-time decision-making and feedback for microscope operation. However, the number of use cases for real-time ML remains remarkably small. Furthermore, we discuss some considerations in designing ML-based active experiments and pose that the likely strategy for the next several years will be human-in-the-loop automated experiments (hAE). In this paradigm, the ML learning agent directly controls beam position and image and spectroscopy acquisition functions, and a human operator monitors experiment progression in real and feature space of the system and tunes the policies of the ML agent to steer the experiment toward specific objectives.

47 OTHER INSTRUMENTATION↗

DOE OSTI2022

A machine learning approach to photometric metallicities of giant stars

ABSTRACT Despite the advances provided by large-scale photometric surveys, stellar features – such as metallicity – generally remain limited to spectroscopic observations often of bright, nearby low-extinction stars. To rectify this, we present a neural network approach for estimating the metallicities and distances of red giant stars with 8-band photometry and parallaxes from Gaia EDR3 and the 2MASS and WISE surveys. The algorithm accounts for uncertainties in the predictions arising from the range of possible outputs at each input and from the range of models compatible with the training set (through drop-out). A two-stage procedure is adopted where an initial network to estimate photoastrometric parallaxes is trained using a large sample of noisy parallax data from Gaia EDR3 and then a secondary network is trained using spectroscopic metallicities from the APOGEE and LAMOST surveys and an augmented feature space utilizing the first-stage parallax estimates. The algorithm produces metallicity predictions with an average uncertainty of $\pm 0.19\, \mathrm{dex}$. The methodology is applied to stars within the Galactic bar/bulge with particular focus on a sample of 1.69 million objects with Gaia radial velocities. We demonstrate the use and validity of our approach by inspecting both spatial and kinematic gradients with metallicity in the Galactic bar/bulge recovering previous results on the vertical metallicity gradient (−0.528 ± 0.002 dex kpc−1) and the vertex deviation of the bar ($-21.29\pm 2.74\, \mathrm{deg}$).

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2023

Phase-resolved terahertz nanoimaging of W Te 2 microcrystals

The terahertz (THz) electrodynamics of few-layer W⁢Te 2 is dominated by the plasmon response. However, THz surface plasmons (SPs) with long wavelengths in two-dimensional exfoliated crystals are typically confined by the lateral geometry. Direct visualization of the plasmonic standing wave patterns is challenging due to the spatial confinement and low quality factor of the SP, especially for samples that are only a few monolayers thick. Here, we resolve subtle real-space features of the plasmonic response of W⁢Te 2 by augmenting more common scattering amplitude experiments with the phase contrast accomplished within the time-domain version of THz nanoimaging. Amplitude and phase images allow us to quantitatively evaluate the evolution of the plasmonic response at cryogenic temperatures in samples with variable thickness from 3 to 12 monolayers. Further, the proposed imaging modality is universally applicable to the THz near-field nanoscopy of low-dimensional materials.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

DOE OSTI2022

Nuclear masses learned from a probabilistic neural network

Machine learning methods and uncertainty quantification have been gaining interest throughout the last several years in low-energy nuclear physics. In particular, Gaussian processes and Bayesian neural networks have increasingly been applied to improve mass model predictions while providing well-quantified uncertainties. In this work, we use the probabilistic Mixture Density Network (MDN) to directly predict the mass excess of the 2016 Atomic Mass Evaluation within the range of measured data, and we extrapolate the inferred models beyond available experimental data. The MDN provides not only mean values but also full posterior distributions both within the training set and extrapolated testing set. We show that the addition of physical information to the feature space increases the accuracy of the match to the training data as well as provides for more physically meaningful extrapolations beyond the the limits of experimental data.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2023

Coupling of magnetism, crystal lattice, and transport in EuCuP and EuCuAs

EuCuP and EuCuAs are members of a family of materials with candidates for realizing magnetically tuned electronic topology. Here, in this work, the magnetic phase transitions and magnetoelastic coupling of EuCuP and EuCuAs have been investigated. Around the Curie temperature, the thermal expansion coefficient and specific-heat capacity of EuCuP are found to have two closely spaced features, at approximately 30 and 31.3 K, which may indicate a cascading magnetic transition or perhaps an electronic transition closely coupled to the magnetic ordering. The zero-field magnetoelastic coupling appears to be stronger in EuCuP than in EuCuAs, and field-dependent measurements suggest this is due to the dominant ferromagnetic interaction in EuCuP as opposed to antiferromagnetic order in EuCuAs below T N =13.5 K. Thermal expansion is anisotropic around T N in EuCuAs, with a maximum expansion along [001] occurring above T N prior to a stiffening of this c -axis component on cooling through T N ; the expansion of the basal plane has a lambda-like peak centered slightly above T N . Matching these behaviors, the ac susceptibility data for EuCuAs suggest the presence of strong ferromagnetic correlations above T N in the vicinity where the c-axis expansion peaks. Both compounds possess similar electrical and thermoelectric transport behaviors, with short-range magnetic order likely playing an important role above T C or T N . Transport properties suggest these are predominantly hole doped due to intrinsic defects, and narrow-gap semiconducting or semimetallic behavior may be achievable if the underlying defects can be tuned.

36 MATERIALS SCIENCE↗