SEARCH · Engineering Papers

Results for “Feature Space”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 397 records · Page 22

All sources NASA NTRS DOE OSTI

DOE OSTI2021

Evaluating causal‐based feature selection for fuel property prediction models

Abstract In‐silico screening of novel biofuel molecules based on chemical and fuel properties is a critical first step in the biofuel evaluation process due to the significant volumes of samples required for experimental testing, the destructive nature of engine tests, and the costs associated with bench‐scale synthesis of novel fuels. Predictive models are limited by training sets of few existing measurements, often containing similar classes of molecules that represent just a subset of the potential molecular fuel space. Software tools can be used to generate every possible molecular descriptor for use as input features, but most of these features are largely irrelevant and training models on datasets with higher dimensionality than size tends to yield poor predictive performance. Feature selection has been shown to improve machine learning models, but correlation‐based feature selection fails to provide scientific insight into the underlying mechanisms that determine structure–property relationships. The implementation of causal discovery in feature selection could potentially inform the biofuel design process while also improving model prediction accuracy and robustness to new data. In this study, we investigate the benefits causal‐based feature selection might have on both model performance and identification of key molecular substructures. We found that causal‐based feature selection performed on par with alternative filtration methods, and that a structural causal model provides valuable scientific insights into the relationships between molecular substructures and fuel properties.

Nguyen, Bernard↗

DOE OSTI2022

Quantum model learning agent: characterisation of quantum systems through machine learning

Accurate models of real quantum systems are important for investigating their behaviour, yet are difficult to distil empirically. Here, we report an algorithm—the quantum model learning agent (QMLA)—to reverse engineer Hamiltonian descriptions of a target system. We test the performance of QMLA on a number of simulated experiments, demonstrating several mechanisms for the design of candidate Hamiltonian models and simultaneously entertaining numerous hypotheses about the nature of the physical interactions governing the system under study. QMLA is shown to identify the true model in the majority of instances, when provided with limited a priori information, and control of the experimental setup. Our protocol can explore Ising, Heisenberg and Hubbard families of models in parallel, reliably identifying the family which best describes the system dynamics. We demonstrate QMLA operating on large model spaces by incorporating a genetic algorithm to formulate new hypothetical models. The selection of models whose features propagate to the next generation is based upon an objective function inspired by the Elo rating scheme, typically used to rate competitors in games such as chess and football. In all instances, our protocol finds models that exhibit F 1 score ≥ 0.88 when compared with the true model, and it precisely identifies the true model in 72% of cases, whilst exploring a space of over 250 000 potential models. By testing which interactions actually occur in the target system, QMLA is a viable tool for both the exploration of fundamental physics and the characterisation and calibration of quantum devices.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2025

Isochronous and period-doubling diagrams for symplectic maps of the plane

Symplectic mappings of the plane serve as key models for exploring the fundamental nature of complex behavior in nonlinear systems. Central to this exploration is the effective visualization of stability regimes, which enables the interpretation of how systems evolve under varying conditions. While the area-preserving quadratic Hénon map has received significant theoretical attention, a comprehensive description of its mixed parameter-space dynamics remain lacking. This limitation arises from early attempts to reduce the full two-dimensional phase space to a one-dimensional projection, a simplification that resulted in the loss of important dynamical features. Consequently, there is a clear need for a more thorough understanding of the underlying qualitative aspects. This paper aims to address this gap by revisiting the foundational concepts of reversibility and associated symmetries, first explored in the early works of G.D. Birkhoff. We extend the original framework proposed by Hénon by adding a period-doubling diagram to his isochronous diagram, which allows to represents the system’s bifurcations and the groups of symmetric periodic orbits that emerge in typical bifurcations of the fixed point. A qualitative and quantitative explanation of the main features of the region of parameters with bounded motion is provided, along with the application of this technique to other symplectic mappings, including cases of multiple reversibility. Modern chaos indicators, such as the Reversibility Error Method (REM) and the Generalized Alignment Index (GALI), are employed to distinguish between various dynamical regimes in the mixed space of variables and parameters. These tools prove effective in differentiating regular and chaotic dynamics, as well as in identifying twistless orbits and their associated bifurcations. Additionally, we discuss the application of these methods to real-world problems, such as visualizing dynamic aperture in accelerator physics, where our findings have direct relevance.

43 PARTICLE ACCELERATORS↗

DOE OSTI2022

Feature engineering for machine learning enabled early prediction of battery lifetime

Accurate battery lifetime estimates enable accelerated design of novel battery materials and determination of optimal use protocols for longevity in deployments. Unfortunately, traditional battery testing may take years to reach thousands of cycles. Recent studies have shown that machine learning (ML) tools can predict lithium-ion battery lifetimes from 100 or fewer preliminary cycles, representing only a few weeks of cycling. Until now, conclusions about the efficacy and broad applicability of these predictions across a variety of cathode chemistries have been limited by available experimental information. In this work, we leverage a battery cycling dataset representing six cathode chemistries (NMC111, NMC532, NMC622, NMC811, HE5050, and 5Vspinel), multiple electrolyte/anode compositions, and 300 total carefully prepared pouch batteries to explore feature selection and battery chemistry's role in ML battery lifetime predictions. Here, a mean absolute error (MAE) of 78 cycles in prediction was seen for a chemistry-spanning test set from 100 preliminary cycles. Furthermore, an MAE of 103 cycles was seen when using only the first cycle. This study represents an in-depth investigation of strategies for feature selection for battery lifetime prediction, ML models' generalization across multiple battery chemistries, and predictions beyond the training set in the chemical space.

25 ENERGY STORAGE↗

DOE OSTI2022

How to see hidden patterns in metamaterials with interpretable machine learning

Machine learning models can assist with metamaterials design by approximating computationally expensive simulators or solving inverse design problems. However, past work has usually relied on black box deep neural networks, whose reasoning processes are opaque and require enormous datasets that are expensive to obtain. Here, in this work, we develop two novel machine learning approaches to metamaterials discovery that have neither of these disadvantages. These approaches, called shape-frequency features and unit-cell templates, can discover 2D metamaterials with user-specified frequency band gaps. Our approaches provide logical rule-based conditions on metamaterial unit-cells that allow for interpretable reasoning processes, and generalize well across design spaces of different resolutions. The templates also provide design flexibility where users can almost freely design the fine resolution features of a unit-cell without affecting the user’s desired band gap.

36 MATERIALS SCIENCE↗

DOE OSTI2023

Running decompactification, sliding towers, and the distance conjecture

We study towers of light particles that appear in infinite-distance limits of moduli spaces of 9-dimensional $\mathcal{N}$ = 1 string theories, some of which notably feature decompactification limits with running string coupling. The lightest tower in such decompactification limits consists of the non-BPS Kaluza-Klein modes of Type I' string theory, whose masses depend nontrivially on the moduli of the theory. We work out the moduli-dependence by explicit computation, finding that despite the running decompactification the Distance Conjecture remains satisfied with an exponential decay rate α ≥ 1 / $\sqrt{d-2}$ in accordance with the sharpened Distance Conjecture. The related sharpened Convex Hull Scalar Weak Gravity Conjecture also passes stringent tests. Our results non-trivially test the Emergent String Conjecture, while highlighting the important subtlety that decompactifcation can lead to a running solution rather than to a higher-dimensional vacuum.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

DOE OSTI2022

A comprehensive and fair comparison of two neural operators (with practical extensions) based on $\mathrm{FAIR}$ data

Neural operators can learn nonlinear mappings between function spaces and offer a new simulation paradigm for real-time prediction of complex dynamics for realistic diverse applications as well as for system identification in science and engineering. Herein, we investigate the performance of two neural operators, which have shown promising results so far, and we develop new practical extensions that will make them more accurate and robust and importantly more suitable for industrial-complexity applications. The first neural operator, DeepONet, was published in 2019 (Lu et al., 2019), and its original architecture was based on the universal approximation theorem of Chen & Chen (1995). The second one, named Fourier Neural Operator or FNO, was published in 2020, and it is based on parameterizing the integral kernel in the Fourier space. DeepONet is represented by a summation of products of neural networks (NNs), corresponding to the branch NN for the input function and the trunk NN for the output function; both NNs are general architectures, e.g., the branch NN can be replaced with a CNN or a ResNet. According to Kovachki et al. (2021), FNO in its continuous form can be viewed conceptually as a DeepONet with a specific architecture of the branch NN and a trunk NN represented by a trigonometric basis. In order to compare FNO with DeepONet computationally for realistic setups, we develop several extensions of FNO that can deal with complex geometric domains as well as mappings where the input and output function spaces are of different dimensions. We also develop an extended DeepONet with special features that provide inductive bias and accelerate training, and we present a faster implementation of DeepONet with cost comparable to the computational cost of FNO, which is based on the Fast Fourier Transform. Here we consider 16 different benchmarks to demonstrate the relative performance of the two neural operators, including instability wave analysis in hypersonic boundary layers, prediction of the vorticity field of a flapping airfoil, porous media simulations in complex-geometry domains, etc. We follow the guiding principles of FAIR (Findability, Accessibility, Interoperability, and Reusability) for scientific data management and stewardship. The performance of DeepONet and FNO is comparable for relatively simple settings, but for complex geometries the performance of FNO deteriorates greatly. We also compare theoretically the two neural operators and obtain similar error estimates for DeepONet and FNO under the same regularity assumptions.

42 ENGINEERING↗

DOE OSTI2023

VTAnDeM: A python toolkit for simultaneously visualizing phase stability, defect energetics, and carrier concentrations of materials

Phase stability, defect formation energies, and carrier concentrations are closely interrelated features of semiconductors. Due to their joint dependence on the multidimensional chemical potential space, it is challenging to quantitatively establish patterns between these quantities in a given semiconductor, especially when the semiconductor is comprised of multiple elements. To enable synchronous visualization and analysis of these complementary material properties and their interdependence, we developed the Visualization Toolkit for Analyzing Defects in Materials (VTAnDeM). This python-based toolkit allows users to interactively explore how defect formation energies and carrier concentrations vary across the composition and chemical potential spaces of multicomponent semiconductors. Here, we illustrate the computational workflow that employs VTAnDeM as a post-processing tool for first-principles calculations and describe the data organization and theory underlying the visualization scheme. Furthermore, we believe that this software will serve as a useful tool for simultaneously visualizing the often complex and non-intuitive chemical potential – defect – carrier concentration phase space of semiconductors.

36 MATERIALS SCIENCE↗

DOE OSTI2021

Neutrino non-standard interactions: Complementarity between LHC and oscillation experiments

We explore the complementarity between LHC searches and neutrino experiments in probing neutrino non-standard interactions. Our study spans the theoretical frameworks of effective field theory, simplified model and an illustrative UV completion, highlighting the synergies and distinctive features in all cases. We show that besides constraining the allowed NSI parameter space, the LHC data can break important degeneracies present in oscillation experiments such as DUNE, while the latter play an important role in probing light and weakly coupled physics undetectable at the LHC.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

DOE OSTI2023

Solution Structure and Hydration Forces between Mica and Hydrophilic Versus Hydrophobic Surfaces

Solid-liquid interfaces are central to a range of interesting phenomena including catalysis, heterogeneous nucleation, water desalination, and biomolecular assembly. While three-dimensional Fast Force Mapping (3D FFM) has emerged as a technique for resolving interfacial solution structure at the molecular scale, key challenges for data interpretation persist, most notably regarding the influence of the probe on the measured structure. Using the mica-water system as a case study, we investigate the effect of hydrophilic and hydrophobic probes on interfacial solution structure measured by 3D FFM. Data from hydrophilic silicon-based probes are in good agreement with molecular dynamics simulations, wherein the innermost water molecules adsorb preferentially at the surface ditrigonal cavity sites followed by two subsequent hydration layers. In contrast, the hydrophobic carbon-based probes detect vertical oscillatory features, but do not show lateral patterning that matches the underlying mica lattice. At high ionic strength, up to six of these oscillatory features are observed extending 2 nm into the solution phase with an average spacing of 0.29 ± (0.04) nm. Further, we also determine that the repulsive hydration force between mica and the hydrophilic probe depends on the nature and concentration of ions in solution. Specifically, solutions with stronger ion-water and ion-ion interactions increase the interfacial viscosity, which results in a stronger repulsive hydration force as the probe approaches the surface. Based on these observations, we present a scheme for controlling the outcomes of particle attachment and aggregation by varying the solution conditions to tune the hydration force.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2021

Structure Tuning, Strong Second Harmonic Generation Response, and High Optical Stability of the Polar Semiconductors Na 1- x K x AsQ 2

We report the mixed cation compounds Na 1-x K x AsSe 2 (x = 0.8, 0.65, 0.5) and Na 0.1 K 0.9 AsS 2 crystallize in the polar noncentrosymmetric space group Cc. The AAsQ(2) (A = alkali metals, Q = S, Se) family features one-dimensional (1D) 1 / ∞ [AQ 2 - ] chains comprising corner-sharing pyramidal AQ 3 units in which the packing of these chains is dependent on the alkali metals. The parallel 1 / ∞ [AQ(2) - ] chains interact via short As ∙∙∙Se contacts, which increase in length when the fraction of K atoms is increased. The increase in the As ∙∙∙Se interchain distance increases the band gap from 1.75 eV in γ-NaAsSe 2 to 2.01 eV in Na 0.35 K 0.65 AsSe 2 , 2.07 eV in Na 0.2 K 0.8 AsSe 2 , and 2.18 eV in Na 0.1 K 0.9 AsS 2 . The Na 1-x K x AsSe 2 (x = 0.8, 0.65) compounds melt congruently at approximately 316 °C. Wavelength-dependent second harmonic generation (SHG) measurements on powder samples of Na 1-x K x AsSe 2 (x = 0.8, 0.65, 0.5) and Na 0.1 K 0.9 AsS 2 suggest that Na 0.2 K 0.8 AsSe 2 and Na 0.1 K 0.9 AsS 2 have the highest SHG response and exhibit significantly higher laser-induced damage thresholds (LIDTs). Theoretical SHG calculations on Na 0.5 K 0.5 AsSe 2 confirm its SHG response with the highest value of d 33 = 22.5 pm/V χ 333 (2) = 45.0 pm/V). The effective nonlinearity for a randomly oriented powder is calculated to be d eff = 18.9 pm/V χ eff (2) = 37.8 pm/V), which is consistent with the experimentally obtained value of d eff = 16.5 pm/V χ eff (2) = 33.0 pm/V). Three-photon absorption is the dominant mechanism for the optical breakdown of the compounds under intense excitation at 1580 nm, with Na 0.2 K 0.8 AsSe 2 exhibiting the highest stability.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2020

A Drift‐Kinetic Method for Obtaining Gradients in Plasma Properties From Single‐Point Distribution Function Data

Abstract In this paper, we derive a new drift‐kinetic method for estimating gradients in the plasma properties through a velocity space distribution at a single point. The gradients are intrinsically related to agyrotropic features of the distribution function. This method predicts the gradients in the magnetized distribution function and can predict gradients of arbitrary moments of the gyrotropic background distribution function. The method allows for estimates on density and pressure gradients on the scale of a Larmor radius, proving to resolve smaller scales than any method currently available to spacecraft. The model is verified with a set of fully kinetic VPIC particle‐in‐cell simulations.

Wetherton, B. A.↗

DOE OSTI2021

Noise reduction in X-ray photon correlation spectroscopy with convolutional neural networks encoder–decoder models

Abstract Like other experimental techniques, X-ray photon correlation spectroscopy is subject to various kinds of noise. Random and correlated fluctuations and heterogeneities can be present in a two-time correlation function and obscure the information about the intrinsic dynamics of a sample. Simultaneously addressing the disparate origins of noise in the experimental data is challenging. We propose a computational approach for improving the signal-to-noise ratio in two-time correlation functions that is based on convolutional neural network encoder–decoder (CNN-ED) models. Such models extract features from an image via convolutional layers, project them to a low dimensional space and then reconstruct a clean image from this reduced representation via transposed convolutional layers. Not only are ED models a general tool for random noise removal, but their application to low signal-to-noise data can enhance the data’s quantitative usage since they are able to learn the functional form of the signal. We demonstrate that the CNN-ED models trained on real-world experimental data help to effectively extract equilibrium dynamics’ parameters from two-time correlation functions, containing statistical noise and dynamic heterogeneities. Strategies for optimizing the models’ performance and their applicability limits are discussed.

36 MATERIALS SCIENCE↗

DOE OSTI2020

Twinned nanostructure of VO 2 thin films grown on r-cut sapphire

Due to strong electron-phonon interactions, strain engineering is a powerful tool to control quantum critical phenomena in strongly correlated oxides. Exploring this possibility requires understanding the nanoscale structure of quantum materials and the role it plays in forming the strain landscape. In this work, we used a combination of x-ray nanoimaging and reciprocal space mapping to study the nanostructure of the archetypal Mott insulator VO 2 featuring an insulator-to-metal and structural phase transitions. We found that VO 2 thin films grown on r-cut sapphire consist of two intertwined crystal lattices, permanently inclined with respect to each other. This persistent pattern of twin domains stands out from the symmetry breaking induced by the structural phase transition and conceivably originates from the post-growth strain relaxation process. We propose a model explaining the formation of twin domains and the emergence of anisotropy in the film nanostructure. Our work suggests using miscut substrates to suppress either one or the other twin that can serve as a new tool to control strain in VO 2 films.

36 MATERIALS SCIENCE↗

DOE OSTI2023

Application of a Distributed Element Roughness Model to Additively Manufactured Internal Cooling Channels

Abstract Design for cooling effectiveness in turbine blades relies on accurate models for dynamic losses and heat transfer of internal cooling passages. Metal additive manufacturing (AM) has expanded the design space for these configurations, but can give rise to large-scale roughness features. The range of roughness length scales in these systems makes morphology resolved computational fluid dynamics (CFD) impractical. However, volumetric roughness models can be leveraged, as they have computational costs orders of magnitude lower. In this work, a discrete element roughness model (DERM), based on the double-averaged Navier–Stokes equations, is presented and applied to additively manufactured rough channels, representative of gas turbine blade cooling passages. Unique to this formulation of DERM is a generalized sheltering-based treatment of drag, a two-layer model for spatially averaged Reynolds stresses, and explicit treatment of dispersion. Six different AM rough surface channel configurations are studied, with roughness trough to peak sizes ranging from 15% to 60% nominal channel passage half-width, and the roughness Reynolds number ranges from Rek = 60 to 300. DERM predictions for spatially and temporally averaged mean flow quantities are compared to previously reported direct numerical simulation results. Good agreement in the mean velocity profiles, stress balances, and drag partitions are observed. While DERM models are typically calibrated to specific deterministic roughness morphologies at comparatively small roughness Reynolds numbers, the present more generalized DERM formulation has wider applicability. Here, it is demonstrated that the model can accommodate random roughness of large scale, typical of AM.

Engineering↗

DOE OSTI2023

GRAPH CONVOLUTIONAL NEURAL NETWORK (GCNN)FOR POLYMER PROPERTY PREDICTION

SF-22-121 Graph convolutional neural networks (GCNN) are powerful machine learning models that apply a message-passing algorithm on adjacent nodes in a graph. Due to the natural representation of molecules via discrete graphs (where nodes encode atoms and edges encode bonds), GCNNs are an intuitive machine learning model chemical space informatics, including the prediction of polymer properties. Here, molecules are represented in feature and adjacency matrices where they are directly used as inputs to a GCNN.

FEINSTEIN, JEREMY↗

DOE OSTI2023

PRIMED for the Future: Purposing Raw Intake for Machine Learning-Enabled Detection (Final Report)

The COVID-19 pandemic demonstrated how a novel, elusive, and diffuse biological threat can engender uncertainty and misinformation, and it underscored the need for flexible analytical modalities agnostic to the identity of biological material. Yet even before the pandemic, recognition of the limitations of the current, list-based approach, which focuses on known pathogens and biotoxins, and of the importance of agent-agnostic biodetection was growing within the biosecurity community. In a 2018 report on “Biodefense in the Age of Synthetic Biology,” for example, the National Academy of Sciences stated that “an overreliance on the Select Agent List is a systematic weakness affecting many aspects of the United States’ current biodefense mitigation capability”. More recently, a group of biodefense researchers proposed the identification and adoption of “bioagent-agnostic signatures (BASs)” as a way of detecting and characterizing not only existing agents but also novel ones, an approach they believe will “enable a more flexible and resilient biodefense posture”. Indeed, the future of biodetection requires us to begin developing novel analytics that can identify anomalies and/or characteristics that indicate a potential threat, whether known or unknown, without looking for a specific signature that has been identified previously. To assess potential threats more rapidly, it is critical to develop agnostic artificial intelligence (AI)/machine learning (ML) systems that can be employed for real-time assessment of the nature and source of a perturbation. Such systems should be multi scale and multi-dimensional, integrating sensor data from a range of biological, chemical, and physical application spaces. Emerging deep learning (DL) models demonstrate exceptional promise for identification of discriminatory features within multi-dimensional datasets. DL models have the capacity to recognize and encode highly complex patterns in a wide range of input data modalities, including images, text, and biological/chemical/physical spectra. As such, they can execute a wide range of assessments and determinations that have traditionally required a human operator. The promise of advances in DL is apparent in the realm of human health and medicine. DL models have been validated for evaluating a variety of clinical threats to human health in a range of contexts, including infection and cancer, and they demonstrated improved performance in predicting stroke relative to human neurologists in some categories of data. Continuously evolving advances in AI/ML are expected to support more efficient evaluation of raw sequence, spectroscopy, and spectrometry data. For instance, recent advances and deployment of large language models (LLM) such as Generative Pre training Transformer (GPT) and Bidirectional Encoder Representations from Transformers (BERT) have already motivated application of these models for biological function prediction. As frameworks such as LLMs become larger and more complex in their representations, their capacity to serve as pre-trained models that can be fine-tuned for biological/biodetection purposes will similarly be amplified. While existing and emerging AI/ML have found broad applicability and use cases in the clinical sciences, development for environmental evaluation and biodetection has been limited. Functionalizing such capabilities for this purpose requires an understanding of the existing technical landscape and how the respective tools and algorithms are currently being employed. This landscape awareness then allows an assessment of the current practical capabilities of existing models and the anticipated requirements and development efforts that will be needed to adapt available algorithms for biodetection applications relevant to DHS. Leveraging expertise in biodetection, ML, and operational biodetection, the effort described in this report is comprised of a systematic landscape assessment (Subtask 2.1), comparative evaluation (Subtask 2.2), and formulation of a value proposition (Subtask 2.3) for the prospect of ML-enabled, agnostic biodetection from raw, or minimally-processed, datasets.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2023

PRIMED for the Future: Purposing Raw Intake for Machine Learning-Enabled Detection

59 BASIC BIOLOGICAL SCIENCES↗