Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Learning Framework”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 361 records · Page 20
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Application of multidimensional structural characterization to detect and describe moderate forest disturbance

The study of vegetation community and structural change has been central to ecology for over a century, yet the ways in which disturbances reshape the physical structure of forest canopies remain relatively unknown. Moderate severity disturbances affect different canopy strata and plant species, resulting in variable structural outcomes and ecological consequences. Terrestrial lidar (light detection and ranging) offers an unprecedented view of the interior arrangement and distribution of canopy elements, permitting the derivation of multidimensional measures of canopy structure that describe several canopy structural traits (CSTs) with known links to ecosystem function. We used lidar-derived CSTs within a machine learning framework to detect and describe the structural changes that result from various disturbance agents, including moderate severity fire, ice storm damage, age-related senescence, hemlock woolly adelgid, beech bark disease, and chronic acidification. We found that fire and ice storms primarily affected the amount and position of vegetation within canopies, while acidification, senescence, pathogen, and insect infestation altered canopy arrangement and complexity. Only two of the six disturbance agents significantly reduced leaf area, counter to common assumptions regarding many moderate severity disturbances. While findings are limited in their generalizability due to lack of replication among disturbances, they do suggest that the current limitations of standard disturbance detection methods—such as optical-based remote sensing platforms, which are often above-canopy perspectives—limit our ability to understand the full ecological and structural impacts of disturbance, and to evaluate the consistency of structural patterns within and among disturbance agents. A more broadly inclusive definition of ecological disturbance that incorporates multiple aspects of canopy structural change may potentially improve the modeling, detection, and prediction of functional implications of moderate severity disturbance as well as broaden our understanding of the ecological impacts of disturbance.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

Heterogeneous Multilayer Nanopores via Chemically Tuned Dielectric Breakdown for Single‐Molecule Sensing

Solid-state nanopores are powerful platforms for single-molecule sensing, yet their performance is often constrained by fabrication complexity, noise, and limited control over surface properties. Here we report a direct method to fabricate heterogeneous multilayer nanopores using chemically tuned controlled dielectric breakdown (CT-CDB). We integrate hBN, MoS 2 , or graphene atop a silicon nitride membrane to form five distinct bilayer and tri-layer architectures, with bare SiN x nanopore as a control. CT-CDB achieves pore formation reproducibly through material-stacks with high efficiency, good pore size control, and strong yield, validated by various characterizations. Transferrin protein translocation experiments, supported by simulations, reveal that multilayer configurations modulate protein conformations, ionic current blockade and dwell time distributions, reflecting combined effects of membrane type, interfacial chemistry, and local electric field gradients. A supervised machine learning framework is implemented to assist identifying multilayer structure effects embedded in signal signatures, with over 96% accuracy. This work presents a modular and scalable framework for functional nanopore engineering with complex structural integration, thereby expanding the potential of 2D materials in single-molecule sensing applications.

2D materials↗
DOE OSTI2021

In-depth understanding of molecular mechanisms of aldehyde toxicity to engineer robust Saccharomyces cerevisiae

Aldehydes are ubiquitous electrophilic compounds that ferment microorganisms including Saccharomyces cerevisiae encounter during the fermentation processes to produce food, fuels, chemicals, and pharmaceuticals. Aldehydes pose severe toxicity to the growth and metabolism of the S. cerevisiae through a variety of toxic molecular mechanisms, predominantly via damaging macromolecules and hampering the production of targeted compounds. Compounds with aldehyde functional groups are far more toxic to S. cerevisiae than all other functional classes, and toxic potency depends on physicochemical characteristics of aldehydes. The yeast synthetic biology community established a design–build–test–learn framework to develop S. cerevisiae cell factories to valorize the sustainable and renewable biomass, including the lignin-derived substrates. However, thermochemically pretreated biomass-derived substrate streams contain diverse aldehydes (e.g., glycolaldehyde and furfural), and biological conversions routes of lignocellulosic compounds consist of toxic aldehyde intermediates (e.g., formaldehyde and methylglyoxal), and some of the high-value targeted products have aldehyde functional group (e.g., vanillin and benzaldehyde). Numerous studies comprehensively characterized both single and additive effects of aldehyde toxicity via systems biology investigations, and novel molecular approaches have been discovered to overcome the aldehyde toxicity. Based on those novel approaches, researchers successfully developed synthetic yeast cell factories to convert lignocellulosic substrates to valuable products, including aldehyde compounds. Here, we highlight the salient relationship of physicochemical charac- teristics and molecular toxicity of aldehydes, the molecular detoxification and macromolecules protection mechanisms of aldehydes, and the advances of engineering robust S. cerevisiae against complex mixtures of aldehyde inhibitors.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

Scalable Bayesian optimization with randomized prior networks

Several fundamental problems in science and engineering consist of global optimization tasks involving unknown high-dimensional (black-box) functions that map a set of controllable variables to the outcomes of an expensive experiment. Bayesian Optimization (BO) techniques are known to be effective in tackling global optimization problems using a relatively small number objective function evaluations, but their performance suffers when dealing with high-dimensional outputs. To overcome the major challenge of dimensionality, here we propose a deep learning framework for BO and sequential decision making based on bootstrapped ensembles of neural architectures with randomized priors. Using appropriate architecture choices, we show that the proposed framework can approximate functional relationships between design variables and quantities of interest, even in cases where the latter take values in high-dimensional vector spaces or even infinite-dimensional function spaces. In the context of BO, we augmented the proposed probabilistic surrogates with re-parameterized Monte Carlo approximations of multiple-point (parallel) acquisition functions, as well as methodological extensions for accommodating black-box constraints and multi-fidelity information sources. We test the proposed framework against state-of-the-art methods for BO and demonstrate superior performance across several challenging tasks with high-dimensional outputs, including a constrained multi-fidelity optimization task involving shape optimization of rotor blades in turbo-machinery.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Kernel methods for evolution of generalized parton distributions

Generalized parton distributions (GPDs) characterize the 3-dimensional structure of hadrons, combining information about their internal quark and gluon longitudinal momentum distributions and transverse position within the hadron. The dependence of GPDs on the factorization scale Q 2 allows one to connect hard exclusive processes involving GPDs at disparate energy and momentum scales, which is needed in global analyses of experimental data. Here, in this work, we explore how finite element methods can be used to construct fast and differentiable Q 2 evolution codes for GPDs in momentum space, which can be used in a machine learning framework. We show numerical benchmarks of the methods' accuracy, including a comparison to an existing evolution code from PARTONS/APFEL++, and provide a repository where the code can be accessed.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2021

NEXTorch: A Design and Bayesian Optimization Toolkit for Chemical Sciences and Engineering

Automation and optimization of chemical systems require well-informed decisions on what experiments to run to reduce time, materials, and/or computations. Data-driven active learning algorithms have emerged as valuable tools to solve such tasks. Bayesian optimization, a sequential global optimization approach, is a popular active-learning framework. Past studies have demonstrated its efficiency in solving chemistry and engineering problems. Here we introduce NEXTorch, a library in Python/PyTorch, to facilitate laboratory or computational design using Bayesian optimization. NEXTorch offers fast predictive modeling, flexible optimization loops, visualization capabilities, easy interfacing with legacy software, and multiple types of parameters and data type conversions. It provides GPU acceleration, parallelization, and state-of-the-art Bayesian optimization algorithms and supports both automated an d human-in-the-loop optimization. The comprehensive online documentation introduces Bayesian optimization theory and several examples from catalyst synthesis, reaction condition optimization, parameter estimation, and reactor geometry optimization. NEXTorch is open-source and available on GitHub

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Exploring the Relationship of Microstructure and Conductivity in Metal Halide Perovskites via Active Learning-Driven Automated Scanning Probe Microscopy

Electronic transport and hysteresis in metal halide perovskites (MHPs) are key to the applications in photovoltaics, light emitting devices, and light and chemical sensors. These phenomena are strongly affected by the materials microstructure including grain boundaries, ferroic domain walls, and secondary phase inclusions. Here, we demonstrate an active machine learning framework for “driving” an automated scanning probe microscope (SPM) to discover the microstructures responsible for specific aspects of transport behavior in MHPs. In our setup, the microscope can discover the microstructural elements that maximize the onset of conduction, hysteresis, or any other characteristic that can be derived from a set of current–voltage spectra. Furthermore, this approach opens new opportunities for exploring the origins of materials functionality in complex materials by SPM and can be integrated with other characterization techniques either before (prior knowledge) or after (identification of locations of interest for detail studies) functional probing.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Attentional Ptycho-Tomography (APT) for three-dimensional nanoscale X-ray imaging with minimal data acquisition and computation time

Abstract Noninvasive X-ray imaging of nanoscale three-dimensional objects, such as integrated circuits (ICs), generally requires two types of scanning: ptychographic, which is translational and returns estimates of the complex electromagnetic field through the IC; combined with a tomographic scan, which collects these complex field projections from multiple angles. Here, we present Attentional Ptycho-Tomography (APT), an approach to drastically reduce the amount of angular scanning, and thus the total acquisition time. APT is machine learning-based, utilizing axial self-Attention for Ptycho-Tomographic reconstruction. APT is trained to obtain accurate reconstructions of the ICs, despite the incompleteness of the measurements. The training process includes regularizing priors in the form of typical patterns found in IC interiors, and the physics of X-ray propagation through the IC. We show that APT with ×12 reduced angles achieves fidelity comparable to the gold standard Simultaneous Algebraic Reconstruction Technique (SART) with the original set of angles. When using the same set of reduced angles, then APT also outperforms Filtered Back Projection (FBP), Simultaneous Iterative Reconstruction Technique (SIRT) and SART. The time needed to compute the reconstruction is also reduced, because the trained neural network is a forward operation, unlike the iterative nature of these alternatives. Our experiments show that, without loss in quality, for a 4.48 × 93.2 × 3.92 µm 3 IC (≃6 × 10 8 voxels), APT reduces the total data acquisition and computation time from 67.96 h to 38 min. We expect our physics-assisted and attention-utilizing machine learning framework to be applicable to other branches of nanoscale imaging, including materials science and biological imaging.

47 OTHER INSTRUMENTATION↗
DOE OSTI2020

Clustering earthquake signals and background noises in continuous seismic data with unsupervised deep learning

The continuously growing amount of seismic data collected worldwide is outpacing our abilities for analysis, since to date, such datasets have been analyzed in a human-expert intensive, supervised fashion. Moreover, analyses that are conducted can be strongly biased by the standard models employed by seismologists. In response to both of these challenges, we develop a new unsupervised machine learning framework for detecting and clustering seismic signals in continuous seismic records. Our approach combines a deep scattering network and a Gaussian mixture model to cluster seismic signal segments and detect novel structures. To illustrate the power of the framework, we analyze seismic data acquired during the June 2017 Nuugaatsiaq, Greenland landslide. We demonstrate the blind detection and recovery of the repeating precursory seismicity that was recorded before the main landslide rupture, which suggests that our approach could lead to more informative forecasting of the seismic activity in seismogenic areas.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

Machine learning-based observation-constrained projections reveal elevated global socioeconomic risks from wildfire

Reliable projections of wildfire and associated socioeconomic risks are crucial for the development of efficient and effective adaptation and mitigation strategies. The lack of or limited observational constraints for modeling outputs impairs the credibility of wildfire projections. Here, we present a machine learning framework to constrain the future fire carbon emissions simulated by 13 Earth system models from the Coupled Model Intercomparison Project phase 6 (CMIP6), using historical, observed joint states of fire-relevant variables. During the twenty-first century, the observation-constrained ensemble indicates a weaker increase in global fire carbon emissions but higher increase in global wildfire exposure in population, gross domestic production, and agricultural area, compared with the default ensemble. Such elevated socioeconomic risks are primarily caused by the compound regional enhancement of future wildfire activity and socioeconomic development in the western and central African countries, necessitating an emergent strategic preparedness to wildfires in these countries.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Active learning of reactive Bayesian force fields applied to heterogeneous catalysis dynamics of H/Pt

Abstract Atomistic modeling of chemically reactive systems has so far relied on either expensive ab initio methods or bond-order force fields requiring arduous parametrization. Here, we describe a Bayesian active learning framework for autonomous “on-the-fly” training of fast and accurate reactive many-body force fields during molecular dynamics simulations. At each time-step, predictive uncertainties of a sparse Gaussian process are evaluated to automatically determine whether additional ab initio training data are needed. We introduce a general method for mapping trained kernel models onto equivalent polynomial models whose prediction cost is much lower and independent of the training set size. As a demonstration, we perform direct two-phase simulations of heterogeneous H 2 turnover on the Pt(111) catalyst surface at chemical accuracy. The model trains itself in three days and performs at twice the speed of a ReaxFF model, while maintaining much higher fidelity to DFT and excellent agreement with experiment.

42 ENGINEERING↗
DOE OSTI2025

Multimodal super-resolution: discovering hidden physics and its application to fusion plasmas

Understanding complex physical systems often requires integrating data from multiple diagnostics, each with limited resolution or coverage. We present a machine learning framework that reconstructs synthetic high-temporal-resolution data for a target diagnostic using information from other diagnostics, without direct target measurements during the inference. This multimodal super-resolution technique improves diagnostic robustness and enables monitoring even in case of measurement failures or degradation. Applied to fusion plasmas, our method targets edge-localized modes (ELMs), which can damage plasma-facing materials. By reconstructing super-resolution Thomson Scattering data from complementary diagnostics, we uncover fine-scale plasma dynamics and validate the role of resonant magnetic perturbations (RMPs) in ELM suppression through magnetic island formation. The approach provides new observation supporting the plasma profile flattening due to these islands. Our results demonstrate the framework’s ability to generate high-fidelity synthetic diagnostics, offering a powerful tool for ELM control development in future reactors like ITER. The approach is broadly transferable to other domains facing sparse, incomplete, or degraded diagnostic data, opening new avenues for discovery.

Jalalvand, Azarakhsh [Princeton Univ., NJ (United ↗
DOE OSTI2020

On-the-fly active learning of interpretable Bayesian force fields for atomistic rare events

Abstract Machine learned force fields typically require manual construction of training sets consisting of thousands of first principles calculations, which can result in low training efficiency and unpredictable errors when applied to structures not represented in the training set of the model. This severely limits the practical application of these models in systems with dynamics governed by important rare events, such as chemical reactions and diffusion. We present an adaptive Bayesian inference method for automating the training of interpretable, low-dimensional, and multi-element interatomic force fields using structures drawn on the fly from molecular dynamics simulations. Within an active learning framework, the internal uncertainty of a Gaussian process regression model is used to decide whether to accept the model prediction or to perform a first principles calculation to augment the training set of the model. The method is applied to a range of single- and multi-element systems and shown to achieve a favorable balance of accuracy and computational efficiency, while requiring a minimal amount of ab initio training data. We provide a fully open-source implementation of our method, as well as a procedure to map trained models to computationally efficient tabulated force fields.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Distilling physical origins of hardness in multi-principal element alloys directly from ensemble neural network models

Abstract Despite a plethora of data being generated on the mechanical behavior of multi-principal element alloys, a systematic assessment remains inaccessible via Edisonian approaches. We approach this challenge by considering the specific case of alloy hardness, and present a machine-learning framework that captures the essential physical features contributing to hardness and allows high-throughput exploration of multi-dimensional compositional space. The model, tested on diverse datasets, was used to explore and successfully predict hardness in Al x Ti y (CrFeNi) 1- x - y , Hf x Co y (CrFeNi) 1- x - y and Al x (TiZrHf) 1- x systems supported by data from density-functional theory predicted phase stability and ordering behavior. The experimental validation of hardness was done on TiZrHfAl x . The selected systems pose diverse challenges due to the presence of ordering and clustering pairs, as well as vacancy-stabilized novel structures. We also present a detailed model analysis that integrates local partial-dependencies with a compositional-stimulus and model-response study to derive material-specific insights from the decision-making process.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2026

Autonomous fabrication of tailored defect structures in 2D materials using machine learning-enabled scanning transmission electron microscopy

Materials with tailored quantum properties can be engineered from atomic-scale assembly techniques, but existing methods often lack the agility and accuracy to precisely and intelligently control the manufacturing process. Here, we demonstrate a fully autonomous approach for fabricating atomic-level defects using electron beams in scanning transmission electron microscopy (STEM) that combines advanced machine learning and automated beam control. As a proof of concept, we achieved controlled fabrication of MoS-nanowire (MoS-NW) edge structures by iterative and targeted exposure of MoS 2 monolayer to a focused electron beam to selectively eject sulfur atoms, utilizing high-angle annular dark-field (HAADF) imaging for feedback-controlled monitoring of structural evolution of defects. A machine learning framework combining a random forest model and a convolutional neural network (CNN) was developed to decode the HAADF image and accurately identify atomic positions and species. This atomic-level information was then integrated into an autonomous decision-making platform, which applied predefined fabrication strategies to instruct beam control about atomic sites to be ejected. The selected sites were subsequently exposed to a localized electron beam using an FPGA-controlled scan routine with precise control over beam positioning and duration. While the MoS-NW edge structures produced exhibit promising mechanical and electronic properties, the proposed methods to build the autonomous fabrication framework is material-agnostic and can be extended to other 2D materials for the creation of diverse defect structures and heterostructures beyond Mo S2 .

Engineering↗
DOE OSTI2023

De novo design of protein structure and function with RFdiffusion

Abstract There has been considerable recent progress in designing new proteins using deep-learning methods 1–9 . Despite this progress, a general deep-learning framework for protein design that enables solution of a wide range of design challenges, including de novo binder design and design of higher-order symmetric architectures, has yet to be described. Diffusion models 10,11 have had considerable success in image and language generative modelling but limited success when applied to protein modelling, probably due to the complexity of protein backbone geometry and sequence–structure relationships. Here we show that by fine-tuning the RoseTTAFold structure prediction network on protein structure denoising tasks, we obtain a generative model of protein backbones that achieves outstanding performance on unconditional and topology-constrained protein monomer design, protein binder design, symmetric oligomer design, enzyme active site scaffolding and symmetric motif scaffolding for therapeutic and metal-binding protein design. We demonstrate the power and generality of the method, called RoseTTAFold diffusion (RFdiffusion), by experimentally characterizing the structures and functions of hundreds of designed symmetric assemblies, metal-binding proteins and protein binders. The accuracy of RFdiffusion is confirmed by the cryogenic electron microscopy structure of a designed binder in complex with influenza haemagglutinin that is nearly identical to the design model. In a manner analogous to networks that produce images from user-specified inputs, RFdiffusion enables the design of diverse functional proteins from simple molecular specifications.

Science & Technology - Other Topics↗
DOE OSTI2023

Local Bayesian Dirichlet mixing of imperfect models

Abstract To improve the predictability of complex computational models in the experimentally-unknown domains, we propose a Bayesian statistical machine learning framework utilizing the Dirichlet distribution that combines results of several imperfect models. This framework can be viewed as an extension of Bayesian stacking. To illustrate the method, we study the ability of Bayesian model averaging and mixing techniques to mine nuclear masses. We show that the global and local mixtures of models reach excellent performance on both prediction accuracy and uncertainty quantification and are preferable to classical Bayesian model averaging. Additionally, our statistical analysis indicates that improving model predictions through mixing rather than mixing of corrected models leads to more robust extrapolations.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Case study on climate change effects and food security in Southeast Asia

Agriculture, a cornerstone of human civilization, faces rising challenges from climate change, resource limitations, and stagnating yields. Precise crop production forecasts are crucial for shaping trade policies, development strategies, and humanitarian initiatives. This study introduces a comprehensive machine learning framework designed to predict crop production. We leverage CMIP5 climate projections under a moderate carbon emission scenario to evaluate the future suitability of agricultural lands and incorporate climatic data, historical agricultural trends, and fertilizer usage to project yield changes. Our integrated approach forecasts significant regional variations in crop production across Southeast Asia by 2028, identifying potential cropland utilization. Specifically, the cropland area in Indonesia, Malaysia, Philippines, and Viet Nam is projected to decline by more than 10% if no action is taken, and there is potential to mitigate that loss. Moreover, rice production is projected to decline by 19% in Viet Nam and 7% in Thailand, while the Philippines may see a 5% increase compared to 2021 levels. Our findings underscore the critical impacts of climate change and human activities on agricultural productivity, offering essential insights for policy-making and fostering international cooperation.

54 ENVIRONMENTAL SCIENCES↗