Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Deep Direct Use”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Neural Networks to Find the Optimal Forcing for Offsetting the Anthropogenic Climate Change Effects

Abstract Of great relevance to climate engineering is the systematic relationship between the radiative forcing to the climate system and the response of the system, a relationship often represented by the linear response function (LRF) of the system. However, estimating the LRF often becomes an ill-posed inverse problem due to high-dimensionality and nonunique relationships between the forcing and response. Recent advances in machine learning make it possible to address the ill-posed inverse problem through regularization and sparse system fitting. Here, we develop a convolutional neural network (CNN) for regularized inversion. The CNN is trained using the surface temperature responses from a set of Green’s function perturbation experiments as imagery input data together with data sample densification. The resulting CNN model can infer the forcing pattern responsible for the temperature response from out-of-sample forcing scenarios. This promising proof of concept suggests a possible strategy for estimating the optimal forcing to negate certain undesirable effects of climate change. The limited success of this effort underscores the challenges of solving an inverse problem for a climate system with inherent nonlinearity. Significance Statement Predicting the climate response for a given climate forcing is a direct problem, while inferring the forcing for a given desired climate response is often an inverse, ill-posed, problem, posing a new challenge to the climate community. This study makes the first attempt to infer the radiative forcing for a given target pattern of global surface temperature response using a deep learning approach. The resulting deeply trained convolutional neural network inversion model shows promise in capturing the forcing pattern corresponding to a given surface temperature response, with a significant implication on the design of an optimal solar radiation management strategy for curbing global warming. This study also highlights the technical challenges that future research should prioritize in seeking feasible solutions to the inverse climate problem.

Ren, Huiying↗
DOE OSTI2024

Materials Characterization, Prediction and Control Project: Summary Report on Data Analytics Framework

This report summarizes the activities performed under the data analytics Vertex in the Materials Characterization, Prediction and Control Project funded under laboratory directed research and development at Pacific Northwest National Laboratory. The data analytics Vertex developed models for associating global or local process parameters, microstructural features, and performance properties of friction-stir-processed 316L stainless steel plates. Statistical, machine learning, and deep learning models, as well as generative artificial intelligence approaches, were used to develop the associations between the process-structure-property data streams. These associations formed the basis for predicting global properties of parts manufactured under different process envelopes, providing a basis for predicting performance using data driven as well as physics-informed and physics-constrained approaches. Additionally, the associations were used to predict local process parameters and microstructural features of the product, predictive relationships that have the potential to form the basis of a control framework that could eventually modulate a friction-stir process to maintain product quality.

316L stainless steel↗
DOE OSTI2025

Joint Modeling of Quasar Variability and Accretion Disk Reprocessing Using Latent Stochastic Differential Equations

Quasars are bright active galactic nuclei powered by the accretion of matter around supermassive black holes at the center of galaxies. Their stochastic brightness variability depends on the physical properties of the accretion disk and black hole. The upcoming Rubin Observatory Legacy Survey of Space and Time (LSST) is expected to observe tens of millions of quasars, so there is a need for efficient techniques like machine learning that can handle the large volume of data. Quasar variability is believed to be driven by an X-ray corona, which is reprocessed by the accretion disk and emitted as UV/optical variability. We are the first to introduce an auto-differentiable simulation of the accretion disk and reprocessing. We use the simulation as a direct component of our neural network to jointly model the driving variability and reprocessing, trained with supervised learning on simulated LSST-like 10 yr quasar light curves. We encode the light curves using a transformer encoder, and the driving variability is reconstructed using latent stochastic differential equations, a physically motivated generative deep learning method that can model continuous-time stochastic dynamics. By embedding the physical processes of the driving signal and reprocessing into our network, we achieve a model that is more robust and interpretable. We demonstrate that our model outperforms a Gaussian process regression baseline and can infer accretion disk parameters and time delays between wave bands, even for out-of-distribution driving signals. Our approach provides a powerful framework that can be adapted to solve other inverse problems in multivariate time series.

Fagin, Joshua [City Univ. of New York (CUNY), NY (↗
DOE OSTI2020

End-to-End Physics Event Classification with CMS Open Data: Applying Image-Based Deep Learning to Detector Data for the Direct Classification of Collision Events at the LHC

This paper describes the construction of novel end-to-end image-based classifiers that directly leverage low-level simulated detector data to discriminate signal and background processes in pp collision events at the Large Hadron Collider at CERN. To better understand what end-to-end classifiers are capable of learning from the data and to address a number of associated challenges, we distinguish the decay of the standard model Higgs boson into two photons from its leading background sources using high-fidelity simulated CMS Open Data. We demonstrate the ability of end-to-end classifiers to learn from the angular distribution of the photons recorded as electromagnetic showers, their intrinsic shapes, and the energy of their constituent hits, even when the underlying particles are not fully resolved, delivering a clear advantage in such cases over purely kinematics-based classifiers.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2025

Neutron Tagging From Neutrino Interactions in DUNE-ND 2x2 Prototype

The Deep Underground Neutrino Experiment (DUNE) is a long-baseline neutrino oscillation experiment that aims to measure whether CP is violated in the leptonic sector (if violated, how much) and unambiguously determine the neutrino mass ordering. DUNE consists of near and far detectors that rely on liquid argon time projection chamber (LArTPC) technology to observe neutrino interactions. The near detector (ND) will be placed in Fermilab, near the neutrino source, while the far detector (FD) will be deployed in Sanford Lab, 1.5 km deep underground, which is 1300 km away from the source. LArTPCs provide excellent particle identification and calorimetry; however, detecting neutrons is challenging, as they do not leave direct ionization signals in LArTPCs. Neutrons can carry away up to 25% of the neutrino energy, introducing a significant uncertainty in DUNE measurements. The DUNE near detector (ND) features a novel modular LArTPC with pixelated charge readout, which enhances event recons truction. The modular design enables precise correlation between ionization signals and light signals in a high-rate environment, improving the identification of delayed energy depositions from neutrons in neutrino interactions. We introduce a neutron tagging technique using the 2x2 Demonstrator, a small-scale prototype of the DUNE ND LArTPC. The analysis utilizes Monte Carlo simulations and deep-learning techniques to identify neutron-induced energy depositions and reconstruct low-energy activity.

Kufatty, Georgette [Florida State U.]↗
DOE OSTI2022

High-Throughput Microfluidics Platform for Intracellular Delivery and Sampling of Biomolecules from Live Cells

Nondestructive cell membrane permeabilization systems enable the intracellular delivery of exogenous biomolecules for cell engineering tasks as well as the temporal sampling of cytosolic contents from live cells for the analysis of dynamic processes. Here, in this paper, we report a microwell array format live-cell analysis device (LCAD) that can perform localized-electroporation induced membrane permeabilization, for cellular delivery or sampling, and directly interfaces with surface-based biosensors for analyzing the extracted contents. We demonstrate the capabilities of the LCAD via an automated high-throughput workflow for multimodal analysis of live-cell dynamics, consisting of quantitative measurements of enzyme activity using self-assembled monolayers for MALDI mass spectrometry (SAMDI) and deep-learning enhanced imaging and analysis. By combining a fabrication protocol that enables robust assembly and operation of multilayer devices with embedded gold electrodes and an automated imaging workflow, we successfully deliver functional molecules (plasmid and siRNA) into live cells at multiple time-points and track their effect on gene expression and cell morphology temporally. Furthermore, we report sampling performance enhancements, achieving saturation levels of protein tyrosine phosphatase activity measured from as few as 60 cells, and demonstrate control over the amount of sampled contents by optimization of electroporation parameters using a lumped model. Lastly, we investigate the implications of cell morphology on electroporation-induced sampling of fluorescent molecules using a deep-learning enhanced image analysis workflow.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2020

Parametrizing the detector response with neural networks

In high energy physics, characterizing the response of a detector to radiation is one of the most important and fundamental experimental tasks. In many cases, this task is accomplished by parameterizing summary statistics of the full detector response probability density. The parameterized detector response can then be used for calibration as well as for directly improving physics analysis sensitivity. This paper reports on how to parameterize summary statistics of the detector response using neural networks. Specifically, neural networks are powerful tools for incorporating multidimensional data and the loss function used during training determines which summary statistic is learned. One common summary statistic that has not been combined with deep learning (as far as the authors are aware) is the mode. A neural network-based approach to mode learning is proposed and empirically demonstrated in the context of high energy jet calibrations. Altogether, the neural network-based toolkit for detector response parameterization can enhance the utility of data collected at high energy physics experiments and beyond.

47 OTHER INSTRUMENTATION↗
DOE OSTI2021

PRISM3D: a 3-D reference seismic model for Iberia and adjacent areas

SUMMARY We present PRISM3D, a 3-D reference seismic model of P- and S-wave velocities for Iberia and adjacent areas. PRISM3D results from the combination of the most up-to-date earth models available for the region. It extends horizontally from 15°W to 5°E in longitude, 34°N to 46°N in latitude and vertically from 3.5 km above to 200 km below sea level, and is modelled on a regular grid with 10 and 0.5 km of grid node spacing in the horizontal and vertical directions, respectively. It was designed using models inferred from local and teleseismic body-wave tomography, earthquake and ambient noise surface wave tomography, receiver function analysis and active source experiments. It includes two interfaces, namely the topography/bathymetry and the Mohorovičić (Moho) discontinuity. The Moho was modelled from previously published receiver function analysis and deep seismic sounding results. To that end we used a probabilistic surface reconstruction algorithm that allowed to extract the mean of the Moho depth surface along with its associated standard deviation, which provides a depth uncertainty estimate. The Moho depth model is in good agreement with previously published models, although it presents slightly sharper gardients in orogenic areas such as the Pyrenees or the Betic-Rif system. Crustal and mantle P- and S-wave wave speed grids were built separately on each side of the Moho depth surface by weighted average of existing models, thus allowing to realistically render the speed gradients across that interface. The associated weighted standard deviation was also calculated, which provides an uncertainty estimation on the average wave speed values at any point of the grid. At shallow depths (<10 km), low P and S wave speeds and high VP/VS are observed in offshore basins, while the Iberian Massif, which covers a large part of western Iberia, appears characterized by a rather flat Moho, higher than average VP and VS and low VP/VS. Conversely, the Betic-Rif system seems to be associated with low VP and VS, combined with high VP/VS in comparison to the rest of the study area. The most prominent feature of the mantle is the well known high wave speed anomaly related to the Alboran slab imaged in various mantle tomography studies. The consistency of PRISM3D with previous work is verified by comparing it with two recent studies, with which it shows a good general agreement.The impact of the new 3-D model is illustrated through a simple synthetic experiment, which shows that the lateral variations of the wave speed can produce traveltime differences ranging from –1.5 and 1.5 s for P waves and from –2.5 and 2.5 s for S waves at local to regional distances. Such values are far larger than phase picking uncertainties and would likely affect earthquake hypocentral parameter estimations. The new 3-D model thus provides a basis for regional studies including earthquake source studies, Earth structure investigations and geodynamic modelling of Iberia and its surroundings.

Arroucau, P.↗
DOE OSTI2023

Data-Driven Affinely Adjustable Robust Volt/VAr Control

Recent years have seen the increasing proliferation of distributed energy resources with intermittent power outputs, posing new challenges to the voltage management in distribution networks. To this end, this paper proposes a data-driven affinely adjustable robust Volt/VAr control (AARVVC) scheme, which modulates the smart inverter’s reactive power in an affine function of its active power, based on the voltage sensitivities with respect to real/reactive power injections. To achieve a fast and accurate estimation of voltage sensitivities, we propose a data-driven method based on deep neural network (DNN), together with a rule-based bus-selection process using the bidirectional search method. Our method only uses the operating statuses of selected buses as inputs to DNN, thus significantly improving the training efficiency and reducing information redundancy. Finally, a distributed consensus-based solution, based on the alternating direction method of multipliers (ADMM), for the AARVVC is applied to decide the inverter’s reactive power adjustment rule with respect to its active power. Only limited information exchange is required between each local agent and the central agent to obtain the slope of the reactive power adjustment rule, and there is no need for the central agent to solve any (sub)optimization problems. Finally, numerical results on the modified IEEE-123 bus system validate the effectiveness and superiority of the proposed data-driven AARVVC method.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2026

Learning thermodynamic master equations for open quantum systems

The characterization of Hamiltonians and other components of open quantum dynamical systems plays a crucial role in quantum computing and other applications. Scientific machine learning techniques have been applied to this problem in a variety of ways, including by modeling with deep neural networks. However, the majority of mathematical models describing open quantum systems are linear, and the natural nonlinearities in learnable models have not been incorporated using physical principles. We present a data-driven model for open quantum systems that includes learnable, thermodynamically consistent terms. The trained model is interpretable, as it directly estimates the system Hamiltonian and linear components of coupling to the environment. We validate the model on synthetic two and three-level data, as well as experimental two-level data collected from a quantum device at Lawrence Livermore National Laboratory.

Mathematics and Computing↗
DOE OSTI2024

Missing Wedge Completion via Unsupervised Learning with Coordinate Networks

Cryogenic electron tomography (cryoET) is a powerful tool in structural biology, enabling detailed 3D imaging of biological specimens at a resolution of nanometers. Despite its potential, cryoET faces challenges such as the missing wedge problem, which limits reconstruction quality due to incomplete data collection angles. Recently, supervised deep learning methods leveraging convolutional neural networks (CNNs) have considerably addressed this issue; however, their pretraining requirements render them susceptible to inaccuracies and artifacts, particularly when representative training data is scarce. To overcome these limitations, we introduce a proof-of-concept unsupervised learning approach using coordinate networks (CNs) that optimizes network weights directly against input projections. This eliminates the need for pretraining, reducing reconstruction runtime by 3–20× compared to supervised methods. Our in silico results show improved shape completion and reduction of missing wedge artifacts, assessed through several voxel-based image quality metrics in real space and a novel directional Fourier Shell Correlation (FSC) metric. Our study illuminates benefits and considerations of both supervised and unsupervised approaches, guiding the development of improved reconstruction strategies.

42 ENGINEERING↗
DOE OSTI2024

Measurement of Nuclear Dependence in Inclusive Antineutrino Scattering

One of the fundamental questions in physics is the matter-antimatter asymmetry of the Universe, explored through charge-parity violation searches in neutrino oscillation experiments. Next-generation oscillation experiments like DUNE need to constrain the systematic uncertainties arising from our understanding of (anti)neutrino-nucleus scattering to within a few percent to achieve their physics goals. MINERvA, a dedicated (anti)neutrino-nucleus scattering experiment, plays a crucial role in constraining these uncertainties. This thesis presents MINERvA's first high-statistics direct measurement of nuclear dependence in charged-current inclusive antineutrino scattering on carbon, hydrocarbon, iron, and lead as a function of antimuon transverse momentum, $p_{\text{T}}$, and Bjorken~$x$. The analysis utilises interactions with a mean antineutrino energy of approximately~6~GeV, with reconstructed antimuons having a scattering angle of less than 17$^\circ$ relative to the antin eutrino beam and an antimuon energy of 2--20 GeV. The measured per-nucleon differential cross-sections are reported with a precision of 7--9\%, while the cross-section ratios of carbon, iron, and lead to hydrocarbon have uncertainties of 5\% or less. The cross-sections for iron and lead indicate strong suppression at low $p_{\text{T}}$ and Bjorken~$x$, and an enhancement at high $p_{\text{T}}$. These effects are observed to be more pronounced with the increasing size of the target nucleus and are not reproduced by the underlying simulation prediction. Comparisons to alternative models used in current (anti)neutrino interaction generators show some improvements in modelling over the base prediction model, yet they are still unable to fully reproduce the observed nuclear dependence in this analysis. Importantly, the analysis provides a direct test of nuclear effects in inclusive antineutrino scattering, with major contributions from resonant pion production, deep inelastic scattering, and the transition region between these channels, which will be significant in DUNE. This measurement also represents one of the largest antineutrino datasets in this energy regime analysed to date.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2022

SPANet: Generalized permutationless set assignment for particle physics using symmetry preserving attention

The creation of unstable heavy particles at the Large Hadron Collider is the most direct way to address some of the deepest open questions in physics. Collisions typically produce variable-size sets of observed particles which have inherent ambiguities complicating the assignment of observed particles to the decay products of the heavy particles. Current strategies for tackling these challenges in the physics community ignore the physical symmetries of the decay products and consider all possible assignment permutations and do not scale to complex configurations. Attention based deep learning methods for sequence modelling have achieved state-of-the-art performance in natural language processing, but they lack built-in mechanisms to deal with the unique symmetries found in physical set-assignment problems. We introduce a novel method for constructing symmetry-preserving attention networks which reflect the problem's natural invariances to efficiently find assignments without evaluating all permutations. This general approach is applicable to arbitrarily complex configurations and significantly outperforms current methods, improving reconstruction efficiency between 19% - 35% on typical benchmark problems while decreasing inference time by two to five orders of magnitude on the most complex events, making many important and previously intractable cases tractable. A full code repository containing a general library, the specific configuration used, and a complete dataset release, are available at https://github.com/Alexanders101/SPANet

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2025

jaxhps: An elliptic PDE solver built with machine learning in mind

Elliptic partial differential equations (PDEs) can model many physical phenomena, such as electrostatics, acoustics, wave propagation, and diffusion. In scientific machine learning settings, a high-throughput PDE solver may be required to generate a training dataset, run in the inner loop of an iterative algorithm, or interface directly with a deep neural network. To provide value to machine learning users, such a PDE solver must be compatible with standard automatic differentiation frameworks, scale efficiently when run on graphics processing units (GPUs), and maintain high accuracy for a large range of input parameters. We have designed the jaxhps package with these use-cases in mind by implementing a highly efficient and accurate solver for elliptic problems with native hardware acceleration and automatic differentiation support.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Comparative Life Cycle Analysis of Carbon Dioxide Utilization in Concrete Products

In this study, a comparative LCA of CO2U concrete processes is conducted, revealing promise in several research areas. The environmental impacts of replacing conventional binder and aggregates with carbonated steel slag and direct carbonation of concrete are investigated in ten different product systems, which include both ready-mix and pre-cast concretes. The results indicate that cement substitution, CO2 uptake, electricity consumption, and the electricity grid mix constitute critical levers for deep decarbonization of concrete building materials. This presentation applies LCA to inform the use of CO2U concrete technology pathways in the design of sustainable concrete while promoting transparency and rational assumptions in the presence of uncertainty. Broader themes in the work include LCA of emerging technologies and the sensitivity of LCA results to co-product management methods.

Clarke, James↗
DOE OSTI2021

Deep Learning Predicts Stress–Strain Relations of Granular Materials Based on Triaxial Testing Data

This study presents an AI-based constitutive modelling framework wherein the prediction model directly learns from triaxial testing data by combining discrete element modelling (DEM) and deep learning. A constitutive learning strategy is proposed based on the generally accepted frame-indifference assumption in constructing material constitutive models. The low-dimensional principal stress-strain sequence pairs, measured from discrete element modelling of triaxial testing, are used to train recurrent neural networks, and then the predicted principal stress sequence is augmented to other high-dimensional or general stress tensor via coordinate transformation. Through detailed hyperparameter investigations, it is found that long short-term memory (LSTM) and gated recurrent unit (GRU) networks have similar prediction performance in constitutive modelling problems, and both satisfactorily predict the stress responses of granular materials subjected to a given unseen strain path. Furthermore, the unique merits and ongoing challenges of data-driven constitutive models for granular materials are discussed.

42 ENGINEERING↗
DOE OSTI2023

Decarbonization of the Chemical Industry Through Electrification: Barriers and Opportunities

The chemical industry is a major source of economic productivity and employment globally and among the top 3 industrial sources of greenhouse gas (GHG) emissions, along with steel and cement. As global demand for chemical products continues to grow, there is an urgency to develop and deploy sustainable chemical production pathways and to reconsider continued investment in current emission-intensive production technologies. This perspective describes the challenges and opportunities to decarbonize the chemical industry via electrification powered by low-carbon electricity supply, both in the near term and long term, and it discusses four technological pathways ranging from the more mature direct substitution of heat with electricity and use of hydrogen to technologically less mature, yet potentially more selective, approaches based on electrochemistry and plasma. Finally, we highlight the key elements of integrating an electrified industrial process with the power sector to leverage process flexibility to reduce energy costs of chemical production and provide valuable power grid support services. Unlocking such plant-to-grid coordination and the four electrification pathways has significant potential to facilitate rapid and deep decarbonization of the chemical industry sector.

chemical synthesis↗
DOE OSTI2023

Towards Geospatial Knowledge Graph Infused Neuro-Symbolic AI for Remote Sensing Scene Understanding

Deep learning has proven its effectiveness in numerous tasks for remote sensing scene understanding. However there is an increasing interest to explore fusion of domain-specific background information to the deep neural network to further improve its performance. Remote sensing researchers are also working towards developing models that generalize and adapt to multiple applications. Generalization challenges coupled with the scarcity of large corpora of high-quality noise-free labelled data, have together fueled an interest for leveraging background information. Knowledge graphs serve as excellent choice to represent domain-specific information in a structured, standardized and extensible manner. Integrating symbolic knowledge representations in the form of Knowledge Graph Embedding (KGE) to perform neuro-symbolic reasoning is an emerging research direction promising significant impacts. This vision paper seeks to position ideas and provoke early thoughts toward advancing neuro-symbolic artificial intelligence in the context of geospatial challenges. Specifically, it conceptualizes and elaborates on an architecture for infusing geospatial knowledge from knowledge graph in a deep neural network pipeline. As guiding case studies - land-use land-cover classification, object detection and instance segmentation can benefit from infusing spatio-contextual information with remote sensing imagery. The discussion further reflects on and articulates the challenges and explainable AI opportunities anticipated when scaling and maintaining large-scale geospatial knowledge graphs.

Potnis, Abhishek↗