Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “deep neural network”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 541 records · Page 30
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Chapter 14: Machine Learning of Combustion LES Models from Reacting Direct Numerical Simulation

In this chapter we demonstrate how supervised deep learning techniques can be used to construct models for the filtered progress variable source term necessary for large eddy simulation (LES). The source data for the model is a direct numerical simulation (DNS) of a reacting flow in a low swirl burner configuration. Filtered quantities taken from the DNS data are used to train a deep neural network (DNN)-based model. An efficient data sampling strategy was devised to ensure that a uniform representation of all the states observed in the filtered DNS data are equally present in the training dataset. A-priori testing of the DNN-based model highlights the representative power of DNN to accurately reproduce the filtered reaction progress variable source term over a range of scales and various flame regimes as seen in an industrial burner.

combustion LES models↗
DOE OSTI2020

Toward Real-Time Analysis of Synchrotron Micro-Tomography Data: Accelerating Experimental Workflows with AI and HPC

ynchrotron light sources are routinely used to perform imaging experiments. In this paper, we review the relevant computational stages, identify bottlenecks, and highlight future opportunities to streamline data acquisition for experimental microscopy workflows. We demonstrate our preliminary exploration with an end-to-end scientific workflow on Summit based on micro-computed tomography data. Computational elements include: 1) reconstruction of volumetric image data; 2) denoising with deep neural networks; and 3) non-local means based segmentation and quantitative analysis.

Mcclure, James↗
DOE OSTI2023

Transferable Adversarial Attack on 3D Object Tracking in Point Cloud

3D point cloud object tracking has recently witnessed considerable progress relying on deep learning. Such progress, however, mainly focuses on improving tracking accuracy. The risk, especially considering that deep neural network is vulnerable to adversarial perturbations, of a tracker being attacked is often neglected and rarely explored. In order to attract attentions to this potential risk and facilitate the study of robustness in point cloud tracking, we introduce a novel transferable attack network (TAN) to deceive 3D point cloud tracking. Specifically, TAN consists of a 3D adversarial generator, which is trained with a carefully designed multi-fold drift (MFD) loss. The MFD loss considers three common grounds, including classification, intermediate feature and angle drifts, across different 3D point cloud tracking frameworks for perturbation generation, leading to high transferability of TAN for attack. In our extensive experiments, we demonstrate the proposed TAN is able to not only drastically degrade the victim 3D point cloud tracker, \ie, P2B, but also effectively deceive other unseen state-of-the-art approaches such as BAT and M^2Track, posing a new threat to 3D point cloud tracking.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Search for flavor-changing neutral current interactions of the top quark and the Higgs boson decaying to a bottom quark-antiquark pair at $ \sqrt{s} $ = 13 TeV

A search for flavor-changing neutral current interactions of the top quark (t) and the Higgs boson (H) is presented. The search is based on a data sample corresponding to an integrated luminosity of 137 fb-1 recorded by the CMS experiment at the LHC in proton-proton collisions at √s = 13 TeV. Events containing exactly one lepton (muon or electron) and at least three jets, among which at least two are identified as originating from the hadronization of a bottom quark, are analyzed. A set of deep neural networks is used for kinematic event reconstruction, while boosted decision trees distinguish the signal from the background events. No significant excess over the background predictions is observed, and upper limits on the signal production cross sections are extracted. These limits are interpreted in terms of top quark decay branching fractions (B) to the Higgs boson and an up (u) or a charm quark (c). Assuming one nonvanishing extra coupling at a time, the observed (expected) upper limits at 95% confidence level are B(t → Hu) < 0.079 (0.11)% and B(t → Hc) < 0.094 (0.086)%.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2025

Measurements of inclusive and differential cross sections for top quark production in association with a Z boson in proton-proton collisions at $\sqrt{s} $ = 13 TeV

Measurements are presented of inclusive and differential cross sections for Z boson associated production of top quark pairs ($ \textrm{t}\overline{\textrm{t}}\textrm{Z} $) and single top quarks (tZq or tWZ). The data were recorded in proton-proton collisions at a center-of-mass energy of 13 TeV, corresponding to an integrated luminosity of 138 fb$^{−1}$. Events with three or more leptons, electrons or muons, are selected and a multiclass deep neural network is used to separate three event categories, the $ \textrm{t}\overline{\textrm{t}}\textrm{Z} $ and tWZ processes, the tZq process, and the backgrounds. A profile likelihood approach is used to unfold the differential cross sections, to account for systematic uncertainties, and to determine the correlations between the two signal categories in one global fit. The inclusive cross sections for a dilepton invariant mass between 70 and 110 GeV are measured to be 1.14 ± 0.07 pb for the sum of $ \textrm{t}\overline{\textrm{t}}\textrm{Z} $ and tWZ, and 0.81 ± 0.10 pb for tZq, in good agreement with theoretical predictions.[graphic not available: see fulltext]

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2024

Search for Long-Lived Heavy Neutral Leptons with Lepton Flavour Conserving or Violating Decays to a Jet and a Charged Lepton

A search for long-lived heavy neutral leptons (HNLs) is presented, which considers the hadronic final state and coupling scenarios involving all three lepton generations in the 2–20 GeV HNL mass range for the first time. Events comprising two leptons (electrons or muons) and jets are analyzed in a data sample of proton-proton collisions, recorded with the CMS experiment at the CERN LHC at a centre-of-mass energy of 13 TeV, corresponding to an integrated luminosity of 138 fb$^{−1}$. A novel jet tagger, based on a deep neural network, has been developed to identify jets from an HNL decay using various features of the jet and its constituent particles. The network output can be used as a powerful discriminating tool to probe a broad range of HNL lifetimes and masses. Contributions from background processes are determined from data. No excess of events in data over the expected background is observed. Upper limits on the HNL production cross section are derived as functions of the HNL mass and the three coupling strengths V$_{ℓN}$ to each lepton generation ℓ and presented as exclusion limits in the coupling-mass plane, as lower limits on the HNL lifetime, and on the HNL mass. In this search, the most stringent limit on the coupling strength is obtained for pure muon coupling scenarios; values of |$ {V}_{\mu \textrm{N}}^2 $| > 5 (4) × 10$^{−7}$ are excluded for Dirac (Majorana) HNLs with a mass of 10 GeV at a confidence level of 95% that correspond to proper decay lengths of 17 (10) mm.[graphic not available: see fulltext]

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2025

Search for vector-like leptons coupling to first- and second-generation Standard Model leptons in pp collisions at s = 13 TeV with the ATLAS detector

A search for pair production of vector-like leptons coupling to first- and second-generation Standard Model leptons is presented. The search is based on a dataset of proton-proton collisions at s$$ \sqrt{s} $$ = 13 TeV recorded with the ATLAS detector during Run 2 of the Large Hadron Collider, corresponding to an integrated luminosity of 140 fb−1. Events are categorised depending on the flavour and multiplicity of leptons (electrons or muons), as well as on the scores of a deep neural network targeting particular signal topologies according to the decay modes of the vector-like leptons. In each of the signal regions, the scalar sum of the transverse momentum of the leptons and the missing transverse momentum is analysed. The main background processes are estimated using dedicated control regions in a simultaneous fit with the signal regions to data. No significant excess above the Standard Model background expectation is observed and limits are set at 95% confidence level on the production cross-sections of vector-like electrons and muons as a function of the vector-like lepton mass, separately for SU(2) doublet and singlet scenarios. The resulting mass lower limits are 1220 GeV (1270 GeV) and 320 GeV (400 GeV) for vector-like electrons (muons) in the doublet and singlet scenarios, respectively.

Aad, G↗
DOE OSTI2023

Search for long-lived particles using out-of-time trackless jets in proton-proton collisions at $\sqrt{s}$ = 13 TeV

A search for long-lived particles decaying in the outer regions of the CMS silicon tracker or in the calorimeters is presented. The search is based on a data sample of proton-proton collisions at $\sqrt{s}$ = 13 TeV recorded with the CMS detector at the LHC in 2016–2018, corresponding to an integrated luminosity of 138 fb −1 . A novel technique, using nearly trackless and out-of-time jet information combined in a deep neural network discriminator, is employed to identify decays of long-lived particles. The results are interpreted in a simplified model of chargino-neutralino production, where the neutralino is the next-to-lightest supersymmetric particle, is long-lived, and decays to a gravitino and either a Higgs or Z boson. This search is most sensitive to neutralino proper decay lengths of approximately 0.5 m, for which masses up to 1.18 TeV are excluded at 95% confidence level. The current search is the best result to date in the mass range from the kinematic limit imposed by the Higgs boson mass up to 1.8 TeV.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2024

Is infrared-collinear safe information all you need for jet classification?

Machine learning-based jet classifiers are able to achieve impressive tagging performance in a variety of applications in high-energy and nuclear physics. However, it remains unclear in many cases which aspects of jets give rise to this discriminating power, and whether jet observables that are tractable in perturbative QCD such as those obeying infrared-collinear (IRC) safety serve as sufficient inputs. In this article, we introduce a new classifier, Jet Flow Networks (JFNs), in an effort to address the question of whether IRC unsafe information provides additional discriminating power in jet classification. JFNs are permutation-invariant neural networks (deep sets) that take as input the kinematic information of reconstructed subjets. The subjet radius and a cut on the subjet’s transverse momenta serve as tunable hyperparameters enabling a controllable sensitivity to soft emissions and nonperturbative effects. We demonstrate the performance of JFNs for quark vs. gluon and Z vs. QCD jet tagging. For small subjet radii and transverse momentum cuts, the performance of JFNs is equivalent to the IRC-unsafe Particle Flow Networks (PFNs), demonstrating that infrared-collinear unsafe information is not necessary to achieve strong discrimination for both cases. As the subjet radius is increased, the performance of the JFNs remains essentially unchanged until physical thresholds that we identify are crossed. For relatively large subjet radii, we show that the JFNs may offer an increased model independence with a modest tradeoff in performance compared to classifiers that use the full particle information of the jet. These results shed new light on how machines learn patterns in high-energy physics data.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2020

Inclusive search for highly boosted Higgs bosons decaying to bottom quark-antiquark pairs in proton-proton collisions at $\sqrt{s} =$ 13 TeV

A search for standard model Higgs bosons (H) produced with transverse momentum (p$_{T}$) greater than 450 GeV and decaying to bottom quark-antiquark pairs ($ \mathrm{b}\overline{\mathrm{b}} $) is performed using proton-proton collision data collected by the CMS experiment at the LHC at $ \sqrt{s} $ = 13 TeV. The data sample corresponds to an integrated luminosity of 137 fb$^{−1}$. The search is inclusive in the Higgs boson production mode. Highly Lorentz-boosted Higgs bosons decaying to $ \mathrm{b}\overline{\mathrm{b}} $ are reconstructed as single large-radius jets, and are identified using jet substructure and a dedicated b tagging technique based on a deep neural network. The method is validated with Z →$ \mathrm{b}\overline{\mathrm{b}} $ decays. For a Higgs boson mass of 125 GeV, an excess of events above the background assuming no Higgs boson production is observed with a local significance of 2.5 standard deviations (σ), while the expectation is 0.7. The corresponding signal strength and local significance with respect to the standard model expectation are μ$_{H}$ = 3.7 ± 1.2(stat)$ {}_{-0.7}^{+0.8} $(syst)$ {}_{-0.5}^{+0.8} $(theo) and 1.9 σ. Additionally, an unfolded differential cross section as a function of Higgs boson p$_{T}$ for the gluon fusion production mode is presented, assuming the other production modes occur at the expected rates.[graphic not available: see fulltext]

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2022

Systematic quark/gluon identification with ratios of likelihoods

Discriminating between quark- and gluon-initiated jets has long been a central focus of jet substructure, leading to the introduction of numerous observables and calculations to high perturbative accuracy. At the same time, there have been many attempts to fully exploit the jet radiation pattern using tools from statistics and machine learning. We propose a new approach that combines a deep analytic understanding of jet substructure with the optimality promised by machine learning and statistics. After specifying an approximation to the full emission phase space, we show how to construct the optimal observable for a given classification task. This procedure is demonstrated for the case of quark and gluons jets, where we show how to systematically capture sub-eikonal corrections in the splitting functions, and prove that linear combinations of weighted multiplicity is the optimal observable. In addition to providing a new and powerful framework for systematically improving jet substructure observables, we demonstrate the performance of several quark versus gluon jet tagging observables in parton-level Monte Carlo simulations, and find that they perform at or near the level of a deep neural network classifier. Combined with the rapid recent progress in the development of higher order parton showers, we believe that our approach provides a basis for systematically exploiting subleading effects in jet substructure analyses at the Large Hadron Collider (LHC) and beyond.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2023

Search for heavy Higgs bosons with flavour-violating couplings in multi-lepton plus b-jets final states in pp collisions at 13 TeV with the ATLAS detector

A search for new heavy scalars with flavour-violating decays in final states with multiple leptons and b-tagged jets is presented. The results are interpreted in terms of a general two-Higgs-doublet model involving an additional scalar with couplings to the top-quark and the three up-type quarks (ρ tt , ρ tc , and ρ tu ). The targeted signals lead to final states with either a same-sign top-quark pair, three top-quarks, or four top-quarks. The search is based on a data sample of proton-proton collisions at $\sqrt{s}$ = 13 TeV recorded with the ATLAS detector during Run 2 of the Large Hadron Collider, corresponding to an integrated luminosity of 139 fb –1 . Events are categorised depending on the multiplicity of light charged leptons (electrons or muons), total lepton charge, and a deep-neural-network output to enhance the purity of each of the signals. Masses of an additional scalar boson m H between 200 – 630 GeV with couplings ρ tt = 0.4, ρ tc = 0.2, and ρ tu = 0.2 are excluded at 95% confidence level. Additional interpretations are provided in models of R-parity violating supersymmetry, motivated by the recent flavour and (g – 2) μ anomalies.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2023

Efficient multi-scale representation of visual objects using a biologically plausible spike-latency code and winner-take-all inhibition

Deep neural networks have surpassed human performance in key visual challenges such as object recognition, but require a large amount of energy, computation, and memory. In contrast, spiking neural networks (SNNs) have the potential to improve both the efficiency and biological plausibility of object recognition systems. Here we present a SNN model that uses spike-latency coding and winner-take-all inhibition (WTA-I) to efficiently represent visual stimuli using multi-scale parallel processing. Mimicking neuronal response properties in early visual cortex, images were preprocessed with three different spatial frequency (SF) channels, before they were fed to a layer of spiking neurons whose synaptic weights were updated using spike-timing-dependent-plasticity. We investigate how the quality of the represented objects changes under different SF bands and WTA-I schemes. We demonstrate that a network of 200 spiking neurons tuned to three SFs can efficiently represent objects with as little as 15 spikes per neuron. Furthermore, studying how core object recognition may be implemented using biologically plausible learning rules in SNNs may not only further our understanding of the brain, but also lead to novel and efficient artificial vision systems.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

A Decision-Making Machine Learning Approach in Hermite Spectral Approximations of Partial Differential Equations

The accuracy and effectiveness of Hermite spectral methods for the numerical discretization of partial differential equations on unbounded domains are strongly affected by the amplitude of the Gaussian weight function employed to describe the approximation space. This is particularly true if the problem is under-resolved, i.e., there are no enough degrees of freedom. The issue becomes even more crucial when the equation under study is time-dependent, forcing in this way the choice of Hermite functions where the corresponding weight depends on time. In order to adapt dynamically the approximation space, it is here proposed an automatic decision-making process that relies on machine learning techniques, such as deep neural networks and support vector machines. The algorithm is numerically tested with success on a simple 1D problem, but the main goal is its exportability in the context of more serious applications. Here we also show at the end an application in the framework of plasma physics.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Analysis-Specific Fast Simulation at the LHC with Deep Learning

Abstract We present a fast-simulation application based on a deep neural network, designed to create large analysis-specific datasets. Taking as an example the generation of W + jet events produced in $$\sqrt{s}=$$ s = 13 TeV proton–proton collisions, we train a neural network to model detector resolution effects as a transfer function acting on an analysis-specific set of relevant features, computed at generation level, i.e., in absence of detector effects. Based on this model, we propose a novel fast-simulation workflow that starts from a large amount of generator-level events to deliver large analysis-specific samples. The adoption of this approach would result in about an order-of-magnitude reduction in computing and storage requirements for the collision simulation workflow. This strategy could help the high energy physics community to face the computing challenges of the future High-Luminosity LHC.

Chen, C.↗
DOE OSTI2024

Machine learning-driven descriptions of protein dynamics at solid-liquid interfaces

This chapter has described how ML has enabled quantitative analysis of HS-AFM data to discover the physical phenomena governing protein dynamics and ordering at solid-liquid interfaces. The research detailed in this chapter modeled the rotation models of protein nanorods, the discovery of which would otherwise not be possible. By tracking the trajectories of individual protein rods from frame to frame, it was possible to model Brownian type motion and behaviors and Levy-flight dynamics that had not previously been shown. We also described the application of the Python package AtomAI, which has been developed specifically to analyze and extract physical phenomena, providing exemplar code for training an ensemble of deep neural networks to produce the semantic segmentation of AFM data and functions for encoding and decoding local environments. We last described a combinatorial approach to analyze very noisy data with a densely covered substrate where the emergence of order for the protein liquid crystals could be elucidated. By combining the methods from Case 1 and 2, it was possible to obtain the center of mass and angle for each rod in the images and track the assembly of the rods over time into a 2D liquid crystal array on the surface of mica.

protein dynamics, solid-liquid interfaces, atomic ↗
DOE OSTI2025

Multi-objective surrogate-assisted calibration of CPFEM models using macroscopic response and in situ EBSD measurements of grain reorientation trajectories

Crystal plasticity finite element method (CPFEM) models are widely used to simulate the deformation behaviour of polycrystalline materials, but their calibration is often limited by their high computational cost and the non-convexity of the optimisation landscape. Here, this study develops a multi-objective surrogate-assisted calibration workflow that couples a multi-objective genetic algorithm (MOGA) with an adaptively trained deep neural network (DNN) surrogate model to efficiently identify CPFEM parameters from experimental data. The workflow is demonstrated on three crystal plasticity (CP) formulations of increasing complexity — Voce hardening (VH), two-coefficient latent hardening (LH2), and six-coefficient latent hardening (LH6) — using in situ electron backscatter diffraction (EBSD) measurements of Alloy 617 under uniaxial tensile loading. The CPFEM models are calibrated against the experimentally observed stress–strain response and reorientation trajectories of eight grains, then validated against eight additional trajectories and overall texture evolution. Across the CP formulations, the macroscopic response was reproduced reliably, while differences emerged in the robustness and accuracy of the grain-scale predictions. Including grain reorientation trajectories in the multi-objective calibration improved texture evolution predictions and filtered out physically inconsistent parameter sets that can arise from calibrating against only the stress–strain data. The workflow also demonstrates good transferability of calibrated parameters from a low- to a high-fidelity microstructural model. These results provide practical guidance for integrating in situ microstructural data into CPFEM through efficient, repeatable, and physically meaningful multi-objective calibration.

Crystal plasticity finite element method↗
DOE OSTI2023

Machine learning–assisted prediction of heat fluxes through thermally anisotropic building envelopes

Thermally anisotropic building envelope (TABE) is a novel active building envelope that can save energy use to maintain thermal comfort in buildings by redirecting heat and coolness from building envelopes to thermal loops. Finite element models (FEMs) can be used to compute the heat fluxes through TABEs, but the high computational cost of finite element simulations has prevented parametric studies and design optimizations. This paper proposes a domain knowledge–informed, finite element–based machine learning framework to reduce the computation cost for the energy management of buildings installed with TABE that uses a ground thermal loop. First, the training heat flux data set was generated by FEM simulations with different thermal loop schedules. Then, both shallow learning models (i.e., multivariate linear regression and eXtreme Gradient Boost, or XGBoost) and a deep learning model (i.e., deep neural network, or DNN) were trained to predict the heat fluxes. Domain knowledge was used for data preprocessing and feature selection. Finally, the suitability of the selected machine learning model was tested under different thermal loop schedules. Herein, the case study results showed that: (1) XGBoost can be as accurate as DNN (coefficient of determination equal to 0.81) with much less training time; (2) the annual energy cost savings for different thermal loop schedules obtained by the XGBoost-predicted and FEM-calculated heat fluxes are consistent, having a difference of only 4%; and (3) XGBoost can reduce the computation time for the annual energy analysis of the case study building with a given thermal loop schedule from around 12 h by using FEM to less than 1 min.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗