Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “generative machine learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 577 records · Page 32

Machine Learning Predictions of a Multiresolution Climate Model Ensemble

Statistical models of high-resolution climate models are useful for many purposes, including sensitivity and uncertainty analyses, but building them can be computationally prohibitive. We generated a unique multiresolution perturbed parameter ensemble of a global climate model. We use a novel application of a machine learning technique known as random forests to train a statistical model on the ensemble to make high-resolution model predictions of two important quantities: global mean top-of-atmosphere energy flux and precipitation. The random forests leverage cheaper low-resolution simulations, greatly reducing the number of high-resolution simulations required to train the statistical model. We demonstrate that high-resolution predictions of these quantities can be obtained by training on an ensemble that includes only a small number of high-resolution simulations. Finally, we also find that global annually averaged precipitation is more sensitive to resolution changes than to any of the model parameters considered.

54 ENVIRONMENTAL SCIENCES↗

Multi-objective optimization techniques to design the Pareto front of organic dielectric polymers

Here, we present two Monte Carlo algorithms to find the Pareto front of the chemical space of a class of dielectric polymers that is most interesting with respect to optimizing both the bandgap and dielectric constant. Starting with a dataset generated from density functional theory calculations, we used machine learning to construct surrogate models for the bandgaps and dielectric constants of all physically meaningful 4-block polymers (that is, polymer systems with a 4-block repeat unit). We parameterized these machine learning models in such a way that the surrogates built for the 4-block polymers were readily extendable to polymers beyond a 4-block repeat unit. By using translational invariance, chemical intuition, and domain knowledge, we were able to enumerate all possible 4, 6, and 8 block polymers and benchmark our Monte Carlo sampling of the chemical space against the exact enumeration of the surrogate predictions. We obtained exact agreement for the fronts of 4-block polymers and at least a 90% agreement for those of 6 and 8-block polymers. We present fronts for 10-block polymer that are not possible to obtain by direct enumeration. We note that our Monte Carlo methods also return polymers close to the predicted front and a measure of the closeness. Both quantities are useful information for the design and discovery of new polymers.

36 MATERIALS SCIENCE↗

Review of heat transfer enhancement techniques for single phase flows

The thermal energy exchange between a flowing fluid and its confining channel is a ubiquitous process in modern society. To enhance the fluid-to-wall or wall-to-fluid heat transfer, several techniques have been developed to maximize the contact area between the fluid and the inner wall and/or disrupt the flow to enhance circulation or induce turbulence. Deployment of channels having features capable of enhancing heat transfer enables the reduction of heat exchanger size while maintaining performance. Reduction in equipment size is critical due to the ability to minimize the required volume of costly working fluids and to mitigate potential safety concerns associated with total system fluid volume. Here, a comprehensive review of single-phase heat transfer enhancement techniques is presented. The article provides a thorough comparison by analyzing the heat transfer rate, pressure drop, and other operational aspects. Single-phase heat transfer enhancement methods are divided into active and passive techniques. Active methods such as electrohydrodynamic (EHD), magnetohydrodynamics (MHD), or mechanical motion require external power to create enhancement. Passive methods such as dimples, fins, or tape inserts do not require external input and rely only on surface modification. Although active methods are more expensive and difficult to implement compared to passive techniques, it enables active control of heat transfer augmentation. Finally, this review develops and summarizes key learning data for design optimization enabled by additive manufacturing and machine learning algorithms, helping to inform these next-generation heat exchanger design methodologies for a plethora of modern applications such as electrification of vehicles, computing, and classical industries.

42 ENGINEERING↗

Rapid Identification of Synthetic Routes to Functional Metastable Phases Using X-ray Probed Laser Anneal Mapping (XPLAM) Time-Temperature Quench Maps

Many material systems have known or predicted functional phases that are metastable at standard temperature and pressure. While substantial advances have been made in the high-throughput and combinatorial synthesis of materials with a range of stoichiometries, investigation of thermal processing remains largely the domain of iterative uniform anneals or static gradients. Here we develop X-ray probed laser anneal mapping (XPLAM), a high throughput technique coupling spatially resolved X-ray diffraction with microsecond to millisecond laser gradient anneals to produce temperature–dwell–transformation (TDT) diagrams of the phase as a function of quench time and temperature. In addition to showing regimes where specific metastable phases form preferentially, TDT diagrams provide insight into the submillisecond kinetics of solid–solid phase transitions. This is a unique tool for mapping reaction pathways for metastable phases. As a first demonstration of XPLAM, we study Bi2O3, which has a rich set of polytypes, including the d-phase with an exceptionally high oxygen ion conductivity. We demonstrate the first annealing-driven synthesis of room temperature d-Bi2O3. We expect XPLAM to prove a powerful technique for rapid identification of synthetic routes to metastable phases and to generate the exhaustive data sets required for machine learning-guided exploration of materials processing.

36 MATERIALS SCIENCE↗

Convergent Protocols for Computing Protein–Ligand Interaction Energies Using Fragment-Based Quantum Chemistry

Fragment-based quantum chemistry methods offer a way to sidestep the steep nonlinear scaling of electronic structure calculations so that large molecular systems can be investigated using high-level methods. Here, we use fragmentation to compute protein–ligand interaction energies in systems with several thousand atoms, using a new software platform for managing fragment-based calculations that implements a screened many-body expansion. Convergence tests using a minimal-basis semiempirical method (HF-3c) indicate that two-body calculations, with single-residue fragments and simple hydrogen caps, are sufficient to reproduce interaction energies obtained using conventional supramolecular electronic structure calculations, to within 1 kcal/mol at about 1% of the computational cost. We also demonstrate that the HF-3c results are illustrative of trends obtained with density functional theory in basis sets up to augmented quadruple-ζ quality. Strategic deployment of fragmentation facilitates the use of converged biomolecular model systems alongside high-quality electronic structure methods and basis sets, bringing ab initio quantum chemistry to systems of hitherto unimaginable size. This will be useful for generation of high-quality training data for machine learning applications.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Filming movies of attosecond charge migration in single molecules with high harmonic spectroscopy

Electron migration in molecules is the progenitor of chemical reactions and biological functions after light-matter interaction. Following this ultrafast dynamics, however, has been an enduring endeavor. Here we demonstrate that, by using machine learning algorithm to analyze high-order harmonics generated by two-color laser pulses, we are able to retrieve the complex amplitudes and phases of harmonics of single fixed-in-space molecules. These complex dipoles enable us to construct movies of laser-driven electron migration after tunnel ionization of N 2 and CO 2 molecules at time steps of 50 attoseconds. Moreover, the angular dependence of the migration dynamics is fully resolved. By examining the movies, we observe that electron holes do not just migrate along the laser polarization direction, but may swirl around the atom centers. Our result establishes a general scheme for studying ultrafast electron dynamics in molecules, paving a way for further advance in tracing and controlling photochemical reactions by femtosecond lasers.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

The LHC Olympics 2020 a community challenge for anomaly detection in high energy physics

A new paradigm for data-driven, model-agnostic new physics searches at colliders is emerging, and aims to leverage recent breakthroughs in anomaly detection and machine learning. In order to develop and benchmark new anomaly detection methods within this framework, it is essential to have standard datasets. To this end, we have created the LHC Olympics 2020, a community challenge accompanied by a set of simulated collider events. Participants in these Olympics have developed their methods using an R&D dataset and then tested them on black boxes: datasets with an unknown anomaly (or not). Furthermore, methods made use of modern machine learning tools and were based on unsupervised learning (autoencoders, generative adversarial networks, normalizing flows), weakly supervised learning, and semi-supervised learning. This paper will review the LHC Olympics 2020 challenge, including an overview of the competition, a description of methods deployed in the competition, lessons learned from the experience, and implications for data analyses with future datasets as well as future colliders.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

LEMD

Deep neural network-based force field enables researchers to study materials systems of large size and/or time scale efficiently with comparable accuracy to DFT-based methods. However, such force fields, if improperly trained or mistakenly selected, could result in ill-conditioned results. This SBIR Phase I project has explored the possibility to characterize and index force fields in Deep potential theme by quantizing local atomic environments of atoms in a simulation system. This project has also demonstrated the feasibility of building a public accessible web infrastructure providing high quality machine learning algorithm-based force field for next generation materials modeling and simulation to accelerate the study and discovery of new energy-related materials.

Su, Ninghai↗

Load Disaggregation (Modeling Individual Appliance Power Generation & Consumption in Real-Time)

We developed a machine learning-based load disaggregation method to estimate the real-time output of individual appliances from the whole-house measurements. We first learn the important features associated with each type of appliances using the ground truth consumption data of individual appliances potentially available for a small set of houses equipped with submeters. The learned features are then be used to estimate the power generation/consumption of the appliances from the whole-house consumption. This developed load disaggregation software includes two steps. The first step is to identify the on/off status of different appliances using a classification method, and the second step is to estimate the appliance output using a regression method.

Hao, Jun↗

Detecting Soft Errors in Stencil based Computations

Given the growing emphasis on system resilience, it is important to develop software-level error detectors that help trap hardware-level faults with reasonable accuracy while minimizing false alarms as well as the performance overhead introduced. We present a technique that approaches this idea by taking stencil computations as our target, and synthesizing detectors based on machine learning. In particular, we employ linear regression to generate computationally inexpensive models which form the basis for error detection. Our technique has been incorporated into a new open-source library called SORREL. In addition to reporting encouraging experimental results, we demonstrate techniques that help reduce the size of training data. We also discuss the efficacy of various detectors synthesized, as well as our future plans.

97 MATHEMATICS AND COMPUTING↗

The Bias-Variance-Correlation Tradeoff and Its Implications for ML Applications in HEP

The bias-variance tradeoff is a well-recognized phenomenon in statistics and machine learning. In this talk, I will discuss an extension, dubbed the bias-variance-correlation tradeoff. Roughly speaking, as the flexibility of a model decreases, the correlations in the outputs of a trained model for different inputs increases. Such correlations have implications for several applications of machine learning in high energy physics, e.g., the use generative models for event generation. In particular, I will argue that claims in the literature of data amplification by generative models stem from ignoring important correlations between the model's outputs for different inputs.

Shyamsundar, Prasanth [Fermilab] (ORCID:0000000227↗

Assessing shellfish water exposure to fecal bacteria pollution in Salish Sea: three-dimensional modeling and implications for monitoring

Fecal bacteria (FB) contamination poses significant risks to shellfish safety and management in coastal and estuarine waters. Despite extensive pollution identification and correction efforts, FB contamination in shellfish-growing areas persists in the Salish Sea, highlighting the need to identify overlooked sources and better understand FB transport from riverine and shoreline inputs to shellfish beds. To address this, a high-resolution three-dimensional hydrodynamic model coupled with FB kinetics was developed and applied to a case study site in Salish Sea—Portage Bay—to simulate freshwater plume circulation, flushing dynamics, and bacterial transport. Daily FB loading from the major freshwater inflow—Nooksack River was generated by both linear interpolation and integrating a machine learning approach (XGBoost), trained on historical hydrological and meteorological data. The model successfully reproduced both the magnitude and seasonal variation of FB concentrations in Portage Bay for the year of 2021, demonstrating that simplified FB kinetics with first-order decay due to mortality was effective in this dynamic coastal environment with short flushing time. Model results identified the Nooksack River as the dominant far-field FB source, while scenario simulations showed that near-field coastal stormwater outfalls elevated local FB levels following rainfall, particularly under low-flow conditions. The XGBoost prediction provided comparable or superior accuracy to linear interpolation, particularly during periods of missing observational data, by capturing short-term variability and event-driven loading more effectively. Integrating data-driven riverine FB inputs with mechanistic coastal numerical modeling provides a robust framework for operational forecasting of shellfish bed exposure risk and supports adaptive monitoring and management of shellfish growing areas in the Salish Sea and similar coastal systems.

Salish Sea↗

Physically regularized machine learning emulators of aerosol activation

Abstract. The activation of aerosol into cloud droplets is an important step in the formation of clouds and strongly influences the radiative budget of the Earth. Explicitly simulating aerosol activation in Earth system models is challenging due to the computational complexity required to resolve the necessary chemical and physical processes and their interactions. As such, various parameterizations have been developed to approximate these details at reduced computational cost and accuracy. Here, we explore how machine learning emulators can be used to bridge this gap in computational cost and parameterization accuracy. We evaluate a set of emulators of a detailed cloud parcel model using physically regularized machine learning regression techniques. We find that the emulators can reproduce the parcel model at higher accuracy than many existing parameterizations. Furthermore, physical regularization tends to improve emulator accuracy, most significantly when emulating very low activation fractions. This work demonstrates the value of physical constraints in machine learning model development and enables the implementation of improved hybrid physical and machine learning models of aerosol activation into next-generation Earth system models.

58 GEOSCIENCES↗

The Zwicky Transient Facility: Data Processing, Products, and Archive

The Zwicky Transient Facility (ZTF) is a new robotic time-domain survey currently in progress using the Palomar 48-inch Schmidt Telescope. ZTF uses a 47 square degree field with a 600 megapixel camera to scan the entire northern visible sky at rates of ∼3760 square degrees/hour to median depths of g ~ 20.8 and r ~ 20.6 mag (AB, 5σ in 30 sec). We describe the Science Data System that is housed at IPAC, Caltech. This comprises the data-processing pipelines, alert production system, data archive, and user interfaces for accessing and analyzing the products. The real-time pipeline employs a novel image-differencing algorithm, optimized for the detection of point-source transient events. These events are vetted for reliability using a machine-learned classifier and combined with contextual information to generate data-rich alert packets. The packets become available for distribution typically within 13 minutes (95th percentile) of observation. Detected events are also linked to generate candidate moving-object tracks using a novel algorithm. Objects that move fast enough to streak in the individual exposures are also extracted and vetted. We present some preliminary results of the calibration performance delivered by the real-time pipeline. The reconstructed astrometric accuracy per science image with respect to Gaia DR1 is typically 45 to 85 milliarcsec. This is the RMS per-axis on the sky for sources extracted with photometric S/N ≥10 and hence corresponds to the typical astrometric uncertainty down to this limit. The derived photometric precision (repeatability) at bright unsaturated fluxes varies between 8 and 25 millimag. The high end of these ranges corresponds to an airmass approaching ∼2—the limit of the public survey. Photometric calibration accuracy with respect to Pan-STARRS1 is generally better than 2%. The products support a broad range of scientific applications: fast and young supernovae; rare flux transients; variable stars; eclipsing binaries; variability from active galactic nuclei; counterparts to gravitational wave sources; a more complete census of Type Ia supernovae; and solar-system objects.

Frank J. Masci↗

Sub-microsecond Transformers for Jet Tagging on FPGAs

We present the first sub-microsecond transformer implementation on an FPGA achieving competitive performance for state-of-the-art high-energy physics benchmarks. Transformers have shown exceptional performance on multiple tasks in modern machine learning applications, including jet tagging at the CERN Large Hadron Collider (LHC). However, their computational complexity prohibits use in real-time applications, such as the hardware trigger system of the collider experiments up until now. In this work, we demonstrate the first application of transformers for jet tagging on FPGAs, achieving $\mathcal{O}(100)$ nanosecond latency with superior performance compared to alternative baseline models. We leverage high-granularity quantization and distributed arithmetic optimization to fit the entire transformer model on a single FPGA, achieving the required throughput and latency. Furthermore, we add multi-head attention and linear attention support to hls4ml, making our work accessible to the broader fast machine learning community. This work advances the next-generation trigger systems for the High Luminosity LHC, enabling the use of transformers for real-time applications in high-energy physics and beyond.

Laatu, Lauri [Imperial Coll., London]↗

Dark matter effective field theory scattering in direct detection experiments

We examine the consequences of the effective field theory (EFT) of dark matter–nucleon scattering for current and proposed direct detection experiments. Exclusion limits on EFT coupling constants computed using the optimum interval method are presented for SuperCDMS Soudan, CDMS II, and LUX, and the necessity of combining results from multiple experiments in order to determine dark matter parameters is discussed. We demonstrate that spectral differences between the standard dark matter model and a general EFT interaction can produce a bias when calculating exclusion limits and when developing signal models for likelihood and machine learning techniques. We also discuss the implications of the EFT for the next-generation (G2) direct detection experiments and point out regions of complementarity in the EFT parameter space.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗