Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Generative models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 973 records · Page 54
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Multimessenger cosmology: Correlating cosmic microwave background and stochastic gravitational wave background measurements

Characterizing the physical properties of the stochastic gravitational wave background (SGWB) is a key step towards identifying the nature of its possible origin. We focus our analysis on SGWB anisotropies. The existence of a nontrivial primordial scalar-tensor-tensor (STT) correlation in the squeezed configuration may be inferred from the effect that a long wavelength scalar mode has on the gravitational wave power spectrum: an anisotropic contribution. Crucially, such a contribution is correlated with temperature anisotropies in the cosmic microwave background (CMB). This paper shows that, for inflationary models that generate suitably large STT non-Gaussianities, cross correlating the CMB with the stochastic background of gravitational waves is a very effective probe of early universe physics. The resulting signal can be a smoking gun for primordial SGWB anisotropies.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Projected sensitivities of the LUX-ZEPLIN experiment to new physics via low-energy electron recoils

LUX-ZEPLIN is a dark matter detector expected to obtain world-leading sensitivity to weakly-interacting massive particles interacting via nuclear recoils with a ∼7-tonne xenon target mass. This paper presents sensitivity projections to several low-energy signals of the complementary electron recoil signal type: 1) an effective neutrino magnetic moment, and 2) an effective neutrino millicharge, both for 𝑝⁢𝑝-chain solar neutrinos, 3) an axion flux generated by the Sun, 4) axionlike particles forming the Galactic dark matter, 5) hidden photons, 6) mirror dark matter, and 7) leptophilic dark matter. World-leading sensitivities are expected in each case, a result of the large 5.6 t 1000 d exposure and low expected rate of electron-recoil backgrounds in the <100 keV energy regime. A consistent signal generation, background model and profile-likelihood analysis framework is used throughout.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2022

Temporally quasiperiodic data, propagating in the laboratory frame, can be rendered periodic by Galilean transformation

For a broad class of distributions of temperature, concentration, or another quantity propagating rectilinearly, we show that temporally quasiperiodic behavior in the laboratory frame can be rendered periodic by Galilean transformation. The approach is illustrated analytically and numerically using as an example a closed-form model distribution generated from a one-dimensional partial differential equation, and a detailed process is developed to determine frame speed from more general quasiperiodic, one-dimensional, temporally- and spatially-discretized data. Furthermore, the approach is extended to two- and three-dimensional rectilinear propagation, and its application to nonrectilinear propagation, along with implications for interpreting noise-corrupted data, are also discussed.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Spectroscopic Measurements and Models of Energy Deposition in the Substrate of Quantum Circuits by Natural Ionizing Radiation

Naturally occurring background radiation is a potential source of correlated decoherence events in superconducting qubits that will challenge error-correction schemes. In order to characterize the radiation environment in an unshielded laboratory representative of superconducting qubits’ environments, we performed broadband, spectroscopic measurements of background radiation events inside a millikelvin refrigerator. The spectrometer was designed to mimic the size and composition of a quantum circuit. Specifically, we measured the background radiation spectra in silicon substrates of two thicknesses, 500 and 1500 µm, and one area, 25 mm 2 . The observed spectra span energies from a few kilo-electron-volts up to nearly 10 MeV, are nearly featureless, and decrease in intensity by a factor of 40 000 between 100 keV and 3 MeV for the 500-µm substrate. We integrate the spectra to obtain the average event rates and deposited power levels. These quantities correspond to a rate of 0.023 events per second and a power of 4.9 keV s -1 , when counting events that deposit at least 40 keV for the 500-µm-thick substrate. We find that the cryogenic measurements are in good agreement with predictions based on simple measurements of the terrestrial gamma-ray flux outside the refrigerator, published models of cosmic-ray fluxes, a crude model of the cryostat, and radiation-transport simulations. This model requires no free parameters to predict the background radiation spectra in the silicon substrates. The agreement between measurements and predictions demonstrates that the model we present can be used to assess the relative contributions of terrestrial and cosmic-ray sources to background radiation interactions in silicon substrates of varying thickness. These spectroscopic measurements are performed with a novel combination of superconducting microresonators located on micromachined silicon islands that define the interaction volume with background radiation. The resonators transduce deposited energy to a readily detectable electrical signal. Microresonator readout closely resembles dispersive superconducting qubit readout, so similar devices—with or without micromachined islands—are suitable for integration with superconducting quantum circuits as detectors for background radiation events. For our specific laboratory conditions, we find that gamma-ray emissions from radioisotopes are responsible for the majority of events that deposit E < 1 ⁢Me⁢V. We present results demonstrating that the background radiation spectrum contains relevant contributions from cosmic-ray particles other than muons, particularly a tail of multi-mega-electron-volt events due to protons and neutrons. These observations suggest several paths to reducing the impact of background radiation on quantum circuits, supported by an empirically validated model for generating reliable predictions of radiation interactions with silicon substrates.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2022

MICCO: An Enhanced Multi-GPU Scheduling Framework for Many-Body Correlation Functions

Calculation of many-body correlation functions is one of the critical kernels utilized in many scientific computing areas, especially in Lattice Quantum Chromodynamics (Lattice QCD). It is formalized as a sum of a large number of contraction terms each of which can be represented by a graph consisting of vertices describing quarks inside a hadron node and edges designating quark propagations at specific time intervals. Due to its computation- and memory-intensive nature, real-world physics systems (e.g., multi-meson or multi-baryon systems) explored by Lattice QCD prefer to leverage multi-GPUs. Different from general graph processing, many-body correlation function calculations show two specific features: a large number of computation-/data-intensive kernels and frequently repeated appearances of original and intermediate data. The former results in expensive memory operations such as tensor movements and evictions. The latter offers data reuse opportunities to mitigate the data-intensive nature of many-body correlation function calculations. However, existing graph-based multi-GPU schedulers cannot capture these data-centric features, thus resulting in a sub-optimal performance for many-body correlation function calculations. To address this issue, this paper presents a multi-GPU scheduling framework, MICCO, to accelerate contractions for correlation functions particularly by taking the data dimension (e.g., data reuse and data eviction) into account. This work first performs a comprehensive study on the interplay of data reuse and load balance, and designs two new concepts: local reuse pattern and reuse bound to study the opportunity of achieving the optimal trade-off between them. Based on this study, MICCO proposes a heuristic scheduling algorithm and a machine-learning-based regression model to generate the optimal setting of reuse bounds. Specifically, MICCO is integrated into a real-world Lattice QCD system, Redstar, for the first time running on multiple GPUs. The evaluation demonstrates MICCO outperforms other state-of-art works, achieving up to 2.25× speedup in synthesized datasets, and 1.49× speedup in real-world correlation functions.

Wang, Qihan↗
DOE OSTI2023

Evolutionary Architecture Search for Generative Adversarial Networks Based on Weight Sharing

Generative adversarial networks (GANs) are a powerful generative technique but frequently face challenges with training stability. Network architecture plays a significant role in determining the final output of GANs, but designing a fine architecture demands extensive domain expertise. This article aims to address this issue by searching for high-performance generator’s architectures through neural architecture search (NAS). The proposed approach, called evolutionary weight sharing GANs (EWSGAN), is based on weight sharing and comprises two steps. First, a supernet of the generator is trained using weight sharing. Second, a multiobjective evolutionary algorithm (MOEA) is employed to identify optimal subnets from the supernet. These subnets inherit weights directly from the supernet for fitness assessment. Two strategies are used to stabilize the training of the generator supernet: 1) a fair single-path sampling strategy and 2) a discarding strategy. Experimental results indicate that the architecture searched by our method achieved a new state-of-the-art among NAS–GAN methods with a Fréchet inception distance (FID) of 9.09 and an inception score (IS) of 8.99 on the CIFAR-10 dataset. Finally, it also demonstrates competitive performance on the STL-10 dataset, achieving FID of 21.89 and IS of 10.51.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Indoor Wireless Localization of Uncooperative Sources Using a Ray Tracing Model

Indoor geolocation of radio frequency (RF) trans- mitters is challenging due to site-specific multipath effects, especially when the sources are uncooperative. A source being uncooperative means that a-priori the transmit time, location, and power are unknown. It is proposed to use a site-specific ray tracing model to generate realistic indoor RF responses, perform geolocation using multiple methods, and compare their performance. This work will look at two types of geolocation algorithms: (1) time-difference of arrival (TDOA) and (2) re- ceived signal strength Indicator (RSSI) fingerprinting or pattern- matching-based methods. An indoor space will be simulated with a grid of fixed receivers and a grid of transmit locations using Remcom’s Wireless InSite. Using the output of the Wireless InSite simulation the response from any given transmit location can be generated and used to evaluate geolocation performance.

indoor source localization, Wireless InSite, re- c↗
DOE OSTI2023

ChemoGraph: Interactive Visual Exploration of the Chemical Space

Exploratory analysis of the chemical space is an important task in the field of cheminformatics. For example, in drug discovery research, chemists investigate sets of thousands of chemical compounds in order to identify novel yet structurally similar synthetic compounds to replace natural products. Manually exploring the chemical space inhabited by all possible molecules and chemical compounds is impractical, and therefore presents a challenge. To fill this gap, we present ChemoGraph, a novel visual analytics technique for interactively exploring related chemicals. In ChemoGraph, we formalize a chemical space as a hypergraph and apply novel machine learning models to compute related chemical compounds. It uses a database to find related compounds from a known space and a machine learning model to generate new ones, which helps enlarge the known space. Moreover, ChemoGraph highlights interactive features that support users in viewing, comparing, and organizing computationally identified related chemicals. With a drug discovery usage scenario and initial expert feedback from a case study, we demonstrate the usefulness of ChemoGraph.

chemical space exploration↗
DOE OSTI2022

Multi-modelling predictions show high uncertainty of required carbon input changes to reach a 4‰ target

Soils store vast amounts of carbon (C) on land, and increasing soil organic carbon (SOC) stocks in already managed soils such as croplands may be one way to remove C from the atmosphere, thereby limiting subsequent warming. The main objective of this study was to estimate the amount of additional C input needed to annually increase SOC stocks by 4‰ at 16 long-term agricultural experiments in Europe, including exogenous organic matter (EOM) additions. We used an ensemble of six SOC models and ran them under two configurations: (1) with default parametrization and (2) with parameters calibrated site-by-site to fit the evolution of SOC stocks in the control treatments (without EOM). We compared model simulations and analysed the factors generating variability across models. The calibrated ensemble was able to reproduce the SOC stock evolution in the unfertilised control treatments. We found that, on average, the experimental sites needed an additional 1.5 ± 1.2 Mg C ha -1 year -1 to increase SOC stocks by 4‰ per year over 30 years, compared to the C input in the control treatments (multi-model median ± median standard deviation across sites). That is, a 119% increase compared to the control. While mean annual temperature, initial SOC stocks and initial C input had a significant effect on the variability of the predicted C input in the default configuration (i.e., the relative standard deviation of the predicted C input from the mean), only water-related variables (i.e., mean annual precipitation and potential evapotranspiration) explained the divergence between models when calibrated. Here, our work highlights the challenge of increasing SOC stocks in agriculture and accentuates the need to increasingly lean on multi-model ensembles when predicting SOC stock trends and related processes. To increase the reliability of SOC models under future climate change, we suggest model developers to better constrain the effect of water-related variables on SOC decomposition.

4 per 1000 initiative↗
DOE OSTI2022

Training data selection for event classification in a highly variable environment

A problem of interest for nuclear nonproliferation is monitoring activities at nuclear facilities, where proliferation events may only take place a few times and often under variable conditions. Machine learning has revolutionized data analytics by enabling the use of measurable signatures to generate predictive models of facility operations. However, traditional methods for training these models require large, reliable data sets with labeled observations, a challenge for nonproliferation. Highly variable conditions further complicate this as events from training data may have occurred in conditions quite different from the event of interest. Our hypothesis is that when events occur in a highly variable environment, careful training data selection for each test event could outperform the standard approach of using all available training data. We developed a method to optimize training data selection for the given test event and applied it to predicting the power level of the High Flux Isotope Reactor (HFIR) at Oak Ridge National Laboratory. In this study, the reactor startup exhibits variability between occurrences due to natural variability in environmental conditions and operational procedures. Using a combination of analysis techniques, a similitude assessment was performed on data collected from HFIR to isolate clusters that were optimal for training a predictive model. Concepts such as dynamic time warping and Jaccard similarity were used in conjunction with clustering analysis. In order to validate this approach, the model was trained on every combination of unique training events and the predictive performance was compared to the performance using a subset of the training data selected by isolated clusters found through the similitude assessment.

Iyer, A↗
DOE OSTI2023

Generalized analytical and numerical modeling of optical second harmonic generation in anisotropic crystals and complex heterostructures using #SHAARP package

Optical second harmonic generation (SHG) is a nonlinear optical effect widely used for nonlinear optical microscopy and laser frequency conversion. The closed-form analytical solution of the nonlinear optical responses is essential for evaluating the optical responses of new materials whose optical properties are unknown a priori. Many approximations have therefore been employed in the existing analytical approaches, such as slowly varying approximation, weak reflection of the nonlinear polarization, transparent medium, high crystallographic symmetry, Kleinman symmetry, easy crystal orientation along a high-symmetry direction, phase matching conditions and negligible interference among nonlinear waves, which may lead to large errors in the reported material properties. To avoid these approximations, here we have developed an open-source package named Second Harmonic Analysis of Anisotropic Rotational Polarimetry (#SHAARP) for single interface (si) and in multilayers (ml) for homogeneous crystals. The reliability and accuracy are established by experimentally benchmarking with both the SHG polarimetry and Maker fringes predicted from the package using standard materials. SHAARP.si and SHAARP.ml are available through GitHub https://github.com/Rui-Zu/SHAARP and https://github.com/bzw133/SHAARP.ml, respectively.

complex systems↗
DOE OSTI2024

Electro-physical properties of surface-barrier diodes on low-resistance n-Cd 0.96 Mn 0.04 Te 0.96 Se 0.04 crystals

The electro-physical properties of Cd 0.96 Mn 0.04 Te 0.96 Se 0.04 n-type conductivity single crystals with relatively low resistivity were studied. The determined resistivity of semiconductor single crystals Cd 0.96 Mn 0.04 Te 0.96 Se 0.04 n-type conductivity is equal to ρ≈2 Ω-cm at 293K. The activation energy of dark conductivity, measured from the temperature dependence of the resistivity of the In/Cd 0.96 Mn 0.04 Te 0.96 Se 0.04 /In structure, is equal to ΔE≈0.11eV. From optical measurements of the absorption coefficient from the energy of photons in the region of large α, the band-gap width of the single crystal was found, which is equal to E g =1.53eV. Diode structures of Ni/Cd 0.96 Mn 0.04 Te 0.96 Se 0.04 /In obtained by vacuum sputtering of Ni on the surface of a single crystal n-Cd 0.96 Mn 0.04 Te 0.96 Se 0.04 were manufactured and studied. Here, the rectification coefficient at a voltage of U=1V is equal to 10 8 . Within the framework of the Sah-Noys-Shockley carrier generation-recombination model, a quantitative match of the experimental measurements of the volt-ampere characteristics with the calculation was achieved.

(Cd,Mn)(Te,Se)↗
DOE OSTI2021

Train Like a (Var)Pro: Efficient Training of Neural Networks with Variable Projection

Deep neural networks (DNNs) have achieved state-of-the-art performance across a variety of traditional machine learning tasks, e.g., speech recognition, image classification, and segmentation. The ability of DNNs to efficiently approximate high-dimensional functions has also motivated their use in scientific applications, e.g., to solve partial differential equations and to generate surrogate models. In this paper, we consider the supervised training of DNNs, which arises in many of the above applications. We focus on the central problem of optimizing the weights of the given DNN such that it accurately approximates the relation between observed input and target data. Devising effective solvers for this optimization problem is notoriously challenging due to the large number of weights, nonconvexity, data sparsity, and nontrivial choice of hyperparameters. To solve the optimization problem more efficiently, we propose the use of variable projection (VarPro), a method originally designed for separable nonlinear least-squares problems. Our main contribution is the Gauss--Newton VarPro method (GNvpro) that extends the reach of the VarPro idea to nonquadratic objective functions, most notably cross-entropy loss functions arising in classification. These extensions make GNvpro applicable to all training problems that involve a DNN whose last layer is an affine mapping, which is common in many state-of-the-art architectures. In our four numerical experiments from surrogate modeling, segmentation, and classification, GNvpro solves the optimization problem more efficiently than commonly used stochastic gradient descent (SGD) schemes. Finally, GNvpro finds solutions that generalize well, and in all but one example better than well-tuned SGD methods, to unseen data points.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Supplemental material for: Verification, validation, and results of an approximate model for the stress of a Tokamak toroidal field coil at the inboard midplane

This is the supplemental material for the manuscript "Verification, validation, and results of an approximate model for the stress of a Tokamak toroidal field coil at the inboard midplane" submitted to Fusion Engineering and Design. This material includes PDF writeups of the derivations of the axisymmetric extended plane strain model, the elastic properties smearing model, and 20+ MATLAB scripts and functions which implement the model and generate the figures in the paper.

Swanson, CPS↗
DOE OSTI2022

ChIMES AL Driver

The ChIMES AL Driver is a python-based workflow tool for generating ChIMES models.

Lindsey, RebeccaK↗
DOE OSTI2024

Firm Synthesizer and Supply-chain Simulator (SynthFirm) v1.0

SynthFirm is a large-scale agent-based freight demand model which generates a complete synthetic population of firms in the U.S. and the business-to-business commodity flows between them. Using publicly available data sources as inputs, SynthFirm simulates detailed firm and fleet characteristics, commodity production and consumption, formation of supply chains, and selection of shipping modes, all of which are essential drivers of commodity flow at a disaggregate level.

Xu, Xiaodan↗
DOE OSTI2025

Multi-Stage FNO

This is the code developed for paper - Reducing Frequency Bias of Fourier Neural Operators in 3D Seismic Wavefield Simulations Through Multi-Stage Training (https://arxiv.org/abs/2503.02023), it contains training the multi-stage FNO model to generate the seismic forward simulations in 3D medium.

Kong, Qingkai [Lawrence Livermore National Laborat↗