Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “density estimation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11

Neural simulation-based inference approach for characterizing the Galactic Center γ-ray excess

The nature of the Fermi γ-ray Galactic Center Excess (GCE) has remained a persistent mystery for over a decade. Although the excess is broadly compatible with emission expected due to dark matter annihilation, an explanation in terms of a population of unresolved astrophysical point sources e.g., millisecond pulsars, remains viable. The effort to uncover the origin of the GCE is hampered in particular by an incomplete understanding of diffuse emission of Galactic origin. This can lead to spurious features that make it difficult to robustly differentiate smooth emission, as expected for a dark matter origin, from more “clumpy” emission expected from a population of relatively bright, unresolved point sources. Here, we use recent advancements in the field of simulation-based inference, in particular density estimation techniques using normalizing flows, in order to characterize the contribution of modeled components, including unresolved point source populations, to the GCE. Compared to traditional techniques based on the statistical distribution of photon counts, our machine learning-based method is able to utilize more of the information contained in a given model of the Galactic Center emission, and in particular can perform posterior parameter estimation while accounting for pixel-to-pixel spatial correlations in the γ-ray map. This makes the method demonstrably more resilient to certain forms of model misspecification. On application to Fermi data, the method generically attributes a smaller fraction of the GCE flux to unresolved point sources when compared to traditional approaches. We nevertheless infer such a contribution to make up a non-negligible fraction of the GCE across all analysis variations considered, with at least $38^{+9}_{-19}$% of the excess attributed to unresolved point sources in our baseline analysis.

79 ASTRONOMY AND ASTROPHYSICS↗

Combining resonant and tail-based anomaly detection

In many well-motivated models of the electroweak scale, cascade decays of new particles can result in highly boosted hadronic resonances (e.g., Z / W / h ). This can make these models rich and promising targets for recently developed resonant anomaly detection methods powered by modern machine learning. We demonstrate this using the state-of-the-art classifying anomalies through outer density estimation () method applied to supersymmetry scenarios with gluino pair production. We show that , despite being model agnostic, is nevertheless competitive with dedicated cut-based searches, while simultaneously covering a much wider region of parameter space. The gluino events also populate the tails of the missing energy and H T distributions, making this a novel combination of resonant and tail-based anomaly detection. Published by the American Physical Society 2024

Astronomy & Astrophysics↗

𝑁-dimensional maximum-entropy tomography via particle sampling

We propose a modified maximum-entropy (MENT) algorithm for six-dimensional phase space tomography. The algorithm uses particle sampling and low-dimensional density estimation to approximate large sets of high-dimensional integrals in the original MENT formulation. We implement this approach using Markov Chain Monte Carlo (MCMC) sampling techniques and demonstrate convergence of six-dimensional MENT on both synthetic and measured data.

Hoover, Austin [Oak Ridge National Laboratory (ORN↗

A Data-Driven Nonparametric Approach for Probabilistic Load-Margin Assessment Considering Wind Power Penetration

A modern power system is characterized by an increasing penetration of wind power, which results in large uncertainties in its states. These uncertainties must be quantified properly; otherwise, the system security may be threatened. Facing this challenge, here we propose a cost-effective, data-driven approach to assessing a power system's load margin probabilistically. Using actual wind data, a kernel density estimator is applied to infer the nonparametric wind speed distributions, which are further merged into the framework of a vine copula. The latter enables us to simulate complex multivariate and highly dependent model inputs with a variety of bivariate copulae that precisely represent the tail dependence in the correlated samples. Furthermore, to reduce the prohibitive computational time of traditional Monte-Carlo simulations that process a large amount of samples, we propose to use a nonparametric, Gaussian-process-emulator-based reduced-order model to replace the original complicated continuation power-flow model through a Bayesian-learning framework. To accelerate the convergence rate of this Bayesian algorithm, a truncated polynomial chaos surrogate, which serves as a highly efficient, parametric Bayesian prior, is developed. This emulator allows us to execute the time-consuming continuation power-flow solver at the sampled values with a negligible computational cost. Results of simulations that are performed on several test systems reveal the impressive performance of the proposed method in the probabilistic load-margin assessment.

17 WIND ENERGY↗

Probing Quantum Telecloning on Superconducting Quantum Processors

Quantum information cannot be perfectly cloned, but approximate copies of quantum information can be generated. Quantum telecloning combines approximate quantum cloning, more typically referred to as quantum cloning, and quantum teleportation. Quantum telecloning allows approximate copies of quantum information to be constructed by separate parties, using the classical results of a Bell measurement made on a prepared quantum telecloning state. Quantum telecloning can be implemented as a circuit on quantum computers using a classical coprocessor to compute classical feedforward instructions using if statements based on the results of a midcircuit Bell measurement in real time. We present universal symmetric optimal 1 → M telecloning circuits and experimentally demonstrate these quantum telecloning circuits for M = 2 up to M = 10, natively executed with real-time classical control systems on IBM Quantum superconducting processors, known as dynamic circuits. We perform the cloning procedure on many different message states across the Bloch sphere, on seven IBM Quantum processors, optionally using the error suppression technique X–X sequence digital dynamical decoupling. Two circuit optimizations are utilized: one that removes ancilla qubits for M = 2,3 , and one that reduces the total number of gates in the circuit but still uses ancilla qubits. Parallel single-qubit tomography with maximum likelihood estimation density matrix reconstruction is used in order to compute the mixed-state density matrices of the clone qubits, and clone quality is measured using quantum fidelity. These results present one of the largest and most comprehensive noisy intermediate-scale quantum computer experimental analyses on (single qubit) quantum telecloning to date. The clone fidelity sharply decreases to 0.5 for M > 5 , but for M = 2 , we are able to achieve a mean clone fidelity of up to 0.79 using dynamical decoupling.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Fiber Uncertainty Visualization for Bivariate Data With Parametric and Nonparametric Noise Models

Visualization and analysis of multivariate data and their uncertainty are top research challenges in data visualization. Constructing fiber surfaces is a popular technique for multivariate data visualization that generalizes the idea of level-set visualization for univariate data to multivariate data. Here, in this paper, we present a statistical framework to quantify positional probabilities of fibers extracted from uncertain bivariate fields. Specifically, we extend the state-of-the-art Gaussian models of uncertainty for bivariate data to other parametric distributions (e.g., uniform and Epanechnikov) and more general nonparametric probability distributions (e.g., histograms and kernel density estimation) and derive corresponding spatial probabilities of fibers. In our proposed framework, we leverage Green's theorem for closed-form computation of fiber probabilities when bivariate data are assumed to have independent parametric and nonparametric noise. Additionally, we present a nonparametric approach combined with numerical integration to study the positional probability of fibers when bivariate data are assumed to have correlated noise. For uncertainty analysis, we visualize the derived probability volumes for fibers via volume rendering and extracting level sets based on probability thresholds. We present the utility of our proposed techniques via experiments on synthetic and simulation datasets.

97 MATHEMATICS AND COMPUTING↗

Influence of Equation-of-States on Supercritical CO2 Combustion Mixtures

Abstract Fossil fuel based direct-fired supercritical CO2 (sCO2) cycles are gaining the attention of industry, academia, and government due to their remarkable efficiency and carbon capture at high-source temperatures. Modeling plays an important role in the development of sCO2 combustors because experiments are very expensive at the designed operating conditions of these direct-fired cycles. Inaccurate density estimates are detrimental to the simulation output. Hence, this work focuses on comprehensive evaluation of the influence and applicability of various equation-of-states (EOS) which are being used in the supercritical combustion modeling literature. A state-of-the-art supercritical combustion modeling methodology is used to simulate counter-flow supercritical CO2 flames by using various equation-of-states. The results show that using the corresponding state principle to evaluate compressibility factor is not accurate. Also, van der Waal type EOSs predictions can be as accurate as complex Benedict–Webb–Rubin EOSs; hence van der Waal EOSs are more suitable to simulate sCO2 combustor simulations. Non-ideal effects are significant under the operating conditions considered in this work. The choice of EOS significantly influences the flame structure and heat release rate. Also, assuming the binary interaction parameter as zero is reasonable in sCO2 combustion simulations.

Energy & Fuels↗

Polynomial Chaos Surrogate Construction for Random Fields with Parametric Uncertainty

Engineering and applied science rely on computational experiments to rigorously study physical systems. The mathematical models used to probe these systems are highly complex, and sampling-intensive studies often require prohibitively many simulations for acceptable accuracy. Surrogate models provide a means of circumventing the high computational expense of sampling such complex models. In particular, polynomial chaos expansions (PCEs) have been successfully used for uncertainty quantification studies of deterministic models where the dominant source of uncertainty is parametric. We discuss an extension to conventional PCE surrogate modeling to enable surrogate construction for stochastic computational models that have intrinsic noise in addition to parametric uncertainty. We develop a PCE surrogate on a joint space of intrinsic and parametric uncertainty, enabled by Rosenblatt transformations, which are evaluated via kernel density estimation of the associated conditional cumulative distributions. Furthermore, we extend the construction to random field data via the Karhunen–Loève expansion. We then take advantage of closed-form solutions for computing PCE Sobol indices to perform a global sensitivity analysis of the model which quantifies the intrinsic noise contribution to the overall model output variance. Additionally, the resulting joint PCE is generative in the sense that it allows generating random realizations at any input parameter setting that are statistically approximately equivalent to realizations from the underlying stochastic model. The method is demonstrated on a chemical catalysis example model and a synthetic example controlled by a parameter that enables a switch from unimodal to bimodal response distributions.

97 MATHEMATICS AND COMPUTING↗

Efficient Neural Network Approaches for Conditional Optimal Transport with Applications in Bayesian Inference

In this work, we present two neural network approaches that approximate the solutions of static and dynamic conditional optimal transport (COT) problems. Both approaches enable conditional sampling and conditional density estimation, which are core tasks in Bayesian inference—particularly in the simulation-based (“likelihood-free”) setting. Our methods represent the target conditional distribution as a transformation of a tractable reference distribution. Obtaining such a transformation, chosen here to be an approximation of the COT map, is computationally challenging even in moderate dimensions. To improve scalability, our numerical algorithms use neural networks to parameterize candidate maps and further exploit the structure of the COT problem. Our static approach approximates the map as the gradient of a partially input convex neural network. It uses a novel numerical implementation to increase computational efficiency compared to state-of-the-art alternatives. Our dynamic approach approximates the conditional optimal transport via the flow map of a regularized neural ODE; compared to the static approach, it is slower to train but offers more modeling choices and can lead to faster sampling. We demonstrate both algorithms numerically, comparing them with competing state-of-the-art approaches, using benchmark datasets and simulation-based Bayesian inverse problems.

97 MATHEMATICS AND COMPUTING↗

Learning to Optimize Variational Quantum Circuits to Solve Combinatorial Problems

Quantum computing is a computational paradigm with the potential to outperform classical methods for a variety of problems. Proposed recently, the Quantum Approximate Optimization Algorithm (QAOA) is considered as one of the leading candidates for demonstrating quantum advantage in the near term. QAOA is a variational hybrid quantum-classical algorithm for approximately solving combinatorial optimization problems. The quality of the solution obtained by QAOA for a given problem instance depends on the performance of the classical optimizer used to optimize the variational parameters. In this paper, we formulate the problem of finding optimal QAOA parameters as a learning task in which the knowledge gained from solving training instances can be leveraged to find high-quality solutions for unseen test instances. To this end, we develop two machine-learning-based approaches. Our first approach adopts a reinforcement learning (RL) framework to learn a policy network to optimize QAOA circuits. Our second approach adopts a kernel density estimation (KDE) technique to learn a generative model of optimal QAOA parameters. In both approaches, the training procedure is performed on small-sized problem instances that can be simulated on a classical computer; yet the learned RL policy and the generative model can be used to efficiently solve larger problems. Furthermore, extensive simulations using the IBM Qiskit Aer quantum circuit simulator demonstrate that our proposed RL- and KDE-based approaches reduce the optimality gap by factors up to 30.15 when compared with other commonly used off-the-shelf optimizers.

97 MATHEMATICS AND COMPUTING↗

The Dark Machines Anomaly Score Challenge: Benchmark Data and Model Independent Event Classification for the Large Hadron Collider

We describe the outcome of a data challenge conducted as part of the Dark Machines (https://www.darkmachines.org) initiative and the Les Houches 2019 workshop on Physics at TeV colliders. The challenged aims to detect signals of new physics at the Large Hadron Collider (LHC) using unsupervised machine learning algorithms. First, we propose how an anomaly score could be implemented to define model-independent signal regions in LHC searches. We define and describe a large benchmark dataset, consisting of >1 billion simulated LHC events corresponding to 10\, fb^{-1} 10 f b − 1 of proton-proton collisions at a center-of-mass energy of 13 TeV. We then review a wide range of anomaly detection and density estimation algorithms, developed in the context of the data challenge, and we measure their performance in a set of realistic analysis environments. We draw a number of useful conclusions that will aid the development of unsupervised new physics searches during the third run of the LHC, and provide our benchmark dataset for future studies at https://www.phenoMLdata.org. Code to reproduce the analysis is provided at https://github.com/bostdiek/DarkMachines-UnsupervisedChallenge.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

How to understand limitations of generative networks

Well-trained classifiers and their complete weight distributions provide us with a well-motivated and practicable method to test generative networks in particle physics. We illustrate their benefits for distribution-shifted jets, calorimeter showers, and reconstruction-level events. In all cases, the classifier weights make for a powerful test of the generative network, identify potential problems in the density estimation, relate them to the underlying physics, and tie in with a comprehensive precision and uncertainty treatment for generative networks.

Physics↗

Single-gap isotropic s- wave superconductivity in single crystals AuSn 4

In this article, London, λ L (T), and Campbell, λ C (T), penetration depths were measured in single crystals of a topological superconductor candidate AuSn 4 . At low temperatures, λ L (T) is exponentially attenuated and, if fitted with the power law, λ(T) ~ T n , gives exponents n > 4, indistinguishable from the isotropic single s- wave gap Bardeen-Cooper-Schrieffer (BCS) asymptotic. The superfluid density fits perfectly in the entire temperature range to the BCS theory. The superconducting transition temperature, T c = 2.40 ± 0.05 K, does not change after 2.5 MeV electron irradiation, indicating the validity of the Anderson theorem for isotropic s- wave superconductors. Campbell penetration depth before and after electron irradiation shows no hysteresis between the zero-field cooling (ZFC) and field cooling (FC) protocols, consistent with the parabolic pinning potential. Interestingly, the critical current density estimated from the original Campbell theory decreases after irradiation, implying that a more sophisticated theory involving collective effects is needed to describe vortex pinning in this system. In general, our thermodynamic measurements strongly suggest that the bulk response of the AuSn 4 crystals is fully consistent with the isotropic s- wave weak-coupling BCS superconductivity.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Sparks in the dark

This study presents a novel method for the definition of signal regions in searches for new physics at collider experiments. By leveraging multi-dimensional histograms with precise arithmetic and utilizing the SparkDensityTree library, it is possible to identify high-density regions within the available phase space, potentially improving sensitivity to very small signals. Inspired by a search for dark mesons at the ATLAS experiment, CMS open data is used for this proof-of-concept intentionally targeting an already excluded signal. Signal regions are defined based on density estimates of signal and background. These preliminary regions align well with the physical properties of the signal while effectively rejecting background events.

Gudnadottir, Olga Sunneborn [Uppsala Univ. (Sweden↗

Design and Optimization of Structured Multi-Functional Trapping Catalysts for Conversion of Hydrocarbons and NOx from Diesel and Advanced Combustion Engines

Oxides of nitrogen in the form of nitric oxide (NO) and nitrogen dioxide (NO 2 ) commonly referred to as NOx, is one of the two chemical precursors that lead to ground-level ozone, a ubiquitous air pollutant in urban areas. A major source of NOx is generated by equipment and vehicles powered by diesel engines, which have a combustion exhaust that contains NOx in the presence of excess O 2 . Vehicular emission control catalysts are ineffective in eliminating CO, hydrocarbons, and NOx during engine cold-start when exhaust temperatures are below 200°C. The objective of the project was to develop and demonstrate a multi-functional, catalyzed trap that enables vehicles with advanced combustion strategies to meet Tier 3 emissions standards while achieving the 150 °C challenge for sustained co-oxidation of HCs and CO and ≥90% NO trapping and release during warmup. Specifically, the multi-functional Lean HC+NOx (LHCNT) was developed for application in the exhaust aftertreatment of conventional diesel engines and engines having low temperature combustion (LTC) regimes. Activities included the design and synthesis of adsorbents and catalysts, screening and evaluation. Passive NOx absorbers (PNA), hydrocarbon (HC) traps, and oxidation catalysts (OC) were evaluated for use in series or as integrated devices. Predictive tools were developed utilizing the characterization and analysis of these materials, and an emission system was designed and optimized utilizing the catalyst systems. Microkinetic models were developed for the PNA for the simple NO-only feed and complex feed containing CO, H 2 , and model hydrocarbons (ethylene and dodecane). A first-principles, mechanistic-based model of the PNA was developed which utilized molecular-scale estimates (density functional theory) of energy barriers, mechanistic-based kinetics and realistic treatments of the flow and transport processes. Two new oxidation catalysts were developed (PdCu alloy, mixed copper-ceria-cobalt oxide), both of which significantly lessened the detrimental inhibition by CO on hydrocarbon and NO oxidation. A method for lessening the detrimental impact of CO on PNA activity was developed that involves use of an oxidation catalyst upstream of the PNA. The SwRI Ectolab TM burner system was applied to evaluate the baseline PNA material and confirmed performance comparable to the benchflow PNA studies using simulated exhaust. Spatially-resolved mass spectrometry (SpaciMS) was used to measure the transient spatial profiles of reacting species spanning the length of a three-function LHCNT containing PNA, HCT, and OC. The findings from this study provide diesel vehicle and catalyst companies valuable information to develop more cost effective emission control catalysts which helps to expand the use of more fuel efficient diesel power. The fundamental modeling and experimental tools and findings from this project can be applied to catalyst technologies used in the energy and chemical industries. The project led to 14 publications in the peer-reviewed literature with 2 additional currently under review. Finally, the project also led to training of several doctoral students who were placed in research jobs in industry and academia. Specifically, Mugdha Ambast (UH) has joined Cummins, Kevin Gu (UVa) has joined GM, and Abhay Gupta (UH) is to join Caterpillar.

02 PETROLEUM↗

Design and Optimization of Structured Multi-Functional Trapping Catalysts for Conversion of Hydrocarbons and NOx from Diesel and Advanced Combustion Engines

Oxides of nitrogen in the form of nitric oxide (NO) and nitrogen dioxide (NO 2 ) commonly referred to as NOx, is one of the two chemical precursors that lead to ground-level ozone, a ubiquitous air pollutant in urban areas. A major source of NOx is generated by equipment and vehicles powered by diesel engines, which have a combustion exhaust that contains NOx in the presence of excess O 2 . Vehicular emission control catalysts are ineffective in eliminating CO, hydrocarbons, and NO x during engine cold-start when exhaust temperatures are below 200°C. The objective of the project was to develop and demonstrate a multi-functional, catalyzed trap that enables vehicles with advanced combustion strategies to meet Tier 3 emissions standards while achieving the 150 °C challenge for sustained co-oxidation of HCs and CO and ≥90% NO trapping and release during warmup. Specifically, the multi-functional Lean HC+NOx (LHCNT) was developed for application in the exhaust aftertreatment of conventional diesel engines and engines having low temperature combustion (LTC) regimes. Activities included the design and synthesis of adsorbents and catalysts, screening and evaluation. Passive NOx absorbers (PNA), hydrocarbon (HC) traps, and oxidation catalysts (OC) were evaluated for use in series or as integrated devices. Predictive tools were developed utilizing the characterization and analysis of these materials, and an emission system was designed and optimized utilizing the catalyst systems. Microkinetic models were developed for the PNA for the simple NO-only feed and complex feed containing CO, H 2 , and model hydrocarbons (ethylene and dodecane). A first-principles, mechanistic-based model of the PNA was developed which utilized molecular-scale estimates (density functional theory) of energy barriers, mechanistic-based kinetics and realistic treatments of the flow and transport processes. Two new oxidation catalysts were developed (PdCu alloy, mixed copper-ceria-cobalt oxide), both of which significantly lessened the detrimental inhibition by CO on hydrocarbon and NO oxidation. A method for lessening the detrimental impact of CO on PNA activity was developed that involves use of an oxidation catalyst upstream of the PNA. The SwRI Ectolab TM burner system was applied to evaluate the baseline PNA material and confirmed performance comparable to the benchflow PNA studies using simulated exhaust. Spatially-resolved mass spectrometry (SpaciMS) was used to measure the transient spatial profiles of reacting species spanning the length of a three-function LHCNT containing PNA, HCT, and OC. The findings from this study provide diesel vehicle and catalyst companies valuable information to develop more cost effective emission control catalysts which helps to expand the use of more fuel efficient diesel power. The fundamental modeling and experimental tools and findings from this project can be applied to catalyst technologies used in the energy and chemical industries. The project led to 14 publications in the peer-reviewed literature with 2 additional currently under review. Finally, the project also led to training of several doctoral students who were placed in research jobs in industry and academia. Specifically, Mugdha Ambast (UH) has joined Cummins, Kevin Gu (UVa) has joined GM, and Abhay Gupta (UH) is to join Caterpillar.

42 ENGINEERING↗

Power density calculation of spontaneous radiation emission from a finite emittance electron beam in planar undulators

We extend the angular power density formulae for spontaneous radiation emission from planar undulators to include finite emittance and angular misalignment of the electron beam. Then we calculate and compare power densities estimated from integral approach with Gaussian beam distribution and summation approach with macro-particle allocation covering particle beam phase space. After showing that both approaches converge to each other, we apply the macro-particle approach to study power absorbed and transmitted by various apertures at front end of 9-ID beamline at National Synchrotron Light Source-II for misaligned electron beam. Our analysis indicate that the electron beam misalignment could lead to unwarranted power deposition at tighter apertures that would have been otherwise difficult to account for during the aperture design/choice process.

43 PARTICLE ACCELERATORS↗