Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “kernel density estimation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Training quantum neural networks using the quantum information bottleneck method

Abstract We provide in this paper a concrete method for training a quantum neural network to maximize the relevant information about a property that is transmitted through the network. This is significant because it gives an operationally well founded quantity to optimize when training autoencoders for problems where the inputs and outputs are fully quantum. We provide a rigorous algorithm for computing the value of the quantum information bottleneck quantity within error ε that requires O ( log 2 ⁡ ( 1 / ϵ ) + 1 / δ 2 ) queries to a purification of the input density operator if its spectrum is supported on { 0 } ⋃ [ δ , 1 − δ ] for δ > 0 and the kernels of the relevant density matrices are disjoint. We further provide algorithms for estimating the derivatives of the QIB function, showing that quantum neural networks can be trained efficiently using the QIB quantity given that the number of gradient steps required is polynomial.

Çatlı, Ahmet Burak (ORCID:0000000152294141)↗
NASA NTRS1988

Magnetic reversal spurts: Rain gauges for comet showers

Abrupt increases in the rate of magnetic reversals (magnetic reversal spurts) were first studied by many others. They hypothesized that spurts result from increased turbulence in the earth's core dynamo during episodes of intense bolide bombardment of the earth. Mechanisms for creating episodes of intense bombardment of the earth involve gravitational perturbation of the Oort cloud of comets, either by a hidden planet, a solar companion, or massive matter in the galactic plane. Herein, the time variation in reversal rate is analyzed using methods of statistical density estimation. A smooth, continuous estimate of reversal rate is obtained using an adaptive kernel method, in which the kernel width is adjusted as a function of reversal rate. The estimates near the ends of the data series (at 165 my ago and the present) are obtained by extending the data by reflection. The results show that the reversal spurts are not associated demonstrably with extinctions or well-dated impacts. If the spurts do record episodes of intense bombardment of the earth, then the mass extinctions do not, in general, occur at times of impacts. Furthermore, the large impact craters seen are not obviously related to the spurts, suggesting that the craters may have been caused by bolides of a different nature and with a different temporal pattern. However, the most simple explanation seems to be that the spurts do not record comet showers, either because the recording mechanism suggested by Muller and Morris is not effective or because comet showers are not triggered in the ways considered by Hut et al.

Lutz, T. M.↗
DOE OSTI2021

Four-point correlation modular bootstrap for OPE densities

In this work we apply the lightcone bootstrap to a four-point function of scalars in two-dimensional conformal field theory. We include the entire Virasoro symmetry and consider non-rational theories with a gap in the spectrum from the vacuum and no conserved currents. For those theories, we compute the large dimension limit (h/c >> 1) of the OPE spectral decomposition of the Virasoro vacuum. We then propose a kernel ansatz that generalizes the spectral decomposition beyond h/c >> 1. Finally, we estimate the corrections to the OPE spectral densities from the inclusion of the lightest operator in the spectrum.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2022

Coarse-Grained Density Functional Theory Predictions via Deep Kernel Learning

Scalable electronic predictions are critical for soft materials design. Recently, the Electronic Coarse-Graining (ECG) method was introduced to renormalize all-atom quantum chemical (QC) predictions to coarse-grained (CG) resolutions using deep neural networks (DNNs). While DNNs can learn complex representations that prove challenging for kernel-based methods, they are susceptible to overfitting and the overconfidence of uncertainty estimations. Here, we develop ECG within a GPU-accelerated Deep Kernel Learning (DKL) framework to enable CG QC predictions using range-separated hybrid density functional theory (DFT), obtaining a 107 speedup relative to naive all-atom QC. By treating the predicted electronic properties as random Gaussian Processes, DKL incorporates CG mapping degeneracy by learning the distribution of electronic energies as a function of CG configuration. DKL-ECG accurately reproduces molecular orbital energies from range-separated DFT while facilitating efficient training via active learning using the uncertainties provided by DKL. Further, we show that while active learning algorithms enable efficient sampling of a more diverse configurational space relative to random sampling, all explored query methods exhibit comparable performance for the examined system. We attribute this result to the significant overlap of the feature space and output property distributions across multiple temperatures.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Codebase release 0.1 for infstat

We propose an intuitive, machine-learning approach to multiparameter inference, dubbed the InferoStatic Networks (ISN) method, to model the score and likelihood ratio estimators in cases when the probability density can be sampled but not computed directly. The ISN uses a backend neural network that models a scalar function called the inferostatic potential \varphi φ . In addition, we introduce new strategies, respectively called Kernel Score Estimation (KSE) and Kernel Likelihood Ratio Estimation (KLRE), to learn the score and the likelihood ratio functions from simulated data. We illustrate the new techniques with some toy examples and compare to existing approaches in the literature. We mention en passant some new loss functions that optimally incorporate latent information from simulations into the training procedure.

Kong, Kyoungchul↗
DOE OSTI2022

S-PLUS DR1 galaxy clusters and groups catalogue using PzWav

ABSTRACT We present a catalogue of 4499 groups and clusters of galaxies from the first data release of the multi-filter (5 broad, 7 narrow) Southern Photometric Local Universe Survey (S-PLUS). These groups and clusters are distributed over 273 deg2 in the Stripe 82 region. They are found using the PzWav algorithm, which identifies peaks in galaxy density maps that have been smoothed by a cluster scale difference-of-Gaussians kernel to isolate clusters and groups. Using a simulation-based mock catalogue, we estimate the purity and completeness of cluster detections: at S/N > 3.3, we define a catalogue that is 80 per cent pure and complete in the redshift range 0.1 < z < 0.4, for clusters with M200 > 1014 M⊙. We also assessed the accuracy of the catalogue in terms of central positions and redshifts, finding scatter of σR = 12 kpc and σz = 8.8 × 10−3, respectively. Moreover, less than 1 per cent of the sample suffers from fragmentation or overmerging. The S-PLUS cluster catalogue recovers ∼80 per cent of all known X-ray and Sunyaev-Zel’dovich selected clusters in this field. This fraction is very close to the estimated completeness, thus validating the mock data analysis and paving an efficient way to find new groups and clusters of galaxies using data from the ongoing S-PLUS project. When complete, S-PLUS will have surveyed 9300 deg2 of the sky, representing the widest uninterrupted areas with narrow-through-broad multi-band photometry for cluster follow-up studies.

Astronomy & Astrophysics↗
DOE OSTI2022

ConKer: An algorithm for evaluating correlations of arbitrary order

Context. High order correlations in the cosmic matter density have become increasingly valuable in cosmological analyses. However, computing these correlation functions is computationally expensive. Aims. We aim to circumvent these challenges by developing a new algorithm called ConKer for estimating correlation functions. Methods. This algorithm performs convolutions of matter distributions with spherical kernels using FFT. Since matter distributions and kernels are defined on a grid, it results in some loss of accuracy in the distance and angle definitions. We study the algorithm setting at which these limitations become critical and suggest ways to minimize them. Results. ConKer is applied to the CMASS sample of the SDSS DR12 galaxy survey and corresponding mock catalogs, and is used to compute the correlation functions up to correlation order n = 5. We compare the n = 2 and n = 3 cases to traditional algorithms to verify the accuracy of the new algorithm. We perform a timing study of the algorithm and find that three of the four distinct processes within the algorithm are nearly independent of the catalog size N , while one subdominant component scales as O ( N ). The dominant portion of the calculation has complexity of O ( N c 4/3 log N c ), where N c is the of cells in a three-dimensional grid corresponding to the matter density. Conclusions. We find ConKer to be a fast and accurate method of probing high order correlations in the cosmic matter density, then discuss its application to upcoming surveys of large-scale structure.

79 ASTRONOMY AND ASTROPHYSICS↗
NASA NTRS1985

Coronal X-ray activity preceding solar flares

The characteristics of coronal emplacements preceding solar flares were investigated based on a comprehensive survey of Skylab soft X-ray images. A search interval of 30 min before flare was used in the X-ray observations. X-ray images with preflare enhancements were compared with high resolution H-alpha images and photospheric magnetograms and preflare enhancements were found in a statistically significant number of the observed preflare intervals. The enhancement events consisted of loops, kernels, and sinuous features with one to three separate preflare structures appearing in each interval. Typical gas pressures in the preflare X-ray features were estimated on the order of a few dyne per sq cm and densities were 4-10 x 10 to the -9th per cu cm for assumed average temperatures. H-alpha brightenings in the form of knots and patches were found in conjunction with the X-ray preflare features in nearly all of the intervals. It is concluded that H-alpha emission is characteristic of preflare emission processes. The observational data are interpreted within the framework of existing loop preheating models, and the results are discussed in detail.

Webb, D. F.↗
DOE OSTI2025

Hierarchical Speed Planner for Automated Vehicles: A Framework for Lagrangian Variable Speed Limit in Mixed-Autonomy Traffic

Here, this article presents a novel hierarchical speed planning framework for variable speed limits in mixed-autonomy traffic environments, leveraging server-side macroscopic control and vehicle-side microscopic execution. The framework integrates real-time traffic state estimation (TSE) and reinforcement learning (RL)-based control to mitigate congestion and improve traffic flow. A TSE enhancement module combines macroscopic data from sources like INRIX with high-resolution observations from connected autonomous vehicles (CAVs), enabling predictive modeling to address latency and noise. The target speed design module employs kernel smoothing and a buffer zone strategy to optimize traffic density and flow around bottlenecks. The proposed system was validated in the largest open-road test to date with 100 CAVs, demonstrating an overall 8% traffic density decrease, with a specific decrease of 7% upstream, 10% downstream, and a 52% decrease during the congestion formation phase at bottlenecks.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
NASA NTRS1974

Nonparametric maximum likelihood estimation of probability densities by penalty function methods

When it is known a priori exactly to which finite dimensional manifold the probability density function gives rise to a set of samples, the parametric maximum likelihood estimation procedure leads to poor estimates and is unstable; while the nonparametric maximum likelihood procedure is undefined. A very general theory of maximum penalized likelihood estimation which should avoid many of these difficulties is presented. It is demonstrated that each reproducing kernel Hilbert space leads, in a very natural way, to a maximum penalized likelihood estimator and that a well-known class of reproducing kernel Hilbert spaces gives polynomial splines as the nonparametric maximum penalized likelihood estimates.

Demontricher, G. F.↗
NASA NTRS1984

First-flight escape from spheres with R(-2) density distribution

Energy-independent first-flight transport kernels are evaluated for a spherical region with an R(-2) density distribution. The uncollided angular-flux distribution is obtained and integrated for a source distribution that is proportional to the density to give the uncollided emitted particle flux and current density. These are useful for the calculation of mass, energy, and momentum carried away by fast particles born in the medium. The data are relevant to estimate escape from weakly bound atmospheres such as comet comae, dilute circumstellar envelopes, and some unconfined laboratory plasmas.

Huebner, W. F.↗
DOE OSTI2022

Kernel learning backward SDE filter for data assimilation

In this paper, we develop a kernel learning backward SDE filter method to estimate the state of a stochastic dynamical system based on its partial noisy observations. A system of forward backward stochastic differential equations is used to propagate the state of the target dynamical model, and Bayesian inference is applied to incorporate the observational information. Further, to characterize the dynamical model in the entire state space, we introduce a kernel learning method to learn a continuous global approximation for the conditional probability density function of the target state by using discrete approximated density values as training data. Numerical experiments demonstrate that the kernel learning backward SDE is highly effective.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS2005

Two-Dimensional Ffowcs Williams/Hawkings Equation Solver

FWH2D is a Fortran 90 computer program that solves a two-dimensional (2D) version of the equation, derived by J. E. Ffowcs Williams and D. L. Hawkings, for sound generated by turbulent flow. FWH2D was developed especially for estimating noise generated by airflows around such approximately 2D airframe components as slats. The user provides input data on fluctuations of pressure, density, and velocity on some surface. These data are combined with information about the geometry of the surface to calculate histories of thickness and loading terms. These histories are fast-Fourier-transformed into the frequency domain. For each frequency of interest and each observer position specified by the user, kernel functions are integrated over the surface by use of the trapezoidal rule to calculate a pressure signal. The resulting frequency-domain signals are inverse-fast-Fourier-transformed back into the time domain. The output of the code consists of the time- and frequency-domain representations of the pressure signals at the observer positions. Because of its approximate nature, FWH2D overpredicts the noise from a finite-length (3D) component. The advantage of FWH2D is that it requires a fraction of the computation time of a 3D Ffowcs Williams/Hawkings solver.

Lockard, David P.↗
DOE OSTI2021

Towards Efficient Uncertainty estimation in deep learning for robust energy prediction in crystal materials

In material science, recent studies have started to explore the potential of using deep learning to improve property prediction from high-fidelity simulations, e.g, density functional theory (DFT). However, the design spaces are sometimes too large and intractable to sample completely. This results in a critical question that is how to evaluate the confidence and robustness of the prediction. In this paper, we propose an efficient approach to estimate uncertainty in deep learning using a single forward pass and then apply it for robust prediction of the total energy in crystal lattice structures. Our approach is built upon the deep kernel learning (DKL) that originally introduces to leverage the expressiveness of deep neural networks as input with a probabilistic prediction of Gaussian processes (GPs) as output. Existing DKL methods have difficulties in the accuracy of predictive uncertainty, training stability, and scaling to large datasets, which lead to significant barriers in real-world applications. We propose to address these challenges by using an inducing point approximate GP in feature space combined with spectral normalization as a regularization. We finally demonstrate our robust performance on an artificial example and a real-world application from materials chemistry.

Bi, Sirui↗
DOE OSTI2026

Particle Filter Based Inference Testing

The primary intent of PAR-FIT (Particle Filter based Inference Testing) is to provide hard inductive evidence that a machine learning model is capable and proven for an individual test input. By examining training data used to form the underlying model functional correlation, an estimate of the reliability that a model will make the correct prediction can be made. The Sequential Probability Ratio Test is used to derive a qualitative evaluation for reliability based on hypothesis testing. The PAR-FIT framework achieves this by implementing a particle filter and the sequential probability ratio test algorithms on the machine learning model training data to determine relevancy of new individual test samples to the training dataset. The kernel function evaluates the local proximity and density of training data used to derive a prediction outcome. Particles are used to probabilistically determine which training data to evaluate for proximity. For test samples that are within a close proximity to and surrounded by multiple training data points, the evaluated reliability of the prediction is high. For test samples that are anomalies not represented by the training dataset, in low density data clusters, or are far from existing data points, the evaluated reliability is low as insufficient training evidence exists to suggest the model is capable of making the correct prediction. Sequential Probability Ratio Test is further used to determine when a hypothesis on whether a signal can be rejected or accepted for use. The ratio test collects sequence information from the particle filter to test whether the signal is anomalous or normal via hypothesis testing of the underlying distributions.

Chen, Edward [Idaho National Laboratory (INL), Ida↗
DOE OSTI2025

Conformal Hierarchical Simulation-Based Inference with Local Validity

Trustworthy and interpretable uncertainty quantification is a long-standing challenge in artificial intelligence. Simulation-based inference (SBI) comprises a broad swath of approaches for estimating latent parameters with uncertainties. Although flexible neural density estimators in SBI can be remark- ably expressive capturing highly structured, high-dimensional posteriors their credible regions can be badly mis-calibrated and are often only accompanied by heuristic coverage checks. We present the first SBI framework that delivers finite-sample local valid coverage guarantees that hold in the neighborhood of each observation. Our framework can couple any off-the-shelf hierarchical SBI engine with a confor- mal Bayesian post-processing step that operates on the posterior predictive density. A kernel-weighted conformity score adapts the conformal quantile to the local geometry of the data, yielding prediction sets that are simultaneously (i) marginally calibrated, (ii) locally valid, and (iii) hierarchical, handling global and observation-specific parameters in a single pass. Through experiments on synthetic data and benchmarks from neuroscience and physics, we show that our approach attains 1 − α coverage, where prior SBI methods under- or over-cover. Our approach also maintains a competitive, credible set size with minimal computational overhead. Finally, our approach can be used to make predictions on real data and give valid credible regions modulo weight-initialization-based model mis-specification.

Trivedi, Shubhendu [Fermilab]↗
DOE OSTI2024

Resonant inelastic x-ray scattering in warm-dense Fe compounds beyond the SASE FEL resolution limit

Resonant inelastic x-ray scattering (RIXS) is a widely used spectroscopic technique, providing access to the electronic structure and dynamics of atoms, molecules, and solids. However, RIXS requires a narrow bandwidth x-ray probe to achieve high spectral resolution. The challenges in delivering an energetic monochromated beam from an x-ray free electron laser (XFEL) thus limit its use in few-shot experiments, including for the study of high energy density systems. Here we demonstrate that by correlating the measurements of the self-amplified spontaneous emission (SASE) spectrum of an XFEL with the RIXS signal, using a dynamic kernel deconvolution with a neural surrogate, we can achieve electronic structure resolutions substantially higher than those normally afforded by the bandwidth of the incoming x-ray beam. We further show how this technique allows us to discriminate between the valence structures of Fe and Fe2O3, and provides access to temperature measurements as well as M-shell binding energies estimates in warm-dense Fe compounds.

74 ATOMIC AND MOLECULAR PHYSICS↗
DOE OSTI2025

The Cosmic Evolution of C IV Absorbers at 1.4 < z < 4.5: Insights from 100,000 Systems in DESI Quasars

We present the largest catalog to date of triply ionized carbon (C IV ) absorbers detected in quasar spectra from the Dark Energy Spectroscopic Instrument. Using an automated matched-kernel convolution method with adaptive signal-to-noise thresholds, we identify 101,487 C IV systems in the redshift range 1.4 < z < 4.5 from 300,637 quasar spectra. Completeness is estimated via Monte Carlo simulations, and the catalog is 50% complete at EW C IV ≥ 0.4 Å. The differential equivalent width frequency distribution declines exponentially and shows weak redshift evolution. The absorber incidence per unit comoving path increases by a factor of 2–5 from z ≈ 4.5 to z ≈ 1.4, with stronger redshift evolution for strong systems. Using column densities derived from the apparent optical depth method, we constrain the cosmic mass density of C IV , Ω C IV , which increases by a factor of ∼3.8 from (0.82 ± 0.05) × 10 −8 at z ≈ 4.5 to (3.16 ± 0.2) × 10 −8 at z ≈ 1.4. From Ω C IV , we estimate a lower limit on intergalactic medium metallicity ${\mathrm{log}}({Z}_{{\rm{IGM}}}/{Z}_{\odot })\gtrsim -3.25$ at z ∼ 2.3, with a smooth decline at higher redshifts. These trends trace the cosmic star formation history and He II photoheating rate, suggesting a link between C IV enrichment, star formation, and UV background over ∼3 Gyr. The catalog also provides a critical resource for future studies connecting circumgalactic metals to galaxy evolution, especially near cosmic noon.

79 ASTRONOMY AND ASTROPHYSICS↗