Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “kernel”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 775 records · Page 43

Do people spend travel time the way they think they would? a comparative study of generic and trip-specific travel time allocation using hybrid multiple discrete continuous (MDC) framework

Unlike driving alone, public transportation allows one to engage in extraneous activities while traveling – often referred to as travel-based multitasking. Research involving travel-based multitasking often relies on either generic (i.e. not related to an actual trip) or revealed (i.e. related to an executed trip) data. The data collected for this study provided a unique opportunity to compare the generic and trip-specific preferences while traveling on public transportation. To this end, the study develops two integrated choice and latent variable models with multiple discrete-continuous (MDC) kernels to simultaneously model the activity selection and the time allocation for generic and trip-specific data, respectively. According to the results the trip-specific data could identify more nuances in the travel-based multitasking behavior than the generic data. Finally, the heterogeneity identified by the developed models will be helpful for the transit operators in providing appropriate facilities (e.g. internet access, reading lights) along various transit corridors.

99 GENERAL AND MISCELLANEOUS↗

Toward the first gluon parton distribution from the LaMET

Abstract We present progress towards the first unpolarized gluon quasi-parton distribution function (PDF) from lattice quantum chromodynamics using high-statistics measurements for hadrons at two valence pion masses M π ≈ 310 and 690 MeV computed on an a ≈ 0.12 fm ensemble with 2 + 1 + 1-flavors of highly improved staggered quark generated by the MILC collaboration. In this study, we consider two gluon operators for which the hybrid-ratio renormalization matching kernels have been recently derived and a third operator that has been used in prior pseudo-PDF studies of the gluon PDFs. We compare the matrix elements for each operator for both the nucleon and pion, at both pion masses, and using two gauge-smearing techniques. Focusing on the more phenomenologically studied nucleon gluon PDF, we compare the ratio and hybrid-ratio renormalized matrix elements at both pion masses and both smearings to those reconstructed from the nucleon gluon PDF from the CT18 global analysis. We identify the best choice of operator to study the gluon PDF and present the first gluon quasi-PDF under some caveats. Additionally, we explore the recent idea of Coulomb gauge fixing to improve signal at large Wilson-line displacement and find it could be a major help in improving the signal in the gluon matrix elements. This work helps identify the best operator for studying the gluon quasi-PDF, shows higher hadron boost momentum is needed to implement hybrid-ratio renormalization reliably, and suggests the need to study more diverse set of operators with their corresponding perturbative calculations for hybrid-ratio renormalization to further gluon quasi-PDF study.

Good, William (ORCID:0000000184281003)↗

Deep learning the properties of inorganic perovskites

We report the ability to accurately and quickly predict the stability of materials and their structural and electronic properties remains a grand challenge in materials science. Density functional theory is widely used as a means of predicting these material properties, but is known to be computationally expensive and scales as the cube of the number of electrons in the material’s unit cell. In this article, for a previously published dataset of inorganic perovskites, we show that a single neural network model using only the elemental properties of the compounds’ constituents can predict lattice constants to within 0.1 Å, heat of formation to within 0.2 eV, and band gaps to within 0.7 eV RMSE. We also compare the performance of the trained network to two widely used regression techniques, namely random forest and Kernel ridge regression, and find that the neural network’s predictions are more accurate for each of the properties. The simultaneous accurate prediction of multiple key properties of technologically relevant materials is promising for rational design and optimization in known and novel chemical spaces.

36 MATERIALS SCIENCE↗

Single Gaussian process method for arbitrary tokamak regimes with a statistical analysis

Abstract Gaussian process regression is a Bayesian method for inferring profiles based on input data. The technique is increasing in popularity in the fusion community due to its many advantages over traditional fitting techniques including intrinsic uncertainty quantification and robustness to over-fitting. This work investigates the use of a new method, the change-point method, for handling the varying length scales found in different tokamak regimes. The use of the Student’s t-distribution for the Bayesian likelihood probability is also investigated and shown to be advantageous in providing good fits in profiles with many outliers. To compare different methods, synthetic data generated from analytic profiles is used to create a database enabling a quantitative statistical comparison of which methods perform the best. Using a full Bayesian approach with the change-point method, Matérn kernel for the prior probability, and Student’s t-distribution for the likelihood is shown to give the best results.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

A Lagrangian perturbation theory in the presence of massive neutrinos

We develop a Lagrangian Perturbation Theory (LPT) framework to study the clustering of cold dark matter (CDM) in cosmologies with massive neutrinos. We follow the trajectories of CDM particles with Lagrangian displacements fields up to third order in perturbation theory. Once the neutrinos become non-relativistic, their density fluctuations are modeled as being proportional to the CDM density fluctuations, with a scale-dependent proportionality factor. This yields a gravitational back-reaction that introduces additional scales to the linear growth function, which is accounted for in the higher order LPT kernels. Through non-linear mappings from Eulerian to Lagrangian frames, we ensure that our theory has a well behaved large scale behavior free of unwanted UV divergences, which are common when neutrino and CDM densities are not treated on an equal footing, and in resummation schemes that manifestly break Galilean invariance. We use our theory to construct correlation functions for both the underlying matter field, as well as for biased tracers using ConvolutionLPT. Redshift-space distortions effects are modeled using the Gaussian Streaming Model. When comparing our analytical results to simulated data from the Quijote 1 simulation suite, we find good accuracy down to r = 20 Mpc h -1 at redshift z = 0.5, for the real space and redshift space monopole particle correlation functions with no free parameters. The same accuracy is reached for the redshift space quadrupole if we additionally consider an effective field theory parameter that shifts the pairwise velocity dispersion. For modeling the correlation functions of tracers we adopt a simple Lagrangian biasing scheme with only density and curvature operators, which we find sufficient to reach down to r = 20 Mpc h -1 when comparing to simulated halos.

79 ASTRONOMY AND ASTROPHYSICS↗

Gravothermal evolution of dark matter halos with differential elastic scattering

Here, we study gravothermal evolution of dark matter halos in the presence of differential self-scattering that has strong velocity and angular dependencies. We design controlled N-body simulations to model Rutherford and Møller scatterings in the halo, and follow its evolution in both core-expansion and -collapse phases. The simulations show the commonly-used transfer cross section underestimates the effects of dark matter self-interactions, but the viscosity cross section provides an accurate approximation for modeling angular-dependent dark matter scattering. We investigate thermodynamic properties of the halo, and find that the three moments of the Boltzmann equation under the fluid approximation are satisfied. We further propose a constant effective cross section, which integrates over the halo's characteristic velocity dispersion with weighting kernels motivated by kinetic theory of heat conduction. The effective cross section provides a good approximation to differential self-scattering for most of the halo evolution. It indicates that we can map astrophysical constraints on a constant self-interacting cross section to an SIDM model with velocity- and angular-dependent scatterings.

79 ASTRONOMY AND ASTROPHYSICS↗

The Atacama Cosmology Telescope: map-based noise simulations for DR6

Abstract The increasing statistical power of cosmic microwave background (CMB) datasets requires a commensurate effort in understanding their noise properties. The noise in maps from ground-based instruments is dominated by large-scale correlations, which poses a modeling challenge. This paper develops novel models of the complex noise covariance structure in the Atacama Cosmology Telescope Data Release 6 (ACT DR6) maps. We first enumerate the noise properties that arise from the combination of the atmosphere and the ACT scan strategy. We then prescribe a class of Gaussian, map-based noise models, including a new wavelet-based approach that uses directional wavelet kernels for modeling correlated instrumental noise. The models are empirical, whose only inputs are a small number of independent realizations of the same region of sky. We evaluate the performance of these models against the ACT DR6 data by drawing ensembles of noise realizations. Applying these simulations to the ACT DR6 power spectrum pipeline reveals a ∼ 20% excess in the covariance matrix diagonal when compared to an analytic expression that assumes noise properties are uniquely described by their power spectrum. Along with our public code,mnms, this work establishes a necessary element in the science pipelines of both ACT DR6 and future ground-based CMB experiments such as the Simons Observatory (SO).

Astronomy & Astrophysics↗

Cosmological perturbation theory for large scale structure in phase space

We develop a framework for Large Scale Structure (LSS) perturbation theory, that solves the Vlasov-Poisson system of equations for the distribution function in full phase space. This approach relaxes the usual apriori assumption of negligible velocity dispersion underlying the Standard Perturbation Theory (SPT). We apply the new method to rederive the usual SPT kernels up to third order in the perturbative expansion. We also show that a counterterm, identical to the one introduced by standard Effective Field Theory (EFT) methods, naturally arises within our framework. We finish by making a precise connection to EFT techniques, which reveals the necessity of the EFTofLSS to self-consistently model the long-wavelength fluid, and illustrates the importance of having theoretical control over short distance fluctuations.

Cosmological perturbation theory in GR and beyond↗

Cosmology from Planck CMB lensing and DESI DR1 quasar tomography

We present a measurement of the amplitude of matter fluctuations over the redshift range 0.8 ≤ z ≤ 3.5 from the cross correlation of over 1.2 million spectroscopic quasars selected by the Dark Energy Spectroscopic Instrument (DESI) across 7,200 deg 2 (∼ 170 quasars/deg 2 ) and Planck PR4 (NPIPE) cosmic microwave background (CMB) lensing maps. We perform a tomographic measurement in three bins centered at effective redshiftsz=1.44, 2.27 and 2.75, which have ample overlap with the CMB lensing kernel. From a joint fit using the angular clustering of all three redshift bins (auto and cross-spectra), and including an Q m prior from DESI DR1 baryon acoustic oscillations to break the $Ω_{m}-σ_{8}$ degeneracy, we constrain the amplitude of matter fluctuations in the matter-dominated regime to be $σ_{8}=0.929^{+0.059}_{-0.074}$ and $S_{8}≡σ_{8}(Ω_m/0.3)^{0.5} = 0.922^{+0.059}_{-0.073}$. We provide a growth of structure measurement with the largest spectroscopic quasar sample to date at high redshift, which is ∼ 1.5σ higher than predictions from ΛCDM fits to measurements of the primary CMB from Planck PR4. The cross-correlation between PR4 lensing maps and DESI DR1 quasars is detected with a signal-to-noise ratio of 21.7 and the quasar auto-correlation at 27.2 for the joint analysis of all redshift bins. We combine our measurement with the CMB lensing auto-spectrum from the ground-based Atacama Cosmology Telescope (ACT DR6) and Planck PR4 to perform a sound-horizon-free measurement of the Hubble constant, yielding $H_{0}=69.1^{+2.2}_{-2.6} {\rm \ km\ s}^{-1}{\rm Mpc}^{-1}$ through its sensitivity to the matter-radiation equality scale.

baryon acoustic oscillations↗

SHADOW4: the popular ray tracing revived for evolving synchrotron sources in fourth-generation storage rings

We present SHADOW4, a new version of the popular ray tracing code. The SHADOW kernel has been completely rewritten in Python applying modern concepts of software engineering. A new user interface is available in the OASYS ecosystem. The new tool has been designed and implemented preparing the future needs both in computing (cloud computing, AI integration) and in the transit to fourth generation sources and beyond.

Sanchez del Rio, Manuel↗

Training quantum neural networks using the quantum information bottleneck method

Abstract We provide in this paper a concrete method for training a quantum neural network to maximize the relevant information about a property that is transmitted through the network. This is significant because it gives an operationally well founded quantity to optimize when training autoencoders for problems where the inputs and outputs are fully quantum. We provide a rigorous algorithm for computing the value of the quantum information bottleneck quantity within error ε that requires O ( log 2 ⁡ ( 1 / ϵ ) + 1 / δ 2 ) queries to a purification of the input density operator if its spectrum is supported on { 0 } ⋃ [ δ , 1 − δ ] for δ > 0 and the kernels of the relevant density matrices are disjoint. We further provide algorithms for estimating the derivatives of the QIB function, showing that quantum neural networks can be trained efficiently using the QIB quantity given that the number of gradient steps required is polynomial.

Çatlı, Ahmet Burak (ORCID:0000000152294141)↗

Learning to classify quantum phases of matter with a few measurements

We study the identification of quantum phases of matter, at zero temperature, when only part of the phase diagram is known in advance. Following a supervised learning approach, we show how to use our previous knowledge to construct an observable capable of classifying the phase even in the unknown region. By using a combination of classical and quantum techniques, such as tensor networks, kernel methods, generalization bounds, quantum algorithms, and shadow estimators, we show that, in some cases, the certification of new ground states can be obtained with a polynomial number of measurements. An important application of our findings is the classification of the phases of matter obtained in quantum simulators, e.g. cold atom experiments, capable of efficiently preparing ground states of complex many-particle systems and applying simple measurements, e.g. single qubit measurements, but unable to perform a universal set of gates.

quantum machine learning↗

Deep energy-pressure regression for a thermodynamically consistent EOS model

Abstract In this paper, we aim to explore novel machine learning (ML) techniques to facilitate and accelerate the construction of universal equation-Of-State (EOS) models with a high accuracy while ensuring important thermodynamic consistency. When applying ML to fit a universal EOS model, there are two key requirements: (1) a high prediction accuracy to ensure precise estimation of relevant physics properties and (2) physical interpretability to support important physics-related downstream applications. We first identify a set of fundamental challenges from the accuracy perspective, including an extremely wide range of input/output space and highly sparse training data. We demonstrate that while a neural network (NN) model may fit the EOS data well, the black-box nature makes it difficult to provide physically interpretable results, leading to weak accountability of prediction results outside the training range and lack of guarantee to meet important thermodynamic consistency constraints. To this end, we propose a principled deep regression model that can be trained following a meta-learning style to predict the desired quantities with a high accuracy using scarce training data. We further introduce a uniquely designed kernel-based regularizer for accurate uncertainty quantification. An ensemble technique is leveraged to battle model overfitting with improved prediction stability. Auto-differentiation is conducted to verify that necessary thermodynamic consistency conditions are maintained. Our evaluation results show an excellent fit of the EOS table and the predicted values are ready to use for important physics-related tasks.

97 MATHEMATICS AND COMPUTING↗

Machine learning materials properties with accurate predictions, uncertainty estimates, domain guidance, and persistent online accessibility

One compelling vision of the future of materials discovery and design involves the use of machine learning (ML) models to predict materials properties and then rapidly find materials tailored for specific applications. However, realizing this vision requires both providing detailed uncertainty quantification (model prediction errors and domain of applicability) and making models readily usable. At present, it is common practice in the community to assess ML model performance only in terms of prediction accuracy (e.g. mean absolute error), while neglecting detailed uncertainty quantification and robust model accessibility and usability. Here, we demonstrate a practical method for realizing both uncertainty and accessibility features with a large set of models. We develop random forest ML models for 33 materials properties spanning an array of data sources (computational and experimental) and property types (electrical, mechanical, thermodynamic, etc). All models have calibrated ensemble error bars to quantify prediction uncertainty and domain of applicability guidance enabled by kernel-density-estimate-based feature distance measures. All data and models are publicly hosted on the Garden-AI infrastructure, which provides an easy-to-use, persistent interface for model dissemination that permits models to be invoked with only a few lines of Python code. We demonstrate the power of this approach by using our models to conduct a fully ML-based materials discovery exercise to search for new stable, highly active perovskite oxide catalyst materials.

domain of applicability↗

Many-body expansion based machine learning models for octahedral transition metal complexes

Abstract Graph-based machine learning (ML) models for material properties show great potential to accelerate virtual high-throughput screening of large chemical spaces. However, in their simplest forms, graph-based models do not include any 3D information and are unable to distinguish stereoisomers such as those arising from different orderings of ligands around a metal center in coordination complexes. In this work we present a modification to revised autocorrelation descriptors, a molecular graph featurization method, for predicting spin state dependent properties of octahedral transition metal complexes (TMCs). Inspired by analytical semi-empirical models for TMCs, the new modeling strategy is based on the many-body expansion (MBE) and allows one to tune the captured stereoisomer information by changing the truncation order of the MBE. We present the necessary modifications to include this approach in two commonly used ML methods, kernel ridge regression and feed-forward neural networks. On a test set composed of all possible isomers of binary TMCs, the best MBE models achieve mean absolute errors (MAEs) of 2.75 kcal mol −1 on spin-splitting energies and 0.26 eV on frontier orbital energy gaps, a 30%–40% reduction in error compared to models based on our previous approach. We also observe improved generalization to previously unseen ligands where the best-performing models exhibit MAEs of 4.00 kcal mol −1 (i.e. a 0.73 kcal mol −1 reduction) on the spin-splitting energies and 0.53 eV (i.e. a 0.10 eV reduction) on the frontier orbital energy gaps. Because the new approach incorporates insights from electronic structure theory, such as ligand additivity relationships, these models exhibit systematic generalization from homoleptic to heteroleptic complexes, allowing for efficient screening of TMC search spaces.

Meyer, Ralf (ORCID:0000000322360261)↗

A review of non-cognitive applications for neuromorphic computing

Abstract Though neuromorphic computers have typically targeted applications in machine learning and neuroscience (‘cognitive’ applications), they have many computational characteristics that are attractive for a wide variety of computational problems. In this work, we review the current state-of-the-art for non-cognitive applications on neuromorphic computers, including simple computational kernels for composition, graph algorithms, constrained optimization, and signal processing. We discuss the advantages of using neuromorphic computers for these different applications, as well as the challenges that still remain. The ultimate goal of this work is to bring awareness to this class of problems for neuromorphic systems to the broader community, particularly to encourage further work in this area and to make sure that these applications are considered in the design of future neuromorphic systems.

97 MATHEMATICS AND COMPUTING↗

SAIGE-GPU: accelerating genome- and phenome-wide association studies using GPUs

Genome-wide association studies (GWAS) at biobank scale are computationally intensive, especially for admixed populations requiring robust statistical models. SAIGE is a widely used method for generalized linear mixed-model GWAS but is limited by its CPU-based implementation, making phenome-wide association studies impractical for many research groups. We developed SAIGE-GPU, a GPU-accelerated version of SAIGE that replaces CPU-intensive matrix operations with GPU-optimized kernels. The core innovation is distributing genetic relationship matrix calculations across GPUs and communication layers. Applied to 2068 phenotypes from 635 969 participants in the Million Veteran Program, including diverse and admixed populations, SAIGE-GPU achieved a 5-fold speedup in mixed model fitting on supercomputing infrastructure and cloud platforms. We further optimized the variant association testing step through multi-core and multi-trait parallelization. Deployed on Google Cloud Platform and Azure, the method provided substantial cost and time savings. Source code and binaries are available for download at https://github.com/saigegit/SAIGE/tree/SAIGE-GPU-1.3.3. A code snapshot is archived at Zenodo for reproducibility (DOI: [10.5281/zenodo.17642591]). SAIGE-GPU is available in a containerized format for use across HPC and cloud environments and is implemented in R/C++ and runs on Linux systems.

Rodriguez, Alex [Argonne National Laboratory (ANL)↗

The genetic architecture of leaf stable carbon isotope composition in Zea mays and the effect of transpiration efficiency on leaf elemental accumulation

With increased demand on freshwater resources for agriculture, it is imperative that more water-use efficient crops are developed. Leaf stable carbon isotope composition, δ 13 C, is a proxy for transpiration efficiency and a possible tool for breeders, but the underlying mechanisms effecting δ 13 C in C 4 plants are not known. It has been suggested that differences in specific leaf area (SLA), which potentially reflects variation in internal CO 2 diffusion, can impact leaf δ 13 C. Furthermore, although it is known that water movement is important for elemental uptake, it is not clear how manipulation of transpiration for increased water-use efficiency may impact nutrient accumulation. Here, we characterize the genetic architecture of leaf δ 13 C and test its relationship to SLA and the ionome in five populations of maize. Five significant QTL for leaf δ 13 C were identified, including novel QTL as well as some that were identified previously in maize kernels. One of the QTL regions contains an Erecta-like gene, the ortholog of which has been shown to regulate transpiration efficiency and leaf δ 13 C in Arabidopsis. QTL for δ 13 C were located in the same general chromosome region, but slightly shifted, when comparing data from two different years. Our data does not support a relationship between δ 13 C and SLA, and of the 19 elements analyzed, only a weak correlation between molybdenum and δ 13 C was detected. Together these data add to the genetic understanding of leaf δ 13 C in maize and suggest that improvements to plant water use may be possible without significantly influencing elemental homeostasis.

59 BASIC BIOLOGICAL SCIENCES↗