Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “large scale analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Greggd

greg(g)d - Global runtime for eBPF-enabled gathering (w/ gumption) daemon Recently the linux kernel has added support for low-level kernel monitoring and profiling through a in-kernel virtual machine. The tooling around these new features (the extended Berkley Packet Filter or eBPF for short) is not mature and is difficult to use. Benefits from eBPF are especially hard to realize while trying to do large scale deployments and integrate with existing metric analysis stacks. A tool was needed to enable loading and collecting data from eBPF programs on large scale HPC systems. Given the problems above it was obvious we needed some wrapper program to compile, load, and collect data from eBPF programs running in the kernel. This tool needed to be lightweight without a heavy set of dependencies, relatively stable between different kernel versions, and integrate nicely with existing widely used metric collection tools. We wrote a program that wraps the eBPF tooling and sends data to our metric gathering tool. eBPF programs are either compiled using the host compiler stack, or loaded in the kernel directly from an object file. These programs are then attached to the system calls that we want to profile. Whenever these system calls are run, the eBPF program collects information of interest and writes that to memory. Our wrapper program polls these memory locations, reads and formats the data, then sends the information to a local unix socket. Our other monitoring tools are configured to read from that socket and send it to the rest of our metric monitoring stack for analysis.

Voss, Joseph [Oak Ridge National Lab. (ORNL), Oak ↗
DOE OSTI2024

Galaxy bispectrum in the spherical Fourier-Bessel basis

The bispectrum, the three-point correlation in Fourier space, is a crucial statistic for studying many effects targeted by the next-generation galaxy surveys, such as primordial non-Gaussianity (PNG) and general relativistic (GR) effects on large scales. In this work we develop a formalism for the bispectrum in the spherical Fourier-Bessel (SFB) basis—a natural basis for computing correlation functions on the curved sky, as it diagonalizes the Laplacian operator in spherical coordinates. Working in the SFB basis allows for line-of-sight effects such as redshift space distortions and GR to be accounted for exactly, i.e., without having to resort to perturbative expansions to go beyond the plane-parallel approximation. Only analytic results for the SFB bispectrum exist in the literature given the intensive computations needed. We numerically calculate the SFB bispectrum for the first time, enabled by a few techniques: We implement a template decomposition of the redshift-space kernel Z 2 into Legendre polynomials, and separately treat the PNG and velocity-divergence terms. We derive an identity to integrate a product of three spherical harmonics connected by a Dirac delta function as a simple sum and use it to investigate the limit of a homogeneous and isotropic Universe. Furthermore, we present a formalism for convolving the signal with separable window functions and use a toy spherically symmetric window to demonstrate the computation and give insights into the properties of the observed bispectrum signal. While our implementation remains computationally challenging, it is a step toward a feasible full extraction of information on large scales via a SFB bispectrum analysis.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Design optimization of lightweight automotive seatback through additive manufacturing compression overmolding of metal polymer composites

With the growing demand for enhanced automotive fuel efficiency and environmental sustainability, there is a need for lightweighting automotive components through innovative design and manufacturing processes. Here, this study leverages a combination of numerical iterative design optimization and hybrid additive manufacturing–compression molding (AM-CM) technique for metal polymer composites to lightweight an automotive seatback. The AM-CM process enables robust mechanical interlocking between metals and composites, boasting high stiffness and strength with low overall density. Replacing metallic components with such metal polymer composites allows for comparable mechanical performance while significantly reducing the overall weight. First, the automotive seatback design space is reduced to critical load carrying regions using topology optimization and high stress concentration areas are identified using finite element analysis. Next, a lightweight metal polymer subcomponent is designed for a high stress concentration region. The full seatback frame with spatially heterogeneous material-specific design is then iteratively optimized to enable enhanced stiffness with minimal weight. Overall, the automotive seatback frame designed with location-specific metal, polymer, and metal polymer composite materials weighs 20% less than the metal-only design while exhibiting similar stiffness.

36 MATERIALS SCIENCE↗
DOE OSTI2022

A novel cosmic filament catalogue from SDSS data

Here, in this work, we present a new catalogue of cosmic filaments obtained from the latest Sloan Digital Sky Survey (SDSS) public data. In order to detect filaments, we implement a version of the Subspace-Constrained Mean-Shift algorithm that is boosted by machine learning techniques. This allows us to detect cosmic filaments as one-dimensional maxima in the galaxy density distribution. Our filament catalogue uses the cosmological sample of SDSS, including Data Release 16, and therefore inherits its sky footprint (aside from small border effects) and redshift coverage. In particular, this means that, taking advantage of the quasar sample, our filament reconstruction covers redshifts up to z = 2.2, making it one of the deepest filament reconstructions to our knowledge. We follow a tomographic approach and slice the galaxy data in 269 shells at different redshift. The reconstruction algorithm is applied to 2D spherical maps. The catalogue provides the position and uncertainty of each detection for each redshift slice. The quality of our detections, which we assess with several metrics, show improvement with respect to previous public catalogues obtained with similar methods. We also detect a highly significant correlation between our filament catalogue and galaxy cluster catalogues built from microwave observations of the Planck Satellite and the Atacama Cosmology Telescope.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2026

Assembly bias and local Primordial non-Gaussianity from DESI DR1 quasars

The analysis of the large-scale clustering of quasars (QSO) observed by the Dark Energy Spectroscopic Instrument (DESI) represents a promising avenue for constraining local Primordial non-Gaussianity (PNG), parameterized by f NL . The signal to be constrained is the scale-dependent bias induced in the 2-point clustering of the considered tracer sample. The resulting constraints on f NL , however, are fully degenerate with the local PNG bias parameter b ϕ , dependent on the assembly bias parameter p. Using IllustrisTNG hydrodynamical simulations, we select a QSO sample reflecting the selection criteria and properties of DESI QSOs, and provide a robust prior for p, and thus for b ϕ , building on the findings of Fondi et al. 2024. We find a distribution with mean p̅ ≃ 1.4 with weak redshift dependence, stable to selection noise and consistent with the expected recent merger history typical of quasar-hosting halos. By comparing with the CAMELS simulations we demonstrate that this prior is robust to astrophysical assumptions and cosmic variance. Finally, applying this prior to the DESI DR1 dataset, we derive updated constraints on local PNG, obtaining f NL = -3.3±9.2.

cosmological parameters from LSS↗
DOE OSTI2022

Translation and rotation equivariant normalizing flow (TRENF) for optimal cosmological analysis

ABSTRACT Our Universe is homogeneous and isotropic, and its perturbations obey translation and rotation symmetry. In this work, we develop translation and rotation equivariant normalizing flow (TRENF), a generative normalizing flow (NF) model which explicitly incorporates these symmetries, defining the data likelihood via a sequence of Fourier space-based convolutions and pixel-wise non-linear transforms. TRENF gives direct access to the high dimensional data likelihood p(x|y) as a function of the labels y, such as cosmological parameters. In contrast to traditional analyses based on summary statistics, the NF approach has no loss of information since it preserves the full dimensionality of the data. On Gaussian random fields, the TRENF likelihood agrees well with the analytical expression and saturates the Fisher information content in the labels y. On non-linear cosmological overdensity fields from N-body simulations, TRENF leads to significant improvements in constraining power over the standard power spectrum summary statistic. TRENF is also a generative model of the data, and we show that TRENF samples agree well with the N-body simulations it trained on, and that the inverse mapping of the data agrees well with a Gaussian white noise both visually and on various summary statistics: when this is perfectly achieved the resulting p(x|y) likelihood analysis becomes optimal. Finally, we develop a generalization of this model that can handle effects that break the symmetry of the data, such as the survey mask, which enables likelihood analysis on data without periodic boundaries.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Optimizing the shape of photometric redshift distributions with clustering cross-correlations

We present an optimization method for the assignment of photometric galaxies to a chosen set of redshift bins. This is achieved by combining simulated annealing, an optimization algorithm inspired by solid-state physics, with an unsupervised machine learning method, a self-organizing map (SOM) of the observed colours of galaxies. Starting with a sample of galaxies that is divided into redshift bins based on a photometric redshift point estimate, the simulated annealing algorithm repeatedly reassigns SOM-selected subsamples of galaxies, which are close in colour, to alternative redshift bins. We optimize the clustering cross-correlation signal between photometric galaxies and a reference sample of galaxies with well-calibrated redshifts. Depending on the effect on the clustering signal, the reassignment is either accepted or rejected. By dynamically increasing the resolution of the SOM, the algorithm eventually converges to a solution that minimizes the number of mismatched galaxies in each tomographic redshift bin and thus improves the compactness of their corresponding redshift distribution. This method is demonstrated on the synthetic Legacy Survey of Space and Time cosmoDC2 catalogue. We find a significant decrease in the fraction of catastrophic outliers in the redshift distribution in all tomographic bins, most notably in the highest redshift bin with a decrease in the outlier fraction from 57 percent to 16 percent.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Intrinsic alignment as an RSD contaminant in the DESI survey

ABSTRACT We measure the tidal alignment of the major axes of luminous red galaxies (LRGs) from the Legacy Imaging Survey and use it to infer the artificial redshift-space distortion signature that will arise from an orientation-dependent, surface-brightness selection in the Dark Energy Spectroscopic Instrument (DESI) survey. Using photometric redshifts to downweight the shape–density correlations due to weak lensing, we measure the intrinsic tidal alignment of LRGs. Separately, we estimate the net polarization of LRG orientations from DESI’s fibre-magnitude target selection to be of order 10−2 along the line of sight. Using these measurements and a linear tidal model, we forecast a 0.5 per cent fractional decrease on the quadrupole of the two-point correlation function for projected separations of 40–80 h−1 Mpc. We also use a halo catalogue from the Abacussummit cosmological simulation suite to reproduce this false quadrupole.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

An Integrated Assessment of a G3 GMD Event on Large-Scale Power Grids: From Magnetometer Data to Geomagnetically Induced Current Analysis

Solar activities can cause geomagnetic disturbances (GMDs) that give rise to geomagnetically induced currents (GICs) which may compromise the reliability of the power system. In order to build more reliable models representing GMD interactions with the power grid, the power system’s detailed electrical model must be considered along with fluctuations in the earth’s magnetic and induced surface electric fields. Here, this study investigates the impact of incorporating spatially varying magnetic fields into surface electric field models on GMD risk metrics. A spatially independent magnetic field model and a spatially varying model are compared through simulations. To perform this analysis, the earth’s magnetic field disturbances are transformed into surface electric fields using respective one-dimensional earth conductivity models. Then, the modeling impact of these electric fields is studied using a 2,000-bus grid for Texas and a 25,000-bus grid for the northeast and mid- Atlantic regions of the United States. Simulation results reveal that the inclusion of spatially varying magnetic fields results in considerable differences in GMD risk metrics, highlighting the importance of accounting for spatial variability when assessing GMD risks in the power system.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2023

Current UAS Capabilities for Geospatial Spectral Solutions

Unmanned aerial systems (UAS) are playing an increasingly pivotal role in advancing the remote collection of data. The various datasets collected by these cutting-edge systems provide near-real-time information and help inform end users on everything from disaster recovery efforts to monitoring atmospheric constituents. This chapter focuses on how the collection of imagery has progressed over time, including the pivotal role UAS play in building large-scale datasets driving data analysis. The authors report the findings of a 2018–2021 survey of the fields that use UAS, the UAS platforms most commonly used, and the sensor components users select to outfit their UAS. The chapter will also discuss the range of platforms currently available, with a specific focus on issues including battery life, data downlinks, data processing times, edge computing, and availability of new sensors. The authors will also discuss the future direction of UAS platforms as well as many of the problems associated with the high spatial and temporal resolution of modern geospatial datasets.

Cotten, David↗
DOE OSTI2024

Bayesian inference of structured latent spaces from neural population activity with the orthogonal stochastic linear mixing model

The brain produces diverse functions, from perceiving sounds to producing arm reaches, through the collective activity of populations of many neurons. Determining if and how the features of these exogenous variables (e.g., sound frequency, reach angle) are reflected in population neural activity is important for understanding how the brain operates. Often, high-dimensional neural population activity is confined to low-dimensional latent spaces. However, many current methods fail to extract latent spaces that are clearly structured by exogenous variables. This has contributed to a debate about whether or not brains should be thought of as dynamical systems or representational systems. Here, we developed a new latent process Bayesian regression framework, the orthogonal stochastic linear mixing model (OSLMM) which introduces an orthogonality constraint amongst time-varying mixture coefficients, and provide Markov chain Monte Carlo inference procedures. We demonstrate superior performance of OSLMM on latent trajectory recovery in synthetic experiments and show superior computational efficiency and prediction performance on several real-world benchmark data sets. We primarily focus on demonstrating the utility of OSLMM in two neural data sets: μ ECoG recordings from rat auditory cortex during presentation of pure tones and multi-single unit recordings form monkey motor cortex during complex arm reaching. We show that OSLMM achieves superior or comparable predictive accuracy of neural data and decoding of external variables (e.g., reach velocity). Most importantly, in both experimental contexts, we demonstrate that OSLMM latent trajectories directly reflect features of the sounds and reaches, demonstrating that neural dynamics are structured by neural representations. Together, these results demonstrate that OSLMM will be useful for the analysis of diverse, large-scale biological time-series datasets.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2020

Large Scale Simulations of Quantum Systems on HPC with Analytics for HEP Algorithms

The objective of this work is to combine HEP simulation experience with HPC quantum systems simulations to provide an environment for executing large-scale experiments with advanced analysis capabilities for studying multi-qubit and multi-level reduced-noise, long coherence time quantum systems such as 3D Superconducting RF (SRF) cavities integrated with transmon qubits.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Tensor Text-Mining Methods for Malware Identification and Detection, Malware Dynamics Characterization, and Hosts Ranking

Malware is one of the most persistent and costly cyber threats endangering reputation, confidentiality, integrity, and availability for organizations and national security. Consequently, many of the incident detection and prevention systems, and incident responders have begun to utilize machine learning as a helper in the fight against malware and other cyber threats. However, cyber defenders rely on interpretability and generalizability, yet the popular machine learning methods are black-box and often use traditional supervised solutions that do not generalize to novel malware. Therefore, there is a need to improve the existing solutions. At the same time, the majority of the prior research ignored essential evaluation criteria when reporting the results of their methods, which disables the safe reproducibility of the methods in a production environment. Tensor decomposition, on the other hand, enables interpretable unsupervised analysis of the large-scale data for the discovery of hidden patterns. Our findings, performed on real-world and large-scale experiments, show that tensor factorization-based methods yield performance results that surpasses or competes with existing supervised solutions with the added benefit of interpretability and generalizability. With the ability to analyze complex and large-scale data using tensors, we report results that reflect real-world production environments. We propose to develop new game- changing tools for malware identification and characterization that can trace malware evolution, rank the infected or malicious hosts, and streamline the work of incident response teams, malware analysts, and incident detection and prevention systems.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Application of Ion Sieve Sorbent Prepared from Mineral Stream Associated with Critical Minerals in Direct Lithium Extraction

In this presentation, the speaker discusses the research that has been carried out at NETL regarding direct lithium extraction. The three main discussing points are as follows: developing high-capacity lithium-ion sieve sorbent using mineral streams associated with critical minerals; demonstrating the sorbent ability to recover lithium from oil/gas produced waters and geothermal brines; and assessing the feasibility of large-scale implementation through technoeconomic analysis.

Cheng, Chin-Min [NETL Site Support Contractor, Nat↗
DOE OSTI2025

Wind and Weather Variability within the Californian Offshore Wind Energy Areas

Weather variability over the Northeast Pacific (NEP) region and its influence on wind resources within the Californian offshore wind energy areas (WEAs) at Humboldt and Morro Bay are characterized using 20-years reanalysis model and satellite data. The hub-height (180 m) winds at both locations are predominantly northwesterly driven by the NEP high pressure system, with strong coastal gradients in surface pressure, fluxes, planetary boundary layer (PBL) depths and cloudiness. These sharp coastal gradients and strong annual cycles of temperature and moisture advections pose potential challenges in accurately modeling the local wind resource. Hub-height wind speeds and power capacity factors significantly vary for different regimes of PBL depths, surface fluxes and rain area fractions. This highlights the importance of studying the physical mechanisms driving these weather regimes, hence our analysis of how large-scale NEP weather variability drives the local meteorology at the WEAs. Furthermore, at both WEAs, PBL tops and cloud boundaries intersect the rotor layer (80-280 m) more than 30% and 20% of the time, respectively. While PBL depths significantly modulates hub-height winds and power, cloud boundaries do not have a similar impact, likely due to reanalysis errors in simulating cloud boundaries accurately. These findings underscore the challenges in deploying tall wind turbines in shallow cloudy boundary layers, where the interaction between clouds, precipitation, and atmospheric layers can impact turbine efficiency. As turbines grow taller and are deployed in more complex meteorological conditions, understanding these interactions is crucial for improving wind power forecasting and optimizing energy production in coastal regions.

17 WIND ENERGY↗
DOE OSTI2025

Analysis of Off-Gas Streams from Small- and Large-Scale Sparging Salt Vessels using Laser-Induced Breakdown Spectroscopy

Laser-induced breakdown spectroscopy (LIBS) is being developed as an analytical monitoring tool for molten salt reactor (MSR) systems. A mobile LIBS platform was configured on a small-scale salt vessel (~100 g of salt) and then transported 0.6 km to successfully monitor an engineering-scale pumped salt loop (~100 kg of salt). Several studies on monitoring salt aerosols, hydrogen isotopes, and noble gases were performed on the small-scale system. All these studies were then implemented for monitoring various tests on the engineering-scale loop. Aerosolized salts from both the storage tank and pump bowl were monitored using LIBS to assess bulk salt analyte ratios (Mg, Na, K) and evaluate impurities (H, O, Ca). In addition to monitoring salt aerosols, LIBS was used in tandem with a residual gas analyzer (RGA) and a Raman spectroscopy system to detect hydrogen isotopes as they were sparged through and subsequently depleted from the loop storage tank. Lastly, a similar test with noble gases (100 ppm Kr, 1000 ppm Xe) was performed, in which LIBS demonstrated a faster response than the RGA used in-line. The tests and results are summarized in this report with detailed publications to follow. Key takeaways are listed in the conclusion of the report.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2023

FAST Drift Scan Survey for Ηι Intensity Mapping: I. Preliminary Data Analysis

This work presents the initial results of the drift-scan observation for the neutral hydrogen (Hi) intensity mapping survey with the Five-hundred-meter Aperture Spherical radio Telescope (FAST). The data analyzed in this work were collected in night observations from 2019 through 2021. The primary findings are based on 28 hr of drift-scan observation carried out over 7 nights in 2021, which covers 60 deg 2 sky area. Our main findings are, first, our calibration strategy can successfully correct both the temporal and bandpass gain variation over the 4 hr drift-scan observation. Second, the continuum maps of the surveyed region are made with frequency resolution of 28 kHz and pixel area of $_{2.95\,{\mathrm{arcmin}}^{2}}$. The pixel noise levels of the continuum maps are slightly higher than the forecast assuming $T$ sys = 20 K, which are 36.0 mK (for 10.0 s integration time) at the 1050–1150 MHz band, and 25.9 mK (for 16.7 s integration time) at the 1323–1450 MHz band, respectively. Third, the flux-weighted differential number count is consistent with the NRAO-VLA Sky Survey (NVSS) catalog down to the confusion limit ~7 mJy beam –1 . Finally, the continuum flux measurements of the sources are consistent with those found in the literature. The difference in the flux measurement of 81 isolated NVSS sources is about 6.3%. Our research offers a systematic analysis for the FAST Hi intensity mapping drift-scan survey and serves as a helpful resource for further cosmology and associated galaxies sciences with the FAST drift-scan survey.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Exact Calculation of Nonideal Fields Demonstrates Their Dominance of Injection in Relativistic Reconnection

Magnetic reconnection is an important source of energetic particles in systems ranging from astrophysics to the laboratory. The large separation of spatiotemporal scales involved makes it critical to determine the minimum physical model containing the necessary physics for modeling particle acceleration. Here, by resolving the energy gain from ideal and nonideal magnetohydrodynamic electric fields self-consistently in kinetic particle-in-cell simulations of reconnection, we conclusively show the dominant role of the nonideal field for the early stage of energization known as injection. The importance of the nonideal field increases with magnetization, guide field, and in three dimensions, indicating its general importance for reconnection in natural astrophysical systems. We obtain the statistical properties of the injection process from the simulations, paving the way for the development of extended MHD models capable of accurately modeling particle acceleration in large-scale systems. The novel analysis method developed in this study can be applied broadly to give new insight into a wide range of processes in plasma physics.

79 ASTRONOMY AND ASTROPHYSICS↗