Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “large scale analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 415 records · Page 23
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Multi-probe analysis of the galaxy cluster CL J1226.9+3332: Hydrostatic mass and hydrostatic-to-lensing bias

The precise estimation of the mass of galaxy clusters is a major issue for cosmology. Large galaxy cluster surveys rely on scaling laws that relate cluster observables to their masses. From the high-resolution observations of ~45 galaxy clusters with the NIKA2 and XMM-Newton instruments, the NIKA2 Sunyaev-Zel’dovich Large Program should provide an accurate scaling relation between the thermal Sunyaev-Zel’dovich effect and the hydrostatic mass. In this paper we present an exhaustive analysis of the hydrostatic mass of the well-known galaxy cluster CL J1226.9+3332, the highest-redshift cluster in the NIKA2 Sunyaev-Zel’dovich Large Program at z = 0.89. We combined the NIKA2 observations with thermal Sunyaev-Zel’dovich data from the NIKA, Bolocam, and MUSTANG instruments and XMM-Newton X-ray observations, and tested the impact of the systematic effects on the mass reconstruction. We conclude that slight differences in the shape of the mass profile can be crucial when defining the integrated mass at R 500 , which demonstrates the importance of the modelling in the mass determination. We prove the robustness of our hydrostatic mass estimates by showing the agreement with all the results found in the literature. Another key factor for cosmology is the bias of the masses estimated assuming the hydrostatic equilibrium hypothesis. Based on the lensing convergence maps from the Cluster Lensing And Supernova survey with Hubble (CLASH) data, we obtain the lensing mass estimate for CL J1226.9+3332. From this we are able to measure the hydrostatic-to-lensing mass bias for this cluster, which spans from 1–b HSE/lens ~0.7 to 1, presenting the impact of data sets and mass reconstruction models on the bias.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

Advancing the Representation of Human Actions in Large‐Scale Hydrological Models: Challenges and Future Research Directions

Characterizing the impact of human actions on terrestrial water fluxes and storages at multi-basin, continental, and global scales has long been on the agenda of scientists engaged in climate science, hydrology, and water resources systems analysis. This need has resulted in a variety of modeling efforts focused on the representation of water infrastructure operations. Yet, the representation of human-water interactions in large-scale hydrological models is still relatively crude, fragmented across models, and often achieved at coarse resolutions (~10–100 km) that cannot capture local water management decisions. In this commentary, we argue that the concomitance of four drivers and innovations is poised to change the status quo: “hyper-resolution” hydrological models (~0.1–1 km), multi-sector modeling, satellite missions able to monitor the outcome of human actions, and machine learning are creating a fertile environment for human-water research to flourish. We then outline four challenges that chart future research in hydrological modeling: (a) creating hyper-resolution global data sets of water management practices, (b) improving the characterization of anthropogenic interventions on water quantity, stream temperature, and sediment transport, (c) improving model calibration and diagnostic evaluation, and (d) reducing the computational requirements associated with the successful exploration of these challenges. Overcoming them will require addressing modeling, computational, and data development needs that cut across the hydrology community, thereby requiring a major communal effort.

catchment hydrology↗
DOE OSTI2022

Accelerating astronomical and cosmological inference with preconditioned Monte Carlo

ABSTRACT We introduce preconditioned Monte Carlo (PMC), a novel Monte Carlo method for Bayesian inference that facilitates efficient sampling of probability distributions with non-trivial geometry. PMC utilizes a Normalizing Flow (NF) in order to decorrelate the parameters of the distribution and then proceeds by sampling from the preconditioned target distribution using an adaptive Sequential Monte Carlo (SMC) scheme. The results produced by PMC include samples from the posterior distribution and an estimate of the model evidence that can be used for parameter inference and model comparison, respectively. The aforementioned framework has been thoroughly tested in a variety of challenging target distributions achieving state-of-the-art sampling performance. In the cases of primordial feature analysis and gravitational wave inference, PMC is approximately 50 and 25 times faster, respectively, than nested sampling (NS). We found that in higher dimensional applications, the acceleration is even greater. Finally, PMC is directly parallelisable, manifesting linear scaling up to thousands of CPUs.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

The Alcock–Paczynski effect from Lyman- α forest correlations: analysis validation with synthetic data

The three-dimensional distribution of the Ly α forest has been extensively used to constrain cosmology through measurements of the baryon acoustic oscillations (BAO) scale. However, more cosmological information could be extracted from the full shapes of the Ly α forest correlations through the Alcock–Paczynski (AP) effect. In this work, we prepare for a cosmological analysis of the full shape of the Ly α forest correlations by studying synthetic data of the extended Baryon Oscillation Spectroscopic Survey (eBOSS). We use a set of 100 eBOSS synthetic data sets in order to validate such an analysis. These mocks undergo the same analysis process as the real data. We perform a full-shape analysis on the mean of the correlation functions measured from the 100 eBOSS realizations, and find that our model of the Ly α correlations performs well on current data sets. We show that we are able to obtain an unbiased full-shape measurement of D M /D H (z eff ), where D M is the transverse comoving distance, D H is the Hubble distance, and z eff is the effective redshift of the measurement. We test the fit over a range of scales, and decide to use a minimum separation of r min = 25 h –1 Mpc. Here, we also study and discuss the impact of the main contaminants affecting Ly α forest correlations, and give recommendations on how to perform such analysis with real data. While the final eBOSS Ly α BAO analysis measured D M /D H (z eff = 2.33) with 4 per cent statistical precision, a full-shape fit of the same correlations could provide an $\sim 2~{{\ \rm per\ cent}}$ measurement.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Scientific machine learning benchmarks

Deep learning has transformed the use of machine learning technologies for the analysis of large experimental datasets. In science, such datasets are typically generated by large-scale experimental facilities, and machine learning focuses on the identification of patterns, trends and anomalies to extract meaningful scientific insights from the data. In upcoming experimental facilities, such as the Extreme Photonics Application Centre (EPAC) in the UK or the international Square Kilometre Array (SKA), the rate of data generation and the scale of data volumes will increasingly require the use of more automated data analysis. Furthermore, at present, identifying the most appropriate machine learning algorithm for the analysis of any given scientific dataset is a challenge due to the potential applicability of many different machine learning frameworks, computer architectures and machine learning models. Historically, for modelling and simulation on high-performance computing systems, these issues have been addressed through benchmarking computer applications, algorithms and architectures. Extending such a benchmarking approach and identifying metrics for the application of machine learning methods to open, curated scientific datasets is a new challenge for both scientists and computer scientists. Here, we introduce the concept of machine learning benchmarks for science and review existing approaches. As an example, we describe the SciMLBench suite of scientific machine learning benchmarks.

42 ENGINEERING↗
DOE OSTI2021

Combination of cluster number counts and two-point correlations: validation on mock Dark Energy Survey

ABSTRACT We present a method of combining cluster abundances and large-scale two-point correlations, namely galaxy clustering, galaxy–cluster cross-correlations, cluster autocorrelations, and cluster lensing. This data vector yields comparable cosmological constraints to traditional analyses that rely on small-scale cluster lensing for mass calibration. We use cosmological survey simulations designed to resemble the Dark Energy Survey Year 1 (DES-Y1) data to validate the analytical covariance matrix and the parameter inferences. The posterior distribution from the analysis of simulations is statistically consistent with the absence of systematic biases detectable at the precision of the DES-Y1 experiment. We compare the χ2 values in simulations to their expectation and find no significant difference. The robustness of our results against a variety of systematic effects is verified using a simulated likelihood analysis of DES-Y1-like data vectors. This work presents the first-ever end-to-end validation of a cluster abundance cosmological analysis on galaxy catalogue level simulations.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2026

Dark Energy Survey Year 3 results: Simulation-based 𝑤CDM inference from weak lensing and galaxy clustering maps with deep learning: Analysis design

Data-driven approaches using deep learning are emerging as powerful techniques to extract non-Gaussian information from cosmological large-scale structure. Here, this work presents the first simulation-based inference (SBI) pipeline that combines weak lensing and galaxy clustering maps in a realistic Dark Energy Survey Year 3 (DES Y3) configuration and serves as preparation for a forthcoming analysis of the survey data. We develop a scalable forward model based on the CosmoGridV1 suite of N-body simulations to generate over one million self-consistent mock realizations of DES Y3 at the map level. Leveraging this large dataset, we train deep graph convolutional neural networks on the full survey footprint in spherical geometry to learn low-dimensional features that approximately maximize mutual information with target parameters. These learned compressions enable neural density estimation of the implicit likelihood via normalizing flows in a ten-dimensional parameter space spanning cosmological 𝑤CDM, intrinsic alignment, and linear galaxy bias parameters, while marginalizing over baryonic, photometric redshift, and shear bias nuisances. To ensure robustness, we extensively validate our inference pipeline using synthetic observations derived from both systematic contaminations in our forward model and independent Buzzard galaxy catalogs. Our forecasts yield significant improvements in cosmological parameter constraints, achieving 2−3× higher figures of merit in the 𝛺 𝑚 − 𝑆 8 plane relative to our implementation of baseline two-point statistics and effectively breaking parameter degeneracies through probe combination. These results demonstrate the potential of SBI analyses powered by deep learning for upcoming Stage-IV wide-field imaging surveys.

Thomsen, A. [Zurich, ETH] (ORCID:0000000203099021)↗
DOE OSTI2024

ZMPY3D: accelerating protein structure volume analysis through vectorized 3D Zernike moments and Python-based GPU integration

Abstract Motivation Volumetric 3D object analyses are being applied in research fields such as structural bioinformatics, biophysics, and structural biology, with potential integration of artificial intelligence/machine learning (AI/ML) techniques. One such method, 3D Zernike moments, has proven valuable in analyzing protein structures (e.g., protein fold classification, protein–protein interaction analysis, and molecular dynamics simulations). Their compactness and efficiency make them amenable to large-scale analyses. Established methods for deriving 3D Zernike moments, however, can be inefficient, particularly when higher order terms are required, hindering broader applications. As the volume of experimental and computationally-predicted protein structure information continues to increase, structural biology has become a “big data” science requiring more efficient analysis tools. Results This application note presents a Python-based software package, ZMPY3D, to accelerate computation of 3D Zernike moments by vectorizing the mathematical formulae and using graphical processing units (GPUs). The package offers popular GPU-supported libraries such as CuPy and TensorFlow together with NumPy implementations, aiming to improve computational efficiency, adaptability, and flexibility in future algorithm development. The ZMPY3D package can be installed via PyPI, and the source code is available from GitHub. Volumetric-based protein 3D structural similarity scores and transform matrix of superposition functionalities have both been implemented, creating a powerful computational tool that will allow the research community to amalgamate 3D Zernike moments with existing AI/ML tools, to advance research and education in protein structure bioinformatics. Availability and implementation ZMPY3D, implemented in Python, is available on GitHub (https://github.com/tawssie/ZMPY3D) and PyPI, released under the GPL License.

Lai, Jhih-Siang (ORCID:0000000156775890)↗
DOE OSTI2020

Toward large-scale simulation of residual stress and distortion in wire and arc additive manufacturing

In this study, we aim to advance the structural analysis of wire and arc additive manufacturing (WAAM) by considering the thermomechanical features inherent in direct energy deposition. Simulation approaches including the iterative substructure method (ISM), dynamic mesh refining method (DMRM), and graphics processing unit (GPU) based explicit finite element method (FEM) were developed for accelerating additive manufacturing stress analysis that is very time consuming by conventional numerical methods. ISM and DMRM take advantage of the strong nonlinearity phenomenon near the moving heat source by reducing the global iterations and refining the local mesh, respectively. In addition to the use of GPUs, the explicit FEM is accelerated by a time scaling technique based on the inherent strain concept. The residual stress and distortion of two large builds were analyzed, showing very consistent numerical results and good agreement with experiments. Compared with the commercial software Abaqus, the novel approaches reduced the computational cost substantially without compromising accuracy. The GPU code showed the highest computational efficiency (30~70×), while DMRM and ISM had acceleration factors of 9× and 3×, respectively. Finally, such high-fidelity modeling approaches will be very useful for building up a digital twin of WAAM to reduce development time and cost.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Data-driven enhancement of coherent structure-based models for predicting instantaneous wall turbulence

Predictions of the spatial representation of instantaneous wall-bounded flows, via coherent structure-based models, are highly sensitive to the geometry of the representative structures employed by them. In this study, we propose a methodology to extract the three-dimensional (3-D) geometry of the statistically significant eddies from multi-point wall-turbulence datasets, for direct implementation into these models to improve their predictions. The methodology is employed here for reconstructing a 3-D statistical picture of the inertial wall coherent turbulence for all canonical wall-bounded flows, across a decade of friction Reynolds number (Re T ). These structures are responsible for the Re T -dependence of the skin-friction drag and also facilitate the inner-outer interactions, making them key targets of structure-based models. The empirical analysis brings out the geometric self-similarity of the large-scale wall-coherent motions and also suggests the hairpin packet as the representative flow structure for all wall-bounded flows, thereby aligning with the framework on which the attached eddy model (AEM) is based. The same framework is extended here to also model the very-large-scaled motions, with a consideration of their differences in internal versus external flows. Implementation of the empirically-obtained geometric scalings for these large structures into the AEM is shown to enhance the instantaneous flow predictions for all three velocity components. Finally, an active flow control system driven by the same geometric scalings is conceptualized, towards favourably altering the influence of the wall coherent motions on the skin-friction drag.

42 ENGINEERING↗
DOE OSTI2022

Long-time simulations for fixed input states on quantum hardware

Publicly accessible quantum computers open the exciting possibility of experimental dynamical quantum simulations. While rapidly improving, current devices have short coherence times, restricting the viable circuit depth. Despite these limitations, we demonstrate long-time, high fidelity simulations on current hardware. Specifically, we simulate an XY-model spin chain on Rigetti and IBM quantum computers, maintaining a fidelity over 0.9 for 150 times longer than is possible using the iterated Trotter method. Our simulations use an algorithm we call fixed state Variational Fast Forwarding (fsVFF). Recent work has shown an approximate diagonalization of a short time evolution unitary allows a fixed-depth simulation. fsVFF substantially reduces the required resources by only diagonalizing the energy subspace spanned by the initial state, rather than over the total Hilbert space. We further demonstrate the viability of fsVFF through large numerical simulations, and provide an analysis of the noise resilience and scaling of simulation errors.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Production Operations Management System (POMS) for Fermilab Experiments

The Production Operations Management System (POMS) software allows production teams and analysis groups across multiple Fermilab experiments to launch, modify and monitor large scale campaigns of related Monte Carlo or data processing jobs, and currently manages the majority of production computing of experiments at Fermilab.POMS provides a web service interface that enables automated job submission on distributed resources according to customers’ requests, as well as subsequent monitoring of those submissions as well as recovery of failed submissions, debugging and record keeping.POMS interfaces with existing HEP data access, processing, movement and monitoring tools at Fermilab, including Jobsub (for job submission), SAM (for data management), and Landscape (for monitoring), and in combination with them handles the creation of intermediate datasets of files for multistage campaigns.POMS visualizes these campaigns with an interactive GUI interface. An important feature of POMS is a one-to-one connection between the GUI campaign visualizer and a text based representation of the complete campaign configuration. An extensible library of template campaign configurations is available. The templates are user modifiable and map cleanly to and from the GUI description of the campaign.This paper will discuss the current usage, history, and some technical details of POMS, as well as planned future extensions, particularly interfacing with Rucio as well as SAM for file movement.

Mengel, Marc↗
DOE OSTI2024

Large-Scale CO2 Storage and Reservoir Management Strategies: Case Studies

This poster describes large-scale CO2 storage and reservoir management case studies for presentation at the AGU2024 conference. The analysis in this study provides a wealth of details on the designs and strategies that can lead to an optimal solution for pressure and CO2 plume management under critical constraints. These findings not only promise a reduction in the CO2 storage footprint but also hold the potential to create a more environmentally friendly ecosystem. Furthermore, this research offers valuable insights into the decision-making process when considering multi-project deployment in a shared basin for large-scale and gigatons of CO2 storage, paving the way for a more sustainable future. Poster presented (virtual) at the 2024 AGU Conference, December 9-13, 2024, Washington, D.C.

Liu, Guoxiang [NETL]↗
DOE OSTI2020

The completed SDSS-IV extended Baryon Oscillation Spectroscopic Survey: N -body mock challenge for the quasar sample

ABSTRACT The growth rate and expansion history of the Universe can be measured from large galaxy redshift surveys using the Alcock–Paczynski effect. We validate the Redshift Space Distortion models used in the final analysis of the Sloan Digital Sky Survey (SDSS) extended Baryon Oscillation Spectroscopic Survey (eBOSS) Data Release 16 quasar clustering sample, in configuration and Fourier space, using a series of halo occupation distribution mock catalogues generated using the OuterRim N-body simulation. We test three models on a series of non-blind mocks, in the OuterRim cosmology, and blind mocks, which have been rescaled to new cosmologies, and investigate the effects of redshift smearing and catastrophic redshifts. We find that for the non-blind mocks, the models are able to recover fσ8 to within 3 per cent and α∥ and α⊥ to within 1 per cent. The scatter in the measurements is larger for the blind mocks, due to the assumption of an incorrect fiducial cosmology. From this mock challenge, we find that all three models perform well, with similar systematic errors on fσ8, α∥, and α⊥ at the level of $\sigma _{f\sigma _8}=0.013$, $\sigma _{\alpha _\parallel }=0.012$, and $\sigma _{\alpha _\bot }=0.008$. The systematic error on the combined consensus is $\sigma _{f\sigma _8}=0.011$, $\sigma _{\alpha _\parallel }=0.008$, and $\sigma _{\alpha _\bot }=0.005$, which is used in the final DR16 analysis. For baryon acoustic oscillation fits in configuration and Fourier space, we take conservative systematic errors of $\sigma _{\alpha _\parallel }=0.010$ and $\sigma _{\alpha _\bot }=0.007$.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Simulating ice-shelf extent using damage mechanics

Abstract Inaccurate representations of iceberg calving from ice shelves are a large source of uncertainty in mass-loss projections from the Antarctic ice sheet. Here, we address this limitation by implementing and testing a continuum damage-mechanics model in a continental scale ice-sheet model. The damage-mechanics formulation, based on a linear stability analysis and subsequent long-wavelength approximation of crevasses that evolve in a viscous medium, links damage evolution to climate forcing and the large-scale stresses within an ice shelf. We incorporate this model into the BISICLES ice-sheet model and test it by applying it to idealized (1) ice tongues, for which we present analytical solutions and (2) buttressed ice-shelf geometries. Our simulations show that the model reproduces the large disparity in lengths of ice shelves with geometries and melt rates broadly similar to those of four Antarctic ice shelves: Erebus Glacier Tongue (length ~ 13 km), the unembayed portion of Drygalski Ice Tongue (~ 65 km), the Amery Ice Shelf (~ 350 km) and the Ross Ice Shelf (~ 500 km). These results demonstrate that our simple continuum model holds promise for constraining realistic ice-shelf extents in large-scale ice-sheet models in a computationally tractable manner.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Radiation effects on stress evolution and dimensional stability of large fusion energy structures

Here we assess the effects of neutron irradiation on the deformation and stress evolution of large-scale fusion energy structures. This is accomplished through non-linear finite element structural analysis of the coupled thermal and mechanical fields at the Beginning-Of-Life (BOL), at 45 dpa, and at 90 dpa. Radiation effects include volumetric swelling and the influence of radiation on the mechanical properties. The system studied here is a large section of a full inboard module of an integrated structure comprising the First Wall and Blanket (FW/B) of a Dual Cooled Lithium-Lead (DCLL) energy conversion unit in the Fusion Nuclear Science Facility (FNSF). The structural material is the ferritic/martensitic steel F82H. We analyze several radiation effects phenomena that can lead to significant impact on the mechanical design and lifetime of the structure. These include volumetric swelling effects on the assembly and disassembly of modules and the impact of spatial gradients in neutron damage and helium generation on deformation, stress evolution, and plastic strain accumulation. We show that the stress state is strongly influenced by the accumulation of swelling strains, radiation hardening and softening, and by spatial gradients in displacement damage and helium gas generation. Several key regions in the FW/B structure are identified where severe plastic strains accumulate and may be potential sites for failure, especially during cyclic reactor operations. We finally show that minimum gaps between Inboard (IB) blanket sectors must be present during assembly so as to avoid excessive stress and strain in FW/B modules critical regions and raising chances of failure. A range of structural displacements are shown, from as low as 4 mm at BOL for free side walls to as high as 46 mm at 90 dpa for fully constrained side walls.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2024

Cosmological Constraints from Combining Photometric Galaxy Surveys and Gravitational Wave Observatories

Spatial variations in survey properties due to selection effects generate substantial systematic errors in large-scale structure measurements in optical galaxy surveys on very large scales. On such scales, the statistical sensitivity of optical surveys is also limited by their finite sky coverage. By contrast, gravitational wave (GW) sources appear to be relatively free of these issues, provided the angular sensitivity of GW experiments can be accurately characterized. We quantify the expected cosmological information gain from combining the forecast LSST 3$\times$2pt analysis (combination of three 2-point correlations of galaxy density and weak lensing shear fields) with the large-scale auto-correlation of GW sources from proposed next-generation GW experiments. We find that in $\Lambda$CDM and $w$CDM models, there is no significant improvement in cosmological constraints from combining GW with LSST 3$\times$2pt over LSST alone, due to the large shot noise for the former; however, this combination does enable a $\sim6\%$ constraint on the linear galaxy bias of GW sources. More interestingly, the optical-GW data combination provides tight constraints on models with primordial non-Gaussianity (PNG), due to the predicted scale-dependent bias in PNG models on large scales. Assuming that the largest angular scales that LSST will probe are comparable to those in Stage III surveys ($\ell_{\rm min}\sim50$), the inclusion of next-generation GW measurements could improve constraints on the PNG parameter $f_{\rm NL}$ by up to a factor of $\simeq6.6$ compared to LSST alone, yielding $\sigma(f_{\rm NL})=8.5$. These results assume the expected capability of a network of Einstein Telescope-like GW observatories, with a detection rate of $10^6$ events/year. We investigate the sensitivity of our results to different assumptions about future GW detectors as well as different LSST analysis choices.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Convergence of halo statistics: code comparison between rockstar and compaso using scale-free simulations

ABSTRACT In this study, we perform a halo-finder code comparison between rockstar and compaso. Based on our previous analysis aiming at quantifying resolution of N-body simulations by exploiting large (up to N = 40963) simulations of scale-free cosmologies run using abacus, we focus on convergence of the halo mass function, two-point correlation function, and mean radial pairwise velocities of halo centres selected with the aforementioned two algorithms. We establish convergence, for both rockstar and compaso, of mass functions at the 1 per cent precision level and of the mean pairwise velocities (and also two-point correlation function) at the 2 per cent level. At small scales and masses, we find that rockstar exhibits greater self-similarity. We also highlight the role played by the merger-tree post-processing of compaso haloes on their convergence. Finally, we give resolution limits expressed as a minimum particle number per halo in a form that can be directly extrapolated to Lambda cold dark matter.

Astronomy & Astrophysics↗