Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “large scale analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 523 records · Page 29
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

From Simple Labels to Time-Use Integrations: Supporting the Spectrum of Qualitative Travel Behavior Data

In transportation research, applications of travel behavior data collection are context-specific and require different types of qualitative inputs. These inputs can be viewed as spanning a spectrum of user burden and data quality, from simple trip labels to complex time-use surveys. However, each currently active smartphone-based travel diary platform appears to only support one type of qualitative input, and the effort required for customization is unclear. In this paper, we characterize the spectrum by defining four canonical use cases: (i) trip labels, (ii) trip questionnaire, (iii) counterfactual trips, and (iv) time-use surveys. We then outline a mechanism for supporting configurable user inputs on the same underlying smartphone-based sensing mechanism and demonstrate that it can support all the use cases without any code changes. We further demonstrate that the flexible data model that underpins this mechanism can enable real-time monitoring and analysis. Finally, we evaluate per-user data collection and engagement metrics for large-scale deployments of three canonical use cases, spanning 10 programs, 435 users, and 251,041 trips, and a maximum duration of 800 days. Future efforts may support additional use cases through an expanded configuration and provide greater insight into user engagement. We hope that these insights enable the research community to look at qualitative inputs through a new lens and experiment with novel use cases to fill in the spectrum.

ADVANCED PROPULSION SYSTEMS,POWER TRANSMISSION AND↗
DOE OSTI2020

Potential Impacts of Assimilating All-sky Satellite Infrared Radiances on Convection-Permitting Analysis and Prediction of Tropical Convection

Geostationary infrared satellite observations are spatially dense [< 1/(20 km)2] and temporally frequent (< 1/hour). These suggest the possibility of using these observations to constrain sub-synoptic features over data sparse regions, such as tropical oceans. In this study, the potential impacts of assimilating water vapor channel brightness temperature (WV-BT) observations from the geostationary Meteorological Satellite 7 (Meteosat-7) on tropical convection analysis and prediction were systematically examined through a series of ensemble data assimilation experiments. WV-BT observations were assimilated hourly into convection-permitting ensembles using Penn State’s ensemble square root filter (EnSRF). Comparisons against independently observed Meteosat-7 window channel brightness temperature (Window-BT) show that the assimilation of WV-BT generally improved the intensities and locations of large-scale cloud patterns at spatial scales larger than 100 km. However, comparisons against independent soundings indicate that the EnSRF analysis produced a much stronger dry bias than the no data assimilation experiment. This strong dry bias is associated with the use of the simulated WV-BT from the prior mean during the EnSRF analysis step. A stochastic variant of the ensemble Kalman filter (NoMeanSF) is proposed. The NoMeanSF algorithm was able to assimilate the WV-BT without causing such a strong dry bias and the quality of the analyses’ horizontal cloud pattern is similar to EnSRF’s analyses. Finally, deterministic forecasts initiated from the NoMeanSF analyses possess better horizontal cloud patterns above 500 km than those of the EnSRF. These results suggest that it might be better to assimilate all-sky WV-BT through the NoMeanSF algorithm than EnSRF algorithm.

Chan, Man-Yau↗
DOE OSTI2020

Machine Learning for Distributed Acoustic Sensing data (MLDAS) v1.0.1

MLDAS is a Python-written package for exploratory data analysis and deep learning training on Distributed Acoustic Sensing data. The machine learning tools are powered by the PyTorch library and designed to work efficiently on large scale datasets using parallel computing. Various SLURM scripts as well as a tutorial have also been made available to allow geophysicists to quickly and easily implement the available tools in their analysis workflow on supercomputer facilities.

Dumont, Vincent↗
DOE OSTI2022

Accuracy of power spectra in dissipationless cosmological simulations

Abstract We exploit a suite of large N-body simulations (up to N = 40963) performed with abacus, of scale-free models with a range of spectral indices n, to better understand and quantify convergence of the matter power spectrum. Using self-similarity to identify converged regions, we show that the maximal wavenumber resolved at a given level of accuracy increases monotonically as a function of time. At 1 per cent level it starts at early times from a fraction of $k_\Lambda$, the Nyquist wavenumber of the initial grid, and reaches at most, if the force softening is sufficiently small, ${\sim}2{-}3 k_\Lambda$ at the very latest times we evolve to. At the $5{{\ \rm per\ cent}}$ level, accuracy extends up to wavenumbers of order $5k_\Lambda$ at late times. Expressed as a suitable function of the scale-factor, accuracy shows a very simple n-dependence, allowing a extrapolation to place conservative bounds on the accuracy of N-body simulations of non-scale-free models like LCDM. We note that deviations due to discretization in the converged range are not well modelled by shot noise, and subtracting it in fact degrades accuracy. Quantitatively our findings are broadly in line with the conservative assumptions about resolution adopted by recent studies using large cosmological simulations (e.g. Euclid Flagship) aiming to constrain the mildly non-linear regime. On the other hand, we remark that conclusions about small-scale clustering (e.g. concerning the validity of stable clustering) obtained using PS data at wavenumbers larger than a few $k_\Lambda$ may need revision in light of our convergence analysis.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Large-scale atomistic model construction of subbituminous and bituminous coals for solvent extraction simulations with reactive molecular dynamics

Large-scale atomistic models for complex polycyclic aromatic hydrocarbon systems help understand the chemical properties and behaviors of complex feedstocks such as coal or petroleum. However, the development and utilization of large-scale models remain limited due to the difficulty in achieving the varied structural characteristics necessary to capture stochastic nature of these feedstocks. Here we demonstrate a systematic workflow to construct stochastic molecular systems from a broad analytical suite: high-resolution transmission electron microscopy (HRTEM), carbon-13 nuclear magnetic resonance spectroscopy ( 13 C NMR), laser desorption ionization mass spectroscopy (LDI-MS), and elemental analysis. We present a model construction and analysis utility of a new Python-based module. We selected one subbituminous and three high-volatile bituminous coals to construct large-scale models (~40,000 atoms). The constructed models were utilized to examine the affinity for solvent extraction (naphthalene or tetralin) and the effect of structural properties (e.g., aromatic cluster size, functional groups, and cross-linking) in reactive molecular dynamics simulations. Complex chemical reactions were monitored with bond order transitions, intermediates formation, and mass distributions. Reactive molecular dynamics simulations suggest a plausible chemical extraction process and products for the complex fossil feedstocks. The results indicated that radical formations with bond breaking of bridging oxygens and carbons were required at high temperatures to facilitate hydrogeneration and extraction of gas molecules from radical-free molecules. We observed that aliphatic chains of tetralin were easily decomposed and combined with radicals to form small size of molecules with aryl bonding, mainly increasing molecules in the 500–1000 Da, while naphthalene had little impact on chemical extraction process.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

Enabling AI-Accelerated Multiscale Modeling of Thrombogenesis at Millisecond and Molecular Resolutions on Supercomputers

We report the first congruent integration of HPC, AI, and multiscale modeling (MSM) for solving a mainstream biomechanical problem of thrombogenesis involving 6 million particles at record molecular-scale resolutions in space and at simulation rates of milliseconds per day. The two supercomputers, the IBM Summit-like AiMOS and our University’s SeaWulf, are used for scalability analysis of, and production runs with, the LAMMPS with our customization and AI augmentation and they attained optimal simulation speeds of 3,077 µs/day and 266 µs/day respectively. The long-time and large scales simulations enable the first study of the integrated platelet flowing, flipping, aggregating dynamics in one dynamically-coupled production run. The platelets’ angular and translational speeds, membrane particles’ speeds, and the membrane stress distributions are presented for the analysis of platelets’ aggregations.

Zhu, Yicong↗
DOE OSTI2026

Regression Analysis with the Directed Infusion of Data

Integrating artificial intelligence and machine learning tools into industry necessitates large-scale collaborative efforts that ensure the robust and accurate execution of downstream analytics such as time series prediction, uncertainty quantification, grid optimization, and condition monitoring. However, concerns related to data privacy pervade the nuclear industry due to the proprietary nature of its data and the possibility of data leakage. Legacy techniques such as encryption often require the explicit transmission of data to trustworthy parties, thereby inviting data leakage concerns. The ideal collaboration scenario avoids the explicit dissemination of data/code while maintaining experimental fidelity, which is currently accomplished using various techniques such as trusted execution environments, homomorphic encryption, differential privacy, and multimatrix masking. These techniques, however, often necessitate a trade-off between trust, efficiency, and utility. This article extends a previously proposed technique called the directed infusion of data (DIOD) that ensures data privacy, allows for scalable obfuscation, and combats the risk of data leakage without compromising utility. The experiments discussed in this article examine a regression-type scenario using DIOD with the goal of preserving the inferential link between two variables. Using the point-kinetics equations, regression experiments compare the performance of a model trained using the original data to that of a model trained using the obfuscated data, which produced identical results. Our claim is further strengthened by an information theoretic proof and experiment, which showed that the inferential content between variables remains the same after obfuscation, thereby avoiding the required communication of the proprietary data.

47 - OTHER INSTRUMENTATION↗
DOE OSTI2024

Comparative Analysis of Cosmological Simulations via Angular Power Spectra

Cosmology is the study of the universe's origin, large-scale structure, and dynamics. One such area of study is understanding dark energy and dark matter. Dark matter has not been observed to interact with luminous matter other than through gravitational attractions, forming large scale structures observed throughout the universe. In this area, the primary model is the Lambda Cold Dark Matter (ΛCDM) model. This standard model consists of cosmological dark energy (Λ), cold dark matter (CDM), and normal luminous matter. We use angular power spectra (APS) to compare simulated ΛCDM models with observed large-scale galaxy distributions from the DECam Local Volume Exploration Survey (DELVE) [1]. After ensuring that the simulations can produce APS that match observational results, we vary cosmological parameters to constrain the allowed ranges of parameter values that are consistent with the observed data.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Comparative analysis of cosmological simulations via angular power spectra

Cosmology is the study of the universe's origin, large-scale structure, and dynamics. One such area of study is understanding dark energy and dark matter. Dark matter has not been observed to interact with luminous matter other than through gravitational attractions, forming large scale structures observed throughout the universe. In this area, the primary model is the Lambda Cold Dark Matter (ΛCDM) model. This standard model consists of cosmological dark energy (Λ), cold dark matter (CDM), and normal luminous matter. We use Angular Power Spectra (APS) to compare simulated ΛCDM models with observed large-scale galaxy distributions from the DECam Local Volume Exploration Survey (DELVE). After ensuring that the simulations can produce APS which match observational results, we vary cosmological parameters to constrain the allowed ranges of parameter values that are consistent with the observed data.

Feithen, William↗
DOE OSTI2026

Risk-Aware Measurement Synchronization and Recovery for DSSE With Heterogeneous Data Sources

Power distribution systems are increasingly integrating heterogeneous sensors with varying data reporting rates and types, which pose challenges to achieving observability at the desired temporal resolution of distribution system state estimation (DSSE). Multisensor failures caused by extreme events exacerbate these issues, introducing substantial uncertainties into DSSE. This article proposes a novel solution to these challenges by ensuring high-resolution system observability despite heterogeneous data sources and multisensor failures. First, a deep learning architecture combining long short-term memory (LSTM) and graph convolutional network (GCN) is employed to synchronize meters with different reporting rates, aiming to achieve system observability. A random-walk-model-based approach is introduced to generate pseudo-measurements while properly characterizing their uncertainties under multisensor failures. Finally, a disaster-risk-informed observability metric (RiOM) is defined to quantify the uncertainty associated with state estimation results. The proposed framework offers deeper insights into the system observability on the fly compared with conventional analysis. The effectiveness of the framework is demonstrated on an IEEE standard test case and a large-scale real-world distribution feeder in mid-Minnesota in the U.S.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

A Comprehensive Analysis of Real-World Accelerometer Data Quality in a Global Smartphone-based Seismic Network

The proliferation of low-cost sensors in smartphones has facilitated numerous applications; however, large-scale deployments often encounter performance issues. Sensing heterogeneity, which refers to varying data quality due to factors such as device differences and user behaviors, presents a significant challenge. In this research, we perform an extensive analysis of 3-axis accelerometer data from the MyShake system, a global seismic network utilizing smartphones. We systematically evaluate the quality of approximately 22 million 3-axis acceleration waveforms from over 81 thousand smartphone devices worldwide, using metrics that represent sampling rate and noise level. We explore a broad range of factors influencing accelerometer data quality, including smartphone and accelerometer manufacturers, phone specifications (release year, RAM, battery), geolocation, and time. Our findings indicate that multiple factors affect data quality, with accelerometer model and smartphone specifications being the most critical. In addition, we examine the influence of data quality on earthquake parameter estimation and show that removing low-quality accelerometer data enhances the accuracy of earthquake magnitude estimation.

58 GEOSCIENCES↗
DOE OSTI2024

Parametric description of intermittent probability distribution functions in solar wind and magnetohydrodynamic turbulence

ABSTRACT In this work, we find empirical evidence that the scale-dependent statistical properties of solar wind and magnetohydrodynamic (MHD) turbulence can be described in terms of a family of parametric probability distribution functions (PDFs) known as Normal Inverse Gaussian (NIG). Understanding these PDFs is one of the most important goals in turbulence theory, as they are inherently connected to the intermittent properties of solar wind turbulence. We investigate the properties of PDFs of Elsasser increments based on a large statistical sample from solar wind observations and high-resolution numerical simulations of MHD turbulence. In order to measure the PDFs and their corresponding properties, three experiments are presented: fast and slow solar wind for experimental data and a simulation of reduced MHD (RMHD) turbulence. Conditional statistics on a 23-yr-long sample of WIND data near 1 au and high-resolution pseudo-spectral simulation of steadily driven RMHD turbulence on a $2048^3$ mesh are used to construct scale-dependent PDFs. The empirical PDFs are fitted to NIG distributions, which depend on four free parameters. Our analysis shows that NIG distributions accurately capture the evolution of the PDFs, with scale-dependent parameters, from large scales characterized by a Gaussian distribution, turning to exponential tails within the inertial range and stretched exponentials at dissipative scales. We also show that empirically-measured NIG parameters exhibit well-defined scaling properties that are similar across the three empirical data sets, which may be indicative of universal behaviour.

Astronomy & Astrophysics↗
DOE OSTI2022

Scaled Vecchia Approximation for Fast Computer-Model Emulation

Many scientific phenomena are studied using computer experiments consisting of multiple runs of a computer model while varying the input settings. Gaussian processes (GPs) are a popular tool for the analysis of computer experiments, enabling interpolation between input settings, but direct GP inference is computationally infeasible for large datasets. We adapt and extend a powerful class of GP methods from spatial statistics to enable the scalable analysis and emulation of large computer experiments. Specifically, we apply Vecchia’s ordered conditional approximation in a transformed input space, with each input scaled according to how strongly it relates to the computer-model response. The scaling is learned from the data by estimating parameters in the GP covariance function using Fisher scoring. Our methods are highly scalable, enabling estimation, joint prediction, and simulation in near-linear time in the number of model runs. In several numerical examples, our approach substantially outperformed existing methods.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Cosmological Constraints on Secluded Dark Radiation

Dark radiation (DR) is ubiquitous in physics beyond the Standard Model (SM), and its interactions with the SM and dark matter (DM) lead to a variety of interesting effects on cosmological observables. However, even in scenarios where DR is 'secluded', i.e., only gravitationally interacting with SM and DM, it can leave discernible signatures. We present a comprehensive study of four different types of DR: free-streaming, self-interacting (coupled), decoupling, and recoupling DR, and vary initial conditions to include both adiabatic and isocurvature perturbations. In addition to these properties, we also vary neutrino energy density, DR energy density, and the SM neutrino masses to perform a general analysis and study degeneracies among neutrino and DR properties. We derive constraints using the cosmic microwave background, large-scale structure, and supernova datasets. We find no significant preference for physics beyond the $Λ$CDM model, but data exhibit interesting interplays between different physical quantities. When the neutrino energy density is allowed to vary, we find that the cosmological dataset prefers massless free-streaming DR over massive neutrinos, leading to a significant relaxation of the neutrino mass bound. Although we do not find any evidence of DR isocurvature, the data show support for a strong blue tilt of the isocurvature power spectrum. Our analysis also highlights the degeneracy of various DR parameters with the Hubble constant $H_0$ resulting in a mild relaxation of the $H_0$ tension.

Chang, Jae Hyeok [Fermilab; Illinois U., Chicago] ↗
DOE OSTI2024

Mock data sets for the Eboss and DESI Lyman-α forest surveys

We present a publicly-available code to generate sets of mock Lyman-α (Lyα) forest data that have realistic large-scale correlations including those due to the Baryonic Acoustic Oscillations (BAO). The primary purpose of these mocks is to test the analysis procedures of the Extended Baryon Oscillation Survey (eBOSS) and the Dark Energy Spectroscopy Instrument (DESI) surveys. The transmitted flux fraction, F(λ), of background quasars due to Lyα absorption in the intergalactic medium (IGM) is simulated using the Fluctuating Gunn-Petterson Approximation (FGPA) applied to Gaussian random fields produced through the use of fast Fourier transforms (FFT). The output includes the IGM-Lyα transmitted flux fraction along quasar lines of sight and a catalog of high-column-density systems appropriately placed at high-density regions of the IGM. This output serves as input to additional code that superimposes the IGM tranmission on realistic quasar spectra, adds absorption by high-column-density systems and metals, and simulates instrumental transmission and noise. Redshift space distortions (RSD) of the flux correlations are implemented by including the large-scale velocity-gradient field in the FGPA resulting in a correlation function of F(λ) that can be accurately predicted. One hundred realizations have been produced over the 14,000 deg 2 DESI survey footprint with 100 quasars per deg 2 . The analysis of these realizations shows that the correlations of F(λ) follows the prediction within the accuracy of eBOSS survey. Here, the most time-consuming part of the mock production occurs before application of the FGPA, and the existing pre-FGPA forests can be used to easily produce new mock sets with modified redshift-dependent bias parameters or observational conditions.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Genome-scale phylogeny and comparative genomics of the fungal order Sordariales

The order Sordariales is taxonomically diverse, and harbours many species with different lifestyles and large economic importance. Despite its importance, a robust genome-scale phylogeny, and associated comparative genomic analysis of the order is lacking. In this study, we examined whole-genome data from 99 Sordariales, including 52 newly sequenced genomes, and seven outgroup taxa. We inferred a comprehensive phylogeny that resolved several contentious relationships amongst families in the order, and cleared-up intrafamily relationships within the Podosporaceae. Extensive comparative genomics showed that genomes from the three largest families in the dataset (Chaetomiaceae, Podosporaceae and Sordariaceae) differ greatly in GC content, genome size, gene number, repeat percentage, evolutionary rate, and genome content affected by repeat-induced point mutations (RIP). All genomic traits showed phylogenetic signal, and ancestral state reconstruction revealed that the variation of the properties stems primarily from within-family evolution. Together, the results provide a thorough framework for understanding genome evolution in this important group of fungi.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Improving Convection Trigger Functions in Deep Convective Parameterization Schemes Using Machine Learning

Abstract Deficiencies in convection trigger functions, used in deep convection parameterizations in General Circulation Models (GCMs), have critical impacts on climate simulations. A novel convection trigger function is developed using the machine learning (ML) classification model XGBoost. The large‐scale environmental information associated with convective events is obtained from the long‐term constrained variational analysis forcing data from the Atmospheric Radiation Measurement (ARM) program at its Southern Great Plains (SGP) and Manaus (MAO) sites representing, respectively, continental mid‐latitude and tropical convection. The ML trigger is separately trained and evaluated per site, and jointly trained and evaluated at both sites as a unified trigger. The performance of the ML trigger is compared with four convective trigger functions commonly used in GCMs: dilute convective available potential energy (CAPE), undilute CAPE, dilute dynamic CAPE (dCAPE), and undilute dCAPE. The ML trigger substantially outperforms the four CAPE‐based triggers in terms of the F 1 score metric, widely used to estimate the performance of ML methods. The site‐specific ML trigger functions can achieve, respectively, 91% and 93% F 1 scores at SGP and MAO. The unified trigger also has a 91% F 1 score, with virtually no degradation from the site‐specific training, suggesting the potential of a global ML trigger function. The ML trigger alleviates a GCM deficiency regarding the overprediction of convection occurrence, offering a promising improvement to the simulation of the diurnal cycle of precipitation. Furthermore, to overcome the black box issue of the ML methods, insights derived from the ML model are discussed, which may be leveraged to improve traditional CAPE‐based triggers.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Accurate and Efficient Parametric Model-Order Reduction for Turbulent Thermal Transport

This project produced new algorithms and software for low-cost exploration of turbulent thermal-fluids behavior under parametric variation by using reduced-order models (ROMs). The ROMs numerically solve the governing equations for fluid motion by using a small set of basis functions (typically, N=20-200 modes) to represent the solution. The base modes are computed as optimal combinations of solutions from expensive high-fidelity "anchor-point" solutions involving millions of unknowns, which are typically generated by solving the full Navier-Stokes equations on a supercomputer. The ROM solution is itself a combination of the base modes, where the basis coefficients are determined by evolving an NxN system of nonlinear equations. The overarching idea is to use the inexpensive ROM to predict solutions under conditions where the parameters differ from the anchor-point conditions. Several ingredients are required to make ROMs useful for thermal hydraulics analysis. These include: a stable and accurate ROM that is capable of reproducing the large-scale dynamics of turbulent flow, error indicators than can guide the choice of anchor points, and low-cost mechanisms for evaluating nonlinear terms in the reduced equations.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗