Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Functional Data Analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Real‐time XFEL data analysis at SLAC and NERSC: A trial run of nascent exascale experimental data analysis

X‐ray scattering experiments using free electron lasers (XFELs) are a powerful tool to determine the molecular structure and function of unknown samples (such as COVID‐19 viral proteins). XFEL experiments are a challenge to computing in two ways: (i) due to the high cost of running XFELs, a fast turnaround time from data acquisition to data analysis is essential to make informed decisions on experimental protocols; (ii) data‐collection rates are growing exponentially, requiring new scalable algorithms. Here we report our experiences analyzing data from two experiments at the Linac Coherent Light Source (LCLS) during September 2020. Raw data were analyzed on NERSC's Cori XC40 system, using the Superfacility paradigm: our workflow automatically moves raw data between LCLS and NERSC, where it is analyzed using the software package CCTBX. We achieved real time data analysis with a turnaround time from data acquisition to full molecular reconstruction in as little as 10 min—sufficient time for the experiment's operators to make informed decisions. By hosting the data analysis on Cori, and by automating LCLS‐NERSC interoperability, we achieved a data analysis rate which matches the data acquisition rate. Completing data analysis within 10 min is a first for XFEL experiments and an important milestone if we are to keep up with data‐collection trends.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2023

Imaginary-time correlation function thermometry: A new, high-accuracy and model-free temperature analysis technique for x-ray Thomson scattering data

The accurate interpretation of experiments with matter at extreme densities and pressures is a notoriously difficult challenge. In a recent work [Dornheim et al., Nat. Commun. 13, 7911 (2022)], we have introduced a formally exact methodology that allows extracting the temperature of arbitrary complex materials without any model assumptions or simulations. Here, we provide a more detailed introduction to this approach and analyze the impact of experimental noise on the extracted temperatures. In particular, we extensively apply our method both to synthetic scattering data and to previous experimental measurements over a broad range of temperatures and wave numbers. We expect that our approach will be of high interest to a gamut of applications, including inertial confinement fusion, laboratory astrophysics, and the compilation of highly accurate equation-of-state databases.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2024

Operando pair distribution function analysis of nanocrystalline functional materials: the case of TiO 2 -bronze nanocrystals in Li-ion battery electrodes

Structural modelling of operando pair distribution function (PDF) data of complex functional materials can be highly challenging. To aid the understanding of complex operando PDF data, this article demonstrates a toolbox for PDF analysis. The tools include denoising using principal component analysis together with the structureMining , similarityMapping and nmfMapping apps available through the online service `PDF in the cloud' ( PDFitc , https://pdfitc.org/). The toolbox is used for both ex situ and operando PDF data for 3 nm TiO 2 -bronze nanocrystals, which function as the active electrode material in a Li-ion battery. The tools enable structural modelling of the ex situ and operando PDF data, revealing two pristine TiO 2 phases (bronze and anatase) and two lithiated Li x TiO 2 phases (lithiated versions of bronze and anatase), and the phase evolution during galvanostatic cycling is characterized.

Chemistry↗
DOE OSTI2024

Visualizing metagenomic and metatranscriptomic data: A comprehensive review

The fields of Metagenomics and Metatranscriptomics involve the examination of complete nucleotide sequences, gene identification, and analysis of potential biological functions within diverse organisms or environmental samples. Despite the vast opportunities for discovery in metagenomics, the sheer volume and complexity of sequence data often present challenges in processing analysis and visualization. This article highlights the critical role of advanced visualization tools in enabling effective exploration, querying, and analysis of these complex datasets. Emphasizing the importance of accessibility, the article categorizes various visualizers based on their intended applications and highlights their utility in empowering bioinformaticians and non-bioinformaticians to interpret and derive insights from meta-omics data effectively.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

New constraints on cosmological modified gravity theories from anisotropic three-point correlation functions of BOSS DR12 galaxies

Here we report a new test of modified gravity theories using the large-scale structure of the Universe. This paper is the first attempt to (1) apply a joint analysis of the anisotropic components of galaxy two- and three-point correlation functions (2 and 3PCFs) to actual galaxy data and (2) constrain the non-linear effects of degenerate higher-order scalar-tensor (DHOST) theories on cosmological scales. Applying this analysis to the Baryon Oscillation Spectroscopic Survey (BOSS) data release 12, we obtain the lower bounds of –1.655 < ξ t and –0.504 < ξ s at the $95{{\ \rm per\ cent}}$ confidence level on the parameters characterizing the time evolution of the tidal and shift terms of the second-order velocity field. These constraints are consistent with GR predictions of ξ t = 15/1144 and ξs = 0. Moreover, they represent a 35-fold and 20-fold improvement, respectively, over the joint analysis with only the isotropic 3PCF. We ensure the validity of our results by investigating various quantities, including theoretical models of the 3PCF, window function corrections, cumulative S/N, Fisher matrices, and statistical scattering effects of mock simulation data. We also find statistically significant discrepancies between the BOSS data and the Patchy mocks for the 3PCF measurement. Finally, we package all of our 3PCF analysis codes under the name hitomi and make them publicly available so that readers can reproduce all the results of this paper and easily apply them to ongoing future galaxy surveys.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Real-Time XFEL Data Analysis at SLAC and NERSC: a Trial Run of Nascent Exascale Experimental Data Analysis

X-ray scattering experiments using Free Electron Lasers (XFELs) are a powerful tool to determine the molecular structure and function of unknown samples (such as COVID-19 viral proteins). XFEL experiments are a challenge to computing in two ways: i) due to the high cost of running XFELs, a fast turnaround time from data acquisition to data analysis is essential to make informed decisions on experimental protocols; ii) data collection rates are growing exponentially, requiring new scalable algorithms. Here we report our experiences analyzing data from two experiments at the Linac Coherent Light Source (LCLS) during September 2020. Raw data were analyzed on NERSC's Cori XC40 system, using the Superfacility paradigm: our workflow automatically moves raw data between LCLS and NERSC, where it is analyzed using the software package CCTBX. We achieved real time data analysis with a turnaround time from data acquisition to full molecular reconstruction in as little as 10 min -- sufficient time for the experiment's operators to make informed decisions. By hosting the data analysis on Cori, and by automating LCLS-NERSC interoperability, we achieved a data analysis rate which matches the data acquisition rate. Furthermore, completing data analysis with 10 mins is a first for XFEL experiments and an important milestone if we are to keep up with data collection trends.

Blaschke, Johannes P.↗
DOE OSTI2025

Uncertainty Visualization of Critical Points of 2D Scalar Fields for Parametric and Nonparametric Probabilistic Models

This paper presents a novel end-to-end framework for closed-form computation and visualization of critical point uncertainty in 2D uncertain scalar fields. Critical points are fundamental topological descriptors used in the visualization and analysis of scalar fields. The uncertainty inherent in data (e.g., observational and experimental data, approximations in simulations, and compression), however, creates uncertainty regarding critical point positions. Uncertainty in critical point positions, therefore, cannot be ignored, given their impact on downstream data analysis tasks. Here, in this work, we study uncertainty in critical points as a function of uncertainty in data modeled with probability distributions. Although Monte Carlo (MC) sampling techniques have been used in prior studies to quantify critical point uncertainty, they are often expensive and are infrequently used in production-quality visualization software. We, therefore, propose a new end-to-end framework to address these challenges that comprises a threefold contribution. First, we derive the critical point uncertainty in closed form, which is more accurate and efficient than the conventional MC sampling methods. Specifically, we provide the closed-form and semianalytical (a mix of closed-form and MC methods) solutions for parametric (e.g., uniform, Epanechnikov) and nonparametric models (e.g., histograms) with finite support. Second, we accelerate critical point probability computations using a parallel implementation with the VTK-m library, which is platform portable. Finally, we demonstrate the integration of our implementation with the ParaView software system to demonstrate near-real-time results for real datasets.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Multiscale spatial analysis of fracture arrangement and pattern reconstruction using Ripley's K-function

This work presents novel multiscale spatial data analytics using Ripley's K-function, as a measure of spatial interaction, to study one-dimensional arrangement of fractures. Fracture spatial arrangements are classified into clustered, anticlustered, or indistinguishable from random by testing statistical significance of the calculated Ripley's K-function. Characterizations of fracture arrangements are performed as a function of length scale and position. Analysis of the K-function along the study interval identifies where fracture clustering and anticlustering occur. Here, a simulation technique is also introduced here to statistically reconstruct spatial arrangements and to generate fracture realizations that are spatially similar to the fractures observed in the field. With this simulation technique, one can also fill spatial gaps in fracture measurements where data are absent, unreliable, or unused. Synthetic as well as field-measured 1D fracture datasets are used for testing and demonstration. Methods introduced in this work can be readily applied to fracture datasets observed in outcrops, borehole image logs, and cores.

58 GEOSCIENCES↗
DOE OSTI2025

DESI DR1 Ly$α$ forest: 3D full-shape analysis and cosmological constraints

We perform an analysis of the full shapes of Lyman-$α$ (Ly$α$) forest correlation functions measured from the first data release (DR1) of the Dark Energy Spectroscopic Instrument (DESI). Our analysis focuses on measuring the Alcock-Paczynski (AP) effect and the cosmic growth rate times the amplitude of matter fluctuations in spheres of $8$$h^{-1}\text{Mpc}$, $fσ_8$. We validate our measurements using two different sets of mocks, a series of data splits, and a large set of analysis variations, which were first performed blinded. Our analysis constrains the ratio $D_M/D_H(z_\mathrm{eff})=4.525\pm0.071$, where $D_H=c/H(z)$ is the Hubble distance, $D_M$ is the transverse comoving distance, and the effective redshift is $z_\mathrm{eff}=2.33$. This is a factor of $2.4$ tighter than the Baryon Acoustic Oscillation (BAO) constraint from the same data. When combining with Ly$α$ BAO constraints from DESI DR2, we obtain the ratios $D_H(z_\mathrm{eff})/r_d=8.646\pm0.077$ and $D_M(z_\mathrm{eff})/r_d=38.90\pm0.38$, where $r_d$ is the sound horizon at the drag epoch. We also measure $fσ_8(z_\mathrm{eff}) = 0.37\; ^{+0.055}_{-0.065} \,(\mathrm{stat})\, \pm 0.033 \,(\mathrm{sys})$, but we do not use it for cosmological inference due to difficulties in its validation with mocks. In $Λ$CDM, our measurements are consistent with both cosmic microwave background (CMB) and galaxy clustering constraints. Using a nucleosynthesis prior but no CMB anisotropy information, we measure the Hubble constant to be $H_0 = 68.3\pm 1.6\;\,{\rm km\,s^{-1}\,Mpc^{-1}}$ within $Λ$CDM. Finally, we show that Ly$α$ forest AP measurements can help improve constraints on the dark energy equation of state, and are expected to play an important role in upcoming DESI analyses.

Cuceu, Andrei [LBL, Berkeley; Chicago U., KICP] (O↗
DOE OSTI2020

Updates on LANL AM Data Analysis

The NMF k algorithm results in strong classification scores and informative basis functions to describe the spectra associated with pore formation.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗
DOE OSTI2023

Quantification of spatial and seasonal trends in the atmosphere and construction of statistical models for infrasonic propagation

SUMMARY Infrasonic waves are influenced by variations in the density, pressure and temperature as well as the ambient winds. Modelling infrasonic propagation can be challenging due to the dynamic nature of the atmosphere as well as the sparseness of measurements which result in variability and notable uncertainty. A framework is presented to quantify spatial and seasonal trends in atmospheric structure via analysis of the effective sound speed profile and identification of temporal trends in the middle atmospheric waveguide produced by the circumpolar vortex winds. Seasonal definitions identifying typical atmospheric structures during the summer, winter and spring/fall transition periods are identified using atmospheric data from 2010 through 2020. Seasonal trend analysis is conducted for a number of locations across the contiguous United States to quantify spatial variations in atmospheric structure that impact infrasonic propagation. For each season and location, empirical orthogonal function analysis is used to reduce the historical archive of atmospheric data into a smaller representative set that can be analysed using numerical tools more efficiently. Infrasonic ray tracing and finite-frequency modal propagation analyses are applied to construct propagation path geometry and transmission loss statistics which are useful in localization and yield estimation for infrasonic sources, respectively. An example application is detailed in which transmission loss statistics are combined with an explosive source model and noise statistics to quantify the capability of a network to detect nearby sources.

58 GEOSCIENCES↗
DOE OSTI2020

XRF-MAPS

x-ray fluorescence (XRF) imaging typically involves the creation and analysis of 3D data sets, where at each scan position a full energy dispersive x-ray spectrum is recorded. This allows one to later process the data in a variety of different approaches, e.g., by spectral region of interest (ROI) summation with or without background subtraction, principal component analysis, or fitting. XRF-Maps is a C++ open source software package that implements these functions to provide a tool set for the analysis of XRF data sets.

GLOWACKI, ARTHURT↗
DOE OSTI2023

GSAS-II (GENERAL STRUCTURE AND ALAYSIS SYSTEM-II)

GSAS-II is a comprehensive data analysis and simulation software package for determining atomistic structures from single-crystal and powder diffraction data. X-ray, neutron and electron data may be used. Constant-wavelength, time-of-flight and pink-beam sources may be employed and analyses may combine different types of data. The package is oriented towards materials characterization problems, but protein crystallography, pair-distribution function analysis, small-angle scattering and reflectometry analysis are all included. GSAS-II provides tools for indexing and solving structures from powder diffraction data, in addition to structure, data and results visualization tools

TOBY, BRIANH↗
DOE OSTI2023

Guided construction of single cell reference for human and mouse lung

Accurate cell type identification is a key and rate-limiting step in single-cell data analysis. Single-cell references with comprehensive cell types, reproducible and functionally validated cell identities, and common nomenclatures are much needed by the research community for automated cell type annotation, data integration, and data sharing. Here, we develop a computational pipeline utilizing the LungMAP CellCards as a dictionary to consolidate single-cell transcriptomic datasets of 104 human lungs and 17 mouse lung samples to construct LungMAP single-cell reference (CellRef) for both normal human and mouse lungs. CellRefs define 48 human and 40 mouse lung cell types catalogued from diverse anatomic locations and developmental time points. We demonstrate the accuracy and stability of LungMAP CellRefs and their utility for automated cell type annotation of both normal and diseased lungs using multiple independent methods and testing data. We develop user-friendly web interfaces for easy access and maximal utilization of the LungMAP CellRefs.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

Extending quantum-mechanical benchmark accuracy to biological ligand-pocket interactions

Predicting the binding affinity of ligands to protein pockets is key in the drug design pipeline. The flexibility of ligand-pocket motifs arises from a range of attractive and repulsive electronic interactions during binding. Accurately accounting for all interactions requires robust quantum-mechanical (QM) benchmarks, which are scarce for ligand-pocket systems. Additionally, disagreement between “gold standard” Coupled Cluster (CC) and Quantum Monte Carlo (QMC) methods casts doubt on many benchmarks for larger non-covalent systems. We introduce the “QUantum Interacting Dimer” (QUID) benchmark framework containing 170 non-covalent (non-)equilibrium systems modeling chemically and structurally diverse ligand-pocket motifs. Symmetry-adapted perturbation theory shows that QUID broadly covers non-covalent binding motifs and energetic contributions. Robust binding energies are obtained using complementary CC and QMC methods, achieving agreement of 0.5 kcal/mol. The benchmark data analysis reveals that several dispersion-inclusive density functional approximations provide accurate energy predictions, though their atomic van der Waals forces differ in magnitude and orientation. Contrarily, semiempirical methods and empirical force fields require improvements in capturing non-covalent interactions (NCIs) for out-of-equilibrium geometries. The wide span of NCIs, highly accurate interaction energies, and analysis of molecular properties take QUID beyond the “gold standard” for QM benchmarks of ligand-protein systems.

Puleva, Mirela [University of Luxembourg, Luxembou↗
DOE OSTI2022

Temperature-dependent behavior in the local structure of BaTiO 3 nanocrystals

Here, we use pair distribution function analysis of synchrotron X-ray total scattering data to inspect the local structure of BaTiO 3 nanocrystals from 253 K < T < 413 K. The local structure consists of ca. r = 35 Å domains in which Ti 4+ displacements have the same coherence length as the overall perovskite structure.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Systematic study of short- and long-range correlations in RE 3 TaO 7 weberite-type compounds by neutron total scattering and X-ray diffraction

The atomic structures of the lanthanide tantalates, Ln 3 TaO 7 , series (Ln = Pr, Tb, Dy, Ho, Tm, Yb) were systematically investigated using total scattering techniques. High-energy X-ray and neutron diffraction analysis revealed that the long-range structures can be grouped into three distinct families: (1) ordered Cmcm (Ln = Pr), (2) ordered Ccmm (Ln = Tb, Dy, Ho), and (3) disordered, defect-fluorite Fm$\bar{3}$m (Ln = Ho, Tm, Yb). These findings help to clarify the symmetry discrepancy for the already reported long-range structures in the literature. The short-range analysis of neutron total scattering data via pair distribution functions reveals a high degree of structural heterogeneity across length scales for all compounds, with distinct local atomic arrangements that are not fully captured by the average, long-range structure. The short-range structures at the level of coordination polyhedra are better captured by a set of alternative non-centrosymmetric structural models: (1) C2cm, (2) C222 1 , and (3) C2mm. This establishes a short-range multiferroic character for weberite-type tantalates because ferroelectric interactions compete with magnetic correlations. These ferroelectric interactions are particularly pronounced for the disordered compounds Tm 3 TaO 7 and Yb 3 TaO 7 . In conclusion, the structural differences among the three families are the result of changes in TaO 6 polyhedral tilt (transition between families 1 and 2) and dipolar interactions of off-centered Ta cations (transition between families 2 and 3).

36 MATERIALS SCIENCE↗
DOE OSTI2022

Organizing Large Data Sets for Efficient Analyses on HPC Systems

Upcoming exascale applications could introduce significant data management challenges due to their large sizes, dynamic work distribution, and involvement of accelerators such as graphical processing units, GPUs. In this work, we explore the performance of reading and writing operations involving one such scientific application on two different supercomputers. Our tests showed that the Adaptable Input and Output System, ADIOS, was able to achieve speeds over 1TB/s, a significant fraction of the peak I/O performance on Summit. We also demonstrated the querying functionality in ADIOS could effectively support common selective data analysis operations, such as conditional histograms. In tests, this query mechanism was able to reduce the execution time by a factor of five. More importantly, ADIOS data management framework allows us to achieve these performance improvements with only a minimal amount of coding effort.

Gu, Junmin↗