Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,027 records · Page 57

Active Flash: Out-of-core Data Analytics on Flash Storage

Next generation science will increasingly come to rely on the ability to perform efficient, on-the-fly analytics of data generated by high-performance computing (HPC) simulations, modeling complex physical phenomena. Scientific computing workflows are stymied by the traditional chaining of simulation and data analysis, creating multiple rounds of redundant reads and writes to the storage system, which grows in cost with the ever-increasing gap between compute and storage speeds in HPC clusters. Recent HPC acquisitions have introduced compute node-local flash storage as a means to alleviate this I/O bottleneck. We propose a novel approach, Active Flash, to expedite data analysis pipelines by migrating to the location of the data, the flash device itself. We argue that Active Flash has the potential to enable true out-of-core data analytics by freeing up both the compute core and the associated main memory. By performing analysis locally, dependence on limited bandwidth to a central storage system is reduced, while allowing this analysis to proceed in parallel with the main application. In addition, offloading work from the host to the more power-efficient controller reduces peak system power usage, which is already in the megawatt range and poses a major barrier to HPC system scalability. We propose an architecture for Active Flash, explore energy and performance trade-offs in moving computation from host to storage, demonstrate the ability of appropriate embedded controllers to perform data analysis and reduction tasks at speeds sufficient for this application, and present a simulation study of Active Flash scheduling policies. These results show the viability of the Active Flash model, and its capability to potentially have a transformative impact on scientific data analysis.

99 GENERAL AND MISCELLANEOUS↗

Automated Chemical Analysis of Internally Mixed Aerosol Particles Using X-ray Spectromicroscopy at the Carbon K-Edge

We have developed an automated data analysis method for atmospheric particles using scanning transmission X-ray microscopy coupled with near edge X-ray fine structure spectroscopy (STXM/NEXAFS). This method is applied to complex internally mixed submicron particles containing organic and inorganic material. Several algorithms were developed to exploit NEXAFS spectral features in the energy range from 278-320 eV for quantitative mapping of the spatial distribution of elemental carbon, organic carbon, potassium, and non-carbonaceous elements in particles of mixed composition. This energy range encompasses the carbon K-edge and potassium L2 and L3 edges. STXM/NEXAFS maps of different chemical components were complemented with a subsequent analysis using elemental maps obtained by scanning electron microscopy coupled with energy dispersive X-ray analysis (SEM/EDX). We demonstrate application of the automated mapping algorithms for data analysis and the statistical classification of particles.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

FY23 Progress Report: SRNL Analysis of ICCWR LCM and WAMS data for Corrosion and Cracking

Algorithms for Machine Learning (ML) and data analysis for the 3013 Surveillance Program have been developed in an ongoing collaborative effort by the Savannah River National Laboratory (SRNL) and the University of South Carolina (USC). The objective of the algorithms is to automate the identification of corrosion and crack formation in the Inner Container Closure Weld Region (ICCWR) of the canister system used to store Pu-bearing material. Data for corrosion and cracking is collected from large binary files generated by a Laser Confocal Microscope (LCM), the Wide Area 3D Measurement System (WAMS), and in a recent proposal, by a Scanning Electron Microscope (SEM). The ML software uses the physical attributes in the data files (e.g., one or all of: height, color, and grayscale values as functions of position in a plane projection) to detect the presence of surface corrosion and cracking after being trained on similar data with the features to be detected labeled.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

FY24 Progress Report: SRNL Analysis of ICCWR LCM and WAMS data for Corrosion and Cracking

Algorithms for Machine Learning (ML) and data analysis for the 3013 Surveillance Program have been developed in an ongoing collaborative effort by the Savannah River National Laboratory (SRNL) and the University of South Carolina (USC). The objective of the algorithms is to automate the identification of corrosion and crack formation in the Inner Container Closure Weld Region (ICCWR) of the canister system used to store Pu-bearing material. Data for corrosion and cracking is collected from large binary files generated by a Laser Confocal Microscope (LCM), the Wide Area 3D Measurement System (WAMS), or,in a recent proposal, by a Scanning Electron Microscope (SEM). The ML software uses the physical attributes in the data files (e.g., one or more of: height, color, and 16-bit grayscale values as functions of position in a plane projection) to detect signs of surface corrosion and cracking after being trained on similar data, with the features to be detected. Although the initial scope included screening for broader indicators of corrosion, e.g., pitting, identification of potential cracks was prioritized for the past several years at the request of program leadership. Labeled training data is essential to developing the ML algorithm, and enhancements to data labeling capability have been developed to address this essential precursor to application of ML routines. Efficient labeling is particularly important in view of the large volume of data required to train ML algorithms and the relative rarity of cracks in the ICCWR data set. The updated program will read binary data from either LCM, WAMS or SEM files, interrogate data attributes, facilitate user labeling of data for training ML algorithms, execute ML algorithms, output parameters from trained ML algorithms, report ML model accuracy with respect to labeled data, and generate graphical representations for various analyses. In FY24, hourglass neural networks (HNNs) that were initiated in FY22 were further developed and tested using available LCM data, and their performance was tested against that of the alternative U-Net Neural Network algorithm structure. HNNs along with previously developed Convolutional Neural Networks (CNNs) and Deep Neural Networks (DNNs) comprise a suite of ML tools for identification of cracks in the ICCWR

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

A scalable transformer model for real-time decision making in neutron scattering experiments

The U.S. Department of Energy's (DOE's) neutron research facilities at Oak Ridge National Laboratory (ORNL), including the High Flux Isotope Reactor (HFIR) and the Spallation Neutron Source (SNS), are a state-of-the-art neutron scattering facility that allows researchers to study the structure and dynamics of materials at the atomic scale. At the SNS, neutrons are measured using the time-of-flight (TOF) technique as they move through a neutron beamline to interact with a sample. Large volumes of neutron scattering data are collected and recorded in neutron event mode. Optimal productivity of the TOF instrument is limited due to the lack of real-time data analysis tools. The large amount of data generated by the experiments can be challenging to process and analyze in real time, particularly for experiments that require rapid feedback and adjustment of experimental parameters. The regular computer/workstation cannot keep up with the experiment speed to provide real-time feedback to adjust experimental parameters, so connecting the supercomputers available to the neutron facility is necessary to achieve real-time data analysis and experiment steering. To address this challenge, we exploit the Frontier supercomputer at Oak Ridge Leadership Computing Facility (OLCF) to train a scalable temporal fusion transformer model for real-time decision making of TOF neutron scattering experimentation. Here, in this paper, we present the results using Frontier to provide the processing power needed to rapidly process and analyze large volumes of single-crystal diffraction data collected at TOPAZ, a neutron time-of-flight Laue single-crystal diffractometer at the SNS.

97 MATHEMATICS AND COMPUTING↗

High-accuracy emulators for observables in ΛCDM, N eff, Σ m ν, and w cosmologies

ABSTRACT We use the emulation framework CosmoPower to construct and publicly release neural network emulators of cosmological observables, including the cosmic microwave background (CMB) temperature and polarization power spectra, matter power spectrum, distance-redshift relation, baryon acoustic oscillation (BAO) and redshift-space distortion (RSD) observables, and derived parameters. We train our emulators on Einstein–Boltzmann calculations obtained with high-precision numerical convergence settings, for a wide range of cosmological models including ΛCDM, wCDM, ΛCDM + Neff, and ΛCDM + Σmν. Our CMB emulators are accurate to better than 0.5 per cent out to ℓ = 104, which is sufficient for Stage-IV data analysis, and our P(k) emulators reach the same accuracy level out to $k=50 \, \, \mathrm{Mpc}^{-1}$, which is sufficient for Stage-III data analysis. We release the emulators via an online repository (CosmoPower Organisation), which will be continually updated with additional extended cosmological models. Our emulators accelerate cosmological data analysis by orders of magnitude, enabling cosmological parameter extraction analyses, using current survey data, to be performed on a laptop. We validate our emulators by comparing them to class and camb and by reproducing cosmological parameter constraints derived from Planck TT, TE, EE, and CMB lensing data, as well as from the Atacama Cosmology Telescope Data Release 4 CMB data, Dark Energy Survey Year-1 galaxy lensing and clustering data, and Baryon Oscillation Spectroscopic Survey Data Release 12 BAO and RSD data.

Astronomy & Astrophysics↗

Automated Chemical Analysis of Internally Mixed Aerosol Particles Using X-ray Spectromicroscopy at the Carbon K-Edge

We have developed an automated data analysis method for atmospheric particles using scanning transmission X-ray microscopy coupled with near edge X-ray fine structure spectroscopy (STXM/NEXAFS). This method is applied to complex internally mixed submicrometer particles containing organic and inorganic material. Several algorithms were developed to exploit NEXAFS spectral features in the energy range from 278 to 320 eV for quantitative mapping of the spatial distribution of elemental carbon, organic carbon, potassium, and noncarbonaceous elements in particles of mixed composition. This energy range encompasses the carbon K-edge and potassium L2 and L3 edges. STXM/NEXAFS maps of different chemical components were complemented with a subsequent analysis using elemental maps obtained by scanning electron microscopy coupled with energy dispersive X-ray analysis (SEM/EDX). We demonstrate the application of the automated mapping algorithms for data analysis and the statistical classification of particles.

54 ENVIRONMENTAL SCIENCES↗

Use of Longitudinal Serum Analysis and Machine Learning to Develop a Classifier for Cancer Early Detection

Early detection of solid tumors through a simple screening process, such as the proteomic analysis of biofluids, has the potential to significantly alter the management and outcomes of cancers. The application of advanced targeted proteomics measurements and data analysis strategies to uniformly collected serum or plasma samples would enable longitudinal studies of cancer risk, progression, and response to therapy that have the potential to significantly reduce cancer burden in general. In this article, we describe a generalizable workflow combining robust, multiplexed targeted proteomics measurements applied to longitudinal samples from the Department of Defense Serum Repository with a Random Forest machine learning method for developing and initially evaluating the performance of candidate biomarker panels for early detection of cancers. The effectiveness of this approach was demonstrated in a cohort of 175 head and neck squamous cell carcinoma patients. The outlined protocols include methods for sample preparation, instrument analysis, and data analysis and interpretation using this workflow.

Longitudinal analysis, machine learning, cancer, e↗

Pagoda

Pagoda is a set of parallel tools as well as an application programmer interface for parallel data analysis of high-resolution climate data. Pagoda implements data parallel versions of some of the commonly used tools from the NetCDF Operators. These tools support data processing operations including subsetting, record and ensemble averages, binary operations, and interpolation. Pagoda also provides an application programmer interface for developing custom data analysis programs.

Source record↗

Analysis of 191 Ir(n, γ) data measured at the DANCE facility

Measurements of the 191 Ir(n, γ) reaction were performed at the DANCE facility in 2013. Description of the data analysis is presented. Deduced relative neutron-capture cross section is reported. The cross section is compared to the ENDF evaluation.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Pagoda

Pagoda is a set of parallel tools as well as an application programmer interface for parallel data analysis of high-resolution climate data. Pagoda implements data parallel versions of some of the commonly used tools from the NetCDF Operators. These tools support data processing operations including subsetting, record and ensemble averages, binary operations, and interpolation. Pagoda also provides an application programmer interface for developing custom data analysis programs.

Source record↗

Decay curve analysis for data error quantification in time-domain induced polarization imaging

In recent years, the time-domain induced polarization (TDIP) imaging technique has emerged as a suitable method for the characterization and the monitoring of hydrogeologic and biogeochemical processes. However, one of the major challenges refers to the resolution of the electrical images. Hence, various studies have stressed the importance of data processing, error characterization, and the deployment of adequate inversion schemes. A widely accepted method to assess data error in electrical imaging relies on the analysis of the discrepancy between normal and reciprocal measurements. Nevertheless, the collection of reciprocals doubles the acquisition time and is only viable for a limited subset of commonly used electrode configurations (e.g., dipole-dipole [DD]). To overcome these limitations, we have developed a new methodology to quantify the data error in TDIP imaging, which is entirely based on the analysis of the recorded IP decay curve and does not require recollection of data (e.g., reciprocals). The first two steps of the methodology assess the general characteristics of the decay curves and the spatial consistency of the measurements for the detection and removal of outliers. In the third and fourth steps, we quantify the deviation of the measured decay curves from a smooth model for the estimation of random error of the total chargeability and transfer resistance measurement. The error models and imaging results obtained from this methodology - in the following referred to as "decay curve analysis" - are compared with those obtained following a conventional normal-reciprocal analysis revealing consistent results. As a result, we determine the applicability of our methodology with real field data collected at the floodplain scale (approximately 12 ha) using multiple gradient and DD configurations.

58 GEOSCIENCES↗

Physics-informed graph neural networks for predicting cetane number with systematic data quality analysis

Designing alternative fuels for advanced compression ignition engines necessitates a predictive model for cetane number (CN). In this study, the physics-informed graph neural networks are introduced for a reliable CN prediction by considering molecular features pertinent to the physical properties of molecules that affect CN. The reliability of measured data is another key factor to consider for improving the predictive model. Various experimental instruments for measuring CN exist, including standard and non-standard methods. In this regard, a systematic data quality analysis was carried out for the total 630 CNs collected from literature and new measurements in this study using Advanced Fuel Ignition Delay Analyzer (AFIDA). The results from this data curation process were reflected in the model by imposing lower sample weights on the data coming from less reliable measurement techniques. This approach effectively maximized the prediction accuracy while incorporating data from all available sources. Using the sample weights decreased the mean absolute error (MAE) up to 0.8 CN units. The accuracy was also improved by introducing the CN-related physical properties (the number of hydrogen bond donors and acceptors); the test set MAE is 5.74 and 7.01 for the model with and without such properties, respectively. Investigating molecular structural effects on CN was also carried out to gain chemical insights into factors used to design new fuel candidates. The dimensionality reduction analysis of feature vectors showed a clear clustering in terms of functional groups and CN and the structural effect derived from the model was consistent with the physicochemical insights. Finally, this physics-informed model and data curation would be helpful for accurate CN prediction and inform rational fuel design.

97 MATHEMATICS AND COMPUTING↗

Electrical Energy Storage Data Submission Guidelines

Energy storage technologies are positioned to play a substantial role in power delivery systems. They are being touted as an effective new resource to maintain reliability and allow for increased penetration of renewable energy. However, due to their relative infancy, there is a lack of knowledge on how these resources truly operate over time. Data analysis can help ascertain the operational and performance characteristics of these emerging technologies. Rigorous testing and data analysis are important for all stakeholders to ensure a safe, reliable system that performs predictably on a macro level. Standardizing testing and analysis approaches to verifying the performance of energy storage devices, equipment, and systems when integrating them into the grid will improve the understanding and benefit of energy storage over time from technical and economic vantage points. Demonstrating the life-cycle value and capabilities of energy storage systems begins with the data the provider supplies for analysis. After review of energy storage data received from several providers, it has become clear that some of these data are inconsistent and incomplete, raising the question of their efficacy for robust analysis. This report reviews and proposes general guidelines such as sampling rates and data points that providers must supply for robust data analysis to take place. Consistent guidelines are the basis of the proper protocol and ensuing standards to (a) reduce the time it takes data to reach those who are providing analysis; (b) allow them to better understand the energy storage installations; and (c) enable them to provide high-quality analysis of the installations. This report is intended to serve as a starting point for what data points should be provided when monitoring. As battery technologies continue to advance and the industry expands, this report will be updated to remain current.

25 ENERGY STORAGE↗

Data and Analysis Preservation in the PHENIX Experiment at RHIC

The PHENIX experiment (the Pioneering High Energy Nuclear Interaction eXperiment) is the largest of the four experiments that have operated at the Relativistic Heavy Ion Collider (RHIC), taking data in 2000-2016. PHENIX has made fundamental contributions to the discovery and study of the Quark-Gluon Plasma, advancement of spin physics and other areas. Currently, the PHENIX Collaboration is analyzing large data samples previously collected, while facing challenges in the area of Data and Analysis Preservation. We describe the strategy and practices employed by the PHENIX Collaboration to meet these challenges by leveraging state-of-the-art platforms and tools created and maintained by the High Energy and Nuclear Physics communities, including Zenodo, HEPData, OpenData, REANA and others.

97 MATHEMATICS AND COMPUTING↗

Towards Lightweight Data Integration Using Multi-Workflow Provenance and Data Observability

Modern large-scale scientific discovery requires multidisciplinary collaboration across diverse computing facilities, including High Performance Computing (HPC) machines and the Edge-to-Cloud continuum. Integrated data analysis plays a crucial role in scientific discovery, especially in the current AI era, by enabling Responsible AI development, FAIR, Reproducibility, and User Steering. However, the heterogeneous nature of science poses challenges such as dealing with multiple supporting tools, cross-facility environments, and efficient HPC execution. Building on data observability, adapter system design, and provenance, we propose MIDA: an approach for lightweight runtime Multi-workflow Integrated Data Analysis. MIDA defines data observability strategies and adaptability methods for various parallel systems and machine learning tools. With observability, it intercepts the dataflows in the background without requiring instrumentation while integrating domain, provenance, and telemetry data at runtime into a unified database ready for user steering queries. We conduct experiments showing end-to-end multi-workflow analysis integrating data from Dask and MLFlow in a real distributed deep learning use case for materials science that runs on multiple environments with up to 276 GPUs in parallel. We show near-zero overhead running up to 100,000 tasks on 1,680 CPU cores on the Summit supercomputer.

Santos Souza, Renan↗

Characterization of intact N- and O-linked glycopeptides using higher energy collisional dissociation

Simultaneous elucidation of the glycan structure and the glycosylation site are needed to reveal the biological function of protein glycosylation. In this study, we employed a recent type of fragmentation termed higher energy collisional dissociation (HCD) to examine fragmentation patterns of intact glycopeptides generated from a mixture of standard glycosylated proteins. The normalized collisional energy (NCE) value for HCD was varied from 30% to 60% to evaluate the optimal conditions for the fragmentation of peptide backbones and glycoconjugates. Our results indicated that HCD with lower NCE valuespreferentially fragmented the sugar chains attached to the peptides to generate a ladder of neutral loss of monosaccharides, thus enabling the putative glycan structure characterization. Also, detection of the oxonium ions enabled unambiguous differentiation of glycopeptides from non-glycopeptides. On the contrary, HCD with higher NCE values preferentially fragmented the peptide backbone and thus provided information needed for confident peptide identification. We evaluated the HCD approach with alternating NCE parameters for confident characterization of intact N-linked and O-linked glycopeptides in a single liquid chromatography-tandem mass spectrometry (LC-MS/MS) analysis. In addition, we applied a novel data analysis pipeline, so-called GlycoFinder, to form a basis for automated data analysis. Overall, 38 unique intact glycopeptides corresponding to eight glycosylation sites (including six N-linked and two O-linked sites) were confidently identified from a standard protein mixture. This approach provided concurrent characterization of both, the peptide and the glycan, thus enabling comprehensive structural characterization of glycoproteins in a single LC-MS/MS analysis.

automated identification↗