Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 451 records · Page 25

Functional Data Analysis for Extracting the Intrinsic Dimensionality of Spectra: Application to Chemical Homogeneity in the Open Cluster M67

High-resolution spectroscopic surveys of the Milky Way have entered the Big Data regime and have opened avenues for solving outstanding questions in Galactic archeology. However, exploiting their full potential is limited by complex systematics, whose characterization has not received much attention in modern spectroscopic analyses. In this work, we present a novel method to disentangle the component of spectral data space intrinsic to the stars from that due to systematics. Using functional principal component analysis on a sample of 18,933 giant spectra from APOGEE, we find that the intrinsic structure above the level of observational uncertainties requires ≈10 functional principal components (FPCs). Our FPCs can reduce the dimensionality of spectra, remove systematics, and impute masked wavelengths, thereby enabling accurate studies of stellar populations. To demonstrate the applicability of our FPCs, we use them to infer stellar parameters and abundances of 28 giants in the open cluster M67. We employ Sequential Neural Likelihood, a simulation-based Bayesian inference method that learns likelihood functions using neural density estimators, to incorporate non-Gaussian effects in spectral likelihoods. By hierarchically combining the inferred abundances, we limit the spread of the following elements in M67: Fe ≲ 0.02 dex; C ≲ 0.03 dex; O, Mg, Si, Ni ≲ 0.04 dex; Ca ≲ 0.05 dex; N, Al ≲ 0.07 dex (at 68% confidence). Our constraints suggest a lack of self-pollution by core-collapse supernovae in M67, which has promising implications for the future of chemical tagging to understand the star formation history and dynamical evolution of the Milky Way.

79 ASTRONOMY AND ASTROPHYSICS↗

AXEAP : a software package for X-ray emission data analysis using unsupervised machine learning

The Argonne X-ray Emission Analysis Package ( AXEAP ) has been developed to calibrate and process X-ray emission spectroscopy (XES) data collected with a two-dimensional (2D) position-sensitive detector. AXEAP is designed to convert a 2D XES image into an XES spectrum in real time using both calculations and unsupervised machine learning. AXEAP is capable of making this transformation at a rate similar to data collection, allowing real-time comparisons during data collection, reducing the amount of data stored from gigabyte-sized image files to kilobyte-sized text files. With a user-friendly interface, AXEAP includes data processing for non-resonant and resonant XES images from multiple edges and elements. AXEAP is written in MATLAB and can run on common operating systems, including Linux, Windows, and MacOS.

97 MATHEMATICS AND COMPUTING↗

Field Data Analysis and Modeling of Drillstring Vibrations to Identify Inefficiency in Deep Geothermal Drilling

One challenge that hinders efficient drilling and causes downhole tool failures is severe drillstring vibrations. The objective of this paper is to identify the root cause of drillstring vibrations in deep geothermal wells and investigate their effect on drilling performance using data analytics and vibration modeling. A near-bit sub was utilized to collect vibration data, where the burst data was used to obtain the drillstring torsional natural frequency. The data showed that the highest lateral acceleration and stick-slip severities (SSS) occur at the higher mechanical specific energy (MSE) range, while the low vibration levels were encountered in the optimum range of the MSE curve. The elevated SSS levels consistently occur at the low to mid-range of applied RPM and the highest sonic velocity. Additionally, the lateral acceleration levels are higher at the low to mid-range of the applied RPM. The effect of drillstring vibration on drilling performance was recognized by the presented MSE analysis.

15 GEOTHERMAL ENERGY↗

Block-Parallel Data Analysis with DIY2

DIY2 is a programming model and runtime for block-parallel analytics on distributed-memory machines. Its main abstraction is block-structured data parallelism: data are decomposed into blocks; blocks are assigned to processing elements (processes or threads); computation is described as iterations over these blocks, and communication between blocks is defined by reusable patterns. By expressing computation in this general form, the DIY2 runtime is free to optimize the movement of blocks between slow and fast memories (disk and flash vs. DRAM) and to concurrently execute blocks residing in memory with multiple threads. This enables the same program to execute in-core, out-of-core, serial, parallel, single-threaded, multithreaded, or combinations thereof. This paper describes the implementation of the main features of the DIY2 programming model and optimizations to improve performance. DIY2 is evaluated on benchmark test cases to establish baseline performance for several common patterns and on larger complete analysis codes running on large-scale HPC machines.

97 MATHEMATICS AND COMPUTING↗

CMS distributed data analysis with CRAB3

The CMS Remote Analysis Builder (CRAB) is a distributed workflow management tool which facilitates analysis tasks by isolating users from the technical details of the Grid infrastructure. Throughout LHC Run 1, CRAB has been successfully employed by an average of 350 distinct users each week executing about 200,000 jobs per day.CRAB has been significantly upgraded in order to face the new challenges posed by LHC Run 2. Components of the new system include 1) a lightweight client, 2) a central primary server which communicates with the clients through a REST interface, 3) secondary servers which manage user analysis tasks and submit jobs to the CMS resource provisioning system, and 4) a central service to asynchronously move user data from temporary storage in the execution site to the desired storage location. Furthermore, the new system improves the robustness, scalability and sustainability of the service.Here we provide an overview of the new system, operation, and user support, report on its current status, and identify lessons learned from the commissioning phase and production roll-out.

97 MATHEMATICS AND COMPUTING↗

Leveraging Big Data Analysis Techniques for U.S. Vocational Vehicle Drive Cycle Characterization, Segmentation, and Development

Under a collaborative interagency agreement between the U.S. Environmental Protection Agency and the U.S. Department of Energy (DOE), the National Renewable Energy Laboratory (NREL) performed a series of in-depth analyses to characterize on-road driving behavior including distributions of vehicle speed, idle time, accelerations and decelerations, and other driving metrics of medium- and heavy-duty vocational vehicles operating within the United States. As part of this effort, NREL researchers segmented U.S. medium- and heavy-duty vocational vehicle driving characteristics into three distinct operating groups or clusters using real-world drive cycle data collected at 1 Hz and stored in NREL's Fleet DNA database. The Fleet DNA database contains millions of miles of historical drive cycle data captured from medium- and heavy-duty vehicles operating across the United States. The data encompass existing DOE activities as well as contributions from valued industry stakeholder participants. For this project, data captured from 913 unique vehicles comprising 16,250 days of operation were drawn from the Fleet DNA database and examined. The Fleet DNA data used as a source for this analysis has been collected from a total of 30 unique fleets/data providers operating across 22 unique geographic locations spread across the United States. This includes locations with topographies ranging from the foothills of Denver, Colorado, to the flats of Miami, Florida. This paper includes the results of the statistical analysis performed by NREL and a discussion and detailed summary of the development of the vocational drive cycle weights and representative transient drive cycles for testing and simulation. Additional discussion of known limitations and potential future work is also included.

33 ADVANCED PROPULSION SYSTEMS↗

Battery Life Estimator (BLE) Data Analysis Software v. 1.2

The purpose of this software is estimate the useable life of rechargeable batteries (e.g., lithium-ion). The software employs a generalized statistical approach to model cell data in the context of accelerated aging experiments. The cell performance is modeled in two parts. The first part consists of a deterministic degradation model which models the average cell behavior. The second part relates to the statistical variation in performance of the cells (error model). Experimental data from an accelerated aging experiment will be input from an Excel worksheet. The software will then query the user for a specific model form (within the generalized model framework). Model parameters will be estimated by the software using various statistical methodologies. Average cell life will be predicted using the estimated model parameters. The uncertainty in the estimated cell life will also be computed using bootstrap simulations. This software can be used in several modes: 1) fit only, 2) fit and simulation, and 3) simulation only

Thomas, Edward↗

Visual Data Analysis as an Integral Part of Environmental Management

The U.S. Department of Energy's (DOE) Office of Environmental Management (DOE/EM) currently supports an effort to understand and predict the fate of nuclear contaminants and their transport in natural and engineered systems. Geologists, hydrologists, physicists and computer scientists are working together to create models of existing nuclear waste sites, to simulate their behavior and to extrapolate it into the future. We use visualization as an integral part in each step of this process. In the first step, visualization is used to verify model setup and to estimate critical parameters. High-performance computing simulations of contaminant transport produces massive amounts of data, which is then analyzed using visualization software specifically designed for parallel processing of large amounts of structured and unstructured data. Finally, simulation results are validated by comparing simulation results to measured current and historical field data. We describe in this article how visual analysis is used as an integral part of the decision-making process in the planning of ongoing and future treatment options for the contaminated nuclear waste sites. Lessons learned from visually analyzing our large-scale simulation runs will also have an impact on deciding on treatment measures for other contaminated sites.

54 ENVIRONMENTAL SCIENCES↗

Data analysis and modeling pipelines for controlled networked social science experiments

There is large interest in networked social science experiments for understanding human behavior at-scale. Significant effort is required to perform data analytics on experimental outputs and for computational modeling of custom experiments. Moreover, experiments and modeling are often performed in a cycle, enabling iterative experimental refinement and data modeling to uncover interesting insights and to generate/refute hypotheses about social behaviors. The current practice for social analysts is to develop tailor-made computer programs and analytical scripts for experiments and modeling. This often leads to inefficiencies and duplication of effort. In this work, we propose a pipeline framework to take a significant step towards overcoming these challenges. Our contribution is to describe the design and implementation of a software system to automate many of the steps involved in analyzing social science experimental data, building models to capture the behavior of human subjects, and providing data to test hypotheses. The proposed pipeline framework consists of formal models, formal algorithms, and theoretical models as the basis for the design and implementation. We propose a formal data model, such that if an experiment can be described in terms of this model, then our pipeline software can be used to analyze data efficiently. The merits of the proposed pipeline framework is elaborated by several case studies of networked social science experiments.

97 MATHEMATICS AND COMPUTING↗

Blind photovoltaic modeling intercomparison: A multidimensional data analysis and lessons learned

The Photovoltaic (PV) Performance Modeling Collaborative (PVPMC) organized a blind PV performance modeling intercomparison to allow PV modelers to blindly test their models and modeling ability against real system data. Measured weather and irradiance data were provided along with detailed descriptions of PV systems from two locations (Albuquerque, New Mexico, USA, and Roskilde, Denmark). Participants were asked to simulate the plane-of-array irradiance, module temperature, and DC power output from six systems and submit their results to Sandia for processing. The results showed overall median mean bias (i.e., the average error per participant) of 0.6% in annual irradiation and –3.3% in annual energy yield. While most PV performance modeling results seem to exhibit higher precision and accuracy as compared to an earlier blind PV modeling study in 2010, human errors, modeling skills, and derates were found to still cause significant errors in the estimates.

14 SOLAR ENERGY↗

Radiograph and passive data analysis using mixed variable optimization

Disclosed herein are representative embodiments of methods, apparatus, and systems for performing radiography analysis. For example, certain embodiments perform radiographic analysis using mixed variable computation techniques. One exemplary system comprises a radiation source, a two-dimensional detector for detecting radiation transmitted through a object between the radiation source and detector, and a computer. In this embodiment, the computer is configured to input the radiographic image data from the two-dimensional detector and to determine one or more materials that form the object by using an iterative analysis technique that selects the one or more materials from hierarchically arranged solution spaces of discrete material possibilities and selects the layer interfaces from the optimization of the continuous interface data.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Hanford Site Composite Analysis Data Package: Exposure Scenarios and Radionuclide Specific Dose Conversion Factors

This data package summarizes the exposure assumptions, equations, and methods used to calculate radionuclide-specific unit dose factors and the radiological doses for both groundwater and atmospheric pathways as a part of the updated Hanford Site Composite Analysis (CA). An All Pathways Representative Person exposure scenario is considered to evaluate exposure via both groundwater and atmospheric transport pathways. The radiological dose assessments for both groundwater and atmospheric pathways are included in the performance assessments (PAs) for various Waste Management Areas at the Hanford Site. This data package calculates exposure route-specific and total unit dose factors for CA-specific radionuclides of concern based on the exposure assumptions used in the CA and PAs. This data package also presents the results and comparison of the radionuclide-specific unit dose factors based on the exposure assumptions used in the revised Hanford Site Composite Analysis and Hanford Site performance assessments for low-level waste disposal facilities.

61 RADIATION PROTECTION AND DOSIMETRY↗

Natural Language Processing-Enhanced Nuclear Industry Operating Experience Data Analysis to Support Risk Model Parameter Estimations

This set of slides has been prepared for a talk at the INL AI/ML Symposium held on September 8, 2022. Presentation outline: Background - Nuclear power plant operating experience data sources • Research focus and motivation - Analyzing free-text operating experience data: present and future • Research method - Input - Methodological steps - Output • Conclusions and next steps

99 GENERAL AND MISCELLANEOUS↗

Filling data analysis gaps in time-resolved crystallography by machine learning

There is a growing understanding of the structural dynamics of biological molecules fueled by x-ray crystallography experiments. Time-resolved serial femtosecond crystallography (TR-SFX) with x-ray Free Electron Lasers allows the measurement of ultrafast structural changes in proteins. Nevertheless, this technique comes with some limitations. One major challenge is the quality of data from TR-SFX measurements, which often faces issues like data sparsity, partial recording of Bragg reflections, timing errors, and pixel noise. To overcome these difficulties, conventionally, large volumes of data are collected and grouped into a few temporal bins. The data in each bin are then averaged and paired with the mean of their corresponding jittered timestamps. This procedure provides one structure per bin, resulting in a limited number of averaged structures for the entire time interval spanned by the experiment. Therefore, the information on ultrafast structural dynamics at high temporal resolution is lost. This has initiated research for advanced methods of analyzing experimental TR-SFX data beyond the standard binning and averaging method. To address this problem, we use a machine learning algorithm called Nonlinear Laplacian Spectral Analysis (NLSA), which has emerged as a promising technique for studying the dynamics of complex systems. In this work, we demonstrate the power of this algorithm using synthetic x-ray diffraction snapshots from a protein with significant data incompleteness, timing uncertainties, and noise. Our study confirms that NLSA is a suitable approach that effectively mitigates the effects of these artifacts in TR-SFX data and recovers accurate structural dynamics information hidden in such data.

Trujillo, Justin (ORCID:0000000285505360)↗

Enabling Real-time Scattering Data Analysis with Scalable Optimization [Slides]

Diffraction experiments produce datasets with rich multidimensional physics information such as microstructure, equations of state, crystal structure, elastoplastic properties, and other key inputs to LANL mission-essential multiphysics models. This information is typically extracted through a process called Rietveld refinement, which involves selecting appropriate models of the instrument, crystal structure, and microstructure, identifying suitable starting values, and then fitting often hundreds of model parameters using a sequence of empirical parameter turnon/off sequences within a non-global gradient-based optimization. Extensive user expertise is required to properly setup a refinement, identify appropriate models, and select initial parameter values close to truth, such that the refinement will yield parameter values that are optimally predictive. This is a very tedious manual process performed far after the beamline campaign has ended. As facilities have become capable of generating larger volumes of data, the limitation in throughput due to Rietveld refinement has led to a dramatic increase in unanalyzed data as opposed to an intended increase in new science. In our FY22 TED, we demonstrated an integrated toolset providing near real-time automated Rietveld analysis. If this toolset can be optimized to provide automated Rietveld analysis in real-time, this could alleviate the bottleneck in unanalyzed diffraction data, aid in decision-making during experiments, and increase efficiency of the facility.

74 ATOMIC AND MOLECULAR PHYSICS↗

Calibration and Data Analysis of a Frequency Selectable Laser Source for CMB Detector Characterization

Cosmic Microwave Background (CMB) experiments study faint radiation left over from the early universe. The CMB was created when the universe became cool enough for light to travel freely through space, and today it gives scientists one of the earliest images of the universe. One important goal of modern CMB experiments is to measure this radiation with higher precision in order to search for evidence that supports the theory of cosmic inflation. To do this, scientists use extremely sensitive detectors that must be calibrated accurately. The Frequency Selectable Laser Source, or FLS, is a new calibration tool that can send selected frequencies to detectors and help measure their response. During my internship, I worked on the FLS after it returned to Fermilab from Chile, where it had been used to characterize detectors at the Simons Observatory. The system came back in parts, so the first part of my project was helping rebuild the optical and mechanical setup. After the system was rebuilt, we performed alignments to maximize the receiver photocurrent. We then collected calibration measurements over different frequency ranges, including 543 GHz to 568 GHz, 740 GHz to 766 GHz, and 60 GHz to 500 GHz. These measurements were used to check waterline calibration and reflectivity features and compare new data with previous data. Another major part of my project was learning Python so I could understand previous analysis code, modify it for new files, and write my own code to compare the mean response between datasets. The results showed that the new data was close to previous measurements and that waterline features near 556 GHz and 752 GHz were found within less than 1.5 GHz of the expected values. I also completed the reflectivity analysis for five prisms in two polarization orientations. In the original orientation, the results were consistent between the five prisms and close to values measured on a different system at the University of Chicago. I then collected a second set of measurements on my own with the polarization of the laser rotated by 90 degrees and compared them with the original data using the same Python workflow. The measured reflectivity increased for all five prisms in the new orientation, showing that the prism reflectivity depends on polarization. Future work will focus on using the FLS to characterize real CMB detectors.

Pumarino, Rafael [Unlisted]↗