Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

TXM-Sandbox : an open-source software for transmission X-ray microscopy data analysis

A transmission X-ray microscope (TXM) can investigate morphological and chemical information of a tens to hundred micrometre-thick specimen on a length scale of tens to hundreds of nanometres. It has broad applications in material sciences and battery research. TXM data processing is composed of multiple steps. A workflow software has been developed that integrates all the tools required for general TXM data processing and visualization. The software is written in Python and has a graphic user interface in Jupyter Notebook . Users have access to the intermediate analysis results within Jupyter Notebook and have options to insert extra data processing steps in addition to those that are integrated in the software. The software seamlessly integrates ImageJ as its primary image viewer, providing rich image visualization and processing routines. As a guide for users, several TXM specific data analysis issues and examples are also presented.

36 MATERIALS SCIENCE↗
DOE OSTI2018

Novel functional and distributed approaches to data analysis available in ROOT

The bright future of particle physics at the Energy and Intensity frontiers poses exciting challenges to the scientific software community. The traditional strategies for processing and analyzing data are evolving in order to (i) offer higher-level programming model approaches and (ii) exploit parallelism to cope with the ever increasing complexity and size of the datasets. This contribution describes how the ROOT framework, a cornerstone of software stacks dedicated to particle physics, is preparing to provide adequate solutions for the analysis of large amount of scientific data on parallel architectures. The functional approach to parallel data analysis provided with the ROOT TDataFrame interface is then characterized. The design choices behind this new interface are described also comparing with other widely adopted tools such as Pandas and Apache Spark. The programming model is illustrated highlighting the reduction of boilerplate code, composability of the actions and data transformations as well as the capabilities of dealing with different data sources such as ROOT, JSON, CSV or databases. Details are given about how the functional approach allows transparent implicit parallelization of the chain of operations specified by the user. The progress done in the field of distributed analysis is examined. In particular, the power of the integration of ROOT with Apache Spark via the PyROOT interface is shown. In addition, the building blocks for the expression of parallelism in ROOT are briefly characterized together with the structural changes applied in the building and testing infrastructure which were necessary to put them in production.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2024

In situ Synchrotron X‐ray Metrology Boosted by Automated Data Analysis for Real‐time Monitoring of Cathode Calcination

Abstract Synchrotron X‐ray‐based in situ metrology is advantageous for monitoring the synthesis of battery materials, offering high throughput, high spatial and temporal resolution, and chemical sensitivity. However, the rapid generation of massive data poses a challenge to on‐site, on‐the‐fly analysis needed for real‐time process monitoring. Here, a weighted lagged cross‐correlation (WLCC) similarity approach is presented for automated data analysis, which merges with in situ synchrotron X‐ray diffraction metrology to monitor the calcination process of the archetypal nickel‐based cathode, LiNiO 2 . The WLCC approach, incorporating variables that account for peak shifts and width changes associated with structural transformations, enables rapid extraction of phase progression within 10 seconds from tens of diffraction patterns. Details are captured, from initial precursors to intermediates and the final layered LiNiO 2 , providing information for agile on‐site adjustments during experiments and complementing post hoc diffraction analysis by offering insights into early‐stage phase nucleation and growth. Expanding this data‐powered platform paves the way for real time calcination process monitoring and control, which is pivotal to quality control in battery cathode manufacturing.

36 MATERIALS SCIENCE↗
DOE OSTI2012

A DEEP, WIDE-FIELD, AND PANCHROMATIC VIEW OF 47 Tuc AND THE SMC WITH HST: OBSERVATIONS AND DATA ANALYSIS METHODS

In Hubble Space Telescope (HST) Cycle 17, we imaged the well-known globular star cluster 47 Tucanae for 121 orbits using the Wide Field Channel of the Advanced Camera for Surveys (ACS) and both the UV/visible (UVIS) and IR channels of the newly installed Wide Field Camera 3 (WFC3) instrument (GO-11677, PI: H. Richer). This unique data set was obtained to address many scientific questions that demand a very deep, panchromatic, and panoramic view of the cluster's stellar populations. In total, the program obtained over 0.75 Ms of imaging exposure time with the three HST cameras, over a time span of 9 months in 2010. The primary ACS field was imaged in the two broadband filters F606W and F814W, at 13 orientations, for all 121 orbits. The parallel WFC3 imaging provides a panchromatic (0.4-1.7 {mu}m) and contiguous imaging swath over a 250 Degree-Sign azimuthal range at impact radii of 6.5-17.9 pc in 47 Tuc. This imaging totals over 60 arcmin{sup 2} in area and utilizes the F390W and F606W broadband filters on WFC3/UVIS and the F110W and F160W broadband filters on WFC3/IR. In this paper, we describe the observational design of the new survey and one of the methods used to analyze all of the imaging data. This analysis combines over 700 full-frame images taken with the three HST cameras into a handful of ultra-deep, well-sampled combined images in each of the six filters. We discuss in detail the methods used to calculate accurate transformations that provide optimal alignment of the input images, the methods used to perform sky background offsets in the input stack and the flagging of deviant pixels, and the balance reached between the input-pixel drop size onto an output supersampled pixel grid. Careful photometric, morphological, and astrometric measurements are performed on the stacks using iterative PSF-fitting techniques, and reveal unprecedented color-magnitude diagrams of the cluster extending to >30th magnitude in the optical, 29th magnitude in the UV, and 27th magnitude in the IR. The data set provides a characterization of the complete stellar populations of 47 Tuc, extending from the faintest hydrogen-burning dwarfs through the main-sequence and giant branches down to very cool white dwarf remnants in the cluster. The imaging also provides the deepest probe of the stellar populations of the background Small Magellanic Cloud galaxy, resolving low-mass main-sequence dwarfs with M {approx}< 0.2 M{sub Sun }.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2013

AGC-2 Graphite Preirradiation Data Analysis Report

This report describes the specimen-loading order and documents all preirradiation examination material property measurement data for graphite specimens contained within the Second Advanced Graphite Capsule (AGC-2) irradiation capsule.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2018

ALS/Milo: BL402 RSXD data analysis

Suite of tools designed to simply data collection, extraction, reduction, and plotting for resonant soft x-ray scattering experiments performed at ALS beamline 4.0.2; speeds up the process of converting data into meaningful information for users to publish experimental results. * Python software routines for processing CCD images, including reciprocal space maps, diffraction peak alignment, resonant spectral profiles, line-cut comparisons, coordinate transforms, etc. * Scan file generator, optimized for typical uses cases, reduces burden on users by handling complex operations behind the scenes of a simplified user interface * Deployed at beamline endstation computers; packaged and deployable as standardized PyPI package * Under version control (git) and hosted on LBL-sponsored repository (bitbucket)

Shafer, Padraic↗
DOE OSTI2025

Brazilian CBP - Technoeconomic analysis data

This data is related to the paper entitled "Techno-economic analysis of sugarcane bagasse and straw conversion into cellulosic ethanol via consolidated bioprocessing". That features the evaluation of sugarcane bagasse and straw conversion to ethanol at stand-alone facilities generating electricity from residues. The following scenarios were evaluated: Conventional, featuring hydrothermal pretreatment, fungal cellulase, and yeast fermentation (current commercial standard); Mid-term consolidated bioprocessing (CBP), relying on bagasse solubilization without pretreatment or cotreatment; and Mature CBP, incorporating cotreatment but no pretreatment and considering significant technological advance of the CBP. Available here are the spreadsheets used for Material and Energy balance calculation, Capital and Operational costs estimation and Cash flow analysis. Also available are the description and python code used for Monte Carlo analysis of the ethanol and capital investment variations. This data can be used as a source to implement other techno-economic analysis in the biorefinary context.

09 BIOMASS FUELS↗
DOE OSTI2011

{chi}{sup 2} versus median statistics in supernova type Ia data analysis

In this paper we compare the performances of the {chi}{sup 2} and median likelihood analysis in the determination of cosmological constraints using type Ia supernovae data. We perform a statistical analysis using the 307 supernovae of the Union 2 compilation of the Supernova Cosmology Project and find that the {chi}{sup 2} statistical analysis yields tighter cosmological constraints than the median statistic if only supernovae data is taken into account. We also show that when additional measurements from the cosmic microwave background and baryonic acoustic oscillations are considered, the combined cosmological constraints are not strongly dependent on whether one applies the {chi}{sup 2} statistic or the median statistic to the supernovae data. This indicates that, when complementary information from other cosmological probes is taken into account, the performances of the {chi}{sup 2} and median statistics are very similar, demonstrating the robustness of the statistical analysis.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2014

A Visual Analytics Approach to Structured Data Analysis to Enhance Nonproliferation and Arms Control Verification Activities

Analysis activities for Nonproliferation and Arms Control verification require the use of many types of data. Tabular structured data, such as Excel spreadsheets and relational databases, have traditionally been used for data mining activities, where specific queries are issued against data to look for matching results. The application of visual analytics tools to structured data enables further exploration of datasets to promote discovery of previously unknown results. This paper discusses the application of a specific visual analytics tool to datasets related to the field of Arms Control and Nonproliferation to promote the use of visual analytics more broadly in this domain. Visual analytics focuses on analytical reasoning facilitated by interactive visual interfaces (Wong and Thomas 2004). It promotes exploratory analysis of data, and complements data mining technologies where known patterns can be mined for. Also with a human in the loop, they can bring in domain knowledge and subject matter expertise. Visual analytics has not widely been applied to this domain. In this paper, we will focus on one type of data: structured data, and show the results of applying a specific visual analytics tool to answer questions in the Arms Control and Nonproliferation domain. We chose to use the T.Rex tool, a visual analytics tool developed at PNNL, which uses a variety of visual exploration patterns to discover relationships in structured datasets, including a facet view, graph view, matrix view, and timeline view. The facet view enables discovery of relationships between categorical information, such as countries and locations. The graph tool visualizes node-link relationship patterns, such as the flow of materials being shipped between parties. The matrix visualization shows highly correlated categories of information. The timeline view shows temporal patterns in data. In this paper, we will use T.Rex with two different datasets to demonstrate how interactive exploration of the data can aid an analyst with arms control and nonproliferation verification activities. Using a dataset from PIERS (PIERS 2014), we will show how container shipment imports and exports can aid an analyst in understanding the shipping patterns between two countries. We will also use T.Rex to examine a collection of research publications from the IAEA International Nuclear Information System (IAEA 2014) to discover collaborations of concern. We hope this paper will encourage the use of visual analytics structured data analytics in the field of nonproliferation and arms control verification. Our paper outlines some of the challenges that exist before broad adoption of these kinds of tools can occur and offers next steps to overcome these challenges.

arms control↗
DOE OSTI2013

AGC-2 Graphite Preirradiation Data Analysis Report (Revision 1)

This report described the specimen loading order and documents all pre-irradiation examination material property measurement data for the graphite specimens contained within the second Advanced Graphite Capsule (AGC-2) irradiation capsule. The AGC-2 capsule is the second in six planned irradiation capsules comprising the Advanced Graphite Creep (AGC) test series. The AGC test series is used to irradiate graphite specimens allowing quantitative data necessary for predicting the irradiation behavior and operating performance of new nuclear graphite grades to be generated which will ascertain the in-service behavior of the graphite for pebble bed and prismatic Very High Temperature Reactor (VHTR) designs. Similar to the AGC-1 specimen pre-irradiation examination report, material property tests were conducted on specimens from 18 nuclear graphite types but on an increased number of specimens (512) prior to loading into the AGC-2 irradiation assembly. All AGC-2 specimen testing was conducted at Idaho National Laboratory (INL) from October 2009 to August 2010. This report also details the specimen loading methodology for the graphite specimens inside the AGC-2 irradiation capsule. The AGC-2 capsule design requires “matched pair” creep specimens that have similar dose levels above and below the neutron flux profile mid-plane to provide similar specimens with and without an applied load. This document utilized the neutron flux profile calculated for the AGC-2 capsule design, the capsule dimensions, and the size (length) of the selected graphite and silicon carbide samples to create a stacking order that can produce “matched pairs” of graphite samples above and below the AGC-2 capsule elevation mid-point to provide specimens with similar neutron dose levels.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2021

Development of a deep learning based automated data analysis for step-filter x-ray spectrometers in support of high-repetition rate short-pulse laser-driven acceleration experiments

We present a deep learning based framework for real-time analysis of a differential filter based x-ray spectrometer that is common on short-pulse laser experiments. The analysis framework was trained with a large repository of synthetic data to retrieve key experimental metrics, such as slope temperature. With traditional analysis methods, these quantities would have to be extracted from data using a time-intensive and manual analysis. Furthermore, this framework was developed for a specific diagnostic, but may be applicable to a wide variety of diagnostics common to laser experiments and thus will be especially crucial to the development of high-repetition rate (HRR) diagnostics for HRR laser systems that are coming online.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2022

Performance Debugging and Tuning of Flash-X with Data Analysis Tools

State-of-the-art multiphysics simulations running on large scale leadership computing platforms have many variables contributing to their performance and scaling behavior. We recently encountered an interesting performance anomaly in Flash-X, a multiphysics multicomponent simulation software, when characterizing its performance behavior on several large-scale HPC platforms. The anomaly was tracked down to the interaction between the use of dynamic allocation of scratch data and data locality in the cache hierarchy. In this paper we present the details of unexpected performance variability of Flash-X, its extensive analysis using the performance measurement tool TAU to collect the data and Python data analysis libraries to explore the data, and our insights from this experience. In this process, we discovered and removed or mitigated two additional performance limiting bottlenecks for performance tuning.

Huck, Kevin↗
DOE OSTI2021

A Co-design Framework for Online Data Analysis and Reduction

Science applications preparing for the exascale era are increasingly exploring in situ computations comprising of simulation-analysis-reduction pipelines coupled in-memory. Efficient composition and execution of such complex pipelines for a target platform is a codesign process that evaluates the impact and tradeoffs of various application- and system-specific parameters. In this article, we describe a toolset for automating performance studies of composed HPC applications that perform online data reduction and analysis. We describe Cheetah, a new framework for composing parametric studies on coupled applications, and Savanna, a runtime engine for orchestrating and executing campaigns of codesign experiments. Furthermore, this toolset facilitates understanding the impact of various factors such as process placement, synchronicity of algorithms, and storage versus compute requirements for online analysis of large data. Ultimately, we aim to create a catalog of performance results that can help scientists understand tradeoffs when designing next-generation simulations that make use of online processing techniques. We illustrate the design of Cheetah and Savanna, and present application examples that use this framework to conduct codesign studies on small clusters as well as leadership class supercomputers.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2015

Data Analysis for Explosive Firesets [Poster]

I analyzed the data from various detonators at different initial voltages to find the RLC values (resistance, inductance, capacitance) of the fireset. The data I was given contained a current and voltage for each time value taken on nanosecond intervals. From this, I was able to make plots of several variables to try and find which if any of variables correlated with a burst or a go. These results will allow us to fully understand what is required to achieve a burst in the bridgewire so that we can know what is safe or what will never cause detonation. We may also be able to predict the outcome of using the same fireset with different detonators or with different sizes or materials of bridgewire.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗
DOE OSTI2014

AGC-1 Irradiation Creep Strain Data Analysis

This Technical Memorandum (TM) fulfills milestone 4.2 of SOW-112178 “VHTR TDO GRAPHITE R&D – FY2014”, a level 2 deliverable due to the Department of Energy on September 30, 2014. Here we report the creep strain data and the analysis of the creep strain data from the irradiation creep capsule AGC-1 specimens that were supplied to ORNL. This is the first (prototype) of a series of five or six capsules planned as part of the Advanced Graphite Creep (AGC) experiment to fully characterize the neutron irradiation effects and radiation creep behavior of current nuclear graphites. The data reported include: specimen dimensions and hence the dimensional change upon irradiation. A comparison of these data for specimen matched pairs yields the creep strain; mass and volume, hence density. The creep strain analysis is by graphite grade. The AGC-1 capsule was irradiated in the Advanced Test Reactor (ATR) at INL at approximately 700°C and to a peak dose of 7 dpa (displacements per atom). The specimens final dose, temperature and stress conditions have been reported by INL1,2 are also tabulated here and used in the analysis.

Graphite Creep↗