Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data analytics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,387 records · Page 77

Mini-apps for high performance data analysis

Scaling-up scientific data analysis and machine learning algorithms for data-driven discovery is a grand challenge that we face today. Despite the growing need for analysis from science domains that are generating `Big Data' from instruments and simulations, building high-performance analytical workflows of data-intensive algorithms have been daunting because: (i) the `Big Data' hardware and software architecture landscape is constantly evolving, (ii) newer architectures impose new programming models, and (iii) data-parallel kernels of analysis algorithms and their performance facets on different architectures are poorly understood. To address these problems, we have: (i) identified scalable data-parallel kernels of popular data analysis algorithms, (ii) implemented `Mini-Apps' of those kernels using different programming models (e.g. Map Reduce, MPI, etc.), (iii) benchmarked and validated the performance of the kernels in diverse architectures. In this paper, we discuss two of those Mini-Apps and show the execution of principal component analysis built as a workflow of the Mini-Apps. We show that Mini-Apps enable scientists to (i) write domain-specific data analysis code that scales on most HPC hardware and (ii) and offers the ability (most times with over a 10x speed-up) to analyze data sizes 100 times the size of what off-the-shelf desktop/workstations of today can handle.

Sukumar, Sreenivas R.↗

A Short Survey on the State of the Art in Architectures and Platforms for Large Scale Data Analysis and Knowledge Discovery from Data

Intended as a survey for practicing architects and researchers seeking an overview of the state-of-the-art architectures for data analysis, this paper provides an overview of the emerg- ing data management and analytic platforms including par- allel databases, Hadoop-based systems, High Performance Computing (HPC) platforms and platforms popularly re- ferred to as NoSQL platforms. Platforms are presented based on their relevance, analysis they support and the data organization model they support.

99 GENERAL AND MISCELLANEOUS↗

Precise analysis of {pi}{pi} scattering data from Roy equations and forward dispersion relations

We review our recent analysis of {pi}{pi} scattering data in terms of Roy equations and Forward Dispersion Relations, and present some preliminary results in terms of a new set of once-subtracted coupled equations for partial waves. The first analysis consists of independent fits to the different {pi}{pi} channels that satisfies rather well the dispersive representation. In the second analysis we constrain the fit with the dispersion relations. The latter provides a very precise and model independent description of data using just analyticity, causality and crossing.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Total metal, carbon, anion, iron speciation, and sulfide concentrations; Slate River, East River, and Trail Creek surface water and floodplains, Crested Butte, CO; May 2023–August 2023

This data package comprises analytical results and metadata from stream and groundwater samples collected from the Slate River, East River, Trail Creek, and their respective floodplains. This dataset contains five files: (1) a samples file (2023_SFA_Field_samples.csv) that contains site information; (2) a chemical analysis data file (2023_FieldWaterSampleData_IC__ICPOES__ICPMS__TOC__Fe__S_chem_data.csv) that contains sample analysis values; (3) a file-level metadata file (flmd.csv) that lists each file contained in the dataset with associated metadata; (4) a data dictionary file (dd.csv) that contains column/row headers used throughout the files along with definitions, units, and data types; and (5) a methods file (methods.csv) that contains ID, type, description, instrument, and lab information for each method.The samples’ anion concentrations were measured using ion chromatography (IC), total metal concentrations using inductively coupled plasma emission spectrometry (ICP-OES) and inductively coupled plasma mass spectrometry (ICP-MS), non-purgeable organic carbon using total organic carbon (TOC) analysis, dissolved sulfide concentration using methylene blue spectrophotometry, and iron speciation using the ferrozine assay. To support bulk chemical analyses and colloid characterization, samples were collected from multiple depths ranging from the surface to 3.5 meters below ground.Update on 2024-10-18: Updates were made to the 2023_FieldWaterSampleData_IC__ICPOES__ICPMS__TOC__Fe__S_chem_data.csv and dd.csv files to correct units (ppb instead of ppm).

54 ENVIRONMENTAL SCIENCES↗

Automatic Analyte-Ion Recognition and Background Removal for Ambient Mass-Spectrometric Data Based on Cross-Correlation

Ambient mass spectrometry is a powerful approach for rapid, high-throughput, and direct sample analysis. Due to the open-air desorption and ionization processes, random fluctuations of ambient conditions can lead to large variances in mass-spectral signals over time. The mass-spectral data also can be further complicated due to multiple analytes present in the sample, background-ion signals stemming from the desorption/ionization source itself, and other laboratory-specific conditions (e.g., ambient laboratory air, nearby hardware). Thus, background removal and analyte-ion recognition can be quite difficult, particularly in non-targeted analyses. Here, we demonstrate the use of a cross-correlation-based approach to exploit chemical information encoded in the time domain to group/categorize mass-spectral peaks from a single analysis dataset. Ions that originate from ambient (or other) background species were readily flagged and removed from spectra; the result was a decrease in mass-spectral complexity by over 70% due to the removal of these background ions. Meanwhile, analyte ions were differentiated and categorized based on their time-domain profiles. With sufficient mass resolving-power and mass-spectral acquisition rate, isolated mass spectra containing ions from the same species in a sample could be extracted, leading to a reduction in mass-spectral complexity by more than 98% in some cases. The cross-correlation approach was tested with different ionization sources as well as reproducible and irreproducible sample introduction. Software built in-house enabled fully automated data processing, which can be performed within a few seconds. Ultimately, this approach provides an additional dimension of analyte separation in ambient mass-spectrometric analyses with information that is already recorded throughout the analysis. .

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

A Reasoning And Hypothesis-Generation Framework Based On Scalable Graph Analytics

Finding actionable insights from data has always been difficult. As the scale and forms of data increase tremendously, the task of finding value becomes even more challenging. Data scientists at Oak Ridge National Laboratory are leveraging unique leadership infrastructure (e.g. Urika-XA and Urika-GD appliances) to develop scalable algorithms for semantic, logical and statistical reasoning with unstructured Big Data. We present the deployment of such a framework called ORiGAMI (Oak Ridge Graph Analytics for Medical Innovations) on the National Library of Medicine s SEMANTIC Medline (archive of medical knowledge since 1994). Medline contains over 70 million knowledge nuggets published in 23.5 million papers in medical literature with thousands more added daily. ORiGAMI is available as an open-science medical hypothesis generation tool - both as a web-service and an application programming interface (API) at http://hypothesis.ornl.gov . Since becoming an online service, ORIGAMI has enabled clinical subject-matter experts to: (i) discover the relationship between beta-blocker treatment and diabetic retinopathy; (ii) hypothesize that xylene is an environmental cancer-causing carcinogen and (iii) aid doctors with diagnosis of challenging cases when rare diseases manifest with common symptoms. In 2015, ORiGAMI was featured in the Historical Clinical Pathological Conference in Baltimore as a demonstration of artificial intelligence to medicine, IEEE/ACM Supercomputing and recognized as a Centennial Showcase Exhibit at the Radiological Society of North America (RSNA) Conference in Chicago. The final paper will describe the workflow built for the Cray Urika-XA and Urika-GD appliances that is able to reason with the knowledge of every published medical paper every time a clinical researcher uses the tool.

graph analytics↗

Pathosphere.org: pathogen detection and characterization through a web-based, open source informatics platform

The detection of pathogens in complex sample backgrounds has been revolutionized by wide access to next-generation sequencing (NGS) platforms. However, analytical methods to support NGS platforms are not as uniformly available. Pathosphere (found at Pathosphere.org) is a cloud - based open - sourced community tool that allows for communication, collaboration and sharing of NGS analytical tools and data amongst scientists working in academia, industry and government. The architecture allows for users to upload data and run available bioinformatics pipelines without the need for onsite processing hardware or technical support. The pathogen detection capabilities hosted on Pathosphere were tested by analyzing pathogen-containing samples sequenced by NGS with both spiked human samples as well as human and zoonotic host backgrounds. Pathosphere analytical pipelines developed by Edgewood Chemical Biological Center (ECBC) identified spiked pathogens within a common sample analyzed by 454, Ion Torrent, and Illumina sequencing platforms. ECBC pipelines also correctly identified pathogens in human samples containing arenavirus in addition to animal samples containing flavivirus and coronavirus. These analytical methods were limited in the detection of sequences with limited homology to previous annotations within NCBI databases, such as parvovirus. Utilizing the pipeline-hosting adaptability of Pathosphere, the analytical suite was supplemented by analytical pipelines designed by the United States Army Medical Research Institute of Infectious Diseases and Walter Reed Army Institute of Research (USAMRIID-WRAIR). These pipelines were implemented and detected parvovirus sequence in the sample that the ECBC iterative analysis previously failed to identify. By accurately detecting pathogens in a variety of samples, this work demonstrates the utility of Pathosphere and provides a platform for utilizing, modifying and creating pipelines for a variety of NGS technologies developed to detect pathogens in complex sample backgrounds. These results serve as an exhibition for the existing pipelines and web-based interface of Pathosphere as well as the plug-in adaptability that allows for integration of newer NGS analytical software as it becomes available.

59 BASIC BIOLOGICAL SCIENCES↗

Edge-computing with enhanced standoff sensors

A system senses analytes through one or more sensors that detect or measure a physical characteristic. The one or more sensor generate a spectroscopic-data signal corresponding to the detection. An edge device communicatively couples the one or more sensors that communicatively couples a wide-area network coupling a cloud service. The edge device includes a data acquisition device that receives spectroscopic data signals from the one or more sensor and a processor that processes the spectroscopic-data signals to identify an analyte. The edge device also includes a transceiver that transmits data identifying the analytes to the cloud service.

Passian, Ali↗

Grid Utility Asset Vulnerability Assessment (GUAVA) Software Tool

Increasing demand and changes in generation portfolios is pushing power grid to operate towards the limit. However, due to lack of analytical tools for understanding various scales of impact on grid, it is becoming more vulnerable to wide scale power outages and blackouts. A vulnerable grid operating at its limit can be easily disrupted by asset failures caused by devastating hurricanes which has been known to damage transmission and distribution lines along its track. In this direction, researchers have focused on determining these assets by conducting Monte Carlo simulations of hurricanes with uncertainties and collected a large set of simulation data. To determine the infrastructure updates necessary for mitigating wide scale impact of hurricanes on the grid, we propose a software tool named “Grid Utility Asset Vulnerability Analysis” (GUAVA) framework. GUAVA presents a novel data-driven probabilistic analytical approach to (1) post-process hurricane failure scenarios, (2) identify/rank assets that are most vulnerable and critical to failing and are associated with highest impact/risk, and (3) to inform system upgrade decisions & prioritization. Based on the observed results and employed data-driven methodology, it is expected GUAVA can be adapted to provide power system planners with a recommendation engine for making informed decisions to improve resilience of grid.

Mahapatra, Kaveri↗

Coupled Lattice Boltzmann Modeling Framework for Pore-Scale Fluid Flow and Reactive Transport

In this paper, we propose a modeling framework for pore-scale fluid flow and reactive transport based on a coupled lattice Boltzmann model (LBM). We develop a modeling interface to integrate the LBM modeling code parallel lattice Boltzmann solver and the PHREEQC reaction solver using multiple flow and reaction cell mapping schemes. The major advantage of the proposed workflow is the high modeling flexibility obtained by coupling the geochemical model with the LBM fluid flow model. Consequently, the model is capable of executing one or more complex reactions within desired cells while preserving the high data communication efficiency between the two codes. Meanwhile, the developed mapping mechanism enables the flow, diffusion, and reactions in complex pore-scale geometries. We validate the coupled code in a series of benchmark numerical experiments, including 2D single-phase Poiseuille flow and diffusion, 2D reactive transport with calcite dissolution, as well as surface complexation reactions. The simulation results show good agreement with analytical solutions, experimental data, and multiple other simulation codes. In addition, we design an AI-based optimization workflow and implement it on the surface complexation model to enable increased capacity of the coupled modeling framework. Compared to the manual tuning results proposed in the literature, our workflow demonstrates fast and reliable model optimization results without incorporating pre-existing domain knowledge.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Enabling Efficient Surveillance, Control, and Automation of Geothermal Operations with Advanced Predictive Analytics

Automation and control of geothermal energy production and operations require reliable and efficient predictive tools. While physics-based simulation offers a comprehensive tool for predicting energy production performance in geothermal systems, predicting the behavior of geothermal reservoirs involves complex multi-physics processes with coupling effects, highly uncertain input parameters and subsurface descriptions. Moreover, building, running, and integrating simulation models into standard model calibration and optimization workflows entail significant technical and computational efforts. An emerging alternative to physics-based simulation is data-driven predictive analytics models that have gained popularity in energy industry. In this report, we develop novel predictive models for integration into real-time fault diagnosis and model predictive control algorithms to improve the efficiency of energy production operations in geothermal reservoirs. The report includes two major research Thrust Areas, that is, the surface power plant and the subsurface reservoir.

15 GEOTHERMAL ENERGY↗

Centroidal Voronoi tessellation based methods for optimal rain gauge location prediction

With more satellite and model precipitation data becoming available, new analytical methods are needed that can take advantage of emerging data patterns to make well informed predictions in many hydrological applications. Herein we propose a new strategy where we extract precipitation variability patterns and use correlation map to build the resulting density map that serves as an input to centroidal Voronoi tessellation construction that optimizes placement of precipitation gauges. We provide results of numerical experiments based on the data from the Alto-Adige region in Northern Italy and Oklahoma and compare them against actual gauge locations. This method provides an automated way for choosing new gauge locations and can be generalized to include physical constraints and to tackle other types of resource allocation problems.

54 ENVIRONMENTAL SCIENCES↗

The Effect of Grain Boundary Facet Junctions on Segregation and Embrittlement

Junctions are discontinuities in flat grain boundaries that arise in all polycrystalline materials and are thought to play important roles in the response of a grain boundary network to thermal and mechanical loads. A key open question concerns the mechanisms by which solute segregation to junctions impacts properties of the grain boundary. Here, in this work, we investigate the influence of grain boundary facet junctions on solute embrittlement, and we present an analytical model that uses the hydrostatic stress field contributed by dislocations at multiple junctions to describe these effects. Specifically, we study junctions between {112} facets of various lengths in Au $\langle111\rangle$ Σ3 tilt grain boundaries. Copper and silver solutes are employed to determine if the effect of junctions on solute segregation and embrittlement is dependent on size relative to the host. Combined, atomistic simulation data and the analytical model show that Cu and Ag have opposite segregation responses to junctions due to the sign of the hydrostatic stress field induced by junctions. However, a positive shift in the embrittling potency is computed near junctions regardless of solute type or the stress state of the segregation site. Hence, for the conditions studied, junctions consistently shift the energetic landscape towards embrittlement.

36 MATERIALS SCIENCE↗

Fallon, NV FORGE well 21-31 Lithology, Mineral, Image Log, and Injection Test data

Attached is 5 datasets collected from Fallon FORGE well 21-31 located in Churchill County, Nevada collected and interpreted between Feburary 2018-January 2020. This submission includes 1) new lithology interpretation derived from petrographic thin sections of sidewall cores taken from well 21-31, 2) X-Ray Diffraction (XRD) interpretation of sidewall cores and cuttings from well 21-31, 3) Hyperspectral (Short-Wave Infrared and Long-Wave Infrared) interpretation of cuttings and sidewall cores from well 21-31, 4) Interpretation of Formation MicroImager (FMI) and Borehole Televiewer (BHTV) image logs for natural fractures and induced structures for well 21-31, 5) Injection test data and associated analytical model parameters from well testing of well 21-31.

15 GEOTHERMAL ENERGY↗

Development and validation of a quantitative proton NMR method for the analysis of pregnenolone

Pregnenolone (PREG) is an endogenous steroid frequently sold as an over-the-counter dietary supplement touted to promote neurological and immunological health. While the PREG dietary supplement is added to the diet for health benefits, there are no FDA approved PREG drugs. However, compounded PREG drug products are available to U.S. patients. The FDA works with state regulatory authorities on the oversight of compounding activities, including developing 503A and 503B lists of bulk substances that compounders are permitted to use. PREG is one of the substances publicly nominated to be included on the 503B list. Compounded hormone therapies such as those using PREG are of interest given the lack of standardization in compounded drug products which may increase the possibility of underdosing, overdosing, or contamination. However, no USP monograph currently exists to evaluate the quality of PREG drug substance or product. To address knowledge gaps and assist in quality control, a simple and rapid quantitative proton nuclear magnetic resonance spectroscopy (qNMR) method for the identification and assay of PREG in different types of PREG products was developed and validated. PREG samples were characterized using 1D 1 H and 2D 1 H– 13 C HSQC NMR spectra. The qNMR assay method (taking approximately 10 min per NMR spectrum) was validated for precision, accuracy, specificity, robustness and linearity per ICH Q2(R1) guidance. The method was validated in a range from 0.032 to 3.2 mg/mL. As a proof of concept, seven PREG bulk substance samples, three tablet and two capsule PREG dietary supplements were assessed by the qNMR analytical procedure. NMR data from all tested samples met the expected criteria for identification and assay. The results demonstrate the potential of qNMR for the quality assessment of different types of PREG samples.

60 APPLIED LIFE SCIENCES↗

Distributed wireless sensing for fugitive methane leak detection

Large scale environmental monitoring requires dynamic optimization of data transmission, power management, and distribution of the computational load. In this work, we demonstrate the use of a wireless sensor network for detection of chemical leaks on gas oil well pads. The sensor network consist of chemi-resistive and wind sensors and aggregates all the data and transmits it to the cloud for further analytics processing. The sensor network data is integrated with an inversion model to identify leak location and quantify leak rates. We characterize the sensitivity and accuracy of such system under multiple well controlled methane release experiments. It is demonstrated that even 1 hour measurement with 10 sensors localizes leaks within 1 m and determines leak rate with an accuracy of 40%. This integrated sensing and analytics solution is currently refined to be a robust system for long term remote monitoring of methane leaks, generation of alarms, and tracking regulatory compliance.

04 OIL SHALES AND TAR SANDS↗