Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data analytics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 361 records · Page 20
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Well Stimulation Treatment in California: Evaluation of Disclosure Data, May 2015 – October 2019

In this document, disclosure data from 1,228 well stimulations occurring May 2015 to October 2019 in California are evaluated. This evaluation updates a previous study that was based on 618 well stimulations occurring May 2015 to June 2016 (Stringfellow, W.T., Camarillo, M.K., and Jordan, P. 2017, Status of Well Stimulation in California Since Implementation of SB-4 Regulations, Berkeley National Laboratory, Berkeley, CA). While the goal of the previous study was to provide a summary of information obtained since passage of California Senate Bill No. 4—Oil and Gas, the goal of the current evaluation is to provide a basis for studying chemical indicators that could potentially be used to detect aquifer contamination. We evaluate chemical indicators is a separate document using the data contained herein as well as data from monitoring wells located within oil fields. Compared with the data used by Stringfellow et al. 2017, the current evaluation is based on a more diverse data set. While the previous study contained data for only two oil fields with more than 30 well stimulations, the current data set contains four oil fields with more than 30 well stimulations, making these data more ideal for comparisons using statistical tests. More producers and a new oil field, Buena Vista Nose, are represented in the current data set. Some well stimulation practices remain relatively unchanged since the previous study. Well stimulation is mostly occurring in Kern County with the exception of a single well stimulation in Orange County. Almost all well stimulations are hydraulic fracturing. The current data set contains two acid fracturing treatments and one matrix acidizing treatment. The median number of chemicals added per well stimulation—excluding water and proppant—was previously 21; the number in the expanded data set is 20. Median water added per well stimulation was previously 89,000 gallons and is now 98,000 gallons. While this water use represents a 10% increase, water use for hydraulic fracturing in California is still lower than water use in other oil and gas fields. Chemical formulations appear to have shifted since the previous study. This shift may be related to a change in the predominant service company. We identified 26 chemicals for which the frequency of use has changed by more than 30%. The total number of chemicals used has also expanded. Previously, 178 unique chemicals were identified as being added to well stimulation fluids. The total number of unique chemicals is now 205. Analytical data available for base and recovered fluids has expanded. The number of base fluid samples has increased from 12 to 35 and the number of recovered fluid samples has increased from 1,078 to 2,166. The expanded data set is more ideal for an evaluation of indicator chemicals and comparisons across different formations. The analytical data for recovered fluid samples indicates that many ions, radioactive constituents, and organics are consistently observed, making these chemicals ideal for consideration as potential indicators of aquifer contamination.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2015

Big–deep–smart data in imaging for guiding materials design

Harnessing big data, deep data, and smart data from state-of-the-art imaging might accelerate the design and realization of advanced functional materials. Here we discuss new opportunities in materials design enabled by the availability of big data in imaging and data analytics approaches, including their limitations, in material systems of practical interest. We specifically focus on how these tools might help realize new discoveries in a timely manner. Such methodologies are particularly appropriate to explore in light of continued improvements in atomistic imaging, modelling and data analytics methods.

36 MATERIALS SCIENCE↗
DOE OSTI2017

Toward General Software Level Silent Data Corruption Detection for Parallel Applications

Silent data corruption (SDC) poses a great challenge for high-performance computing (HPC) applications as we move to extreme-scale systems. Mechanisms have been proposed that are able to detect SDC in HPC applications by using the peculiarities of the data (more specifically, its “smoothness” in time and space) to make predictions. However, these data-analytic solutions are still far from fully protecting applications to a level comparable with more expensive solutions such as full replication. In this work, we propose partial replication to overcome this limitation. More specifically, we have observed that not all processes of an MPI application experience the same level of data variability at exactly the same time. Thus, we can smartly choose and replicate only those processes for which the lightweight data-analytic detectors would perform poorly. In addition, we propose a new evaluation method based on the probability that a corruption will pass unnoticed by a particular detector (instead of just reporting overall single-bit precision and recall). Here in our experiments, we use four applications dealing with different explosions. Finally, our results indicate that our new approach can protect the MPI applications analyzed with 7–70% less overhead (depending on the application) than that of full duplication with similar detection recall.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Chemically Enabled CO 2 -Enhanced Oil Recovery in Multi-Porosity, Hydrothermally Altered Carbonates in the Southern Michigan Basin - Task 2 Topical Report

This attachment A is a detailed Topical Report for Task 2 (Advanced Field Characterization and Machine Learning Based Data Integration) under the project "Chemically Enabled CO 2 -Enhanced Oil Recovery in Multi-Porosity, Hydrothermally Altered Carbonates in the Southern Michigan Basin." The overall project activity and finding, including the field pilot testing of CO 2 injection are summarized in the companion Final Technical Report The Advanced Field Characterization and Machine Learning Based Data Integration task (Task 2) involved a systematic geologic characterization of the Trenton-Black River (TBR) play in the SMB which included the development of comprehensive datasets, advanced data analytics, risk assessment, and piggyback field characterization. These activities aimed to address the complex carbonate systems by evaluating the extent of fractures, dolomitization, facies, and reservoir properties with the primary objective of informing the static and dynamic modeling, field injection test, and providing input into the development strategy plan. The task was divided into four subtasks: • Subtask 2.1 – Data compilation, review, and analysis • Subtask 2.2 – Risk Assessment • Subtask 2.3 – Advanced Field Characterization • Subtask 2.4 – Integrated Physics-Based Machine Learning and Advanced Data Analytics

02 PETROLEUM↗
DOE OSTI2015

Baseline Risk Assessment Supporting Closure at Waste Management Area C at the Hanford Site Washington

The Office of River Protection under the U.S. Department of Energy is pursuing closure of the Single-Shell Tank (SST) Waste Management Area (WMA) C under the requirements of the Hanford Federal Facility Agreement and Consent Order (HFFACO). A baseline risk assessment (BRA) of current conditions is based on available characterization data and information collected at WMA C. The baseline risk assessment is being developed as a part of a Resource Conservation and Recovery Act (RCRA) Facility Investigation (RFI)/Corrective Measures Study (CMS) at WMA C that is mandatory under Comprehensive Environmental Response, Compensation, and Liability Act and RCRA corrective action. The RFI/CMS is needed to identify and evaluate the hazardous chemical and radiological contamination in the vadose zone from past releases of waste from WMA C. WMA C will be under Federal ownership and control for the foreseeable future, and managed as an industrial area with restricted access and various institutional controls. The exposure scenarios evaluated under these conditions include Model Toxics Control Act (MTCA) Method C, industrial worker, maintenance and surveillance worker, construction worker, and trespasser scenarios. The BRA evaluates several unrestricted land use scenarios (residential all-pathway, MTCA Method B, and Tribal) to provide additional information for risk management. Analytical results from 13 shallow zone (0 to 15 ft. below ground surface) sampling locations were collected to evaluate human health impacts at WMA C. In addition, soil analytical data were screened against background concentrations and ecological soil screening levels to determine if soil concentrations have the potential to adversely affect ecological receptors. Analytical data from 12 groundwater monitoring wells were evaluated between 2004 and 2013. A screening of groundwater monitoring data against background concentrations and Federal maximum concentration levels was used to determine vadose zone contamination impacts on groundwater. Waste Management Area C is the first of the Hanford tank farms to begin the closure planning process. The current baseline risk assessment will provide valuable information for making corrective actions and closure decisions for WMA C, and will also support the planning for future tank farm soil investigation and baseline risk assessments.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2025

Technical Assessment of the Application of Digital Twin and Prognostic Tools for Condition Monitoring

This report was prepared for the U.S. Nuclear Regulatory Commission (NRC) to present use cases of the application of advanced technologies toward meeting the current and future regulatory requirements for maintenance and condition monitoring of structures, systems, and components (SSCs). The advanced technologies considered in this work, collectively referred to as digital twin (DT) technologies, are advanced sensors and instrumentation, data analytics, machine learning and artificial intelligence (ML/AI), and physics-based models. The report presents two use cases of reactor coolant pumps (RCPs) and heat pipes in nuclear power plants (NPPs) with technical and regulatory considerations and opportunities in using advanced technologies for conditional monitoring. Key findings from the exploration of these considerations are as follows: - Uncertainties in sensor data and model predictions must be rigorously addressed through validation and verification processes - Regulatory compliance is paramount, necessitating data driven models to be developed in line with existing codes and standards, as well as considering potential future guidelines for advanced reactors - Explainability and transparency in ML/AI models are essential for developing operator trust and regulatory review, including methods that enhance the interpretability of complex data-driven predictions - Condition monitoring programs must be evaluated for their effectiveness in reducing maintenance-preventable function failures (MPFF) and aligning with plant performance criteria - The deployment of advanced technologies for condition monitoring could lead to a transition from periodic to continuous monitoring, thereby optimizing maintenance schedules - Collaborative efforts between industry stakeholders, regulatory bodies, and technology developers are crucial for the successful adoption of advanced technologies for condition monitoring systems in nuclear facilities In summary, the introduction of advanced technologies into condition monitoring programs represents a significant leap forward in the domain of NPP maintenance. By harnessing the capabilities of advanced sensors, data analytics, and ML/AI, NPP operators can transition from a time-based to a condition-based maintenance approach. This shift can potentially enhance the reliability and safety of critical plant components while optimizing maintenance efforts and minimizing unnecessary outages. The NRC is continuing to explore the regulatory aspects of advanced technologies as part of inservice inspection and inservice testing (ISI and IST) programs by pursuing additional research in this technical area.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2017

High-Performance Key-Value Store on OpenSHMEM

Recently, there has been a growing interest in enabling fast data analytics by leveraging system capabilities from large-scale high-performance computing (HPC) systems. OpenSHMEM is a popular run-time system on HPC systems that has been used for large-scale compute-intensive scientific applications. In this paper, we propose to leverage OpenSHMEM to design a distributed in-memory key-value store for fast data analytics. Accordingly, we have developed SHMEMCache on top of OpenSHMEM to leverage its symmetric global memory, efficient one-sided communication operations and general portability. We have also evaluated SHMEMCache through extensive experimental studies. Our results show that SHMEMCache has accomplished significant performance improvements over hte original Memcached in terms of latency and throughput. Our evaluation on the Titan supercomputer has also demonstrated that SHMEMCache can scale to 1024 nodes.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2016

TERRA: Building New Communities for Advanced Biofuels

ARPA-E’s Transportation Energy Resources from Renewable Agriculture (TERRA) program is bringing together top experts from different disciplines – agriculture, robotics and data analytics – to rethink the production of advanced biofuel crops. ARPA-E Program Director Dr. Joe Cornelius discusses the TERRA program and explains how ARPA-E’s model enables multidisciplinary collaboration among diverse communities. The video focuses on two TERRA projects—Donald Danforth Center and Purdue University—that are developing and integrating cutting-edge remote sensing platforms, complex data analytics tools and plant breeding technologies to tackle the challenge of sustainably increasing biofuel stocks.

09 BIOMASS FUELS↗
DOE OSTI2020

Distributed heterogeneous compute infrastructure for the study of additive manufacturing systems

We present the current status of a large-scale computing framework to address the need of the multidisciplinary effort to study chemical dynamics. Specifically, we are enabling scientists to process and store experimental data, run large-scale computationally expensive high-fidelity physical simulation, and analyze these results using the state-of-the-art data analytics tools, machine learning, and uncertainty quantification methods using heterogeneous computing resources, such as CPU and GPU cluster. The framework can integrate or abstract out multiple domains based on roles. In order to develop this framework, we have leveraged an existing framework coupled with in-house heterogeneous computing resources. We present the results of using this framework on a single metadata triggered workflow to accelerate an additive manufacturing use case.

heterogeneous computing, hpc, workflows, reproduci↗
DOE OSTI2020

A Survey of Singular Value Decomposition Methods for Distributed Tall/Skinny Data

The Singular Value Decomposition (SVD) is one of the most important matrix factorizations, enjoying a wide variety of applications across numerous application domains. In statistics and data analysis, the common applications of SVD inclue Principal Components Analysis (PCA) and regression. Usually these applications arise on data that has far more rows than columns, so-called "tall/skinny" matrices. In the big data analytics context, this may take the form of hundreds of millions to billions of rows with only a few hundred columns. There is a need, therefore, for fast, accurate, and scalable tall/skinny SVD implementations which can fully utilize modern computing resources. To that end, we present a survey of three different algorithms for computing the SVD for these kinds of tall/skinny data layouts using MPI for communication. We contextualize these with common big data analytics techniques. Finally, we present both CPU and GPU timing results from the Summit supercomputer, and discuss possible alternative approaches.

Schmidt, Drew↗
DOE OSTI2014

Predicting Student Success using Analytics in Course Learning Management Systems

Educational data analytics is an emerging discipline, concerned with developing methods for exploring the unique types of data that come from the educational context. For example, predicting college student performance is crucial for both the student and educational institutions. It can support timely intervention to prevent students from failing a course, increasing efficacy of advising functions, and improving course completion rate. In this paper, we present the efforts carried out at Oak Ridge National Laboratory (ORNL) toward conducting predictive analytics to academic data collected from 2009 through 2013 and available in one of the most commonly used learning management systems, called Moodle. First, we have identified the data features useful for predicting student outcomes such as students scores in homework assignments, quizzes, exams, in addition to their activities in discussion forums and their total GPA at the same term they enrolled in the course. Then, Logistic Regression and Neural Network predictive models are used to identify students as early as possible that are in danger of failing the course they are currently enrolled in. These models compute the likelihood of any given student failing (or passing) the current course. Numerical results are presented to evaluate and compare the performance of the developed models and their predictive accuracy.

Educational data mining↗
DOE OSTI2022

Energy Efficient Material Processing through Automated Process Monitoring and Controls

Smart manufacturing is bound to play a crucial role in reducing global energy consumption while accelerating economic development. This phenomenon is evident in advanced sensing technology developments, data analytics and machine learning/AI, automated controls, cloud computing, etc. The immediate opportunity for smart manufacturing is to improve the energy efficiency of manufacturing operations through innovations in processes and controls. The manufacturing industry still consumes about 30% of total global energy production, which is significant. This program focused on the recommendation of heterogeneous sensors to monitor the Chemical Vapor Infiltration (CVI) process parameters, states, and key performance indices and utilize cloud computing to sort and analyze the real-time data. Learning through data analytics helps guide the control parameters affecting energy usage. The target process in the program is the CVI process at the Honeywell South Bend facility, which is one of the most energy-intensive manufacturing industries.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2023

Fracture-matrix fluid exchange in oil-bearing unconventional mudstones

The poromechanical properties of unconventional reservoir materials are in large part dictated by their mineralogy. Since these properties govern the response to stress experienced during hydraulic fracturing, fluid production, and fluid injection, they play a central role in the formation of microcracks or bedding delaminations which ultimately dominate mass transport. In this work we study access to the porosity of end member unconventional reservoir materials, where the end members are predominantly dictated by carbonate content. Access to the porosity is quantified using state of the art 3D x-ray computed tomography coupled with physics informed data analytics. Xenon gas, which attenuates x-rays, provides a spatiotemporal map of access to the porosity. The accessible porosity is quantified over a range of net confining stress relevant to the manmade disturbances listed above. These experiments demonstrate that heavily carbonated mudstones are nearly impermeable at the core (~ cm) scale, while carbonate free analogues afford better access to the microstructure. Consistent with previous qualitative 2D radiographs, access to the interior of the clastic mudstones is first observed along planar microcracks, followed by slow penetration into the surrounding matrix. Physics informed data analytics of the 3D tomography measurements presented here show that these microcracks do not permit uniform access to the adjacent rock matrix. In addition, variation of the effective pressure elucidates the mechanisms that govern fracture/matrix fluid exchange. Under conditions consistent with hydrocarbon production fluid accumulates in the immediate vicinity of the nearest microcrack. While there is clear evidence that, as intended, part of this accumulation is from the more distant matrix, fluid is also squeezed out of the microcrack. The fluid build-up at the microcrack indicates that migration out of the rock is hindered by the coupled poroelastic response of the microcrack and adjacent rock matrix. We show that these mechanisms ultimately account for the meager oil recovery factors realized in practice. These insights have implications for making reservoir scale predictions based on core scale observations, and provide a basis for devising new asset development techniques to access more porosity, and enhance fluid extraction. Finally, these findings shed light on key features and mechanisms that govern shale storage capacity, with relevance to other important industrial processes, such as geologic CO 2 storage.

58 GEOSCIENCES↗
DOE OSTI2018

In Situ Monitoring of Groundwater Contamination for Sustainable Remediation Using the Kalman Filter - 18423

Groundwater monitoring is critical for nuclear-related facilities as well as radioactively contaminated sites. Recent advances in sensing, data analytics and simulation capabilities provide substantial opportunities to improve and change current monitoring procedures. In particular, we need a paradigm shift from contaminant-only or compliance-only monitoring programs to comprehensive monitoring, i.e., including other ancillary environmental variables for a holistic understanding of the groundwater systems and plume behaviors. Such new approaches are needed for the effective implementation of sustainable remediation (enhanced and natural attenuation), and they have great potential for cost reduction in site monitoring. This paper reviews recent developments for improving long-term monitoring, with focus on the effective use of in situ sensors, data analytics and simulation capabilities. In particular, we highlight a recent application of the Kalman filter algorithm to estimate contaminant concentrations continuously in real time, based on in-situ measured water quality parameters (e.g. electrical conductance and pH) and sparse groundwater sampling. The results show that we can reduce the groundwater sampling frequency significantly, while capturing the dynamics of short- and long-term contaminant concentration changes. Such advanced and integrated monitoring systems will be beneficial for local residents (e.g., to ensure the safety by detecting adverse events early, enabling a swift response) as well as for site operators (e.g., to gain/improve public acceptance, to be better prepared for litigations and false claims, and to reduce overall monitoring cost). (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2016

Diagnosing the Dynamics of Observed and Simulated Ecosystem Gross Primary Productivity with Time Causal Information Theory Quantifiers

Data analysis and model-data comparisons in the environmental sciences require diagnostic measures that quantify time series dynamics and structure, and are robust to noise in observational data. This paper investigates the temporal dynamics of environmental time series using measures quantifying their information content and complexity. The measures are used to classify natural processes on one hand, and to compare models with observations on the other. The present analysis focuses on the global carbon cycle as an area of research in which model-data integration and comparisons are key to improving our understanding of natural phenomena. We investigate the dynamics of observed and simulated time series of Gross Primary Productivity (GPP), a key variable in terrestrial ecosystems that quantifies ecosystem carbon uptake. However, the dynamics, patterns and magnitudes of GPP time series, both observed and simulated, vary substantially on different temporal and spatial scales. Here we demonstrate that information content and complexity, or Information Theory Quantifiers (ITQ) for short, serve as robust and efficient data-analytical and model benchmarking tools for evaluating the temporal structure and dynamical properties of simulated or observed time series at various spatial scales. At continental scale, we compare GPP time series simulated with two models and an observations-based product. This analysis reveals qualitative differences between model evaluation based on ITQ compared to traditional model performance metrics, indicating that good model performance in terms of absolute or relative error does not imply that the dynamics of the observations is captured well. Furthermore, we show, using an ensemble of site-scale measurements obtained from the FLUXNET archive in the Mediterranean, that model-data or model-model mismatches as indicated by ITQ can be attributed to and interpreted as differences in the temporal structure of the respective ecological time series. At global scale, our understanding of C fluxes relies on the use of consistently applied land models. Here, we use ITQ to evaluate model structure: The measures are largely insensitive to climatic scenarios, land use and atmospheric gas concentrations used to drive them, but clearly separate the structure of 13 different land models taken from the CMIP5 archive and an observations-based product. In conclusion, diagnostic measures of this kind provide data-analytical tools that distinguish different types of natural processes based solely on their dynamics, and are thus highly suitable for environmental science applications such as model structural diagnostics.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2019

The Monarch Initiative in 2019: an integrative data and analytic platform connecting phenotypes to genotypes across species

In biology and biomedicine, relating phenotypic outcomes with genetic variation and environmental factors remains a challenge: patient phenotypes may not match known diseases, candidate variants may be in genes that haven’t been characterized, research organisms may not recapitulate human or veterinary diseases, environmental factors affecting disease outcomes are unknown or undocumented, and many resources must be queried to find potentially significant phenotypic associations. The Monarch Initiative (https://monarchinitiative.org) integrates information on genes, variants, genotypes, phenotypes and diseases in a variety of species, and allows powerful ontology-based search. We develop many widely adopted ontologies that together enable sophisticated computational analysis, mechanistic discovery and diagnostics of Mendelian diseases. Our algorithms and tools are widely used to identify animal models of human disease through phenotypic similarity, for differential diagnostics and to facilitate translational research. Launched in 2015, Monarch has grown with regards to data (new organisms, more sources, better modeling); new API and standards; ontologies (new Mondo unified disease ontology, improvements to ontologies such as HPO and uPheno); user interface (a redesigned website); and community development. Monarch data, algorithms and tools are being used and extended by resources such as GA4GH and NCATS Translator, among others, to aid mechanistic discovery and diagnostics.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2020

An Exploratory Approach Using Regression and Machine Learning in the Analysis of Mass Absorption Cross Section of Black Carbon Aerosols: Model Development and Evaluation

Mass absorption cross-section of black carbon (MAC BC ) describes the absorptive cross-section per unit mass of black carbon, and is, thus, an essential parameter to estimate the radiative forcing of black carbon. Many studies have sought to estimate MAC BC from a theoretical perspective, but these studies require the knowledge of a set of aerosol properties, which are difficult and/or labor-intensive to measure. We therefore investigate the ability of seven data analytical approaches (including different multivariate regressions, support vector machine, and neural networks) in predicting MAC BC for both ambient and biomass burning measurements. Our model utilizes multi-wavelength light absorption and scattering as well as the aerosol size distributions as input variables to predict MAC BC across different wavelengths. We assessed the applicability of the proposed approaches in estimating MAC BC using different statistical metrics (such as coefficient of determination (R 2 ), mean square error (MSE), fractional error, and fractional bias). Overall, the approaches used in this study can estimate MAC BC appropriately, but the prediction performance varies across approaches and atmospheric environments. Based on an uncertainty evaluation of our models and the empirical and theoretical approaches to predict MAC BC , we preliminarily put forth support vector machine (SVM) as a recommended data analytical technique for use. We provide an operational tool built with the approaches presented in this paper to facilitate this procedure for future users.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Quantifying the Influence of Size, Shape, and Density of Microplastics on Their Transport Modes: A Modeling Approach

Microplastics (MPs) pose significant risks to marine ecosystems and human health, necessitating accurate predictions of their distributions in aquatic environments for effective risk mitigation. However, understanding MP transport dynamics is challenging because of the inadequate representation of MP characteristics such as size, shape, and density in numerical models. Further, the accuracy of the MP vertical profiles in existing models has not been thoroughly validated. Thus, we developed an MP transport model within the Finite Volume Community Ocean Model framework (FVCOM-MP) by integrating MP characteristics. We validated FVCOM-MP against experimental and analytical data, focusing on various MP transport modes and transitions. FVCOM-MP successfully replicates MP profiles in different transport modes, including the bedload, surface-load, suspended-load, and mixed-load modes. Additionally, we introduce phase diagrams for classifying MP transport modes based on particle characteristics, enhancing our understanding of MP dynamics in aquatic systems. The transport modes for a number of real-world MP particles, including fishing line, plastic bag/bottle fragments, synthetic fibers, tire wear particles, polyvinyl chloride and expanded polystyrene pellets, were analyzed with these phase diagrams.

Microplastic transport, Settling velocity, Rising ↗