Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data analytics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,045 records · Page 58
All sourcesNASA NTRSDOE OSTI
DOE OSTI2017

Summary Report for the Evaluation of Current QA Processes Within the FRMAC FAL and EPA MERL.

The Federal Radiological Monitoring and Assessment Center (FRMAC) relies on accurate and defensible analytical laboratory data to support its mission. Therefore, FRMAC must ensure that the environmental analytical laboratories providing analytical services maintain an ongoing capability to provide accurate analytical results to DOE. It is undeniable that the more Quality Assurance (QA) and Quality Control (QC) measures required of the laboratory, the less resources that are available for analysis of response samples. Being that QA and QC measures in general are understood to comprise a major effort related to a laboratory’s operations, requirements should only be considered if they are deemed “value-added” for the FRMAC mission. This report provides observations of areas for improvement and potential interoperability opportunities in the areas of Batch Quality Control Requirements, Written Communications, Data Review Processes, Data Reporting Processes, along with the lessons learned as they apply to items in the early phase of a response that will be critical for developing a more efficient, integrated response for future interactions between the FRMAC and EPA assets.

61 RADIATION PROTECTION AND DOSIMETRY↗
DOE OSTI2021

From multivariate to functional data analysis: Fundamentals, recent developments, and emerging areas

Functional data analysis (FDA), which is a branch of statistics on modeling infinite dimensional random vectors resided in functional spaces, has become a major research area for Journal of Multivariate Analysis. We review some fundamental concepts of FDA, their origins and connections from multivariate analysis, and some of its recent developments, including multi-level functional data analysis, high-dimensional functional regression, and dependent functional data analysis. Here, we also discuss the impact of these new methodology developments on genetics, plant science, wearable device data analysis, image data analysis, and business analytics. Two real data examples are provided to motivate our discussions.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2016

Site-resolved multiple-quantum filtered correlations and distance measurements by magic-angle spinning NMR: Theory and applications to spins with weak to vanishing quadrupolar couplings

We discuss and analyze four magic-angle spinning solid-state NMR methods that can be used to measure internuclear distances and to obtain correlation spectra between a spin I = 1/2 and a half-integer spin S > 1/2 having a small quadrupolar coupling constant. Three of the methods are based on the heteronuclear multiple-quantum and single-quantum correlation experiments, that is, high rank tensors that involve the half spin and the quadrupolar spin are generated. Here, both zero and single-quantum coherence of the half spins are allowed and various coherence orders of the quadrupolar spin are generated, and filtered, via active recoupling of the dipolar interaction. As a result of generating coherence orders larger than one, the spectral resolution for the quadrupolar nucleus increases linearly with the coherence order. Since the formation of high rank tensors is independent of the existence of a finite quadrupolar interaction, these experiments are also suitable to materials in which there is high symmetry around the quadrupolar spin. A fourth experiment is based on the initial quadrupolar-driven excitation of symmetric high order coherences (up to p = 2S, where S is the spin number) and subsequently generating by the heteronuclear dipolar interaction higher rank (l + 1 or higher) tensors that involve also the half spins. Due to the nature of this technique, it also provides information on the relative orientations of the quadrupolar and dipolar interaction tensors. For the ideal case in which the pulses are sufficiently strong with respect to other interactions, we derive analytical expressions for all experiments as well as for the transferred echo double resonance experiment involving a quadrupolar spin. We show by comparison of the fitting of simulations and the analytical expressions to experimental data that the analytical expressions are sufficiently accurate to provide experimental {sup 7}Li–{sup 13}C distances in a complex of lithium, glycine, and water. Discussion of the regime for which such an approach is valid is given.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2019

Grid Data Crossing Platform (GriD-Xing)

This project is to develop a data management and analytics platform called Grid Data Crossing (GriD-Xing) that integrates data processing, storage, analysis, and visualization functionalities for users at industry (e.g., EMS and DMS) and universities. It intends to increase the applicability of large set of multi-source data (e.g., SCADA, PMU, μPMU, AMI, inverter, load/DER forecasting, and cyber data) and eventually improve the resilience, reliability, and security of critical energy infrastructure. GriD-Xing also intends to be a research platform to identify the usefulness of large multi-source data via case studies of interest to industry (e.g., 2011 southwest cold weather and 2016 Blue Cut fire events). In the first year, the team focused on the development and demonstration of large multi-source data (e.g., PMU, μPMU, SCADA, AMI, and cyber data) processing, storage, and analysis. Specifically, the team designed GriD-Xing framework in functional and structural aspects, developed GriD-Xing algorithms for large multi-source grid data processing, storage, and analysis, and finally demonstrated GriD-Xing prototype algorithms performance through a series of tests and case studies using real-world and simulation data.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2015

Scenario driven data modelling: a method for integrating diverse sources of data and data streams

A system and method of integrating diverse sources of data and data streams is presented. The method can include selecting a scenario based on a topic, creating a multi-relational directed graph based on the scenario, identifying and converting resources in accordance with the scenario and updating the multi-directed graph based on the resources, identifying data feeds in accordance with the scenario and updating the multi-directed graph based on the data feeds, identifying analytical routines in accordance with the scenario and updating the multi-directed graph using the analytical routines and identifying data outputs in accordance with the scenario and defining queries to produce the data outputs from the multi-directed graph.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Power System Waveform Datasets for Machine Learning

The desire for increased visibility across the electricity grid will necessarily increase the deployment of sensing and measurement devices and associated data management needs to unprecedented levels. For the existing sensing and measurement infrastructure, there remains a great amount of “value” yet to be extracted through advanced data management and analytics. Availability of more data will not, by itself, lead to changes in grid visibility, security, and resiliency. To create the predictive and prescriptive environment required to enable new markets and transactions for customer revenue and a reliable grid, the data must be collected, organized, evaluated, and analyzed using sophisticated algorithms to provide actionable information allowing operators and customers to reliably manage an increasingly complex grid. Progress in artificial intelligence (AI) has been largely driven by large, publicly available datasets that can be used to train AI algorithms such as MNIST, a database of handwritten images of digits, and ImageNet, an image database of everyday objects. These types of publicly available databases of real-world training datasets have been largely credited for advancement of image processing, computer vision, and deep learning algorithms that these use cases deploy. However, in the power systems industry to date, there are few databases with proper event labeling, and data access to a publicly available collection of power system event waveforms that will allow users to interact with grid signature data. Publicly available datasets of power system event waveforms, such as the DOE/EPRI dataset, often lack critical metadata or contain limited examples of each event type, and data formats vary widely across these datasets.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2018

Defining a Metric Space of Host Logs and Operational Use Cases

Host logs, in particular, Windows Event Logs, are a valuable source of information often collected by security operation centers (SOCs). The semi-structured nature of host logs inhibits automated analytics, and while manual analysis is common, the sheer volume makes manual inspection of all logs impossible. Although many powerful algorithms for analyzing time-series and sequential data exist, utilization of such algorithms for most cyber security applications is either infeasible or requires tailored, research-intensive preparations. In particular, basic mathematic and algorithmic developments for providing a generalized, meaningful similarity metric on system logs is needed to bridge the gap between many existing sequential data mining methods and this currently available but under-utilized data source. In this paper, we provide a rigorous definition of a metric product space on Windows Event Logs, providing an embedding that allows for the application of established machine learning and time-series analysis methods. We then demonstrate the utility and flexibility of this embedding with multiple use-cases on real data: (1) comparing known infected to new host log streams for attack detection and forensics, (2) collapsing similar streams of logs into semantically-meaningful groups (by user, by role), thereby reducing the quantity of data but not the content, (3) clustering logs as well as short sequences of logs to identify and visualize user behaviors and background processes over time. Overall, we provide a metric space framework for general host logs and log sequences that respects semantic similarity and facilitates a wide variety of data science analytics to these logs without data-specific preparations for each.

Verma, Miki↗
DOE OSTI2021

Pollution inequality 50 years after the Clean Air Act: the need for hyperlocal data and action

Fifty years ago the Clean Air Act amendments of 1970 were the first major US legislation that authorized regulation of air pollutants, creating National Ambient Air Quality Standards (NAAQSs) to protect public health and the environment. While US air quality has improved, with average PM 2.5 concentrations in 2016 a third of 1981 levels, air pollution remains a major health risk in the US and globally. Moreover, air pollution impacts are still uneven, with the most polluted US communities of 50 years ago still so today. Air pollution “hot spots” result in disproportionate exposure at neighborhood scales within cities, particularly in disadvantaged communities, but an in-depth understanding at these scales is lacking. This policy perspective discusses how trends in sensor technology, spatial data collection, analytics and retrieval are converging to enable the production of hyperlocal air pollution data, and that this needs to be done in a manner that enables marginalized communities to shape decision making.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2023

Initial Characterization and Optimization of the Liquid Sampling-Atmospheric Pressure Glow Discharge Ionization Source Coupled to an Orbitrap Mass Spectrometer for the Determination of Plutonium

Plutonium measurements are essential to the nuclear forensics and safeguards community. The liquid sampling-atmospheric pressure glow discharge (LS-APGD) microplasma ionization source coupled with an Orbitrap mass spectrometer is a proven platform for uranium isotope ratio determinations. Here, this work expands the LS-APGD-Orbitrap platform capabilities by reporting the first-ever analysis of plutonium with the LS-APGD and the first-ever measurement of elemental plutonium with an Orbitrap mass spectrometer. This coupling has the potential to dramatically reduce the complex sample manipulations required for traditional analysis techniques employed for actinide isotope ratio determinations. As a first step toward the goal of simultaneous uranium and plutonium isotope ratio determinations, the initial characterization and optimization of the platform for the detection of plutonium are reported. Collision-induced dissociation modality settings were optimized to reduce water-related and other molecular clusters containing plutonium, maximizing 242 Pu 16 O 2 + responses. A design of experiments study was conducted to optimize the discharge conditions of the dual-electrode LS-APGD toward the responsivity of 242 Pu 16 O 2 +. The measurement sensitivity was determined from a Pu response curve, yielding a limit of detection of 10 fg (absolute) of total analyte when data was collected and processed with a Spectroswiss FTMS Booster X2 data acquisition system. Additionally, plutonium and uranium were measured in a simultaneous acquisition, and each analyte remained unaffected by the other. It is believed that the LS-APGD-Orbitrap platform could be a valuable addition to the nuclear forensics’ toolbox and, indeed, other scientific disciplines and regulatory communities in which rapid, high-resolution plutonium determinations are paramount.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Operational Analytics Studies for ATLAS Distributed Computing: Data Popularity Forecast and Utilization of the WLCG Centers

Operational analytics is the direction of research related to the analysis of the current state of computing processes and the prediction of future states in order to anticipate imbalances and take timely measures to stabilize a complex system. There are two relevant areas in ATLAS Distributed Computing that are currently the focus of studies: user physics analysis including the forecast of popularity of data samples among users, and evaluating WLCG centers for their readiness to process user analysis payloads. Studying these areas is challenging due to the complexity involved, as it requires a comprehensive understanding of numerous boundary conditions typically found in large-scale distributed computing infrastructures. Forecasts of data popularity are problematic without the categorization of user tasks by their types (data transformation or physics analysis), which do not always appear on the surface but may induce noise, which introduces significant distortions for predictive analysis. Evaluating the WLCG resources by their analysis workloads is also a challenging task as it is necessary to find a balance between the workload of the resource, its performance, the waiting time for jobs on it, as well as the volume of jobs that it processes. This is especially difficult in a heterogeneous computing environment, where legacy resources are used along with modern high-performance machines. We will look at these areas of research in detail and discuss what tools and methods are used in our work, demonstrating results already obtained.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2019

Hanford SMART System: Calculation of Radionuclide Emissions, Ambient Air Concentrations and Error Propagation (Final Report)

This document, authored by Radiological Assessment Corporation (RAC), details the calculations used to convert laboratory radiological analytical sample data and field measurement data for both ambient air samplers and stack air samples to concentration values with associated uncertainty. The RAC supported an effort by Mission Support Alliance (MSA) to replace the Automated Bar Coding of All Samples at Hanford (ABCASH) and Environmental Release Summary (ERS) database software with a commercial off-the-shelf (COTS) data management software system. The ABCASH and ERS databases were not compatible with the Hanford system standards Windows 10 Operating System deployed in calendar year 2018. The replacement software, Sample Management and Analytical Results Tracking (SMART), is used for environmental data collection, analyses, and regulatory reporting for the Hanford Environmental Surveillance and Effluent Monitoring programs.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Critical Roles of Information, Analysis, Research, and Operations in the Cyber Realm

PNNL has developed an adaptive cyber integration framework (ACIF) to facilitate the timely sharing of cyber threat information along with the advancement of situational awareness tools to enhance protection against and respond to critical infrastructure cybersecurity threats. The ACIF comprises components implemented iteratively to achieve research and mission goals. The ACIF components include data generation technologies, analytic tools development and maturation, data enrichment and fusion, trust building with stakeholders, investigative research, analytic rigor, production, and dissemination. Each component, its importance to the ACIF, and how they can be adopted and applied across other information-sharing sectors and domains are discussed in this paper.

Cyber Threat Intelligence, Cyber Security, Data En↗
DOE OSTI2022

Bridging Equipment Reliability Data and Robust Decisions in a Plant Operation Context

In order to reduce operation and maintenance (O&M) costs, nuclear power plants (NPPs) are moving from corrective and periodic maintenance to predictive maintenance strategies. Such transition requires changes on the data that needs to be retrieved and on the type of decision processes to be employed. Advanced monitoring and data analysis technologies are essential to support predictive strategies. They can in fact provide precise information about health of a component, track its degradation trends, and provide information of its expected failure time. With such information, maintenance operations for a component can be performed right before its expected failure time. This dynamic context of O&M operations requires new methods to analyze data, propagate component health information from the component to the system level, and optimize plant resources. In this respect, the risk informed asset management (RIAM) project has been tasked to develop and test this new class of methods into a risk analytics toolset. This toolset consists of data analytics tools coupled with reliability methods designed to manage plant assets and performances in a predictive maintenance context. This report shows the latest improvements on such development and the initial testing of our methods on the three main research areas that the RIAM project is focusing on. These areas are the following: equipment reliability data analytics, system reliability modeling, and plant resources optimization methods. We show how the methods developed in these areas can support predictive maintenance strategies by: 1) analyzing equipment reliability data (either in numeric and textual form), 2) assessing component and system health through an innovative margin-based reliability approach, and 3) identifying the most critical components and set optimal maintenance schedule based on plant economic and operational constraints.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Reevaluating Contour Visualizations for Power Systems Data

Effective visual analytics tools are needed now more than ever as emerging energy systems data and models are rapidly growing in scale and complexity. Here we examined the suitability of colored contour maps to visually represent bus values in two different power system models: a dense 24k-bus distribution system and a 240-bus transmission system. In a quantitative analysis, we found that contour maps misrepresent power systems data, changing the statistical dispersion of the bus values, including the loss of extreme values. In a controlled empirical study with thirty professional power system research engineers, we found that these distortions significantly impact excursion identification tasks. Additionally, the engineers were less confident in their assessments using contour-based visualizations than glyph-based visualizations.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2021

Improving Detection of Disease Re-emergence Using a Web-Based Tool (RED Alert): Design and Case Analysis Study

Background: Currently, the identification of infectious disease re-emergence is performed without describing specific quantitative criteria that can be used to identify re-emergence events consistently. This practice may lead to ineffective mitigation. In addition, identification of factors contributing to local disease re-emergence and assessment of global disease re-emergence require access to data about disease incidence and a large number of factors at the local level for the entire world. This paper presents Re-emerging Disease Alert (RED Alert), a web-based tool designed to help public health officials detect and understand infectious disease re-emergence. Objective: Our objective is to bring together a variety of disease-related data and analytics needed to help public health analysts answer the following 3 primary questions for detecting and understanding disease re-emergence: Is there a potential disease re-emergence at the local (country) level? What are the potential contributing factors for this re-emergence? Is there a potential for global re-emergence? Methods: We collected and cleaned disease-related data (eg, case counts, vaccination rates, and indicators related to disease transmission) from several data sources including the World Health Organization (WHO), Pan American Health Organization (PAHO), World Bank, and Gideon. We combined these data with machine learning and visual analytics into a tool called RED Alert to detect re-emergence for the following 4 diseases: measles, cholera, dengue, and yellow fever. We evaluated the performance of the machine learning models for re-emergence detection and reviewed the output of the tool through a number of case studies. Results: Our supervised learning models were able to identify 82%-90% of the local re-emergence events, although with 18%-31% (except 46% for dengue) false positives. This is consistent with our goal of identifying all possible re-emergences while allowing some false positives. The review of the web-based tool through case studies showed that local re-emergence detection was possible and that the tool provided actionable information about potential factors contributing to the local disease re-emergence and trends in global disease re-emergence. Conclusions: To the best of our knowledge, this is the first tool that focuses specifically on disease re-emergence and addresses the important challenges mentioned above.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2021

Online Detection of Low-Quality Synchrophasor Data Considering Frequency Similarity

Here, this letter proposes a new approach for online detection of low-quality synchrophasor data under both normal and event conditions. The proposed approach utilizes the features of synchrophasor data in time and frequency domains to distinguish multiple regional PMU signals and detect low-quality synchrophasor data. It is more effective to detect low-quality data with apparently indistinguishable profiles. Case studies from recorded synchrophasor measurements verify the effectiveness of the proposed approach for detecting low-quality synchrophasor data in frequency, voltage magnitude and voltage angle.

42 ENGINEERING↗
DOE OSTI2022

Natural Language Processing-Enhanced Nuclear Industry Operating Experience Data Analysis to Support Risk Model Parameter Estimations

This set of slides has been prepared for a talk at the INL AI/ML Symposium held on September 8, 2022. Presentation outline: Background - Nuclear power plant operating experience data sources • Research focus and motivation - Analyzing free-text operating experience data: present and future • Research method - Input - Methodological steps - Output • Conclusions and next steps

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2016

A GLOBAL VIEW OF VELOCITY FLUCTUATIONS IN THE CORONA BELOW 1.3 R {sub ⊙} WITH CoMP

The Coronal Multi-channel Polarimeter (CoMP) has previously demonstrated the presence of Doppler velocity fluctuations in the solar corona. The observed fluctuations are thought to be transverse waves, i.e., highly incompressible motions whose restoring force is dominated by the magnetic tension, some of which demonstrate clear periodicity. We aim to exploit CoMP’s ability to provide high cadence observations of the off-limb corona to investigate the properties of velocity fluctuations in a range of coronal features, providing insight into how (whether) the properties of the waves are influenced by the varying magnetic topology in active regions, quiet Sun and open field regions. An analysis of Doppler velocity time-series of the solar corona from the 10747 Å Iron xiii line is performed, determining the velocity power spectrum and using it as a tool to probe wave behavior. Further, the average phase speed and density for each region are estimated and used to compute the spectra for energy density and energy flux. In addition, we assess the noise levels associated with the CoMP data, deriving analytic formulae for the uncertainty on Doppler velocity measurements and providing a comparison by estimating the noise from the data. It is found that the entire corona is replete with transverse wave behavior. The corresponding power spectra indicate that the observed velocity fluctuations are predominately generated by stochastic processes, with the spectral slope of the power varying between the different magnetic regions. Most strikingly, all power spectra reveal the presence of enhanced power occurring at ∼3 mHz, potentially implying that the excitation of coronal transverse waves by p -modes is a global phenomenon.

79 ASTRONOMY AND ASTROPHYSICS↗