Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data analytics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,765 records · Page 98

An architecture for real time data acquisition and online signal processing for high throughput tandem mass spectrometry

Independent, greedy collection of data events using simple heuristics results in massive over-sampling of the prominent data features in large-scale studies over what should be achievable through “intelligent,” online acquisition of such data. As a result, data generated are more aptly described as a collection of a large number of small experiments rather than a true large-scale experiment. Nevertheless, achieving “intelligent,” online control requires tight interplay between state-of-the-art, data-intensive computing infrastructure developments and analytical algorithms. In this paper, we propose a Software Architecture for Mass spectrometry-based Proteomics coupled with Liquid chromatography Experiments (SAMPLE) to develop an “intelligent” online control and analysis system to significantly enhance the information content from each sensor (in this case, a mass spectrometer). Using online analysis of data events as they are collected and decision theory to optimize the collection of events during an experiment, we aim to maximize the information content generated during an experiment by the use of pre-existing knowledge to optimize the dynamic collection of events.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

PNNL pushing scientific discovery through data intensive computing breakthroughs

The Pacific Northwest National Laboratory's approach to data intensive computing (DIC) is focused on three key research areas: hybrid hardware architectures, software architectures, and analytic algorithms. Advancements in these areas will help to address, and solve, DIC issues associated with capturing, managing, analyzing and understanding, in near real time, data at volumes and rates that push the frontiers of current technologies.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

Selection of Global Climate Model Data for Downscaling With Generative Machine Learning and Use in the Power Planning for Alignment of Climate and Energy Systems Project

The range of results from climate models and scenarios is important to the understanding of uncertainty in power planning analysis. A U.S. Department of Energy-funded analytic project called Power Planning for Alignment of Climate and Energy Systems is developing data and analytic methods to reflect the effects of climate change on key variables for power system planning, as part of the Grid Modernization Lab Consortium. This project will select and prepare global climate model results for use in power system planning models. A related report (Evaluation of Global Climate Models for Use in Energy Analysis) assesses the performance of various global climate models from the Coupled Model Intercomparison Project Phase 6 data archive for their historical skill with respect to energy system performance and for their future projections under multiple climate change scenarios. Building from that report, we describe the selection of a climate scenario (Shared Socioeconomic Pathway [SSP] 2-4.5) and five climate models: TaiESM1, EC-Earth3-CC, GFDL-CM4, EC-Earth3-Veg, and MPI-ESM1-2-HR. We describe the model selection criteria, which were based on the quality of the match between model results under historical conditions and on the representation of the range of future values for several variables. These results will be downscaled via an open-source generative machine learning method called Super-Resolution for Renewable Energy Resource Data with Climate Change Impacts.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

AnalyzeThis: An Analysis Workflow-Aware Storage System

The need for novel data analysis is urgent in the face of a data deluge from modern applications. Traditional approaches to data analysis incur significant data movement costs, moving data back and forth between the storage system and the processor. Emerging Active Flash devices enable processing on the flash, where the data already resides. An array of such Active Flash devices allows us to revisit how analysis workflows interact with storage systems. By seamlessly blending together the flash storage and data analysis, we create an analysis workflow-aware storage system, AnalyzeThis. Our guiding principle is that analysis-awareness be deeply ingrained in each and every layer of the storage, elevating data analyses as first-class citizens, and transforming AnalyzeThis into a potent analytics-aware appliance. We implement the AnalyzeThis storage system atop an emulation platform of the Active Flash array. Our results indicate that AnalyzeThis is viable, expediting workflow execution and minimizing data movement.

Data Analytics↗

PNNLs Data Intensive Computing research battles Homeland Security threats

The Pacific Northwest National Laboratorys (PNNL's) approach to data intensive computing (DIC) is focused on three key research areas: hybrid hardware architecture, software architectures, and analytic algorithms. Advancements in these areas will help to address, and solve, DIC issues associated with capturing, managing, analyzing and understanding, in near real time, data at volumes and rates that push the frontiers of current technologies.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

Integrating Heterogeneous Healthcare Datasets and Visual Analytics for Disease Bio-surveillance and Dynamics

n this paper, we present an overview of the big data chal- lenges in disease bio-surveillance and then discuss the use of visual analytics for integrating data and turning it into knowl- edge. We will explore two integration scenarios: (1) combining text and multimedia sources to improve situational awareness and (2) enhancing disease spread model data with real-time bio-surveillance data. Together, the proposed integration methodologies can improve awareness about when, where and how emerging diseases can affect wide geographic regions.

Ramanathan, Arvind↗

Characterizing mammography reports for health analytics

As massive collections of digital health data are becoming available, the opportunities for large scale automated analysis increase. In particular, the widespread collection of detailed health information is expected to help realize a vision of evidence-based public health and patient-centric health care. Within such a framework for large scale health analytics we describe several methods to characterize and analyze free-text mammography reports, including their temporal dimension, using information retrieval, supervised learning, and classical statistical techniques. We present experimental results with a large collection of mostly unlabeled reports that demonstrate the validity and usefulness of the approach, since these results are consistent with the known features of the data and provide novel insights about it.

60 APPLIED LIFE SCIENCES↗

Three dimensional low-mode areal-density non-uniformities in indirect-drive implosions at the National Ignition Facility

To achieve hotspot ignition, an inertial confinement fusion implosion must achieve high hotspot pressure that is inertially confined by a dense shell of DT fuel. This requires a symmetric implosion having high in-flight shell velocity and high areal density at stagnation. The size of the driver and scale of the capsule required can be minimized by maintaining a high efficiency of energy coupling from the imploding shell to the hotspot. Significant 3D low mode asymmetries, however, are commonly observed in indirect-drive implosions and reduce the coupling of shell kinetic energy to the hotspot. To better quantify the magnitudes and impacts of shell density asymmetries, we have developed new analysis techniques and analytic models [Hurricane et al., Phys. Plasmas 27(6), 062704 (2020)]. To build confidence in the underlying data, we have also developed an analytic neutron transport model to cross-compare two independent measurements of asymmetry, which shows excellent agreement across shots for mode-1 (ℓ = 1). This work also demonstrates that asymmetry can introduce potential sampling bias into down-scattered ratio measurements causing the solid-angle-average and uncertainty-weighted-average down-scattered ratios to differ significantly. Diagnosing asymmetries beyond mode-1 (ℓ > 1) presents significant challenges. Using new diagnostic instruments and analysis techniques, however, evidence of significant Legendre mode P2 (ℓ = 2, m = 0) and additional 3D asymmetries (ℓ > 1, m ≠ 0) are beginning to emerge from the high precision activation diagnostic data (real-time nuclear activation detectors) and down-scattered neutron imaging data.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Geographic Information System Tools for Management of US DOE Sites - 13489

The DOE Office of Legacy Management (LM) uses a variety of GIS tools to support long-term surveillance and maintenance (LTS and M) activities at DOE closure sites. These geo-spatial applications provide access to data both for external public viewing and for internal analysis and decision making. LM uses a custom geo-spatial application called geo-spatial Environmental Mapping System (GEMS) that draws validated information from a database of 4.6 million analytical results and 232,000 water level measurements for 58 LTS and M sites. These data were collected from transferred sites over a period of 40 years. The database is used to capture and store historical environmental information such as analytical chemistry data, groundwater depths and elevations, well logs, well construction data, geo-referenced boundaries, site physical features, and sampling locations from LTS and M sites. Stakeholders, regulators, and project personnel can use this Web-based application and data to display information in several forms, such as a tabular report, a graph, and a geo-spatial display, or the data can be labeled or highlighted in a map view. Institutional controls, with their LTS and M requirements and documentation, have recently been incorporated into a prototype GEMS Web page for the Weldon Spring, Missouri, Site. LM uses multiple internal GIS viewers to help ensure the future protection of human health and the environment. For example, at the Rocky Flats, Colorado, Site, LM uses a GIS application to display real property interests on authoritative maps. Another project is used to facilitate discussions at stakeholder meetings for the Rocky Flats site's Original Landfill. The Uranium Leasing Program uses multiple interactive maps that assist in ongoing monitoring and the oversight of lease-holders' activities. (authors)

54 ENVIRONMENTAL SCIENCES↗

NCSP Analytical Methods Subtask 3, AMPX Development and Maintenance, and NCSP Nuclear Data Subtask 6, SAMMY Modernization

The modernization of SAMMY continued with the removal of all container array access for the main program. The container array was used due to the computer limitations at the time of the initial writing of SAMMY, but it prevented the use of some modern code testing options. Additionally, the authors continued to make the code more modular by shifting the storage of the energy grid and the covariance information to C++ storage, thus allowing for better unit testing and the elimination of scratch files. For AMPX, the authors continued to implement the new Evaluated Nuclear Data File format to allow AMPX to read new evaluations as they become available.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

NCSP Analytical Methods Subtask 3, AMPX Development and Maintenance, and NCSP Nuclear Data Subtask 6, SAMMY Modernization

SAMMY 1 is a production code that still contains a lot of old-style FORTRAN (F77) code. While the code is widely used and performs well, the legacy code base makes it difficult to maintain and to add new features. However, because it is a production code, it cannot lose any functionality while being modernized. In addition, new features need to be added to support the changing needs of the evaluators to analyze data obtained with new equipment and at higher resolution. In addition, as the data are analyzed with higher fidelity and new models within SAMMY, the processing codes and formats must keep pace. This will ensure that any new SAMMY evaluation can be processed by AMPX and can be tested and used in transport codes like SCALE 2 for maximum benefit of the Nuclear Criticality Safety Program (NCSP) mission.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Human Factors in Streaming Data Analysis: Challenges and Opportunities for Information Visualization: Human Factors in Streaming Data Analysis

State-of-the-art visual analytics models and frameworks mostly assume a static snapshot of the data, while in many cases it is a stream with constant updates and changes. Exploration of streaming data poses unique challenges as machine-level computations and abstractions need to be synchronized with the visual representation of the data and the temporally evolving human insights. In the visual analytics literature, we lack a thorough characterization of streaming data and analysis of the challenges associated with task abstraction, visualization design, and adaptation of the role of human-in-the-loop for exploration of data streams. We aim to fill this gap by conducting a survey of the state-of-the-art in visual analytics of streaming data for systematically describing the contributions and shortcomings of current techniques and analyzing the research gaps that need to be addressed in the future. Our contributions are: i) problem characterization for identifying challenges that are unique to streaming data analysis tasks, ii) a survey and analysis of the state-of-the-art in streaming data visualization research with a focus on the visualization design space for dynamic data and the role of the human-in-the-loop, and iii) reflections on the design-trade-offs for streaming visual analytics techniques and their practical applicability in real-world application scenarios.

streaming data↗

Knowledge management information tool Web analytics - 15182

The Knowledge Management Information Tool (KM-IT) is a web-based [01] system developed to maintain and preserve the Department of Energy's (DOE's) D and D knowledge base. The system was developed by Florida International University's Applied Research Center (FIU-ARC) with the support of the D and D community including the DOE Office of Environmental Management, and with the active collaboration and support of the DOE's Energy Facility Contractors Group (EFCOG). The KM-IT system is a D and D community driven system tailored to serve the technical issues faced by the D and D workforce across the DOE Complex. The D and D KM-IT is an interactive web-based system operational and available for free access at www.dndkm.org. [02] The D and D KM-IT is currently composed of the following tailored D and D modules: Web Crawler, Hotline, Technology, Document Library (including Hanford's and Savannah River Sites' ALARA Center Reports), Specialist Directory, Lessons Learned, Best Practices, Video/Picture Library, Vendors, Collaboration Tools, Training, and Mobile Systems. The Web Crawler dynamically searches through the D and D KM-IT repository as well as the web and displays search results based on the search criteria. The Hotline allows registered users to post questions/problems related to D and D and to receive solutions from a subject-matter specialist. The Technology module serves as repository of D and D technologies and contains technology/ demonstration fact sheets and vendor information. D and D community members can add Lessons Learned, Best Practices, Documents, and Pictures/Videos to the D and D KM-IT repository, after a formal approval process. The Vendor module provides a directory of commercial vendors who provide D and D related technologies, supplies, and services. D and D KM-IT makes excellent use of the knowledge that exists within the D and D community by allowing D and D project managers around the DOE complex to collaborate by sharing innovative ideas, past experiences, and practices and by maintaining a directory of subject matter specialists. The mobile version of the KM-IT can be accessed from m.dndkm.org [03] and currently has six active modules: Vendor, Technology, Picture/Video Library, Hotline, Lessons Learned and Specialist Directory. Web analytics is a key tool being implemented by the D and D KM-IT project team in an effort to enhance the system to better meet users' needs. The D and D KM-IT project team incorporates web analytics as part of its operational elements to analyze information and key data points on how the system is being used. Web analytics is the measurement, collection, analysis and reporting of internet data for the purposes of understanding and optimizing web usage. The use of web analytics retains or attracts D and D community members to access and share knowledge through virtual collaboration on the KM-IT platform. D and D KM-IT web analytics measures details on the overall usage of the system without tracking personal information or specific user behavior: how many users visited the application, how many of those users were unique visitors, how visitors come to the system (i.e., by following a link to the system or by using the web site URL via bookmark or directly typing the address), what keywords were used to perform searches with the search engine, how long the average user stayed on a given screen or on the entire system and what links were clicked on. This information is used to identify which areas of the system are more popular than the others and provides information that can be used to streamline the application for a better user experience. (authors)

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

One-Dimensional Rydberg Atom Interaction with Half-Cycle Pulses

Our study describes the interaction of Rydberg atoms with short half-cycle pulses, using impulse approximation and modeling of one-dimensional atoms. One-dimensional Rydberg atoms are in extremely elongated states of high principal quantum number. Half-cycle pulses are unipolar, high-power electromagnetic pulses. In our research, their duration is much shorter than the classical electron orbit period. A single electric field pulse simply delivers an impulsive momentum transfer or ''kick'' to the excited electron. Atomic transition matrix elements are found and discussed in the frame of quantum and semiclassical theories, and various approximations are used. The dynamic of THz Rydberg wave packets is investigated. Transition probabilities, calculated from derived simple analytical expressions in the case of two time-delayed weak pulses, agree well with the experimental data and calculations of other authors. Analytical expressions for the revival and fractional revival phenomena of the autocorrelation function for Gaussian and Lorentzian distribution, as well as the ionization probabilities of Rydberg atom interaction with two half-cycle pulses, are analyzed.

74 ATOMIC AND MOLECULAR PHYSICS↗

Hybrid Data-Driven Physics-Based Model Framework Implementation: Towards a Secure Cyber-Physical Operation of the Smart Grid

False data injection cyber-attack detection models on smart grid operation have been much explored recently, considering analytical physics-based and data-driven solutions. Recently, a hybrid data-driven physics-based model framework for monitoring the smart grid is developed. However, the framework has not been implemented in real-time environment yet. In this paper, the framework of the hybrid model is developed within a real-time simulation environment. OPAL-RT real-time simulator is used to enable Hardware-in-the-Loop testing of the framework. IEEE 9-bus system is considered as a testing grid for gaining insight. The process of building the framework and the challenges faced during development are presented. The performance of the framework is investigated under various false data injection attacks.

false data injection attack, machine learning, sta↗

A data-driven framework for sparsity-enhanced surrogates with arbitrary mutually dependent randomness

The challenge of quantifying uncertainty propagation in real-world systems is rooted in the high-dimensionality of the stochastic input and the frequent lack of explicit knowledge of its probability distribution. Traditional approaches show limitations for such problems, especially when the size of the training data is limited. To address these diculties, we have developed a general framework of constructing surrogate models on spaces of stochastic input with arbitrary probability measure irrespective of the mutual dependencies between individual components of the random inputs and the analytical form. The present Data-driven Sparsity-enhancing Rotation for Arbitrary Randomness (DSRAR) framework includes a data-driven construction of multivariate polynomial basis for arbitrary mutually dependent probability measure and a sparsity enhancement rotation procedure. This sparsity-enhancing rotation method was initially proposed in our previous work [1] for Gaussian density distributions, which may not be feasible for non-Gaussian distributions due to the loss of orthogonality after the rotation. To remedy such diculties, we developed a new data-driven approach to construct orthonormal polynomials for polynomials for arbitrary mutually dependent (amdP) randomness, ensuring the constructed basis maintains the orthogonality/near-orthogonality with respect to the density of the rotated random vector, where directly applying the regular polynomial chaos including arbitrary polynomial chaos (aPC) [2] shows limitations due to the assumption of the mutual independence between the components of the random inputs. The developed DSRAR framework leads to accurate recovery, with only limited training data, of a sparse representation of the target functions. The eectiveness of our method is demonstrated in challenging problems such as PDEs and realistic molecular systems within high-dimensional conformational space (O(10)) where the underlying density is implicitly represented by a large collection of sample data, as well as systems with explicitly given non-Gaussian probabilistic measures.

Lei, Huan↗

SUPERFLUID VORTEX UNPINNING AS A COHERENT NOISE PROCESS, AND THE SCALE INVARIANCE OF PULSAR GLITCHES

The scale-invariant glitch statistics observed in individual pulsars (exponential waiting-time and power-law size distributions) are consistent with a critical self-organization process, wherein superfluid vortices pin metastably in macroscopic domains and unpin collectively via nearest-neighbor avalanches. Macroscopic inhomogeneity emerges naturally if pinning occurs at crustal faults. If, instead, pinning occurs at lattice sites and defects, which are macroscopically homogeneous, we show that an alternative, noncritical self-organization process operates, termed coherent noise, wherein the global Magnus force acts uniformly on vortices trapped in a range of pinning potentials and undergoing thermal creep. It is found that vortices again unpin collectively, but not via nearest-neighbor avalanches, and that, counterintuitively, the resulting glitch sizes are scale invariant, in accord with observational data. A mean-field analytic theory of the coherent noise process, supported by Monte Carlo simulations, yields a power-law size distribution, between the smallest and largest glitch, with exponent a in the range -2 {<=} a {<=} 0. When the theory is fitted to data from the nine most active pulsars, including the two quasi-periodic glitchers PSR J0537-6910 and PSR J0835-4510, it directly constrains the distribution of pinning potentials in the star, leading to two conclusions: (1) the potentials are broadly distributed, with the mean comparable to the standard deviation; and (2) the mean potential decreases with characteristic age. Fitting the theory to the data also constrains the pinned vortex fraction and the rate of thermal creep. An observational test is proposed to discriminate between nearest-neighbor avalanches and coherent noise: the latter process predicts a statistical excess of large glitches ('aftershocks') following a large glitch, whereas the former process does not. Its discriminatory power is discussed under various microphysical scenarios.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Solar Performance Insight (Final Report)

The PV Operations and Maintenance (O&M) service industry lacks an affordable, well-documented, intuitive PV modeling and analytics tool to calculate modeled performance from actual data from multiple data acquisition systems (DAS). We envision a performance modeling and analytics platform built on open-source, extensible, community-maintained code. The key innovation is the community-driven development of pvlib python delivered through a lightweight web service to provide configurable, consistent and reproducible PV modeling for O&M providers.

14 SOLAR ENERGY↗