Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data systems”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 307 records · Page 17

A Data Handling System for Modern and Future Fermilab Experiments

Current and future Fermilab experiments such as Minerva, NOνA, and MicroBoone are now using an improved version of the Fermilab SAM data handling system. SAM was originally used by the CDF and D0 experiments for Run II of the Fermilab Tevatron to provide file metadata and location cataloguing, uploading of new files to tape storage, dataset management, file transfers between global processing sites, and processing history tracking. However SAM was heavily tailored to the Run II environment and required complex and hard to deploy client software, which made it hard to adapt to new experiments. The Fermilab Computing Sector has progressively updated SAM to use modern, standardized, technologies in order to more easily deploy it for current and upcoming Fermilab experiments, and to support the data preservation efforts of the Run II experiments.

Illingworth, R. A.↗

Second-generation downscaled earth system model data using generative machine learning

The second-generation Sup3rCC dataset provides high-resolution meteorological data generated through the downscaling of multiple earth system models (ESMs) from the Coupled Model Intercomparison Project Phase 6 (CMIP6). This downscaling is performed through application of a generative machine learning approach called Super-Resolution for Renewable Resource Data (sup3r). This dataset builds on the first-generation Sup3rCC data by applying improved bias correction methods and adding downscaled precipitation to the output variables. As with the first Sup3rCC version, the data still include temperature, wind speed and direction at multiple heights, pressure, three components of downwelling solar radiation, and relative humidity—all at 4-kilometer (km) hourly resolution over the contiguous United States. This is a 25x spatial enhancement and 24x temporal enhancement of the source 100-km daily-average ESM data. This extension of the Sup3rCC dataset includes data from six ESMs from two shared socioeconomic pathways (SSPs) totaling 400 years of data with multiple future projections of changing meteorological conditions. The scenario selection was based on a structured evaluation of historical ESM skill and comprehensive representation of possible trajectories of future climate change in temperature, humidity, precipitation, solar irradiance, and near-surface wind speeds. The inclusion of multiple future projections is intended to enable users to assess key drivers of un 36 certainty and variability. All data are double-bias corrected, resulting in a product that can be used out-of-the-box for energy system analysis with minimal historical bias. The potential applications of Sup3rCC data extend to various topics in renewable energy resource assessment, energy systems modeling, and grid resilience studies. High-resolution future meteorological projections are critical for evaluating the effects of changing meteorological conditions on renewable energy generation, energy demand, and for optimizing energy storage and grid infrastructure. The 4-km hourly resolution of the downscaled data enables understanding of spatial and temporal variability at the scales necessary for energy system operational planning. In addition, the dataset can support risk assessments by providing detailed information on possible future extreme weather events and long-term meteorological variability at scales relevant to energy infrastructure. By offering an enhanced representation of possible future meteorological conditions, the second-generation Sup3rCC dataset enables more precise modeling of energy resilience and adaptation strategies in response to changing meteorological conditions.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Towards Composing Data Aware Systems Biology Workflows on Cloud Platforms: A MeDICi-based Approach

Cloud computing is being increasingly adopted for deploying systems biology scientific workflows. Scientists developing these workflows use a wide variety of fragmented and competing data sets and computational tools of all scales to support their research. To this end, the synergy of client side workflow tools with cloud platforms is a promising approach to share and reuse data and workflows. In such systems, the location of data and computation is essential consideration in terms of quality of service for composing a scientific workflow across remote cloud platforms. In this paper, we describe a cloud-based workflow for genome annotation processing that is underpinned by MeDICi - a middleware designed for data intensive scientific applications. The workflow implementation incorporates an execution layer for exploiting data locality that routes the workflow requests to the processing steps that are colocated with the data. We demonstrate our approach by composing two workflowswith the MeDICi pipelines.

59 BASIC BIOLOGICAL SCIENCES↗

SPLENDAQ: A Detector-Agnostic Data Acquisition System for Small-Scale Physics Experiments

Many scientific applications from rare-event searches to condensed matter system characterization to high-rate nuclear experiments require time-domain triggering on a raw stream of data, where the triggering is generally threshold-based or randomly acquired. When carrying out detector R &D, there is a need for a general data acquisition (DAQ) system to quickly and efficiently process such data. In the SPLENDOR collaboration, we are developing the Python-based SPLENDAQ package for this exact purpose—it offers two main features for offline analysis of continuous data: a threshold triggering algorithm based on the time-domain optimal filter formalism and an algorithm for randomly choosing nonoverlapping segments for noise measurements. Further, combined with the commercially available Moku platform, developed by Liquid Instruments, we have a full pipeline of event building off raw data with minimal setup. Here, we review the underlying principles of this detector-agnostic DAQ package and give concrete examples of its utility in various applications.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Slow control and data acquisition systems in the Mu2e experiment

The Mu2e experiment at the Fermilab Muon Campus will search for the coherent neutrinolessconversion of a muon into an electron in the field of an aluminum nucleus with a sensitivityimprovement by a factor of 10,000 over existing limits. The Mu2e Trigger and Data AcquisitionSystem (TDAQ) usesotsdaqas the online Data Acquisition System (DAQ) solution. Developed atFermilab,otsdaqintegrates both theartdaqDAQ and theartanalysis frameworks for event transfer,filtering, and processing.otsdaqis an online DAQ software suite with a focus on flexibility andscalability and provides a multi-user, web-based, interface accessible through a web browser. Thedata stream from the detector subsystems is read by a software filter algorithm that selects eventswhich are combined with the data flux coming from a Cosmic Ray Veto System. The DetectorControl System (DCS) has been developed using the Experimental Physics and Industrial ControlSystem (EPICS) open source platform for monitoring, controlling, alarming, and archiving. TheDCS System has been integrated intootsdaq. A prototype of the TDAQ and the DCS systems hasbeen built at Fermilab’s Feynman Computing Center. In this paper, we report on the progress ofthe integration of this prototype in the onlineotsdaqsoftware.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

System using data compression and hashing adapted for use for multimedia encryption

A system and method is disclosed for multimedia encryption. Within the system of the present invention, a data compression module receives and compresses a media signal into a compressed data stream. A data acquisition module receives and selects a set of data from the compressed data stream. And, a hashing module receives and hashes the set of data into a keyword. The method of the present invention includes the steps of compressing a media signal into a compressed data stream; selecting a set of data from the compressed data stream; and hashing the set of data into a keyword.

97 MATHEMATICS AND COMPUTING↗

Next Generation Workload Management System For Big Data on Heterogeneous Distributed Computing

The Large Hadron Collider (LHC), operating at the international CERN Laboratory in Geneva, Switzerland, is leading Big Data driven scientific explorations. Experiments at the LHC explore the fundamental nature of matter and the basic forces that shape our universe, and were recently credited for the discovery of a Higgs boson. ATLAS and ALICE are the largest collaborations ever assembled in the sciences and are at the forefront of research at the LHC. To address an unprecedented multi-petabyte data processing challenge, both experiments rely on a heterogeneous distributed computational infrastructure. The ATLAS experiment uses PanDA (Production and Data Analysis) Workload Management System (WMS) for managing the workflow for all data processing on hundreds of data centers. Through PanDA, ATLAS physicists see a single computing facility that enables rapid scientific breakthroughs for the experiment, even though the data centers are physically scattered all over the world. The scale is demonstrated by the following numbers: PanDA manages O(10 2 ) sites, O(10 5 ) cores, O(10 8 ) jobs per year, O(10 3 ) users, and ATLAS data volume is O(10 17 ) bytes. In 2013 we started an ambitious program to expand PanDA to all available computing resources, including opportunistic use of commercial and academic clouds and Leadership Computing Facilities (LCF). The project titled 'Next Generation Workload Management and Analysis System for Big Data' (BigPanDA) is funded by DOE ASCR and HEP. Extending PanDA to clouds and LCF presents new challenges in managing heterogeneity and supporting workflow. The BigPanDA project is underway to setup and tailor PanDA at the Oak Ridge Leadership Computing Facility (OLCF) and at the National Research Center "Kurchatov Institute" together with ALICE distributed computing and ORNL computing professionals. Our approach to integration of HPC platforms at the OLCF and elsewhere is to reuse, as much as possible, existing components of the PanDA system. Finally, we will present our current accomplishments with running the PanDA WMS at OLCF and other supercomputers and demonstrate our ability to use PanDA as a portal independent of the computing facilities infrastructure for High Energy and Nuclear Physics as well as other data-intensive science applications.

97 MATHEMATICS AND COMPUTING↗

The IceCube data acquisition system for galactic core collapse supernova searches

The IceCube Neutrino Observatory was designed to detect highly energetic neutrinos. The detector was built as a lattice of 5160 photomultiplier tubes monitoring one cubic kilometer of clear Antarctic ice. Due to low photomultiplier dark noise rates in the cold and radio-pure ice, IceCube is also able to detect bursts of O(10MeV) neutrinos expected to be emitted from core collapse supernovae. The detector will provide the world’s highest statistical precision for the lightcurves of galactic supernovae by observing an induced collective rise in all photomultiplier rates [1]. This paper presents the supernova data acquisition system, the search algorithms for galactic supernovae, as well as the recently implemented HitSpooling DAQ extension. HitSpooling will overcome the current limitation of transmitting photomultiplier rates in intervals of 1.6384 ms by storing all recorded time-stamped hits for supernova candidate triggers. From the corresponding event-based information, the average neutrino energy can be estimated and the background induced by detector noise and atmospheric muons can be reduced.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Application of Spatial Data Modeling Systems, Geographical Information Systems (GIS), and Transportation Routing Optimization Methods for Evaluating Integrated Deployment of Interim Spent Fuel Storage Installations and Advanced Nuclear Plants

The objective of this siting study work is to support DOE in evaluating integrated advanced nuclear plant and ISFSI deployment options in the future. This study looks at several nuclear power plant growth scenarios that consider the locations of existing and planned commercial nuclear power plants integrated with the establishment of consolidated interim spent fuel storage installations (ISFSIs). This research project is aimed at providing methodologies, information, and insights that inform the process for determining and optimizing candidate areas for new advanced nuclear power generation plants and consolidated ISFSIs to meet projected US electric power demands for the future.

Geographical Information Systems (GIS)↗

A Causal Approach to Integrate Component Health Data into System Reliability Models

Two of the challenges of current plant reliability approaches are the ability to integrate plant health data, and to support decision making. Condition based data and diagnostic/prognostic information are in fact not considered into plant reliability models to inform system engineers on the most critical components. Currently, the propagation of quantitative health data from the component to the system level is a challenge given the diverse nature/structure of the data. On the other hand, plant reliability methods (which are typically based on fault-trees or reliability block diagrams) can effectively propagate data from the component to the system level, but values of failure rates or failure probabilities are an approximated integral representation of the past industry-wide operational experience, and it neglects the present component health status (e.g., diagnostic and condition-based data) and health projection (when available from prognostic data). Our first claim is that system reliability models should propagate health information from the component to the system/plant level in order to provide a quantitative snapshot of system/plant health and identify the most critical components. Our second claim is that component health should be informed solely by that specific component current and historical performance data and should not be an approximated integral representation of the past industry-wide operational experience. This paper is directly supporting these two claims by proposing a different approach to perform reliability modeling which relies on available component diagnostic, prognostic and condition-based data to measure component health, and it propagates this information through fault tree models. The propagation of health data from the component to the system level is performed not in terms of probability, but in terms of margins where margin is defined as the “distance” between the present actual status and an undesired event (e.g., failure or unacceptable performance). Through a cause-effect lens, while classical reliability models target the effect associated to a component performance, a margin-based approach focuses on the cause of an undesired component performance (i.e., component health). Hence, thinking of reliability in terms of margins implies decision making based on causal reasoning. We will show how fault tree models can be solved using a margin language and how this process can effectively assist system engineers to identify the most critical components.

97 MATHEMATICS AND COMPUTING↗

Data Challenges in Multi-Sensor Data Science System for Monitoring a Solvent Extraction Process

Idaho National Laboratory (INL) is maintaining and gaining knowledge into the nuclear fuel cycle by building a test bed to allow researchers the opportunity to study nuclear fuel processing operations. This includes studying solvent extraction processes that use centrifugal contactors. As part of INL’s mission, the goal of this project is to develop a system that utilizes non-traditional measurement sources such as vibration, acoustics, current, light, flow, and temperature in conjunction with data-based, machine learning techniques that will allow for signal discovery. This multisensory data can support the development of safeguards by design, provide operator process awareness, and discover process anomalies. This poster will highlight some of the data collection and analytics challenges for the multi-sensor system as well as the mitigation strategies to build a robust system. Additionally, some preliminary data from the first testing campaign will be shown to help illustrate the data needs of the system.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

Cognitive analysis of metabolomics data for systems biology

Cognitive computing is revolutionizing the way big data are processed and integrated, with artificial intelligence (AI) natural language processing (NLP) platforms helping researchers to efficiently search and digest the vast scientific literature. Most available platforms have been developed for biomedical researchers, but new NLP tools are emerging for biologists in other fields and an important example is metabolomics. NLP provides literature-based contextualization of metabolic features that decreases the time and expert-level subject knowledge required during the prioritization, identification and interpretation steps in the metabolomics data analysis pipeline. Here, we describe and demonstrate four workflows that combine metabolomics data with NLP-based literature searches of scientific databases to aid in the analysis of metabolomics data and their biological interpretation. Additionally, the four procedures can be used in isolation or consecutively, depending on the research questions. The first, used for initial metabolite annotation and prioritization, creates a list of metabolites that would be interesting for follow-up. The second workflow finds literature evidence of the activity of metabolites and metabolic pathways in governing the biological condition on a systems biology level. The third is used to identify candidate biomarkers, and the fourth looks for metabolic conditions or drug-repurposing targets that the two diseases have in common. The protocol can take 1–4 h or more to complete, depending on the processing time of the various software used.

59 BASIC BIOLOGICAL SCIENCES↗

Multi-Sensor Data Acquisition System for Process Monitoring

Idaho National Laboratory is building a new nuclear fuel cycle test bed. This fuel cycle test bed named “Beartooth” will give researchers the opportunity to study the nuclear fuel cycle process. The process operations include the use of centrifugal contactors and process flow for the purification of special nuclear material recovery in used fuel. This new research facility has the need to use non-traditional measurement sensors to determine the state-of-health of the solvent extraction process. These non-traditional sensors can also enhance nuclear nonproliferation supervision and other activities. The non-traditional sensors include accelerometers, acoustic, current, flow, colorimetric, temperature, pH and conductivity. The challenge behind deploying all these sensors, is the need for fast and reliable data collection. The data acquisition system (DAQ) needs to be capable of recording up to 12 accelerometers and/or acoustic microphones simultaneously at rates up to 12.8 kSamples/second/channel. This requires the need for a strong architecture and data collection solution. This summary identifies the system architecture, DAQ, and sensors needed to support non-traditional measurements in a solvent extraction process.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Improving CLM5.0 Biomass and Carbon Exchange Across the Western United States Using a Data Assimilation System

The Western United States is dominated by natural lands that play a critical role for carbon balance, water quality, and timber reserves. This region is also particularly vulnerable to forest mortality from drought, insect attack, and wildfires, thus requiring constant monitoring to assess ecosystem health. Carbon monitoring techniques are challenged by the complex mountainous terrain, thus there is an opportunity for data assimilation systems that combine land surface models and satellite-derived observations to provide improved carbon monitoring. Here, we use the Data Assimilation Research Testbed to adjust the Community Land Model (CLM5.0) with remotely sensed observations of leaf area and above-ground biomass. The adjusted simulation significantly reduced the above-ground biomass and leaf area, leading to a reduction in both photosynthesis and respiration fluxes. The reduction in the carbon fluxes mostly offset, thus both the adjusted and free simulation projected a weak carbon sink to the land. This result differed from a separate observation-constrained model (FLUXCOM) that projected strong carbon uptake to the land. Simulation diagnostics suggested water limitation had an important influence upon the magnitude and spatial pattern of carbon uptake through photosynthesis. We recommend that additional observations important for water cycling (e.g., snow water equivalent, land surface temperature) be included to improve the veracity of the spatial pattern in carbon uptake. Furthermore, the assimilation system should be enhanced to maximize the number of the simulated state variables that are adjusted, especially those related to the recommended observed quantities including water cycling and soil carbon.

54 ENVIRONMENTAL SCIENCES↗

Dynamically Reconfigurable Data Readout of Pixel Detectors for Automatic Synchronization with Data Acquisition Systems

Reconfigurable detectors with dynamically selectable sensing and readout modes are highly desirable for implementing edge computing as well as enabling advanced imaging techniques such as foveation. The concept of a camera system capable of simultaneous passive imaging and dynamic ranging in different regions of the detector is presented. Such an adaptive-autonomous detector with both spatial and temporal control requires programmable window of exposure (time frames), ability to switch between readout modes such as full-frame imaging and zero-suppressed data, modification of the number of pixel data bits and independent programmability for distinct detector regions. In this work, a method is presented for seamlessly changing time frames and readout modes without data corruption while still ensuring that the data acquisition system (DAQ) does not need to stop and resynchronize at each change of setting, thus avoiding significant dead time. Data throughput is maximized by using a minimum unique data format, rather than lengthy frame headers, to differentiate between consecutive frames. A data control and transmitter (DCT) synchronizes data transfer from the pixel to the periphery, reconfigures the data to transmit it serially off-chip, while providing optimized decision support based on a DAQ definable mode. Measurements on a test structure demonstrate that the DCT can operate at 1 GHz in a 65 nm LP CMOS process.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

PowerSystems.jl and PowerSimulations.jl [SWR-18-23]

Data structures in Julia to enable power systems analysis. Also, PowerSimulations.jl is a Julia package for power system modeling and simulation found at https://github.com/NREL/PowerSimulations.jl. The objectives of the package are: Provide a flexible modeling framework that can accommodate problems of different complexity and at different time-scales. Streamline the construction of large scale optimization problems to avoid repetition of work when adding/modifying model details. Exploit Julia's capabilities to improve computational performance of large scale power system simulations. The flexible modeling framework is enabled through a modular set of capabilities that enable scalable power system analysis and exploration of new analysis methods. The modularity of PowerSimulations results from the structure of the simulations enabled by the package: Simulations define a set of problems that can be solved using numerical techniques. Problems are generated by expressing model formulations against system data For example, an annual production cost modeling simulation can be created by formulating a unit commitment model against system data to assemble a set of 365 daily time-coupled scheduling problems.

Lara, Jose Daniel↗