SEARCH · Engineering Papers
Results for “Data management”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
IMG/M: the integrated metagenome data management and comparative analysis system
Explore the source record for details and available documents.
IMG/VR v.2.0: an integrated data management and analysis system for cultivated and environmental viral genomes
Not Available
Stimulus: Accelerate Data Management for Scientific AI applications in HPC
Explore the source record for details and available documents.
Faodel: Data Management for Next-Generation Application Workflows.
Abstract not provided.
CryptoConfig (ITS Data Management) [SWR-20-23]
Python class for handling encrypted elements in a config file. Extension of ConfigParser. This class overides the 'get' method of ConfigParser replacing it with Fernet symmetric encryption so that you can safely store encrypted passwords in an ini file.
Scientific Data Management (SDM) Center for Enabling Technologies. Final Report, 2007-2012
Our contributions to advancing the State of the Art in scientific workflows have focused on the following areas: Workflow development; Generic workflow components and templates; Provenance collection and analysis; and, Workflow reliability and fault tolerance.
Scientific Data Management (SDM) Center for Enabling Technologies. 2007-2012
Over the past five years, our activities have both established Kepler as a viable scientific workflow environment and demonstrated its value across multiple science applications. We have published numerous peer-reviewed papers on the technologies highlighted in this short paper and have given Kepler tutorials at SC06,SC07,SC08,and SciDAC 2007. Our outreach activities have allowed scientists to learn best practices and better utilize Kepler to address their individual workflow problems. Our contributions to advancing the state-of-the-art in scientific workflows have focused on the following areas. Progress in each of these areas is described in subsequent sections. Workflow development. The development of a deeper understanding of scientific workflows "in the wild" and of the requirements for support tools that allow easy construction of complex scientific workflows; Generic workflow components and templates. The development of generic actors (i.e.workflow components and processes) which can be broadly applied to scientific problems; Provenance collection and analysis. The design of a flexible provenance collection and analysis infrastructure within the workflow environment; and, Workflow reliability and fault tolerance. The improvement of the reliability and fault-tolerance of workflow environments.
Performance Understanding and Analysis for Exascale Data Management Workflows (Collaboration)
The general approach of the MONA project is depicted in Figure 1. The figure shows performance monitoring applied to an I/O workflow associated with a scientific simulation, with online measurements captured from this workflow informing methods for workflow reconfiguration and dynamic adjustment. The goal is to maintain suitable levels of Quality of Service for workflow execution, by understanding the underlying causes of workflow performance and behavior. One outcome will be workflow performance models able to characterize realistic workflows. Another outcome will be performance ‘mini-apps’ implementing such workflow behavior. Out of scope for this project are advanced methods for online workflow control.
Challenges and Opportunities for Data Management and Collaborative Analysis in Shared Electron Microscopy Facilities.
Abstract not provided.
Development of a Data Management Methodology for a COTS Part Testing Program to Meet the Needs of a Broad Range of Users.
Abstract not provided.
A Data Management Infrastructure for Multi-Lab Geoscience Projects .
Abstract not provided.
FY 2024 Multidimensional Data Correlation Platform: Unified Software Architecture For Advanced Materials And Manufacturing Technologies Data Management And Processing
Explore the source record for details and available documents.
Developing and Managing Data Acquisition Software Using Spack
The Data Acquisition systems of particle physics experiments regularly push the boundaries of high-throughput computing, demanding low-latency collection of data from thousands of devices, collating data into time-sliced events, processing these events and making trigger decisions, and writing the selected data streams to disk. To accomplish these tasks, the DAQ Engineering and Operations department at Fermilab leverages multiple software libraries and builds reusable DAQ frameworks on top. These libraries must be delivered in well-defined bundles and are thoroughly tested for compatibility and functionality before being deployed to live detectors. We have several techniques used to ensure that a consistent set of dependencies can be delivered and re-created at need. We must also support active development of DAQ software components, ideally in an environment as close as possible to that of the detectors. This development often occurs across multiple packages which have to be built in concert and features tested in a consistent and reproducible manner. I will present our scheme for accomplishing these goals using Spack environments, bundle packages, and Github Actions-based CI.
A Metadata Exchange Model for Distributed Acoustic Sensing (DAS) by the DAS-RCN Data Management Team
Co-Author Voon Hui Lai, Australian National University, will be attending IUGG and presenting the work. The session of interested is "S05 - Advances in Earthquake and Explosion Monitoring Using Distributed Acoustic Sensing"