Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data storage”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,423 records · Page 79

Storage Systems and Input/Output: Organizing, Storing, and Accessing Data for Scientific Discovery. Report for the DOE ASCR Workshop on Storage Systems and I/O. [Summary Brief]

In September, 2018, the Department of Energy, Office of Science, Advanced Scientific Computing Research Program convened a workshop to identify key challenges and define research directions that will advance the field of storage systems and I/O over the next 5-7 years.The workshop concluded that addressing these combined challenges and opportunities requires tools and techniques that greatly extend traditional approaches and require new research directions. Key research opportunities were identified. This summary brief highlights three areas: The Impact of Storage and I/O, Research Opportunities, and, A new and productive Storage and I/O Environment. The full report from the workshop can be viewed at DOI: 10.2172/1491994.

97 MATHEMATICS AND COMPUTING↗

High Performance Data Analytics on a Commodity Private Cloud

Sandia is researching novel methods of analysis for large datasets. The term “Big Data” has been used frequently in recent years to describe a discipline of computer science that attempts to distil an increasing quantity of data into a result or meaningful subset that can be easily visualized and acted upon by human consumers. These data are frequently characterized by one or more of the following: high volume, velocity, variety, and veracity. Sandia scientists and researchers are no strangers to large datasets, which often typify the result of high-performance computing workloads. The challenge for Sandia data scientists, however, comes at the arrival of exascale computing, which has become mandated by executive order for national computing centers. Because of power and networking limitations, exascale computing precludes the movement of datasets at exascale from data production to data analysis. Such analysis must be done in-situ, to mitigate the time and power costs of network transport. Currently, many of Sandia’s data analytics environments exist as independent entities, often specialized for individual use cases, interconnected to other data analytics, high-performance computing, and storage systems. Sandia is procuring, installing, and researching future platforms for such data analytics. A memory footprint of 256 GB per node, fourteen data rate (FDR) InfiniBand networking, PCIe connected non-volatile memory (NVMe) data storage, and an object data store will characterize the coming institutional data analytics platforms. The combined systems will contain 300 compute nodes. A cloud-inspired software stack resulting from collaboration between the Sandia centers will allow the systems to support a flexible mix of user and system-facing workloads and use cases including code development and testing in R and Python, Apache Hadoop and Spark, distributed in-memory databases, graph analytics, emulytics, system log and predictive analytics, and data visualization for institutional and mission customers. These systems will arrive at the end of FY 2015 and production is planned by the spring of FY 2016.

97 MATHEMATICS AND COMPUTING↗

System, method, and computer program product for warming a cache for a task launch

A system, method, and computer program product for warming a cache for a task launch is described. The method includes the steps of receiving a task data structure that defines a processing task, extracting information stored in a cache warming field of the task data structure, and, prior to executing the processing task, generating a cache warming instruction that is configured to load one or more entries of a cache storage with data fetched from a memory.

Ricketts, Scott↗

Processing Raw HST Data With Up-to-Date Calibration Data

On-the-Fly Reprocessing (OTFR) is a collection of data-processing routines that work within the context of the Hubble Space Telescope (HST) pipeline data-flow system. The purpose served by OTFR is to generate, on demand, scientifically useful data products from raw HST data stored in an archive. First, on the basis of the requested final data products, OTFR retrieves the corresponding sets of raw data from the archives. Next, OTFR processes the raw data sets to remove artifacts and to establish proper header and other template information. Finally, the calibration routines appropriate to the specific data sets are invoked to produce the requested data products, and the data products are released to an archive distribution system for transmission to the requesting party. OTFR offers two notable advantages: (1) Inasmuch as calibrated data occupy about 8 times as much storage space as do raw data, by obviating storage of calibrated data, OTFR reduces the storage capacity needed by the archive; and (2) the calibration routines can be updated to give requesters the benefit of the most recent calibrations.

Miller, Warren↗

AAFE man-made noise experiment project. Volume 3: Appendices

Management and operational considerations involved in the project to measure man-made electromagnetic noise at earth orbital altitudes are discussed. The subjects considered are: (1) launch and orbit of the Scout D vehicles, (2) experiment management, (3) receiver scanning considerations, (4) data handling, and (5) threshold measurements. The storage requirements for a high resolution, complete data storage library are defined. Mathematical models of signal detection probability are developed.

Source record↗

Solar energy storage via liquid filled cans - Test data and analysis

This paper describes the design of a solar thermal storage test facility with water-filled metal cans as heat storage medium and also presents some preliminary tests results and analysis. This combination of solid and liquid mediums shows unique heat transfer and heat contents characteristics and will be well suited for use with solar air systems for space and hot water heating. The trends of the test results acquired thus far are representative of the test bed characteristics while operating in the various modes.

Saha, H.↗

Advanced Biotelemetry Systems for Space Life Sciences

The Sensors 2000! Program at NASA-Ames Research Center is developing an Advanced Biotelemetry System (ABTS) for Space Life Sciences applications. This modular suite of instrumentation is planned to be used in operational spaceflight missions, ground-based research and development experiments, and collaborative, technology transfer and commercialization activities. The measured signals will be transmitted via radio-frequency (RF), electromagnetic or optical carriers and direct-connected leads to a remote ABTS receiver and data acquisition system for data display, storage, and transmission to Earth. Intermediate monitoring and display systems may be hand held or portable, and will allow for personalized acquisition and control of medical and physiological data.

Hines, John W.↗

AnalyzeThis: an analysis workflow-aware storage system

The need for novel data analysis is urgent in the face of a data deluge from modern applications. Traditional approaches to data analysis incur significant data movement costs, moving data back and forth between the storage system and the processor. Emerging Active Flash devices en-able processing on the flash, where the data already resides. An array of such Active Flash devices allows us to revisit how analysis workflows interact with storage systems. By seamlessly blending together the flash storage and data analysis, we create an analysis workflow-aware storage system, AnalyzeThis. Our guiding principle is that analysis-awareness be deeply ingrained in each and every layer of the storage, elevating data analyses as first-class citizens, and transforming AnalyzeThis into a potent analytics-aware appliance. We implement the AnalyzeThis storage system atop an emulation platform of the Active Flash array. Our results indicate that AnalyzeThis is viable, expediting workflow execution and minimizing data movement.

Computer Science↗

Design description of the Tangaye Village photovoltaic power system

The engineering design of a stand alone photovoltaic (PV) powered grain mill and water pump for the village of Tangaye, Upper Volta is described. The socioeconomic effects of reducing the time required by women in rural areas for drawing water and grinding grain were studied. The suitability of photovoltaic technology for use in rural areas by people of limited technical training was demonstrated. The PV system consists of a 1.8-kW (peak) solar cell array, 540 ampere hours of battery storage, instrumentation, automatic controls, and a data collection and storage system. The PV system is situated near an improved village well and supplies d.c. power to a grain mill and a water pump. The array is located in a fenced area and the mill, battery, instruments, controls, and data system are in a mill building. A water storage tank is located near the well. The system employs automatic controls which provide battery charge regulation and system over and under voltage protection. This report includes descriptions of the engineering design of the system and of the load that it serves; a discussion of PV array and battery sizing methodology; descriptions of the mechanical and electrical designs including the array, battery, controls, and instrumentation; and a discussion of the safety features. The system became operational on March 1, 1979.

Martz, J. E.↗

Demonstration of INCC6 for advanced list-mode data acquisition and analysis using ALMM

The International Neutron Coincidence Counting (INCC) software plays an important role in nuclear safeguards and nuclear material control and accounting (NMC&A) measurements. While the current version, INCC5, represents the traditional standard utilized by inspectorates as well as facilities and practitioners alongside shift register hardware, LANL has recently developed an upgraded version of the software, INCC6. INCC6 offers the same analysis tools as INCC5 while adding new capabilities including acquisition and analysis of list-mode data, recording and storage of list-mode data files, and an expanded set of advanced analysis tools that make use of the additional information available from list-mode data. Here, this paper presents the first demonstration of data acquisition and analysis using INCC6 and the Advanced List Mode Multiplicity Module (ALMM). The capability of INCC6 to perform live list-mode data acquisition and analysis is demonstrated for a variety of neutron sources with a range of neutron emission rates relevant for practical applications and validated against the results obtained with INCC5 and traditional shift register hardware. Advanced list-mode analysis tools introduced by INCC6, such as time-interval and coincidence matrix analysis, are also demonstrated. Finally, the capability of INCC6 to analyze list-mode data files is tested and validated against traditional shift register results using INCC5.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Standardizng Data

To enable the rational design of nanomaterials for improved efficacy and safety, it is critical to understand and exploit the physicochemical properties that drive biological behavior (Morris, 2010). Data mining and computer simulation are essential for deriving information about nanomaterial behavior; however, the datasets needed to support such studies are sparse and stored across a variety of repositories and resources. Schrurs and Lison (2012) have expressed the need for more coherence and structure in the conduct of nanotechnology research. Additionally, the lack of common reporting standards and non-uniformity of information reported have proven to be significant barriers to such data sharing and re-use. The Nanotechnology Working Group (Nano WG), of the US National Institutes of Health National Cancer Informatics Program, has been focused on addressing these barriers. The Nano WG - which includes representatives from over 20 organizations including government agencies, academia, industry, standards organizations, and alliances -has developed ISA-TAB-Nano (Thomas et al, 2013), a general framework for representing and integrating diverse types of data related to the description and characterization of nanomaterials. Recognizing that nanoparticle characterization studies have many of the same challenges as ‘omics-based assays, the Nano WG joined the ISA Commons (Sansone et al., 2012) to leverage lessons learned in ‘omics data sharing. The ISA Commons community brings together 50 collaborators at over 30 scientific organizations around the globe, including regulatory and industrial participants in an increasingly diverse set of life science domains. At the core of the ISA Commons is the ISA metadata tracking framework which forms the basis for the ISA-TAB-Nano extension. The extension of the ISA framework to nanotechnology domain illustrates the power of a synergistic approach that seeks the interoperability of data across multiple research disciplines. To increase adoption, especially in the commercial arena from vendors and manufactures, the ISA-Tab-Nano data-sharing specification has also been submitted for consideration as a standard to the American Society for Testing and Materials (ASTM). Delivering a community-driven specification is only the first phase of the process. To be useful and used, ISA-TAB-Nano must be implemented by tools and databases to assist researchers in reporting their data accordingly, shielding them from unnecessary complexity. Our next step is to extend the open source ISA Software Suite to provide user-oriented tools for the collection, curation, and storage of data compliant with the ISA-TAB-Nano specification. Future work will also focus on the application of the ISA-TAB-Nano format to support emerging standards on minimal information about nanomaterials in biological research (Ostraat et al, 2012; MinChar). ISA-TAB-Nano development is a community-driven effort and we welcome new contributions, collaborations and domain expertise. We invite researchers, software developers, vendors, and other stakeholders to work with us to implement the ISA-Tab-Nano format in their existing systems and research. Likewise, we welcome engagement of regulators, funding agencies, editors, and other policy makers to discuss how this standard can be used to facilitate the sharing and reuse of nanotechnology data across a wide range of disciplines. More information about the ISA-TAB-Nano project can be found online at https://wiki.nci.nih.gov/display/ICR/ISA-TAB-Nano.

informatics↗

Data Science Infrastructure SOFTWARE

LANL science workflows generate complex data sets and ensembles of data requiring significant compute and storage resources. The Data Science Infrastructure (DSI) project focuses on data-driven approaches to make data more readily available to LANL projects. DSI workflows leverage metadata stored in data-agnostic databases, supported by an abstraction layer API to simplify searching and accessing data across simulation runs, experimental runs, filesystems and environments. The abstraction layer API allows the user to query a range of data types: raw output, processed data, configuration data, machine learning models, performance data, etc. In addition to the abstraction backend API, the DSI project is developing client-driven query APIs and UIs to support specific user workflows.

Turton, Terece↗

Modeling Impacts of Resilience Architectures for Extreme-Scale Storage Systems

The Scientific Modeling and Simulation of Storage project focused on improving our ability to store information reliably. The project, done jointly at the University of Wisconsin-Madison, Los Alamos National Laboratories, and Sandia National Laboratories, had the main goal of transforming the art of reliable storage system construction into a more precise science. Along those lines, the project developed numerous tools to expose problems in existing systems; these tools, when applied to the state of the art, uncovered numerous flaws in existing approaches, showing that they both are error prone and in some cases contain serious design flaws. The project also led to the creation of new approaches in reliable system construction. One such approach shows how a storage system can adapt its behavior on the fly to deliver higher performance when there are few underlying failures, but then act more conservatively when more failures are occurring to ensure the safe storage of user data. Another approach develops a storage system consistency model which both delivers high performance but high levels of reliability, a significant advance over previous approaches. Overall, the tools developed within the project advanced the science of reliable storage design, and the new approaches that resulted advanced the science of storage system construction.

97 MATHEMATICS AND COMPUTING↗

Acquisition and analysis of primate physiologic data for the Space Shuttle

This paper describes the design and prototypes of the Physiologic Acquisition and Telemetry System (PATS), which is a multichannel system, designed for large primates, for the data acquisition, telemetry, storage, and analysis of physiological data. PATS is expected to acquire data from units implanted in the abdominal cavities of rhesus monkeys that will be flown aboard the Spacelab. The system will telemeter both stored and real-time internal physiologic measurements to an external Flight Support Station (FSS) computer system. The implanted Data Acquition and Telemetry Subsystem subunit will be externally activated, controlled and reprogrammed from the FSS.

Eberhart, Russell C.↗

Demonstration and performance of an online data selection algorithm for liquid argon time projection chambers using MicroBooNE

The MicroBooNE detector is a liquid argon time projection chamber (LArTPC) that produces three-dimensional images of particle interactions using ionization charge collected by anode wire plane arrays and scintillation light collected by a light detection system. In addition to testing long-standing experimental neutrino anomalies and performing measurements of neutrino interactions with argon nuclei using the Fermilab Booster Neutrino Beam, MicroBooNE aims to develop methodologies for rare beyond the Standard Model and off-beam physics searches. Looking ahead to the upcoming Deep Underground Neutrino Experiment (DUNE), with MicroBooNE serving as a valuable testbed, achieving high sensitivity and livetime for off-beam physics while satisfying data processing and storage constraints will require data-driven, intelligent, and online or real-time data selection techniques. These techniques are essential for reducing data rates and preserving rare signals with high accuracy. In this paper, we describe a fast data selection algorithm suitable for online execution to identify electrons from stopping cosmic ray muons in the MicroBooNE detector utilizing ionization charge information, and present its performance. This represents the first demonstration of online data selection in a LArTPC using real data and charge information exclusively and provides an important proof-of-principle for applying such techniques to other LArTPC experiments such as the Short-Baseline Near Detector and DUNE.

Abratenko, P. [Tufts U. (main)]↗

Unified Ultrasonic/Eddy-Current Data Acquisition

Imaging station for detecting cracks and flaws in solid materials developed combining both ultrasonic C-scan and eddy-current imaging. Incorporation of both techniques into one system eliminates duplication of computers and of mechanical scanners; unifies acquisition, processing, and storage of data; reduces setup time for repetitious ultrasonic and eddy-current scans; and increases efficiency of system. Same mechanical scanner used to maneuver either ultrasonic or eddy-current probe over specimen and acquire point-by-point data. For ultrasonic scanning, probe linked to ultrasonic pulser/receiver circuit card, while, for eddy-current imaging, probe linked to impedance-analyzer circuit card. Both ultrasonic and eddy-current imaging subsystems share same desktop-computer controller, containing dedicated plug-in circuit boards for each.

Chern, E. James↗