Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “DATA STORAGE”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,531 records · Page 85
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Soft error-mitigating semiconductor design system and associated methods

A soft error-mitigating semiconductor design system and associated methods that tailor circuit design steps to mitigate corruption of data in storage elements (e.g., flip flops) due to Single Events Effects (SEEs). Required storage elements are automatically mapped to triplicated redundant nodes controlled by a voting element that enforces majority-voting logic for fault-free output (i.e., Triple Modular Redundancy (TMR)). Storage elements are also optimally positioned for placement in keeping with SEE-tolerant spacing constraints. Additionally, clock delay insertion (employing either a single global clock or clock triplication) in the TMR specification may introduce useful skew that protects against glitch propagation through the designed device. The resultant layout generated from the TMR configuration may relax constraints imposed on register transfer level (RTL) engineers to make rad-hard designs, as automation introduces TMR storage registers, memory element spacing, and clock delay/triplication with minimal designer input.

Miryala, Sandeep↗
DOE OSTI2024

Soft error-mitigating semiconductor design system and associated methods

A soft error-mitigating semiconductor design system and associated methods that tailor circuit design steps to mitigate corruption of data in storage elements (e.g., flip flops) due to Single Events Effects (SEEs). Required storage elements are automatically mapped to triplicated redundant nodes controlled by a voting element that enforces majority-voting logic for fault-free output (i.e., Triple Modular Redundancy (TMR)). Storage elements are also optimally positioned for placement in keeping with SEE-tolerant spacing constraints. Additionally, clock delay insertion (employing either a single global clock or clock triplication) in the TMR specification may introduce useful skew that protects against glitch propagation through the designed device. The resultant layout generated from the TMR configuration may relax constraints imposed on register transfer level (RTL) engineers to make rad-hard designs, as automation introduces TMR storage registers, memory element spacing, and clock delay/triplication with minimal designer input.

Miryala, Sandeep↗
NASA NTRS2004

Data Grid Management Systems

The "Grid" is an emerging infrastructure for coordinating access across autonomous organizations to distributed, heterogeneous computation and data resources. Data grids are being built around the world as the next generation data handling systems for sharing, publishing, and preserving data residing on storage systems located in multiple administrative domains. A data grid provides logical namespaces for users, digital entities and storage resources to create persistent identifiers for controlling access, enabling discovery, and managing wide area latencies. This paper introduces data grids and describes data grid use cases. The relevance of data grids to digital libraries and persistent archives is demonstrated, and research issues in data grids and grid dataflow management systems are discussed.

Moore, Reagan W.↗
DOE OSTI2013

A new data set for estimating organic carbon storage to 3 m depth in soils of the northern circumpolar permafrost region

High-latitude terrestrial ecosystems are key components in the global carbon cycle. The Northern Circumpolar Soil Carbon Database (NCSCD) was developed to quantify stocks of soil organic carbon (SOC) in the northern circumpolar permafrost region (a total area of 18.7 × 10 6 km 2 ). The NCSCD is a geographical information system (GIS) data set that has been constructed using harmonized regional soil classification maps together with pedon data from the northern permafrost region. Previously, the NCSCD has been used to calculate SOC storage to the reference depths 0–30 cm and 0–100 cm (based on 1778 pedons). It has been shown that soils of the northern circumpolar permafrost region also contain significant quantities of SOC in the 100–300 cm depth range, but there has been no circumpolar compilation of pedon data to quantify this deeper SOC pool and there are no spatially distributed estimates of SOC storage below 100 cm depth in this region. Here we describe the synthesis of an updated pedon data set for SOC storage (kg C m -2 ) in deep soils of the northern circumpolar permafrost regions, with separate data sets for the 100–200 cm (524 pedons) and 200–300 cm (356 pedons) depth ranges. These pedons have been grouped into the North American and Eurasian sectors and the mean SOC storage for different soil taxa (subdivided into Gelisols including the sub-orders Histels, Turbels, Orthels, permafrost-free Histosols, and permafrost-free mineral soil orders) has been added to the updated NCSCDv2. The updated version of the data set is freely available online in different file formats and spatial resolutions that enable spatially explicit applications in GIS mapping and terrestrial ecosystem models. While this newly compiled data set adds to our knowledge of SOC in the 100–300 cm depth range, it also reveals that large uncertainties remain. In conclusion, identified data gaps include spatial coverage of deep (> 100 cm) pedons in many regions as well as the spatial extent of areas with thin soils overlying bedrock and the quantity and distribution of massive ground ice.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Data-driven Chaos Indicator for Nonlinear Dynamics and Applications on Storage Ring Lattice Design

A data-driven chaos indicator concept is introduced to characterize the degree of chaos for nonlinear dynamical systems. The indicator is represented by the prediction accuracy of surrogate models established purely from data. It provides a metric for the predictability of nonlinear motions in a given system. When using the indicator to implement a tune-scan for a quadratic Hénon map, the main resonances and their asymmetric stop-band widths can be identified. When applied to particle transportation in a storage ring, as particle motion becomes more chaotic, its surrogate model prediction accuracy decreases correspondingly. Therefore, the prediction accuracy, acting as a chaos indicator, can be used directly as the objective for nonlinear beam dynamics optimization. This method provides a different perspective on nonlinear beam dynamics and an efficient method for nonlinear lattice optimization. Applications in dynamic aperture optimization are demonstrated as real world examples.

43 PARTICLE ACCELERATORS↗
DOE OSTI2022

Data-driven chaos indicator for nonlinear dynamics and applications on storage ring lattice design

A data-driven chaos indicator concept is introduced to characterize the degree of chaos for nonlinear dynamical systems. The indicator is represented by the prediction accuracy of surrogate models established purely from data. It provides a metric for the predictability of nonlinear motions in a given system. When using the indicator to implement a tune-scan for a quadratic Hénon map, the main resonances and their asymmetric stop-band widths can be identified. When applied to particle transportation in a storage ring, as particle motion becomes more chaotic, its surrogate model prediction accuracy decreases correspondingly. So, the prediction accuracy, acting as a chaos indicator, can be used directly as the objective for nonlinear beam dynamics optimization. This method provides a different perspective on nonlinear beam dynamics and an efficient method for nonlinear lattice optimization. Applications in dynamic aperture optimization are demonstrated as real world examples.

36 MATERIALS SCIENCE↗
DOE OSTI2017

Used Nuclear Fuel-Storage, Transportation & Disposal Analysis Resource and Data System (UNF-ST&DARDS) 4.x

A new, integrated data and analysis system has been designed to simplify and automate the performance of accurate and efficient evaluations for characterizing the input to the overall waste management system-UNF-Storage, Transportation & Disposal Analysis Resource and Data System (UNF-ST&DARDS). A relational database has been assembled to provide a standard means by which UNF-ST&DARDS can succinctly store and retrieve M&S parameters for specific SNF analysis. Users can import SNF data into this database for user-specific analysis. A library of various analysis model templates provides the ability to communicat the various set of M&S parameters to the most appropriate M&S application. A process manager facilitates performance of actual, as-loaded, assembly-specific and cask-specific evaluations. Interactive visualization capabilities facilitate data analysis and results interpretation.

Banerjee, Kaushik↗
DOE OSTI2017

Washington Clean Energy Fund: Energy Storage System Performance Test Plans and Data Requirements

This report documents the test plans, including detailed duty cycles, used in evaluating the technical performance of five energy storage systems (ESSs) sponsored by the Washington State Clean Energy Fund (CEF). These ESSs were installed at three participating utilities’ (Avista, Snohomish Public Utility District or SnoPUD, and Puget Sound Energy or PSE) designated sites. Under each test plan, a number of baseline and use case tests are defined. This report documents the test plan for each utility, including duty cycles, data and performance reporting requirements. Baseline tests defined in this report mainly focus on determining an initial or reference performance for each ESS, which may be compared with the performance at any later time to assess the state of health of the ESS. Parameter values of a given ESS obtained from baseline tests are applied for different modeling purposes and use case tests. The stored energy capacity test is the first test conducted in the baseline test program, which generates data to calculate round trip efficiency (RTE). The response time and ramp rate tests provide the time required for an ESS to change from zero to full charging/discharging rate and hence the ramp rate, which is important in understanding ESS performance for applications calling for fast response. Internal resistance testing of ESS cells is also conducted in conjunction with the response time and ramp rate tests. Finally, the baseline tests include frequency regulation (FR) and peak shaving (PS) tests based on real-world duty cycles. Upon completion of the baseline tests, use case tests are conducted at each of the storage sites with duty cycles developed to meet the site-specific criteria and conditions. The use cases are grouped according to their intended target benefits within the electric infrastructure topology (e.g., transmission versus distribution). Although an ESS may be located on the low-voltage side of a substation that provides power to a distribution feeder, a use case that addresses bulk power services could still be provided and would be grouped under the transmission or bulk-power benefits. Use cases for ESS applications deep into the distribution circuit would be categorized under the distribution system cases.

25 ENERGY STORAGE↗
DOE OSTI2017

Used Nuclear Fuel-Storage, Transportation & Disposal Analysis Resource and Data System (UNF-ST&DARDS)

This will be licensed via RSICC. A new, integrated data and analysis system has been designed to simplify and automate the performance of accurate and efficient evaluations for characterizing the input to the overall nuclear waste management system -UNF-Storage, Transportation & Disposal Analysis Resource and Data System (UNF-ST&DARDS). A relational database within UNF-ST&DARDS provides a standard means by which UNF-ST&DARDS can succinctly store and retrieve modeling and simulation (M&S) parameters for specific spent nuclear fuel analysis. A library of various analysis model templates provides the ability to communicate the various set of M&S parameters to the most appropriate M&S application. Interactive visualization capabilities facilitate data analysis and results interpretation. UNF-ST&DARDS current analysis capabilities include (1) assembly-specific depletion and decay, (2) and spent nuclear fuel cask-specific criticality and shielding. Currently, UNF-ST&DARDS uses SCALE nuclear analysis code system for performing nuclear analysis.

Banerjee, Kaushik↗
NASA NTRS2012

Investigation into Cloud Computing for More Robust Automated Bulk Image Geoprocessing

Geospatial resource assessments frequently require timely geospatial data processing that involves large multivariate remote sensing data sets. In particular, for disasters, response requires rapid access to large data volumes, substantial storage space and high performance processing capability. The processing and distribution of this data into usable information products requires a processing pipeline that can efficiently manage the required storage, computing utilities, and data handling requirements. In recent years, with the availability of cloud computing technology, cloud processing platforms have made available a powerful new computing infrastructure resource that can meet this need. To assess the utility of this resource, this project investigates cloud computing platforms for bulk, automated geoprocessing capabilities with respect to data handling and application development requirements. This presentation is of work being conducted by Applied Sciences Program Office at NASA-Stennis Space Center. A prototypical set of image manipulation and transformation processes that incorporate sample Unmanned Airborne System data were developed to create value-added products and tested for implementation on the "cloud". This project outlines the steps involved in creating and testing of open source software developed process code on a local prototype platform, and then transitioning this code with associated environment requirements into an analogous, but memory and processor enhanced cloud platform. A data processing cloud was used to store both standard digital camera panchromatic and multi-band image data, which were subsequently subjected to standard image processing functions such as NDVI (Normalized Difference Vegetation Index), NDMI (Normalized Difference Moisture Index), band stacking, reprojection, and other similar type data processes. Cloud infrastructure service providers were evaluated by taking these locally tested processing functions, and then applying them to a given cloud-enabled infrastructure to assesses and compare environment setup options and enabled technologies. This project reviews findings that were observed when cloud platforms were evaluated for bulk geoprocessing capabilities based on data handling and application development requirements.

Brown, Richard B.↗
DOE OSTI2022

Adjoint sensitivity analysis and data assimilation for verification of dry storage cask contents

Dry cask storage is a method for interim storage of spent fuel assemblies which contain fissile isotopes of uranium and plutonium. These can present a proliferation concern and consequently there is a need for non-destructive testing methods to verify a dry cask's contents for proliferation protection. We present an application of adjoint sensitivity analysis and data assimilation to a multigroup diffusion model of dry cask storage. Adjoint sensitivity analysis allows the efficient calculation of sensitivities for use in data assimilation to calibrate imprecisely known parameter values and data consistency tests to detect diversion scenarios. (authors)

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2017

Data preservation at the Fermilab Tevatron

The Fermilab Tevatron collider's data-taking run ended in September 2011, yielding a dataset with rich scientific potential. The CDF and D0 experiments each have approximately 9 PB of collider and simulated data stored on tape. A large computing infrastructure consisting of tape storage, disk cache, and distributed grid computing for physics analysis with the Tevatron data is present at Fermilab. The Fermilab Run II data preservation project intends to keep this analysis capability sustained through the year 2020 and beyond. To achieve this goal, we have implemented a system that utilizes virtualization, automated validation, and migration to new standards in both software and data storage technology and leverages resources available from currently-running experiments at Fermilab. Lastly, these efforts have also provided useful lessons in ensuring long-term data access for numerous experiments, and enable high-quality scientific output for years to come.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2014

SSD-optimized workload placement with adaptive learning and classification in HPC environments

In recent years, non-volatile memory devices such as SSD drives have emerged as a viable storage solution due to their increasing capacity and decreasing cost. Due to the unique capability and capacity requirements in large scale HPC (High Performance Computing) storage environment, a hybrid configuration (SSD and HDD) may represent one of the most available and balanced solutions considering the cost and performance. Under this setting, effective data placement as well as movement with controlled overhead become a pressing challenge. In this paper, we propose an integrated object placement and movement framework and adaptive learning algorithms to address these issues. Specifically, we present a method that shuffle data objects across storage tiers to optimize the data access performance. The method also integrates an adaptive learning algorithm where realtime classification is employed to predict the popularity of data object accesses, so that they can be placed on, or migrate between SSD or HDD drives in the most efficient manner. We discuss preliminary results based on this approach using a simulator we developed to show that the proposed methods can dynamically adapt storage placements and access pattern as workloads evolve to achieve the best system level performance such as throughput.

Wan, Lipeng↗
DOE OSTI2015

A practical approach to reconciling availability, performance, and capacity in provisioning extreme-scale storage systems

The increasing data demands from high-performance computing applications significantly accelerate the capacity, capability and reliability requirements of storage systems. As systems scale, component failures and repair times increase, significantly impacting data availability. A wide array of decision points must be balanced in designing such systems. We propose a systematic approach that balances and optimizes both initial and continuous spare provisioning based on a detailed investigation of the anatomy and field failure data analysis of extreme-scale storage systems. We consider the component failure characteristics and its cost and impact at the system level simultaneously. We build a tool to evaluate different provisioning schemes, and the results demonstrate that our optimized provisioning can reduce the duration of data unavailability by as much as 52% under a fixed budget. We also observe that non-disk components have much higher failure rates than disks, and warrant careful considerations in the overall provisioning process.

Computer Science↗
DOE OSTI2016

Multivariate Predictive Analytics of Wind Power Data for Robust Control of Energy Storage

Short-term forecasting is frequently identified as an important tool for the effective management of wind generation. However, forecasting errors, inherent to the point forecasts, increase requirements for energy storage and can affect optimal system operation. Probabilistic forecasts can help tackle this issue by providing a proper characterization of forecasting errors in the optimization process. This paper proposes a multivariate model of forecasting data for wind generation. Predictive uncertainty intervals of wind power can be obtained by sampling from the proposed model. The main goal is to use empirical data models without linear or Gaussian approximations of the distributional or temporal variations. The predictive modeling is utilized within a case study of an energy storage system. Finally, a modified robust convex programming is used to maintain the practical robustness and feasibility of the solution based on the sampled scenarios from the model.

17 WIND ENERGY↗
DOE OSTI2020

Streaming Data Reorganization at Scale with DeltaFS Indexed Massive Directories

We report complex storage stacks providing data compression, indexing, and analytics help leverage the massive amounts of data generated today to derive insights. It is challenging to perform this computation, however, while fully utilizing the underlying storage media. This is because, while storage servers with large core counts are widely available, single-core performance and memory bandwidth per core grow slower than the core count per die. Computational storage offers a promising solution to this problem by utilizing dedicated compute resources along the storage processing path. We present DeltaFS Indexed Massive Directories (IMDs), a new approach to computational storage. DeltaFS IMDs harvest available (i.e., not dedicated) compute, memory, and network resources on the compute nodes of an application to perform computation on data. We demonstrate the efficiency of DeltaFS IMDs by using them to dynamically reorganize the output of a real-world simulation application across 131,072 CPU cores. DeltaFS IMDs speed up reads by 1,740x while only slightly slowing down the writing of data during simulation I/O for in situ data processing.

97 MATHEMATICS AND COMPUTING↗