SEARCH · Engineering Papers

Results for “DATA STORAGE”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 649 records · Page 36

All sources NASA NTRS DOE OSTI

DOE OSTI2015

Enabling Co-Design of Multi-Layer Exascale Storage Architectures

Growing demands for computing power in applications such as energy production, climate analysis, computational chemistry, and bioinformatics have propelled computing systems toward the exascale: systems with 10 18 floating-point operations per second. These systems, to be designed and constructed over the next decade, will create unprecedented challenges in component counts, power consumption, resource limitations, and system complexity. Data storage and access are an increasingly important and complex component in extreme-scale computing systems, and significant design work is needed to develop successful storage hardware and software architectures at exascale. Co-design of these systems will be necessary to find the best possible design points for exascale systems. The goal of this work has been to enable the exploration and co-design of exascale storage systems by providing a detailed, accurate, and highly parallel simulation of exascale storage and the surrounding environment. Specifically, this simulation has (1) portrayed realistic application checkpointing and analysis workloads, (2) captured the complexity, scale, and multilayer nature of exascale storage hardware and software, and (3) executed in a timeframe that enables “what if'” exploration of design concepts. We developed models of the major hardware and software components in an exascale storage system, as well as the application I/O workloads that drive them. We used our simulation system to investigate critical questions in reliability and concurrency at exascale, helping guide the design of future exascale hardware and software architectures. Additionally, we provided this system to interested vendors and researchers so that others can explore the design space. We validated the capabilities of our simulation environment by configuring the simulation to represent the Argonne Leadership Computing Facility Blue Gene/Q system and comparing simulation results for application I/O patterns to the results of executions of these I/O kernels on the actual system.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2019

From Data to Models and Analytics: An Integrated Scientific Computing Platform to Accelerate Environmental Research SBIR Phase I (Final Technical Report)

Phase I research was conducted to investigate the technical feasibility of an integrated open source platform GeoLib to provide turnkey solutions for model-data integration for environmental systems science (ESS), using modern web technologies, advances in HPC and cloud computing and high-performance visualization. A key feature of our platform is that it minimizes and automates data movement between data storage and computing systems. Another critical feature of the design is that it enables users to perform high-fidelity post-processing by performing high-performance visualization server-side and in-situ on the compute cluster close to the data. The investigation, which was performed over a 12-month period ending April 2019, centered on developing prototype software to demonstrate the key enabling technologies required for this system. This included: (i) rapid access to data from multiple remote sources, via a unified data interface; (ii) software for scalable geospatial visualization of raster, vector, and point cloud data on the web; (iii) development of an easy-to-use API for creating simulation and modeling workflows; (iv) remote data visualization and processing on middle-tier servers; and (v) remote data processing on high-performance computing systems. A critical part of this work is that all of these capabilities be accessible to end users through standard desktop tools such as Project Jupyter, which is widely adopted for ESS simulation and modeling.

97 MATHEMATICS AND COMPUTING↗

NASA NTRS2003

Analysis of Moessbauer Data from Mars: A Database and Artificial Neural Network for Identification of Iron-bearing Phases

The exploration of the planet Mars is one of the major goals within the Solar system exploration programs of the US-American space agency NASA and the European Space Agency ESA. In particular the search for water and life and understanding of the history of the surface and atmosphere will be the major tasks of the upcoming space missions to Mars. The miniaturized Moessbauer spectrometer MIMOS II has been selected for the NASA Mars-Exploration-Rover twin-mission to Mars in 2003 and the ESA 2003 Mars-Express Beagle 2 mission. Reduced in size and weight, in comparison to ordinary laboratory setup, the sensor head just weights approximately 400 g, with a volume of (50x50x90) cu mm, and holds two gamma-ray sources: the stronger for experiments and the weaker for calibrations. The collimator (in sample direction) also shields the primary radiation off the detectors. Around the drive four detectors are mounted. The detectors are made of Si-PIN-photodiodes in chip form (100 sq mm, thickness of 0.5 mm). The control unit is located in a separate electronics board. This board is responsible for the power supply, generation of the drive's velocity reference signal, read of the detector pulses to record the spectrum, data storage and communication with the host computer. After more than four decades from the discovery of the Moessbauer effect, more than 400 minerals were studied at different temperatures. Their Moessbauer parameters were reported in the literature, and have been recently collected in a data bank. Previous Mars-missions, namely Viking and Mars Pathfinder, revealed Si, Al, Fe, Mg, Ca, K, Ti, S and Cl to be the major constituents in soil and rock elemental composition of the red planet. More than 200 minerals already studied by Moessbauer spectroscopy contain significant amounts of these elements. A considerable number of Moessbauer studies were also carried out on meteorites and on Moon samples. Looking backward in the studies of the whole Moessbauer community, we have built a specific library containing Moessbauer parameters of those possible Mars minerals. The selected minerals, their Moessbauer parameter values (min. max. s.d and number of available data), main site substitution, behavior as a function of temperature and a ranking as expected to be found on Mars were organized. Mars-analogue Fe-bearing minerals not studied by Moessbauer spectroscopy are being collected and investigated. In addition, it an identification system based on Artificial Neural Networks (ANN) was implemented which enables fast and precise mineral identification from the experimental Moessbauer parameters at a given temperature.

P A de Souza Jr.↗

NASA NTRS1977

The Viking seismometer

The Viking seismometer, operating on the Martian surface in the region of Utopia Planitia, includes three inertial velocity transducers, amplifiers, filters, automatic event detectors, data compactors, and temporary data storage capability within a unit weighing 2.2 kg. The seismometer functions at a peak magnification of 218,000 with a ground resolution of 2 nanosec and 3 Hz. Since the telemetry capacities associated with the system are limited, the seismometer instrument package employs three data processing modes: a high sampling rate mode; a heavily filtered background monitoring mode; and a frequently-used data compacting mode.

Miller, W. F.↗

NASA NTRS1992

Autonomous support for microorganism research in space

A preliminary design for performing on orbit, autonomous research on microorganisms and cultured cells/tissues is presented. An understanding of gravity and its effects on cells is crucial for space exploration as well as for terrestrial applications. The payload is designed to be compatible with the Commercial Experiment Transporter (COMET) launch vehicle, an orbiter middeck locker interface, and with Space Station Freedom. Uplink/downlink capabilities and sample return through controlled reentry are available for all carriers. Autonomous testing activities are preprogrammed with in-flight reprogrammability. Sensors for monitoring temperature, pH, light, gravity levels, vibrations, and radiation are provided for environmental regulation and experimental data collection. Additional experimental data acquisition includes optical density measurement, microscopy, video, and film photography. On-board full data storage capabilities are provided. A fluid transfer mechanism is utilized for inoculation, sampling, and nutrient replenishment of experiment cultures. In addition to payload design, representative experiments were developed to ensure scientific objectives remained compatible with hardware capabilities. The project is defined to provide biological data pertinent to extended duration crewed space flight including crew health issues and development of a Controlled Ecological Life Support System (CELSS). In addition, opportunities are opened for investigations leading to commercial applications of space, such as pharmaceutical development, modeling of terrestrial diseases, and material processing.

Fleet, Mary L.↗

NASA NTRS1992

Autonomous support for microorganism research in space

A preliminary design for performing on-orbit, autonomous research on microorganisms and cultured cells/tissues is presented. An understanding of gravity and its effects on cells is crucial for space exploration as well as for terrestrial applications. The payload is designed to be compatible with the COMmercial Experiment Transported (COMET) launch vehicle, an orbiter middeck locker interface, and with Space Station Freedom. Uplink/downlink capabilities and sample return through controlled reentry are available for all carriers. Autonomous testing activities are preprogrammed with inflight reprogrammability. Sensors for monitoring temperature, pH, light, gravity levels, vibration, and radiation are provided for environmental regulation and experimental data collection. Additional experiment data acquisition includes optical density measurement, microscopy, video, and file photography. Onboard full data storage capabilities are provided. A fluid transfer mechanism is utilized for inoculation, sampling, and nutrient replenishment of experiment cultures. In addition to payload design, representative experiments were developed to ensure scientific objectives remained compatible with hardware capabilities. The project is defined to provide biological data pertinent to extended duration crewed space flight including crew health issues and development of a Controlled Ecological Life Support System (CELSS). In addition, opportunities are opened for investigations leading to commercial applications of space, such as pharmaceutical development, modeling of terrestrial diseases, and material processing.

Luttges, M. W.↗

DOE OSTI2025

Geospatial Data Workflow Orchestration and Architecture

In an era characterized by explosive growth in geospatial data, the selection of appropriate technologies for data storage, processing, and orchestration is critical for organizations aiming to maintain competitive advantages. This white paper provides a comprehensive analysis of how Oak Ridge National Laboratory (ORNL) has effectively employed various cloud technologies, including containerized applications, container orchestrators, and workflow orchestrators, to develop robust geospatial data processing solutions. We explore the fundamental concepts behind these technologies and compare multiple deployment models tailored to diverse use cases. Our findings conclude that while Kubernetes has emerged as the preferred platform for truly scalable and fault-tolerant production workflows, the choice of workflow orchestration tool requires careful consideration of team needs, pipeline complexity, and deployment environments. This paper aims to serve as a strategic guide for organizations leveraging geospatial data, articulating the balance between technology choices and practical implementation to enhance workflow efficacy and scalability.

97 MATHEMATICS AND COMPUTING↗

NASA NTRS1972

The Mariner Venus Mercury flight data subsystem.

The flight data subsystem (FDS) discussed handles both the engineering and scientific measurements performed on the MVM'73. It formats the data into serial data streams, and sends it to the modulation/demodulation subsystem for transmission to earth or to the data storage subsystem for storage on a digital tape recorder. The FDS is controlled by serial digital words, called coded commands, received from the central computer sequencer of from the ground via the modulation/demodulation subsystem. The eight major blocks of the FDS are: power converter, timing and control, engineering data, memory, memory input/output and control, nonimaging data, imaging data, and data output. The FDS incorporates some 4000 components, weighs 17 kg, and uses 35 W of power. General data on the mission and spacecraft are given.

Whitehead, P. B.↗

DOE OSTI2025

Leveraging public AI tools to explore systems biology resources in mathematical modeling

Predictive mathematical modeling is an essential part of systems biology and is interconnected with information management. Systems biology information is often stored in specialized formats to facilitate data storage and analysis. These formats are not designed for easy human readability and thus require specialized software to visualize and interpret results. Therefore, comprehending modeling and underlying networks and pathways is contingent on mastering systems biology tools, which is particularly challenging for users with no or little background in data science or system biology. To address this challenge, we investigated the usage of public Artificial Intelligence (AI) tools in exploring systems biology resources in mathematical modeling. We tested public AI’s understanding of mathematics in models, related systems biology data, and the complexity of model structures. Our approach can enhance the accessibility of systems biology for non-system biologists and help them understand systems biology without a deep learning curve.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2022

Real-Time Interactive 4D-STEM Phase-Contrast Imaging From Electron Event Representation Data: Less computation with the right representation

The arrival of direct electron detectors (DED) with high frame-rates in the field of scanning transmission electron microscopy has enabled many experimental techniques that require collection of a full diffraction pattern at each scan position, a field which is subsumed under the name four dimensional-scanning transmission electron microscopy (4D-STEM). DED frame rates approaching 100 kHz require data transmission rates and data storage capabilities that exceed commonly available computing infrastructure. Current commercial DEDs allow the user to make compromises in pixel bit depth, detector binning or windowing to reduce the per-frame file size and allow higher frame rates. This change in detector specifications requires decisions to be made before data acquisition that may reduce or lose information that could have been advantageous during data analysis. The 4D Camera, a DED with 87 kHz frame-rate developed at Lawrence Berkeley National Laboratory, reduces the raw data to a linear-index encoded electron event representation (EER). Here we show with experimental data from the 4D Camera that linear-index encoded EER and its direct use in 4D-STEM phase contrast imaging methods enables real-time, interactive phase-contrast from large-area 4D-STEM datasets. Furthermore, we detail the computational complexity advantages of the EER and the necessary computational steps to achieve real-time interactive ptychography and center-of-mass differential phase contrast using commonly available hardware accelerators.

4D-STEM↗

DOE OSTI2026

Data Center Market Report

The data center market is poised to explode in the coming decade due to undeniable drivers such as continued adoption of generative AI, increased data storage needs, and enterprise integration of AI in numerous industries [1] [2] [3]. Scalable power and increased computational capacity are at the forefront of considerations for hyperscalers, the major cloud service providers in this space. Lawrence Livermore National Laboratory is uniquely poised to help with informed decision making for data center market leaders during this phase of explosive expansion. National grid modeling expertise and cutting edge innovations in computer cooling systems place LLNL in an enviable position for creating economic impact in the data center industry by leveraging its expertise in these areas which can help the data center market keep up with growing demand.

97 MATHEMATICS AND COMPUTING↗

NASA NTRS1990

Microspacecraft and Earth observation: Electrical field (ELF) measurement project

The Utah State University space system design project for 1989 to 1990 focuses on the design of a global electrical field sensing system to be deployed in a constellation of microspacecraft. The design includes the selection of the sensor and the design of the spacecraft, the sensor support subsystems, the launch vehicle interface structure, on board data storage and communications subsystems, and associated ground receiving stations. Optimization of satellite orbits and spacecraft attitude are critical to the overall mapping of the electrical field and, thus, are also included in the project. The spacecraft design incorporates a deployable sensor array (5 m booms) into a spinning oblate platform. Data is taken every 0.1 seconds by the electrical field sensors and stored on-board. An omni-directional antenna communicates with a ground station twice per day to down link the stored data. Wrap-around solar cells cover the exterior of the spacecraft to generate power. Nine Pegasus launches may be used to deploy fifty such satellites to orbits with inclinations greater than 45 deg. Piggyback deployment from other launch vehicles such as the DELTA 2 is also examined.

Olsen, Tanya↗

NASA NTRS2003

Towards Automating Spacecraft Attitude Sensor Calibration

With a view towards reducing cost and complexity for spacecraft early mission support at the NASA Goddard Space Flight Center (GSFC), efforts are being made to automate the attitude sensor calibration process. This paper addresses one of the major components needed by such a system. The beneficiaries of an improved calibration process are missions that demand moderate to high precision attitude knowledge or that need to perform accurate attitude slews. Improved slew accuracy reduces the time needed for re-acquisition of fine-pointing after each attitude maneuver, Rapid target acquisition can be very important for astronomical targeting or for off-nadir surface feature targeting by Earth-oriented spacecraft. The normal sequence of on-orbit calibration starts with alignment calibration of the star trackers and possibly the Sun sensor. Their relative alignment needs to be determined using a sufficiently large data set so their fields of view are adequately sampled. Next, the inertial reference unit (IRU) is calibrated for corrections to its alignment and scale factors. The IRU biases are estimated continuously by the onboard attitude control system, but the IRU alignment and scale factors are usually determined on the ground using a batch-processing method on a data set that includes several slews sufficient to give full observability of all the IRU calibration parameters. Finally, magnetometer biases, alignment, and its coupling to the magnetic torquers are determined in order io improve momentum management and occasionally for use in the attitude determination system. The detailed approach used for automating calibrations will depend on whether the automated system resides on the ground or on the spacecraft with an ultimate goal of autonomous calibration. Current efforts focus on a ground-based system driving subsystems that could run either on the ground or onboard. The distinction is that onboard calibration should process the data sequentially rather than in a single large batch since onboard computer data storage is limited. Very good batch- processing calibration utilities have been developed and used extensively at NASA/GSFC for mission support but no sequential calibration utilities are available. To meet this need, this paper presents the mathematical description of a sequential IRU calibration system. The system has been tested using flight data from the Rossi X-ray Timing Explorer (RXTE) during a series of attitude slews. The paper also discusses the current state of the overall automated system and describes plans for adding sequential alignment calibration and other additions that will reduce the amount of analyst time and input.

Sedlak, Joseph↗

DOE OSTI2024

AmpSuite

Seismic amplitudes offer vital information about explosion source characteristics, including discrimination and yield estimation. To take advantage of this, we developed an interactive Python package to measure, control data quality, generate broad area propagation models and perform discrimination and estimate yield. Propagation models are essential in support of transportable yield and broad area discrimination. The key benefit of this package will be its ability to continuously integrate data and new techniques. The AmpSuite framework will provide standardized, repeatable, and accurate model generation and characterization routines. The capability is crucial for monitoring agencies tasked with rapid and high-quality seismic event characterization. The AmpSuite software includes a series of independent modules to perform: • Direct Phase Amplitude Measurement and Storage • Coda Envelope Measurement and Storage • Data Quality Control • New Propagation Model Developments • Seismic Discrimination and Analysis • Yield Estimation and supporting utility software. The AmpSuite software provides comprehensive solutions for monitoring agencies seeking to optimize model generation and event analysis within a contemporary Python framework. Stakeholders (AFTAC) have begun to move towards the Python language for scientific analysis as a new workforce emerges.

Alfaro, Richard↗

NASA NTRS2012

Identifying and Addressing Land Surface Model Deficiencies with Data Assimilation

Land surface models (LSMs) encapsulate our understanding of terrestrial water and energy cycle physics and provide estimates of land surface states and fluxes when and where measurement gaps exist. Gaps in our understanding of the physics are a different issue. Data assimilation can address that issue both directly, through updating of prognostic model variables, or indirectly, when the simulated world conflicts with observation, necessitating adjustment of the model. Here we will focus on the latter case and present several examples, including (1) depth to bedrock adjustment to accommodate assimilated GRACE terrestrial water storage data; (2) steps to prevent immediate melting of assimilated snow cover; (3) irrigation's contribution to evapotranspiration; (4) lessons learned from soil moisture data assimilation; (5) the potential impact of satellite based runoff observation

Rodell, Matthew↗

NASA NTRS2011

Sptrace

Sptrace is a general-purpose space utilization tracing system that is conceptually similar to the commercial Purify product used to detect leaks and other memory usage errors. It is designed to monitor space utilization in any sort of heap, i.e., a region of data storage on some device (nominally memory; possibly shared and possibly persistent) with a flat address space. This software can trace usage of shared and/or non-volatile storage in addition to private RAM (random access memory). Sptrace is implemented as a set of C function calls that are invoked from within the software that is being examined. The function calls fall into two broad classes: (1) functions that are embedded within the heap management software [e.g., JPL's SDR (Simple Data Recorder) and PSM (Personal Space Management) systems] to enable heap usage analysis by populating a virtual time-sequenced log of usage activity, and (2) reporting functions that are embedded within the application program whose behavior is suspect. For ease of use, these functions may be wrapped privately inside public functions offered by the heap management software. Sptrace can be used for VxWorks or RTEMS realtime systems as easily as for Linux or OS/X systems.

Burleigh, Scott C.↗

NASA NTRSDate not supplied

The Gandalf Staff: A Mobile Tool for Lunar Exploration (2nd year of development)

The Gandalf Staff is a mobile tool designed to be a flexible device supporting crewed and uncrewed operations on the lunar surface. The core of the device is a 24v battery with communications and data storage systems. Initial optional components supporting crewed Extra-Vehicular Activity (EVA) include a LiDAR and 360˚ camera. These provide 3D mapping of the traverse for documentation, and to aid future planning. The mapping also creates outreach opportunities for the public to “stand beside” the astronaut in Virtual Reality (VR). The staff provides external lighting for field site illumination in the south polar region low sun angle environment. Navigation instruments for crew position determination with Lunar Search and Rescue (LunaSAR) are also included. The staff itself can be used as a walking aid or as a splint for Incapacitated Crew Rescue (ICR). As a stand-alone device, the staff operates as a long duration untended science platform collecting environmental data and sending it to a lunar base station. The stand-alone mode requires connection to an auxiliary power source (e.g. solar array) and energy storage system (e.g. battery), so it could become an electrical recharging station. To make rapid progress in the 1st year, and also to demonstrate innovative project management techniques, NASA guided a private industry partner, T STAR, in leading Capstone Engineering student teams at Texas A&M University (TAMU) for proof-of-concept development and testing. These teams developed the power system and demonstrated successful integration of LiDAR, WiFi communications, and external lighting subsystems. Another industry team at Jacobs Technology prototyped a tripod to hold the staff upright. For the 2nd year (FY’22), NASA will again collaborate with partners to prototype enhanced power and lighting concepts. Year 2 will also add new capability for LunaSAR and geophysical science instrumentation using a heat probe. The heat probe is based upon Apollo heritage but modified to measure subsurface volatile ice regimes at the Artemis landing site. Components of the Gandalf Staff can be developed, tested, and deployed independently, or on the integrated staff, rovers, or utility trailers. The project supports crew safety, lunar sample curation, mission science, and public outreach goals of NASA. PLAIN TEST SUMMARY: Gandalf Staff is a 24v battery powered mobile tool for the lunar surface supporting crewed geologic field site exploration, or as a stand-alone science platform. As a tool assisting astronauts conducting field geology, the Gandalf Staff provides external lighting to illuminate shadowed regions on the surface. It also documents the process of collecting rocks and dust samples using a LiDAR (laser range instrument) and cameras. The staff provides a beacon for emergency location of astronauts and augments communications when the astronauts are blocked by large boulders. As a standalone science platform, the Gandalf Staff provides a power system for instruments and sensors to measure the lunar environment over long periods of time. The staff gathers data and sends the results to a lunar base station for analysis.

External Lighting↗

NASA NTRS1992

A model to compare performance of space and ground network support of low-Earth orbiters

This article compares the downlink performance in a gross average sense between space and ground network support of low-Earth orbiters. The purpose is to assess what the demand for DSN support of future small, low-cost missions might be, if data storage for spacecraft becomes reliable enough and small enough to support the storage requirements needed to enable support only a fraction of the time. It is shown that the link advantage of the DSN over space reception in an average sense is enormous for low-Earth orbiters. The much shorter distances needed to communicate with the ground network more than make up for the speedup in data rate needed to compensate for the short contact times with the DSN that low-Earth orbiters have. The result is that more and more requests for DSN-only support of low-Earth orbiters can be expected.

Posner, E. C.↗