Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data cube”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3
All sourcesNASA NTRSDOE OSTI
NASA NTRS1992

The evolution of the FIGARO data reduction system

The Figaro data reduction system originated at Caltech around 1983. It was based on concepts being developed in the U.K. by the Starlink organization, particularly the use of hierarchical self-defining data structures and the abstraction of most user-interaction into a set of 'parameter system' routines. Since 1984 it has continued to be developed at AAO, in collaboration with Starlink and Caltech. It was adopted as Starlink's main spectroscopic data reduction package, although it is by no means limited to spectra; it has operations for images and data cubes and even a few (very specialized) for four-dimensional data hypercubes. It continued to be used at Caltech and will be used at the Keck. It is also in use at a variety of other organizations around the world. Figaro was originally a system for VMS Vaxes. Recently it was ported (at Caltech) to run on SUN's, and work is underway at the University of New South Wales on a DecStation version. It is hoped to coordinate all this work into a unified release, but coordination of the development of a system by organizations covering three continents poses a number of interesting administrative problems. The hierarchical data structures used by Figaro allow it to handle a variety of types of data, and to add new items to data structures. Error and data quality information was added to the basic file format used, error information being particularly useful for infrared data. Cooperating sets of programs can add specific sub-structures to data files to carry information that they understand (polarimetry data containing multiple data arrays, for example), without this affecting the way other programs handle the files. Complex instrument-specific ancillary information can be added to data files written at a telescope and can be used by programs that understand the instrumental details in order to produce properly calibrated data files. Once this preliminary data processing was done the resulting files contain 'ordinary' spectra or images that can be processed by programs that are not instrument-specific. The structures holding the instrumental information can then be discarded from the files. Much effort has gone into trying to make it easy to write Figaro programs; data access subroutines are now available to handle access to all the conventional items found in Figaro files (main data arrays, error information, quality information etc), and programs that only need to access such items can be very simple indeed. A large number of Figaro users do indeed write their own Figaro applications using these routines. The fact that Figaro programs are written as callable subroutines getting information from the user through a small set of parameter routines means that they can be invoked in numerous ways; they are normally linked and run as individual programs (called by a small main routine that is generated automatically), but are also available linked to run under the ADAM data acquisition system and there is an interface that lets them be called as part of a user-written Fortran program. The long-term future of Figaro probably depends to a large extent on how successfully it manages the transition from being a VMS-only system to being a multi-platform system.

Shortridge, K.↗
NASA NTRS1995

Yohkoh/SXT x-ray synoptic maps of coronal brightness and temperature

The Yohkoh soft X-ray telescope (SXT) records on the order of 50 solar images per day in two different color filters. These provide material for the generation of synoptic maps, which compress the 3-dimensional data cube into two dimensions. We are creating synoptic maps from strips of data both at disk center and at different heights, including limb maps that are analogous to those produced by ground-based coronagraphs. The ratios of intensities in images taken in two filters provide estimates of the electron temperature in the range 1 - 3 x 10(exp 6) K. These are broad-band temperature maps; rather than maps created with discrete sampling as in the case of the coronal green and red lines. We discuss the properties of these maps and their application to the study of energy release in the corona.

Slater, G. L.↗
NASA NTRS2006

X-ray Mapping of Terrestrial and Extraterrestrial Materials Using the Electron Microprobe

Lunar samples returned from the Apollo program motivated development of the Bence-Albee algorithm for the rapid and accurate analysis of lunar materials, and established interlaboratory comparability through its common use. In the analysis of mineral and rock fragments it became necessary to combine micro- and macroscopic analysis by coupling electron-probe microanalysis (EPMA) with automated stage point counting. A coarse grid that included several thousand points was used, and initially wavelength-dispersive (WDS) and later energydispersive (EDS) data were acquired at discrete stage points using approx. 5 sec count times. A approx 50 micrometer beam diameter was used for WDS and up to 500 micrometer beam diameter for EDS analysis. Average analyses of discretely sampled phases were coupled with the point count data to calculate the bulk composition using matrix algebra. Use of a defocused beam resulted in a contribution from multiple phases to each analytical point, and the analytical data were deconvolved relative to end-member phase chemistry on the fly. Impressive agreement was obtained between WDS and EDS measurements as well as comparison with bulk chemistry obtained by other methods. In the 30 years since these methods were developed, significant improvements in EPMA automation and computer processing have taken place. Digital beam control allows routine collection of x-ray maps by EDS, and stage mapping for WDS is conducted continuously at slew speed and incrementally by sampling at discrete points. Digital pulse processing in EDS systems has significantly increased the throughput for EDS mapping, and the ongoing development of Si-drift detector systems promises mapping capabilities rivaling WDS systems. Spectrum imaging allows a data cube of EDS spectra to be acquired and sophisticated processing of the original data is possible using matrix algebra techniques. The study of lunar and meteoritic materials includes the need to conveniently: (1) Characterize the sample at microscopic and macroscopic scales with relatively high sensitivity, (2) Determine the modal abundance of minerals, and (3) Identify and relocate discrete features of interest in terms of size and chemistry. The coupled substitution of cations in minerals can result in significant variation in mineral chemistry, but at similar average Z, leading to poor backscattered-electron (BSE) contrast discrimination of mineralogy. It is necessary to discriminate phase chemistry at both the trace element level and the major element level. To date, the WDS of microprobe systems is preferred for mapping due to high throughput and the ability to obtain the necessary intensity to discriminate phases at both trace and major element concentrations. It is desirable to produce fully quantitative compositional maps of geological materials, which requires the acquisition of k-ratio maps that are background and dead-time corrected, and which have been corrected by phi(delta z> or an equivalent algorithm at each pixel. To date, turnkey systems do not allow the acquisition of k-ratio maps and the rigorous correction in this manner. X-ray maps of a chondrule from the Ourique meteorite, and a comb-layered xenolith from the San Francisco volcanic field, have been analyzed and processed to extract phase information. The Ourique meteorite presents a challenge due to relatively low BSE contrast, and has been studied using spectrum imaging. X-ray maps for Si, Mg, and FeK(alpha) were used to produce RGB images. The xenolith sample contains sector-zoned augite, olivine, plagioclase, and basaltic glass. X-ray maps were processed using Lispix and ImageJ software to produce mineral phase maps. The x-ray maps for Mg, Ca, and Ti were used with traceback to generate binary images that were converted to RGB images. These approaches are successful in discriminating phases, but it is desirable to achieve the methods that were used on lunar samples 30 years ago on current microprobe systems. Curnt research includes x-ray mapping analysis of the Dalgety Downs chondrite by micro x-ray fluorescence and spectrum imaging, in collaboration with Kenny Witherspoon of IXRF Systems and Dale Newbury of NIST.

Carpenter, P.↗
NASA NTRS2016

Optimal Reorganization of NASA Earth Science Data for Enhanced Accessibility and Usability for the Hydrology Community

A long-standing "Digital Divide" in data representation exists between the preferred way of data access by the hydrology community and the common way of data archival by earth science data centers. Typically, in hydrology, earth surface features are expressed as discrete spatial objects (e.g., watersheds), and time-varying data are contained in associated time series. Data in earth science archives, although stored as discrete values (of satellite swath pixels or geographical grids), represent continuous spatial fields, one file per time step. This Divide has been an obstacle, specifically, between the Consortium of Universities for the Advancement of Hydrologic Science, Inc. and NASA earth science data systems. In essence, the way data are archived is conceptually orthogonal to the desired method of access. Our recent work has shown an optimal method of bridging the Divide, by enabling operational access to long-time series (e.g., 36 years of hourly data) of selected NASA datasets. These time series, which we have termed "data rods," are pre-generated or generated on-the-fly. This optimal solution was arrived at after extensive investigations of various approaches, including one based on "data curtains." The on-the-fly generation of data rods uses "data cubes," NASA Giovanni, and parallel processing. The optimal reorganization of NASA earth science data has significantly enhanced the access to and use of the data for the hydrology user community.

data rods↗
NASA NTRS2022

VIPRE: A Tool Aiding the Design for Entry Probe Missions

Exploring planetary atmospheres uncovers important information for how our solar system formed and evolved. While remote sensing is extensively used, some crucial observations require in-situ measurements by an atmospheric probe. Given their scientific importance, probe missions to Saturn, Uranus and Neptune are considered for the coming decades. In anticipation of future probe missions, the software tool VIPRE was developed as proof-of-concept to facilitate selection of probe entry locations. Currently, there is no analytical way to identify which interplanetary trajectory from thousands of feasible launch opportunities is optimal for a considered mission concept. The search and decision process for that solution is complex and relies on the intuition of mission designers, who focus on a subset of trajectories to make the trade space manageable. The idea of VIPRE is to (1) generate a multi-dimensional data cube showing relevant engineering and science parameters simultaneously for thousands of trajectories, and (2) visualize the data for all entry sites over the body's envelope. VIPRE lays the foundation to make the data available for browsing in a 3-D visualization to identify the best family of solutions for a given mission. The paper introduces the validated and verified core algorithms of VIPRE, published on GitHub. VIPRE serves as a basic framework to be used and extended for different purposes. The paper presents the motivation for the development and algorithms. It explains the computation and data visualization strategy, and gives a list of suggested functionalities to extend and further develop VIPRE to fully leverage its potential.

Ice Giants↗
NASA NTRS2011

Properties and Spatial Distribution of Dust Emission in the Crab Nebula

The nature and quantity of dust produced in supernovae (SNe) is still poorly understood. Recent IR observations of freshly-formed dust in supernova remnants (SNRs) have yielded significantly lower dust masses than predicted by theoretical models and observations high-redshift galaxies. The Crab Nebula's pulsar wind is thought to be sweeping up freshly-formed SN dust along with the SN ejecta. The evidence for this dust was found in the form of an IR bump in the integrated spectrum of the Crab and in extinction against the synchrotron nebula that revealed the presence of dust in the filament cores. We present the first spatially-resolved emission spectra of dust in the Crab Nebula acquired with the Spitzer Space Telescope. The IR spectra are dominated by synchrotron emission and show forbidden line emission from both sides of the expanding nebula, including emission from [S III], [Si II], [Ne II], [Ne III], [Ne V], [Ar III], [Ar V], [Fe II], and [Ni II]. We extrapolated a synchrotron spectral data cube from the Spitzer 3.6 and 4.5 micron images, and subtracted this contribution from our 15-40 micron spectral data to produce a map of the residual continuum emission from dust. The emission appears to be concentrated along the ejecta filaments and is well described by astronomical silicates at an average temperature of 65 K. The estimated mass of dust in the Crab Nebula is 0.008 solar masses.

Sonneborn, G.↗
DOE OSTI2023

NDA Tech: Multimodal Data Fusion with 3D Gamma-Ray Imaging for Safeguards

The ultimate project goal is to improve quantitative results obtained by the IAEA with the H420 gamma ray imager. Distribution to the IAEA will be through incorporation of project results into the software provided with the device by our commercial partner, H3D, Inc. Toward achieving that goal, we have started discussions with H3D to identify the requisite software components and how they will mesh with their own internally developed contextual data systems and other extant software components. We have identified the coded-aperture response data cube as a key structure. Discussions on contextual imaging were informative but somewhat inconclusive as the project lead on contextual data (LBNL) has not been available.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
NASA NTRS2002

Software for Simulation of Hyperspectral Images

A package of software generates simulated hyperspectral images for use in validating algorithms that generate estimates of Earth-surface spectral reflectance from hyperspectral images acquired by airborne and spaceborne instruments. This software is based on a direct simulation Monte Carlo approach for modeling three-dimensional atmospheric radiative transport as well as surfaces characterized by spatially inhomogeneous bidirectional reflectance distribution functions. In this approach, 'ground truth' is accurately known through input specification of surface and atmospheric properties, and it is practical to consider wide variations of these properties. The software can treat both land and ocean surfaces and the effects of finite clouds with surface shadowing. The spectral/spatial data cubes computed by use of this software can serve both as a substitute for and a supplement to field validation data.

Richtsmeier, Steven C.↗
NASA NTRS2004

Simulation of Hyperspectral Images

A software package generates simulated hyperspectral imagery for use in validating algorithms that generate estimates of Earth-surface spectral reflectance from hyperspectral images acquired by airborne and spaceborne instruments. This software is based on a direct simulation Monte Carlo approach for modeling three-dimensional atmospheric radiative transport, as well as reflections from surfaces characterized by spatially inhomogeneous bidirectional reflectance distribution functions. In this approach, "ground truth" is accurately known through input specification of surface and atmospheric properties, and it is practical to consider wide variations of these properties. The software can treat both land and ocean surfaces, as well as the effects of finite clouds with surface shadowing. The spectral/spatial data cubes computed by use of this software can serve both as a substitute for, and a supplement to, field validation data.

Richsmeier, Steven C.↗
DOE OSTI2026

FAIRLinked: Data FAIRification Tools for Materials Data Science

FAIRLinked is a software package created to support the FAIRification of materials science data, ensuring proper alignment with FAIR principles: Findable, Accessible, Interoperable, and Reusable. It is built to be compatible with MDS-Onto, an ontology designed to capture the semantics of various types of materials data, enabling integration and sharing across different research workflows. The package is subdivided into three subpackages: InterfaceMDS, RDFTableConversion, and QBWorkflow. The first subpackage, InterfaceMDS allows users to search for terms using either string search or various filters, explore different domains and subdomains, and add terms to MDS-Onto. RDFTableConversion is used for serialization and deserialization of data from CSV into JSONLDs and vice versa in a way that captures the semantics of the data using MDS-Onto. Lastly, QBWorkflow is a serialization and deserialization workflow that incorporates RDF Data Cube vocabulary, useful for working with multidimensional datasets. By offering these packages, FAIRLinked lowers the barrier of creating FAIR, machine-actionable data for researchers in the materials science community.

FAIR↗
NASA NTRS2003

A High Performance Image Data Compression Technique for Space Applications

A highly performing image data compression technique is currently being developed for space science applications under the requirement of high-speed and pushbroom scanning. The technique is also applicable to frame based imaging data. The algorithm combines a two-dimensional transform with a bitplane encoding; this results in an embedded bit string with exact desirable compression rate specified by the user. The compression scheme performs well on a suite of test images acquired from spacecraft instruments. It can also be applied to three-dimensional data cube resulting from hyper-spectral imaging instrument. Flight qualifiable hardware implementations are in development. The implementation is being designed to compress data in excess of 20 Msampledsec and support quantization from 2 to 16 bits. This paper presents the algorithm, its applications and status of development.

Yeh, Pen-Shu↗
NASA NTRS2012

Wide-Field Imaging Interferometry Spatial-Spectral Image Synthesis Algorithms

Developed is an algorithmic approach for wide field of view interferometric spatial-spectral image synthesis. The data collected from the interferometer consists of a set of double-Fourier image data cubes, one cube per baseline. These cubes are each three-dimensional consisting of arrays of two-dimensional detector counts versus delay line position. For each baseline a moving delay line allows collection of a large set of interferograms over the 2D wide field detector grid; one sampled interferogram per detector pixel per baseline. This aggregate set of interferograms, is algorithmically processed to construct a single spatial-spectral cube with angular resolution approaching the ratio of the wavelength to longest baseline. The wide field imaging is accomplished by insuring that the range of motion of the delay line encompasses the zero optical path difference fringe for each detector pixel in the desired field-of-view. Each baseline cube is incoherent relative to all other baseline cubes and thus has only phase information relative to itself. This lost phase information is recovered by having point, or otherwise known, sources within the field-of-view. The reference source phase is known and utilized as a constraint to recover the coherent phase relation between the baseline cubes and is key to the image synthesis. Described will be the mathematical formalism, with phase referencing and results will be shown using data collected from NASA/GSFC Wide-Field Imaging Interferometry Testbed (WIIT).

Lyon, Richard G.↗
NASA NTRS2009

Mineralogy of the Lunar Crust in Spatial Context: First Results from the Moon Mineralogy Mapper (M3)

India's Chandrayaan-1 successfully launched October 22, 2008 and went into lunar orbit a few weeks later. Commissioning of instruments began in late November and was near complete by the end of the year. Initial data for NASA's Moon Mineralogy Mapper (M3) were acquired across the Orientale Basin and the science results are discussed here. M 3 image-cube data provide mineralogy of the surface in geologic context. A major new result is that the existence and distribution of massive amounts of anorthosite as a continuous stratigraphic crustal layer is now irrefutable.

Pieters, C. M.↗
NASA NTRS2000

Acousto-Optic Imaging Spectrometers for Mars Surface Science

NASA's long term plan for Mars sample collection and return requires a highly streamlined approach for spectrally characterizing a landing site, documenting the mineralogical make-up of the site and guiding the collections of samples which represent the diversity of the site. Ideally, image data should be acquired at hundreds of VIS and IR wavelengths, in order to separately distinguish numerous anticipated species, using principal component analysis and linear unmixing. Cameras with bore-sighted point spectrometers can acquire spectra of isolated scene elements, but it requires 10(exp 2) to 10(exp 2) successive motions and precise relative pointing knowledge in order to create a single data cube which qualifies as a spectral map. These and other competing science objectives have to be accomplished within very short lander/rover operational lifetime (a few sols). True, 2-D imaging spectroscopy greatly speeds up the data acquisition process, since the spectra of all pixels in the scene are collected at once. This task can be accomplished with cameras that use electronically tunable acousto-optic tunable filters (AOTFs) as the optical tuning element. AOTFs made from TeO2 are now a mature technology, and operate at wavelengths from near-UV to about 5 microns. Because of incremental improvements in the last few years, present generation devices are rugged, radiation-hard and operate at temperatures down to at least 150K so they can be safely integrated into the ambient temperature optics of in-situ instruments such as planetary or small-body landers. They have been used for ground-based astronomy, and were also baselined for the ST-4 Champollion IR comet lander experiment (CIRCLE), prior to cancellation of the ST-4 mission last year. AIMS (for Acousto-optic Imaging spectrometer), is a prototype lander instrument which is being built at GSFC with support by the NASA OSS Advanced Technologies and Mission Studies, Mars Instrument Definition and Development Program (MIDP). AIMS is capable of tunable spectroscopic imaging of surface mineralogy, ices and dust between 0.5 and 2.4 microns, at a resolving power (lambda/delta lambda) which is typically several hundred. The design spatial resolution, similar to IMP and SSI, will allow mapping at scales down to about 1 cm.

Glenar, D. A.↗
DOE OSTI2022

A scalable, open-source implementation of a large-scale mechanistic model for single cell proliferation and death signaling

Mechanistic models of how single cells respond to different perturbations can help integrate disparate big data sets or predict response to varied drug combinations. However, the construction and simulation of such models have proved challenging. Here, we developed a python-based model creation and simulation pipeline that converts a few structured text files into an SBML standard and is high-performance- and cloud-computing ready. We applied this pipeline to our large-scale, mechanistic pan-cancer signaling model (named SPARCED) and demonstrate it by adding an IFNγ pathway submodel. We then investigated whether a putative crosstalk mechanism could be consistent with experimental observations from the LINCS MCF10A Data Cube that IFNγ acts as an anti-proliferative factor. The analyses suggested this observation can be explained by IFNγ-induced SOCS1 sequestering activated EGF receptors. This work forms a foundational recipe for increased mechanistic model-based data integration on a single-cell level, an important building block for clinically-predictive mechanistic models.

60 APPLIED LIFE SCIENCES↗
NASA NTRS2018

Benchmark Comparison of Cloud Analytics Methods Applied to Earth Observations

Earth Observation data are a vital resource for studying long term changes, but the large data volumes can be challenging to analyze. Time series analysis in particular is hampered by the typical thin-time-slice file organization. We examine several potential solutions inspired in large part by the data-parallel methods that have arisen with cloud computing. These solutions include various combinations of data re-organization, spatial indexing, distributed storage and pre-computation that we term "Analytics Optimized Data Stores" (AODS). We find that even simple solutions (such as a data cube) produce more than an order of magnitude improvement; the best provide two to three orders of magnitude improvement. The most performant solutions have tradeoffs in terms of generality or storage footprint, but may nonetheless be useful components in data analytics frameworks where performance is critical.

parallel processing (computers)↗
DOE OSTI2023

The GMRT archive atomic gas survey – II. Mass modelling and dark matter halo properties across late-type spirals

Studying the kinematics and mass modelling of galaxies from H i 21 cm data provides valuable insights into the properties of both the baryonic components and the dark matter halo in nearby galaxies. Despite many observational studies, mass modelling of galaxies remains challenging due to different limitations. For example, most of the previous studies involving mass modelling are based on rotation curves derived from 2D velocity fields from H i or H α spectroscopic observation which are often affected by beam smearing and projection effect. However, kinematic modelling done by fitting the ‘Tilted ring model’ to 3D data cube is not affected by these issues. In this study, we present and compare 3D kinematic modelling of a pilot sample of 11 galaxies from the GMRT archive atomic gas survey (GARCIA) using two different publicly available pipelines. We model the observed H i rotation curve using 3.6-μm infrared data and SDSS r-band data for stellar contribution, H i surface density profile for gas, and Navarro–Frenk–White profile for dark matter halo; and employ the Markov chain Monte Carlo optimization method for parameter estimation. Further, to validate our analysis, we revisit important scaling relations, e.g. the M gas –M star relation, M star –M halo relation, M gas –M halo relation and Baryonic Tully–Fisher relation. Here, the scaling relations from our analysis are broadly consistent with that reported in the literature. A larger sample of galaxies from GARCIA in the near future will allow studying these scaling relations in greater details.

79 ASTRONOMY AND ASTROPHYSICS↗
NASA NTRS2001

Spatial/Spectral Identification of Endmembers from AVIRIS Data using Mathematical Morphology

During the last several years, a number of airborne and satellite hyperspectral sensors have been developed or improved for remote sensing applications. Imaging spectrometry allows the detection of materials, objects and regions in a particular scene with a high degree of accuracy. Hyperspectral data typically consist of hundreds of thousands of spectra, so the analysis of this information is a key issue. Mathematical morphology theory is a widely used nonlinear technique for image analysis and pattern recognition. Although it is especially well suited to segment binary or grayscale images with irregular and complex shapes, its application in the classification/segmentation of multispectral or hyperspectral images has been quite rare. In this paper, we discuss a new completely automated methodology to find endmembers in the hyperspectral data cube using mathematical morphology. The extension of classic morphology to the hyperspectral domain allows us to integrate spectral and spatial information in the analysis process. In Section 3, some basic concepts about mathematical morphology and the technical details of our algorithm are provided. In Section 4, the accuracy of the proposed method is tested by its application to real hyperspectral data obtained from the Airborne Visible/Infrared Imaging Spectrometer (AVIRIS) imaging spectrometer. Some details about these data and reference results, obtained by well-known endmember extraction techniques, are provided in Section 2. Finally, in Section 5 we expose the main conclusions at which we have arrived.

Plaza, Antonio↗