Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data Processing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,711 records · Page 95

IDC Re-Engineering Phase 2 System Specification Document Version 1.5

This document contains the system specifications derived to satisfy the system requirements found in the IDC System Requirements Document for the IDC Re-Engineering Phase 2 project. This System Specification Document (SSD) defines waveform data processing requirements for the International Data Centre (IDC) of the Comprehensive Nuclear Test Ban Treaty Organization (CTBTO). The routine processing includes characterization of events with the objective of screening out events considered to be consistent with natural phenomena or non-nuclear, man-made phenomena. This document does not address requirements concerning acquisition, processing and analysis of radionuclide data but does include requirements for the dissemination of radionuclide data and products.

97 MATHEMATICS AND COMPUTING↗

Description of the TCERT Vetting Reports for Data Release 25

This document, the Kepler Instrument Handbook (KIH), is for Kepler and K2 observers, which includes the Kepler Science Team, Guest Observers (GOs), and astronomers doing archival research on Kepler and K2 data in NASAs Astrophysics Data Analysis Program (ADAP). The KIH provides information about the design, performance, and operational constraints of the Kepler flight hardware and software, and an overview of the pixel data sets available. The KIH is meant to be read with these companion documents:1. Kepler Data Processing Handbook (KSCI-19081) or KDPH (Jenkins et al., 2016). The KDPH describes how pixels downlinked from the spacecraft are converted by the Kepler Data Processing Pipeline (henceforth just the pipeline) into the data products delivered to the MAST archive. 2. Kepler Archive Manual (KDMC-10008) or KAM (Thompson et al., 2016). The KAM describes the format and content of the data products, and how to search for them.3. Kepler Data Characteristics Handbook (KSCI-19040) or KDCH (Christiansen et al., 2016). The KDCH describes recurring non-astrophysical features of the Kepler data due to instrument signatures, spacecraft events, or solar activity, and explains how these characteristics are handled by the pipeline.4. Kepler Data Release Notes 25 (KSCI-19065) or DRN 25 (Thompson et al., 2015). DRN 25 describes signatures and events peculiar to individual quarters, and the pipeline software changes between a data release and the one preceding it.Together, these documents supply the information necessary for obtaining and understanding Kepler results, given the real properties of the hardware and the data analysis methods used, and for an independent evaluation of the methods used if so desired.

Instrument↗

Saltstone Studies Using the Scaled Continuous Processing Facility

The Savannah River National Laboratory (SRNL) has supported the Saltstone Facility since its conception with bench-scale laboratory experiments, mid-scale testing at vendor facilities, and consultations and testing at the Saltstone Facility. There have been minimal opportunities for the measurement of rheological properties of the grout slurry at the Saltstone Production Facility (SPF); thus, the Scaled Continuous Processing Facility (SCPF), constructed to provide processing data related to mixing, transfer, and other operations conducted in the SPF, is the most representative process data for determining the expected rheological properties in the SPF. These results can be used to verify the laboratory scale experiments that support the SPF using conventional mixing processes that appropriately represent the shear imparted to the slurry in the SPF.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Satellite pattern classification using charge transfer devices

The potential uses of Charge Transfer Devices (CTDs) in pattern classification operations are explored. The needs for a hardware-based pattern classifier are established, and a matrix multiplication subsystem based upon a sum-of-products CTD is presented. Applications of the subsystem to the classification of multi-modal Gaussian distributions in general and to LANDSAT data processing in particular are discussed. Finally, the potential impact of this technology on satellite data processing methodologies is discussed.

Snyder, W. E.↗

Goldstone solar system radar

This task provides for the planning, experiment design, and coordination of the data acquisition and engineering activities in support of all Goldstone planetary radar astronomy. Activities related to up-grades of the receiver systems, transmitter systems, and data processing support systems are currently intense. Also, the hardware and software maintenance of the data processing facility used by many of the Goldstone Solar System Radar investigators are covered.

Jurgens, Raymond F.↗

First Cosmology Results using Supernovae Ia from the Dark Energy Survey: Survey Overview, Performance, and Supernova Spectroscopy

We present details on the observing strategy, data-processing techniques, and spectroscopic targeting algorithms for the first three years of operation for the Dark Energy Survey Supernova Program (DES-SN). This five-year program using the Dark Energy Camera mounted on the 4 m Blanco telescope in Chile was designed to discover and follow supernovae (SNe) Ia over a wide redshift range (0.05 < z < 1.2) to measure the equation-of-state parameter of dark energy. We describe the SN program in full: strategy, observations, data reduction, spectroscopic follow-up observations, and classification. From three seasons of data, we have discovered 12,015 likely SNe, 308 of which have been spectroscopically confirmed, including 251 SNe Ia over a redshift range of 0.017 < z < 0.85. We determine the effective spectroscopic selection function for our sample and use it to investigate the redshift-dependent bias on the distance moduli of SNe Ia we have classified. The data presented here are used for the first cosmology analysis by DES-SN (“DES-SN3YR”), the results of which are given in Dark Energy Survey Collaboration et al. The 489 spectra that are used to define the DES-SN3YR sample are publicly available at https://des.ncsa.illinois.edu/releases/sn.

79 ASTRONOMY AND ASTROPHYSICS↗

GIS-and Web-based Water Resource Geospatial Infrastructure for Oil Shale Development

The Colorado School of Mines (CSM) was awarded a grant by the National Energy Technology Laboratory (NETL), Department of Energy (DOE) to conduct a research project en- titled GIS- and Web-based Water Resource Geospatial Infrastructure for Oil Shale Development in October of 2008. The ultimate goal of this research project is to develop a water resource geo-spatial infrastructure that serves as “baseline data” for creating solutions on water resource management and for supporting decisions making on oil shale resource development. The project came to the end on September 30, 2012. This final project report will report the key findings from the project activity, major accomplishments, and expected impacts of the research. At meantime, the gamma version (also known as Version 4.0) of the geodatabase as well as other various deliverables stored on digital storage media will be send to the program manager at NETL, DOE via express mail. The key findings from the project activity include the quantitative spatial and temporal distribution of the water resource throughout the Piceance Basin, water consumption with respect to oil shale production, and data gaps identified. Major accomplishments of this project include the creation of a relational geodatabase, automated data processing scripts (Matlab) for database link with surface water and geological model, ArcGIS Model for hydrogeologic data processing for groundwater model input, a 3D geological model, surface water/groundwater models, energy resource development systems model, as well as a web-based geo-spatial infrastructure for data exploration, visualization and dissemination. This research will have broad impacts of the devel- opment of the oil shale resources in the US. The geodatabase provides a “baseline” data for fur- ther study of the oil shale development and identification of further data collection needs. The 3D geological model provides better understanding through data interpolation and visualization techniques of the Piceance Basin structure spatial distribution of the oil shale resources. The sur- face water/groundwater models quantify the water shortage and better understanding the spatial distribution of the available water resources. The energy resource development systems model reveals the phase shift of water usage and the oil shale production, which will facilitate better planning for oil shale development. Detailed descriptions about the key findings from the project activity, major accomplishments, and expected impacts of the research will be given in the sec- tion of “ACCOMPLISHMENTS, RESULTS, AND DISCUSSION” of this report.

04 OIL SHALES AND TAR SANDS↗

Distinguishing Provenance Equivalence of Earth Science Data

Reproducibility of scientific research relies on accurate and precise citation of data and the provenance of that data. Earth science data are often the result of applying complex data transformation and analysis workflows to vast quantities of data. Provenance information of data processing is used for a variety of purposes, including understanding the process and auditing as well as reproducibility. Certain provenance information is essential for producing scientifically equivalent data. Capturing and representing that provenance information and assigning identifiers suitable for precisely distinguishing data granules and datasets is needed for accurate comparisons. This paper discusses scientific equivalence and essential provenance for scientific reproducibility. We use the example of an operational earth science data processing system to illustrate the application of the technique of cascading digital signatures or hash chains to precisely identify sets of granules and as provenance equivalence identifiers to distinguish data made in an an equivalent manner.

Tilmes, Curt↗

Zero-Dimensional Model to Study the Effectiveness of Plasma Heating and Thermal Energy Confinement in Globus-M Tokamak in Ohmic Heating Modes

Experimental study of thermal energy confinement in magnetic confinement devices is one of the fundamental problems in plasma physics. The data processing technique covering kinetic and magnetic measurements performed for the Globus-M tokamak is described. A zero-dimensional code has been developed on the basis of this approach making it possible to calculate important discharge parameters during the experiment (between discharges): the electron and ion stored thermal energy content, plasma effective charge, and confinement time. Good agreement of the zero-dimensional calculations and ASTRA modeling indicates that this approach can be applied for routine data processing in Globus-M in view of the specifics of the device.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Biomass Harmonization and SAR Analysis with the Multi-mission Algorithm and Analysis Platform (MAAP)

The Multi‐mission Algorithm and Analysis Platform (MAAP) is a collaborative effort between NASA and the European Space Agency (ESA) to support above ground biomass (AGB) research in an open science framework. MAAP brings together relevant data, algorithms, and computing capabilities in a common cloud environment to address the challenges of sharing and processing data from field, airborne and satellite measurements. MAAP was publicly released in October 2021, providing computing capabilities co-located with the data, a collaborative coding and analysis environment, and a set of interoperable tools and algorithms developed to support the estimation and visualization of data. MAAP has allowed scientists from both North America and Europe to collaborate on the generation and analysis/visualization of data derived from multiple, discipline-adjacent missions in an open, collaborative environment that has reached beyond traditional scientific investigation. MAAP has been used to support multiple scientific activities. To date, existing LiDAR data from multiple platforms has been calibrated with field measurements and combined for more comprehensive and accurate estimates of above ground biomass AGB; these LiDAR platforms include airborne (e.g. LVIS), the International Space Station (NASA’s Global Ecosystem Dynamics Investigation (GEDI), and satellites (e.g. ICESat-2). The current challenge is to effectively and seamlessly combine the aforementioned LiDAR-based data with new data sources such as P-band RADAR from ESA’s upcoming BIOMASS mission, existing ESA Sentinel-1 C-band SAR, and the 30 PB/yr of high cadence global coverage L-band SAR data from the upcoming NASA-ISRO SAR (NISAR) mission. Recent analysis using MAAP merged ICESat-2 and optical data (Harmonized Landsat Sentinel) produced the most comprehensively precise estimate of boreal-wide AGB to date. Another effort using MAAP is the production and open distribution of global comparisons of AGB map estimates, including from ICESat-2 and GEDI, to bolster stakeholder uptake for policy applications. These map estimates will feed into the Intergovernmental Panel on Climate Change (IPCC) database, likely aiding the next Global Carbon Stocktake of the UNFCCC. Furthermore, the biomass retrieval intercomparison exercise BRIX-2 could benefit from the MAAP providing standardized test cases (based on airborne campaign and spaceborne data) allowing the community to develop and apply retrieval algorithms based on these test cases, while forthcoming SAR data training curricula could also use the MAAP as a teaching and learning platform. The MAAP is meeting the challenges inherent in international, open science collaboration and large scale computing with a platform that is entirely open source and cloud native, using open standards for data access, manipulation, protocols, and formats. The MAAP data system consists of a dedicated data store whose data is indexed in an online catalog conforming to established metadata, application programmatic interfaces (APIs), and service interface standards, using an implementation of the open sourced NASA Common Metadata Repository. Federation of user identities allows users from either NASA or ESA to access and consume services from the other using a unified metadata catalog for the data utilized across the ESA and NASA MAAP platforms. Similarly, we are exploring how to increase interoperability to achieve a common approach to packaging, orchestrating and executing algorithms, with interoperable access to data for subsetting, fast browse, and cloud-optimized access, all using interoperable standards such as those from the Open Geospatial Consortium (OGC). Designed for interoperability, ESA and NASA utilize a common architecture for the software platform. It provides a cloud-based algorithm development environment (ADE) that enables scientists to develop algorithms collaboratively with access to the MAAP data catalog as well as other data archives. MAAP provides an Eclipse Che-based ADE supporting both Python and R languages, popular in this biomass community. Algorithms developed and containerized within the ADE can be deployed to run to thousands of computational nodes in the MAAP’s data processing system (DPS), dramatically speeding up processing and giving scientists a rapid, iterative turnaround of results. NASA’s implementation of the DPS is based on the Hybrid Science Data System (HySDS) framework, used by NASA flight projects to produce Earth science standard products.

cloud computing↗

Scanning ARM Cloud Radars. Part II: Data Quality Control and Processing

The Scanning ARM Cloud Radars (SACR’s) are the primary instruments for documenting the four-dimensional structure and evolution of clouds within a 20-30 km radius from the ARM fixed and mobile sites. Here, the post-processing of the calibrated SACR measurements is discussed. First, a feature mask algorithm that objectively determines the presence of significant radar returns is described. The feature mask algorithm is based on the statistical properties of radar receiver noise. It accounts for atmospheric emission and is applicable even for SACR profiles with few or no signal-free range gates. Using the nearest-in-time atmospheric sounding, the SACR radar reflectivities are corrected for gaseous attenuation (water vapor and oxygen) using a line-by-line absorption model. Despite having a high pulse repetition frequency, the SACR has a narrow Nyquist velocity limit and thus Doppler velocity folding is commonly observed. An unfolding algorithm that makes use of a first guess for the true Doppler velocity using horizontal wind measurements from the nearest sounding is described. The retrieval of the horizontal wind profile from the HS-RHI SACR scan observations and/or nearest sounding is described. The retrieved horizontal wind profile can be used to adaptively configure SACR scan strategies that depend on wind direction. Several remaining challenges are discussed, including the removal of insect and second-trip echoes. The described algorithms significantly enhance SACR data quality and constitute an important step towards the utilization of SACR measurements for cloud research.

climate↗

High-Throughput, Adaptive FFT Architecture for FPGA-Based Spaceborne Data Processors

Exponential growth in microelectronics technology such as field-programmable gate arrays (FPGAs) has enabled high-performance spaceborne instruments with increasing onboard data processing capabilities. As a commonly used digital signal processing (DSP) building block, fast Fourier transform (FFT) has been of great interest in onboard data processing applications, which needs to strike a reasonable balance between high-performance (throughput, block size, etc.) and low resource usage (power, silicon footprint, etc.). It is also desirable to be designed so that a single design can be reused and adapted into instruments with different requirements. The Multi-Pass Wide Kernel FFT (MPWK-FFT) architecture was developed, in which the high-throughput benefits of the parallel FFT structure and the low resource usage of Singleton s single butterfly method is exploited. The result is a wide-kernel, multipass, adaptive FFT architecture. The 32K-point MPWK-FFT architecture includes 32 radix-2 butterflies, 64 FIFOs to store the real inputs, 64 FIFOs to store the imaginary inputs, complex twiddle factor storage, and FIFO logic to route the outputs to the correct FIFO. The inputs are stored in sequential fashion into the FIFOs, and the outputs of each butterfly are sequentially written first into the even FIFO, then the odd FIFO. Because of the order of the outputs written into the FIFOs, the depth of the even FIFOs, which are 768 each, are 1.5 times larger than the odd FIFOs, which are 512 each. The total memory needed for data storage, assuming that each sample is 36 bits, is 2.95 Mbits. The twiddle factors are stored in internal ROM inside the FPGA for fast access time. The total memory size to store the twiddle factors is 589.9Kbits. This FFT structure combines the benefits of high throughput from the parallel FFT kernels and low resource usage from the multi-pass FFT kernels with desired adaptability. Space instrument missions that need onboard FFT capabilities such as the proposed DESDynl, SWOT (Surface Water Ocean Topography), and Europa sounding radar missions would greatly benefit from this technology with significant reductions in non-recurring cost and risk.

NguyenKobayashi, Kayla↗

An efficient data format for mass spectrometry based proteomics

The diverse range of mass spectrometry (MS) instrumentation along with corresponding proprietary and non-proprietary data formats has generated a proteomics community driven call for a standardized format to facilitate management, processing, storing, visualization, and exchange of both experimental and processed data. To date, significant efforts have been extended towards standardizing XML-based formats for mass spectrometry data representation, despite the recognized inefficiencies associated with storing large numeric datasets in XML. The proteomics community has periodically entertained alternate strategies for data exchange, e.g., using a common application programming interface or a database-derived format. However these efforts have yet to garner significant attention, mostly because they haven’t illustrated significant performance benefits over existing standards, but also due to issues such as extensibility to multi-dimensional separation systems, robustness of operation, and incomplete or mismatched vocabulary. Here, we describe a format based on standard database principles that offers multiple benefits over existing formats in terms of storage size, ease of processing, data retrieval times and extensibility to accommodate multi-dimensional separation systems.

99 GENERAL AND MISCELLANEOUS↗

Analysis of plasma measurements for the Geotail mission

Data processing and research efforts for the period October 1993 to September 1994 are reported. Routine data processing includes the production of color spectrograms and computing of quantitative plasma parameters such as the plasma number density, bulk flow velocity, temperature, and pressure. In addition, specialized analysis software is being developed for specific and general applications. Research activities include the measurement of plasmas from the Geotail spacecraft; the processing of the measurements from a hot plasma analyzer to compute one minute averages of plasma densities, temperatures, and velocities for a substantial part of the Geotail deep tail mission; and, a preliminary survey of the magnetotail for geocentric radial distances of 10 to 210 earth radii. The topology of the magnetotail with its various regions and boundaries is determined by a complex interaction with the fields and plasmas of the solar wind. Observations of the rotation of the magnetic field in the solar wind show that it is well correlated with repeated transitions at Geotail from the magnetotail lobe to a magnetosheath-like boundary layer.

Frank, Louis A.↗

Lessons from Adaptive Level One Accelerator (ALOA) System Implementation

The Adaptive Level One Accelerator (ALOA) system was developed as part of the Earth Science Data and Information System (ESDIS) project. The reconfigurable computing technologies were investigated for Level 1 satellite telemetry data processing to achieve computing acceleration and cost reduction for the next-generation Level 1 data processing systems. The MODIS instrument calibration algorithm was implemented using reconfigurable a computer. The system development process and the lessons learned throughout the design cycle are summarized in this paper.

Patel, Umesh D.↗

Mars-Approach Navigation Using In Situ Orbiters

A document discusses the continuing development of a navigation system that would enable a spacecraft to approach Mars on a trajectory precise enough to enable the spacecraft to land within 1 km of a specified location on the Martian surface. This degree of accuracy would represent an order-of-magnitude improvement over that now obtained in radiometric tracking by use of the Deep Space Network. The navigation system would be implemented largely in software running in digital processors in the Electra transceiver, the Mars Network s standard radio transceiver, that would be in both the approaching spacecraft and Mars Network orbiter. The Mars Network is an ad hoc constellation of existing and future Mars science orbiters and dedicated telecommunication orbiters that has been established as a communication and navigation infrastructure to support the exploration of Mars. The software would exploit the sensory and data-processing capabilities of the Electra transceivers to gather Doppler-shift and other radiometric tracking data and process those data into trajectories data that would be accurate to within 0.3 km at the point of entry into the Martian atmosphere (as needed to land within 1 km of a target surface location).

Duncan, Courtney↗

The magnetic field investigation on Cluster

The magnetic field investigation of the Cluster four-spacecraft mission is designed to provide intercalibrated measurements of the B magnetic field vector. The instrumentation and data processing of the mission are discussed. The instrumentation is identical on the four spacecraft. It consists of two triaxial fluxgate sensors and of a failure tolerant data processing unit. The combined analysis of the four spacecraft data will yield such parameters as the current density vector, wave vectors, and the geometry and structure of discontinuities.

Balogh, A.↗

Data movement engine

A memory system of a data processing system includes one or more storage devices and a data rearrangement engine for moving data between memory regions of the plurality of memory regions. The data rearrangement engine is configured to rearrange data stored at non-contiguous addresses in a source memory region into contiguous address in a destination region responsive to a rearrangement specified by a host processing unit of the data processing system. A description of the rearranged data is maintained in a metadata memory region. Rearranged data may be accessed by one or more host processing units. Write-back of data from the destination to the source region may be reduced by use of Bloom filter or the like.

Beard, Jonathan Curtis↗