Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Sparse Data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 541 records · Page 30
All sourcesNASA NTRSDOE OSTI
NASA NTRS2023

Assessment of the Impact of Discontinuity in Satellite Instruments and Retrievals on Global PM2.5

Exposure to fine particulate matter (PM2.5) is the leading environmental risk factor for mortality globally. Satellite-derived estimates of surface PM2.5 developed from a combination of satellites, simulations, and ground monitor data are relied upon for health impact studies. The ability to develop satellite-derived PM2.5 estimates requires the continued availability of aerosol optical depth (AOD) sources. This work examines the impact of the addition or loss of satellite AOD data sources on global PM2.5 estimation and the impact of continuing the longterm record with AOD from the Visible Infrared Imaging Radiometer Suite (VIIRS) on the Suomi-National Polar orbiting Partnership (S-NPP) satellite after the loss of the MODIS (MODerate resolution Imaging Spectroradiometer) and MISR (Multi-angle Imaging Spectroradiometer) instruments on board the Terra and Aqua satellites. We find that the addition of VIIRS S-NPP AOD products to geophysical PM2.5 estimates from satellites and simulations causes regional differences that correspond to differences in the VIIRS and MODIS Deep Blue AOD algorithms and sampling. Changes in long-term trends and timeseries due to the addition or loss of AOD data sources are generally within their uncertainties. Statistical fusion with ground monitor data partially corrects for changes due to sampling differences when introducing the VIIRS AOD products, but uncertainty remains over desert regions where ground monitor coverage is sparse. This work provides promise for the sustained development of global satellite-derived PM2.5 estimates, despite discontinuities in instruments and retrieval methods.

Remote sensing↗
NASA NTRS2013

Coarse-Grain Bandwidth Estimation Scheme for Large-Scale Network

A large-scale network that supports a large number of users can have an aggregate data rate of hundreds of Mbps at any time. High-fidelity simulation of a large-scale network might be too complicated and memory-intensive for typical commercial-off-the-shelf (COTS) tools. Unlike a large commercial wide-area-network (WAN) that shares diverse network resources among diverse users and has a complex topology that requires routing mechanism and flow control, the ground communication links of a space network operate under the assumption of a guaranteed dedicated bandwidth allocation between specific sparse endpoints in a star-like topology. This work solved the network design problem of estimating the bandwidths of a ground network architecture option that offer different service classes to meet the latency requirements of different user data types. In this work, a top-down analysis and simulation approach was created to size the bandwidths of a store-and-forward network for a given network topology, a mission traffic scenario, and a set of data types with different latency requirements. These techniques were used to estimate the WAN bandwidths of the ground links for different architecture options of the proposed Integrated Space Communication and Navigation (SCaN) Network. A new analytical approach, called the "leveling scheme," was developed to model the store-and-forward mechanism of the network data flow. The term "leveling" refers to the spreading of data across a longer time horizon without violating the corresponding latency requirement of the data type. Two versions of the leveling scheme were developed: 1. A straightforward version that simply spreads the data of each data type across the time horizon and doesn't take into account the interactions among data types within a pass, or between data types across overlapping passes at a network node, and is inherently sub-optimal. 2. Two-state Markov leveling scheme that takes into account the second order behavior of the store-and-forward mechanism, and the interactions among data types within a pass. The novelty of this approach lies in the modeling of the store-and-forward mechanism of each network node. The term store-and-forward refers to the data traffic regulation technique in which data is sent to an intermediate network node where they are temporarily stored and sent at a later time to the destination node or to another intermediate node. Store-and-forward can be applied to both space-based networks that have intermittent connectivity, and ground-based networks with deterministic connectivity. For groundbased networks, the store-and-forward mechanism is used to regulate the network data flow and link resource utilization such that the user data types can be delivered to their destination nodes without violating their respective latency requirements.

Cheung, Kar-Ming↗
NASA NTRSDate not supplied

Compressive Sensing Based Data Acquisition Architecture for Transient Stellar Events in Crowded Star Fields

Compressive sensing is a mathematical technique for simultaneous data acquisition and compression. In this work, we show a CS based architecture for acquiring and reconstructing transient stellar events. This architecture recon-structs a differenced image itself, eliminating the need for any sparse domain transforms, otherwise required for traditional CS reconstruction. The resulting reconstructed differenced image is of critical importance as the information required for generating a time-series photometric light curve is obtained only from a differenced image. Hence, reconstructing a crowded star spatial image, followed by differencing is wasteful. This architecture eliminates the need to 1.) transform an image to a sparse domain, 2.) Reconstruct a dense field, and then apply differencing on the image to obtain the image of critical value. We study the case of microlensing to depict a star source experiencing magnification in time. Our results show that this architecture is able to reconstruct star source magnitudes with magnification factors greater than 1 for clean images with error less than 2% using only 10% of the Nyquist rate samples.

Compressive Sensing, Data acquisition, Image diffe↗
NASA NTRS1985

Parallel, iterative solution of sparse linear systems - Models and architectures

Solving large, sparse, linear systems of equations is a fundamental problem in large scale scientific and engineering computation. A model of a general class of asynchronous, iterative solution methods for linear systems is developed. In the model, the system is solved by creating several cooperating tasks that each compute a portion of the solution vector. A data transfer model predicting both the probability that data must be transferred between two tasks and the amount of data to be transferred is presented. This model is used to derive an execution time model for predicting parallel execution time and an optimal number of tasks given the dimension and sparsity of the coefficient matrix and the costs of computation, synchronization, and communication. The suitability of different parallel architectures for solving randomly sparse linear systems is discussed. Based on the complexity of task scheduling, one parallel architecture, based on a broadcast bus, is presented and analyzed.

Reed, D. A.↗
NASA NTRS1990

Two-dimensional shape recognition using sparse distributed memory

Researchers propose a method for recognizing two-dimensional shapes (hand-drawn characters, for example) with an associative memory. The method consists of two stages: first, the image is preprocessed to extract tangents to the contour of the shape; second, the set of tangents is converted to a long bit string for recognition with sparse distributed memory (SDM). SDM provides a simple, massively parallel architecture for an associative memory. Long bit vectors (256 to 1000 bits, for example) serve as both data and addresses to the memory, and patterns are grouped or classified according to similarity in Hamming distance. At the moment, tangents are extracted in a simple manner by progressively blurring the image and then using a Canny-type edge detector (Canny, 1986) to find edges at each stage of blurring. This results in a grid of tangents. While the technique used for obtaining the tangents is at present rather ad hoc, researchers plan to adopt an existing framework for extracting edge orientation information over a variety of resolutions, such as suggested by Watson (1987, 1983), Marr and Hildreth (1980), or Canny (1986).

Kanerva, Pentti↗
NASA NTRS2016

Annual Greenland Accumulation Rates (2009-2012) from Airborne Snow Radar

Contemporary climate warming over the Arctic is accelerating mass loss from the Greenland Ice Sheet through increasing surface melt, emphasizing the need to closely monitor its surface mass balance in order to improve sea-level rise predictions. Snow accumulation is the largest component of the ice sheet's surface mass balance, but in situ observations thereof are inherently sparse and models are difficult to evaluate at large scales. Here, we quantify recent Greenland accumulation rates using ultra-wideband (2-6.5 gigahertz) airborne snow radar data collected as part of NASA's Operation IceBridge between 2009 and 2012. We use a semi-automated method to trace the observed radiostratigraphy and then derive annual net accumulation rates for 2009-2012. The uncertainty in these radar-derived accumulation rates is on average 14 percent. A comparison of the radarderived accumulation rates and contemporaneous ice cores shows that snow radar captures both the annual and longterm mean accumulation rate accurately. A comparison with outputs from a regional climate model (MAR - Modele Atmospherique Regional for Greenland and vicinity) shows that this model matches radar-derived accumulation rates in the ice sheet interior but produces higher values over southeastern Greenland. Our results demonstrate that snow radar can efficiently and accurately map patterns of snow accumulation across an ice sheet and that it is valuable for evaluating the accuracy of surface mass balance models.

surface melt↗
NASA NTRS2016

Assessment of the SMAP Passive Soil Moisture Product

The National Aeronautics and Space Administration (NASA) Soil Moisture Active Passive (SMAP) satellite mission was launched on January 31, 2015. The observatory was developed to provide global mapping of high-resolution soil moisture and freeze-thaw state every two to three days using an L-band (active) radar and an L-band (passive) radiometer. After an irrecoverable hardware failure of the radar on July 7, 2015, the radiometer-only soil moisture product became the only operational Level 2 soil moisture product for SMAP. The product provides soil moisture estimates posted on a 36 kilometer Earth-fixed grid produced using brightness temperature observations from descending passes. Within months after the commissioning of the SMAP radiometer, the product was assessed to have attained preliminary (beta) science quality, and data were released to the public for evaluation in September 2015. The product is available from the NASA Distributed Active Archive Center at the National Snow and Ice Data Center. This paper provides a summary of the Level 2 Passive Soil Moisture Product (L2_SM_P) and its validation against in situ ground measurements collected from different data sources. Initial in situ comparisons conducted between March 31, 2015 and October 26, 2015, at a limited number of core validation sites (CVSs) and several hundred sparse network points, indicate that the V-pol Single Channel Algorithm (SCA-V) currently delivers the best performance among algorithms considered for L2_SM_P, based on several metrics. The accuracy of the soil moisture retrievals averaged over the CVSs was 0.038 cubic meter per cubic meter unbiased root-mean-square difference (ubRMSD), which approaches the SMAP mission requirement of 0.040 cubic meter per cubic meter.

passive↗
NASA NTRS2017

Global Assimilation of X Project Loon Stratospheric Balloon Observations

Project Loon has an overall goal of providing worldwide internet coverage using a network of long-duration super-pressure balloons. Beginning in 2013, Loon has launched over 1600 balloons from multiple tropical and middle latitude locations. These GPS tracked balloon trajectories provide lower stratospheric wind information over the oceans and remote land areas where traditional radiosonde soundings are sparse, thus providing unique coverage of lower stratospheric winds. To fully investigate these Loon winds we: 1) compare the Loon winds to winds produced by a global data assimilation system (DAS: NASA GEOS) and 2) assimilate the Loon winds into the same comprehensive DAS. Results show that in middle latitudes the Loon winds and DAS winds agree well and assimilating the Loon winds have only a small impact on short-term forecasting of the Loon winds, however, in the tropics the loon winds and DAS winds often disagree substantially (8 m/s or more in magnitude) and in these cases assimilating the loon winds significantly improves the forecast of the loon winds. By highlighting cases where the Loon and DAS winds differ, these results can lead to improved understanding of stratospheric winds, especially in the tropics.

Loo↗
NASA NTRS2019

Global Assimilation of Loon Stratospheric Balloon Observations and Their Trajectories Relative to Tropical Waves

Project Loon has an overall goal of providing worldwide internet coverage using a network of long-duration super-pressure balloons. Beginning in 2013, Loon has launched over 1600 balloons from multiple tropical and middle latitude locations. These GPS tracked balloon trajectories provide lower stratospheric wind information over the oceans and remote land areas where traditional radiosonde soundings are sparse, thus providing unique coverage of lower stratospheric winds. To fully investigate these Loon winds we: 1) compare the Loon winds to winds produced by a global data assimilation system (DAS: NASA GEOS) and 2) assimilate the Loon winds into the same comprehensive DAS. During May through December 2016 Loon balloons were often able to remain near the equator by selectively adjusting the Loon altitude. Our results based on global wind analyses show that the expected mean poleward motion from the Brewer-Dobson circulation can be circumvented by vertically adjusting the Loon altitudes with the phasing with the meridional wind of equatorial Rossby waves, allowing the Loon balloons to remain in the tropics.

Coy, L.↗
NASA NTRSDate not supplied

Surface Expression of Bed Topography in Greenland and Antarctica

It has long been recognized that major subglacial topographic features beneath the Greenland and Antarctic ice sheets – whether especially prominent or wide – can generate an observable surface expression. Recent advances in digital elevation models (ArcticDEM, REMA) and bed-to-surface transfer theory now permit widespread observation of this phenomena and a more robust interpretation. Hillshading a digital elevation model from the direction of ice flow permits straightforward detection of major surface features. For Greenland, comparison against the growing catalog of airborne radar-sounding data confirms that the large majority of these features are associated with subglacial topography – typically valleys. These observations suggest a better path toward interpolating subglacial topography between sparse radar observations by developing methods that also require fidelity to observed surface relief.

Joe Macgregor↗
NASA NTRS2022

Gaussian Process Regression Method for Costing SmallSat Bus Capabilities

NASA is responding to the growing interest in, andcapabilities of, small satellites for science applications with an increasingnumber and frequency of Announcements of Opportunityfor small satellite space missions. Estimating the probabilitythat these mission concepts will fit within the small cost capsof these opportunities is largely driven by the probability thatone of the burgeoning number of small satellite providers will beable to meet the payload’s accommodation requirements withinthe budget for the spacecraft. JPL has collected a databasecontaining technical specifications and cost of commerciallyavailable Smallsat buses across various vendors. The primarypurpose of the database is for use in JPL’s Team X architecturestudies to inform cost estimates of a spacecraft bus which fitsthe customer’s technical requirements for their payload andmission. Customer needs are often unique and don’t alignperfectly with an off-the-shelf commercial spacecraft bus, whichmotivates the need to develop a cost model across the continuoustechnical parameter space.Al’s Bus Cost Distribution Estimator (ABCDE) uses Gaussianprocess regression (GPR) to predict commercial Smallsat spacecraftbus cost based on a subset of a customer’s technicalrequirements (payload mass, payload power, delta V, pointingcontrol, and downlink rate). GPR is implemented in ABCDE asa Bayesian method which fits an implied multivariate regressionon the technical parameters and uses kriging to intentionally“overfit” the residuals. Overfitting the residuals allows costestimates to collapse in uncertainty closer to the data pointswhile maintaining larger uncertainty intervals in regions of parameterspace with fewer data records. The data used to fit thismodel is sensitive and represents cost estimates for off-the-shelfcommercial buses. GPR simultaneously protects the sensitivityof the database and uses the sparse nature of the database toaccount for uncertainty in cost in a useful way. For a givenset of customer technical requirements, the tool provides a costestimate distribution, the percentiles of which can be interpretedas a confidence level of finding a commercial bus under a specifiedcost cap. ABCDE dramatically pushes the boundaries ofspacecraft cost estimation models due to its Bayesian methodology(accounting for the maximum uncertainty in the underlyingregression), the mathematically advanced kriging methodology,and the novelty of its application in Team X architecture tradestudies.

Austin, Alex↗
NASA NTRSDate not supplied

Performance Optimization Methods for a Memory-Bound, Unstructured-Grid CFD Application on Massively Parallel GPU Platforms

Computational performance of the FUN3D unstructured-grid computational fluid dynamics (CFD) application on massively parallel GPU environments is memory-bound and highly dependent upon efficient reads from and atomic updates to the irregular cell-, edge-, and node-based data structures. In this talk, we present recent efforts into optimizing select performance-critical kernels on NVIDIA Tesla V100 and A100 GPUs and AMD CDNA MI100 GPUs. A novel use of L2 cache residency controls and asynchronous loads into on-chip shared memory are explored on the A100 GPU for the sparse iterative solver, which is dominated by mixed-precision, sparse matrix vector multiplication. Demonstrations show that these methods improve global memory bandwidth utilization by 13.5% on the A100 GPU. Several techniques are also presented that use registers and/or shared memory to facilitate array transposition and aggregation which combine to reduce the frequency and increase the cache efficiency of floating-point atomic updates to the irregular data structures. These methods are demonstrated to improve the kernel throughput by nearly 500% on select kernels on the AMD MI100 over atomic updates directly to global memory. Overall, both V100 and A100 GPUs outperformed the MI100 GPU on kernels dominated by double-precision atomic updates; however, the techniques demonstrated here reduced the performance gap and improved the MI100 performance.

GPU CPU unstructured CFD memory↗
NASA NTRS1983

Progress on a generalized coordinates tensor product finite element 3DPNS algorithm for subsonic

A generalized coordinates form of the penalty finite element algorithm for the 3-dimensional parabolic Navier-Stokes equations for turbulent subsonic flows was derived. This algorithm formulation requires only three distinct hypermatrices and is applicable using any boundary fitted coordinate transformation procedure. The tensor matrix product approximation to the Jacobian of the Newton linear algebra matrix statement was also derived. Tne Newton algorithm was restructured to replace large sparse matrix solution procedures with grid sweeping using alpha-block tridiagonal matrices, where alpha equals the number of dependent variables. Numerical experiments were conducted and the resultant data gives guidance on potentially preferred tensor product constructions for the penalty finite element 3DPNS algorithm.

Baker, A. J.↗
NASA NTRS2021

Thermal Infrared Detector Sparse Array for NASA Planetary Applications

In this work, we present an uncooled infrared (IR) thermal imager featuring a sparse array of resonant pixels that can be monolithically integrated with the readout electronics for long-term operation in hightemperature environments. Each of the detector pixels is made of an IR-sensitive GaN microresonator developed to be operated at up to 500 0C. The pixels are employed in sparse array configuration to allow for routing the signal carrying traces and to ease the routing from pixel to circuit, as well as to reduce the power consumption. A 128´128 sparse resonator array with the array density of 37.5% is designed and used in conjunction with the Compressed Sensing method to reconstruct complex test images from highly incomplete data. Capabilities and performance metrics of the recovery technique are explored.

Rais-Zadeh, Mina↗
NASA NTRS1990

Recognition of simple visual images using a sparse distributed memory: Some implementations and experiments

Previously, a method was described of representing a class of simple visual images so that they could be used with a Sparse Distributed Memory (SDM). Herein, two possible implementations are described of a SDM, for which these images, suitably encoded, will serve both as addresses to the memory and as data to be stored in the memory. A key feature of both implementations is that a pattern that is represented as an unordered set with a variable number of members can be used as an address to the memory. In the 1st model, an image is encoded as a 9072 bit string to be used as a read or write address; the bit string may also be used as data to be stored in the memory. Another representation, in which an image is encoded as a 256 bit string, may be used with either model as data to be stored in the memory, but not as an address. In the 2nd model, an image is not represented as a vector of fixed length to be used as an address. Instead, a rule is given for determining which memory locations are to be activated in response to an encoded image. This activation rule treats the pieces of an image as an unordered set. With this model, the memory can be simulated, based on a method of computing the approximate result of a read operation.

Jaeckel, Louis A.↗
NASA NTRS1992

Large-scale structure in the Southern Sky Redshift Survey

The power spectrum from the Southern Sky Redshift Survey and the CfA samples are measured in order to explore the amplitude of fluctuation in the galaxy density. At lambda of less than or equal to 30/h Mpc the observed power spectrum is quite consistent with the standard CDM model. At larger scales the data indicate an excess of power over the standard CDM model. The observed power spectrum from these optical galaxy samples is in good agreement with that drawn from the sparsely sampled IRAS galaxies. The shape of the power spectrum is also studied by examining the relation between the genus per unit volume and the smoothing length. It is found that, over Gaussian smoothing scales from 6 to 14/h Mpc, the power spectrum has a slope of about -1. The topology of the galaxy density field is studied by measuring the shift of the genus curve from the Gaussian case. Over all smoothing scales studied, the observed genus curves are consistent with a random phase distribution of the galaxy density field, as predicted by the inflationary scenarios.

Park, Changbom↗
NASA NTRS1994

Multiresolution representation and numerical algorithms: A brief review

In this paper we review recent developments in techniques to represent data in terms of its local scale components. These techniques enable us to obtain data compression by eliminating scale-coefficients which are sufficiently small. This capability for data compression can be used to reduce the cost of many numerical solution algorithms by either applying it to the numerical solution operator in order to get an approximate sparse representation, or by applying it to the numerical solution itself in order to reduce the number of quantities that need to be computed.

Harten, Amiram↗
NASA NTRS2009

Synthesis and Assimilation Systems - Essential Adjuncts to the Global Ocean Observing System

Ocean assimilation systems synthesize diverse in situ and satellite data streams into four-dimensional state estimates by combining the various observations with the model. Assimilation is particularly important for the ocean where subsurface observations, even today, are sparse and intermittent compared with the scales needed to represent ocean variability and where satellites only sense the surface. Developments in assimilation and in the observing system have advanced our understanding and prediction of ocean variations at mesoscale and climate scales. Use of these systems for assessing the observing system helps identify the strengths of each observation type. Results indicate that the ocean remains under-sampled and that further improvements in the observing system are needed. Prospects for future advances lie in improved models and better estimates of error statistics for both models and observations. Future developments will be increasingly towards consistent analyses across components of the Earth system. However, even today ocean synthesis and assimilation systems are providing products that are useful for many applications and should be considered an integral part of the global ocean observing and information system.

Rienecker, Michele M.↗