Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “streaming data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 451 records · Page 25

SensorWeb 3G: Extending On-Orbit Sensor Capabilities to Enable Near Realtime User Configurability

This research effort prototypes an implementation of a standard interface, Web Coverage Processing Service (WCPS), which is an Open Geospatial Consortium(OGC) standard, to enable users to define, test, upload and execute algorithms for on-orbit sensor systems. The user is able to customize on-orbit data products that result from raw data streaming from an instrument. This extends the SensorWeb 2.0 concept that was developed under a previous Advanced Information System Technology (AIST) effort in which web services wrap sensors and a standardized Extensible Markup Language (XML) based scripting workflow language orchestrates processing steps across multiple domains. SensorWeb 3G extends the concept by providing the user controls into the flight software modules associated with on-orbit sensor and thus provides a degree of flexibility which does not presently exist. The successful demonstrations to date will be presented, which includes a realistic HyspIRI decadal mission testbed. Furthermore, benchmarks that were run will also be presented along with future demonstration and benchmark tests planned. Finally, we conclude with implications for the future and how this concept dovetails into efforts to develop "cloud computing" methods and standards.

Mandl, Daniel↗

Synthesis and Assimilation Systems - Essential Adjuncts to the Global Ocean Observing System

Ocean assimilation systems synthesize diverse in situ and satellite data streams into four-dimensional state estimates by combining the various observations with the model. Assimilation is particularly important for the ocean where subsurface observations, even today, are sparse and intermittent compared with the scales needed to represent ocean variability and where satellites only sense the surface. Developments in assimilation and in the observing system have advanced our understanding and prediction of ocean variations at mesoscale and climate scales. Use of these systems for assessing the observing system helps identify the strengths of each observation type. Results indicate that the ocean remains under-sampled and that further improvements in the observing system are needed. Prospects for future advances lie in improved models and better estimates of error statistics for both models and observations. Future developments will be increasingly towards consistent analyses across components of the Earth system. However, even today ocean synthesis and assimilation systems are providing products that are useful for many applications and should be considered an integral part of the global ocean observing and information system.

Rienecker, Michele M.↗

Browser-Based Application for Telemetry Monitoring of Robotic Assets

AEGSE Virtuoso Charting is an application that enables animated, real-time charting of telemetry streams of data from a rover. These automatically scaled charts are completely interactive, and allow users to choose the variables that they want to monitor. The charts can process data from streams with many variables. This application allows for the simultaneous viewing of up to four individually configured charts on a small touch-screen laptop. The charting application has been tested and found to be extremely robust during long operations. It was left running overnight, with incoming telemetry at 100 Hz, and it did not experience any signs of lost functionality or memory leaks. This robustness is critical for an application that will be used to support vital tests for the Mars Science Laboratory rover. The charting component also provides an interactive interface that allows the engineers to decide how many charts they want on their screen, and which attributes should be plotted on each chart. The application is optimized to make the charts on display take up as much of the available space as possible to maximize the use of the screen real estate. Engineers are also able to plot multiple attributes on the same chart, which enables them to observe the correlation between various attributes.

Breed, Kelly S.↗

Agent-Supported Mission Operations Teamwork

This slide presentation reviews the development of software agents to support of mission operations teamwork. The goals of the work was to make automation by agents easy to use, supervise and direct, manage information and communication to decrease distraction, interruptions, workload and errors, reduce mission impact of off-nominal situations and increase morale and decrease turnover. The accomplishments or the project are: 1. Collaborative agents - mixed initiative and creation of instructions for mediating agent 2. Methods for prototyping, evaluating and evolving socio-technical systems 3. Technology infusion: teamwork tools in mISSIons 4. Demonstrations in simulation testbed An example of the use of agent is given, the use of an agent to monitor a N2 tank leak. An incomplete instruction to the agent is handled with mediating assistants, or Intelligent Briefing and Response Assistant (IBRA). The IBRA Engine also watches data stream for triggers and executes Act-Whenever actions. There is also a Briefing and Response Instruction (BRI) which is easy for a discipline specialist to create through a BRI editor.

Malin, Jane T.↗

Understanding Solar Eruptions with SDO/HMI Measuring Photospheric Flows, Testing Models, and Steps Towards Forecasting Solar Eruptions

The imminent launch of Solar Dynamics Observatory (SDO) will carry the first full-disk imaging vector magnetograph, the Helioseismic and Magnetic Imager (HMI), into an inclined geosynchronous orbit. This magnetograph will provide nearly continuous measurements of photospheric vector magnetic fields at cadences of 90 seconds to 12 minutes with I" resolution, precise pointing, and unfettered by atmospheric seeing. The enormous data stream of ~1.5 Terabytes per day from SDO will provide an unprecedented opportunity to understand the mysteries of solar eruptions. These ground-breaking observations will permit the application of a new technique, the differential affine velocity estimator for vector magnetograms (DAVE4VM), to measure photospheric plasma flows in active regions. These measurements will permit, for the first time, accurate assessments of the coronal free energy available for driving CMEs and flares. The details of photospheric plasma flows, particularly along magnetic neutral-lines, are critical to testing models for initiating coronal mass ejections (CMEs) and flares. Assimilating flows and fields into state-of-the art 3D MHD simulations that model the highly stratified solar atmosphere from the convection zone to the corona represents the next step towards achieving NASA's Living with a Star forecasting goals of predicting "when a solar eruption leading to a CME will occur." This talk will describe these major science and predictive advances that will be delivered by SDO /HMI.

Schuck, Peter W.↗

Transitioning Models and Model Output to Space Weather Operations: Challenges and Opportunities

The transition of space weather models or of information derived from space weather models to space weather forecasting is the last step of the chain from model development to model deployment in forecasting operations. As such, it is an extremely important element of the quest to increase our national capability to forecast and mitigate space weather hazards. It involves establishing customer requirements, and analyses of available models, which are, in principle, capable of delivering the required product. Models will have to be verified and validated prior to a selection of the best performing model. Further considerations include operational hardware, and the availability of data streams to drive the model. The final steps include the education of forecasters, and the implementation on gateway hardware prior to operational use. This presentation will provide a discussion of opportunities for rapid progress from the viewpoint of the Community Coordinated Modeling Center.

Hesse, Michael↗

The Operational Land Imager (OLI) and the Thermal Infrared Sensor (TIRS) on the Landsat Data Continuity Mission (LDCM)

The Landsat Data Continuity Mission (LDCM), a joint NASA and United States Geological Survey (USGS) mission, is scheduled for launch in December, 2012. The LDCM instrument payload will consist of the Operational Land Imager (OLI), provided by Ball Aerospace and Technology Corporation (BATC) under contract to NASA and the Thermal Infrared Sensor (TIRS), provided by NASA's Goddard Space Flight Center (GSFC). This paper will describe the design, capabilities and status of the OLI and TIRS instruments. The OLI will provide 8 channel multispectral images at a spatial resolution of 30 meters and panchromatic images at 15 meter spatial resolution. The TIRS is a 100 meter spatial resolution push-broom imager whose two spectral channels, centered at 10.8 and 12 microns, split the ETM+ thermal bands. The two channels allow the use of the "split-window" technique to aid in atmospheric correction. The TIRS focal plane consists of three Quantum Well Infrared Photodetector (QWIP) arrays to span the 185 km swath width. The OLI and TIRS instruments will be operated independently but in concert with each other. Data from both instruments will be merged into a single data stream at the (USGS)/Earth Resources Observation and Science (EROS) facility. The ground system, being developed by USGS, includes an Image Assessment System (lAS), similar to Landsat-7's, to operationally monitor, characterize and update the calibrations of the two sensors.

Reuter, Dennis↗

The VIIRS Ocean Data Simulator Enhancements and Results

The VIIRS Ocean Science Team (VOST) has been developing an Ocean Data Simulator to create realistic VIIRS SDR datasets based on MODIS water-leaving radiances. The simulator is helping to assess instrument performance and scientific processing algorithms. Several changes were made in the last two years to complete the simulator and broaden its usefulness. The simulator is now fully functional and includes all sensor characteristics measured during prelaunch testing, including electronic and optical crosstalk influences, polarization sensitivity, and relative spectral response. Also included is the simulation of cloud and land radiances to make more realistic data sets and to understand their important influence on nearby ocean color data. The atmospheric tables used in the processing, including aerosol and Rayleigh reflectance coefficients, have been modeled using VIIRS relative spectral responses. The capabilities of the simulator were expanded to work in an unaggregated sample mode and to produce scans with additional samples beyond the standard scan. These features improve the capability to realistically add artifacts which act upon individual instrument samples prior to aggregation and which may originate from beyond the actual scan boundaries. The simulator was expanded to simulate all 16 M-bands and the EDR processing was improved to use these bands to make an SST product. The simulator is being used to generate global VIIRS data from and in parallel with the MODIS Aqua data stream. Studies have been conducted using the simulator to investigate the impact of instrument artifacts. This paper discusses the simulator improvements and results from the artifact impact studies.

Robinson, Wayne D.↗

Evaluation of Shortwave Infrared Atmospheric Correction for Ocean Color Remote Sensing of Chesapeake Bay

The NASA Moderate Resolution Imaging Spectroradiometer onboard the Aqua platform (MODIS-Aqua) provides a viable data stream for operational water quality monitoring of Chesapeake Bay. Marine geophysical products from MODIS-Aqua depend on the efficacy of the atmospheric correction process, which can be problematic in coastal environments. The operational atmospheric correction algorithm for MODIS-Aqua requires an assumption of negligible near-infrared water-leaving radiance, nL(sub w)(NIR). This assumption progressively degrades with increasing turbidity and, as such, methods exist to account for non-negligible nL(sub w)(NIR) within the atmospheric correction process or to use alternate radiometric bands where the assumption is satisfied, such as those positioned within shortwave infrared (SWIR) region of the spectrum. We evaluated a decade-long time-series of nL(sub w)(lambda) from MODIS-Aqua in Chesapeake Bay derived using NIR and SWIR bands for atmospheric correction. Low signal-to-noise ratios (SNR) for the SWIR bands of MODIS-Aqua added noise errors to the derived radiances, which produced broad, flat frequency distributions of nL(sub w)(lambda) relative to those produced using the NIR bands. The SWIR approach produced an increased number of negative nL(sub w)(lambda) and decreased sample size relative to the NIR approach. Revised vicarious calibration and regional tuning of the scheme to switch between the NIR and SWIR approaches may improve retrievals in Chesapeake Bay, however, poor SNR values for the MODIS-Aqua SWIR bands remain the primary deficiency of the SWIR-based atmospheric correction approach.

Werdell, P. Jeremy↗

What Have We Learned from MERRA about Reanalyses of the Stratosphere?

The Modern-Era Retrospective analysis for Research and Applications (MERRA) reanalysis includes a well-resolved middle atmosphere. The upper boundary of the underlying model is in the mesosphere, near 80km, and the input data streams include the Stratospheric Sounding Unit (SSU) and Advanced Microwave Sounding Unit (AMSU) radiance observations. These two datasets provide observational constraints on the deep-layer thermal structure in approximately the 10-2hPa region, the middle to upper stratosphere, which is above the highest range of most radiosonde ascents. This analysis will focus on the difficulties of producing realistic analyses in the middle to upper stratosphere: these arise largely because of vertical averaging inherent in the AMSU and SSU observations, the sensitivity to model biases in this region, the relative biases among the same channels on different instruments, and the orbital sampling of the satellites (morning or afternoon orbits). These issues will be illustrated with examples from MERRA and enhanced by discussions of potential ways of improving the middle atmosphere in future reanalyses.

Pawson, Steven↗

Time Distribution Using SpaceWire in the SCaN Testbed on ISS

A paper describes an approach for timekeeping and time transfer among the devices on the CoNNeCT project s SCaN Testbed. It also describes how the clocks may be synchronized with an external time reference; e.g., time tags from the International Space Station (ISS) or RF signals received by a radio (TDRSS time service or GPS). All the units have some sort of counter that is fed by an oscillator at some convenient frequency. The basic problem in timekeeping is relating the counter value to some external time standard such as UTC. With SpaceWire, there are two approaches possible: one is to just use SpaceWire to send a message, and use an external wire for the sync signal. This is much the same as with the RS- 232 messages and l pps line from a GPS receiver. However, SpaceWire has an additional capability that was added to make it easier - it can insert and receive a special "timecode" word in the data stream.

Lux, James P.↗

Hardware Implementation of Lossless Adaptive Compression of Data From a Hyperspectral Imager

Efficient onboard data compression can reduce the data volume from hyperspectral imagers on NASA and DoD spacecraft in order to return as much imagery as possible through constrained downlink channels. Lossless compression is important for signature extraction, object recognition, and feature classification capabilities. To provide onboard data compression, a hardware implementation of a lossless hyperspectral compression algorithm was developed using a field programmable gate array (FPGA). The underlying algorithm is the Fast Lossless (FL) compression algorithm reported in Fast Lossless Compression of Multispectral- Image Data (NPO-42517), NASA Tech Briefs, Vol. 30, No. 8 (August 2006), p. 26 with the modification reported in Lossless, Multi-Spectral Data Comressor for Improved Compression for Pushbroom-Type Instruments (NPO-45473), NASA Tech Briefs, Vol. 32, No. 7 (July 2008) p. 63, which provides improved compression performance for data from pushbroom-type imagers. An FPGA implementation of the unmodified FL algorithm was previously developed and reported in Fast and Adaptive Lossless Onboard Hyperspectral Data Compression System (NPO-46867), NASA Tech Briefs, Vol. 36, No. 5 (May 2012) p. 42. The essence of the FL algorithm is adaptive linear predictive compression using the sign algorithm for filter adaption. The FL compressor achieves a combination of low complexity and compression effectiveness that exceeds that of stateof- the-art techniques currently in use. The modification changes the predictor structure to tolerate differences in sensitivity of different detector elements, as occurs in pushbroom-type imagers, which are suitable for spacecraft use. The FPGA implementation offers a low-cost, flexible solution compared to traditional ASIC (application specific integrated circuit) and can be integrated as an intellectual property (IP) for part of, e.g., a design that manages the instrument interface. The FPGA implementation was benchmarked on the Xilinx Virtex IV LX25 device, and ported to a Xilinx prototype board. The current implementation has a critical path of 29.5 ns, which dictated a clock speed of 33 MHz. The critical path delay is end-to-end measurement between the uncompressed input data and the output compression data stream. The implementation compresses one sample every clock cycle, which results in a speed of 33 Msample/s. The implementation has a rather low device use of the Xilinx Virtex IV LX25, making the total power consumption of the implementation about 1.27 W.

Keymeulen, Didlier↗

Sampling Technique for Robust Odorant Detection Based on MIT RealNose Data

This technique enhances the detection capability of the autonomous Real-Nose system from MIT to detect odorants and their concentrations in noisy and transient environments. The lowcost, portable system with low power consumption will operate at high speed and is suited for unmanned and remotely operated long-life applications. A deterministic mathematical model was developed to detect odorants and calculate their concentration in noisy environments. Real data from MIT's NanoNose was examined, from which a signal conditioning technique was proposed to enable robust odorant detection for the RealNose system. Its sensitivity can reach to sub-part-per-billion (sub-ppb). A Space Invariant Independent Component Analysis (SPICA) algorithm was developed to deal with non-linear mixing that is an over-complete case, and it is used as a preprocessing step to recover the original odorant sources for detection. This approach, combined with the Cascade Error Projection (CEP) Neural Network algorithm, was used to perform odorant identification. Signal conditioning is used to identify potential processing windows to enable robust detection for autonomous systems. So far, the software has been developed and evaluated with current data sets provided by the MIT team. However, continuous data streams are made available where even the occurrence of a new odorant is unannounced and needs to be noticed by the system autonomously before its unambiguous detection. The challenge for the software is to be able to separate the potential valid signal from the odorant and from the noisy transition region when the odorant is just introduced.

Duong, Tuan A.↗

Assimilation of GIRO Data into a Real-Time IRI

Increasingly accurate and detailed global 3-D specification of the Earth's space plasma environment is required to further understand its intricate organization and behavior. For a long time space physics and aeronomy research has been data starved due to the great variety of natural time scales involved in the plasma phenomenology. We have started developing a new approach to the global ionospheric specification called Real-Time Assimilative Mapping (RTAM). The IRI-RTAM will use data from the Global Ionospheric Radio Observatory (GIRO) to smoothly transform International Reference Ionosphere's (IRI's) background empirical maps of the ionospheric characteristics to match the observations. Such empirical assimilative modeling will provide a high-resolution, global picture of the ionospheric response to various short-term events observed during periods of storm activity or the impact of gravity waves coupling the ionosphere to the lower atmosphere, including timelines of the vertical restructuring of the plasma distribution. It will also contribute to the challenging task of providing a rapid insight into the temporal and spatial space weather development using the real-time GIRO data streams. The new assimilation technique "updates" the IRI electron density distribution while preserving the overall integrity of IRI s typical ionospheric feature representations. The technique adjusts the coefficients of the spherical/diurnal expansions used by the CCIR and URSI-88 model to obtain the global sub-peak electron density distribution. The set of global corrected coefficients can be generated as frequently as every 15 min and easily disseminated using a single real-time RTAM server operated by GIRO.

Galkin, I. A.↗

Technology Readiness Level (TRL) Advancement of the MSPI On-Board Processing Platform for the ACE Decadal Survey Mission

The Xilinx Virtex-5QV is a new Single-event Immune Reconfigurable FPGA (SIRF) device that is targeted as the spaceborne processor for the NASA Decadal Survey Aerosol-Cloud-Ecosystem (ACE) mission's Multiangle SpectroPolarimetric Imager (MSPI) instrument, currently under development at JPL. A key technology needed for MSPI is on-board processing (OBP) to calculate polarimetry data as imaged by each of the 9 cameras forming the instrument. With funding from NASA's ESTO1 AIST2 Program, JPL is demonstrating how signal data at 95 Mbytes/sec over 16 channels for each of the 9 multi-angle cameras can be reduced to 0.45 Mbytes/sec, thereby substantially reducing the image data volume for spacecraft downlink without loss of science information. This is done via a least-squares fitting algorithm implemented on the Virtex-5 FPGA operating in real-time on the raw video data stream.

multiangle-multiwavelength polarimeter↗

ITOS to EDGE "Bridge" Software for Morpheus Lunar/Martian Vehicle

My project Involved Improving upon existing software and writing new software for the Project Morpheus Team. Specifically, I created and updated Integrated Test and Operations Systems (ITOS) user Interfaces for on-board Interaction with the vehicle during archive playback as well as live streaming data. These Interfaces are an integral part of the testing and operations for the Morpheus vehicle providing any and all information from the vehicle to evaluate instruments and insure coherence and control of the vehicle during Morpheus missions. I also created a "bridge" program for Interfacing "live" telemetry data with the Engineering DOUG Graphics Engine (EDGE) software for a graphical (standalone or VR dome) view of live Morpheus nights or archive replays, providing graphical representation of vehicle night and movement during subsequent tests and in real missions.

Hirsh, Robert↗

Evaluating NMME Seasonal Forecast Skill for use in NASA SERVIR Hub Regions

The U.S. National Multi-Model Ensemble seasonal forecasting system is providing hindcast and real-time data streams to be used in assessing and improving seasonal predictive capacity. The coupled forecasts have numerous potential applications, both national and international in scope. The NASA / USAID SERVIR project, which leverages satellite and modeling-based resources for environmental decision making in developing nations, is focusing on the evaluation of NMME forecasts specifically for use in driving applications models in hub regions including East Africa, the Hindu Kush- Himalayan (HKH) region and Mesoamerica. A prerequisite for seasonal forecast use in application modeling (e.g. hydrology, agriculture) is bias correction and skill assessment. Efforts to address systematic biases and multi-model combination in support of NASA SERVIR impact modeling requirements will be highlighted. Specifically, quantilequantile mapping for bias correction has been implemented for all archived NMME hindcasts. Both deterministic and probabilistic skill estimates for raw, bias-corrected, and multi-model ensemble forecasts as a function of forecast lead will be presented for temperature and precipitation. Complementing this statistical assessment will be case studies of significant events, for example, the ability of the NMME forecasts suite to anticipate the 2010/2011 drought in the Horn of Africa and its relationship to evolving SST patterns.

Roberts, J. Brent↗

Evaluating Downscaling Methods for Seasonal Climate Forecasts over East Africa

The U.S. National Multi-Model Ensemble seasonal forecasting system is providing hindcast and real-time data streams to be used in assessing and improving seasonal predictive capacity. The NASA / USAID SERVIR project, which leverages satellite and modeling-based resources for environmental decision making in developing nations, is focusing on the evaluation of NMME forecasts specifically for use in impact modeling within hub regions including East Africa, the Hindu Kush-Himalayan (HKH) region and Mesoamerica. One of the participating models in NMME is the NASA Goddard Earth Observing System (GEOS5). This work will present an intercomparison of downscaling methods using the GEOS5 seasonal forecasts of temperature and precipitation over East Africa. The current seasonal forecasting system provides monthly averaged forecast anomalies. These anomalies must be spatially downscaled and temporally disaggregated for use in application modeling (e.g. hydrology, agriculture). There are several available downscaling methodologies that can be implemented to accomplish this goal. Selected methods include both a non-homogenous hidden Markov model and an analogue based approach. A particular emphasis will be placed on quantifying the ability of different methods to capture the intermittency of precipitation within both the short and long rain seasons. Further, the ability to capture spatial covariances will be assessed. Both probabilistic and deterministic skill measures will be evaluated over the hindcast period.

Robertson, Franklin R.↗