Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “DATA PROCESSING”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,243 records · Page 69

Detecting Phase Boundaries in Hard-Sphere Suspensions

A special image-data-processing technique has been developed for use in experiments that involve observation, via optical microscopes equipped with electronic cameras, of moving boundaries between the colloidal-solid and colloidal-liquid phases of colloidal suspensions of monodisperse hard spheres. During an experiment, it is necessary to adjust the position of a microscope to keep the phase boundary within view. A boundary typically moves at a speed of the order of microns per hour. Because an experiment can last days or even weeks, it is impractical to require human intervention to keep the phase boundary in view. The present image-data-processing technique yields results within a computation time short enough to enable generation of automated-microscope-positioning commands to track the moving phase boundary

McDowell, Mark↗

A design methodology for portable software on parallel computers

This final report for research that was supported by grant number NAG-1-995 documents our progress in addressing two difficulties in parallel programming. The first difficulty is developing software that will execute quickly on a parallel computer. The second difficulty is transporting software between dissimilar parallel computers. In general, we expect that more hardware-specific information will be included in software designs for parallel computers than in designs for sequential computers. This inclusion is an instance of portability being sacrificed for high performance. New parallel computers are being introduced frequently. Trying to keep one's software on the current high performance hardware, a software developer almost continually faces yet another expensive software transportation. The problem of the proposed research is to create a design methodology that helps designers to more precisely control both portability and hardware-specific programming details. The proposed research emphasizes programming for scientific applications. We completed our study of the parallelizability of a subsystem of the NASA Earth Radiation Budget Experiment (ERBE) data processing system. This work is summarized in section two. A more detailed description is provided in Appendix A ('Programming Practices to Support Eventual Parallelism'). Mr. Chrisman, a graduate student, wrote and successfully defended a Ph.D. dissertation proposal which describes our research associated with the issues of software portability and high performance. The list of research tasks are specified in the proposal. The proposal 'A Design Methodology for Portable Software on Parallel Computers' is summarized in section three and is provided in its entirety in Appendix B. We are currently studying a proposed subsystem of the NASA Clouds and the Earth's Radiant Energy System (CERES) data processing system. This software is the proof-of-concept for the Ph.D. dissertation. We have implemented and measured the performance of a portion of this subsystem on the Intel iPSC/2 parallel computer. These results are provided in section four. Our future work is summarized in section five, our acknowledgements are stated in section six, and references for published papers associated with NAG-1-995 are provided in section seven.

Nicol, David M.↗

Visualization of Computational Fluid Dynamics

Scientific visualization serves the dual purpose of exploration and exposition of the results of numerical simulations of fluid flow. Along with the basic visualization process which transforms source data into images, there are four additional components to a complete visualization system: Source Data Processing, User Interface and Control, Presentation, and Information Management. The requirements imposed by the desired mode of operation (i.e. real-time, interactive, or batch) and the source data have their effect on each of these visualization system components. The special requirements imposed by the wide variety and size of the source data provided by the numerical simulation of fluid flow presents an enormous challenge to the visualization system designer. We describe the visualization system components including specific visualization techniques and how the mode of operation and source data requirements effect the construction of computational fluid dynamics visualization systems.

Gerald-Yamasaki, Michael↗

Landsat Data Continuity Mission

The Landsat Data Continuity Mission (LDCM) is currently under development and is on schedule to launch the 8th satellite in the Landsat series in December of 2012. LDCM is a joint project between the National Aeronautics and Space Administration (NASA) and the United States Geological Survey (USGS). NASA is responsible for developing and launching the flight hardware and on-orbit commissioning and USGS is responsible for developing the ground system and operating the system onorbit after commissioning. Key components of the flight hardware are the Operational Land Imager (OLI), nearing completion by Ball Aerospace & Technologies Corp in Boulder, CO, the Thermal Infrared Sensor (TIRS), being built by NASA's Goddard Space Flight Center and the spacecraft, undergoing integration at Orbital Sciences Corp in Gilbert, Arizona. The launch vehicle will be an Atlas-5 with launch services provided by NASA's Kennedy Space Center. Key ground systems elements are the Mission Operations Element, being developed by the Hammers Corporation, and the Collection Activity Planning Element, Ground Network Element, and Data Processing and Archive System, being developed internally by the USGS Earth Resources Observations and Science (EROS) Center. The primary measurement goal of LDCM is to continue the global coverage of moderate spatial resolution imagery providing continuity with the existing Landsat record. The science goal for this imagery is to monitor land use and land cover, particularly as it relates to global climate change. Together the OLI and TIRS instruments on LDCM replace the ETM+ instrument on Landsat-7 with significant enhancements. The OLI is a pushbroom design instrument where the scanning mechanism of the ETM+ is effectively replaced by a long line of detectors. The OLI has 9 spectral bands with similar spatial resolution to ETM+: 7 of them similar to the reflective spectral bands on ETM+ and two new bands. The two new bands cover (1) the shorter wavelength blue part of the spectrum to help with coastal studies and aerosol analyses/atmospheric correction and (2) an atmospheric water absorption band, where the Earth surface is generally not visible, but Cirrus clouds are, to aid in cloud detection and screening. The radiometry of OLI benefits from improved SNR, dynamic range and quantization. OLI is undergoing system testing with a delivery scheduled for Spring 2011. The TIRS is also a pushbroom design and used QWIPS detectors that require cooling to 43K using a cryocooler. It.has two spectral bands, effectively splitting the ETM+ band 6 in half, that can be used as a split window to aid in atmospheric correction. It has nominally 100 m spatial resolution as opposed to the 60 m of Landsat-7 ETM+: TIRS has commenced integration and test, with a delivery to the spacecraft vendor scheduled for Winter 2011-2012. The Orbital spacecraft currently being integrated for LDCM will have improved capabilities for pointing over previous missions. These capabilities will allow the OLI and TIRS instruments to point off-nadir the equivalent of one WRS-2 path to increase the chances of coverage for high priority targets, particularly in the event of natural disasters. Also, the pointing capability will allow the calibration of the OLI using the sun (roughly weekly), the moon (monthly), stars (during commissioning) and the Earth (at 90 deg from normal orientation, a.k.a., side slither) quarterly. The solar calibration will be used for OLI absolute and relative calibration, the moon for trending the stability of the OLI response, the stars will be used for Line of Sight determination and the side slither will be an alternate OLI and relative gain determination methodology. The spacecraft is scheduled to begin integration with the OLI instrument in Summer 2011. The LDCM data processing and archive system (DPAS), located at USGS EROS, generates the products for distribution to users. Like Landsat-7 this includes an image assessment system for characrizing instrument performance and updating calibration parameters. Products will be generated that include the spectral bands from both instruments, terrain corrected and registered to the geoid. Also, like Landsat-7, data products will be distributed at no charge to the user. The current status and plans of the space and ground segments of the LDCM project will be presented along with performance predictions as available. More detailed information on the two instruments is intended to be presented in separate papers.

Markham, Brian↗

GeneLab: A Systems Biology Platform for Omics Analysis

NASA's GeneLab includes an open-access repository of some 200+ omics datasets generated by biological experiments relevant to spaceflight (including simulated cosmic radiation and microgravity). In order to maximize the intelligibility of these data, particularly for users with limited bioinformatics knowledge, GeneLab is now transforming the data in the repository into actual biological and physiological knowledge of the genetic and proteomic signatures found in these samples. This processed data is being derived by establishing standard data analysis workflows vetted by 114 scientists who are members of the four GeneLab Analysis Working Groups (Animal AWG, Plant AWG, Microbe AWG, Multi-Omics AWG). AWG members from institutes spanning the U.S. and four other countries participate on a voluntary basis. The AWGs meet monthly to discuss data mining, compare results and interpretations, and test forthcoming releases of the GeneLab Data Systems (GLDS). GLDS version 3.0 has been available to the general public since October 1st 2018, and has been providing a professional state-of-the-art bioinformatics platform for everyone in the space biology community to upload their data into a space biology omics data commons, to process their data with vetted standard workflows and to compare to existing analyses. The user interface for the platform is being designed to be accessible to a broad variety of users including those with limited bioinformatics experience, including high school and college students who can use it to learn about omics data analysis and space biology. As such, Genelab will constitute a powerful general public outreach capability of NASA and the Space Biology community at large. Data mining of the GeneLab database by the AWG has already started generating very interesting findings, including reports linking specific spaceflight conditions such as radiation, microgravity or carbon dioxide levels to molecular changes seen across various species. In this presentation, we will report on the current and future objectives for GeneLab, and review recent studies reported by the various AWGs relating molecular changes observed in various animal models and tissue with microgravity, radiation, circadian rhythm, hydration and carbon dioxide conditions.

Omics↗

GeneLab: A Systems Biology Platform for Omics Analysis: Disseminate and Reuse Data, Tools, and Samples Post-Project

NASA's GeneLab includes an open-access repository of some 200 plus omics datasets generated by biological experiments relevant to spaceflight (including simulated cosmic radiation and microgravity). In order to maximize the intelligibility of these data, particularly for users with limited bioinformatics knowledge, GeneLab is now transforming the data in the repository into actual biological and physiological knowledge of the genetic and proteomic signatures found in these samples. This processed data is being derived by establishing standard data analysis workflows vetted by 114 scientists who are members of the four GeneLab Analysis Working Groups (Animal AWG, Plant AWG, Microbe AWG, Multi-Omics AWG). AWG members from institutes spanning the U.S. and four other countries participate on a voluntary basis. The AWGs meet monthly to discuss data mining, compare results and interpretations, and test forthcoming releases of the GeneLab Data Systems (GLDS). GLDS version 3.0 has been available to the general public since October 1st 2018, and has been providing a professional state-of-the-art bioinformatics platform for everyone in the space biology community to upload their data into a space biology omics data commons, to process their data with vetted standard workflows and to compare to existing analyses. The user interface for the platform is being designed to be accessible to a broad variety of users including those with limited bioinformatics experience, including high school and college students who can use it to learn about omics data analysis and space biology. As such, Genelab will constitute a powerful general public outreach capability of NASA and the Space Biology community at large. Data mining of the GeneLab database by the AWG has already started generating very interesting findings, including reports linking specific spaceflight conditions such as radiation, microgravity or carbon dioxide levels to molecular changes seen across various species. In this presentation, we will report on the current and future objectives for GeneLab, and review recent studies reported by the various AWGs relating molecular changes observed in various animal models and tissue with microgravity, radiation, circadian rhythm, hydration and carbon dioxide conditions.

Omics↗

Advanced processing and information extraction techniques applied to ERTS-1 MSS data

Conventional automatic data processing and information extraction techniques fall short of providing the information required by the user in some applications. For those cases, advanced techniques are needed to permit the extraction of the necessary information. Advanced techniques are described and examples of their application to ERTS-1 MSS data are provided. The techniques are designed to help overcome problems in location, mensuration, and classification accuracies which result from geometric distortions of the ERTS MSS data, the relatively coarse resolution of the sensor, and variations in atmospheric state over the region to be surveyed. It is shown that each of these factors can seriously degrade one's ability to extract necessary information. Further, it is shown that advanced techniques can alleviate the effects of these factors.

Malila, W. A.↗

NASA SETI microwave observing project: Sky Survey element

The SETI Sky Survey Observing Program is one of two complimentary strategies that NASA plans to use in its microwave Search for Extraterrestrial Intelligence (SETI). The primary objective of the sky survey is to search the entire sky over the frequency range of 1.0 to 10.0 GHz for evidence of narrow band signals of extraterrestrial intelligent origin. Frequency resolutions of 30 Hz or narrower will be used across the entire band. Spectrum analyzers with upwards of ten million channels are required to keep the survey time approximately 6 years. Data rates in excess of 10 megabits per second will be generated in the data taking process. Sophisticated data processing techniques will be required to determine the ever changing receiver baselines, and to detect and archive potential SETI signals. Existing radio telescopes, including several of NASA's Deep Space Network (DSN) 34 meter antennas located at Goldstone, CA and Tidbinbilla, Australia will be used for the observations. The JPL has the primary responsibility to develop and carry out the sky survey. In order to lay the foundation for the full scale SETI Sky Survey, a prototype system is being developed at the JPL. The system will be installed at the new 34-m high efficiency antenna at the Deep Space Station (DSS) 13 research and development station, Goldstone, CA, where it will be used to initiate the observational phase of the NASA SETI Sky Survey. It is anticipated that the early observations will be useful to test signal detection algorithms, scan strategies, and radio frequency interference rejection schemes. The SETI specific elements of the prototype system are: (1) the Wide Band Spectrum Analyzer (WBSA); a 2-million channel fast Fourier transformation (FFT) spectrum analyzer which covers an instantaneous bandpass of 40 MHz; (2) the signal detection processor; and (3) the SETI Sky Survey Manager, a network-based C-language environment that provides observatory control, performs data acquisition and analysis algorithms. A high level description of the prototype hardware and software systems will be given and the current status of the system development will be reported.

Klein, M. J.↗

Pre-Launch GOES-R Risk Reduction Activities for the Geostationary Lightning Mapper

The GOES-R Geostationary Lightning Mapper (GLM) is a new instrument planned for GOES-R that will greatly improve storm hazard nowcasting and increase warning lead time day and night. Daytime detection of lightning is a particularly significant technological advance given the fact that the solar illuminated cloud-top signal can exceed the intensity of the lightning signal by a factor of one hundred. Our approach is detailed across three broad themes which include: Data Processing Algorithm Readiness, Forecast Applications, and Radiance Data Mining. These themes address how the data will be processed and distributed, and the algorithms and models for developing, producing, and using the data products. These pre-launch risk reduction activities will accelerate the operational and research use of the GLM data once GOES-R begins on-orbit operations. The GLM will provide unprecedented capabilities for tracking thunderstorms and earlier warning of impending severe and hazardous weather threats. By providing direct information on lightning initiation, propagation, extent, and rate, the GLM will also capture the updraft dynamics and life cycle of convective storms, as well as internal ice precipitation processes. The GLM provides information directly from the heart of the thunderstorm as opposed to cloud-top only. Nowcasting applications enabled by the GLM data will expedite the warning and response time of emergency management systems, improve the dispatch of electric power utility repair crews, and improve airline routing around thunderstorms thereby improving safety and efficiency, saving fuel and reducing delays. The use of GLM data will assist the Bureau of Land Management (BLM) and the Forest Service in quickly detecting lightning ground strikes that have a high probability of causing fires. Finally, GLM data will help assess the role of thunderstorms and deep convection in global climate, and will improve regional air quality and global chemistry/climate modeling. The GLM has a robust design that benefits and improves upon its strong heritage of NASA-developed LEO predecessors, the Optical Transient Detector (OTD) and the Lightning Imaging Sensor (LIS). GLM will have a substantially larger number of pixels within the focal plane, two lens systems, and multiple Real-Time Event Processors REPS for on-board event detection and data compression to provide continuous observations of the Americas and adjacent oceans.

Goodman, S. J.↗

Simple, Scalable, Script-Based Science Processor (S4P)

The development and deployment of data processing systems to process Earth Observing System (EOS) data has proven to be costly and prone to technical and schedule risk. Integration of science algorithms into a robust operational system has been difficult. The core processing system, based on commercial tools, has demonstrated limitations at the rates needed to produce the several terabytes per day for EOS, primarily due to job management overhead. This has motivated an evolution in the EOS Data Information System toward a more distributed one incorporating Science Investigator-led Processing Systems (SIPS). As part of this evolution, the Goddard Earth Sciences Distributed Active Archive Center (GES DAAC) has developed a simplified processing system to accommodate the increased load expected with the advent of reprocessing and launch of a second satellite. This system, the Simple, Scalable, Script-based Science Processor (S42) may also serve as a resource for future SIPS. The current EOSDIS Core System was designed to be general, resulting in a large, complex mix of commercial and custom software. In contrast, many simpler systems, such as the EROS Data Center AVHRR IKM system, rely on a simple directory structure to drive processing, with directories representing different stages of production. The system passes input data to a directory, and the output data is placed in a "downstream" directory. The GES DAAC's Simple Scalable Script-based Science Processing System is based on the latter concept, but with modifications to allow varied science algorithms and improve portability. It uses a factory assembly-line paradigm: when work orders arrive at a station, an executable is run, and output work orders are sent to downstream stations. The stations are implemented as UNIX directories, while work orders are simple ASCII files. The core S4P infrastructure consists of a Perl program called stationmaster, which detects newly arrived work orders and forks a job to run the appropriate executable (registered in a configuration file for that station). Although S4P is written in Perl, the executables associated with a station can be any program that can be run from the command line, i.e., non-interactively. An S4P instance is typically monitored using a simple Graphical User Interface. However, the reliance of S4P on UNIX files and directories also allows visibility into the state of stations and jobs using standard operating system commands, permitting remote monitor/control over low-bandwidth connections. S4P is being used as the foundation for several small- to medium-size systems for data mining, on-demand subsetting, processing of direct broadcast Moderate Resolution Imaging Spectroradiometer (MODIS) data, and Quick-Response MODIS processing. It has also been used to implement a large-scale system to process MODIS Level 1 and Level 2 Standard Products, which will ultimately process close to 2 TB/day.

Lynnes, Christopher↗

Data for Process Strategies for Recovery of Sugars, Lipids, and Lignin from Oilcane Bagasse Using Natural Deep Eutectic Solvents (NADES)

Sugarcane is being enhanced as a bioenergy crop by engineering it to accumulate and store lipids along with polymeric sugars in vegetative tissues. However, there is no existing process that allows for processing this new crop to recover both lipid and cellulosic sugars from the oilcane bagasse. Therefore, a comprehensive investigation of two pretreatment methods—natural deep eutectic solvents (NADES) and chemical-free hydrothermal pretreatment (HT) was conducted to judge their suitability for recovering fermentable sugars, lipids, and lignin from bagasse. Two NADES, i.e., choline chloride: lactic acid (ChCl:LA) and betaine: lactic acid (BT:LA) were prepared using a 1:2 M ratio and were evaluated for pretreatment of oilcane bagasse at 10, 20, and 50 % (w/w) solids, followed by enzymatic hydrolysis at 10 % (w/w) solids. Notably, ChCl:LA NADES treatment at 10 % (w/w) solids at 140 °C for 2 h, solubilized 78.8 % of lignin and 80.4 % of hemicellulose and allowed 82.7 % enzymatic conversion of glucans to glucose. In contrast, HT pretreatment removed approximately 87.6 % of the hemicellulose and provided an enzymatic glucose yield of 69.7 %. Furthermore, ChCl:LA operated at 50 % solids loading the enriched lipids 2.6-fold (9.2 wt%) in recovered solids compared to HT (6.4 %) and BT:LA (5.1 %) pretreatment processes. NMR-HSQC and GPC analysis showed that ChCl:LA also cleaved the most lignin β–O–4 linkages and demonstrated lower molecular weight compared to HT. This study demonstrates that NADES pretreatment is an effective green processing method for recovering lipids, sugars, and lignin from bioenergy crops at high solid loading (50 % w/w) within the context of an integrated biorefinery.

Conversion↗

National Energy Water Treatment and Speciation (NEWTS) Database & Dashboard

The Department of Energy's Office of Fossil Energy & Carbon Management (DOE/FECM) through the National Energy Technology Laboratory (NETL) has launched a free online tool, the National Energy Water Treatment and Speciation (NEWTS) Database and Dashboard, which can be utilized by community leaders and water researchers to better understand the composition of energy-related wastewater streams. The NEWTS Database and Dashboard provide public access to difficult-to-access datasets, including the original data sources and the processed data forms for input into aqueous chemistry modeling software. The data provided by the tool will help mitigate environmental risks and identify possible sources of valuable critical minerals (CM). The goal of this ASME Power presentation is to highlight the data and capabilities of this free online-tool for obtaining high quality water datasets in formats that are easy for modeling the treatment and recovery of valuable resources from effluent waste stream associated with energy operations.

Siefert, Nicholas↗

The role of remotely sensed and relayed data in the Delaware River Basin

A discussion is presented of the planned integration of the existing Delaware River Basin water quality monitoring and data processing systems with a data relay experiment proposed for the Earth Resources Technology Satellite (ERTS)-A, which will be launched in 1972. The experiment is designed to use ERTS-A as a data relay link for a maximum of 20 hydrologic stations in the basin, including streamgaging, reservoir level, ground water level,and water quality monitoring stations. This experiment has the potential for reducing the timelag between data collection and dissemination to less than 12 hours. At present there is a significant timelag between the time when the data are recorded at a monitoring site and the water resources agencies receive the data. The timelag exists because most of these instruments operate in remote locations without telementry, and the data records are removed manually, generally at a weekly frequency. For most water quality monitoring, the data do not reach water resources agencies for a period of 2 weeks to 2 months.

Paulson, R. W.↗

Engineering study for the functional design of a multiprocessor system

The results are presented of a study to generate a functional system design of a multiprocessing computer system capable of satisfying the computational requirements of a space station. These data management system requirements were specified to include: (1) real time control, (2) data processing and storage, (3) data retrieval, and (4) remote terminal servicing.

Miller, J. S.↗