SEARCH · Engineering Papers

Results for “science data processing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 883 records · Page 49

All sources NASA NTRS DOE OSTI

NASA NTRS1994

OOD/OOP experience in the Science Operations Center part of the ground system for X ray Timing Explorer mission

The Science Operations Center (SOC) for the X-ray Timing Explorer (XTE) mission is an important component of the XTE ground system. Its mandate includes: (1) command and telemetry for the three XTE instruments, using CCSDS standards; (2) monitoring of the real-time science operations, reconfiguration of the experiment and the instruments, and real-time commanding to address the targets of opportunity (TOO) and alternate observations; and (3) analysis, processing, and archival of the XTE telemetry, and the timely delivery of the data products to the principal investigator (PI) teams and the guest observers (GO). The SOC has two major components: the science operations facility (SOF) that addresses the first two objectives stated above and the guest observer facility (GOF) that addresses the third. The SOF has subscribed to the object oriented design and implementation; while the GOF uses the traditional approach in order to take advantage of the existing software developed in support of previous missions. This paper details the SOF development using the object oriented design (OOD), and its implementation using the object oriented programming (OOP) in C++ under Unix environment on client-server architecture using Sun workstations. It also illustrates how the object oriented (OO) and the traditional approaches coexist in SOF and GOF, the lessons learned, and how the OOD facilitated the distributed software development collaboratively by four different teams. Details are presented for the SOF system, its major subsystems, its interfaces with the rest of the XTE ground data system, and its design and implementation approaches.

Choudhary, Abdur Rahim↗

NASA NTRS2023

Pypromice: A Python Package for Processing Automated Weather Station Data

The pypromice Python package is for processing and handling observation datasets from automated weather stations (AWS). It is primarily aimed at users of AWS data from the Geological Survey of Denmark and Greenland (GEUS), which collects and distributes in situ weather station observations to the cryospheric science research community. Functionality in pypromice is primarily handled using two key open-source Python packages, xarray (Hoyer & Hamman, 2017) and pandas (The pandas development team, 2020). A defined processing workflow is included in pypromice for transforming original AWS observations (Level 0, L0) to a usable, CF-convention-compliant dataset (Level 3, L3) (Figure 1). Intermediary processing levels (L1,L2) refer to key stages in the workflow, namely the conversion of variables to physical measurements and variable filtering (L1), cross-variable corrections and user-defined data flagging and fixing (L2), and derived variables (L3). Information regarding the station configuration is needed to perform the processing, such as instrument calibration coefficients and station type (one-boom tripod or two-boom mast station design, for example), which are held in a toml configuration file. Two example configuration files are provided with pypromice , which are also used in the package’s unit tests. More detailed documentation of the AWS design, instrumentation, and processing steps are described in Fausto et al. (2021).

pypromice↗

NASA NTRS2015

Enabling Earth Science Measurements with NASA UAS Capabilites

NASA's Airborne Science Program (ASP) maintains a fleet of manned and unmanned aircraft for Earth Science measurements and observations. The unmanned aircraft systems (UAS) range in size from very large (Global Hawks) to medium (SIERRA, Viking) and relatively small (DragonEye). UAS fly from very low (boundary layer) to very high altitude (stratosphere). NASA also supports science and applied science projects using UAS operated by outside companies or agencies. The aircraft and accompanying data and support systems have been used in numerous investigations. For example, Global Hawks have been used to study both hurricanes and atmospheric composition. SIERRA has been used to study ice, earthquake faults, and coral reefs. DragonEye is being used to measure volcanic emissions. As a foundation for NASA's UAS work, Altair and Ikkana not only flew wildfires in the Western US, but also provided major programs for the development of real-time data download and processing capabilities. In early 2014, an advanced L-band Synthetic Aperture Radar (SAR) also flew for the first time on Global Hawk, proving the utility of UAVSAR, which has been flying successfully on a manned aircraft. In this paper, we focus on two topics: 1) the results of a NASA program called UAS-Enabled Earth Science, in which three different science teams flew (at least) two different UAS to demonstrate platform performance, airspace integration, sensor performance, and applied science results from the data collected; 2) recent accomplishments with the high altitude, long-duration Global Hawks, especially measurements from several payload suites consisting of multiple instruments. The latest upgrades to data processing, communications, tracking and flight planning systems will also be described.

Earth Science↗

NASA NTRSDate not supplied

Interoperable Map Services with Performance Tuning for Earth Science Data through API-Tiles and Dynamic API-Styles

NASA’s Goddard Earth Sciences Data and Information Services Center (GES DISC) provides access to a wide range of global climate data from various satellite missions and models. However, the visualization and analysis of these data can be challenging due to their large volume, complex structure, and diverse formats. This study presents the implementation of interoperable map services (API-Maps) with performance tuning using API-Tiles and dynamic API-Styles. API-Maps is a standard for defining and exposing map services through RESTful (representational state transfer) APIs (application programming interfaces). API-Tiles is a technique for generating and delivering map tiles on demand from any data source. API-Styles is a method for dynamically applying styles to map tiles based on user preferences or data attributes. The use of API-Tiles and dynamic API-Styles enhances the performance and scalability of the map services, allowing for smooth and interactive visualization of large datasets. Two types of Earth Science data sources from the NASA GES DISC are used in the experiment: regularly gridded data, such as Global Precipitation Measurement (GPM) precipitation data, and low processing level data, such as low-level data of atmospheric composite measurements from the TROPOspheric Monitoring Instrument (TROPOMI) mission. Re-gridding of swath data (low level data - e.g. Level 2) of atmospheric composites (e.g. TROPOMI products, such as nitrogen dioxide, ozone and aerosol optical depth) is applied to enable the Web-based, interoperable, tiled, and styled mapping (rendering) services of such data. The results demonstrate the effectiveness of the proposed approach in providing fast and efficient access to Earth science data through interoperable map services.

Geographic Information System↗

NASA NTRS1979

ALSEP termination report

The Apollo Lunar Surface Experiments Package (ALSEP) final report was prepared when support operations were terminated September 30, 1977, and NASA discontinued the receiving and processing of scientific data transmitted from equipment deployed on the lunar surface. The ALSEP experiments (Apollo 11 to Apollo 17) are described and pertinent operational history is given for each experiment. The ALSEP data processing and distribution are described together with an extensive discussion on archiving. Engineering closeout tests and results are given, and the status and configuration of the experiments at termination are documented. Significant science findings are summarized by selected investigators. Significant operational data and recommendations are also included.

Bates, J. R.↗

NASA NTRS2020

Perspectives on Data Reproducibility and Replicability in Paleoclimate and Climate Science

This paper summarizes the current state of reproducibility and replicability in the fields of climate and paleoclimate science, including brief histories of their development and applications in climate science, new and recent approaches towards improvement of reproducibility and replicability, and challenges. Recommendations for addressing those challenges include: development of searchable, auto-updated, interlinked, multi-archive public paleoclimate repositories for raw and processed digital datasets; cross-center standardized code base cases, improved data storage techniques, and a focus on replicability for climate simulation storage and access; and support of the development and community awareness of findable, accessible, interoperable and reusable (FAIR) principles by funding agencies and publishers. This paper is largely based on the May 2018 presentations of a panel of researchers to the Committee on Reproducibility and Replicability in Science, part of the National Academies of Science, Engineering, and Medicine. The commentary and recommendations made here are in alignment with those of its Consensus Study Report on Reproducibility and Replicability in Science (2019).

data repositories↗

NASA NTRS2019

Satellite Sounder Products in NASA GES DISC & Services Supporting Their Applications

The NASA Goddard Earth Sciences Data and Information Services Center (GES DISC), in collaboration with NASA Sounder Team at the Jet Propulsion Laboratory (JPL), provides processing, archiving, and distribution services for remotely-sensed data acquired by satellite sounders. Supported data sets begin chronologically with the legacy TIROS Operational Vertical Sounder (TOVS) Pathfinder, continue to the Atmospheric Infrared Sounder (AIRS), a modern hyperspectral sounder onboard the Aqua satellite, and are followed by data from the subsequent Suomi-National Polar-orbiting Partnership Cross-track Infrared Sounder (CrIS) mission and the Joint Polar Satellite System (JPSS) series CrIS missions. These satellite sounders provide long-term global observations of the atmospheric state, including temperature and humidity profiles, outgoing longwave radiation, cloud properties, and trace gases. Applications of sounder data products cover a broad range of fields, including meteorology climatology, hydrology, and air quality. The GES DISC has developed many services to assist users, including simplified and efficient methods for searching, accessing, downloading, and analytically exploring these satellite sounder data products. We have also developed the Giovanni system, a broadly used Web-based application, which provides a simple and intuitive way to visualize, analyze, and access Earth science remote sensing data. In this presentation, we will introduce the standard and near-real time sounder data products, and demonstrate our services through some use cases. Highlights of our service capabilities include data subset, vertical profile plot, inter-comparison, multi-year monthly/seasonal mean, interannual monthly/seasonal time series, and anomaly analysis.

Ding, Feng↗

NASA NTRSDate not supplied

Phenomena Portal: Large- Scale Visual Exploration of Atmospheric Phenomena

The Earth science community is experiencing a high influx of remote sensing data due to recent advancements in sensor technology. This enables the community to extend their research on a larger scale than ever before. Unfortunately, traditional data processing techniques do not scale well to these new, high volume data sources. State-of-the-art machine learning (ML) pipelines have been proven to overcome these burdens in various other fields but are underexploited within the physical sciences community. Moreover, ML is reliant on labeled data, which is currently sparsely available, owing to the fact that ML adoption is still in the early stages within the Earth and atmospheric science communities. To address these issues, we developed the Phenomena Portal, a visual exploration tool that uses ML to detect various atmospheric phenomena on a global scale. This allows the Earth and atmospheric science communities to view trends of occurrences of phenomena, identify potential relationships between them, and analyze spatiotemporal patterns over time. These detections can also serve as initial labeled data for ML research pertaining to the respective phenomena. The tool also incorporates feedback from subject matter experts to further improve the model detection accuracy, thereby facilitating human-in-the-loop. This presentation will provide an overview of the ML model development and cloud deployment. We also discuss the capabilities of the user interface for displaying the detections.

Muthukumaran Ramasubramanian↗

NASA NTRS1999

TRMM Realtime Data Production, Transfer, and Future Plans

The Tropical Rainfall Measuring Mission, a joint US NASA and Japan NASDA mission, was launched on November 27, 1997 from Tanegashima Island, Japan on a NASDA provided H-II launch vehicle. The TRMM objectives are: to obtain and study multi-year science data sets of tropical and sub- tropical rainfall measurement; to understand how interactions between the sea, air, and land masses produce changes in global rainfall and climate; to help improve modeling of tropical rainfall processes; to test, evaluate, and improve the performance of satellite rainfall estimates measurements and techniques. The routine production and quick distribution of standard products provides an important underpinning to these objectives. The determination of standard TRMM algorithms and the requirements for routine production and distribution fall within the authority of the joint US-Japan Science Team. In April of 1998, the Joint TRMM Science team requested that TRMM data be made available in near real-time to approved international agencies and modelers. This request was an addition to the routine production of the standard TRMM data products. The science team requested that near-realtime products be as small as possible to facilitate their transfer via networks. Indeed, it was determined that only network transfer would be available. This presentation provides an overview of the type of products available from the realtime system and how the TRMM system was developed at the lowest cost in the shortest amount of time. It then describes the real-time data flow. The presentation also summarizes how the science quality of real-time data is maintained. It describes how interested groups can get access to this data and the importance of networks for the future of real-time data expansion. The presentation concludes real-time possibilities and improvements possible as part of the proposed Global Precipitation Mission. High speed network access availability is an important catalyst to real-time data flow during the proposed mission.

Stocker, Erich Franz↗

NASA NTRS2014

Data Albums: An Event Driven Search, Aggregation and Curation Tool for Earth Science

One of the largest continuing challenges in any Earth science investigation is the discovery and access of useful science content from the increasingly large volumes of Earth science data and related information available. Approaches used in Earth science research such as case study analysis and climatology studies involve gathering discovering and gathering diverse data sets and information to support the research goals. Research based on case studies involves a detailed description of specific weather events using data from different sources, to characterize physical processes in play for a specific event. Climatology-based research tends to focus on the representativeness of a given event, by studying the characteristics and distribution of a large number of events. This allows researchers to generalize characteristics such as spatio-temporal distribution, intensity, annual cycle, duration, etc. To gather relevant data and information for case studies and climatology analysis is both tedious and time consuming. Current Earth science data systems are designed with the assumption that researchers access data primarily by instrument or geophysical parameter. Those who know exactly the datasets of interest can obtain the specific files they need using these systems. However, in cases where researchers are interested in studying a significant event, they have to manually assemble a variety of datasets relevant to it by searching the different distributed data systems. In these cases, a search process needs to be organized around the event rather than observing instruments. In addition, the existing data systems assume users have sufficient knowledge regarding the domain vocabulary to be able to effectively utilize their catalogs. These systems do not support new or interdisciplinary researchers who may be unfamiliar with the domain terminology. This paper presents a specialized search, aggregation and curation tool for Earth science to address these existing challenges. The search tool automatically creates curated "Data Albums", aggregated collections of information related to a specific science topic or event, containing links to relevant data files (granules) from different instruments; tools and services for visualization and analysis; and information about the event contained in news reports, images or videos to supplement research analysis. Curation in the tool is driven via an ontology based relevancy ranking algorithm to filter out non-relevant information and data.

Ramachandran, Rahul↗

NASA NTRSDate not supplied

Improved Characterization of PSC Processes Derived from a Third-Generation CALIOP and MLS Detection and Composition Classification Algorithm

The new 3-year CloudSat and CALIPSO Science Team project described in this poster will use a unique combination of data from the Cloud-Aerosol LIdar with Orthogonal Polarization (CALIOP) instrument on CALIPSO and the Microwave Limb Sounder (MLS) on Aura, in conjunction with supporting meteorological information and detailed modeling studies, to advance our understanding of polar stratospheric cloud (PSC) processes and their role in ozone depletion. We will develop a third-generation (Gen3) PSC detection and composition algorithm that incorporates a new, more robust two-dimensional, multi-channel CALIOP feature detection scheme (2D-McDA). We will also devise and implement an improved two-dimensional PSC composition classification scheme that utilizes multiple parameters (e.g., CALIOP 532-nm parallel and perpendicular scattering ratios, CALIOP 1064-nm total scattering ratio, MLS HNO3 and H2O, ambient temperature, and temperature histories) in a Bayesian approach to determine the most likely PSC composition and help constrain solid PSC particle number density and size/shape. The combined CALIOP/MLS analyses will allow us to study in detail the full life cycle of PSCs and their resulting impact on gas-phase HNO3 and H2O, which should lead to improved parameterizations of PSC microphysics in global CCMs where detailed particle information is not available. The Gen3 CALIOP PSC algorithm will be a natural stepping-stone toward the analysis of data collected during future spaceborne lidar missions, such as NASA’s Atmosphere Observation System (AtmOS) mission currently scheduled for launch late in this decade. We will also investigate possible trends in PSC occurrence and composition over the entire CALIOP data record and through further comparisons with the Stratospheric Aerosol Measurement (SAM) II solar occultation PSC record from 1979-1989. Finally, we will validate the mountain-wave parameterization and PSC schemes used in the UM-UKCA (Unified Model coupled to the United Kingdom Chemistry and Aerosol module) chemistry-climate model through detailed comparisons with earlier CALIOP PSC data products and those developed under this proposal.

CALIPSO↗

NASA NTRSDate not supplied

Improved Characterization of PSC Processes Derived from a Third-Generation CALIOP and MLS Detection and Composition Classification Algorithm

The new 3-year CloudSat and CALIPSO Science Team project described in this poster will use a unique combination of data from the Cloud-Aerosol LIdar with Orthogonal Polarization (CALIOP) instrument on CALIPSO and the Microwave Limb Sounder (MLS) on Aura, in conjunction with supporting meteorological information and detailed modeling studies, to advance our understanding of polar stratospheric cloud (PSC) processes and their role in ozone depletion. We will develop a third-generation (Gen3) PSC detection and composition algorithm that incorporates a new, more robust two-dimensional, multi-channel CALIOP feature detection scheme (2D-McDA). We will also devise and implement an improved two-dimensional PSC composition classification scheme that utilizes multiple parameters (e.g., CALIOP 532-nm parallel and perpendicular scattering ratios, CALIOP 1064-nm total scattering ratio, MLS HNO3 and H2O, ambient temperature, and temperature histories) in a Bayesian approach to determine the most likely PSC composition and help constrain solid PSC particle number density and size/shape. The combined CALIOP/MLS analyses will allow us to study in detail the full life cycle of PSCs and their resulting impact on gas-phase HNO3 and H2O, which should lead to improved parameterizations of PSC microphysics in global chemistry-climate models (CCMs) where detailed particle information is not available. The Gen3 CALIOP PSC algorithm will be a natural stepping-stone toward the analysis of data collected during future spaceborne lidar missions, such as NASA’s Atmosphere Observation System (AOS) mission currently scheduled for launch late in this decade. We will also investigate possible trends in PSC occurrence and composition over the entire CALIOP data record and through further comparisons with the Stratospheric Aerosol Measurement (SAM) II solar occultation PSC record from 1979-1989. Finally, we will validate the mountain-wave parameterization and PSC schemes used in the UM-UKCA (Unified Model coupled to the United Kingdom Chemistry and Aerosol module) CCM through detailed comparisons with earlier CALIOP PSC data products and those developed under this proposal.

CALIPSO↗

NASA NTRS1977

Instrumentation for space flight experiments

The selection of measurement systems for experiments conducted in the context of a space flight must be guided by the criteria applicable to any scientific study requiring objective measurements of physiological variables. Steps fundamental to the process of choosing the best instrumentation system are identified and the key factors in matching the operational characteristics of the instrumentation to its intended use are discussed. Special problems in obtaining data from nonhuman primates, whether restrained or unrestrained, are explored. Choices for data processing are evaluated as well as the use of prototype flight tests and simulations to assess future life science experiments for spacelab or payloads for the space shuttle biomedical scientific satellite.

Mccutcheon, E. P.↗

NASA NTRS1982

Design and development of the ERBE data management system

The Earth radiation budget experiment (ERBE) software development approach is described. An iterative development approach was adopted which provides for three releases or versions of the processing system, each of increasing levels of complexity and solidity. The final release of the system will be used to process the flight data. The major phases for each iterative release consist of specifications developed in concert with the science team, preliminary design, subsystem reviews, coding, subsystem code walkthroughs, system testing, system documentation, and project status review.

Kibler, J. F.↗

NASA NTRS1990

Adaptive pattern recognition by mini-max neural networks as a part of an intelligent processor

In this decade and progressing into 21st Century, NASA will have missions including Space Station and the Earth related Planet Sciences. To support these missions, a high degree of sophistication in machine automation and an increasing amount of data processing throughput rate are necessary. Meeting these challenges requires intelligent machines, designed to support the necessary automations in a remote space and hazardous environment. There are two approaches to designing these intelligent machines. One of these is the knowledge-based expert system approach, namely AI. The other is a non-rule approach based on parallel and distributed computing for adaptive fault-tolerances, namely Neural or Natural Intelligence (NI). The union of AI and NI is the solution to the problem stated above. The NI segment of this unit extracts features automatically by applying Cauchy simulated annealing to a mini-max cost energy function. The feature discovered by NI can then be passed to the AI system for future processing, and vice versa. This passing increases reliability, for AI can follow the NI formulated algorithm exactly, and can provide the context knowledge base as the constraints of neurocomputing. The mini-max cost function that solves the unknown feature can furthermore give us a top-down architectural design of neural networks by means of Taylor series expansion of the cost function. A typical mini-max cost function consists of the sample variance of each class in the numerator, and separation of the center of each class in the denominator. Thus, when the total cost energy is minimized, the conflicting goals of intraclass clustering and interclass segregation are achieved simultaneously.

Szu, Harold H.↗

NASA NTRS1991

International Solar Terrestrial Physics (ISTP) geotail mission

The Geotail spacecraft will be provided by the Institute of Space and Astronautical Science (ISAS) and will provide a Delta Launch Vehicle, tracking support by the Deep Space Network (DSN), and data processing support by GSFC. In exchange, ISAS will reserve part of the payload for NASA instruments together with a certain number of investigators from the United States. As the solar wind flows toward the Earth, some of the energy is modified by the Earth's magnetosphere, ionosphere, and upper atmosphere. This interaction causes the flow to be altered, creating a plasmasphere, plasma sheet, and ring currents in the Earth's Geomagnetic Tail region. The result is a series of distinct regions which affect processes on the Earth. By traversing the tail region to a variety of depths, Geotail will be able to determine the size, position, and other properties of these regions. When correlated with information obtained from the other ISAS spacecraft, Geotail data should help to provide a more complete understanding of how the solar processes affect the Earth's environment. The flight profile is given, and information is presented in tabular form on the following topics: DSN support, frequency assignments, telemetry, command, and tracking support responsibility.

Sanford, R.↗

NASA NTRS1995

Scientific visualization tools for the ISTP project: Mission planning, data analysis and model interpretation

Visualization tools are being developed to meet the challenges of mission planning and data analysis presented by the International Solar-Terrestrial Physics (ISTP) program. ISTP encompasses a large number of spacecraft, multiple ground-based observatories, and several theoretical investigations, with the goal of understanding the global behavior of the solar wind/magnetosphere/ionosphere system. The tools include three-dimensional displays of key boundaries in geospace along with spacecraft trajectories, which can be animated and synchronized to universal time. Magnetic field models and MHD simulation results can be invoked to reveal the magnetic topology or to identify magnetic conjunctions between spacecraft and/or ground-based facilities. Simultaneous displays of satellite trajectories, spacecraft-borne observations, and model predictions are available to facilitate data processing and interpretation efforts. The current status of these tools is described, and their implementation at the ISTP Science Planning and Operations Facility and distribution to the entire ISTP community are discussed.

Peredo, M.↗

NASA NTRS2000

BOREAS Derived Surface Meteorological Data

In 1995, the BOREAS science teams identified the need for a continuous surface meteorological and radiation data set to support flux and surface process modeling efforts. This data set contains actual, substituted, and interpolated 15-minute meteorological and radiation data compiled from several surface measurements sites over the BOREAS SSA and NSA. Temporally, the data cover 01-Jan-1994 to 31-Dec-1996. The data are stored in tabular ASCII files, and are classified as AFM-Staff data.

Hall, Forrest G.↗