Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data product”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 649 records · Page 36

TPSAS-NF1676L-33992-DND

The CERES Science Team integrates and fuses observations from 6 CERES instruments aboard the Terra, Aqua, S-NPP, and NOAA-20 missions with data from more than 20 other unique data sources. Following the November 2017 launch of CERES Flight Model 6 (FM6) onboard NOAA20, CERES has now amassed over 80 instrument-years of valuable Earth radiation budget data. The rapidly growing volume of CERES data coupled with the introduction of new data products alongside improvements to existing science algorithms fosters the requirement for faster, more flexible, and scalable data production and orchestration. New virtualized, cloud-centric compute hardware hosted by the NASA Langley Research Center’s (LaRC) Atmospheric Sciences Data Center (ASDC) provides an ideal environment for these ever-increasing data production demands for CERES. This poster discusses updates to the implementation of the CERES Data Management Team’s (DMT) CERES AuTomAted job Loading sYSTem (CATALYST), a custom data processing workflow engine for CERES, to use on-demand computing resources to perform automated CERES data production processing in a Linux-based container environment. Linux containers provide CERES the flexibility to build multiple production environments in containers tailored for specific workloads and allow effortless provisioning of resources based on the CERES Science Team’s data production requirements.

Thomas N. Hillyer↗

Fast Longwave and Shortwave Radiative Flux (FLASHFlux) Products from CERES and MODIS Measurements

The Clouds and the Earth s Radiant Energy Systems (CERES) project is currently producing world-class climatological data products derived from measurements taken aboard the Terra and Aqua spacecrafts (Wielicki et al., 1996). While of exceptional fidelity, these data products require a considerable amount of processing to assure quality and verify accuracy and precision. Obtaining such high quality assurance, however, means that the CERES data is typically released more than six months after the acquisition of the initial measurements. For climate studies, such delays are of little consequence, especially considering the improved quality of the released data products. There are, however, many uses for the CERES data products on a near real-time basis. These include: CERES instrument calibration and subsystem quality checks, CLOUDSAT operations, seasonal predictions, agricultural and ocean assimilations, support of field campaigns, and outreach programs such as S'Cool. The FLASHflux project was envisioned as a conduit whereby CERES data could be provided to the community within a week of the initial measurements, with the trade-off that some degree of fidelity would be exacted to gain speed. In this paper, we will report on some very encouraging initial results from the FLASHflux project in which we compared the FLASHflux instantaneous surface fluxes to the CERES surface-only flux algorithm data products.

Stackhouse, Paul W., Jr.↗

PULSAR OBSERVATIONS USING THE FIRST STATION OF THE LONG WAVELENGTH ARRAY AND THE LWA PULSAR DATA ARCHIVE

We present initial pulsar results from the first station of the Long Wavelength Array (LWA1) obtained during the commissioning period of LWA1 and in early science results. We present detections of periodic emission from 44 previously known pulsars, including 3 millisecond pulsars. The effects of the interstellar medium (ISM) on pulsar emission are significantly enhanced at the low frequencies of the LWA1 band (10–88 MHz), making LWA1 a very sensitive instrument for characterizing changes in the dispersion measure (DM) and other effects from the ISM. Pulsars also often have significant evolution in their pulse profile at low frequency and a break in their spectral index. We report DM measurements for 44 pulsars, mean flux density measurements for 36 pulsars, and multi-frequency component spacing and widths for 15 pulsars with more than one profile component. For 27 pulsars, we report spectral index measurements within our frequency range. We also introduce the LWA1 Pulsar Data Archive, which stores reduced data products from LWA1 pulsar observations. Reduced data products for the observations presented here can be found in the archive. Reduced data products from future LWA1 pulsar observations will also be made available through the archive.

79 ASTRONOMY AND ASTROPHYSICS↗

The Algorithm Theoretical Basis Document for Level 1A Processing

The first process of the Geoscience Laser Altimeter System (GLAS) Science Algorithm Software converts the Level 0 data into the Level 1A Data Products. The Level 1A Data Products are the time ordered instrument data converted from counts to engineering units. This document defines the equations that convert the raw instrument data into engineering units. Required scale factors, bias values, and coefficients are defined in this document. Additionally, required quality assurance and browse products are defined in this document.

Jester, Peggy L.↗

Uncertainty Quantification in Wind Plant Energy Estimation: Preprint

Data characterizing a wind power plant's production is important for the validation, calibration, and refinement of the wake loss models used to simulate performance for pre-construction energy estimates. In this process, there is the potential for significant variation in the methods used by an analyst for, first, the preparation of the operational production data for comparison to model data and, second, the generation of analogous production data from simulations. In this work, the uncertainty introduced by these method variations is quantified by considering ensembles of analysis methods. Specifically, 1920 methods variations were developed for preparing the operational data as a predictable production benchmark and simulations taking as input sample sets of the observed wind resource ranged in size from covering 4% to 125% of a full year were run using 3 engineering wake loss models in FLORIS simulations. The benchmark and simulation input uncertainties place lower bounds on the precision of the calibration between the simulation model estimates and operational benchmark data. Even within subsets of method variations (representative of what might be seen within a single company), the uncertainty in the predictable expected production is estimated to be between 1% and 3% the median predictable expected production while the uncertainty in the simulated expected production remains at best on the order of 2%. To put this into context: the simulated expected production is very closely related to the annual energy production (AEP) metric commonly used to quantify a plant's predicted performance and a 3% error in the pre-construction AEP estimate can result in a $17M loss due to additional financing costs for a typical 100MW Texas plant.

17 WIND ENERGY↗

Detailed design specification for the ALT Shuttle Information Extraction Subsystem (SIES)

The approach and landing test (ALT) shuttle information extraction system (SIES) is described in terms of general requirements and system characteristics output products and processing options, output products and data sources, and system data flow. The ALT SIES is a data reduction system designed to satisfy certain data processing requirements for the ALT phase of the space shuttle program. The specific ALT SIES data processing requirements are stated in the data reduction complex approach and landing test data processing requirements. In general, ALT SIES must produce time correlated data products as a result of standardized data reduction or special purpose analytical processes. The main characteristics of ALT SIES are: (1) the system operates in a batch (non-interactive) mode; (2) the processing is table driven; (3) it is data base oriented; (4) it has simple operating procedures; and (5) it requires a minimum of run time information.

Clouette, G. L.↗

Towards a distributed information architecture for avionics data

Avionics data at the National Aeronautics and Space Administration's (NASA) Jet Propulsion Laboratory (JPL consists of distributed, unmanaged, and heterogeneous information that is hard for flight system design engineers to find and use on new NASA/JPL missions. The development of a systematic approach for capturing, accessing and sharing avionics data critical to the support of NASA/JPL missions and projects is required. We propose a general information architecture for managing the existing distributed avionics data sources and a method for querying and retrieving avionics data using the Object Oriented Data Technology (OODT) framework. OODT uses XML messaging infrastructure that profiles data products and their locations using the ISO-11179 data model for describing data products. Queries against a common data dictionary (which implements the ISO model) are translated to domain dependent source data models, and distributed data products are returned asynchronously through the OODT middleware. Further work will include the ability to 'plug and play' new manufacturer data sources, which are distributed at avionics component manufacturer locations throughout the United States.

Information architecture↗

THE NEW ONLINE METADATA EDITOR FOR GENERATING STRUCTURED METADATA

Nobody is better suited to “describe” data than the scientist who created it. This “description” about a data is called Metadata. In general terms, Metadata represents the who, what, when, where, why and how of the dataset [1]. eXtensible Markup Language (XML) is the preferred output format for metadata, as it makes it portable and, more importantly, suitable for system discoverability. The newly developed ORNL Metadata Editor (OME) is a Web-based tool that allows users to create and maintain XML files containing key information, or metadata, about the research. Metadata include information about the specific projects, parameters, time periods, and locations associated with the data. Such information helps put the research findings in context. In addition, the metadata produced using OME will allow other researchers to find these data via Metadata clearinghouses like Mercury [2][4]. OME is part of ORNL’s Mercury software fleet [2][3]. It was jointly developed to support projects funded by the United States Geological Survey (USGS), U.S. Department of Energy (DOE), National Aeronautics and Space Administration (NASA) and National Oceanic and Atmospheric Administration (NOAA). OME’s architecture provides a customizable interface to support project-specific requirements. Using this new architecture, the ORNL team developed OME instances for USGS’s Core Science Analytics, Synthesis, and Libraries (CSAS&L), DOE’s Next Generation Ecosystem Experiments (NGEE) and Atmospheric Radiation Measurement (ARM) Program, and the international Surface Ocean Carbon Dioxide ATlas (SOCAT).Researchers simply use the ORNL Metadata Editor to enter relevant metadata into a Web-based form. From the information on the form, the Metadata Editor can create an XML file on the server that the editor is installed or to the user’s personal computer. Researchers can also use the ORNL Metadata Editor to modify existing XML metadata files.As an example, an NGEE Arctic scientist use OME to register their datasets to the NGEE data archive and allows the NGEE archive to publish these datasets via a data search portal (http://ngee.ornl.gov/data). These highly descriptive metadata created using OME allows the Archive to enable advanced data search options using keyword, geo-spatial, temporal and ontology filters. Similarly, ARM OME allows scientists or principal investigators (PIs) to submit their data products to the ARM data archive.How would OME help Big Data Centers like the Oak Ridge National Laboratory Distributed Active Archive Center (ORNL DAAC)?The ORNL DAAC is one of NASA’s Earth Observing System Data and Information System (EOSDIS) data centers managed by the Earth Science Data and Information System (ESDIS) Project. The ORNL DAAC archives data produced by NASA's Terrestrial Ecology Program. The DAAC provides data and information relevant to biogeochemical dynamics, ecological data, and environmental processes, critical for understanding the dynamics relating to the biological, geological, and chemical components of the Earth's environment. Typically data produced, archived and analyzed is at a scale of multiple petabytes, which makes the discoverability of the data very challenging. Without proper metadata associated with the data, it is difficult to find the data you are looking for and equally difficult to use and understand the data.OME will allow data centers like the NGEE and ORNL DAAC to produce meaningful, high quality, standards-based, descriptive information about their data products in-turn helping with the data discoverability and interoperability. Useful Links:USGS OME: http://mercury.ornl.gov/OME/NGEE OME: http://ngee-arctic.ornl.gov/ngeemetadata/ARM OME: http://archive2.ornl.gov/armome/Contact: Ranjeet Devarakonda (devarakondar@ornl.gov)References:[1] Federal Geographic Data Committee. Content standard for digital geospatial metadata. Federal Geographic Data Committee, 1998.[2] Devarakonda, Ranjeet, et al. "Mercury: reusable metadata management, data discovery and access system." Earth Science Informatics 3.1-2 (2010): 87-94.[3] Wilson, B. E., Palanisamy, G., Devarakonda, R., Rhyne, B. T., Lindsley, C., & Green, J. (2010). Mercury Toolset for Spatiotemporal Metadata.[4] Pouchard, L. C., Branstetter, M. L., Cook, R. B., Devarakonda, R., Green, J., Palanisamy, G., ... & Noy, N. F. (2013). A Linked Science investigation: enhancing climate change data discovery with semantic technologies. Earth science informatics, 6(3), 175-185.

FGDC CSDGM↗

3D Orbit Visualization for Earth-Observing Missions

This software visualizes orbit paths for the Orbiting Carbon Observatory (OCO), but was designed to be general and applicable to any Earth-observing mission. The software uses the Google Earth user interface to provide a visual mechanism to explore spacecraft orbit paths, ground footprint locations, and local cloud cover conditions. In addition, a drill-down capability allows for users to point and click on a particular observation frame to pop up ancillary information such as data product filenames and directory paths, latitude, longitude, time stamp, column-average dry air mole fraction of carbon dioxide, and solar zenith angle. This software can be integrated with the ground data system for any Earth-observing mission to automatically generate daily orbit path data products in Google Earth KML format. These KML data products can be directly loaded into the Google Earth application for interactive 3D visualization of the orbit paths for each mission day. Each time the application runs, the daily orbit paths are encapsulated in a KML file for each mission day since the last time the application ran. Alternatively, the daily KML for a specified mission day may be generated. The application automatically extracts the spacecraft position and ground footprint geometry as a function of time from a daily Level 1B data product created and archived by the mission s ground data system software. In addition, ancillary data, such as the column-averaged dry air mole fraction of carbon dioxide and solar zenith angle, are automatically extracted from a Level 2 mission data product. Zoom, pan, and rotate capability are provided through the standard Google Earth interface. Cloud cover is indicated with an image layer from the MODIS (Moderate Resolution Imaging Spectroradiometer) aboard the Aqua satellite, which is automatically retrieved from JPL s OnEarth Web service.

Jacob, Joseph C.↗

FLASHFlux Working Group Status: Assessing FF NOAA-20 Products and Future Upgrades

The CERES Fast Longwave and SHortwave radiative Flux working provides low latency data products from the CERES measurements within about 5-6 days of real time. This presentation reviews progress made toward evaluating the current data products and shows some examples of users for the instantaneous and daily averaged data products. In this presentation the comparisons to surface surface measurements are made through June 2023. Also, we preview some new results for replacing current algorithms with neural net model trained on the new CERES CRS data products. Lastly, present update plans for the next 9 months.

radiation budget↗

Accessing and Understanding MODIS Data

The National Aeronautics and Space Administration (NASA) launched the Terra satellite in December 1999, as part of the Earth Science Enterprise promotion of interdisciplinary studies of the integrated Earth system. Aqua, the second satellite from the series of EOS constellation, was launched in May 2002. Both satellites carry the MODerate resolution Imaging Spectroradiometer (MODIS) instrument. MODIS data are processed at the Goddard Space Flight Center, Greenbelt, MD, and then archived and distributed by the Distributed Active Archive Centers (DAACs). Data products from the MODIS sensors present new challenges to remote sensing scientists due to specialized production level, data format, and map projection. MODIS data are distributed as calibrated radiances and as higher level products such as: surface reflectance, water-leaving radiances, ocean color and sea surface temperature, land surface kinetic temperature, vegetation indices, leaf area index, land cover, snow cover, sea ice extent, cloud mask, atmospheric profiles, aerosol properties, and many other geophysical parameters. MODIS data are stored in HDF- EOS format in both swath format and in several different map projections. This tutorial guides users through data set characteristics as well as search and order interfaces, data unpacking, data subsetting, and potential applications of the data. A CD-ROM with sample data sets, and software tools for working with the data will be provided to the course participants.

Leptoukh, Gregory↗

The disCO2ver Platform: Curating Data and Tools for Geologic Carbon Sequestration and Deep Subsurface Research Systems

The U.S. DOE National Energy Technology Laboratory has invested 12+ years of development into the data repository and digital laboratory, the Energy Data eXchange (EDX, edx.netl.doe.gov). Supporting a variety of research areas across the DOE Office of Fossil Energy and Carbon Management, the platform has successfully curated and preserved thousands of data products from DOE research. The Carbon Storage Program has successfully supported data curation, upload, and publishing of data products on EDX for many years, demonstrating a success story of how resources like EDX can effectively help with long term preservation and publishing of DOE data products. EDX continues to shift towards cloud-supported infrastructure, taking a hybrid approach combining on-premises compute and storage integrated with cloud-hosted services. The integration of cloud compute and hybrid architecture enables the development of EDX-hosted platforms that tailor the data and tools hosted on them to a specific community, enables implementation of machine learning tools for data discovery and filtering, and enables the hosting of virtual (online user interface) tools. Geologic carbon sequestration (GCS) research continues to scale up in response to the current administration goals to reduce greenhouse gas emissions and transition the energy economy. Over the last year, EDX’s disCO2ver platform has been developed in response to the need for access to data products and tools to support the scaling up of GCS research. disCO2ver provides access to data resources and tools, produced by DOE and outside authoritative external resources. The platform also provides a user-access control component for the virtualization and cloud hosting of tools. Tools that need to be virtualized, to eliminate the need for users to download the tool and use local compute resources, is essential to supporting big-data analysis and machine learning that is becoming common place in carbon storage modeling, risk analysis, and data publishing practices. This talk will review the EDX’s disCO2ver platform and the current work ongoing to curate data and tools to support GCS and deep subsurface systems research.

Morkner, Paige↗

Improving Geolocation Accuracy of the Advanced Meteorological Imager on the GEO-KOMPSAT-2A

GeoNEX is a collaborative project led by scientists from NASA and many other international institutes to generate Earth monitoring products using data streams from the latest geostationary (GEO) sensors. Its consistent processing and common gridding systems can produce research-quality data products from GEO sensors and leverage GEO-GEO or GEO-LEO (low earth orbit) synergistic uses. Currently, GeoNEX has produced and disseminated L1G (geometrically corrected Level 1 products) from GOES 16/17 ABIs and Himawari-8 AHI, but a new Korean geostationary sensor (Advanced Meteorological Imager, AMI) onboard Geo-KOMPSAT-2A covering a large proportion of Asia and all of Oceania is in development. Our recent efforts on assessing geolocation accuracy in ABI and AHI suggest a nontrivial residual exists in both level 1B data with varying spatiotemporal patterns. The findings urge us to prioritize identifying and correcting geolocation residuals of AMI to generate accurate and consistent GeoNEX top-of-atmosphere (TOA) reflectance products and following processing chains. Here we implement a phase correlation correction approach to a visible band (0.64 μm, 500 m) using landmarks prepared from finer scale digital terrain models. We characterize spatiotemporal patterns (e.g., diurnal & daily) of geolocation residuals of AMI before and after correction. We then assess stability of datasets and quantify impact of unexpected geolocation errors on terrestrial monitoring. The geolocation corrected AMI data are further compared with GeoNEX AHI L1G products which are able to create unique stereo-type observations with AMI through leveraging the similarities of spectral bands and the sun-target-sensor geometry. Further, we discuss challenges in utilizing the GEO-GEO (e.g., AMI & AHI) satellite data for potential applications.

Geostationary Satellites↗

Delineating parton distributions and the strong coupling

In this study, global fits for precision determinations of parton distributions, together with the highly correlated strong coupling α s , are presented up to next-to-next-to- leading order (NNLO) of QCD utilizing most world data (charm and jet production data are used where theoretically possible), except Tevatron gauge boson production data and LHC data which are left for genuine predictions. This is done within the 'dynamical' (valencelike input at Q 0 2 = 0.8 GeV 2 ) and 'standard' (input at Q 0 2 = 2 GeV 2 ) approach. The stability and reliability of the results are ensured by including nonperturbative higher-twist terms, nuclear corrections as well as target mass corrections, and by applying various (Q 2 , W 2 ) cuts on available data. In addition, the Q 0 2 dependence of the results is studied in detail. Predictions are given, in particular for LHC, on gauge and Higgs boson as well as for top-quark pair production. At NNLO the dynamical approach results in α s (M Z 2 ) = 0.1136 ± 0.0004, whereas the somewhat less constrained standard fit gives α s (M Z 2 ) = 0.1162 ± 0.0006.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Evaluation of distributed process-based hydrologic model performance using only a priori information to define model inputs

Fully distributed, integrated surface–subsurface hydrological models (ISSHMs) have seen renewed interest due to availability of better software, high performance computing facilities, and high-resolution, spatially extensive data products. ISSHMs are valuable as tools for advancing system understanding as they can resolve multiple processes defined on the plot scale including three-dimensional interaction of surface water and groundwater. Here, we evaluated the performance of an ISSHM, the Advanced Terrestrial Simulator (ATS), on seven diverse catchments across the continental US using widely available data products to define model inputs without calibration. We compare the ATS-simulated streamflow and evapotranspiration with gauge observations and MODIS-derived evapotranspiration, respectively. Using the Kling-Gupta Efficiency (KGE) as metric, ATS with default data products performed reasonably well at 6 of 7 catchments for streamflow. However, in one of those 6 catchments ATS had poor performance on baseflow and ATS’s overall performance was thus judged to be inadequate despite the acceptable KGE. ATS performance for evapotranspiration was good in all 7 catchments using default data products. In the two catchments where ATS streamflow performance using default data products was not acceptable, the performance was significantly improved by using local information on subsurface properties below the soil. We also compare the model-simulated streamflow and evapotranspiration with the Sacramento soil moisture accounting (SAC-SMA) model, a semi-distributed model that was calibrated on a catchment-by-catchment basis. Uncalibrated ATS performance is comparable to the calibrated SAC-SMA model in terms of streamflow while ATS performance is similar to or better (much better in certain catchments) in reproducing MODIS-derived evapotranspiration. Reasonably good performance of ATS without catchment-specific calibration provides new confidence in the ISSHM class of models and community data products as tools for advancing understanding of watershed function in a changing environment.

54 ENVIRONMENTAL SCIENCES↗

A Whale of a Tale: Creating Spacecraft Telemetry Data Analysis Products for the Deep Impact Mission

This paper describes some of the challenges and lessons learned from the Deep Impact (DI) Mission Ground Data System's (GDS) telemetry data processing and product generation tool, nicknamed 'Whale.' One of the challenges of any mission is to analyze testbed and operational telemetry data. Methods to retrieve this data to date have required spacecraft subsystem members to become experts in the use of a myriad of query and plot tools. As budgets shrink, and the GDS teams grow smaller, more of the burden to understand these tools falls on the users. The user base also varies from novice to expert, and requiring them to become GDS tool experts in addition to spacecraft domain experts is an undue burden. The "Whale" approach is to process all of the data for a given spacecraft test, and provide each subsystem with plots and data products 'automagically.'.

Deep Impact↗

Global Land Data Assimilation System (GLDAS) Products from NASA Hydrology Data and Information Services Center (HDISC)

The Global Land Data Assimilation System (GLDAS) is generating a series of land surface state (e.g., soil moisture and surface temperature) and flux (e.g., evaporation and sensible heat flux) products simulated by four land surface models (CLM, Mosaic, Noah and VIC). These products are now accessible at the Hydrology Data and Information Services Center (HDISC), a component of the NASA Goddard Earth Sciences Data and Information Services Center (GES DISC). Current data holdings include a set of 1.0 degree resolution data products from the four models, covering 1979 to the present; and a 0.25 degree data product from the Noah model, covering 2000 to the present. The products are in Gridded Binary (GRIB) format and can be accessed through a number of interfaces. New data formats (e.g., netCDF), temporal averaging and spatial subsetting will be available in the future. The HDISC has the capability to support more hydrology data products and more advanced analysis tools. The goal is to develop HDISC as a data and services portal that supports weather and climate forecast, and water and energy cycle research.

Fang, Hongliang↗

An Update on the CDDIS

The Crustal Dynamics Data Inforn1ation System (CoorS) supports data archiving and distribution activities for the space geodesy and geodynamics community. The main objectives of the system are to store space geodesy and geodynamics related data products in a central data bank, to maintain infom1ation about the archival of these data, and to disseminate these data and information in a timely mam1er to a global scientific research community. The archive consists of GNSS, laser ranging, VLBI, and OORIS data sets and products derived from these data. The coors is one of NASA's Earth Observing System Oata and Infom1ation System (EOSorS) distributed data centers; EOSOIS data centers serve a diverse user community and are tasked to provide facilities to search and access science data and products. The coors data system and its archive have become increasingly important to many national and international science communities, in pal1icular several of the operational services within the International Association of Geodesy (lAG) and its project the Global Geodetic Observing System (GGOS), including the International OORIS Service (IDS), the International GNSS Service (IGS), the International Laser Ranging Service (ILRS), the International VLBI Service for Geodesy and Astrometry (IVS), and the International Earth Rotation Service (IERS). The coors has recently expanded its archive to supp011 the IGS Multi-GNSS Experiment (MGEX). The archive now contains daily and hourly 3D-second and subhourly I-second data from an additional 35+ stations in RINEX V3 fOm1at. The coors will soon install an Ntrip broadcast relay to support the activities of the IGS Real-Time Pilot Project (RTPP) and the future Real-Time IGS Service. The coors has also developed a new web-based application to aid users in data discovery, both within the current community and beyond. To enable this data discovery application, the CDDIS is currently implementing modifications to the metadata extracted from incoming data and product files pushed to its archive. This poster will include background information about the system and its user communities, archive contents and updates, enhancements for data discovery, new system architecture, and future plans.

Noll, Carey↗