Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data Sources”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 325 records · Page 18

Object-Based Comparison of Data-Driven and Physics-Driven Satellite Estimates of Extreme Rainfall

The Global Precipitation Measurement (GPM) constellation of spaceborne sensors provides a variety of direct and indirect measurements of precipitation processes. Such observations can be employed to derive spatially and temporally consistent gridded precipitation estimates either via data-driven retrieval algorithms or by assimilation into physically based numerical weather models. We compare the data-driven Integrated Multisatellite Retrievals for GPM (IMERG) and the assimilation-enabled NASA-Unified Weather Research and Forecasting (NU-WRF) model against Stage IV reference precipitation for four major extreme rainfall events in the southeastern United States using an object-based analysis framework that decomposes gridded precipitation fields into storm objects. As an alternative to conventional ‘‘grid-by-grid analysis,’’ the object-based approach provides a promising way to diagnose spatial properties of storms, trace them through space and time, and connect their accuracy to storm types and input data sources. The evolution of two tropical cyclones are generally captured by IMERG and NU-WRF, while the less organized spatial patterns of two mesoscale convective systems pose challenges for both. NU-WRF rain rates are generally more accurate, while IMERG better captures storm location and shape. Both show higher skill in detecting large, intense storms compared to smaller, weaker storms. IMERG’s accuracy depends on the input microwave and infrared data sources; NU-WRF does not appear to exhibit this dependence. Findings highlight that an object-oriented view can provide deeper insights into satellite precipitation performance and that the satellite precipitation community should further explore the potential for ‘‘hybrid’’ data-driven and physics-driven estimates in order to make optimal usage of satellite observations.

extreme events↗

Mars Science Laboratory Entry, Descent, and Landing Trajectory and Atmosphere Reconstruction

On August 5th 2012, The Mars Science Laboratory entry vehicle successfully entered Mars atmosphere and landed the Curiosity rover on its surface. A Kalman filter approach has been implemented to reconstruct the entry, descent, and landing trajectory based on all available data. The data sources considered in the Kalman filtering approach include the inertial measurement unit accelerations and angular rates, the terrain descent sensor, the measured landing site, orbit determination solutions for the initial conditions, and a new set of instrumentation for planetary entry reconstruction consisting of forebody pressure sensors, known as the Mars Entry Atmospheric Data System. These pressure measurements are unique for planetary entry, descent, and landing reconstruction as they enable a reconstruction of the freestream atmospheric conditions without any prior assumptions being made on the vehicle aerodynamics. Moreover, the processing of these pressure measurements in the Kalman filter approach enables the identification of atmospheric winds, which has not been accomplished in past planetary entry reconstructions. This separation of atmosphere and aerodynamics allows for aerodynamic model reconciliation and uncertainty quantification, which directly impacts future missions. This paper describes the mathematical formulation of the Kalman filtering approach, a summary of data sources and preprocessing activities, and results of the reconstruction.

Karlgaard, Christopher D.↗

Understanding Event Trajectories Across Massive Temporal Datasets with Word Embeddings and Visualization

In collaboration with researchers from Virginia Tech, Savannah River National Laboratory has continued development of a natural language processing pipeline to identify and extract events of interest from massive open data sources in the domain of worldwide state-sponsored civil nuclear energy. The foundation of the pipeline is built on compass aligned temporal word embedding models, whereby contextual shifts are automatically identified by comparing keyword embedding vectors across successive time windows. Within the approach, a contextual shift indicates the occurrence of a potential event of interest. However, in such a broad topical domain that captures events at a global scale, across various life cycle stages, and across numerous different technology types, a user that is monitoring events may have broad interests in capturing many different event types with varying degrees of signal. As such, the quantity of information that may be returned from an automated event extraction pipeline can be substantial, requiring manual effort to sift through the information to identify any relevant bits of information. Therefore, a more streamlined workflow that aids in directing a user toward specific information at different points in time is necessary. The workflow presented here has been developed with this concept in mind, built on top of the initial prototype event extraction pipeline, whereby a user can analyze temporal text-based data sources at multiple different contextual levels to isolate key points in time and key subdomains captured within a data corpus. Using multiple corpuses that consist of approximately 7 million Tweets and 7 million news articles, the team has extended compass aligned temporal word embedding models to establish an interconnected and hierarchical structure that relates known key words of interest to documents, local topics (i.e., within a time window), and global topics across the corpuses. All of this information is packaged into a visual analytics system that is linked to the information extraction pipeline and enables a user to identify contextual information that describes the evolution of a high dimensional embedding space across time to isolate changes of interest and explore associated events. This report demonstrates the use of these analytics and a means to fuse information across multiple datasets.

97 MATHEMATICS AND COMPUTING↗

Air Quality Forecasting at Sub-City Scale by Combining Models, Satellites, and Surface Measures

While there are a variety of sources for air quality information, no one source simultaneously allows for high accuracy, low bias, fine spatial resolution, wide spatial coverage, high temporal frequency, and the capability for near-term forecasting of air quality. Global models, like the NASA’s Goddard Earth Observing System -Composition Forecasting (GEOS-CF) model, provide global coverage and forecasting capabilities, but operate at relatively coarse spatial resolution and require ground-truthing with in-situ data. Polar-orbiting satellite data products, like those of the ESA TROPOspheric Monitoring Instrument (TROPOMI), provide higher-spatial-resolution remote sensing of atmospheric composition, but are limited by cloud cover and overpass times and report column-integrated quantities. Surface measurements, both from regulatory-grade monitors and low-cost networks, measure “nose-level” air quality, but may not represent concentration variability across large spatial domains, and (in the case of low-cost sensors) are subject to interference and biases. There exists a great potential to combine these diverse data sources together, using the strengths of some to offset the weaknesses of others to build a more comprehensive picture of air quality. This presentation will summarize results from ongoing efforts to produce such a combined forecast, with application case studies for surface-level Nitrogen Dioxide forecasting in several major US cities. Furthermore, we will examine the relative impacts and benefits of different data sources on the forecasting accuracy at different spatial and temporal scales. Finally, we will examine the potential for integrating low-cost sensors into such a system, both in terms of using these integrated air quality estimates as a baseline from which to calibrate networks of low-cost sensors in the field, and in terms of using dense networks of low-cost sensors to refine the spatial resolution of integrated air quality forecasts.

Air Quality↗

Data Quality Challenges for Analysis Ready Data (ARD)

Data quality plays a critical role in research and applications. The Earth Science Information Partners (ESIP) Information Quality Cluster (IQC) defines four aspects of information quality: Science, Product, Stewardship, and Services. The ESIP IQC has become internationally recognized as an authoritative and responsive resource of information and guidance to data producers and distributors on how to implement data quality standards and best practices for their science data systems, datasets, and data/metadata dissemination services. In recent years, cloud computing environments have provided scale-up capabilities such as data archives and services, enabling interdisciplinary science and applications. More value-added products are expected from data service providers, including Analysis Ready Data (ARD). ARD refers to data that has been preprocessed into a form that allows immediate analysis by the end user, processed to a minimum set of requirements and provides interoperability over time and across multiple datasets. Once a dataset has been developed from its original form to produce ARD, what quality characteristics should the derived dataset or ARD possess? Also, is it safe to assume that the quality of the ARD is consistent with the quality of the source data, or are there special attributes to an ARD that would warrant a secondary, independent quality assessment? What provenance (also called “data lineage”) information needs to be included in ARD? It is important to answer these questions, especially given the ease of use of ARD, and the consequent temptation by users to trust ARD without understanding the limitations or possible variations in quality compared to the source data. In this presentation, we will discuss data quality challenges for ARD products and services and introduce IQC for participation.

data quality↗

Sources of Propane Consumed in California

Project Scope: The objective of this study is to specify the sources of propane consumed in California. It answers the questions, where does the propane used in California come from and how was it produced? The results of this study provide comprehensive, transparent, and verifiable estimates, based on the 2018 market. The information provided in this report is suitable for use to assess the life cycle carbon intensity of propane used as a transportation fuel in California. As the 2009 Low Carbon Fuel Standard (LCFS) aims to reduce California’s greenhouse gas (GHG) emissions and other smog-forming and toxic air pollutants, the appropriate designation of carbon intensity for propane as a transportation fuel is important for evaluating propane’s potential to contribute to GHG goals and understandings in the context of various actions. This study focuses on estimating the shares of total propane consumed in the state of California produced from petroleum refineries, natural gas plants, and bituminous sands sources inside California and elsewhere. Results: An estimated 590 million gallons of propane were consumed in California in 2018, of which, 59.5% originated from refinery production and 40.5% originated from natural gas plants. The majority of this was sourced from refinery production in California, 334 million gallons. Most of the propane imported to California for consumption was sourced from natural gas plants, 113 million gallons, with over half of the imported volume sourced from Canada. The volume sourced from bituminous sand upgrader and fractionator operations was negligible. Details from this analysis are presented in the table below which provides an overview of the propane flows estimated in this study by region and production method. The shares and volumes presented here represent a snapshot for 2018. A significant increase in propane demand, such as could be caused by increased use of propane as a transportation fuel in the state, would affect California’s propane production, imports, and exports. The method and data sources used for the estimates provided in this report also provide the framework which could be used for future updates. Key Method Considerations: The values presented here are based on a two-step approach where the first step was to determine the flows of propane into and out of California from different regions and the second step was to estimate the propane production methods in each region. A volume balance approach is used as the primary method for tracking the volume of propane in and out of California as propane production and import volumes are available by Petroleum Administration of Defense District (PADD) from EIA and neither inter-PADD propane transfers nor state-specific non-prime supplier consumption are available from a public data source. The volume balance performed for this study covered PADD 5 (the West Coast), which includes Arizona, California, Nevada, Oregon, and Washington. The volume balance used all available public datasets to determine propane production, imports, exports, and consumption. Volumes unaccounted for by these datasets were estimated using the resulting volume balance by assuming market equilibrium. Consumption within each state in PADD 5 was estimated based on known import, export, and production volumes and this amount was used to develop the volume balance. EIA only tracks consumption at the state level by prime supplier sales. The volume balance approach provides the basis to correct for additional propane consumed in-states where propane is transferred to California. To determine the California propane sources and trade in 2018. volume of propane consumed in California, the volume balance approach is again used where it was estimated all imported volumes not specifically flagged for re-export were consumed, and the remaining consumption was produced in-state. The California Energy Commission (CEC) provided the total volume of propane imported and exported from California in 2018; this volume data set along with commodity tracking from the Canada Energy Regulator (CER) and the International Trade Commission (ITC) which tracks port of entry and final destination was used to determine where propane originated from and where it was ultimately consumed. For example, the CER tracks propane leaving Canada and entering each state within the U.S. Imported propane from Canada to California – marked for California – is assumed to be consumed in California. When no further data were available, import volumes were assumed to be consumed in California without pass-through (i.e., no propane imported to California was directly sold and exported). In most cases, the production method for each propane source region was applied to the volume of propane transferred to California. In other words, the shares of propane sourced from natural gas and refineries for each production region was assigned to California imports based on their contribution to the total volume flows into California to determine the production method for propane consumed in-state. For volumes imported into California from PADD 4, Washington State, Canada, and the rest of the world (Argentina, Chile, Norway, Peru, South Korea, and Trinidad and Tobago), the volumes sourced from petroleum refineries and natural gas plants reflect the either production ratio for the region or, in cases where the sources specific to the amounts exported to California could be determined, the sources specific to the volumes transferred to California.

03 NATURAL GAS↗

An Agent-Based Interface to Terrestrial Ecological Forecasting

The latest generation of NASA Earth Observing System (EOS) satellites has brought a new dimension to continuous monitoring of the living part of the Earth System, the biosphere. EOS data can now provide weekly global measures of vegetation productivity and ocean chlorophyll, and many related biophysical factors such as land cover changes or snowmelt rates. However, the highest economic value would come from forecasting impending conditions of the biosphere, to allow decision makers to mitigate dangers or exploit positive trends. NASA's strategic plan for the Earth Science Enterprise i d e n a s ecological forecasting as a focus for research. Ecological forecasting predicts the effects of changes in the physical, chemical and biological environment on ecosystem activity. Possible applications of such a system include predicting shortfalls or bumper crops of agricultural production, populations of threatened or invasive species or wildfire danger in time to allow improves preparation and logistical efficiency. Petabytes of remote sensing data are now available to help measure, understand and forecast changes in the Earth system, but using these data effectively can be surprisingly hard. The volume and variety of data files and formats are daunting. Simple data management activities, such as locating and transferring files, changing file formats, gridding point data, and scaling and reprojecting gridded data, can consume far more personnel time and resources than the actual data analysis. Some scientists commit to a particular data source or resolution just because using anything different would be more effort that it's worth. Better tools can help, but most of the tools developed to date are little more than shell scripts; they lack the flexibility to meet the diverse needs of users and are difficult to extend to handle changes in available data sources.

Golden, Keith↗

Open Data for Nuclear Explosion Monitoring (NEM) [Slides]

The data sources tend to have the highest quality data and metadata, particularly for more recent data sets. Early data from sources such as IRIS tend to have some metadata issues.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

Characterization of AIRS temperature and water vapor measurement capability using correlative observations

In this presentation we address several fundamental issues in the measurement of temperature and water vapor by AIRS: accuracy, precision, vertical resolution and biases as a function of cloud amount. We use two correlative data sources. First we compare AIRS total water vapor with that from the Advanced microwave Sounding Radiometer for EOS (AMSR-E) instrument, also onboard the Aqua spacecraft. AMSRE uses a mature methodology with a heritage including the operational Special Sensor Microwave Imager (SSM/I) instruments. AIRS and AMSR-E observations are collocated and simultaneous, providing a very large data set for comparison: about 200,000 over-ocean matches daily. We show small cloud-dependent biases between AIRS and AMSR-E total water vapor for several oceanic regions. Our second correlative data source is several hundred dedicated radiosondes launched during AIRS overpasses.

meteorology↗

NetGraf: An End-to-End Learning NetworkMonitoring Service (NetGraf) v1

NetGraf is a novel end-to-end learning monitoring system that utilizes current monitoring tools, merges multiple data sources into one dashboard for easy use, and provides machine learning libraries to analyze the data and perform real-time anomaly findings. Using a database backend, NetGraf can learn performance trends and show users if network performance has degraded. We demonstrate how NetGraf can easily be deployed through automation services and linked to multiple monitoring sources to collect data. Via the machine learning innovation and merging various data sources, NetGraf aims to fulfill the need for holistic learning network telemetry monitoring. To the best of our knowledge, this is the first-ever end-to-end learning monitoring service. We demonstrate its use on two network setups to showcase its impact.

Mohammed, Bashir↗

Data and Scripts Associated with "Modeling Ecohydrological Responses of Vegetation to Urban Microclimates Using the E3SM Land Model"

This dataset supports the study of vegetation ecohydrological responses to urban microclimates using the land component of the Energy Exascale Earth System Model (ELM) at four urban sites in Knoxville, Tennessee, USA. It includes the model inputs, simulation outputs, and associated scripts for running ELM simulations and analyzing the resulting data. The Model_Inputs folder includes static surface data, satellite-derived phenology (i.e., leaf area index), and atmospheric forcing data used to drive ELM simulations. Detailed descriptions of these datasets are provided in Section 2.3.2 of the associated manuscript. The Model_Outputs folder contains simulation results for the baseline, treatment, and ensemble experiments. Outputs from the baseline and treatment simulations are provided as raw ELM NetCDF files. Because the raw outputs from the 4,000-member ensemble are prohibitively large, the ensemble results are provided as summarized CSV files, which also serve as the source data for Figure 5 of the associated manuscript. The Scripts folder contains three components: E3SM, the core codebase of the Energy Exascale Earth System Model (E3SM); elm-olmt, the Offline Land Model Testbed (OLMT) used to perform the simulations; and knoxville_elm, which contains the analysis scripts used to process model outputs and generate the figures and results presented in the associated manuscript. Additional information is provided in Scripts_readme.txt within the Scripts directory.

Lu, Xiaoman [ORNL] (ORCID:0000000306698780)↗

Adjoint-Based Inversion of Geodetic Data for Sources of Deformation and Strain

An adjoint-based formulation leads to a particularly efficient approach for inverting geodetic measurements for the source of the deformation. Specifically, the quantities necessary to iteratively improve the fit to the observations can be computed with just three forward calculations, one to obtain the current residuals, another to solve the adjoint problem, and a third to compute the step length. An inversion algorithm utilizing the adjoint-based gradient is applied to a set of Interferometric Synthetic Aperture Radar (InSAR) data gathered between 2016 and 2018 over the Tulare Basin in California's Central Valley. Because the measured deformation is due to groundwater withdrawal, a penalty function is included in the inversion to avoid placing aquifer volume change in locations that are far from any documented wells. The solution of the inverse problem provides estimates of aquifer compaction that provide a match to the observed range changes while honoring the well data. The solution indicates an average aquifer volume loss of 2.17 km 3 /year over the two year period from January 2016 to January 2018, encompassing one drought year (2016) and one wet year (2017). Finally, this magnitude of lost volume is compatible with the 3.1 km 3 /year decrease in water volume for the entire Central Valley, estimated from GRACE satellite gravity data.

58 GEOSCIENCES↗

Weather Design Considerations for the TASAR Traffic Aware Planner

The Traffic Aware Planner (TAP) is a decision support automation tool for trajectory planning and optimization intended for use on today’s flight deck. Drawing from a variety of on- and off-board data sources, TAP employs a sophisticated trajectory optimization algorithm that provides the aircrew with fuel- and time-saving reroute recommendations that are free of known conflicts with traffic, special use airspace, and severe convective weather. As this kind of weather is a significant part of the pilot’s decision-making process while planning trajectory changes en route, a series of investigations has been conducted into the integration of weather data and associated functionality into the TAP software. This paper reviews the weather data sources and functionality that have been incorporated into TAP to date, along with experience gathered in the course of the design process.

Lewis, Timothy A.↗

Future Flight Opportunities and Calibration Protocols for CERES: Continuation of Observations in Support of the Long-Term Earth Radiation Budget Climate Data Record

The goal of the Clouds and the Earth s Radiant Energy System (CERES) project is to provide a long-term record of radiation budget at the top-of-atmosphere (TOA), within the atmosphere, and at the surface with consistent cloud and aerosol properties at climate accuracy. CERES consists of an integrated instrument-algorithm validation science team that provides development of higher-level products (Levels 1-3) and investigations. It involves a high level of data fusion, merging inputs from 25 unique input data sources to produce 18 CERES data products. Over 90% of the CERES data product volume involves two or more instruments. Continuation of the Earth Radiation Budget (ERB) Climate Data Record (CDR) has been identified as critical in the 2007 NRC Decadal Survey, the Global Climate Observing System WCRP report, and in an assessment titled Impacts of NPOESS Nunn-McCurdy Certification on Joint NASA-NOAA Climate Goals . Five CERES instruments have flown on three different spacecraft: TRMM, EOS-Terra and EOS-Aqua. In response, NASA, NOAA and NPOESS have agreed to fly the existing CERES Flight Model (FM-5) on the NPP spacecraft in 2011 and to procure an additional CERES Sensor with modest upgrades for flight on the JPSS C1 spacecraft in 2014, followed by a CERES follow-on sensor for flight in 2018. CERES is a scanning broadband radiometer that measures filtered radiance in the SW (0.3-5 m), total (TOT) (0.3-200 m) and WN (8-12 m) regions. Pre-launch calibration is performed on each Flight Model to meet accuracy requirements of 1% for SW and 0.5% for outgoing LW observations. Ground to flight or in-flight changes are monitored using protocols employing onboard and vicarious calibration sources. Studies of flight data show that SW response can change dramatically due to optical contamination. with greatest impact in blue-to UV radiance, where tungsten lamps are largely devoid of output. While science goals remain unchanged for ERB Climate Data Record, it is now understood that achieving these goals is more difficult for two reasons. The first is an increased understanding of the dynamics of the Earth/atmosphere system which demonstrates that separation of natural variability from anthropogenic change on decadal time scales requires observations with higher accuracy and stabilit

Priestley, Kory J.↗

Intercomparison of observed cloud radiative forcing - A zonal and global perspective

Cloud radiative forcing determined by the Earth Radiation Budget Experiment (ERBE) scene identification method and two regression methods is compared using identical data sources and the same analysis periods. Results confirm that from the global perspective the increased reflection of SW radiation induced by clouds is greater than outgoing longwave energy trapped by clouds. The estimates of net effect obtained from the three methods are found to be in good agreement (within 3.5 W/sq m). It is concluded that differences in published global mean values of net cloud radiative forcing are mainly due to different data sources and analysis periods. The best estimated annual mean among all previous estimates is considered to be the ERBE measurement (-17.3 W/sq m).

Sohn, Byung-Ju↗

Machine learning and ligand binding predictions: A review of data, methods, and obstacles

We report that computational predictions of ligand binding is a difficult problem, with more accurate methods being extremely computationally expensive. The use of machine learning for drug binding predictions could possibly leverage the use of biomedical big data in exchange for time-intensive simulations. This paper reviews current trends in the use of machine learning for drug binding predictions, data sources to develop machine learning algorithms, and potential problems that may lead to overfitting and ungeneralizable models. A few popular datasets that can be used to develop virtual high-throughput screening models are characterized using spatial statistics to quantify potential biases. We can see from evaluating some common benchmarks that good performance correlates with models with high-predicted bias scores and models with low bias scores do not have much predictive power. A better understanding of the limits of available data sources and how to fix them will lead to more generalizable models that will lead to novel drug discovery.

59 BASIC BIOLOGICAL SCIENCES↗

Constructing the 'Best' Reliability Data for the Job - Developing Generic Reliability Data from Alternative Sources Early in a Product's Development Phase

Reliability practitioners advocate getting reliability involved early in a product development process. However, when assigned to estimate or assess the (potential) reliability of a product or system early in the design and development phase, they are faced with lack of reasonable models or methods for useful reliability estimation. Developing specific data is costly and time consuming. Instead, analysts rely on available data to assess reliability. Finding data relevant to the specific use and environment for any project is difficult, if not impossible. Instead, analysts attempt to develop the "best" or composite analog data to support the assessments. Industries, consortia and vendors across many areas have spent decades collecting, analyzing and tabulating fielded item and component reliability performance in terms of observed failures and operational use. This data resource provides a huge compendium of information for potential use, but can also be compartmented by industry, difficult to find out about, access, or manipulate. One method used incorporates processes for reviewing these existing data sources and identifying the available information based on similar equipment, then using that generic data to derive an analog composite. Dissimilarities in equipment descriptions, environment of intended use, quality and even failure modes impact the "best" data incorporated in an analog composite. Once developed, this composite analog data provides a "better" representation of the reliability of the equipment or component. It can be used to support early risk or reliability trade studies, or analytical models to establish the predicted reliability data points. It also establishes a baseline prior that may updated based on test data or observed operational constraints and failures, i.e., using Bayesian techniques. This tutorial presents a descriptive compilation of historical data sources across numerous industries and disciplines, along with examples of contents and data characteristics. It then presents methods for combining failure information from different sources and mathematical use of this data in early reliability estimation and analyses.

Kleinhammer, Roger K.↗

U.S. national water and energy land dataset for integrated multisector dynamics research

Abstract Understanding resource demands and tradeoffs among energy, water, and land socioeconomic sectors requires an explicit consideration of spatial scale. However, incorporation of land dynamics within the energy-water nexus has been limited due inconsistent spatial units of observation from disparate data sources. Herein we describe the development of a National Water and Energy Land Dataset (NWELD) for the conterminous United States. NWELD is a 30-m, 86-layer rasterized dataset depicting the land use of mappable components of the United States energy sector life cycles (and related water used for energy), specifically the extraction, development, production, storage, distribution, and operation of eight renewable and non-renewable technologies. Through geospatial processing and programming, the final products were assembled using four different methodologies, each depending upon the nature and availability of raw data sources. For validation, NWELD provided a relatively accurate portrayal of the spatial extent of energy life cycles yet displayed low measures of association with mainstream land cover and land use datasets, indicating the provision of new land use information for the energy-water nexus.

58 GEOSCIENCES↗