Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data Set”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,045 records · Page 58

Geographic information system for fusion and analysis of high-resolution remote sensing and ground truth data

We seek to combine high-resolution remotely sensed data with models and ground truth measurements, in the context of a Geographical Information System, integrated with specialized image processing software. We will use this integrated system to analyze the data from two Case Studies, one at a bore Al forest site, the other a tropical forest site. We will assess the information content of the different components of the data, determine the optimum data combinations to study biogeophysical changes in the forest, assess the best way to visualize the results, and validate the models for the forest response to different radar wavelengths/polarizations. During the 1990's, unprecedented amounts of high-resolution images from space of the Earth's surface will become available to the applications scientist from the LANDSAT/TM series, European and Japanese ERS-1 satellites, RADARSAT and SIR-C missions. When the Earth Observation Systems (EOS) program is operational, the amount of data available for a particular site can only increase. The interdisciplinary scientist, seeking to use data from various sensors to study his site of interest, may be faced with massive difficulties in manipulating such large data sets, assessing their information content, determining the optimum combinations of data to study a particular parameter, visualizing his results and validating his model of the surface. The techniques to deal with these problems are also needed to support the analysis of data from NASA's current program of Multi-sensor Airborne Campaigns, which will also generate large volumes of data. In the Case Studies outlined in this proposal, we will have somewhat unique data sets. For the Bonanza Creek Experimental Forest (Case I) calibrated DC-8 SAR data and extensive ground truth measurement are already at our disposal. The data set shows documented evidence to temporal change. The Belize Forest Experiment (Case II) will produce calibrated DC-8 SAR and AVIRIS data, together with extensive measurements on the tropical rain forest itself. The extreme range of these sites, one an Arctic forest, the other a tropical rain forest, has been deliberately chosen to find common problems which can lead to generalized observations and unique problems with data which raise issues for the EOS System.

Freeman, Anthony↗

Evaluation of SLAR and thematic mapper MSS data for forest cover mapping using computer-aided analysis techniques

The column normalizing technique was used to adjust the data for variations in the amplitude of the signal due to look angle effects with respect to solar zenith angle along the scan lines (i.e., across columns). Evaluation of the data set containing the geometric and radiometric adjustments, indicates that the data set should be satisfactory for further processing and analysis. Software was developed for degrading the spatial resolution of the aircraft data to produce a total of four data sets for further analysis. The quality of LANDSAT 2 CCT data for the test site is good for channels four, five, and six. Channel seven was not present on the tape. The data received were reformatted and analysis of the test site area was initiated.

Hoffer, R. M.↗

Integration of SAR and DEM data: Geometrical considerations

General principles for integrating data from different sources are derived from the experience of registration of SAR images with digital elevation models (DEM) data. The integration consists of establishing geometrical relations between the data sets that allow us to accumulate information from both data sets for any given object point (e.g., elevation, slope, backscatter of ground cover, etc.). Since the geometries of the two data are completely different they cannot be compared on a pixel by pixel basis. The presented approach detects instances of higher level features in both data sets independently and performs the matching at the high level. Besides the efficiency of this general strategy it further allows the integration of additional knowledge sources: world knowledge and sensor characteristics are also useful sources of information. The SAR features layover and shadow can be detected easily in SAR images. An analytical method to find such regions also in a DEM needs in addition the parameters of the flight path of the SAR sensor and the range projection model. The generation of the SAR layover and shadow maps is summarized and new extensions to this method are proposed.

Kropatsch, Walter G.↗

Region-based convolutional neural network for wind turbine wake characterization from scanning lidars

A convolutional neural network is applied to lidar scan images from three experimental campaigns to identify and characterize wind turbine wakes. Initially developed as a proof-of-concept model and applied to a single data set in complex terrain, the model is now improved and generalized and applied to two other unique lidar data sets, one located near an escarpment and one located offshore. The model, initially developed using lidar scans collected in predominantly westerly flow, exhibits sensitivity to wind flow direction. The model is thus successfully generalized through implementing a standard rotation process to scan images before input into the convolutional neural network to ensure the flow is westerly. The sample size of lidar scans used to train the model is increased, and along with the generalization process, these changes to the model are shown to enhance accuracy and robustness when characterizing dissipating and asymmetric wakes. Applied to the offshore data set in which nearly 20 wind turbine wakes are included per scan, the improved model exhibits a 95% success rate in characterizing wakes and a 74% success rate in characterizing dissipating wake fragments. The improved model is shown to generalize well to the two new data sets, although an increase in wake characterization accuracy is offset by an increase in model sensitivity and false positive wake identifications.

17 WIND ENERGY↗

Models, data, and scripts associated with “Prediction of Distributed River Sediment Respiration Rates using Community-Generated Data and Machine Learning”

This data package is associated with the publication “Prediction of Distributed River Sediment Respiration Rates using Community-Generated Data and Machine Learning’’ submitted to the Journal of Geophysical Research: Machine Learning and Computation (Scheibe et al. 2024). River sediment respiration observations are expensive and labor intensive to obtain and there is no physical model for predicting this quantity. The Worldwide Hydrobiogeochemisty Observation Network for Dynamic River Systems (WHONDRS) observational data set (Goldman et al.; 2020) is used to train machine learning (ML) models to predict respiration rates at unsampled sites. This repository archives training data, ML models, predictions, and model evaluation results for the purposes of reproducibility of the results in the associated manuscript and community reuse of the ML models trained in this project. One of the key challenges in this work was to find an optimum configuration for machine learning models to work with this feature-rich (i.e. 100+ possible input variables) data set. Here, we used a two-tiered approach to managing the analysis of this complex data set: 1) a stacked ensemble of ML models that can automatically optimize hyperparameters to accelerate the process of model selection and tuning and 2) feature permutation importance to iteratively select the most important features (i.e. inputs) to the ML models. The major elements of this ML workflow are modular, portable, open, and cloud-based, thus making this implementation a potential template for other applications. This data package is associated with the GitHub repository found at Please see the file level metadata (flmd; “sl-archive-whondrs_flmd.csv”) for a list of all files contained in this data package and descriptions for each. Please see the data dictionary (dd; “sl-archive-whondrs_dd.csv”) for a list of all column headers contained within comma separated value (csv) files in this data package and descriptions for each. The GitHub repository is organized into five top-level directories: (1) “input_data” holds the training data for the ML models; (2) “ml_models” holds machine learning models trained on the data in “input_data”; (3) “scripts” contains data preprocessing and postprocessing scripts and intermediate results specific to this data set that bookend the ML workflow; (4) “examples” contains the visualization of the results in this repository including plotting scripts for the manuscript (e.g., model evaluation, FPI results) and scripts for running predictions with the ML models (i.e., reusing the trained ML models); (5) “output_data” holds the overall results of the ML model on that branch. Each trained ML model resides on its own branch in the repository; this means that inputs and outputs can be different branch-to-branch. Furthermore, depending on the number of features used to train the ML models, the preprocessing and postprocessing scripts, and their intermediate results, can also be different branch-to-branch. The “main-*” branches are meant to be starting points (i.e. trunks) for each model branch (i.e. sprouts). Please see the Branch Navigation section in the top-level README.md in the GitHub repository for more details. There is also one hidden directory “.github/workflows”. This hidden directory contains information for how to run the ML workflow as an end-to-end automated GitHub Action but it is not needed for reusing the ML models archived here. Please the top-level README.md in the GitHub repository for more details on the automation.

13C↗

Utilization of satellite-derived cloud cover to improve the estimation of latent heat release in a winter extratropical cyclone

A simple scheme for utilizing satellite cloud pattern information to improve the estimation of parameterized stable and convective latent heat release is proposed and tested for an extratropical cyclone occurring over the United States during January 9-11, 1975. Calculations are done over the standard North American rawinsonde data region and over a sparse data region simulated by ignoring one-third of the original rawinsonde stations. Results indicate 15 percent and 30 percent improvements in latent heating estimates derived from the total and sparse data sets, respectively. A larger improvement was found using the sparse data set because the parameterized latent heat release estimates obtained using these data were poorer than those obtained using the total data set.

Lin, S.-J.↗

ROSAT investigation of flaring and activity on Prox Cen

The objective of this program was to investigate with high sensitivity the low-level flare activity which may underlie coronal heating. This was done. The ROSAT observations of Prox Cen were scheduled for 50 ks spread out from 26 Feb. - 10 Mar. 1992. Unfortunately because of spacecraft problems many of these pointings turned out to contain no useful data or extremely truncated valid data sets. Considerable time was spent trying to determine which of the data would be scientifically useful and which would not. Fortunately, several developments took place to augment the original data in such a way that the scientific goal of advancing the study of flaring and variability was able to be achieved after all. These are as follows: (1) a second round of ROSAT observations was carried out in Feb. 1993 which only came to the attention of the PI in Apr. 1993 when a new data tape arrived; (2) simultaneous IUE observations were requested and obtained; (3) data from the UK WFC are available via the collaboration with Dr. G. Bromage; and (4) the 'cleaned-up' original data set was found to include one major flare and 2 moderate flares. Because of the problems with the original data set, the unexpected acquisition of new data only two months ago, and the availability of IUE and WFC data, an article on Prox Cen for publication is not ready at this time. Such an article is being developed and can be completed as part of ongoing ROSAT research efforts on stellar coronae and flaring.

Haisch, Bernhard↗

The special effort processing of FGGE data

The basic FGGE level IIb data set was enhanced. It focused on removing deficiencies in the objective methods of quality assurance, removing efficiencies in certain types of operationally produced satellite soundings, and removing deficiencies in certain types of operationally produced cloud tracked winds. The Special Effort was a joint NASA-NOAA-University of Wisconsin effort. The University of Wisconsin installed an interactive McIDAS capability on the Amdahl computer at the Goddard Laboratory of Atmospheric Sciences (GLAS) with one interactive video terminal at Goddard and the other at the World Weather Building. With this interactive capability a joint processing effort was undertaken to reprocess certain FGGE data sets. NOAA produced a specially edited data set for the special observing periods (SOPs) of FGGE. NASA produced an enhanced satellite sounding data set for the SOPs while the University of Wisconsin produced an enhanced cloud tracked wind set from the Japanese geostationary satellite images.

Source record↗

A comparison of SMMR and AVHRR data for continental land cover characterization

Images using reflected visible and NIR data and images using passive microwave data were compared in terms of their usefulness for characterizing land-cover types in South America and Africa. The former images are of the normalized difference vegetation index (NDVI), and the latter images are of the microwave polarization difference temperature (MPDT). The combined use of MPDT and NDVI data sets show clear synergistic benefits in using the two data sets. However, the evidence suggests that for most cover types, increasing the temporal frequency of the NDVI images is more advantageous than incorporating MPDT data sets.

Townshend, J. R. G.↗

Streaming Compression of Scientific Data via Weak-SINDy

Here, in this paper, a streaming weak-SINDy algorithm is developed specifically for compressing streaming scientific data. The production of scientific data, either via simulation or experiments, is undergoing a stage of exponential growth, which makes data compression important and often necessary for storing and utilizing large scientific data sets. As opposed to classical “offline” compression algorithms that perform compression on a readily available data set, streaming compression algorithms compress data “online” while the data generated from simulation or experiments is still flowing through the system. This feature makes streaming compression algorithms well suited for scientific data compression, where storing the full data set offline is often infeasible. This work proposes a new streaming compression algorithm, streaming weak-SINDy, which takes advantage of the underlying data characteristics during compression. The streaming weak-SINDy algorithm constructs feature matrices and target vectors in the online stage via a streaming integration method in a memory efficient manner. The feature matrices and target vectors are then used in the offline stage to build a model through a regression process that aims to recover equations that govern the evolution of the data. For compressing high-dimensional streaming data, we adopt a streaming proper orthogonal decomposition (POD) process to reduce the data dimension and then use the streaming weak-SINDy algorithm to compress the temporal data of the POD expansion. We propose modifications to the streaming weak-SINDy algorithm to accommodate the dynamically updated POD basis. By combining the built model from the streaming weak-SINDy algorithm and a small amount of data samples, the full data flow could be reconstructed accurately at a low memory cost, as shown in the numerical tests.

97 MATHEMATICS AND COMPUTING↗

Geographic information system for fusion and analysis of high-resolution remote sensing and ground data

We seek to combine high-resolution remotely sensed data with models and ground truth measurements, in the context of a Geographical Information System (GIS), integrated with specialized image processing software. We will use this integrated system to analyze the data from two Case Studies, one at a boreal forest site, the other a tropical forest site. We will assess the information content of the different components of the data, determine the optimum data combinations to study biogeophysical changes in the forest, assess the best way to visualize the results, and validate the models for the forest response to different radar wavelengths/polarizations. During the 1990's, unprecedented amounts of high-resolution images from space of the Earth's surface will become available to the applications scientist from the LANDSAT/TM series, European and Japanese ERS-1 satellites, RADARSAT and SIR-C missions. When the Earth Observation Systems (EOS) program is operational, the amount of data available for a particular site can only increase. The interdisciplinary scientist, seeking to use data from various sensors to study his site of interest, may be faced with massive difficulties in manipulating such large data sets, assessing their information content, determining the optimum combinations of data to study a particular parameter, visualizing his results and validating his model of the surface. The techniques to deal with these problems are also needed to support the analysis of data from NASA's current program of Multi-sensor Airborne Campaigns, which will also generate large volumes of data. In the Case Studies outlined in this proposal, we will have somewhat unique data sets. For the Bonanza Creek Experimental Forest (Case 1) calibrated DC-8 SAR (Synthetic Aperture Radar) data and extensive ground truth measurement are already at our disposal. The data set shows documented evidence to temporal change. The Belize Forest Experiment (Case 2) will produce calibrated DC-8 SAR and AVIRIS data, together with extensive measurements on the tropical rain forest itself. The extreme range of these sites, one an Arctic forest, the other a tropical rain forest, has been deliberately chosen to find common problems which can lead to generalized observations and unique problems with data which raise issues for the EOS System.

Freeman, Anthony↗

All-sky Search for Transient Astrophysical Neutrino Emission with 10 Years of IceCube Cascade Events

Abstract Neutrino flares in the sky are searched for in data collected by IceCube between 2011 and 2021 May. This data set contains cascade-like events originating from charged-current electron neutrino and tau neutrino interactions and all-flavor neutral-current interactions. IceCube’s previous all-sky searches for neutrino flares used data sets consisting of track-like events originating from charged-current muon neutrino interactions. The cascade data set is statistically independent of the track data sets, and while inferior in angular resolution, the low-background nature makes it competitive and complementary to previous searches. No statistically significant flare of neutrino emission was observed in an all-sky scan. Upper limits are calculated on neutrino flares of varying duration from 1 hr to 100 days. Furthermore, constraints on the contribution of these flares to the diffuse astrophysical neutrino flux are presented, showing that multiple unresolved transient sources may contribute to the diffuse astrophysical neutrino flux.

79 ASTRONOMY AND ASTROPHYSICS↗

Algorithm Derives Rules From Data

Set of best rules based on quantitative measure. ITRULE (Information Theoretic RULE induction) algorithm induces rules from examples in data base. Algorithm not only learns rules for given concept (classification) but also simultaneously learns rules relating multiple concepts.

Smyth, Padhraic J.↗

Famine Early Warning Systems Network (FEWS NET) Land Data Assimilation System (LDAS) and Other Assimilated Hydrological Data at NASA GES DISC

The NASA Goddard Earth Sciences Data and Information Services Center (GES DISC) provides science support for several data sets relevant to agriculture and food security, including the Famine Early Warning Systems Network (FEWS NET) Land Data Assimilation System (LDAS), or FLDAS data set. The GES DISC is one of twelve NASA Earth Observing System (EOS) data centers that process, archive, document, and distribute data from Earth science missions and related projects. The GES DISC hosts a wide range of remote sensing and model data, and provides reliable and robust data access and other services to users worldwide. Beyond data archive and access, the GES DISC offers many services to visualize and analyze the data. This presentation provides a summary of the hydrological data available at the GES DISC, along with an overview of related data services. Specifically, the FLDAS data set has been adapted to work with domains, data streams, and monitoring and forecast requirements associated with food security assessment in data-sparse, developing country settings. The FLDAS global monthly data have a 0.1 x 0.1 degree spatial resolution covering the period from January 1982 to present. Global FLDAS monthly anomaly and monthly climatology data are also available at the GES DISC to evaluate how current conditions compare to averages over the FLDAS 35-year period. Several case studies using the FLDAS soil moisture, evapotranspiration, rainfall, runoff, and surface temperature data will be presented.

Loeser, Carlee↗

Deriving earth science products from SSM/I

A few of the major accomplishments during the second phase include: (1) all three Special Sensor Microwave Imagers (SSM/I's: F08, F10, and F11) have been cross-calibrated; (2) a very large, quality-controlled, collocated SSM/I and radiosonde data set has been produced; (3) the SSM/I-radiosonde and SSM/I-buoy data sets have been used to calibrate the SSM/I ocean retrieval algorithm; (4) ocean products have been produced for both F10 and F11 SSM/I for 1991-1993; (5) the SSM/I-buoy data set was used to better determine the variation of the ocean T(sub B) with wind direction; and (6) it was demonstrated that under high wind conditions, wind direction information can be obtained from individual SSM/I observations.

Wentz, Frank J.↗

Measurements of the 27 Al(α,n) Thick Target Yield near Threshold

In this work, we present results from direct measurements of the 27 Al(α,n) thick-target yield from laboratory incident energies E α ≈ 3 to 5 MeV, performed with the 3 HeBF 3 Giant Barrel (HeBGB) neutron detector at the Edwards Accelerator Laboratory. Our measurements have a small energy cadence in order to address discrepancies and sparseness of thick-target-yield data sets existing for this energy region. We find general agreement with existing data sets, including yields derived from cross-section data, while resolving a discrepancy between existing thick-target-yield data sets for E α ≈ 4–5 MeV. However, for E α < 3.5 MeV, our results are substantially lower than previous thick-target-yield data and somewhat larger than yields calculated from existing cross-section data. Our data complete the energy range needed for estimates of the 27 Al(α,n) contribution to neutrino and dark matter detector backgrounds and result in increased viability of 27 Al(α,n) as a plasma diagnostic tool at fusion facilities such as the National Ignition Facility.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Choosing Meteorological Input for the Global Modeling Initiative Assessment of High Speed Aircraft

The Global Modeling Initiative (GMI) science team is developing a three dimensional chemistry and transport model (CTM) to be used in assessment of the atmospheric effects of aviation. Requirements are that this model be documented, be validated against observations, use a realistic atmospheric circulation, and contain numerical transport and photochemical modules representing atmospheric processes. The model must also retain computational efficiency to be tractable to use for multiple scenarios and sensitivity studies. To meet these requirements, a facility model concept was developed in which the different components of the CTM are evaluated separately. The first use of the GMI model will be to evaluate the impact of the exhaust of supersonic aircraft on the stratosphere. The assessment calculations will depend strongly on the wind and temperature fields used by the CTM. Three meteorological data sets for the stratosphere are available to GMI: the National Center for Atmospheric Research Community Climate Model (CCM2), the Goddard Earth Observing System Data Assimilation System (GEOS DAS), and the Goddard Institute for Space Studies general circulation model (GISS). Objective criteria were established by the GMI team to identify the data set which provides the best representation of the stratosphere. Simulations of gases with simple chemical control were chosen to test various aspects of model transport. The three meteorological data sets were evaluated and graded based on their ability to simulate these aspects of stratospheric measurements. This paper describes the criteria used in grading the meteorological fields. The meteorological data set which has the highest score and therefore was selected for GMI is CCM2. This type of objective model evaluation establishes a physical basis for interpretation of differences between models and observations. Further, the method provides a quantitative basis for defining model errors, for discriminating between different models, and for ready re-evaluation of improved models. These in turn will lead to a higher level of confidence in assessment calculations.

Douglas, A. R.↗

Choosing Meteorological Input for the Global Modeling Initiative Assessment of High Speed Aircraft

The Global Modeling Initiative (GMI) science team is developing a three dimensional chemistry and transport model (CTM) to be used in assessment of the atmospheric effects of aviation. Requirements are that this model be documented be validated against observations, use a realistic atmospheric circulation, and contain numerical transport and photochemical modules representing atmospheric processes. The model must also retain computational efficiency to be tractable to use for multiple scenarios and sensitivity studies. To meet these requirements, a facility model concept was developed in which the different components of the CTM are evaluated separately. The first use of the GMI model will be to evaluate the impact of the exhaust of supersonic aircraft on the stratosphere. The assessment calculations will depend strongly on the wind and temperature fields used by the CTM. Three meteorological data sets for the stratosphere are available to GMI: the National Center for Atmospheric Research Community Climate Model (CCM2), the Goddard Earth Observing System Data Assimilation System (GEOS DAS), and the Goddard Institute for Space Studies general circulation model (GISS). Objective criteria were established by the GMI team to identify the data set which provides the best representation of the stratosphere. Simulations of gases with simple chemical control were chosen to test various aspects of model transport. The three meteorological data sets were evaluated and graded based on their ability to simulate these aspects of stratospheric measurements. This paper describes the criteria used in grading the meteorological fields. The meteorological data set which has the highest score and therefore was selected for GMI is CCM2. This type of objective model evaluation establishes a physical basis for interpretation of differences between models and observations. Further, the method provides a quantitative basis for defining model errors, for discriminating between different models, and for ready re-evaluation of improved models. These in turn will lead to a higher level of confidence in assessment calculations.

Douglass, A. R.↗