Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data Distribution”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,045 records · Page 58

Comparison of CO2 Lidar Backscatter with Particle Size Distribution and GOES-7 Data in Hurricane Juliette

Backscatter measurements using 9.1 and 10.6 micron continuous wave lidars were obtained along with particle size distributions in 1995 Hurricane Juliette at altitude approximately 11.7 km. Agreement between lidar backscatter and cloud particle size distribution was excellent. Measurements also correlated well with concurrent GOES-7 infrared images of cloud top height.

Jarzembski, Maurice↗

CODAS Data from Oliktok Point, Beaufort Sea, Alaska

Cryosphere/Ocean Distributed Acoustic Sensing (CODAS) data collected from the Beaufort Sea, Alaska, using ~37.4 km of dark telecommunications fiber located at Oliktok Point, Alaska. Data were collected with a Silixa iDAS, using 10 m gauge length, 2 m spatial resolution, and 1000 Hz sample rate. Provided here are the DAS-recorded time series for the rapid refreeze event described in Baker & Abbott (2022) (see link below). This covers a date range of 2021-11-10 15:00 UTC to 2021-11-11 17:00 UTC. Data have been decimated to 100 Hz and 20 m (i.e., every 10th channel for 1831 channels, total), as used in Baker & Abbott (2022). Data have been extracted from raw format into 1-hour long .sac* files and organized into directories by channel number, spanning channels 100 to 18400. Time series units are nano-strainrate (nm/m/s). For distribution, data have been compressed into .zip files containing all time series files for 100 channels. *For information on the Seismic Analysis Code (SAC) file format: https://seiscode.iris.washington.edu/projects/sac

16 TIDAL AND WAVE POWER↗

Program for Weibull Analysis of Fatigue Data

A Fortran computer program has been written for performing statistical analyses of fatigue-test data that are assumed to be adequately represented by a two-parameter Weibull distribution. This program calculates the following: (1) Maximum-likelihood estimates of the Weibull distribution; (2) Data for contour plots of relative likelihood for two parameters; (3) Data for contour plots of joint confidence regions; (4) Data for the profile likelihood of the Weibull-distribution parameters; (5) Data for the profile likelihood of any percentile of the distribution; and (6) Likelihood-based confidence intervals for parameters and/or percentiles of the distribution. The program can account for tests that are suspended without failure (the statistical term for such suspension of tests is "censoring"). The analytical approach followed in this program for the software is valid for type-I censoring, which is the removal of unfailed units at pre-specified times. Confidence regions and intervals are calculated by use of the likelihood-ratio method.

Krantz, Timothy L.↗

Models, data, and scripts associated with “Prediction of Distributed River Sediment Respiration Rates using Community-Generated Data and Machine Learning”

This data package is associated with the publication “Prediction of Distributed River Sediment Respiration Rates using Community-Generated Data and Machine Learning’’ submitted to the Journal of Geophysical Research: Machine Learning and Computation (Scheibe et al. 2024). River sediment respiration observations are expensive and labor intensive to obtain and there is no physical model for predicting this quantity. The Worldwide Hydrobiogeochemisty Observation Network for Dynamic River Systems (WHONDRS) observational data set (Goldman et al.; 2020) is used to train machine learning (ML) models to predict respiration rates at unsampled sites. This repository archives training data, ML models, predictions, and model evaluation results for the purposes of reproducibility of the results in the associated manuscript and community reuse of the ML models trained in this project. One of the key challenges in this work was to find an optimum configuration for machine learning models to work with this feature-rich (i.e. 100+ possible input variables) data set. Here, we used a two-tiered approach to managing the analysis of this complex data set: 1) a stacked ensemble of ML models that can automatically optimize hyperparameters to accelerate the process of model selection and tuning and 2) feature permutation importance to iteratively select the most important features (i.e. inputs) to the ML models. The major elements of this ML workflow are modular, portable, open, and cloud-based, thus making this implementation a potential template for other applications. This data package is associated with the GitHub repository found at Please see the file level metadata (flmd; “sl-archive-whondrs_flmd.csv”) for a list of all files contained in this data package and descriptions for each. Please see the data dictionary (dd; “sl-archive-whondrs_dd.csv”) for a list of all column headers contained within comma separated value (csv) files in this data package and descriptions for each. The GitHub repository is organized into five top-level directories: (1) “input_data” holds the training data for the ML models; (2) “ml_models” holds machine learning models trained on the data in “input_data”; (3) “scripts” contains data preprocessing and postprocessing scripts and intermediate results specific to this data set that bookend the ML workflow; (4) “examples” contains the visualization of the results in this repository including plotting scripts for the manuscript (e.g., model evaluation, FPI results) and scripts for running predictions with the ML models (i.e., reusing the trained ML models); (5) “output_data” holds the overall results of the ML model on that branch. Each trained ML model resides on its own branch in the repository; this means that inputs and outputs can be different branch-to-branch. Furthermore, depending on the number of features used to train the ML models, the preprocessing and postprocessing scripts, and their intermediate results, can also be different branch-to-branch. The “main-*” branches are meant to be starting points (i.e. trunks) for each model branch (i.e. sprouts). Please see the Branch Navigation section in the top-level README.md in the GitHub repository for more details. There is also one hidden directory “.github/workflows”. This hidden directory contains information for how to run the ML workflow as an end-to-end automated GitHub Action but it is not needed for reusing the ML models archived here. Please the top-level README.md in the GitHub repository for more details on the automation.

13C↗

Detection of Stealthy False Data Injection Attacks in Unobservable Distribution Networks

In this paper, a composite scheme is proposed for detecting stealthy data manipulation attacks on distribution system which is unobservable with standard least squares based state estimators. This technique has three stages where the process of data imputation, voltage phasor estimation and the bad data detection are carried out in a systematic manner. The proposed approach is then integrated with moving target defense strategies which perturbs the network parameters to reveal stealthy false data injection attacks. The proposed approach is tested is validated on a three-phase, unbalanced 37-node distribution system and its results are presented. It is shown that the proposed approach has the ability to accurately detect the presence of FDI attacks using limited measurements (i.e., the test system is unobservable).

Rajasekaran, James K.↗

KDD Services at the Goddard Earth Sciences Distributed Active Archive Center

NASA's Goddard Earth Sciences Distributed Active Archive Center (GES DAAC) processes, stores and distributes earth science data from a variety of remote sensing satellites. End users of the data range from instrument scientists to global change and climate researchers to federal agencies and foreign governments. Many of these users apply data mining techniques to large volumes of data (up to 1 TB) received from the GES DAAC. However, rapid advances in processing power are enabling increases in data processing that are outpacing tape drive performance and network capacity. As a result, the proportion of data that can be distributed to users continues to decrease. As mitigation, we are migrating more data mining and mining preparation activities into the data center in order to reduce the data volume that needs to be distributed and to offer the users a more useful and manageable product. This migration of activities faces a number of technical and human-factor challenges. As data reduction and mining algorithms are normally quite specific to the user's research needs, the user's algorithm must be integrated virtually unchanged into the archive environment. Also, the archive itself is busy with everyday data archive and distribution activities and cannot be dedicated to, or even impacted by, the mining activities. Therefore, we schedule KDD 'campaigns' (similar to reprocessing campaigns), during which we schedule a wholesale retrieval of specific data products, offering users the opportunity to extract information from the data being retrieved during the campaign.

Lynnes, Christopher↗

Space platform utilities distribution study

Generic concepts for the installation of power data and thermal fluid distribution lines on large space platforms were discussed. Connections with central utility subsystem modules and pallet interfaces were also considered. Three system concept study platforms were used as basepoints for the detail development. The tradeoff of high voltage low voltage power distribution and the impact of fiber optics as a data distribution mechanism were analyzed. Thermal expansion and temperature control of utility lines and ducts were considered. Technology developments required for implementation of the generic distribution concepts were identified.

Lefever, A. E.↗

Development of the Ames Global Hyperspectral Synthetic Data Set: Surface Bidirectional Reflectance Distribution Function

This study introduces the Ames Global Hyperspectral Synthetic Data set (AGHSD), in particular the surface bidirectional reflectance distribution function (BRDF) product, to support the NASA Surface Biology and Geology (SBG) mission development. The data set is generated based on the corresponding multispectral BRDF products from NASA's MODIS satellite sensor. Based on theories of radiative transfer in vegetation canopies, we derive a simple but robust relationship that indicates that the hyperspectral surface BRDF can be accurately approximated as a weighted sum of the soil surface reflectance, the leaf single albedo, and the canopy scattering coefficient, where the weights or coefficients are spectrally invariant and thus readily estimated from the multispectral MODIS products. We validate the algorithm with simulations by a Monte Carlo Ray Tracing model and find the results highly consistent with the theoretic derivation. Using reflectance spectra of soil and vegetation derived from existing spectral libraries, we apply the algorithm to generate the AGHSD BRDF product at 1 km and 8-day resolutions for the year of 2019. The data set is biogeochemically and biogeophysically coherent and consistent, and serves the goal to support the SBG community in developing sciences and applications for the future global imaging spectroscopy mission.

Hyperspectral Remote Sensing↗

Deriving representative size distributions from UW OPC data for SAGE II extinction measurements

For the purposes of studying the impacts of aerosols on the chemistry and climate of the atmosphere, size distribution information has been inferred from extinction measurements for decades. Using the measurements from the University of Wyoming balloon-borne optical particle counter experiment we have derived representative size distributions at SAGE II channel wavelengths. These are bimodal lognormal size distributions grouped into bins of 525 to 1020 nm extinction ratio. Future work will include expanding this analysis to SAGE III’s channels and considering the effect of a absorbing channel in the IR would have.

Aerosol↗

Deriving Representative Size Distributions From UW OPC Data for Sage II Extinction Measurements

For the purposes of studying the impacts of aerosols on the chemistry and climate of the atmosphere, size distribution information has been inferred from extinction measurements for decades. Using the measurements from the University of Wyoming balloon-borne optical particle counter experiment we have derived representative size distributions at SAGE II channel wavelengths. These are bimodal lognormal size distributions grouped into bins of 525 to 1020 nm extinction ratio. However there exists fundamental limitations to the information that can be derived from SAGE measurements. Future work will include expanding this analysis to SAGE III’s channels and considering the effect of a absorbing channel in the IR would have.

Aerosol↗

Deriving Representative Size Distributions From UW OPC Data for Sage II Extinction Measurements

For the purposes of studying the impacts of aerosols on the chemistry and climate of the atmosphere, size distribution information has been inferred from extinction measurements for decades. Using the measurements from the University of Wyoming balloon-borne optical particle counter experiment we have derived representative size distributions at SAGE II channel wavelengths. These are bimodal lognormal size distributions grouped into bins of 525 to 1020 nm extinction ratio. However there exists fundamental limitations to the information that can be derived from SAGE measurements. Future work will include expanding this analysis to SAGE III’s channels and considering the effect of a absorbing channel in the IR would have.

Aerosol↗

Deriving Representative Size Distributions From UW OPC Data for Sage II Extinction Measurements

For the purposes of studying the impacts of aerosols on the chemistry and climate of the atmosphere, size distribution information has been inferred from extinction measurements for decades. Using the measurements from the University of Wyoming balloon-borne optical particle counter experiment we have derived representative size distributions at SAGE II channel wavelengths. These are bimodal lognormal size distributions grouped into bins of 525 to 1020 nm extinction ratio. However there exists fundamental limitations to the information that can be derived from SAGE measurements

Atmospheric composition↗

Quantifying Distribution System Resilience From Utility Data: Large Event Risk and Benefits of Investments

We focus on blackouts in electric distribution systems that have a large cost to customers. To quantify resilience to these events, we show how to calculate risk metrics from the historical outage data routinely collected by utilities' outage management systems. Risk is defined using a customer cost exceedance curve. The exceedance curve has a heavy tail that implies large fluctuations in large blackout costs, and this makes estimating the mean large cost in the usual way impractical. To avoid this problem, we use new resilience metrics describing the large event risk; these metrics are the probability of a large cost event, the annual log cost resilience index, and the average of the logarithm of the cost of large-cost events or the slope magnitude of the tail on a log–log exceedance curve. Resilience can be improved by planned investments to upgrade system components or speed up restoration. The benefits that these investments would have had if they had been made in the past can be quantified by “rerunning history” with the effects of the investment included, and then recalculating the large event risk to find the improvement in resilience. An example using utility data shows a 2% reduction in the probability of a large cost event due to 10% wind hardening and 6%–7% reduction due to 10% faster restoration in two different areas of a distribution utility. This new data-driven approach to quantify resilience and resilience investments is realistic and much easier to apply than complicated approaches based on modeling all the phases of resilience. Moreover, an appeal to improvements to past lived experience may well be persuasive to customers and regulators in making the case for resilience investments.

24 POWER TRANSMISSION AND DISTRIBUTION↗

The Virtual Wave Observatory (VWO)

Heliophysics wave data are currently not easily searchable by computers, making identifying pertinent wave data features for analyses and cross comparisons difficult and laborious. Since wave data analysis requires specialized knowledge about waves, which spans the spectrum of microphysics to macrophysics, researchers having varied expertise cannot easily use wave data. To resolve these difficulties and to allow wave data to contribute more fully to Heliophysics research, we are developing a Virtual Wave Observatory (VWO) whose goal is to enable all Heliophysics wave data to become searchable, understandable and usable by the Heliophysics community. The VWO objective is to enable search of multiple and distributed wave data (from both active and passive measurements). This presentation provides and overview of the VWO, a new VxO component within the emerging distributed Heliophysics data and model environment.

Fung, Shing F.↗

The Airborne Visible/Infrared Imaging Spectrometer (AVIRIS)

AVIRIS is a facility consisting of a flight system, a ground data system, a calibration facility, and a full-time operations team. The facility was developed by JPL under funding from NASA. NASA also provides funding for operations and maintenance. The flight system is a whisk-broom imager that acquires data in 224 narrow, contiguous spectral bands covering the solar reflected portion of the electromagnetic spectrum. It is flown aboard the NASA high altitude ER-2 research aircraft. The ground data system is a facility dedicated to the processing and distribution of data acquired by AVIRIS. It operates year round at JPL. The calibration facility consists of a calibration laboratory at JPL and a suite of field instruments and procedures for performing inflight calibration of AVIRIS. A small team of engineers, technicians, and scientists supports a yearly operations schedule that includes 6 months of flight operations, 6 months of routine ground maintenance of the flight system, and year-round data processing and distribution. Details of the AVIRIS system, its performance history, and future plans are described.

Vane, Gregg↗

Flood Management Enhancement Using Remotely Sensed Data

SENTAR, Inc., entered into a cooperative agreement with NASA Goddard Space Flight Center (GSFC) in December 1994. The intent of the NASA Cooperative Agreement was to stimulate broad public use, via the Internet, of the very large remote sensing databases maintained by NASA and other agencies, thus stimulating U.S. economic growth, improving the quality of life, and contributing to the implementation of a National Information Infrastructure. SENTAR headed a team of collaborating organizations in meeting the goals of this project. SENTAR's teammates were the NASA Marshall Space Flight Center (MSFC) Global Hydrology and Climate Center (GHCC), the U.S. Army Space and Strategic Defense Command (USASSDC), and the Alabama Emergency Management Agency (EMA). For this cooperative agreement, SENTAR and its teammates accessed remotely sensed data in the Distributed Active Archive Centers, and other available sources, for use in enhancing the present capabilities for flood disaster management by the Alabama EMA. The project developed a prototype software system for addressing prediction, warning, and damage assessment for floods, though it currently focuses on assessment. The objectives of the prototype system were to demonstrate the added value of remote sensing data for emergency management operations during floods and the ability of the Internet to provide the primary communications medium for the system. To help achieve these objectives, SENTAR developed an integrated interface for the emergency operations staff to simplify acquiring and manipulating source data and data products for use in generating new data products. The prototype system establishes a systems infrastructure designed to expand to include future flood-related data and models or to include other disasters with their associated remote sensing data requirements and distributed data sources. This report covers the specific work performed during the seventh, and final, milestone period of the project, which began on 1 October 1996 and ended on 31 January 1997. In addition, it provides a summary of the entire project.

Romanowski, Gregory J.↗

Retrieval of aerosol size distribution moments from multiwavelength particulate extinction data

An iterative method for deriving the particle size distribution from multiwavelength satellite remote sensing data is presented and its use illustrated with an application to SAGE II data. The compression size distribution method (CSD) features interpolation and look-up features for relating the coefficients of a least-squares fit as a function of wavelength to parameters of the compression function that have been obtained by Mie calculations. Results are reported of comparisons between particulate radii predicted for the El Chichon volcano aerosol based on SAGE II data and 14 radii measured with NASA flights through the aerosol with aircraft carrying wire impactors.

Livingston, J. M.↗

A Metric to Quantify Shared Visual Attention in Two-Person Teams

Introduction: Critical tasks in high-risk environments are often performed by teams, the members of which must work together efficiently. In some situations, the team members may have to work together to solve a particular problem, while in others it may be better for them to divide the work into separate tasks that can be completed in parallel. We hypothesize that these two team strategies can be differentiated on the basis of shared visual attention, measured by gaze tracking. 2) Methods: Gaze recordings were obtained for two-person flight crews flying a high-fidelity simulator (Gontar, Hoermann, 2014). Gaze was categorized with respect to 12 areas of interest (AOIs). We used these data to construct time series of 12 dimensional vectors, with each vector component representing one of the AOIs. At each time step, each vector component was set to 0, except for the one corresponding to the currently fixated AOI, which was set to 1. This time series could then be averaged in time, with the averaging window time (t) as a variable parameter. For example, when we average with a t of one minute, each vector component represents the proportion of time that the corresponding AOI was fixated within the corresponding one minute interval. We then computed the Pearson product-moment correlation coefficient between the gaze proportion vectors for each of the two crew members, at each point in time, resulting in a signal representing the time-varying correlation between gaze behaviors. We determined criteria for concluding correlated gaze behavior using two methods: first, a permutation test was applied to the subjects' data. When one crew member's gaze proportion vector is correlated with a random time sample from the other crewmember's data, a distribution of correlation values is obtained that differs markedly from the distribution obtained from temporally aligned samples. In addition to validating that the gaze tracker was functioning reasonably well, this also allows us to compute probabilities of coordinated behavior for each value of the correlation. As an alternative, we also tabulated distributions of correlation coefficients for synthetic data sets, in which the behavior was modeled as a first-order Markov process, and compared correlation distributions for identical processes with those for disparate processes, allowing us to choose criteria and estimate error rates. 3) Discussion: Our method of gaze correlation is able to measure shared visual attention, and can distinguish between activities involving different instruments. We plan to analyze whether pilots strategies of sharing visual attention can predict performance. Possible measurements of performance include expert ratings from instructors, fuel consumption, total task time, and failure rate. While developed for two-person crews, our approach can be applied to larger groups, using intra-class correlation coefficients instead of the Pearson product-moment correlation.

Gontar, Patrick↗