Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Real Data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,783 records · Page 99

MLtool: Universal Supervised Machine Learning Tool to Model Tabulated Data

Machine Learning (ML) is a subfield of Artificial Intelligence that gives computers the ability to learn from past data without being explicitly programmed. The predictive capabilities of ML models have already been used to facilitate several scientific breakthroughs. However, the practical application of ML is often limited due to the gaps in technical knowledge of its users. The common issue faced by many scientific researchers is the inability to choose the appropriate ML pipelines that are needed to treat real-world data, which is often sparse and noisy. To solve this problem, we have developed an automated Machine Learning tool (MLtool) that includes a set of ML algorithms and approaches to aid scientific researchers. The current version of MLtool is implemented as an object-oriented Python code that is easily extensible. It includes 44 different regression algorithms used to model data. MLtool helps users select the best model for their data, based on the scoring metrics used. Besides regression algorithms, MLtool also includes a suite of pre- and post-processing techniques such as missing value imputation, categorical variable encoding, input feature normalization, uncertainty quantification, exploratory data analysis (EDA), etc. MLtool was tested on several publicly available multi-dimensional data sets and was found capable of making accurate predictions.

Machine learning↗

MLtool Python Code

Machine Learning (ML) is a subfield of Artificial Intelligence that gives computers the ability to learn from past data without being explicitly programmed. The predictive capabilities of ML models have already been used to facilitate several scientific breakthroughs. However, the practical application of ML is often limited due to the gaps in technical knowledge of its users. The common issue faced by many scientific researchers is the inability to choose the appropriate ML pipelines that are needed to treat real-world data, which is often sparse and noisy. To solve this problem, we have developed an automated Machine Learning tool (MLtool) that includes a set of ML algorithms and approaches to aid scientific researchers. The current version of MLtool is implemented as an object-oriented Python code that is easily extensible. It includes 44 different regression algorithms used to model data. MLtool helps users select the best model for their data, based on the scoring metrics used. Besides regression algorithms, MLtool also includes a suite of pre- and post-processing techniques such as missing value imputation, categorical variable encoding, input feature normalization, uncertainty quantification, exploratory data analysis (EDA), etc. MLtool was tested on several publicly available multi-dimensional data sets and was found capable of making accurate predictions.

Machine Learning↗

TU-FG-BRB-06: A Prompt Gamma-Ray Spectroscopy System for Clinical Studies of in Vivo Proton Range Verification

Purpose: We present a new system to perform prompt gamma-ray spectroscopy during proton pencil-beam scanning treatments, which enables in vivo verification of the proton range. This system will be used for the first clinical studies of this technology. Methods: After successful pre-clinical testing of prompt gamma-ray spectroscopy, a full scale system for clinical studies is now being assembled. Prompt gamma-rays will be detected during patient treatment using an array of 8 detector modules arranged behind a tungsten collimator. Each detector module consists of a lanthanum(III) bromide scintillator, a photomultiplier tube, and custom electronics for stable high voltage supply and signal amplification. A new real-time data acquisition and control system samples the signals from the detectors with analog-to-digital converters, analyses events of interest, and communicates with the beam delivery systems. The timing of the detected events was synchronized to the cyclotron radiofrequency and the pencil-beam delivery. Range verification is performed by matching measured energy- and timeresolved gamma-ray spectra to nuclear reaction models based on the clinical treatment plan. Experiments in phantoms were performed using clinical beams in order to assess the performance of the systems. Results: The experiments showed reliable real-time analysis of more than 10 million detector events per second. The individual detector modules acquired accurate energy- and time-resolved gamma-ray measurements at a rate of 1 million events per second, which is typical for beams delivered with a clinical dose rate. The data acquisition system successfully tracked the delivery of the scanned pencil-beams to determine the location of range deviations within the treatment field. Conclusion: A clinical system for proton range verification using prompt gamma-ray spectroscopy has been designed and is being prepared for use during patient treatments. We anticipate to start a first clinical study in the near future. This work was supported by the Federal Share of program income earned by Massachusetts; General Hospital on C06-CA059267, Proton Therapy Research and Treatment Center.

60 APPLIED LIFE SCIENCES↗

Synthetic galaxy clusters and observations based on Dark Energy Survey Year 3 Data

ABSTRACT We develop a novel data-driven method for generating synthetic optical observations of galaxy clusters. In cluster weak lensing, the interplay between analysis choices and systematic effects related to source galaxy selection, shape measurement, and photometric redshift estimation can be best characterized in end-to-end tests going from mock observations to recovered cluster masses. To create such test scenarios, we measure and model the photometric properties of galaxy clusters and their sky environments from the Dark Energy Survey Year 3 (DES Y3) data in two bins of cluster richness $\lambda \in [30; 45)$, $\lambda \in [45; 60)$ and three bins in cluster redshift ($z\in [0.3; 0.35)$, $z\in [0.45; 0.5)$ and $z\in [0.6; 0.65)$. Using deep-field imaging data, we extrapolate galaxy populations beyond the limiting magnitude of DES Y3 and calculate the properties of cluster member galaxies via statistical background subtraction. We construct mock galaxy clusters as random draws from a distribution function, and render mock clusters and line-of-sight catalogues into synthetic images in the same format as actual survey observations. Synthetic galaxy clusters are generated from real observational data, and thus are independent from the assumptions inherent to cosmological simulations. The recipe can be straightforwardly modified to incorporate extra information, and correct for survey incompleteness. New realizations of synthetic clusters can be created at minimal cost, which will allow future analyses to generate the large number of images needed to characterize systematic uncertainties in cluster mass measurements.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Load Profile Inpainting for Missing Load Data Restoration and Baseline Estimation

This paper introduces a Generative Adversarial Nets (GAN) based, Load Profile Inpainting Network (Load-PIN) for restoring missing load data segments and estimating the baseline for a demand response event. The inputs are time series load data before and after the inpainting period together with explanatory variables (e.g., weather data). Here, we propose a Generator structure consisting of a coarse network and a fine-tuning network. The coarse network provides an initial estimation of the data segment in the inpainting period. The fine-tuning network consists of self-attention blocks and gated convolution layers for adjusting the initial estimations. Loss functions are specially designed for the fine-tuning and the discriminator networks to enhance both the point-to-point accuracy and realisticness of the results. We test the Load-PIN on three real-world data sets for two applications: patching missing data and deriving baselines of conservation voltage reduction (CVR) events. We benchmark the performance of Load-PIN with five existing deep-learning methods. Our simulation results show that, compared with the state-of-the-art methods, Load-PIN can handle varying-length missing data events and achieve 15-30% accuracy improvement.

14 SOLAR ENERGY↗

Determination of airplane model structure from flight data by using modified stepwise regression

The linear and stepwise regressions are briefly introduced, then the problem of determining airplane model structure is addressed. The MSR was constructed to force a linear model for the aerodynamic coefficient first, then add significant nonlinear terms and delete nonsignificant terms from the model. In addition to the statistical criteria in the stepwise regression, the prediction sum of squares (PRESS) criterion and the analysis of residuals were examined for the selection of an adequate model. The procedure is used in examples with simulated and real flight data. It is shown that the MSR performs better than the ordinary stepwise regression and that the technique can also be applied to the large amplitude maneuvers.

Klein, V.↗

Fast, efficient lossless data compression

This paper presents lossless data compression and decompression algorithms which can be easily implemented in software. The algorithms can be partitioned into their fundamental parts which can be implemented at various stages within a data acquisition system. This allows for efficient integration of these functions into systems at the stage where they are most applicable. The algorithms were coded in Forth to run on a Silicon Composers Single Board Computer (SBC) using the Harris RTX2000 Forth processor. The algorithms require very few system resources and operate very fast. The performance of the algorithms with the RTX enables real time data compression and decompression to be implemented for a wide range of applications.

Ross, Douglas↗

A COUPLED 2 × 2D BABCOCK–LEIGHTON SOLAR DYNAMO MODEL. I. SURFACE MAGNETIC FLUX EVOLUTION

The need for reliable predictions of the solar activity cycle motivates the development of dynamo models incorporating a representation of surface processes sufficiently detailed to allow assimilation of magnetographic data. In this series of papers we present one such dynamo model, and document its behavior and properties. This first paper focuses on one of the model’s key components, namely surface magnetic flux evolution. Using a genetic algorithm, we obtain best-fit parameters of the transport model by least-squares minimization of the differences between the associated synthetic synoptic magnetogram and real magnetographic data for activity cycle 21. Our fitting procedure also returns Monte Carlo-like error estimates. We show that the range of acceptable surface meridional flow profiles is in good agreement with Doppler measurements, even though the latter are not used in the fitting process. Using a synthetic database of bipolar magnetic region (BMR) emergences reproducing the statistical properties of observed emergences, we also ascertain the sensitivity of global cycle properties, such as the strength of the dipole moment and timing of polarity reversal, to distinct realizations of BMR emergence, and on this basis argue that this stochasticity represents a primary source of uncertainty for predicting solar cycle characteristics.

79 ASTRONOMY AND ASTROPHYSICS↗

A Novel Sparse Compositional Technique Reveals Microbial Perturbations

ABSTRACT The central aims of many host or environmental microbiome studies are to elucidate factors associated with microbial community compositions and to relate microbial features to outcomes. However, these aims are often complicated by difficulties stemming from high-dimensionality, non-normality, sparsity, and the compositional nature of microbiome data sets. A key tool in microbiome analysis is beta diversity, defined by the distances between microbial samples. Many different distance metrics have been proposed, all with varying discriminatory power on data with differing characteristics. Here, we propose a compositional beta diversity metric rooted in a centered log-ratio transformation and matrix completion called robust Aitchison PCA. We demonstrate the benefits of compositional transformations upstream of beta diversity calculations through simulations. Additionally, we demonstrate improved effect size, classification accuracy, and robustness to sequencing depth over the current methods on several decreased sample subsets of real microbiome data sets. Finally, we highlight the ability of this new beta diversity metric to retain the feature loadings linked to sample ordinations revealing salient intercommunity niche feature importance. IMPORTANCE By accounting for the sparse compositional nature of microbiome data sets, robust Aitchison PCA can yield high discriminatory power and salient feature ranking between microbial niches. The software to perform this analysis is available under an open-source license and can be obtained at https://github.com/biocore/DEICODE ; additionally, a QIIME 2 plugin is provided to perform this analysis at https://library.qiime2.org/plugins/q2-deicode .

59 BASIC BIOLOGICAL SCIENCES↗

NASA's Fire Information for Resource Management System (FIRMS): Near Real-Time Global Fire Monitoring Using Data from MODIS and VIIRS

NASA's Fire Information for Resource Management System (FIRMS) provides near-real time active fire / hotspot products from MODIS and VIIRS to users in over 160 countries. The goal of FIRMS is to meet the needs of natural resource and protected area managers that face considerable challenges in obtaining timely satellite-derived information on fires burning within and around their management area. FIRMS has been reliably providing active fire / hotspot data in easy to use formats since its inception in 2006. Fire information is provided through a web map interface, email alerts, a web mapping service, and a range of downloadable files (SHP, CSV, KML and JSON). FIRMS data are used directly by end users and by brokers who take the data and add value to it before re-distributing it.FIRMS was initially developed by the University of Maryland in 2006; it was funded by the United Nations FAO and NASA's Applied sciences program under a NASA ROSES call. In 2012 FIRMS became integrated in to NASA's Land Atmosphere Near real-time Capability for EOS (LANCE); a virtual system that leverages NASAs existing science processing capabilities to deliver NRT data from ten instruments within 3 hours of satellite overpass. This presentation will describe the FIRMS system, provide an overview of the system, briefly describe some of the known applications and describe plans to further integrate the data in to NASA's Global Imagery Browse Services (GIBS) public mapping services and Worldview website.

active fire/hotspots↗

The voltage threshold for arcing for solar cells in LEO: Flight and ground test results

Ground and flight results of solar cell arcing in low Earth orbit (LEO) conditions are compared and interpreted. It is shown that an apparent voltage threshold for arcing may be produced by a strong power law dependence of arc rate on voltage, combined with a limited observation time. The change in this apparent threshold with plasma density is a reflection of the density dependence of the arc rate. A nearly linear dependence of arc rate on density is inferred from the data. A real voltage threshold for arcing for 2 by 2 cm solar cells may exist however, independent of plasma density, near -230 V relative to the plasma. Here, arc rates may change by more than an order of magnitude for a change of only 30 V in array potential. For 5.9 by 5.9 solar cells, the voltage dependence of the arc rate is steeper, and the data are insufficient to indicate the existence of an arcing increased by an atomic oxygen plasma, as is found in LEO, and by arcing from the backs of welded-through substrates.

Ferguson, D. C.↗

The voltage threshold for arcing for solar cells in Leo - Flight and ground test results

Ground and flight results of solar cell arcing in low earth orbit (LEO) conditions are compared and interpreted. It is shown that an apparent voltage threshold for arcing may be produced by a storage power law dependence of arc rate on voltage, combined with a limited observation time. The change in this apparent threshold with plasma density is a reflection of the density dependence of the arc rate. A nearly linear dependence of arc rate on density is inferred from the data. A real voltage threshold for arcing for 2 by 2 cm solar cells may exist however, independent of plasma density, near -230 V relative to the plasma. Here, arc rates may change by more than an order of magnitude for a change of only 30 V in array potential. For 5.9 by 5.9 solar cells, the voltage dependence of the arc rate is steeper, and the data are insufficient to indicate the existence of an arcing increased by an atomic oxygen plasma, as is found in LEO, and by arcing from the backs of welded-through substrates.

Ferguson, Dale C.↗

Radiation Dosimetry Experiment (RaD-X): High-Altitude Balloon Flight Mission for Improving the NAIRAS Model

The NASA Radiation Dosimetry Experiment (RaD-X) high-altitude balloon mission was successfully launched from Fort Sumner, New Mexico USA on 25 September, 2015. Over 15 hours of science data were obtained from four dosimeters at altitudes above about 25 km. One of the main goals of the RaD-X mission is to improve aviation radiation model characterization of cosmic ray primaries by taking dosimetric measurements above the Pfotzer maximum before the production of secondary particles occurs. The second goal of the RaD-X mission is to facilitate the pathway toward real-time, data assimilative predictions of atmospheric cosmic radiation exposure by identifying and characterizing low-cost radiation measurement solutions.

Mertens, Christopher J.↗

Simulation studies of the impact of future observing systems on weather prediction

The features and preliminary results from a simulation system being implemented to develop realistic estimates of the impacts future data acquisition systems will have on large-scale numerical weather simulation are described. The new instruments may include advanced passive IR and microwave satellite sensors, as well as active scatterometer and lidar sounders. A main goal of the impact study is to identify those sensor systems which will provide the most benefit. The realism of the study is being enhanced by assimilating as much real-world data as possible and generating global weather maps for comparison with maps generated on the bases on the projected new, higher resolution data. Early results have indicated a preference for higher resolution wind data than for temperature data for making 1-5 day forecasts. The prime instrument candidate for collecting the data is lidar, provided the sensor resolution design goals are met.

Atlas, R.↗

GraphPrints: Towards a Graph Analytic Method for Network Anomaly Detection

This paper introduces a novel graph-analytic approach for detecting anomalies in network flow data called \textit{GraphPrints}. Building on foundational network-mining techniques, our method represents time slices of traffic as a graph, then counts graphlets\textemdash small induced subgraphs that describe local topology. By performing outlier detection on the sequence of graphlet counts, anomalous intervals of traffic are identified, and furthermore, individual IPs experiencing abnormal behavior are singled-out. Initial testing of GraphPrints is performed on real network data with an implanted anomaly. Evaluation shows false positive rates bounded by 2.84\% at the time-interval level, and 0.05\% at the IP-level with 100\% true positive rates at both.

anomaly detection↗

Data Assimilation for Robust UQ Within Agent-Based Simulation on HPC Systems

Agent-based simulation provides a powerful tool for in silico system modeling. However, these simulations do not provide built-in methods for uncertainty quantification (UQ). Within these types of models a typical approach to UQ is to run multiple realizations of the model then compute aggregate statistics. This approach is limited due to the compute time required for a solution. When faced with an emerging biothreat, public health decisions need to be made quickly and solutions for integrating near real-time data with analytic tools are needed. We propose an integrated Bayesian UQ framework for agent-based models based on sequential Monte Carlo sampling. Given streaming or static data about the evolution of an emerging pathogen this Bayesian framework provides a distribution over the parameters governing the spread of a disease through a population. These estimates of the spread of a disease may be provided to public health agencies seeking to abate the spread. By coupling agent-based simulations with Bayesian modeling in a data assimilation, our proposed framework provides a powerful tool for modeling dynamical systems in silico. We propose a method which reduces model error and provides a range of realistic possible outcomes. Moreover, our method addresses two primary limitations of ABMs: the lack of UQ and an inability to assimilate data. Our proposed framework combines the flexibility of an agent-based model with UQ provided by the Bayesian paradigm in a workflow which scales well to HPC systems. We provide algorithmic details and results on a simulated outbreak with both static and streaming data.

Spannaus, Adam [ORNL] (ORCID:0000000225213657)↗

A Nonparametric Bayesian Framework for Short-Term Wind Power Probabilistic Forecast

To improve the energy system resilience and economic efficiency, the wind power as a renewable energy starts to be deeply integrated into smart power grids. However, the wind power forecast uncertainty brings operational challenges. In order to provide a reliable guidance on operational decisions, in this paper, we propose a short-term wind power probabilistic forecast. Specifically, to model the rich dynamic behaviors of underlying physical wind power stochastic process occurring in various meteorological conditions, we first introduce an infinite Markov switching autoregressive model. This nonparametric time series model can capture the important properties in the real world data to improve the prediction accuracy. Then, given finite historical data, the posterior distribution of flexible forecast model can correctly quantify the model estimation uncertainty. Built on it, we develop the posterior predictive distribution to rigorously quantify the overall forecasting uncertainty accounting for both inherent stochastic uncertainty and model estimation error. Furthermore, the proposed approach can provide accurate and reliable short-term wind power probabilistic forecast, which can be used to support smart power grids real-time risk management.

17 WIND ENERGY↗

Sea surface determination from space: The GSFC geoid

The determination of the sea surface/geoid and its relative variation were investigated and results of the altimeter experiment on Skylab to test the geoid are discussed. The spaceborne altimeter on Skylab revealed that the sea surface of the world's oceans can be measured with an accuracy in the meter range. Surface variations are discussed as they relate to those computed from satellite orbital dynamics and ground based gravity data. The GSFC geoid was constructed from about 400,000 satellite tracking data (range, range rate, angles) and about 20,000 ground gravity observations. One of the last experiments on Skylab was to measure and/or test this geoid over almost one orbit. It was found that the computed water surface deviates between 5 to 20 m from the measured one. Further outlined are the influence of orbital errors on the sea surface, and numerical examples are given based upon real tracking data. Orbital height error estimates were computed for geodetic type satellites and are found to be in the order of 0.2 to 5 meters.

Vonbun, F. O.↗