SEARCH · Engineering Papers
Results for “data networks”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Development of a Convolutional Neural Network Classifier for Data Starved Spectra - 20199
The Institute for Clean Energy Technology (ICET) at Mississippi State University is exploring the utility of machine learning in augmenting its mobile radiation surveying platforms, which are currently being developed as means to survey depleted uranium contaminated areas in support of remediation and decommissioning efforts. Mobile survey platforms provide a means to efficiently scan large areas of interest while reducing human exposure to radiation and other hazards. The survey platforms can also be used for scanning for any gamma emitting isotope in addition to depleted uranium. The spectral data that the platforms collect may be data starved with relatively low counts and poorly defined spectral features depending on the speed of the platforms and scintillation detector selection. Such data-starved spectra are difficult to use for isotope identification, requiring advanced knowledge of the possible radionuclides that could be present and environmental factors that could attenuate signals or introduce background noise. These factors in combination with the volume of survey data increases the time it takes to perform analysis of survey data when the source type is unknown. There are a number of algorithms in the field of machine learning that can be used to classify data that would be challenging and time-consuming for a human to identify. Supervised machine learning algorithms train models based on extensive amounts of human-labeled training data. Once sufficiently trained, these models can be used to quickly make high-fidelity predictions on new data. Convolutional neural networks are machine learning algorithms that excel in learning representations of 'shapes'. They do this by taking numerical input data and convolving them with spatial feature detectors referred to as filters. These filters are incrementally adjusted to reduce the prediction error on the data during the backpropagation step of training. Discussed in this paper is the development of a convolutional neural network classifier (CNNC) that can utilize spectral survey data for source discrimination and isotope identification. Bench-top laboratory experiments data using LaBr{sub 3}(Ce) scintillation detectors were used to train and evaluate the performance of the developed CNNC. The CNNC is capable of discriminating a variety of gamma emitting source types, differentiating different forms of uranium (depleted vs. natural), and estimating the amount of uranium for a known geometry. The discussed CNNC may be useful in scenarios where survey systems are deployed in situations where hazardous radioactive material maybe present, but the type is unknown. When used in remediation applications the CNNC can be used to screen-out false positives, helping reduce remediation costs. (authors)
Albedo Data Sets for Bifacial PV Systems
For use by the PV and financial communities to better estimate the performance and to reduce the risk of bifacial PV systems, data sets of ground albedo and associated meteorological data were developed by using existing measurement network data and data contributed by the PV industry. The data sets include time-series data as well as summary information of tabular monthly and yearly data and plots of monthly and hourly albedo values. Complete information is presented in a user's guide and data are available for download from NREL's DuraMAT website.
Albedo Data for Bifacial PV Systems Update
For use by the PV and financial communities to better estimate the performance and to reduce the risk of bifacial PV systems, data sets of ground albedo and associated meteorological data were developed by using existing measurement network data and data contributed by the PV industry. The data sets include time-series data as well as summary information of tabular monthly and yearly data and plots of monthly and hourly albedo values. Complete information is presented in a user’s guide and data are available for download from NREL’s DuraMAT website.
Albedo Data Sets for Bifacial PV Systems: Preprint
For use by the PV and financial communities to better estimate the performance and to reduce the risk of bifacial PV systems, data sets of ground albedo and associated meteorological data were developed by using existing measurement network data and data contributed by the PV industry. The data sets include time-series data as well as summary information of tabular monthly and yearly data and plots of monthly and hourly albedo values. Complete information is presented in a user’s guide and data are available for download from NREL’s DuraMAT website.
Soil Water Content (m3 m-3) located in the Dominican Republic , February 2013 - December 2016
Daily data that has been processed to monthly. Data represents near-surface soil moisture (depth of 0-10 cm) at a latitude of 17.90 N, and longitude -71.67 E. Data was downloaded from the PBO soil moisture data network and is publicly available. Data from this site is referenced as Dominican Republic (2) in Table 1 and Figure 4 of Solander et al., 2020, The pan-tropical soil moisture response to El Nino, Hydrol. Earth Syst. Sci., in press.
Soil Water Content (m3 m-3) from the Dominican Republic, February 2013 - August 2017.
Daily data that has been processed to monthly. Data represents near-surface soil moisture (depth of 0-10 cm) at a latitude of 19.76 N, and longitude -70.57 E. Data was downloaded from the PBO soil moisture data network and is publicly available. Data from this site is referenced as Dominican Republic (1) in Table 1 and Figure 4 of Solander et al., 2020, The pan-tropical soil moisture response to El Nino, Hydrol. Earth Syst. Sci., in press.
Soil Water Content (m3 m-3) from Australia, June 2011 - December 2016
Hourly data processed to monthly. Data collected from Cosmic Neutron Probes at variable depth averaging 38 cm that was interpolated to near-surface (0-10 cm). Site located at latitude -14.16 deg N, longitude 131.39 deg E. Data was downloaded from the The COsmic-ray Soil Moisture Observing System (COSMOS) soil moisture data network and is publicly available. Data from this site located at, referenced as Australia (2) in Table 1 and Figure 4 of Solander et al., 2020, The pan-tropical soil moisture response to El Nino, Hydrol. Earth Syst. Sci., in press.
Soil Water Content (m3 m-3) from Guyaflux site, French Guiana, January 2007 - December 2014
Daily data processed to monthly. Data was collected from Eddy Covariance Flux Tower at the near-surface (0-10 cm). Site located at latitude 5.28 deg N, longitude -52.92 deg E. Data was downloaded from the FluxNet soil moisture data network and is publicly available. Data from this site is referenced as French Guiana (2) in Table 1 and Figure 4 of Solander et al., 2020, The pan-tropical soil moisture response to El Nino, Hydrol. Earth Syst. Sci., in press.
Soil Water Content (m3 m-3) from Australia, November 2007 - May 2009
Hourly data processed to monthly. Data collected from Eddy Covariance Flux Tower at near-surface (0-10 cm). Site located at latitude -13.08 deg N, longitude 131.12 deg E. Data was downloaded from the FluxNet soil moisture data network and is publicly available. Data from this site located at, referenced as Australia (3) in Table 1 and Figure 4 of Solander et al., 2020, The pan-tropical soil moisture response to El Nino, Hydrol. Earth Syst. Sci., in press.
Soil Water Content (m3 m-3) located in Santarem, Brazil K67, July 2000 - February 2004
Hourly data processed to monthly. Data collected from Eddy Covariance Flux Tower at the near-surface (0-10 cm). Site located at a latitude -3.02 deg N, longitude -54.97 deg E. Data was downloaded from the FluxNet soil moisture data network and is publicly available. Data from this site is referenced as Brazil (3) in Table 1 and Figure 4 of Solander et al., 2020, The pan-tropical soil moisture response to El Nino, Hydrol. Earth Syst. Sci., in press.
Soil Water Content (m3 m-3) from Australia, August 2001 - December 2014
Hourly data processed to monthly. Data collected from Eddy Covariance Flux Tower at near-surface (0-10 cm). Site located at latitude -12.49 deg N, longitude 131.15 deg E. Data was downloaded from the FluxNet soil moisture data network and is publicly available. Data from this site is referenced as Australia (4) in Table 1 and Figure 4 of Solander et al., 2020, The pan-tropical soil moisture response to El Nino, Hydrol. Earth Syst. Sci., in press.
Soil Water Content (m3 m-3), October 2011 - May 2017
Hourly data processed to monthly. Data collected from Cosmic Neutron Probes at variable depth averaging 15 cm that was interpolated to near-surface (0-10 cm). Site located at latitude 0.28 deg N, longitude 36.87 deg E. Data was downloaded from the The COsmic-ray Soil Moisture Observing System (COSMOS) soil moisture data network and is publicly available. Data was made available by the COsmic-ray Soil Moisture Observing SysteM (COSMOS). Data from this site is referenced as Kenya in Table 1 and Figure 4 of Solander et al., 2020, The pan-tropical soil moisture response to El Nino, Hydrol. Earth Syst. Sci., in press.
Anomaly Detection in Seismic Data with Deep Learning: Application for Instrument Failure Detection and Forecasting
Seismic data quality assessment (QA) is the first and one of the most important steps before conducting any further data analysis. Traditional methods involve checking various metrics, such as spike detection and power spectral density, by setting strict thresholds or comparing data against synthetic benchmarks. However, these approaches often rely on pre-existing knowledge and assumptions about data anomalies, leading to potential misclassification of unusual cases. Here, in this study, we propose a deep autoencoder model, an unsupervised learning approach that evaluates data quality without making assumptions about normal and anomalous data, which can be used to identify deviations in recorded data that may indicate nascent instrument failure. We test the model with the U.S. International Monitoring System (IMS) seismic stations and demonstrate the capability of detecting anomalies on a monthly scale. This could prompt station operators to examine potential problems early, allowing sufficient time for instrument maintenance to prevent data outages. In addition, we use a new manually selected testing dataset to compare our model performance against two supervised machine learning (ML) approaches and a standard QA package, as baseline models. When applied to the dataset containing known data anomalies, performance of the supervised and unsupervised ML approaches is similar, with an accuracy of 88.1% for our model compared to ∼90% for the supervised ML approach and 78.2% for the standard QA package. Our model outperforms the baseline models when applied to new stations, where new types of data anomalies can be station-specific and not included in the training dataset. Finally, we show model transferability by training the model with data from the Global Seismograph Network only and applying it to the IMS network data. The results suggest that our model is generalizable and can be applied to new stations with good accuracy.
Measured and satellite-derived albedo data for estimating bifacial photovoltaic system performance
The albedo of the ground surface is an important factor in the cost-effectiveness of a bifacial photovoltaic (PV) system. To improve the availability of reliable albedo data, datasets of ground albedo and associated meteorological data were developed by using existing measurement network data and data measured by the PV industry. The measured datasets include time-series data as well as summary information of tabular monthly and yearly data and plots of monthly and hourly albedo values. Satellite-derived values of albedo are available from the National Solar Radiation Data Base (NSRDB). The NSRDB albedos were compared to the measured albedos for Surface Radiation budget (SURFRAD) network locations for the period 2001–2017, and the mean bias difference results were from -0.044 to +0.056. Overall, these differences are greater than the albedo measurement uncertainty of ±0.02; consequently, the NSRDB albedos should be used with caution for estimating the performance of bifacial PV systems. Differences between SURFRAD and NSRDB albedos are attributed to the NSRDB method for determining albedo and to the ground surfaces within the NSRDB 4 km spatial resolution pixel consisting of a mixture of surface types rather than just the single surface types viewed by the albedometers at the SURFRAD stations.
Adaptive neural network management system
A method and computer system for managing a neural network. Data is sent into an input layer in a portion of layers of nodes in the neural network. The data moves on an encode path through the portion such that an output layer in the portion outputs encoded data. The encoded data is sent into the output layer on a decode path through the portion back to the input layer to obtain a reconstruction of the data by the input layer. A determination is made as to whether an undesired amount of error has occurred in the output layer based on the data sent into the input layer and the reconstruction of the data. A number of new nodes is added to the output layer when a determination is present that the undesired amount of the error occurred, enabling reducing the error using the number of the new nodes.
Review of Intrusion Detection Methods and Tools for Distributed Energy Resources
Recent trends in the growth of distributed energy resources (DER) in the electric grid and newfound malware frameworks that target internet of things (IoT) devices is driving an urgent need for more reliable and effective methods for intrusion detection and prevention. Cybersecurity intrusion detection systems (IDSs) are responsible for detecting threats by monitoring and analyzing network data, which can originate either from networking equipment or end-devices. Creating intrusion detection systems for PV/DER networks is a challenging undertaking because of the diversity of the attack types and intermittency and variability in the data. Distinguishing malicious events from other sources of anomalies or system faults is particularly difficult. New approaches are needed that not only sense anomalies in the power system but also determine causational factors for the detected events. In this report, a range of IDS approaches were summarized along with their pros and cons. Using the review of IDS approaches and subsequent gap analysis for application to DER systems, a preliminary hybrid IDS approach to protect PV/DER communications is formed in the conclusion of this report to inform ongoing and future research regarding the cybersecurity and resilience enhancement of DER systems.
ADVERT: An Asynchronous Runtime for Fine-Grained Network Systems
The Data Vortex Network, a novel fine-grained high-radix interconnect, provides the performance and injection rates required by the fine-grained, unpredictable communication patterns of irregular applications. This paper presents ADVERT, an asynchronous runtime system that provides performance and productivity for the fine-grained Data Vortex Network. ADVERT integrates a lightweight memory manager (DVMem) for the user accessible SRAM integrated in the network interface, and a communication library (DVComm) that implements active messaging primitives (remote execution, and, based on this, get and put routines). ADVERT hides the complexity of controlling all the network hardware features through the low-level Data Vortex programming interface, while providing comparable performance. We discuss ADVERT's design and present an analysis of three exemplar irregular kernels (Triangle Count, Page Rank, and GUPS). ADVERT can provide the communication substrate required to build emerging higher level asynchronous many tasking runtimes and partitioned global address space libraries on top of the Data Vortex Network.