Application of Analysis on the Wire to Streaming NSLS-II Beamline Data
Explore the source record for details and available documents.
SEARCH · Engineering Papers
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Explore the source record for details and available documents.
A hardware random number generator comprises a gas discharge tube, an average voltage generator, and a comparator. The gas discharge tube includes first, second, and third terminals and may generate a variable voltage on the second terminal when a supply voltage is applied to the first and third terminals. The average voltage generator receives the variable voltage from the gas discharge tube and may generate an average voltage equal to a moving average value of the variable voltage over successive periods of time. The comparator receives the variable voltage and the average voltage and may generate a random stream of data bits, such that a value of each bit varies according to the relative magnitudes of the variable voltage and the average voltage.
With an increasing interest in constructing new run-of-the-river (ROR) hydroelectric generation over the more traditional reservoir-based hydroelectric systems, there is an increasing operational challenge due to the volatility of stream flow. The Snohomish County Public Utilities District (SnoPUD) has recently invested in the construction and operation of 3 new run-of-the-river projects in Northwestern Washington along Calligan Creek, Hancock Creek, and Youngs Creek. In order to effectively plan generation dispatch, SnoPUD has expressed interest in the development of an accurate forecasting tool to predict the generation capacity for these ROR systems. The following research project aims to use statistical learning models, namely Hidden Markov Models (HMMs), to predict day-ahead generation capacities for the aforementioned ROR systems. These models are constructed using 12 years of historical stream flow data collected at the intake sites and precipitation data recorded at the National Oceanic and Atmospheric Administration (NOAA) Alpine Meadows station. Four methods of constructing the models are studied for their forecast accuracies, and are compared with the persistence model. Despite using only one set of observable variables, the HMMs are shown to have slight improvements in accuracy over the persistence model approach, which shows great optimism for future work.
Event-based biosurveillance is a scientific discipline in which diverse streams of data, available from the Internet, are characterized prospectively to provide information on infectious disease events. Biosurveillance complements traditional public health surveillance to provide both early warning of infectious disease events as well as situational awareness. The Global Health Security Action Group (GHSAG) of the Global Health Security Initiative is developing a biosurveillance capability that integrates and leverages component systems from member nations. This work discusses these biosurveillance systems and identifies needed future studies.
We present candidate members of the Pal 5, GD-1, Cetus Polar, and Orphan tidal stellar streams found in LAMOST DR3, SDSS DR9 and APOGEE catalogs. In LAMOST DR3, we find 20, 4, 24 high confidence candidates of tidal streams GD-1, Cetus Polar and Orphan respectively. We also list from the SDSS DR9 spectroscopic catalog 59, 118, 10 high confidence candidates of tidal streams Cetus Polar, Orphan and Pal 5, respectively. Furthermore, we find 7 high confidence candidates of the Pal 5 tidal stream in APOGEE data. Compared with SDSS, the new candidates from LAMOST DR3 are brighter, so that together, more of the color-magnitude diagram, including the giant branch can be explored. Analysis of SDSS data shows that there are 3 metallicity peaks of the Orphan stream and also shows some spatial separation. LAMOST data confirms multiple metallicities in this stream. The metallicity, given by the higher resolution APOGEE instrument, of the Pal 5 tidal stream is [Fe/H] $\sim -1.2$, higher than that given earlier by SDSS spectra. Here, many previously unidentified stream members are tabulated here for the first time, along with existing members, allowing future researchers to further constrain the orbits of these objects as they move within the Galaxy's dark matter potential.
This data set reports 15-minute and daily stream discharge, and annual runoff for the West and East Forks draining Walker Branch Watershed (WBW). The long-term Walker Branch Hydrology Monitoring project was intended to document changes in the water balance (precipitation inputs, stream discharge outputs) for the WBW over time. This data set contains three data files of stream discharge (L/s) for 15-minute and daily intervals, and annual runoff (cm). The daily and annual datasets began in 1969 in both East and West Forks, while the 15-minute datasets began in 1994 in both Forks. Data were collected through 2014 for the West Fork, and through 2012 for the East Fork. The Walker Branch Watershed is located on the U.S. Department of Energy's Oak Ridge Reservation in eastern Tennessee.
ORPC staff collected site characterization data on Millinocket Stream, downstream of the hydropower station at the former Great Northern Paper Mill site in Millinocket, Maine. Bathymetry was collected with a SonTek M9 using HydroSurveyor software package and velocity was collected using the SonTek M9 RiverSurveyor software package. Bathymetry only was collected on 9/30/21. Bathymetry and velocity were collected on 10/21/21.
Researchers at Savannah River National Laboratory (SRNL) have established an In-Situ Decommissioning (ISD) Sensor Network Test Bed-a unique, small scale, configurable environment - for the assessment of prospective sensors on actual ISD system material at minimal cost. The data collected by the ISD sensors are ideal for applying temporal data mining (TDM) technique since they are time-specific, age-specific, and developmental stage-specific. In this research, TDM algorithms were applied on the baseline data collected by ISD test bed in the recent few years to seek frequency episodes in event stream. The tentative results prove that TDM techniques are effective tools for validating ISD performance. Frequent episodes in the data stream have confirmed the daily cycle of the sensor responses and establish sequences of different types of sensors, which was verified by the experimental setup of ISD Sensor Network Test Bed. The abnormal episodes in the data stream may lead to the early indicators of ISD system failures. (authors)
We present ∼115 new spectroscopically identified members of the GD-1 tidal stream observed with the 5000-fiber Dark Energy Spectroscopic Instrument (DESI). We confirm the existence of a “cocoon,” which is a broad (FWHM ∼ 2:932 ∼ 460 pc) and kinematically hot (velocity dispersion, σ ∼ 5–8 km s −1 ) component that surrounds a narrower (FWHM ∼ 0:353 ∼ 55 pc) and colder [(σ = 3.09 ± 0.76 km s −1 )] thin stream component (based on a median per star velocity precision of 2.7 km s −1 ). The cocoon extends over at least a 30 ∘ segment of the stream observed by DESI. The thin and cocoon components have similar mean values of [Fe/H]: −2.54 ± 0.04 dex and −2.47 ± 0.06 dex, suggestive of a common origin. The data are consistent with the following scenarios for the origin of the cocoon. The progenitor of the GD-1 stream was an accreted globular cluster (GC) and: (a) the cocoon was produced by pre-accretion tidal stripping of the GC while it was still inside its parent dwarf galaxy; (b) the cocoon comprises debris from the parent dwarf galaxy; (c) an initially thin GC tidal stream was heated by impacts from dark subhalos in the Milky Way; (d) an initially thin GC stream was heated by a massive Sagittarius dwarf galaxy; or a combination of some of these. Future DESI spectroscopy and detailed modeling may enable us to distinguish between these possible origins.
The Mu2e experiment at the Fermilab Muon Campus will search for the coherent neutrinoless conversion of a muon into an electron in the field of an aluminum nucleus with a sensitivity improvement by a factor of 10 000 over existing limits. Such a charged lepton flavor-violating reaction probes new physics at a scale unavailable with direct searches at either present or planned high-energy colliders. The Mu2e Trigger and Data Acquisition (TDAQ) system exploits otsdaq as its online Data Acquisition System (DAQ) solution. Furthermore, developed at Fermilab, otsdaq integrates both the artdaq DAQ and the art analysis frameworks for event transfer, filtering, and processing. otsdaq is an online DAQ software suite with a focus on flexibility and scalability and provides a multi-user, web-based, interface accessible through a web browser. The read out controllers (ROCs) stream out zero-suppressed data continuously from the detector subsystems to the data transfer controllers (DTCs). The data stream is then read over the peripheral component interconnect express (PCIe) bus to a software filter algorithm that selects events which are combined with the data flux coming from a cosmic-ray veto (CRV) system. The detector control system (DCS) has been developed using the experimental physics and industrial control system (EPICS) open source platform for monitoring, controlling, alarming, and archiving. The DCS has been integrated into otsdaq. A prototype of the TDAQ system and the DCS has been built at Fermilab's Feynman Computing Center. In this article, we report on the progress of the integration of this prototype in the online otsdaq software.
A simulation system for use in testing a radar system comprises a coarse delay module, a fine delay module, and a doppler shift module. The coarse delay module is configured to receive a first stream of digital data samples that are sampled from a radar signal at a sample time period or a second stream of digital data samples that are processed by another simulation system component and delay the digital data samples by a selectable first delay time that is greater than or equal to the sample time period. The fine delay module is configured to receive the digital data samples and filter the digital data samples to represent delay by a selectable second delay time that is less than the sample time period. The doppler shift module is configured to receive the digital data samples and adjust a value of a frequency content of the fine delayed samples.
This data package provides data on the natural abundance isotopes of nitrate from various sources, including porewater, stream, and precipitation. The overall purpose of this data package is to complement additional data streams for nitrogen cycling metrics (e.g., riverine inorganic and organic nitrogen measurements) with specific data gleaned from the interpretation of terrestrial and riverine isotope measurements and collectively understand on how nitrogen is cycled around this system. The Rifle and East River are part of the Watershed Function Scientific Focus Area (WFSFA) located in the Upper Colorado River Basin, United States. Collection locations include: Pumphouse (multiple sampling dates), River (upstream/ downstream meander C), Shallow soil lysimeters (hillslope, toeslope, floodplain), Hillslope-floodplain borehole wells (i.e., Pumphouse Lower Montane (PLM) wells), and Potassium chloride(KCL)-extracted soil samples. Copper Creek sampling includes 8x river sample points and two tributaries sampled on Sept. Oct. 2017, July 2018. East River below the Rocky Mountain Biological Laboratory sampling includes 1 access point sampled on July, Sept. Oct. 2017. Rifle floodplain sampling includes well TT03 across multiple collection times over 2014. Data is provided in 5 individual files by location in csv format, or all compiled in Excel format.
Herein, we introduce the southern stellar stream spectroscopy survey (S 5 ), an on-going program to map the kinematics and chemistry of stellar streams in the southern hemisphere. The initial focus of S 5 has been spectroscopic observations of recently identified streams within the footprint of the dark energy survey (DES), with the eventual goal of surveying streams across the entire southern sky. Stellar streams are composed of material that has been tidally striped from dwarf galaxies and globular clusters and hence are excellent dynamical probes of the gravitational potential of the Milky Way, as well as providing a detailed snapshot of its accretion history. Observing with the 3.9 m Anglo-Australian Telescope’s 2-degree-Field fibre positioner and AAOmega spectrograph, and combining the precise photometry of DES DR1 with the superb proper motions from Gaia DR2, allows us to conduct an efficient spectroscopic survey to map these stellar streams. So far S 5 has mapped nine DES streams and three streams outside of DES; the former are the first spectroscopic observations of these recently discovered streams. In addition to the stream survey, we use spare fibres to undertake a Milky Way halo survey and a low-redshift galaxy survey. This paper presents an overview of the S 5 program, describing the scientific motivation for the survey, target selection, observation strategy, data reduction, and survey validation. Lastly, we describe early science results on stellar streams and Milky Way halo stars drawn from the survey. Updates on S 5 , including future public data releases, can be found at http://s5collab.github.io.
Error-bounded lossy compression is one of the most efficient solutions to reduce the volume of scientific data. For lossy compression, progressive decompression and random-access decompression are critical features that enable on-demand data access and flexible analysis workflows. However, these features can severely degrade compression quality and speed. To address these limitations, we propose a novel streaming compression framework that supports both progressive decompression and random-access decompression while maintaining high compression quality and speed. Our contributions are three-fold: (1) we design the first compression framework that simultaneously enables both progressive decompression and random-access decompression; (2) we introduce a hierarchical partitioning strategy to enable both streaming features, along with a hierarchical prediction mechanism that mitigates the impact of partitioning and achieves high compression quality—even comparable to state-of-the-art (SOTA) non-streaming compressor SZ3; and (3) our framework delivers high compression and decompression speed, up to 6.7 × faster than SZ3.
Abstract- We extend our approach capturing and relating the provenance and performance metrics of computational workflows as a diagnostic tool for runtime optimization and placement. One important challenge is the volume of extracted data, both for performance metrics and provenance, even when specifying filters and focusing on quantities of interest in a simulation. We reduce this data by performing anomaly detection on streaming data and store provenance for the detected anomalies, an approach we call prescriptive provenance. This paper discusses the Chimbuko architecture enabling the approach. We present the use of a protein structure propagation workflow based on NWChemEx. We are testing algorithms for anomaly detection and present preliminary results here obtained with Local Outlier Factor. While scaling remains a challenge, these results show that our robust Chimbuko architecture for streaming analysis with prescriptive provenance is a promising approach.
Stream classifications are important for understanding stream ecosystem diversity while also serving as tools for aquatic conservation and management. With current rates of land and riverscape modification within the United States (US), a comprehensive inventory and evaluation of naturally occurring stream habitats is needed, as this provides a physical template upon which stream biodiversity is organized and maintained. To adequately represent the heterogeneity of stream ecosystems, such a classification needs to be spatially extensive where multiple stream habitat components are represented at the highest resolution possible. Herein, we present a multi-layered empirically-driven stream classification system for the conterminous US, constructed from over 2.6 million stream reaches within the NHDPlus V2 stream network. The classification is based on emergent natural variation in six habitat layers meaningful at the stream-reach resolution: size, gradient, hydrology, temperature, network bifurcation, and valley confinement. To support flexibility of use, we provide multiple alternative approaches to developing classes and report uncertainty in classes assigned to stream reaches. The stream classification and underlying data provide valuable resources for stream conservation and research.
Early fault detection and fault prognosis are crucial to ensure efficient and safe operations of complex engineering systems such as the Spallation Neutron Source (SNS) and its power electronics (high voltage converter modulators). Following an advanced experimental facility setup that mimics SNS operating conditions, the authors successfully conducted 21 early fault detection experiments, where fault precursors are introduced in the system to a degree enough to cause degradation in the waveform signals, but not enough to reach a real fault. Nine different machine learning techniques based on ensemble trees, convolutional neural networks, support vector machines, and hierarchical voting ensembles are proposed to detect the fault precursors. Although all 9 models have shown a perfect and identical performance during the training and testing phase, the performance of most models has decreased in the next test phase once they got exposed to realworld data from the 21 experiments. The hierarchical voting ensemble, which features multiple layers of diverse models, maintains a distinguished performance in early detection of the fault precursors with 95% success rate (20/21 tests), followed by adaboost and extremely randomized trees with 52% and 48% success rates, respectively. The support vector machine models were the worst with only 24% success rate (5/21 tests). The study concluded that a successful implementation of machine learning in the SNS or particle accelerator power systems would require a major upgrade in the controller and the data acquisition system to facilitate streaming and handling big data for the machine learning models. In addition, this study shows that the best performing models were diverse and based on the ensemble concept to reduce the bias and hyperparameter sensitivity of individual models.