Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Streaming data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,549 records · Page 86

Uncertainty quantification in the presence of limited climate model data with discontinuities.

Uncertainty quantification in climate models is challenged by the sparsity of the available climate data due to the high computational cost of the model runs. Another feature that prevents classical uncertainty analyses from being easily applicable is the bifurcative behavior in the climate data with respect to certain parameters. A typical example is the Meridional Overturning Circulation in the Atlantic Ocean. The maximum overturning stream function exhibits discontinuity across a curve in the space of two uncertain parameters, namely climate sensitivity and CO2 forcing. We develop a methodology that performs uncertainty quantification in this context in the presence of limited data.

54 ENVIRONMENTAL SCIENCES↗

Introducing Weirs: An Abstraction for Next Generation Streaming Workflows

In HPC applications, it is widely understood that in situ systems will play a significant role in next generation systems. The rate that next-generation leadership machines will be able to generate data will exceed the bandwidths of the planned I/O systems, leading to a need for in situ processing of the resulting data to reduce it. There have been a number of techniques proposed for in situ workflow systems; we are concerned here specifically with the needs of publish/subscribe or streaming-based approaches, which allow the in situ system to be composed of completely separate executables running concurrently on the hardware. In this paper we introduce an abstract known as a Weir. A weir is a useful mechanism to control state in a point to point streaming workflow in the absence of a third party publish subscribe system.

97 MATHEMATICS AND COMPUTING↗

New constraints on warm dark matter from the Lyman- α forest power spectrum

The forest of Lyman-α absorption lines detected in the spectra of distant quasars encodes information on the nature and properties of dark matter and the thermodynamics of diffuse baryonic material. Its main observable—the 1D flux power spectrum (FPS)—should exhibit a suppression on small scales and an enhancement on large scales in warm dark matter (WDM) cosmologies compared to standard Λ⁢CDM. Here, we present an unprecedented suite of 1080 high-resolution cosmological hydrodynamical simulations run with the graphics processing unit-accelerated code cholla to study the evolution of the Lyman-α forest under a wide range of physically motivated gas thermal histories along with different free-streaming lengths of WDM thermal relics in the early Universe. A statistical comparison of synthetic data with the forest FPS measured down to the smallest velocity scales ever probed at redshifts 4.0≲z≲5.2 [E. Boera et al., Revealing reionization with the thermal history of the intergalactic medium: New constraints from the Ly⁢α flux power spectrum, Astrophys. J. 872, 101 (2019)] yields a lower-limit m WDM >3.1 keV (95% C.L.) for the WDM particle mass and constrains the amplitude and spectrum of the photoheating and photoionizing background produced by star-forming galaxies and active galactic nuclei at these redshifts. Interestingly, our Bayesian inference analysis appears to weakly favor WDM models with a peak likelihood value at the thermal relic mass of m WDM =4.5 keV. In conclusion, we find that the suppression of the FPS from free-streaming saturates at k≳0.1 s km -1 because of peculiar velocity smearing, and this saturated suppression combined with a slightly lower gas temperature provides a moderately better fit to the observed small-scale FPS for WDM cosmologies.

79 ASTRONOMY AND ASTROPHYSICS↗

Admiralty Inlet Hub-Height Turbulence Measurements from June 2012

This data is from measurements at Admiralty Head, in Admiralty Inlet. The measurements were made using an IMU equipped ADV mounted on a mooring, the 'Tidal Turbulence Mooring' or 'TTM'. The inertial measurements from the IMU allows for removal of mooring motion in post processing. The mooring motion has been removed from the stream-wise and vertical velocity signals (u, w). The lateral (v) velocity may have some 'persistent motion contamination' due to mooring sway. The ADV was positioned 11m above the seafloor in 58m of water at 48.1515N, 122.6858W. Units ------ - Velocity data (_u, urot, uacc) is in m/s. - Acceleration (Accel) data is in m/s^2. - Angular rate (AngRt) data is in rad/s. - The components of all vectors are in 'ENU' orientation. That is, the first index is True East, the second is True North, and the third is Up (vertical). - All other quantities are in the units defined in the Nortek Manual. Motion correction and rotation into the ENU earth reference frame was performed using the Python-based open source DOLfYN library (linked in resources). Details on motion correction can be found there. For additional details on this dataset see the included Marine Energy Technology Symposium paper.

16 TIDAL AND WAVE POWER↗

Long-term hydrological, biogeochemical, and climatological data from Walker Branch Watershed, East Tennessee, USA

In 1967, the original Walker Branch Watershed (WBW) project was established to study elemental cycling and mass balances in a relatively unimpacted watershed. Over the next 50+ years, findings from additional experimental studies and long-term observations on WBW advanced understanding of catchment hydrology, biogeochemistry, and ecology and established WBW as a seminal site for catchment science. The 97.5-ha WBW is located in East Tennessee, USA, on the U.S. Department of Energy's Oak Ridge Reservation. Vegetation on the watershed is characteristic of an eastern deciduous, second-growth forest. The watershed is divided into two subcatchments: the West Fork (38.4 ha) and the East Fork (59.1 ha). Headwater streams draining these subcatchments are fed by multiple springs, and thus flow is perennial. Stream water is high in base cations due to weathering of dolomite bedrock and nutrient concentrations are low. Long-term observations of climate, hydrology, and biogeochemistry include daily (1969–2014) and 15-min (1994–2014) stream discharge and annual runoff (1969–2014); hourly, daily, and annual rainfall (1969–2012); daily climate and soil temperature (1993–2010); and weekly stream water chemistry (1989–2013). These long-term datasets are publicly available on the WBW website (https://walkerbranch.ornl.gov/long-term-data/). While collection of these data has ceased, related long-term measurements continue through the National Ecological Observatory Network (NEON), where WBW is the core terrestrial and aquatic site in the Appalachian and Cumberland Plateau region (NEON's Domain 7) of the United States. These long-term datasets have been and will continue to be important in evaluating the influence of climatic and environmental drivers on catchment processes.

54 ENVIRONMENTAL SCIENCES↗

Elimination of the Characterization of DWPF Pour Stream Sample and the Glass Fabrication and Testing of the DWPF Sludge Batch Qualification Sample

A recommendation to eliminate all characterization of pour stream glass samples and the glass fabrication and Product Consistency Test (PCT) of the sludge batch qualification sample was made by a Six-Sigma team chartered to eliminate non-value-added activities for the Defense Waste Processing Facility (DWPF) sludge batch qualification program and is documented in the report SS-PIP-2006-00030. That recommendation was supported through a technical data review by the Savannah River National Laboratory (SRNL) and is documented in the memorandums SRNL-PSE-2007-00079 and SRNL-PSE-2007-00080. At the time of writing those memorandums, the DWPF was processing sludge-only waste but, has since transitioned to a coupled operation (sludge and salt). The SRNL was recently tasked to perform a similar data review relevant to coupled operations and re-evaluate the previous recommendations. This report evaluates the validity of eliminating the characterization of pour stream glass samples and the glass fabrication and Product Consistency Test (PCT) of the sludge batch qualification samples based on sludge-only and coupled operations. The pour stream sample has confirmed the DWPF's ability to produce an acceptable waste form from Slurry Mix Evaporator (SME) blending and product composition/durability predictions for the previous sixteen years but, ultimately the pour stream analysis has added minimal value to the DWPF's waste qualification strategy. Similarly, the information gained from the glass fabrication and PCT of the sludge batch qualification sample was determined to add minimal value to the waste qualification strategy since that sample is routinely not representative of the waste composition ultimately processed at the DWPF due to blending and salt processing considerations. Moreover, the qualification process has repeatedly confirmed minimal differences in glass behavior from actual radioactive waste to glasses fabricated from simulants or batch chemicals. In contrast, the variability study has significantly added value to the DWPF's qualification strategy. The variability study has evolved to become the primary aspect of the DWPF's compliance strategy as it has been shown to be versatile and capable of adapting to the DWPF's various and diverse waste streams and blending strategies. The variability study, which aims to ensure durability requirements and the PCT and chemical composition correlations are valid for the compositional region to be processed at the DWPF, must continue to be performed. Due to the importance of the variability study and its place in the DWPF's qualification strategy, it will also be discussed in this report. An analysis of historical data and Production Records indicated that the recommendation of the Six Sigma team to eliminate all characterization of pour stream glass samples and the glass fabrication and PCT performed with the qualification glass does not compromise the DWPF's current compliance plan. Furthermore, the DWPF should continue to produce an acceptable waste form following the remaining elements of the Glass Product Control Program; regardless of a sludge-only or coupled operations strategy. If the DWPF does decide to eliminate the characterization of pour stream samples, pour stream samples should continue to be collected for archival reasons, which would allow testing to be performed should any issues arise or new repository test methods be developed.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Slow control and data acquisition systems in the Mu2e experiment

The Mu2e experiment at the Fermilab Muon Campus will search for the coherent neutrinolessconversion of a muon into an electron in the field of an aluminum nucleus with a sensitivityimprovement by a factor of 10,000 over existing limits. The Mu2e Trigger and Data AcquisitionSystem (TDAQ) usesotsdaqas the online Data Acquisition System (DAQ) solution. Developed atFermilab,otsdaqintegrates both theartdaqDAQ and theartanalysis frameworks for event transfer,filtering, and processing.otsdaqis an online DAQ software suite with a focus on flexibility andscalability and provides a multi-user, web-based, interface accessible through a web browser. Thedata stream from the detector subsystems is read by a software filter algorithm that selects eventswhich are combined with the data flux coming from a Cosmic Ray Veto System. The DetectorControl System (DCS) has been developed using the Experimental Physics and Industrial ControlSystem (EPICS) open source platform for monitoring, controlling, alarming, and archiving. TheDCS System has been integrated intootsdaq. A prototype of the TDAQ and the DCS systems hasbeen built at Fermilab’s Feynman Computing Center. In this paper, we report on the progress ofthe integration of this prototype in the onlineotsdaqsoftware.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Online DAQ and slow control interface for the Mu2e experiment

The Mu2e experiment at the Fermilab Muon Campus will search for the coherent neutrinolessconversion of a muon into an electron in the field of an aluminum nucleus with a sensitivityimprovement by a factor of 10,000 over existing limits. The Mu2e Trigger and Data AcquisitionSystem (TDAQ) usesotsdaqas the online Data Acquisition System (DAQ) solution. Developed atFermilab,otsdaqintegrates both theartdaqDAQ and theartanalysis frameworks for event transfer,filtering, and processing.otsdaqis an online DAQ software suite with a focus on flexibility andscalability and provides a multi-user, web-based, interface accessible through a web browser. Thedata stream from the detector subsystems is read by a software filter algorithm that selects eventswhich are combined with the data flux coming from a Cosmic Ray Veto System. The DetectorControl System (DCS) has been developed using the Experimental Physics and Industrial ControlSystem (EPICS) open source platform for monitoring, controlling, alarming, and archiving. TheDCS System has been integrated intootsdaq. A prototype of the TDAQ and the DCS systems hasbeen built at Fermilab’s Feynman Computing Center. In this paper, we report on the progress ofthe integration of this prototype in the onlineotsdaqsoftware.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Petaflops router

Disclosed is a method and system for performing operations on at least one input data vector in order to produce at least one output vector to permit easy, scalable and fast programming of a petascale equivalent supercomputer. A PetaFlops Router may comprise one or more PetaFlops Nodes, which may be connected to each other and/or external data provider/consumers via a programmable crossbar switch external to the PetaFlops Node. Each PetaFlops Node has a FPGA and a programmable intra-FPGA crossbar switch that permits input and output variables to be configurably connected to various physical operators contained in the FPGA as desired by a user. This allows a user to specify the instruction set of the system on a per-application basis. Further, the intra-FPGA crossbar switch permits the output of one operation to be delivered as an input to a second operation. By configuring the external crossbar switch, the output of a first operation on a first PetaFlops Node may be used as the input for a second operation on a second PetaFlops Node. An embodiment may provide an ability for the system to recognize and generate pipelined functions. Streaming operators may be connected together at run-time and appropriately staged to allow data to flow through a series of functions. This allows the system to provide high throughput and parallelism when possible. The PetaFlops Router may implement the user desired instructions by appropriately configuring the intra-FPGA crossbar switch on each PetaFlops Node and the external crossbar switch.

97 MATHEMATICS AND COMPUTING↗

An experimental and modeling study of the application of membrane contactor reactors to methanol synthesis using pure CO 2 feeds

We describe here a post-combustion CO 2 capture and utilization (CCU) technology that converts the CO 2 into methanol (MeOH), a valuable chemical, thus providing a way to monetize the carbon captured to offset process costs. Methanol synthesis (MeS) has been discussed recently for application to CCU, but thermodynamic limitations make it difficult to convert in a single pass a large CO 2 fraction. Conventional catalysts show slow kinetics in converting CO 2 -rich syngas (or pure CO 2 ) into MeOH. Our Group developed a novel MeS process, employing a membrane contactor reactor (MCR) system that attains carbon conversions significantly higher than equilibrium. Our focus here is to process pure CO 2 streams by combining the MCR with a separate reactor, which converts the CO 2 into a syngas via the reverse water gas shift (RWGS) reaction. In this preliminary effort, the RWGS reactor (RWGSR) is assumed to reach equilibrium. Additional MeS kinetic rate data are generated validating experimentally the ability of the MeS-MCR to process as a feed the RWGSR exit stream. The performance of the combined (RWGSR/MeS-MCR) system is then simulated using a recently developed MeS-MCR model. In conclusion, the findings are encouraging, and research is currently ongoing to experimentally validate the RWGSR/MeS-MCR system performance.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

New Variable Stars in NGC 6652 and Its Background Sagittarius Stream

We conducted a variable star search on the metal-rich Galactic globular cluster NGC 6652 using archival Gemini-S/Gemini Multiobject Spectrograph data. We report the discovery of nine new variable stars in the NGC 6652 field, of which we classify six as eclipsing binaries and one as an SX Phoenicis star, leaving two variables without classification. Using proper motions from Gaia DR2 and Hubble Space Telescope, albeit with some uncertainties, we find that the cluster, the field, and the background Sagittarius stream each have three of these variables. We also reassess the membership of known variables based on the Gaia proper motions, confirming the existence of one RR Lyrae star in the cluster.

79 ASTRONOMY AND ASTROPHYSICS↗

Scaling Analysis of Vortex Shedding Frequency between In line Plates

The Global Threat Reduction initiative (GTRI) was established by the National Nuclear Security Administration (NNSA) in 2004. One of the highlights of the program is to convert research and test reactors at home and abroad from Highly Enriched Uranium (HEU) to Low Enriched Uranium (LEU) fuels. By switching directly from HEU to LEU, an LEU reactor produces fewer neutrons than an HEU reactor and in some cases; a direct switch from HEU to LEU results in the reactor being unable to achieve criticality. Under certain circumstances, criticality is achieved and the original neutron fluxes are restored with LEU fuel by adding more fuel elements to the core. Not all reactors, exemplified by the Advanced Test Reactor (ATR) at the Idaho National Lab (INL), have the luxury of simply adding more fuel to the core. In such cases, entirely new designs must be created and tested. The ATR utilizes plate type fuel. During the design and testing of the ATR fuel, vortex shedding was identified as potential source for experiment and fuel failure. For fuel conversion, elements must be tested in pile prior to the qualification of the new fuel design. For some test elements, the primary test plate is followed by a secondary handling plate. It is known that objects downstream influence the vortex shedding. While vortex shedding is an important and well-studied phenomenon, not only in the context of nuclear engineering, but in fields as diverse as aeronautical engineering and biology, there is a significant gap in the understanding of vortex shedding in regards to two bluff bodies in line direct line with one another. The study provides a scaling analysis of the frequency of vortex shedding for plates in line. The scaling analysis is then compared to numerical simulation of two in line plates. The study provided a scaling analysis and suggested parameter for determining the expected trends in the Strouhal number for a plate with some object downstream. The analysis made the consideration of differing length scales as the cause for a reduction in vortex shedding frequency as well as looked at the potential impact of boundary layer growth on vortex shedding for a flat plate. The comparison between the expected scaling and numerical data was less than ideal, but there are several potential causes. One of the biggest issues with the comparison is the uncertainty associated with the defect velocity. The frequency was well established in several cases, but the velocity was not always well established resulting in a larger uncertainty. In the cases where the velocity was near zero (i.e. b/d = 0.5), the uncertainty dominated since the corrected Strouhal number is divided by the defect velocity. The Reynolds numbers were not incredibly large, ranging from 350-1600. The low Reynolds numbers potentially undermine the principle assumption made in the scaling analysis, i.e. Reynolds number is negligibly small. Additionally, the exact definition of the 'reduced velocity' was never explicitly defined, merely inferred from the assumption that the x length scale and y length scale were in fact different. Another potential problem is the defect velocities in the lower Reynolds number cases were not much smaller than the free stream velocity. Further work needs to be done at higher Reynolds numbers and with more data points to ensure the assumptions made are valid as well as confirm the accuracy of the scaled relationship. (authors)

42 ENGINEERING↗

Solar energetic particle events in different types of solar wind

We examine statistically some properties of 96 20 MeV gradual solar energetic proton (SEP) events as a function of three different types of solar wind (SW) as classified by Richardson and Cane. Gradual SEP (E > 10 MeV) events are produced in shocks driven by fast (V ≳ 900 km s{sup –1}) and wide (W > 60°) coronal mass ejections (CMEs). We find no differences among the transient, fast, and slow SW streams for SEP 20 MeV proton event timescales. It has recently been found that the peak intensities Ip of these SEP events scale with the ∼2 MeV proton background intensities, which may be a proxy for the near-Sun shock seed particles. Both the intensities Ip and their 2 MeV backgrounds are significantly enhanced in transient SW compared to those of fast and slow SW streams, and the values of Ip normalized to the 2 MeV backgrounds only weakly correlate with CME V for all SW types. This result implies that forecasts of SEP events could be improved by monitoring both the Sun and the local SW stream properties and that the well known power-law size distributions of Ip may differ between transient and long-lived SW streams. We interpret an observed correlation between CME V and the 2 MeV background for SEP events in transient SW as a manifestation of enhanced solar activity.

79 ASTRONOMY AND ASTROPHYSICS↗

Tidal Energy Resource Characterization, Velocity and Turbulence Measurements, Processed Data, Cook Inlet, AK, 2021

This submission contains processed datasets from a long-term deployment of 3 moorings and a transect survey of the proposed tidal energy site off the East Forelands in Cook Inlet, AK. The long-term mooring datasets were created from 8 instruments mounted on a Terrasond High Energy Oceanographic Mooring (THEOM) bottom lander and two Mid-Water Mooring (MWM) Stablemoor buoys from 1 July 2021 to 31 August 2021 (60 days). The west-most mooring (MWM1) was deployed at 60.720225 N, 151.436196 W in ~50 m of water. The middle mooring (THEOM) was deployed at 60.720703 N, 151.429500 W in ~52 m of water. The east-most buoy (MWM2) was deployed at 60.720081 N, 151.420896 W in ~50 m of water. Each Stablemoor carried three instruments: 1. A Nortek Vector acoustic Doppler velocimeter (ADV) mounted at the Stablemoor's nose. Data were recorded at 8 Hz on a 5 minute duty cycle every 20 minutes. Data was motion-corrected using the internal IMU and external ADCP bottom-track data and then bin-averaged into 4 minute bins and converted to the Principal (streamwise, cross-stream, vertical) coordinate system. (Note: 30 seconds were trimmed from the beginning and end of each 5 minute duty cycle to account for the filter end-effects from turning on and turning off the IMU.) 2. A down-looking Nortek Signature 1000 kHz acoustic Doppler current profiler (ADCP) mounted in the first Stablemoor instrument well. Data were recorded in 2 Hz with 5-beam burst and bottom-track enabled. Processed data has been averaged into 10 minute bins and converted into the Principal coordinate system. 3. An up-looking Nortek Signature 1000 kHz acoustic Doppler current profiler (ADCP) mounted in the second Stablemoor instrument well. Data were recorded at 4 Hz with 5 beam burst enabled. Processed data has been averaged into 10 minute bins and converted into the Principal coordinate system. Note: the down-facing ADCP on MWM1 failed on July 10th, 2021, only recording 9 days of data. Because ADV motion-correction required bottom track, the ADV from MWM1 also only has 9 days processed. Additionally, only 25 days of data were processed from the MWM2 ADV because it appeared to have been impacted by debris on 7/25. Two instruments were mounted on the THEOM (see MHKDR link further below for THEOM raw data): 4. A Nortek Vector acoustic Doppler velocimeter (ADV). Data were recorded at 8 Hz on a 5 minute duty cycle every 20 minutes. Data was bin-averaged into 5 minute bins, and converted to the Principal coordinate system. 5. A Nortek Signature 500 kHz acoustic Doppler current profiler (ADCP). Data were recorded in 4 Hz in the beam coordinate system from all 5 beams. Processed data has been averaged into 10 minutes bins and converted to the Principal coordinate system.

16 TIDAL AND WAVE POWER↗

Understanding the implications of the data from recent high-energy-density Kelvin-Helmholtz shear layer experiments

The first successful high energy density Kelvin-Helmholtz (KH) shear layer experiments (O.A. Hurricane, et al., Phys. Plasmas, 16, 056305, 2009; E.C. Harding, et al., Phys. Rev. Lett., 103, 045005, 2009) demonstrated the ability to design and field a target that produces an array of large diagnosable KH vortices in a controlled fashion. Data from these experiments vividly showed the complete evolution of large distinct eddies, from formation to apparent turbulent break-up. Unexpectedly, low-density bubbles/cavities comparable to the vortex size ({approx} 300 - 400 {micro}m) appeared to grow up in the free-stream flow above the unstable material interface. In this paper, the basic principles of the experiment will be discussed, the data reviewed, and the progress on understanding the origin of the above bubble structures through theory and simulation will be reported on.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Waste Stream Analyses for Nuclear Fuel Cycles

A high-level study was performed in Fiscal Year 2009 for the U.S. Department of Energy (DOE) Office of Nuclear Energy (NE) Advanced Fuel Cycle Initiative (AFCI) to provide information for a range of nuclear fuel cycle options (Wigeland 2009). At that time, some fuel cycle options could not be adequately evaluated since they were not well defined and lacked sufficient information. As a result, five families of these fuel cycle options are being studied during Fiscal Year 2010 by the Systems Analysis Campaign for the DOE NE Fuel Cycle Research and Development (FCRD) program. The quality and completeness of data available to date for the fuel cycle options is insufficient to perform quantitative radioactive waste analyses using recommended metrics. This study has been limited thus far to qualitative analyses of waste streams from the candidate fuel cycle options, because quantitative data for wastes from the front end, fuel fabrication, reactor core structure, and used fuel for these options is generally not yet available.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

ATAT: Astronomical Transformer for time series and Tabular data

Context. The advent of next-generation survey instruments, such as theVera C. RubinObservatory and its Legacy Survey of Space and Time (LSST), is opening a window for new research in time-domain astronomy. The Extended LSST Astronomical Time-Series Classification Challenge (ELAsTiCC) was created to test the capacity of brokers to deal with a simulated LSST stream. Aims. Our aim is to develop a next-generation model for the classification of variable astronomical objects. We describe ATAT, the Astronomical Transformer for time series And Tabular data, a classification model conceived by the ALeRCE alert broker to classify light curves from next-generation alert streams. ATAT was tested in production during the first round of the ELAsTiCC campaigns. Methods. ATAT consists of two transformer models that encode light curves and features using novel time modulation and quantile feature tokenizer mechanisms, respectively. ATAT was trained on different combinations of light curves, metadata, and features calculated over the light curves. We compare ATAT against the current ALeRCE classifier, a balanced hierarchical random forest (BHRF) trained on human-engineered features derived from light curves and metadata. Results. When trained on light curves and metadata, ATAT achieves a macro F1 score of 82.9 ± 0.4 in 20 classes, outperforming the BHRF model trained on 429 features, which achieves a macro F1 score of 79.4 ± 0.1. Conclusions. The use of transformer multimodal architectures, combining light curves and tabular data, opens new possibilities for classifying alerts from a new generation of large etendue telescopes, such as theVera C. RubinObservatory, in real-world brokering scenarios.

Astronomy & Astrophysics↗

Baltimore Social-Environmental Collaborative (BSEC) Doppler Lidar & Derived Products

This repository contains all processed Doppler‐lidar outputs from the PSU lidar deployed for the Baltimore Social‐Environmental Collaborative (BSEC) project. Vertical Stare Scans (fixed‐beam, vertical profiling): 1 Hz backscatter intensity (m⁻¹ sr⁻¹), signal‐to‐noise ratio (unitless), and Doppler vertical‐velocity (m s⁻¹) on 30 m range gates (and 3 m range gates), stored as CF-compliant NetCDF. Wind Profiles (horizontal‐wind retrieval): daily NetCDF outputs of retrieved horizontal wind speed (m s⁻¹) and direction (degrees), computed from the angled‐scan returns. Profile Statistics (summary statistics on the vertical velocity): 15 min windows (default) of mean, variance, skewness, kurtosis, high-frequency variance, etc., as a function of height; saved as CF-compliant NetCDF files. Boundary Layer Height (BLH) (fuzzy-logic output): 15 min BLH estimates (m), with lower/upper fuzzy bounds (m) and a quality flag (0–4) indicating data status (e.g., no data, good, ran out of signal, below range, cloud-topped). Cloud Base Height (Haar-gradient detection): 10 min estimates of cloud-base height (m). All five product streams are organized by year and date under their own top-level folders (01_Vertical_Stare_Scans/ through 05_Cloud_Height/). Each folder contains a data_ /YYYY/ subdirectory with daily CF-compliant NetCDF outputs (96 windows per day at 15 min intervals). Global attributes in each file include creation history, version (3.0.0), institution, and source. Instrument & MeasurementsThe PSU Doppler Lidar samples aerosol backscatter (m⁻¹ sr⁻¹), signal-to-noise ratio, and radial velocity at ~1 Hz. Vertical stare scans point the beam straight up; after collecting angled scans through multiple elevation angles, the "Wind Profiles" product contains the fully retrieved horizontal wind speed and direction. Data were collected continuously at ~30 m range resolution (and 3 m for the year of 2025), with a typical height ceiling of ~12 km. How to Use Open any NetCDF with Python's xarray, MATLAB, or similar CF-compliant tools. Stare scans and angled-scan retrievals (Wind Profiles) are CF-compliant daily NetCDF files. Profile-Statistics, BLH, and Cloud Height files are daily 15 min (10 min for Cloud Heights) summaries (96 time steps per file). Inspect the included variables (e.g., vertical_velocity_variance, wind_speed, BLH, cloud_base_height) for your analyses. Use the quality flags (BLH_flag, cloud_flag) to filter out poor-quality retrievals. For more information or questions about processing methods, please contact:Nicholas E. Prince ⟨nec5299@psu.edu⟩Penn State Department of Meteorology & Atmospheric Science

Air Quality↗