Engineering topics

Proffitt, M.

Publications and source records attributed to Proffitt, M..

6 records

DOE OSTI2020

ServiceX A Distributed, Caching, Columnar Data Delivery Service

We will describe a component of the Intelligent Data Delivery Service being developed in collaboration with IRIS-HEP and the LHC experiments. ServiceX is an experiment-agnostic service to enable on-demand data delivery specifically tailored for nearly-interactive vectorized analysis. This work is motivated by the data engineering challenges posed by HL-LHC data volumes and the increasing popularity of python and Spark-based analysis workflows.ServiceX gives analyzers the ability to query events by dataset metadata. It uses containerized transformations to extract just the data required for the analysis. This operation is colocated with the data to avoid transferring unnecessary branches over the WAN. Simple filtering operations are supported to further reduce the amount of data transferred.Transformed events are cached in a columnar datastore to accelerate delivery of subsequent similar requests. ServiceX will learn commonly related columns and automatically include them in the transformation to increase the potential for cache hits by other users.Selected events are streamed to the analysis system using an efficient wire protocol that can be readily consumed by a variety of computational frameworks. This reduces time-to-insight for physics analysis by delegating to ServiceX the complexity of event selection, slimming, reformatting, and streaming.

Galewsky, B.↗

NASA NTRS2000

Scale Invariance of High Altitude Aircraft Observations in the Upper Troposphere and Lower Stratosphere at Tropical and Subtropical Latitudes

Exchange between the upper tropical troposphere and the lower troposphere is considered by examining high altitude aircraft observations of water, ozone, methane, wind and temperature for scale invariance.

altitude aircraft observations↗

NASA NTRS1999

Comparison of MkIV Balloon and ER-2 Aircraft Measurements of Atmospheric Trace Gases

On 8 May 1997 vertical profiles of over 30 different gases were measured remotely in solar occultation by the JPl MkIV Interferometer during a balloon flight launched from Fairbanks, Alaska.

infrared↗

NASA NTRS1996

Quantifying Transport Between the Tropical and Mid-Latitude Lower Stratosphere

Because exchange with the tropics is slower than multi-dimensional models generally assume, ozone at mid-latitudes apears to be more sensitive to elevated levels of industrial chlorine than currently predicted. Nevertheless, approximately 45% of air in the tropical ascent region at 21 km has been entrained from mid-latitudes, implying that emissions from supersonic aircraft could deplete ozone in the middle stratosphere.

stratosphere↗

NASA NTRS1994

Chlorine Chemistry of the Lower Stratosphere: Aircraft (ALIAS, ER-2) and Balloon (BLISSs) In-Situ Measurements of HC1,NO(sub 2), andN(sub 2)O for Testing Heterogeneous Chemistry

Stratospheric concentrations of HC1 measured in the northern hemisphere from the ER-2 aircraft are significantly lower than model predictions using both gas phase and heterogeneous chemistry, but measurements in the southern hemisphere are in much better agreement.

gas phase and heterogeneous chemistry↗

NASA NTRS1993

Gravity waves generated by a tropical cyclone during the STEP tropical field program - A case study

Overflights of a tropical cyclone during the Australian winter monsoon field experiment of the Stratosphere-Troposphere Exchange Project (STEP) show the presence of two mesoscale phenomena: a vertically propagating gravity wave with a horizontal wavelength of about 110 km and a feature with a horizontal scale comparable to that of the cyclone's entire cloud shield. The larger feature is fairly steady, though its physical interpretation is ambiguous. The 110-km gravity wave is transient, having maximum amplitude early in the flight and decreasing in amplitude thereafter. Its scale is comparable to that of 100-to 150-km-diameter cells of low satellite brightness temperatures within the overall cyclone cloud shield; these cells have lifetimes of 4.5 to 6 hrs. These cells correspond to regions of enhanced convection, higher cloud altitude, and upwardly displaced potential temperature surfaces. The temporal and spatial distribution of meteorological variables associated with the 110-km gravity wave can be simulated by a slowly moving transient forcing at the anvil top having an amplitude of 400-600 m, a lifetime of 4.5-6 hrs, and a size comparable to the cells of low brightness temperature.

Pfister, L.↗