Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data logging”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 721 records · Page 40
All sourcesNASA NTRSDOE OSTI
NASA NTRS1994

Passive microwave observations of the Wedell Sea during austral winter and early spring

The results of multispectral passive microwave observations (6.7 to 90-GHz) are presented from the cruises of the FS Polarstern in the Weddell Sea from July to December 1986. This paper includes primarily the analysis of radiometric observations taken at ice station sites. Averaged emissivity spectra for first-year (FY) ice were relatively constant throughout the experiment and were not statistically different from FY ice signatures in the Arctic. Detailed ice characterization was carried out at each site to compare the microwave signatures of the ice with the physical properties. Absorption optical depths of FY ice were found to be sufficiently high that only the structure in the upper portions of the ice contributed significantly to interstation emissivity variations. The emissivities at 90-GHz, e(90), had the greatest variance. Both e(90) at vertical polarization and GR(sub e)(90, 18.7)(defined as (e(sub V)(90)-e(sub V)(18.7))/e(sub V)(90 + e(sub V)(18.7)) depended on the scattering optical depth which is a function of the snow grain diameter and layer thickness. The variance showed a latitude dependence and is probably due to an increase in the strength of snow metamorphism nearer the northern edge of the ice pack. The contribution of variations of near-surface brine volume to the emissivity was not significant over the range of values encountered at the station sites. Emissivity spectra are presented for a range of thin ice types. Unsupervised principal component analysis produced three significant eigenvectors and showed a separation among four different surface types: open water, thin ice, FY ice, and FY ice with a thick snow cover. A comparison with SMMR satellite data showed that average ice concentrations derived from the ship's ice watch log were consistent with the satellite concentrations. The surface based emissivities for FY ice were also compared with emissivities calculated from scanning multichannel microwave radiometer (SMMR) satellite radiances. Best agreement was found at 6.7 and 10-GHz, while at 18 and 37-GHz, SMMR emissivities were slightly lower than surface based results. For the three lower frequencies agreement was found within a confidence limit of 95% and for 37-GHz within about 90%.

Grenfell, T. C.↗
NASA NTRS1995

Is coverage a factor in non-Gaussianity of IMF parameters?

Recently, Feynman and Ruzmaikin (1994) showed that IMF parameters for the 1973 to 1990 period are not log-normally distributed as previously suggested by Burlaga and King (1979) for the data obtained over a shorter time period (1963-75). They studied the first four moments, namely: mean, variance, skewness, and kurtosis. For a Gaussian distribution, moments higher than the variance should vanish. In particular, Feynman and Ruzmaikin obtained very high values of kurtosis during some periods of their analysis. We note that the coverage for IMF parameters is very uneven for the period analyzed by them, ranging from less than 40% to greater than 80%. So a question arises as to whether the amount of coverage is a factor in their analysis. We decided to test this for the B(sub z) component of IMF, since it is an effective geoactive parameter for short term disturbances. Like them, we used 1-hour averaged data available on the Omnitape. We studied the scatter plots of the annual mean values of B(sub z)(nT) and its kurtosis versus the percent coverage for the year. We obtain a correlation coefficient of 0.48 and 0.42 respectively for the 1973-90 period. The probability for a chance occurrence of these correlation coefficients for 18 pair of points is less than 8%. As a rough measure of skewness, we determined the percent asymmetry between the areas of the histograms representing the distributions of the positive and the negative values of B(sub z) and studied its correlation with the coverage for the year. This analysis yields a correlation coefficient of 0.41 When we extended the analysis for the whole period for which IMF data are available (1963-93) the corresponding correlation coefficients are 0.59, 0.14, and 0.42. Our findings will be presented and discussed

Ahluwalia, H. S.↗
NASA NTRS1998

Worldwide Research, Worldwide Participation: Web-Based Test Logger

Thanks to the World Wide Web, a new paradigm has been born. ESCORT (steady state data system) facilities can now be configured to use a Web-based test logger, enabling worldwide participation in tests. NASA Lewis Research Center's new Web-based test logger for ESCORT automatically writes selected test and facility parameters to a browser and allows researchers to insert comments. All data can be viewed in real time via Internet connections, so anyone with a Web browser and the correct URL (universal resource locator, or Web address) can interactively participate. As the test proceeds and ESCORT data are taken, Web browsers connected to the logger are updated automatically. The use of this logger has demonstrated several benefits. First, researchers are free from manual data entry and are able to focus more on the tests. Second, research logs can be printed in report format immediately after (or during) a test. And finally, all test information is readily available to an international public.

Clark, David A.↗
NASA NTRS2002

Deep Space Network equipment performance, reliability, and operations management information system

The Deep Space Mission System (DSMS) Operations Program Office and the DeepSpace Network (DSN) facilities utilize the Discrepancy Reporting Management System (DRMS) to collect, process, communicate and manage data discrepancies, equipment resets, physical equipment status, and to maintain an internal Station Log. A collaborative effort development between JPL and the Canberra Deep Space Communication Complex delivered a system to support DSN Operations.

discrepancy reporting DSN operations web-based too↗
NASA NTRS2019

Long-Term Impacts of Selective Logging on Amazon Forest Dynamics from Multi-Temporal Airborne LiDAR

Forest degradation is common in tropical landscapes, but estimates of the extent and duration of degradation impacts are highly uncertain. In particular, selective logging is a form of forest degradation that alters canopy structure and function, with persistent ecological impacts following forest harvest. In this study, we employed airborne laser scanning in 2012 and 2014 to estimate three-dimensional changes in the forest canopy and understory structure and aboveground biomass following reduced-impact selective logging in a site in Eastern Amazon. Also, we developed a binary classification model to distinguish intact versus logged forests. We found that canopy gap frequency was significantly higher in logged versus intact forests even after 8 years (the time span of our study). In contrast, the understory of logged areas could not be distinguished from the understory of intact forests after 6–7 years of logging activities. Measuring new gap formation between LiDAR acquisitions in 2012 and 2014, we showed rates 2 to 7 times higher in logged areas compared to intact forests. New gaps were spatially clumped with 76 to 89% of new gaps within 5 m of prior logging damage. The biomass dynamics in areas logged between the two LiDAR acquisitions was clearly detected with an average estimated loss of -4.14 +/- 0.76 MgC/hay. In areas recovering from logging prior to the first acquisition, we estimated biomass gains close to zero. Together, our findings unravel the magnitude and duration of delayed impacts of selective logging in forest structural attributes, confirm the high potential of airborne LiDAR multitemporal data to characterize forest degradation in the tropics, and present a novel approach to forest classification using LiDAR data.

Pinage, Ekena Rangel↗
DOE OSTI2024

Machine Learning Applications in Analyzing the Role of Shale Barriers and Baffles for CO2 Storage

This study uses machine learning to analyze microseismic data from the Illinois Basin Decatur Project (IBDP) and quantify CO₂ plume extents. By leveraging well logs, microseismic records, and CO₂ injection metrics, the research predicts subsurface CO₂ plume dynamics. Findings show vertical clustering of microseismic events near the injection well, with CO₂ periodically breaching barriers due to buoyancy. K-Means clustering performed best, achieving the highest Silhouette Score and lowest Davies-Bouldin Index. This capability is crucial for real-time monitoring and management of CO₂ sequestration sites, validated against physical models and IBDP data, reinforcing CO₂ geological sequestration's viability and enhancing management tools.

Carr, Timothy↗
NASA NTRS2018

Quantifying Long-Term Changes in Carbon Stocks and Forest Structure from Amazon Forest Degradation

Despite sustained declines in Amazon deforestation, forest degradation from logging and firecontinues to threaten carbon stocks, habitat, and biodiversity in frontier forests along the Amazon arcof deforestation. Limited data on the magnitude of carbon losses and rates of carbon recoveryfollowing forest degradation have hindered carbon accounting efforts and contributed to incompletenational reporting to reduce emissions from deforestation and forest degradation (REDD+). Wecombined annual time series of Landsat imagery and high-density airborne lidar data to characterizethe variability, magnitude, and persistence of Amazon forest degradation impacts on abovegroundcarbon density (ACD) and canopy structure. On average, degraded forests contained 45.1% of thecarbon stocks in intact forests, and differences persisted even after 15 years of regrowth. Incomparison to logging, understory fires resulted in the largest and longest-lasting differences in ACD.Heterogeneity in burned forest structure varied by fire severity and frequency. Forests with a historyof one, two, and three or more fires retained only 54.4%, 25.2%, and 7.6% of intact ACD,respectively, when measured after a year of regrowth. Unlike the additive impact of successive fires,selective logging before burning did not explain additional variability in modeled ACD loss andrecovery of burned forests. Airborne lidar also provides quantitative measures of habitat structure thatcan aid the estimation of co-benefits of avoided degradation. Notably, forest carbon stocks recoveredfaster than attributes of canopy structure that are critical for biodiversity in tropical forests, includingthe abundance of tall trees. We provide the first comprehensive look-up table of emissions factors forspecific degradation pathways at standard reporting intervals in the Amazon. Estimated carbon lossand recovery trajectories provide an important foundation for assessing the long-term contributionsfrom forest degradation to regional carbon cycling and advance our understanding of the currentstate of frontier forests.

Rappaport, Danielle I.↗
DOE OSTI2024

Oscilloscope Data Push Program

This paper details the development of a Python program designed to automate the data acquisition and conversion for an oscilloscope for the purposes of a one-off/temporary data acquisition system for users that readily need data, and do not have the option of obtaining a Data Acquisition (DAQ) solution. Creating DAQ systems for analyzing a system requires expensive electronics and a dedicated team of engineers for support. Traditionally, manual data collection and processing are time consuming and prone to error. By automating these processes, the cost, efficiency and accuracy of data handling are improved upon. This project involves the creation of a program that interacts with the oscilloscope. During this interaction, there are various functions being performed such as the acquisition of waveform data via floating points, generating plots with the acquired wave points, and storing of floating points in a CSV file format for future reference and plotting purposes. While the initial aim of the project included continuous logging to a cloud database, this was deferred due to time constraints. The results portrayed an almost-instant rate of data collection with a buffer time, showcasing the potential for further integration and real-time data processing.

Osei-Tutu, Jason↗
NASA NTRS2021

A Semi-Empirical Scheme for Bathymetric Mapping in Shallow Water by ICESat-2 and Sentinel-2: A Case Study in the South China Sea

To derive shallow water bathymetry for coastal areas, a common approach is to deploy a scanning airborne bathymetric light detection and ranging (LiDAR) system or a shipborne echosounder for ground surveys. However, recent advancements in satellite remote sensing, including the Ice, Cloud and land Elevation Satellite-2 (ICESat-2) offer new tools for generating satellite derived bathymetry (SDB). The key payload onboard ICESat-2 is the Advanced Topographic Laser Altimeter System (ATLAS), a micro-pulse, photon-counting LiDAR system, simultaneously emitting six separate 532 nm beams at 10 kHz pulse rate. However, despite its high resolution, the major limitation for bathymetry is that ICESat-2 only provides along-track height profiles, leaving observation gaps between the parallel ground tracks. Merging ICESat-2 observations with optical multispectral imagery, as demonstrated herein, provides an effective solution for deriving a full scene of water depth in light of the spectral attenuation behavior. This study aims to combine ICESat-2 and Sentinel-2 optical data to derive shallow water bathymetry (depth <20 m) at six islands and reefs in the South China Sea. ICESat-2 ATL03 point clouds of georeferenced photons are first filtered to determine the seafloor elevation along the ground track. Results indicate a root-mean-square error (RMSE) of 0.26–0.61 m as compared with independent observations from an airborne LiDAR campaign. Next, three semi-empirical functions, namely the Modified Linear/Polynomial/Exponential Ratio Models with its kernel formed by the log ratio between Sentinel-2′s green and blue bands, are used to fit the spectral data with ICESat-2 height profiles. After water depth mapping using the trained model, independent ICESat-2 point clouds are used to validate the Sentinel-2 derived bathymetry. The RMSE values of the three models using the weighted average of multiple images for these six islands are within 0.50–0.90 m in 0–15 m deep. We also demonstrate that a synthesis of satellite laser altimetry and optical remote sensing can produce SDB results that potentially meet the requirement of category C in Zones of Confidence (ZOC) of the Electronic Navigational Chart (ENC) in 0–8 m deep. It is foreseen that ICESat-2 will be a helpful tool for mapping coastal and shallow waters around the world especially where bathymetric data are unavailable.

Coastal Bathymetry↗
DOE OSTI2020

Pulsed Neutron Capture for Monitoring CO 2 Storage with Enhanced Oil Recovery in Northern Michigan

The Midwest Regional Carbon Sequestration Partnership (MRCSP) was founded in 2003 as part of the U.S. Department of Energy’s (DOE’s) Regional Carbon Sequestration Partnership initiative. Since its founding, MRCSP has made significant strides toward making CCUS a viable option for states in the region. The public/private consortium, funded through the DOE Regional Carbon Sequestration Initiative, brings together nearly 40 industry partners and 10 states. Battelle, as the project lead, oversees research, development and operations and coordinates activities among the partners. The incremental, phased approach has built a valuable knowledge base for the industry and paved the way for commercial-scale adoption of CCUS technologies. From 2008 to 2020, MRCSP Phase III focused on the development of large-scale injection projects. This report is part of a series of reports prepared under the Midwestern Regional Carbon Sequestration Partnership (MRCSP) Phase III (Development Phase). These reports summarize and detail the findings of the work conducted under the Phase III project. Pulsed neutron capture (PNC) logging has been used as part of the MRCSP monitoring of CO 2 injection and storage during assessment of enhanced oil recovery (EOR) in several Northern Niagara Pinnacle Reef Trend (NNPRT) reefs in Michigan. This technique and data processing cost less than traditional fluid sampling and presents a low risk to well operations by utilizing through-tubing logging capabilities. Additionally, monitoring CO 2 migration and break-through can be conducted from a single monitoring well in the reservoir. A total of four reefs were selected for these studies to monitor CO 2 migration and to test the viability and effectiveness of the PNC technology for saturation monitoring in a low porosity and highly diverse lithology environment. This study provides assessment of the technology and recommendations for utilization of saturation analysis.

01 COAL, LIGNITE, AND PEAT↗
DOE OSTI2021

Core Analysis E-Reports Produced for the Southwest Regional Partnership on Carbon Sequestration for Wells 13-10A, 13-14, and 32-8 of the Farnsworth Unit, Texas

The submission is three electronic reports (e-reports) produced by Terra Tek, a former Schlumberger company, for and under the oversight of the Southwest Regional Partnership on Carbon Sequestration (SWP). The SWP designed and implemented a coring and core analysis program in conjunction with the previous field operator Chaparral Energy, L.L.C. The main SWP contacts who oversaw the coring and core analysis program, including geologic core descriptions and sample selection for testing by the Terra Tek, are listed below in the Authors section. The three reports are for Wells 13-10A, 13-14, and 32-8 of the Farnsworth Unit, TX, a site of the SWP's CO2 storage and enhanced oil recovery project. The e-reports include many data types that are not listed in full detail here, but may include: geomechanical, geochemical, and petrophysical measurements; white light and UV core photos; spectral gamma logs on the core; and Heterogeneous Rock Analysis logs. Fracture core review reports are included for Wells 13-14 and 32-8. The three e-reports each have many subfolders with the various types of data in spreadsheets, pdfs, image files, or other formats. The main e-reports for each well are listed by the well name. The sub-folder “E-Report” for each well has a Report.html file, which, when opened, will have hyperlinks to the various data sets and information. The files in the zipped folder will need to be extracted for the Report.html files to work properly. These authors thank Joseph Hall, a geologist formerly of Chaparral Energy, L.L.C., for assistance in designing the coring program, his geologic expertise of the Farnsworth Unit, and his assistance with characterizing the core. Christopher Gillespie, of Terra Tek at the time, managed the myriad geomechanical, geochemical, and petrophysical measurements provided by Terra Tek for this project. The core from which the samples were collected for this project are housed at the Subsurface Data and Core Libraries of the New Mexico Bureau of Geology and Mineral Resources, Socorro, New Mexico, USA. Funding for this project is provided by the U.S. Department of Energy's (DOE) National Energy Technology Laboratory (NETL) through the Southwest Regional Partnership on Carbon Sequestration (SWP) under Award No. DE-FC26-05NT42591. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525. These e-reports describe objective technical results and analysis. Any subjective views or opinions that might be expressed in the reports do not necessarily represent the views of the US Department of Energy or the United States Government.

Caprock↗
NASA NTRS1986

Experiments in software reliability - Life-critical applications

The paper discusses four reliability data gathering experiments which were conducted using a small sample of programs for two problems having ultrareliability requirements, n-version programming for fault detection, and repetitive run modeling for failure and fault rate estimation. The experimental results agree with those of Nagel and Skrivan in that the program error rates suggest an approximate log-linear pattern and the individual faults occurred with significantly different error rates. Additional analysis of the experimental data raises new questions concerning the phenomenon of interacting faults. This phenomenon may provide one explanation for software reliability decay. The fourth experiment underscored the difficulty in distinguishing between observations of deficiencies in the design of the algorithm and observations of software faults for real-time process control software. These experiments are a part of a program of serial experiments being pursued by the System Validation Methods of NASA-Langley Research Center to find a means of credibly performing reliability evaluations of flight control software.

Dunham, J. R.↗
NASA NTRS2017

A UAV-Based Fog Collector Design for Fine-Scale Aerobiological Sampling

Airborne microbes are found throughout the troposphere and into the stratosphere. Knowing how the activity of airborne microorganisms can alter water, carbon, and other geochemical cycles is vital to a full understanding of local and global ecosystems. Just as on the land or in the ocean, atmospheric regions vary in habitability; the underlying geochemical, climatic, and ecological dynamics must be characterized at different scales to be effectively modeled. Most aerobiological studies have focused on a high level: 'How high are airborne microbes found?' and 'How far can they travel?' Most fog and cloud water studies collect from stationary ground stations (point) or along flight transects (1D). To complement and provide context for this data, we have designed a UAV-based modified fog and cloud water collector to retrieve 4D-resolved samples for biological and chemical analysis.Our design uses a passive impacting collector hanging from a rigid rod suspended between two multi-rotor UAVs. The suspension design reduces the effect of turbulence and potential for contamination from the UAV downwash. The UAVs are currently modeled in a leader-follower configuration, taking advantage of recent advances in modular UAVs, UAV swarming, and flight planning.The collector itself is a hydrophobic mesh. Materials including Tyvek, PTFE, nylon, and polypropylene monofilament fabricated via laser cutting, CNC knife, or 3D printing were characterized for droplet collection efficiency using a benchtop atomizer and particle counter. Because the meshes can be easily and inexpensively fabricated, a set can be pre-sterilized and brought to the field for 'hot swapping' to decrease cross-contamination between flight sessions or use as negative controls.An onboard sensor and logging system records the time and location of each sample; when combined with flight tracking data, the samples can be resolved into a 4D volumetric map of the fog bank. Collected samples can be returned to the lab for a variety of analyses. Based on a review of existing flight studies, we have identified ion chromatography, metagenomic sequencing, cell staining and quantification, and ATP quantification as high-priority assays for implementation. Support for specific toxicology assays, such as methylmercury quantification, is also planned.

Design↗
DOE OSTI2020

RedMaPPer: Evolution and Mass Dependence of the Conditional Luminosity Functions of Red Galaxies in Galaxy Clusters

In this work we characterize the luminosity distribution, halo-mass dependence, and redshift evolution of red galaxies in galaxy clusters using the SDSS Data Release 8 redMaPPer cluster sample. We propose a simple prescription for the relationship between the luminosity of both red central and red satellite galaxies and the mass of their host halos, and show that this model is well fit by the data. Using a larger galaxy cluster sample than previously employed in the literature, we find that the luminosities of red central galaxies scale as $\langle \mathrm{log}L\rangle \propto {A}_{L}\mathrm{log}({M}_{200b})$, with A L = 0.39 ± 0.04, and that the scatter of the red central galaxy luminosity at fixed M 200b (${\sigma }_{\mathrm{log}L| M}$) is ${0.23}_{-0.04}^{+0.05}$ dex, with the error bar including systematics due to mis-centering of the cluster finder, photometry, and photometric redshift estimation. Our data prefers a positive correlation between the luminosity of red central galaxies and the observed richness of clusters at a fixed halo mass, with an effective correlation coefficient ${d}_{\mathrm{eff}}={0.36}_{-0.16}^{+0.17}$. The characteristic luminosity of red satellites becomes dimmer from z = 0.3 to z = 0.1 by ~20% after accounting for passive evolution. We estimate the fraction of galaxy clusters where the brightest red galaxy is not the central to be P BNC ~ 20%. We discuss implications of these findings in the context of galaxy evolution and the galaxy–halo connection.

79 ASTRONOMY AND ASTROPHYSICS↗
NASA NTRS1996

Repeat Pass Aircraft Interferometry Results at Portage Lake, Maine and Innisfail, Australia

The NASA/JPL AIRSAR/TOPSAR instruments have the capability of collecting fully polarimetric radar data at three wavelengths (C, L, and P-bands) and dual antenna interferometry at C-band, and more recently, L-band. In order to understand frequency and baseline dependent scattering effects in vegetated regions, repeat pass interferometry data was collected for two vegetated regions in 1993. Portage Lake, Maine is a primarily coniferous forested region with some clear cutting from logging activities in the region. The second site at Innisfail, Australia borders a tropical rain forest and is situated adjacent to some major clear cut regions and banana plantations. Preliminary analysis of repeat pass data collected in these areas shows that the smaller the wavelength the greater the temporal decorrelation between passes, the longer the wavelength the greater the penetration depth for some types of vegetation canopy, yet for some vegetation canopy types, in particular for a banana plantation, there appears to be no frequency dependent penetration into the canopy.

Hensley, Scott↗
NASA NTRS1996

Repeat Pass Aircraft Interferometry Results at Portage Lake, Maine and Innisfail, Australia

The NASA/JPL AIRSAR/TOPSAR instruments have the capability of collecting fully polarimetric radar data at three wavelengths (C, L and P-Bands) and dual antenna interferometry at C-Band, and more recently L-Band. In order to understand frequency and baseline dependent scattering effects in vegetated regions repeat pass interferometry data was collected for two vegetated regions in 1993. Portage Lake, Maine is a primarily coniferous forested region with some clear cutting from logging activities in the region. The second site at Innisfail, Australia borders a tropical rain forest and is situated adjacent to some major clear cut regions and banana plantations. Preliminary analysis of repeat pass data collected in these areas shows that the smaller the wavelength the greater the temporal decorrelation between passes, the longer the wavelength the greater the penetration depth for some types of vegetation canopy, yet for some vegetation canopy types, in particular for a banana plantation there appears to be no frequency dependent penetration into the canopy.

Hensley, Scott↗
NASA NTRS2016

A UAV-Based Fog Collector Design for Fine-Scale Aerobiological Sampling

Airborne microbes are found throughout the troposphere and into the stratosphere. Knowing how the activity of airborne microorganisms can alter water, carbon, and other geochemical cycles is vital to a full understanding of local and global ecosystems. Just as on the land or in the ocean, atmospheric regions vary in habitability; the underlying geochemical, climatic, and ecological dynamics must be characterized at different scales to be effectively modeled. Most aerobiological studies have focused on a high level: 'How high are airborne microbes found?' and 'How far can they travel?' Most fog and cloud water studies collect from stationary ground stations (point) or along flight transects (1D). To complement and provide context for this data, we have designed a UAV-based modified fog and cloud water collector to retrieve 4D-resolved samples for biological and chemical analysis.Our design uses a passive impacting collector hanging from a rigid rod suspended between two multi-rotor UAVs (Unmanned Aerial Vehicles). The suspension design reduces the effect of turbulence and potential for contamination from the UAV downwash. The UAVs are currently modeled in a leader-follower configuration, taking advantage of recent advances in modular UAVs, UAV swarming, and flight planning.The collector itself is a hydrophobic mesh. Materials including Tyvek, PTFE, nylon, and polypropylene monofilament fabricated via laser cutting, CNC knife, or 3D printing were characterized for droplet collection efficiency using a benchtop atomizer and particle counter. Because the meshes can be easily and inexpensively fabricated, a set can be pre-sterilized and brought to the field for 'hot swapping' to decrease cross-contamination between flight sessions or use as negative controls.An onboard sensor and logging system records the time and location of each sample; when combined with flight tracking data, the samples can be resolved into a 4D volumetric map of the fog bank. Collected samples can be returned to the lab for a variety of analyses. Based on a review of existing flight studies, we have identified ion chromatography, metagenomic sequencing, cell staining and quantification, and ATP quantification as high-priority assays for implementation. Support for specific toxicology assays, such as methyl-mercury quantification, is also planned.

Design↗
DOE OSTI2025

DEDUPKV: A Space-Efficient and High-Performance Key-Value Store via Fine-Grained Deduplication

Log-Structured Merge Tree (LSM-tree) based key-value stores excel in write-intensive environments but suffer from data duplication, consuming up to 49% of storage space in LSM-tree-based key-value store deployments. Traditional solutions like compression and coarse-grained file system-level deduplication introduce overhead or have limited effectiveness. In this study, we propose DedupKV, a fine-grained deduplication framework tailored for LSM-tree, maximizing data reduction efficiency while minimizing write stalls and read overheads. DedupKV features three key innovations: (1) FLUSH-integrated inline deduplication, which removes duplicates during memory-to-storage writes; (2) WAL file-based offline deduplication, repurposing write-ahead logs to avoid double writes; and (3) elastic execution, dynamically balancing inline and offline deduplication based on memory pressure and workload intensity. Additionally, dynamic granularity management reduces deduplication metadata overhead. We implemented these four ideas in RocksDB for the first time and conducted experiments in a Linux environment. Our evaluation shows that WAL file-based offline deduplication and DedupKV outperform BlobDB by 33% and 23%, respectively, in write-heavy workloads, while reducing write amplification by 1.2 ×, 2 ×, and 1.6 × for real KV datasets.

Jamil, Safdar [Sogang University]↗