Author Correction: The FLUXNET2015 dataset and the ONEFlux processing pipeline for eddy covariance data
Correction to: Scientific Data https://doi.org/10.1038/s41597-020-0534-3, published online 09 July 2020
SEARCH · Engineering Papers
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Correction to: Scientific Data https://doi.org/10.1038/s41597-020-0534-3, published online 09 July 2020
Not Available
Digital image sensors are ubiquitous in astronomical instrumentation and it is well known that they suffer from issues that must be corrected for data to be scientifically useful. I present discussion on errors resulting from digitization and characterization of nonlinearity and ADC errors of the PhotonFocus MV-D1024E cameras selected for the K-coronagraph of the Coronal Solar Magnetism Observatory. I derive an analytic expression for quantization errors. The MV-D1024E camera has adequate bit depth for which quantization error is not an issue. I show that this is not the case for all cameras, particularly those with deep wells and low read noise. The impact of nonlinearity and ADC errors on science observations of the K-coronagraph is analyzed using a simplified telescope model. Errors caused by the camera ADCs result in systematic errors in the measurement of the polarimetric signal of several times 10{sup −9} B {sub ⊙}, which is about an order of magnitude above the desired sensitivity. I demonstrate a method for post-facto data correction using a lookup table and derive parameters from camera characterization measurements that were made with a lab setup. Nonlinearity is traditionally addressed with a global correction. I show through analysis of calibration data that for the MV-D1024E this correction leaves residual systematic errors after dark and gain correction of up to 1% of the signal. I demonstrate that a pixel-wise correction of nonlinearity reduces the errors to below 0.1%. These corrections are necessary for the K-coronagraph data products to meet the science requirements. They have been implemented in the instrument data acquisition system and data reduction pipeline. While no other instruments besides the K-coronagraph or cameras besides the MV-D1024E are discussed here, the results are illustrative for all instruments and cameras.
The U.S. Department of Energy’s (DOE) Atmospheric Radiation Measurement (ARM) User Facility operates three fixed-site observatories: Eastern North Atlantic (ENA), North Slope of Alaska (NSA), and Southern Great Plains (SGP). Each fixed site has a wide variety of atmospheric instrumentation that has been collecting data for at least 10 years (NSA and SGP over 25 years). Each site is unique because it represents a different climate state. The environment at ENA is characterized by marine stratocumulus clouds and one of the key scientific areas of focus is the interaction of these clouds with aerosols. At NSA the focus is on arctic climate and cloud and radiative processes in a high-latitude environment. SGP represents a mid-latitude, mid-continent climate that experiences environmental cycles on diurnal and seasonal time scales. The ARM observatories are all meant to improve understanding of atmospheric processes that can then be better incorporated into weather and climate models. Another common thread between the fixed sites is the focus on cloud processes. Each site is equipped with at least one radar that provides continuous remote-sensing observations of clouds and precipitation. This report details the analysis of a1-level radar data at the fixed sites and the process for generating b1-level data. While b1-level data have been produced for ARM campaigns at the mobile facilities, this is the first analysis led by ARM radar mentors to correct data at the fixed sites. In particular, we focus on calibrations and corrections of the Ka-band ARM Zenith Radars (KAZRs) at ENA, NSA, and SGP. Ongoing and future work will involve corrections applied to other fixed-site radars.
Quantum errors are primarily detected and corrected using the measurement of syndrome information which itself is an unreliable step in practical error correction implementations. Typically, such faulty or noisy syndrome measurements are modeled as a binary measurement outcome flipped with some probability. However, the measured syndrome is in fact a discretized value of the continuous voltage or current values obtained in the physical implementation of the syndrome extraction. In this paper, we use this "soft" or analog information without the conventional discretization step to benefit the iterative decoders for decoding quantum low-density parity-check (QLDPC) codes. Syndrome-based iterative belief propagation (BP) decoders are modified to utilize the syndrome-soft information to successfully correct both data and syndrome errors simultaneously, without repeated measurements. We demonstrate the advantages of extracting the soft information from the syndrome in our improved decoders, not only in terms of comparison of thresholds and logical error rates for quasi-cyclic lifted-product QLDPC code families, but also for faster convergence of iterative decoders. In particular, the new BP decoder with noisy syndrome performs as good as the standard BP decoder under ideal syndrome.
The U.S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) user facility deployed the first ARM Mobile Facility (AMF1) to Houston, Texas for the Tracking Aerosol Convection Interactions Experiment (TRACER) field campaign. The TRACER campaign was conducted from October 1, 2021 to September 30, 2022, with an intensive operational period (IOP) from June 1 to September 30, 2022. To investigate the life cycles of convective cells in the polluted and humid urban environment of Houston, ARM deployed cloud and precipitation radars, including the C-band Scanning ARM Precipitation Radar (CSAPR2), the X/Ka-band Scanning ARM Cloud Radar (SACR), and the Ka-band ARM Zenith cloud Radar (KAZR), as shown in Figure 1. This report presents an analysis of radar data quality, hardware calibrations, and radar data corrections.
This is a code repository for a set of tools for detecting and mitigating data shifts in machine learning. The goal of the tools is to provide capabilities for determining when new data sets differ from training data sets and for adapting existing models to new data or correcting data shifts (via domain adaptation). The components will be written in Python, a high-level programming language that takes advantage of the Python ecosystem of high-quality open-source packages for machine learning and signal processing.
Significant errors related to poor time zero estimation, well deviation or mislocation of the transmitter (TX) and receiver (RX) stations can render even the most sophisticated modeling and inversion routine useless. Previous examples of methods for the analysis and correction of data errors in geophysical tomography include the works of Maurer and Green (1997), Squires et al. (1992) and Peterson (2001). Here we follow the analysis and techniques of Peterson (2001) for data quality control and error correction. Through our data acquisition and quality control procedures we have very accurate control on the surface locations of wells, the travel distance of both the transmitter and receiver within the boreholes, and the change in apparent zero time. However, we often have poor control on well deviations, either because of economic constraints or the nature of the borehole itself prevented the acquisition of well deviation logs. Also, well deviation logs can sometimes have significant errors. Problems with borehole deviations can be diagnosed prior to inversion of travel-time tomography data sets by plotting the apparent velocity of a straight ray connecting a transmitter (TX) to a receiver (RX) against the take-off angle of the ray. Issues with the time-zero pick or distances between wells appear as symmetric smiles or frown in these QC plots. Well deviation or dipping-strong anisotropy will result in an asymmetric correlation between apparent velocity and take-off angle (Figure 1-B). In addition, when a network of interconnected GPR tomography data is available, one has the additional quality constraint of insuring that there is continuity in velocity between immediately adjacent tomograms. A sudden shift in the mean velocity indicates that either position deviations are present or there is a shift in the pick times. Small errors in well geometry may be effectively treated during inversion by including weighting, or relaxation, parameters into the inversion (e.g. Bautu et al., 2006). In the technique of algebraic reconstruction tomography (ART), which is used herein for the travel time inversion (Peterson et al., 1985), a small relaxation parameter will smooth imaging artifacts caused by data errors at the expense of resolution and contrast (Figure 2). However, large data errors such as unaccounted well deviations cannot be adequately suppressed through inversion weighting schemes. Previously, problems with tomograms were treated manually. However, in large data sets and/or networks of data sets, trial and error changes to well geometries become increasingly difficult and ineffective. Mislocation of the transmitter and receiver stations of GPR cross-well tomography data sets can lead to serious imaging artifacts if not accounted for prior to inversion. Previously, problems with tomograms have been treated manually prior to inversion. In large data sets and/or networks of tomographic data sets, trial and error changes to well geometries become increasingly difficult and ineffective. Our approach is to use cross-well data quality checks and a simplified model of borehole deviation with particle swarm optimization (PSO) to automatically correct for source and receiver locations prior to tomographic inversion. We present a simple model of well deviation, which is designed to minimize potential corruption of actual data trends. We also provide quantitative quality control measures based on minimizing correlations between take-off angle and apparent velocity, and a quality check on the continuity of velocity between adjacent wells. This methodology is shown to be accurate and robust for simple 2-D synthetic test cases. Plus, we demonstrate the method on actual field data where it is compared to deviation logs. This study shows the promise for automatic correction of well deviations in GPR tomographic data. Analysis of synthetic data shows that very precise estimates of well deviation can be made for small deviations, even in the presence of static data errors. However, the analysis of the synthetic data and the application of the method to a large network of field data show that the technique is sensitive to data errors varying between neighboring tomograms.
Correctly incorporating the influence of mechanical joints in built-up mechanical systems is a critical element for model development for structural dynamics predictions. Quality experimental data are often difficult to obtain and is rarely sufficient to determine fully parameters for relevant mathematical models. On the other hand, fine-mesh finite element (FMFE) modeling facilitates innumerable numerical experiments at modest cost. Detailed FMFE analysis of built-up structures with frictional interfaces reproduces trends among problem parameters found experimentally, but there are qualitative differences. Those differences are currently ascribed to the very approximate nature of the friction model available in most finite element codes. Though numerical simulations are insufficient to produce qualitatively correct behavior of joints, some relations, developed here through observations of a multitude of numerical experiments, suggest interesting relationships among joint properties measured under different loading conditions. These relationships can be generalized into forms consistent with data from physical experiments. One such relationship, developed here, expresses the rate of energy dissipation per cycle within the joint under various combinations of extensional and clamping load in terms of dissipation under other load conditions. The use of this relationship-though not exact-is demonstrated for the purpose of extrapolating a representative set of experimental data to span the range of variability observed from real data.
This presentation discusses standard techniques and processes used for radiation mapping (RM) via an AMS, Aerial Measurement System. The advantages and shortcomings of standard AMS-based RM are presented, along with some suggested areas for improvement. Issues touched on include what gets counted, data quality, background correction, data processing, altitude correction, isotope extraction, contouring, and time shift.
This report explores how error-correction data generated by a Reed-Solomon code may be used as a mechanism to apply changes to an existing installed codebase. Using the Reed-Solomon code to generate error-correction data for a changed or updated codebase will allow the error-correction data to be applied to an existing codebase to both validate and introduce changes or updates from some upstream source to the existing installed codebase.
The Nuclear Data Interface 2.2.0 has been released. It includes the addition of charged particle dE/dx (stopping power) data, the ability to read in NDI-formatted binary data, corrections to TN data, and other minor changes and bug fixes.
The Nuclear Data Interface 2.2.0alpha has been released. It includes the addition of charged particle dE/dx (stopping power) data, the ability to read in NDI-formatted binary data, corrections to TN data, CP 2011 and CP 2020 data, and other minor changes and bug fixes.
Purpose: In computed tomography (CT) system, CT images with ring artifacts will be reconstructed when some adjacent bins of detector don’t work. The ring artifacts severely degrade CT image quality. We present a useful CT ring artifacts reduction based on projection data correction, aiming at estimating the missing data of projection data accurately, thus removing the ring artifacts of CT images. Methods: The method consists of ten steps: 1) Identification of abnormal pixel line in projection sinogram; 2) Linear interpolation within the pixel line of projection sinogram; 3) FBP reconstruction using interpolated projection data; 4) Filtering FBP image using mean filter; 5) Forwarding projection of filtered FBP image; 6) Subtraction forwarded projection from original projection; 7) Linear interpolation of abnormal pixel line area in the subtraction projection; 8) Adding the interpolated subtraction projection on the forwarded projection; 9) FBP reconstruction using corrected projection data; 10) Return to step 4 until the pre-set iteration number is reached. The method is validated on simulated and real data to restore missing projection data and reconstruct ring artifact-free CT images. Results: We have studied impact of amount of dead bins of CT detector on the accuracy of missing data estimation in projection sinogram. For the simulated case with a resolution of 256 by 256 Shepp-Logan phantom, three iterations are sufficient to restore projection data and reconstruct ring artifact-free images when the dead bins rating is under 30%. The dead-bin-induced artifacts are substantially reduced. More iteration number is needed to reconstruct satisfactory images while the rating of dead bins increases. Similar results were found for a real head phantom case. Conclusion: A practical CT image ring artifact correction scheme based on projection data is developed. This method can produce ring artifact-free CT images feasibly and effectively.
In May 1990, a quartz tube extensometer was installed in the Sopronbanfalva Geodynamic Observatory of the Geodetic and Geophysical Research Institute (GGRI) of the Hungarian Academy of Sciences for recording Earth tides and recent tectonic movements. The paper describes the construction of the extensometer and a portable calibrator used for the in situ calibration of the instrument. The extensometer is very sensitive. Its scale factor is 2.093{+-}0.032 nm/mV according to the highly precise calibration method developed at the GGRI. Since the stability of extensometers is strongly influenced by the geological structure and properties of the rocks in the vicinity of the recording site, the observatory instrument system was tested by coherence analysis between theoretical (as the input signal) and measured tidal data series (as the output signal). In the semidiurnal tidal frequency band the coherence is better than 0.95, while in the diurnal band it is about 0.8. Probably this is due to the fact that the noise is higher in the diurnal band (0.4-0.5 nstr) than in the semidiurnal band (0.19-0.22 nstr). Coherence analysis between theoretical and measured data corrected for barometric changes yielded a small improvement of coherence in both frequency bands, while using temperature data correction, no observable improvement was obtained. Results of the tidal analysis also show that the observatory instrument system is suitable for recording very small tectonic movements. The 18 years of continuous data series measured by the extensometer prove the high quality of the extensometer. On the basis of investigations, it was pointed out that further efforts should be done to improve the barometric correction method and that correction for ocean load, as well as considering topographic and cavity effects are necessary to increase the accuracy of determining tidal parameters.
Purpose: Positron emission tomography (PET) imaging of yttrium-90 in the liver post radioembolization has been shown useful for personalized dosimetry calculations and evaluation of extrahepatic deposition. The purpose of this study was to quantify the benefits of several MR-based data correction approaches offered by using a combined PET/MR system to improve Y-90 PET imaging. In particular, the feasibility of motion and partial volume corrections were investigated in a controlled phantom study. Methods: The ACR phantom was filled with an initial concentration of 8 GBq of Y-90 solution resulting in a contrast of 10:1 between the hot cylinders and the background. Y-90 PET motion correction through motion estimates from MR navigators was evaluated by using a custom-built motion stage that simulated realistic amplitudes of respiration-induced liver motion. Finally, the feasibility of an MR-based partial volume correction method was evaluated using a wavelet decomposition approach. Results: Motion resulted in a large (∼40%) loss of contrast recovery for the 8 mm cylinder in the phantom, but was corrected for after MR-based motion correction was applied. Partial volume correction improved contrast recovery by 13% for the 8 mm cylinder. Conclusions: MR-based data correction improves Y-90 PET imaging on simultaneous PET/MR systems. Assessment of these methods must be studied further in the clinical setting.
This report documents the evaluation of the information and data available on the unclassified source term and radionuclide contamination for CAU 97: Yucca Flat/Climax Mine. The total residual inventory of radionuclides associated with one or more tests is known as the radiologic source term (RST). The RST is comprised of radionuclides in water, glass, or other phases or mineralogic forms. The hydrologic source term (HST) of an underground nuclear test is the portion of the total RST that is released into the groundwater over time following the test. In this report, the HST represents radionuclide release some time after the explosion and does not include the rapidly evolving mechanical, thermal, and chemical processes during the explosion. The CAU 97: Yucca Flat/Climax Mine has many more detonations and a wider variety of settings to consider compared to other CAUs. For instance, the source term analysis and evaluation performed for CAUs 101 and 102: Central and Western Pahute Mesa and CAU 98: Frenchman Flat did not consider vadose zone attenuation because many detonations were located near or below the water table. However, the large number of Yucca Flat/Climax Mine tests and the location of many tests above the water table warrant a more robust analysis of the unsaturated zone.
This report documents the evaluation of the information and data available on the unclassified source term and radionuclide contamination for CAU 97: Yucca Flat/Climax Mine. The total residual inventory of radionuclides associated with one or more tests is known as the radiologic source term (RST). The RST is comprised of radionuclides in water, glass, or other phases or mineralogic forms. The hydrologic source term (HST) of an underground nuclear test is the portion of the total RST that is released into the groundwater over time following the test. In this report, the HST represents radionuclide release some time after the explosion and does not include the rapidly evolving mechanical, thermal, and chemical processes during the explosion. The CAU 97: Yucca Flat/Climax Mine has many more detonations and a wider variety of settings to consider compared to other CAUs. For instance, the source term analysis and evaluation performed for CAUs 101 and 102: Central and Western Pahute Mesa and CAU 98: Frenchman Flat did not consider vadose zone attenuation because many detonations were located near or below the water table. However, the large number of Yucca Flat/Climax Mine tests and the location of many tests above the water table warrant a more robust analysis of the unsaturated zone. The purpose of this report is to develop and document conceptual models of the Yucca Flat/Climax Mine HST for use in implementing source terms for the Yucca Flat/Climax Mine models. This document presents future plans to incorporate the radionuclide attenuation mechanisms due to unsaturated/multiphase flow and transport within the Yucca Flat CAU scale modeling. The important processes that influence radionuclide migration for the unsaturated and saturated tests in alluvial, volcanic, and carbonate settings are identified. Many different flow and transport models developed by Lawrence Livermore National Laboratory (LLNL) and Los Alamos National Laboratory (LANL), including original modeling of multiphase flow and transport by the Stoller-Navarro Joint Venture (SNJV), are integrated to form a general understanding of how the RST relates to the HST. This report is unlike the Frenchman Flat source term analysis because it does not calculate the HST for each test. Instead, this work only identifies the important processes that must be considered when the CAU-transport modeling is performed.