Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “normal measurement error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Assessment of Clonal Expansion Using CarcSeq Measurement of Lung Cancer Driver Mutations and Correlation With Mouse Strain- and Sex-Related Incidence of Spontaneous Lung Neoplasia

Quantification of variation in levels of spontaneously occurring cancer driver mutations (CDMs) was developed to assess clonal expansion and predict future risk of neoplasm development. Specifically, an error-corrected next-generation sequencing method, CarcSeq, and a mouse CarcSeq panel (analogous to human and rat panels) were developed and used to quantify low-frequency mutations in a panel of amplicons enriched in hotspot CDMs. Mutations in a subset of panel amplicons, Braf, Egfr, Kras, Stk11, and Tp53, were related to incidence of lung neoplasms at 2 years. This was achieved by correlating median absolute deviation (MAD) from the overall median mutant fraction (MF) measured in the lung DNA of 16-week-old male and female, B6C3F1 and CD-1 mice (10 mice/sex/strain) with percentages of spontaneous alveolar/bronchioloalveolar adenomas and carcinomas reported in bioassay control groups. A total of 1586 mouse lung mutants with MFs > x 10-4 were recovered. The ratio of nonsynonymous to synonymous mutations was used to assess the proportion of recovered mutations conferring a positive selective advantage. The greatest ratio was observed in what is considered the most lung tumor-sensitive model examined, male B6C3F1 mice. Of the recurrent, nonsynonymous mouse mutations recovered, 55.5% have been reported in human tumors, with many located in or around the mouse equivalent of human cancer hotspot codons. MAD for the same subset of amplicons measured in normal human lung DNA samples showed a correlation of moderate strength and borderline significance with age (a cancer risk factor), as well as age-related cumulative lung cancer risk, suggesting MAD may inform species extrapolation.

Toxicology↗

Improving multiwell petrophysical interpretation from well logs via machine learning and statistical models

Well-log interpretation estimates in situ rock properties along well trajectory, such as porosity, water saturation, and permeability, to support reserve-volume estimation, production forecasts, and decision making in reservoir development. However, due to measurement errors, variability of well logs caused by multiple measurement vendors, different borehole tools, and nonuniform drilling/borehole conditions, estimations of rock properties with original well logs without proper preprocessing may not be accurate, especially in the context of multiwell estimation. Well-log normalization techniques such as two-point scaling and mean-variance normalization are commonly used to improve the robustness of multiwell rock-property estimation. However, these techniques do not consider the correlation between well logs and require subjective knowledge for their effective implementation. To reduce uncertainties and processing time associated with multiwell rock-property estimation from well logs, we develop discriminative adversarial (DA) and linear constraint models for well-log normalization and rock-property estimation. The DA neural network model developed for well-log normalization and interpretation can perform linear and nonlinear well-log normalization while considering the joint distribution of each well log and rock properties. However, the linear constraint model uses an ensemble of predictions from linear models to constrain well-log normalization and rock-property estimation. We also develop a divergence-based type well identification method to select type (training) wells for a test well based on the statistical similarity of associated well-log distributions instead of the interwell distance. We apply the DA model to perform well-log normalization and prediction of permeability for the Seminole San Andres Unit carbonate reservoir. Compared with the permeability predicted with the classical machine learning model without well-log normalization and models with two-point scaling normalization, the DA model yields the most accurate permeability prediction by decreasing the mean-squared error of permeability prediction by 20%–50%.

Geochemistry & Geophysics↗

Attribution of Snowpack Errors to Simulated Temperature and Precipitation in E3SMv1 Over the Contiguous United States

Abstract Snow water equivalent (SWE), temperature, and precipitation biases and trends are evaluated in the atmosphere‐land simulations of the Energy Exascale Earth System Model version 1 (E3SMv1) in comparison to the Community Earth System Model version 2 (CESM2) and two other models using the ground measurement‐based University of Arizona (UA) snow product. SWE, temperature, and precipitation biases are highest in magnitude in the Western contiguous United States (CONUS). SWE errors are attributed to temperature and precipitation through multiple linear regressions of normalized errors, the coefficients of which represent the sensitivities to temperature and precipitation errors. SWE errors are more sensitive to temperature errors throughout the CONUS. Model SWE and temperature trends are generally opposite from UA product trends in the Western CONUS. SWE trend errors are also attributed to temperature and precipitation trend errors using multiple linear regressions of normalized trend errors. SWE trend errors are more sensitive to those of precipitation at higher elevations (>1,500 m) in the Western CONUS in these simulations. Thus, the sensitivity to temperature and precipitation differ for SWE errors and its trend errors. Furthermore, the SWE trend errors are more sensitive to temperature and precipitation in the atmosphere‐ocean coupled simulations in which the atmosphere‐land is coupled to an active ocean model. These results suggest that both errors in simulated temperature and precipitation contribute to SWE errors.

Meteorology & Atmospheric Sciences↗

Field validation of dynamic mechanical torque measurements using fiber-optic strain sensors for geared wind turbines

Abstract Accurate knowledge of the mechanical loads of wind turbine gearboxes has become essential in modern, highly loaded gearbox designs, as maintaining or even improving gearbox reliability with increasing torque density demands is proving to be challenging. Unfortunately, the traditional method of measuring dynamic mechanical torque using strain gauges placed on the outer surface of a rotating shaft and transmitting the resulting signal is unsuitable for serial deployment due to technical and economic constraints. An alternative method based on fiber-optic strain sensors placed on the stationary outer surface of the gearbox ring gear has been proposed. Like shaft torsion, the radial deformation of the ring gear is proportionate to the rotor torque. Placing the sensors on a stationary component is a cost-effective alternative for serial implementation because the need for complex and expensive data transfer via wireless transmission or a slip ring is eliminated. In this paper, we present the results of an extensive field experiment conducted to evaluate the torque measurement accuracy of this novel sensing solution installed on the gearbox of a Gamesa G97 2-MW wind turbine at the National Renewable Energy Laboratory’s Flatirons Campus. Torque measurements derived from fiber-optic strain sensors placed on the ring gear of the planetary stage are compared to conventional torque measurements from strain gauges placed on the main shaft. Two different torque estimation data processing methods were evaluated, with the method based on operational deflection shapes providing the most accurate results with an average normalized root mean square error below 0.7% for a load revolution distribution analysis. The effect of operating conditions on the torque estimate was also investigated, and the third planet-passing operational deflection shape was found to be the least sensitive to nontorque load-related effects. The fiber-optic strain sensors’ successful operation during the complete test campaign has demonstrated a robust and accurate solution for fleet-wide enhanced gearbox remaining useful life estimation.

17 WIND ENERGY↗

Field Validation of Dynamic Mechanical Torque Measurements for Geared Wind Turbines

Accurate knowledge of the mechanical loads of wind turbine gearboxes has become essential in modern, highly loaded gearbox designs, as maintaining or even improving gearbox reliability with increasing torque density demands is proving to be challenging. Unfortunately, the traditional method of measuring dynamic mechanical torque using strain gauges placed on the outer surface of a rotating shaft and transmitting the resulting signal is unsuitable for serial deployment due to technical and economic constraints. An alternative method based on fiber-optic strain sensors placed on the stationary outer surface of the gearbox ring gear has been proposed. Like shaft torsion, the radial deformation of the ring gear is proportionate to the rotor torque. Placing the sensors on a stationary component is a cost-effective alternative for serial implementation because the need for complex and expensive data transfer via wireless transmission or a slip ring is eliminated. In this paper, we present the results of an extensive field experiment conducted to evaluate the torque measurement accuracy of this novel sensing solution installed on the gearbox of a Gamesa G97 2-MW wind turbine at the National Renewable Energy Laboratory's Flatirons Campus. Torque measurements derived from fiber-optic strain sensors placed on the ring gear of the planetary stage are compared to conventional torque measurements from strain gauges placed on the main shaft. Two different torque estimation data processing methods were evaluated, with the method based on operational deflection shapes providing the most accurate results with an average normalized root mean square error below 0.7% for a load revolution distribution analysis. The effect of operating conditions on the torque estimate was also investigated, and the third planet-passing operational deflection shape was found to be the least sensitive to nontorque load-related effects. The fiber-optic strain sensors' successful operation during the complete test campaign has demonstrated a robust and accurate solution for fleet-wide enhanced gearbox remaining useful life estimation.

17 WIND ENERGY↗

Measurements of the z > 5 Lyman-α forest flux autocorrelation functions from the extended XQR-30 data set

We present the first observational measurements of the Lyman-α (Ly α) forest flux autocorrelation functions in ten redshift bins from 5.1 ≤ z ≤ 6.0. We use a sample of 35 quasar sightlines at z > 5.7 from the extended XQR-30 data set; these data have signal-to-noise ratios of >20 per spectral pixel. We carefully account for systematic errors in continuum reconstruction, instrumentation, and contamination by damped Ly α systems. With these measurements, we introduce software tools to generate autocorrelation function measurements from any simulation. Our measurements of the smallest bin of the autocorrelation function increase with redshift when normalizing by the mean flux, $\langle{F}\rangle$. This increase may come from decreasing $\langle{F}\rangle$ or increasing mean free path of hydrogen-ionizing photons, λmfp. Recent work has shown that the autocorrelation function from simulations at z > 5 is sensitive to λmfp, a quantity that contains vital information on the ending of reionization. For an initial comparison, we show our autocorrelation measurements with simulation models for recently measured λmfp values and find good agreements. Further work in modelling and understanding the covariance matrices of the data is necessary to get robust measurements of λmfp from this data.

79 ASTRONOMY AND ASTROPHYSICS↗

Perturbation-Based Diagnosis of False Data Injection Attack Using Distributed Energy Resources

Modern smart grid relies on various sensor measurements for its operational control. In a successful false data injection attack, the attacker manipulates the measurements from the grid sensors such that undetected errors are introduced into the estimates of the system parameters leading to catastrophic situations. This paper proposes a novel perturbation based false data injection attack detection mechanism that utilizes inverter based distributed energy resources (DERs) to create low magnitude perturbation signal in the distribution system voltage that is inconsequential to the normal grid operation. Two voltage sensitivity analysis based algorithms are designed to identify the optimal set of DERs that can create the voltage perturbation signal of desired magnitude. An analytical method of voltage sensitivity analysis is used to compute the magnitude of voltage perturbation signal at each node in a computationally efficient manner. Then, a detection mechanism is developed that checks for the presence of the perturbation sequence in each sensor measurement. A sensor measurement is deemed authentic if the voltage perturbation signal is present in the data. In case of sensor malfunction or cyber-attack, the perturbation signal will not be present in the measurement data. Performance of the proposed attack detection mechanism is validated via simulation of the IEEE 69 bus test system.

24 POWER TRANSMISSION AND DISTRIBUTION↗

An Unmanned Aerial System (UAS) for concurrent measurements of solar-induced chlorophyll fluorescence and hyperspectral reflectance toward improving crop monitoring

Unmanned aerial system (UAS)-based remote sensing can provide high spatial- and temporal-resolution crop monitoring for precision management. Existing crop monitoring UAS primarily use conventional techniques such as multi-spectral broadband vegetation indices (VIs) to track canopy structure/biomass. Recently developed lightweight hyperspectral sensors can track crop physiology and performance via complementary signals such as solar-induced chlorophyll fluorescence (SIF) and photochemical reflectance index (PRI) that can be derived from hyperspectral reflectance. However, few existing UAS can acquire high-quality SIF and hyperspectral reflectance. Here, we designed a novel UAS that simultaneously captures far-red SIF and hyperspectral reflectance, using a single bifurcated fiber and motorized arm to measure downwelling and upwelling irradiance. The UAS was tested over (1) a heterogeneous corn field with spatially varying crop yield potential and (2) a set of soybean and corn plots under differing nutrient treatments. Our UAS can maintain stability under low-to-moderate winds (2–3 m/s) with <0.4 m geolocation accuracy, <0.1 m altitude drift, and <1.5° error of the fiber optic from nadir position during scanning. Weekly seasonal campaigns reveal that SIF outperforms conventional VIs such as the normalized difference vegetation index (NDVI) for distinguishing plots with different crop yield potential, especially after canopy closure when NDVI tends to saturate. The UAS can capture the diurnal dynamics of SIF and PRI for both corn and soybean. At the seasonal scale, SIF acquired from the UAS correlates well with that from a fixed SIF tower system ( R 2 = 0.81), which measured the same target albeit with different footprints, demonstrating the capability of UAS in characterizing the seasonal progression of crop activity. In conclusion, our newly developed UAS provides high-quality SIF and hyperspectral reflectance, facilitating mechanistic understanding of the physiological control on photosynthesis dynamics. Our findings also imply that this UAS could enable extension of fixed tower-based systems to monitor multiple targets from diurnal to seasonal scales and improve monitoring of heterogeneous fields.

59 BASIC BIOLOGICAL SCIENCES↗

AAPM Truth‐based CT (TrueCT) reconstruction grand challenge

Background: This Special Report summarizes the 2022, AAPM grand challenge on Truth-based CT image reconstruction. Purpose: To provide an objective framework for evaluating CT reconstruction methods using virtual imaging resources consisting of a library of simulated CT projection images of a population of human models with various diseases. Methods: Two hundred unique anthropomorphic, computational models were created with varied diseases consisting of 67 emphysema, 67 lung lesions, and 66 liver lesions. The organs were modeled based on clinical CT images of real patients. The emphysematous regions were modeled using segmentations from patient CT cases in the COPDGene Phase I dataset. For the lung and liver lesion cases, 1–6 malignant lesions were created and inserted into the human models, with lesion diameters ranging from 5.6 to 21.9 mm for lung lesions and 3.9 to 14.9 mm for liver lesions. The contrast defined between the liver lesions and liver parenchyma was 82 ± 12 HU, ranging from 50 to 110 HU. Similarly, the contrast between the lung lesions and the lung parenchyma was defined as 781 ± 11 HU, ranging from 725 to 805 HU. For the emphysematous regions, the defined HU values were −950 ± 17 HU ranging from −918 to −979 HU. The developed human models were imaged with a validated CT simulator. The resulting CT sinograms were shared with the participants. The participants reconstructed CT images from the sinograms and sent back their reconstructed images. Further, the reconstructed images were then scored by comparing the results against the corresponding ground truth values. The scores included both task-generic (root mean square error [RMSE] and structural similarity matrix [SSIM]), and task-specific (detectability index [d’] and lesion volume accuracy) metrics. For the cases with multiple lesions, the measured metric was averaged across all the lesions. To combine the metrics with each other, each metric was normalized to a range of 0 to 1 per disease type, with “0” and “1” being the worst and best measured values across all cases of the disease type for all received reconstructions. Results: The True-CT challenge attracted 52 participants, out of which 5 successfully completed the challenge and submitted the requested 200 reconstructions. Across all participants and disease types, SSIM absolute values ranged from 0.22 to 0.90, RMSE from 77.6 to 490.5 HU, d’ from 0.1 to 64.6, and volume accuracy ranged from 1.2 to 753.1 mm3. The overall scores demonstrated that participant “A” had the best performance in all categories, except for the metrics of d’ for lung lesions and RMSE for liver lesions. Participant “A” had an average normalized score of 0.41 ± 0.22, 0.48 ± 0.32, and 0.42 ± 0.33 for the emphysema, lung lesion, and liver lesion cases, respectively. Conclusions: The True-CT challenge successfully enabled objective assessment of CT reconstructions with the unique advantage of access to a diverse population of diseased human models with known ground truth. This study highlights the significant potential of virtual imaging trials in objective assessment of medical imaging technologies.

60 APPLIED LIFE SCIENCES↗

Development, calibration, and validation of a novel gray-box energy model for residential split air conditioners

Energy models for vapor compression refrigeration in residential air conditioners have been developed through white-box, gray-box, and black-box methods in decades. However, existing white-box and gray-box models require complicated equations with detailed geometries while black-box models require substantial experimental data. Further, this paper aims to develop and validate a simple gray-box steady-state energy model without the need for detailed geometries, which can accurately predict the cooling capacity and electrical power input based on outdoor and indoor air conditions, and supply airflow rates. First three state variables, including the evaporation and condensation temperatures, and refrigerant mass flowrate, are applied to develop the energy model and are solved by three physical equations, including the energy conservations at the evaporator and condenser, and the refrigerant volume-mass flow correlation of the compressor. Secondly, seven performance property functions related to three state variables and three physical equations are identified and calibrated by simple temperature and power measurements. Finally, field experiments are conducted on a residential air conditioner to calibrate these performance property functions and validate the developed model. The validated results reveal the model can accurately predict the cooling capacity and electrical power input, with the normalized root mean square errors of 2.3% and 0.87% respectively.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Product Consistency Test and Vapor Hydration Test Comparisons of a Radioactive Hanford Waste Glass with its Non-Radioactive Simulant Glass

Product Consistency Tests (PCT) and Vapor Hydration Tests (VHT) were performed on a radioactive glass made from Hanford tank AP-107 waste (i.e., R-AP-107) and its non-radioactive equivalent glass made from simulated tank waste (i.e., S-AP-107). The radioactive and non-radioactive experiments were conducted in parallel with identical equipment, protocols, and staff to remove additional experimental uncertainties. PCT and VHT results are reported for all samples and are shown in Table S.1. Average normalized mass loss of B ( NL B ) and Na ( NL Na ) calculated from the three replicate test results for each glass with their respective standard deviations (SD) are presented for PCT results while individual VHT rates ( r VHT ) with their propagated errors ( σ r prop ) from individual thickness measurements on each sample are presented for the VHT results. Some VHT samples experienced more than 50% evaporation loss during the experiments. However, no visible alteration was detected on any VHT samples regardless on the amount of evaporation loss detected as shown in Table S.1.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Composition Measurements of the HFG1 Glasses

This report provides results from the analyses of glass compositions for the High Fluoride Glasses-1, a series of simulated nuclear waste glasses fabricated at the Pacific Northwest National Laboratory. The series included the quenched version of the glasses. These data will be used to validate or identify areas of potential characterization improvements in the current glass property/composition models. Chemical analyses were performed on a representative sample of each of the quenched glasses to allow for comparisons with the targeted compositions. The relative differences between the targeted and measured concentrations of F, K 2 0, and Li 2 O for some of the glasses were greater than 10%. Overall, there were no indications of errors in batching of the simulated waste glasses. These results can be used in further characterization of this series of glasses, including the normalization of Product Consistency Test results.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Multi-area parameter error identification for large power systems

Power grid model parameters may contain errors due to various reasons. Detecting and correcting parameter errors typically requires significant computational effort due to the size and complexity of the parameter database. While the normalized Lagrange multiplier (NLM) method can effectively detect, identify and correct parameter errors, its computational burden could rapidly grow with increasing system size. This paper addresses this issue by proposing a multi-area parameter error identification method. Each area has its own outlier detection tool for detecting the incorrect parameters and measurements within the area. On the other hand, due to the reduced redundancy at area boundaries, parameter errors on branches incident to boundary buses may not be detected. Such errors are subsequently detected by a coordination level estimator completing the system-wide parameter detection procedure. In conclusion, performance of the developed method is demonstrated using the IEEE 118-bus and 2000-bus Texas synthetic systems.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Calibration of cloud and aerosol related parameters for solar irradiance forecasts in WRF-solar

Model parameters are a major source of uncertainty in numerical weather prediction. Recently, the Weather Research and Forecasting model with Solar extensions (WRF-Solar) has been upgraded by enhancing the treatment of sub-grid scale cloud and aerosols with augmentations of a sub-grid scale cloud scheme (CLD3) and an upgraded aerosol-aware Thompson-Eidhammer scheme (TE14). However, the value of model parameters associated with these parameterizations are assigned based on limited measurements or theoretical calculations. Calibrating the most sensitive parameters has the potential to improve solar irradiance predictions. Here, we adopted a multiobjective surrogate-based optimization (SBO) framework to calibrate nine parameters used in CLD3 and TE14 that lead to the largest sensitivity in simulated irradiance. The normalized mean-absolute-error (NMAE) of global horizontal irradiance (GHI) and direct normal irradiance (DNI) are minimized by calibrating WRF-Solar over two regions including the Southern Great Plains (SGP) and Central California, in order to focus on parameter calibration under cloudy conditions with different aerosol loading. The results show that generalized linear model (GLM)-based surrogate models approximate physical models well, particularly when the third order and three-way interaction terms are considered. The SBO framework efficiently searches the parameter space for optimal solutions with less computational costs than directly calibrating the physical model. We first calibrate CLD3 parameters over the less-polluted SGP region. Optimized CLD3 parameters alone result in NMAE reduction by 14% for the site-mean and up to 33% for individual cases over the SGP region. With further calibration of TE14 parameters over the Central California during active fire periods, the optimized parameters lead to over 20% reductions of NMAE. Our investigation reveals, however, that optimizing TE14 has a limited impact on irradiance simulations under less-polluted conditions in the SGP.

14 SOLAR ENERGY↗

Optical functions of crystalline and amorphous TeO2

The optical functions of crystalline paratellurite (α-TeO2) and amorphous TeO2 were determined using several optical techniques: (1) standard spectroscopic two-modulator generalized ellipsometry (2-MGE) of paratellurite (200–850 nm, 6.2–1.46 eV), (2) near-normal-incidence two-modulator generalized ellipsometry microscopy (2-MGEM) of paratellurite (577 nm, 2.15 eV), (3) Mueller matrix transmission of paratellurite (320–798 nm, 3.87–1.55 eV), and (4) polarized transmission of paratellurite (323.6–334.3 nm, 3.83–3.71 eV). The 2-MGE measurements yielded highly accurate values of the dielectric functions and error estimates from 1.46 to 6.2 eV for both paratellurite and amorphous TeO2, whereas the polarization-dependent transmission yielded more accurate values of the absorption coefficient below the band edge of paratellurite. The 2-MGEM measured the diattenuation of paratellurite, which is related to the birefringence. Mueller matrix transmission measurements of paratellurite of a (001) cut crystal as a function of angle of incidence were used to determine both the birefringence and the rotary power as a function of photon energy.

Jellison Jr, Gerald [ORNL]↗

Composition Measurements of the LAW Phase 4 Glasses

In this report, the Savannah River National Laboratory provides results from the analyses of glass compositions for a series of simulated nuclear waste glasses fabricated at the Pacific Northwest National Laboratory. The series included quenched versions of the glasses. The resulting data will be used in the development of enhanced property/composition models for waste vitrification at Hanford. Chemical analyses were performed on a representative sample of each of the quenched glasses to allow for comparisons with the targeted compositions. For the quenched glasses from Set 1, measured concentrations of B 2 O 3 and SiO 2 were generally above the targeted values. Measured concentrations for MgO and P 2 O 5 were generally low for glasses. Measured concentrations of ZrO 2 were both below and above the targeted values for glasses. For the quenched glasses from Set 2, measured concentrations of AL 2 O 3 , B 2 O 3 , P 2 O 5 , SiO 2 , and ZrO 2 were generally below the targeted values. Measured concentrations of Na 2 0 were both below and above the targeted values for glasses. The measured concentrations of chlorine, fluorine, and SO 3 were below the targeted values for most of the study glasses, likely because of volatility during melting. Overall, there were no indications of errors in batching of the simulated waste glasses. These results can be used in further characterization of this series of glasses, including the normalization of Product Consistency Test results.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Seeing through noise in power laws

Despite widespread claims of power laws across the natural and social sciences, evidence in data is often equivocal. Modern data and statistical methods reject even classic power laws such as Pareto’s law of wealth and the Gutenberg–Richter law for earthquake magnitudes. We show that the maximum-likelihood estimators and Kolmogorov–Smirnov (K-S) statistics in widespread use are unexpectedly sensitive to ubiquitous errors in data such as measurement noise, quantization noise, heaping and censorship of small values. This sensitivity causes spurious rejection of power laws and biases parameter estimates even in arbitrarily large samples, which explains inconsistencies between theory and data. We show that logarithmic binning by powers of λ > 1 attenuates these errors in a manner analogous to noise averaging in normal statistics and that λ thereby tunes a trade-off between accuracy and precision in estimation. Binning also removes potentially misleading within-scale information while preserving information about the shape of a distribution over powers of λ, and we show that some amount of binning can improve sensitivity and specificity of K-S tests without any cost, while more extreme binning tunes a trade-off between sensitivity and specificity. We therefore advocate logarithmic binning as a simple essential step in power-law inference.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Seeing through noise in power laws

Despite widespread claims of power laws across the natural and social sciences, evidence in data is often equivocal. Modern data and statistical methods reject even classic power laws such as Pareto’s law of wealth and the Gutenberg–Richter law for earthquake magnitudes. We show that the maximum-likelihood estimators and Kolmogorov–Smirnov (K-S) statistics in widespread use are unexpectedly sensitive to ubiquitous errors in data such as measurement noise, quantization noise, heaping and censorship of small values. This sensitivity causes spurious rejection of power laws and biases parameter estimates even in arbitrarily large samples, which explains inconsistencies between theory and data. We show that logarithmic binning by powers of λ > 1 attenuates these errors in a manner analogous to noise averaging in normal statistics and that λ thereby tunes a trade-off between accuracy and precision in estimation. Binning also removes potentially misleading within-scale information while preserving information about the shape of a distribution over powers of λ, and we show that some amount of binning can improve sensitivity and specificity of K-S tests without any cost, while more extreme binning tunes a trade-off between sensitivity and specificity. We therefore advocate logarithmic binning as a simple essential step in power-law inference.

97 MATHEMATICS AND COMPUTING↗