Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “spatial statistics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 433 records · Page 24
All sourcesNASA NTRSDOE OSTI
NASA NTRS2014

Comparison Of Downscaled CMIP5 Precipitation Datasets For Projecting Changes In Extreme Precipitation In The San Francisco Bay Area.

Water resource managers planning for the adaptation to future events of extreme precipitation now have access to high resolution downscaled daily projections derived from statistical bias correction and constructed analogs. We also show that along the Pacific Coast the Northern Oscillation Index (NOI) is a reliable predictor of storm likelihood, and therefore a predictor of seasonal precipitation totals and likelihood of extremely intense precipitation. Such time series can be used to project intensity duration curves into the future or input into stormwater models. However, few climate projection studies have explored the impact of the type of downscaling method used on the range and uncertainty of predictions for local flood protection studies. Here we present a study of the future climate flood risk at NASA Ames Research Center, located in South Bay Area, by comparing the range of predictions in extreme precipitation events calculated from three sets of time series downscaled from CMIP5 data: 1) the Bias Correction Constructed Analogs method dataset downscaled to a 1/8 degree grid (12km); 2) the Bias Correction Spatial Disaggregation method downscaled to a 1km grid; 3) a statistical model of extreme daily precipitation events and projected NOI from CMIP5 models. In addition, predicted years of extreme precipitation are used to estimate the risk of overtopping of the retention pond located on the site through simulations of the EPA SWMM hydrologic model. Preliminary results indicate that the intensity of extreme precipitation events is expected to increase and flood the NASA Ames retention pond. The results from these estimations will assist flood protection managers in planning for infrastructure adaptations.

Storm↗
DOE OSTI2024

Future Climate Projections for South Florida: Improving the Accuracy of Air Temperature and Precipitation Extremes With a Hybrid Statistical Bias Correction Technique

Projecting future climate variables is essential for comprehending the potential impacts on hydroclimatic hazards like floods and droughts. Evaluating these impacts is challenging due to the coarse spatial resolution of global climate models (GCMs); therefore, bias correction is widely used. Here, we applied two statistical methods—standard empirical quantile mapping (EQM) and a hybrid approach, EQM with linear correction (EQM-LIN)—to bias correct precipitation and air temperature simulated by nine GCMs. We used historical observations from 20 weather stations across South Florida to project future climate under three shared socioeconomic pathways (SSPs). Compared to the EQM, the hybrid EQM-LIN method improved R 2 of daily quantiles by up to 30% over the historical period and improved MAE up to 70% in months that contain most extreme values. Projected extreme precipitation at the weather stations showed that, compared to the EQM-LIN, the EQM method underestimates the high quantiles by up to 26% in SSP585. The projected changes in annual maximum precipitation from historical period (1985–2014) to near future (2040–2069) and far future (2070–2100) were between 2% and 16% across the study area. Projected future precipitation suggested a slight decrease during summer but an increase in fall. This, along with rising summer temperatures, suggested that South Florida can experience rapid oscillations from warmer summers and increased flooding in fall under future climate. Additionally, our comparative analyses with globally and nationally downscaled studies showed that such coarse scale studies do not represent the climatic extremes well, particularly for high quantile precipitation.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1993

A statistical analysis of mesoscale rainfall as a random cascade

The paper considers the random cascade theory for spatial rainfall. Particular attention was given to the following four areas: (1) the relationship of the random cascade theory of rainfall to the simple scaling and the hierarchical cluster-point-process theories, (2) the mathematical foundations for some of the formalisms commonly applied in the develpment of statistical cascade theory, (3) the empirical evidence for a random cascade theory of rainfall, and (4) the way of using data for making estimates of parameters and for making statistical inference within this theoretical framework. An analysis of space-time rainfall data is presented. Cascade simulations are carried out to provide a comparison with methods of analysis that are applied to the rainfall data.

Gupta, Vijay K.↗
NASA NTRS1988

The influence of processor focus on speckle correlation statistics for a Shuttle imaging radar scene of Hurricane Josephine

The surface wave field produced by Hurricane Josephine was imaged by the L-band SAR aboard the Challenger on October 12, 1984. Exponential trends found in the two-dimensional autocorrelations of speckled image data support an equilibrium theory model of sea surface hydrodynamics. The notions of correlated specular reflection, surface coherence, optimal Doppler parameterization and spatial resolution are discussed within the context of a Poisson-Rayleigh statistical model of the SAR imaging process.

Tilley, David G.↗
NASA NTRS1975

Lightning properties in Florida thunderstorms from video tape records

From video-tape recordings of lightning flashes to ground in convective daytime storms at the NASA Kennedy Space Center, Florida, and near Ocala, Florida, statistical data are presented for the flash-time duration, the number of strokes per flash, the time between all strokes, and the time between strokes having spatially separate channels. A daytime video tape 'photograph' of a stepped leader is reproduced. Finally, statistical data are presented for 13 long horizontal lightning discharges occurring along a line of nocturnal thunderstorms near Gainesville, Florida. These discharges all propagated horizontally near the freezing level (4.5 km) at an apparent average velocity between 5600 and 11,000 m/s for a typical distance of 2 to 3 km. Eleven of the 13 horizontal discharges were preceded by or occurred within 16.7 ms of a glow in the cloud roughly 0.5 km above the horizontal channel.

Brantley, R. D.↗
DOE OSTI2023

Generating high-resolution total canopy SIF emission from TROPOMI data: Algorithm and application

Solar-induced chlorophyll fluorescence (SIF) is a rapidly advancing front in modeling global terrestrial gross primary production (GPP). Canopy total SIF emissions (SIF total ) are mechanistically linked to the plant photosynthesis, and can be estimated from satellite observed SIF (SIF obs ) through radiative transfer modeling. However, the current satellite SIF obs and thus SIF total are available only at coarse spatial resolutions from several kilometers to tens of kilometers, inhibiting the application at fine spatial scales. Here, in this work, we proposed an algorithm to generate both global high-resolution SIF total (HSIF total ) and high-resolution SIF obs (HSIF obs ) at 1 km from low-resolution SIF obs (LSIF obs ) from the TROPOspheric Monitoring Instrument (TROPOMI), which has a spatial resolution at nadir of 3.5 km by 5.6–7 km. Our statistical method is based on the law of energy conservation and uses satellite derived fraction of absorbed photosynthetically active radiation, fluorescence efficiency, and the escape probability of fluorescence. We evaluated the accuracy of our HSIF total using the Orbiting Carbon Observatory-2 SIF (R 2 = 0.78). We found that the spatial resolution had clear effects on the relationship between HSIF total and GPP. We also compared HSIF total to 8-day averaged tower GPP from 135 flux sites and found that they were better correlated when HSIF total was averaged over a 1-km radius around the tower than when averaged over a larger radius. Our study provided a unique high-resolution HSIF total product, which will advance the estimation of GPP by extrapolating site-level relationships to the global scale.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2023

A computationally efficient statistically downscaled 100 m resolution Greenland product from the regional climate model MAR

The Greenland Ice Sheet (GrIS) has been contributing directly to sea level rise, and this contribution is projected to accelerate over the next decades. A crucial tool for studying the evolution of surface mass loss (e.g., surface mass balance, SMB) consists of regional climate models (RCMs), which can provide current estimates and future projections of sea level rise associated with such losses. However, one of the main limitations of RCMs is the relatively coarse horizontal spatial resolution at which outputs are currently generated. Here, we report results concerning the statistical downscaling of the SMB modeled by the Modèle Atmosphérique Régional (MAR) RCM from the original spatial resolution of 6 km to 100 m building on the relationship between elevation and mass losses in Greenland. To this goal, we developed a geospatial framework that allows the parallelization of the downscaling process, a crucial aspect to increase the computational efficiency of the algorithm. Using the results obtained in the case of the SMB, surface and air temperature are assessed through the comparison of the modeled outputs with in situ and satellite measurement. The downscaled products show a considerable improvement in the case of the downscaled product with respect to the original coarse output, with the coefficient of determination (R 2 ) increasing from 0.868 for the original MAR output to 0.935 for the SMB downscaled product. Moreover, the value of the slope and intercept of the linear regression fitting modeled and measured SMB values shifts from 0.865 for the original MAR to 1.015 for the downscaled product in the case of the slope and from the value −235 mm w.e. yr -1 (original) to −57 mm w.e. yr -1 (downscaled) in the case of the intercept, considerably improving upon results previously published in the literature.

Greenland Ice Sheet↗
DOE OSTI2021

Quantitative Precipitation Estimation of Extremes in CONUS With Radar Data

When constructing an accurate, continental, in-situ-based, kilometer-scale, long-term record of the precipitation field and its spatiotemporal changes remains a significant challenge. Here, we determine the extreme-value behavior of the NEXRAD Stage IV radar-based quantitative precipitation estimate. We find that the climatology of 5-year daily return values in the contiguous United States East of the Rocky Mountains shows only slight variability on spatial scales smaller than (Formula presented.) ~100 km. In light of this finding, we test whether rain-gauge-only daily precipitation data sets can produce accurate extreme-value behavior at spatial scales finer than the spacing between gauges. We find that the 5-year daily return values are accurate at locations far from rain gauges only if the interpolation between gauges is carried out appropriately for extremes. Precipitation statistics derived from in-situ rain gauge data are therefore of sufficient spatial resolution to faithfully capture daily extremes over much of the eastern United States.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2001

Statistical Ensemble of Large Eddy Simulations

A statistical ensemble of large eddy simulations (LES) is run simultaneously for the same flow. The information provided by the different large scale velocity fields is used to propose an ensemble averaged version of the dynamic model. This produces local model parameters that only depend on the statistical properties of the flow. An important property of the ensemble averaged dynamic procedure is that it does not require any spatial averaging and can thus be used in fully inhomogeneous flows. Also, the ensemble of LES's provides statistics of the large scale velocity that can be used for building new models for the subgrid-scale stress tensor. The ensemble averaged dynamic procedure has been implemented with various models for three flows: decaying isotropic turbulence, forced isotropic turbulence, and the time developing plane wake. It is found that the results are almost independent of the number of LES's in the statistical ensemble provided that the ensemble contains at least 16 realizations.

Carati, Daniele↗
DOE OSTI2020

Three-Dimensional Imaging Lidar for Characterizing Particle Fields and Organisms in the Mesopelagic Zone

The ocean’s mesopelagic zone is largely uncharacterized despite its vital role in sustaining ocean ecosystems. The composition, cycling, and fate of particle fields in the mesopelagic lacks an integrative multi-scale understanding of organism migration patterns, distribution, and diversity. This problem is addressed by combining complementary technologies with overlapping size spectra, including profiler mounted optical scattering sensors, profiler, and ship mounted acoustic devices, and a custom Unobtrusive Multi-Static Lidar Imager (UMSLI). This unique sensor suite can observe distributions of particles including organisms over a six order of magnitude dynamic size range, from microns to meters. Overlapping size ranges between different methods allows for cross-validation. This work focuses on the lidar imaging measurements and optical backscattering and attenuation, covering a combined particle size range of 0.1 mm to several cm. Particles at the small end of this range are sized using an existing backscattering time series inversion method after Briggs et al. (2013). Larger particles are resolved with UMSLI over an expanding volume using three-dimensional photo-realistic laser serial imaging. UMSLI’s image rectifying ability over time allows for derivation of particle concentration, size, and spatial distribution. Technical details on the development and post-processing methods for the novel UMSLI system are provided. Image resolved particle size distributions (PSDs) revealed a size shift from smaller to larger particles (>0.5 mm) as indicated by flatter slopes from dawn (slope = 2.6) to dusk (slope = 3.0). PSD trends are supported by an optical backscatter and transmissometer time series inversion analysis. Size shifts in the particle field are largely attributed to aggregation effects. Images support evidence of temporal variation between dusk and dawn stations through statistical analysis of particle concentrations for particle sizes 0.50–5.41 mm. Spatial analysis of the particle field revealed a dominantly uniform distributed marine snow background. The importance and potential of integrated approaches to studying particle and organism dynamics in ocean environments are discussed.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Significant DBSCAN+: Statistically Robust Density-based Clustering

Cluster detection is important and widely used in a variety of applications, including public health, public safety, transportation, and so on. Given a collection of data points, we aim to detect density-connected spatial clusters with varying geometric shapes and densities, under the constraint that the clusters are statistically significant. The problem is challenging, because many societal applications and domain science studies have low tolerance for spurious results, and clusters may have arbitrary shapes and varying densities. As a classical topic in data mining and learning, a myriad of techniques have been developed to detect clusters with both varying shapes and densities (e.g., density-based, hierarchical, spectral, or deep clustering methods). However, the vast majority of these techniques do not consider statistical rigor and are susceptible to detecting spurious clusters formed as a result of natural randomness. On the other hand, scan statistic approaches explicitly control the rate of spurious results, but they typically assume a single “hotspot” of over-density and many rely on further assumptions such as a tessellated input space. To unite the strengths of both lines of work, we propose a statistically robust formulation of a multi-scale DBSCAN, namely Significant DBSCAN+, to identify significant clusters that are density connected. As we will show, incorporation of statistical rigor is a powerful mechanism that allows the new Significant DBSCAN+ to outperform state-of-the-art clustering techniques in various scenarios. We also propose computational enhancements to speed-up the proposed approach. Experiment results show that Significant DBSCAN+ can simultaneously improve the success rate of true cluster detection (e.g., 10–20% increases in absolute F1 scores) and substantially reduce the rate of spurious results (e.g., from thousands/hundreds of spurious detections to none or just a few across 100 datasets), and the acceleration methods can improve the efficiency for both clustered and non-clustered data.

Computer Science↗
NASA NTRS2013

Urban Image Classification: Per-Pixel Classifiers, Sub-Pixel Analysis, Object-Based Image Analysis, and Geospatial Methods: Chapter - 10

Remote sensing methods used to generate base maps to analyze the urban environment rely predominantly on digital sensor data from space-borne platforms. This is due in part from new sources of high spatial resolution data covering the globe, a variety of multispectral and multitemporal sources, sophisticated statistical and geospatial methods, and compatibility with GIS data sources and methods. The goal of this chapter is to review the four groups of classification methods for digital sensor data from space-borne platforms; per-pixel, sub-pixel, object-based (spatial-based), and geospatial methods. Per-pixel methods are widely used methods that classify pixels into distinct categories based solely on the spectral and ancillary information within that pixel. They are used for simple calculations of environmental indices (e.g., NDVI) to sophisticated expert systems to assign urban land covers. Researchers recognize however, that even with the smallest pixel size the spectral information within a pixel is really a combination of multiple urban surfaces. Sub-pixel classification methods therefore aim to statistically quantify the mixture of surfaces to improve overall classification accuracy. While within pixel variations exist, there is also significant evidence that groups of nearby pixels have similar spectral information and therefore belong to the same classification category. Object-oriented methods have emerged that group pixels prior to classification based on spectral similarity and spatial proximity. Classification accuracy using object-based methods show significant success and promise for numerous urban 3 applications. Like the object-oriented methods that recognize the importance of spatial proximity, geospatial methods for urban mapping also utilize neighboring pixels in the classification process. The primary difference though is that geostatistical methods (e.g., spatial autocorrelation methods) are utilized during both the pre- and post-classification steps. Within this chapter, each of the four approaches is described in terms of scale and accuracy classifying urban land use and urban land cover; and for its range of urban applications. We demonstrate the overview of four main classification groups in Figure 1 while Table 1 details the approaches with respect to classification requirements and procedures (e.g., reflectance conversion, steps before training sample selection, training samples, spatial approaches commonly used, classifiers, primary inputs for classification, output structures, number of output layers, and accuracy assessment). The chapter concludes with a brief summary of the methods reviewed and the challenges that remain in developing new classification methods for improving the efficiency and accuracy of mapping urban areas.

Myint, Soe W.↗
DOE OSTI2024

Fractional Statistics

The quantum-mechanical description of assemblies of particles whose motion is confined to two (or one) spatial dimensions offers many possibilities that are distinct from bosons and fermions. We call such particles anyons. The simplest anyons are parameterized by an angular phase parameter θ. θ = 0, π correspond to bosons and fermions, respectively; at intermediate values, we say that we have fractional statistics. In two dimensions, θ describes the phase acquired by the wave function as two anyons wind around one another counterclockwise. It generates a shift in the allowed values for the relative angular momentum. Composites of localized electric charge and magnetic flux associated with an abelian U(1) gauge group realize this behavior. More complex charge-flux constructions can involve nonabelian and product groups acting on a spectrum of allowed charges and fluxes, giving rise to nonabelian and mutual statistics. Interchanges of nonabelian anyons implement unitary transformations of the wave function within an emergent space of internal states. Anyons of all kinds are described by quantum field theories that include Chern–Simons terms. The crossings of one-dimensional anyons on a ring are unidirectional, such that a fractional phase θ acquired upon interchange gives rise to fractional shifts in the relative momenta between the anyons. The quasiparticle excitations of fractional quantum Hall states have long been predicted to include anyons. Recently, the anyon behavior predicted for quasiparticles in the ν = 1/3 fractional quantum Hall state has been observed in both scattering and interferometric experiments. Excitations within designed systems, notably including superconducting circuits, can exhibit anyon behavior. Such systems are being developed for possible use in quantum information processing.

Physics↗
DOE OSTI2023

Tensor-to-scalar ratio forecasts for extended LiteBIRD frequency configurations

LiteBIRD is a planned JAXA-led cosmic microwave background (CMB) B-mode satellite experiment aiming for launch in the late 2020s, with a primary goal of detecting the imprint of primordial inflationary gravitational waves. Its current baseline focal-plane configuration includes 15 frequency bands between 40 and 402 GHz, fulfilling the mission requirements to detect the amplitude of gravitational waves with the total uncertainty on the tensor-to-scalar ratio, δr, down to δr < 0.001. A key aspect of this performance is accurate astrophysical component separation, and the ability to remove polarized thermal dust emission is particularly important. In this paper we note that the CMB frequency spectrum falls off nearly exponentially above 300 GHz relative to the thermal dust spectral energy distribution, and a relatively minor high frequency extension can therefore result in even lower uncertainties and better model reconstructions. Specifically, we compared the baseline design with five extended configurations, while varying the underlying dust modeling, in each of which the High-Frequency Telescope (HFT) frequency range was shifted logarithmically toward higher frequencies, with an upper cutoff ranging between 400 and 600 GHz. In each case, we measured the tensor-to-scalar ratio r uncertainty and bias using both parametric and minimum-variance component-separation algorithms. When the thermal dust sky model includes a spatially varying spectral index and temperature, we find that the statistical uncertainty on r after foreground cleaning may be reduced by as much as 30–50% by extending the upper limit of the frequency range from 400 to 600 GHz, with most of the improvement already gained at 500 GHz. We also note that a broader frequency range leads to higher residuals when fitting an incorrect dust model, but also it is easier to discriminate between models through higher χ 2 sensitivity. Even in the case in which the fitting procedure does not correspond to the underlying dust model in the sky, and when the highest frequency data cannot be modeled with sufficient fidelity and must be excluded from the analysis, the uncertainty on r increases by only about 5% for a 500 GHz configuration compared to the baseline.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Quantitative assessment of fitting errors associated with streak camera noise in Thomson scattering data analysis

Thomson scattering measurements in high energy density experiments are often recorded using optical streak cameras. In the low-signal regime, noise introduced by the streak camera can become an important and sometimes the dominant source of measurement uncertainty. In this paper, we present a formal method of accounting for the presence of streak camera noise in our measurements. We present a phenomenological description of the noise generation mechanisms and present a statistical model that may be used to construct the covariance matrix associated with a given measurement. This model is benchmarked against simulations of streak camera images. We demonstrate how this covariance may then be used to weight fitting of the data and provide quantitative assessments of the uncertainty in the fitting parameters determined by the best fit to the data and build confidence in the ability to make statistically significant measurements in the low-signal regime, where spatial correlations in the noise become apparent. These methods will have general applicability to other measurements made using optical streak cameras.

47 OTHER INSTRUMENTATION↗
DOE OSTI2024

UFNet: Joint U-Net and Fully Connected Neural Network to Bias Correct Precipitation Predictions from

Paper information. Shuang Yu, Indrasis Chakraborty, Gemma J. Anderson, Donald D. Lucas, Yannic Lops, and Daniel Galea. UFNet: Joint U-Net and fully connected neural network to bias correct precipitation predictions from climate models. Artificial Intelligence for the Earth Systems, 2024. Overview. This work develops the UFNet methodology to correct E3SM historical precipitation projection bias. The UFNet deep learning framework consists of a two-part architecture: a U-Net convolutional network to capture the spatiotemporal distribution of precipitation and a fully connected network to capture the distribution of higher-order statistics. The joint network, termed UFNet, can simultaneously improve the spatial structure of the modeled precipitation and capture the distribution of extreme precipitation values. Below we provide guidance for applying UFNet to correct the Energy Exascale Earth System Model (E3SM; Golaz et al. 2019) daily precipitation projection over the contiguous United States (CONUS). Getting started 1. Obtain the historical climate simulation and observation data. The E3SM historical simulation data are available through https://aims2.llnl.gov/search/cmip6/. The CPC unified gauge-based analysis of daily precipitation can be found through https://psl.noaa.gov/data/gridded/data.cpc.globalprecip.html. The ECMWF atmospheric reanalysis of the 20th century (ERA-20C) data are available through https://www.ecmwf.int/en/forecasts/datasets/reanalysis-datasets/era-20c. The spatial resolution of E3SM and observed datasets are both regridded to a common 1° resolution grid using conservative interpolation. The regridded E3SM, CPC and ERA-20C with 1° resolution can be found throught ./data/. 2. Train the fully connected network (DNN) Python train_dnn.py 3. Train the UFNet Python train_ufnet.py 4. Evaluation and compared with the baseline Python evaluation.py

Lucas, DonaldD↗
NASA NTRS1973

Electron precipitation patterns and substorm morphology.

Statistical analysis of data from the auroral particles experiment aboard OGO 4, performed in a statistical framework interpretable in terms of magnetospheric substorm morphology, both spatial and temporal. Patterns of low-energy electron precipitation observed by polar satellites are examined as functions of substorm phase. The implications of the precipitation boundaries identifiable at the low-latitude edge of polar cusp electron precipitation and at the poleward edge of precipitation in the premidnight sector are discussed.

Hoffman, R. A.↗