Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “variational”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9

A discussion of plausible solar irradiance variations, 1700-1992

From satellite observations the solar total irradiance is known to vary. Sunspot blocking, facular emission, and network emission are three identified causes for the variations. In this paper we examine several different solar indices measured over the past century that are potential proxy measures for the Sun's irradiance. These indices are (1) the equatorial solar rotation rate, (2) the sunspot structure, the decay rate of individual sunspots, and the number of sunspots without umbrae, and (3) the length and decay rate of the sunspot cycle. Each index can be used to develop a model for the Sun's total irradiance as seen at the Earth. Three solar indices allow the irradiance to be modeled back to the mid-1700s. The indices are (1) the length of the solar cycle, (2) the normalized decay rate of the solar cycle, and (3) the mean level of solar activity. All the indices are well correlated, and one possible explanation for their nearly simultaneous variations is changes in the Sun's convective energy transport. Although changes in the Sun's convective energy transport are outside the realm of normal stellar structure theory (e.g., mixing length theory), one can imagine variations arising from even the simplest view of sunspots as vertical tubes of magnetic flux, which would serve as rigid pillas affecting the energy flow patterns by ensuring larger-scale eddies. A composite solar irradiance model, based upon these proxies, is compared to the northern hemisphere temperature depatures for 1700-1992. Approximately 71% of the decadal variance in the last century can be modeled with these solar indices, although this analysis does not include anthropogenic or other variations which would affect the results. Over the entire three centuries, approx. 50% of the variance is modeled. Both this analysis and previous similar analyses have correlations of model solar irradiances and measured Earth surface temperatures that are significant at better than the 95% confidence level. To understand our present climate variations, we must place the anthropogenic variations in the context of natural variability from solar, volcanic, oceanic, and other sources.

Hoyt, Douglas V.↗

Response of Tropical Clouds to the Interannual Variation of Sea Surface Temperature

Connections between the large-scale interannual variations of clouds, deep convection, atmospheric winds. vertical thermodynamic structure, and SSTs over global tropical oceans are examined over the period July 1983 - December 1990. The SST warming associated with El Nino had a significant impact on the global tropical cloud field, although the warming itself was confined to the equatorial central and eastern Pacific. Extensive variations of the total cloud field occurred in the northeastern Indian, western and central Pacific, and western Atlantic Oceans. The changes of high and middle clouds dominated the total cloud variation in these regions. Total cloud variation was relatively weak in the eastern Pacific and the Atlantic because of the cancellation between the changes of high and low clouds. The variation of low clouds dominated the total cloud change in those areas. The destabilization of the lapse rate between 900 and 750 mb was more important for enhancing convective instability than was the change of local SSTs in the equatorial central Pacific during the 1997 El Nino. This destabilization is associated with anomalous rising motion in that region. As a result. convection and high and middle clouds increased in the equatorial central Pacific, In the subtropical Pacific, both the change of lapse rate between 900 and 750 mb associated A,ith anomalous subsidence and the decrease of boundary-layer buoyancy due to a decrease of temperature and moisture played an important role in enhancing convective stability. Consequently, convection, as well its high and middle clouds, decreased in these areas. The change ot'low clouds in the equatorial and southeastern Atlantic was correlated to both local SSTs and the SST changes in the equatorial eastern Pacific. In this area. the increase of low clouds was consistent with the sharper inversion during the 1987 El Nino, The strengthening of the inversion was not caused by a local SST change. although the local SST change appeared to he correlated to the change of low clouds. The coherence between clouds and SST tendency shows that SST tendency leads cloud variation in the equatorial Pacific. Thus, the change of clouds does not dominate the sign of SST tendency even though the cloud change was maximum during the 1987 El Nino. In some ideas of the Indian, subtropical Pacific, and North Atlantic Oceans, cloud change leads SST tendency. Cloud change might affect SST tendency in these regions.

Fu, Rong↗

Space-Time Characteristics of Rainfall Diurnal Variations

The space-time features of rainfall diurnal variation of precipitation are systematically investigated by using the Tropical Rainfall Measuring Mission (TRMM) precipitation products retrieved from TRMM microwave imager (TMI), precipitation radar (PR) and TMI/PR combined algorithms. Results demonstrate that diurnal variability of precipitation is obvious over tropical regions. The dominant feature of rainfall diurnal cycle over, ocean is that there is consistent rainfall peak in early morning, while there is a consistent rainfall peak in mid-late afternoon over land. The seasonal variation on intensity of rainfall diurnal cycle is clearly evidenced. Horizontal distributions of rainfall diurnal variations indicate that there is a clearly early-morning peak with a secondary peak in the middle-late afternoon in ocean rainfall at latitudes dominated by large-scale convergence and deep convection. There is also an analogous early-morning peak in land rainfall along with a stronger afternoon peak forced by surface heating. Amplitude analysis shows that the patterns and its evolution of rainfall diurnal cycle are very close to rainfall distribution pattern and its evolution. These results indicate that rainfall diurnal variations are strongly associated with large-scale convective systems and climate weather systems. Phase studies clearly present the regional and seasonal features of rainfall diurnal activities. Further studies on convective and stratiform rainfall show different characteristics of diurnal cycles. Their spatial and temporal variations of convective and stratiform rainfall indicate that mechanisms for rainfall diurnal variations vary with time and space.

Yang, Song↗

Modeled Seasonal Variations of Firn Density Induced by Steady State Surface Air Temperature Cycle

Seasonal variations of firn density in ice-sheet firn layers have been attributed to variations in deposition processes or other processes within the upper firn. A recent high-resolution (mm scale) density profile, measured along a 181 m core from Antarctica, showed small-scale density variations with a clear seasonal cycle that apparently was not-related to seasonal variations in deposition or known near-surface processes (Gerland and others 1999). A recent model of surface elevation changes (Zwally and Li, submitted) produced a seasonal variation in firn densification, and explained the seasonal surface elevation changes observed by satellite radar altimeters. In this study, we apply our 1-D time-dependent numerical model of firn densification that includes a temperature-dependent formulation of firn densification based on laboratory measurements of grain growth. The model is driven by a steady-state seasonal surface temperature and a constant accumulation rate appropriate for the measured Antarctic ice core. The modeled seasonal variations in firn density show that the layers of snow deposited during spring to mid-summer with the highest temperature history compress to the highest density, and the layers deposited during later summer to autumn with the lowest temperature history compress to the lowest density. The initial amplitude of the seasonal difference of about 0.13 reduces to about 0.09 in five years and asymptotically to 0.92 at depth, which is consistent with the core measurements.

Jun, Li↗

Implications of the Observed Mesoscale Variations of Clouds for Earth's Radiation Budget

The effect of small-spatial-scale cloud variations on radiative transfer in cloudy atmospheres currently receives a lot of research attention, but the available studies are not very clear about which spatial scales are important and report a very large range of estimates of the magnitude of the effects. Also, there have been no systematic investigations of how to measure and represent these cloud variations. We exploit the cloud climatology produced by the International Satellite Cloud Climatology Project (ISCCP) to: (1) define and test different methods of representing cloud variation statistics, (2) investigate the range of spatial scales that should be included, (3) characterize cloud variations over a range of space and time scales covering mesoscale (30 - 300 km, 3-12 hr) into part of the lower part of the synoptic scale (300 - 3000 km, 1-30 days), (4) obtain a climatology of the optical thickness, emissivity and cloud top temperature variability of clouds that can be used in weather and climate GCMS, together with the parameterization proposed by Cairns et al. (1999), to account for the effects of small-scale cloud variations on radiative fluxes, and (5) evaluate the effect of observed cloud variations on Earth's radiation budget. These results lead to the formulation of a revised conceptual model of clouds for use in radiative transfer calculations in GCMS. The complete variability climatology can be obtained from the ISCCP Web site at http://isccp.giss.nasa.gov.

Rossow, William B.↗

Measurement and Interpretation of Temporal Variations of the Earths Gravity Field Using GPS and SLR Data

This investigation has had four main thrusts: 1) The analysis of seasonal variations of the Earth's gravitational field using Lageos 1 and 2 SLR data and comparisons to geophysical models. We have estimated the annual variation of the gravity field via a spherical harmonic expansion complete to degree and order 4. We have also constructed a similar model using models of the annual variation in the gravity field due to atmospheric, hydrologic, and ocean mass redistribution. These three models, when combined together, are in excellent agreement with the variations observed by satellite laser ranging. An article on these results was published in the journal Geophysical Research Letters. 2) The second thrust of our investigation has been to analyze the output of a Global Climate Model (GCM) to determine if the GRACE gravity mission can be expected to detect climate change signals. Working with Gary Russell at the Goddard Institute for Space Studies (GISS), we have determined that there are several large secular signals that GRACE might be able to detect, including secular changes in snow cover, sea ice, polar ice, ocean mass, and other variables. It is possible that some of these signals could be detected with 5 years of GRACE measurements - its hard to judge this because the interannual variability in the GCM, which could mask the climate signals, is unreliable. Certainly a follow-on GRACE mission could detect these signals when compared to the data from the initial GRACE mission.). An article on these results will be published in the journal Journal of Geophysical Research. 3) In the last year of the investigation, we developed a new technique for analyzing temporal gravity variations using "geophysical fingerprints", which was successfully demonstrated on 20 years of satellite laser ranging data [Nerem et al., 20031. 4]. We also participated in a workshop on future satellite gravity measurements, which resulted in paper on measuring ocean mass variations using GRACE [Nerem et al., 20031 and on using laser interferometry for future gravity missions [Bender et al., 20031].

Nerem, R. Steven↗

Variations in Upper-Tropospheric Humidity and Convective Processes as Seen from SSM/T-2

Water vapor feedback, particularly involving water vapor in the upper troposphere (UTH), is widely regarded as the process with the most potential to amplify anthropogenic greenhouse forcing. Yet, our ability to quantify observationally water vapor variations in the current climate and the relationships to convective processes remains rather crude. Remote sensing from polar orbiting instruments has played a major role in documenting UTH variability, supplementing highly undersampled and poorly calibrated rawinsonde measurements. Most of our observational understanding of UTH has come from the 6.7 micrometer channel measurements which are subject to cloud contamination uncertainties. In this work we examine UTH variations present in the Special Sensor Microwave Temperature Sounder 2 (SSM/T-2) sensors flying aboard Defense Military Satellite Program (DMSP) polar orbiting satellites during the period 1993 through 2001. We employ data from the the 183.3 +/- 1 GHz channel which is far less sensitive to cirrus than IR methods. Our primary focus is on obtaining more reliable statistics of interannual behavior; i.e. How close to constant RH are interannual variations in T2 UTH over the tropics? How do temperature and moisture variations contribute regionally? The 1997/1998 strong ENS0 warming event and adjacent cool periods provide a strong signal to study, albeit a perturbation of natural climate variability. Modeling the 183.3 GHz channel using reanalysis temperature data, but with climatological water vapor, allows us to infer the separate contribution by water vapor in the observations. In addition, frozen hydrometeors produced by deep convection are also captured in the 150 GHz oxygen channel, providing an opportUnity to relate the incidence of deep convection to water vapor variability. Our results indicate a much larger variation of 183.3 GHz brightness temperatures would be observed were it not for water vapor variations positively correlated with tropical SSTs. Comparisons are made with previous studies using both IR and microwave observations to characterize UTH response to tropical SSTs.

Robertson, Franklin R.↗

The Nanograv Nine-Year Data Set: Measurement and Analysis of Variations in Dispersion Measures

We analyze dispersion measure(DM) variations of 37 millisecond pulsars in the nine-year North American Nanohertz Observatory for Gravitational Waves (NANOGrav) data release and constrain the sources of these variations. DM variations can result from a changing distance between Earth and the pulsar, inhomogeneities in the interstellar medium, and solar effects. Variations are significant for nearly all pulsars, with characteristic timescales comparable to or even shorter than the average spacing between observations. Five pulsars have periodic annual variations, 14 pulsars have monotonically increasing or decreasing trends, and 14 pulsars show both effects. Of the four pulsars with linear trends that have line-of-sight velocity measurements, three are consistent with a changing distance and require an overdensity of free electrons local to the pulsar. Several pulsars show correlations between DM excesses and lines of sight that pass close to the Sun. Mapping of the DM variations as a function of the pulsar trajectory can identify localized interstellar medium features and, in one case, an upper limit to the size of the dispersing region of 4 au. Four pulsars show roughly Kolmogorov structure functions (SFs), and another four show SFs less steep than Kolmogorov. One pulsar has too large an uncertainty to allow comparisons. We discuss explanations for apparent departures from a Kolmogorov-like spectrum, and we show that the presence of other trends and localized features or gradients in the interstellar medium is the most likely cause.

pulsars: general↗

Decomposing Shortwave Top-of-Atmosphere and Surface Radiative Flux Variations in Terms of Surface and Atmospheric Contributions

Adiagnostic tool for determining surface and atmospheric contributions to interannual variations in top-of-atmosphere (TOA) reflected shortwave (SW) and net downward SW surface radiative fluxes is introduced. The method requires only upward and downward radiative fluxes at the TOA and surface as input and therefore can readily be applied to both satellite-derived and model-generated adiative fluxes. Observations from the Clouds and the Earth’s Radiant Energy System (CERES) Energy Balanced and Filled (EBAF) Edition 4.0 product show that 81% of the monthly variability in global mean reflected SW TOA flux anomalies is associated with atmospheric variations (mainly clouds),6%is from surface variations, and 13% is from atmosphere–surface covariability. Over the Arctic Ocean, most of the variability in both reflected SW TOA flux and net downward SW surface flux anomalies is explained by variations in sea ice and cloud fraction alone (r2 5 0.94). Compared to CERES, variability in two reanalyses—the ECMWF interim reanalysis (ERA-Interim) and NASA’s Modern-Era Retrospective Analysis for Research and Applications, version 2 (MERRA-2)—show large differences in the regional distribution of variance for both the atmospheric and surface contributions to anomalies in net downward SW surface flux. For MERRA-2 the atmospheric contribution is 17% too large compared to CERES while ERA-Interim underestimates the variance by 15%. The difference is mainly due to how cloud variations are represented in the reanalyses. The overall surface contribution in both ERA-Interim and MERRA-2 is smaller than CERES EBAF by 15% for ERA-Interim and 58% for MERRA-2, highlighting limitations of the reanalyses in representing surface albedo variations and their influence on SW radiative fluxes.

Norman G. Loeb↗

The Statistical Emulators of GGCMI Phase 2: Responses of Year-to-Year Variation of Crop Yield to CO 2 , Temperature, Water and Nitrogen Perturbations

Understanding the impact of climate change on year-to-year variation of crop yield is critical to global food stability and security. While crop model emulators are believed to be lightweight tools to replace the models, few emulators have been developed to capture such interannual variation of crop yield in response to climate variability. In this study, we developed a statistical emulator with a machine learning algorithm to reproduce the response of year-to-year variation of four crop yields to CO 2 (C), temperature (T), water (W), and nitrogen (N) perturbations defined in the Global Gridded Crop Model Intercomparison Project (GGCMI) phase 2. The emulators were able to explain more than 52 % of the variance of simulated yield and performed well in capturing the year-to-year variation of global average and gridded crop yield over current croplands in the baseline. With the changes in CO 2 –temperature–water–nitrogen (CTWN) perturbations, the emulators could reproduce the year-to-year variation of crop yield well over most current cropland. The variation of R and the mean absolute error was small under the single CTWN perturbations and dual-factor perturbations. These emulators thus provide statistical response surfaces of yield, including both its mean and interannual variability, to climate factors. They could facilitate spatiotemporal downscaling of crop model simulation, projecting the changes in crop yield variability in the future and serving as a lightweight tool for multi-model ensemble simulation. The emulators enhanced the flexibility of crop yield estimates and expanded the application of large-ensemble simulations of crop yield under climate change.

Climate change↗

Natural variation in the consequences of gene overexpression and its implications for evolutionary trajectories

Copy number variation through gene or chromosome amplification provides a route for rapid phenotypic variation and supports the long-term evolution of gene functions. Although the evolutionary importance of copy-number variation is known, little is understood about how genetic background influences its tolerance. Here, we measured fitness costs of over 4000 overexpressed genes in 15 Saccharomyces cerevisiae strains representing different lineages, to explore natural variation in tolerating gene overexpression (OE). Strain-specific effects dominated the fitness costs of gene OE. We report global differences in the consequences of gene OE, independent of the amplified gene, as well as gene-specific effects that were dependent on the genetic background. Natural variation in the response to gene OE could be explained by several models, including strain-specific physiological differences, resource limitations, and regulatory sensitivities. This work provides new insight on how genetic background influences tolerance to gene amplification and the evolutionary trajectories accessible to different backgrounds.

59 BASIC BIOLOGICAL SCIENCES↗

Upwind Moisture Controls on Interannual Variations of Precipitation and Vegetation in China's Drylands

Dryland precipitation depends on upwind and local moisture sources via moisture recycling. How upwind moisture variations affect interannual variations of downwind precipitation and vegetation in China's drylands remains unclear. We used high-resolution moisture tracking data sets and found terrestrial moisture (93%) was the dominant moisture source for China's drylands, especially from drylands themselves (46%). In most dryland grids, we observed strong correlations between precipitation and upwind moisture sources from 2003 to 2022 (median r = 0.55), with a more significant effect in drier areas. These demonstrated the upwind moisture control on interannual variations of dryland precipitation, in which internal moisture from drylands exceeds the influence of external terrestrial sources. The upwind moisture variations, especially the recycled moisture of drylands, propagate to influence downwind vegetation greenness in precipitation-sensitive dryland areas. Our findings revealed that upwind moisture variations induced by climate or land-cover changes have important implications for water and food security in China's drylands.

54 ENVIRONMENTAL SCIENCES↗

Projective Integral Updates for High-Dimensional Variational Inference

Variational inference is an approximation framework for Bayesian inference that seeks to improve quantified uncertainty in predictions by optimizing a simplified distribution over parameters to stand in for the full posterior. Capturing model variations that remain consistent with training data enables more robust predictions by reducing parameter sensitivity. This work introduces a fixed-point optimization for variational inference that is applicable when every feasible log density can be expressed as a linear combination of functions from a given basis. In such cases, the optimizer becomes a fixed-point of projective integral updates. When the basis spans univariate quadratics in each parameter, the feasible distributions are Gaussian mean-fields and the projective integral updates yield quasi-Newton variational Bayes (QNVB). Other bases and updates are also possible. Since these updates require high-dimensional integration, this work begins by proposing an efficient quasirandom sequence of quadratures for mean-field distributions. Each iterate of the sequence contains two evaluation points that combine to correctly integrate all univariate quadratic functions and, if the mean-field factors are symmetric, all univariate cubics. More importantly, averaging results over short subsequences achieves periodic exactness on a much larger space of multivariate polynomials of quadratic total degree. The corresponding variational updates require four loss evaluations with standard (not second-order) backpropagation to eliminate error terms from over half of all multivariate quadratic basis functions. Furthermore, this integration technique is motivated by first proposing stochastic blocked mean-field quadratures, which may be useful in other contexts. A PyTorch implementation of QNVB allows for better control over model uncertainty during training than competing methods. Experiments demonstrate superior generalizability for multiple learning problems and architectures.

Gaussian mean-field↗

A Generalized Variational Principle with Applications to Excited State Mean Field Theory

We present a generalization of the variational principle that is compatible with any Hamiltonian eigenstate that can be specified uniquely by a list of properties. This variational principle appears to be compatible with a wide range of electronic structure methods, including mean field theory, density functional theory, multireference theory, and quantum Monte Carlo. Like the standard variational principle, this generalized variational principle amounts to the optimization of a nonlinear function that, in the limit of an arbitrarily flexible wave function, has the desired Hamiltonian eigenstate as its global minimum. Unlike the standard variational principle, it can target excited states and select individual states in cases of degeneracy or near-degeneracy. As an initial demonstration of how this approach can be useful in practice, we employ it to improve the optimization efficiency of excited state mean field theory by an order of magnitude. With this improved optimization, we are able to demonstrate that the accuracy of the corresponding second-order perturbation theory rivals that of singles-and-doubles equation-of-motion coupled cluster in a substantially broader set of molecules than could be explored by our previous optimization methodology.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

The Diurnal Variation of the Aerosol Optical Depth at the ARM SGP Site

Abstract This study examines the diurnal variation of the aerosol optical depth (AOD) at 355 nm observed by Raman lidar (RL) at the Atmospheric Radiation Measurement Program Southern Great Plains (SGP) site under both clear and cloudy‐sky conditions. Here only cloudy‐skies when the lidar signal is not fully attenuated are considered. The daytime AOD and its variation from the RL showed an excellent agreement with the Aerosol Robotic Network, demonstrating that the RL‐retrieved AOD is not affected by solar background contamination. The climatological annual‐mean daytime‐mean AOD is only slightly larger than the nighttime‐mean AOD (by 1%–3%). However, day‐to‐day variations are observed such that the daytime‐ and nighttime‐mean AOD difference for a given day can be large (about 95% of days have differences within 0.2). The seasonal AOD diurnal range (i.e., the difference between the maximum and minimum values) relative to the mean was 10%–15% except in the winter when it was 44%. The seasonal‐mean cloudy‐sky AOD diurnal variation is similar to that for clear‐sky, except that the AODs are larger (the annual‐mean cloudy‐sky AOD is larger than the clear‐sky by 24%). The aerosol lidar ratio diurnal variations are also examined, which are 10%–20% for all seasons with a minimum near 9 a.m. to 15 p.m. for all seasons except winter. Also presented is the annual‐mean AOD from the Cloud‐Aerosol Lidar and Infrared Pathfinder Satellite at SGP site: its daytime AOD is about 0.1 smaller than nighttime AOD because of daytime solar background contamination.

54 ENVIRONMENTAL SCIENCES↗

Climate-driven divergence in plant-microbiome interactions generates range-wide variation in bud break phenology

Soil microbiomes are rapidly becoming known as an important driver of plant phenotypic variation and may mediate plant responses to environmental factors. However, integrating spatial scales relevant to climate change with plant intraspecific genetic variation and soil microbial ecology is difficult, making studies of broad inference rare. Here we hypothesize and show: 1) the degree to which tree genotypes condition their soil microbiomes varies by population across the geographic distribution of a widespread riparian tree, Populus angustifolia; 2) geographic dissimilarity in soil microbiomes among populations is influenced by both abiotic and biotic environmental variation; and 3) soil microbiomes that vary in response to abiotic and biotic factors can change plant foliar phenology. We show soil microbiomes respond to intraspecific variation at the tree genotype and population level, and geographic variation in soil characteristics and climate. Using a fully reciprocal plant population by soil location feedback experiment, we identified a climate-based soil microbiome effect that advanced and delayed bud break phenology by approximately 10 days. These results demonstrate a landscape-level feedback between tree populations and associated soil microbial communities and suggest soil microbes may play important roles in mediating and buffering bud break phenology with climate warming, with whole ecosystem implications.

59 BASIC BIOLOGICAL SCIENCES↗

On the statistical theory of self-gravitating collisionless dark matter flow: Scale and redshift variation of velocity and density distributions

The statistics of velocity and density fields are crucial for cosmic structure formation and evolution. Here, this paper extends our previous work on the two-point second-order statistics for the velocity field [Phys. Fluids 35, 077105 (2023)] to one-point probability distributions for both density and velocity fields. The scale and redshift variation of density and velocity distributions are studied by a halo-based non-projection approach. First, all particles are divided into halo and out-of-halo particles so that the redshift variation can be studied via generalized kurtosis of distributions for halo and out-of-halo particles, respectively. Second, without projecting particle fields onto a structured grid, the scale variation is analyzed by identifying all particle pairs on different scales $r$. We demonstrate that: (i) Delaunay tessellation can be used to reconstruct the density field. The density correlation, spectrum, and dispersion functions were obtained, modeled, and compared with the N-body simulation; (ii) the velocity distributions are symmetric on both small and large scales and are non-symmetric with a negative skewness on intermediate scales due to the inverse energy cascade on small scales with a constant rate $\varepsilon_u$; (iii) On small scales, the even order moments of pairwise velocity $\Delta u_L$ follow a two-thirds law $\propto{(-\varepsilon_ur)}^{2/3}$, while the odd order moments follow a linear scaling $\langle(\Delta u_L)^{2n+1}\rangle=(2n+1)\langle(\Delta u_L)^{2n}\rangle\langle\Delta u_L\rangle\propto{r}$; (iv) The scale variation of the velocity distributions was studied for longitudinal velocities $u_L$ or $u_L^{'}$, pairwise velocity (velocity difference) $\Delta u_L$=$u_L^{'}$-$u_L$ and velocity sum $\Sigma u_L$=$u^{'}_L$+$u_L$. Fully developed velocity fields are never Gaussian on any scale, despite that they can initially be Gaussian; (v) On small scales, $u_L$ and $\Sigma u_L$ can be modeled by a $X$ distribution to maximize the entropy of the system. The distribution of $\Delta u_L$ can be different; (vi) On large scales, $\Delta u_L$ and $\Sigma u_L$ can be modeled by a logistic or a $X$ distribution, while $u_L$ has a different distribution; (vii) the redshift variation of the velocity distributions follows the evolution of the $X$ distribution involving a shape parameter $\alpha(z)$ decreasing with time.

79 ASTRONOMY AND ASTROPHYSICS↗

The Sensitivity of Variational Bayesian Neural Network Performance to Hyperparameters

In scientific applications, predictive modeling is often of limited use without accurate uncertainty quantification (UQ) to indicate when a model may be extrapolating or when more data needs to be collected. Bayesian Neural Networks (BNNs) produce predictive uncertainty by propagating uncertainty in neural network (NN) weights and offer the promise of obtaining not only an accurate predictive model but also accurate UQ. However, in practice, obtaining accurate UQ with BNNs is difficult due in part to the approximations used for model training (such as those made in variational inference) and in part to the need to choose a suitable set of hyperparameters; these hyperparameters outnumber those needed for traditional NNs and often have opaque effects on the results. We aim to shed light on the effects of hyperparameter choices for variational BNNs by performing a global sensitivity analysis of variational BNN performance under varying hyperparameter settings. Our results indicate that many of the hyperparameters interact with each other to affect both predictive accuracy and UQ. For improved usage of variational BNNs in real-world applications, we suggest that thorough hyperparameter tuning, including tuning of prior hyperparameters and loss function parameters, is essential for accurate UQ in variational BNNs.

97 MATHEMATICS AND COMPUTING↗