Learning Uncertainties the Frequentist Way: Calibration and Correlation in High Energy Physics
Not Available
SEARCH · Engineering Papers
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Not Available
This report assesses the potential for nationwide adoption of a duct static pressure reset in MZ VAV systems in appropriate applications. Building on the 3-year End-Use Load Profiles project to calibrate and validate the U.S. Department of Energy’s ResStock™ and ComStock™ models, this work produces national datasets that enable cities, states, utilities, and other stakeholders to answer a broad range of questions regarding their commercial building stock. ComStock is a highly granular, bottom-up model that uses various data sources, statistical sampling methods, and advanced building energy simulations to estimate the annual sub-hourly energy consumption of the commercial building stock across the United States. The “baseline” model intends to represent the U.S. commercial building stock as it existed in 2018. The methodology of the baseline model is discussed in the ComStock Reference Documentation. The goal of this work is to develop energy efficiency and demand flexibility measures that cover market-ready technologies and study their mass-adoption impact on the baseline building stock. “Measures” refers to various “what-if” scenarios that can be applied to buildings. The results for the baseline and measure scenario simulations are published in public datasets that provide insights into building stock characteristics, operational behaviors, utility bill impacts, and annual and sub-hourly energy usage by fuel type and end use. This report describes the modeling methodology for a single ComStock measure scenario—Fan Static Pressure Reset for Multizone Variable Air Volume (VAV) Systems—and briefly introduces key results. The full public dataset can be accessed on the ComStock data lake or via the Data Viewer at comstock.nrel.gov. The public dataset enables users to create custom aggregations of results for their use case (e.g., filter to a specific county or building type).
This report assesses the potential for nationwide adoption of thermostat setbacks in appropriate applications. Building on the 3-year End-Use Load Profiles project to calibrate and validate the U.S. Department of Energy’s ResStock™ and ComStock™ models, this work produces national datasets that enable cities, states, utilities, and other stakeholders to answer a broad range of questions regarding their commercial building stock. ComStock is a highly granular, bottom-up model that uses various data sources, statistical sampling methods, and advanced building energy simulations to estimate the annual sub-hourly energy consumption of the commercial building stock across the United States. The “baseline” model intends to represent the U.S. commercial building stock as it existed in 2018. The methodology of the baseline model is discussed in the ComStock Reference Documentation. The goal of this work is to develop energy efficiency and demand flexibility measures that cover market-ready technologies and study their mass-adoption impact on the baseline building stock. “Measures” refers to various “what-if” scenarios that can be applied to buildings. The results for the baseline and measure scenario simulations are published in public datasets that provide insights into building stock characteristics, operational behaviors, utility bill impacts, and annual and sub-hourly energy usage by fuel type and end use. This report describes the modeling methodology for a single ComStock measure scenario— Thermostat Setbacks During Unoccupied Periods—and briefly introduces key results. The full public dataset can be accessed on the ComStock data lake or via the Data Viewer at comstock.nrel.gov. The public dataset enables users to create custom aggregations of results for their use cases (e.g., filter to a specific county or building type).
We present galaxy--galaxy lensing (GGL) measurements from the full six years of data from the Dark Energy Survey (DES Y6), covering $4031\,\mathrm{deg}^2$ and used in the DES Y6 $3\times2$pt cosmological analysis. We use the MagLim++ lens sample, containing $\sim 9$ million galaxies divided into six redshift bins, and the Metadetection source catalog, including $\sim 140$ million galaxies divided into four redshift bins. The mean tangential shear signal achieves a total signal-to-noise ratio (S/N) of $173$, corresponding to a $17\%$ improvement over DES Y3. After applying the scale cuts used in the cosmological analysis, with $R_{\min}=6\,\mathrm{Mpc}/h$ ($4\,\mathrm{Mpc}/h$) for the linear (nonlinear) galaxy-bias model, the S/N is reduced to $75$ (90). A comprehensive suite of validation tests demonstrates that the measurement is robust against observational and astrophysical systematics at the statistical precision required for the DES Y6 analysis. Although not used in the main cosmological analysis, we extract high--signal-to-noise geometric shear-ratio measurements from the galaxy--galaxy lensing signal on small angular scales. These measurements provide an internal consistency check on the photometric redshift distributions and shear calibration used in the $3\times2$pt analysis.
Predictive mathematical models are a cornerstone of science and engineering. Yet selecting, calibrating, and validating said science-based models often remains an art in practice. Model-based design of experiments (MBDoE) provides a systematic framework to maximize information gain from experiments while minimizing time and resource costs. But MBDoE remains limited to niche application areas, in part because practitioners must integrate expertise in statistics, computational optimization, and modeling. To help reduce this barrier, we introduce Pyomo.DOE, an open-source package for MBDoE. Pyomo.DOE uses a nonlinear sensitivity analysis code k_aug to quickly approximate the Fisher information matrix and leverages a new stochastic programming abstraction. We demonstrate Pyomo.DOE with the first application of MBDoE to fixed-bed breakthrough experiments, which highlights the power of Pyomo.DOE to quantify the value of experimental modifications a priori for large-scale partial differential-algebraic equation (PDAE) models. Here we also provide a mathematical primer on MBDoE targeted at general chemical engineers.
Here, we present galaxy-galaxy lensing measurements from the full six years of data from the Dark Energy Survey (DES Y6), covering 4031 deg 2 and used in the DES Y6 3×2 pt cosmological analysis. We use the Maglim++ lens sample, containing ∼9 million galaxies divided into six redshift bins, and the Metadetection source catalog, including ∼140 million galaxies divided into four redshift bins. The mean tangential shear signal achieves a total signal-to-noise ratio (S/N) of 173, corresponding to a 17% improvement over DES Y3. After applying the scale cuts used in the cosmological analysis, with 𝑅 min =6 Mpc/ℎ (4 Mpc/ℎ) for the linear (nonlinear) galaxy-bias model, the S/N is reduced to 75 (90). A comprehensive suite of validation tests demonstrates that the measurement is robust against observational and astrophysical systematics at the statistical precision required for the DES Y6 analysis. Although not used in the main cosmological analysis, we extract high signal-to-noise geometric shear-ratio measurements from the galaxy-galaxy lensing signal on small angular scales. These measurements provide an internal consistency check on the photometric redshift distributions and shear calibration used in the 3 ×2 pt analysis.
The E12-17-003 (e, e'K+) experiment was carried out in the experimental Hall A facility of Jefferson Lab in November 2018. The experiment aimed at providing the experimental data for the unknown Lambda-n interaction by measuring the bound state or the resonance state as indicated by the HypHI experiment. The so obtained Lambda-n interaction was assumed to solve the existing charge symmetry breaking problem in the case of Lambda-N interaction. The experiment used Hall A high resolution spectrometers (both left and right spectrometers) positioned symmetrically at constant angle 13.2 deg. each. A 25 cm long aluminum cylinder filled with H-3 gas was used as a production target. The major calibration data were taken with the H target contained in an identical aluminum cylinder. The electroproduction of Lambda and Sigma^0 via p(e, e'K+)Lambda, Sigma^0 reactions was used to calibrate the absolute energy scale with the known masses of the Lambda and Sigma^0. Then by using the (e, e'K+) Sigma-reaction, two possible Lambda-nn resonance states and one NN bound state were observed. The observed states have the energy resolution about 1.6 MeV (FWHM), however, great r statistics are required to solidly confirm the observed states. The A = 3 and 4 Sigma bound states have been predicted long ago but only the A = 4 Sigma hypernucleus, that is He-4/Sigma, was found in the (K-, pi-) reaction. A careful Monte Carlo study was conducted to study the A (nuclear mass number) dependence on the missing mass resolution by using the identical experimental conditions. The simulated and experimentally obtained Lambda and Sigma^0 channels agreed within 100 keV in sigma, where sigma is the standard deviation. The intrinsic missing mass resolution of A = 3 (3/Lambda-n) resonance was predicted about sigma = 0.67 MeV with a natural width of about 0.6 MeV. However, due to the low statistics the precision does not permit sufficient constrain on the determination of the Lambda-n interaction. The reason of having such low statistics is due to the use of unoptimized Hall A system which was definitely feasible but not ideal for this experiment. In addition, the cross section was found to be much smaller than expected.
Building on the 3-year End-Use Load Profiles project to calibrate and validate the U.S. Department of Energy's ResStock and ComStock models, this work produces national data sets that enable cities, states, utilities, and other stakeholders to answer a broad range of questions regarding their commercial building stock. ComStock is a highly granular, bottom-up model that uses various data sources, statistical sampling methods, and advanced building energy simulations to estimate the annual subhourly energy consumption of the commercial building stock across the United States. The "baseline" model intends to represent the U.S. commercial building stock as it existed in 2018. The methodology of the baseline model is discussed in the ComStock Reference Documentation. The goal of this work is to develop energy efficiency and demand flexibility measures that cover market-ready technologies and study their mass adoption impact on the baseline building stock. "Measures" refers to various "what-if" scenarios that can be applied to buildings. The results for the baseline and measure scenario simulations are published in public data sets that provide insights into building stock characteristics, operational behaviors, utility bill impacts, and annual and sub-hourly energy usage by fuel type and end use. This report describes the modeling methodology for a single ComStock measure scenario - high-efficiency rooftop unit (RTU) - and briefly introduces key results. The full public data set can be accessed on the Comstock data lake or via the Data Viewer at comstock.nlr.gov. The public data set enables users to create custom aggregations of results for their use case (e.g., filter to a specific county or building type).
Building on the 3-year End-Use Load Profiles project to calibrate and validate the U.S. Department of Energy's ResStock and ComStock models, this work produces national data sets that enable cities, states, utilities, and other stakeholders to answer a broad range of questions regarding their commercial building stock. ComStock is a highly granular, bottom-up model that uses various data sources, statistical sampling methods, and advanced building energy simulations to estimate the annual subhourly energy consumption of the commercial building stock across the United States. The "baseline" model intends to represent the U.S. commercial building stock as it existed in 2018. The methodology of the baseline model is discussed in the ComStock Reference Documentation. The goal of this work is to develop energy efficiency and demand flexibility measures that cover market-ready technologies and study their mass adoption impact on the baseline building stock. "Measures" refers to various "what-if" scenarios that can be applied to buildings. The results for the baseline and measure scenario simulations are published in public data sets that provide insights into building stock characteristics, operational behaviors, utility bill impacts, and annual and sub-hourly energy usage by fuel type and end use. This report describes the modeling methodology for a single ComStock measure scenario - variable speed pumps - and briefly introduces key results. The full public data set can be accessed on the ComStock data lake or via the Data Viewer at comstock.nlr.gov. The public data set enables users to create custom aggregations of results for their use case (e.g., filter to a specific county or building type).
In this study, we present direct evidence for neutrons causing nucleation of supercooled water. Highly purified water (20 nm filtration) is cooled to well below freezing (as low as −20 °C) with a radioactive calibration source of neutrons/gamma-rays either present or removed during each of many control cooling runs for the same volume of water. When it is primarily neutrons irradiating the sample bulk, the non-equilibrium freezing point (also known as the “supercooling point”) is, on average, +0.7 °C warmer than the control equivalent, with a statistical significance of greater than 5 Sigma, with systematic uncertainty included. This effect is not observed with water in the presence of gamma-rays instead of neutrons. While these neutrons should have theoretically had sufficient energy to mount the energy barrier, corroborating our results, their raising of supercooling temperature has never been reported experimentally to the best of our knowledge. The potential to use deeply supercooled solutions, not only water, as metastable detectors for radiation and perhaps dark matter or neutrino physics presents now a new avenue for exploration.
We present a Hubble Space Telescope (HST) weak gravitational lensing study of nine distant and massive galaxy clusters with redshifts 1.0 ≲ z ≲ 1.7 (z median = 1.4) and Sunyaev Zel’dovich (SZ) detection significance ξ > 6.0 from the South Pole Telescope Sunyaev Zel’dovich (SPT-SZ) survey. We measured weak lensing galaxy shapes in HST/ACS F606W and F814W images and used additional observations from HST/WFC3 in F110W and VLT/FORS2 in U HIGH to preferentially select background galaxies at z ≳ 1.8, achieving a high purity. We combined recent redshift estimates from the CANDELS/3D-HST and HUDF fields to infer an improved estimate of the source redshift distribution. We measured weak lensing masses by fitting the tangential reduced shear profiles with spherical Navarro-Frenk-White (NFW) models. We obtained the largest lensing mass in our sample for the cluster SPT-CL J2040—4451, thereby confirming earlier results that suggest a high lensing mass of this cluster compared to X-ray and SZ mass measurements. Combining our weak lensing mass constraints with results obtained by previous studies for lower redshift clusters, we extended the calibration of the scaling relation between the unbiased SZ detection significance ζ and the cluster mass for the SPT-SZ survey out to higher redshifts. We found that the mass scale inferred from our highest redshift bin (1.2 < z < 1.7) is consistent with an extrapolation of constraints derived from lower redshifts, albeit with large statistical uncertainties. Thus, our results show a similar tendency as found in previous studies, where the cluster mass scale derived from the weak lensing data is lower than the mass scale expected in a PlanckνΛCDM (i.e. νΛ cold dark matter) cosmology given the SPT-SZ cluster number counts.
This study assesses the deterministic and probabilistic forecasting skill of a 1-month-lead ensemble of Artificial Neural Networks (EANN) based on low-frequency climate oscillation indices. The predictand is the February-April (FMA) rainfall in the Brazilian state of Ceará, which is a prominent subject in climate forecasting studies due to its high seasonal predictability. Additionally, the study proposes combining the EANN with dynamical models into a hybrid multi-model ensemble (MME). The forecast verification is carried out through a leave-one-out cross-validation based on 40 years of data. The EANN forecasting skill is compared with traditional statistical models and the dynamical models that compose Ceará’s operational seasonal forecasting system. A spatial comparison showed that the EANN was among the models with the smallest Root Mean Squared Error (RMSE) and Ranked Probability Score (RPS) in most regions. Moreover, the analysis of the area-aggregated reliability showed that the EANN is better calibrated than the individual dynamical models and has better resolution than Multinomial Logistic Regression for above-normal (AN) and below-normal (BN) categories. It is also shown that combining the EANN and dynamical models into a hybrid MME reduces the overconfidence of the extreme categories observed in a dynamically-based MME, improving the reliability of the forecasting system.
We are compiling a new list of gamma-ray jetted active galactic nuclei (AGN), starting from the fourth catalog of point sources of the Fermi Large Area Telescope (LAT). Our aim is to prepare a list of jetted AGN with known redshifts and classifications to be used to calibrate jet power. We searched in the available literature for all the published optical spectra and multiwavelength studies useful to characterize the sources. We found new, missed, or even forgotten information leading to a substantial change in the redshift values and classification of many sources. We present here the preliminary results of this analysis and some statistics based on the gamma-ray sources with right ascension within the interval 0 h --12 h (J2000). Although flat-spectrum radio quasars and BL Lac objects are still the dominant populations, there is a significant increase in the number of other objects, such as misaligned AGN, narrow-line Seyfert 1 galaxies, and Seyfert galaxies. We also introduced two new classes of objects: changing-look AGN and ambiguous sources. About one third of the sources remain unclassified.
Weak gravitational lensing has emerged as a leading probe of the growth of cosmic structure. However, the shear signal is very small and accurate measurement depends critically on our ability to understand how non-ideal instrumental effects affect astronomical images. The Wide-Field Infrared Survey Telescope (WFIRST) will fly a focal plane containing 18 Teledyne H4RG-10 near-infrared detector arrays, which present different instrument calibration challenges from previous weak lensing observations. Previous work [Paper I: Hirata & Choi, PASP, 132, 014501 (2020); and Paper II: Choi & Hirata, PASP, 132, 014502 (2020)] has shown that correlation functions of flat field images, including cross-correlations between different time slices that are enabled by the non-destructive read capability of the infrared detectors, are effective tools for disentangling linear and nonlinear inter-pixel capacitance (IPC) and the brighter-fatter effect (BFE). Here we present a Fourier-domain treatment of the flat field correlations, which allows us to expand the previous formalism to all orders in IPC, BFE, and classical nonlinearity. We show that biases in simulated flat field analyses in Paper I are greatly reduced through the use of this formalism. We then apply this updated formalism to flat field data from three WFIRST flight candidate detectors, and explore the robustness to variations in the analysis. We find that the BFE is present in all three detectors, and that its contribution to the flat field correlations dominates over the nonlinear IPC, in accordance with the results from Paper II on a development detector. The magnitude of the BFE is such that the effective area of a pixel is increased by (3.54 ± 0.03) × 10 -7 for every electron deposited in a neighboring pixel (sensor chip assembly [SCA] 20829, statistical error, not IPC-deconvolved). We compare IPC maps from flat field autocorrelation measurements to those obtained from the single pixel reset method and find a median difference of 0.113% for SCA 20829. After further diagnosis of this difference, we ascribe it largely to an additional source of cross-talk, the vertical trailing pixel effect, and recommend further work to develop a model for this effect. These results represent a significant step toward calibration of the non-ideal effects in WFIRST detectors.
A unifying mathematical formulation is needed to move from one-off digital twins built through custom implementations to robust digital twin implementations at scale. This work proposes a probabilistic graphical model as a formal mathematical representation of a digital twin and its associated physical asset. We create an abstraction of the asset–twin system as a set of coupled dynamical systems, evolving over time through their respective state spaces and interacting via observed data and control inputs. The formal definition of this coupled system as a probabilistic graphical model enables us to draw upon well-established theory and methods from Bayesian statistics, dynamical systems and control theory. The declarative and general nature of the proposed digital twin model make it rigorous yet flexible, enabling its application at scale in a diverse range of application areas. Here, we demonstrate how the model is instantiated to enable a structural digital twin of an unmanned aerial vehicle (UAV). The digital twin is calibrated using experimental data from a physical UAV asset. Its use in dynamic decision-making is then illustrated in a synthetic example where the UAV undergoes an in-flight damage event and the digital twin is dynamically updated using sensor data. The graphical model foundation ensures that the digital twin calibration and updating process is principled, unified and able to scale to an entire fleet of digital twins.
The Ka-band ARM Zenith Radar Active Remote Sensing of CLouds CloudSat-aligned (KAZRARSCL-CLOUDSAT) Value-Added Product (VAP) applies satellite-based reflectivity calibrations to KAZRARSCL data sets. The Atmospheric Radiation Measurement (ARM) user facility has primarily used radar subsystem calibration monitoring to track cloud radar reflectivity drift over time, since reliable external calibration sources or other absolute references (such as corner reflectors) have historically been unavailable or impracticable. A study by Kollias et al. (2019) examined cloud reflectivity profiles observed with a well-characterized spaceborne downward-pointing millimeter cloud radar, operating as part of NASA’s CloudSat satellite mission (Tanelli et al. 2008). The Kollias team derived monthly statistical reflectivity offsets between CloudSat and the various generations of ARM cloud radars (millimeter wavelength cloud radar [MMCR], W-Band ARM Cloud Radar [WACR[, and Ka-band ARM Zenith Radar [KAZR]) for many, but not all, months at most fixed and mobile ARM sites over the period 2007-2017. These offsets, when available, are applied to the existing KAZRARSCL VAP products using the KAZRARSCL-CLOUDSAT VAP.
Building on a 3-year effort to calibrate and validate the U.S. Department of Energy's ResStock (TM) and ComStock (TM) models, this work produces national datasets that empower analysts working for federal, state, utility, city, and manufacturer stakeholders to answer a broad range of questions regarding their commercial building stock. ComStock is a highly granular, bottom-up model that uses multiple data sources, statistical sampling methods, and advanced building energy simulations to estimate the annual energy consumption (at a subhourly resolution) of the commercial building stock across the United States. The baseline model intends to represent the U.S. commercial building stock as it existed in 2018. The methodology and results of the baseline model are discussed in the final technical report of the End-Use Load Profiles project. The goal of this work is to develop energy efficiency and demand flexibility end-use load shapes that cover high-impact, market-ready (or nearly market-ready) measures. "Measures" refers to various "what-if" scenarios that can be applied to buildings. An end-use savings shape is the difference in energy consumption between a baseline building (or collection of buildings) and a building with an energy efficiency or demand flexibility measure applied. It results in a time-series profile broken down by end use and fuel (electricity or on-site gas, propane, or fuel oil use) at each time step, as well as annual aggregations. This report describes the modeling methodology for a single end-use savings shape measure - chiller replacement - and briefly introduces key results. The full public dataset can be accessed on the ComStock (TM) data lake or via the Data Viewer at comstock.nrel.gov. The public data set enables users to create custom aggregations of results for their use case (e.g., filter to a specific county).
Building on a 3-year effort to calibrate and validate the U.S. Department of Energy's ResStock (TM) and ComStock (TM) models, this work produces national datasets that empower analysts working for federal, state, utility, city, and manufacturer stakeholders to answer a broad range of questions regarding their commercial building stock. ComStock is a highly granular, bottom-up model that uses multiple data sources, statistical sampling methods, and advanced building energy simulations to estimate the annual energy consumption (at subhourly resolution) of the commercial building stock across the United States. The baseline model intends to represent the U.S. commercial building stock as it existed in 2018. The methodology and results of the baseline model are discussed in the final technical report of the End-Use Load Profiles project. The goal of this work is to develop energy efficiency and demand flexibility end-use load shapes that cover high-impact, market-ready (or nearly market-ready) measures. "Measures" refers to various "what-if" scenarios that can be applied to buildings. An end-use savings shape is the difference in energy consumption between a baseline building (or collection of buildings) and a building with an energy efficiency or demand flexibility measure applied. It results in a time-series profile broken down by end use and fuel (electricity or on-site gas, propane, or fuel oil use) at each time step, as well as annual aggregations.