Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “parameter calibration”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 469 records · Page 26
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

A precise measurement of the jet energy scale derived from single-particle measurements and in situ techniques in proton–proton collisions at $\sqrt{s}=$ 13 TeV with the ATLAS detector

The jet energy calibration and its uncertainties are derived from measurements of the calorimeter response to single particles in both data and Monte Carlo simulation using proton–proton collisions at $\sqrt{s} = 13$ TeV collected with the ATLAS detector during Run 2 at the Large Hadron Collider. The jet calibration uncertainty for anti-$k_T$ jets with a jet radius parameter of R$_\textrm{jet} = 0.4$ and in the central jet rapidity region is about 2.5% for transverse momenta ($p_{\text {T}}$) of 20 $\text {GeV}$ , about 0.5% for $p_{\text {T}} = 300$ GeV and 0.7% for $p_{\text {T}} = 4$ TeV . Excellent agreement is found with earlier determinations obtained from -balance based in situ methods ($Z/\gamma$ +jets). The combination of these two independent methods results in the most precise jet energy measurement achieved so far with the ATLAS detector with a relative uncertainty of 0.3% at $p_\textrm{T} = 300$ GeV and 0.6% at 4 TeV. The jet energy calibration is also derived with the single-particle calorimeter response measurements separately for quark- and gluon-induced jets and furthermore for jets with R jet varying from 0.2 to 1.0 retaining the correlations between these measurements. Differences between inclusive jets and jets from boosted top-quark decays, with and without grooming the soft jet constituents, are also studied.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2021

Numerical study of the chemo-mechanical behavior of FEBEX bentonite in nuclear waste disposal based on the Barcelona expansive model

Experimental studies show that compacted bentonite used as a backfill material for nuclear waste repository experiences strong coupling between chemical and mechanical processes. Here, we use a dual-structure expansive soil model, referred to as the Barcelona Expansive Model (BExM), to predict the behavior of bentonite buffer in subsurface emplacement tunnels for high-level radioactive waste. After emplacement, the bentonite is subjected to complex and coupled Thermal-Hydraulic-Mechanical-Chemical (THMC) processes. The BExM constitutive model is implemented in a multi-phase reactive transport and geomechanics simulator, TOUGHREACT-FLAC3D, and the model is verified with one benchmark test on FEBEX bentonite. We utilize a one-way Chemo-Mechanical (C-M) coupling approach, in which chemical changes affect the mechanical behavior of bentonite through the BExM linked with the evolution of mass fraction of smectite, exchangeable cation concentration, and ionic strength via osmotic suction. The parameters of the new coupled model for FEBEX bentonite are calibrated against a series of laboratory experiments with various salinity solutions. Finally, coupled THMC modeling is conducted for a generic argillite repository with bentonite buffer under high temperature, focusing on the long-term chemical change and its effect on the mechanical process.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2021

Strong detection of the CMB lensing and galaxy weak lensing cross-correlation from ACT-DR4, Planck Legacy, and KiDS-1000

Here we measured the cross-correlation between galaxy weak lensing data from the Kilo Degree Survey (KiDS-1000, DR4) and cosmic microwave background (CMB) lensing data from the Atacama Cosmology Telescope (ACT, DR4) and the Planck Legacy survey. We used two samples of source galaxies, selected with photometric redshifts, (0.1 < z B < 1.2) and (1.2 < z B < 2), which produce a combined detection significance of the CMB lensing and weak galaxy lensing cross-spectrum of 7.7σ. With the lower redshift galaxy sample, for which the cross-correlation was detected at a significance of 5.3σ, we present joint cosmological constraints on the matter density parameter, Ω m , and the matter fluctuation amplitude parameter, σ 8 , marginalising over three nuisance parameters that model our uncertainty in the redshift and shear calibration as well as the intrinsic alignment of galaxies. We find our measurement to be consistent with the best-fitting flat ΛCDM cosmological models from both Planck and KiDS-1000. We demonstrate the capacity of CMB weak lensing cross-correlations to set constraints on either the redshift or shear calibration by analysing a previously unused high-redshift KiDS galaxy sample (1.2 < z B < 2), with the cross-correlation detected at a significance of 7σ. This analysis provides an independent assessment for the accuracy of redshift measurements in a regime that is challenging to calibrate directly owing to known incompleteness in spectroscopic surveys.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Methods to determine the radiated power in SPI-mitigated disruptions in JET

Here we present techniques for evaluating the radiated power in JET disruptions. Disrupting plasmas are shown to have non-axisymmetric radiation profiles, motivating the re-evaluation of the standard techniques for calculating the total radiated power at JET using bolometry. Four single-channel bolometers at different toroidal locations are exploited to quantify the radiation asymmetry. Toroidal radiation peaking factors integrated over the entire disruption of up to 1.5 have been observed when varying the quantity of neon in pellets used in disruptions mitigated by shattered pellet injection. Using synthetic bolometer diagnostics developed with the Cherab spectroscopy modeling framework, we can estimate the systematic error on total power calculations for relevant radiation profiles and improve estimates of the total radiated power. We show that the component of the systematic error on the total power due to the poloidal radiation profile can be reduced from 70% to 10% with suitable assumptions about the structure of the poloidal profile.

47 OTHER INSTRUMENTATION↗
DOE OSTI2020

Characterization of the pressure coefficient of manganin and temperature evolution of pressure in piston-cylinder cells

Here, we report measurements of the temperature- and pressure-dependent resistance, R ( T , p ), of a manganin manometer in a 4 He-gas pressure setup from room temperature down to the solidification temperature of 4 He ( T solid ~ 50 K at 0.8 GPa) for pressures, p , between 0 GPa and ~0.8 GPa. The same manganin wire manometer was also measured in a piston-cylinder cell (PCC) from 300 K down to 1.8 K and for pressures between 0 GPa and ~2 GPa. From these data, we infer the temperature and pressure dependence of the pressure coefficient of manganin, α ( T , p ), defined by the equation R p = (1 + αp ) R 0 , where R 0 and R p are the resistances of manganin at ambient pressure and finite pressure, respectively. Our results indicate that upon cooling, α first decreases, then goes through a broad minimum at ~120 K, and increases again toward lower temperatures. In addition, we find that α is almost pressure-independent at T ≳ 60 K up to p ~ 2 GPa, but shows a pronounced p dependence at T ≲ 60 K. Using this manganin manometer, we demonstrate that p overall decreases with decreasing temperature in the PCC for the full pressure range and that the size of the pressure difference between room temperature and low temperatures ( T = 1.8 K), Δ p , decreases with increasing pressure. We also compare the pressure values inferred from the manganin manometer with the low-temperature pressure, determined from the superconducting transition temperature of elemental lead (Pb). As a result of these data and analysis, we propose a practical algorithm to infer the evolution of pressure with temperature in a PCC.

47 OTHER INSTRUMENTATION↗
DOE OSTI2021

Going Forward with the Nancy Grace Roman Space Telescope Transient Survey: Validation of Precision Forward-modeling Photometry for Undersampled Imaging

The Nancy Grace Roman Space Telescope (Roman) is an observatory for both wide-field observations and coronagraphy that is scheduled for launch in the mid-2020s. Part of the planned survey is a deep, cadenced field or fields that enable cosmological measurements with type Ia supernovae (SNe Ia). With a pixel scale of 0$_.^"$11, the Wide Field Instrument will be undersampled, presenting a difficulty for precisely subtracting the galaxy light underneath the SNe. We use simulated data to validate the ability of a forward-model code (such codes are frequently also called “scene-modeling” codes) to perform precision supernova photometry for the Roman SN survey. Our simulation includes over 760,000 image cutouts around SNe Ia or host galaxies (~10% of a full-scale survey). To have a realistic 2D distribution of underlying galaxy light, we use the VELA simulated high-resolution images of galaxies. We run each set of cutouts through our forward-modeling code which automatically measures time-dependent SN fluxes. Given our assumed inputs of a perfect model of the instrument point-spread functions and calibration, we find biases at the millimagnitude level from this method in four red filters (Y106, J129, H158, and F184), easily meeting the 0.5% Roman inter-filter calibration requirement for a cutting-edge measurement of cosmological parameters using SNe Ia. Simulated data in the bluer Z087 filter shows larger ~ 2–3 mmg biases, also meeting this requirement, but with more room for improvement. Our forward-model code has been released on Zenodo.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

StarDICE III: characterization of the photometric instrument with a collimated beam projector

The measurement of Type Ia supernovae magnitudes provides cosmological distances, which constrain dark energy parameters. Current and upcoming large photometric surveys require improved photometric calibration precision to reduce systematic uncertainties in cosmological constraints. The StarDICE experiment aims to establish accurate broad-band flux references for these surveys, targeting sub-percent precision in magnitude measurements. Achieving this requires precise filter bandpass measurements for both StarDICE and survey instruments with sub-nanometre accuracy. To this end, we developed the Collimated Beam Projector (CBP), an optical device for calibrating the throughput of astronomical telescopes and their filters. The CBP uses a tunable laser source and a reversed telescope to emit a parallel monochromatic light beam, continuously monitored in flux and wavelength. The CBP output flux is measured with a large-area photodiode calibrated relative to a NIST photodiode. Using CBP measurements, we derive the StarDICE telescope throughput and filter transmissions, anchoring them to NIST’s absolute calibration. After analysing systematic uncertainties, we achieved sub-nanometre accuracy for filter central wavelengths, measured filter transmission with ~0.5 per cent precision per 1 nm bin, and detected out-of-band leakages at a relative level of 10 –4 ⁠. Furthermore, we synthesized equivalent transmission for full pupil illumination from four sampled positions in the StarDICE telescope mirror, with ~0.2 nm accuracy for central wavelengths and 7 mmag for broad-band fluxes. This demonstrates our ability to characterize telescope throughput down to the millimagnitude, paving the way for future developments, such as the Rubin-CBP for measuring the LSST at Vera Rubin Observatory, and a portable CBP version for in-situ transmission monitoring.

Calibration↗
DOE OSTI2021

High-accuracy waveforms for black hole-neutron star systems with spinning black holes

The availability of accurate numerical waveforms is an important requirement for the creation and calibration of reliable waveform models for gravitational wave astrophysics. For black hole-neutron star binaries, very few accurate waveforms are however publicly available. Most recent models are calibrated to a large number of older simulations with good parameter space coverage for low-spin non-precessing binaries but limited accuracy, and a much smaller number of longer, more recent simulations limited to non-spinning black holes. In this paper, we present long, accurate numerical waveforms for three new systems that include rapidly spinning black holes, and one precessing configuration. Here, we study in detail the accuracy of the simulations, and in particular perform for the first time in the context of BHNS binaries a detailed comparison of waveform extrapolation methods to the results of Cauchy Characteristic Extraction. The new waveforms have <0.1rad phase errors during inspiral, rising to ~(0.2-0.4)rad errors at merger, and ≲1% error in their amplitude. We compute the faithfulness of recent analytical models to these numerical results, and find that models specifically designed for BHNS binaries perform well (F>0.99) for binaries seen face-on. For edge-on observations, particularly for precessing systems, disagreements between models and simulations increase, and models that include precession and/or higher-order modes start to perform better than BHNS models that currently lack these features.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

In Situ Cloud Measurements at AMF3 Field Campaign Report

This campaign is a follow-up project to the U.S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) user facility field campaign entitled Cloud Droplet Measurement System for TBS that was focused on integration of the Mesa Photonics' cloud droplet measurement system (CDMS) into the DOE ARM tethered balloon system (TBS) and its initial field testing at ARM’s Southern Great Plains (SGP) atmospheric observatory in February–March 2020. The CDMS performs in situ measurement of droplet size distribution function and droplet number density in clouds. These characteristics are important cloud microphysical properties that are critical input parameters for atmospheric models and are also useful for proper calibration and validation of performance of other atmospheric measurement instrumentation. The overall goals of this campaign were to deploy the CDMS on the DOE ARM TBS, test its compatibility with the TBS under relevant conditions, and perform a series of in-cloud measurements at the third ARM Mobile Facility (AMF3) at Oliktok Point, Alaska. The TBS flights were conducted on November 12–19, 2020.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Cloud Droplet Measurement System for the ARM Tethered Balloon System (TBS) Field Campaign Report

The Mesa Photonics' cloud droplet measurement system (CDMS) performs in situ measurement of droplet size distribution and droplet number density in clouds. These characteristics are important cloud microphysical properties that are critical input parameters for atmospheric models and are also useful for proper calibration and validation of performance of other atmospheric measurement instrumentation. This small campaign was the first project (out of two) that involved integration of the CDMS into the U.S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) user facility’s tethered balloon system (TBS) and its initial testing at the ARM Southern Great Plains (SGP) atmospheric observatory. The follow-up campaign (AFC07016) involved testing of the CDMS under relevant conditions at the third ARM Mobile Facility (AMF3) at Oliktok Point, Alaska and making in situ measurements in clouds. The goal of this small field campaign was to deploy the CDMS on the ARM TBS, demonstrate its integrity and compatibility with the TBS, and test the wireless telecommunication system in preparation for subsequent in-cloud measurements at ARM’s North Slope of Alaska (NSA) observatory at Utqiagvik (formerly Barrow). The specific technical objectives included: (1) Integration of the Mesa Photonics' CDMS into the ARM TBS, (2) testing of the wireless telecommunication system of the CDMS, (3) evaluating the data acquisition software and image processing algorithms especially under high-background-illumination conditions, and (4) testing the ruggedness of the instrument's optical alignment and other performance characteristics. All objectives have been successfully met. The mounting hardware was designed and built mostly at Sandia National Laboratories (SNL), which allowed reliable mounting of the CDMS on the TBS and co-locating the CDMS with other instruments. The field tests were performed by the principal investigator (PI) in collaboration with the TBS operational crew led by D. Dexheimer. The field testing demonstrated good compatibility of the CDMS with the TBS. During the TBS flights, the crew did not experience any operational issues with the CDMS. The instrument demonstrated reliable operational characteristics, including sufficient battery life and good thermal management. The wireless telecommunication system has been successfully tested at TBS flight altitudes of up to 1000 m. During all flights, the CDMS raw data were wirelessly transmitted to the ground station and processed in real time. The ruggedness of the instrument's optical alignment was evaluated by performing calibration of the CDMS (using Mesa Photonics' fixed-size monodisperse droplet generator) before and after the campaign. The calibration was stable within the instrument's measurement precision. In summary, the campaign demonstrated good compatibility of the Mesa Photonics' CDMS with the ARM TBS. The flight tests confirmed the mechanical integrity of the CDMS and stability of its optical layout, as well as reliability of the wireless telecommunication system. Successful completion of this campaign provided a solid basis for the next campaign (AFC07016, November 2020), that involved testing of the CDMS during in-cloud TBS flights at AMF3 at Oliktok Point.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Strength models for stainless steel 304L alloys

This report provides nominal, weak and strong calibrations of Preston- Tonks-Wallace (PTW) plasticity model [1] parameters for stainless steel 304L alloys. The data sets shown indicate that for these alloys, the material’s prove- nance plays an important role in accurate characterization. First we provide a parameter set fit to compression-tested annealed samples, both quasistatic (QS) and split Hopkinson pressure bar (SHPB), from the MST-8 group at LANL within the last year. Then we compare simulations using the FLAG hydrocode [2], with this and other parameter sets, to data from a Taylor cylinder impact test performed within the same group around 2013.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Model-Data for Joint Estimation of Biogeochemical Model Parameters from Multiple Experiments: A Bayesian Approach Applied to Mercury Methylation

This modeling archive supports the manuscript submitted for publication in the Environmental Modeling and Software. This study is supported by ORNL-SFA and IDEAS-Watershed. This study aims to improve calibration of complex biogeochemical models using datasets from multiple experiments targeting specific subprocesses. The proposed Bayesian joint-fitting scheme calibrates the entire biogeochemical model in one go using all the available datasets and estimate parameter uncertainties using Markov Chain Monte Carlo (MCMC). This allows for complete propagation of uncertainties and utilization of the information shared between different datasets. Mapping joint distribution of parameters guides model improvement by identifying null spaces in the parameter space. This archive contains files used to perform MCMC, post-process outputs and visualize results.

East Fork Poplar Creek↗
DOE OSTI2026

Strong Lensing Cosmology with Population-level Calibrated Neural Ratio Estimation

Strong gravitational lensing contains key information about cosmic acceleration. Modern and next-generation galaxy imaging surveys are expected to provide high-quality data on $\mathcal{O}(10^5)$ galaxy-galaxy lensing systems. The plethora and complexity of the data are likely to present computational challenges for parameter inference methods for fitting high-dimensional likelihoods, which are often analytically intractable. Neural Ratio Estimation (NRE) efficiently computes individual likelihood ratios that can be combined into population-level posteriors. We use simulations to study the capacity of NRE to jointly predict the dark energy equation-of-state parameter $w$ and the total matter density $Ω_{m}$ from lensing images and companion spectroscopic information. We also introduce a post hoc posterior coverage calibration procedure that mitigates the model overconfidence that is typically found in neural density estimation applications. Our experiments show that the errors on both parameters decrease with increasing inference population sizes. In particular, for 100 lenses in a standard $Λ$CDM Universe, our calibrated NRE model achieves median fractional uncertainty of $22.8\%$ in $w$ and $2.9\%$ in $Ω_{m}$. This proof of concept demonstrates a potentially scalable approach for efficient cosmological parameter inference with large populations of galaxy-scale lenses observed in future surveys.

Jarugula, Sreevani [Fermilab] (ORCID:0000000253867↗
DOE OSTI2022

Application and evaluation of a pattern-based building energy model calibration method using public building datasets

Building performance simulation has been adopted to support decision making in the building life cycle. An essential issue is to ensure a building energy simulation model can capture the reality and complexity of buildings and their systems in both the static characteristics and dynamic operations. Building energy model calibration is a technique that takes various types of measured performance data (e.g., energy use) and tunes key model parameters to match the simulated results with the actual measurements. This study performed an application and evaluation of an automated pattern-based calibration method on commercial building models that were generated based on characteristics of real buildings. A public building dataset that includes high-level building attributes (e.g., building type, vintage, total floor area, number of stories, zip code) of 111 buildings in San Francisco, California, USA, was used to generate building models in EnergyPlus. Monthly level energy use calibrations were then conducted by comparing building model results against the actual buildings' monthly electricity and natural gas consumption. The results showed 57 out of 111 buildings were successfully calibrated against actual buildings, while the remaining buildings showed opportunities for future calibration improvements. Enhancements to the pattern-based model calibration method are identified to expand its use for: (1) central heating, ventilation and air conditioning (HVAC) systems with chillers, (2) space heating and hot water heating with electricity sources, (3) mixed-use building types, and (4) partially occupied buildings.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2022

Optimization of WAAM Process to Produce AUSC Components with Increased Service Life

Additive manufacturing has the potential to revolutionize industrial hardware and unlock efficiency gains through the fabrication of geometries and architectures not possible by conventional processing. Wire Arc Additive manufacturing (WAAM) process is a class of directed energy deposition process enabling higher build rate and allowing custom wire feedstock allowing spatial variation of microstructure. The larger spot size and lower speed creates a larger melt pool, reducing residual stress and often time creating directional/columnar microstructure for Ni-superalloy. The use of flexible platform provides freedom in deposition strategy, which can accommodate complex substrates, including feature addition onto existing structures, non-flat layers, and repair methods. However, the certification of the final component needs to match the strength requirement. Hence, the quality of the component produced is stringently monitored to avoid buildup of residual stress, cracks, porosity and to reduce detrimental segregated phases commonly observed during alloy solidification. Simulation plays a huge role in predicting the melt pool dimension and can be used to optimize the process parameter. Similar development is also required to perform physics-based modeling of microstructural development in WAAM that can predict the microstructural features during solidification and can be used to optimize the process more effectively. To move toward this goal, Raytheon Technologies Research Center together with Siemens worked to create a set of computational tools to control the process parameters, enable on-line measurements and acquisition with feedback to the optimized process parameters, and eventually track material evolution through each step of the additive process. Computational fluid dynamics is used for accurate prediction and calibration of the thermal field during WAAM process. and phase field models for microstructure evolution as a function of processing parameters to establish a connection between additive parameters and the final microstructure. Here we report cellular automata (CA) model development to predict the dendritic microstructure evolution with surface and bulk nuclei for single track and multiple layers. The CA model was developed to account for secondary element addition and predict segregation, local melting, and latent heat release as well as prediction of Euler angles from orientation information and validated against experiments. This framework was utilized to tailor spatially-varying composition in a part by appropriately controlling the microstructure evolution during the additive process. Functionally graded Haynes 282 alloy with high Cr content at the surface was tested for oxidation and mechanical properties. An advanced physics-based reaction-diffusion model predicting the simultaneous creation of chromium oxide and alumina is developed and validated to extend life expectancy of the WAAM manufactured high temperature part. A machine-learning data-driven framework establishing the process-structure relationship from a dataset of real microstructure images and corresponding process history data has been developed and implemented in the NX Siemens design system. The digital twin configuration along with the tool path generation enabled prediction of WAAM component buildup time and the techno-economic analysis provided a favorable option for all 4 cases with 15-40% cost reduction.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2024

Slitless spectrophotometry with forward modelling: Principles and application to measuring atmospheric transmission

Context.In the next decade, many optical surveys will aim to answer the question of the nature of dark energy by measuring its equation-of-state parameter at the per mill level. This requires trusting the photometric calibration of the survey with a precision never reached so far on many sources of systematic uncertainties. The measurement of the on-site atmospheric transmission for each exposure, or for each season or for the full survey on average, can help reach the per mill precision for the magnitudes. Aims.This work aims at proving the ability to use slitless spectroscopy for standard-star spectrophotometry and its use to monitor on-site atmospheric transmission as needed, for example, by theVera C. RubinObservatory Legacy Survey of Space and Time supernova cosmology program. We fully deal with the case of a disperser in the filter wheel, which is the configuration chosen in theRubinAuxiliary Telescope. Methods.The theoretical basis of slitless spectrophotometry is at the heart of our forward-model approach to extract spectroscopic information from slitless data. We developed a publicly available software calledSpectractor, which implements each ingredient of the model and finally performs a fit of a spectrogram model directly on image data to obtain the spectrum. Results.We show through simulations that our model allows us to understand the structure of spectrophotometric exposures. We also demonstrate its use on real data by solving specific issues and illustrating that our procedure allows the improvement of the model describing the data. Finally, we discuss how this approach can be used to directly extract atmospheric transmission parameters from the data and thus provide the base for on-site atmosphere monitoring. We show the efficiency of the procedure in simulations and test it on the limited available data set.

Astronomy & Astrophysics↗
DOE OSTI2023

An empirical approach to model selection: weak lensing and intrinsic alignments

ABSTRACT In cosmology, we routinely choose between models to describe our data, and can incur biases due to insufficient models or lose constraining power with overly complex models. In this paper, we propose an empirical approach to model selection that explicitly balances parameter bias against model complexity. Our method uses synthetic data to calibrate the relation between bias and the χ2 difference between models. This allows us to interpret χ2 values obtained from real data (even if catalogues are blinded) and choose a model accordingly. We apply our method to the problem of intrinsic alignments – one of the most significant weak lensing systematics, and a major contributor to the error budget in modern lensing surveys. Specifically, we consider the example of the Dark Energy Survey Year 3 (DES Y3), and compare the commonly used non-linear alignment (NLA) and tidal alignment and tidal torque (TATT) models. The models are calibrated against bias in the Ωm–S8 plane. Once noise is accounted for, we find that it is possible to set a threshold Δχ2 that guarantees an analysis using NLA is unbiased at some specified level Nσ and confidence level. By contrast, we find that theoretically defined thresholds (based on, e.g. p-values for χ2) tend to be overly optimistic, and do not reliably rule out cosmological biases up to ∼1–2σ. Considering the real DES Y3 cosmic shear results, based on the reported difference in χ2 from NLA and TATT analyses, we find a roughly $30{{\ \rm per\ cent}}$ chance that were NLA to be the fiducial model, the results would be biased (in the Ωm–S8 plane) by more than 0.3σ. More broadly, the method we propose here is simple and general, and requires a relatively low level of resources. We foresee applications to future analyses as a model selection tool in many contexts.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2021

Advanced Performance Metrics and their Application to the Sensitivity Analysis for Model Validation and Calibration

High-quality generator dynamic models are critical to reliable and accurate power systems studies and planning. With the availability of PMUs, measurement-based approach for model validation has gained significant prominence. In this approach, the quality of a model is analyzed by visually comparing measured generator response with the model-based simulated response for large system disturbances. This paper proposes a new set of performance metrics to assess the model validation results to facilitate automation of the model validation process. In the proposed methodology, first, the slow governor response and comparatively faster oscillatory response are separated, and then a separate set of performance metrics is calculated for each of these two components. These proposed metrics quantify the mismatch between the actual and model-based response in a comprehensive manner without missing any information enabling automation of the process. Furthermore, in this paper, we are also proposing that the sensitivity analysis for model calibration be performed with respect to the proposed metrics for the systematic identification of key parameters. In this work, results obtained using both simulated and real-world case-studies validate the effectiveness of the proposed performance metrics for model validation and their application to the sensitivity analysis for model calibration.

24 POWER TRANSMISSION AND DISTRIBUTION↗