Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Statistical calibration”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6

Normalizing flows for domain adaptation when identifying Λ hyperon events

Here this study focuses on the application of a normalizing flow as a method of domain adaptation when classifying physics data. Normalizing flows offer a way to transform data points between two different distributions. The present study investigates a novel method of transforming latent representations of physics data to a normal distribution and then to a physics distribution again. The final distribution models a simulated distribution. After being transformed, the data can be classified by a neural network trained on labeled simulation data. The present study succeeds in training two normalizing flows that can transform between data (or simulation) and a Gaussian distribution.

47 OTHER INSTRUMENTATION↗

MIC-DP: A Scalable Correlation-Aware Differential Privacy Framework for High-Dimensional Data

Conventional differential privacy (DP) assumes record independence, limiting effectiveness on real-world datasets with temporal, spatial, or structural correlations. These dependencies undermine privacy guarantees and degrade utility in domains like healthcare, IoT, and smart city analytics. We propose Maximum Information Correlated Differential Privacy (MIC-DP), a novel framework that dynamically calibrates noise based on statistical dependencies. MIC-DP uses the Maximum Information Coefficient (MIC) to capture both linear and nonlinear correlations without explicit modeling, enabling adaptive sensitivity adjustment and improved privacy–utility trade-offs. Evaluations on healthcare (MIMIC), demographic (ACI), and synthetic datasets show that MIC-DP reduces mean absolute error (MAE) by up to 5.2% under strict privacy budgets (ϵ≤1), with aggregate utility improvements reaching 18% across datasets and evaluation metrics. MIC-DP provides formal (ϵ,δ)-privacy guarantees, scales efficiently with feature count, and supports deployment in moderate-scale, privacy-sensitive applications. Its tunable performance and runtime efficiency make MIC-DP suitable for privacy-sensitive applications where low-latency analytics and strong privacy guarantees must coexist. These results demonstrate MIC-DP’s effectiveness as a correlation-aware solution for practical DP.

Yang, Wenjun [Univ. of Washington, Tacoma, WA (Uni↗

DeepBench: A simulation package for physical benchmarking data

We introduce **DeepBench**, a python library that generates simple simulated image data from first principles, such as basic geometric shapes and astronomical objects. These data are highly valuable for developing (calibration, testing, and benchmarking) statistical and machine learning models because they make it possible to connect the final data product to physically interpretable inputs. This software includes tools to curate and store the datasets to maximize reproducibility.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Forecasting Lightning Threat using Cloud-resolving Model Simulations

As numerical forecasts capable of resolving individual convective clouds become more common, it is of interest to see if quantitative forecasts of lightning flash rate density are possible, based on fields computed by the numerical model. Previous observational research has shown robust relationships between observed lightning flash rates and inferred updraft and large precipitation ice fields in the mixed phase regions of storms, and that these relationships might allow simulated fields to serve as proxies for lightning flash rate density. It is shown in this paper that two simple proxy fields do indeed provide reasonable and cost-effective bases for creating time-evolving maps of predicted lightning flash rate density, judging from a series of diverse simulation case study events in North Alabama for which Lightning Mapping Array data provide ground truth. One method is based on the product of upward velocity and the mixing ratio of precipitating ice hydrometeors, modeled as graupel only, in the mixed phase region of storms at the -15\dgc\ level, while the second method is based on the vertically integrated amounts of ice hydrometeors in each model grid column. Each method can be calibrated by comparing domainwide statistics of the peak values of simulated flash rate proxy fields against domainwide peak total lightning flash rate density data from observations. Tests show that the first method is able to capture much of the temporal variability of the lightning threat, while the second method does a better job of depicting the areal coverage of the threat. A blended solution is designed to retain most of the temporal sensitivity of the first method, while adding the improved spatial coverage of the second. Weather Research and Forecast Model simulations of selected North Alabama cases show that this model can distinguish the general character and intensity of most convective events, and that the proposed methods show promise as a means of generating quantitatively realistic fields of lightning threat. However, because models tend to have more difficulty in correctly predicting the instantaneous placement of storms, forecasts of the detailed location of the lightning threat based on single simulations can be in error. Although these model shortcomings presently limit the precision of lightning threat forecasts from individual runs of current generation models, the techniques proposed herein should continue to be applicable as newer and more accurate physically-based model versions, physical parameterizations, initialization techniques and ensembles of cloud-allowing forecasts become available.

McCaul, E. W., Jr.↗

The Atacama Cosmology Telescope: Data Characterization and Map Making

We present a description of the data reduction and mapmaking pipeline used for the 2008 observing season of the Atacama Cosmology Telescope (ACT). The data presented here at 148 GHz represent 12% or the 90 TB collected by ACT from 2007 to 2010. In 2008 we observed for 136 days, producing a total of 142h of data (11 TB for the 148 GHz band only), with a daily average of 10.5 h of observation. From these, 108.5 h were devoted to 850 sq deg stripe (11.2 h by 9 deg.1) centered on a declination of -52 deg.7, while 175 h were devoted to a 280 square deg stripe (4.5 h by 4 deg.8) centered at the celestial equator. We discuss sources of statistical and systematic noise, calibration, telescope pointing and data selection. Out of 1260 survey hours and 1024 detectors per array, 816 h and 593 effective detectors remain after data selection for this frequency band, yielding a 38 % survey efficiency. The total sensitivity in 2008, determined from the noise level between 5 Hz and 20 Hz in the time-ordered data stream (TOD), is 32 muK square root of s in CMB units. Atmospheric brightness fluctuations constitute the main contaminant in the data and dominate the detector and noise covariance at low frequencies in the TOD. The maps were made by solving the lease squares problem using the Preconditioned Conjugate Gradient method, incorporating the details of the detector and noise correlations. Cross-correlation with WMAP sky maps as well as analysis from simulations reveal the our maps are unbiased at l > 300. This paper accompanies the public release of the 148 GHz southern stripe maps from 2008. The techniques described here will be applied to future maps and data releases.

Duenner, Rolando↗

Updates of the KArLE Experiment: New Libs Calibration Under High Vacuum for the Quantification of Potassium in Basalt for In Situ Geochronology

In planetary exploration, in situ absolute geochronology is one of the main important measurements that needs to be accomplished. Until now, on Mars, the age of the surface is only determined by crater density counting, which gives relative ages. These ages can have a lot of uncertainty as they depend on many parameters. More than that, the curves must be ties to absolute ages. Thus far, only the lost lander Beagle 2 was designed to conduct absolute geochronology measurements, though some recent attempts using MSL Curiosity show that this investigation is feasible and should be strongly encouraged for future flight. Experimental: The Potassium (K)-Argon Laser Experiment (KArLE) is being developed at MSFC through the NASA Planetary Instrument Definition and Development Program (PIDDP). The goal of this experiment is to provide in situ geochronology based on the K-Ar method. A laser ablates a rock under high vacuum, creating a plasma which is sensed by an optical spectrometer to do Laser Induced Breakdown Spectroscopy (LIBS). The ablated material frees gases, including radiogenic 40Ar,which is measured by a mass spectrometer (MS). As the potassium is a content and the 40Ar is a quantity, the ablated mass needed in order to relate them. The mass is given by the product of the ablated volume by the density of this material. So we determine the mineralogy of the ablated material with the LIBS spectra and images and calculate its density. The volume of the pit is measured by using microscopy. LIBS measurement of K under high vacuum: Three independant projects [1, 2, 3] including KArLE, are developing geochronological instruments based on this LA-LIBS-MS method. Despite several differences in their setup, all of them have validated the methods with analyses and ages. However, they all described difficulties with the LIBS measurements of K [3,4]. At ambient pressure, the quantification of K by LIBS on geological materials can be accurate [5]. However the protocol of the LA-LIBS-MS experiment required hundreds of shots under high vacuum in order to free enough 40Ar* to be measured by the QMS. This long duration of ablation may induces significant changes in the LIBS spectra. The pressure may increases by orders of magnitudewithin the chamber and the laser pit geometry can change the effectiveness of ablation and intensity of plasma light received. These effects introduce variation between the first and last spectra and so the quantification of K is more complex. The ablation of one crater can give, depending on the protocol of acquisition, from tens to hundreds of spectra. Protocol and results: We are in the process of further characterizing the variation introduced into LIBS spectra by the use of hundreds of laser shots, and definining a protocol that can be used to ensure accuracy and reporoducibility in the results.We are using natural rock powder standards fused in a furnace, as well as mars analog samples with known K content. We will show the result of the calibration and some new statistical approaches in order to apprehend the effects of the long time ablation on rocks under high vacuum.

Devismes, D.↗

Status of the NASA GMAO Observing System Simulation Experiment

An Observing System Simulation Experiment (OSSE) is a pure modeling study used when actual observations are too expensive or difficult to obtain. OSSEs are valuable tools for determining the potential impact of new observing systems on numerical weather forecasts and for evaluation of data assimilation systems (DAS). An OSSE has been developed at the NASA Global Modeling and Assimilation Office (GMAO, Errico et al 2013). The GMAO OSSE uses a 13-month integration of the European Centre for Medium- Range Weather Forecasts 2005 operational model at T511/L91 resolution for the Nature Run (NR). Synthetic observations have been updated so that they are based on real observations during the summer of 2013. The emulated observation types include AMSU-A, MHS, IASI, AIRS, and HIRS4 radiance data, GPS-RO, and conventional types including aircraft, rawinsonde, profiler, surface, and satellite winds. The synthetic satellite wind observations are colocated with the NR cloud fields, and the rawinsondes are advected during ascent using the NR wind fields. Data counts for the synthetic observations are matched as closely as possible to real data counts, as shown in Figure 2. Errors are added to the synthetic observations to emulate representativeness and instrument errors. The synthetic errors are calibrated so that the statistics of observation innovation and analysis increments in the OSSE are similar to the same statistics for assimilation of real observations, in an iterative method described by Errico et al (2013). The standard deviations of observation minus forecast (xo-H(xb)) are compared for the OSSE and real data in Figure 3. The synthetic errors include both random, uncorrelated errors, and an additional correlated error component for some observational types. Vertically correlated errors are included for conventional sounding data and GPS-RO, and channel correlated errors are introduced to AIRS and IASI (Figure 4). HIRS, AMSU-A, and MHS have a component of horizontally correlated error. The forecast model used by the GMAO OSSE is the Goddard Earth Observing System Model, Version 5 (GEOS-5) with Gridpoint Statistical Interpolation (GSI) DAS. The model version has been updated to v. 5.13.3, corresponding to the current operational model. Forecasts are run on a cube-sphere grid with 180 points along each edge of the cube (approximately 0.5 degree horizontal resolution) with 72 vertical levels. The DAS is cycled at 6-hour intervals, with 240 hour forecasts launched daily at 0000 UTC. Evaluation of the forecasting skill for July and August is currently underway. Prior versions of the GMAO OSSE have been found to have greater forecasting skill than real world forecasts. It is anticipated that similar forecast skill will be found in the updated OSSE.

OSSE↗

Comparison of hot wire/laser velocimeter turbulence intensity measurements

The question of whether a random measure of particle velocities yields a good statistical estimate of the stationary condition of the turbulence flow field was investigated by comparing hot-wire and laser velocimeter turbulence intensity measurements. Great care was taken to insure that the instrument precision of both the laser velocimeter and hot wire was maximized. In this attempt to reduce the measurement uncertainties in the hot wire, direct digitization of the analog output signal was performed with point-by-point conversion to velocity through a spline fit calibration curve and the turbulence intensity function was calculated statistically. Frequent calibrations of the hot wire were performed using the laser velocimeter as the velocity standard to account for the presence of the small seed particles in the air flow and signal drift in the hot wire.

Meyers, J. F.↗

Generic Techniques for the Calibration of Robots with Application of the 3-D Fixtures and Statistical Technique on the PUMA 500 and ARID Robots

A relatively simple, inexpensive, and generic technique that could be used in both laboratories and some operation site environments is introduced at the Robotics Applications and Development Laboratory (RADL) at Kennedy Space Center (KSC). In addition, this report gives a detailed explanation of the set up procedure, data collection, and analysis using this new technique that was developed at the State University of New York at Farmingdale. The technique was used to evaluate the repeatability, accuracy, and overshoot of the Unimate Industrial Robot, PUMA 500. The data were statistically analyzed to provide an insight into the performance of the systems and components of the robot. Also, the same technique was used to check the forward kinematics against the inverse kinematics of RADL's PUMA robot. Recommendations were made for RADL to use this technique for laboratory calibration of the currently existing robots such as the ASEA, high speed controller, Automated Radiator Inspection Device (ARID) etc. Also, recommendations were made to develop and establish other calibration techniques that will be more suitable for site calibration environment and robot certification.

Tawfik, Hazem↗

High mass and halo resolution from fast low resolution simulations

Generating mocks for future sky surveys requires large volumes and high resolutions, which is computationally expensive even for fast simulations. Here we try to develop numerical schemes to calibrate various halo and matter statistics in fast low resolution simulations compared to high resolution N-body and hydrodynamic simulations. For the halos, we improve the initial condition resolution and develop a halo finder "relaxed-FoF", where we allow different linking lengths for different halo mass and velocity dispersions. We show that our relaxed-FoF halo finder improves the common statistics, such as halo bias, halo mass function, halo auto power spectrum, cross correlation coefficient with the reference halo catalog, and halo-matter cross power spectrum. We also calibrate small-scale velocities of small halos to improve the power spectrum in redshift space. For the matter statistics, we incorporate the potential gradient descent (PGD) method into fast simulations to improve the matter distribution at nonlinear scales. By building a lightcone output, we show that the PGD method significantly improves the weak lensing convergence tomographic power spectrum. With these improvements FastPM is comparable to the high resolution full N-body simulation of the same mass resolution, with two orders of magnitude fewer time steps. These techniques can be used to improve the halo and matter statistics of FastPM simulations for mock catalogs of future surveys such as DESI and LSST.

79 ASTRONOMY AND ASTROPHYSICS↗

Bridging the gap between experiments and simulations using machine learning

The physics of inertial confinement fusion is rich and complex. Simulation codes that are used to design experiments are computationally expensive and lack the predictive capability required for extensive parameter exploration in search of a high-performing design for laser direct drive. In this work we use deep learning to build a fast emulator of experiments. To facilitate the development of the deep-learning model, an autoencoder is used to reduce the dimensionality of the input space. Two deep learning models are developed. One model is trained on a vast array of simulation data and is subsequently calibrated to expensive and limited experimental data using a technique known as “transfer learning.” The other model is trained on a statistical model and is subsequently calibrated using experimental data. A comparative study of the two predictive models is carried out. The models potentially reproduce key experimental observables with high accuracy and unprecedented inference times relative to those achieved with simulation codes. These models facilitate rapid exploration of a high dimensional input parameter space.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Preliminary Statistical Analysis of the 1995 Evaluation by NASA LaRC of the IAI Automatic Balance Calibration Machine

The NASA Langley Research Center (LARC) participated in a national cooperative evaluation of the Israel Aircraft Industries (IAI) automatic balance calibration machine at Microcraft, San Diego in September 1995. A LaRC-designed six-component strain gauge balance was selected for test and calibration during LaRC's scheduled evaluation period. Eight calibrations were conducted using three selected experimental designs. Raw data were exported to LaRC facilities for reduction and statistical analysis using the techniques outlined in Tripp and Tcheng (1994). This report presents preliminary assessments of the results, and compares IAI calibration results with manual calibration results obtained at the Modern Machine and Tool Co., Inc. (MM & T). Newport News, VA. A more comprehensive report is forthcoming.

Tcheng, Ping↗

Bayes goes fast: Uncertainty quantification for a covariant energy density functional emulated by the reduced basis method

A covariant energy density functional is calibrated using a principled Bayesian statistical framework informed by experimental binding energies and charge radii of several magic and semi-magic nuclei. The Bayesian sampling required for the calibration is enabled by the emulation of the high-fidelity model through the implementation of a reduced basis method (RBM)—a set of dimensionality reduction techniques that can speed up demanding calculations involving partial differential equations by several orders of magnitude. The RBM emulator we build—using only 100 evaluations of the high-fidelity model—is able to accurately reproduce the model calculations in tens of milliseconds on a personal computer, an increase in speed of nearly a factor of 3,300 when compared to the original solver. Besides the analysis of the posterior distribution of parameters, we present model calculations for masses and radii with properly estimated uncertainties. We also analyze the model correlation between the slope of the symmetry energy L and the neutron skin of 48 Ca and 208 Pb. The straightforward implementation and outstanding performance of the RBM makes it an ideal tool for assisting the nuclear theory community in providing reliable estimates with properly quantified uncertainties of physical observables. Such uncertainty quantification tools will become essential given the expected abundance of data from the recently inaugurated and future experimental and observational facilities.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

CALIPSO IIR Version 2 Level 1b Calibrated Radiances: Analysis and Reduction of Residual Biases in the Northern Hemisphere

Version 2 of the Level 1b calibrated radiances of the Imaging Infrared Radiometer (IIR) on board the Cloud-Aerosol Lidar and Infrared Satellite Observation (CALIPSO) satellite has been released recently. This new version incorporates corrections of small but systematic seasonal calibration biases previously revealed in Version 1 data products mostly north of 30° N. These biases – of different amplitudes in the three IIR channels 8.65 µm (IIR1), 10.6 µm (IIR2), and 12.05 µm (IIR3) – were made apparent by a striping effect in images of IIR inter-channel brightness temperature differences (BTDs) and through seasonal warm biases of nighttime IIR brightness temperatures in the 30–60° N latitude range. The latter were highlighted through observed and simulated comparisons with similar channels of the Moderate Resolution Imaging Spectroradiometer (MODIS) on board the Aqua spacecraft. To characterize the calibration biases affecting Version 1 data, a semi-empirical approach is developed, which is based on the in-depth analysis of the IIR internal calibration procedure in conjunction with observations such as statistical comparisons with similar MODIS/Aqua channels. Two types of calibration biases are revealed: an equalization bias affecting part of the individual IIR images and a global bias affecting the radiometric level of each image. These biases are observed only when the temperature of the instrument increases, and they are found to be functions of elapsed time since night-to-day transition, regardless of the season. Correction coefficients of Version 1 radiances could thus be defined and implemented in the Version 2 code. As a result, the striping effect seen in Version 1 is significantly attenuated in Version 2. Systematic discrepancies between nighttime and daytime IIR–MODIS BTDs in the 30–60° N latitude range in summer are reduced from 0.2 K in Version 1 to 0.1 K in Version 2 for IIR1–MODIS29. For IIR2–MODIS31 and IIR3–MODIS32, they are reduced from 0.4 K to close to zero, except for IIR3–MODIS32 in June, where the night-minus-day difference is around −0.1 K.

Garnier, Anne↗

A probabilistic creep model incorporating test condition, initial damage, and material property uncertainty

Uncertainty is prevalent in the creep resistance of alloys, where at elevated temperature and low pressure, rupture can range across logarithmic decades. In this study, a probabilistic continuum-damage-mechanics (CDM)-based model is derived to capture the uncertainty of creep resistance. To meet this objective, creep data for alloy 304 Stainless Steel is gathered. A constitutive model, “Sinh”, is calibrated deterministically to determine the statistical variability of the material properties. Three sources of uncertainty are injected into the model: test condition (stress and temperature), initial damage, and material properties. Probabilistic simulations are carried out by (a) calibrating probability distribution functions (pdfs) for each source of uncertainty (b) randomly sampling the pdfs using Monte Carlo methods and (c) executing simulations to replicate the uncertain creep behavior. A sensitivity analysis is performed to evaluate the relative effect of each source of uncertainty. In full probabilistic simulations, the cumulative uncertainty of creep behavior is evaluated. The probabilistic model accurately predicts the creep deformation and rupture of the available experiments. The probabilistic model is validated for interpolation but lacks extrapolation ability. Several future works are proposed to further improve the model.

36 MATERIALS SCIENCE↗

How Useful are Conventional I–Vs for Performance Calibration of Single- and Two-Junction Perovskite Solar Cells? A Statistical Analysis of Performance Data on ≈200 Cells from 30 Global Sources

As perovskite photovoltaics (PV) advance from the laboratory to commercial prototypes, their accurate and reliable performance testing is becoming increasingly important. The well-documented dynamic response of perovskite solar cells to an external applied voltage has led to the development of steady-state performance measurement methods; however, these methods have not been widely adopted by the perovskite PV community. A key reason for this is that steady-state measurement methods take tens of minutes to complete, as opposed to conventional "fast" current-voltage (I-V) measurements usually lasting a few seconds. Fast I-Vs arise from a snapshot, almost always not a steady-state condition of the device; however, given their widespread use, the question arises: how do performance parameters of perovskite PV compare when measured with fast I-V and with a steady-state method? Results compiled from approximately 200 perovskite PV cells, including single junction, and two-terminal perovskite-perovskite and perovskite-Si tandems, show that fast I-Vs can provide a useful measure of the open-circuit voltage of the devices, while the short-circuit current and the overall efficiency can be widely misestimated. Here, the implications of these findings on performance testing protocols are discussed and possible options for fast and accurate testing of perovskite PV are proposed.

14 SOLAR ENERGY↗

Quantifying uncertainty in analysis of shockless dynamic compression experiments on platinum. II. Bayesian model calibration

Dynamic shockless compression experiments provide the ability to explore material behavior at extreme pressures but relatively low temperatures. Typically, the data from these types of experiments are interpreted through an analytic method called Lagrangian analysis. Here, in this work, alternative analysis methods are explored using modern statistical methods. Specifically, Bayesian model calibration is applied to a new set of platinum data shocklessly compressed to 570 GPa. Several platinum equation-of-state models are evaluated, including traditional parametric forms as well as a novel non-parametric model concept. The results are compared to those in Paper I obtained by inverse Lagrangian analysis. The comparisons suggest that Bayesian calibration is not only a viable framework for precise quantification of the compression path, but also reveals insights pertaining to trade-offs surrounding model form selection, sensitivities of the relevant experimental uncertainties, and assumptions and limitations within Lagrangian analysis. The non-parametric model method, in particular, is found to give precise unbiased results and is expected to be useful over a wide range of applications. The calibration results in estimates of the platinum principal isentrope over the full range of experimental pressures to a standard error of 1.6%, which extends the results from Paper I while maintaining the high precision required for the platinum pressure standard.

Brown, Justin Lee↗

An extended radar relative calibration adjustment (eRCA) technique for higher-frequency radars and range–height indicator (RHI) scans

Abstract. This study extends the relative calibration adjustment technique for calibration of weather radars to higher-frequency radars as well as range–height indicator (RHI) scans. The calibration of weather radars represents one of the most dominant sources of error for their use in a variety of fields including quantitative precipitation estimation and model comparisons. While most weather radars are routinely calibrated, the frequency of calibration is often less than required, resulting in miscalibrated time periods. While full absolute calibration techniques often require the radar to be taken offline for a period of time, there have been online calibration techniques discussed in the literature. The relative calibration adjustment (RCA) technique uses the statistics of the ground clutter surrounding the radar as a monitoring source for the stability of calibration but has only been demonstrated to work at S- and C-band for plan-position indicator (PPI) scans at a constant elevation. In this work the RCA technique is modified to work with higher-frequency radars, including Ka-band cloud radars. At higher frequencies the properties of clutter can be much more variable. This work introduces an extended clutter selection procedure that incorporates the temporal stability of clutter and helps to improve the operational stability of RCA for relatively higher-frequency radars. The technique is also extended to utilize range–height scans from radars where the elevation is varied rather than the azimuth. These types of scans are often utilized with research radars to examine the vertical structure of clouds. The newly extended technique (eRCA) is applied to four Department of Energy Atmospheric Radiation Measurement (DOE ARM) weather radars ranging in frequency from C- to Ka-band. Cross comparisons of three co-located radars with frequencies C, X, and Ka at the ARM Cloud, Aerosol, and Complex Terrain Interactions (CACTI) site show that the technique can determine changes in calibration. Using an X-band radar at the ARM Eastern North Atlantic (ENA) site, we show how the technique can be modified to be more resilient to clutter fields that show increased variability, in this case due to sea clutter. The results show that this technique is promising for a posteriori data calibration and monitoring.

47 OTHER INSTRUMENTATION↗