Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “parameter calibration”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 559 records · Page 31
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Automated Calibration of Parallel and Distributed Computing Simulators: A Case Study

Many parallel and distributed computing research results are obtained in simulation, using simulators that mimic real-world executions on some target system. Each such simulator is configured by picking values for parameters that define the behavior of the underlying simulation models it implements. The main concern for a simulator is accuracy: simulated behaviors should be as close as possible to those observed in the real-world target system. This requires that values for each of the simulator's parameters be carefully picked, or “calibrated,” based on ground-truth real-world executions. Examining the current state of the art shows that simulator calibration, at least in the field of parallel and distributed computing, is often undocumented (and thus perhaps often not performed) and, when documented, is described as a labor-intensive, manual process. In this work we evaluate the benefit of automating simulation calibration using simple algorithms. Specifically, we use a real-world case study from the field of High Energy Physics and compare automated calibration to calibration performed by a domain scientist. Our main finding is that automated calibration is on par with or significantly outperforms the calibration performed by the domain scientist. Furthermore, automated calibration makes it straightforward to operate desirable tradeoffs between simulation accuracy and simulation speed.

Mc donald, Jesse↗
DOE OSTI2020

Power system model parameter conditioning tool

A power system model parameter conditioning tool including a server control processor in communication with phasor measurement unit monitored data records of multiple disturbance events, a model calibration unit providing event screening, power system model simulation, and simultaneous tuning of model parameters. The model calibration performing a simulation using default model parameters, the processor comparing the simulation results to the monitored data. If the prediction is within threshold, then terminating conditioning; else performing parameter identifiability analysis to determine differing effects of various model parameters on power system model accuracy, selecting a parameter set causing a degradation in power system model prediction, and updating the default model parameters corresponding to members of the parameter set with values selected to reduce the degradation. A method and a non-transitory computer readable medium are also disclosed.

Baone, Chaitanya Ashok↗
NASA NTRS2018

Recent Updates in the SMAP Level-4 Soil Moisture Algorithm

The NASA Soil Moisture Active Passive (SMAP) mission generates, among other data sets, the Level-4 Soil Moisture (L4_SM) product. The L4_SM data are published with a mean latency of ~2.5 days from the time of observation and provide global, three-hourly, 9-km resolution estimates of surface and root-zone soil moisture and related land surface states and fluxes. The L4_SM algorithm is based on the assimilation of SMAP radiometer brightness temperature observations into the NASA Catchment land surface model using a spatially distributed ensemble Kalman filter (EnKF). In 2018, the L4_SM algorithm was upgraded from Version 3 to Version 4. Underlying the new version is a revised modeling system that includes improved input parameter datasets for land cover, topography, and vegetation height that are based on recent, high-quality, space-borne remote sensing observations. Additionally, SMAP Level-2 soil moisture retrievals and in situ soil moisture measurements were used to calibrate a particular Catchment model parameter that governs the recharge of surface soil moisture from below under non-equilibrium conditions, which brings the model's surface soil moisture more in line with the SMAP Level-2 and in situ soil moisture. Moreover, the calibration of the assimilated SMAP brightness temperatures changed substantially from Version 3 to Version 4, and the "catchment deficit" model variable was removed from the EnKF state vector to avoid degrading the model's groundwater estimates.Considerable effort went into the version upgrade, creating an expectation that the new version is improved over the old version. Indeed, some aspects of the new version are clearly better. However, other aspects are not. In this presentation we summarize the skill of the new and old versions vs. independent in situ measurements and in terms of data assimilation diagnostics, including, for example, the statistics of the (soil moisture) analysis increments and the observation-minus-forecast (brightness temperatures) residuals. We share our experience with trying to improve to the L4_SM product and the lessons learned from the effort.

Reichle, Rolf H.↗
DOE OSTI2024

Rapid Inverse Parameter Inference Using Physics-Informed Neural Network

As Li-ion batteries become more essential in today's economy, tools need to be developed to accurately and rapidly diagnose a battery's internal state-of-health. Using a Li-ion battery's (high-rate) voltage response, it is proposed to determine a battery's internal state through Bayesian calibration. However, Bayesian calibration is notoriously slow and requires thousands of model runs. To accelerate parameter inference using Bayesian calibration, a surrogate model is developed to replace the underlying physics-based Li-ion model. Developing a surrogate model for rapid Bayesian calibration analysis is discussed for both the single particle model (SPM) and the pseudo two-dimensional (P2D) model. Surrogate models are constructed using physics-informed neural networks (PINNs) that encode the influence of internal properties on observed voltage responses. In practice, a neural network can be trained by: 1) using simulation results of the physics-based model (i.e., a data-loss approach); 2) using the residuals of the governing equations themselves (i.e., a physics-loss approach); or 3) using a combination of simulation results and governing equation residuals. In the present work, PINNs are developed using a variety of training losses and neural network architectures. In this analysis, it is shown that a PINN surrogate model can be reliably trained with only physics-informed loss. However, using a coupled data-informed and physics-loss approach produced the most accurate PINNs.

Bayesian calibration↗
DOE OSTI2023

Sensitivity of Near-Surface Variables in the RUC Land Surface Model in the Weather Research and Forecasting Model

In this study, we investigate the parametric sensitivity of near-surface variables, such as sensible heat flux, latent heat flux, ground heat flux, hub-height wind speed and land surface temperature, to the parameters used in the Rapid Update Cycle (RUC) land surface model (LSM) during a wintertime and summertime period. The model simulations are compared with observations collected from the second Wind Forecast Improvement Project (WFIP2) field campaign. The results suggest that parameters related to snow/ice and thermal processes can have significant impact on the simulated near-surface variables. Out of the 11 examined parameters, only 6 of them have considerable influences on the model behaviors and explain about 60 ~ 80 % of the estimated total variance of the simulated variables. In addition, the magnitude of the parametric sensitivity varies with season. For instance, parameters associated with snow/ice processes are dominant during the wintertime whereas those associated with thermal processes are more important during the summertime. Furthermore, the impact of the identified parameters on the simulated variables is highly related to the topography. There is a high degree of sensitivity to the parameter values over the slope region. This points out the importance of collecting field observations over steep areas to better quantity the appropriate values of key parameters. Overall, our findings provide a better understanding of the RUC LSM behavior associated with parameter uncertainties and can be used to improve the forecasting skill of land surface processes via calibration of the most uncertain model parameters.

17 WIND ENERGY↗
NASA NTRS2009

Model Calibration in Watershed Hydrology

Hydrologic models use relatively simple mathematical equations to conceptualize and aggregate the complex, spatially distributed, and highly interrelated water, energy, and vegetation processes in a watershed. A consequence of process aggregation is that the model parameters often do not represent directly measurable entities and must, therefore, be estimated using measurements of the system inputs and outputs. During this process, known as model calibration, the parameters are adjusted so that the behavior of the model approximates, as closely and consistently as possible, the observed response of the hydrologic system over some historical period of time. This Chapter reviews the current state-of-the-art of model calibration in watershed hydrology with special emphasis on our own contributions in the last few decades. We discuss the historical background that has led to current perspectives, and review different approaches for manual and automatic single- and multi-objective parameter estimation. In particular, we highlight the recent developments in the calibration of distributed hydrologic models using parameter dimensionality reduction sampling, parameter regularization and parallel computing.

Yilmaz, Koray K.↗
DOE OSTI2024

Interlaced Characterization and Calibration (ICC) for Improved Computational Simulation Credibility

Accurate material characterization and model calibration are pivotal for simulations used for high-consequence engineering decisions. Current characterization and calibration methods (1) use simplified test specimen geometries and global data, (2) cannot guarantee that sufficient characterization data is collected for a specific model of interest, (3) provide only mean parameter values with no uncertainty quantification, and (4) are sequential, inflexible, and time-consuming. This work developed a new paradigm—coined Interlaced Characterization and Calibration (ICC)—which drives forward the state-of-the-art in model calibration by bringing together recent advancements into one improved workflow. The ICC paradigm (1) employs tools to efficiently use full-field data to calibrate high-fidelity material models, (2) aligns the data needed with the data collected by adopting an optimal experimental design protocol, (3) provides uncertainty metrics on the calibrated model parameters, and (4) incorporates these advances into a quasi real-time feedback loop. The ICC framework was validated synthetically with both low-fidelity and high-fidelity simulations paired with several different elastoplastic material models, and was also demonstrated experimentally with an aluminum 6061 cruciform exemplar specimen. Results showed that the ICC framework—in which Bayesian optimal experimental design actively guided the experiment— resulted in calibrations with similar or better accuracy than predetermined experiments based on subject matter expertise. Moreover, the ICC framework produced a complete model calibration— with quantified uncertainties on model parameters—in 1 week, a 5 - 10× increase in efficiency over traditional approaches. Thus, the ICC paradigm improves both the calibration process and quality, by (1) improving efficiency, which increases agility of solid mechanics modeling and enables utilization of computational simulation (CompSim) at earlier stages of the design cycle and (2) providing quantified, and in some cases reduced, parameter uncertainties, which increases confidence in model predictions and supports credible decision making.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Physics-constrained fault diagnosis framework for monitoring a multi-component thermal hydraulic system

A method for diagnosing faults includes receiving a system description of a thermal hydraulic system, the system description indicating a plurality of components and sensors. The method also includes constructing, based on physical conservations laws and using the system description, a plurality of physics-based models for the plurality of components, each of the plurality of physics-based models including unknown parameters. The method further includes receiving historical measurements and calibrating the physics-based models by calculating the unknown parameters of each of the physics-based models using the historical measurements to produce calibrated models. The method also includes receiving sensor measurements of the sensors, and calculating residuals corresponding to differences between measurements predicted by the plurality of calibrated models and the sensor measurements. The method also includes determining, based on the calculated residuals, a fault of a component or a sensor, and generating an alert indicating the fault.

Nguyen, Tat Nghia↗
NASA NTRSDate not supplied

Sensitivity of Simulated Radiative Emission from Nitrogen Flows to Chemical Parameters

Numerical models of hypersonic flows rely on chemistry data inferred from experiments and quantum calculations. Experiments from NASA's Electric Arc Shock Tube (EAST) measure the spectral emission of strong shocks in pure nitrogen flows. These spectral profiles are only approximately captured by numerical simulations. To address these discrepancies, one wishes to calibrate some of the chemical parameters to better match experiment. Because there are hundreds of parameters in the numerical model, a sensitivity analysis was carried out on the entire chemistry database to determine which parameters are most important to analyze in the future. In order to perform this work it was necessary to generate a consistent chemical database that interfaced with both the CFD and line-by-line radiation solver. Using Monte Carlo methods, the total Sobol index was calculated for important parameters. Twenty parameters were identified as important across the nitrogen system. However, it was noted that in some spectral regions, the parametric uncertainty was unable to bound EAST measurements. Further improvements could be made by increasing the parameter uncertainties or addressing other sources of modeling error.

Kaelan B Hansson↗
NASA NTRSDate not supplied

Sensitivity of Simulated Radiative Emission from Nitrogen Flows to Chemical Parameters

Numerical models of hypersonic flows rely on chemistry data inferred from experiments and quantum calculations. Experiments from NASA's Electric Arc Shock Tube (EAST) measure the spectral emission of strong shocks in pure nitrogen flows. These spectral profiles are only approximately captured by numerical simulations. To address these discrepancies, one wishes to calibrate some of the chemical parameters to better match experiment. Because there are hundreds of parameters in the numerical model, a sensitivity analysis was carried out on the entire chemistry database to determine which parameters are most important to analyze in the future. In order to perform this work it was necessary to generate a consistent chemical database that interfaced with both the CFD and line-by-line radiation solver. Using Monte Carlo methods, the total Sobol index was calculated for important parameters. Twenty parameters were identified as important across the nitrogen system. However, it was noted that in some spectral regions, the parametric uncertainty was unable to bound EAST measurements. Further improvements could be made by increasing the parameter uncertainties or addressing other sources of modeling error.

Kaelan Hansson↗
NASA NTRS2012

Frequency Domain Beamforming for a Deep Space Network Downlink Array

This paper describes a frequency domain beamformer to array up to 8 antennas of NASA's Deep Space Network currently in development. The objective of this array is to replace and enhance the capability of the DSN 70m antennas with multiple 34m antennas for telemetry, navigation and radio science use. The array will coherently combine the entire 500 MHz of usable bandwidth available to DSN receivers. A frequency domain beamforming architecture was chosen over a time domain based architecture to handle the large signal bandwidth and efficiently perform delay and phase calibration. The antennas of the DSN are spaced far enough apart that random atmospheric and phase variations between antennas need to be calibrated out on an ongoing basis in real-time. The calibration is done using measurements obtained from a correlator. This DSN Downlink Array expands upon a proof of concept breadboard array built previously to develop the technology and will become an operational asset of the Deep Space Network. Design parameters for frequency channelization, array calibration and delay corrections will be presented as well a method to efficiently calibrate the array for both wide and narrow bandwidth telemetry.

Filterbank↗
DOE OSTI2022

SEGUE-2: Old Milky Way Stars Near and Far

The Sloan Extension for Galactic Understanding and Exploration 2 (SEGUE-2) obtained 128,288 low-resolution spectra (R ~ 1800) of 118,958 unique stars in the first year of the Sloan Digital Sky Survey III (2008–2009). SEGUE-2 targeted prioritized distant halo tracers (blue horizontal-branch stars, K giants, and M giants) and metal-poor or kinematically hot populations. The main goal of SEGUE-2 was to target stars in the distant halo and measure their kinematics and chemical abundances to learn about the formation and evolution of the Milky Way. We present the SEGUE-2 field placement and target selection strategies. We discuss the success rate of the targeting based on the SEGUE-2 spectra and other spectroscopic and astrometric surveys. We describe the final SEGUE-2/SDSS-III improvements to the stellar parameter determinations based on the SEGUE Stellar Parameter Pipeline. We report a (g - i) color-effective temperature relation calibrated to the IRFM. We evaluate the accuracy and uncertainties associated with these stellar parameters by comparing with fundamental parameters, a sample of high-resolution spectra of SEGUE stars analyzed homogeneously, stars in well-studied clusters, and stars observed in common by the APOGEE survey. The final SEGUE spectra, calibration data, and derived parameters described here were released in SDSS-III Data Release 9 and continue to be included in all subsequent SDSS Data Releases. Because of its faint limiting magnitude and emphasis on the distant halo, the public SEGUE-2 data remain an important resource for the spectroscopy of stars in the Milky Way.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Monitoring water quality in the lower Kansas River using remote sensing

Abstract We demonstrate how to combine remote sensing data from satellite imagery (Sentinel‐2) with in situ water quality gauging (USGS Super Gages and the Gybe hyperspectral radiometer) to create spatially dense maps of water quality parameters (chlorophyll‐a concentration, turbidity, and nitrate plus nitrite concentration) along the lower Kansas River. The water quality maps are created using locally tuned models of the target water quality parameters, and this study describes the steps used to design, calibrate, and validate the empirical correlations. Water quality parameters such as chlorophyll‐a concentration are correlated with well‐studied absorption and scattering features in the visible spectrum (roughly 400–700 nm). Nutrients (such as nitrate plus nitrite concentration) lack strong absorption features in the visible spectrum, and in those cases we describe a novel surrogate data modeling approach that identifies overlapping water parcels between the in situ gauging and the remote sensing imagery. Measurements from the overlapping water parcels yield excellent correlations () for the target water quality parameters for limited windows of time (or limited sections of river reaches). Examples are provided illustrating how the water quality maps can be used to track river inputs from ungauged sources (such as creeks), or reveal the mixing patterns at the confluences.

Tufillaro, Nicholas↗
NASA NTRS1993

The effect of clock, media, and station location errors on Doppler measurement accuracy

Doppler tracking by the Deep Space Network (DSN) is the primary radio metric data type used by navigation to determine the orbit of a spacecraft. The accuracy normally attributed to orbits determined exclusively with Doppler data is about 0.5 microradians in geocentric angle. Recently, the Doppler measurement system has evolved to a high degree of precision primarily because of tracking at X-band frequencies (7.2 to 8.5 GHz). However, the orbit determination system has not been able to fully utilize this improved measurement accuracy because of calibration errors associated with transmission media, the location of tracking stations on the Earth's surface, the orientation of the Earth as an observing platform, and timekeeping. With the introduction of Global Positioning System (GPS) data, it may be possible to remove a significant error associated with the troposphere. In this article, the effect of various calibration errors associated with transmission media, Earth platform parameters, and clocks are examined. With the introduction of GPS calibrations, it is predicted that a Doppler tracking accuracy of 0.05 microradians is achievable.

Miller, J. K.↗
DOE OSTI2023

Benchmarking magnetised three-wave coupling for laser backscattering: analytic solutions and kinetic simulations

Understanding magnetised laser–plasma interactions is important for controlling magneto-inertial fusion experiments and developing magnetically assisted radiation and particle sources. For nanosecond pulses at non-relativistic intensities, interactions are dominated by coherent three-wave interactions, whose nonlinear coupling coefficients became known only recently when waves propagate at oblique angles with the magnetic field. In this paper, backscattering coupling coefficients predicted by warm-fluid theory are benchmarked using particle-in-cell simulations in one spatial dimension, and excellent agreements are found for a wide range of plasma temperatures, magnetic field strengths and laser propagation angles, when the interactions are mediated by electron-dominant hybrid waves. Systematic comparisons between theory and simulations are made possible by a rigorous protocol. On the theory side, the initial boundary value problem of linearised three-wave equations is solved, and the transient-time solutions allow the effects of growth and damping to be distinguished. On the simulation side, parameters are carefully chosen and calibration runs are performed to ensure that comparisons are well controlled. Fitting simulation data to analytical solutions yields numerical growth rates that match theory predictions within error bars. Although warm-fluid theory is found to be valid for a wide parameter range, genuine kinetic effects have also been observed.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2024

Emulator-Based Bayesian Calibration of the CISNET Colorectal Cancer Models

Purpose To calibrate Cancer Intervention and Surveillance Modeling Network (CISNET)'s SimCRC, MISCAN-Colon, and CRC-SPIN simulation models of the natural history colorectal cancer (CRC) with an emulator-based Bayesian algorithm and internally validate the model-predicted outcomes to calibration targets.Methods We used Latin hypercube sampling to sample up to 50,000 parameter sets for each CISNET-CRC model and generated the corresponding outputs. We trained multilayer perceptron artificial neural networks (ANNs) as emulators using the input and output samples for each CISNET-CRC model. We selected ANN structures with corresponding hyperparameters (i.e., number of hidden layers, nodes, activation functions, epochs, and optimizer) that minimize the predicted mean square error on the validation sample. We implemented the ANN emulators in a probabilistic programming language and calibrated the input parameters with Hamiltonian Monte Carlo-based algorithms to obtain the joint posterior distributions of the CISNET-CRC models' parameters. We internally validated each calibrated emulator by comparing the model-predicted posterior outputs against the calibration targets.Results The optimal ANN for SimCRC had 4 hidden layers and 360 hidden nodes, MISCAN-Colon had 4 hidden layers and 114 hidden nodes, and CRC-SPIN had 1 hidden layer and 140 hidden nodes. The total time for training and calibrating the emulators was 7.3, 4.0, and 0.66 h for SimCRC, MISCAN-Colon, and CRC-SPIN, respectively. The mean of the model-predicted outputs fell within the 95% confidence intervals of the calibration targets in 98 of 110 for SimCRC, 65 of 93 for MISCAN, and 31 of 41 targets for CRC-SPIN.Conclusions Using ANN emulators is a practical solution to reduce the computational burden and complexity for Bayesian calibration of individual-level simulation models used for policy analysis, such as the CISNET CRC models. In this work, we present a step-by-step guide to constructing emulators for calibrating 3 realistic CRC individual-level models using a Bayesian approach.

artificial neural networks↗