Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “model calibration tasks”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

A Method for Producing Hierarchical and Statistically Calibrated Predictions of Nuclear Material Properties from Existing Models

Computer vision-based analysis of micrographs of nuclear materials is an emerging technique for property prediction, synthetic route identification, and other material analysis tasks. These analysis tasks play a pivotal role in many material characterization applications such as signature development for treaty verification, process optimization, etc. The backbone in many of the recent computer vision-based techniques is a deep learning model, which takes a fixed-size set of pixels and provides a class prediction for that set of pixels. For example, previous work developed a deep convolutional neural network (CNN) to predict the synthetic route from a 256 px x 256 px patch taken from a larger image of uranium ore concentrates. In this work, we present several methods for first calibrating these models in a manner that they can provide accurate probabilities of their predictions’ veracity, and several methods of combining these probabilities. Overall, the combination of these two steps into a pipeline allows for full-image and even full-sample (where a sample has many images) predictions with associated confidence values. Finally, we show that one can also use the patch predictions and confidence to produce a visualization to map predicted constituents through the image. Results and examples for predicting and mapping uranium ore concentrates’ synthetic process from imagery will be presented.

artificial intelligence↗
DOE OSTI2024

Quarterly Research Performance Progress Report (Q8)

As part of Task 1, we have started by testing our modeling capabilities by reproducing isothermal DFIT simulations presented in the literature. Once satisfied with the results we have started by targeting the modeling of the DFITs at conducted at well 58-32. We have a identified a specific test (cycle 4 in zone 2) as the most interesting to be model with GEOS hydraulic fracturing module. Thus, we have first produced results with an isothermal model and adjusted model parameters to get a satisfying match with field pressure data. The, we have added thermal effects and compared the modeling results with and without thermal effects to estimate how thermal effects may influence test interpretation. Models seem to suggest that, for small volumes of fluid, thermal effects are moderate. In Task 2, we have adapted GEOS phase-field formulation to be able to simulate near-wellbore hydraulic fracture nucleation and propagation. We have devised a novel formulation that, compared to other existing ones, incorporates rock strengths. We have submitted a journal publication about our work. We are currently employing this phase-field formulation to model the experiments taking place at U Pitt and help us understand the effect of various parameters. In Task 3, we have built a model of the region surround well 16A and have started modeling stage 3 stimulation because of its simpler planar geometry. After calibrating simulation parameters using known analytical solutions, we have simulated the stage 3 stimulation using our isothermal hydraulic fracturing module, varying the permeability field, the stress conditions including different physics to get a better understanding of the numerical challenges and of the effects of varying these parameters on the simulation results. In Task 4 laboratory experimentation, a set of specialized drilling and injection tools has been customized and constructed to accommodate an inclined well with an orientation of up to 30 degrees relative to material anisotropy or principal stress axes. These inclined samples have also undergone thermal stress and hydraulic fracturing at a temperature of 190 degrees Celsius. Furthermore, both vertical and deviated sampling testing setups enable an extended analysis of post-peak pressure behaviors, facilitating post-test pressure analyses such as the G-function, step rate, and fracture reopening measurements. Thus, the key components of in-situ stress estimation can be extracted and validated through our experiment, providing a solid foundation for validating existing in-situ stress estimation theories or proposing new ones. Simultaneously, we are integrating computer vision techniques with traditional experimental fracture observation methods such as multi-overcore/slicing and water-penetration fracture observation. This combination will prove beneficial in populating the hydraulic fracture patterns database, generated under challenging EGS conditions. This approach aims to deepen our understanding of the complexities in EGS reservoirs and pave the way for future data-driven investigations. Additionally, PITT has also equipped the ELE International compression machine, which is now prepared for conducting indirect tensile and fracture toughness tests. These tests will aid in characterizing how rock fabrics influence the resulting fracture patterns. Additionally, we have completed the required personnel training and gained access to Scanning Electron Microscopy (SEM) and Energy Dispersive Spectroscopy (EDS) for conducting more detailed characterization and analysis of rock fabrics, as well as the examination of thermal and hydraulically induced fracture patterns. Thus, the PITT team has effectively demonstrated the capabilities of our experimental apparatuses in exploring the thermal effects, well deviation angles, material anisotropy, and operational choices (such as circulation rate, injection fluid viscosity, and injection rate) and their impact on pressure responses and fracture trajectories under the Utah FORGE conditions.

15 GEOTHERMAL ENERGY↗
DOE OSTI2020

UNESE Data Analysis-Disko Elm Gas Transport Characteristics (NA-22 Quarterly Report)

Recently published papers have demonstrated the impact of sorption mechanisms on gas transport in the subsurface following an underground nuclear explosion. To include sorption processes in the multi-physics models of noble gas production and transport, researchers have conducted experiments of gas sorption in geologic materials and calibrated a linear (Henry’s law) sorption model for all gases in various geologic materials. As a part of Task #4, we requested the experimental data from Sandia Laboratories and derived a dual-mode (Henry’s absorption and Langmuir adsorption) sorption model. The derived model better describes the nonlinear sorption mechanism with much higher fitness with the experimental data. When gas concentrations are relatively low (in the conditions of field experiments or underground nuclear explosions) compared to those used sorption experiments, the nonlinear sorption model can be approximated as a linear sorption model. The equivalent Henry’s constant, which equals the product of Langmuir capacity and affinity, is systematically higher than the literature values. Further analyses and comparison of sorption models are planned in FY2020 Q4 and the sorption model will be coupled in models of nonisothermal multiphase transport for studying noble gas detectability.

58 GEOSCIENCES↗
DOE OSTI2021

Constitutive Model Development for Aging Polymer Encapsulants (ASC P&EM FY2021 L2 Milestone 7836)

This SAND report fulfills the completion requirements for the ASC Physics and Engineering Modeling Level 2 Milestone 7836 during Fiscal Year 2021. The Sandia Simplified potential energy clock (SPEC) non-linear viscoelastic constitutive model was developed to predict a whole host of polymer glass physical behaviors in order to provide a tool to assess the effects of stress on these materials over their lifecycle. Polymer glasses are used extensively in applications such as electronics packaging, where encapsulants and adhesives can be critical to device performance. In this work, the focus is on assessing the performance of the model in predicting material evolution associated with long-term physical aging, an area that the model has not been fully vetted in. These predictions are key to utilizing models to help demonstrate electronics packaging component reliability over decades long service lives, a task that is very costly and time consuming to execute experimentally. The initiating hypothesis for the work was that a model calibration process can be defined that enables confidence in physical aging predictions under ND relevant environments and timescales without sacrificing other predictive capabilities. To test the hypothesis, an extensive suite of calibration and aging data was assembled from a combination of prior work and collaborating projects (Aging and Lifetimes as well as the DoD Joint Munitions Program) for two mission relevant epoxy encapsulants, 828DGEBA/DEA and 828DGEBA/T403. Multiple model calibration processes were developed and evaluated against the entire set of data for each material. A qualitative assessment of each calibration's ability to predict the wide range of aging responses was key to ranking the calibrations against each other. During this evaluation, predictions that were identified as non-physical, i.e., demonstrated something that was qualitatively different than known material behavior, were heavily weighted against the calibration performance. Thus, unphysical predictions for one aspect of aging response could generate a lower overall rating for a calibration process even if that process generated better quantitative predictions for another aspect of aging response. This insurance that all predictions are qualitatively correct is important to the overall aim of utilizing the model to predict residual stress evolution, which will depend on the interplay amongst the different material aging responses. The DSC-focused calibration procedure generated the best all-around aging predictions for both materials, demonstrating material models that can qualitatively predict the whole host of different physical aging responses that have been measured. This step forward in predictive capability comes from an unanticipated source, utilization of calorimetry measurements to specify model parameters. The DSC-focused calibration technique performed better than compression-focused techniques that more heavily weigh measurements more closely related to the structural responses to be predicted. Indeed, the DSC-focused calibration procedure was only possible due to recent incorporation of the enthalpy and heat capacity features into SPEC that was newly verified during this L2 milestone. Fundamentally similar aspects of the two material model calibrations as well as parametric studies to assess sensitives of the aging predictions are discussed within the report. A perspective on the next steps to the overall goal of residual stress evolution predictions under stockpile conditions closes the report.

36 MATERIALS SCIENCE↗
DOE OSTI2025

A comparative analysis of numerical approaches for the description of gas flow in clay-based repository systems: From a laboratory to a large-scale gas injection test

There is nowadays a consensus among many countries that geological disposal is a favourable solution for the long-term management. Although different host formations and different barrier systems are under consideration around the world, clay-based materials form an important component for waste isolation in most national programmes. Hence, a good comprehension of the effect of gas flow on the hydro-mechanical behaviour of clay-based soils is essential, both at laboratory and field scale. Task B under the international cooperative project DECOVALEX-2023 has recently shown that, after some enhancement, models can be employed to reproduce laboratory scale tests, even with different sample geometries 37 . However, further work is required to understand whether they can be applied to simulate a large-scale experiment. Up-scaling of models for the advective transport of gas through clay-based low permeable material presents a number of problems related to the difficulty in obtaining consistent hydrogeological parameters and constitutive relationships at both laboratory and field scale. Based on a unique dataset from a large-scale gas injection test (Lasgit) performed at the Äspö Hard Rock Laboratory (Sweden), Task B within DECOVALEX-2023 has explored the refinement of these numerical strategies applied to the simulation of gas flow. Work performed within the task reveals that codes do not need to be substantially modified from the laboratory models to reproduce full-scale tests: indeed, model parameters calibrated and validated at laboratory scale have been applied to predict field scale gas flow at Lasgit, including peak gas pressure and injected cumulative gas volume. By means of (1) the introduction of interfaces between blocks to reflect the experimental configuration and the (2) adjustment of some parameters (e.g., higher permeability), the updated models are able to represent most of the key features observed in the experimental data, even at a large scale.

Tamayo-Mas, E↗
DOE OSTI2021

An initial exploration of Bayesian model calibration for estimating the composition of rocks and soils on Mars

The Mars Curiosity rover carries an instrument, ChemCam, designed to measure the composition of surface rocks and soil using laser-induced breakdown spectroscopy (LIBS). The measured spectra from this instrument must be analyzed to identify the component elements in the target sample, as well as their relative proportions. This process, which we call disaggregation, is complicated by so-called matrix effects, which describe nonlinear changes in the relative heights of emission lines as an unknown function of composition due to atomic interactions within the LIBS plasma. In this work, we explore the use of the plasma physics code ATOMIC, developed at Los Alamos National Laboratory, for the disaggregation task. ATOMIC has recently been used to model LIBS spectra and can robustly reproduce matrix effects from first principles. The ability of ATOMIC to predict LIBS spectra presents an exciting opportunity to perform disaggregation in a manner not yet tried in the LIBS community, namely via Bayesian model calibration. However, using it directly to solve our inverse problem is computationally intractable due to the large parameter space and the computation time required to produce a single output. Therefore, we also explore the use of emulators as a fast solution for this analysis. We discuss a proof of concept Gaussian process emulator for disaggregating two-element compounds of sodium and copper. The training and test datasets were simulated with ATOMIC using a Latin hypercube design. After testing the performance of the emulator, we successfully recover the composition of 25 test spectra with Bayesian model calibration.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Model Assumptions and Data Characteristics: Impacts on Domain Adaptation in Building Segmentation

Studies on domain adaptation (DA) for remote sensing (RS) imagery analysis lack consistency in selection and description of evaluation scenarios. Without properly characterizing datasets, model assumptions, and evaluation scenarios, it is difficult to objectively compare DA methods and reach conclusions about their suitability across different applications. With this motivation, this work seeks to empirically assess to which extent the interaction between data characteristics and model assumptions influences the effectiveness of DA methods. Using the widely explored task of building footprint segmentation as a case study, we perform a large-scale study across over 200 DA scenarios that include variations across view angles, areas observed, and sensors used for data acquisition. Rather than adopting different model architectures or optimization criteria, we contrast the performances of two DA methods based on adversarial learning that differ only in their assumptions about source and target domains. Informed by metadata and data characteristics unveiled using traditional computer vision (CV) techniques as well as pretrained deep models, we provide a detailed meta-analysis of experiments highlighting the importance of accurately considering data assumptions for DA in RS segmentation tasks. As demonstrated by a “cherry-picking” exercise, different claims regarding which model is best could be made by selecting different subsets of evaluation scenarios. While well-calibrated assumptions can be beneficial, mismatching assumptions can lead to negative biases in DA applications. Furthermore, this study intends to motivate the community toward more consistent evaluation protocols while providing recommendations and insights toward creating novel benchmark datasets, documenting data characteristics, application-specific knowledge, and model assumptions.

42 ENGINEERING↗
DOE OSTI2026

Correlation of Surface Acoustic Wave (SAW) force myography sensor output with elbow joint torque

Accurate assessment of skeletal muscle forces and net joint torque is essential for preventing fatigue-related injuries, optimizing physical training, and monitoring disease progression in neuromuscular conditions. However, existing joint torque evaluation techniques are hindered by limited portability and high operational costs, confining their use to controlled laboratory or clinical settings. Despite substantial advances in wearable joint torque estimation systems, ongoing challenges such as power constraints, bulky wired setups, and susceptibility to environmental or motion artifacts underscore the urgent need for truly batteryless, wireless solutions deployable in real-world settings. This paper proposes a novel surface acoustic wave (SAW)-based force myography (FMG) system for noninvasive measurement of joint torque, validated against a gold-standard electromechanical dynamometer. The approach uses a single SAW sensor embedded in an armband to detect volumetric biceps brachii changes, with a second-order polynomial mapping sensor output and elbow angle to torque. Seven participants were tested in both isometric (15°–90°) and isokinetic (10°/s and 20°/s) supinated elbow flexion tasks. Under isometric conditions, subject-specific calibration achieved a normalized root-mean-square error (NRMSE) of 13.6% ± 6.0% and R 2 = 0.834 ± 0.180, while a group-level model yielded 14.4% ± 6.8% and 0.808 ± 0.208, respectively. For isokinetic trials, the group model produced an NRMSE of 24.1% ± 6.6% at 10°/s and 24.9% ± 08.9% at 20°/s, highlighting the feasibility of using a single-sensor SAW-FMG setup across different speeds. Because SAW devices support wireless, battery-free operation, the proposed system offers a pathway to portable, real-time monitoring for sports medicine, rehabilitation, and clinical diagnostics.

36 MATERIALS SCIENCE↗
DOE OSTI2025

LTAU-FF: Loss Trajectory Analysis for Uncertainty in atomistic Force Fields

Model ensembles are effective tools for estimating prediction uncertainty in deep learning atomistic force fields. However, their widespread adoption is hindered by high computational costs and overconfident error estimates. In this work, we address these challenges by leveraging distributions of per-sample errors obtained during training and employing a distance-based similarity search in the model latent space. Our method, which we call LTAU (Loss Trajectory Analysis for Uncertainty), efficiently estimates the full probability distribution function of errors for any test point using the logged training errors, achieving speeds that are 2–3 orders of magnitudes faster than typical ensemble methods and allowing it to be used for tasks where training or evaluating multiple models would be infeasible. We apply LTAU towards estimating parametric uncertainty in atomistic force fields (LTAU-FF), demonstrating that it produces well-calibrated confidence intervals and predicts errors that correlate strongly with the true errors for data near the training domain. Furthermore, we show that the errors predicted by LTAU-FF can be used in practical applications for detecting out-of-domain data, tuning model performance, and predicting failure during simulations. We believe that LTAU will be a valuable tool for uncertainty quantification in atomistic force fields and is a promising method that should be further explored in other domains of machine learning.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Enabling machine learning-ready HPC ensembles with Merlin

With the growing complexity of computational and experimental facilities, many scientific researchers are turning to machine learning (ML) techniques to analyze large scale ensemble data. With complexities such as multi-component workflows, heterogeneous machine architectures, parallel file systems, and batch scheduling, care must be taken to facilitate this analysis in a high performance computing (HPC) environment. Here, we present Merlin, a workflow framework to enable large ML-friendly ensembles of scientific HPC simulations. By augmenting traditional HPC with distributed compute technologies, Merlin aims to lower the barrier for scientific subject matter experts to incorporate ML into their analysis. As a producer–consumer workflow model, Merlin enables multi-machine, cross-batch job, dynamically allocated yet persistent workflows capable of utilizing surge-compute resources. Key features of Merlin are a flexible HPC-centric interface, low per-task overhead, multi-tiered fault recovery, and a hierarchical sampling algorithm that allows for $\mathscr{O}$(N) task execution and $\mathscr{O}$(N ln N) task queuing to ensembles of millions of tasks. In addition to Merlin’s design, we test the algorithm’s performance in an HPC center and demonstrate the ability to enqueue 40 million simulations in 100 s, with a 30 millisecond per-task overhead that is independent of ensemble size. Finally, we describe some example applications that Merlin has enabled on leadership-class HPC resources, such as the ML-augmented optimization of nuclear fusion experiments and the calibration of infectious disease models to study the progression of and possible mitigation strategies for COVID-19.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

CMB-S4 Instrument Modeling and Development for CMB-S4

During this thirteen month award, we focused on two main tasks relevant to the development of the CMB-S4 project: (1) The refinement of sensitivity models and use of those to optimize the instrument design, and (2) the final development and testing a cryogenic blackbody calibrator prototype, of which we then produced three copies for CMB-S4's detector testing systems at FNAL, SLAC and UIUC.

47 OTHER INSTRUMENTATION↗
DOE OSTI2025

Beyond pinball loss: Quantile methods for calibrated uncertainty quantification

Amongthemanywaysofquantifying uncertainty in a regression setting, specifying the full quantile function is attractive, as quantiles are amenable to interpretation and evaluation. A model that predicts the true conditional quantiles for each input, at all quantile levels, presents a correct and efficient representation of the underlying uncertainty. To achieve this, many current quantile-based methods focus on optimizing the pinball loss. However, this loss restricts the scope of applicable regression models, limits the ability to target many desirable properties (e.g. calibration, sharpness, centered intervals), and may produce poor conditional quantiles. In this work, we develop new quantile methods that address these shortcomings. In particular, we propose methods that can apply to any class of regression model, select an explicit balance between calibration and sharpness, optimize for calibration of centered intervals, and produce more accurate conditional quantiles. We provide a thorough experimental evaluation of our methods, which includes a high dimensional uncertainty quantification task in nuclear fusion.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Code Release for “Unlocking Extreme Space Weather through Advanced Modeling of Legacy Vela Spacecraft” ER

The software being developed for this project has two mains aims. First, a Bayesian Model Calibration (BMC) procedure is being developed to calibrate a spallation model that simulates protons hitting a spacecraft orbiting earth to real data. The procedure will be developed for general data (there is no data release requested as part of this code release). Second, an inverse physics modeling task is being undertaken to map the number of resulting neutrons observed from this process to the expected number of protons that hit the model. This second task is of statistical interest; to publish on it, the code will need to be open source.

Murph, Alexander↗
DOE OSTI2022

Task 5 Field Scale Stress Modeling Scripts and Data

Project data and Matlab scripts for Task 5 of the project “A Non-Invasive Approach for Elucidating the Spatial Distribution of In Situ Stress in Deep Subsurface Geologic Formations Considered for CO2 Storage”. Project includes the static earth models, grids and other data used for simulation and calibration of the two case studies addressed in the project, referred to herein as the “FutureGen2” model (Illinois) and the “Perch” model (Otsego county, Michigan). Large Dataset, please contact EDXSupport@netl.doe.gov

FutureGen2↗
DOE OSTI2025

Confidence-weighted integration of human and machine judgments for superior decision-making

Large language models (LLMs) can surpass humans in certain forecasting tasks. What role does this leave for humans in the overall decision process? One possibility is that humans, despite performing worse than LLMs, can still add value when teamed with them. A human and machine team can surpass each individual teammate when team members’ confidence is well calibrated and team members diverge in which tasks they find difficult (i.e., calibration and diversity are needed). We simplified and extended a Bayesian approach to combining judgments using a logistic regression framework that integrates confidence-weighted judgments for any number of team members. Using this straightforward method, we demonstrated its effectiveness in both image classification and neuroscience forecasting tasks. Combining human judgments with one or more machines consistently improved overall team performance. Our hope is that this simple and effective strategy for integrating the judgments of humans and machines will lead to productive collaborations.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

A Bayesian analysis of nuclear deformation properties with Skyrme energy functionals

In spite of numerous scientific and practical applications, there is still no comprehensive theoretical description of the nuclear fission process based solely on protons, neutrons and their interactions. Furthermore, the most advanced simulations of fission are currently carried out within nuclear density functional theory (DFT). In spite of being fully quantum-mechanical and rooted in the theory of nuclear forces, DFT still depends on a dozen or so parameters characterizing the energy functional. Calibrating these parameters on experimental data results in uncertainties that must be quantified for applications. This task is very challenging because of the high computational cost of DFT calculations for fission. In this paper, we use Gaussian processes to build emulators of DFT models in order to quantify and propagate statistical uncertainties of theoretical predictions for a range of nuclear deformations relevant to describing the fission process.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2026

Selective Amnesia using Contrastive Subnet Erasure for Class Level Unlearning in Vision Models

We study concept-level forgetting in pretrained vision models: removing an entire semantic category so the system no longer recognizes that object in unseen images and contexts, rather than merely forgetting specific training examples. Prior work either applies blunt global projections or fine-tunes parameters, which can introduce collateral damage to unrelated features, add compute, and become unstable as forgetting strength increases. We introduce Contrastive Subnet Erasure (CSE), a training-free, encoder-centric edit that targets a compact set of channels most responsible for the class and attenuates them in a calibrated manner. The modification is algebraically folded into the subsequent layer, yielding no inference-time overhead and leaving task heads unchanged. To evaluate whether forgetting generalizes beyond the data used to specify the class, we introduce a cross dataset protocol in which the class is defined on a source dataset and performance is measured on a disjoint target dataset drawn from a different distribution with no shared images. This setup tests whether the model still fails to recognize the object when it looks different or appears in new scenes, and it helps avoid overfitting to patterns in the source dataset. Across CIFAR 10, CIFAR 100, and ImageNet under this protocol, CSE achieves stronger forgetting of the target class while better preserving non target utility than existing baselines in both single class and multi class settings. Overall, CSE provides a simple, stable, and deployment-ready mechanism for class-level unlearning in vision.

Kotevska, Olivera [ORNL] (ORCID:0000000316772243)↗
DOE OSTI2024

Calibrating Bayesian generative machine learning for Bayesiamplification

Recently, combinations of generative and Bayesian deep learning have been introduced in particle physics for both fast detector simulation and inference tasks. These neural networks aim to quantify the uncertainty on the generated distribution originating from limited training statistics. The interpretation of a distribution-wide uncertainty however remains ill-defined. We show a clear scheme for quantifying the calibration of Bayesian generative machine learning models. For a Continuous Normalizing Flow applied to a low-dimensional toy example, we evaluate the calibration of Bayesian uncertainties from either a mean-field Gaussian weight posterior, or Monte Carlo sampling network weights, to gauge their behaviour on unsteady distribution edges. Well calibrated uncertainties can then be used to roughly estimate the number of uncorrelated truth samples that are equivalent to the generated sample and clearly indicate data amplification for smooth features of the distribution.

97 MATHEMATICS AND COMPUTING↗