Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “observational methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 397 records · Page 22
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

A score-based diffusion model approach for adaptive learning of stochastic partial differential equation solutions

In this paper, we propose a novel framework for adaptively learning the time-evolving solutions of stochastic partial differential equations (SPDEs) using score-based diffusion models within a recursive Bayesian inference setting. SPDEs play a central role in modeling complex physical systems under uncertainty, but their numerical solutions often suffer from model errors and reduced accuracy due to incomplete physical knowledge and environmental variability. To address these challenges, we encode the governing physics into the score function of a diffusion model using simulation data and incorporate observational information via a likelihood-based correction in a reverse-time stochastic differential equation. This enables adaptive learning through iterative refinement of the solution as new data becomes available. To improve computational efficiency in high-dimensional settings, we introduce the ensemble score filter, a training-free approximation of the score function designed for real-time inference. Numerical experiments on benchmark SPDEs demonstrate the accuracy and robustness of the proposed method under sparse and noisy observations.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Estimating basis functions in massive fields under the spatial mixed effects model

Abstract Spatial prediction is commonly achieved under the assumption of a Gaussian random field by obtaining maximum likelihood estimates of parameters, and then using the kriging equations to arrive at predicted values. For massive datasets, fixed rank kriging using the expectation–maximization algorithm for estimation has been proposed as an alternative to the usual but computationally prohibitive kriging method. The method reduces computation cost of estimation by redefining the spatial process as a linear combination of basis functions and spatial random effects. A disadvantage of this method is that it imposes constraints on the relationship between the observed locations and the knots. We develop an alternative method that utilizes the spatial mixed effects model, but allows for additional flexibility by estimating the range of the spatial dependence between the observations and the knots via an alternating expectation conditional maximization algorithm. Experiments show that our methodology improves estimation without sacrificing prediction accuracy while also minimizing the additional computational burden of extra parameter estimation. The methodology is applied to a temperature dataset archived by the United States National Climate Data Center, with improved results over previous methodology.

Pazdernik, Karl↗
DOE OSTI2023

Constructing a Simulation Surrogate with Partially Observed Output

Gaussian process surrogates are a popular alternative to directly using computationally expensive simulation models. When the simulation output consists of many responses, dimension-reduction techniques are often employed to construct these surrogates. However, surrogate methods with dimension reduction generally rely on complete output training data. This article proposes a new Gaussian process surrogate method that permits the use of partially observed output while remaining computationally efficient. The new method involves the imputation of missing values and the adjustment of the covariance matrix used for Gaussian process inference. The resulting surrogate represents the available responses, disregards the missing responses, and provides meaningful uncertainty quantification. In conclusion, the proposed approach is shown to offer sharper inference than alternatives in a simulation study and a case study where an energy density functional model that frequently returns incomplete output is calibrated.

42 ENGINEERING↗
DOE OSTI2024

Constraining Cosmology with Simulation-based inference and Optical Galaxy Cluster Abundance

We test the robustness of simulation-based inference (SBI) in the context of cosmological parameter estimation from galaxy cluster counts and masses in simulated optical datasets. We construct ``simulations'' using analytical models for the galaxy cluster halo mass function (HMF) and for the observed richness (number of observed member galaxies) to train and test the SBI method. We compare the SBI parameter posterior samples to those from an MCMC analysis that uses the same analytical models to construct predictions of the observed data vector. The two methods exhibit comparable performance, with reliable constraints derived for the primary cosmological parameters, ($\Omega_m$ and $\sigma_8$), and richness-mass relation parameters. We also perform out-of-domain tests with observables constructed from galaxy cluster-sized halos in the Quijote simulations. Again, the SBI and MCMC results have comparable posteriors, with similar uncertainties and biases. Unsurprisingly, upon evaluating the SBI method on thousands of simulated data vectors that span the parameter space, SBI exhibits worsened posterior calibration metrics in the out-of-domain application. We note that such calibration tests with MCMC is less computationally feasible and highlight the potential use of SBI to stress-test limitations of analytical models, such as in the use for constructing models for inference with MCMC.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Elastic Changepoint Detection for Globally-indexed Functional Time Series Data with Climate Applications

Changepoint detection is a vital tool in the application of climate data analysis. Numerous types of climate observation data are most properly represented by functional time series, implying a need for accurate changepoint detection methods applicable to functional time series data. Such data taken at a global scale often contain both spatial heterogeneity and dependence as well as phase (time) misalignment. In this report, we present methods which can detect spatially-dependent changepoints while allowing different estimates of change time and change strength depending on location. Additionally, we provide extensions to this spatially-predicted model which controls for phase variability among observations. Our methods provide the ability to detect a single change, or control for epidemic changes (where a “return-to-normal” change is more likely to be detected than the initial change). We showcase results analyzing the June 1991 eruption of Mt. Pinatubo, where our methods demonstrate the ability to accurately detect both single and epidemic changepoints even in the presence of strong seasonal variability. We find that our spatially-predicted model improves the detection of relevant changepoints versus methods which do not take spatial information into account, and we find that controlling for phase variability helps to control the false discovery rate during the detection process.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Structural properties of optically clear bacterial cellulose produced by Komagataeibacter hansenii using arabitol

Here, bacterial cellulose (BC) exhibits beneficial properties for use in biomedical applications but is limited by its lack of tunable transparency capabilities. To overcome this deficiency, a novel method to synthesize transparent BC materials using an alternative carbon source, namely arabitol, was developed. Characterization of the BC pellicles was performed for yield, transparency, surface morphology, and molecular assembly. Transparent BC was produced using mixtures of glucose and arabitol. Zero percent arabitol pellicles exhibited 25% light transmittance, which increased with increasing arabitol concentration through to 75% light transmittance. While transparency increased, overall BC yield was maintained indicating that the altered transparency may be induced on a micro-scale rather than a macro-scale. Significant differences in fiber diameter and the presence of aromatic signatures were observed. Overall, this research outlines methods for producing BC with tunable optical transparency, while also bringing new insight to insoluble components of exopolymers produced by Komagataeibacter hansenii.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Cognitive simulation models for inertial confinement fusion: Combining simulation and experimental data

The design space for inertial confinement fusion (ICF) experiments is vast, and experiments are extremely expensive. Researchers rely heavily on computer simulations to explore the design space in search of high-performing implosions. However, ICF multiphysics codes must make simplifying assumptions, and thus deviate from experimental measurements for complex implosions. For more effective design and investigation, simulations require input from past experimental data to better predict future performance. In this work, we describe a cognitive simulation method for combining simulation and experimental data into a common, predictive model. This method leverages a machine learning technique called “transfer learning,” the process of taking a model trained to solve one task, and partially retraining it on a sparse dataset to solve a different, but related task. In the context of ICF design, neural network models are trained on large simulation databases and partially retrained on experimental data, producing models that are far more accurate than simulations alone. Here, we demonstrate improved model performance for a range of ICF experiments at the National Ignition Facility and predict the outcome of recent experiments with less than 10% error for several key observables. We discuss how the methods might be used to carry out a data-driven experimental campaign to optimize performance, illustrating the key product—models that become increasingly accurate as data are acquired.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2020

Conditional Karhunen-Loève expansion for uncertainty quantification and active learning in partial differential equation models

We use a conditional Karhunen-Lo` eve (KL) model to quantify and reduce uncertainty in a stochastic partial differential equation (SPDE) problem with partially-known space-dependent coefficient, Y (x). We assume that a small number of Y (x) measurements are available and model Y (x) with a KL expansion. We achieve reduction in uncertainty by conditioning the KL expansion coefficients on measurements. We consider two approaches for conditioning the KL expansion: In Approach 1, we condition the KL model first and then truncate it. In Approach 2, we first truncate the KL expansion and then condition it. We employ the conditional KL expansion together with Monte Carlo and sparse grid collocation methods to compute the moments of the solution of the SPDE problem. Uncertainty of the problem is further reduced by adaptively selecting additional observation locations using two active learning methods. Method 1 minimizes the variance of the PDE coefficient, while Method 2 minimizes the variance of the solution of the PDE. We demonstrate that conditioning leads to dimension reduction of the KL representation of Y (x). For a linear diffusion SPDE with uncertain log-normal coefficient, we show that Approach 1 provides a more accurate approximation of the conditional log-normal coefficient and solution of the SPDE than Approach 2 for the same number of random dimensions in a conditional KL expansion. Furthermore, Approach 2 provides a good estimate for the number of terms of the truncated KL expansion of the conditional field of Approach 1. Finally, we demonstrate that active learning based on Method 2 is more efficient for uncertainty reduction in the SPDE’s states (i.e., it leads to a larger reduction of the variance) than active learning using Method 2.

Conditioned Karhunen-Lo` eve expanion, machine lea↗
DOE OSTI2026

Data for Clumping Index Estimation With 30°-tilted Cameras in Row Crops: Evaluation of Methods and Segment Size Effects

The clumping index (CI) quantifies the spatial distribution of foliage elements and is essential for accurately estimating the plant area index (PAI), canopy radiative transfer, and photosynthesis. Traditionally, the finite-length averaging method (LX), the gap size distribution method (CC), and a combined approach of CC and LX (CLX) have been applied to instruments like TRAC and digital hemispherical photography to estimate CI. However, a comprehensive evaluation of these methods in row crops remains limited, especially regarding the influence of segment size on CI. Meanwhile, digital cameras offer a cost-effective and user-friendly solution for canopy measurements in row crops, yet their application in this context remains underexplored. In this study, we employed a new approach using a 30°-tilted digital camera to estimate CI in corn and soybean fields, applying the LX, CC, and CLX methods. We systematically assessed the performance of these three methods by combining field measurements in real-world fields with simulations using the LESS 3D radiative transfer model. Our results showed that CLX applied to the whole image and 45° segment offered accurate estimation of CI (bias within ±0.1, RMSE < 0.2) and PAI (bias within ±0.4, RMSE < 1) in real-world fields and LESS simulations. The accuracy of the LX method was highly sensitive to segment size, with the best performance observed at the 15° segment (PAI bias within ±0.4). In contrast, the CC method remained stable across different segment sizes, and its performance was generally comparable to that of LX, except at the 15° segment. Across view zenith angles, CI derived from CC generally showed a continuous increase, while those from LX and CLX followed a rising trend at small zenith angles but began to decline at 68°, likely due to an increasing proportion of no-gap segments. Seasonally, LX tended to show decreasing CI during early growth stages but increased as the canopy matured, whereas CC and CLX showed gradually increasing CI before plateauing at peak PAI. The 30°-tilted camera effectively captured CI variations across different angles and growth stages, making it a practical and robust instrument for row crop canopy structure analysis. Applying these CI methods to digital cameras offers a low-cost and accessible CI estimation alternative, improving canopy structure monitoring accuracy in row crops.

Modeling↗
DOE OSTI2022

Understanding Recent Global Hydroclimate Change Using Multivariate Detection and Attribution Techniques and GCM Experiments

The observed slowdown in the rate of global average surface temperature (T) warming during the post-1998 decade (referred to at the time as the “global warming hiatus”) posed a challenge for climate researchers because it was not captured in global climate models projection. Observational and modeling evidence hinted that that leveling of the T trend was linked with the simultaneous appearance of cold surface temperature in the eastern equatorial Pacific that formed a protracted La Niña-like state, a phenomenon known as the Inter-decadal Pacific Oscillation (IPO). It was however not clear whether the concurrent equatorial Pacific cooling was a regional response to the rise in atmospheric greenhouse gas levels or anthropogenic aerosols that is not captured by the climate models or whether it was an unrelated, serendipitous manifestation of a natural phenomenon, internal to the climate system. To resolve this issue, we proposed in this project to develop and apply fingerprinting methods to differentiate between the observed climate response to various external forcing agents and the manifestations of internal climate variability. The project also sought to find out if climate models are able to reproduce the change signals detected in key observational phenomena and if they can be used to investigate the underlying processes. As such we examined changes in global hydroclimate variability and in an outstanding example of regional hydroclimate change, namely the multi-decadal 20 th century change in Sahel rainfall.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

A Dynamic Trajectory Fit to Multisensor Fireball Observations

Meteorites with known orbital origins are key to our understanding of solar system formation and the source of life on Earth. Fireball networks have been developed globally in a unified effort to record and ultimately retrieve these cosmic samples. However, the accuracy of the determined orbit and the likelihood of meteorite recovery depend directly on the accuracy of the chosen meteoroid triangulation method. There are three leading techniques for meteoroid triangulation discussed in the literature: the method of planes, the straight-line least-squares method, and the multiparameter fit method. Here we describe an alternative method to meteoroid triangulation, called the dynamic trajectory fit. This approach uses the meteoroid’s 3D dynamic equations of motion to fit a realistic trajectory directly to multisensor line-of-sight observations. This method has the ability to resolve fragmentation events, fit systematic observatory timing offsets, and determine mass estimates of the meteoroid along its observable trajectory. Through a comprehensive Monte Carlo analysis of over 100,000 trajectory simulations, we find this new method to more accurately estimate meteoroid trajectories of slow entry events (<25 km s{sup −1}) and events observed from low convergence angles (<10°) compared to existing meteoroid triangulation techniques. Additionally, we triangulate an observed fireball event with visible fragmentation using the various triangulation methods to show that the proposed dynamic trajectory fit implementing fragmentation to best match the captured multisensor line-of-sight data.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Measuring Gas Transport and Sorption in Large Intact Geologic Specimens via the Piezometric Method

Uptake of noble gases into heterogeneous geologic core samples was measured using a piezometric methodology. In addition to measuring accessible porosity—as with gas pycnometry—by monitoring the rate of pressure decay, this method can also be used to estimate the gas effective diffusivity in the sample. In contrast to previous applications of this method, where milligram quantities of fractured grains are characterized, here approximately kilogram core samples were left intact when tested. In doing so, a more representative sample of the heterogeneous field geology is provided. Additionally, alteration of the pore structure and connectivity during sample preparation is avoided. Furthermore, to scale the piezometric method from milligrams to kilograms, the system was designed to operate at medium vacuum (1 to 100 Pa) to restrict transport in pores less than approximately 60 µm to large Knudsen numbers. To test the system performance, two samples of interest were selected: a rhyolitic welded tuff from Blue Canyon Dome at the Energetic Materials Research and Testing Center and a zeolitized non-welded rhyolitic tuff from the Nevada National Security Site. Three noble gases were utilized in this test series; Argon and xenon as they are of direct interest to nuclear monitoring efforts and helium as it is a weakly adsorbing reference standard. Additionally, mercury intrusion porosimetry measurements were made on subsamples of the core to compare the observed porosity by the two methods and to discuss gas transport rates in the context of the measured pore distribution.

58 GEOSCIENCES↗
DOE OSTI2020

Matrix Completion Using Alternating Minimization for Distribution System State Estimation

This paper examines the problem of state estimation in power distribution systems under low-observability conditions. The recently proposed constrained matrix completion method which combines the standard matrix completion method and power flow constraints has been shown to be effective in estimating voltage phasors under low-observability conditions using single-snapshot information. However, the method requires solving a semidefinite programming (SDP) problem, which becomes computationally infeasible for large systems and if multiple-snapshot (time-series) information is used. This paper proposes an efficient algorithm to solve the constrained matrix completion problem with time-series data. This algorithm is based on reformulating the matrix completion problem as a bilinear (non-convex) optimization problem, and applying the alternating minimization algorithm to solve this problem. This paper proves the summable convergence of the proposed algorithm, and demonstrates its efficacy and scalability via IEEE 123-bus system and a real utility feeder system. This paper also explores the value of adding more data from the history in terms of computation time and estimation accuracy.

41 EE - Solar Energy Technologies Office (EE-4S)↗
DOE OSTI2020

Matrix Completion Using Alternating Minimization for Distribution System State Estimation: Preprint

This paper examines the problem of state estimation in power distribution systems under low-observability conditions. The recently proposed constrained matrix completion method which combines the standard matrix completion method and power flow constraints has been shown to be effective in estimating voltage phasors under low-observability conditions using single-snapshot information. However, the method requires solving a semidefinite programming (SDP) problem, which becomes computationally infeasible for large systems and if multiple-snapshot (time-series) information is used. This paper proposes an efficient algorithm to solve the constrained matrix completion problem with time-series data. This algorithm is based on reformulating the matrix completion problem as a bilinear (non-convex) optimization problem, and applying the alternating minimization algorithm to solve this problem. This paper proves the summable convergence of the proposed algorithm, and demonstrates its efficacy and scalability via IEEE 123-bus system and a real utility feeder system. This paper also explores the value of adding more data from the history in terms of computation time and estimation accuracy.

41 EE - Solar Energy Technologies Office (EE-4S)↗
DOE OSTI2024

Detailed Characterization of CZT Detector Response for Improved Coded-Aperture Imaging Performance

Gamma-ray imaging is a powerful method for locating and quantifying sources of radiation. The coded-aperture technique demonstrates superior angular resolution in comparison to other methods (e.g., Compton reconstruction). In this method, a mask constructed of highly attenuating material encodes the scene as a shadow pattern on a position-sensitive detector; this pattern can then be used to recreate the origin(s) of incident radiation. This is typically done through convolution of the mask and shadow patterns. Iterative methods which attempt to reconstruct the observed shadow pattern using a weighted combination of simulated patterns may also be employed. In either case, errors in event position reconstruction due to detector imperfections alter the shadow pattern and will therefore degrade system performance and may introduce imaging artifacts. These effects can be mitigated with a detailed understanding of such errors – allowing for the generation of representative simulations that include the errors and/or correction of raw imager data to remove the errors. We present a calibration process for a commercially available cadmium zinc telluride (CZT) gamma imager which provides a comprehensive characterization of the spatial and energy dependence of event reconstruction. By illuminating a mask featuring a regular grid of pinholes with a calibration source, the localized response of the detector can be measured with fine granularity. These local responses are combined to generate a full detector response map which can be used to distort simulations in a manner that is representative of the observed detector data. Details of the calibration procedure and an assessment of the impact of its end products on the performance of iterative imaging methods will be presented.

Ziock, Klaus-Peter↗
DOE OSTI2022

Cosmic rays in molecular clouds probed by H 2 rovibrational lines

Context. Low-energy cosmic rays (<1 TeV) play a fundamental role in the chemical and dynamical evolution of molecular clouds, as they control the ionisation, dissociation, and excitation of H 2 . Their characterisation is therefore important both for the interpretation of observations and for the development of theoretical models. However, the methods used so far for estimating the cosmic-ray ionisation rate in molecular clouds have several limitations due to uncertainties in the adopted chemical networks. Aims. Here, we refine and extend a previously proposed method to estimate the cosmic-ray ionisation rate in molecular clouds by observing rovibrational transitions of H 2 at near-infrared wavelengths, which are mainly excited by secondary cosmic-ray electrons. Methods. Combining models of interstellar cosmic-ray propagation and attenuation in molecular clouds with the rigorous calculation of the expected secondary electron spectrum and updated electron-H 2 excitation cross sections, we derive the intensity of the four H 2 rovibrational transitions observable in cold dense gas: (1—0)O(2), (1—0)Q(2), (1—0)S(0), and (1—0)O(4). Results. The proposed method allows the estimation of the cosmic-ray ionisation rate for a given observed line intensity and H 2 column density. We are also able to deduce the shape of the low-energy cosmic-ray proton spectrum impinging upon the molecular cloud. In addition, we present a look-up plot and a web-based application that can be used to constrain the low-energy spectral slope of the interstellar cosmic-ray proton spectrum. We finally comment on the capability of the James Webb Space Telescope to detect these near-infrared H 2 lines, which will make it possible to derive, for the first time, spatial variation in the cosmic-ray ionisation rate in dense gas. Besides the implications for the interpretation of the chemical-dynamic evolution of a molecular cloud, it will finally be possible to test competing models of cosmic-ray propagation and attenuation in the interstellar medium, as well as compare cosmic-ray spectra in different Galactic regions

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Methods for the Enhancement of Security Probabilistic Risk Assessments

The US Department of Energy is exploring the methods associated with probabilistic risk assessment (PRA) and how they could be used to enhance physical security evaluations for nuclear facilities. A brief review of both international and US Nuclear Regulatory Commission physical security assessment methods is presented. From this review, and with an understanding of the technical elements associated with a traditional nuclear safety PRA, several observations are made pertaining to where physical security analysis methods could be enhanced. These observations principally support and enhance the answers within a physical security context to the risk triplet: (1) What can go wrong? (2) What is the likelihood? and (3) What are the consequences? Finally, benefits and technical challenges toward the development of a full security PRA are presented.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗