Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “latent error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6

Thermodynamics-informed latent space dynamics identification

This software showcases a latent space dynamics identification method, namely tLaSDI, that embeds the first and second principles of thermodynamics. The latent variables are learned through an autoencoder as a nonlinear dimension reduction model. The latent dynamics are constructed by a neural network-based model that precisely preserves certain structures for the thermodynamic laws through the GENERIC formalism. An abstract error estimate is established, which provides a new loss formulation involving the Jacobian computation of autoencoder. The autoencoder and the latent dynamics are simultaneously trained to minimize the new loss. Computational examples demonstrate the effectiveness of tLaSDI, which exhibits robust generalization ability, even in extrapolation. In addition, an intriguing correlation is empirically observed between a quantity from tLaSDI in the latent space and the behaviors of the full-state solution.

Cheung, Siu Wun↗

Selection of Spectral Variables and Improvement of the Accuracy of Calibration of Temperature by Projection onto Latent Structures Using the Fluorescence Spectra of Yb{sup 3+}:CaF{sub 2}

The efficiency of interval methods for selecting variables and the divisive method of interval optimization by a genetic algorithm is considered with the purpose to increase the accuracy of temperature calibration by projection onto latent structures. The fluorescence spectra of Yb{sup 3+}:CaF{sub 2} recorded in the 880–1120 nm band with a resolution of approximately 0.2 nm in the temperature range from 66 to 150°C in 2°C increments are used as an example. The best result for the root-mean-square error of temperature prediction in the test sample (0.45°C) was obtained by interval projection onto latent structures by a combination of moving windows. The use of methods for selecting spectral variables improved more than two times the accuracy of temperature calibration.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Novel Multivariate Analysis for Soil Carbon Measurements Using Laser-Induced Breakdown Spectroscopy

Laser-induced breakdown spectroscopy (LIBS), a rapid and potentially field-deployable technology for estimating total carbon in soil, represents a novel approach to address important issues in soil science and carbon management. Our study has shown that models relating LIBS signal intensity at 247.85 nm to percent total carbon determined by dry combustion vary as a function of elemental and textural characteristics of the soil, and, to a lesser extent, wavelength and excitation energy of the laser. To better quantify these sources of variation, two wavelengths and three excitation energies were used to analyze soils from various locations. The emission line of carbon at 247.85 nm was pronounced at an excitation wavelength of 532 nm and energy of 45 mJ, but it was largely obscured by the 248.9 nm Fe line at 1064 nm and excitation energies of 90 and 135 mJ. Univariate analysis revealed linear, but soil-specific correlations between signal intensity at 247.85 nm and total carbon concentration. A single calibration model correlating LIBS spectra to carbon concentration in all samples was obtained using a multivariate approach. Several emission lines in addition to the strong carbon line contributed significantly to the multivariate model. These results show that multivariate analysis can be used to construct a robust calibration model for LIBS spectra and therein provide a reliable estimate of total soil carbon. Such results must be confirmed for a broader range of soils, yet crop and soil scientists, carbon managers, and instrument developers should find these results encouraging.

54 ENVIRONMENTAL SCIENCES↗

Estimating monthly averaged air-sea transfers of heat and momentum using the bulk aerodynamic method

Air-sea transfers of sensible heat, latent heat and momentum are computed from 25 years of middle-latitude and subtropical ocean weather ship data in the North Atlantic and North Pacific using the bulk aerodynamic method. The results show that monthly averaged wind speeds, temperatures and humidities can be used to estimate the monthly averaged sensible and latent heat fluxes from the bulk aerodynamic equations to within a relative error of approximately 10%. The estimates of monthly averaged wind stress under the assumption of neutral stability are shown to be within approximately 5% of the monthly averaged nonneutral values.

Esbensen, S. K.↗

Estimating monthly-averaged air-sea transfers of heat and momentum using the bulk aerodynamic method

Air-sea transfers of sensible heat, latent heat, and momentum are computed from twenty-five years of middle-latitude and subtropical ocean weather ship data in the North Atlantic and North Pacific using the bulk aerodynamic method. The results show that monthly-averaged wind speeds, temperatures, and humidities can be used to estimate the monthly-averaged sensible and latent heat fluxes computed from the bulk aerodynamic equations to within a relative error of approximately 10%. The estimate of monthly-averaged wind stress under the assumption of neutral stability are shown to be within approximately 5% of the monthly-averaged non-neutral values.

Esbensen, S. K.↗

Multispectral satellite data in the context of land surface heat balance

Multispectral satellite data are demonstrated to be an important potential contributor to the understanding and completeness of heat balance analysis. Satellite observations are presented, including visible, near-IR, IR, and microwave bands, which estimate surface characteristics and surface fluctuations. The relationship of the interannual variations of the satellite data and the land surface changes is discussed. It is shown that spatially representative values of global fluxes and parameters from multispectral data can consistently enhance the results of heat balance analysis. Daily net radiation can be estimated with a 10 percent error, while the error for albedo would be higher. Computations for all heat fluxes except the latent heat flux are shown. Soil moisture and surface temperature estimates can be derived from microwave and IR observations, respectively. Spectral reflectances in the visible and near-IR bands are suggested as important heat-balance indices for future consideration.

Choudhury, Bhaskar J.↗

Estimating Software Reliability for Space Launch Vehicles in Probabilistic Risk Assessment (PRA)

It is acutely recognized in the Probabilistic Risk assessment (PRA) field that software plays a defining role in overall system reliability for all modern systems across a wide variety of industries. Regardless if the software is embedded firmware for working components or elements, part of a Human-Machine-Interface, or automated command and control logic, the success of the software to fulfill its function under nominal and off-nominal environments will be a dominant contributor to system reliability. It is also recognized that software reliability prediction and estimation is one of the more challenging and questionable aspects of any PRA or system analyses due to the nature of software and its integration with physics based systems. Irrespective of this dichotomy, any incorporation of software reliability methods requires that the contributions are accountable, quantitative, and tractable. This paper provides a brief overview of software reliability methods, establishes some minimum requirements that the methods should incorporate for completeness, and provides a logic structure for applying software reliability. Model resolution will be discussed that supports current testing plans and trade studies. We will provide initial recommendations for use in the NASA PRA and present a future dynamic option for software and PRA. Space Launch Vehicle Software is recognized to be reliable in static conditions, yet relatively vulnerable to a set of failure modes in changing environments/flight phases. Two quantitative methods were chosen to incorporate software reliability into a Space Launch Vehicle PRA accounting for phase adjustments. One method predicts latent software failure using statistical methods, and the second provides estimates of coding errors and software operating system failures based on test and historical data, respectively. Software uncertainty will also be discussed. We determined that recommendations for PRA software reliability should be modeled at the software module level where multiple software components compose a module and combinations of the software architecture can lead to a functional failure.

Novack, Steven↗

Estimating Software Reliability for Space Launch Vehicles in Probabilistic Risk Assessment (PRA)

It is acutely recognized in the Probabilistic Risk Assessment (PRA) field that software plays a defining role in overall system reliability for all modern systems across a wide variety of industries. Regardless of whether the software is embedded firmware for working components or elements, part of a Human-Machine-Interface, or automated command and control logic, the success of the software to fulfill its function under nominal and off-nominal environments will be a dominant contributor to system reliability. It is also recognized that software reliability prediction and estimation is one of the more challenging and questionable aspects of any PRA or system analyses due to the nature of software and its integration with physics based systems. Irrespective of this dichotomy, any incorporation of software reliability methods requires that the contributions are accountable, quantitative, and tractable. This paper provides a brief overview of software reliability methods, establishes some minimum requirements that the methods should incorporate for completeness, and provides a logic structure for applying software reliability. Model resolution will be discussed that supports current testing plans and trade studies. We will provide initial recommendations for use in the National Aeronautics and Space Administration (NASA) PRA and present a future dynamic option for software and PRA. Space Launch Vehicle software is recognized to be reliable in static conditions, yet relatively vulnerable to a set of failure modes in changing environments/flight phases. Two quantitative methods were chosen to incorporate software reliability into a Space Launch Vehicle PRA accounting for phase adjustments. One method predicts latent software failure using statistical methods, and the second provides estimates of coding errors and software operating system failures based on test and historical data. Software uncertainty will also be discussed. It is determined that recommendations for PRA software reliability should be modeled at the software module level where multiple software components compose a module and combinations of the software architecture can lead to a functional failure.

Steven D. Novack↗

Use of ground-based remotely sensed data for surface energy balance calculations during Monsoon '90

Surface energy balance was evaluated at a semiarid watershed using direct and indirect measurements of the turbulent fluxes, a remote technique based on measurements of surface reflectance and temperature, and conventional meteorological information. Comparison of remote estimates of net radiant flux and soil heat flux densities with measured values showed errors on the order of +/-40 W/sq m. To account for the effects of sparse vegetation, semi-empirical adjustments to aerodynamic resistance were required for evaluation of sensible heat flux density (H). However, a significant scatter in estimated versus measured latent heat flux density (LE) was still observed, +/-75 W/sq m over a range from 100-400 W/sq m. The errors of H and LE estimates were reduced to +/-50 W/sq m when observations were restricted to clear sky conditions.

Moran, M. S.↗

Autoencoder Neural Network for chemically reacting systems

Incorporating detailed chemical kinetic models is critical for accurate simulations of reacting flows. However, detailed models involve a large number of thermochemical (TC) state variables. Solving the governing equations to evolve these TC variables becomes impractical for real-world applications. In this work, we propose an autoencoder (AE) neural network (NN)-based reduced model to accelerate such simulations. The AE NN is first trained to find a low-dimensional latent representation of the TC states. Then, the evolving state of a chemical system can be tracked by solving the equations of the latent variables instead of the original TC equations. We demonstrate the reduced model in a syngas CO/H 2 combustion system, using training data collected from canonical perfectly stirred reactors (PSRs). It is found that the AE model can reduce the dimension of the combustion system from 12 to 2 while maintaining low reconstruction error and excellent elemental mass conservation for the test dataset. In the a posteriori test, the combustion states obtained from solving the two latent equations are compared to those from solving the 12 equations of the full model. The AE reduced method is found to be able to capture the diverse combustion states on the top two branches of the S-curve well including the extinction turning point, but with higher prediction errors for states near the ignition turning point.

97 MATHEMATICS AND COMPUTING↗

Impact of Lateral Flow on Surface Water and Energy Budgets over the Southern Great Plains – A Modeling Study

As we see the horizontal grid spacing decrease, treatment of hydrologic processes in land surface models, such as the lateral flow of surface and subsurface flow, need to be explicitly represented. Unlike previous studies that mainly focused on the mountainous regions, in this study the offline WRF-Hydro model is employed to study the impact of lateral flow on soil moisture and energy fluxes over the relatively flat southern Great Plains (SGP). The vast amount of measurements over the SGP provide an unique opportunity to assess the model behavior. In addition, newly developed land surface properties and input forcing are ingested into the model, in an attempt to reduce uncertainties associated with the initial and boundary forcing and help to identify model deficiencies. Our results show that the more realistic inputs (parameters, soil types, forcing) lead to larger underestimation of latent heat flux and dry bias, indicating the existence of model structural uncertainty (embedded errors) in WRF-Hydro that need to be characterized to inform future model development efforts. Including lateral flow processes partly mitigates the model deficiencies in representing hydrologic processes and alleviates the dry bias. In particular, both surface and subsurface lateral flow increase soil moisture mainly over the lower elevations, except that subsurface flow also affects soil moisture over steeper terrains. Additional simulations are performed to assess the effect of routing resolution on model results. When LSM resolution is high, noticeable differences in soil moisture are produced between different routing resolutions especially over steep terrain. Whereas when LSM resolution is coarse, differences between routing resolutions become negligible, especially over flat terrain.

54 ENVIRONMENTAL SCIENCES↗

Physics-Informed Machine Learning of Dynamical Systems for Efficient Bayesian Inference

Although the no-u-turn sampler (NUTS) is a widely adopted method for performing Bayesian inference, it requires numerous posterior gradients which can be expensive to compute in practice. Recently, there has been a significant interest in physics-based machine learning of dynamical (or Hamiltonian) systems and Hamiltonian neural networks (HNNs) is a noteworthy architecture. But these types of architectures have not been applied to solve Bayesian inference problems efficiently. We propose the use of HNNs for performing Bayesian inference efficiently without requiring numerous posterior gradients. We introduce latent variable outputs to HNNs (L-HNNs) for improved expressivity and reduced integration errors. We integrate L-HNNs in NUTS and further propose an online error monitoring scheme to prevent sampling degeneracy in regions where L-HNNs may have little training data. We demonstrate L-HNNs in NUTS with online error monitoring consider several complex high-dimensional posterior densities and compare its performance to NUTS.

97 MATHEMATICS AND COMPUTING↗

Quantum-Assisted Variational Segmentation for Image-to-Image Wildfire Detection Using Satellite Data

The quantum computing community has been searching for suitable applications to demonstrate the potential of near-term quantum devices. Quantum machine learning is a potential candidate, particularly using models that cannot be efficiently simulated with classical computers [1, 2]. This work focuses on a transition phase of quantum computers where the quantum machine learning model is still simulable classically but projected not to be simulable as the size of the model grows. Ultimately quantum computers may have advantages for high-dimensional real-world problems. Due to the limited number of qubits in current noisy intermediate-scale quantum (NISQ) devices, the direct application of quantum computers in high dimensional data is not feasible. To remedy this problem, an encoder-decoder architecture can be utilized. The encoder model would transform the high-dimensional data into a compact representation, to a level that small quantum computers can be used today (or in the near future), and the decoder would take the quantum processed outputs back to the high-dimensional space. Addressing the two challenges of quantum machine learning, this work investigates a hybrid supervised generative model with a quantum Ising Born machine embedded as the latent distribution. The model contains four main parts (Figure 1.a.): (1) a U-NET architecture responsible for learning segmentation flow, (2) a Prior network responsible for learning an encoded latent distribution of the input data, (3) a Born machine which represents the latent distribution, and (4) a Posterior network in charge of learning the joint encoded latent distribution of inputs and target data. The initial model, proposed by [3], is optimized by (1) maximizing the overlap of the prior and posterior latent distributions, and (2) minimizing the segmentation loss. The proposed model is designed to be investigated in a simulation environment applied to the real-world application of wildfire segmentation. Specifically, the model is designed to solve the patchy wildfire segmentations of Moderate Resolution Imaging Spectroradiometer (MODIS) by taking the MODIS observations and using Visible Infrared Imaging Radiometer Suite’s (VIIRS) consistent wildfire product as the target. The model solves patchy wildfire segmentations and provides insight into the epistemic errors sourced from model variation. The model utilizes the Born machine as a QUBO solver to represent the latent space as a Bernoulli distribution. The proposed configuration allows the variational segmentation model to leverage the true quantum probabilistic nature and derive a more expressive latent configuration, increasing the model performance in describing wildfire segmentations. The quantum probabilistic information of the Born machine is directly incorporated in the Kullback-Leibler divergence loss in the prior and posterior distributions, forcing the Bernoulli latent distribution to maximize the overlap of input and joint input-target distributions. The proposed model is then trained and compared with a baseline only consisting of direct Bernoulli latent distribution with no Born machine representing the latent space. The models are evaluated based on the segmentation metrics, such as precision, recall, intersect of union, with uncertainty boundaries accounting for the stochastic nature of the model. Our findings show that even in low latent-dimensional space (due to the limit in computational power of the classical quantum simulator), we are able to effectively capture the latent representation and hence the model performs better than the baseline. The findings are a projection for scaling the model into higher dimensional latent space with the Born machine surpassing the baseline performance. Figure 1. Sub-figure (a) demonstrates the architecture for the training phase. The model consists of a Prior and Posterior network that encode inputs and joint input-target data into compact representations, respectively. The Born machine represents the latent distribution, and the U-NET branch learns the segmentation patterns of the data. The stochasticity is introduced to the U-NET through its last layer to create meaningful but stochastic segmentations. Sub-figure (b) represents the inference phase where the model takes the stochastic behavior from the prior network and injects that into the U-NET. Each attempt of inference will generate different but similar segmentations from the same distribution of the wildfire event. REFERENCES [1] Coyle, B., Mills, D., Danos, V., & Kashefi, E. (2020). The Born supremacy: quantum advantage and training of an Ising Born machine. npj Quantum Information, 6(1), 1-11. [2] Liu, J. G., & Wang, L. (2018). Differentiable learning of quantum circuit born machines. Physical Review A, 98(6), 062324. [3] Kohl, S., Romera-Paredes, B., Meyer, C., De Fauw, J., Ledsam, J. R., Maier-Hein, K., ... & Ronneberger, O. (2018). A probabilistic u-net for segmentation of ambiguous images. Advances in neural information processing systems, 31.

quantum machine learning↗

gLaSDI: Parametric physics-informed greedy latent space dynamics identification

A parametric adaptive physics-informed greedy Latent Space Dynamics Identification (gLaSDI) method is proposed for accurate, efficient, and robust data-driven reduced-order modeling of high-dimensional nonlinear dynamical systems. In the proposed gLaSDI framework, an autoencoder discovers intrinsic nonlinear latent representations of high-dimensional data, while dynamics identification (DI) models capture local latent-space dynamics. Here, an interactive training algorithm is adopted for the autoencoder and local DI models, which enables identification of simple latent-space dynamics and enhances accuracy and efficiency of data-driven reduced-order modeling. To maximize and accelerate the exploration of the parameter space for the optimal model performance, an adaptive greedy sampling algorithm integrated with a physics-informed residual-based error indicator and random-subset evaluation is introduced to search for the optimal training samples on the fly. Further, to exploit local latent-space dynamics captured by the local DI models for an improved modeling accuracy with a minimum number of local DI models in the parameter space, a -nearest neighbor convex interpolation scheme is employed. The effectiveness of the proposed framework is demonstrated by modeling various nonlinear dynamical problems, including Burgers equations, nonlinear heat conduction, and radial advection. The proposed adaptive greedy sampling outperforms the conventional predefined uniform sampling in terms of accuracy. Compared with the high-fidelity models, gLaSDI achieves 17 to 2,658× speed-up with 1 to 5% relative errors.

97 MATHEMATICS AND COMPUTING↗

Interannual and Decadal Variability of Ocean Surface Latent Heat Flux as Seen from Passive Microwave Satellite Algorithms

Ocean surface turbulent fluxes are critical links in the climate system since they mediate energy exchange between the two fluid systems (ocean and atmosphere) whose combined heat transport determines the basic character of Earth's climate. Deriving physically-based latent and sensible heat fluxes from satellite is dependent on inferences of near surface moisture and temperature from coarser layer retrievals or satellite radiances. Uncertainties in these "retrievals" propagate through bulk aerodynamic algorithms, interacting as well with error properties of surface wind speed, also provided by satellite. By systematically evaluating an array of passive microwave satellite algorithms, the SEAFLUX project is providing improved understanding of these errors and finding pathways for reducing or eliminating them. In this study we focus on evaluating the interannual variability of several passive microwave-based estimates of latent heat flux starting from monthly mean gridded data. The algorithms considered range from those based essentially on SSM/I (e.g. HOAPS) to newer approaches that consider additional moisture information from SSM/T-2 or AMSU-B and lower tropospheric temperature data from AMSU-A. On interannual scales, variability arising from ENSO events and time-lagged responses of ocean turbulent and radiative fluxes in other ocean basins (as well as the extratropical Pacific) is widely recognized, but still not well quantified. Locally, these flux anomalies are of order 10-20 W/sq m and present a relevant "target" with which to verify algorithm performance in a climate context. On decadal time scales there is some evidence from reanalyses and remotely-sensed fluxes alike that tropical ocean-averaged latent heat fluxes have increased 5-10 W/sq m since the early 1990s. However, significant uncertainty surrounds this estimate. Our work addresses the origin of these uncertainties and provides statistics on time series of tropical ocean averages, regional space / time correlation analysis, and separation of contributions by variations in wind and near surface humidity deficit. Comparison to variations in reanalysis data sets is also provided for reference.

Robertson, Franklin R.↗

Symbolic pregression: Discovering physical laws from distorted video

In this work, we present a method for unsupervised learning of equations of motion for objects in raw and optionally distorted unlabeled synthetic video (or, more generally, for discovering and modeling predictable features in time-series data). We first train an autoencoder that maps each video frame into a low-dimensional latent space where the laws of motion are as simple as possible, by minimizing a combination of nonlinearity, acceleration, and prediction error. Differential equations describing the motion are then discovered using Pareto-optimal symbolic regression. We find that our pre-regression (“pregression”) step is able to rediscover Cartesian coordinates of unlabeled moving objects even when the video is distorted by a generalized lens. Using intuition from multidimensional knot theory, we find that the pregression step is facilitated by first adding extra latent space dimensions to avoid topological problems during training and then removing these extra dimensions via principal component analysis. An inertial frame is autodiscovered by minimizing the combined equation complexity for multiple experiments.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Modeling energy balance while correcting for measurement error via free knot splines

Measurements of energy balance components (energy intake, energy expenditure, changes in energy stores) are often plagued with measurement error. Doubly-labeled water can measure energy intake (EI) with negligible error, but is expensive and cumbersome. An alternative approach that is gaining popularity is to use the energy balance principle, by measuring energy expenditure (EE) and change in energy stores (ES) and then back-calculate EI. Gold standard methods for EE and ES exist and are known to give accurate measurements, albeit at a high cost. We propose a joint statistical model to assess the measurement error in cheaper, non-intrusive measures of EE and ES. We let the unknown true EE and ES for individuals be latent variables, and model them using a bivariate distribution. We try both a bivariate Normal as well as a Dirichlet Process Mixture Model, and compare the results via simulation. Our approach, is the first to account for the dependencies that exist in individuals’ daily EE and ES. We employ semiparametric regression with free knot splines for measurements with error, and linear components for error free covariates. We adopt a Bayesian approach to estimation and inference and use Reversible Jump Markov Chain Monte Carlo to generate draws from the posterior distribution. Based on the semiparameteric regression, we develop a calibration equation that adjusts a cheaper, less reliable estimate, closer to the true value. Along with this calibrated value, our method also gives credible intervals to assess uncertainty. A simulation study shows our calibration helps produce a more accurate estimate. Furthermore, our approach compares favorably in terms of prediction to other commonly used models.

60 APPLIED LIFE SCIENCES↗

Evaluation of energy balance closure adjustment methods by independent evapotranspiration estimates from lysimeters and hydrological simulations

Here, we report non-closure of the surface energy balance is a frequently observed phenomenon of hydrometeorological field measurements, when using the eddy-covariance method, which can be ascribed to an underestimation of the turbulent fluxes. Several approaches have been proposed in order to adjust the measured fluxes for this apparent systematic error. However, there are uncertainties about partitioning of the energy balance residual between the sensible and latent heat flux and whether such a correction should be applied on 30-minute data or longer time scales. The data for this study originate from two grassland sites in southern Germany, where measurements from weighable lysimeters are available as reference. The adjusted evapotranspiration rates are also compared with joint energy and water balance simulations using a physically-based distributed hydrological model. We evaluate two adjustment methods: the first one preserves the Bowen ratio and the correction factor is determined on a daily basis. The second one attributes a smaller portion of the residual energy to the latent heat flux than to the sensible heat flux for closing the energy balance for every 30-minute flux integration interval. Both methods lead to an improved agreement of the eddy-covariance based fluxes with the independent lysimeter estimates and the physically-based model simulations. The first method results in a better comparability of evapotranspiration rates, and the second method leads to a smaller overall bias. These results are similar between both sites despite considerable differences in terrain complexity and grassland management. Moreover, we found that a daily adjustment factor leads to less scatter than a complete partitioning of the residual for every half-hour time interval. Lastly, the vertical temperature gradient in the surface layer and friction velocity were identified as important predictors for a potential future parameterization of the energy balance residual.

58 GEOSCIENCES↗