Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “identification problem”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11

GPLaSDI: Gaussian Process Latent Space Dynamics Identification

GPLaSDI is a software that introduces GPLaSDI, a novel LaSDI-based framework that relies on Gaussian process (GP) for latent space ODE interpolations. Using GPs offers two significant advantages. First, it enables the quantification of uncertainty over the reduced order model (ROM) predictions. Second, leveraging this prediction uncertainty allows for efficient adaptive training through a greedy selection of additional training data points. This approach does not require prior knowledge of the underlying PDEs. Consequently, GPLaSDI is inherently non-intrusive and can be applied to problems without a known PDE or its residual. We demonstrate the effectiveness of our approach on the Burgers equation, Vlasov equation for plasma physics, and a rising thermal bubble problem. Our proposed method achieves between 200 and 100,000 times speed-up, with up to 7% relative error.

Choi, Youngsoo↗

gLaSDI: Parametric physics-informed greedy latent space dynamics identification

A parametric adaptive physics-informed greedy Latent Space Dynamics Identification (gLaSDI) method is proposed for accurate, efficient, and robust data-driven reduced-order modeling of high-dimensional nonlinear dynamical systems. In the proposed gLaSDI framework, an autoencoder discovers intrinsic nonlinear latent representations of high-dimensional data, while dynamics identification (DI) models capture local latent-space dynamics. Here, an interactive training algorithm is adopted for the autoencoder and local DI models, which enables identification of simple latent-space dynamics and enhances accuracy and efficiency of data-driven reduced-order modeling. To maximize and accelerate the exploration of the parameter space for the optimal model performance, an adaptive greedy sampling algorithm integrated with a physics-informed residual-based error indicator and random-subset evaluation is introduced to search for the optimal training samples on the fly. Further, to exploit local latent-space dynamics captured by the local DI models for an improved modeling accuracy with a minimum number of local DI models in the parameter space, a -nearest neighbor convex interpolation scheme is employed. The effectiveness of the proposed framework is demonstrated by modeling various nonlinear dynamical problems, including Burgers equations, nonlinear heat conduction, and radial advection. The proposed adaptive greedy sampling outperforms the conventional predefined uniform sampling in terms of accuracy. Compared with the high-fidelity models, gLaSDI achieves 17 to 2,658× speed-up with 1 to 5% relative errors.

97 MATHEMATICS AND COMPUTING↗

Root identification in minirhizotron imagery with multiple instance learning

In this study, multiple instance learning (MIL) algorithms to automatically perform root detection and segmentation in minirhizotron imagery using only image-level labels are proposed. Root and soil characteristics vary from location to location, and thus, supervised machine learning approaches that are trained with local data provide the best ability to identify and segment roots in minirhizotron imagery. However, labeling roots for training data (or otherwise) is an extremely tedious and time-consuming task. This paper aims to address this problem by labeling data at the image level (rather than the individual root or root pixel level) and train algorithms to perform individual root pixel level segmentation using MIL strategies. Three MIL methods (multiple instance adaptive cosine coherence estimator, multiple instance support vector machine, multiple instance learning with randomized trees) were applied to root detection and compared to non-MIL approaches. The results show that MIL methods improve root segmentation in challenging minirhizotron imagery and reduce the labeling burden. In our results, multiple instance support vector machine outperformed other methods. The multiple instance adaptive cosine coherence estimator algorithm was a close second with an added advantage that it learned an interpretable root signature which identified the traits used to distinguish roots from soil and did not require parameter selection.

59 BASIC BIOLOGICAL SCIENCES↗

Using Temporal Information from Human Mobility Data to Detect Anchor Points

Spatiotemporal mobility data are available in massive quantities, but large quantities of data typically include fewer variables or data fields. Often, the only available fields are User ID, Longitude, Latitude, Timestamp (ULLT). This raises an important question: how much can we infer about human mobility patterns using only these four fields? With ULLT data, we do not know individuals' socioeconomic status information or when they are visiting their anchor points (AP) or locations (such as homes, places of employment, or schools), and it is a modern challenge to use this data to infer these characteristics. When detecting anchor locations with limited input information, verification and validation (VV) are significant challenges. This paper addresses the problem of identifying individuals' anchor locations using only temporal information from spatiotemporal datasets with limited attributes. Our approach does not explicitly use latitude and longitude during analysis. Locationbased information is only employed in the preprocessing stage to identify periods of movement (trips) and stops (dwelling). Beyond this step, all analysis is based on temporal patterns. In theory, if stops and dwell times could be detected through alternative means, our method could function entirely without location-based input. We demonstrate this methodology on the 2017 National Household Travel Survey (NHTS) data, because it includes a carefully designed and collected time use survey with representative sampling and labeled ground truth. The high-quality survey data allows us to test the accuracy of our methods because NHTS contains intended place labels and agent/user characteristics. We have also applied our validated AP identification algorithm on very large-scale GPS based trajectory data for Patterns-of-Life (PoL) assessment and other applications, but due to space limit that could not be presented here.

McBride, Liz [ORNL] (ORCID:0000000286925869)↗

Molecular structure retrieval directly from laboratory-frame photoelectron spectra in laser-induced electron diffraction

Ubiquitous to most molecular scattering methods is the challenge to retrieve bond distance and angle from the scattering signals since this requires convergence of pattern matching algorithms or fitting methods. This problem is typically exacerbated when imaging larger molecules or for dynamic systems with little a priori knowledge. Here, we employ laser-induced electron diffraction (LIED) which is a powerful means to determine the precise atomic configuration of an isolated gas-phase molecule with picometre spatial and attosecond temporal precision. We introduce a simple molecular retrieval method, which is based only on the identification of critical points in the oscillating molecular interference scattering signal that is extracted directly from the laboratory-frame photoelectron spectrum. The method is compared with a Fourier-based retrieval method, and we show that both methods correctly retrieve the asymmetrically stretched and bent field-dressed configuration of the asymmetric top molecule carbonyl sulfide (OCS), which is confirmed by our quantum-classical calculations.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

A Multi-Harmonic System Identification Method for Internal Circuit Element Monitoring

Many critical infrastructures depend on the reliability of electronic circuits, whose health depends on the values of internal circuit elements that degrade over time. It is therefore important to estimate the values of internal circuit elements from external measurements and monitor them for changes. The challenge to doing so is that, typically, the internal voltages and currents are not accessible for measurement. Prior work on internal circuit element monitoring uses data obtained from sensors placed inside the circuit or requires additional circuitry to be added to the given system, both of which are undesirable. We propose a new multi-harmonic frequency-domain based system identification method that is non-intrusive. It exploits the latent non-idealities already present in the system, specifically harmonics in the measured input and output signals. We show how sensitivity analysis can be used to both assess the accuracy of the method as well as to optimize the choice of harmonics to use. We use as a motivation and illustrative example the problem of determining the equivalent series resistance and capacitance in a class of dc-link capacitance circuits in Adjustable Speed Drives. We assess the performance of this method using simulations, and establish its validity by experimental results.

Deshpande, Ankit Vivek↗

Verification, Validation, and Uncertainty Quantification in Thermal Hydraulics, Freeman Scholar Lecture (2019)

Engineering problems are generally solved by analytical models or computer codes. These models, in addition to conservation equations, also include many empirical relationships and approximate numerical methods. Each of these components contributes to the uncertainty in the prediction. A systematic approach to judge the applicability of the code to the intended application is needed. It starts from verification of implementation of formulation in the code, identification of important phenomena, finding relevant tests with quantified uncertainty for these phenomena, and validation of the code by comparing predictions with the relevant test data. The relevant tests must address phenomena as expected in the intended application. In case of small size or limited condition tests, the scaling analyses are needed to assess the relevancy of the tests. Finally, a statement of uncertainty in the prediction is needed. Systematic approaches are described to aggregate uncertainties from different components of the code for intended application. Here, verification, validation, and uncertainty quantifications (VVUQs) are briefly described.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Physics-Informed Active Learning With Simultaneous Weak-Form Latent Space Dynamics Identification

The parametric greedy latent space dynamics identification (gLaSDI) framework has demonstrated promising potential for accurate and efficient modeling of high-dimensional nonlinear physical systems. However, it remains challenging to handle noisy data. Here, to enhance robustness against noise, we incorporate the weak-form estimation of nonlinear dynamics (WENDy) into gLaSDI. In the proposed weak-form gLaSDI (WgLaSDI) framework, an autoencoder and WENDy are trained simultaneously to discover intrinsic nonlinear latent-space dynamics of high-dimensional data. Compared with the standard sparse identification of nonlinear dynamics (SINDy) employed in gLaSDI, WENDy enables variance reduction and robust latent space discovery, therefore leading to more accurate and efficient reduced-order modeling. Furthermore, the greedy physics-informed active learning in WgLaSDI enables adaptive sampling of optimal training data on the fly for enhanced modeling accuracy. The effectiveness of the proposed framework is demonstrated by modeling various nonlinear dynamical problems, including viscous and inviscid Burgers' equations, time-dependent radial advection, and the Vlasov equation for plasma physics. With data that contains 5%–10% Gaussian white noise, WgLaSDI outperforms gLaSDI by orders of magnitude, achieving 1%–7% relative errors. Compared with the high-fidelity models, WgLaSDI achieves 121 to 1779x speed-up.

97 MATHEMATICS AND COMPUTING↗

IDENTIFICATION OF ADSORBA TION OF ADSORBATE FT-IR BANDS USING IN-SI -IR BANDS USING IN-SITU TECHNIQUES: Pd SPECIATION AND ADSORPTION CHEMISTRY OF Pd-ZEOLITES FOR PASSIVE NOx ADSORPTION

To meet increasingly stringent automotive emissions standards, further improvements in catalytic converter design are necessary. Current automotive catalyst systems are effective at eliminating emission of nitrogen oxides (NOx) once the catalyst reaches operational temperature (~200 °C). NOx emitted at lower catalyst temperatures now comprises most of the NOx released during a typical test cycle. Referred to as “the cold start problem” this issue has come to the forefront of automotive catalyst development, as mitigating these emissions is necessary to further reduce automotive emissions. Passive NOx adsorbers present an appealing solution to the cold start problem, these being a class of materials that chemisorb exhaust components such as NOx, carbon monoxide (CO) and hydrocarbons at near-ambient temperatures, and then desorb these compounds once the downstream catalyst has reached operational temperature. An effective passive NOx adsorber must have several properties: high NOx adsorption at near-ambient temperatures, near-complete NOx desorption at temperatures within the operational range, high thermal stability, and resistance to automotive exhaust components at high temperatures. The potential environmental impact of such a system is substantial, as NOx emissions currently result in the formation of millions of tons of smog and acid rain each year. Pd-exchanged zeolites have shown promise for deployment as Passive NOx adsorbers, though much remains to be understood about their adsorption chemistry and deactivation. In-situ Diffuse Reflectance Infrared Fourier Transform Spectroscopy (DRIFTS) provides a convenient probe of adsorbed species, most automotive exhaust components possessing IR-active chemical bonds. By examining the evolution of IR bands under various pretreatments and adsorbates, the overall Pd-speciation and adsorptive zeolite sites of each material can be characterized, and the identities of IR bands can be deduced. In this work, microreactor-MS analysis of the adsorption and desorption behavior of these materials was also examined, these results being coupled with in-situ DRIFTS temperature programmed desorption (TPD) to correlate desorption events with specific adsorbed species. A pair of zeolite frameworks of similar Si/Al ratio but differing pore size were examined, Beta zeolite (BEA) and Chabazite (CHA) representing a medium- and small-pore framework, respectively. The effect of Pd-loading on BEA was examined, as well as the various deactivation pathways and active sites of each material.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Deep Learning Explicit Differentiable Predictive Control Laws for Buildings

We present a differentiable predictive control (DPC) methodology for learning constrained control laws for unknown nonlinear systems. DPC poses an approximate solution to multiparametric programming problems emerging from explicit nonlinear model predictive control (MPC). Contrary to approximate MPC, DPC does not require supervision by an expert controller. Instead, a system dynamics model is learned from a small dataset of recorded observations of the perturbed system's dynamics and the control law is optimized offline by interaction with the learned system model. The DPC method is based on two sequential steps, i) system identification using a constrained neural state-space model, and ii) optimization of an explicit control law parametrized by another neural network in closed-loop simulation with the identified neural state-space model. The combination of a differentiable closed-loop system and penalty methods for constraint handling of system outputs and inputs allows us to optimize the control law's parameters directly by backpropagating economic MPC loss through the learned system model. By incorporating domain knowledge and leveraging established techniques from optimal control, our method leverages deep neural networks as nonlinear function approximators for system identification and control while avoiding concomitant costs of intractably large datasets, and computationally expensive over-parametrized models. The scalability, data efficiency, and constrained optimal control capability of the proposed DPC method are demonstrated in simulation using a multi-zone building emulator.

Drgona, Jan↗

Quantifying the atomistic free-volume morphology of materials with graph theory

Here, we introduce a new computational methodology for the identification and characterization of free volume within/around atomistic configurations. This scheme employs a three-stage workflow, by which spheres are iteratively grown inside of voxels, and ultimately converted to planar graphs, which are then characterized via a graph-based order parameter. Our approach is computationally efficient, physically intuitive, and universally transferable to any material system. Validation of our methodology is performed on several sets of materials problems: (1) classification of unique free volumes in various crystal phases, (2) autonomous detection and classification of complex surface defects during epitaxial growth simulations, (3) characterization of free volume defects in metals/alloys, and (4) quantification of the spatio-temporal behavior of nano-scale free volume morphologies as a function of both temperature and free-volume size. Our method accurately identifies and characterizes unique free volumes over a multitude of systems and length scales, indicating its potential for future use in understanding the relationship between free volume morphology and material properties under both static and dynamic conditions.

36 MATERIALS SCIENCE↗

Probing Naturalness with Searches for Supersymmetric Higgs Partners at the Large Hadron Collider

The discovery of the Higgs boson at the Large Hadron Collider completed the standard model of particle physics and led to the 2013 Nobel Prize. While it has been extremely successful in describing a wide variety of phenomena, the standard model cannot be the final theory of nature because it is unable to explain why the Higgs boson mass lies at the electroweak scale rather than 16 orders of magnitude larger at the Planck scale, a theoretical flaw known as the ``hierarchy problem.'' Supersymmetry is a standard model extension that could provide a natural solution to the hierarchy problem by introducing light supersymmetric Higgs partners. This proposal focused on searches that are sensitive to supersymmetric Higgs partners in data collected by the ATLAS experiment, which were carried out by the University of Illinois high-energy physics group led by PI Ben Hooberman as part of his Department of Energy Early Career Research Program award from 2017-2023. The searches were complemented by improvements to particle identification algorithms and the ATLAS trigger system that extend the sensitivity of future supersymmetry searches.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Time-frequency based cyber security defense of wide-area control system for fast frequency reserve

Global power systems are transiting from conventional fossil fuel energy to renewable energies due to their environmental benefits. The increasing penetration of renewable energies presents challenges for power system operation. The efficiency and sufficiency of responsive reserves have become increasingly important for power systems with a high proportion of renewable energies. The Fast Frequency Reserve (FFR), especially the Wide-area Monitoring System (WAMS)-based FFR, is a promising and effective solution to secure and enhance the stability of power systems. However, cyber security has become a new challenge for the WAMS-based FFR system. Cyber attacks on the FFR control system may threaten the safety of power system operation due to the rapid power controllability requirement of FFR. Therefore, to address this problem, a time-frequency based cyber security defense framework is proposed to detect the cyber spoofing of synchrophasor data in WAMS-based FFR control systems. This paper first introduces the Continuous Wavelet Transforms (CWTs) to decompose spoofing signals. Then, the Dual-frequency Scale Convolutional Neural Networks (DSCNN) is proposed to identify the time-frequency domains matrix from two frequency scales. Integrating CWTs and DSCNN, an identification framework called CWTs-DSCNN is further proposed to detect the spoofing attacks in the WAMS-based FFR system. Multiple experiments using the actual data from FNET/GridEye are performed to verify the effectiveness of the framework in securing WAMS-based FFR systems.

25 ENERGY STORAGE↗

Leveraging Multitime Hamilton–Jacobi PDEs for Certain Scientific Machine Learning Problems

Hamilton-Jacobi partial differential equations (HJ PDEs) have deep connections with a wide range of fields, including optimal control, differential games, and imaging sciences. By considering the time variable to be a higher dimensional quantity, HJ PDEs can be extended to the multi-time case. In this paper, we establish a novel theoretical connection between specific optimization problems arising in machine learning and the multi-time Hopf formula, which corresponds to a representation of the solution to certain multi-time HJ PDEs. Through this connection, we increase the interpretability of the training process of certain machine learning applications by showing that when we solve these learning problems, we also solve a multi-time HJ PDE and, by extension, its corresponding optimal control problem. As a first exploration of this connection, we develop the relation between the regularized linear regression problem and the Linear Quadratic Regulator (LQR). We then leverage our theoretical connection to adapt standard LQR solvers (namely, those based on the Riccati ordinary differential equations) to design new training approaches for machine learning. Lastly, we provide some numerical examples that demonstrate the versatility and possible computational advantages of our Riccati-based approach in the context of continual learning, post-training calibration, transfer learning, and sparse dynamics identification.

97 MATHEMATICS AND COMPUTING↗

Accurate data-driven surrogates of dynamical systems for forward propagation of uncertainty

Stochastic collocation (SC) is a well-known non-intrusive method of constructing surrogate models for uncertainty quantification. In dynamical systems, SC is especially suited for full-field uncertainty propagation that characterizes the distributions of the high-dimensional solution fields of a model with stochastic input parameters. However, due to the highly nonlinear nature of the parameter-to-solution map in even the simplest dynamical systems, the constructed SC surrogates are often inaccurate. Here, this work presents an alternative approach, where we apply the SC approximation over the dynamics of the model, rather than the solution. By combining the data-driven sparse identification of nonlinear dynamics framework with SC, we construct dynamics surrogates and integrate them through time to construct the surrogate solutions. We demonstrate that the SC-over-dynamics framework leads to smaller errors, both in terms of the approximated system trajectories as well as the model state distributions, when compared against full-field SC applied to the solutions directly. We present numerical evidence of this improvement using three test problems: a chaotic ordinary differential equation, and two partial differential equations from solid mechanics.

42 ENGINEERING↗

Understanding the High Energy Higgs Sector with the CMS Experiment and Artificial Intelligence

This dissertation describes efforts towards understanding the Higgs boson at the highest energies humanly accessible, using the CMS experiment at the Large Hadron Collider and advances in artificial intelligence (AI) and machine learning (ML). We present searches for resonant and nonresonant Higgs-boson (H) pair production in the all-hadronic two beauty-quark and two vector boson (V) final state, using a novel strategy to measure the quartic HHVV coupling and search for new Higgs-like bosons. By targeting highly Lorentz-boosted Higgs pairs, we probe effects of potential new physics in the high energy Higgs sector, which could hold answers to fundamental mysteries of nature such as baryon asymmetry. To enable these and future searches, we introduce as well significant developments in AI/ML, including in the identification of boosted H$\rightarrow$VV decays with deep transformer networks and advances in AI-accelerated fast simulations of the CMS detector. The latter notably includes the development of the first, highly performant generative models for point-cloud data in high energy physics, which have the potential to improve CMS' computational efficiency by up to three orders of magnitude. We also highlight novel solutions to the important and challenging problems of calibrating and validating these ML techniques. Finally, we present new approaches to search for new physics in a model-agnostic manner, using physics-informed ML methods equivariant to Lorentz transformations. The quartic HHVV coupling is observed (expected) to be constrained to $[-0.04, 2.05]$ ($[0.05, 1.98]$) at the 95% confidence level relative to the standard model prediction, representing the second-most sensitive measurement of this coupling by CMS to date. Exclusion limits on the production cross section of new heavy resonances decaying to two Higgs-like bosons are expected to be as low as 0.3 fb for high resonance masses.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Exploring quantum statistics for massive Dirac and Majorana neutrinos using spinor-helicity techniques

Recently, there has been interest in the applicability of quantum statistics to distinguish Dirac from Majorana neutrinos in multineutrino final states. In particular, debate has arisen over the validity of the Dirac-Majorana confusion theorem in these processes, i.e., that any distinction between the Dirac and Majorana processes goes to zero as the neutrino mass goes to zero. Here we approach this problem equipped with spinor-helicity methods generalized for massive Dirac and Majorana fermions. We explicitly calculate all helicity amplitudes, and their squares, for the decay of a light scalar particle to two neutrinos and two oppositely charged leptons. This allows us to pinpoint the crucial steps which could lead to claims of a violation of the confusion theorem. We show that, if the correct antisymmetrization of Dirac to Majorana amplitudes is used, identification of which is clear in this framework, and all relevant contributions are appropriately summed, a scalar decay into two charged leptons and two neutrinos satisfies the Dirac-Majorana confusion theorem.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

The CHIMERAS project: design framework for the Collisionless HIgh-beta Magnetized Experiment Researching Astrophysical Systems

From the near-Earth solar wind to the intracluster medium of galaxy clusters, collisionless, high-beta, magnetized plasmas pervade our universe. Energy and momentum transport from large-scale fields and flows to small-scale motions of plasma particles is ubiquitous in these systems, but a full picture of the underlying physical mechanisms remains elusive. The transfer is often mediated by a turbulent cascade of Alfvénic fluctuations as well as a variety of kinetic instabilities; these processes tend to be multi-scale and/or multi-dimensional, which makes them difficult to study using spacecraft missions and numerical simulations alone. Meanwhile, existing laboratory devices struggle to produce the collisionless, high ion beta (β i ≳ 1), magnetized plasmas across the range of scales necessary to address these problems. As envisioned in recent community planning documents, it is therefore important to build a next generation laboratory facility to create a β i ≳ 1, collisionless, magnetized plasma in the laboratory for the first time. A working group has been formed and is actively defining the necessary technical requirements to move the facility towards a construction-ready state. Recent progress includes the development of target parameters and diagnostic requirements as well as the identification of a need for source-target device geometry. As the working group is already leading to new synergies across the community, we anticipate a broad community of users funded by a variety of federal agencies (including National Aeronautics and Space Administration, Department of Energy and National Science Foundation) to make copious use of the future facility.

astrophysical plasmas↗