Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “sparse data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 811 records · Page 45
All sourcesNASA NTRSDOE OSTI
DOE OSTI2018

Accuracy of Some Approximate Gaussian Filters for the Navier--Stokes Equation in the Presence of Model Error

Bayesian state estimation of a dynamical system from a stream of noisy measurements is important in many geophysical and engineering applications where high dimensionality of the state space, sparse observations, and model error pose key challenges. In this work, three computationally feasible, approximate Gaussian data assimilation/filtering algorithms are considered in various regimes of turbulent 2D Navier--Stokes dynamics in the presence of model error. The first source of error arises from the necessary use of reduced models for the forward dynamics of the filters, while a particular type of representation error arises from the finite resolution of observations which mix up information about resolved and unresolved dynamics. Two stochastically parameterized filtering algorithms, referred to as cSPEKF and GCF, are compared with 3DVAR---a prototypical time-sequential algorithm known to be accurate for filtering dissipative systems for a suitably inflated “background” covariance. We provide the first evidence that the stochastically parameterized algorithms, which do not rely on detailed knowledge of the underlying dynamics and do not require covariance inflation, can compete with or outperform an optimally tuned 3DVAR algorithm, and they can overcome competing sources of error in a range of dynamical scenarios.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

First Sagittarius A* Event Horizon Telescope Results. III. Imaging of the Galactic Center Supermassive Black Hole

We present the first event-horizon-scale images and spatiotemporal analysis of Sgr A* taken with the Event Horizon Telescope in 2017 April at a wavelength of 1.3 mm. Imaging of Sgr A* has been conducted through surveys over a wide range of imaging assumptions using the classical CLEAN algorithm, regularized maximum likelihood methods, and a Bayesian posterior sampling method. Different prescriptions have been used to account for scattering effects by the interstellar medium toward the Galactic center. Mitigation of the rapid intraday variability that characterizes Sgr A* has been carried out through the addition of a “variability noise budget” in the observed visibilities, facilitating the reconstruction of static full-track images. Our static reconstructions of Sgr A* can be clustered into four representative morphologies that correspond to ring images with three different azimuthal brightness distributions and a small cluster that contains diverse nonring morphologies. Based on our extensive analysis of the effects of sparse (u,v)-coverage, source variability, and interstellar scattering, as well as studies of simulated visibility data, we conclude that the Event Horizon Telescope Sgr A* data show compelling evidence for an image that is dominated by a bright ring of emission with a ring diameter of ∼50 μas, consistent with the expected “shadow” of a 4 × 10$^{6}$ M $_{⊙}$ black hole in the Galactic center located at a distance of 8 kpc.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2017

Robust Spectral Unmixing of Sparse Multispectral Lidar Waveforms using Gamma Markov Random Fields

Here, this paper presents a new Bayesian spectral un-mixing algorithm to analyse remote scenes sensed via sparse multispectral Lidar measurements. To a first approximation, in the presence of a target, each Lidar waveform consists of a main peak, whose position depends on the target distance and whose amplitude depends on the wavelength of the laser source considered (i.e, on the target reflectivity). Besides, these temporal responses are usually assumed to be corrupted by Poisson noise in the low photon count regime. When considering multiple wavelengths, it becomes possible to use spectral information in order to identify and quantify the main materials in the scene, in addition to estimation of the Lidar-based range profiles. Due to its anomaly detection capability, the proposed hierarchical Bayesian model, coupled with an efficient Markov chain Monte Carlo algorithm, allows robust estimation of depth images together with abundance and outlier maps associated with the observed 3D scene. The proposed methodology is illustrated via experiments conducted with real multispectral Lidar data acquired in a controlled environment. The results demonstrate the possibility to unmix spectral responses constructed from extremely sparse photon counts (less than 10 photons per pixel and band).

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2016

Effects of EMF Emissions from Cables and Junction Boxes on Marine Species

Studies have shown that diverse aquatic species are electrosensitive. Many fishes, and marine mammals, can either detect, navigate by, or are affected by electromagnetic fields (EMF) with various sensitivities, and their behavior may be impacted by unnatural EMF emissions in the water column. Sharks, rays and skates are known to have the highest sensitivity to electric fields. Electric field emissions in the range 0.5–100 micro volt/m appear to attract them, and emissions over 100 micro volt/m to repulse them. A marine hydrokinetic MHK device will have multiple components and associated multiple submarine cables on the seafloor and running through the water column and would potentially increase the level of EMF emissions to which the marine species at the site may be exposed to. There are therefore concerns amongst stakeholders that EMF emissions associated with MHK devices and their components may act as barriers to species migration, cause disorientation, change community compositions and ecosystems, and that they may attract sharks, leading to a local increase in the risk of shark attacks. However, field data to validate and model potential relationships between observed responses and the EMF emissions in situ are sparse. A program of experimental field surveys were conducted off the coast of South Florida, USA to characterize the electromagnetic field (EMF) emissions in the water column from a submarine cable, and to monitor for responses of local aquatic species. The field surveys were conducted at the South Florida Ocean Measurement Facility (SFOMF) off Fort Lauderdale, which is a cabled offshore in-water navy range. It consists of multiple active submarine power cables and a number of junction boxes, with the capability to transmit AC/DC power at a range of strength and frequencies. The site includes significant marine life activities and community structure, including highly mobile species, such as sharks, stingrays, mammals and turtles. SFOMF therefore typifies a setting representative of an offshore location where a MHK device may be sited. Background electromagnetic field (EMF) levels and EMF emissions due to submarine cables were measured using a custom E-field sensor and a commercial magnetometer deployed from an autonomous underwater vehicle (AUV) at various fixed altitudes above the seafloor. EMF signatures detected from power cables and junction boxes are contrasted against ambient background levels and other EMF sources. The potential responses of local marine species were observed at selected representative locations using divers on SCUBA, complemented with fixed cameras on the sea bottom and by a set of video cameras mounted on the AUV. The objectives of the study were: 1) to characterize the EMF emission levels associated with submarine cables 2) to monitor potential responses of aquatic animals to the emissions and 3) to develop an associated database of field observations. As control, observations of EMF levels and in situ marine species were conducted with power in the cable turned off. Good quality measurements of EMF emissions were obtained using the mobile AUV platform and the data from the surveys were used to develop contour maps of the EMF levels in the water column above the live cable as well as to provide information about how the field decays away from the cable. The measurements show good agreement with theoretical models of the how EMF levels decay away from the cable in deep and shallow water environment. Electric fields in excess of 200µV/m were measured in the vicinity of the cable during the power on state. Quarterly surveys by SCUBA divers were conducted, using point and transect count methods, over a period of one year at three locations, one at a shallow site where the water depth is approximately 5m, and the other at the Barracuda Reef where the water depth is approximately 10m. The sampling results were analyzed to determine if the presence of an SFOMF generated EMF alters: (1) abundance, species richness, and assemblage structure of coral reef fishes, (2) the behavior of fishes including elasmobranchs, and (3) the distribution of marine turtles and mammals. Diver observations were also used in attempt to discern if there were any noticeable organismal responses during the transitional period between ambient OFF to energized AC or DC power states, and video footage was intended to augment the in-situ visual survey data and aid in interpretation of the results. Comparisons are provided between observation datasets between the three sites and between the point and transect count methods. Presence of several individual elasmobranch species, including sharks and stingrays, were recorded during the surveys. No apparent effect on richness could be discerned between the power on and off states. No apparent sudden animal movements were observed during transitions between power states.

16 TIDAL AND WAVE POWER↗
DOE OSTI2024

Spike-and-Slab Shrinkage Priors for Structurally Sparse Bayesian Neural Networks

Network complexity and computational efficiency have become increasingly significant aspects of deep learning. Sparse deep learning addresses these challenges by recovering a sparse representation of the underlying target function by reducing heavily overparameterized deep neural networks. Specifically, deep neural architectures compressed via structured sparsity (e.g., node sparsity) provide low-latency inference, higher data throughput, and reduced energy consumption. In this article, we explore two well-established shrinkage techniques, Lasso and Horseshoe, for model compression in Bayesian neural networks (BNNs). To this end, we propose structurally sparse BNNs, which systematically prune excessive nodes with the following: 1) spike-and-slab group Lasso (SS-GL) and 2) SS group Horseshoe (SS-GHS) priors, and develop computationally tractable variational inference, including continuous relaxation of Bernoulli variables. We establish the contraction rates of the variational posterior of our proposed models as a function of the network topology, layerwise node cardinalities, and bounds on the network weights. Furthermore, we empirically demonstrate the competitive performance of our models compared with the baseline models in prediction accuracy, model compression, and inference latency.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Non-intrusive reduced-order modeling for dynamical systems with spatially localized features

This work presents a non-intrusive reduced-order modeling framework for dynamical systems with spatially localized features characterized by slow singular value decay. The proposed approach builds upon two existing methodologies for reduced and full-order non-intrusive modeling, namely Operator Inference (OpInf) and sparse Full-Order Model (sFOM) inference. We decompose the domain into two complementary subdomains that exhibit fast and slow singular value decay. The dynamics of the subdomain exhibiting slow singular value decay are learned with sFOM while the dynamics with intrinsically low dimensionality on the complementary subdomain are learned with OpInf. The resulting, coupled OpInf-sFOM formulation leverages the computational efficiency of OpInf and the high resolution of sFOM, and thus enables fast non-intrusive predictions for conditions beyond those sampled in the training data set. A novel regularization technique with a closed-form solution based on the Gershgorin disk theorem is introduced to promote stable sFOM and OpInf models. We also provide a data-driven indicator for subdomain selection and ensure solution smoothness over the interface via a post-processing interpolation step. We evaluate the efficiency of the approach in terms of offline and online speedup through a quantitative, parametric computational cost analysis. We demonstrate the coupled OpInf-sFOM formulation for two test cases: a one-dimensional Burgers’ model for which accurate predictions beyond the span of the training snapshots are presented, and a two-dimensional parametric model for the Pine Island Glacier ice thickness dynamics, for which the OpInf-sFOM model achieves an average prediction error on the order of 1% with an online speedup factor of approximately 8$\times$ compared to the numerical simulation.

42 ENGINEERING↗
DOE OSTI2023

Characterizing the performance of node-aware strategies for irregular point-to-point communication on heterogeneous architectures

Supercomputer architectures are trending toward higher computational throughput due to the inclusion of heterogeneous compute nodes. These multi-GPU nodes increase on-node computational efficiency, while also increasing the amount of data to be communicated and the number of potential data flow paths. In this work, we characterize the performance of irregular point-to-point communication with MPI on heterogeneous compute environments through performance modeling, demonstrating the limitations of standard communication strategies for both device-aware and staging-through-host communication techniques. Presented models suggest staging communicated data through host processes then using node-aware communication strategies for high inter-node message counts. Notably, the models also predict that node-aware communication utilizing all available CPU cores to communicate inter-node data leads to the most performant strategy when communicating with a high number of nodes. Furthermore, model validation is provided via a case study of irregular point-to-point communication patterns in distributed sparse matrix–vector products. Importantly, we include a discussion on the implications model predictions have on communication strategy design for emerging supercomputer architectures.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

SGD-Net: Efficient Model-Based Deep Learning with Theoretical Guarantees

Deep unfolding networks have recently gained popularity for solving imaging inverse problems. However, the computational and memory complexity of data-consistency layers within traditional deep unfolding networks scales with the number of measurements, limiting their applicability to large-scale imaging inverse problems. We propose SGD-Net as a new methodology for improving the efficiency of deep unfolding through stochastic approximations of the data-consistency layers. Our theoretical analysis shows that SGD-Net can be trained to approximate batch deep unfolding networks to an arbitrary precision. Our simulations on intensity diffraction tomography and sparse-view computed tomography show that SGD-Net can match the performance of the traditional batch network at a fraction of training and testing complexity.Deep unfolding networks have recently gained popularity for solving imaging inverse problems. However, the computational and memory complexity of data-consistency layers within traditional deep unfolding networks scales with the number of measurements, limiting their applicability to large-scale imaging inverse problems. We propose SGD-Net as a new methodology for improving the efficiency of deep unfolding through stochastic approximations of the data-consistency layers. Our theoretical analysis shows that SGD-Net can be trained to approximate batch deep unfolding networks to an arbitrary precision. Our simulations on intensity diffraction tomography and sparse-view computed tomography show that SGD-Net can match the performance of the traditional batch network at a fraction of training and testing complexity.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2017

A New Precision Measurement of the Small-scale Line-of-sight Power Spectrum of the Ly α Forest

We present a new measurement of the Lyα forest power spectrum at 1.8 < z < 3.4 using 74 Keck/HIRES and VLT/UVES high-resolution, high-signal-to-noise-ratio quasar spectra. We developed a custom pipeline to measure the power spectrum and its uncertainty, which fully accounts for finite resolution and noise and corrects for the bias induced by masking missing data, damped Lyα absorption systems, and metal absorption lines. Our measurement results in unprecedented precision on the small-scale modes $k\gt 0.02\,{\rm{s}}\,{\mathrm{km}}^{-1}$, inaccessible to previous SDSS/BOSS analyses. It is well known that these high-k modes are highly sensitive to the thermal state of the intergalactic medium, but contamination by narrow metal lines is a significant concern. We quantify the effect of metals on the small-scale power and find a modest effect on modes with $k\lt 0.1\,{\rm{s}}\,{\mathrm{km}}^{-1}$. As a result, by masking metals and restricting to $k\lt 0.1\,{\rm{s}}\,{\mathrm{km}}^{-1}$, their impact is completely mitigated. We present an end-to-end Bayesian forward-modeling framework whereby mock spectra with the same noise, resolution, and masking as our data are generated from Lyα forest simulations. These mock spectra are used to build a custom emulator, enabling us to interpolate between a sparse grid of models and perform Markov chain Monte Carlo fits. Our results agree well with BOSS on scales $k\lt 0.02\,{\rm{s}}\,{\mathrm{km}}^{-1}$, where the measurements overlap. The combination of the percent-level low-k precision of BOSS with our 5%–15% high-k measurements results in a powerful new data set for precisely constraining the thermal history of the intergalactic medium, cosmological parameters, and the nature of dark matter. Lastly, the power spectra and their covariance matrices are provided as electronic tables.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2020

The Value of Information From Horizontal Distributed Acoustic Sensing Compared to Multicomponent Geophones Via Machine Learning

Abstract Faults play an important role in recharging many geothermal reservoirs, and seismic information can image the locations of these faults. The value of information (VOI) metric is used to objectively quantify and compare the value of two types of seismic receiver data via a machine learning approach. The demonstrated VOI methodology is novel by including spatial models from seismic data and obtaining the information statistics from machine learning. Our two-dimensional numerical experiments compare images created from sparsely spaced (80 m), two-component geophone sampling to high spatial resolution (1 m), single-component DAS. We used a three-fold cross validation of a U-Net convolutional neural networks to achieve average classification statistics. The results suggest that when horizontal sources are utilized, geophones and DAS identify reflectors and non-reflectors at roughly the same rate. The average F1 score for horizontal DAS is 0.939 and 0.931 for geophones. For images created from a vertical source, DAS performed marginally better (F1 = 0.919) than geophones (F1 = 0.877). Our transferrable methodology can provide guidance on which acquisition scenarios can improve images of important structures in the subsurface and present an efficient method for obtaining reliability statistics from high-dimensional, spatial data.

Energy & Fuels↗
DOE OSTI2022

Design of Digital Twin Sensing Strategies Via Predictive Modeling and Interpretable Machine Learning

This work develops a methodology for sensor placement and dynamic sensor scheduling decisions for digital twins. The digital twin data assimilation is posed as a classification problem, and predictive models are used to train optimal classification trees that represent the map from observed data to estimated digital twin states. In addition to providing a rapid digital twin updating capability, the resulting classification trees yield an interpretable mathematical representation that can be queried to inform sensor placement and sensor scheduling decisions. The proposed approach is demonstrated for a structural digital twin of a 12 ft wingspan unmanned aerial vehicle. Offline, training data are generated by simulating scenarios using predictive reduced-order models of the vehicle in a range of structural states. Furthermore, these training data can be further augmented using experimental or other historical data. In operation, the trained classifier is applied to observational data from the physical vehicle, enabling rapid adaptation of the digital twin in response to changes in structural health. Within this context, we study the performance of the optimal tree classifiers and demonstrate how they enable explainable structural assessments from sparse sensor measurements and also inform optimal sensor placement.

47 OTHER INSTRUMENTATION↗
DOE OSTI2026

Anomaly Detection for Online Monitoring of Thermocouple Sensors in the Advanced Test Reactor

This study explores data-driven anomaly detection methods to analyze sensor fail- ures in the Advanced Gas Reactor (AGR) nuclear fuel irradiation experiments. Specifically, we examine failures of thermocouples (TCs), which are critical for mon- itoring and controlling in-reactor temperatures during operation. Failures were pri- marily observed during abrupt power transitions and manifested as sensor drop-outs, drifts, or unexplained behavior. We applied three time-series analysis techniques— rolling mean smoothing, matrix profile, and vector auto-regression (VAR)—to de- tect anomalies in TC data prior to failure events. The rolling mean method effec- tively highlighted deviations aligned with reported failures, while the matrix profile provided partial early warning but sometimes flagged normal fluctuations during power-down periods. VAR shows potential in capturing multivariate dependencies but requires further calibration. A rare case of TC drift was also documented, which did not result in failure, underscoring the challenge of building predictive models with sparse positive examples. Our findings demonstrate that traditional statistical tools can aid anomaly detection but have limited predictive power without richer training data. We propose future directions including synthetic data generation, real- time surrogate modeling, and multi-modal feature integration. This work provides a foundation for applying robust anomaly detection frameworks to mission-critical sensor systems in experimental settings.

11 - NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2024

Accelerated Constrained Sparse Tensor Factorization on Massively Parallel Architectures

This study presents the first constrained sparse tensor factorization (cSTF) framework that optimizes and fully offloads computation to massively parallel GPU architectures, and the first performance characterization of cSTF on GPU architectures. In contrast to prior work on tensor factorization, where the matricized tensor times Khatri-Rao product (MTTKRP) is the primary performance bottleneck, our systematic analysis of the cSTF algorithm on GPUs reveals that adding constraints creates an additional bottleneck in the update operation for many real-world sparse tensors. While executing the update operation on the GPU brings significant speedup over its CPU counterpart, it remains a significant bottleneck. To further accelerate the update operation, we propose cuADMM, a new update algorithm that leverages algorithmic and code optimization strategies to minimize both computation and data movement on GPUs. As a result, our framework delivers significantly improved performance compared to prior state-of-the-art. On 10 real-world sparse tensors, our framework achieves geometric mean speedup of 5.1 × (max 41.59 ×) and 7.01 × (max 58.05 ×) on the NIVIDA A100 and H100 GPUs, respectively, over the state-of-the-art SPLATT library running on a 26-core Intel Ice Lake Xeon CPU.

Soh, Yongseok↗
DOE OSTI2016

SU-G-TeP1-09: Modality-Specific Dose Gradient Modeling for Prostate IMRT Using Spherical Distance Maps of PTV and Isodose Contours

Purpose: Overlapping volume histogram (OVH) and distance-to-target histogram (DTH) calculations rely on the assumption that dose gradients are symmetric with respect to primary target volume (PTV) expansion and minimum distance to PTV surface, respectively. It is desirable to lift this assumption and instead account for achievable modality-specific dose gradients (MSDG) for a given PTV shape. Methods: From a library of 96 prostate 7-beam IMRT plans, we computed spherical distance maps (SDMs) for PTVs and 3 iso-dose contours. Each SDM contains the minimum distances between plan isocenter and the object’s surface for a fixed set of azimuthal and polar angles. We performed principal component analysis (PCA)-based missing data recovery with PTV SDM as input and a single iso-dose contour SDM as output. Repeating this process for the set of iso-dose contours sparsely reconstructed the MSDG for a given PTV. DVH points were computed from the MSDG for bladder and rectum (OARs) as a natural way of casting patient-specific geometric information into modality-specific dose space (vs. OVH and DTH where data is purely geometric). For comparison, we implemented a cumulative (c)DTH-based prediction algorithm, and produced DVH for both OARs separately. We then computed linear regressions between each method and the DVH of the original patient plan for three different OAR DVH points. Results: R-squared for MSD-Gcomputed DVH vs. original plan DVH at V90%, V80% and V60% of max dose were 0.86, 0.83, and 0.78, for bladder and 0.36, 0.52, and 0.55 for rectum, respectively; R-squared for cDTH-based predicted DVH vs. original plan DVH were 0.67, 0.81, and 0.83, for bladder and 0.44, 0.50, and 0.51, for rectum, respectively. Conclusion: By simply modeling the MSDG about a given PTV, we are able to reproduce DVHs consistent with a validated cDTH-based DVH prediction. Regression analysis suggests MSDG could further improve predictions.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2021

Utilizing Earth Observations of Soil Freeze/Thaw Data and Atmospheric Concentrations to Estimate Cold Season Methane Emissions in the Northern High Latitudes

The northern wetland methane emission estimates have large uncertainties. Inversion models are a qualified method to estimate the methane fluxes and emissions in northern latitudes but when atmospheric observations are sparse, the models are only as good as their a priori estimates. Thus, improving a priori estimates is a competent way to reduce uncertainties and enhance emission estimates in the sparsely sampled regions. Here, we use a novel way to integrate remote sensing soil freeze/thaw (F/T) status from SMOS satellite to better capture the seasonality of methane emissions in the northern high latitude. The SMOS F/T data provide daily information of soil freezing state in the northern latitudes, and in this study, the data is used to define the cold season in the high latitudes and, thus, improve our knowledge of the seasonal cycle of biospheric methane fluxes. The SMOS F/T data is implemented to LPX-Bern DYPTOP model estimates and the modified fluxes are used as a biospheric a priori in the inversion model CarbonTracker Europe-CH 4 . The implementation of the SMOS F/T soil state is shown to be beneficial in improving the inversion model’s cold season biospheric flux estimates. Our results show that cold season biospheric CH4 emissions in northern high latitudes are approximately 0.60 Tg lower than previously estimated, which corresponds to 17% reduction in the cold season biospheric emissions. This reduction is partly compensated by increased anthropogenic emissions in the same area (0.23 Tg), and the results also indicates that the anthropogenic emissions could have even larger contribution in cold season than estimated here.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Advanced data analysis in inertial confinement fusion and high energy density physics

Bayesian analysis enables flexible and rigorous definition of statistical model assumptions with well-characterized propagation of uncertainties and resulting inferences for single-shot, repeated, or even cross-platform data. This approach has a strong history of application to a variety of problems in physical sciences ranging from inference of particle mass from multi-source high-energy particle data to analysis of black-hole characteristics from gravitational wave observations. The recent adoption of Bayesian statistics for analysis and design of high-energy density physics (HEDP) and inertial confinement fusion (ICF) experiments has provided invaluable gains in expert understanding and experiment performance. In this Review, we discuss the basic theory and practical application of the Bayesian statistics framework. We highlight a variety of studies from the HEDP and ICF literature, demonstrating the power of this technique. Due to the computational complexity of multi-physics models needed to analyze HEDP and ICF experiments, Bayesian inference is often not computationally tractable. Two sections are devoted to a review of statistical approximations, efficient inference algorithms, and data-driven methods, such as deep-learning and dimensionality reduction, which play a significant role in enabling use of the Bayesian framework. We provide additional discussion of various applications of Bayesian and machine learning methods that appear to be sparse in the HEDP and ICF literature constituting possible next steps for the community. We conclude by highlighting community needs, the resolution of which will improve trust in data-driven methods that have proven critical for accelerating the design and discovery cycle in many application areas.

47 OTHER INSTRUMENTATION↗
DOE OSTI2026

Collaborative Research: Enabling multi-scale studies of magnetic reconnection with interpretable data-driven models

The development of accurate reduced descriptions and improved closures for magnetic reconnection is an important and a long‐standing challenge in plasma physics. The four‐fluid approach, and associated closures, that were investigated have the potential to improve the accuracy of plasma fluid models, capturing physical effects which would otherwise require a kinetic description. If successful, this approach could have an important impact for the modeling of laboratory and space plasmas. The major goals of this project were to develop new machine learning (ML) tools based on sparse and symbolic regression techniques, and to extract interpretable and generalizable reduced models (e.g., in the form of partial differential equations - PDEs) from data generated by first principles plasma simulations. Preserving interpretability of such data‐driven models is key to addressing the long‐standing theoretical and numerical challenges. Prior proof‐of‐principle studies have demonstrated the enormous potential of this approach, by recovering the well‐established hierarchy of plasma equations (from Vlasov to MHD) from data produced by particle‐in‐cell (PIC) simulations. Our goal in this project was to extend and apply these new tools to construct better kinetic closures for magnetic reconnection; to derive better models of particle injection and acceleration by this fundamental plasma process; and to use this understanding to accelerate the development of multi‐scale plasma algorithms. While our immediate focus was on the problem of magnetic reconnection, the tools that were will developed are general and applicable to other areas of plasma physics, and more broadly to many‐body phenomena. We anticipate that the development of these multi‐scale models will have a significant impact across different areas of plasma science, from fusion to space and astrophysical plasmas.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2022

Dynamic signal recovery in distribution grids using compressive lossy measurements

Distribution system state estimation requires reliable aggregation of the measured data. However, the large volume of the measured data imposes a significant stress on the underlying communication infrastructure. With the challenges associated with measurement availability, current distribution systems are typically unobservable. To cope with the unobservability issue, compressive sensing theory allows us to recover system state information from a small number of measurements provided the states of the distribution system exhibit sparsity. In this paper, we evaluate the robustness of an updated Kalman filtered modified compressive sensing (KF-ModCS) technique that dynamically estimates the grid states using a small fraction of measured data. In practice, measurements used for sparsity based state estimation may also be intermittent due to communication network induced losses. Further, to understand the effect of packet losses on KF-ModCS, we provide an upper bound for the expected variances of the state estimation error for a given rate of information loss. This upper bound is further improved if the support set of the sparse signal that characterizes the state dynamics does not change over time and/or the reduced model is observable. Simulations based on two practical data sets collected from actual customers in a distribution grid validate the theoretical results.

24 POWER TRANSMISSION AND DISTRIBUTION↗