Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Sparse Data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 649 records · Page 36

A Remote Sensing Technique to Upscale Methane Emission Flux in a Subtropical Peatland

Abstract Quantification of methane (CH 4 ) gas emission from peat is critical to understand CH 4 budget from natural wetlands under a climate warming scenario. Previous studies have focused on prediction and mapping of CH 4 emission flux using process‐based models, while application of statistical‐empirical models for upscaling spatially sparse in situ measurements is scarce. In this study, we developed an empirical remote sensing upscaling approach to estimate CH 4 emission flux in the Everglades using limited in situ point‐based CH 4 emission flux measurements and Landsat data during 2013–2018. We spatially and temporally linked in situ data with Landsat surface reflectance based on temporally composite data sets and developed an object‐based machine learning framework to model and map CH 4 emission flux. An ensemble analysis of two machine learning models, k ‐Nearest Neighbor ( k ‐NN) and Support Vector Machine (SVM), shows that the upscaling approach is promising for predicting CH 4 emission flux with a R 2 of 0.65 and 0.87 based on a fivefold cross‐validation for a dry season and wet season estimation, respectively. We generated emission flux map products that successfully revealed the spatial and temporal heterogeneity of CH 4 emission within the dominant freshwater marsh ecosystem in the Everglades. We conclude that Landsat is promising for upscaling and monitoring CH 4 emission flux and reducing the uncertainty in emission estimates from wetlands.

Zhang, Caiyun↗

LCA-PyTorch

LCA-PyTorch is a code repository which contains PyTorch implementations of the Locally Competitive Algorithm (LCA), which is a biologically-plausible sparse coding model. LCA-PyTorch allows for the training, testing, and analysis of single layer LCA networks, multi-layer LCA networks, and hybrid LCA-based deep neural network models on a wide variety of applications and data types. LCA-PyTorch was developed in Python, a high-level programming language that takes advantage of the Python ecosystem of high-quality open-source packages for machine learning. LCA-PyTorch interfaces heavily with the open-source PyTorch Python package.

Teti, Michael↗

Machine Learning for DUNE Supernova Trigger

One of the major scientific goals of the Deep Underground Neutrino Experiment (DUNE) is to detect and measure the neutrino flux originating from galactic core-collapse supernovae. These neutrinos provide an opportunity to study the end of life evolution of massive stars, and reveal information about the structure of core-collapse that is not visible in observations of the electromagnetic spectrum. Because of the rarity of these events, it is crucial that DUNE is able to detect supernova neutrino interactions when they occur. However, this will require sifting through a large quantity of data, motivating the development of a trigger algorithm to identify significant events and discard irrelevant data. Machine learning provides a potential approach to building this trigger. This project generates ADC and ground truth images of simulated neutrino interactions in a LArTPC detector to be used for machine learning, and uses them to train a sparse Convolutional Neural Network (C NN). The performance of this model when applied to the task of pixel classification based on interaction type is examined. This project found that the sparse CNN approach has the potential to have high accuracy in pixel classification, meaning it may be highly relevant to the development of a supernova neutrino trigger for the DUNE far detector.

Damish, S.↗

Nonconvex regularization for sparse neural networks

Convex ℓ 1 regularization using an infinite dictionary of neurons has been suggested for constructing neural networks with desired approximation guarantees, but can be affected by an arbitrary amount of over-parametrization. This can lead to a loss of sparsity and result in networks with too many active neurons for the given data, in particular if the number of data samples is large. As a remedy, in this paper, a nonconvex regularization method is investigated in the context of shallow ReLU networks: We prove that in contrast to the convex approach, any resulting (locally optimal) network is finite even in the presence of infinite data (i.e., if the data distribution is known and the limiting case of infinite samples is considered). Moreover, here we show that approximation guarantees and existing bounds on the network size for finite data are maintained.

97 MATHEMATICS AND COMPUTING↗

Bit-GraphBLAS: Bit-Level Optimizations of Matrix-Centric Graph Processing on GPU

In the graph data structure like adjacency matrix, the connectivity of two nodes can be sufficiently represented using only 1 bit, but they are generally treated as 32-bit full-precision in state-of-the-art graph frameworks to adopt common sparse format such as CSR. Meanwhile, bit-level parallelism has recently be explored to have high-performance potential and low storage requirement on GPUs with dense bit-tiles. To fill the gap, our solution is a hierarchical storage format that contains the bit-indexing base and dense bit-tile units. Inherently, the granularity of the bit-tile is an essential factor in achieving both storage compression and GPU parallelism. How to find a sweet spot that trades off between avoiding sparsity and exploiting is comprehensively researched in this work. In the experiment, we evaluate the proposed storage format and algorithms on modern generation GPUs, including Pascal and Volta, to figure out critical software co-designs in conjunction with existing hardware-specific optimization.

Chen, Jou-An↗

New approaches to an old problem: addressing spatial gaps in the World Stress Map

Abstract A well-recognized characteristic of the World Stress Map (WSM) database is the continued presence of large spatial gaps in the distribution of the data records despite the more than 40-year development history of the database. The current release has more than 30 000 high-quality (A–C) data records (often referred to as ‘stress indicators’), but while some continental areas (such as Australia) have seen a significant increase in spatial converge with the latest release, other continental regions (Africa, central Asia, most of South America) remain markedly sparse. In this contribution we (1) review the current state of the spatial distribution of stress indicators in the continental regions (above sea-level); (2) quantify the clustering of the stress indicators in the latest WSM release using the Hopkins statistic as a way to explore the current spatial distribution of the indicators and assess future WSM releases; and (3) present three approaches (joint inversion, seismic anisotropy and InSAR) that provide a way to fill in the gaps (both in the S Hmax orientation and principal stress magnitudes) in regions that lack active seismicity and where borehole drilling is cost prohibitive. These three approaches have the potential to guide procedures for improving a priori estimates of the ambient stress field in the Earth's crust and reduce the uncertainty in predicting both the magnitude and orientation of the principal tectonic stresses.

58 GEOSCIENCES↗

Weak-Form Latent Space Dynamics Identification

This software showcases the enhanced capabilities of the Latent Space Dynamics Identification (LaSDI) algorithm through the application of the weak form, resulting in WLaSDI. WLaSDI first compresses the data, then projects it onto test functions, and subsequently learns the local latent space models. Notably, WLaSDI demonstrates significantly improved robustness to noise. Using weak-form equation learning techniques, WLaSDI achieves local latent space modeling. Compared to the standard sparse identification of nonlinear dynamics (SINDy) used in LaSDI, the variance reduction of the weak form ensures robust and precise latent space recovery, enabling fast, robust, and accurate simulations. We demonstrate the efficacy of WLaSDI against LaSDI using several common benchmark examples, including viscid and inviscid Burgers', radial advection, and heat conduction. For instance, in 1D inviscid Burgers' simulations with up to 100% Gaussian white noise, WLaSDI maintains relative errors consistently below 6%, whereas LaSDI errors can exceed 10,000%. Similarly, in radial advection simulations, WLaSDI keeps relative errors below 16%, compared to potential errors of up to 10,000% with LaSDI. Additionally, WLaSDI achieves significant speedups, such as a 140X speedup in 1D Burgers' simulations compared to the corresponding full order model.

Choi, Youngsoo↗

City-Wide Distributed Roof-Top Photovoltaic System Adoption Forecast, Grid Impact Simulation, & Neighborhood Microgrid Contribution Assessment

The adoption of distributed photovoltaic (PV) systems grew significantly in recent years. Market projections anticipate future growth for both residential and commercial installations. To understand grid impacts associated with distributed PV, useful hosting capacity studies require accurate representations of the spatial distribution of PV adoptions. Prediction of PV locations and numbers depends on median income data, building use zoning maps, and permit records to understand existing trends and predict future adoption rates and locations throughout an entire city. Using the PV adoption data, advanced and realistic simulations were performed to capture the distributed PV impacts on the grid. Also, using graph theory community detection hundreds of neighborhood microgrids can be discovered for the entire city by identifying densely connected loads that are sparsely connected to other communities. Then, based on the PV adoption predictions, this work identified the contribution of PV within each of the newly discovered graph theory defined microgrid communities.

24 POWER TRANSMISSION AND DISTRIBUTION↗

High-resolution modeling of indoor radon exposure with uncertainty quantification in Utah

Indoor radon accounts for 37% of population-level exposure to ionizing radiation in the United States. However, radon metrics are typically reported at coarse spatial scales, potentially obscuring meaningful local variation. We developed a high-resolution modeling framework to estimate indoor radon concentrations across Utah while explicitly quantifying predictive uncertainty. A total of 19,497 residential radon measurements collected between 2006 and 2017 were combined with environmental and housing characteristics and analyzed using a geospatial neural network that accommodates spatial dependence and nonlinear associations. Predictions were generated on a uniform hexagonal grid at 0.73 km2 resolution (H3 level 8). Out-of-sample predictions aggregated to the H3 level 8 grid showed good agreement with observed concentrations (Pearson r=0.64), while household-level predictions exhibited more moderate agreement (r=0.45). The model produced well-calibrated uncertainty estimates, with 24.1% of held-out observations exceeding the predicted 75th-percentile threshold. Maps of predicted radon concentrations and the probability of exceeding the U.S. EPA action level of 148 Bq/m3 (4 pCi/L) revealed substantial fine-scale spatial heterogeneity that was not apparent in conventional coarse-resolution summaries, with greater local variability observed in densely monitored urban counties than in sparsely sampled regions. High-resolution radon models that explicitly quantify uncertainty provide a useful framework for characterizing the spatial distribution of indoor radon and identifying areas of elevated exceedance risk. These findings highlight the value of fine-scale monitoring data and uncertainty-aware modeling approaches for radon exposure assessment, environmental risk characterization, and radon-related health research.

Wu, Yunhan [ORNL] (ORCID:0000000178842994)↗

Interferometric SAR modelling of near surface data to improve geological model in the Surat Basin, Australia

Here we present a study on geophysical inverse modelling for subsurface structural properties of an unconventional hydrocarbon site that was monitored previously by Interferometric Synthetic Aperture Radar (InSAR) technology for surface deformation. A static three-dimensional geomodel along with extracted property maps replicates the depth of each underlying stratigraphic unit and structural feature with the density of each geological layer. We examine the hypothesis that integration of elastic properties of each formation layer with InSAR observations in a stratified elastic medium will lead to a viscoelastic geophysical inverse problem that can be solved to estimate fractional volume change at the reservoir level. Moreover, we examine synthetic scenarios in which the elastic properties of the formations are perturbed before determining the resulting impact on the rate of surface deformation. The results show that although the slope of underlying formations, their density and depth can define the extent and pattern of a deformation signal, their properties have a marginal impact on volumetric change compared to the dense network of shallow depth Coal Seam Gas (CSG) mining wells. Besides, it is also demonstrated that the inversion of InSAR deformation maps can resolve the uncertainties associated with low-resolution seismic interpretation as well as filling the data gaps within seismic acquisitions. A significant contribution of this investigation to the geological basin modelling involves a) introducing a remote and non-invasive technology such as InSAR to improve geophysical mapping of subsurface structures such as faults in areas with sparse or no reflective seismic information, and b) applying a multi-layer viscoelastic geophysical source model for an unconventional hydrocarbon reservoir such as CSG.

58 GEOSCIENCES↗

Trigonometric Parallaxes of Two T Dwarfs With Keck and ShaneAO Astrometry

We present trigonometric parallax and proper motion measurements for two T-type brown dwarfs. We derive our measurements from infrared laser guide star adaptive optics observations spanning five years from the ShaneAO/SHARCS and NIRC2/medium-cam instruments on the Shane and Keck telescopes, respectively. To improve our astrometric precision, we measure and apply a distortion correction to our fields for both instruments. We also transform the Keck and ShaneAO astrometric reference frames onto the ICRS using five-parameter parallax and proper motion solutions for background reference stars from Gaia DR2. Fitting for parallax and proper motion, we measure parallaxes of 73.5 ± 9.2 mas and 70.1 ± 6.7 mas for WISEJ19010703+47181688 (WISE1901) and WISEJ21543294+59421370 (WISE2154), respectively. We utilize Monte Carlo methods to estimate the error in our sparse field methods, taking into account overfitting and differential atmospheric refraction. Comparing to previous measurements in the literature, all of our parallax and proper motion values fall within 2σ of the published measurements, and 4 of 6 measurements are within 1σ. These data are among the first parallax measurements of these T dwarfs and serve as precise measurements for calibrating stellar formation models. These two objects are the first results of an ongoing survey of T dwarfs with Keck/NIRC2 and the Shane Adaptive Optics system at Lick Observatory.

79 ASTRONOMY AND ASTROPHYSICS↗

Projected Multi-Agent Consensus Equilibrium (PMACE) With Application to Ptychography

Multi-Agent Consensus Equilibrium (MACE) formulates an inverse imaging problem as a balance among multiple update agents such as data-fitting terms and denoisers. However, each such agent operates on a separate copy of the full image, leading to redundant memory use and slow convergence when each agent affects only a small subset of the full image. In this article, we extend MACE to Projected Multi-Agent Consensus Equilibrium (PMACE), in which each agent updates only a projected component of the full image, thus greatly reducing memory use for some applications. We describe PMACE in terms of an equilibrium problem and an equivalent fixed-point problem and show that in most cases the PMACE equilibrium is not the solution of an optimization problem. To demonstrate the value of PMACE, we apply it to the problem of ptychography, in which a sample is reconstructed from the diffraction patterns resulting from coherent X-ray illumination at multiple overlapping spots. In our PMACE formulation, each spot corresponds to a separate data-fitting agent, with the final solution found as an equilibrium among all the agents. In conclusion, our results demonstrate that the PMACE reconstruction algorithm generates more accurate reconstructions at a lower computational cost than existing ptychography algorithms when the spots are sparsely sampled.

97 MATHEMATICS AND COMPUTING↗

Physics-informed graphical neural network for power system state estimation

State estimation is highly critical for accurately observing the dynamic behavior of the power grids and minimizing risks from cyber threats. However, existing state estimation methods encounter challenges in accurately capturing power system dynamics, primarily because of limitations in encoding the grid topology and sparse measurements. Here, this paper proposes a physics-informed graphical learning state estimation method to address these limitations by leveraging both domain physical knowledge and a graph neural network (GNN). We employ a GNN architecture that can handle the graph-structured data of power systems more effectively than traditional data-driven methods. The physics-based knowledge is constructed from the branch current formulation, making the approach adaptable to both transmission and distribution systems. The validation results of three IEEE test systems show that the proposed method can achieve lower mean square error more than 20% than the conventional methods.

43 PARTICLE ACCELERATORS↗

Reproduction drives changes in space use and habitat selection in a highly adaptable invasive mammal

Abstract For ungulates, it is not well understood how the interaction between habitat and reproduction affects movement behavior, space use, and habitat selection. We used known parturition (farrowing) data to validate First Passage Time (FPT) movement analysis to identify wild pig (Sus scrofa) parturition events from data collected with GPS collars. We examined home range and habitat selection during three physiologically distinct time periods in the reproductive cycle: late-gestation; farrowing; and neonate-care period. Sows exhibited a behavioral change 1-2 days prior to farrowing, suggesting FPT analysis can reliably identify parturition events for wide-ranging species that have a focused birthing area. Home range was smallest during the farrowing period, likely reflective of nest building, parturition, and protection of neonates. Home range size during the neonate-care period was intermediate between the late-gestation and farrowing periods, indicative of offspring care that may restrict maternal movement. Across all periods, sows avoided developed areas that have sparse canopy and ground cover and are associated with human activities. During late-gestation, sows avoided pine forests that have an open understory and less vegetative cover. During late-gestation and neonate-care, sows selected bottomland hardwood forests, habitat associated with ample food, cover, and water. During farrowing and neonate-care periods, sows selected upland hardwood forests, habitat with high quality food and cover for neonates. The physiological requirements of reproduction drive female habitat selection and spatial scale of movement patterns associated with parturition. Our study contributes to delineation of the appropriate scale at which to analyze movement data to provide insight about where individuals chose to place their home range, how much space to use, and how they use resources on the landscape to maximize reproductive success and fitness.

Zoology↗

ChatMPI: LLM-Driven MPI Code Generation for HPC Workloads

The Message Passing Interface (MPI) standard plays a crucial role in enabling scientific applications for parallel computing and is an essential component in high-performance computing (HPC). However, implementing MPI code manually—especially applying a proper domain decomposition and communication pattern—is a challenging and error-prone task. We present ChatMPI, an AI assistant for MPI parallelization of sequential C codes. In our analysis, we focus on testing six essential HPC workloads, which are based on Basic Linear Algebra Subprograms levels 1, 2, and 3 as well as sparse, stencil, and iterative operations. We analyze the process of creating ChatMPI by using the ChatHPC library. This lightweight large language model (LLM)–based infrastructure enables HPC experts to efficiently create and supervise trustworthy AI capabilities for critical HPC software tasks. We study the data required for training (fine-tuning) ChatMPI to generate parallel codes that not only use MPI syntax correctly but also apply HPC techniques to reduce memory communication and maximize performance by using proper work decomposition. With a relatively small training dataset composed of a few dozen prompts and fewer than 15 minutes of fine-tuning on one node equipped with two NVIDIA H100 GPUs, ChatMPI elevates trustworthiness for MPI code generation of current LLMs (e.g., Code Llama, ChatGPT-4o and ChatGPT 5). Additionally, we evaluate the performance of the MPI codes generated by ChatMPI in comparison with the ones generated by ChatGPT-4o and ChatGPT-5. The codes generated by ChatMPI provide up to a 4 × boost in performance by using better problem decomposition, communication patterns, and HPC techniques (e.g., communication avoiding).

Valero Lara, Pedro [ORNL] (ORCID:0000000214794310)↗

Role of physics in physics-informed machine learning

Physical systems are characterized by inherent symmetries, one of which is encapsulated in the units of their parameters and system states. These symmetries enable a lossless order-reduction, e.g., via dimensional analysis based on the Buckingham theorem. Despite the latter's benefits, machine learning (ML) strategies for the discovery of constitutive laws seldom subject experimental and/or numerical data to dimensional analysis. We demonstrate the potential of dimensional analysis to significantly enhance the interpretability and generalizability of ML-discovered secondary laws. Our numerical experiments with creeping fluid flow past solid ellipsoids show how dimensional analysis enable both deep neural networks and sparse regression reproduce old results, e.g., Stokes law for a sphere, and generate new ones, e.g., an expression for an ellipsoid misaligned with the flow direction. Furthermore, our results suggest the need to incorporate other physics-based symmetries and invariances into ML-based techniques for equation discovery.

97 MATHEMATICS AND COMPUTING↗

Geothermal Play-Fairway Analysis of Washington State Prospects: Final Report

The Washington State Geothermal Play-Fairway Analysis overcomes the exploration challenges posed by dense vegetation, glacial deposits, and extreme precipitation. The geothermal play-fairways we target are locations where heat, permeability, and saturated porosity are present in sufficient volume to provide adequate heat exchange at depths accessible by modern drilling technology. The three study areas lie along the Cascade Range magmatic arc and are near Mount Baker, Mount St. Helens, and the Wind River Valley. The seven-year project is divided into three phases. In Phase 1 we build on a previous statewide assessment of geothermal resources and develop an initial modeling approach. The results are a series of favorability, uncertainty, and risk maps for three targeted study areas. Based on these initial results, we collect new geologic and geophysical data to further refine our modeling and reduce exploration uncertainty in Phase 2. We improve the modeling method to handle the new data and update the favorability, uncertainty, and risk maps. We also update the conceptual geothermal resource models. In Phase 3 we validate our modeling approach by drilling two temperature-gradient holes and collecting and analyzing core, image logs, and new geochemistry. Our modeling approach improves on an earlier statewide method through a more-rigorous and detailed assessment of heat and permeability. Permeability potential is assessed through geomechanical modeling of the deformation that can generate and maintain reservoir porosity and permeability. Metrics to inform heat potential include temperature-gradient wells, which are sparse in Washington; proximity of Quaternary volcanic vents and young intrusive rock; spring temperature; and reservoir temperature inferred from geothermometry. We weight the individual components using an expert-guided approach known as the Analytical Hierarchy Process. During Phase 2 we also develop a fluid-filled fracture model, and an infrastructure model that helps to delineate areas which are more favorable for geothermal development based on proximity to transmission lines, elevation, land ownership and use restrictions, and availability of process water. New geologic and geophysical data is collected during Phase 2 in each of our three main study areas. At Mount Baker and north of Mount St. Helens we conduct 1:24,000-scale geologic mapping and lidar analysis to better constrain the location and character of surface faults; detailed mapping in the Wind River Valley was completed just prior to the start of this project. Ages of intrusive rocks are determined with 40 Ar/ 39 Ar geochronology, though all of our samples are Miocene or older. We collect ground based gravity observations (a total of 1,580 new stations) in all of our study areas and ground-based magnetic lines (a total of 93 km) at Mount Baker. These data are combined with existing gravity and aeromagnetic data and used to constrain fault locations and geometry. Two to three cross sections are constructed at each study area using the mapped surface geology and forward-modeling of the gravity and magnetic data; these cross sections form the basis for our updated conceptual models. We collect magnetotelluric surveys at Mount Baker and Mount St. Helens and these data are inverted to form a resistivity model from the surface to about 10 km depth; each model shows conductive zones that can be interpreted as upwelling geothermal fluids. At Mount St. Helens we deploy a passive seismic array and use the newly detected events to refine the location of the Saint Helens seismic zone. We also employ ambient-noise tomography to develop a detailed seismic-velocity model for the study area and use this model to help constrain our cross sections and conceptual model. Based on the new data collected during Phase 2—and our updated models—we develop a campaign of temperature-gradient holes and core analysis to validate our modeling in Phase 3. Drill hole MB76-31 is located near Little Park Creek, 11 km west-southwest of the summit of Mount Baker, and is 1,471 ft deep. About 410 ft of core from the lower portion of the hole—and image logs from ~175 ft below ground surface to the bottom—are collected and analyzed. Water samples are collected and processed for geothermometry. Drill hole MSH17-24 is located along upper Schultz Creek, 16 km north-northeast of Mount St. Helens and has core from 470 ft to the bottom at 1,053 ft. We did not collect image logs due to borehole stability concerns, but water samples are collected and analyzed for geothermometry. Repeat temperature-gradient measurements are made at both sites and thermal conductivity is measured from core samples. At MB76-31, the equilibrated temperature gradient of 64°C/km and calculated heat flow of 141–159 mW/m 2 is more than twice the regional average. Detailed mapping and analysis of the core, coupled with correlation to the image logs, indicates a history of permeability generation consistent with our predictions of high permeability. Because the site has high favorability in the Phase 2 model, we consider the results a positive validation of the modeling. At site MSH17-24, the equilibrated temperature gradient of ~15°C/km and calculated heat flow of 41–43 mW/m 2 are similar to regional. Geochemical analysis of the water samples indicates a meteoric source without any geothermal component. Detailed outcrop-based mapping of fault exposures near the drill site and analysis of image logs from nearby boreholes indicates a history of permeability generation consistent with our predictions. Because the site has low favorability in the Phase 2 model, we consider the results a positive validation of the modeling. Together, the two sites provide a reasonably positive validation of the Phase 2 modeling and should encourage future use of this modeling approach.

15 GEOTHERMAL ENERGY↗

Deep learning of free boundary and Stefan problems

Free boundary problems appear naturally in numerous areas of mathematics, science and engineering. These problems present a great computational challenge because they necessitate numerical methods that can yield an accurate approximation of free boundaries and complex dynamic interfaces. In this work, we propose a multi-network model based on physics-informed neural networks to tackle a general class of forward and inverse free boundary problems called Stefan problems. Specifically, we approximate the unknown solution as well as any moving boundaries by two deep neural networks. Besides, we formulate a new type of inverse Stefan problems that aim to reconstruct the solution and free boundaries directly from sparse and noisy measurements. We demonstrate the effectiveness of our approach in a series of benchmarks spanning different types of Stefan problems, and illustrate how the proposed framework can accurately recover solutions of partial differential equations with moving boundaries and dynamic interfaces. All code and data accompanying this manuscript are publicly available at https://github.com/PredictiveIntelligenceLab/DeepStefan.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗