Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Sparse Data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 793 records · Page 44
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Modeling atmospheric data and identifying dynamics Temporal data-driven modeling of air pollutants

Atmospheric modelling has recently experienced a surge with the advent of deep learning. Most of these models, however, predict concentrations of pollutants following a data-driven approach in which the physical laws that govern their behaviors and relationships remain hidden. Furthermore, with the aid of real-world air quality data collected hourly in different stations throughout Madrid, we present a case study using a series of data-driven techniques with the following goals: (1) Find systems of ordinary differential equations that model the concentration of pollutants and their changes over time; (2) assess the performance and limitations of our model using stability analysis; (3) reconstruct the time series of chemical pollutants not measured in certain stations using delay coordinate embedding results.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

High-resolution national mapping of natural gas composition substantially updates methane leakage impacts

Methane is emitted from oil and gas operations alongside heavier hydrocarbons and non-hydrocarbon gases, shaping emissions management decision-making, including air quality impacts. Yet, most assessments assume fixed gas composition, overlooking significant spatial and temporal variations. Here, we generate a high-resolution, data-driven map of natural gas composition across the United States, reconstructing methane, heavier hydrocarbons, and non-hydrocarbon species using spatio-temporal interpolation and oil-and-gas production patterns. Our approach is able to reduce composition prediction errors by 39% in terms of Mean Absolute Error (MAE) compared to standard techniques and reveals that methane loss rates have been underestimated by more than 50% in some regions. Beyond methane, we uncover substantial variability in co-emitted gases, exposing blind spots in current emissions inventories and emissions management frameworks. Our work enables more accurate emissions assessments, guides targeted measurement strategies, and informs emissions management decision-making. It also provides a general framework for prediction in environmental applications that integrate sparse measurements with auxiliary variables.

03 NATURAL GAS↗
DOE OSTI2026

AmeriFlux FLUXNET-1F US-TLR Timberlake Observatory for Wetland Restoration (TOWeR)

This is the AmeriFlux Management Project (AMP) created FLUXNET-1F version of the carbon flux data for the site US-TLR Timberlake Observatory for Wetland Restoration (TOWeR). This is the FLUXNET version of the carbon flux data for the site US-TLR Timberlake Observatory for Wetland Restoration (TOWeR) produced by applying the standard ONEFlux (1F) software. Site Description - This tower is located in Timberlake Forest, a restored forested wetland located 4 km from Albermarle Sound on the North Carolina coast. The forest to the south of the tower had historically been ditched, drained and converted to agricultural land, and subsequently reforested with Black Gum and Cypress trees and naturally re-wetted in 2006. This southern region has a bottomland forest ecosystem which saw a large-scale succession event of pine trees following the reforestation efforts. The northern part of the forest had been ditched, but never drained or converted for other land uses. It is much wetter and more sparsely vegetated when compared to the southern region, and has a mixed bottomland forest and swamp ecosystem.

Rey-Sanchez, Camilo [North Carolina State Universi↗
DOE OSTI2026

AmeriFlux FLUXNET-1F CA-SF3 Saskatchewan - Western Boreal, forest burned in 1998

This is the AmeriFlux Management Project (AMP) created FLUXNET-1F version of the carbon flux data for the site CA-SF3 Saskatchewan - Western Boreal, forest burned in 1998. This is the FLUXNET version of the carbon flux data for the site CA-SF3 Saskatchewan - Western Boreal, forest burned in 1998 produced by applying the standard ONEFlux (1F) software. Site Description - The 1998 burn site (F98) was in the east part of Prince Albert National Park, Saskatchewan, in the Waskesiu Fire, ignited by lightning that burned about 1700 ha in July 1998. The pre-fire forest consisted of jack pine and black spruce stands, with some intermixed aspen. The fire was severe, consuming much of the top layer of organic soil and killing all trees. In 2001, much of the regenerating vegetation consisted of aspen saplings about 1 m tall and shorter jack pine and black spruce seedlings. An overstory of dead, leafless jack pine trees dominated at a height of 18 m. Sparse grass and herbs, such as fireweed (Epilobium angustifolium L.) covered the ground. There were a large number of fallen dead trees, mostly perched above the ground and not decomposing quickly.

Amiro, Brian [University of Manitoba; Canadian For↗
DOE OSTI2022

To Fail or not to Fail: An Exploration of Machine Learning Techniques for Predictive Maintenance

Predictive maintenance refers to the ability to predict when machinery or systems need to be maintained. Making an accurate prediction is quite challenging given the costs for both over-estimating (unnecessary maintenance and reduction in availability of assets) and under-estimating (untimely breakdowns and possible loss of equipment or lives). To address these challenges researchers were able to develop new approaches for analyzing oil samples taken extracting samples from oil-wetted machinery that may provide information critical to developing predictive capabilities. We consider the problem from both supervised (though data limited) and unsupervised approaches and provide a first look into a data driven approach for identification of condition indicators. Through this work we identify a collection of candidate features that can form the basis of condition indicators for both a high level discrimination of failure vs. normal operation as well as a set for potential failure mode identification. Finally, we present an anomaly detection framework for detecting failures which can be a viable solution for an onboard analysis tool in deployed systems.

predictive maintenance, anomaly detection, Laserne↗
DOE OSTI2020

Methodology for the development of empirical models relating 13C NMR spectral features to fuel properties

Effective formulation of new gasoline or diesel fuels for internal combustion engines would benefit from the development of reliable models for predicting key fuel properties based on a set of molecular descriptors obtained from a single measurement. This is particularly relevant in the case of renewable fuels, where the available fuel sample quantity may be limited. In this work, we present a statistically-based methodology for building empirical models to predict multiple properties from one-dimensional 13C nuclear magnetic resonance (NMR) spectra measured on around 200 microliters of a liquid fuel. NMR spectra contain information about the molecular composition of a sample and the carbon types and molecular substructures therein. Our approach uses this information to build sparse, interpretable models, where the predicted properties are linked to specific molecular features. The approach takes into consideration the constrained nature of the features making up the one-dimensional NMR spectrum, which, after standardization, represent a relative fuel composition. We point to the limitations in interpretability that arise when building this type of empirical predictive model and suggest how these limitations may be diminished. Among the many properties important for maximizing engine performance and minimizing emissions, we build models that predict derived cetane number and distillation temperatures as these are of particular interest because of their links to fuel economy, drivability, and engine-out emissions. Results suggest that the properties of interest may be impacted by only a few of the 27 13C NMR regions represented in the data, pointing to new directions for further testing in the development of improved fuels.

predictive models, biofuels., NMR Analysis↗
DOE OSTI2020

Shed Light in the DaRk LineagES of the Fungal Tree of Life—STRES

The polyphyletic group of black fungi within the Ascomycota (Arthoniomycetes, Dothideomycetes, and Eurotiomycetes) is ubiquitous in natural and anthropogenic habitats. Partly because of their dark, melanin-based pigmentation, black fungi are resistant to stresses including UV- and ionizing-radiation, heat and desiccation, toxic metals, and organic pollutants. Consequently, they are amongst the most stunning extremophiles and poly-extreme-tolerant organisms on Earth. Even though ca. 60 black fungal genomes have been sequenced to date, [mostly in the family Herpotrichiellaceae (Eurotiomycetes)], the class Dothideomycetes that hosts the largest majority of extremophiles has only been sparsely sampled. By sequencing up to 92 species that will become reference genomes, the “Shed light in The daRk lineagES of the fungal tree of life” (STRES) project will cover a broad collection of black fungal diversity spread throughout the Fungal Tree of Life. Interestingly, the STRES project will focus on mostly unsampled genera that display different ecologies and life-styles (e.g., ant- and lichen-associated fungi, rock-inhabiting fungi, etc.). With a resequencing strategy of 10- to 15-fold depth coverage of up to ~550 strains, numerous new reference genomes will be established. To identify metabolites and functional processes, these new genomic resources will be enriched with metabolomics analyses coupled with transcriptomics experiments on selected species under various stress conditions (salinity, dryness, UV radiation, oligotrophy). The data acquired will serve as a reference and foundation for establishing an encyclopedic database for fungal metagenomics as well as the biology, evolution, and ecology of the fungi in extreme environments.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

Deployment of ADTimePix3 areaDetector Driver at Neutron and X-ray User Facilities

TimePix3 is a 65k hybrid pixel readout chip with simultaneous Time-of-Arrival (ToA) and Time-over-Threshold (ToT) recording in each pixel*. The chip operates without a trigger signal with a sparse readout where only pixels containing events are read out. The flexible architecture allows 40 MHits/s/cm² readout throughput, using simultaneous readout and acquisition by sharing readout logic with transport logic of superpixel matrix formed using 2x4 structure. The chip ToA records 1.5625 ns time resolution. The X-ray and charged particle events are counted directly. However, indirect neutron counts use 6Li fission in a scintillator matrix, such as ZnS(Ag). The fission space-charge region is limited to 5-9 um. A photon from scintillator material excites a photocathode electron, which is further multiplied in dual-stack MCP. The neutron count event is a cluster of electron events at the chip. We report on the EPICS areaDetector** ADTimePix3 driver that controls Serval*** using json commands. The driver directs data to storage and to a real-time processing pipeline and configures the chip. The time-stamped data are stored in raw .tpx3 file format and passed through a socket where the clustering software identifies individual neutron events. The conventional 2D images are available as images for each exposure frame, and a preview is useful for sample alignment. The areaDetector driver allows integration of time-enhanced capabilities of this detector into SNS beamlines controls and unprecedented time resolution.

Gofron, Kaz↗
DOE OSTI2024

Scaling neural simulations in STACS

Abstract As modern neuroscience tools acquire more details about the brain, the need to move towards biological-scale neural simulations continues to grow. However, effective simulations at scale remain a challenge. Beyond just the tooling required to enable parallel execution, there is also the unique structure of the synaptic interconnectivity, which is globally sparse but has relatively high connection density and non-local interactions per neuron. There are also various practicalities to consider in high performance computing applications, such as the need for serializing neural networks to support potentially long-running simulations that require checkpoint-restart. Although acceleration on neuromorphic hardware is also a possibility, development in this space can be difficult as hardware support tends to vary between platforms and software support for larger scale models also tends to be limited. In this paper, we focus our attention on Simulation Tool for Asynchronous Cortical Streams (STACS), a spiking neural network simulator that leverages the Charm++ parallel programming framework, with the goal of supporting biological-scale simulations as well as interoperability between platforms. Central to these goals is the implementation of scalable data structures suitable for efficiently distributing a network across parallel partitions. Here, we discuss a straightforward extension of a parallel data format with a history of use in graph partitioners, which also serves as a portable intermediate representation for different neuromorphic backends. We perform scaling studies on the Summit supercomputer, examining the capabilities of STACS in terms of network build and storage, partitioning, and execution. We highlight how a suitably partitioned, spatially dependent synaptic structure introduces a communication workload well-suited to the multicast communication supported by Charm++. We evaluate the strong and weak scaling behavior for networks on the order of millions of neurons and billions of synapses, and show that STACS achieves competitive levels of parallel efficiency.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Pisces VII: discovery of a possible satellite of Messier 33 in the DESI legacy imaging surveys

ABSTRACT We report deep imaging observations with DOLoRes@TNG of an ultra-faint dwarf satellite candidate of the Triangulum galaxy (M33) found by visual inspection of the public imaging data release of the DESI Legacy Imaging Surveys. Pisces VII/Triangulum (Tri) III is found at a projected distance of $72\, {\rm kpc}$ from M33, and using the tip of the red giant branch method, we estimate a distance of $D=1.0^{+0.3}_{-0.2}\, {\rm Mpc}$, meaning the galaxy could either be an isolated ultra-faint or the second known satellite of M33. We estimate an absolute magnitude of MV = −6.1 ± 0.2 if Pisces VII/Tri II is at the distance of M33, or as bright as MV = −6.8 ± 0.2 if the galaxy is isolated. At the isolated distance, it has a physical half-light radius of $r_{\rm h}=131\pm 61\, {\rm pc}$ consistent with similarly faint galaxies around the Milky Way. As the tip of the red giant branch is sparsely populated, constraining a precision distance is not possible, but if Pisces VII/Tri III can be confirmed as a true satellite of M33, it is a significant finding. With only one potential satellite detected around M33 previously (Andromeda XXII/Tri I), it lacks a significant satellite population in stark contrast to the similarly massive Large Magellanic Cloud. The detection of more satellites in the outskirts of M33 could help to better illuminate if this discrepancy between expectation and observations is due to a poor understanding of the galaxy formation process, or if it is due to the low luminosity and surface brightness of the M33 satellite population which has thus far fallen below the detection limits of previous surveys. If it is truly isolated, it would be the faintest known field dwarf detected to date.

Martínez-Delgado, David↗
DOE OSTI2025

Overcoming sparse datasets with multi-task learning as applied to high entropy alloys

Abstract The design of novel High Entropy Alloys for use in high-temperature applications is an area of active interest due to their potential to provide exceptional properties compared to conventional alloys. Since the increased popularity of machine learning, an important cog in the design process has been training surrogate models on alloy properties. However, these Single-Task models are trained on individual mechanical properties and do not take advantage of the relatedness between properties. Multi-Task models can capture the interdependencies between tasks, leading to potentially more accurate predictions for all tasks. In this paper, we investigate if Multi-Task models can show improvement over Single-Task models when used for predicting the mechanical properties of these alloys. To ensure fair evaluation between the models, we apply L 0 regularization and skip connections to the models, which allows them to adjust the number of model parameters and depth for optimal performance. We find that the Multi-Task models can leverage task relationships to perform better than Single-Task models, especially for high amounts of missing data in the tasks. Furthermore, adding simple auxiliary targets can boost Multi-Task performance even further despite not being effective as input descriptors to single-task models themselves. We anticipate that the proposed strategies can achieve more accurate predictions and consequently enable better design capabilities for such data-constrained domains without incurring much additional computational cost.

Debnath, Arindam (ORCID:0000000194274499)↗
DOE OSTI2025

Sparse measurement medical CT reconstruction using multi-fused block matching denoising priors

A major challenge for medical X-ray CT imaging is reducing the number of X-ray projections to lower radiation dosage and reduce scan times without compromising image quality. However these under-determined inverse imaging problems rely on the formulation of an expressive prior model to constrain the solution space while remaining computationally tractable. Traditional analytical reconstruction methods like Filtered Back Projection (FBP) often fail with sparse measurements, producing artifacts due to their reliance on the Shannon-Nyquist Sampling Theorem. Consensus Equilibrium, which is a generalization of Plug and Play, is a recent advancement in Model-Based Iterative Reconstruction (MBIR), has facilitated the use of multiple denoisers are prior models in an optimization free framework to capture complex, non-linear prior information. However, 3D prior modelling in a Plug and Play approach for volumetric image reconstruction requires long processing time due to high computing requirement. Instead of directly using a 3D prior, this work proposes a BM3D Multi Slice Fusion (BM3D-MSF) prior that uses multiple 2D image denoisers fused to act as a fully 3D prior model in Plug and Play reconstruction approach. Our approach does not require training and are thus able to circumvent ethical issues related with patient training data and are readily deployable in varying noise and measurement sparsity levels. In addition, reconstruction with the BM3D-MSF prior achieves similar reconstruction image quality as fully 3D image priors, but with significantly reduced computational complexity. We test our method on clinical CT data and demonstrate that our approach improves reconstructed image quality.

Hossain, Maliha [ORNL]↗
DOE OSTI2022

AmeriFlux FLUXNET-1F US-Me2 Metolius mature ponderosa pine

This is the AmeriFlux Management Project (AMP) created FLUXNET-1F version of the carbon flux data for the site US-Me2 Metolius mature ponderosa pine. This is the FLUXNET version of the carbon flux data for the site US-Me2 Metolius mature ponderosa pine produced by applying the standard ONEFlux (1F) software. Site Description - Site Description before Fire (January, 2002 - August, 2020): The mean stand age is 71 years old and the stand age of the oldest 10% of trees is about 108 years old. This site is one of the Metolius core cluster sites with different age and disturbance classes and part of the AmeriFlux network. The overstory is almost exclusively composed of ponderosa pine trees (Pinus ponderosa Doug. Ex P. Laws) with a few scattered incense cedars (Calocedrus decurrens (Torr.) Florin) and has a peak leaf area index (LAI) of 2.1 m2 m-2. Tree height is relatively homogeneous at about 18 m, and the mean tree density is approximately 339 trees ha-1 (Irvine et al., 2008). The understory is sparse with an LAI of 0.2 m2 m-2 and primarily composed of bitterbrush (Purshia tridentata (Push) DC.) and greenleaf manzanita (Arctostaphylos patula Greene). Soils at the site are sandy (69%/24%/7% sand/silt/clay at 0–0.2 m depth and 66%/27%/7% at 0.2–0.5 m depth, and 54%/ 35%/11% at 0.5–1.0 m depth), freely draining with a soil depth of approximately 1.5 m (Irvine et al., 2008; Law et al., 2001b; Schwarz et al., 2004). Green Ridge Fire: On August 20, 2020, the Green Ridge Fire burned through Us-Me2. The fire was ignited by lightning on August 16th, and grew rapidly to the east over the first few days driven by strong, downslope (westerly) afternoon winds. Fire behavior and observed fire effects were highly heterogeneous due to the localized wind pattern carrying the flaming head of the fire forward, and the efforts being made by suppression resources to contain the fire. The site experienced the full range of fire effects, from <1 m high surface fire that charred litter and duff and only consumed shrubs and herbaceous material to full tree (>15 m) crown fire that consumed 100% of needles, small limbs, and surface fuels at high intensity, leaving only ash and bare soil post-fire. Salvage Logging: From late March to late April 2021, salvage logging by the landowner occurred at the site. Almost all trees within the flux footprint were logged except a small area with lower burn severity, where sap flow and automatic soil respiration measurements are continued since the fire. In August 2022 the primary flux system was moved from the top of the damaged tall tower to a nearby shorter tower centering on the salvage/regenerating footprint.

Hanson, Chad↗
DOE OSTI2022

Optimizing first- and last-mile public transit services leveraging transportation network companies (TNC)

First-mile last-mile (FMLM) mobility services that connect riders to public transit can lead to improved transit accessibility and network efficiency if such services are convenient and reliable. However, many current FMLM services are inefficient and costly because they are inflexible (e.g., fixed supply of shuttles) and do not leverage collected data for optimized decision making. At the same time, new forms of shared mobility can provide added flexibility and real-time analytics to FMLM systems when carefully integrated. This study evaluates performance and cost implications of public/private coordination between transit shuttles and transportation network companies (TNC) in the FMLM context. A real-time operations model was developed to simulate daily operations for an existing FMLM system using real-world demand data. Three supply strategies were tested with varying levels of flexibility: (1) Status Quo (two 23-passenger on-demand shuttles), (2) Hybrid (one 23-passenger on-demand shuttle + TNC), and (3) TNC Only (exclusively use TNC services). Results indicated that the added flexibility of the Hybrid service design (using shuttles and TNCs) improved service performance (a 7.7% improvement), reduced daily operating costs (– 6.0%), and improved service reliability (95th percentile travel times decreased by up to 40% during peak periods). In addition, the Hybrid service design was more robust to variations in demand. Here, the Hybrid service was significantly cheaper to operate (– 31.6%) at reduced demand levels (50% of normal), and improved service performance (a 10.2% improvement) when demand levels were increased (150% of normal). These findings emphasize the importance of flexibility in FMLM service designs, especially when demand is sparse and variable.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2024

Spatially resolved microlensing time-scale distributions across the Galactic bulge with the VVV survey

ABSTRACT We analyse 1602 microlensing events found in the VISTA Variables in the Via Lactea (VVV) near-infrared (NIR) survey data. We obtain spatially resolved, efficiency-corrected time-scale distributions across the Galactic bulge (|ℓ| < 10°, |b| < 5°), using a Bayesian hierarchical model. Spatially resolved peaks and means of the time-scale distributions, along with their marginal distributions in strips of longitude and latitude, are in agreement at a 1σ level with predictions based on the Besançon model of the Galaxy. We find that the event time-scales in the central bulge fields (|ℓ| < 5°) are on average shorter than the non-central (|ℓ| > 5°) fields, with the average peak of the lognormal time-scale distribution at 23.6 ± 1.9 d for the central fields and 29.0 ± 3.0 d for the non-central fields. Our ability to probe the structure of the bulge with this sample of NIR microlensing events is limited by the VVV survey’s sparse cadence and relatively small number of detected microlensing events compared to dedicated optical surveys. Looking forward to future surveys, we investigate the capability of the Roman telescope to detect spatially resolved asymmetries in the time-scale distributions. We propose two pairs of Roman fields, centred on (ℓ = ±9, 5°, b = −0.125°) and (ℓ = −5°, b = ±1.375°) as good targets to measure the asymmetry in longitude and latitude, respectively.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Search for interacting galaxy clusters from SDSS DR-17 employing optimized friends-of-friends algorithm and multimessenger tracers

ABSTRACT In the theoretical framework of hierarchical structure formation, galaxy clusters evolve through continuous accretion and mergers of substructures. Cosmological simulations have revealed the best picture of the universe as a 3D filamentary network of dark-matter distribution called the cosmic web. Galaxy clusters are found to form at the nodes of this network and are the regions of high merging activity. Such mergers being highly energetic, contain a wealth of information about the dynamical evolution of structures in the Universe. Observational validation of this scenario needs a colossal effort to identify numerous events from all-sky surveys. Therefore, such efforts are sparse in literature and tend to focus on individual systems. In this work, we present an improved search algorithm for identifying interacting galaxy clusters and have successfully produced a comprehensive list of systems from SDSS DR-17. By proposing a set of physically motivated criteria, we classified these interacting clusters into two broad classes, ‘merging’ and ‘pre-merging/postmerging’ systems. Interestingly, as predicted by simulations, we found that most cases show cluster interaction along the prominent cosmic filaments of galaxy distribution (i.e. the proxy for dark matter filaments), with the most violent ones at their nodes. Moreover, we traced the imprint of interactions through multiband signatures, such as diffuse cluster emissions in radio or X-rays. Although we could not find direct evidence of diffuse emission from connecting filaments and ridges; our catalogue of interacting clusters will ease locating such faintest emissions as data from sensitive telescopes such as eROSITA or SKA, becomes accessible.

Oak, Tejas↗