Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data reduction”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 307 records · Page 17

A flexible class of priors for orthonormal matrices with basis function-specific structure

Statistical modeling of high-dimensional matrix-valued data motivates the use of a low-rank representation that simultaneously summarizes key characteristics of the data and enables dimension reduction. Low-rank representations commonly factor the original data into the product of orthonormal basis functions and weights, where each basis function represents an independent feature of the data. However, the basis functions in these factorizations are typically computed using algorithmic methods that cannot quantify uncertainty or account for basis function correlation structure a priori. While there exist Bayesian methods that allow for a common correlation structure across basis functions, empirical examples motivate the need for basis function-specific dependence structure. We propose a prior distribution for orthonormal matrices that can explicitly model basis function-specific structure. The prior is used within a general probabilistic model for singular value decomposition to conduct posterior inference on the basis functions while accounting for measurement error and fixed effects. We discuss how the prior specification can be used for various scenarios and demonstrate favorable model properties through synthetic data examples. Finally, we apply our method to two-meter air temperature data from the Pacific Northwest, enhancing our understanding of the Earth system’s internal variability.

97 MATHEMATICS AND COMPUTING↗

Unsupervised classification for region of interest in X-ray ptychography

X-ray ptychography offers high-resolution imaging of large areas at a high computational cost due to the large volume of data provided. To address the cost issue, we propose a physics-informed unsupervised classification algorithm that is performed prior to reconstruction and removes data outside the region of interest (RoI) based on the multimodal features present in the diffraction patterns. The preprocessing time for the proposed method is inconsequential in contrast to the resource-intensive reconstruction process, leading to an impressive reduction in the data workload to a mere 20% of the initial dataset. This capability consequently reduces computational time dramatically while preserving reconstruction quality. Through further segmentation of the diffraction patterns, our proposed approach can also detect features that are smaller than beam size and correctly classify them as within the RoI.

97 MATHEMATICS AND COMPUTING↗

Biogeochemical controls on iron speciation and cycling across upland to shoreline gradients in freshwater and estuarine coastal soils (Lake Erie and Chesapeake Bay, United States)

Coastal environments are dynamic interfaces that mediate carbon and nutrient exchanges between terrestrial landscapes and open waters, and understanding the biogeochemical factors controlling these exchanges, particularly iron (Fe) redox transformations, is crucial for predicting coastal ecosystem functions. Here, we investigated the mechanisms controlling Fe speciation changes across upland-to-shoreline gradients in freshwater and estuarine soils using Fe K-edge X-ray absorption spectroscopy, solid and porewater composition analysis, and 16S rRNA sequencing analysis. We show that Fe transformations depend primarily on inundation patterns. In unsaturated uplands, Fe occurs as Fe(III) oxyhydroxides, mainly goethite (9–35 %), Fe(II,III)-phyllosilicates (39–89 %), and Fe(III)-organic species (0–61 %). Soils influenced by estuarine waters exhibit porewater sulfide concentrations reaching up to 221 μM, Fe- and S-cycling bacteria, and up to 81 % pyrite (FeS 2 ), indicating that sulfur-driven redox dynamics control Fe transformations. In lacustrine wetlands, Fe(III) reduction is indicated by porewater Fe(II) concentrations increasing to 1.0–2.1 mM, and ~10–15 % of Fe as Fe(II,III)-(hydr)oxides (green rust), vivianite (Fe 3 (PO 4 ) 2 ·8H 2 O), and/or adsorbed Fe(II) species. EXAFS data also indicate reduction of structural Fe(III) to Fe(II) in phyllosilicates. The presence of Fe- and S-cycling bacteria, as well as sulfide (0–10 μM), suggests that Fe-cycling is microbially driven and potentially coupled with cryptic S-cycling. Fe(II) oxidation was indicated above/near the water table by the presence of Fe(III) oxyhydroxides (ferrihydrite, lepidocrocite). Furthermore, negligible Fe(III) or sulfate reduction was observed at some water-saturated sites located at the upland-wetland transition, likely due to oxic (sub-)surface water inputs. Overall, our results highlight the importance of considering both Fe-speciation and hydro-biogeochemical dynamics when predicting Fe-cycling at coastal interfaces.

54 ENVIRONMENTAL SCIENCES↗

Rapid detection of rare events from in situ X-ray diffraction data using machine learning

High-energy X-ray diffraction methods can non-destructively map the 3D microstructure and associated attributes of metallic polycrystalline engineering materials in their bulk form. These methods are often combined with external stimuli such as thermo-mechanical loading to take snapshots of the evolving microstructure and attributes over time. However, the extreme data volumes and the high costs of traditional data acquisition and reduction approaches pose a barrier to quickly extracting actionable insights and improving the temporal resolution of these snapshots. This article presents a fully automated technique capable of rapidly detecting the onset of plasticity in high-energy X-ray microscopy data. The technique is computationally faster by at least 50 times than the traditional approaches and works for data sets that are up to nine times sparser than a full data set. This new technique leverages self-supervised image representation learning and clustering to transform massive data sets into compact, semantic-rich representations of visually salient characteristics ( e.g. peak shapes). These characteristics can rapidly indicate anomalous events, such as changes in diffraction peak shapes. It is anticipated that this technique will provide just-in-time actionable information to drive smarter experiments that effectively deploy multi-modal X-ray diffraction methods spanning many decades of length scales.

Zheng, Weijian↗

Case studies in bias reduction and inference for electronic health record data with selection bias and phenotype misclassification

Electronic health records (EHR) are not designed for population‐based research, but they provide easy and quick access to longitudinal health information for a large number of individuals. Many statistical methods have been proposed to account for selection bias, missing data, phenotyping errors, or other problems that arise in EHR data analysis. However, addressing multiple sources of bias simultaneously is challenging. We developed a methodological framework (R package, SAMBA ) for jointly handling both selection bias and phenotype misclassification in the EHR setting that leverages external data sources. These methods assume factors related to selection and misclassification are fully observed, but these factors may be poorly understood and partially observed in practice. As a follow‐up to the methodological work, we demonstrate how to apply these methods for two real‐world case studies, and we evaluate their performance. In both examples, we use individual patient‐level data collected through the University of Michigan Health System and various external population‐based data sources. In case study (a), we explore the impact of these methods on estimated associations between gender and cancer diagnosis. In case study (b), we compare corrected associations between previously identified genetic loci and age‐related macular degeneration with gold standard external summary estimates. These case studies illustrate how to utilize diverse auxiliary information to achieve less biased inference in EHR‐based research.

60 APPLIED LIFE SCIENCES↗

Reduction in Nuclear Size and Quadrupole Deformation of High-Spin Isomers of 127,129 In

We employed laser spectroscopy of atomic transitions to measure the nuclear charge radii and electromagnetic properties of the high-spin isomeric states in neutron-rich indium isotopes (𝑍 =49) near the closed proton and neutron shells at 𝑍 = 50 and 𝑁 = 82. Our data reveal a reduction in the nuclear charge radius and intrinsic quadrupole moment when protons and neutrons are fully aligned in 129 In ⁢(𝑁 = 80), to form the high spin isomer. Such a reduction is not observed in 127 In ⁢(𝑁 = 78), where more complex configurations can be formed by the existence of four neutron holes. These observations are not consistently described by nuclear theory.

high spin states↗

Data for Wilson and Megonigal (2025), "Nitrate reduction across soils transitioning from coastal forest to wetland are hotspots for denitrification"

Sea level rise drives spatial migration of coastal ecosystems and can lead to the accelerated replacement of coastal forests with tidal wetlands. Soil biogeochemical cycles in steady-state upland and wetland ecosystems are well studied, but pathways and rates in rapidly changing ecosystems are largely unconstrained. Wilson and Megonigal (2025) performed a one-time sampling and a subsequent incubation experiment, and characterized the reduction of reactive nitrogen (N) via denitrification and dissimilatory nitrate reduction to ammonia. Sampling was done at four sites where coastal deciduous forest is undergoing ecosystem state change and becoming wetland throughout the Chesapeake Bay, USA. The COMPASS-FME project (http://compass.pnnl.gov) established the sites sampled in this study in 2022–2023.This dataset consists of:* Isotope-labeled incubation results comparing nitrate reduction rates across transects spanning upland, transition, and wetland; and* Ancillary porewater chemistry data.All files in this dataset are plain text, comma-separated value (CSV), and no special software is required to read them.

54 ENVIRONMENTAL SCIENCES↗

Quantification of Swelling in Hematite Pellets Reduced Using Hydrogen–Nitrogen Gas Mixture

Iron ore pellets are reduced in a 50%H 2 –50%N 2 1 atm gas mixture at 750, 800, 850, 900, and 950 °C while simultaneously documenting swelling (change in pellet radius) and weight change. Swelling increases with increasing temperature, with catastrophic swelling (>20% of reduction swelling index) observed at 850, 900, and 950 °C. As the pellet is reduced, the pellet radius increases until 40–50% reduction is achieved, followed by a decrease in diameter beyond 40–50% reduction at 750 and 850 °C. At 950 °C, the pellet radius continues to increase with additional pellet reduction without any subsequent decrease in diameter. Scanning electron microscopy (SEM) analysis shows that the neighboring grains inside the pellet sinter together at 750 and 850 °C, whereas the individual grains sinter internally at 950 °C. SEM analysis and observations suggest that the reduction process at 750 and 850 °C can be approximated as a topochemical reaction process, while the reduction process at 950 °C can no longer be approximated as a topochemical reaction process. In conclusion, an empirical equation for the radius of the pellet is derived with fitting parameters dependent on temperature and the degree of reduction of the pellet undergoing reduction based on the experimental data.

08 HYDROGEN↗

A global gridded dataset for cloud vertical structure from combined CloudSat and CALIPSO observations

Abstract. The vertical structure of clouds has a profound effect on the global energy budget, the global circulation, and the atmospheric hydrological cycle. The CloudSat and Cloud-Aerosol Lidar and Infrared Pathfinder Satellite Observations (CALIPSO) missions have taken complementary, colocated observations of cloud vertical structure for over a decade. However, no globally gridded dataset is available to the public for the full length of this unique combined data record. Here we present the 3S-GEOPROF-COMB product (Bertrand et al. 2023, https://doi.org/10.5281/zenodo.8057791), a globally gridded (level 3S) community data product summarizing geometrical profiles (GEOPROF) of hydrometeor occurrence from combined (COMB) CloudSat and CALIPSO data. Our product is calculated from the latest release (R05) of per-orbit (level-2) combined cloud mask profiles. We process a set of cloud cover, vertical cloud fraction, and sampling variables at 2.5, 5, and 10° spatial resolutions and monthly and seasonal temporal resolutions. We address the 2011 reduction in CloudSat data collection with Daylight-Only Operations (DO-Op) mode by subsampling pre-2011 data to mimic DO-Op collection patterns, thereby allowing users to evaluate the impact of the reduced sampling on their analyses. We evaluate our data product against CloudSat-only and CALIPSO-only global-gridded data products as well as four comparable surface-based sites, underscoring the added value of the combined product. Interest in the product is anticipated for the study of cloud processes, cloud–climate interactions, and as a candidate baseline climate data record for comparison to follow-up satellite missions, among other uses.

Bertrand, Leah (ORCID:0009000001607558)↗

A novel MC TRT method: vectorizable variance reduction for the energy spectra

Data produced up to now gives us confidence that we will continue to see variance reduction behavior at amenable runtimes as we move this test bed forward. This method has characteristics of event and history based Monte Carlo transport, without the bulky modifications required by event based Monte Carlo while avoiding some overhead.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Transfer learning nonlinear plasma dynamic transitions in low dimensional embeddings via deep neural networks

Deep learning algorithms provide a new paradigm to study high-dimensional dynamical behaviors, such as those in fusion plasma systems. Development of novel, data-driven model reduction methods, coupled with detection of abnormal modes with plasma physics, opens a unique opportunity to identify plasma instabilities through automated construction of parsimonious models that can be tuned to balance accuracy and cost. Our fusion transfer learning (FTL) model demonstrates success in rapidly reconstructing nonlinear kink mode structures by learning from a limited amount of nonlinear simulation data. The knowledge transfer process leverages a pre-trained neural encoder–decoder network, initially trained on linear simulations, to effectively capture nonlinear dynamics. The low-dimensional embeddings extract the coherent structures of interest, while preserving the inherent dynamics of the complex system. Experimental results highlight FTL’s capacity to capture transitional behaviors and dynamical features in plasma dynamics—a task often challenging for conventional methods. The model developed in this study is generalizable and can be extended broadly through transfer learning to address various magnetohydrodynamics modes.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Measuring the β-decay Properties of Neutron-rich Exotic Pm, Sm, Eu, and Gd Isotopes to Constrain the Nucleosynthesis Yields in the Rare-earth Region

Abstract The β -delayed neutron-emission probabilities of 28 exotic neutron-rich isotopes of Pm, Sm, Eu, and Gd were measured for the first time at RIKEN Nishina Center using the Advanced Implantation Detector Array (AIDA) and the BRIKEN neutron detector array. The existing β -decay half-life ( T 1/2 ) database was significantly increased toward more neutron-rich isotopes, and uncertainties for previously measured values were decreased. The new data not only constrain the theoretical predictions of half-lives and β -delayed neutron-emission probabilities, but also allow for probing the mechanisms of formation of the high-mass wing of the rare-earth peak located at A ≈ 160 in the r -process abundance distribution through astrophysical reaction network calculations. An uncertainty quantification of the calculated abundance patterns with the new data shows a reduction of the uncertainty in the rare-earth peak region. The newly introduced variance-based sensitivity analysis method offers valuable insight into the influence of important nuclear physics inputs on the calculated abundance patterns. The analysis has identified the half-lives of 168 Sm and of several gadolinium isotopes as some of the key variables among the current experimental data to understand the remaining abundance uncertainty at A = 167–172.

79 ASTRONOMY AND ASTROPHYSICS↗

Methane Emissions Produced by Pneumatic Devices and Produced Water Tanks on Natural Gas Wellsites

In recent years, more scrutiny has been placed on the release of greenhouse gasses (GHGs) by the oil and gas industry in North America as climate concerns increase. In the coming years, stricter regulations proposed by the Environmental Protection Agency (EPA) concerning the release of GHGs will further direct attention to GHG emissions quantification, modeling, and overall reduction. Active natural gas wellsites employ production equipment that routinely emits methane during normal operation. Production equipment often includes, but is not limited to, gas production units (GPUs), pneumatic controllers (PCs) and actuators powered by produced natural gas, and produced water storage tanks. This work details direct methane emission measurements taken at active natural gas wellsites originating from intermittent pneumatic controllers and produced water storage tanks. Efforts to model methane flows originating from these sources are also detailed, and those results are compared to direct measurement. The direct methane emissions measurement campaign collected flow data from two active dry wellsites in the Marcellus shale region. These measurement campaigns captured, in total, several weeks of continuous data from these sites. Data included multiple pneumatic device vent flowrate channels, a single channel monitoring total emissions vented from the produced water storage tanks, and corresponding site weather data. Periodic composition measurements were taken from flows vented from produced water tanks. Computational modeling efforts attempted to mimic a given site’s methane emissions behavior given limited input parameters. Direct measurement data and simulation data yielded, through reduction and analysis, apparent methane emissions factors, statistics on pneumatic device actuation events, important relationships between GPU parameters and pneumatic device actuation events, produced water storage tank vent flows and flow compositions, and parameters most contributing to the magnitude and frequency of these fugitive methane emissions. Measurements, considering data from a 72hr period, produced PC emissions factors from 0.008 to 0.03 SCFH per device with an average device emitting 0.026 SCFH at the first site. The second site produced PC emissions factors spanning from 0.05 to 25.47 SCFH with an average device emitting 1.93 SCFH not including the 25.47 SCFH device, which was assumed to be malfunctioning. Two unique water tank emission measurements were made, 618 g CH4 per hour and 32.6 g CH4 per hour. On a water basis, the water tank emissions factors were 0.66 and 0.042 kg CH4 per bbl of water, respectively.

03 NATURAL GAS↗

PCAfold 2.0—Novel tools and algorithms for low-dimensional manifold assessment and optimization

We describe an update to our open-source Python package, PCAfold, designed to help researchers generate, analyze and improve low-dimensional data manifolds. In the current version, PCAfold 2.0, we introduce novel tools and algorithms for assessing and optimizing low-dimensional manifolds. This includes a method that generates a “map” of local feature sizes that can help pinpoint researchers to problematic regions on a manifold. We introduce a novel cost function that characterizes the quality of a manifold topology with a single number. We develop two algorithms for feature selection based on principal component analysis (PCA) that use the cost function as an objective function to minimize. We introduce a quantity of interest (QoI)-aware dimensionality reduction strategy where data projections are computed using an artificial neural network and are directly optimized towards representing various projection-independent and projection-dependent QoIs. We also introduce an implementation of partition of unity networks (POUnets) for efficient reconstruction of QoIs from low-dimensional manifolds based on combining neural network classification with localized polynomial regression. Our software can be broadly applicable in all domains of science and engineering that aim to reduce data dimensionality, as well as in the fundamental research on representation learning.

97 MATHEMATICS AND COMPUTING↗

Multidimensional scaling informed by F -statistic: Visualizing grouped microbiome data with inference

Multidimensional scaling (MDS) is a widely used dimensionality reduction technique in microbial ecology data analysis that captures the multivariate structure of the data while preserving pairwise distances between samples. While improvements in MDS have enhanced the ability to reveal group-specific data patterns, these MDS-based methods require prior assumptions for inference, limiting their application in general microbiome analysis. Here, in this study, we introduce a new MDS-based ordination method, “F-informed MDS,” which configures the data distribution based on the F-statistic, the ratio of dispersion between groups sharing common and different characteristics. Using semisynthetic datasets, we demonstrate that the proposed method is robust to hyperparameter selection while maintaining statistical significance throughout the ordination process. Various quality metrics for evaluating dimensionality reduction confirm that F-informed MDS is comparable to state-of-the-art methods in preserving both local and global data structures. Its application to a diatom-associated bacterial community suggests the role of this new method in interpreting the community’s response to the host. Our approach offers a well-founded refinement of MDS that aligns with statistical test results, which can be beneficial for broader multidimensional data analyses in microbiology and ecology. This new visualization tool can be incorporated into standard microbiome data analyses.

Biological and medical sciences↗

A Generalized Grain-Scale Model for the Non-Plasma and Plasma-Assisted Hydrogen Direct Reduction of Iron Ore

Direct Reduction of Iron ore using hydrogen (H-DRI) is a promising pathway towards efficient steelmaking and accurate predictive models are a necessity for scale-up and optimization of this technology. However, accurate models of this process remain limited because existing models oversimplify grain-scale phenomena, such as nonlinearity inside grain, self-sufficient porosity, surface reactions, and the role of plasma species. These phenomena are important for flash steelmaking and plasma-assisted H-DRI processes. To address this need, we present a phenomenological model for simulating H-DRI at the scale of a single micron-sized grain of the iron ore. We call this the Transient Reactive Grain Model (TRGM). TRGM incorporates key physical process: gas species transport, a chemical kinetics of material conversion, nanopore structural evolution and, adsorption-desorption surface kinetics at the reactive nanopore surface. The important contribution of this work is that the model provides a dependence on different reductant species, specifically hydrogen atoms versus molecules, so that role of hydrogen plasma reduction can be clarified compared to the use of pure hydrogen gas reduction. TRGM predictions agree well with experimental data for both molecular H2 reduction of Fe2O3 and plasma hydrogen reduction of Fe3O4. Results reveal species concentration gradients with a diffuse reaction zone, and enhanced hydrogen diffusion at the grain outer surface due to evolving porosity. These findings challenge common assumptions in existing models, including sharp reaction fronts, quasi-steady diffusion and kinetics, and the neglect of surface chemistry. As a generalized grain-scale model for H-DRI processes, TRGM has practical applications in flash steelmaking and in-flight reduction using both molecular and plasma hydrogen.

08 HYDROGEN↗

Snowmass Topical Group Summary Report: IF04 -- Trigger and Data Acquisition Systems

A trend for future high energy physics experiments is an increase in the data bandwidth produced from the detectors. Datasets of the Petabyte scale have already become the norm, and the requirements of future experiments -- greater in size, exposure, and complexity -- will further push the limits of data acquisition technologies to data rates of exabytes per seconds. The challenge for these future data-intensive physics facilities lies in the reduction of the flow of data through a combination of sophisticated event selection in the form of high-performance triggers and improved data representation through compression and calculation of high-level quantities. These tasks must be performed with low-latency (i.e. in real-time) and often in extreme environments including high radiation, high magnetic fields, and cryogenic temperatures.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Snowmass Topical Group Summary Report: IF04 -- Trigger and Data Acquisition Systems

A trend for future high energy physics experiments is an increase in the data bandwidth produced from the detectors. Datasets of the Petabyte scale have already become the norm, and the requirements of future experiments -- greater in size, exposure, and complexity -- will further push the limits of data acquisition technologies to data rates of exabytes per seconds. The challenge for these future data-intensive physics facilities lies in the reduction of the flow of data through a combination of sophisticated event selection in the form of high-performance triggers and improved data representation through compression and calculation of high-level quantities. These tasks must be performed with low-latency (i.e. in real-time) and often in extreme environments including high radiation, high magnetic fields, and cryogenic temperatures.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗