Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data reduction methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14

Smooth local subspace projection for nonlinear noise reduction

Many nonlinear or chaotic time series exhibit an innate broad spectrum, which makes noise reduction difficult. Local projective noise reduction is one of the most effective tools. It is based on proper orthogonal decomposition (POD) and works for both map-like and continuously sampled time series. However, POD only looks at geometrical or topological properties of data and does not take into account the temporal characteristics of time series. Here, we present a new smooth projective noise reduction method. It uses smooth orthogonal decomposition (SOD) of bundles of reconstructed short-time trajectory strands to identify smooth local subspaces. Restricting trajectories to these subspaces imposes temporal smoothness on the filtered time series. It is shown that SOD-based noise reduction significantly outperforms the POD-based method for continuously sampled noisy time series.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Sensitivity and uncertainty analysis applied to the JHR reactivity prediction

The on-going AMMON program in EOLE reactor at CEA Cadarache (France) provides experimental results to qualify the HORUS-3D/N neutronics calculation scheme used for the design and safety studies of the new Material Testing Jules Horowitz Reactor (JHR). This paper presents the determination of technological and nuclear data uncertainties on the core reactivity and the propagation of the latter from the AMMON experiment to JHR. The technological uncertainty propagation was performed with a direct perturbation methodology using the 3D French stochastic code TRIPOLI4 and a statistical methodology using the 2D French deterministic code APOLLO2-MOC which leads to a value of 289 pcm (1{sigma}). The Nuclear Data uncertainty propagation relies on a sensitivity study on the main isotopes and the use of a retroactive marginalization method applied to the JEFF 3.1.1 {sup 27}Al evaluation in order to obtain a realistic multi-group covariance matrix associated with the considered evaluation. This nuclear data uncertainty propagation leads to a K{sub eff} uncertainty of 624 pcm for the JHR core and 684 pcm for the AMMON reference configuration core. Finally, transposition and reduction of the prior uncertainty were made using the Representativity method which demonstrates the similarity of the AMMON experiment with JHR (the representativity factor is 0.95). The final impact of JEFF 3.1.1 nuclear data on the Begin Of Life (BOL) JHR reactivity calculated by the HORUS-3D/N V4.0 is a bias of +216 pcm with an associated posterior uncertainty of 304 pcm (1{sigma}). (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

On the estimation of statistical uncertainties on powder diffraction and small-angle scattering data from two-dimensional X-ray detectors

Optimal methods are explored for obtaining one-dimensional powder pattern intensities from two-dimensional planar detectors with good estimates of their standard deviations. Methods are described to estimate uncertainties when the same image is measured in multiple frames as well as from a single frame. The importance of considering the correlation of diffraction points during the integration and the resampling process of data analysis is shown. It is found that correlations between adjacent pixels in the image can lead to seriously overestimated uncertainties if such correlations are neglected in the integration process. Off-diagonal entries in the variance–covariance (VC) matrix are problematic as virtually all data processing and modeling programs cannot handle the full VC matrix. It is shown that the off-diagonal terms come mainly from the pixel-splitting algorithm used as the default integration algorithm in many popular two-dimensional integration programs, as well as from rebinning and resampling steps later in the processing. When the full VC matrix can be propagated during the data reduction, it is possible to get accurate refined parameters and their uncertainties at the cost of increasing computational complexity. However, as this is not normally possible, the best approximate methods for data processing in order to estimate uncertainties on refined parameters with the greatest accuracy from just the diagonal variance terms in the VC matrix is explored.

Yang, X.↗

Electronic damage in S atoms in a native protein crystal induced by an intense X-ray free-electron laser pulse

Current hard X-ray free-electron laser (XFEL) sources can deliver doses to biological macromolecules well exceeding 1 GGy, in timescales of a few tens of femtoseconds. During the pulse, photoionization can reach the point of saturation in which certain atomic species in the sample lose most of their electrons. This electronic radiation damage causes the atomic scattering factors to change, affecting, in particular, the heavy atoms, due to their higher photoabsorption cross sections. Here, it is shown that experimental serial femtosecond crystallography data collected with an extremely bright XFEL source exhibit a reduction of the effective scattering power of the sulfur atoms in a native protein. Quantitative methods are developed to retrieve information on the effective ionization of the damaged atomic species from experimental data, and the implications of utilizing new phasing methods which can take advantage of this localized radiation damage are discussed.

Galli, L.↗

Crystalline Silicon Photovoltaic Module Manufacturing Costs and Sustainable Pricing: 1H 2018 Benchmark and Cost Reduction Road Map

In this paper we provide an overview of the accounting methods and most recent input data used within NREL's bottom-up crystalline silicon (c-Si) solar photovoltaic (PV) module supply chain cost models. The costs accounting framework that is detailed in this paper provides a methodology to prepare bottom-up c-Si PV supply chain cost models in accordance with the U.S. Generally Accepted Accounting Principles (GAAP) and the International Financial Reporting Standards (IFRS). For the polysilicon, ingot, wafer, cell conversion, and module assembly steps of the c-Si supply chain, we outline what is relevant for calculations of the costs of goods sold (consisting of the materials, labor, electricity, maintenance, and depreciation of capital equipment); as well as the additional operating expenses of research and development (R&D); and sales, general, and business administration (S, G, &A). This 2017 benchmark analysis is applied to current state-of-the-art manufacturing sites located within the United States, China, Taiwan, South Korea, Malaysia, the Philippines, and Germany. Primarily due to country-dependent labor and electricity rates, tax rates, and cost-of-capital considerations, we calculate differences in minimum sustainable pricing for all of these countries. In this paper we also include technical descriptions and bottom-up cost model results for several emerging c-Si technologies including larger Czochralski (Cz) ingots, kerfless wafers, reduced silicon utilization by thinner wafers and advanced diamond wire wafering, new encapsulants and backsheets, shingled cells, and the cell architectures passivated emitter and rear cells (PERC), bifacial passivated emitter and rear totally diffused (PERT) cells, bifacial heterojunction intrinsic thin layer (HIT) cells, and interdigitated all back-contact cells (IBC).

14 SOLAR ENERGY↗

Random projection using random quantum circuits

The random sampling task performed by Google's Sycamore processor gave us a glimpse of the “quantum supremacy era.” This has definitely shed some light on the power of random quantum circuits in this abstract task of sampling outputs from the (pseudo)random circuits. In this paper, we explore a practical near-term use of local random quantum circuits in dimensional reduction of large low-rank data sets. We make use of the well-studied dimensionality reduction technique called the random projection method. This method has been extensively used in various applications such as image processing, logistic regression, entropy computation of low-rank matrices, etc. We prove that the matrix representations of local random quantum circuits with sufficiently shorter depths [ ∼ O ( n ) ] serve as good candidates for random projection. We demonstrate numerically that their projection abilities are not far off from the computationally expensive classical principal components analysis on MNIST and CIFAR-100 image datasets. We also benchmark the performance of quantum random projection against the commonly used classical random projection in the tasks of dimensionality reduction of image data sets and computing von Neumann entropies of large low-rank density matrices. And finally, using variational quantum singular value decomposition, we demonstrate a near-term implementation of extracting the singular vectors with dominant singular values after quantum random projecting a large low-rank matrix to lower dimensions. All such numerical experiments unequivocally demonstrate the ability of local random circuits to randomize a large Hilbert space at sufficiently shorter depths with robust retention of properties of large data sets in reduced dimensions. Published by the American Physical Society 2024

Kumaran, Keerthi (ORCID:0009000949125721)↗

Denoising Autoencoder for Reconstructing Sensor Observation Data and Predicting Evapotranspiration: Noisy and Missing Values Repair and Uncertainty Quantification

Abstract Machine learning (ML) methods applied in scientific research often deal with interrelated features in high‐dimensional data. Reducing data noise and redundancy is needed to increase prediction accuracy and efficiency especially when dealing with data from field sensors. We explored an unsupervised learning method, the denoising autoencoder (DAE), to extract the underlying data structure from noisy raw data in the context of predicting hydrologic quantities from multiple field sensors. These sensors have intrinsic instrumental noise and occasional malfunctions that cause missing values. Our DAE neural network reconstructed meteorological sensor data containing noise and missing values to predict evapotranspiration in a mountainous watershed. The DAE reconstructed the sensor variables with a mean coefficient of determination value of 0.77 across 15 dimensions representing individual sensors. It reduced variance and bias uncertainties compared to a classical autoencoder model. The reconstruction quality varied across dimensions depending on their cross‐correlation and alignment with the underlying data structure. Uncertainties arising from the model structure were overall higher than those resulting from data corruption. We attached the DAE structure to a downstream ET‐prediction neural network in three formats and achieved reasonably accurate ET predictions . The use of the DAE notably reduced variance uncertainty in ET prediction. However, excessive variance reduction may be accompanied by an increase in bias due to the intrinsic bias‐variance tradeoff. Our method of evaluating and reducing uncertainties in aggregated data from different sources can be used to improve predictive models, process understanding, and uncertainty quantification for better water resource management. Plain Language Summary We present a machine learning method, namely the denoising autoencoder, which reduces the effects of data noise and missing values typically present in scientific data sets collected through sensor measurements. This method selects the most relevant information from noisy raw data collected by the instruments and fills in missing values. To demonstrate the effectiveness of our method, we applied it to predict evapotranspiration, a hydrologic variable that represents the water moved from the land surface to the atmosphere through a combination of evaporation and plant water use (transpiration). We also used a random sampling technique (the Monte Carlo method) to compare the uncertainty in the predictions when using the raw and noisy data versus the reconstructed data. The denoising process produced more accurate predictions of evapotranspiration with less uncertainty. Improved predictions of evapotranspiration can lead to a better understanding and accounting of water budgets. This ML approach is broadly suitable for a wide variety of applications that involve noisy sensor data with missing values. Key Points We used a denoising autoencoder (DAE) neural network to reduce noise in meteorological and soil sensor observations by on average We used Monte Carlo sampling to estimate the bias and variance of all model outputs, including uncertainty sources from data and the model We attached the DAE component to a downstream neural network to predict ET with the variance reduced by , compared to that without the DAE

denoising autoencoder↗

KEPLER ECLIPSING BINARY STARS. III. CLASSIFICATION OF KEPLER ECLIPSING BINARY LIGHT CURVES WITH LOCALLY LINEAR EMBEDDING

We present an automated classification of 2165 Kepler eclipsing binary (EB) light curves that accompanied the second Kepler data release. The light curves are classified using locally linear embedding, a general nonlinear dimensionality reduction tool, into morphology types (detached, semi-detached, overcontact, ellipsoidal). The method, related to a more widely used principal component analysis, produces a lower-dimensional representation of the input data while preserving local geometry and, consequently, the similarity between neighboring data points. We use this property to reduce the dimensionality in a series of steps to a one-dimensional manifold and classify light curves with a single parameter that is a measure of 'detachedness' of the system. This fully automated classification correlates well with the manual determination of morphology from the data release, and also efficiently highlights any misclassified objects. Once a lower-dimensional projection space is defined, the classification of additional light curves runs in a negligible time and the method can therefore be used as a fully automated classifier in pipeline structures. The classifier forms a tier of the Kepler EB pipeline that pre-processes light curves for the artificial intelligence based parameter estimator.

79 ASTRONOMY AND ASTROPHYSICS↗

SNS: A Solution-Based Nonlinear Subspace Method for Time-Dependent Model Order Reduction

Several reduced order models have been successfully developed for nonlinear dynamical systems. To achieve a considerable speed-up, a hyper-reduction step is needed to reduce the computational complexity due to nonlinear terms. Many hyper-reduction techniques require the construction of nonlinear term basis, which introduces a computationally expensive offline phase. A novel way of constructing nonlinear term basis within the hyper-reduction process is introduced. In contrast to the traditional hyper-reduction techniques where the collection of nonlinear term snapshots is required, the SNS method avoids collecting the nonlinear term snapshots. Instead, it uses the solution snapshots that are used for building a solution basis, which enables avoiding an extra data compression of nonlinear term snapshots. As a result, the SNS method provides a more efficient offline strategy than the traditional model order reduction techniques, such as the DEIM, GNAT, and ST-GNAT methods. The SNS method is theoretically justified by the conforming subspace condition and the subspace inclusion relation. It is useful for model order reduction of large-scale nonlinear dynamical problems to reduce the offline cost. It is especially useful for ST-GNAT that has shown promising results, such as a good accuracy with a considerable online speed-up for hyperbolic problems in a recent paper by Choi and Carlberg [SIAM J. Sci. Comput., 41 (2019), pp. A26--A58], because ST-GNAT involves an expensive offline cost related to collecting nonlinear term snapshots. Error analysis for the SNS method is presented. Numerical results support that the accuracy of the solution from the SNS method is comparable to the traditional methods and a considerable speed-up (i.e., a factor of two to a hundred) is achieved in the offline phase.

97 MATHEMATICS AND COMPUTING↗

From microbial diversity to functional potential using dimensionality reduction

The high dimensionality of microbial diversity data from ‘omics observations can be reduced using Machine Learning, with many recent studies showcasing ML utility for exploratory ecological feature finding and process prediction. Here, we compare the Self Organizing Map (SOM) dimensionality reduction method to the well-documented sample-based Principal Coordinate Analysis (PCoA) and taxa-based Weighted Gene Correlation Network Analysis (WGCNA) using near daily 16S rRNA gene amplicon sequencing data from the 2019 to 2020 MOSAiC International Arctic Drift Expedition. We then map k-means clustering outputs from each method to available metagenomes, extracting functionally distinct seasonal microbial ecotypes in the surface Arctic Ocean. Our results indicate the SOM method better represented expected seasonal transitions and identified a greater number of metabolically distinct functional groups than the more traditional PCoA ordination. Ultimately, we identified four community ecotypes with distinct taxonomic and functional cut-offs driven by seasonality, water mass, and substrate turnover, highlighting the importance of succession in functional diversity for the central Arctic Ocean. These results reinforce ML dimensionality reduction as a meaningful translator in the mining of historical amplicon datasets to address modern mechanistic questions and potentially provide ’omics informed ecotype diversity to leverage in mechanistic biogeochemical models.

Arctic Ocean↗

Deep Hierarchical Super Resolution for Scientific Data

We present a novel technique for hierarchical super resolution (SR) with neural networks (NNs), which upscales volumetric data represented with an octree data structure to a high-resolution uniform gridwith minimal seam artifacts on octree node boundaries. Our method uses existing state-of-the-art SR models and adds flexibility to upscale input data with varying levels of detail across the domain, instead of only uniform grid data that are supported in previous approaches.The key is to use a hierarchy of SR NNs, each trained to perform 2x SR between two levels of detail, with a hierarchical SR algorithm that minimizes seam artifacts by starting from the coarsest level of detail and working up.We show that our hierarchical approach outperforms baseline interpolation and hierarchical upscaling methods, and demonstrate the usefulness of our proposed approach across three use cases including data reduction using hierarchical downsampling+SR instead of uniform downsampling+SR, computation savings for hierarchical finite-time Lyapunov exponent field calculation, and super-resolving low-resolution simulation results for a high-resolution approximation visualization.

97 MATHEMATICS AND COMPUTING↗

CV4Quantum

CV4Quantum is a statistical technique for reducing the sampling overhead in probabilistic error cancellation, which is an error mitigation technique used in quantum computing. CV4Quantum is based on the control variates method, which is a Monte Carlo variance reduction technique. This repository contains the code and data associated with a demonstration of CV4Quantum using simulation experiments.

Shyamsundar, Prasanth [Fermi National Accelerator ↗

Kinetics and Mechanism of Nickel Oxide Reduction by Methane

Nickel oxide reduction by methane is of particular importance in catalysis, extractive metallurgy, and clean power generation technologies. Despite extensive investigations of the NiO + CH 4 reaction, many questions remain about its kinetics and molecular and structural transformation mechanisms. We discuss the reduction kinetics of bulk polycrystalline NiO by CH 4 using a new calorimetric method. The technique permits rapid, controllable heating of the NiO/Ni wires and continuous data (electrical power, the electrical resistivity of the wire, and temperature) acquisition with a frequency of 10 kHz. The method also allows arresting and preservation of the structure of the sample by programmed termination of electric power in thin specimens. This approach, coupled with ex situ electron microscopy, allows determination of the reaction rate and tracking of the ongoing structural transformations. The mechanism of NiO reduction by methane is suggested based on direct correlations between reaction kinetics and the observed microstructure transformations. The kinetic data treatment revealed that the nucleation-growth model describes the reaction kinetics. Ex situ microscopy observations of reacted specimens showed that the first nuclei rapidly accelerate the process. Pore formation occurs at the nucleation sites, and the porous structure then quickly grows into the bulk NiO. The second type of reduced Ni microstructure, compact layer, can be observed only on the outer surface of the wire. Based on kinetic data and microstructural observations, a mechanism of reduction was suggested according to which porous microstructure forms predominantly by NiO reduction with carbon. The compact layer observed on the outer surface of the wire forms through the diffusion-controlled hydrogen reduction.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

A SURVEY OF ALKALI LINE ABSORPTION IN EXOPLANETARY ATMOSPHERES

We obtained over 90 hr of spectroscopic observations of four exoplanetary systems with the Hobby-Eberly Telescope. Observations were taken in transit and out of transit, and we analyzed the differenced spectra-i.e., the transmission spectra-to inspect it for absorption at the wavelengths of the neutral sodium (Na I) doublet at {lambda}{lambda}5889, 5895 and neutral potassium (K I) at {lambda}7698. We used the transmission spectrum at Ca I {lambda}6122-which shows strong stellar absorption but is not an alkali metal resonance line that we expect to show significant absorption in these atmospheres-as a control line to examine our measurements for systematic errors. We use an empirical Monte Carlo method to quantify these systematic errors. In a reanalysis of the same data set using a reduction and analysis pipeline that was derived independently, we confirm the previously seen Na I absorption in HD 189733b at a level of (- 5.26 {+-} 1.69) Multiplication-Sign 10{sup -4} (the average value over a 12 A integration band to be consistent with previous authors). Additionally, we tentatively confirm the Na I absorption seen in HD 209458b (independently by multiple authors) at a level of (- 2.63 {+-} 0.81) Multiplication-Sign 10{sup -4}, though the interpretation is less clear. Furthermore, we find Na I absorption of (- 3.16 {+-} 2.06) Multiplication-Sign 10{sup -4} at <3{sigma} in HD 149026b; features apparent in the transmission spectrum are consistent with real absorption and indicate this may be a good target for future observations to confirm. No other results (Na I in HD 147506b and Ca I and K I in all four targets) are significant to {>=}3{sigma}, although we observe some features that we argue are primarily artifacts.

79 ASTRONOMY AND ASTROPHYSICS↗

Alignment-free Visualization of Metagenomic Data by Nonlinear Dimension Reduction

The visualization of metagenomic data, especially without prior taxonomic identification of reconstructed genomic fragments, is a challenging problem in computational biology. An ideal visualization method should, among others, enable clear distinction of congruent groups of sequences of closely related taxa, be applicable to fragments of lengths typically achievable following assembly, and allow the efficient analysis of the growing amounts of community genomic sequence data. Here, we report a scalable approach for the visualization of metagenomic data that is based on nonlinear dimension reduction via Barnes-Hut Stochastic Neighbor Embedding of centered log-ratio transformed oligonucleotide signatures extracted from assembled genomic sequence fragments. The approach allows for alignment-free assessment of the data-inherent taxonomic structure, and it can potentially facilitate the downstream binning of genomic fragments into uniform clusters reflecting organismal origin. We demonstrate the performance of our approach by visualizing community genomic sequence data from simulated as well as groundwater, human-derived and marine microbial communities.

59 BASIC BIOLOGICAL SCIENCES↗

QProR: An Efficient Framework for Quantity-of-Interest Based Progressive Retrieval with Guaranteed Error Control

Scientific applications generate an unprecedented volume of data, overwhelming the network and file systems’ bandwidth and posing challenges for efficient and scalable data retrieval and analysis. Progressive data compression offers a promising solution by enabling on-demand retrieval at reduced size. However, existing progressive methods either fail to bound the errors in essential quantities of interest (QoIs) derived from raw data or suffer from suboptimal retrieval efficiency. In this work, we propose QProR, an efficient QoI-based progressive framework that optimizes progressive retrieval for target QoIs. Our key contributions include: (1) a systematic framework that integrates error-controlled lossy compressors with bitplane encoding while decoupling the two processes for high flexibility and adaptability; (2) a novel weighted bitplane encoding method which incorperates QoI knowledge into data refactoring to enhance retrieval efficiency; (3) an optimized retrieval strategy that accounts for the varying impacts of different variables on multivariate QoIs; (4) comprehensive evaluations using six real-world datasets from multiple scientific applications and thorough comparisons against state of the arts. Experimental results demonstrate that QProR achieves up to 80.38% reduction in the retrieval size under the same requested QoI error tolerance, when compared with the best-performing existing methods. When transferring 384 GB of scientific data to remote sites, QProR delivers up to 1.68 × speedup in the end-to-end data transfer performance.

Li, Wenbo [University of Kentucky]↗

An algorithm for efficient metal artifact reductions in permanent seed implants

Purpose: In permanent seed implants, 60 to more than 100 small metal capsules are inserted in the prostate, creating artifacts in x-ray computed tomography (CT) imaging. The goal of this work is to develop an automatic method for metal artifact reduction (MAR) from small objects such as brachytherapy seeds for clinical applications. Methods: The approach for MAR is based on the interpolation of missing projections by directly using raw helical CT data (sinogram). First, an initial image is reconstructed from the raw CT data. Then, the metal objects segmented from the reconstructed image are reprojected back into the sinogram space to produce a metal-only sinogram. The Steger method is used to determine precisely the position and edges of the seed traces in the raw CT data. By combining the use of Steger detection and reprojections, the missing projections are detected and replaced by interpolation of non-missing neighboring projections. Results: In both phantom experiments and patient studies, the missing projections have been detected successfully and the artifacts caused by metallic objects have been substantially reduced. The performance of the algorithm has been quantified by comparing the uniformity between the uncorrected and the corrected phantom images. The results of the artifact reduction algorithm are indistinguishable from the true background value. Conclusions: An efficient algorithm for MAR in seed brachytherapy was developed. The test results obtained using raw helical CT data for both phantom and clinical cases have demonstrated that the proposed MAR method is capable of accurately detecting and correcting artifacts caused by a large number of very small metal objects (seeds) in sinogram space. This should enable a more accurate use of advanced brachytherapy dose calculations, such as Monte Carlo simulations.

60 APPLIED LIFE SCIENCES↗

Sorption capacity and sorption kinetic measurements of CO{sub 2} and CH{sub 4} in confined and unconfined bituminous coal

Carbon dioxide injection into coal formations provides an opportunity to sequester carbon while simultaneously enhancing methane recovery. Although powdered coal samples provide a quick indication of the gas sorption capacity, underground storage takes place within compact coal monoliths, and therefore, it may be necessary to account for in situ conditions, specifically confining stress, for meaningful estimates. This study presents the sorption rates and sorption capacities of CO{sub 2} and CH{sub 4} for a bituminous coal sample in a whole sample and in pulverized form. The impact of confining stress on these sorption capacities of coal cores is evaluated with a multiple-point isotherm over a prolonged time period. The kinetics of the complex, heterogeneous processes occurring in a bituminous coal sample are quantified while under confining stress. Sorption capacities for a powdered sample are 1.17 and 0.66 mmol/g for CO{sub 2} and CH{sub 4}, respectively. The application of 6.9 and 13.8 MPa of confining stress contributed to 39 and 64% CO{sub 2} sorption capacity reduction. Similarly, 85 and 91% CH{sub 4} uptake capacity reduction is observed at those confining stresses. The time-dependent gas diffusion parameters are quantified using the volumetric method with a mathematical analysis of the pressure-decay data. Carbon dioxide diffused through the coal faster than CH{sub 4}. Initial exposure over a few days showed a rapid reduction in diffusion presumably as the macro- and mesopores filled. With longer exposure, 10 additional days, a steady slower diffusion is observed for CO{sub 2}. The steady-state slower diffusion is achieved within a few days for CH{sub 4}. It was found that the overall gas movement, specifically diffusion, is hindered by confining stresses and takes place at rates significantly less than in unconfined powder coal.

01 COAL, LIGNITE, AND PEAT↗