Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “alternating least squares”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Efficient CP Rounding Using Alternating Least Squares with QR Decomposition

The CANDECOMP/PARAFAC (CP) decomposition is widely used for analyzing multidimensional data, and the alternating least squares (CP-ALS) algorithm is a common method for its computation. CP rounding is the problem of computing a lower-rank CP decomposition of an input already in a higher-rank CP format. While the normal equations (NE) approach in CP-ALS is efficient for the CP rounding problem and frequently used, it becomes unstable in the presence of ill-conditioned subproblems. This paper presents a new QR-based CP-ALS method for CP rounding that preserves both numerical stability and computational efficiency. Here, our experiments show that the proposed method offers significant speedup over a previous QR-based approach and the Tensor Toolbox's NE-based implementation, particularly for higher-order tensors. Furthermore, our approach demonstrates a marked reduction in error for ill-conditioned problems, with error reductions several orders of magnitude smaller compared to the NE-based method, while achieving faster convergence and more accurate solutions. By using a more numerically stable approach, we can solve more problems in reduced working precision, which enables further reduction in time to solution.

CANDECOMP/PARAFAC↗

CP decomposition for tensors via alternating least squares with QR decomposition

The CP tensor decomposition is used in applications such as machine learning and signal processing to discover latent low-rank structure in multidimensional data. Computing a CP decomposition via an alternating least squares (ALS) method reduces the problem to several linear least squares problems. The standard way to solve these linear least squares subproblems is to use the normal equations, which inherit special tensor structure that can be exploited for computational efficiency. However, the normal equations are sensitive to numerical ill-conditioning, which can compromise the results of the decomposition. In this paper, we develop versions of the CP-ALS algorithm using the QR decomposition and the singular value decomposition, which are more numerically stable than the normal equations, to solve the linear least squares problems. Our algorithms utilize the tensor structure of the CP-ALS subproblems efficiently, have the same complexity as the standard CP-ALS algorithm when the input is dense and the rank is small, and are shown via examples to produce more stable results when ill-conditioning is present. Our MATLAB implementation achieves the same running time as the standard algorithm for small ranks, and we show that the new methods can obtain lower approximation error.

97 MATHEMATICS AND COMPUTING↗

Use of Fisher's Ratio assisted multivariate curve resolution- alternating least squares for discovery-based analysis using ultrahigh pressure liquid chromatography-high resolution mass spectrometry

Non-targeted analysis of complex chemical mixtures can be difficult considering the convoluted nature of the matrix and the potential unknown chemical differences between samples or classes of samples. Ultrahigh pressure liquid chromatography coupled to quadrupole time-of-flight mass spectrometry (UHPLC-QTOF) is an ideal technique to probe chemical differences for a wide variety of samples. While UHPLC-QTOF can discover minute chemical differences down to low part per billion (ppb) concentrations with a high degree of confidence, the application of high-resolution mass spectrometry can yield massive amounts of information (∼ 10 gb per sample) that cannot be analyzed manually. Therefore, the application of chemometric techniques is mandatory for the interrogation of complex samples. Fisher's ratio (FR) assisted multivariate curve resolution-alternating least squares (MCR-ALS) was used to the discover and identify the chemical differences between two classes of materials: 1) a pond water matrix and 2) the matrix spiked with a pharmaceutical standard mix containing 17 compounds. Thirteen of the seventeen spiked compounds were discovered using FR analysis, and then five were successfully deconvoluted using MCR-ALS wherein the number of curves chosen were automatically determined using singular value decomposition (SVD). In conclusion, the use of an automated FR assisted MCR-ALS will aid in discovering trace levels of chemical components without the need for the researcher to provide potentially biased input which will aid in non-targeted workflow.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

New methods for trace analysis of gamma-irradiated pentaerythritol tetranitrate

High explosives (HEs) are used in a diverse range of applications in which they could be exposed to various radiation levels that may cause potential chemical changes. This study further evaluated pentaerythritol tetranitrate (PETN) that was previously aged with a low-level 2 kGy dose of gamma irradiation in order to understand chemical changes caused by irradiation. Both unirradiated PETN and gamma-irradiated PETN were analyzed using ultra high-pressure liquid chromatography coupled to quadrupole time of flight mass spectrometry (UHPLC-QTOF). The resulting data were processed in a non-targeted manner using Fisher's ratio analysis and multivariate curve resolution-alternating least squares (MCR-ALS) to aid in discovery and identification of the chemical changes brought about by irradiation without a priori knowledge. The application of using UHPLC-QTOF in combination with chemometric techniques for the analysis of irradiated samples has not previously been performed. Here, in this work, we show how to use this method to provide chemical information that would otherwise not be discernible, such as the discovery of degradation of the various homologues of PETN. Major differences identified with radiolytic aging of the PETN sample included decomposition products that resulted from the degradation of the trigger linkage – the O–NO 2 bonds – resulting in the formation of alcohol and aldehyde groups. Similar degradation was also observed in the PETN homologues as well as interconversion from one homologue to another.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗

Temporal Ni K-Edge X-ray Absorption Spectroscopy Study Reveals the Kinetics of the Ni Redox Behavior of the Iron-Nickel Oxide Bimetallic OER Catalyst

Operando X-ray absorption spectroscopy (XAS) can be utilized to probe the phase and structural changes of FeNiOx and similar transition metal oxide electrocatalysts during electrocatalytic reactions. However, capturing the temporal changes occurring in the operando chemistry of electrocatalysts has been little studied. Here, in this work, we successfully capture the time-resolved changes at the Ni K-edge for both the X-ray absorption near-edge structure (XANES) and extended X-ray absorption fine structure (EXAFS) regions of an aqueous phase synthesized FeNiO x bimetallic nanoparticle electrocatalyst. During a stepped voltage experiment, the temporal change in the Ni K-edge was observed as the applied voltage was stepped from 0.7 to 0.8 V versus the silver/silver chloride reference electrode, and the change observed is associated with the Ni redox transition from the 2+ to 3+/4+ oxidation state. Individual XAS spectra were obtained in 90 s, and a total of 9 scans post voltage step showed a unique transition from a hydroxide to an oxyhydroxide phase. The shift in absorption edge energy position and the changes in spectral shape for individual scans explain the typically observed broadening of the Ni K-edge XANES spectrum during time-averaged operando XAS, and a kinetic analysis revealed a first-order observed rate constant, |k obs |, of 0.00426 s –1 and a half-life (t 1/2 ) of 163 s. Multivariate curve resolution-alternating least squares analysis followed by linear combination fitting analysis for time-averaged versus time-resolved Ni K-edge changes upon voltage step show distinct differences in estimated contributions from Ni 2+ oxide/hydroxide phases. Detailed EXAFS modeling shows the phase transition from hydroxide to oxyhydroxide on top of the unchanged metallic core.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Quantifying the Impact of Metal Population Distribution in MFI-Supported Mo Catalysts for Methane Dehydroaromatization

Precise evaluation of intrinsic kinetic behavior in Mo/MFI catalysts for methane dehydroaromatization (MDA) is confounded by variations in Mo dispersion and speciation, which are influenced by metal loading and zeolite acidity. This work advances the utility of H 2 -temperature programmed reduction (H 2 -TPR) for characterizing Mo/MFI catalysts by enabling quantitative comparison of MoO x populations distinguished by reduction behavior and linked to initial catalytic performance. A comprehensive H 2 reduction pathway is established through systematic H 2 - TPR studies varying catalyst composition (1–10 wt % Mo, Si/Al = 15, 40, ∞), supplemented by UV-Raman spectroscopy, X-ray powder diffraction, N 2 physisorption, NH 3 -TPD, and advanced spectroscopic analysis (in situ XAS with principal component analysis/multivariate curve resolution—alternating least squares). Two low-temperature H 2 -TPR regions capture distinct Mo populations undergoing initial Mo(VI)→Mo(IV) reduction: a lower-temperature population (Mo-RI) associated primarily with highly dispersed, anchored MoO x species expected to predominantly reside within MFI channels, and a higher-temperature population (Mo-RII) corresponding to a broader set of MoO x species that becomes increasingly bulk-like/extrazeolitic at higher Mo loading. Quantification of these populations provides practical, kinetically relevant descriptors for comparing initial MDA rates across catalysts with varying Mo loading, Si/Al ratio, and MoO x heterogeneity. Application of lower-temperature Mo-RI estimates to kinetic measurements reveals a minimum threshold of ∼0.12 × 10 –3 mol Mo-RI/g cat , above which initial forward benzene rates normalized to this population converge despite differences in metal loading and zeolite Brønsted acidity. This threshold coincides with a transition toward a common C 2 -mediated benzene-forming regime, as indicated by approach-to-equilibrium analysis of methane-to-ethane, ethane-to-ethylene, and ethylene-to-benzene reaction steps. Above this threshold, normalized initial benzene rates are nearly invariant with increasing Mo-RII/Mo-RI population ratio, indicating that excess Mo-RII populations, including bulk-like/extrazeolitic MoO x domains present at higher loading, do not measurably suppress benzene formation associated with anchored and mostly channel-confined Mo population under the initial-rate conditions examined.

Mo/MFI↗

The controlling role of atmosphere in dawsonite versus gibbsite precipitation from tetrahedral aluminate species

In highly alkaline solution, aluminum speciates as the tetrahedrally coordinated aluminate monomer, Al(OH)4- and/or dimer Al2O(OH)62-, yet precipitates as octahedrally coordinated gibbsite (Al(OH)3). This tetrahedral to octahedral transformation governs Al precipitation, which is crucial to worldwide Al production, and to the processing of caustic high-level radioactive wastes. Despite its significance, the transformation pathway remains unknown. Here we explore the roles of atmospheric water and carbon dioxide in mediating the transformation of the tetrahedrally coordinated potassium aluminate dimer salt (K2Al2O(OH)6) to gibbsite versus potassium dawsonite (KAl(CO3)(OH)2). A combination of in-situ attenuated total reflection infrared spectroscopy, ex-situ micro X-ray diffraction, and multivariate curve resolution-alternating least squares chemometrics analysis reveals that humidity plays a key role in the transformation by limiting the amount of alkalinity neutralization by dissolved CO2. Lower humidity favors higher alkalinity and incorporation of carbonate species in the final Al product to form KAl(CO3)(OH)2. Higher humidity enables more acid generation that destabilizes dawsonite and favors gibbsite as the solubility limiting phase. Because the transformation was restricted to occur in thin water films, the results suggest that transition from tetra- to octahedrally coordinated Al does not have to occur in bulk solution, as has often been hypothesized, but may instead appear on the source mineral surface.

Dembowski, Mateusz↗

BioXTAS RAW 2 : new developments for a free open-source program for small-angle scattering data reduction and analysis

BioXTAS RAW is a free open-source program for reduction, analysis and modelling of biological small-angle scattering data. Here, the new developments in RAW version 2 are described. These include improved data reduction using pyFAI ; updated automated Guinier fitting and D max finding algorithms; automated series ( e.g. size-exclusion chromatography coupled small-angle X-ray scattering or SEC-SAXS) buffer- and sample-region finding algorithms; linear and integral baseline correction for series; deconvolution of series data using regularized alternating least squares ( REGALS ); creation of electron-density reconstructions using electron density via solution scattering ( DENSS ); a comparison window showing residuals, ratios and statistical comparisons between profiles; and generation of PDF reports with summary plots and tables for all analysis. Furthermore, there is now a RAW API, which can be used without the graphical user interface (GUI), providing full access to all of the functionality found in the GUI. In addition to these new capabilities, RAW has undergone significant technical updates, such as adding Python 3 compatibility, and has entirely new documentation available both online and in the program.

97 MATHEMATICS AND COMPUTING↗

Quantifying neptunium oxidation states in nitric acid through spectroelectrochemistry and chemometrics

Controlled-potential in situ thin-layer spectropotentiometry was leveraged to generate visible/near-infrared (VIS/NIR) absorption spectral data sets for the development of chemometric models to quantify Np(III/IV/V/VI) oxidation states in HNO 3 . This technology would be valuable in laboratory studies and when monitoring process solutions to guide feed adjustments for radiochemical separations—the performance of which depends on oxidation state. This approach successfully isolated and stabilized Np species in pure (~99%) oxidation states without compromising solution optical properties. Multivariate curve resolution–alternating least squares models were evaluated to resolve spectral and component concentrations from a scan that sequentially produced Np(VI), Np(V), Np(IV), and Np(III) spectra with mixtures of two valences at a time. Although it provided a useful approximation, the method was not able to quantitively resolve each component likely because of rotational ambiguity. Additionally, partial least squares regression models were built from artificial and electrochemically generated VIS/NIR spectral training sets to study the effect of interionic interactions on spectral characteristics. Models built with true Bi-chemical mixtures of coexisting Np oxidation states and spectra generated from additive combinations of pure end points had similar prediction performance. This methodology can be used to directly quantify Np concentration and the ratio of Np oxidation states and other actinides in remote settings such as hot cells.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗

Reverse-mode differentiation in arbitrary tensor network format: with application to supervised learning.

This paper describes an efficient reverse-mode differentiation algorithm for contraction operations of tensor networks that may have arbitrary and unconventional network topologies. The approach leverages the tensor contraction tree of Evenbly and Pfeifer (2014), which provides an instruction set for the contraction sequence of a network. We show that this tree can be efficiently leveraged for differentiation of a full tensor network contraction using a recursive scheme that exploits (1) the bilinear property of contraction and (2) the property that trees have single path from root to leaves. While differentiation of tensor-tensor contraction is already possible in most automatic differentiation packages, we show that exploiting these two additional properties in the specific context of contraction sequences can improve efficiency. Following a description of the algorithm and computational complexity analysis, we investigate its utility for gradient-based supervised learning for low-rank function recovery and for fitting real-world unstructured datasets. We demonstrate improved performance over alternating least-squares optimization approaches and the capability to handle heterogeneous and arbitrary tensor network formats. When compared to alternating minimization algorithms, we find that the gradient-based approach requires a smaller oversampling ratio (number of samples compared to number model parameters) for recovery. This increased efficiency extends to fitting unstructured data of varying dimensionality and when employing a variety of tensor network formats. Here, we show improved learning using the hierarchical Tucker method over the tensor-train in high-dimensional settings on a number of benchmark problems.

97 MATHEMATICS AND COMPUTING↗

Distributed-Memory Parallel JointNMF

Joint Nonnegative Matrix Factorization (JointNMF) is a hybrid method for mining information from datasets that contain both feature and connection information. We propose distributed-memory parallelizations of three algorithms for solving the JointNMF problem based on Alternating Nonnegative Least Squares, Projected Gradient Descent, and Projected Gauss-Newton. We extend well-known communication-avoiding algorithms using a single processor grid case to our coupled case on two processor grids. We demonstrate the scalability of the algorithms on up to 960 cores (40 nodes) with 60% parallel efficiency. The more sophisticated Alternating Nonnegative Least Squares (ANLS) and Gauss-Newton variants outperform the first-order gradient descent method in reducing the objective on large-scale problems. We perform a topic modelling task on a large corpus of academic papers that consists of over 37 million paper abstracts and nearly a billion citation relationships, demonstrating the utility and scalability of the methods.

Eswar, Srinivas↗

Low rank approximation in simulations of quantum algorithms

Simulating quantum algorithms on classical computers is challenging when the system size, i.e., the number of qubits used in the quantum algorithm, is moderately large. However, some quantum algorithms and the corresponding quantum circuits can be simulated efficiently on a classical computer if the input quantum state is a low rank tensor and all intermediate states of the quantum algorithm can be represented or approximated by low rank tensors. Here, in this paper, we examine the possibility of simulating a few quantum algorithms by using low-rank canonical polyadic (CP) decomposition to represent the input and all intermediate states of these algorithms. Two rank reduction algorithms are used to enable efficient simulation. We show that some of the algorithms preserve the low rank structure of the input state and can thus be efficiently simulated on a classical computer. However, the rank of the intermediate states in other quantum algorithms can increase rapidly, making efficient simulation more difficult. To some extent, such difficulty reflects the advantage or superiority of a quantum computer over a classical computer. As a result, understanding the low rank structure of a quantum algorithm allows us to identify algorithms that can benefit significantly from quantum computers.

97 MATHEMATICS AND COMPUTING↗

Notes on Regression Analysis for Radar Parameter Estimation

A fundamental task of radar, beyond merely detecting a target, is to estimate some parameters associated with it. For example, this might include range, direction, velocity, etc. In any case, multiple measurements, often noisy, need to be processed to yield a ‘best estimate’ of the parameter. A common mathematical method for doing so is called “Regression” analysis. The goal is to minimize the expected squared error in the estimate. Even when alternate algorithms are considered, the least squared-error regression analysis is the benchmark against which alternatives are compared.

47 OTHER INSTRUMENTATION↗

A fast two-stage algorithm for non-negative matrix factorization in smoothly varying data

This article reports the study of algorithms for non-negative matrix factorization (NMF) in various applications involving smoothly varying data such as time or temperature series diffraction data on a dense grid of points. Utilizing the continual nature of the data, a fast two-stage algorithm is developed for highly efficient and accurate NMF. In the first stage, an alternating non-negative least-squares framework is used in combination with the active set method with a warm-start strategy for the solution of subproblems. In the second stage, an interior point method is adopted to accelerate the local convergence. The convergence of the proposed algorithm is proved. The new algorithm is compared with some existing algorithms in benchmark tests using both real-world data and synthetic data. Furthermore, the results demonstrate the advantage of the algorithm in finding high-precision solutions.

interior point method↗

Standardising the “Gregory method” for calculating equilibrium climate sensitivity

The equilibrium climate sensitivity (ECS) – the equilibrium global mean temperature response to a doubling of atmospheric CO 2 – is a high-profile metric for quantifying the Earth system's response to human-induced climate change. A widely applied approach to estimating the ECS is the “Gregory method” (Gregory et al., 2004), which uses an ordinary least squares (OLS) regression between the net radiative flux, N, and surface air temperature anomalies, ΔT, from a 150 year experiment in which atmospheric CO 2 concentrations are quadrupled. The ECS is determined by extrapolating the linear fit to N=0, i.e. the ΔT-intercept, indicating the point at which the system is back in equilibrium. This method has been used to compare ECS estimates across the CMIP5 and CMIP6 ensembles and will likely be a key diagnostic for CMIP7. Despite its widespread application, there is little consistency or transparency between studies in how the climate model data is processed prior to the regression, leading to potential discrepancies in ECS estimates. We identify 32 alternative data processing pathways, varying by differences in global mean weighting, net radiative flux variable, anomaly calculation method, and linear regression fit. Using 44 CMIP6 models, we systematically assess the impact of these choices on ECS estimates and calculate uncertainty ranges using two bootstrap approaches. While the inter-model ECS range is insensitive to the data processing pathway, individual outlier models exhibit notable differences. Approximating a model's native grid cell area (if irregular) with cosine of the latitude can decrease the ECS by 11 %, the choice of N-variable can change the ECS by 6 %, and some anomaly calculation methods can introduce spurious temporal correlations in the processed data. Beyond data processing choices, we also evaluate an alternative linear regression method – total least squares (TLS) – which has a more statistically robust basis than OLS. However, for consistency with previous literature, and given TLS may reduce the ECS compared to OLS (by up to 24 %), thereby making a known bias in the Gregory method worse, we do not feel there is sufficient clarity to recommend a transition to TLS in all cases. To improve reproducibility and comparability in future studies, we recommend a standardised Gregory method: weighting the global mean by cell area, using the top of the atmosphere (as opposed to the top of model) N-variable, and calculating anomalies by first applying a rolling average to the preindustrial control timeseries then subtracting from the raw CO 2 quadrupling experiment. This approach accounts for model drift while reducing noise in the data to best meet the pre-conditions of the linear regression. While CMIP6 results of the multi-model mean ECS appear insensitive to these processing choices, similar assumptions may not hold for CMIP7, underscoring the need for standardised data preparation in future climate sensitivity assessments.

Geosciences↗

QuadSync: Quadrifocal tensor synchronization via Tucker decomposition

In structure from motion, quadrifocal tensors capture more information than their pairwise counterparts (essential matrices), yet they have often been thought of as impractical and only of theoretical interest. In this work, we challenge such beliefs by providing a new framework to recover n cameras from the corresponding collection of quadrifocal tensors. We form the block quadrifocal tensor and show that it admits a Tucker decomposition whose factor matrices are the stacked camera matrices, and which thus has a multilinear rank of (4,4,4,4) independent of n. We develop the first synchronization algorithm for quadrifocal tensors, using Tucker decomposition, alternating direction method of multipliers, and iteratively reweighted least squares. We further establish relationships between the block quadrifocal, trifocal, and bifocal tensors, and introduce an algorithm that jointly synchronizes these three entities. Numerical experiments demonstrate the effectiveness of our methods on modern datasets, indicating the potential and importance of using higher-order information in synchronization.

Miao, Daniel [University of Minnesota]↗

Two-Level Sketching Alternating Anderson Acceleration for Complex Physics Applications

We present a novel two-level sketching extension of the Alternating Anderson–Picard (AAP) method for accelerating fixed-point iterations in challenging single- and multiphysics simulations governed by discretized PDEs. Our approach combines a static, physics-based projection that reduces the least-squares (LS) problem to the most informative field (e.g., via Schur-complement insight) with a dynamic, algebraic sketching stage driven by a backward stability analysis under Lipschitz continuity. We introduce inexpensive estimators for stability thresholds and cache-aware randomized selection strategies to balance computational cost against memory access overhead. The resulting algorithm solves reduced LS systems in place, minimizes memory footprints, and seamlessly alternates between low-cost Picard updates and Anderson mixing. Implemented in Julia, our two-level sketching AAP achieves up to 50% time-to-solution reductions compared to standard Anderson acceleration—without degrading convergence rates—on benchmark problems including Stokes, 𝑝-Laplacian, bidomain, and Navier–Stokes formulations at varying problem sizes. These results demonstrate the method’s robustness, scalability, and potential for integration into high-performance scientific computing frameworks. Our implementation is available open source in the AAP.jl library.

Barnafi, Nicolas [University of Chile, Santiago]↗