Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “spectral statistics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

The need for multicomponent dust attenuation in modeling nebular emission: Constraints from SDSS-IV MaNGA

A fundamental assumption adopted in nearly every extragalactic study that analyzes optical emission lines is that the attenuation of different emission lines can be described by a single attenuation curve, scaled by a single reddening parameter, usually E(B - V). Here we show this assumption fails in many cases with important implications for derived results. We developed a new method to measure the differential nebular attenuation among three kinds of transitions: the Balmer lines of hydrogen; high-ionization transitions (> 13.6 eV) including [Ne III], [O III], and [S III]; and low-ionization transitions (≲13.6 eV) including [O II], [N II], and [S II]. This method bins the observed data in a multidimensional space spanned by attenuation-insensitive line ratios. Within each small bin, the variations in nebular parameters such as the metallicity and ionization parameter are negligible compared to the variation in the nebular attenuation. This allowed us to measure the nebular attenuation using both forbidden lines and Balmer lines. We applied this method to a sample of 2.4 million star-forming (SF) spaxels from the Mapping Nearby Galaxies at Apache Point Observatory (MaNGA) survey. We found that the attenuation of high ionization lines and Balmer lines can be well described by a single Fitzpatrick (1999, PASP, 111, 63) extinction curve with R V = 3.1. However, no single attenuation curve can simultaneously account for these transitions and the derived attenuation of low-ionization lines. This strongly suggests that different lines have different effective attenuations, likely because spectroscopy at hundreds of parsecs to kiloparsecs of resolution mixes multiple physical regions that exhibit different intrinsic line ratios and different levels of attenuation. As a result, the assumption that different lines follow the same attenuation curve breaks down. Using a single attenuation curve determined by Balmer lines to correct attenuation-sensitive forbidden line ratios could bias the nebular parameters derived by 0.06–0.25 dex at A V = 1, depending on the details of the dust attenuation model. Observations of a statistically large sample of H II regions with high spatial resolutions and large spectral coverage are vital for improved modeling and deriving accurate corrections for this effect.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2020

Extended nonergodic regime and spin subdiffusion in disordered SU(2)-symmetric Floquet systems

In this work, we explore thermalization and quantum dynamics in a one-dimensional disordered SU(2)-symmetric Floquet model, where a many-body localized phase is prohibited by the non-Abelian symmetry. Despite the absence of localization, we find an extended nonergodic regime at strong disorder where the system exhibits nonthermal behaviors. In the strong disorder regime, the level spacing statistics exhibit neither a Wigner-Dyson nor a Poisson distribution, and the spectral form factor does not show a linear-in-time growth at early times characteristic of random matrix theory. The average entanglement entropy of the Floquet eigenstates is subthermal, although violating an area-law scaling with system sizes. We further compute the expectation value of local observables and find strong deviations from the eigenstate thermalization hypothesis. The infinite-temperature spin autocorrelation function decays at long times as $t^{–β}$ with $\textit{β}$ < 0.5, indicating subdiffusive transport at strong disorders.

36 MATERIALS SCIENCE↗
DOE OSTI2024

PROVABGS: The Probabilistic Stellar Mass Function of the BGS One-percent Survey

We present the probabilistic stellar mass function (pSMF) of galaxies in the DESI Bright Galaxy Survey (BGS), observed during the One-percent Survey. The One-percent Survey was one of DESI's survey validation programs conducted from 2021 April to May, before the start of the main survey. It used the same target selection and similar observing strategy as the main survey and successfully observed the spectra and redshifts of 143,017 galaxies in the r < 19.5 magnitude-limited BGS Bright sample and 95,499 galaxies in the fainter surface-brightness- and color-selected BGS Faint sample over z < 0.6. We derive pSMFs from posteriors of stellar mass, M*, inferred from DESI photometry and spectroscopy using the Hahn et al. PRObabilistic Value-Added BGS (PROVABGS) Bayesian spectral energy distribution modeling framework. We use a hierarchical population inference framework that statistically and rigorously propagates the M* uncertainties. Furthermore, we include correction weights that account for the selection effects and incompleteness of the BGS observations. We present the redshift evolution of the pSMF in BGS, as well as the pSMFs of star-forming and quiescent galaxies classified using average specific star formation rates from PROVABGS. Overall, the pSMFs show good agreement with previous stellar mass function measurements in the literature. Our pSMFs showcase the potential and statistical power of BGS, which in its main survey will observe >100 × more galaxies. Moreover, we present the statistical framework for subsequent population statistics measurements using BGS, which will characterize the global galaxy population and scaling relations at low redshifts with unprecedented precision.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Rapid measurement of soluble xylo-oligomers using near-infrared spectroscopy (NIRS) and multivariate statistics: calibration model development and practical approaches to model optimization

Rapid monitoring of biomass conversion processes using techniques such as near-infrared (NIR) spectroscopy can be substantially quicker and less labor-, resource-, and energy-intensive than conventional measurement techniques such as gas or liquid chromatography (GC or LC) due to the lack of solvents and preparation methods, as well as removing the need to transfer samples to an external lab for analytical evaluation. The purpose of this study was to determine the feasibility of rapid monitoring of a biomass conversion process using NIR spectroscopy combined with multivariate statistical modeling, and to examine the impact of (1) subsetting the samples in the original dataset by process location and (2) reducing the spectral range used in the calibration model on model performance. We develop multivariate calibration models for the concentrations of soluble xylo-oligosaccharides (XOS), monomeric xylose, and total solids at multiple points in a biomass conversion process which produces and then purifies XOS compounds from sugar cane bagasse. A single model using samples from multiple locations in the process stream showed acceptable performance as measured by standard statistical measures. However, compared to the single model, we show that separate models built by segregating the calibration samples according to process location show improved performance. We also show that combining an understanding of the sample spectra with simple multivariate analysis tools can result in a calibration model with a substantially smaller spectral range that provides essentially equal performance to the full-range model. We demonstrate that real-time monitoring of soluble xylo-oligosaccharides (XOS), monomeric xylose, and total solids concentration at multiple points in a process stream using NIR spectroscopy coupled with multivariate statistics is feasible. Segregation of sample populations by process location improves model performance. Models using a reduced spectral range containing the most relevant spectral signatures show very similar performance to the full-range model, reinforcing the importance of performing robust exploratory data analysis before beginning multivariate modeling.

09 BIOMASS FUELS↗
DOE OSTI2021

Chemometrics and Experimental Design for the Quantification of Nitrate Salts in Nitric Acid: Near-Infrared Spectroscopy Absorption Analysis

Implementing remote, real-time spectroscopic monitoring of radiochemical processing streams in hot cell environments requires efficiency and simplicity. The success of optical spectroscopy for the quantification of species in chemical systems highly depends on representative training sets and suitable validation sets. Selecting a training set (i.e., calibration standards) to build multivariate regression models is both time- and resource-consuming using standard one-factor-at-a-time approaches. This study describes the use of experimental design to generate spectral training sets and a validation set for the quantification of sodium nitrate (0–1 M) and nitric acid (0.1–10 M) using the near-infrared water band centered at 1440 nm. Partial least squares regression models were built from training sets generated by both D- and I-optimal experimental designs and a one-factor-at-a-time approach. The prediction performance of each model was evaluated by comparing the bias and standard error of prediction for statistical significance. D- and I-optimal designs reduced the number of samples required to build regression models compared with one-factor-at-a-time while also improving performance. Models must be confirmed against a validation sample set when minimizing the number of samples in the training set. The D-optimal design performed the best when considering both performance and efficiency by improving predictive capability and reducing number of samples in the training set by 64% compared with the one-factor-at-a-time approach. The experimental design approach objectively selects calibration and validation spectral data sets based on statistical criterion to optimize performance and minimize resources.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗
DOE OSTI2026

Spectral Properties and Energy Injection in Mercury's Magnetotail Current Sheet

Mercury's magnetotail hosts a thin and highly dynamic current sheet (CS), where magnetic reconnection and strong fluctuations frequently occur. Here, we statistically analyze magnetic field power spectra across 370 magnetotail CSs observed by MESSENGER. About 20% of the events are quasi-laminar, showing single power-law spectra, whereas ∼80% are turbulent, exhibiting a spectral break separating inertial and kinetic ranges. A dawn–dusk asymmetry is identified: inertial-range slopes are systematically shallower on the dawnside, whereas kinetic-range slopes are steeper, indicating more developed turbulence there, consistent with the higher occurrence of reconnection-related processes on the dawnside. Component analysis shows that the transverse components, orthogonal to the tail-aligned principal field ( B X ), display shallow slopes near −1 in the inertial range, suggesting energy injection at ion scales rather than a classical inertial range. These results demonstrate that Mercury's unique plasma environment fundamentally reshapes the initiation of turbulence and the redistribution of energy in the magnetotail.

Mercury↗
DOE OSTI2022

An Improved Method for Coupling Hydrodynamics with Astrophysical Reaction Networks

Reacting astrophysical flows can be challenging to model, because of the difficulty in accurately coupling hydrodynamics and reactions. This can be particularly acute during explosive burning or at high temperatures where nuclear statistical equilibrium is established. We develop a new approach, based on the ideas of spectral deferred corrections (SDC) coupling of explicit hydrodynamics and stiff reaction sources as an alternative to operator splitting, that is simpler than the more comprehensive SDC approach we demonstrated previously. We apply the new method to a double-detonation problem with a moderately sized astrophysical nuclear reaction network and explore the time step size and reaction network tolerances, to show that the simplified-SDC approach provides improved coupling with decreased computational expense compared to traditional Strang operator splitting. This is all done in the framework of the Castro hydrodynamics code, and all algorithm implementations are freely available.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2025

Changing-look Active Galactic Nuclei from the Dark Energy Spectroscopic Instrument. II. Statistical Properties from the First Data Release

We present the identification of changing-look active galactic nuclei (CL-AGNs) from the Dark Energy Spectroscopic Instrument First Data Release and Sloan Digital Sky Survey Data Release 16 at z ≤ 0.9. To confirm the CL-AGNs, we utilize spectral flux calibration assessment via an [O III ]-based calibration, pseudophotometry examination, and visual inspection. This rigorous selection process allows us to compile a statistical catalog of 561 CL-AGNs, encompassing 527 Hβ, 149 Hα, and 129 Mg II CL behaviors. In this sample, we find (1) a 283:278 ratio of turn-on to turn-off CL-AGNs. (2) The median Eddington ratio for CL-AGNs in the dim state is approximately λ Edd ∼ 0.01. (3) A strong correlation between the change in the luminosity of the broad emission lines (BELs) and variation in the continuum luminosity, with Mg II and Hβ displaying similar responses during CL phases. (4) The Baldwin–Phillips–Terlevich diagram for CL-AGNs shows no statistical difference from the general AGN catalog. (5) Five CL-AGNs are associated with asymmetrical mid-infrared flares, possibly linked to tidal disruption events. Given the large CL-AGN sample and the stochastic sampling of spectra, we propose that some CL phenomena are inherently due to typical AGN variability during low accretion rates, particularly for CL phenomenon only occurring on one BEL. Finally, we introduce a monotonically dimming CL phase for objects characterized by a gradual decline over decades in the light curve and the complete disappearance of entire BELs in faint spectra, indicative of a real transition in the accretion disk.

accretion↗
DOE OSTI2025

Changing-look Active Galactic Nuclei from the Dark Energy Spectroscopic Instrument. II. Statistical Properties from the First Data Release

We present the identification of changing-look active galactic nuclei (CL-AGNs) from the Dark Energy Spectroscopic Instrument First Data Release and Sloan Digital Sky Survey Data Release 16 at z≤ 0.9. To confirm the CL-AGNs, we utilize spectral flux calibration assessment via an [O iii]-based calibration, pseudophotometry examination, and visual inspection. This rigorous selection process allows us to compile a statistical catalog of 561 CL-AGNs, encompassing 527 Hβ, 149 Hα, and 129 Mg ii CL behaviors. In this sample, we find (1) a 283:278 ratio of turn-on to turn-off CL-AGNs. (2) The median Eddington ratio for CL-AGNs in the dim state is approximately λ$_{Edd}$ ∼ 0.01. (3) A strong correlation between the change in the luminosity of the broad emission lines (BELs) and variation in the continuum luminosity, with Mg ii and Hβ displaying similar responses during CL phases. (4) The Baldwin–Phillips–Terlevich diagram for CL-AGNs shows no statistical difference from the general AGN catalog. (5) Five CL-AGNs are associated with asymmetrical mid-infrared flares, possibly linked to tidal disruption events. Given the large CL-AGN sample and the stochastic sampling of spectra, we propose that some CL phenomena are inherently due to typical AGN variability during low accretion rates, particularly for CL phenomenon only occurring on one BEL. Finally, we introduce a monotonically dimming CL phase for objects characterized by a gradual decline over decades in the light curve and the complete disappearance of entire BELs in faint spectra, indicative of a real transition in the accretion disk.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Inexact iterative numerical linear algebra for neural network-based spectral estimation and rare-event prediction

Understanding dynamics in complex systems is challenging because there are many degrees of freedom, and those that are most important for describing events of interest are often not obvious. The leading eigenfunctions of the transition operator are useful for visualization, and they can provide an efficient basis for computing statistics, such as the likelihood and average time of events (predictions). Here, we develop inexact iterative linear algebra methods for computing these eigenfunctions (spectral estimation) and making predictions from a dataset of short trajectories sampled at finite intervals. We demonstrate the methods on a low-dimensional model that facilitates visualization and a high-dimensional model of a biomolecular system. Implications for the prediction problem in reinforcement learning are discussed.

Chemistry↗
DOE OSTI2021

Power spectrum and form factor in random diagonal matrices and integrable billiards

Triggered by a controversy surrounding a universal behavior of the power spectrum in quantum systems exhibiting regular classical dynamics, we focus on a model of random diagonal matrices (RDM), often associated with the Poisson spectral universality class, and examine how the power spectrum and the form factor get affected by two-sided truncations of RDM spectra. Having developed a nonperturbative description of both statistics, we perform their detailed asymptotic analysis to demonstrate explicitly how a traditional assumption (lying at the heart of the controversy) – that the power spectrum is merely determined by the spectral form factor – breaks down for truncated spectra. This observation has important consequences as we further argue that bounded quantum systems with integrable classical dynamics are described by heavily truncated rather than complete RDM spectra. High-precision numerical simulations of semicircular and irrational rectangular billiards lend independent support to these conclusions.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2021

Radio Frequency Characteristics of Volcanic Lightning and Vent Discharges

In this study, we analyze the pulse width and spectral content of vent discharges and volcanic lightning flashes. We made measurements of electrical activity with a broadband very high frequency antenna (20–80 MHz) during an explosive eruption of Sakurajima volcano on November 8, 2019. The individual impulses that comprise vent discharges and volcanic lightning were analyzed to determine the fundamental width of the impulses and the rate of fall-off of their energy spectral density. The results show that vent discharges are more similar to volcanic lightning than they are different. Here, the mean pulse width for both vent discharges and volcanic lightning was 50 ns. Both types of electrical activity had similar spectral content; the average slope of the amplitude spectra was –3.4 for both. Further, examination of the pulse width and spectral slope distributions showed that while the distributions of volcanic lightning and vent discharges are statistically distinct from each other, the distribution of vent discharges is a subset of the distribution of volcanic lightning.

58 GEOSCIENCES↗
DOE OSTI2022

Unsupervised Machine Learning for Exploratory Data Analysis of Exoplanet Transmission Spectra

Abstract Transit spectroscopy is a powerful tool for decoding the chemical compositions of the atmospheres of extrasolar planets. In this paper, we focus on unsupervised techniques for analyzing spectral data from transiting exoplanets. After cleaning and validating the data, we demonstrate methods for: (i) initial exploratory data analysis, based on summary statistics (estimates of location and variability); (ii) exploring and quantifying the existing correlations in the data; (iii) preprocessing and linearly transforming the data to its principal components; (iv) dimensionality reduction and manifold learning; (v) clustering and anomaly detection; and (vi) visualization and interpretation of the data. To illustrate the proposed unsupervised methodology, we use a well-known public benchmark data set of synthetic transit spectra. We show that there is a high degree of correlation in the spectral data, which calls for appropriate low-dimensional representations. We explore a number of different techniques for such dimensionality reduction and identify several suitable options in terms of summary statistics, principal components, etc. We uncover interesting structures in the principal component basis, namely well-defined branches corresponding to different chemical regimes of the underlying atmospheres. We demonstrate that those branches can be successfully recovered with a K-means clustering algorithm in a fully unsupervised fashion. We advocate for lower-dimensional representations of the spectroscopic data in terms of the main principal components, in order to reveal the existing structure in the data and quickly characterize the chemical class of a planet.

Matchev, Konstantin T. (ORCID:0000000341829096)↗
DOE OSTI2020

Detecting and tracking drift in quantum information processors

Abstract If quantum information processors are to fulfill their potential, the diverse errors that affect them must be understood and suppressed. But errors typically fluctuate over time, and the most widely used tools for characterizing them assume static error modes and rates. This mismatch can cause unheralded failures, misidentified error modes, and wasted experimental effort. Here, we demonstrate a spectral analysis technique for resolving time dependence in quantum processors. Our method is fast, simple, and statistically sound. It can be applied to time-series data from any quantum processor experiment. We use data from simulations and trapped-ion qubit experiments to show how our method can resolve time dependence when applied to popular characterization protocols, including randomized benchmarking, gate set tomography, and Ramsey spectroscopy. In the experiments, we detect instability and localize its source, implement drift control techniques to compensate for this instability, and then demonstrate that the instability has been suppressed.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Avalanches and many-body resonances in many-body localized systems

Here we numerically study both the avalanche instability and many-body resonances in strongly disordered spin chains exhibiting many-body localization (MBL). Finite-size systems behave like MBL within the MBL regimes, which we divide into the asymptotic MBL phase and the finite-size MBL regime; the latter regime is, however, thermal in the limit of large systems and long times. In both Floquet and Hamiltonian models, we identify some landmarks within the MBL regimes. Our first landmark is an estimate of where the MBL phase becomes unstable to avalanches, obtained by measuring the slowest relaxation rate of a finite chain coupled to an infinite bath at one end. Our estimates indicate that the actual MBL-to-thermal phase transition occurs much deeper in the MBL regimes than has been suggested by most previous studies. Our other landmarks involve systemwide many-body resonances: We find that the effective matrix elements producing eigenstates with systemwide many-body resonances are enormously broadly distributed. This broad distribution means that the onset of such resonances in typical samples occurs quite deep in the MBL regimes, and the first such resonances typically involve rare pairs of eigenstates that are farther apart in energy than the minimum gap. Thus we find that the resonance properties define two landmarks that divide the MBL regimes of finite-size systems into three subregimes: (i) at strongest randomness, typical samples do not have any eigenstates that are involved in systemwide many-body resonances; (ii) there is a substantial intermediate subregime where typical samples do have such resonances but the pair of eigenstates with the minimum spectral gap does not, so the size of the minimum gap agrees with expectations from Poisson statistics; and (iii) in the weaker randomness subregime, the minimum gap is larger than predicted by Poisson level statistics because it is involved in a many-body resonance and thus subject to level repulsion. Nevertheless, even in this third subregime, all but a vanishing fraction of eigenstates remain nonresonant and the system thus still appears MBL in most respects. Based on our estimates of the location of the avalanche instability, it might be that the MBL phase is only part of subregime (i) and the other subregimes are entirely in the thermal phase, even though they look localized in most respects, so are in the finite-size MBL regime.

36 MATERIALS SCIENCE↗
DOE OSTI2025

One-shot gas detection with transformer paired neural networks in Mako collected longwave infrared hyperspectral imagery

To date, careful data treatment workflows and statistical detectors are used to perform hyperspectral image (HSI) detection of any gas contained in a spectral library, which is often expanded with physics models to incorporate different spectral characteristics. In general, surrounding evidence or known gas-release parameters are used to provide confidence in or confirm detection capability, respectively. This makes quantifying detection performance difficult as it is nearly impossible to develop an absolute ground truth for gas target pixel presence in collected HSI. Consequently, developing and comparing new detection methods, especially machine learning (ML)-based methods, is susceptible to subjectivity in derived detection map quality. Here, in this work, we demonstrate the first use of transformer-based paired neural networks (PNNs) for one-shot gas target detection for multiple gases while providing quantitative classification and detection metrics for their use on labeled data. Terabytes of training data are generated from a database of long-wave infrared HSI obtained from historical Mako sensor campaigns over Los Angeles. By incorporating labels, singular signature representations, and a model development pipeline, we can tune and select PNNs to detect multiple gas targets that are not seen in training on a quantitative basis. We additionally assess our test set detections using interpretability techniques widely employed with ML-based predictors, but less common with detection methods relying on learned latent spaces.

Hyperspectral imaging↗
DOE OSTI2024

Hyperspectral Detection of the Fluorescence Shift between Chirality-Sorted Empty and Water-Filled Single-Wall Carbon Nanotube Enantiomers

Single-wall carbon nanotubes (SWCNTs) have extraordinary electronic and optical properties that depend strongly on their exact chiral structure and their interaction with their inner and outer environment. The fluorescence (PL) of semiconducting SWCNTs, for instance, will shift depending on the molecules with which the SWCNT’s hollow core is filled. These interaction-induced shifts are challenging to resolve on the ensemble level in samples containing a mixture of different filling contents due to the relatively large inhomogeneous line width of the ensemble SWCNT PL compared to the size of these shifts. To circumvent this inhomogeneous broadening, single-tube spectroscopy and hyperspectral imaging are often applied, which until now required time-consuming statistical studies. Here, we present hyperspectral PL microscopy combined with automated SWCNT segmenting based on either principal component analysis or a convolutional neural network, capable of both spatially and spectrally resolving the PL along the length of many individual SWCNTs at the same time and automatically fitting peak positions and line widths of individual SWCNTs. The methodology is demonstrated by accurately determining the emission shifts and line widths of thousands of left- and right-handed empty and water-filled SWCNTs coated with a chiral surfactant, resulting in four statistical distributions which cannot be resolved in ensemble spectroscopy of unsorted samples. The results demonstrate a robust method to quickly probe ensemble properties with single-enantiomer spectral resolution. Moreover, it promises to be an absolute quantitative method to characterize the relative abundances of SWCNTs with different handedness or filling content in macroscopic samples, simply by counting individual species.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Resolving turbulent magnetohydrodynamics: a hybrid operator-diffusion framework

We present a hybrid machine learning framework that combines physics-informed neural operators (PINOs) with score-based generative diffusion models to simulate the full spatio-temporal evolution of two-dimensional, incompressible, resistive magnetohydrodynamic turbulence across a broad range of Reynolds numbers (Re). The framework leverages the equation-constrained generalization capabilities of PINOs to predict coherent, low-frequency dynamics, while a conditional diffusion model stochastically corrects high-frequency residuals, enabling accurate modeling of fully developed turbulence. Trained on a comprehensive ensemble of high-fidelity simulations with Re ϵ {100, 250, 500, 750, 1000, 3000, 10000}, the approach achieves state-of-the-art accuracy in regimes previously inaccessible to deterministic surrogates. At Re = 1000 and 3000, the model faithfully reconstructs the full spectral energy distributions of both velocity and magnetic fields late into the simulation, capturing non-Gaussian statistics, intermittent structures, and cross-field correlations with high fidelity. At extreme turbulence levels (Re = 10 000), it remains the first surrogate capable of recovering the high-wavenumber evolution of the magnetic field, preserving large-scale morphology and enabling statistically meaningful predictions.

Diffusion-Integrated Neural Operators↗