Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “clustering statistics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 685 records · Page 38

Accurate and efficient parameterization of an atomic cluster expansion (ACE) potential for ammonia under extreme conditions

We present a machine learning interatomic potential for ammonia designed to capture its complex multiphase behavior, including both molecular and superionic phases. The potential is based on the atomic cluster expansion (ACE) formulation and has been parameterized to facilitate high-fidelity molecular dynamics simulations of ammonia under extreme conditions, for pressures up to 100 GPa and for temperatures above 500 K and up to 6000 K. A diverse range of configurations was generated through high-quality ab initio molecular dynamics simulations, covering insulating and superionic ice phases, liquid ammonia, molecular nitrogen (N 2 ) and hydrogen (H 2 ), and metastable compounds that form upon dissociation, including $NH^{+}_{4}$, $H^{+}_{3}$, N 2 H 4 , and N 3 H. We demonstrate that the ammonia ACE potential accurately reproduces experimental and density functional theory predicted isotherms and Hugoniots. Crucially, the potential is able to capture the intricate phase behavior of ammonia, including the transition from insulating molecular fluid to the superionic phase. This work provides a robust interatomic potential that can be used for large-scale, accurate simulations of ammonia under extreme thermodynamic conditions, offering a powerful tool for investigating its behavior in various phases and applications.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Beyond mass: detecting secondary halo properties with galaxy-galaxy lensing

ABSTRACT Secondary halo properties beyond mass, such as the mass accretion rate (MAR), concentration, and the half mass scale, are essential in understanding the formation of large-scale structure and dark matter haloes. In this paper, we study the impact of secondary halo properties on the galaxy-galaxy lensing observable, ΔΣ. We build an emulator trained on N-body simulations to model ΔΣ and quantify the impact of different secondary parameters on the ΔΣ profile. We focus on the impact of MAR on ΔΣ. We show that a 3σ detection of variations in MAR at fixed halo mass could be achieved with the Hyper Suprime Cam survey assuming no baryonic effects and a proxy for MAR with scatter <1.5. We show that the full radial profile of ΔΣ depends on secondary properties at fixed halo mass. Consequently, an emulator that can perform full shape fitting yields better than two times improvement upon the constraints on MAR than only using the outer part of the halo. Finally, we highlight that miscentring and MAR impact the radial profile of ΔΣ in a similar fashion, implying that miscentring and MAR need to be modelled jointly for unbiased estimates of both effects. We show that present-day lensing data sets have the statistical capability to place constraints on halo MAR within our assumptions. Our analysis opens up new possibilities for observationally measuring the assembly history of the dark matter haloes that host galaxies and clusters.

79 ASTRONOMY AND ASTROPHYSICS↗

Maximizing the impact of the Vera Rubin Observatory LSST, and DESI and CMB-S4 experiments in constraining gravity and dark sector physics

The work in this award has addressed our objectives on a number of fronts: Current graduate student Chris Wilson and Bean are determining how cosmic voids can be used to test the properties of gravity, leveraging simulations from DESI collaborator Baojiu Li and refining theoretical Gaussian Streaming Model approaches to predict galaxy dynamics in voids when the cosmology is not GR. This work is still underway, including analyses of the efficacy of void quadrupole correlation statistics and void size functions when studying dark matter halo statistics or the expected galaxy distributions from upcoming galaxy surveys; Current graduate student Yulin Gong, Bean with collaborators are refining techniques to extract out the kinetic Sunyaev Zel’dovich effect from galaxy cluster survey data and CMB temperature anisotropies, with the intent to further ready this pipeline development in readiness for spectroscopic data from DESI and LSST along with CMB-S4 measurements.

79 ASTRONOMY AND ASTROPHYSICS↗

X-ray emission from galaxies and the universe

The study of X-ray emission from normal galaxies began with the launch of the Einstein Observatory in 1978. Galaxies of all Hubble types and point sources are discussed. It is concluded that statistical studies of bright Galactic sources, which relate to their evolution, are reliant upon the discovery of sources in many galaxies. It is also concluded that a substantial future increase (the Virgo cluster galaxies) requires a telescope system with better than arcminute resolution and a sensitivity better than 10 x that of Einstein.

Fabian, A. C.↗

Data driven investigation to understand the influence of total solids on biological biogas upgrading

In situ biogas upgrading achieves CO 2 conversion to CH 4 via hydrogenotrophic methanogenesis; however, gas-liquid mass transfer constraints limit the upgrading performance. Recognizing that optimization studies often underrepresent the effects of total solids (TS) and organic loading rate (OLR), this study undertook a holistic, statistics driven assessment of operating conditions for in situ H 2 assisted biogas upgrading, centering the analysis on TS and OLR. A dataset of 31 studies was compiled and comprised 99 observations. A rigorous analytical framework was employed, combining data standardization, fixed- and random-effects (REML) weighted regressions with cluster-robust errors, stratified analyses, and machine learning. Mixed-effects meta regression indicated that TS was the main factor explaining differences of methane fraction (CH 4 %) when considering the between studies heterogeneity. Focusing on a near-stoichiometric subset (H 2 /CO 2 ≈ 4:1), TS remained significant. Stratified results showed a stronger negative relationship between TS and CH 4 % in UASB reactors than in CSTRs, with a negative effect under mesophilic conditions and no significant effect under thermophilic conditions. A Random Forest model corroborated the statistical findings, consistently ranking H 2 /CO 2 ratio, OLR, TS, and hydrogen injection rate (HIR) as the most influential predictors. These findings delineate trends across increasing TS levels, particularly between 1% and 10%, and provide preliminary insights for TS above 15% in in situ biogas upgrading. They further provide insights for the influence of TS by reactor type and temperature, thereby advancing the evidence base for implementing biological CO 2 conversion to CH 4 in practice.

In situ biogas upgrading↗

Detecting anomalous packets in network transfers: investigations using PCA, autoencoder and isolation forest in TCP

Large-scale scientific workflows rely heavily on high-performance file transfers. These transfers require strict quality parameters such as guaranteed bandwidth, no packet loss or data duplication. To have successful file transfers, methods such as predetermined thresholds and statistical analysis need to be done to determine abnormal patterns. Network administrators routinely monitor and analyze network data for diagnosing and alleviating these, making decisions based on their experience. However, as networks grow and become complex, monitoring large data files and quickly processing them, makes it improbable to identify errors and rectify these. Abnormal file transfers have been classified by simply setting alert thresholds, via tools such as PerfSonar and TCP statistics (Tstat). This paper investigates the feasibility of unsupervised feature extraction methods for identifying network anomaly patterns with three unsupervised classification methods—principal component analysis, autoencoder and isolation forest. Here, we collect file transfer statistics from two experiment sets—synthetic iPerf generated traffic and 1000 Genome workflow runs, with synthetically introduced anomalies. Our results show that while PCA and a simple autoencoder finds it difficult to detect clusters, the tree-variant isolation forest is able to identify anomalous packets by breaking down TCP traces into tree classes early.

97 MATHEMATICS AND COMPUTING↗

Stochastic nonlinear analysis of unidirectional fiber composites using image-based microstructural uncertainty quantification

Here, we present a data-driven nonlinear uncertainty quantification and propagation framework to study the microstructure-induced stochastic performance of unidirectional (UD) carbon fiber reinforced polymer (CFRP) composites. The proposed approach integrates (1) microscopic image characterization, (2) stochastic microstructure reconstruction, and (3) efficient multiscale finite element simulations enabled by self-consistent clustering (SCA) analysis. To model the complex microstructural variability, the proposed UQ methods take the non-Gaussian uncertainty sources into account through a distribution-free sampling approach leveraging nonparametric and asymptotic statistical tools. A hierarchical conditional sampling strategy enables the simultaneous sampling of multiple sources of uncertainties. Our approach provides insights into the impact of microstructural variabilities, which are shown to have an increasing impact on the nonlinear responses of UD CFRP parts under progressive compression loading and ultimately on the failure rate over time. We discover that before CFRP parts start to fail, a characteristic time period emerges with distinctive uncertainty distributions specific to the microstructure variability and the probability of failure. Identifying the failure time period is crucial to the reliability prediction, which is an essential component of CFRP design.

36 MATERIALS SCIENCE↗

Further evidence for a color gradient in M15

Using data obtained at the Canada-France-Hawaii Telescope (CFHT) in subarcsecond seeing color maps are constructed in B - V and H-alpha - R of the central regions of the globular cluster M15. Comparison in B - V of the region within 0.31 pc of the cluster center with a coadded sample taken from the surrounding region demonstrates a color gradient, in the sense that the central region is bluer than the surrounding region at a high level of statistical significance. Analysis of the H-alpha - R color map indicates that the central region is 'H-alpha deficient', i.e., has a stronger H-alpha absorption line on average than the coadded region. This result argues against the possibility that the excess blue light from the central region is due to cataclysmic variables. Instead, two possible causes of the color gradient are (1) it may be due to a centrally concentrated population of faint blue stars, possibly resulting from binary-single star interactions, and (2) it may result from a central deficit of low-mass main-sequence stars.

Cederbloom, S. E.↗

Unsupervised segmentation of polarimetric SAR data using the covariance matrix

An unsupervised selection of polarimetric features useful for the segmentation and analysis of polarimetric synthetic aperture radar (SAR) data is presented. The technique is based on multidimensional clustering of the parameters composing the polarimetric covariance matrix of the data. Clustering is performed on the logarithm of these quantities. Once the polarimetric cluster centers have been determined, segmentation of the polarimetric data into regions is performed using a maximum likelihood polarimetric classifier. Segmentation maps are further improved using a Markov random field to describe the statistics of the regions and computing the maximum of the product of the local conditional densities. Examples with real polarimetric SAR imagery are given to illustrate the potential of this method.

Rignot, Eric↗

H I 21 centimeter observations and I-band CCD surface photometry of spiral galaxies behind the Virgo Cluster and toward its antipode

Sample selection, radio and optical data acquisition and reduction, and observation results are presented for spiral galaxies behind the Virgo Cluster and toward its antipode. I-band CCD photometry was obtained for all the bright galaxies and part of the sample of faint galaxies in the two local volumes was studied. The statistical properties of the galaxy samples are discussed.

Lu, N. Y.↗

Multivariate statistical analysis software technologies for astrophysical research involving large data bases

We developed a package to process and analyze the data from the digital version of the Second Palomar Sky Survey. This system, called SKICAT, incorporates the latest in machine learning and expert systems software technology, in order to classify the detected objects objectively and uniformly, and facilitate handling of the enormous data sets from digital sky surveys and other sources. The system provides a powerful, integrated environment for the manipulation and scientific investigation of catalogs from virtually any source. It serves three principal functions: image catalog construction, catalog management, and catalog analysis. Through use of the GID3* Decision Tree artificial induction software, SKICAT automates the process of classifying objects within CCD and digitized plate images. To exploit these catalogs, the system also provides tools to merge them into a large, complete database which may be easily queried and modified when new data or better methods of calibrating or classifying become available. The most innovative feature of SKICAT is the facility it provides to experiment with and apply the latest in machine learning technology to the tasks of catalog construction and analysis. SKICAT provides a unique environment for implementing these tools for any number of future scientific purposes. Initial scientific verification and performance tests have been made using galaxy counts and measurements of galaxy clustering from small subsets of the survey data, and a search for very high redshift quasars. All of the tests were successful, and produced new and interesting scientific results. Attachments to this report give detailed accounts of the technical aspects for multivariate statistical analysis of small and moderate-size data sets, called STATPROG. The package was tested extensively on a number of real scientific applications, and has produced real, published results.

Djorgovski, S. George↗

The Gaseous Content of the Universe at Zeta less than 1.6

Together with graduate student Hsiao-Wen Chen, I have measured and analyzed structural and morphological parameters of 38 galaxies in eight fields for which sensitive measurements of corresponding Ly(alpha) absorption toward background QSOs are available. These measurements are based on Wide Field Planetary Camera 2 (WFPC2) observations obtained with the Hubble Space Telescope (HST) and provide a first look at how the incidence and extent of tenuous gas around galaxies depends on galaxy luminosity, size, and morphological type and on geometry of the impact. The primary result of the analysis is that the amount of gas encountered along the line of sight depends on the galaxy impact parameter and B-band luminosity but does not depend strongly on the galaxy average surface brightness, disk-to-bulge ratio, or redshift. This result confirms and improves upon an anti-correlation between Ly(alpha) absorption equivalent width and galaxy impact parameter found previously. More importantly, this result provides the first quantitative means of relating statistics of faint galaxies to statistics of Ly(alpha) absorption systems. which we plan to exploit to constrain the luminosity function of galaxies beyond the realm of current surveys. Results have been submitted for publication and will greatly improve our statistical conclusions . Together with graduate student Noriaki Yahata. I have measured and classified spectral properties of over 1000 faint galaxies and stars obtained in our low-resolution spectroscopic survey. The goal of this project is two-fold: (1) to exhaustively characterize the spectral properties of all faint galaxies that comprise our current survey, and (2) to gain experience with our measurement and classification code. which ultimately will be used on a data base of 20,000 galaxies to be obtained with the Two-Degree Field (2df) spectrograph at the Anglo-Australian Telescope (AAT). The results will ultimately be used for many goals, but so far we have concentrated on using the results to make a binary classification of the galaxies (i.e. early type versus late type) and to then exploit the density-morphology relationship to obtain a crude density indicator. The primary result of the analysis is that the incidence and extent of tenuous gas around galaxies shows no strong preference for local galaxy environment, at least over the range of densities spanned by the current observations. Along similar lines, two instances of Ly(alpha) absorption lines that arise in groups or clusters were examined. Analysis demonstrates that some can produce corresponding absorption lines and that LY(alpha) absorption lines do not avoid a high-density environment. A new measure of the galaxy-absorber cross-correlation function defines the statistical criterion by which galaxies and absorber pairs are to be matched. I have identified a damped Ly(alpha) absorption system at redshift z equals approximately 0.16, the lowest redshift confirmed to date. The most important results of the analysis are learning that the metal abundances of the absorption system are less than 10 percent of the solar metal abundance and that the absorbing gas is not rotating with the galaxy disk.

Source record↗

Pressure Effects on the Relaxation of an Excited Ethane Molecule in High-Pressure Bath Gases

Here, we use molecular dynamics to calculate the rotational and vibrational energy relaxation of C 2 H 6 in Ar, Kr, and Xe bath gases over a pressure range of 10 to 400 atm and at temperatures of 300 K and 800 K. The C 2 H 6 is instantaneously excited by 80 kcal/mol randomly distributed into both vibrational and rotational modes. The computed relaxation rates show little sensitivity to the identity of the noble gas in the bath. Vibrational relaxation rates show a non-linear pressure dependence at 300 K. At 800 K the reduced range of bath gas densities covered by the range of pressures do not yet show any non-linearity in the pressure dependence. Rotational relaxation is characterized with two relaxation rates. The slower rate is comparable to the vibrational relaxation rate. The faster rate has a linear pressure dependence at 300 K but an irregular, nonlinear pressure dependence at 800 K. To understand this, a model was developed based on approximating the periodic box used in the molecular dynamics simulations by an equal-volume collection of cubes where each cube is sized to allow only single occupancy by the noble gas or the molecule. Combinatorial statistics then leads to a pressure and temperature dependent analytic distribution of the bath gas species the molecule encounters in a collision. This distribution, the dissociation energy of molecule/bath gas complexes and bath gas clusters, and the computed energy release per collision combine to show that only at 300 K is the energy release sufficient to dissociate likely complexes and clusters. This suggests that persistent and pressure-dependent clusters and complexes at 800 K may be responsible for the non-linear pressure dependence of rotational relaxation.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Correcting correlation functions for redshift-dependent interloper contamination

ABSTRACT The construction of catalogues of a particular type of galaxy can be complicated by interlopers contaminating the sample. In spectroscopic galaxy surveys this can be due to the misclassification of an emission line; for example in the Hobby–Eberly Telescope Dark Energy Experiment (HETDEX) low-redshift [O ii] emitters may make up a few per cent of the observed Ly α emitter (LAE) sample. The presence of contaminants affects the measured correlation functions and power spectra. Previous attempts to deal with this using the cross-correlation function have assumed sources at a fixed redshift, or not modelled evolution within the adopted redshift bins. However, in spectroscopic surveys like HETDEX, where the contamination fraction is likely to be redshift dependent, the observed clustering of misclassified sources will appear to evolve strongly due to projection effects, even if their true clustering does not. We present a practical method for accounting for the presence of contaminants with redshift-dependent contamination fractions and projected clustering. We show using mock catalogues that our method, unlike existing approaches, yields unbiased clustering measurements from the upcoming HETDEX survey in scenarios with redshift-dependent contamination fractions within the redshift bins used. We show our method returns autocorrelation functions with systematic biases much smaller than the statistical noise for samples with at least as high as 7 per cent contamination. We also present and test a method for fitting for the redshift-dependent interloper fraction using the LAE–[O ii] galaxy cross-correlation function, which gives less biased results than assuming a single interloper fraction for the whole sample.

79 ASTRONOMY AND ASTROPHYSICS↗

Anatomy of Continuous Mars SEIS and Pressure Data from Unsupervised Learning

The seismic noise recorded by the Interior Exploration using Seismic Investigations, Geodesy, and Heat Transport (InSight) seismometer (Seismic Experiment for Interior Structure [SEIS]) has a strong daily quasi-periodicity and numerous transient microevents, associated mostly with an active Martian environment with wind bursts, pressure drops, in addition to thermally induced lander and instrument cracks. That noise is far from the Earth’s microseismic noise. Quantifying the importance of nonstochasticity and identifying these microevents is mandatory for improving continuous data quality and noise analysis techniques, including autocorrelation. Cataloging these events has so far been made with specific algorithms and operator’s visual inspection. We investigate here the continuous data with an unsupervised deep-learning approach built on a deep scattering network. This leads to the successful detection and clustering of these microevents as well as better determination of daily cycles associated with changes in the intensity and color of the background noise. We first provide a description of our approach, and then present the learned clusters followed by a study of their origin and associated physical phenomena. We show that the clustering is robust over several Martian days, showing distinct types of glitches that repeat at a rate of several tens per sol with stable time differences. We show that the clustering and detection efficiency for pressure drops and glitches is comparable to or better than manual or targeted detection techniques proposed to date, noticeably with an unsupervised approach. Finally, here we discuss the origin of other clusters found, especially glitch sequences with stable time offsets that might generate artifacts in autocorrelation analyses. We conclude with presenting the potential of unsupervised learning for long-term space mission operations, in particular, for geophysical and environmental observatories.

58 GEOSCIENCES↗

A Multistage Stochastic Transmission Expansion Algorithm for Wide-Area Planning under Uncertainty

The overall objective for this project was to develop and demonstrate a set of methods for solving the transmission investment problem for a large network considering many possible scenarios of future conditions and multiple decision points when investments can be made. Project sub-objectives achieved this goal through a succession of extending the methods to apply to problems with increasing complexity or additional features, including the number of decision points, whether generation and transmission are co-optimized, and whether AC or DC power flow is used. A transmission model was developed for the Western Electric Coordinating Council (WECC) region, the high-voltage transmission system that serves the western third of the continental U.S. Using a dataset provided by WECC and by researchers from John Hopkins University, we have validated and demonstrated the model and used it to compare the new method for solving multi-stage stochastic transmission planning to several state-of-the-art techniques. The project has resulted in several key outcomes and achievements: The covariance-based method for choosing a small set of hours to represent short-term variability has superior performance in terms of accuracy to existing methods, including K-means clustering and Importance Sampling; The combined partitioning method for long-term uncertainty with the nested clustering approach for choosing representative hours for each long-term group has superior accuracy for equivalent computational effort compared with existing methods; Using the partitioning/clustering method combined with Sample Average Approximation provides both statistical bounds on the quality of the solution and at the same time, a complete investment plan for all contingencies in the full uncertainty set; no existing methods can provide both at the same time; The method is demonstrated to work well for choosing both transmission and generation investments; A variant on the method allows for both scenario selection and simultaneous correction for the error from the DC power flow approximation to provide a tractable method for AC power flow-based transmission planning under uncertainty; The method applied to the WECC case study demonstrates the additional value to the system operator and the consumer of identifying flexible investment options in the near-term decisions. In particular, the case study exhibits significant option value in postponing some transmission additions that appear useful but in some long-term system states create new congestion problems.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Helium abundance enhancements in the solar wind

Evidence for a link between helium enhancements at 1 AU and transient coronal mass ejections is provided by the statistical analysis of 73 large helium abundance enhancement observations made by IMPs 6, 7 and 8 over 1972-1978. These events, in which helium abundance enhancement is greater than about 10%, are sporadic, sometimes clustered in time, occur approximately in phase with the solar cycle, and nearly 50% of them are associated with interplanetary shocks and/or geomagnetic activity sudden commencements. The plasma pattern associated with them is nevertheless independent of shock occurrence, and features high magnetic field strength, low alpha-proton velocity difference, and low proton temperature, suggesting that the enhancement is embedded in a closed, magnetically dominated structure that expands adiabatically. Evidence of an association between helium enhancement at 1 AU and type II and IV radio bursts in the corona is presented.

Borrini, G.↗

An Integrated Snow Radiance and Snow Physics Modeling Framework for Cold Land Surface Modeling

Recent developments in forward radiative transfer modeling and physical land surface modeling are converging to allow the assembly of an integrated snow/cold lands modeling framework for land surface modeling and data assimilation applications. The key elements of this framework include: a forward radiative transfer model (FRTM) for snow, a snowpack physical model, a land surface water/energy cycle model, and a data assimilation scheme. Together these form a flexible framework for self-consistent remote sensing and water/energy cycle studies. In this paper we will describe the elements and the integration plan. Each element of this framework is modular so the choice of element can be tailored to match the emphasis of a particular study. For example, within our framework, four choices of a FRTM are available to simulate the brightness temperature of snow: Two models are available to model the physical evolution of the snowpack and underlying soil, and two models are available to handle the water/energy balance at the land surface. Since the framework is modular, other models-physical or statistical--can be accommodated, too. All modules will operate within the framework of the Land Information System (LIS), a land surface modeling framework with data assimilation capabilities running on a parallel-node computing cluster at the NASA Goddard Space Flight Center. The advantages of such an integrated modular framework built on the LIS will be described through examples-e.g., studies to analyze snow field experiment observations, and simulations of future satellite missions for snow and cold land processes.

Kim, Edward J.↗