Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “clustering statistics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 595 records · Page 33
All sourcesNASA NTRSDOE OSTI
NASA NTRS2012

Observations of How Magnetofluid Turbulence Dissipates at Small Scales

The solar wind is a turbulent magneto fluid that can be studied intensively at multiple scales. Investigations using single spacecraft have revealed much about the properties of the solar wind throughout the heliosphere (from 0.3 AU to 100 AU). More recently, data from multiple spacecraft have provided further details of both the statistical properties of the turbulence and its small-scale structure. In particular, high time resolution magnetic field measurements from the four Cluster spacecrafl have led to the conclusion that at spatial scales of order the proton inertial length and smaller, the turbulence becomes strongly anisotropic and the power in fluctuations that are perpendicular to the (local) magnetic field is measured to be much larger than that in fluctuations that are parallel to the magnetic field. As the spatial scales approach the electron inertial length, the power is almost completely dissipated. Various analysis techniques and theoretical ideas have been put forward to account for the properties of those measurements. The talk will describe the current state of observations, theory and simulations.

Goldstein, M. L.↗
NASA NTRS2017

Classifying Multi-Model Wheat Yield Impact Response Surfaces Showing Sensitivity to Temperature and Precipitation Change

Crop growth simulation models can differ greatly in their treatment of key processes and hence in their response to environmental conditions. Here, we used an ensemble of 26 process-based wheat models applied at sites across a European transect to compare their sensitivity to changes in temperature (minus 2 to plus 9 degrees Centigrade) and precipitation (minus 50 to plus 50 percent). Model results were analysed by plotting them as impact response surfaces (IRSs), classifying the IRS patterns of individual model simulations, describing these classes and analysing factors that may explain the major differences in model responses. The model ensemble was used to simulate yields of winter and spring wheat at four sites in Finland, Germany and Spain. Results were plotted as IRSs that show changes in yields relative to the baseline with respect to temperature and precipitation. IRSs of 30-year means and selected extreme years were classified using two approaches describing their pattern. The expert diagnostic approach (EDA) combines two aspects of IRS patterns: location of the maximum yield (nine classes) and strength of the yield response with respect to climate (four classes), resulting in a total of 36 combined classes defined using criteria pre-specified by experts. The statistical diagnostic approach (SDA) groups IRSs by comparing their pattern and magnitude, without attempting to interpret these features. It applies a hierarchical clustering method, grouping response patterns using a distance metric that combines the spatial correlation and Euclidian distance between IRS pairs. The two approaches were used to investigate whether different patterns of yield response could be related to different properties of the crop models, specifically their genealogy, calibration and process description. Although no single model property across a large model ensemble was found to explain the integrated yield response to temperature and precipitation perturbations, the application of the EDA and SDA approaches revealed their capability to distinguish: (i) stronger yield responses to precipitation for winter wheat than spring wheat; (ii) differing strengths of response to climate changes for years with anomalous weather conditions compared to period-average conditions; (iii) the influence of site conditions on yield patterns; (iv) similarities in IRS patterns among models with related genealogy; (v) similarities in IRS patterns for models with simpler process descriptions of root growth and water uptake compared to those with more complex descriptions; and (vi) a closer correspondence of IRS patterns in models using partitioning schemes to represent yield formation than in those using a harvest index. Such results can inform future crop modelling studies that seek to exploit the diversity of multi-model ensembles, by distinguishing ensemble members that span a wide range of responses as well as those that display implausible behaviour or strong mutual similarities.

Classification; Climate change; Crop model; Ensemb↗
DOE OSTI2023

Measurement-based quantum simulation of Abelian lattice gauge theories

Numerical simulation of lattice gauge theories is an indispensable tool in high energy physics, and their quantum simulation is expected to become a major application of quantum computers in the future. In this work, for an Abelian lattice gauge theory in d d spacetime dimensions, we define an entangled resource state (generalized cluster state) that reflects the spacetime structure of the gauge theory. We show that sequential single-qubit measurements with the bases adapted according to the former measurement outcomes induce a deterministic Hamiltonian quantum simulation of the gauge theory on the boundary. Our construction includes the (2+1) ( 2 + 1 ) -dimensional Abelian lattice gauge theory simulated on three-dimensional cluster state as an example, and generalizes to the simulation of Wegner’s lattice models M_{(d,n)} M ( d , n ) that involve higher-form Abelian gauge fields. We demonstrate that the generalized cluster state has a symmetry-protected topological order with respect to generalized global symmetries that are related to the symmetries of the simulated gauge theories on the boundary.Our procedure can be generalized to the simulation of Kitaev’s Majorana chain on a fermionic resource state. We also study the imaginary-time quantum simulation with two-qubit measurements and post-selections, and a classical-quantum correspondence, where the statistical partition function of the model M_{(d,n)} M ( d , n ) is written as the overlap between the product of two-qubit measurement bases and the wave function of the generalized cluster state.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
NASA NTRS2005

INDUCTIVE SYSTEM HEALTH MONITORING WITH STATISTICAL METRICS

Model-based reasoning is a powerful method for performing system monitoring and diagnosis. Building models for model-based reasoning is often a difficult and time consuming process. The Inductive Monitoring System (IMS) software was developed to provide a technique to automatically produce health monitoring knowledge bases for systems that are either difficult to model (simulate) with a computer or which require computer models that are too complex to use for real time monitoring. IMS processes nominal data sets collected either directly from the system or from simulations to build a knowledge base that can be used to detect anomalous behavior in the system. Machine learning and data mining techniques are used to characterize typical system behavior by extracting general classes of nominal data from archived data sets. In particular, a clustering algorithm forms groups of nominal values for sets of related parameters. This establishes constraints on those parameter values that should hold during nominal operation. During monitoring, IMS provides a statistically weighted measure of the deviation of current system behavior from the established normal baseline. If the deviation increases beyond the expected level, an anomaly is suspected, prompting further investigation by an operator or automated system. IMS has shown potential to be an effective, low cost technique to produce system monitoring capability for a variety of applications. We describe the training and system health monitoring techniques of IMS. We also present the application of IMS to a data set from the Space Shuttle Columbia STS-107 flight. IMS was able to detect an anomaly in the launch telemetry shortly after a foam impact damaged Columbia's thermal protection system.

Iverson, David L.↗
DOE OSTI2022

Differentially Private K -Means Clustering Applied to Meter Data Analysis and Synthesis

The proliferation of smart meters has resulted in a large amount of data being generated. It is increasingly apparent that methods are required for allowing a variety of stakeholders to leverage the data in a manner that preserves the privacy of the consumers. The sector is scrambling to define policies, such as the so called ‘15/15 rule’, to respond to the need. However, the current policies fail to adequately guarantee privacy. Here, in this paper, we address the problem of allowing third parties to apply K-means clustering, obtaining customer labels and centroids for a set of load time series by applying the framework of differential privacy. We leverage the method to design an algorithm that generates differentially private synthetic load data consistent with the labeled data. We test our algorithm’s utility by answering summary statistics such as average daily load profiles for a 2-dimensional synthetic dataset and a real-world power load dataset.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2021

Understanding protein-complex assembly through grand canonical maximum entropy modeling

Inside a cell, heterotypic proteins assemble in inhomogeneous, crowded systems where the abundance of these proteins vary with cell types. While some protein complexes form putative structures that can be visualized with imaging, there are far more protein complexes that are yet to be solved because of their dynamic associations with one another. Nevertheless, it is possible to infer these protein complexes through a physical model. However, it is often not clear to physicists what kind of data from biology is necessary for such a modeling endeavor. Here, we aim to model these clusters of coarse-grained protein assemblies from multiple subunits through the constraints of interactions among the subunits and the chemical potential of each subunit. We obtained the constraints on the interactions among subunits from the known protein structures. We inferred the chemical potential that dictates the particle number distribution of each protein subunit from the knowledge of protein abundance from experimental data. Guided by the maximum entropy principle, we formulated an inverse statistical mechanical method to infer the distribution of particle numbers from the data of protein abundance as chemical potentials for a grand canonical multicomponent mixture. Using grand canonical Monte Carlo simulations, we captured a distribution of high-order clusters in a protein complex of succinate dehydrogenase with four known subunits. The complexity of hierarchical clusters varies with the relative protein abundance of each subunit in distinctive cell types such as lung, heart, and brain. When the crowding content increases, we observed that crowding stabilizes emergent clusters that do not exist in dilute conditions. We, therefore, proposed a testable hypothesis that the hierarchical complexity of protein clusters on a molecular scale is a plausible biomarker of predicting the phenotypes of a cell.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2026

Stochastic GW -GPU: Rapid Quasi-Particle Energies for Molecules beyond 10,000 Atoms

StochasticGW is a code for computing accurate quasi-particle (QP) energies of molecules and material systems in the GW approximation. StochasticGW utilizes the stochastic Resolution of the Identity (sROI) technique to enable a massively parallel implementation with computational costs that scale semilinearly with system size, allowing the method to access systems with tens of thousands of electrons. Here, we introduce a new implementation, StochasticGW-GPU, for which the main bottleneck steps have been ported to GPUs and give substantial performance improvements over previous versions of the code. We showcase the new code by computing band gaps of hydrogenated silicon clusters (Si x H y ) containing up to 10,001 atoms and 35,144 electrons, and we obtain individual QP energies with a statistical precision of better than ±0.03 eV with times-to-solution of less than 1 h.

Thomas, Phillip S. [Lawrence Berkeley National Lab↗
DOE OSTI2025

RWRtoolkit: multi-omic network analysis using random walks on multiplex networks in any species

Abstract We introduce RWRtoolkit, a multiplex generation, exploration, and statistical package built for R and command-line users. RWRtoolkit enables the efficient exploration of large and highly complex biological networks generated from custom experimental data and/or from publicly available datasets, and is species agnostic. A range of functions can be used to find topological distances between biological entities, determine relationships within sets of interest, search for topological context around sets of interest, and statistically evaluate the strength of relationships within and between sets. The command-line interface is designed for parallelization on high-performance cluster systems, which enables high-throughput analysis such as permutation testing. Several tools in the package have also been made available for use in reproducible workflows via the KBase web application.

Kainer, David (ORCID:0000000172714676)↗
DOE OSTI2023

Q-BEEP: Quantum Bayesian Error Mitigation Employing Poisson Modeling over the Hamming Spectrum

Quantum computing technology has grown rapidly in recent years, with new technologies being explored, error rates being reduced, and quantum processor’s qubit capacity growing. However, near-term quantum algorithms are still unable to be induced without compounding consequential levels of noise, leading to non-trivial erroneous results. Quantum Error Correction (in-situ error mitigation) and Quantum Error Mitigation (post-induction error mitigation) are promising fields of research within the quantum algorithm scene, aiming to alleviate quantum errors, increasing the overall fidelity and hence the overall quality of circuit induction. Earlier this year, a pioneering work, namely HAMMER, published in ASPLOS-22 demonstrated the existence of a latent structure regarding post-circuit induction errors when mapping to the Hamming spectrum. However, they intuitively assumed that errors occur in local clusters, and that at higher average Hamming distances this structure falls away. In this work, we show that such a correlation structure is not only local but extends certain non-local clustering patterns which can be precisely described by a Poisson distribution model taking the input circuit, the device run time status (i.e., calibration statistics) and qubit topology into consideration. Using this quantum error characterizing model, we developed an iterative algorithm over the generated Bayesian network state-graph for post-induction error mitigation. Thanks to more precise modeling of the error distribution latent structure and the new iterative method, our Q-Beep approach provides state of the art performance and can boost circuit execution fidelity by up to 234.6% on Bernstein-Vazirani circuits and on average 71.0% on QAOA solution quality, using 16 practical IBMQ quantum processors. For other benchmarks such as those in QASMBench, the fidelity improvement is up to 17.8%. Q-Beep is a light-weight post-processing technique that can be performed offline and remotely, making it a useful tool for quantum vendors to integrate and provide more reliable circuit induction results.

Stein, Samuel A.↗
DOE OSTI2022

Modelling nearest neighbour distributions of biased tracers using hybrid effective field theory

ABSTRACT We investigate the application of hybrid effective field theory (HEFT) – which combines a Lagrangian bias expansion with subsequent particle dynamics from N-body simulations – to the modelling of k-nearest neighbour cumulative distribution functions (kNN-CDFs) of biased tracers of the cosmological matter field. The kNN-CDFs are sensitive to all higher order connected N-point functions in the data, but are computationally cheap to compute. We develop the formalism to predict the kNN-CDFs of discrete tracers of a continuous field from the statistics of the continuous field itself. Using this formalism, we demonstrate how kNN-CDF statistics of a set of biased tracers, such as haloes or galaxies, of the cosmological matter field can be modelled given a set of low-redshift HEFT component fields and bias parameter values. These are the same ingredients needed to predict the two-point clustering. For a specific sample of haloes, we show that both the two-point clustering and the kNN-CDFs can be well-fit on quasi-linear scales (≳ 20h−1Mpc) by the second-order HEFT formalism with the same values of the bias parameters, implying that joint modelling of the two is possible. Finally, using a Fisher matrix analysis, we show that including kNN-CDF measurements over the range of allowed scales in the HEFT framework can improve the constraints on σ8 by roughly a factor of 3, compared to the case where only two-point measurements are considered. Combining the statistical power of kNN measurements with the modelling power of HEFT, therefore, represents an exciting prospect for extracting greater information from small-scale cosmological clustering.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2020

Modeling regional precipitation over the Indus River basin of Pakistan using statistical downscaling

Complex processes govern spatiotemporal distribution of precipitation within the high-mountainous headwater regions (commonly known as the upper Indus basin (UIB)), of the Indus River basin of Pakistan. Reliable precipitation simulations particularly over the UIB present a major scientific challenge due to regional complexity and inadequate observational coverage. Here, we present a statistical downscaling approach to model observed precipitation of the entire Indus basin, with a focus on UIB within available data constraints. Taking advantage of recent high altitude (HA) observatories, we perform precipitation regionalization using K-means cluster analysis to demonstrate effectiveness of low-altitude stations to provide useful precipitation inferences over more uncertain and hydrologically important HA of the UIB. We further employ generalized linear models (GLM) with gamma and Tweedie distributions to identify major dynamic and thermodynamic drivers from a reanalysis dataset within a robust cross-validation framework that explain observed spatiotemporal precipitation patterns across the Indus basin. Final statistical models demonstrate higher predictability to resolve precipitation variability over wetter southern Himalayans and different lower Indus regions, by mainly using different dynamic predictors. The modeling framework also shows an adequate performance over more complex and uncertain trans-Himalayans and the northwestern regions of the UIB, particularly during the seasons dominated by the westerly circulations. However, the cryosphere-dominated trans-Himalayan regions, which largely govern the basin hydrology, require relatively complex models that contain dynamic and thermodynamic circulations. Furthermore, we also analyzed relevant atmospheric circulations during precipitation anomalies over the UIB, to evaluate physical consistency of the statistical models, as an additional measure of reliability. Overall, our results suggest that such circulation-based statistical downscaling has the potential to improve our understanding towards distinct features of the regional-scale precipitation across the upper and lower Indus basin. Additionally, such understanding should help to assess the response of this complex, data-scarce, and climate-sensitive river basin amid future climatic changes, to serve communal and scientific interests.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

Revealing the Hidden Third Dimension of Point Defects in Two-Dimensional MXenes

Point defects govern many important functional properties of two-dimensional (2D) materials. However, resolving the three-dimensional (3D) arrangement of these defects in multi-layer 2D materials remains a fundamental challenge, hindering rational defect engineering. Here, we overcome this limitation using an artificial intelligence-guided electron microscopy workflow to map the 3D topology and clustering of atomic vacancies in Ti3C2TX MXene. Our approach reconstructs the 3D coordinates of vacancies across hundreds of thousands of lattice sites, generating robust statistical insight into their distribution that can be correlated with specific synthesis pathways. This large-scale data enables us to classify a hierarchy of defect structures-from isolated vacancies to nanopores-revealing their preferred formation and interaction mechanisms, as corroborated by molecular dynamics simulations. This work provides a generalizable framework for understanding and ultimately controlling point defects across large volumes, paving the way for the rational design of defect-engineered functional 2D materials.

2D materials↗
DOE OSTI2020

Parametrizing the detector response with neural networks

In high energy physics, characterizing the response of a detector to radiation is one of the most important and fundamental experimental tasks. In many cases, this task is accomplished by parameterizing summary statistics of the full detector response probability density. The parameterized detector response can then be used for calibration as well as for directly improving physics analysis sensitivity. This paper reports on how to parameterize summary statistics of the detector response using neural networks. Specifically, neural networks are powerful tools for incorporating multidimensional data and the loss function used during training determines which summary statistic is learned. One common summary statistic that has not been combined with deep learning (as far as the authors are aware) is the mode. A neural network-based approach to mode learning is proposed and empirically demonstrated in the context of high energy jet calibrations. Altogether, the neural network-based toolkit for detector response parameterization can enhance the utility of data collected at high energy physics experiments and beyond.

47 OTHER INSTRUMENTATION↗
DOE OSTI2025

Near-term heatwave risk in HighResMIP models across different temperature zones of West Africa

This study projects near-future (2031–2050) changes in heatwave (HW) risk across West Africa (WA) using an ensemble of eight high-resolution global climate models from the High-Resolution Model Intercomparison Project under a high-emission scenario. Using K-means clustering, we divided WA into four unique temperature zones and examined projected changes in extreme temperatures, HW occurrence and magnitude. Our results indicate a statistically significant increase in future HW events across most parts of WA, although considerable spread exists over the region and among individual models. The most pronounced increases are evident in the Sahel/Sahara and the Guinea Highlands subregions, with an ensemble mean increase of ∼10 HW events per year. In contrast, the lowest increase in HW events is projected in central WA, with increases ranging between 1 and 5 events per year. Similarly, the magnitude of HW events is projected to increase in most models, with Sahel/Sahara exhibiting the largest increases. Additionally, projections suggest that the strongest HWs will become more frequent, particularly in northern and southwestern WA. These findings highlight significant spatial heterogeneity in future HW risk across WA, emphasizing the need for targeted adaptation strategies.

HighResMIP↗
DOE OSTI2024

Searching for parity violation in SDSS DR16 Lyman-α forest data

The four-point correlation function is the lowest order correlation function for scalar fields that can be used to probe statistical parity invariance in an isotropic universe. There are intriguing claims of detection of parity violation in the 4-point function of BOSS galaxy clustering data. We apply the same estimator to the public SDSS Data Release 16 Lyman-α forest data. Lyman-α forest data probes a different redshift range and is sensitive to a different density regime using a completely different technique. A detection would therefore be a strong indication of new physics. We identify an accurate covariance matrix as a crucial impediment to performing this measurement accurately, consistent with existing literature on galaxy 4-point function. Here, we discuss several approaches to estimating the covariance matrix, several of which produce spurious detection. Using a robust, but very suboptimal, covariance matrix derived from subsample bootstrapping, we find no evidence for parity violation.

79 ASTRONOMY AND ASTROPHYSICS↗
NASA NTRS1980

Evaluation of SLAR and thematic mapper MSS data for forest cover mapping using computer-aided analysis techniques

Several possibilities were considered for defining the data set in which the same test areas could be used for each of the four different spatial resolutions being evaluated. The LARSYS CLUSTER was used to sort the vectors into spectral classes to reduce the within-spectral class variability in an effort to develop training statistics. A data quality test was written to determine the basic signal to noise characteristics within the data set being used. Because preliminary analysis of the LANDSAT MSS data revealed the presence of high cirrus clouds, other data sets are being sought.

Hoffer, R. M.↗
NASA NTRS1997

Computer Supported Indexing: A History and Evaluation of NASA's MAI System

Computer supported indexing systems may be categorized in several ways. One classification scheme refers to them as statistical, syntactic, semantic or knowledge-based. While a system may emphasize one of these aspects, most systems actually combine two or more of these mechanisms to maximize system efficiency. Statistical systems can be based on counts of words or word stems, statistical association, and correlation techniques that assign weights to word locations or provide lexical disambiguation, calculations regarding the likelihood of word co-occurrences, clustering of word stems and transformations, or any other computational method used to identify pertinent terms. If words are counted, the ones of median frequency become candidate index terms. Syntactical systems stress grammar and identify parts of speech. Concepts found in designated grammatical combinations, such as noun phrases, generate the suggested terms. Semantic systems are concerned with the context sensitivity of words in text. The primary goal of this type of indexing is to identify without regard to syntax the subject matter and the context-bearing words in the text being indexed. Knowledge-based systems provide a conceptual network that goes past thesaurus or equivalent relationships to knowing (e.g., in the National Library of Medicine (NLM) system) that because the tibia is part of the leg, a document relating to injuries to the tibia should he indexed to LEG INJURIES, not the broader MeSH term INJURIES, or knowing that the term FEMALE should automatically be added when the term PREGNANCY is assigned, and also that the indexer should be prompted to add either HUMAN or ANIMAL. Another way of categorizing indexing systems is to identify them as producing either assigned- or derived-term indexes.

Silvester, June P.↗
NASA NTRS2011

Space Radiation Effects on Human Cells: Modeling DNA Breakage, DNA Damage Foci Distribution, Chromosomal Aberrations and Tissue Effects

Future long-tem space travel will face challenges from radiation concerns as the space environment poses health risk to humans in space from radiations with high biological efficiency and adverse post-flight long-term effects. Solar particles events may dramatically affect the crew performance, while Galactic Cosmic Rays will induce a chronic exposure to high-linear-energy-transfer (LET) particles. These types of radiation, not present on the ground level, can increase the probability of a fatal cancer later in astronaut life. No feasible shielding is possible from radiation in space, especially for the heavy ion component, as suggested solutions will require a dramatic increase in the mass of the mission. Our research group focuses on fundamental research and strategic analysis leading to better shielding design and to better understanding of the biological mechanisms of radiation damage. We present our recent effort to model DNA damage and tissue damage using computational models based on the physics of heavy ion radiation, DNA structure and DNA damage and repair in human cells. Our particular area of expertise include the clustered DNA damage from high-LET radiation, the visualization of DSBs (DNA double strand breaks) via DNA damage foci, image analysis and the statistics of the foci for different experimental situations, chromosomal aberration formation through DSB misrepair, the kinetics of DSB repair leading to a model-derived spectrum of chromosomal aberrations, and, finally, the simulation of human tissue and the pattern of apoptotic cell damage. This compendium of theoretical and experimental data sheds light on the complex nature of radiation interacting with human DNA, cells and tissues, which can lead to mutagenesis and carcinogenesis later in human life after the space mission.

Ponomarev, A. L.↗