Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “testing statistics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8
All sourcesNASA NTRSDOE OSTI
DOE OSTI2018

Rapidly Assessing the Quality of Targeted Proteomics Experiments through Monitoring Stable-Isotope Labeled Standards

Selected reaction monitoring (SRM), also known as multiple reaction monitoring (MRM), is a data acquisition technique used in targeted analysis of molecules, including targeted proteomic studies. It exploits the unique capability of triple-quadrupole (QQQ) mass spectrometers to monitor the predefined precursor and fragment ion pairs of specific molecules of interest throughout a liquid chromatography (LC) elution profile. Compared to shotgun proteomics, targeted proteomics using SRM has high selectivity, high sensitivity, and a wide linear dynamic range,(1-3) which makes it especially useful in the accurate and reproducible quantification of low-abundance proteins in highly complex biological samples. SRM has been widely used in the fields of biomarker discovery,(4-7) analysis of protein post-translational modifications(8) and characterization of biological protein networks.(4,9) In the recent years, multiple technical advances have greatly improved the throughput of SRM analyses, allowing for the quantification of hundreds of peptides in a single analysis.(6,7,10) For example, a single 800-plex SRM assay (e.g., 400 unlabeled and heavy-labeled peptide pairs and 2400 transitions with retention time scheduling) using ultrahigh-performance liquid chromatography (UHPLC) has been developed to quantify proteins in plasma.(11) Advanced labeling techniques utilizing in vitro proteome-assisted MRM for protein absolute quantification (iMPAQT) demonstrated the capability of SRM in genome-wide protein quantification of over 18?000 human proteins.(12) Moreover, the scan speed of QQQ instrumentation has been greatly improved in recent releases of commercial instrumentation. The newly developed TSQ Altis (released in 2017) can scan more than 600 transitions per second, which is 6 times more than a traditional QQQ scan speed of 100 transitions per second. The breadth of measurement enabled by these technological improvements to QQQ mass spectrometry has increased the feasibility and popularity of large scale targeted proteomics studies,(13) a major application of which will be in clinical studies in which up to hundreds of protein candidates need to be quantified in hundreds of clinical specimens.(14) Quantitative accuracy is a primary motivating factor for utilizing a targeted proteomics protocol. The precise and reproducible absolute quantification produced by SRM assays is essential to many clinical and laboratory experiments.(15,16) Because the abundance of an endogenous peptide is calculated from the measurement of the spiked-in reference standard, it is essential to assess the data quality of these references.(17) In early applications of targeted proteomics, when instrument speed greatly limited the number of transitions that could be monitored, much of this quality assessment was done manually. However, recent improvements in instrument performance and experimental design have enabled a dramatic increase in the number of target peptides and associated SRM transitions, which makes manual quality assessment an untenable and laborious task. A variety of computational tools assist in SRM experiment design and data analysis. The first task in creating an SRM experiment is the choice of proteins and representative peptides to monitor. Achieving a reliable protein abundance requires appropriately choosing peptides that have a strong signal and are free from interferences in the biological matrix. Numerous computational tools exist to facilitate assay design by identifying peptides and refining SRM transitions.(18-21) To help share these assays and eliminate time spent designing the same transitions at multiple institutions, community portals have begun to host well-designed and vetted assays.(22-24) Analyzing the experimental data requires significant computational effort to align files across replicates and experimental conditions, pick peaks and produce quantitative values, normalize data and perform statistical tests, etc.(25-27)

Gibbons, Bryson C.↗
DOE OSTI2021

Regularized machine learning on molecular graph model explains systematic error in DFT enthalpies

Abstract A major goal of materials research is the discovery of novel and efficient heterogeneous catalysts for various chemical processes. In such studies, the candidate catalyst material is modeled using tens to thousands of chemical species and elementary reactions. Density Functional Theory (DFT) is widely used to calculate the thermochemistry of these species which might be surface species or gas-phase molecules. The use of an approximate exchange correlation functional in the DFT framework introduces an important source of error in such models. This is especially true in the calculation of gas phase molecules whose thermochemistry is calculated using the same planewave basis set as the rest of the surface mechanism. Unfortunately, the nature and magnitude of these errors is unknown for most practical molecules. Here, we investigate the error in the enthalpy of formation for 1676 gaseous species using two different DFT levels of theory and the ‘ground truth values’ obtained from the NIST database. We featurize molecules using graph theory. We use a regularized algorithm to discover a sparse model of the error and identify important molecular fragments that drive this error. The model is robust to rigorous statistical tests and is used to correct DFT thermochemistry, achieving more than an order of magnitude improvement.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Anomalous nanoparticle surface diffusion in LCTEM is revealed by deep learning-assisted analysis

Significance Liquid cell transmission electron microscopy (LCTEM) is an emerging technique, which enables nanoscale visualization and tracking of single nanoparticles near interfaces with unprecedented spatial resolution. Here, we studied the diffusion of nanoparticles in LCTEM experiments using techniques powered by deep neural networks and statistical tests. We observed two underlying regimes of diffusive behavior which are governed by the interaction of the electron beam, the nanoparticle, the nearby substrate, and the liquid environment. This understanding forms the foundation to use LCTEM for single-nanoparticle tracking for a broad range of nanoparticles, interfaces, and liquids.

Jamali, Vida↗
DOE OSTI2020

A semblance measure for model comparison

Algorithmic and computational advances have made it possible that geophysical survey and earth model design can be aided by many systematic trial inverse-modelling runs with synthetic data. Such may, for example, come up in machine-learning approaches. Automated image appraisal pertaining to such applications will involve common statistical tests for goodness-of-data fit as a primary evaluation method. However, solution non-uniqueness may render multiple images equivalent in terms of their data fit, requiring secondary categorizers. A logical choice for classifying synthetic-imaging results quantifies the goodness of model fit where a known reference model replaces the observational input. The task of model intercomparison in terms of measuring the resemblance to the reference model poses challenges to common distance-based metrics like root mean square error and mean absolute error. First, distance-based metrics can introduce spurious contributions when smooth models with fuzzy target contours are to be compared against a sharp reference. Second, large differences due to parameter-estimation overshoots can dominate distance metrics. Here, we propose a remedy that is referred to as semblance and is based on the idea of logistic functions, where a binary-dependent variable adds non-zero or zero accumulation terms for the, respectively, passing or failing of preset target thresholds. This classifying approach is amenable to an objective where model feature recognition is primary. Numerical comparisons to distance-based metrics provide evidence for the advantages of the semblance in view of this objective. Geophysical imaging in conjunction with machine-learning is seen as a benefitting upcoming application area.

58 GEOSCIENCES↗
DOE OSTI2026

Empirical investigation of nuclear correlation function distributions in lattice QCD

Two-point correlation functions of systems with baryon number 𝐵 ∈ {1,2,3,4} are investigated using lattice quantum chromodynamics (QCD). In particular, the empirical distributions of importance-sampling Monte-Carlo samples of these correlation functions are examined as a function of the spacetime separation between the two points and the baryon number. While the exact forms of these distributions are not known for QCD, recent work has determined asymptotic expressions for analogous correlation function distributions in simpler theories such as scalar field theory and the disordered phase of the 𝑂⁡(𝑁) model. The theoretical 𝑂⁡(𝑁) model distributions are found to provide an accurate description of the empirical QCD distributions at zero momentum over a wide range of temporal separations for each baryon number when assessed with a range of different statistical tests. In particular, the behavior of the baryon number 𝐵 QCD correlation function at large temporal separation is well reproduced by the 𝑂⁡(𝑁 ∼ 2/𝐵) model distribution.

Lattice field theory↗
DOE OSTI2024

Learning new physics from data: A symmetrized approach

Thousands of person years have been invested in searches for new physics (NP), the majority of them motivated by theoretical considerations. Yet, no evidence of beyond the Standard Model physics has been found. This suggests that model-agnostic searches might be an important key to explore NP, and help discover unexpected phenomena which can inspire future theoretical developments. A possible strategy for such searches is identifying asymmetries between data samples that are expected to be symmetric within the Standard Model. We propose exploiting neural networks (NNs) to quickly fit and statistically test the differences between two samples. Our method is based on an earlier work, originally designed for inferring the deviations of an observed dataset from that of a much larger reference dataset. We present a symmetric formalism, generalizing the original one, avoiding fine-tuning of the NN parameters and any constraints on the relative sizes of the samples. Our formalism could be used to detect small symmetry violations, extending the discovery potential of current and future particle physics experiments.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2019

Kaon Photoproduction and the Λ Decay Parameter α –

The weak decay parameter $\alpha_-$ of the $\Lambda$ is an important quantity for the extraction of polarization observables in various experiments. Moreover, in combination with $\alpha_+$ from $\bar\Lambda$ decay it provides a measure for matter-antimatter asymmetry. The weak decay parameter also affects the decay parameters of the $\Xi$ and $\Omega$ baryons and, in general, any quantity in which the polarization of the $\Lambda$ is relevant. The recently reported value by the BESIII collaboration of $0.750(9)(4)$ is significantly larger than the previous PDG value of $0.642(13)$ that had been accepted and used for over 40 years. In this work we make an independent estimate of $\alpha_-$, using an extensive set of polarization data measured in kaon photoproduction in the baryon resonance region and constraints set by spin algebra. The obtained value is 0.721(6)(5). The result is corroborated by multiple statistical tests as well as a modern phenomenological model, showing that our new value yields the best description of the data in question. Furthermore, our analysis supports the new BESIII finding that $\alpha_-$ is significantly larger than the previous PDG value. Any experimental quantity relying on the value of $\alpha_-$ should therefore be re-considered.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2022

First Leptophobic Dark Matter Search from the Coherent–CAPTAIN-Mills Liquid Argon Detector

We report the first results of a search for leptophobic dark matter (DM) from the Coherent–CAPTAIN-Mills (CCM) liquid argon (LAr) detector. An engineering run with 120 photomultiplier tubes (PMTs) and 17.9 × 10 20 protons on target (POT) was performed in fall 2019 to study the characteristics of the CCM detector. The operation of this 10-ton detector was strictly light based with a threshold of 50 keV and used coherent elastic scattering off argon nuclei to detect DM. Despite only 1.5 months of accumulated luminosity, contaminated LAr, and nonoptimized shielding, CCM’s first engineering run has already achieved sensitivity to previously unexplored parameter space of light dark matter models with a baryonic vector portal. With an expected background of 115 005 events, we observe 115 005 + 16.5 events which is compatible with background expectations. For a benchmark mediator-to-DM mass ratio of m V B =m χ = 2.1, DM masses within the range 9 MeV ≲ m χ ≲ 50 MeV are excluded at 90% C. L. in the leptophobic model after applying the Feldman-Cousins test statistic. CCM’s upgraded run with 200 PMTs, filtered LAr, improved shielding, and 10 times more POT will be able to exclude the remaining thermal relic density parameter space of this model, as well as probe new parameter space of other leptophobic DM models.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2022

Detection of Cyber Attacks in Grid-tied PV Systems Using Dynamic Watermarking

This paper presents of an active detection scheme for detecting cyber attacks on sensors controlling a grid-tied PV systems. Several cyber vulnerabilities in Grid tied PV Systems are discussed. The defense mechanism introduces a private (secret) watermarking signal into the control inputs of the grid-tied inverter system. This will enable the detection of any malicious manipulation of sensor measurements. Based on the measured data, two statistical tests are conducted to identify anomalies in the system using the presence of the watermarking signal. It shown that when a sensor data is compromised and/or replaced by a pre-recorded healthy signal, both test 1 and 2 exhibit high values indicating a possible malicious activity. The robustness of the proposed algorithm is tested and validated with several attack scenarios on a grid tied PV system. Select results from an experimental setup are discussed.

Ibrahim, Hasan↗
DOE OSTI2023

Leveraging High-Fidelity Datasets for Machine Learning-based Anomaly Detection in Smart Grids

Data-driven intrusion detection systems are increasingly becoming essential for protecting critical cyber-physical infrastructure, such as the power grid, against the growing number of sophisticated cyber-attacks. The development of such tools is reliant on the availability of high-fidelity cyber-physical datasets that cover a diverse variety of potential cyber events. In this work, a high-fidelity smart grid platform is utilized to develop an extensive dataset, which is used to train and test a machine learning-based intrusion detection system. The evaluation of the developed IDS shows robust performance even when tested with statistically diverse test data not used in training.

Hyder, Burhan↗
DOE OSTI2022

Evaluating Synthetic Smart Meter Locations For Communication System Modeling

An important part of good communication models for smart grid applications, particularly when wireless protocols are used, is the location information of the nodes. We’ve developed metrics to assist in evaluating whether a given model with such information is representative of feeders found in the world. These metrics are applied to a set of feeder models with known good location information for the smart meter locations and compared to a set of feeder models with similar location information that is not expected to be representative of real-world feeders. The comparison reveals that the suspect models do not pass statistical tests utilizing the developed metrics, providing initial validation of the analysis technique.

smart meter, feeder model, GridLAB-D↗
DOE OSTI2019

Complex interactions between day length and diurnal patterns of gene expression drive photoperiodic responses in a perennial C 4 grass

Abstract Photoperiod is a key environmental cue affecting flowering and biomass traits in plants. Key components of the photoperiodic flowering pathway have been identified in many species, but surprisingly few studies have globally examined the diurnal rhythm of gene expression with changes in day length. Using a cost‐effective 3′‐Tag RNA sequencing strategy, we characterize 9,010 photoperiod responsive genes with strict statistical testing across a diurnal time series in the C 4 perennial grass, Panicum hallii . We show that the vast majority of photoperiod responses are driven by complex interactions between day length and sampling periods. A fine‐scale contrast analysis at each sampling time revealed a detailed picture of the temporal reprogramming of cis ‐regulatory elements and biological processes under short‐ and long‐day conditions. Phase shift analysis reveals quantitative variation among genes with photoperiod‐dependent diurnal patterns. In addition, we identify three photoperiod enriched transcription factor families with key genes involved in photoperiod flowering regulatory networks. Finally, coexpression networks analysis of GIGANTEA homolog predicted 1,668 potential coincidence partners, including five well‐known GI‐interacting proteins. Our results not only provide a resource for understanding the mechanisms of photoperiod regulation in perennial grasses but also lay a foundation to increase biomass yield in biofuel crops.

Weng, Xiaoyu↗
DOE OSTI2021

A Bayesian nonparametric analysis for zero-inflated multivariate count data with application to microbiome study

High-throughput sequencing technology has enabled researchers to profile microbial communities from a variety of environments, but analysis of multivariate taxon count data remains challenging. Here, we develop a Bayesian nonparametric (BNP) regression model with zero inflation to analyse multivariate count data from microbiome studies. A BNP approach flexibly models microbial associations with covariates, such as environmental factors and clinical characteristics. The model produces estimates for probability distributions which relate microbial diversity and differential abundance to covariates, and facilitates community comparisons beyond those provided by simple statistical tests. We compare the model to simpler models and popular alternatives in simulation studies, showing, in addition to these additional community-level insights, it yields superior parameter estimates and model fit in various settings. The model's utility is demonstrated by applying it to a chronic wound microbiome data set and a Human Microbiome Project data set, where it is used to compare microbial communities present in different environments.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

G-Mapper: Learning a Cover in the Mapper Construction

The Mapper algorithm is a visualization technique in topological data analysis (TDA) that outputs a graph reflecting the structure of a given dataset. However, the Mapper algorithm requires tuning several parameters in order to generate a “nice” Mapper graph. This paper focuses on selecting the cover parameter. We present an algorithm that optimizes the cover of a Mapper graph by splitting a cover repeatedly according to a statistical test for normality. Our algorithm is based on G-means clustering, which searches for the optimal number of clusters in 𝑘-means by iteratively applying the Anderson–Darling test. Our splitting procedure employs a Gaussian mixture model to carefully choose the cover according to the distribution of the given data. In conclusion, experiments for synthetic and real-world datasets demonstrate that our algorithm generates covers so that the Mapper graphs retain the essence of the datasets, while also running significantly faster than a previous iterative method.

G-means clustering↗
DOE OSTI2023

SF_Microbe_Methane (SFMM) v1

Scripts for analyzing microbial community taxonomy and function, running statistical tests, and making complex graphics.

de Mesquita, CliftonB↗
DOE OSTI2025

apricots

APRICOTS: Averaged-Polarization Resampled Integrated Correlated Omnidirectional Test Statistics (O4835)

Meadors, Grant David↗
DOE OSTI2026

Object-Based Evaluation of Dynamical and Statistical Downscaled Precipitation Products over CONUS

High-resolution precipitation data, generated through dynamical downscaling (DD) or statistical downscaling (SD) of global climate model output, provide critical information for regional climate assessment and adaptation planning. Most downscaling development and validation have focused on accurate gridscale precipitation construction and ignored the spatial structure of precipitation across model grids and at the event scale. However, many applications, e.g., hydrologic modeling and the analysis using the downscaled precipitation, require a reasonable representation of the spatial structure of precipitation within watersheds. Therefore, a set of standard metrics to evaluate the representation of the spatial structure of individual storms across diverse downscaled precipitation products is desired. To address this need, we conducted an object-based evaluation of precipitation in decades-long DD and SD products over the contiguous United States (CONUS). Specifically, we evaluate their ability to reproduce various features of precipitation objects in the observations: total volume, precipitation area, peak intensity, and spatial structure. Multiple metrics (bias, Perkins score, and nonparametric statistical tests) are used to quantify model performance. Our evaluation reveals notable variations in performance among individual products across different climate zones and seasons, as well as between extreme and nonextreme events. In general, most DD products exhibit balanced performance across the four precipitation object features, while SD products vary more significantly in their performance across products. Based on this comprehensive evaluation, we provide guidance on choosing downscaled products for specific regions, seasons, and precipitation object features. These findings and recommendations can inform precipitation-relevant modeling and analysis over CONUS, guide future downscaling technique developments, and provide actionable information for climate impact assessment and adaptation.

Environmental sciences↗
DOE OSTI2020

Causal Interactions between Southern Ocean Polynyas and High-Latitude Atmosphere–Ocean Variability

Abstract Weddell Sea open-ocean polynyas have been observed to occasionally release heat from the deep ocean to the atmosphere, indicating that their sporadic appearances may be an important feature of high-latitude atmosphere–ocean variability. Yet, observations of the phenomenon are sparse and many standard-resolution models represent these features poorly, if at all. We use a fully coupled, synoptic-scale preindustrial control simulation of the Energy Exascale Earth System Model (E3SMv0-HR) to effectively simulate open-ocean polynyas and investigate their role in the climate system. Our approach employs statistical tests of Granger causality to diagnose local and remote drivers of, and responses to, polynya heat loss on interannual to decadal time scales. First, we find that polynya heat loss Granger causes a persistent increase in surface air temperature over the Weddell Sea, strengthening the local cyclonic wind circulation. Along with responding to polynyas, atmospheric conditions also facilitate their development. When the Southern Ocean experiences a rapid poleward shift in the circumpolar westerlies following a prolonged negative phase of the southern annular mode (SAM), Weddell Sea salinity increases, promoting density destratification and convection in the water column. Finally, we find that the reduction of surface heat fluxes during periods of full ice cover is not fully compensated by ocean heat transport into the high latitudes. This imbalance leads to a buildup of ocean heat content that supplies polynya heat loss. These results disentangle the complex, coupled climate processes that both enable the polynya’s existence and respond to it, providing insights to improve the representation of these highly episodic sea ice features in climate models.

Kaufman, Zachary S.↗