Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “statistical change detection”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

A Probabilistic Model-Based Diagnostic Framework for Nuclear Engineering Systems

A fault diagnostic framework was investigated in this study for applications in thermal–hydraulic systems of nuclear power plants. The proposed framework consists of quantitative model-based diagnosis, statistical change detection and probabilistic reasoning. The use of physics-based diagnostic models provides high detection sensitivity and allows noise and measurement uncertainty to be incorporated robustly. Performance-related parametric models for each component are constructed based on first principles. Numerical model residuals are generated using the concept of analytical redundancy. Statistical change detection methods are employed to detect non-zero residuals in the presence of uncertainty. The diagnosis task is performed using Bayesian inference to detect and localize possible faults. Application to a single-phase heat exchanger for demonstration showed that the proposed probabilistic framework can provide improved results in comparison with traditional approaches while remaining less sensitive to false alarms in the presence of measurement and modeling uncertainty.

Bayesian network↗

Paradigm For Statistical Analysis Of Threshold Detection

Relative values assigned to double mistakes and changed iteratively. Method for statistical analysis of threshold detection saves experimental time by enabling use of same set of measurements with respect to two thresholds. Accounts for double mistakes, unresolvable by threshold-detection technique.

Diner, Daniel B.↗

Fault detection using a two-model test for changes in the parameters of an autoregressive time series

This article describes an investigation of a statistical hypothesis testing method for detecting changes in the characteristics of an observed time series. The work is motivated by the need for practical automated methods for on-line monitoring of Deep Space Network (DSN) equipment to detect failures and changes in behavior. In particular, on-line monitoring of the motor current in a DSN 34-m beam waveguide (BWG) antenna is used as an example. The algorithm is based on a measure of the information theoretic distance between two autoregressive models: one estimated with data from a dynamic reference window and one estimated with data from a sliding reference window. The Hinkley cumulative sum stopping rule is utilized to detect a change in the mean of this distance measure, corresponding to the detection of a change in the underlying process. The basic theory behind this two-model test is presented, and the problem of practical implementation is addressed, examining windowing methods, model estimation, and detection parameter assignment. Results from the five fault-transition simulations are presented to show the possible limitations of the detection method, and suggestions for future implementation are given.

Scholtz, P.↗

Toward Statistical Real-Time Power Fault Detection

We propose statistical fault detection methodology based on high-frequency data streams that are becoming available in modern power grids. Our approach can be treated as an online (sequential) change point monitoring methodology. However, due to the mostly unexplored and very nonstandard structure of high-frequency power grid streaming data, substantial new statistical development is required to make this methodology practically applicable. The paper includes development of scalar detectors based on multichannel data streams, determination of data-driven alarm thresholds and investigation of the performance and robustness of the new tools. Due to a reasonably large database of faults, we can calculate frequencies of false and correct fault signals, and recommend implementations that optimize these empirical success rates.

bolted faults↗

Regional Changes in Earths Color and Texture as Observed From Space Over a 15-Year Period

Earth-observing satellites provide global observations of many geophysical variables. As these variables are derived from measured radiances, the underlying radiance data are the most reliable sources of information for change detection. Here, we identify statistically significant trends in the color and spatial texture of the Earth as viewed from multiple directions from the Multi-angle Imaging SpectroRadiometer (MISR), which has been sampling the angular distribution of scattered sunlight since 2000. Globally, our results show that the Earth has been appearing relatively bluer (up to 1.6 % per decade from both nadir and oblique views) and smoother (up to 1.5 % per decade only from oblique views) over the past 15 years. The magnitude of the global blueing trends is comparable to that of uncertainties in radiometric calibration stability. Regional shifts in color and texture, which are significantly larger than global means, are observed, particularly over polar regions, along the boundaries of the subtropical highs, the tropical western Pacific, Southwestern Asia, and Australia. We demonstrate that the large regional trends cannot be explained either by uncertainties in radiometric calibration or variability in total or spectral solar irradiance; hence, they reflect changes internal to the Earths climate system. The 15-year-mean true color composites and texture images of the Earth at both nadir and oblique views are also presented for the first time.

regional trends↗

Benchmark Tracking System for Performance Monitoring

Benchmarking is essential for high-performance software development, particularly for monitoring performance across code iterations. This project focused on enhancing the benchmarking process for Lamellar, an asynchronous runtime for High-Performance Computing (HPC) systems developed at Pacific Northwest National Laboratory. Prior to this work, benchmark results were difficult to track and compare across code versions, presenting significant challenges in identifying performance regressions and long-term trends. The primary objective was to establish a systematic, reproducible approach for measuring performance and detecting regressions following code commits. Our methodology involved three key components: standardizing benchmark outputs, implementing data versioning, and developing analysis tools. We standardized the benchmark output format to JSON Line records containing specific fields (execution time, hardware specifications, and environmental variables). To address data management challenges, we evaluated several options and eventually chose a git repository dedicated to benchmark data. We developed a suite of Python tools that processed benchmark results, enriched them with metadata, and facilitated search in the repository. The resulting system enables more efficient filtering and comparison of performance metrics across commit histories, hardware configurations, and benchmark variants through a unified query interface. Our implementation reduces computational overhead by first checking for existing results through configuration matching before initiating new benchmark runs, thereby conserving resources. The system has been validated by Lamellar developers. It organizes results by benchmark type and build configurations for efficient retrieval. Future developments include a planned Large Language Model interface for predicting benchmark performance, incorporating the criterion package for statistical analysis, which will enable automated detection of statistically significant performance changes, and integration with continuous integration pipelines. Despite these enhancements being reserved for future work, this project has successfully provided the Lamellar development team with a framework for maintaining consistent performance standards and identifying optimization opportunities across workloads and hardware environments.

97 MATHEMATICS AND COMPUTING↗

Search for a Cloud Phase Feedback in the Arctic Climate System

This project was motivated by a hypothesis involving the transition in lower troposphere temperatures across the freezing point of water. Specifically, at temperatures just below to about ten degrees below freezing, Arctic clouds should be in a mixed-phase, with strong influences from secondary ice production (e.g., the Hallett-Mossop process). At temperatures just above freezing, clouds should become entirely deglaciated. We hypothesized that, with multiple years of ARM data, a statistically significant change could be detected in cloud radiative properties and surface radiative fluxes that could be directly attributed to this phase change. Furthermore, in a gradually warming climate, these phase change-related responses in surface radiation would represent a cloud phase feedback as part of Arctic amplification. We designed this research project to coincide with a new ARM Arctic cloud radar product developed by Ed Luke and collaborators at BNL (Luke et al., 2021: PNAS, doi:10.1073/pnas.2021387118) that explicitly contains SIP cloud properties retrieved from radar data. This research project has successfully concluded after analysis of a much larger North Slope of Alaska (NSA) data sample than originally anticipated, and the results are quite different than originally hypothesized.

58 GEOSCIENCES↗

Methane as a Diagnostic Tracer of Changes in the Brewer-Dobson Circulation of the Stratosphere

This study makes use of time series of methane (CH4/ data from the Halogen Occultation Experiment (HALOE) to detect whether there were any statistically significant changes of the Brewer-Dobson circulation (BDC) within the stratosphere during 1992-2005. The HALOE CH4 profiles are in terms of mixing ratio versus pressure altitude and are binned into latitude zones within the Southern Hemisphere and the Northern Hemisphere. Their separate time series are then analyzed using multiple linear regression (MLR) techniques. The CH4 trend terms for the Northern Hemisphere are significant and positive at 10 N from 50 to 7 hPa and larger than the tropospheric CH4 trends of about 3%decade(exp -1) from 20 to 7 hPa. At 60 N the trends are clearly negative from 20 to 7 hPa. Their combined trends indicate an acceleration of the BDC in the middle stratosphere of the Northern Hemisphere during those years, most likely due to changes from the effects of wave activity. No similar significant BDC acceleration is found for the Southern Hemisphere. Trends from HALOE H2O are analyzed for consistency. Their mutual trends with CH4 are anti-correlated qualitatively in the middle and upper stratosphere, where CH4 is chemically oxidized to H2O. Conversely, their mutual trends in the lower stratosphere are dominated by their trends upon entry to the tropical stratosphere. Time series residuals for CH4 in the lower mesosphere also exhibit structures that are anti-correlated in some instances with those of the tracer-like species HCl. Their occasional aperiodic structures indicate the effects of transport following episodic, wintertime wave activity. It is concluded that observed multi-year, zonally averaged distributions of CH4 can be used to diagnose major instances of wave-induced transport in the middle atmosphere and to detect changes in the stratospheric BDC.

Remsberg, E. E.↗

Evaluation of precipitation indices in suites of dynamically and statistically downscaled regional climate models over Florida

Abstract The present work evaluates historical precipitation and its indices defined by the Expert Team on Climate Change Detection and Indices (ETCCDI) in suites of dynamically and statistically downscaled regional climate models (RCMs) against NOAA’s Global Historical Climatology Network Daily (GHCN-Daily) dataset over Florida. The models examined here are: (1) nested RCMs involved in the North American CORDEX (NA-CORDEX) program, (2) variable resolution Community Earth System Models (VR-CESM), (3) Coupled Model Intercomparison Project phase 5 (CMIP5) models statistically downscaled using localized constructed analogs (LOCA) technique. To quantify observational uncertainty, three in situ-based (PRISM, Livneh, CPC) and three reanalysis (ERA5, MERRA2, NARR) datasets are also evaluated against the station data. The reanalyses and dynamically downscaled RCMs generally underestimate the magnitude of the monthly precipitation and the frequency of the extreme rainfall in summer. The models forced with CanESM2 miss the phase of the seasonality of extreme precipitation. All models and reanalyses severely underestimate both the mean and interannual variability of mean wet-day precipitation (SDII), consecutive dry days (CDD), and overestimate consecutive wet days (CWD). Metric analysis suggests large uncertainty across NA-CORDEX models. Both the LOCA and VR-CESM models perform better than the majority of models. Overall, RegCM4 and WRF models perform poorer than the median model performance. The performance uncertainty across models is comparable to that in the reanalyses. Specifically, NARR performs poorer than the median model performance in simulating the mean indices and MERRA2 performs worse than the majority of models in capturing the interannual variability of the indices.

54 ENVIRONMENTAL SCIENCES↗

A Biomechanical Approach to Assessing Hip Fracture Risk

Bone loss in microgravity is well documented, but it is difficult to quantify how declines in bone mineral density (BMD) contribute to an astronaut's overall risk of fracture upon return. This study uses a biomechanical approach to assessing hip fracture risk, or Factor of Risk (Phi), which is defined as the ratio of applied load to bone strength. All long-duration NASA astronauts from Expeditions 1-18 were included in this study (n=25), while crewmembers who flew twice (n=2) were treated as separate subjects. Bone strength was estimated based on an empirical relationship between areal BMD at the hip, as measured by DXA, and failure load, as determined by mechanical testing of cadaver femora. Fall load during a sideways fall was calculated from a previously developed biomechanical model, which takes into account body weight, height, gender, and soft tissue thickness overlying the lateral aspect of the hip that serves to attenuate the impact force. While no statistical analyses have been performed yet, preliminary results show that males in this population have a higher FOR than females, with a post- flight Phi of 0.87 and 0.36, respectively. FOR increases 5.1% from preflight to postflight, while only one subject crossed the fracture "threshold" of Phi = 1, for a total of 2 subjects with a postflight Phi > 1. These results suggest that men may be at greater risk for hip fracture due largely in part to their relatively thin soft tissue padding as compared to women, since soft tissue thickness has the highest correlation (R(exp 2)= .53) with FOR of all subject-specific parameters. Future work will investigate changes in FOR during recovery to see if baseline risk levels are restored upon return to 1-g activity. While dual x-ray absorptiometry (DXA) is the most commonly used clinical measure of bone health, it fails to provide compartment-specific information that is useful in assessing changes to bone quality as a result of microgravity exposure. Peripheral quantitative computed tomography (pQCT) accomplishes this by imaging transverse "slices" of the long bones. This project was a re-analysis of a 90 day bed rest study to determine if changes to cortical and trabecular compartments could be detected in the distal tibia with statistical significance using a new pQCT image analysis method. Nearly all changes in bone mineral density (BMD) and cross sectional area (CSA) measures were seen with statistical significance, with the exception of a change in cortical BMD. Total bone CSA increased by 1.1 % (p =0.01), cortical CSA decreased by - 5.6% (p<0.001) and trabecular CSA increased by 1.76% (p=0.007); the combination of which suggests bone resorption occurred at the endocortical surface in response to mechanical unloading by bed rest. Furthermore, total BMD and trabecular BMD decreased (-3.8%, p=0.001 and -2.8%, p =0.007, respectively), while decreases in cortical BMD failed to reach significance (-1.2%, p=0.07). Given that compartment-specific changes are seen with significance and are likely to influence bone strength, it is recommended that pQCT remain a standard measure used in bed rest because it provides a unique measure by which to better evaluate the efficacy of countermeasures to microgravity-induced bone loss.

Ellman, Rachel↗

Fractal mechanisms in the electrophysiology of the heart

The mathematical concept of fractals provides insights into complex anatomic branching structures that lack a characteristic (single) length scale, and certain complex physiologic processes, such as heart rate regulation, that lack a single time scale. Heart rate control is perturbed by alterations in neuro-autonomic function in a number of important clinical syndromes, including sudden cardiac death, congestive failure, cocaine intoxication, fetal distress, space sickness and physiologic aging. These conditions are associated with a loss of the normal fractal complexity of interbeat interval dynamics. Such changes, which may not be detectable using conventional statistics, can be quantified using new methods derived from "chaos theory.".

NASA Discipline Cardiopulmonary↗

Detection of DoS Attacks Using ARFIMA Modeling of GOOSE Communication in IEC 61850 Substations

Integration of Information and Communication Technology (ICT) in modern smart grids (SGs) offers many advantages including the use of renewables and an effective way to protect, control and monitor the energy transmission and distribution. To reach an optimal operation of future energy systems, availability, integrity and confidentiality of data should be guaranteed. Research on the cyber-physical security of electrical substations based on IEC 61850 is still at an early stage. In the present work, we first model the network traffic data in electrical substations, then, we present a statistical Anomaly Detection (AD) method to detect Denial of Service (DoS) attacks against the Generic Object Oriented Substation Event (GOOSE) network communication. According to interpretations on the self-similarity and the Long-Range Dependency (LRD) of the data, an Auto-Regressive Fractionally Integrated Moving Average (ARFIMA) model was shown to describe well the GOOSE communication in the substation process network. Based on this ARFIMA-model and in view of cyber-physical security, an effective model-based AD method is developed and analyzed. Two variants of the statistical AD considering statistical hypothesis testing based on the Generalized Likelihood Ratio Test (GLRT) and the cumulative sum (CUSUM) are presented to detect flooding attacks that might affect the availability of the data. Our work presents a novel AD method, with two different variants, tailored to the specific features of the GOOSE traffic in IEC 61850 substations. The statistical AD is capable of detecting anomalies at unknown change times under the realistic assumption of unknown model parameters. The performance of both variants of the AD method is validated and assessed using data collected from a simulation case study. We perform several Monte-Carlo simulations under different noise variances. The detection delay is provided for each detector and it represents the number of discrete time samples after which an anomaly is detected. In fact, our statistical AD method with both variants (CUSUM and GLRT) has around half the false positive rate and a smaller detection delay when compared with two of the closest works found in the literature. Our AD approach based on the GLRT detector has the smallest false positive rate among all considered approaches. Whereas, our AD approach based on the CUSUM test has the lowest false negative rate thus the best detection rate. Depending on the requirements as well as the costs of false alarms or missed anomalies, both variants of our statistical detection method can be used and are further analyzed using composite detection metrics.

IEC 61850 electrical substations↗

Sensitive Detection of Structural Differences using a Statistical Framework for Comparative Crystallography

Chemical and conformational changes underlie the functional cycles of proteins. Comparative crystallography can reveal these changes over time, over ligands, and over chemical and physical perturbations in atomic detail. A key difficulty, however, is that the resulting observations must be placed on the same scale by correcting for experimental factors. We recently introduced a Bayesian framework for correcting (scaling) X-ray diffraction data by combining deep learning with statistical priors informed by crystallographic theory. To scale comparative crystallography data, we here combine this framework with a multivariate statistical theory of comparative crystallography. By doing so, we find strong improvements in the detection of protein dynamics, element-specific anomalous signal, and the binding of drug fragments.

Hekstra, Doeke R. [Harvard Univ., Cambridge, MA (U↗

Sensitive detection of structural dynamics using a statistical framework for comparative crystallography

Chemical and conformational changes are crucial to protein function and its pharmacological control. X-ray crystallography can reveal these changes in atomic detail, but standard analysis methods, which refine separate datasets, often overlook differences that are subtle or arise in only a subset of molecules. Direct comparison of crystallographic datasets is, in principle, more powerful, but systematic errors (“scales”) often mask changes in the crystallographic observables (“structure factors”). Machine learning algorithms that jointly estimate scales and structure factors can address this limitation. Here, we augment this approach with multivariate, structured priors derived from crystallographic theory, implemented in the variational deep learning framework Careless. Doing so strongly improves the detection of protein dynamics, element-specific anomalous signals, and the binding of drug candidates, offering a robust approach to comparative crystallography and, potentially, to detection of protein dynamics by other structure determination methods.

Hekstra, Doeke R. [Harvard Univ., Cambridge, MA (U↗

The Kepler Mission: A Search for Terrestrial Planets - Development Status

We have embarked on a mission to detect terrestrial planets. The space mission has been optimized to search for earth-size planets (0.5 to 10 earth masses) in the habitable zone (HZ) of solar-like stars. Given this design, the mission will necessarily be capable of not only detecting Earth analogs, but a wide range of planetary types and characteristics ranging from Mercury-size objects with orbital periods of days to gas-giants in decade long orbits that have undeniable signatures even with only one transit detected. The mission is designed to survey the full range of spectral-type dwarf stars. The approach is to detect the periodic signal of transiting planets. Three or more transits of a star exceeding a combined threshold of eight sigma with a statistically consistent period, brightness change and duration provide a rigorous method of detection. From the relative brightness change the planet size can be calculated. From the period the orbital size can be calculated and its location relative to the HZ determined. Presented here are: the mission goals, the top level system design requirements derived from these goals that drive the flight system design, a number of the trades that have lead to the mission concept, expected photometric performance dependence on stellar brightness and spectral type based on the system 'noise tree' analysis. Updated estimates are presented of the numbers of detectable planets versus size, orbit, stellar spectral type and distances based on a planet frequency hypothesis. The current project schedule and organization are given.

Koch, David↗

Simulated Changes in Tropical Cyclone Size, Accumulated Cyclone Energy and Power Dissipation Index in a Warmer Climate

Detection, attribution and projection of changes in tropical cyclone intensity statistics are made difficult from the potentially decreasing overall storm frequency combined with increases in the peak winds of the most intense storms as the climate warms. Multi-decadal simulations of stabilized climate scenarios from a high-resolution tropical cyclone permitting atmospheric general circulation model are used to examine simulated global changes from warmer temperatures, if any, in estimates of tropical cyclone size, accumulated cyclonic energy and power dissipation index. Changes in these metrics are found to be complicated functions of storm categorization and global averages of them are unlikely to easily reveal the impact of climate change on future tropical cyclone intensity statistics.

Wehner, Michael (ORCID:0000000159910082)↗

Singular spectrum analysis in nonlinear dynamics, with applications to paleoclimatic time series

Two dimensions of a dynamical system given by experimental time series are distinguished. Statistical dimension gives a theoretical upper bound for the minimal number of degrees of freedom required to describe the attractor up to the accuracy of the data, taking into account sampling and noise problems. The dynamical dimension is the intrinsic dimension of the attractor and does not depend on the quality of the data. Singular Spectrum Analysis (SSA) provides estimates of the statistical dimension. SSA also describes the main physical phenomena reflected by the data. It gives adaptive spectral filters associated with the dominant oscillations of the system and clarifies the noise characteristics of the data. SSA is applied to four paleoclimatic records. The principal climatic oscillations and the regime changes in their amplitude are detected. About 10 degrees of freedom are statistically significant in the data. Large noise and insufficient sample length do not allow reliable estimates of the dynamical dimension.

Vautard, R.↗

The use of multispectral difference data for urban change detection

The current work describes an experiment in which ERTS-1 digital multispectral scanner data from two times was used to detect change in an urban scene. The computer analysis implementation approach explored here was to register image data from the two times and to subtract the data to form multispectral difference images. The difference imagery was then analyzed using statistical pattern recognition to separate and classify different types of change. Construction was successfully detected.

Anuta, P. E.↗