Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “unobservability”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Understanding the Impact of Unobservable Variables on the Performance of Predictive Models: The Need for Feature Space Partitioning and Fusion

When developing predictive models over a dataset, the model is globally optimized across the entire feature space to learn a decision boundary. However, when unobservable variables—which cannot be measured or estimated—interact with the observable variables, this can negatively impact the optimization applied to the decision boundary since the data samples introduced by unobservable variables may have little to no association with the applied global optimization. This, consequently, penalizes the entire decision boundary and model performance. This paper examines some of the detrimental effects of unobservable variables, particularly their role in creating new modes in the distribution of observable variables and reducing the separability of class distributions. Such challenges result in skewed or warped decision boundaries and decreased accuracy of model predictions, particularly for interpretable models like logistic regression and decision trees. Through two illustrative case examples, we highlight the need to address the challenges imposed by unobservable variables. We propose a strategy to mitigate these challenges by creating local regions within the feature space through partitioning. This enables the optimization of local models within the regions to overcome the impact of unobservability in different feature space localities. Research into a more sophisticated partitioning strategy and where the partition should be relative to the sample of interest is left as future work. Through the analysis of the impact of unobservability and the development of a partitioning method, we demonstrate the clear need for a partitioning strategy that integrates knowledge from multiple local models to estimate risk factors using information fusion. Thus, we establish the foundation and motivation for using partitioning and information fusion to overcome the effects of unobservability in predictive models. Formal fusion methods, such as Dempster-Shafer theory, can better leverage the information from local regions to improve the performance of interpretable predictive models in the presence of unobservable variables.

Time Series Data↗

Detection of Stealthy False Data Injection Attacks in Unobservable Distribution Networks

In this paper, a composite scheme is proposed for detecting stealthy data manipulation attacks on distribution system which is unobservable with standard least squares based state estimators. This technique has three stages where the process of data imputation, voltage phasor estimation and the bad data detection are carried out in a systematic manner. The proposed approach is then integrated with moving target defense strategies which perturbs the network parameters to reveal stealthy false data injection attacks. The proposed approach is tested is validated on a three-phase, unbalanced 37-node distribution system and its results are presented. It is shown that the proposed approach has the ability to accurately detect the presence of FDI attacks using limited measurements (i.e., the test system is unobservable).

Rajasekaran, James K.↗

Voltage Violation Prediction in Unobservable Distribution Systems

Recently, distributed energy resources (DERs) such as photovoltaic (PV) systems have garnered significant attention due to their economic and environmental benefits. However, DERs can also pose new technical challenges to distribution system operation including under/over voltage issues. In this regard, voltage violation prediction (VVP) becomes an essential component of system operation as it enables proactive control strategies. Unfortunately, classical voltage monitoring techniques assume full availability of state measurements across all nodes in the system. In real-world scenarios, distribution systems are limited with few measurement devices, rendering the system unobservable. Therefore, this paper proposes a new Bayesian matrix completion (BMC) based VVP technique that accurately predicts the probability of nodal voltage violations in unobservable (and unbalanced) distribution systems. The proposed approach is tested via simulations on the IEEE 37 test system. Results show that the proposed method offers over 90% violation prediction accuracy with as low as 50% fraction of available data.

Abujubbeh, Mohammad↗

Physics-informed Machine Learning Method for Forecasting and Uncertainty Quantification of Partially Observed and Unobserved States in Power Grids

We present a physics-informed Gaussian Process Regression (GPR) model to predict the phase angle, angular speed, and wind mechanical power from a limited number of measurements. In the traditional data-driven GPR method, the form of the Gaussian Process covariance matrix is assumed and its parameters are found from measurements. In the physics-informed GPR, we treat unknown variables (including wind speed and mechanical power) as a random process and compute the covariance matrix from the resulting stochastic power grid equations. We demonstrate that the physics-informed GPR method is significantly more accurate than the standard data-driven one for immediate forecasting of generators' angular velocity and phase angle. We also show that the physics-informed GPR provides accurate predictions of the unobserved wind mechanical power, phase angle, or angular velocity when measurements from only one of these variables are available. The immediate forecast of observed variables and predictions of unobserved variables can be used for effectively managing power grids (electricity market clearing, regulation actions) and early detection of abnormal behavior and faults. The physics-based GPR forecast time horizon depends on the combination of input (wind power, load, etc.) correlation time and characteristic (relaxation) time of the power grid and can be extended to short and medium-range times.

machine learning, power grid, forecasting, Gaussia↗

Joint Topology Identification and State Estimation in Unobservable Distribution Grids

Many distribution system operations (e.g., state estimation, control, fault detection/localization) rely on the assumption that the underlying topology is accurately defined. In general, topology identification is a challenging problem in distribution systems as these systems are unobservable with a very limited number of available measurements. In this paper, we tackle this problem by designing a compressive sensing framework that jointly estimates the systems states and network topology via an integrated mixed integer nonlinear program (MINLP) formulation. Here, two reformulations of the original MINLP problems are investigated. Firstly, in order to remove the nonlinearity in the MINLP formulation, a mixed integer linear programming (MILP) problem that employs auxiliary variables is derived. Furthermore, to achieve a faster solution, convex relaxation of the original formulation is derived. Finally, using a Markovian model for topology changes, prior information about system topology is used to improve topology identification particularly when a limited amount of measurements is available. Simulation results on IEEE 37-bus test feeder and IEEE 123-bus test feeder illustrate the efficiency and scalability of the proposed approaches from both state estimation and topology identification point of view (even with 30% of available data).

42 ENGINEERING↗

Failure time analysis with unobserved heterogeneity: Earthquake duration time of Turkey

Failure time models assume that all units are subject to same risks embodied in the hazard functions. In this paper, unobserved sources of heterogeneity that are not captured by covariates are included into the failure time models. Destructive earthquakes in Turkey since 1900 are used to illustrate the models and inter-event time between two consecutive earthquakes are defined as the failure time. The paper demonstrates how seismicity and tectonics/physics parameters that can potentially influence the spatio-temporal variability of earthquakes and presents several advantages compared to more traditional approaches.

58 GEOSCIENCES↗

Spatial and unobserved heterogeneity in consumer preferences for adoption of electric and hybrid vehicles: A Bayesian hierarchical modeling approach

The transition to low carbon vehicles known as alternative fuel vehicles (AFVs) is well underway. This transition has been motivated partly by consumer demand and partly by legislation such as the Zero Emission Vehicle mandate, which requires manufacturers to sell a certain percentage of their vehicles as AFVs. While the long-term adoption of AFVs (specifically, electric and hybrids) may take several years, there is a need to understand consumer preferences for AFV adoption and the pathways of AFV adoption from a national perspective. Therefore, this study sought to provide information about consumer preferences regarding AFV ownership while considering spatial and unobserved heterogeneity in consumer preferences, which can potentially impact societal transition to low carbon fueled vehicles. The 2017 National Household Travel Survey was used to calibrate Bayesian logit and hierarchical models. Here, the findings of these models reveal that higher gasoline prices contribute toward the adoption of battery electric vehicles. The results also reveal that the perceived disadvantages of AFVs for long commutes are the key barrier in wider adoption of AFVs. Interestingly, frequent use of the internet by consumers revealed a higher likelihood for purchase of hybrid vehicles. Furthermore, West Coast residents are observed to be a large portion of the early adopters and are more likely to purchase hybrids as compared to battery electric vehicles. The knowledge generated by this study has implications for making better informed decisions about AFV adoption and developing incentives to promote wider adoption of AFVs by overcoming their perceived disadvantages.

33 ADVANCED PROPULSION SYSTEMS↗

Indirect observation of unobservable interstellar molecules

It is suggested that the abundances of neutral non-polar interstellar molecules unobservable by radio astronomy can be systematically determined by radio observation of the protonated ions. As an example, observed N2H(+) column densities are analyzed to infer molecular nitrogen abundances in dense interstellar clouds. The chemistries and expected densities of the protonated ions of O2, C2, CO2, C2H2 and CH4 are then discussed. Microwave transition frequencies fo HCO2(+) and C2H3(+) are estimated, and a preliminary astronomical search for HCO2(+) is described.

Herbst, E.↗

Indirect observation of unobservable interstellar molecules

It is suggested that the abundances of neutral nonpolar interstellar molecules unobservable by radio astronomy can be systematically determined by radio observation of the protonated ions. As an example, observed N2H(+) column densities are analyzed to infer molecular nitrogen abundances in dense interstellar clouds. The chemistries and expected densities of the protonated ions of O2, C2, CO2, C2H2, and CH4 are then discussed. Microwave transition frequencies for HCO2(+) and C2H3(+) are estimated, and a preliminary astronomical search for HCO2(+) is described.

Herbst, E.↗

Exceptional Alignment in a Donor–Acceptor Conjugated Polymer via a Previously Unobserved Liquid Crystal Mesophase

Abstract Orienting polymer semiconductors is desirable to optimize device characteristics, provide insight into microstructure, and magnify subtle phase behavior. Here, a combination of uniaxial strain and subsequent heating of the donor–acceptor (DA) polymer PBnDT‐FTAZ is discovered to lead to exceptional optical dichroic ratios of up to 38 (and close to 50 near the polymer's absorption edge). This alignment is achieved due to the existence of a previously undetected thermotropic liquid crystal (LC) mesophase. The LC transition, not discernable through calorimetry, is uncovered through a combination of in situ UV–vis spectroscopy, X‐ray scattering, and dynamic mechanical analysis (DMA). Comparing PBnDT‐FTAZ to the non‐fluorinated PBnDT‐HTAZ and the homo polymer PBnDT, all of which show similar thermal transitions, reveals that exceptional alignment is only found in PBnDT‐FTAZ. This is attributed to the PBnDT‐FTAZ film having two distinct liquid crystal populations, and the polymer templating to a highly aligned, high‐clearing temperature population when heated. The DMA thermal relaxation behavior observed here is also seen in other DA conjugated polymers suggesting that such thermotropic LC mesophases may be common in these materials. These findings demonstrate a polymer semiconductor with remarkable alignment and uncover phase behavior with broad implications for process‐structure‐property relationships in polymer semiconductors.

36 MATERIALS SCIENCE↗

Detect the Unobservable: Abnormality Detection in mixed Autonomy for Lane Change Maneuver with Following Vehicles’ Trajectories Only

Highly Automated Vehicles (HAVs) and Advanced Driver-Assistance Systems (ADAS) are transforming modern transportation with enhanced mobility, safety, and efficiency. Despite their advantages, cybersecurity vulnerabilities in these systems can lead to abnormal behavior, posing significant risks to surrounding human-driven vehicles (HDVs) in mixed traffic environments. Here, this article addresses the challenge of detecting abnormal lateral movements of HAVs/ADAS vehicles using only trajectory profiles of following HDVs. Specifically, we propose a novel modeling approach that captures both normal and abnormal lateral behaviors through vehicle kinematics, integrated decision-making processes, vehicle control using symbolic regression for lane change vehicles. Additionally, we introduce an abnormality detection framework that relies on observable HDV data, even in occlusion scenarios. The framework evaluates the sensitivity of various car-following models to detect abnormal behaviors, providing insights into the interaction between HAVs/ADAS and HDVs in mixed autonomy systems.

Connected and Automated vehicles↗