Gradient-free MCMC methods for dynamic causal modelling
Not Available
74 ATOMIC AND MOLECULAR PHYSICS↗
SEARCH · Engineering Papers
Results for “Dynamic causal modelling”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
A Generation-Storage Coordination Dispatch Strategy for Power System Based on Causal Reinforcement Learning
In the backdrop of global energy transformation, power systems integrating high proportions of renewable energy sources are facing unprecedented challenges in operational stability and dispatch efficiency. To address these challenges, this study introduces a generation-storage coordination real-time dispatch strategy based on Causal Power System Dynamic Reinforcement Learning (CPSDRL). Diverging from traditional reinforcement learning approaches, CPSDRL innovatively incorporates causal inference within the state prediction model - the crux of model-based reinforcement learning - thereby establishing the Power Causal Dynamic Model (PCDM). Assisted by the prior knowledge of power systems, the model significantly enhances prediction accuracy and reliability through a two-stage training process. Utilizing PCDM, this study further applies a direct policy search algorithm to optimize the real-time dispatch strategy. Experimental results indicate that the proposed method improves the stability of generation-storage coordination real-time dispatch and exhibits competitive advantages in sample efficiency and computational speed, compared to traditional model-based and model-free reinforcement learning algorithms. This method is expected to enhance the practicality and adaptability of causal reinforcement learning techniques in power system scheduling and control.
causal reinforcement learning↗
Global critical materials markets: An agent-based modeling approach
As part of efforts to position the United States as a leader in clean energy technology production, the U. S. Department of Energy (DOE) issued two Critical Materials Strategy reports, which assessed 16 materials on the basis of their importance to clean energy development and their supply risk ( U.S. Department of Energy (DOE), 2010 and DOE, 2011). To understand the implications for clean energy of disruptions in supplies of critical materials, it is important to understand supply chain dynamics from mining to final product production. As a case study of critical material supply chains, we focus on the supply of two rare earth metals, neodymium (Nd) and dysprosium (Dy), for permanent magnets used in wind turbines, electric vehicles and other applications. We introduce GCMat, a dynamic agent-based model that includes interacting agents at five supply chain stages consisting of mining, metal refining, magnet production, final product production and demand. Agents throughout the supply chain make pricing, production and inventory management decisions. Deposit developers choose which deposits to develop based on market conditions and detailed data on 57 rare earth deposits. Wind turbine and electric vehicle producers choose from a set of possible production technologies that require different amounts of rare earths. We ran the model under a baseline scenario and four alternative scenarios with different demand and production technology inputs. Model results from 2010 to 2013 fit well with historical data. Projections through 2025 show a number of possible future price, demand, and supply trajectories. For each scenario, we highlight reasons for turning points under market conditions, for differences between Nd and Dy markets, and for differences between scenarios. Because GCMat can model causal dynamics and provide fine-grain representation of agents and their decisions, it provides explanations for turning points under market conditions that are not otherwise available from other modeling approaches. Our baseline projections show very different behaviors for Nd and Dy prices. Nd prices continue to drop and remain low even at the end of our simulation period as new capacity comes online and leads to a market in which production capacity outpaces demand. Dy price movements, on the other hand, change directions several times with several key turning points related to inventory behaviors of particular agents in the supply chain and asymmetric supply and demand trends. Scenario analyses show the impact of stronger demand growth for rare earths, and in particular finds that Nd price impacts are significantly delayed as compared to Dy. This is explained by the substantial excess production capacity for Nd in the early simulation years that keeps prices down. Scenarios that explore the impact of reducing the Dy content of magnets show the intricate interdependencies of these two markets as price trends for both rare earths reverse directions – reducing the Dy content of magnets reduces Dy demand, which drives down Dy prices and translates into lower magnet prices. This in turn raises the demand for magnets and therefore the demand for Nd and eventually drives up the Nd price.
36 MATERIALS SCIENCE↗
Attention for Causal Relationship Discovery from Biological Neural Dynamics
This paper explores the potential of the transformer models for learning Granger causality in networks with complex nonlinear dynamics at every node, as in neurobiological and biophysical networks. Our study primarily focuses on a proof-of-concept investigation based on simulated neural dynamics, for which the ground-truth causality is known through the underlying connectivity matrix. For transformer models trained to forecast neuronal population dynamics, we show that the cross-attention module effectively captures the causal relationship among neurons, with an accuracy equal to or superior to that of the most popular Granger causality discovery method. While we acknowledge that real-world neurobiology data will bring further challenges, including dynamic connectivity and unobserved variability, this research offers an encouraging preliminary glimpse into the utility of the transformer model for causal representation learning in neuroscience.
Lu, Ziyu↗
Visual HPC Workflows for the Analysis of System Dynamics Models
Visual analytics supported by high performance computing (HPC) accelerates and enhances the discovery, exploration, and analysis of causal patterns in complex system dynamics (SD) models. We present a suite of visualization-assisted ensemble-based techniques for hypothesis generation and testing, and for sensitivity analysis. By employing HPC to provide parallel, on-demand simulation of SD models, one can “steer” an ensemble of simulated scenarios in real time as one first formulates and then informally tests those hypotheses: this provides rapid feedback for analysts to refine their understanding of the causal relationships emergent from a model. Such understandings can be followed and augmented by rigorous application of statistical methods, namely global variance-based sensitivity analysis, Monte-Carlo filtering, adaptive regional sensitivity analysis, and self-organized maps: here timely computation relies on HPC, while effective presentation emphasizes high-dimensional multivariate data visualization. Immersive visualization in virtual 3D environments provides an excellent adjunct to the traditional 2D graphics typically used for SD models, as it generates an embodied understanding of model behavior and facilitates an active, collaborative critique of model structure and output. Finally, we summarize prospects for HPC-enabled visual analytics applied to SD modeling.
29 ENERGY PLANNING, POLICY, AND ECONOMY↗
What is (quantitative) system dynamics modeling? Defining characteristics and the opportunities they create
A clear definition of system dynamics modeling can provide shared understanding and clarify the impact of the field. We introduce a set of characteristics that define quantitative system dynamics, selected to capture core philosophy, describe theoretical and practical principles, and apply to historical work but be flexible enough to remain relevant as the field progresses. The defining characteristics are: (1) models are based on causal feedback structure, (2) accumulations and delays are foundational, (3) models are equation-based, (4) concept of time is continuous, and (5) analysis focuses on feedback dynamics. We discuss the implications of these principles and use them to identify research opportunities in which the system dynamics field can advance. These research opportunities include causality, disaggregation, data science and AI, and contributing to scientific advancement. Progress in these areas has the potential to improve both the science and practice of system dynamics.
97 MATHEMATICS AND COMPUTING↗
Diagnosing the Dynamics of Observed and Simulated Ecosystem Gross Primary Productivity with Time Causal Information Theory Quantifiers
Data analysis and model-data comparisons in the environmental sciences require diagnostic measures that quantify time series dynamics and structure, and are robust to noise in observational data. This paper investigates the temporal dynamics of environmental time series using measures quantifying their information content and complexity. The measures are used to classify natural processes on one hand, and to compare models with observations on the other. The present analysis focuses on the global carbon cycle as an area of research in which model-data integration and comparisons are key to improving our understanding of natural phenomena. We investigate the dynamics of observed and simulated time series of Gross Primary Productivity (GPP), a key variable in terrestrial ecosystems that quantifies ecosystem carbon uptake. However, the dynamics, patterns and magnitudes of GPP time series, both observed and simulated, vary substantially on different temporal and spatial scales. Here we demonstrate that information content and complexity, or Information Theory Quantifiers (ITQ) for short, serve as robust and efficient data-analytical and model benchmarking tools for evaluating the temporal structure and dynamical properties of simulated or observed time series at various spatial scales. At continental scale, we compare GPP time series simulated with two models and an observations-based product. This analysis reveals qualitative differences between model evaluation based on ITQ compared to traditional model performance metrics, indicating that good model performance in terms of absolute or relative error does not imply that the dynamics of the observations is captured well. Furthermore, we show, using an ensemble of site-scale measurements obtained from the FLUXNET archive in the Mediterranean, that model-data or model-model mismatches as indicated by ITQ can be attributed to and interpreted as differences in the temporal structure of the respective ecological time series. At global scale, our understanding of C fluxes relies on the use of consistently applied land models. Here, we use ITQ to evaluate model structure: The measures are largely insensitive to climatic scenarios, land use and atmospheric gas concentrations used to drive them, but clearly separate the structure of 13 different land models taken from the CMIP5 archive and an observations-based product. In conclusion, diagnostic measures of this kind provide data-analytical tools that distinguish different types of natural processes based solely on their dynamics, and are thus highly suitable for environmental science applications such as model structural diagnostics.
54 ENVIRONMENTAL SCIENCES↗
Graph-Based Similarity Metrics for Comparing Simulation Model Causal Structures
The causal structure of a simulation is a major determinant of both its character and behavior, yet most methods we use to compare simulations focus only on simulation outputs. We introduce a method that combines graphical representation with information theoretic metrics to quantitatively compare the causal structures of models. The method applies to agent-based simulations as well as system dynamics models and facilitates comparison within and between types. Comparing models based on their causal structures can illuminate differences in assumptions made by the models, allowing modelers to (1) better situate their models in the context of existing work, including highlighting novelty, (2) explicitly compare conceptual theory and assumptions to simulated theory and assumptions, and (3) investigate potential causal drivers of divergent behavior between models. We demonstrate the method by comparing two epidemiology models at different levels of aggregation.
97 MATHEMATICS AND COMPUTING↗
Causal network inference using biochemical kinetics
Motivation: Networks are widely used as structural summaries of biochemical systems. Statistical estimation of networks is usually based on linear or discrete models. However, the dynamics of biochemical systems are generally non-linear, suggesting that suitable non-linear formulations may offer gains with respect to causal network inference and aid in associated prediction problems. Results: We present a general framework for network inference and dynamical prediction using time course data that is rooted in nonlinear biochemical kinetics. This is achieved by considering a dynamical system based on a chemical reaction graph with associated kinetic parameters. Both the graph and kinetic parameters are treated as unknown; inference is carried out within a Bayesian framework. This allows prediction of dynamical behavior even when the underlying reaction graph itself is unknown or uncertain. Results, based on (i) data simulated from a mechanistic model of mitogen-activated protein kinase signaling and (ii) phosphoproteomic data from cancer cell lines, demonstrate that non-linear formulations can yield gains in causal network inference and permit dynamical prediction and uncertainty quantification in the challenging setting where the reaction graph is unknown. Availability and implementation: MATLAB R2014a software is available to download from warwick.ac.uk/chrisoates.
60 APPLIED LIFE SCIENCES↗
Data driven pathway analysis and forecast of global warming and sea level rise
Climate change is a critical issue of our time, and its causes, pathways, and forecasts remain a topic of broader discussion. In this paper, we present a novel data driven pathway analysis framework to identify the key processes behind mean global temperature and sea level rise, and to forecast the magnitude of their increase from the present to 2100. Based on historical data and dynamic statistical modeling alone, we have established the causal pathways that connect increasing greenhouse gas emissions to increasing global mean temperature and sea level, with its intermediate links encompassing humidity, sea ice coverage, and glacier mass, but not for sunspot numbers. Our results indicate that if no action is taken to curb anthropogenic greenhouse gas emissions, the global average temperature would rise to an estimated 3.28 °C (2.46–4.10 °C) above its pre-industrial level while the global sea level would be an estimated 573 mm (474–671 mm) above its 2021 mean by 2100. However, if countries adhere to the greenhouse gas emission regulations outlined in the 2021 United Nations Conference on Climate Change (COP26), the rise in global temperature would lessen to an average increase of 1.88 °C (1.43–2.33 °C) above its pre-industrial level, albeit still higher than the targeted 1.5 °C, while the sea level increase would reduce to 449 mm (389–509 mm) above its 2021 mean by 2100.
54 ENVIRONMENTAL SCIENCES↗
Operation Optimization using Reinforcement Learning with Integrated Artificial Reasoning Framework
In large and complex systems, operational decision-making requires a systematic analysis with a vast amount of data from both process parameters and component status monitoring. In this paper, we present an integrated artificial reasoning approach for system state transition models that can help operational decision-making with explainable and traceable reasoning. The integrated artificial reasoning framework is a physics-based approach of defining the system structure in a Bayesian network, so we leveraged it in a Markov decision process (MDP) for finding optimal operational solutions. In our proposed framework, the MDP is implemented on a dynamic Bayesian network (DBN), which represents causalities in a system. The multilevel flow modeling was utilized in order to extract these causalities in a more efficient and objective manner. Since multilevel flow modeling is based on the fundamental energy and mass conservation laws, the target system is decomposed into several mass, energy, and information structures, which serve as the basis for a DBN. The MDP consists of the processes of finding a solution for the Bellman equation, which can be derived from the conditional probability equations of the constructed DBN. System operators can capture stochastic system dynamics as multiple subsystem state transitions based on their physical relations and uncertainties coming from the component degradation process or random failures. We analyzed a simplified example system to illustrate finding an optimal operational policy with this approach.
99 GENERAL AND MISCELLANEOUS↗
Explaining and predicting human behavior and social dynamics in simulated virtual worlds: reproducibility, generalizability, and robustness of causal discovery methods
Ground Truth program was designed to evaluate social science modeling approaches using simulation test beds with ground truth intentionally and systematically embedded to understand and model complex Human Domain systems and their dynamics Lazer et al. (Science 369:1060–1062, 2020). Our multidisciplinary team of data scientists, statisticians, experts in Artificial Intelligence (AI) and visual analytics had a unique role on the program to investigate accuracy, reproducibility, generalizability, and robustness of the state-of-the-art (SOTA) causal structure learning approaches applied to fully observed and sampled simulated data across virtual worlds. In addition, we analyzed the feasibility of using machine learning models to predict future social behavior with and without causal knowledge explicitly embedded. In this paper, we first present our causal modeling approach to discover the causal structure of four virtual worlds produced by the simulation teams—Urban Life, Financial Governance, Disaster and Geopolitical Conflict. Our approach adapts the state-of-the-art causal discovery (including ensemble models), machine learning, data analytics, and visualization techniques to allow a human-machine team to reverse-engineer the true causal relations from sampled and fully observed data. We next present our reproducibility analysis of two research methods team’s performance using a range of causal discovery models applied to both sampled and fully observed data, and analyze their effectiveness and limitations. We further investigate the generalizability and robustness to sampling of the SOTA causal discovery approaches on additional simulated datasets with known ground truth. Our results reveal the limitations of existing causal modeling approaches when applied to large-scale, noisy, high-dimensional data with unobserved variables and unknown relationships between them. We show that the SOTA causal models explored in our experiments are not designed to take advantage from vasts amounts of data and have difficulty recovering ground truth when latent confounders are present; they do not generalize well across simulation scenarios and are not robust to sampling; they are vulnerable to data and modeling assumptions, and therefore, the results are hard to reproduce. Finally, when we outline lessons learned and provide recommendations to improve models for causal discovery and prediction of human social behavior from observational data, we highlight the importance of learning data to knowledge representations or transformations to improve causal discovery and describe the benefit of causal feature selection for predictive and prescriptive modeling.
97 MATHEMATICS AND COMPUTING↗
Theoretical Foundations of Remote Sensing for Glacier Assessment and Mapping
The international scientific community is actively engaged in assessing ice sheet and alpine glacier fluctuations at a variety of scales. The availability of stereoscopic, multitemporal, and multispectral satellite imagery from the optical wavelength regions of the electromagnetic spectrum has greatly increased our ability to assess glaciological conditions and map the cryosphere. There are, however, important issues and limitations associated with accurate satellite information extraction and mapping, as well as new opportunities for assessment and mapping that are all rooted in understanding the fundamentals of the radiation transfer cascade. We address the primary radiation transfer components, relate them to glacier dynamics and mapping, and summarize the analytical approaches that permit transformation of spectral variation into thematic and quantitative parameters. We also discuss the integration of satellite-derived information into numerical modeling approaches to facilitate understandings of glacier dynamics and causal mechanisms.
Remote Sensing↗
A knowledge-based approach to identification and adaptation in dynamical systems control
Artificial intelligence techniques are applied to the problems of model form and parameter identification of large-scale dynamic systems. The object-oriented knowledge representation is discussed in the context of causal modeling and qualitative reasoning. Structured sets of rules are used for implementing qualitative component simulations, for catching qualitative discrepancies and quantitative bound violations, and for making reconfiguration and control decisions that affect the physical system. These decisions are executed by backward-chaining through a knowledge base of control action tasks. This approach was implemented for two examples: a triple quadrupole mass spectrometer and a two-phase thermal testbed. Results of tests with both of these systems demonstrate that the software replicates some or most of the functionality of a human operator, thereby reducing the need for a human-in-the-loop in the lower levels of control of these complex systems.
Glass, B. J.↗
Investigation of Surface and Marine-Cloud Coupling and its Impact on Cloud Droplet Number Concentrations and Cloud Cover Over the Southern Ocean
The proposed work involves characterizing and quantifying both the thermodynamic and dynamical coupling of marine low clouds (MLC) with the sea surface using Atmospheric Radiation Measurement (ARM) observations during MARCUS field campaign and an LES model. ARM data from multiple sensors will be used (e.g., Doppler cloud radar, ceilometer, and microwave radiometer) to characterize the MLC-surface coupling by virtue of the vertical structure and integrated quantities of boundary-layer clouds, aerosols, as well as atmospheric profiles and surface meteorology. We have used a combination of case studies and statistics-based composite analyses to find any linkages between large-scale dynamics, MLC-surface coupling, and cloud and boundary layer properties, the sequence of which reflects the chain of causality. An LES model with explicit aerosol physics, which includes the cycle of aerosols by being consumed as CCN and be regenerated following cloud droplet evaporation, has been run to determine the sources and sinks of Nd and their dependence on the degree of MLC-surface coupling. We have examined the systematic differences in both Nd and cloud occurrence between the two clusters under different meteorological conditions and further examine their respective roles, as well as causal relationships by means of LES modeling. This study helped improve our understanding of the ACI by differentiating the dynamic role of the coupling and cloud physics denoted by Nd, bridging the linkage in the chain toward understanding mechanisms governing the persistence of MLC over the Southern Ocean, solving the long-lasting problem of the cloud cover underestimation over the SO by GCMs. Ample ARM data and LES model have been employed to achieve the objectives of the study.
54 ENVIRONMENTAL SCIENCES↗
Operation Optimization Using Reinforcement Learning with Integrated Artificial Reasoning Framework
In large and complex systems, operational decision-making requires a systematic analysis with a vast amount of data from both process parameters and component status monitoring. In this paper, we present an integrated artificial reasoning approach for system state transition models that can help operational decision-making with explainable and traceable reasoning. The integrated artificial reasoning framework is a physics-based approach of defining the system structure in a Bayesian network, so we leveraged it in a Markov decision process (MDP) for finding optimal operational solutions. In our proposed framework, the MDP is implemented on a dynamic Bayesian network (DBN), which represents causalities in a system. The multilevel flow modeling was utilized in order to extract these causalities in a more efficient and objective manner. Since multilevel flow modeling is based on the fundamental energy and mass conservation laws, the target system is decomposed into several mass, energy, and information structures, which serve as the basis for a DBN. The MDP consists of the processes of finding a solution for the Bellman equation, which can be derived from the conditional probability equations of the constructed DBN. System operators can capture stochastic system dynamics as multiple subsystem state transitions based on their physical relations and uncertainties coming from the component degradation process or random failures. We analyzed a simplified example system to illustrate finding an optimal operational policy with this approach.
Kim, Junyung↗