Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “stochastic distribution control”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7
All sourcesNASA NTRSDOE OSTI
NASA NTRS1985

An APL program for the distribution of energy deposition by charged particles passing through thin absorbers

An APL program which numerically evaluates the probability density function (PDF) for the energy deposited in a thin absorber by a charged particle is proposed, with application to the construction, pointing, and control of spacecraft. With this program, the PDF of the restricted energy loss distribution of Watts (1973) is derived, and Vavilov's (1957) distribution is obtained by proper parameter selection. The method is demonstrated with the example of the effect of charged particle induced radiation on the Hubble Space Telescope (HST) pointing accuracy. A Monte Carlo study simulates the photon noise caused by charged particles passing through the photomultiplier tube window, and the stochastic variation of energy loss is introduced into the simulation by generating random energy losses from a power law distribution. The program eliminates annoying loop procedures, and model parameter sensitivity can be studied using the graphical output.

Howell, L. W.↗
DOE OSTI2024

Uncertainty Quantification and Sensitivity Analysis of Non-Nuclear Advanced Controls Testbed Reactor Mockup

The research presented in this report describes our progress in applying stochastic methods and uncertainty quantification, parametric study, and variance-based sensitivity analysis (also known as Sobol sensitivity analysis) to a full-core model of a nuclear thermal propulsion (NTP) system simulated with Griffin, with the goal of developing a reduced order (surrogate) model which can be rapidly sampled while perturbing multiple input parameters. In this NTP system, reactivity and power feedback affect the rotation of control drums, which are controlled by a hybrid proportional, integral and derivative (PID) controller, actuated by the power demand and reactivity feedback from the numerical model. This model uses reactor kinetic feedback (mean generation time and $\beta$ from a transient Griffin simulation executed with the improved quasi-static method to provide the kinetic parameters) as inputs to functions which control the CD rotation angle. Using a number of stochastic method approaches, we developed a dual purpose training-surrogate model of the NTP system using polynomial regression. The trained model can be rapidly sampled while simultaneously perturbing various input parameters of the model, such as coefficients on the PID control, or temperature (directly affect the neutron cross section). The surrogate model delivers accurate results orders-of-magnitude faster (minutes, not days) than the base model. Once the base model has been trained, distributions of the uncertain parameters can be changed at will to investigate the effects of perturbing multiple inputs and their effect on the output. For example, coefficients used in the PID control system may vary due to some physical interference, or there may be uncertainty in the temperature of the neutron cross sections in various regions of the reactor. A distribution can be placed on these parameters and operational boundaries can be determined. The goal of this work is to support development of an advanced control system to operate CDs in a functioning NTP system.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2023

Stochastic Framework for Optimal Control of Planetary Reentry Trajectories Under Multilevel Uncertainties

We present a novel stochastic optimal control framework that accounts for various types of uncertainties, with application to reentry trajectory planning. The formulation of the optimal trajectory control problem is presented in the context of an indirect method where a functional objective associated with the terminal vehicle speed is to be minimized. Uncertain input parameters in the optimal trajectory control model, including aerodynamic parameters and initial and terminal conditions, are modeled as aleatory random variables, while the statistical parameters of these aleatory distributions are themselves random variables. The parametric and model uncertainties are simultaneously propagated through an extended polynomial chaos expansion (EPCE) formalism. Several metrics are described to evaluate response statistics and presented as insightful tools for robust decision making. Specifically, the response probability density function (PDF) reflecting influence of both epistemic and aleatory uncertainties is obtained. By sampling over the random variables representing model error, an ensemble of response PDFs is generated and the associated failure probability is estimated as a random variable with its own polynomial chaos expansion. Besides, the sensitivity index functions of response PDF with respect to the statistical parameters are evaluated. Coupling parametric and model uncertainties within the EPCE framework leads to a robust and efficient paradigm for multilevel uncertainty propagation and PDF characterization in general optimal control problems.

Engineering↗
DOE OSTI2024

Defining Reactivity–Deconstructability Relationships for Copolymerizations Involving Cleavable Comonomer Additives

The incorporation of cleavable comonomers as additives into polymers can imbue traditional polymers with controlled deconstructability and expanded end-of-life options. The efficiency with which cleavable comonomer additives (CCAs) can enable deconstruction is sensitive to their local distribution within a copolymer backbone, which is dictated by their copolymerization behavior. While qualitative heuristics exist that describe deconstructability, comprehensive quantitative connections between CCA loadings, reactivity ratios, polymerization mechanisms, and deconstruction reactions on the deconstruction efficiency of copolymers containing CCAs have not been established. Here, in this work, we broadly define these relationships using stochastic simulations characterizing various polymerization mechanisms (e.g., controlled/living, free-radical, and reversible ring-opening polymerizations), reactivity ratio pairs (spanning 2 orders of magnitude between 0.01 and 100), CCA loadings (2.5% to 20%), and deconstruction reactions (e.g., comonomer sequence-dependent deconstruction behavior). We show general agreement between simulated and experimentally observed deconstruction fragment sizes from the literature, demonstrating the predictive power of the methods used herein. These results will guide the development of more efficient CCAs and inform the formulation of deconstructable materials.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
NASA NTRS2004

Complexity of life via collective mind

e mind is introduced as a set of simple intelligent units (say, neurons, or interacting agents), which can communicate by exchange of information without explicit global control. Incomplete information is compensated by a sequence of random guesses symmetrically distributed around expectations with prescribed variances. Both the expectations and variances are the invariants characterizing the whole class of agents. These invariants are stored as parameters of the collective mind, while they contribute into dynamical formalism of the agents' evolution, and in particular, into the reflective chains of their nested abstract images of the selves and non-selves. The proposed model consists of the system of stochastic differential equations in the Langevin form representing the motor dynamics, and the corresponding Fokker-Planck equation representing the mental dynamics (Motor dynamics describes the motion in physical space, while mental dynamics simulates the evolution of initial errors in terms of the probability density). The main departure of this model from Newtonian and statistical physics is due to a feedback from the mental to the motor dynamics which makes the Fokker-Planck equation nonlinear. Interpretation of this model from mathematical and physical viewpoints, as well as possible interpretation from biological, psychological, and social viewpoints are discussed. The model is illustrated by the dynamics of a dialog.

collective intelligence↗
DOE OSTI2020

Chapter Nine - Automated Optimal Control in Energy Systems: The Reinforcement Learning Approach

With the development of smart grid technologies an increasing number of new devices and participants have joined modern energy systems and are inevitably making them more complicated and interdependent than ever. Optimally controlling such a complex energy system and maintaining its operation in a high-efficient, secure, and resilient manner are challenging tasks to the system operators. Fortunately, the revolution in deep learning and artificial intelligence (AI), both from hardware and algorithms perspectives, has provided new ideas and solutions to many previously intractable problems. As a result, this advance in computer science also sparked great research interests in utilizing AI in solving engineering problems related to the modern energy systems. Among many AI techniques, deep reinforcement learning (DRL) has demonstrated great potential for solving sequential optimization problems, which are very common in the engineering domains. Its ability to handle nonlinearity and stochasticity in controlled systems has out-competed many traditional optimal control algorithms. Therefore in this chapter, we focus on the state-of-the-art of DRL concepts and related algorithms, compare their pros and cons with traditional optimal control approaches and discuss the typical workflow for leveraging RL in solving complex problems in modern energy systems.

artificial intelligence↗
DOE OSTI2021

Multi-Time Scale Coordinated Control and Scheduling of Inverter-Based TCLs With Variable Wind Generation

To address microgrid tie flow errors caused by wind generation variability, here we propose and develop a multi-time scale coordinated control and scheduling strategy for inverter-based thermostatically controlled loads (TCLs). First, in hour-time scale, inverter-based TCLs with adjusting temperature set-point are modeled as virtual generators to compensate tie flow deviations in the day-ahead plan. Next, in minute-time scale, virtual batteries representing operating behaviors of inverter-based TCLs with frequency control are scheduled determined by the control of virtual generators in hour-time scale. The virtual batteries are scheduled to smooth out tie flow errors corresponding to day-ahead plan and hour-time scale schedules. The multi-time scale control methods are coordinated to employ the response potential of inverter-based TCLs and response curve-based methods are proposed to control inverter-based TCLs considering the customer privacy. The multi-time scale stochastic schedules which are based on response curves of inverter-based TCLs are coordinated to accommodate wind generation variability. Simulation results demonstrate that the microgrid tie flow errors are effectively mitigated by the proposed multi-time scale coordinated control and scheduling of inverter-based TCLs.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2020

Communication-Constrained Expansion Planning for Resilient Distribution Systems

Distributed generation and remotely controlled switches have emerged as important technologies to improve the resiliency of distribution grids against extreme weather-related disturbances. Therefore it becomes important to study how best to place them on the grid in order to meet a resiliency criteria, while minimizing costs and capturing their dependencies on the associated communication systems that sustain their distributed operations. This paper introduces the Optimal Resilient Design Problem for Distribution and Communication Systems (ORDPDC) to address this need. The ORDPDC is formulated as a two-stage stochastic mixed-integer program that captures the physical laws of distribution systems, the communication connectivity of the smart grid components, and a set of scenarios that specifies which components are affected by potential disasters. The paper proposes an exact branch-and-price algorithm for the ORDPDC that features a strong lower bound and a variety of acceleration schemes to address degeneracy. The ORDPDC model and branch-and-price algorithm were evaluated on a variety of test cases with varying disaster intensities and network topologies. The results demonstrate the significant impact of the network topologies on the expansion plans and costs, as well as the computational benefits of the proposed approach.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Reinforcement Learning-based Output Structured Feedback for Distributed Multi-Area Power System Frequency Control

Load frequency control (LFC) is a key factor to maintain the stable frequency in multi-area power systems. As the modern power systems evolve from centralized to decentralized paradigm, LFC needs to consider the decentralized scheme that considers limited information from the information-exchange graph for the generator control of each interconnected area. This paper aims to solve a data-driven constrained LQR problem with mean-variance risk constraints and output structured feedback, and applies this framework to solve the LFC problem in multi-area power systems. By reformulating the constrained optimization problem into a minimax problem, the stochastic gradient descent max-oracle (SGDmax) algorithm with zero-order policy gradient (ZOPG) is adopted to find the optimal feedback gain from the learning, while guaranteeing the convergence. In addition, to improve the adaptation of the proposed learning method to new or varying models, we construct an emulator grid that approximates the dynamics of a physical grid and performs training based on this model. Once the feedback gain is obtained from the emulator grid, it is applied to the physical grid with a robustness test to check whether the controller from the approximated emulator applies to the actual system. Numerical tests show that the obtained feedback controller can successfully control the frequency of each area, while mitigating the uncertainty from the loads, with reliable robustness that ensures the adaptability of the obtained feedback gain to the actual physical grid.

Kwon, Kyung-bin↗
NASA NTRS2002

A statistical model for interpreting computerized dynamic posturography data

Computerized dynamic posturography (CDP) is widely used for assessment of altered balance control. CDP trials are quantified using the equilibrium score (ES), which ranges from zero to 100, as a decreasing function of peak sway angle. The problem of how best to model and analyze ESs from a controlled study is considered. The ES often exhibits a skewed distribution in repeated trials, which can lead to incorrect inference when applying standard regression or analysis of variance models. Furthermore, CDP trials are terminated when a patient loses balance. In these situations, the ES is not observable, but is assigned the lowest possible score--zero. As a result, the response variable has a mixed discrete-continuous distribution, further compromising inference obtained by standard statistical methods. Here, we develop alternative methodology for analyzing ESs under a stochastic model extending the ES to a continuous latent random variable that always exists, but is unobserved in the event of a fall. Loss of balance occurs conditionally, with probability depending on the realized latent ES. After fitting the model by a form of quasi-maximum-likelihood, one may perform statistical inference to assess the effects of explanatory variables. An example is provided, using data from the NIH/NIA Baltimore Longitudinal Study on Aging.

NASA Discipline Neuroscience↗
NASA NTRS2004

Computation Molecular Kinetics Model of HZE Induced Cell Cycle Arrest

Cell culture models play an important role in understanding the biological effectiveness of space radiation. High energy and charge (HZE) ions produce prolonged cell cycle arrests at the G1/S and G2/M transition points in the cell cycle. A detailed description of these phenomena is needed to integrate knowledge of the expression of DNA damage in surviving cells, including the determination of relative effectiveness factors between different types of radiation that produce differential types of DNA damage and arrest durations. We have developed a hierarchical kinetics model that tracks the distribution of cells in various cell phase compartments (early G1, late G1, S, G2, and M), however with transition rates that are controlled by rate-limiting steps in the kinetics of cyclin-cdk's interactions with their families of transcription factors and inhibitor molecules. The coupling of damaged DNA molecules to the downstream cyclin-cdk inhibitors is achieved through a description of the DNA-PK and ATM signaling pathways. For HZE irradiations we describe preliminary results, which introduce simulation of the stochastic nature of the number of direct particle traversals per cell in the modulation of cyclin-cdk and cell cycle population kinetics. Comparison of the model to data for fibroblast cells irradiated photons or HZE ions are described.

Cucinotta, Francis A.↗
NASA NTRS2013

Simulation of Inflated Pahoehoe Lava Flows

A new stochastic model simulates late-stage pahoehoe lobes where random processes dominate emplacement. The model prescribes probabilistic rules for determining where and when parcels of lava move within the lobe. Unlike a classical Brownian motion random walk, the model allows individual parcels to remain dormant, but fluid, for multiple time steps. The randomness of parcel volume transfers within the lobe interior as well as at the margins qualitatively reflects inflation processes observed in the field. The fraction of inflated volume to total volume increases with the total volume, with greater than 75% of the lobe volume contributed through inflation for typical lobes. The influence on planform shape and topographic cross-sectional profiles of total volume, source area and shape, topographic confinement, and sequential breakouts at the lobe margins, are all explored with the stochastic model. Each of these factors influences the overall lobe thickness and width. The model provides a means for assessing the relative importance of these processes through comparisons with field data. For the first time, Gaussian and parabolic functions are quantitatively fit to field measurements of pahoehoe lobes. Both functional forms provide adequate description of the cross-sectional flow shapes. When comparing simulated lobes to field data, sequential breakouts at the lobe margins are found to be an important process controlling the final topographic distribution of observed pahoehoe lobes.

modeling↗
NASA NTRS1972

A stochastic bioburden model for spacecraft sterilization.

Development of a stochastic model of the probability distribution for the random variable representing the number of microorganisms on a surface as a function of time. The first basic principle associated with bioburden estimation is that viable particles are removed from surfaces. The second notion important to the analysis is that microorganisms in environments and on surfaces occur in clumps. The last basic principle relating to bioburden modeling is that viable particles are deposited on a surface. The bioburden on a spacecraft is determined by the amount and kind of control exercised on the spacecraft assembly location, the shedding characteristics of the individuals in the vicinity of the spacecraft, its orientation, the geographical location in which the assembly takes place, and the steps in the assembly procedure. The model presented has many of the features which are desirable for its use in the spacecraft sterilization programs currently being planned by NASA.

Roark, A. L.↗
DOE OSTI2020

Nonlinear power flow control for networked AC/DC microgrids

A method for designing feedforward and feedback controllers for integration of stochastic sources and loads into a nonlinear networked AC/DC microgrid system is provided. A reduced order model for general networked AC/DC microgrid systems is suitable for HSSPFC control design. A simple feedforward steady state solution is utilized for the feedforward controls block. Feedback control laws are provided for the energy storage systems. A HSSPFC controller design is implemented that incorporates energy storage systems that provides static and dynamic stability conditions for both the DC random stochastic input side and the AC random stochastic load side. Transient performance was investigated for the feedforward/feedback control case. Numerical simulations were performed and provided power and energy storage profile requirements for the networked AC/DC microgrid system overall performance. The HSSPFC design can be implemented in the Matlab/Simulink environment that is compatible with real time simulation/controllers.

24 POWER TRANSMISSION AND DISTRIBUTION↗
NASA NTRS1993

Feedback control for unsteady flow and its application to the stochastic Burgers equation

The study applies mathematical methods of control theory to the problem of control of fluid flow with the long-range objective of developing effective methods for the control of turbulent flows. Model problems are employed through the formalism and language of control theory to present the procedure of how to cast the problem of controlling turbulence into a problem in optimal control theory. Methods of calculus of variations through the adjoint state and gradient algorithms are used to present a suboptimal control and feedback procedure for stationary and time-dependent problems. Two types of controls are investigated: distributed and boundary controls. Several cases of both controls are numerically simulated to investigate the performances of the control algorithm. Most cases considered show significant reductions of the costs to be minimized. The dependence of the control algorithm on the time-descretization method is discussed.

Choi, Haecheon↗
DOE OSTI2020

Hierarchical Distribution System Adaptive Restoration with Diverse Distributed Energy Resources

Distributed energy resources (DERs) can be utilized as alternative power sources for fast service recovery in cases of distribution system outages. However, the diverse characteristics and stochastic nature of DERs impose challenges on the optimal operation of di-verse resources during the restoration phase. Here, we introduce a hierarchical structure to coordinate distribution system entities and propose an adaptive restoration strategy to sustain a reliable power supply to outage loads in an unbalanced distribution system utilizing DERs. An efficient system reconfiguration model is developed to guarantee the radiality of restoration islands. The flexibility of DERs is evaluated by a novel method that focuses on the cumulative energy consumption, the superiority of which is also proven. Model predictive control (MPC) is adopted to enable the adjustment of system topology and DER operation strategies based on up-to-date data. The performance of the proposed restoration model is validated on a modified IEEE 123-bus test system. Moreover, the effectiveness of the proposed novel flexibility assessment and the MPC-based adaptive restoration strategy are verified through comparative studies.

24 POWER TRANSMISSION AND DISTRIBUTION↗
NASA NTRS1977

Instantaneous and time-averaged dispersion and measurement models for estimation theory applications with elevated point source plumes

Estimation theory, which originated in guidance and control research, is applied to the analysis of air quality measurements and atmospheric dispersion models to provide reliable area-wide air quality estimates. A method for low dimensional modeling (in terms of the estimation state vector) of the instantaneous and time-average pollutant distributions is discussed. In particular, the fluctuating plume model of Gifford (1959) is extended to provide an expression for the instantaneous concentration due to an elevated point source. Individual models are also developed for all parameters in the instantaneous and the time-average plume equations, including the stochastic properties of the instantaneous fluctuating plume.

Diamante, J. M.↗
NASA NTRS1996

Discrete Deterministic and Stochastic Petri Nets

Petri nets augmented with timing specifications gained a wide acceptance in the area of performance and reliability evaluation of complex systems exhibiting concurrency, synchronization, and conflicts. The state space of time-extended Petri nets is mapped onto its basic underlying stochastic process, which can be shown to be Markovian under the assumption of exponentially distributed firing times. The integration of exponentially and non-exponentially distributed timing is still one of the major problems for the analysis and was first attacked for continuous time Petri nets at the cost of structural or analytical restrictions. We propose a discrete deterministic and stochastic Petri net (DDSPN) formalism with no imposed structural or analytical restrictions where transitions can fire either in zero time or according to arbitrary firing times that can be represented as the time to absorption in a finite absorbing discrete time Markov chain (DTMC). Exponentially distributed firing times are then approximated arbitrarily well by geometric distributions. Deterministic firing times are a special case of the geometric distribution. The underlying stochastic process of a DDSPN is then also a DTMC, from which the transient and stationary solution can be obtained by standard techniques. A comprehensive algorithm and some state space reduction techniques for the analysis of DDSPNs are presented comprising the automatic detection of conflicts and confusions, which removes a major obstacle for the analysis of discrete time models.

MATHEMATICAL MODELS↗