Optimal Discounted Stochastic Control for Diffusion Processes
Optimal cost discounted stochastic control for diffusion processes
SEARCH · Engineering Papers
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Optimal cost discounted stochastic control for diffusion processes
Purpose: Application of process control theory in quality assurance programs promises to allow earlier identification of problems and potentially better quality in delivery than traditional paradigms based primarily on tolerances and action levels. The purpose of this project was to characterize underlying seasonal variations in linear accelerator output that can be used to improve performance or trigger preemptive maintenance. Methods: Review of runtime plots of daily (6 MV) output data acquired using in house ion chamber based devices over three years and for fifteen linear accelerators of varying make and model were evaluated. Shifts in output due to known interventions with the machines were subtracted from the data to model an uncorrected scenario for each linear accelerator. Observable linear trends were also removed from the data prior to evaluation of periodic variations. Results: Runtime plots of output revealed sinusoidal, seasonal variations that were consistent across all units, irrespective of manufacturer, model or age of machine. The average amplitude of the variation was on the order of 1%. Peak and minimum variations were found to correspond to early April and September, respectively. Approximately 48% of output adjustments made over the period examined were potentially avoidable if baseline levels had corresponded to the mean output, rather than to points near a peak or valley. Linear trends were observed for three of the fifteen units, with annual increases in output ranging from 2–3%. Conclusion: Characterization of cyclical seasonal trends allows for better separation of potentially innate accelerator behaviour from other behaviours (e.g. linear trends) that may be better described as true out of control states (i.e. non-stochastic deviations from otherwise expected behavior) and could indicate service requirements. Results also pointed to an optimal setpoint for accelerators such that output of machines is maintained within set tolerances and interventions are required less frequently.
This report describes how the Deep Space Mission System (DSMS) Operations Program Office at the Jet Propulsion Laboratory's (EL) uses Statistical Process Control (SPC) to monitor performance and evaluate initiatives for improving processes on the National Aeronautics and Space Administration's (NASA) Deep Space Network (DSN).
A major scientific challenge in environmental sciences is to identify the dominant processes controlling actinide transport in the environment. It is estimated that currently, over 2200 metric tons of anthropogenic plutonium (Pu) has accumulated worldwide, a number that increases yearly with additional spent nuclear fuel (Ewing et al., 2010). Plutonium has been shown to migrate on the scale of kilometers, giving way to a critical concern that the fundamental biogeochemical processes that control its behavior in the subsurface are not well understood (Kersting et al. 1999; Novikov et al. 2006; Santschi et al. 2002). Neptunium (Np) is less prevalent in the environment; however, it is predicted to be a significant long-term dose contributor in high-level nuclear waste. Our focus on Np chemistry in this Science Plan is intended to help formulate a better understanding of Pu redox transformations in the environment and clarify the differences between the two long-lived actinides. The research approach of our Science Plan combines (1) Fundamental Mechanistic Studies that identify and quantify biogeochemical processes that control actinide behavior in solution and on solids, (2) Field Integration Studies that investigate the transport characteristics of Pu and test our conceptual understanding of actinide transport, and (3) Actinide Research Capabilities that allow us to achieve the objectives of this Scientific Focus Area (SFA) and provide new opportunities for advancing actinide environmental chemistry. These three Research Thrusts form the basis of our SFA Science Program.
A method and apparatus for managing operation of graphics processing units in a computer system. A processing thread in the computer system controls processing of a set of sinogram data by a graphics processing unit to form a set of graphics data. An output thread in the computer system controls writing of the set of graphics data to a storage system. The graphics processing unit is available to perform processing of another set of sonogram data while the set of graphics data is written to the storage system such that the increased availability of a plurality of graphics processing units is present.
Model Predictive Control (MPC) is an advanced process control method that has attracted much attention in building heating, ventilation, and air conditioning (HVAC) systems. Here, this paper analyzes the optimal precooling performance in residential buildings using MPC with two different comfort indices, namely, temperature and predicted mean vote (PMV). It first formulates, for each comfort index, an optimization problem that accounts for different factors, such as weather, home thermal condition, prediction horizon, time-of use (TOU) utility rate, and rated cooling capacity. The problem is then solved, resulting in an MPC strategy that determines the HVAC on/off control signal and minimizes energy cost over a receding time horizon while maintaining thermal comfort. The energy performance difference between temperature-based and PMV-based MPC strategies is subsequently investigated, especially in light of the interior wall surface temperature and under different combinations of the factors. Extensive simulation results demonstrated that the proposed MPC strategies are adaptive and their performances depend primarily on weather, home thermal condition, and prediction horizon, while the impact of TOU utility rate and rated cooling capacity is relatively small. Because the PMV-based MPC strategy can take advantage of the lower interior wall surface temperature due to precooling, it resulted in 8–45% cost savings for the scenarios investigated and an average increase of 0.042–0.113 in the absolute value of the PMV index compared to the temperature-based MPC strategy.
Additive manufacturing (AM), as a digital process, can generate a detailed digital thread linking a part’s design and manufacturing to its operational performance. As AM systems advance, an increasing amount of process data is stored in manufacturing databases. In principle, this data can be utilized by simulation-based digital twin approaches, such as real-time process control and asynchronous post-processing guidance. However, few tools currently exist for systematically integrating digital thread data with computational tools. Here, in this study, we propose a software package, called Myna, for connecting data from powder bed fusion processes to simulation tools. The utility of such a platform is demonstrated using build data from the Oak Ridge National Laboratory Manufacturing Demonstration Facility “Peregrine v2023-10” public dataset to automatically configure and run 54 semi-analytical 3DThesis melt pool simulations, 78 numerical Additive FOAM melt pool simulations, and 3 ExaCA microstructure simulations. The simulated, spatially registered microstructures are then compared directly with electron backscatter diffraction characterization of the corresponding as-built part locations. The resulting simulated microstructure showed variation as a function of process parameters, particularly stripe width; however, the experimental data had little variation between the microstructure texture and grain size resulting from different processing conditions. Analysis of the discrepancies suggest that it is possible a two-phase ferritic-austenitic solidification model is needed to accurately predict grain size and texture for certain stainless steel 316L feedstock compositions under powder bed fusion conditions, providing direction for future research. As illustrated here, due to the number and complexity of the simulations involved in AM process-structure–property predictions, automated methods to connect process data and simulations will remain necessary tools for testing hypotheses and implementing digital twin applications.
Here, this study presents a multilevel analysis of electrochemically mediated methanolysis as a promising method for reducing the environmental impacts of plastic recycling, with a focus on depolymerizing poly(ethylene terephthalate) (PET) into dimethyl terephthalate (DMT). Instead of conventional chemical PET depolymerization, this electrochemical approach provides distinct technical advantages in process control and efficiency. At the process level, key operational parameters, including applied current and reaction time, were systematically investigated to optimize PET conversion and DMT selectivity. The electrochemical approach was directly compared to equivalent chemical methanolysis systems and demonstrated superior performance in terms of PET conversion and DMT selectivity. Building on these findings, a technoeconomic assessment identified the current economic bottlenecks and revealed that improvements in process design, DMT selectivity, PET conversion, and energy efficiency are key to reducing the overall process cost and enabling future implementation. While further optimization is required for market competitiveness, these results establish a performance baseline for the electrochemically mediated PET methanolysis process and underscore the importance of combining process-level innovation with systems-level evaluation in the development of sustainable recycling technologies.
A deterministic state-of-charge (SOC) balancing approach software control code is introduced as an integral secondary management to primary control layer of an islanded small microgrid or nanogrid system made up of multiple grid-forming inverter/battery/solar combination systems, where each set of batteries with each inverter are on independent DC buses (i.e. non-paralleled on the DC sides). A DERMS-level control approach, algorithm and automation controller program was developed to improve coordination and enable microgrid asset compliance and SOC balancing, enabling provision of a system-level power stability support architecture, load support, and asset scalability. The architecture is configured to treat each unit or micro/nano-grid as a node in a microgrid network, allowing for autonomous DERMS control regarding load and SOC balancing and power stability. As the network grows with the addition of units, greater coordination efforts may be required. The ideal small network microgrid ranges from 2-10 inverter/battery units before additional control parameters must be considered in the existing architecture. The control approach focuses on a deterministic state-of-charge analysis as the primary level control process followed by a secondary control loop using a forced frequency-watt droop strategy to conform off-the-shelf components into behaving under a leader-follower configuration. Adopting this control scheme has been shown to allow for a balanced, unit-coordinated microgrid network, enabling stable power flow. The deterministic state-of-charge approach is introduced as an integral primary control layer of an islanded small network microgrid. A standard strategy for SOC balancing is implementing a battery management system (BMS) to control SOC on the DC side. An alternative approach is to determine how to coordinate sending and receiving power on the AC side with multiple units. The latter approach assesses all the integrated units in the microgrid network. Once the individual units are identified, further system data is required to calculate each unit's total kWh, provided information about its capability to supply or consume kWh and availability. The secondary control layer in the multi-layered small network microgrid methodology uses the primary layer’s decision to initiate frequency setpoint changes, initializing the SOC balancing. The secondary control layer considers numerous system-dependent variables to enable a charging and discharging profile based on adjustable frequency setpoints. The combined architecture will result in stable, coordinated power flow enhancing an AC microgrid's functionalities.
Refractory metal alloys rating on basis of weldability emphasizing metallurgical considerations, taking into account process control and welding as thermal process
Report discusses totally-automated oxidation and diffusion facility for fabricating IC's. Several innovations are demonstrated: process controller specifically designed for semiconductor processing; automatic loading system to accept wafers from air track, insert them in quartz carrier, and place carrier on paddle for insertion into furnace; automatic unloading of wafers back onto air track; and boron diffusion using diborane.
Ozone concentrations at the Earth's surface are controlled by meteorological and chemical processes and are a function of advection, entrainment, deposition, and net chemical production/loss. The relative contributions of these processes vary in time and space. Understanding the relative importance of these processes controlling surface ozone concentrations is an essential component for designing effective regulatory strategies. Here we focus on the diurnal cycle of entrainment through atmospheric boundary layer (ABL) growth in the Colorado Front Range. Aircraft soundings and surface observations collected in July/August 2014 during the DISCOVER-AQ/FRAPPÉ (Deriving Information on Surface conditions from Column and Vertically Resolved Observations Relevant to Air Quality/Front Range Air Pollution and Photochemistry Éxperiment) campaigns and equivalent data simulated by a regional chemical transport model are analyzed. Entrainment through ABL growth is most important in the early morning, fumigating the surface at a rate of ~5 ppbv/h. The fumigation effect weakens near noon and changes sign to become a small dilution effect in the afternoon on the order of -1 ppbv/h. The chemical transport model WRF-Chem (Weather Research and Forecasting Model with chemistry) underestimates ozone at all altitudes during this study on the order of 10-15 ppbv. The entrainment through ABL growth is overestimated by the model in the order of 0.6-0.8 ppbv/h. This results from differences in boundary layer growth in the morning and ozone concentration jump across the ABL top in the afternoon. This implicates stronger modeled fumigation in the morning and weaker modeled dilution after 11:00 LT.
The 325MHz Single Spoke Resonator 1 (SSR1) Cryomodule (CM) has a 5.3-meter length, and it has 288-liter liquid helium @ 4.5K mode. The High Beta 650 MHz (HB650) CM contains six elliptical cavity cryomodules, has a 9.9-meter overall length and it has 530-liter liquid helium. The SSR1 and HB650 CM had been tested at Fermilab Cryomodule Test Facility (CMTF). Their cryogenic control system includes the Siemens Process Control System S7-400, Automation Direct DL205 PLC, and remote synoptic HMI/EPICS Phoebus GUI. This paper presents a method which has been successfully used by Fermilab PIP2 IT cryogenic remote on-line, real-time control systems.
A major scientific challenge in environmental sciences is to identify the dominant processes controlling actinide transport in the environment. It is estimated that currently, over 2200 metric tons of plutonium (Pu) have been deposited in the subsurface worldwide, a number that increases yearly with additional spent nuclear fuel (Ewing et al., 2010). Plutonium has been shown to migrate on the scale of kilometers, giving way to a critical concern that the fundamental biogeochemical processes that control its behavior in the subsurface are not well understood (Kersting et al., 1999; Novikov et al., 2006; Santschi et al., 2002). Neptunium (Np) is less prevalent in the environment; however, it is predicted to be a significant long-term dose contributor in high-level nuclear waste. Our focus on Np chemistry in this Science Plan is intended to help formulate a better understanding of Pu redox transformations in the environment and clarify the differences between the two long-lived actinides. The research approach of our Science Plan combines (1) Fundamental Mechanistic Studies that identify and quantify biogeochemical processes that control actinide behavior in solution and on solids, (2) Field Integration Studies that investigate the transport characteristics of Pu and test our conceptual understanding of actinide transport, and (3) Actinide Research Capabilities that allow us to achieve the objectives of this Scientific Focus Area (SFA and provide new opportunities for advancing actinide environmental chemistry. These three Research Thrusts form the basis of our SFA Science Program (Figure 1).
Incorporating a state-of-the-art process control and instrumentation system into a complex system for thermal vacuum testing is discussed. The challenge was to connect several independent control systems provided by various vendors to a supervisory computer. This combination will sequentially control and monitor the process, collect the data, and transmit it to color a graphic system for subsequent manipulation. The vacuum system upgrade included: replacement of seventeen diffusion pumps with eight cryogenic pumps and one turbomolecular pump, replacing a relay based control system, replacing vacuum instrumentation, and upgrading the data acquisition system.
Data diodes provide protection of critical cyber assets by the means of physically enforcing traffic direction on the network. In order to deploy data diodes effectively, it is imperative to understand the protection they provide, the protection they do not provide, their limitations, and their place in the larger security infrastructure. In this work, we study data diodes, their functionalities and limitations. We then propose two critical infrastructure systems that can benefit from the additional protection offered by data diodes: process control networks and net-centric cyber decision support systems. We review the security requirements of these systems, describe the architectures, and study the trade-offs. Finally, the architectures are evaluated against different attack patterns.
Laser induced breakdown spectroscopy (LIBS) is a materials characterization technique that has been advanced and refined to provide in situ, real-time quality control of carbon fiber reinforced polymer (CFRP) surfaces. As part of an effort to improve process control for adhesive bonding, a LIBS system was designed and assembled at NASA Langley Research Center (LaRC) to enable detection of ultralow concentrations of silicone contamination on CFRP adherends. The LIBS instrument provides high sensitivity detection and quasi-nondestructive surface characterization of CFRP adherends prior to adhesive bonding. This review focuses on the advancements at LaRC using LIBS as a quality control tool for the detection of silicone contaminants for improved adhesive bonding reliability of CFRP materials. This work describes how the LIBS technique was advanced by analyzing the laser parameters, studying the laser-matter interactions, and performing time-resolved measurements to determine the optimal plasma conditions for elemental detection. In addition, LIBS results were compared to X-ray photoelectron spectroscopy data to enable quantitative analysis from analytical calibration curves. Examples are shown of how to perform surface mapping of silicone contamination. Finally, a brief discussion is also presented on LIBS instrumentation, recommendations for laser parameters and instrumentation components, and LIBS technique maturity.
The NASA Langley 8-Foot High Temperature Tunnel produces true enthalpy environments simulating flight from Mach 4 to Mach 7, primarily for airbreathing propulsion and aerothermal/thermo-structural testing. Flow conditions are achieved through a methane-air heater and nozzles producing aerodynamic Mach numbers of 4, 5 or 7 and have exit diameters of 8 feet or 4.5 feet. The 12-ft long free-jet test section, housed inside a 26-ft vacuum sphere, accommodates large test articles. Recently, the facility underwent significant upgrades to support hydrocarbon fueled scramjet engine testing and to expand flight simulation capability. The upgrades were required to meet engine system development and flight clearance verification requirements originally defined by the joint NASA-Air Force X-43C Hypersonic Flight Demonstrator Project and now the Air Force X-51A Program. Enhancements to the 8-Ft. HTT were made in four areas: 1) hydrocarbon fuel delivery; 2) flight simulation capability; 3) controls and communication; and 4) data acquisition/processing. The upgrades include the addition of systems to supply ethylene and liquid JP-7 to test articles; a Mach 5 nozzle with dynamic pressure simulation capability up to 3200 psf, the addition of a real-time model angle-of-attack system; a new programmable logic controller sub-system to improve process controls and communication with model controls; the addition of MIL-STD-1553B and high speed data acquisition systems and a classified data processing environment. These additions represent a significant increase to the already unique test capability and flexibility of the facility, and complement the existing array of test support hardware such as a model injection system, radiant heaters, six-component force measurement system, and optical flow field visualization hardware. The new systems support complex test programs that require sophisticated test sequences and precise management of process fluids. Furthermore, the new systems, such as the real-time angle of attack system and the new programmable logic controller enhance the test efficiency of the facility. The motivation for the upgrades and the expanded capabilities is described here.