Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “feedback control systems”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 469 records · Page 26

Mechanochemical topological defects in an active nematic

We propose a reaction-diffusion system that converts topological information of an active nematic into chemical signals. We show that a curvature-activated reaction dipole is sufficient for creating a system that dynamically senses topology by producing a concentration field possessing local extrema coinciding with ±$\frac{1}{2}$ defects. The enabling term is analogous to polarization charge density seen in dielectric materials. We demonstrate the ability of this system to identify defects in both passive and active nematics. Our results illustrate that a relatively simple feedback scheme, expressed as a system of partial differential equations, is capable of producing chemical signals in response to inherently nonlocal structures in anisotropic media. Here, we posit that such coarse-grained systems can help generate testable hypotheses for regulated processes in biological systems, such as morphogenesis, and motivate the creation of bio-inspired materials that utilize dynamic coupling between nematic structure and biochemistry.

42 ENGINEERING↗

Three-Channel Sunphotometer Cloud Mode Value-Added Product Report

A primary source of uncertainty in Earth system model (ESM) predictions is the representation of cloud processes and associated cloud feedback. Several fundamental cloud properties critical to the understanding of aerosol-cloud interactions are poorly constrained by observations, with key deficiencies in our observations of cloud and precipitation droplet sizes and cloud optical depth. Observations of these cloud properties are often challenging to estimate from remote-sensing platforms and costly to obtain from in situ aircraft. Nevertheless, observations of boundary-layer clouds, and improved knowledge of stratocumulus cloud (Sc) processes, are especially important to ESM advancement. This is because these clouds have extensive coverage and exert controls on boundary-layer dynamics and the global radiative energy balance.

54 ENVIRONMENTAL SCIENCES↗

Scale Up of High-Performance REBCO Tapes in a Pilot-Scale Advanced MOCVD Tool With In-Line 2D-XRD System

We have reported the development of an Advanced Metal-Organic Chemical Vapor Deposition (AMOCVD) method featuring ohmic heating of the substrate for REBCO film growth, direct tape temperature monitoring, and laminar precursor flow. This A-MOCVD method has been used to fabricate 4 – 5 m thick film REBCO tapes with record high performance: critical currents exceeding 8700 A/12 mm at 30 K, 3 T; and engineering current density of 5200 A/mm 2 at 4.2 K, 15 T. Recently, we constructed a pilot-scale reel-to-reel A-MOCVD system to scale up the technology to long tapes. Preliminary batches of tapes exhibit consistent performance and good uniformity along the length. An in-line 2D X-ray Diffraction (XRD) system has been integrated into the pilot A-MOCVD tool to monitor the REBCO texture and composition, RE 2 O 3 content, and the dimensions of BaMO 3 (BMO, M=Zr,Hf) nanorods that act as artificial pinning centers. Specifically, the streaking angle between REBCO (103) and BZO (101) has been found to correlate well with (Ba+M)/Cu of the film, lift factor in critical current over a range of temperatures and magnetic fields, and the size of the BMO nanorods. Furthermore, the in-line 2D-XRD is expected to serve as a valuable quality measuring tool supporting realtime feedback control for the process to yield uniform and consistent manufacturing of high performance REBCO tapes by Advanced MOCVD.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Carbon Management Projects (CONNECT) Database and Explorer

Overview The Carbon Management Projects (CONNECT) Toolkit is an online exploratory visualization tool developed by the U.S. Department of Energy's (DOE) Office of Fossil Energy and Carbon Management (FECM) with support from other federal agencies such as the U.S. Environmental Protection Agency (EPA) and the U.S. Department of Transportation (DOT). It provides a single point of access to authoritative information on federal agency investment in a portfolio of research, development, and demonstration (RD&D) projects that have been publicly announced to advance technologies for point source carbon capture, carbon dioxide removal, transport, storage, and conversion, collectively referred to as carbon management. The RD&D programs covered in this tool are authorized by annual congressional appropriations ("Base Program") and the 2021 Infrastructure Investment and Jobs Act (IIJA). The tool also incorporates public information on other federal initiatives, such as the Regional Clean Hydrogen Hubs, and public information released by other government agencies, such as the Environmental Protection Agency's (EPA) and Primacy States’ Underground Injection Control Class VI permits and EPA’s facility level greenhouse gas (GHG) emissions. Developed in a geographic information system, the tool organizes carbon management projects into five groups based on the primary technology that a project aims to advance, each visually represented as a digital layer ("carbon management project layer"). Only federally funded projects are included, which can be awarded projects that are completed or ongoing, or projects that have been selected but are currently under negotiation. Project information can be viewed in the map or in the attribute table below it when turned on. In the map view, each project is displayed at either its host site (for field work), where available, or its performer site (project lead's location, further explained in the table below). Host sites and performer sites are represented in distinct icons. Several reference layers offer additional public information on infrastructural and natural resource environment for carbon management. These reference layers, combined with multiple geographical basemaps, enable users to visualize the carbon management project layers in context. Carbon management project information will be updated monthly based on feedback and information availability. Carbon management project layers Point Source Carbon Capture (PSC) This layer contains DOE-funded projects focused on capturing carbon dioxide (CO2) from power plants or industrial facilities. Carbon Dioxide Removal (CDR) This layer contains DOE-funded projects focused on capturing CO2 from the atmosphere, including direct air capture (DAC) and DAC hubs, direct ocean capture, enhanced mineralization, and biomass carbon removal and storage. For projects with multiple host sites, each of the sites are displayed individually with the project cost and cost sharing information representing the total for the entire project. Carbon Transport This layer contains DOE- and DOT-funded projects focused on CO2 transport. The Transport Research and Development sublayer contains projects that do not involve physical infrastructure; the Proposed Transport Corridor sublayer contains projects for which either a route for the transport infrastructure has been proposed or a general area for the transport infrastructure has been identified. Carbon Storage This layer contains DOE-funded key projects focused on CO2 storage. For projects with multiple field-work sites, each of the sites are displayed individually on the map with the project cost and cost sharing information representing the overall total for the entire project. Carbon Conversion This layer contains DOE-funded projects focused on converting CO2 into economically valuable products. Reference layers The following layers provide additional information in the geographic proximity of carbon management projects. Users should reference the original sources for more details (weblinks provided below and in pop-up windows on the map). Regional Clean Hydrogen Hub and Facility These layers illustrate the approximate areas of the Regional Clean Hydrogen Hubs announced by DOE's Office of Clean Energy Demonstrations (OCED) and the approximate locations of individual facilities that constitute the hubs (see "Where are the H2Hubs located?" on the webpage linked above). EPA Facility Level GHG Emissions (direct emitter) This layer shows direct CO2 emissions from stationary sources in 2022, using data extracted from EPA's Facility Level Information on GreenHouse gases Tool (FLIGHT). Captured and injected CO2 are not deducted from direct emitters’ total emissions. Contact EPA for additional details. Underground Injection Control Class VI permit/permit application This layer shows the locations of CO2 injection wells that are granted or in the process of applying for an Underground Injection Control Class VI permit by EPA or a Primacy State (currently Louisiana, North Dakota, and Wyoming). The URLs for the permits or permit applications are provided in the pop-up windows associated with the well locations. Contact EPA for additional details. Carbon Storage Resource This layer contains information on prospective CO2 storage resources in saline formations and oil and gas reservoirs provided by the National Carbon Sequestration Database and Geographic Information System (NATCARB) spatial database. Contact NETL for additional details. Existing CO2 pipeline This layer shows active CO2 pipelines based on information digitized from the map issued by the Pipeline and Hazardous Materials Safety Administration (PHMSA). Contact PHMSA for additional details.

Carbon Conversion↗

A dimensionality reduction algorithm for mapping tokamak operational regimes using a variational autoencoder (VAE) neural network

Abstract A variational autoencoder (VAE) is a type of unsupervised neural network which is able to learn meaningful data representations in a reduced dimensional space. We present an application of VAE in identifying the operational stability boundary of tokamak plasma discharges. This model was implemented using a dataset of over 3000 discharges from the high beta tokamak-extended pulse (HBT-EP) device. We found the VAE model to be capable of forming a continuous low-dimensional operational space map and identifying the operational boundaries using a specified warning time window. By projecting the operational parameters onto the same reduced space, this provides an intuitive way for the machine operator or an automated control system to perform disruption avoidance using a relevant control actuator as a discharge approaches a boundary. Pre-programmed GPU control experiments were conducted to demonstrate this control technique using HBT-EP’s saddle control coils as a horizontal position actuator, showing the ability to avoid the oncoming disruptive event and extend the duration of the discharge.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Introducing the DREAMS Project: DaRk mattEr and Astrophysics with Machine Learning and Simulations

We introduce the DaRk mattEr and Astrophysics with Machine learning and Simulations (DREAMS) project, an innovative approach to understanding the astrophysical implications of alternative dark matter (DM) models and their effects on galaxy formation and evolution. The DREAMS project will ultimately comprise thousands of cosmological hydrodynamic simulations that simultaneously vary over DM physics, astrophysics, and cosmology in modeling a range of systems—from galaxy clusters to ultra-faint satellites. Such extensive simulation suites can provide adequate training sets for machine-learning-based analyses. This paper introduces two new cosmological hydrodynamical suites of warm dark matter (WDM), each comprising 1024 simulations generated using the arepo code. One suite consists of uniform-box simulations covering a ${(25\,{h}^{-1}\,{\rm{Mpc}})}^{3}$ volume, while the other consists of Milky Way zoom-ins with sufficient resolution to capture the properties of classical satellites. For each simulation, the WDM particle mass is varied along with the initial density field and several parameters controlling the strength of baryonic feedback within the IllustrisTNG model. We provide two examples, separately utilizing emulators and convolutional neural networks, to demonstrate how such simulation suites can be used to disentangle the effects of DM and baryonic physics on galactic properties. The DREAMS project can be extended further to include different DM models, galaxy formation physics, and astrophysical targets. In this way, it will provide an unparalleled opportunity to characterize uncertainties on predictions for small-scale observables, leading to robust predictions for testing the particle physics nature of DM on these scales.

cosmological parameters↗

Towards constrained grid-forming control

Grid-forming converters are commonly envisioned to replace conventional synchronous generators as the cornerstone of future power systems. However, compared to synchronous generators, power converters and their power sources (e.g., renewable generation, energy storage) are subject to significant physical constraints (e.g., current limits, modulation limits). Grid-forming controls are commonly designed neglecting these constraints and subsequently augmented with limiters for a subset of constraints. In this work, we propose a systematic approach to constrained grid-forming control of two-level voltage source converters interfacing photovoltaics. We first formulate grid-forming control objectives and constraints of voltage source converters and photovoltaics in a one-step optimal grid-forming control problem. Next, we leverage primal-dual dynamics to obtain a dynamic feedback controller that approximates the solution of the one-step optimal grid-forming control problem. Finally, electromagnetic transient simulations are used to illustrate the results.

Gross, Dominic↗

Matrix converter operating in current control mode using feed forward signals

A matrix converter system having a current control mode operation is provided. The system includes a matrix converter having a switching matrix. The matrix converter is coupled at its low-voltage side to a generator and at its output load side to a load. A controller having a pulse width modulation (PWM) control circuit is configured to control the matrix converter via its switching matrix to increase energy within the internal inductances of the generator when the switching matrix causes a short circuit. A feed forward calculator is configured to calculate a feed forward output phase angle. The feed forward output phase angle is an estimation of an angle between an output current vector and an output voltage vector that represent feedback signals of current and voltage output by the matrix converter. The angular position of the voltage output vector is adjusted as a function of the feed forward output phase angle to align angular position or phase angle of the voltage output vector that represents the voltage output with a selected angular position or phase angle.

42 ENGINEERING↗

ChargeX OCPI Recommendations

The Open Charge Point Interface (OCPI) is an open protocol that enables electric vehicle (EV) charging systems to work together across networks. It supports communication and data sharing between Charge Point Operators (CPOs), who manage charging stations, and e-Mobility Service Providers (eMSPs), who provide charging services to EV drivers. OCPI facilitates functions like user authorization, remote charge point control, charging session data exchange, and billing through Charge Detail Records (CDRs). This allows EV roaming, so drivers can charge at different networks without multiple accounts. As the EV market grows due to increased adoption and technological advancements, OCPI faces higher demands. This has revealed issues with CDR format consistency, timestamp standardization across regions, transmission of EV-side error codes for troubleshooting, and support for new use cases. These challenges can affect operations and user experience, particularly as the industry starts considering Vehicle-to-Grid (V2G) systems, where EVs supply energy to the grid, and Vehicle-to-Everything (V2X) technologies for broader energy interactions. Using feedback from the ChargeX Diagnostics taskforce discussions, industry 1-on-1 meetings, technical standards, and OCPI’s evolution through versions (e.g., OCPI 2.1.1, 2.2, and 2.2.1), this report identifies these issues and suggests practical recommendations. These aim to improve interoperability, streamline operations, and prepare OCPI for future trends in the EV charging ecosystem.

32 - ENERGY CONSERVATION, CONSUMPTION, AND UTILIZA↗

Vegetation Warming Experiment: Chamber and ambient plot digital camera imagery for vegetation phenology, Utqiagvik (Barrow), Alaska, 2018

Time lapse photography of experimental plots within five warming chambers (ZPWs) and paired control plots located on the Barrow Environmental Observatory (BEO), Utqiagvik, Alaska. Images were recorded from 17 June to 24 September, 2018 to capture vegetation dynamics during the growing season. Vegetation phenology, including green up and senescence were captured. Images are *.jpg files recorded daily at 30 minute intervals, from 11:00 - 14:30 Alaska daylight time (AKDT, UTC-8), using Wingscapes TimelapseCam cameras. The target species was Arctagrostis latifolia. Additional information in *.pdf and *.csv files. The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research. The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska. Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗

Load Mitigating Feedback Control of WECs

This report outlines the development of load-mitigating feedback control for wave energy converters. A simple, self-tuning multi-objective controller is demonstrated in simulation for a 3-DOF (surge, heave, pitch) point absorber. In previous work, the proposed control architecture has been shown to be effective in experiment for a variety of device archetypes for the single objective of the maximization of electrical power capture: here this architecture is extended to reduce device loading as well. In particular, PTO actuation forces and the minimization of fatigue damage (determined from the sum of wave-exerted and PTO forces) are considered as additional objectives for the self-tuning controller. This controller is demonstrated for two similar, but distinct systems: one described by the identified linear models from physical testing of the WaveBot device, and another based upon a WEC-Sim simulation that expands upon boundary element method data from the WaveBot device. In both cases, because the power surface is consistently fairly flat in the vicinity of control parameters that maximize power capture in contrasting sea-states, it is found to be generally possible to mitigate either fatigue damage or PTO load. However, PTO load is found to conflict with fatigue damage in some sea-states, limiting the efficacy of control objectives that attempt to mitigate both simultaneously. Additionally, coupling between the surge and pitch DOFs also limits the extent to which fatigue damage can be mitigated for both DOFs in some sea-states. Because control objectives can be considered a function of the sea-state (e.g., load mitigation may not be a concern until the sea is sufficiently large) a simple transition strategy is proposed and demonstrated. This transition strategy is found to be effective with some caveats: firstly, it cannot circumvent the aforementioned objective contradictions. Secondly, this objective transition is too slow to act as a system constraint, and objective thresholds must thus be considered quite conservatively. Improvement of the adjustment strategy is demonstrated through the addition of an integral term. Selection of well-performing transition parameters can be a function of sea-state. While a simple selection procedure is proposed, it is non-optimal, and a more robust selection procedure is suggested for future work.

16 TIDAL AND WAVE POWER↗

Organizational Principles of Hyporheic Exchange Flow and Biogeochemical Cycling in River Networks Across Scales

Hyporheic zones increase freshwater ecosystem resilience to hydrological extremes and global environmental change. However, current conceptualizations of hyporheic exchange, residence time distributions, and the associated biogeochemical cycling in streambed sediments do not always accurately explain the hydrological and biogeochemical complexity observed in streams and rivers. Specifically, existing conceptual models insufficiently represent the coupled transport and reactivity along groundwater and surface water flow paths, the role of autochthonous organic matter in streambed biogeochemical functioning, and the feedbacks between surface-subsurface ecological processes, both within and across spatial and temporal scales. While simplified approaches to these issues are justifiable and necessary for transferability, the exclusion of important hyporheic processes from our conceptualizations can lead to erroneous conclusions and inadequate understanding and management of interconnected surface water and groundwater environments. This is particularly true at the landscape scale, where the organizational principles of spatio-temporal dynamics of hyporheic exchange flow (HEF) and biogeochemical processes remain largely uncharacterized. This article seeks to identify the most important drivers and controls of HEF and biogeochemical cycling based on a comprehensive synthesis of findings from a wide range of river systems. We use these observations to test current paradigms and conceptual models, discussing the interactions of local-to-regional hydrological, geomorphological, and ecological controls of hyporheic zone functioning. This improved conceptualization of the landscape organizational principles of drivers of HEF and biogeochemical processes from reach to catchment scales will inform future river research directions and watershed management strategies.

54 ENVIRONMENTAL SCIENCES↗

Methods and devices configured to operated scanning tunneling microscopes using out-of-bandwidth frequency components added to bias voltage and related software

In the system and method disclosed, an ultrahigh vacuum (UHV) scanning tunneling microscope (STM) tip is used to selectively desorb hydrogen atoms from the Si(100)-2X1:H surface by injecting electrons at a negative sample bias voltage. A new lithography method is disclosed that allows the STM to operate under imaging conditions and simultaneously desorb H atoms as required. A high frequency signal is added to the negative sample bias voltage to deliver the required energy for hydrogen removal. The resulted current at this frequency and its harmonics are filtered to minimize their effect on the operation of the STM's feedback loop. This approach offers a significant potential for controlled and precise removal of hydrogen atoms from a hydrogen-terminated silicon surface and thus may be used for the fabrication of practical silicon-based atomic-scale devices.

Moheimani, Seyed Omid Reza↗

Methods and devices configured to operated scanning tunneling microscopes using out-of-bandwidth frequency components added to bias voltage and related software

In the system and method disclosed, an ultrahigh vacuum (UHV) scanning tunneling microscope (STM) tip is used to selectively desorb hydrogen atoms from the Si(100)-2X1:H surface by injecting electrons at a negative sample bias voltage. A new lithography method is disclosed that allows the STM to operate under imaging conditions and simultaneously desorb H atoms as required. A high frequency signal is added to the negative sample bias voltage to deliver the required energy for hydrogen removal. The resulted current at this frequency and its harmonics are filtered to minimize their effect on the operation of the STM's feedback loop. This approach offers a significant potential for controlled and precise removal of hydrogen atoms from a hydrogen-terminated silicon surface and thus may be used for the fabrication of practical silicon-based atomic-scale devices.

Moheimani, Seyed Omid Reza↗

Voltage regulation in distribution grids: A survey

Environmental and sustainability concerns have caused a recent surge in the penetration of distributed energy resources into the power grid. This may lead to voltage violations in the distribution systems making voltage regulation more relevant than ever. Owing to this and rapid advancements in sensing, communication, and computation technologies, the literature on voltage control techniques is growing at a rapid pace in distribution networks. In particular, there is a paradigm shift from traditional offline centralized approaches to distributed ones leveraging increased and varied types of actuators, real-time sensing, fast and efficient computations, and an overall distributed situational awareness. This paper reviews state-of-the-art voltage control algorithms, summarizes the underlying methods, and classifies their coordination mechanisms into local, centralized, distributed, and decentralized. The underlying solution methodologies are further classified into two categories, open-loop and feedback-based. Two specific example workflows are provided to illustrate these solutions for voltage regulation.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DGPS measurements of solifluction and hillslopes creep at the Teller 47 field site from 2017-2022, Seward Peninsula, AK

DGPS measurements of benchmarks locations were collected during the 2017, 2018, 2019, 2021 and 2022 summers at the NGEE Arctic Teller-47 solifluction site on the Seward Peninsula, Alaska. Benchmarks were installed in 2017 on several solifluction lobes and hillslope locations and re surveyed in 2018 and 2019 with a Trimble R10 DGPS instrument. In 2018, coincident with a UAS-based laser altimetry collection campaign, more ground control targets were installed and subsequently remeasured in 2019. Additional ground control targets were installed in 2021. Points were corrected using NOAA’s Online Positioning User Software (OPUS) and Trimble Business Center (TBC) software. An update to this dataset was made in July 2024, adding new data from 2021 and 2022. The dataset now contains ten total *.csv files: five are data files plus one file-level metadata and five data dictionaries, two *.jpg, four shape file folders, two *.kml, one archive folder of raw data, and one *.pdf. The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research. The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska. Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗

Integrated parameter and process learning for hydrologic and biogeochemical modules in Earth System Models

Focus area: Primary focal area #2; secondary focal area #3: Learning about parameters and processes of land surface hydrologic and biogeochemical models in Earth System models by integrating machine learning, physics, and big data. Science challenges: How do we maximally leverage big-data observations to improve hydrobiogeochemical process description and parameterization so that such modules more realistically capture hydrologic and vegetation responses and feedbacks under the future climate? For example, how can we leverage physics, limited observations of vegetation and streamflow to better estimate evapotranspiration, and, relatedly, net primary productivity, especially for drought areas? Vegetation plays a critical role in regional and global water cycles; however, existing vegetation models have failed to predict vegetation response to droughts (McDowell & Xu, 2017) , arctic greening (Keenan & Riley, 2018) , and critical transitions between forest and savanna (Hirota et al., 2011) . These studies suggest that when we build process-based models (PBM) parameterized from regional and global plant traits, we tend to poorly describe plant adaptation and local-scale competition processes. The models and their associated parameters assigned for different regions in the world are not capturing essential heterogeneity in vegetation responses at finer spatial scales. Many parameters of the land surface models control hydrology and vegetation dynamics at the same time. The heterogeneity in vegetation response is a function of (i) plant type, (ii) plant size, (iii) competition and succession, (iv) environmental controls, and (v) local variations due to the unique ecological community that are very difficult to describe (e.g., the size of gaps resulting from fire that facilitated the coexistence of pioneering species). In the demographic models, only factors (i) and (iv) were captured, and plant types were generally described only by leaf phenology and climate zones. With current demographic models, we generally consider more traits to define plant types (i) and calibrate these traits to consider factors (ii), (iii) and (iv); however, it is substantially challenging to scale to regional and global simulations due to trait variations across space (Ali et al., 2016). Moreover, it has been noted that hillslope processes, including ridge-to-valley flow and sunny vs. shady slopes are primary organizers of water, energy, and vegetation (Clark et al., 2015; Fan et al., 2019) . Although gradual improvements in the hydrologic model component in earth system models may reduce this error (at a remarkably slow pace), the long-term, gradual impact of hydrology on plant traits are not well captured. Recent work showed that the hydrologic controls exerted by groundwater and lateral flow are primary regulators of rooting depth (Fan et al., 2017) . Such hydrologic controls have seldom been reflected in vegetation model parameterizations.

54 ENVIRONMENTAL SCIENCES↗

Reinforcement learning for real-time process control in high-temperature superconductor manufacturing

With high efficiency and low energy loss, high-temperature superconductors (HTS) have demonstrated their profound applications in various fields, such as medical imaging, transportation, accelerators, microwave devices, and power systems. The high-field applications of HTS tapes have raised the demand for producing cost-effective tapes with long lengths in superconductor manufacturing. However, achieving the uniform and enhanced performance of a long HTS tape is challenging due to the unstable growth conditions in the manufacturing process. Although it is confirmed that the process parameters during the advanced metal organic chemical vapor deposition (A-MOCVD) process influence the uniformity of the produced HTS tapes, the high-dimensional process parameter signals and their complicated interactions make it difficult to develop an effective control policy. In this paper, we propose a local measure for the uniformity of HTS tapes to provide instant feedback for our control policy. Then, we model the manufacturing of HTS tapes as a Markov decision process (MDP) with continuous state and action spaces to assess the instant reward in real time in our feedback control model. As our MDP involves continuous and high-dimensional state and action spaces, a neural fitted Q-iteration (NFQ) algorithm is adopted to solve the MDP with artificial neural network (ANN) function approximation. The collinearity of process parameters can restrict our capability of adjusting the process parameters, which is addressed by the principal component analysis (PCA) in our method. The control policy adjusts the PCA of process parameters using the NFQ algorithm. In conclusion, based on our case studies on real A-MOCVD dataset, the obtained control policy increases the average uniformity of tapes by 5.6% and performs especially well on sample HTS tapes with a low uniformity.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗