Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “controller development”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Development of a Practical Secondary Control for Hardware Microgrids

Practical, vendor-agnostic interoperability guidelines for the secondary control architecture of microgrids (MGs) with multiple grid-forming (GFM) inverter-based resources (IBRs) have not yet been developed. Therefore, this paper proposes a generic and vendor-agnostic secondary control architecture that operates with all GFM IBRs and synchronous generators. This secondary control does not require the use of additional measurement devices in the MG and utilizes the inherent communication systems of the GFM units, such as Modbus TCP/IP. The practical challenges of Modbus registers, such as packet loss and quantization error, and their detrimental impacts on secondary control actions are investigated. The proposed three-stage modification for any secondary control architecture to mitigate these impacts includes: 1) averaging the data read, 2) situational event-triggering of the controller, and 3) finite iteration of the controlling action. The proposed method is validated using a three-phase electric power, 480 V, 60 Hz, 500 kVA laboratory hardware microgrid with commercial two GFM IBRs and one diesel generator. The experimental results corroborates the fact the proposed modification in the secondary control architecture is advantageous for practical usage under erroneous measurements.

grid-forming inverter↗
DOE OSTI2024

Development of a Practical Secondary Control for Hardware Microgrids: Preprint

Practical vendor-agnostic interoperability guidelines for the secondary control architecture of microgrids (MGs) with multiple grid-forming (GFM) inverter-based resources (IBRs) have not yet been developed. Therefore, this paper proposes a generic and vendor-agnostic secondary control architecture that works with all GFM IBRs and synchronous generators. This secondary control does not need to employ any additional measurement devices in the MG and uses the inherent communication systems of the GFM units, such as Modbus TCP/IP. The practical challenges of Modbus holding registers such as packet loss, quantization error, etc. and their deteriorating impacts on the secondary control action are investigated. The proposed three-stage modification of any secondary control architecture to eliminate these impacts includes 1) averaging the data read, 2) situational event-triggering of the controller, and 3) the finite iteration of the controlling action. The proposed method is validated using a laboratory hardware MG with commercial GFM units.

inverter based resources↗
DOE OSTI2020

Energy Impact of Connected and Automated Vehicle Technologies. Final report

The overarching goal of this project is to understand the potential impact of connected and automated vehicles. The goal was achieved through data collection, model development, algorithm designs, simulations, and limited field tests. The main outcomes from this project include: (1) we collected energy consumption and GPS data from 500 vehicles over one year, with a total mileage of 8 million miles; (2) Based on the collected data and other datasets collected at the University of Michigan, we developed a calibrated Ann Arbor model in Polaris (model developed by ANL), and the fuel economy accuracy was found to be around 3.9% by comparison with field collected data; (3) An open-source SUMO model of Ann Arbor was developed; (4) Eco-Routing algorithms in Ann Arbor using the SUMO model shows 6% fuel saving potential; (5) Experiments conducted at the Mcity test facility shows that human drivers roughly follow the Eco-driving suggestions roughly 70% of the time; (6) Based in the Ann Arbor travel patterns, we found that each shared automated vehicle can replace around 4 individually owned vehicles; and (7) Adaptive Traffic Signal Control Algorithm developed through this project has been validated both in simulations and preliminary test results. For connected and automated vehicles, on average the performance is 13% delay reduction, and 10% fuel reduction. While connected and automated vehicles are in their early stage of deployment, the results from this project confirm that there is significant potential for energy saving if the technologies are developed and used properly. The three main technologies studied in this project include eco-routing, shared autonomous rides, and adaptive traffic signal controls. The data collected and model developed through the project can be used to study many other connected and automated vehicle technologies.

02 PETROLEUM↗
DOE OSTI2024

Unsupervised Learning for Equitable DER Control: Preprint

In the context of managing distributed energy resources (DERs) within distribution networks (DNs), this work focuses on the task of developing local controllers. We propose an unsupervised learning framework to train functions that can closely approximate optimal power flow (OPF) solutions. The primary aim is to establish specific conditions under which these learned functions can collectively guide the network towards desired configurations asymptotically, leveraging an incremental control approach. The flexibility of the proposed methodology allows to integrate fairness-driven components into the cost function associated with the OPF problem. This addition seeks to mitigate power curtailment disparities among DERs, thereby promoting equitable power injections across the network. To demonstrate the effectiveness of the proposed approach, power flow simulations are conducted using the IEEE 37-bus feeder. The findings not only showcase the guaranteed system stability but also underscore its improved overall performance.

asymptotic stability↗
DOE OSTI2020

Development and Validation of a Simulation Testbed for the Intelligent Building Agents Laboratory (IBAL) Using TRNSYS

This paper documents the development and validation of a dynamic primary cooling and thermal storage system simulation testbed. The system simulation testbed, sIBAL, is based on the Intelligent Building Agents Laboratory (IBAL) at the National Institute of Standards and Technology (NIST), which is a research infrastructure and testbed for the development, evaluation, and demonstration of intelligent control algorithms. The sIBAL testbed developed in this project will serve as a virtual twin of the real facility for future control algorithm development. The details of the methodologies used to develop and validate the simulation testbed, which replicates the dynamic behaviors of the primary cooling and ice storage system in the IBAL facility, are presented. The simulation testbed was developed in TRNSYS using built-in component models and MATLAB functions to replicate the two water-cooled chillers, a thermal storage tank, pumps, valves and other components for four different operation modes. Experiments on IBAL components were designed and executed to generate experimental data for model development and verification of the simulation platform. The validation of the simulation results was carried out in two phases: 1) independent component simulations for the chillers and thermal storage tank, and 2) a combined testbed simulation of the entire hydronic system. Comparison of simulation results to the experimental data obtained from the IBAL facility showed errors within 1 °C for the temperatures outputs of both the chiller and the thermal storage model. The error is within an acceptable range for further intelligent control algorithms development. The findings from the study are summarized and presented along with areas where additional research is needed. In addition, data filtering procedures and model refinement measures utilized to improve the accuracy and accelerate the computation time of the simulation are presented.

cooling systems↗
DOE OSTI2023

Real-time machine-learning-driven control system of a deformable mirror for achieving aberration-free X-ray wavefronts

A neural-network machine learning model is developed to control a bimorph adaptive mirror to achieve and preserve aberration-free coherent X-ray wavefronts at synchrotron radiation and free electron laser beamlines. The controller is trained on a mirror actuator response directly measured at a beamline with a real-time single-shot wavefront sensor, which uses a coded mask and wavelet-transform analysis. The system has been successfully tested on a bimorph deformable mirror at the 28-ID IDEA beamline of the Advanced Photon Source at Argonne National Laboratory. It achieved a response time of a few seconds and maintained desired wavefront shapes (e.g., a spherical wavefront) with sub-wavelength accuracy at 20 keV of X-ray energy. This result is significantly better than what can be obtained using a linear model of the mirror’s response. The developed system has not been tailored to a specific mirror and can be applied, in principle, to different kinds of bending mechanisms and actuators.

47 OTHER INSTRUMENTATION↗
DOE OSTI2024

Developing an intrinsically secure information barrier for arms control verification through machine learning

Near-term solutions are needed to allow for flexible engagement in future nuclear arms control discussions. This project developed a method for implementing an information barrier (IB) on commercial systems, shortening the research and development lifecycle for warhead verification technologies while offering improved and inherently flexible capabilities. The crux of the verification challenge remains the difficulty in developing an authenticatable IB which prevents sensitive host country information from inadvertent transmission to an inspector. Many concepts for IB’s rely on dedicated “trusted” processor modules developed with dedicated custom radiation detection systems and associated algorithms. Without a priori knowledge of the treaty item, the parameter space for measurements can be nearly infinite and robustness against spoofing without the ability to view sensitive data is key. This project has produced an unclassified framework capable of ingesting data from common gamma detectors and identifying the presence of weapons grade nuclear material at over 90% accuracy.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗
DOE OSTI2026

Multibody for Everybody (M4E): A Symbolic Dynamics Modeling Tool with Applications in Simulation, Control, and Optimization

Developing the analytical model of a multibody system is often the initial step in control and optimization. The analytical model (equations of motion) describes a system’s time evolution under specified forcing conditions. Although developing these equations is easy for simple systems, this process becomes more complex for systems composed of multiple bodies. Deriving equations of motion for complex multibody systems requires specialized expertise in multibody dynamics, is time-consuming, and is susceptible to error. To address this issue, this paper presents an open-source, easy-to-use, systematic framework to derive symbolic equations of motion in both Python and MATLAB using the joint coordinate formulation. This formulation results in a set of ordinary differential equations that use the minimum set of coordinates needed to model a system. The symbolic representation provides better insight into the influence of design parameters on system performance, facilitates sensitivity analysis and parameter studies, and supports direct implementation of control and optimization routines. The tool enables numerical simulation for specified parameter sets, is modular for straightforward integration with other tools and libraries, and allows incorporation of hydrodynamics, mooring, and other external forces. The result is a reproducible, extensible pipeline for modeling, simulation, and design of complex multibody systems. The proposed tool is versatile and can be applied to domains such as robotics, control, and design. In addition, we integrated external libraries that provide capabilities for modeling offshore systems such as underwater robots and marine energy converters.

16 TIDAL AND WAVE POWER↗
DOE OSTI2023

Risk-Constrained Reinforcement Learning for Inverter-Dominated Power System Controls

Here, this paper develops a risk-aware controller for grid-forming inverters (GFMs) to minimize large frequency oscillations in GFM inverter-dominated power systems. To tackle the high variability from loads/renewables, we incorporate a mean-variance risk constraint into the classical linear quadratic regulator (LQR) formulation for this problem. The risk constraint aims to bound the time-averaged cost of state variability and thus can improve the worst-case performance for large disturbances. The resulting risk-constrained LQR problem is solved through the dual reformulation to a minimax problem, by using a reinforcement learning (RL) method termed as stochastic gradient-descent with max-oracle (SGDmax). In particular, the zero-order policy gradient (ZOPG) approach is used to simplify the gradient estimation using simulated system trajectories. Numerical tests conducted on the IEEE 68-bus system have validated the convergence of our proposed SGDmax for GFM model and corroborate the effectiveness of the risk constraint in improving the worst-case performance while reducing the variability of the overall control cost.

Frequency control↗
DOE OSTI2021

A Guide to Using GitHub for Developing and Versioning Data Standards and Reporting Formats

Abstract Data standardization combined with descriptive metadata facilitate data reuse, which is the ultimate goal of the Findable, Accessible, Interoperable, and Reusable (FAIR) principles. Community data or metadata standards are increasingly created through an approach that emphasizes collaboration between various stakeholders. Such an approach requires platforms for collaboration on the development process that centers on sharing information and receiving feedback. Our objective in this study was to conduct a systematic review to identify data standards and reporting formats that use version control for developing data standards and to summarize common practices, particularly in earth and environmental sciences. Out of 108 data standards and reporting formats identified in our review, 32 used GitHub as the version control platform, and no other platforms were used. We found no universally accepted methodology for developing and publishing data standards. Many GitHub repositories did not use key features that could help developers to gather user feedback, or to create and revise standards that build on previous work. We provide guidance for community‐driven standard development and associated documentation on GitHub based on a systematic review of existing practices.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Autonomous Inverter Controls for Resilient and Secure Grid Operation: Vector Control Design for Grid Forming

The project addresses both fundamental and practical challenges of GFM/GFL inverter control for the power grids with high inverter based resources (IBRs) penetration. A data- driven modeling technique is applied to accurately model dynamics of PWM inverters, including electromagnetic-transient (EMT). Systematic and integrative designs of grid- forming (GFM) and grid-following (GFL) primary controls are developed to guarantee system performance under either normal or abnormal operating conditions without violating constraints. This modeling and control framework provides black-start capability in case of an outage without relying on rotating generators, and its secondary control is also shown to enhance resilience against cyber-physical attacks.

14 SOLAR ENERGY↗
DOE OSTI2025

Counter-Current Flow Limitation Studies in Complex Geometries Utilizing Interface Capturing Simulations Coupled with PID Flow Rate Controller

In nuclear thermal-hydraulic studies, counter-current flow limitation (CCFL) typically refers to steam rising at a fast rate such that it prevents coolant from draining down within a confined channel. CCFL is a crucial issue in nuclear reactor safety analysis. This study investigates CCFL in debris bed channels using high-resolution interface-capturing simulations. A novel proportional-integral-derivative flow rate controller is developed to efficiently achieve the CCFL conditions. Verification studies confirm that CCFL occurs under the same conditions with or without the controller, demonstrating that PID control ensures accurate prediction. Three debris bed channel geometries were examined: a cylindrical channel, a channel with small obstacles, and a channel with large obstacles. Results show that obstacles significantly impact flow behavior, interfacial shear, wall shear, and pressure gradients required for CCFL. Furthermore, the comparison with experimental data confirmed that simulations incorporating geometric complexities align more closely with experimental CCFL conditions. A pressure gradient correlation was also developed for CCFL prediction.

Counter-current flow limitation↗
DOE OSTI2024

"Reinforcement Learning Based Oscillation Dampening: Scaling up Single-Agent RL algorithms to a 100 AV highway field operational test"

In this article, we explore the technical details of the reinforcement learning (RL) algorithms that were deployed in the largest field test of automated vehicles designed to smooth traffic flow in history as of 2023, uncovering the challenges and breakthroughs that come with developing RL controllers for automated vehicles. We delve into the fundamental concepts behind RL algorithms and their application in the context of self-driving cars, discussing the developmental process from simulation to deployment in detail, from designing simulators to reward function shaping. We present the results in both simulation and deployment, discussing the flow-smoothing benefits of the RL controller. From understanding the basics of Markov decision processes to exploring advanced techniques such as deep RL, our article offers a comprehensive overview and deep dive of the theoretical foundations and practical implementations driving this rapidly evolving field. We also showcase real-world case studies and alternative research projects that highlight the impact of RL controllers in revolutionizing autonomous driving. From tackling complex urban environments to dealing with unpredictable traffic scenarios, these intelligent controllers are pushing the boundaries of what automated vehicles can achieve. Furthermore, we examine the safety considerations and hardware-focused technical details surrounding deployment of RL controllers into automated vehicles. As these algorithms learn and evolve through interactions with the environment, ensuring their behavior aligns with safety standards becomes crucial. We explore the methodologies and frameworks being developed to address these challenges, emphasizing the importance of building reliable control systems for automated vehicles.

Jang, Kathy↗
DOE OSTI2020

Improved Performance of Cu(InGa)(SeS) 2 PV Modules Using the Reaction of Metal Precursors. Final Report

This project “Improved Performance of Cu(InGa)(SeS) 2 PV Modules using the Reaction of Metal Precursors” was a partnership led by the Institute of Energy Conversion (IEC) at the University of Delaware with Columbia University and the Molecular Foundry at the Lawrence Berkeley National Laboratory. The aim was to develop pathways to improve Cu(InGa)(SeS) 2 (CIGSS) thin film photovoltaic modules using processes compatible with low manufacturing cost. The CIGSS approach investigated was a two-step process including deposition of metal precursor films following by reaction in hydride gases utilizing IEC’s novel reactor. The process was similar to that under commercial development by the project’s industry partner Stion. When Stion went out of business mid-project the focus changed to a rapid thermal process considered more commercially viable. Approaches to improve the performance of solar cells using the reacted films focused on two material innovations. First, the overall Ga content was increased to increase the operating voltage, which is desirable for scale-up to commercial modules. Second, the processing and performance advantages arising from Ag alloying were investigated. Advanced characterization guided process and material development including control of relative composition gradients. Research on the formation of Cu-Ga-In metal precursors utilized sputtering deposition which is normally used in commercial applications. The work resulted in processes for deposition of precursor stacks with increased relative Ga content and effects of deposition parameters on morphology and phase composition were established. It was shown that the metal precursor films have comparable phase composition and morphology so subsequent reaction follows from the same starting point. The addition of Ag to the metal precursors gave more uniform morphology and improved adhesion of reacted films which enable higher reaction temperature for faster processing. A novel outcome was the discovery of a previously undocumented material phase in sputter-deposited and evaporated Ag-Cu-In-Ga thin films. Hydride gas reaction processes including time-temperature-concentration profiles were developed for different precursor compositions. This enables control of composition profiles to engineer through-film gradients for solar cell optimization with characterization and simulations used to correlate measured film composition profiles to measurements of devices. In particular, the gradient of sulfur at the front of the CIGSS film was found to be critical. The simulations guided process development leading to improved reproducibility of devices improved performance with higher Ga content and higher voltage. With Ag-alloyed precursors, the reaction pathways leading were determined. A significant finding was that Ag-alloying increases the reaction rate to completely convert precursor films to the final chalcopyrite which could enable reduced reaction time to benefit manufacturability. To maintain potential commercial viability, the process under investigation was refocused to a rapid thermal process that could potentially be incorporated into an in-line process for manufacturing. Precursors with different composition were capped with an extra selenium layer and reacted in hydrogen sulfide 5-15 minutes, compared to typically 2 hours in the previous multi-step batch process. Critical RTP parameters were identified to control the reaction. Further optimization would be needed for high efficiency solar cells but pathways to high quality devices with further optimization and improved heating uniformity were developed. The project also developed new optoelectronic characterization approaches with a focus on development and application of spatial- and time-resolved photoluminescence and a custom mapping photoluminescence microscope built. It was shown how critical electronic transport properties strongly depend on the chemical composition of the material and that a wide range of samples show inhomogeneity on a length scale larger than the grains in the films. Additionally, two-photon excitation capability was developed to distinguish bulk vs surface losses. The project advances the state-of-the -art for precursor reaction processes in several ways that could impact manufacturing. This includes validation of approaches to increase voltage and establishment of model-guided control to form optimal composition profiles. The application of process control approaches with knowledge of phase formation and reaction pathways can be critically valuable in designing a large-scale process.

14 SOLAR ENERGY↗
DOE OSTI2025

Reinforcement Learning-Based Oscillation Dampening: Scaling Up Single-Agent Reinforcement Learning Algorithms to a 100-Autonomous-Vehicle Highway Field Operational Test

In this article, we explore the technical details of the reinforcement learning (RL) algorithms that were deployed in the largest field test of automated vehicles designed to smooth traffic flow in history as of 2023, uncovering the challenges and breakthroughs that come with developing RL controllers for automated vehicles. We delve into the fundamental concepts behind RL algorithms and their application in the context of self-driving cars, discussing the developmental process from simulation to deployment in detail, from designing simulators to reward function shaping. We present the results in both simulation and deployment, discussing the flow-smoothing benefits of the RL controller. From understanding the basics of Markov decision processes to exploring advanced techniques such as deep RL, our article offers a comprehensive overview and deep dive of the theoretical foundations and practical implementations driving this rapidly evolving field. We also showcase real-world case studies and alternative research projects that highlight the impact of RL controllers in revolutionizing autonomous driving. From tackling complex urban environments to dealing with unpredictable traffic scenarios, these intelligent controllers are pushing the boundaries of what automated vehicles can achieve. Furthermore, we examine the safety considerations and hardware-focused technical details surrounding deployment of RL controllers into automated vehicles. As these algorithms learn and evolve through interactions with the environment, ensuring their behavior aligns with safety standards becomes crucial. Here, we explore the methodologies and frameworks being developed to address these challenges, emphasizing the importance of building reliable control systems for automated vehicles.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2023

DOE Bioenergy Technologies Office (BETO) 2023 Project Peer Review: WBS 2.4.1.100 Bench Scale Research & Development

Bench Scale Integration develops and optimizes fermentation processes to produce bio-based fuels and chemicals for commercial scale-up. The project uses fermentation science to achieve high titers and production rates by, for example, manipulating how the microorganisms are fed biomass sugars and nutrients, modifying fermentation conditions (pH, temperature, aeration) or developing online control strategies for better fermentation operations and high titer, rates, and yield (TRY). For this period of performance, we continued our development of a commercial-ready 2,3-butanediol (BDO) fermentation from biomass sugars utilizing NREL's proprietary Zymomonas mobilis microorganism. The engineered Z. mobilis can use all the main sugars in corn stover biomass, which are glucose, xylose, and arabinose. BDO is a versatile, low-carbon chemical which can be catalytically upgraded to a variety of hydrocarbon fuels and chemicals. The project had three goals during this review period; evaluate the technical feasibility of using whole slurry pretreated corn stover to achieve the techno-economic analysis (TEA) performance goals, continue optimizing a liquor-based fed-batch fermentation process for high titer, and develop strategies to enable scale-up. After evaluating different iterations of a whole slurry fermentation that did not meet the TEA goals, a Go/No-Go decision was made to pivot to liquor-only with new TEA performance targets, the main one being 140 g/L titer. We successfully met this goal, producing 141 g/L BDO at 1 g/L-hr productivity and 84% process yield. This titer and productivity attracted industrial interest to scale the fermentation resulting in a Technology Commercialization Fund project award in 2022. We used an NREL developed near-infra red (NIR) spectroscopy method for rapid analysis which allowed for changes to aeration levels and sugar feeding during the fermentation to maximize BDO production. The NIR analysis can be done using a hand-held spectrometer, essentially taking the analysis on to the plant floor during scale-up and preliminary work shows the feasibility of using an online probe for continuous monitoring and control. The other scale-up tool is mapping oxygen transfer coefficient (kLa) and oxygen transfer rate (OTR) in various vessels to find conditions that match the optimized 500 mL vessels. Showing a correlation to the mapping work, which is done with water and a dissolved oxygen probe, can reduce the risk of failed fermentations during scale-up. Our end-of-project goal is to meet the design target BDO titer (140-150 g/L) from DMR corn stover liquor at 1000L or larger scale to demonstrate BDO process design case and transfer the technology to industrial fermentation stakeholders for commercialization.

2 3-butanediol↗