Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Autonomous Control Systems”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 325 records · Page 18
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

Signal Whisperers: Enhancing Wireless Reception Using DRL-Guided Reflector Arrays

This paper presents a multi-agent reinforcement learning (MARL) approach for controlling adjustable metallic reflector arrays to enhance wireless signal reception in non-line-of-sight (NLOS) scenarios. Unlike conventional reconfigurable intelligent surfaces (RIS) that require complex channel estimation, our system employs a centralized training with decentralized execution (CTDE) paradigm where individual agents corresponding to reflector segments autonomously optimize reflector element orientation in three-dimensional space using spatial intelligence based on user location information. Through extensive ray-tracing simulations with dynamic user mobility, the proposed multi-agent beam-focusing framework demonstrates substantial performance improvements over single-agent reinforcement learning baselines, while maintaining rapid adaptation to user movement within one simulation step. Comprehensive evaluation across varying user densities and reflector configurations validates system scalability and robustness. The results demonstrate the potential of learning-based approaches for adaptive wireless propagation control.

deep reinforcement learning↗
DOE OSTI2025

Autonomous Operations for Advanced Reactors Utilizing Supervisory Control

Automation is a critical tenet of reactor plant operations as reliance on nuclear energy increases. Nuclear power plants require a large workforce which does not scale with output; that is, the cost per megawatt increases as reactor output becomes smaller. The economic viability of advanced reactors, particularly small modular reactors (SMRs) and microreactors, requires a significantly reduced onsite workforce. The logical solution is establishing a systematic process of elimination of reliance on human operators, and to the extent possible, replacing these actions with automated functions. In this paper, we propose a method for such transformation to establish a robust technical basis to enable transition to autonomy. Our method is based on finite state automata (FSA)—also known as finite state machines (FSMs). Relying on this method allows us to exploit the rich set of mathematical proofs available in the field of regular languages. FSA are one of the mathematical tools to model discrete event systems (DES). These properties are applied to produce an automated startup controller for the Massachusetts Institute of Technology Research Reactor (MITR). The startup procedure is captured in terms of discrete changes from one state to another while an independent supervisory control system directs the sequence of states and alerts a human in the event of an abnormal operation. First, the design and behavior of the MITR rod control system were modeled in Simulink. Then, the startup procedure was applied to the rod control system and the DES performed a startup by procedurally withdrawing rods to the subcritical position. The simulation also stops rod motion in response to an uncontrollable event and restarts rod motion once the event has been cleared.

46 - INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AN↗
DOE OSTI2026

Functional Nano-to-Microstructures by Jet Printing and Direct Ink Writing

Jet-based printing techniques and direct ink writing have emerged as complementary, convergent technologies serving as key platforms in additive manufacturing for functional nano- to microscale architectures. This review highlights how these approaches enable fine feature resolution and three-dimensional structures in advanced electronics and biointerfacing applications. The interplay of fluid mechanics, viscoelastic ink rheology, droplet–substrate interactions, and drying dynamics is examined as a critical determinant of printing fidelity. Application-focused case studies, from flexible thin-film transistors to bioprinted artificial tissues, demonstrate how precise structural control via printing translates to enhanced device performance and new functionality in electronic and biological systems. Finally, we discuss the challenges and future opportunities driving the evolution of these printing platforms toward autonomous, adaptive, and intelligent manufacturing systems.

Luo, Junchen [Sichuan Univ. of Arts and Science (C↗
DOE OSTI2018

Modular DNA strand-displacement controllers for directing material expansion

Abstract Soft materials that swell or change shape in response to external stimuli show extensive promise in regenerative medicine, targeted therapeutics, and soft robotics. Generally, a stimulus for shape change must interact directly with the material, limiting the types of stimuli that may be used and necessitating high stimulus concentrations. Here, we show how DNA strand-displacement controllers within hydrogels can mediate size change by interpreting, amplifying, and integrating stimuli and releasing signals that direct the response. These controllers tune the time scale and degree of DNA-crosslinked hydrogel swelling and can actuate dramatic material size change in response to <100 nM of a specific biomolecular input. Controllers can also direct swelling in response to small molecules or perform logic. The integration of these stimuli-responsive materials with biomolecular circuits is a major step towards autonomous soft robotic systems in which sensing and actuation are implemented by biomolecular reaction networks.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

Advancing Development of Emissions Detection (Final Report)

This document is the final report to the U.S. Department of Energy (DOE for contract DE-FE0031873) awarded to Colorado State University (CSU). CSU and partners at Harrisburg University of Science and Technology, University of Texas Arlington, and University of Texas at Austin organized several testing rounds to provide knowledge focused on advancing the detection capabilities of emissions monitoring devices. With this funding opportunity the research group began by establishing the Advancing the Development of Emission Detection (ADED) program, with the goal focused on enhancing the accuracy, reliability, and field applicability of methane detection technologies. This effort aimed to address the critical challenges of identifying and quantifying methane emissions while enabling industry stakeholders to meet regulatory compliance and environmental sustainability goals. The program engaged with industry, government, and technology stakeholders to promote adoption and consensus on testing techniques for methane detection solutions. Methane, a potent greenhouse gas, contributes significantly to global warming, and the oil and natural gas (O&G) sector is a primary source of methane emissions. Regulatory measures such as leak detection and repair (LDAR) programs have been implemented to address emissions. However, traditional LDAR approaches, reliant on handheld and component-level measurements, are resource-intensive. To address these limitations and move with evolving regulations, advanced methane technologies are emerging. These solutions include ground-based sensors, mobile systems (e.g., drones, vehicles, and aircraft), and satellite-based platforms. They offer innovative capabilities for autonomous monitoring, larger spatial coverage, and emission quantification using methods such as tracer gas techniques and inverse modeling with Gaussian plume analysis. The ADED program began with creating protocols for methane controlled release (CR) testing these continuous monitoring (CM) and survey technologies that detect and monitor methane emissions at O&G facilities. The protocols were then implemented throughout testing of CM and survey devices at CSU’s Methane Emissions Technology Evaluation Center (METEC) facility from 2021 through 2024. As apart of the protocol, solutions that tested under the ADED program installed their solutions at METEC, documented their system under test, and provided detection reports to the METEC team for analysis. The METEC team would provide the solutions with analyzed reports of their emissions and ground truth data of the releases conducted during their testing session. Under the ADED program, CMs were also tested at O&G facilities for a six week test run of challenge release (ChR) releases. The findings from the ADED program underscore the critical role of collaborative research and innovation in tackling methane emissions, offering a pathway for the oil and gas sector to achieve significant environmental and economic benefits. Results from METEC testing saw improvement of performance and accuracy across all solutions over the extent of the ADED experiments. The results also showed a variance in CM solution performance between CRs and ChRs. That variance pushed the team to further analyze the differences between CR testing environments and field conditions. With the drive from regulations and that variance in field conditions, the ADED team began designing a new CR testing protocol and additions to the METEC testing facility. The METEC team is furthering the progress made through the ADED program with awarded funding from DE-FE0032276. This funding pushes the development of METEC’s addition with new equipment, allowing for an updated facility layout. METEC still facilitates for traditional facilities, with a legacy pad, while expanding an new design based on how O&G infrastructure has Final Report - Contract Number: DE-FE0031873 been changed over the last decade. Throughout the ADED program the team has also been working with international partners to ensure staying in the trend globally. International partners have been essential in moving the new protocol forward to implement into CR testing at the METEC facility in Spring 2025.

42 ENGINEERING↗
DOE OSTI2015

Development of a First-of-a-Kind Deterministic Decision-Making Tool for Supervisory Control System

Decision-making is the process of identifying and choosing alternatives where each alternative offers a different approach or path to move from a given state or condition to a desired state or condition. The generation of consistent decisions requires that a structured, coherent process be defined, immediately leading to a decision-making framework. The overall objective of the generalized framework is for it to be adopted into an autonomous decision-making framework and tailored to specific requirements for various applications. In this context, automation is the use of computing resources to make decisions and implement a structured decision-making process with limited or no human intervention. The overriding goal of automation is to replace or supplement human decision makers with reconfigurable decision- making modules that can perform a given set of tasks reliably. Risk-informed decision making requires a probabilistic assessment of the likelihood of success given the status of the plant/systems and component health, and a deterministic assessment between plant operating parameters and reactor protection parameters to prevent unnecessary trips and challenges to plant safety systems. The implementation of the probabilistic portion of the decision-making engine of the proposed supervisory control system was detailed in previous milestone reports. Once the control options are identified and ranked based on the likelihood of success, the supervisory control system transmits the options to the deterministic portion of the platform. The deterministic multi-attribute decision-making framework uses variable sensor data (e.g., outlet temperature) and calculates where it is within the challenge state, its trajectory, and margin within the controllable domain using utility functions to evaluate current and projected plant state space for different control decisions. Metrics to be evaluated include stability, cost, time to complete (action), power level, etc. The integration of deterministic calculations using multi-physics analyses (i.e., neutronics, thermal, and thermal-hydraulics) and probabilistic safety calculations allows for the examination and quantification of margin recovery strategies. This also provides validation of the control options identified from the probabilistic assessment. Thus, the thermal-hydraulics analyses are used to validate the control options identified from the probabilistic assessment. Future work includes evaluating other possible metrics and computational efficiencies.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2018

On Periodic Solutions of Autonomous Systems

We propose a method for the investigation of periodic solutions of autonomous dynamical systems described by ordinary differential equations with phase and integral restrictions. We formulate the general problem of periodic solutions as a boundary-value problem with restrictions. By introducing a fictitious control, we transform the boundary-value problem into a control problem for dynamical systems with phase and integral restrictions. The control problem is solved by reducing it to an integral Fredholm equation of the first kind. We establish necessary and sufficient conditions for the existence of periodic solutions and propose an algorithm for finding periodic solution according to the limit points of the minimizing sequences.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Seasonal Cost-Benefit Analysis of Automated Distribution Feeder Upgrades with Advanced Mitigation Technologies

The increasing deployment of distributed solar photovoltaics (DPV) to meet clean energy goals can trigger adverse grid operation issues, such as voltage excursions and the violation of thermal loading constraints of the power delivery elements (e.g., lines and transformers) on the evolving electricity infrastructure. Such integration issues would require distribution upgrades with associated costs to mitigate them and to maintain reliable and resilient grid operating conditions. Traditional distribution network upgrade approaches use a specific single snapshot analysis that is overly conservative. This study considers a multi-time point analysis to capture both moderate (probable bounds) and extreme grid operating conditions using time points such as minimum load with minimum photovoltaics (PV), maximum load with maximum PV, maximum load with minimum PV, and minimum load with maximum PV. Further, this study investigates seasonal variation impacts and associated distribution upgrade costs for a spring season case (March, representing a low load and high PV scenario) and a summer case (July, representing a high load and high PV scenario). Such seasonal analysis will allow system operators to characterize upgrade requirements and associated costs across various periods. Because the spatial distribution of DPV can impact upgrade and associated costs, this study investigates three common DPV deployment scenarios - randomly deployed, close to the substation, and far from the substation - at different penetration levels. Apart from spatial distribution impacts, this project evaluates the techno-economic impacts of the nodal photovoltaic penetration factor (NPPF) for generating the various DPV deployment scenarios at increasing penetration levels. This project investigates the impact of varying nodal PV-to-load ratios using conservative and extreme NPPF values of 3 and 10, respectively. This study investigates the deployment of traditional infrastructure upgrade strategies, such as installing new voltage regulating equipment, transformers and lines replacements, and the activation of advanced inverter functionality (e.g., autonomous volt/VAR) in expanding PV hosting capacity. Existing DPV systems are assumed to operate with the legacy unity power factor, and we considered the possibility of retrofitting such systems with the activation of volt/VAR control as integration standards and regulations continue to evolve to allow such functions. The cost-benefit analysis metrics used in study include distribution upgrade costs, average cost per watt of the upgrade cost, average marginal cost per watt of the upgrade cost, and power losses.

14 SOLAR ENERGY↗
DOE OSTI2019

Analysis of the Impact of Radiation on Cameras and Robotic Perception - 19242

Robotic systems are increasingly used for inspection, maintenance, and disaster assistance for nuclear power plants. These robots utilize increasingly high levels of autonomy to operate in environments that are unsafe for humans to operate the robot in or require more precise control over the robot than a human can offer. In these cases, the robot must include perception and computation components to autonomously sense and navigate through the environment to fulfill its mission. This difficult task is complicated by radiation interfering with sensors' operation. The impact of this interference is largely unexplored, as existing works on radiation interference on sensors focus on estimating the incident radiation, rather than how it impacts a robotic system using the sensor. In this work, we seek to quantify and describe the impact of radiation on cameras, and how the radiation affects robotic performance. In this paper we study cameras that are suitable for small, lightweight unmanned aerial vehicles (UAVs) that are increasingly deployed to fly in confined areas in emergencies, where the surrounding environment is unsafe for workers to operate. These small UAVs lack the payload capacity to carry significant radiation shielding, so any onboard sensors will be affected by radiation. In the case of cameras, this radiation appears as noise in the camera imagery. This noise will interfere with the UAV's operation, by obscuring obstacles and interfering with localization and optical flow algorithms that detect detailed features in the environment. To date, there is a lack of information on how the radiation noise in the camera image impacts the overall robot system performance Existing work focuses on estimating the amount of incident radiation by measuring the corruption in the images. However, these works suffer several shortcomings for robotic systems. First, a robot must be able to successfully navigate its environment during a successful mission, and merely quantifying the amount of radiation noise in an image does not adequately explain how it may interfere with higher level navigation and perception tasks. Second, radiation estimation procedures rely on focusing the camera on a known and static background. This is unsuitable for robotic exploration tasks, where the robot frequently moves around an unknown environment that may be dynamically changing. Our work contains two contributions that address these shortcomings. First, we conduct a detailed analysis of the noise radiation causes in cameras by exposing cameras that are commonly used on UAVs [e.g., small form factor complementary metal-oxide-semiconductor (CMOS) cameras] to varying levels of radiation that may be present in emergency scenarios. From this exposure, we quantify not only how much noise is present, but quantify its appearance. By quantifying the appearance and amount of noise in a camera image, researchers can design mitigation strategies for the corruption, so that their robotic systems can operate in these challenging environments. Second, we demonstrate how to leverage this experimental data in robotic simulations. Using data from the first set of experiments allows us to test and verify the robots in simulation. Using simulators allows us to verify the robots will perform as expected during critical times without needing expensive test equipment or damaging valuable robot prototypes. Other researchers using robots for exploration of irradiated environments will benefit from our research by incorporating similar noise models in their research. 1 Southwest Research Institute{sup R} is a registered trademark of Southwest Research Institute in the United States and/or other countries. This will increase the reliability of robotic systems prior to deployment in emergency situations, which will in turn increase their effectiveness and speed the development of robots that would otherwise need expensive and time-consuming test procedures to validate. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2024

Eco-driving Profile Optimization by Dynamic Programming for Battery Electric Vehicles

Although full automation has not yet been achieved, automated vehicles are a valid research area. Not only would automated vehicles provide ultimate driver convenience, but they would maximize energy efficiency by eliminating undesired human driving behaviors and optimally controlling the powertrain. From the perspective of control related to energy saving, speed profile optimization is important for improving system efficiency and satisfying passenger demands. This study employs Dynamic Programming (DP) to solve the constrained optimal problem for travel time, distance, and speed limit by exploring all possible control options. The solutions obtained by DP demonstrate consistent control patterns combining four control modes-acceleration, cruising, coasting, and braking, with cruising or coasting being selective depending on the boundary conditions. Further, this study introduces DP-based simulation results and attempts to provide comprehensive interpretations of the optimal policy by analyzing the essential factors that affect the control problem, including boundary conditions, road load, and powertrain characteristics. Based on these interpretations, the control concepts can be explained as the optimal policy selecting the best control option based on system efficiency and boundary conditions. The results of DP are compared with a human-like driver model to show that the optimal speed profiles can effectively reduce energy consumption.

Autonomous vehicles↗
DOE OSTI2021

4D Proxy Imaging of Fracture Dilation and Stress Shadowing Using Electrical Resistivity Tomography During High Pressure Injections into a Dense Rock Formation

Fluid flow through fractured rock systems is governed in large part by the distribution, interconnectivity, and size of fracture apertures. In-situ stress is one of the primary factors controlling fracture aperture, and one that is altered significantly during high-pressure fluid injections or extractions. Interactions between stress, pore pressure, aperture, and fluid flow can result in complex and evolving poroelastic behavior with significant implications regarding the predictability and risk of developing and managing deep subsurface reservoirs (geothermal, fossil energy, and geologic carbon sequestration). In saturated crystalline rocks, bulk electrical conductivity is highly sensitive to porosity, and therefore to fracture aperture size and distribution. We demonstrate the use of time-lapse 3D electrical resistivity tomography for remotely monitoring stress induced changes in aperture distribution during high pressure injections into a fractured rock system at a scale of tens of meters. Results reveal a complex and continuously evolving stress field involving aperture dilations in the natural fracture system and aperture contractions in adjacent zones of shadow stress. Results provide information about the spatiotemporal changes in the system behavior and point to the potential of electrical imaging for autonomously and remotely monitoring evolving stress conditions by proxy through changes in bulk electrical conductivity.

electrical resisitivity tomography, stress, 4D Tim↗
DOE OSTI2018

NREL Sustainable Mobility: The Transportation World Beyond Tomorrow – Is Here Today!

NREL’s sustainable mobility research is moving beyond vehicles and roads, investigating the best way to get people and goods where they need to go with maximum convenience, efficiency, and affordability while minimizing traffic congestion. Integrated research efforts span a variety of technologies—connected and autonomous vehicles and infrastructure; new materials and devices for top performance, efficiency, reliability, and durability; high-performance computing and machine learning; controls that integrate vehicles with energy, road, communication, building, and mass-transit systems; communities of the future, from rural to megacities; and consumer behavior and new models of car ownership.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2021

Deep Reinforcement Learning for Autonomous Water Heater Control

Electric water heaters represent 14% of the electricity consumption in residential buildings. An average household in the United States (U.S.) spends about USD 400–600 (0.45 ¢/L–0.68 ¢/L) on water heating every year. In this context, water heaters are often considered as a valuable asset for Demand Response (DR) and building energy management system (BEMS) applications. To this end, this study proposes a model-free deep reinforcement learning (RL) approach that aims to minimize the electricity cost of a water heater under a time-of-use (TOU) electricity pricing policy by only using standard DR commands. In this approach, a set of RL agents, with different look ahead periods, were trained using the deep Q-networks (DQN) algorithm and their performance was tested on an unseen pair of price and hot water usage profiles. The testing results showed that the RL agents can help save electricity cost in the range of 19% to 35% compared to the baseline operation without causing any discomfort to end users. Additionally, the RL agents outperformed rule-based and model predictive control (MPC)-based controllers and achieved comparable performance to optimization-based control.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2019

Evaluating Time Varying Connectivities and System Throughput in Opportunistic Networks for Smart Grid Applications

With increasing proliferation of smart phones, there is an opportunity to employ mobile ad hoc networks to connect to distributed energy assets located in remote areas. With embedded intelligence and edge computing capabilities, autonomous ‘edge control nodes’ can enable a decentralized energy nexus, without the need for on-demand communications. Authors have developed an opportunistic networking framework using Bluetooth Low Energy and a specialized mobile phone application that enables delay tolerant networking for the above framework. Here, this paper presents the analysis of time varying graph connectivity for such an opportunistic mobile ad hoc network. Dependence of connectivity on different network parameters such as radio characteristics, the mobility of data mules and parameters governing how connections are established are explored. Simulation results showing the variation of above trends have been presented.

Bluetooth↗
DOE OSTI2026

WM26 Paper Multi-Robot Collaboration for Hazardous Environments

Hazardous nuclear and industrial facilities are rarely designed for robots. Work in these domains demand precise manipulation and robust mobility in cluttered, constrained spaces where off-the-shelf platforms struggle and “one-size-fits-all” machines become costly and complex. Idaho National Laboratory (INL) is developing an autonomous, multi-robot inspection system that coordinates task-specific platforms rather than relying on a single omni-tool robot. An electric truck serves as a power and compute hub for a custom manipulator co-developed with Florida International University (FIU), a commercial mini crawler, a pan–tilt–zoom camera, and a Nexxis Argus LiDAR mapping system. Working in concert, these robots generate spatial, radiation, and temperature maps of the pit environments at the Hanford Waste Tank Farms. These systems will capture visual records and environmental telemetry to allow for analysis post inspection. The system architecture uses Robot Operating System 2 (ROS 2) for publish/subscribe integration, NVIDIA Isaac Sim and Unity for simulation and visualization, and algorithms such as NVBlox to fuse data into unified 3D overlays. This robot-agnostic approach reduces operator burden by enabling autonomy across heterogeneous platforms and lets each robot be used where it is strongest. Having autonomous functions means operators don’t have to fully control multiple different components. The ease of use could allow for more widespread adoption of advanced robotics at waste management sites that see continued use. By coordinating simpler, purpose-built mechanisms, the approach lowers design and manufacturing complexity, reduces capital risk in contaminated settings, and improves controllability for complex inspection and manipulation tasks. We present the architecture, early results, and lessons learned from building and deploying this coordinated multi-robot system, with the goal of accelerating safe, cost-effective adoption of advanced robotics at waste-management sites.

42 - ENGINEERING↗
DOE OSTI2018

Suppression of Weakly-Damped Torsional Oscillations in Autonomous Power Systems

Variants are considered for suppression of weakly-damped vibration effects caused by the first critical frequency of torsional oscillations of a gas-turbine unit in the autonomous electric power system of an oil and gas field. It is shown that torsional oscillations can be suppressed with the aid both of a reactive power source installed at the field power system, consisting of a controlled shunt reactor (CSR) and a static capacitor battery, and of an auxiliary active RLC filter, when using in both cases auxiliary control loops of torsional deviation as well as its first and second derivatives. A methodology has been developed for simultaneous coordination of the settings of any regulation system based on a numerical optimization, which permits selecting the characteristics of control loops of the source of reactive power and active RLC filter that are optimal from the point of view of suppressing torsional oscillations.

24 POWER TRANSMISSION AND DISTRIBUTION↗