SEARCH · Engineering Papers

Results for “vehicle controller”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9

All sources NASA NTRS DOE OSTI

DOE OSTI2025

Reinforcement Learning-Based Oscillation Dampening: Scaling Up Single-Agent Reinforcement Learning Algorithms to a 100-Autonomous-Vehicle Highway Field Operational Test

In this article, we explore the technical details of the reinforcement learning (RL) algorithms that were deployed in the largest field test of automated vehicles designed to smooth traffic flow in history as of 2023, uncovering the challenges and breakthroughs that come with developing RL controllers for automated vehicles. We delve into the fundamental concepts behind RL algorithms and their application in the context of self-driving cars, discussing the developmental process from simulation to deployment in detail, from designing simulators to reward function shaping. We present the results in both simulation and deployment, discussing the flow-smoothing benefits of the RL controller. From understanding the basics of Markov decision processes to exploring advanced techniques such as deep RL, our article offers a comprehensive overview and deep dive of the theoretical foundations and practical implementations driving this rapidly evolving field. We also showcase real-world case studies and alternative research projects that highlight the impact of RL controllers in revolutionizing autonomous driving. From tackling complex urban environments to dealing with unpredictable traffic scenarios, these intelligent controllers are pushing the boundaries of what automated vehicles can achieve. Furthermore, we examine the safety considerations and hardware-focused technical details surrounding deployment of RL controllers into automated vehicles. As these algorithms learn and evolve through interactions with the environment, ensuring their behavior aligns with safety standards becomes crucial. Here, we explore the methodologies and frameworks being developed to address these challenges, emphasizing the importance of building reliable control systems for automated vehicles.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2024

"Reinforcement Learning Based Oscillation Dampening: Scaling up Single-Agent RL algorithms to a 100 AV highway field operational test"

In this article, we explore the technical details of the reinforcement learning (RL) algorithms that were deployed in the largest field test of automated vehicles designed to smooth traffic flow in history as of 2023, uncovering the challenges and breakthroughs that come with developing RL controllers for automated vehicles. We delve into the fundamental concepts behind RL algorithms and their application in the context of self-driving cars, discussing the developmental process from simulation to deployment in detail, from designing simulators to reward function shaping. We present the results in both simulation and deployment, discussing the flow-smoothing benefits of the RL controller. From understanding the basics of Markov decision processes to exploring advanced techniques such as deep RL, our article offers a comprehensive overview and deep dive of the theoretical foundations and practical implementations driving this rapidly evolving field. We also showcase real-world case studies and alternative research projects that highlight the impact of RL controllers in revolutionizing autonomous driving. From tackling complex urban environments to dealing with unpredictable traffic scenarios, these intelligent controllers are pushing the boundaries of what automated vehicles can achieve. Furthermore, we examine the safety considerations and hardware-focused technical details surrounding deployment of RL controllers into automated vehicles. As these algorithms learn and evolve through interactions with the environment, ensuring their behavior aligns with safety standards becomes crucial. We explore the methodologies and frameworks being developed to address these challenges, emphasizing the importance of building reliable control systems for automated vehicles.

Jang, Kathy↗

DOE OSTI2022

System and method of performing a range estimation for hybrid and electric vehicles

A system is provided for performing an automated range estimation process for an electric vehicle using a processor. Included in the system is a range estimator configured to estimate an initial value of an energy required to travel a unit distance for the electric vehicle. The range estimator generates a first estimation model based on a correlation between a maximum all-electric-range and the energy required to travel a unit distance. Then, the first estimation model is adjusted based on one or more predetermined driving conditions. The maximum all-electric-range of the electric vehicle is updated based on the adjusted first estimation model. An estimated range of the electric vehicle is calculated based on the updated maximum all-electric-range of the electric vehicle and a fraction of total energy capability remaining in the electric vehicle. The estimated range of the electric vehicle is outputted and is used to control the electric vehicle.

33 ADVANCED PROPULSION SYSTEMS↗

DOE OSTI2020

Control of SiC Based Integrated DC-DC Powertrain Charger for Electric Vehicles

In this paper, an automated controller for an integrated, reconfigurable dc-dc converter for plugin electric vehicles (EVs) is presented. The integrated converter combines both an interleaved boost converter and dual active bridge (DAB) converter, sharing magnetics and switching devices. The converter switches between operating modes using the existing battery management system (BMS) contactors. The integrated converter operates in isolated DAB mode during battery charging operation. During traction operation, the integrated converter is operated in interleaved boost mode for heavy load and DAB mode during light load, high voltage operation. An online transition algorithm is used to transition from interleaved boost mode to DAB mode with minimal bus distortion. The automated controller selects the operating mode and inverter bus voltage at different torque-speed conditions to get maximum overall traction drive efficiency. An experimental prototype of the integrated converter demonstrates the automated controller functionality.

Anwar, Saeed↗

DOE OSTI2022

Large-scale scenarios of electric vehicle charging with a data-driven model of control

Transportation electrification is forecast to bring millions of new electric vehicles to roads worldwide this decade. Planning to support those vehicles depends on detailed scenarios of their electricity demand in both uncontrolled and controlled or smart charging scenarios. In this work, we present a novel modeling approach to enable rapid generation of demand estimates that represent the impact of controlled charging for large-scale scenarios with millions of individual drivers. To model the effect of load modulation control on aggregate charging profiles, we propose a novel machine learning approach that replaces traditional optimization approaches. We demonstrate its performance modeling workplace charging control under a range of electricity rate schedules, achieving small errors (2.5%–4.5%) while accelerating computations by more than 4000 times. To generate the uncontrolled charging demand for scenarios with residential, workplace, and public charging we use statistical representations of a large data set of real charging sessions. We demonstrate the methodology by generating diverse sets of scenarios for California's charging demand in 2030 which consider multiple charging segments and controls, each run locally in under 50 s. We further demonstrate support for rate design by modeling the large-scale impact of a new, custom rate schedule for workplace charging.

33 ADVANCED PROPULSION SYSTEMS↗

DOE OSTI2025

String instability mitigation of adaptive cruise control without modifying control laws: trajectory shaper and parameter estimation

Vehicle automation technologies equip vehicles with adaptive cruise control (ACC) systems, which relieve driving fatigue. However, recent studies have shown that the current ACC systems are string-unstable (i.e., exacerbate traffic congestion). To achieve string stability, most existing studies directly modify the control algorithms of ACC systems. Alternatively, this study proposes a trajectory shaper (TS)-based method, which only modifies the trajectory information of the predecessor vehicle, so that the ego vehicle driven by a string-unstable ACC system leverages the modified trajectory information to achieve string stability. To devise the TS-based method, an offline-online parameter estimation method integrating batch optimization and an extended Kalman filter is applied to estimate the parameters of an ACC system. The proposed TS-based method is cost-effective during implementation, as it avoids modifying existing ACC control algorithms (which entails a complex analysis of control systems and parameter tuning). In conclusion, the effectiveness of the proposed TS-based method is validated through extensive numerical experiments.

33 ADVANCED PROPULSION SYSTEMS↗

DOE OSTI2025

Optimizing on-ramp merging for connected and automated vehicles: A hierarchical approach using deep reinforcement learning and optimal control

On-ramp merging for Connected and Automated Vehicles (CAVs) presents significant challenges in dynamic traffic environments. Traditional methods and recent learning-based approaches often fail to simultaneously address decision-making complexity and execution precision under fluctuating conditions. This study introduces a novel hierarchical framework that combines: (1) a high-level Deep Reinforcement Learning (DRL) module that coordinates merging sequences through Virtual Traffic Signals (VTS) with Yield/Green phases and (2) a low-level optimal controller generating collision-free speed trajectories via pseudospectral convex optimization. A convolutional autoencoder compresses high-dimensional traffic states to enhance responsiveness. Extensive simulations demonstrate a 12.5% improvement in mainline throughput a 28% reduction in emergency braking events, and 31.66% lower fuel consumption compared to baseline methods. Furthermore, the framework’s effectiveness in coordinating CAV merges highlights its potential for real-world deployment. Future work will extend validation to multi-lane scenarios with mixed traffic and large-scale multiple merging points.

Connected and automated vehicles↗

DOE OSTI2020

Cooperative lane control application for fully connected and automated vehicles at multilane freeways

Advances in communications technology have made the development of connected and automated vehicle (CAV) applications that may potentially replace traditional, gantry operated lane control signals (LCSs) possible. Here, we develop the concept of a prototype CAV-enabled LCS application and provides a preliminary assessment of the potential improvement it offers over traditional LCS. Real-world data obtained from an LCS on I-66 in Northern Virginia was used to calibrate and validate a baseline simulation model. Further, the current lane control scenarios utilized in the Northern Virginia LCS were identified and relevant data resulting from implementation of those scenarios were collected to model the LCS in a simulation environment. The performance of real-world LCS was then compared to a prototype CAV-enabled LCS application developed in this research. The CAV-enabled LCS application consistently outperformed the traditional LCS with increased throughput and speeds. On average, an increase of 18.4%, 9.6% and 12.8% in throughput was observed for three selected scenarios under the best case of a 1 sec headway. Furthermore, the CAV-enabled LCS application was also found to reduce volatility, represented by variation in acceleration and deceleration regimes, by an average of 25.6% and 49.6%. The reduction in turbulence in the traffic stream may indicate potential improved safety with the CAV system.

33 ADVANCED PROPULSION SYSTEMS↗

DOE OSTI2021

Data-Driven Forgetting and Discount Factors for Vehicle Speed Forecasting in Ecological Adaptive Cruise Control

Abstract This paper investigates temporal correlations in human driving behavior using real-world driving to improve speed forecasting accuracy. These correlations can point to a measurement weighting function with two parameters: a forgetting factor for past speed measurements that the vehicle itself drove with, and a discount factor for the speeds of vehicles ahead based on information from vehicle-to-vehicle communication. The developed weighting approach is applied to a vehicle speed predictor using polynomial regression, a prediction method well-known in the literature. The performance of the developed approach is then assessed in both real-world and simulated traffic scenarios for accuracy and robustness. The new weighting method is applied to an ecological adaptive cruise control system, and its influence is analyzed on the prediction accuracy and the performance of the ecological adaptive cruise control in an electric vehicle powertrain model. The results show that the new prediction method improves energy saving from the eco-driving by up to 4.7% compared to a baseline least-square-based polynomial regression. This is a 10% improvement over the constant speed/acceleration model, a conventional speed predictor.

Automation & Control Systems↗

DOE OSTI2025

CityLearn v2: energy-flexible, resilient, occupant-centric, and carbon-aware management of grid-interactive communities

As more distributed energy resources become part of the demand-side infrastructure, quantifying their energy flexibility on a community scale is crucial. CityLearn v1 provided an environment for benchmarking control algorithms. However, there is no standardized environment utilizing realistic building-stock datasets for distributed energy resource control benchmarking without co-simulation or third-party frameworks. CityLearn v2 extends CityLearn v1 by providing a stand-alone simulation environment that leverages the End-Use Load Profiles for the U.S. Building Stock dataset to create grid-interactive communities for resilient, multi-agent, and objective control of distributed energy resources with dynamic occupant feedback. While the v1 environment used pre-simulated building thermal loads, the v2 environment uses data-driven thermal dynamics and eliminates the need for co-simulation with building energy performance software. This work details the v2 environment and provides application examples that use reinforcement learning control to manage battery energy storage system, vehicle-to-grid control, and thermal comfort during heat pump power modulation.

Nweye, Kingsley↗

DOE OSTI2022

Grid-Interactive Electric Vehicle and Building Coordination Using Coupled Distributed Control: Preprint

As an increasing number of controllable devices are introduced onto the grid, they can individually provide ancillary services in support of grid stability. However, the goals of each device differ due to their type and individual objectives, causing instances where they may conflict. To reduce the chances of these devices contributing to grid instability, these devices must effectively communicate in a cooperative manner to both meet their own needs while providing services to the grid. Previous work demonstrates that the NALD (Network Lasso-ADMM - Limited Communication - DMPC) algorithm allows coordination between two subsystems that use different control algorithms (building and charging stations) to provide services to the grid and individually optimize their performance in a specific scenario. The ideal NALD algorithm should be generalized to allow plug-and-play capabilities across devices of differing characteristics. This paper takes a step toward generalizability by updating the electric vehicle charging objective and re-defining the communication scheme compared to prior work to generalize the coordination and, as a result, improve the performance of the NALD algorithm.

ADVANCED PROPULSION SYSTEMS,ENERGY CONSERVATION, C↗

DOE OSTI2022

Precooling system utilizing cryogenic liquid fuels for fueling pressurized vehicle gaseous onboard storage tank system with controlled dispensing temperatures

A method and a precooling system are provided for precooling gaseous fuel supplied for fueling pressurized gaseous vehicle onboard storage tank systems. The precooling system is used in pressurized gaseous fueling stations with source fuels in cryogenic state, such as liquid hydrogen (LH2) and liquefied nature gas (LNG). A thermal buffer heat exchanger includes a heat exchanger medium, and a cold loop and a warm loop contained in the heat exchanger medium. A control unit is configured for controlling cryogenic fuel supplied to the cold loop for cooling the thermal buffer heat exchanger. The thermal buffer heat exchanger enables precooling high pressure gaseous fuel to a preset temperature supplied to a dispenser supplying high pressure gaseous fuel to refuel a vehicle onboard storage tank system.

Elgowainy, Amgad A.↗

DOE OSTI2022

Electric Vehicles at Scale (EVs@Scale) Laboratory Consortium Deep-Dive Technical Meetings: High Power Charging (HPC) Summary Report

Electric vehicle (EV) adoption will change the composition of EV charging load to higher-power charging as more medium- (MD) and heavy-duty (HD) applications are electrified, and as all vocations, including light-duty (LD) vehicles, are capable of faster charging. These shifts provide the opportunity for high-power charging (HPC) and facility equipment to evolve and improve efficiency, cost, and space. High-Power Electric Vehicle Charging Hub Integration Platform (eCHIP) project designs and develops a high-power, interoperable charging experimental platform to research, develop, and demonstrate the integration approaches and technology solutions. The project addresses (1) interconnection and management of a grid-tied inverter; (2) development of a DC distribution system that is responsible for system energy management, interoperability, and DC protection; (3) modular DC/DC conversion for vehicle charging; (4) EV charging interface and DC/DC integration; and (5) smart charge control and vehicle-to-edge (vehicle-to-building [V2B], vehicle-to-everything [V2X]) capability. This summary presentation is the first technical progress output of the project. It provides insight for the first deep-dive technical meeting outputs in terms of research presentations and also includes summary of the discussions occurred in the follow-up breakout sessions. The summary presentation covers three technical areas: (1) HPC: State of the art power architectures and the design of the power electronics, (2) Modeling, energy management, and power control in the HPC station, and (3) Codes and standards work that are in line with the previous two topic areas.

ADVANCED PROPULSION SYSTEMS,POWER TRANSMISSION AND↗

DOE OSTI2023

Electric Vehicles at Scale (EVs@Scale) Laboratory Consortium Deep-Dive Technical Meetings: High Power Charging (HPC) Summary Report

Electric vehicle (EV) adoption will change the composition of EV charging load to higher-power charging as more medium- (MD) and heavy-duty (HD) applications are electrified, and as all vocations, including light-duty (LD) vehicles, are capable of faster charging. These shifts provide the opportunity for high-power charging (HPC) and facility equipment to evolve and improve efficiency, cost, and space. High-Power Electric Vehicle Charging Hub Integration Platform (eCHIP) project designs and develops a high-power, interoperable charging experimental platform to research, develop, and demonstrate the integration approaches and technology solutions. The project addresses (1) interconnection and management of a grid-tied inverter; (2) development of a DC distribution system that is responsible for system energy management, interoperability, and DC protection; (3) modular DC/DC conversion for vehicle charging; (4) EV charging interface and DC/DC integration; and (5) smart charge control and vehicle-to-edge (vehicle-to-building [V2B], vehicle-to-everything [V2X]) capability. This summary presentation is the first technical progress output of the project. It provides insight for the first deep-dive technical meeting outputs in terms of research presentations and also includes summary of the discussions occurred in the follow-up breakout sessions. The summary presentation covers three technical areas: (1) HPC: State of the art power architectures and the design of the power electronics, (2) Modeling, energy management, and power control in the HPC station, and (3) Next Generation Profiles for high power charging characterization.

ADVANCED PROPULSION SYSTEMS↗

DOE OSTI2022

CANShield: Signal-based Intrusion Detection for Controller Area Networks

Modern vehicles rely on complex cyber-physical systems made up of hundreds of electronic control units (ECUs) connected through controller area network (CAN) buses. However, the CAN bus attack surface is increasing due to advanced features in automobiles, making it prone to injection attacks. The ordinary injection attacks disrupt the typical timing properties of the CAN data stream, and the rule-based intrusion detection systems (IDS) can easily detect them. However, advanced attackers can inject false data to the signal level, maintaining the regular pattern/frequency of the CAN messages. Such attacks can bypass the rule-based IDS or any anomaly-based IDS built on binary payload data. To make the vehicles robust against such intelligent attacks, we propose CANShield, a signal-based intrusion detection framework for the CAN bus that consists of three modules. A data preprocessing module handles the high-dimensional CAN data stream at the signal level and make them suitable for any machine learning model. A data analyzer module consists of multiple deep autoencoder networks, each analyzing the time series data from a different perspective. Finally, an attack detection module uses an ensemble method to make the final decision. Evaluation results on a standard signal-based dataset show the effectiveness of the CANShield in detecting five advanced attacks.

Shahriar, Md Hasan↗

DOE OSTI2022

Ecological Adaptive Cruise Control of Plug-In Hybrid Electric Vehicle With Connected Infrastructure and On-Road Experiments

Abstract This paper examines both mathematical formulation and practical implementation of an ecological adaptive cruise controller (ECO-ACC) with connected infrastructure. Human errors are typical sources of accidents in urban driving, which can be remedied by rigorous control theories. Designing an ECO-ACC is, therefore, a classical research problem to improve safety and energy efficiency. We add two main contributions to the literature. First, we propose a mathematical framework of an online ECO-ACC for plug-in hybrid electric vehicle (PHEV). Second, we demonstrate ECO-ACC in a real world, which includes other human drivers and uncertain traffic signals on a 2.6 (km) length of the corridor with eight signalized intersections in Southern California. The demonstration results show, on average, 30.98% of energy efficiency improvement and 8.51% additional travel time.

Automation & Control Systems↗

DOE OSTI2024

CIRCLES: Congestion Impacts Reduction via CAV-in-the-loop Lagrangian Energy Smoothing

The energy efficiency of today’s vehicular mobility relies on the un-integrated combination of i) control via static assets (traffic lights, metering, variable speed limits, etc.); and ii) onboard vehicle automation (adaptive cruise control (ACC), ecodriving, etc.). These two families of control were not co-designed and are not engineered to work in coordination. Recent studies have shown i) limitations of controls, and even ii) negative impacts of ACC. This project focused on the technology development, implementation and prototyping, and validation of Mobile Traffic Control (MTC). MTC can be viewed as an extension of classical traffic control (in which static infrastructure actuates traffic flow). In the MTC paradigm, automated vehicles actuate the entire flow via their behavior, offering enhanced possibilities to optimize the energy footprint of traffic, if designed correctly. We set out to demonstrate for the first time that considerably reduced fuel consumption of all vehicles in traffic can be achieved via distributed control of a small proportion of CAVs. Compared to baseline vehicular technologies, our work offers a significant design departure: control algorithms for the CAVs consider the impact one vehicle can have on overall traffic, improving resulting overall fuel consumption. We focus on using a few vehicles (as traffic controllers via CAV technology) to improve the energy efficiency of traffic flow to further optimize energy efficiency. A live-traffic demonstration in November 2022 featured the deployment of 100 specially-equipped CAVs, constituting an approximate local penetration rate upwards of 2%.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2020

On the Performance of Detecting Injection of Fabricated Messages into the CAN Bus

There have been several public demonstrations of attacks on connected vehicles showing the ability of an attacker to take control of a targeted vehicle by injecting messages into their Controller Area Network (CAN) bus. In this article, using injected speed reading and Revolutions Per Minute (RPM) reading messages in in-motion vehicle, we examine the ability of the Pearson correlation and the unsupervised learning methods k-means clustering and Hidden Markov Model (HMM) to differentiate ’no-attack’ and ’under-attack’ states of the given vehicle. We found that the Pearson correlation distinguishes the two states, the k-means clustering method has an acceptable accuracy but high false positive rate and HMM detects attacks with acceptable detection rate but has a high false positive in detecting attacks from speed readings when there is no attack. The accuracy of these unsupervised learning methods are comparable to the ones of the supervised learning methods used by CAN bus Intrusion Detection System (IDS) suppliers. In addition, the article shows that studying CAN anomaly detection techniques using off-vehicle test facilities may not properly evaluate the performance of the detection techniques. Finally, the results suggest using other features besides the data content of the CAN messages and integrate knowledge about how the Electronic Control Units (ECUs) collaborate in building effective techniques for the detection of injection of fabricated message attacks.

97 MATHEMATICS AND COMPUTING↗