Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “real time optimization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,315 records · Page 73

A Neural Optimizer With Decision-Focused Learning for Optimal Energy Storage Operation

Here, this article introduces a neural optimizer-based framework for optimizing battery energy storage system (BESS) control for grid services, including demand charge and energy cost reduction. By leveraging decision-focused learning (DFL), the proposed framework ensures seamless integration and adaptation, significantly enhancing control performance. A patch time-series transformer is employed for peak load forecasting, incorporating aleatoric uncertainty quantification to account for forecasting uncertainties within the decision-making process. The framework utilizes a solver-in-the-loop approach to generate optimal BESS actions, which are then used to train the neural optimizer-based agent. By co-optimizing both BESS operational modes and output power within the NN, the system achieves improved performance and robustness. After initial training, the forecasting and control models are jointly fine-tuned to account for forecasting errors, further improving decision precision and efficiency through DFL. Case studies are performed to validate the performance of the framework using multiple real-world datasets, demonstrating superior performance in monthly peak load forecasting compared to state-of-the-art models. In addition, the results are compared against existing decision-making approaches. The results demonstrate a reduction in monthly peak forecasting error by approximately 15% across various performance measures and achieve an optimization gap for BESS operation that is about three times smaller compared to existing methods.

Kim, Hyeonjin [Pacific Northwest National Laborato↗

Time-Dependent Electric Bus and Charging Station Deployment Problem

Battery electric buses (BEBs) have gained popularity due to their emission-free and energy-efficient features. Many transit authorities worldwide have set goals to gradually replace their bus fleets with BEBs. Considering the potential decline in BEB battery and charger prices, this study proposes a time-dependent bus fleet transition model to determine the optimal bus fleet transition plan, which includes selecting the bus lines to be electrified, determining the timing and type of BEBs to be purchased, and deploying on-route fast chargers and depot chargers. The model is a bi-objective integer linear program that considers the trade-off between electrified transit mileages and bus electrification costs. A normalized normal constraint method is applied to solve the bi-objective optimization model. The effectiveness of the proposed model is tested using a real-world bus network. Additionally, sensitivity analyses are conducted to better understand the impact of different parameter values on the optimal solutions. Our proposed model can provide transit authorities with a powerful tool to make informed decisions about their BEB fleet replacement plans.

ADVANCED PROPULSION SYSTEMS↗

A Method of Optimal Control for Class 8 Vehicle Platoons Over Hilly Terrain

This work develops and implements an NMPC control system to facilitate fuel-optimal platooning of Class 8 vehicles over challenging terrain. Prior research has shown that Cooperative Adaptive Cruise Control (CACC), which allows multiple Class 8 vehicles to follow in close succession, can save between 3 and 8% in overall fuel consumption on flat terrain. However, on more challenging terrain, e.g. rolling hills, platooning vehicles can experience diminished fuel savings, and, in some cases, an increase in fuel consumption relative to individual vehicle operation. This research explores the use of Nonlinear Model Predictive Control (NMPC) with predefined route grade profiles to allow platooning vehicles to generate an optimal velocity trajectory with respect to fuel consumption. In order to successfully implement the NMPC system, a model relating vehicle velocity to fuel consumption was generated and validated using experimental data. Additionally, the predefined route grade profiles were created by using the vehicle's GPS velocity over the desired terrain. The real-time NMPC system was then implemented on a two-truck platoon operating over challenging terrain, with a reference vehicle running individually. The results from NMPC platooning are compared against fuel results from a classical proportional-integral-derivative (PID) headway control method. Furthermore, this comparison yields the comparative fuel savings and energy efficiency benefit of NMPC system. In the final analysis, significant fuel savings of greater than 14 and 20% were seen for the lead and following vehicles relative to their respective traditional cruise control and platooning architectures.

33 ADVANCED PROPULSION SYSTEMS↗

On the Performance of Adaptive Data Rate over Deep Space Ka-Bank Link: Case Study Using Kepler Data

Future missions envisioned for both human and robotic exploration demand increasing communication capacity through the use of Ka-band communications. The Ka-band channel, being more sensitive to weather impairments, presents a unique trade-offs between data storage, latency, data volume and reliability. While there are many possible techniques for optimizing Ka-band operations such as adaptive modulation and coding and site-diversity, this study focus exclusively on the use of adaptive data rate (ADR) to achieve significant improvement in the data volume-availability tradeoff over a wide range of link distances for near Earth and Mars exploration. Four years of Kepler Ka-band downlink symbol signal-to-noise (SNR) data reported by the Deep Space Network were utilized to characterize the Ka-band channel statistics at each site and conduct various what-if performance analysis for different link distances. We model a notional closed-loop adaptive data rate system in which an algorithm predicts the channel condition two-way light time (TWLT) into the future using symbol SNR reported in near-real time by the ground receiver and determines the best data rate to use. Fixed and adaptive margins were used to mitigate errors in channel prediction. The performance of this closed-loop adaptive data rate approach is quantified in terms of data volume and availability and compared to the actual mission configuration and a hypothetical, optimized single rate configuration assuming full a priori channel knowledge.

Gao, Jay L.↗

Molar Absorptivities of U(VI), U(IV), and Pu(III) in Nitric Acid Solutions of Various Concentrations Relevant to Developing Nuclear Fuel Recycling Flowsheets

Testing of a co-decontamination (CoDCon) tributyl phosphate (TBP) based solvent extraction flowsheet is being performed to optimize conditions for achieving a target U/Pu ratio in the Pu-containing product. The flowsheet is designed to directly produce a mixture of U and Pu with a U/Pu mass ratio of 7/3. The system is monitored in real time using optical spectroscopy, which allows for control of the U/Pu ratio in the aqueous U/Pu nitrate product. On-line spectrophotometric monitoring of the aqueous stream at the reductive stripping step involves determination of U(VI), U(IV) and Pu(III) concentrations and relies on molar absorptivities of these species in nitric acid at a number of wavelengths corresponding to their peaks’ maxima. The magnitudes of these molar absorptivities are a sensitive function of nitric acid concentration and have to be determined as precisely as possible using an off-line spectrophotometry under well controlled conditions. This step (called training set acquisition) is typically performed not in a high contamination area of radiological glovebox where flow-through cells and other on-line equipment are installed but in a less aggressive environment of a radiological fume hood with much better control of stock solutions quality, dilution factors, optical absorbance scale calibration, etc. This is followed by the calibration transfer between the off-line instrument and the instrument deployed during extraction and stripping runs. This paper reports values of molar absorptivities of U(VI), U(IV), and Pu(III) in nitric acid solution of 0.5 M to 4 M concentration and compares them with available technical literature data. Results of off-line spectrophotometric analysis of selected aqueous grab samples from one of CoDCon runs show satisfactory agreement with total uranium and plutonium concentrations determined in the same samples by ICP-MS.

Sinkov, Sergey I.↗

Robust cooperative control strategy for a platoon of connected and autonomous vehicles against sensor errors and control errors simultaneously in a real-world driving environment

In a real-world driving environment, a platoon of connected and autonomous vehicles (CAVs) is subject to many internal and external disturbances, resulting in uncertain vehicle dynamics. In general, the disturbances can be categorized into two types: disturbances due to vehicle sensor errors (e.g., GPS error) and disturbances due to vehicle control errors (e.g., actuator delay). In the literature, many control strategies have been proposed to improve the robustness of the CAV platoon against uncertain vehicle dynamics induced by these disturbances. However, most of these strategies only consider one type of disturbance and cannot tackle both types of disturbances simultaneously. Furthermore, they are designed to maximize the benefits of each vehicle in the platoon independently, which can deteriorate the performance of the platoon. Here, to address these problems, this study proposes a robust cooperative control (RCC) strategy to maneuver the vehicles in the platoon cooperatively to counteract the impacts of both types of disturbances. The RCC strategy is developed based on a minimax problem, where the maximization subproblem seeks to find the worst inputs for the uncertainty terms in the vehicle dynamics equation to minimize the platoon performance, while the minimization subproblem seeks to find the optimal control decisions for all subsequent vehicles to maximize the platoon performance in the worst case. To solve the minimax problem, this study proposes a globally convergent solution algorithm. It can solve the minimax problem very efficiently to enable real time deployment of the RCC strategy. Numerical application indicates that compared to the existing methods, the RCC strategy can dramatically improve the robustness of the CAV platoon against the uncertain vehicle dynamics induced by both vehicle state detection errors and vehicle control errors. Therefore, it can maneuver the CAV platoon safely and efficiently in a real-world driving environment.

33 ADVANCED PROPULSION SYSTEMS↗

A Scalable Semi-Implicit Barotropic Mode Solver for the MPAS-Ocean

A scalable semi-implicit barotropic mode solver for the ocean component of the model for prediction across scales has been implemented as a competitor to an existing explicit-subcycling scheme to allow faster and more stable simulations while not sacrificing accuracy. The semi-implicit solver adopts the pipelined preconditioned bi-conjugate gradient stabilization algorithm as an iterative solver in conjunction with the restricted additive Schwarz preconditioner that accelerates the convergence rate of the iterative solver. The preconditioner is constructed from a linearized barotropic system that also reorders the system for optimal performance, while the semi-implicit solver deals with the fully nonlinear barotropic system that requires reassembly of the coefficient matrix for every time step. Several numerical experiments, from simple one-dimensional tests to three-dimensional real-world tests, demonstrate that the semi-implicit solver has almost the same accuracy and better parallel scalability compared with the existing scheme while allowing faster and more stable simulations. Furthermore, the semi-implicit solver accelerates the barotropic mode up to 2.9 times faster than the existing scheme on 16,320 processors, leading to an overall runtime speedup of 1.9.

97 MATHEMATICS AND COMPUTING↗

DUNE DAQ R&D integration in ProtoDUNE Single-Phase at CERN

The DAQ system of ProtoDUNE-SP successfully proved its design principles and met the requirements of the beam run of 2018. The technical design of the DAQ system for the DUNE experiment has major differences compared to the prototype due to different requirements placed on the detector, as well as a radically different location of operation. The single-phase prototype at CERN is a major integration facility for R&D aspects of the DUNE DAQ system. The facility allows for the exploration of additional data processing capabilities and optimization of the FELIX system, which is the chosen TPC readout solution for the DUNE single-phase detectors. One of the fundamental differences from the prototype is that the DUNE DAQ relies on self-triggering. Therefore, real-time processing of the data stream for hit and trigger primitive finding is essential for the requirement of continuous readout. The supernova burst trigger requires a large and fast buffering technique, where 3D XPoint persistent memory solutions are evaluated and integrated. In order to maximize resource utilization of the FELIX hosting servers, the elimination of the 100 Gb network communication stack is desired. This implies the design and development of a single-host application layer, which is a fundamental element of the self-triggering chain. This paper discusses the evaluation and integration of these developments for the DUNE DAQ, in the ProtoDUNE environment.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

A comparative analysis of YOLOv8 and U-Net image segmentation approaches for transmission electron micrographs of polycrystalline thin films

Metallic thin films offer a platform to experimentally study the dynamics of microstructural evolution, but the required transmission electron microscopy (TEM)-based imaging generates complex images that are challenging to segment and quantify. This work provides a comparative analysis of a new YOLOv8 model and an established U-Net model for bright-field TEM images of polycrystals, employing a framework leveraging physical observables to evaluate performance against two hand-traced benchmark datasets. This methodology obviates the comparison of large, diversely structured, and manually labeled datasets that are required to assess performance on a per-image/per-pixel basis. It is found that the YOLOv8 model, adapted for real-time instance segmentation, has up to 43× faster inferencing (NVIDIA GeForce RTX 4090) compared to U-Net and reconstructs hand-traced grain size distributions (GSDs) with excellent fidelity, finding mean diameter within 3% for grains near an optimal magnification; for grains that deviate from the optimal pixel-diameter, the size of small- (large)-diameter grains is systematically over- (under)-estimated. This is partially mitigated by including scale-aware augmentations during training. Moreover, when the bias is corrected post-inference by a rigid shift in distribution, the YOLOv8 model reproduces ground truth GSDs with exceptional fidelity, with statistical tests indicating <5% probability that the distributions are distinct. Based on ground truth data, calibration curves pertaining to this shift can be constructed for a given model. This issue is not present in the U-Net model’s results, indicating that for quantitative measurements where the true size of objects is of interest, special procedures must be implemented for YOLO-based models.

36 MATERIALS SCIENCE↗

Dynamic, symmetry-preserving, and hardware-adaptable circuits for quantum computing many-body states and correlators of the Anderson impurity model

We present a hardware-reconfigurable ansatz on N q -qubits for the variational preparation of many-body states of the Anderson impurity model (AIM) with N imp + N bath = N q /2 sites, which conserves total charge and spin z component within each variational search subspace. The many-body ground state of the AIM is determined as the minimum over all minima of O(N$^2_ q$) distinct charge-spin sectors. Hamiltonian expectation values are shown to require ω(N q ) < N meas. $\leqslant$ O(N imp N bath ) symmetry-preserving, parallelizable measurement circuits, each amenable to postselection. To obtain the one-particle impurity Green’s function we show how initial Krylov vectors can be computed via midcircuit measurement and how Lanczos iterations can be computed using the symmetry-preserving ansatz. For a single-impurity Anderson model with a number of bath sites increasing from one to seven, we show using numerical emulation that the ease of variational ground-state preparation is suggestive of linear scaling in circuit depth and subquartic scaling in optimizer complexity. We therefore expect that, combined with time-dependent methods for Green’s function computation, our ansatz provides a useful tool to account for electronic correlations on early fault-tolerant processors. Finally, with a view towards computing real materials properties of interest like magnetic susceptibilities and electron-hole propagators, we provide a straightforward method to compute many-body, time-dependent correlation functions using a combination of time evolution, midcircuit measurement-conditioned operations, and the Hadamard test.

36 MATERIALS SCIENCE↗

Automated Operational Forecasting of Monsoon Low Pressure Systems

Monsoon low pressure systems (LPSs) are the dominant rain-bearing weather system of South Asia, often producing extreme precipitation and hydrological disasters in a region inhabited by nearly two billion people. Despite the importance of these storms, no operational system has automatically identified and tracked LPS in real time in numerical weather prediction model output; many commonly used vortex-tracking algorithms are ill suited for monsoon LPS because of the weak winds and cold cores of these systems. Here, we describe a new system that uses optimized algorithms to identify monsoon LPS in short- to medium-range forecasts from the U.S. Global Ensemble Forecast System (GEFS) and a version of the deterministic Global Forecast System (GFS) adapted and used operationally by the Indian Institute of Tropical Meteorology (IITM). We also assess the historical performance of these models in forecasting South Asian monsoon LPS, comparing this with the performance of the Integrated Forecasting System of the ECMWF. We assess the accuracy of model predictions of LPS genesis, position, intensity, and precipitation rates for forecast lead times of 1–5 days, yielding quantitative information on model biases to guide operational forecasters and disaster managers. The system we introduce here could be extended to other low-latitude regions affected by dynamically weak, heavily precipitating atmospheric vortices that are often not included in tropical cyclone inventories.

54 ENVIRONMENTAL SCIENCES↗

Laser-based Adhesion Strength Measurements for Advanced Manufactured Sensor Adhesion Characterization

As part of the advanced manufacturing (AM) focus of the Nuclear Energy Enabling Technologies (NEET) Advanced Sensors and Instrumentation (ASI) Program, new in-house capabilities to fabricate and test novel active and passive in-pile sensors are being developed at the Idaho National Laboratory (INL). These advanced-manufactured sensors, such as peak temperature monitors and strain gauges, must be miniaturized and be able to provide real-time feedback, all while withstanding the coupled extremes of temperature and radiation typically observed in the environment of a nuclear test reactor. Fabricating durable and robust in-pile sensors with high fidelity requires a fundamental understanding of the optimal process parameters required in the AM technique, as well as the effect of deviations from optimal process parameters on the sensor-substrate adhesion and the ultimate robustness of the sensor. This report presents the use of a laser-based, non-contact approach for characterizing the adhesion of sensors manufactured using aerosol jet printing (AJP) that comprise of silver nanoparticle inks deposited and sintered on austenitic stainless steel (SS) 316L substrates. The effect of substrate surface roughness, surface energy, ink sintering time and sintering temperature on the printed sensor topography and the sensor-substrate adhesion has been systematically investigated. The sensor-substrate interfacial adhesion strength was determined from the critical laser pulse energy required to ablate/ detach the printed sensor from the substrate. Measurements of the sensor topography using optical profilometry revealed that post-deposition sintering at 400°C for 60 minutes resulted in a reduced sensor thickness, while plasma treating the substrate prior to printing yielded sensors with uniform thickness profiles transverse to the print direction. Sintering temperature and time were found to be the dominant parameters that affected sensor-substrate adhesion, followed by substrate surface roughness. The laser-based and locally-destructive approach for adhesion strength measurements shows promise in overcoming the challenges and limitations of current standardized peel tests and can be developed into a post-fabrication process control protocol for evaluating the durability of AM printed sensors in a high throughput fashion. Future studies will investigate the use of laser-induced spallation techniques as well as non-destructive laser ultrasonic methods for sensor-substrate adhesion characterization on sensors manufactured using AJP and other AM techniques such as plasma jet printing (PJP).

42 ENGINEERING↗

Demonstration of Utility Managed Smart Charging for Multiple Benefit Streams (Final Report)

In the summer of 2020, the U.S. Department of Energy (DOE) awarded funding to Exelon’s Maryland utilities—Baltimore Gas and Electric (BGE), Delmarva Power & Light (DPL), and Potomac Electric Power Company (Pepco)—to implement the Smart Charge Management (SCM) pilot. This initiative aimed to design and implement managed electric vehicle (EV) charging strategies, evaluate the grid impacts of EV charging, and assess the utilities' ability to control EV load based on real-time grid conditions. The SCM pilot explored four aspects for continued improvement: (1) cybersecurity and managed charging functionality testing of two vendor platforms—WeaveGrid (telematics-based) and Shell Recharge Solutions (network-based)—which pursued charge scheduling and optimization through distinct approaches; (2) an analysis by Argonne National Laboratory (ANL) modeling team of three potential SCM enrollment scenarios within BGE and Pepco service territories over the next decade to assess future scalability; (3) employing customer engagement strategies, including surveys and a responsive pricing approach; and (4) the launch and implementation of pilots in Exelon’s Maryland territories in collaboration with WeaveGrid.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Development of High Speed Imaging and Analysis Techniques Compressible Dynamics Stall

Dynamic stall has limited the flight envelope of helicopters for many years. The problem has been studied in the laboratory as well as in flight, but most research, even in the laboratory, has been restricted to surface measurement techniques such as pressure transducers or skin friction gauges, except at low speed. From this research, it became apparent that flow visualization tests performed at Mach numbers representing actual flight conditions were needed if the complex physics associated with dynamic stall was to be properly understood. However, visualization of the flow field during compressible conditions required carefully aligned and meticulously reconstructed holographic interferometry. As part of a long-range effort focused on exposing of the physics of compressible dynamic stall, a research wind tunnel was developed at NASA Ames Research Center which permits visual access to the full flow field surrounding an oscillating airfoil during compressible dynamic stall. Initially, a stroboscopic schlieren technique was used for visualization of the stall process, but the primary research tool has been point diffraction interferometry(PDI), a technique carefully optimized for use in th is project. A review of the process of development of PDI will be presented in the full paper. One of the most valuable aspects of PDI is the fact that interferograms are produced in real time on a continuous basis. The use of a rapidly-pulsed laser makes this practical; a discussion of this approach will be presented in the full paper. This rapid pulsing(up to 40,000 pulses/sec) produces interferograms of the rapidly developing dynamic stall field in sufficient resolution(both in space and time) that the fluid physics of the compressible dynamic stall flowfield can be quantitatively determined, including the gradients of pressure in space and time. This permits analysis of the influence of the effect of pitch rate, Mach number, Reynolds number, amplitude of oscillation, and other parameters on the dynamic stall process. When interferograms can be captured in real time, the potential for real-time mapping of a developing unsteady flow such as dynamic stall becomes a possibility. This has been achieved in the present case through the use of a high-speed drum camera combined with electronic circuitry which has resulted in a series of interferograms obtained during a single cycle of dynamic stall; images obtained at the rate of 20 KHz will be presented as a part of the formal presentation. Interferometry has been available for a long time; however, most of its use has been limited to visualization. The present research has focused on use of interferograms for quantitative mapping of the flow over oscillating airfoils. Instantaneous pressure distributions can now be obtained semi-automatically, making practical the analysis of the thousands of interferograms that are produced in this research. A review of the techniques that have been developed as part of this research effort will be presented in the final paper.

Chandrasekhara, M. S.↗

Autonomous Medical Care for Exploration

The goal of Autonomous Medical Care (AMC) is to ensure a healthy, well-performing crew which is a primary need for exploration. The end result of this effort will be the requirements and design for medical systems for the CEV, lunar operations, and Martian operations as well as a ground-based crew health optimization plan. Without such systems, we increase the risk of medical events occurring during a mission and we risk being unable to deal with contingencies of illness and injury, potentially threatening mission success. AMC has two major components: 1) pre-flight crew health optimization and 2) in-flight medical care. The goal of pre-flight crew health optimization is to reduce the risk of illness occurring during a mission by primary prevention and prophylactic measures. In-flight autonomous medical care is the capability to provide medical care during a mission with little or no real-time support from Earth. Crew medical officers or other crew members provide routine medical care as well as medical care to ill or injured crew members using resources available in their location. Ground support becomes telemedical consultation on-board systems/people collect relevant data for ground support to review. The AMC system provides capabilities to incorporate new procedures and training and advice as required. The on-board resources in an autonomous system should be as intelligent and integrated as is feasible, but autonomous does not mean that no human will be involved. The medical field is changing rapidly, and so a challenge is to determine which items to pursue now, which to leverage other efforts (e.g. military), and which to wait for commercial forces to mature. Given that what is used for the CEV or the Moon will likely be updated before going to Mars, a critical piece of the system design will be an architecture that provides for easy incorporation of new technologies into the system. Another challenge is to determine the level of care to provide for each mission type. The level of care refers to the amount and type of care one will render based on perceived need and ability. This is in contrast to the standard of care which is the benchmark by which that care is provided. There are certainly some devices and procedures that have unique microgravity or partial gravity requirements such that terrestrial methods will not work. For example, performing CPR on Mars cannot be done in exactly the same way as on Earth because the reduced gravity causes too large a reduction in the forces available for effective compression of the chest. Likewise, fluid behavior in microgravity may require a specialized water filtration and mixing system for the creation of intravenous fluids. This paper will outline the drivers for the design of the medical care systems, prioritization and planning techniques, key system components, and long term goals.

Johnson-Throop, Kathy A.↗

Enhanced Multi-Modal Access to Planetary Exploration

Tomorrow's Interplanetary Network (IPN) will evolve from JPL's Deep-Space Network (DSN) and provide key capabilities to future investigators, such as simplified acquisition of higher-quality science at remote sites and enriched access to these sites. These capabilities could also be used to foster public interest, e.g., by making it possible for students to explore these environments personally, eventually perhaps interacting with a virtual world whose models could be populated by data obtained continuously from the IPN. Our paper looks at JPL's approach to making this evolution happen, starting from improved communications. Evolving space protocols (e.g., today's CCSDS proximity and file-transfer protocols) will provide the underpinning of such communications in the next decades, just as today's rich web was enabled by progress in Internet Protocols starting from the early 1970's (ARPAnet research). A key architectural thrust of this effort is to deploy persistent infrastructure incrementally, using a layered service model, where later higher-layer capabilities (such as adaptive science planning) are enabled by earlier lower-layer services (such as automated routing of object-based messages). In practice, there is also a mind shift needed from an engineering culture raised on point-to-point single-function communications (command uplink, telemetry downlink), to one in which assets are only indirectly accessed, via well-defined interfaces. We are aiming to foster a 'community of access' both among space assets and the humans who control them. This enables appropriate (perhaps eventually optimized) sharing of services and resources to the greater benefit of all participants. We envision such usage to be as automated in the future as using a cell phone is today - with all the steps in creating the real-time link being automated.

interplanetary network (IPN)↗

An Optimal Initial Guess Generator for Entry Interface Targeters

If a pure numerical iterative approach is used, targeting entry interface (EI) conditions for nominal and abort return trajectories or for correction maneuvers can be computationally expensive. This paper describes an algorithm to obtain an optimal impulsive maneuver that generates a trajectory satisfying a set of EI targets: inequality constraints on longitude, latitude and azimuth and a fixed flight-path angle. Most of the calculations require no iterations, making it suitable for real-time applications or large trade studies. This algorithm has been used to generate initial guesses for abort trajectories during Earth-Moon transfers.

Senent, Juan S.↗

Integration of Decentralized Graph-Based Multi-Agent Reinforcement Learning with Digital Twin for Traffic Signal Optimization

Machine learning (ML) methods, particularly Reinforcement Learning (RL), have gained widespread attention for optimizing traffic signal control in intelligent transportation systems. However, existing ML approaches often exhibit limitations in scalability and adaptability, particularly within large traffic networks. This paper introduces an innovative solution by integrating decentralized graph-based multi-agent reinforcement learning (DGMARL) with a Digital Twin to enhance traffic signal optimization, targeting the reduction of traffic congestion and network-wide fuel consumption associated with vehicle stops and stop delays. In this approach, DGMARL agents are employed to learn traffic state patterns and make informed decisions regarding traffic signal control. The integration with a Digital Twin module further facilitates this process by simulating and replicating the real-time asymmetric traffic behaviors of a complex traffic network. The evaluation of this proposed methodology utilized PTV-Vissim, a traffic simulation software, which also serves as the simulation engine for the Digital Twin. The study focused on the Martin Luther King (MLK) Smart Corridor in Chattanooga, Tennessee, USA, by considering symmetric and asymmetric road layouts and traffic conditions. Comparative analysis against an actuated signal control baseline approach revealed significant improvements. Experiment results demonstrate a remarkable 55.38% reduction in Eco_PI, a developed performance measure capturing the cumulative impact of stops and penalized stop delays on fuel consumption, over a 24 h scenario. In a PM-peak-hour scenario, the average reduction in Eco_PI reached 38.94%, indicating the substantial improvement achieved in optimizing traffic flow and reducing fuel consumption during high-demand periods. These findings underscore the effectiveness of the integrated DGMARL and Digital Twin approach in optimizing traffic signals, contributing to a more sustainable and efficient traffic management system.

42 ENGINEERING↗