SEARCH · Engineering Papers

Results for “control strategy”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 955 records · Page 53

All sources NASA NTRS DOE OSTI

DOE OSTI2021

Programming Abstractions for Managing Workflows on Tiered Storage Systems

Scientific workflows in High Performance Computing (HPC) environments are processing large amounts of data. The storage hierarchy on HPC systems is getting deeper, driven by new technologies (NVRAMs, SSDs, etc.) There is a need for new programming abstractions that allow users to seamlessly manage data at the workflow level on multi-tiered storage systems, and provide optimal workflow performance and use of storage resources. In previous work, we introduced a software architecture Managing Data on Tiered Storage for Scientific Workflows (MaDaTS) that used a Virtual Data Space (VDS) abstraction to hide the complexities of the underlying storage system while allowing users to control data management strategies. In this article, we detail the data-centric programming abstractions that allow users to manage a workflow around its data on the storage layer. The programming abstractions simplify data management for scientific workflows on multi-tiered storage systems, without affecting workflow performance or storage capacity. We measure the overheads and effectiveness introduced by the programming abstractions of MaDaTS. Our results show that these abstractions can optimally use the storage capacity in lesser capacity storage tiers, and simplify data management without adding any performance overheads.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

DOE OSTI2023

Dancing the Quantum Waltz: Compiling Three-Qubit Gates on Four Level Architectures

Superconducting quantum devices are a leading technology for quantum computation, but they face several challenges. Gate errors, coherence errors and a lack of connectivity all contribute to low fidelity results. In particular, connectivity restrictions enforce a gate set that requires three-qubit gates to be decomposed into one- or two-qubit gates. This substantially increases the number of two-qubit gates that need to be executed. However, many quantum devices have access to higher energy levels. We can expand the qubit abstraction of |0〉 and |1〉 to a ququart which has access to the |2〉 and |3〉 state, but with shorter coherence times. This allows for two qubits to be encoded in one ququart, enabling increased virtual connectivity between physical units from two adjacent qubits to four fully connected qubits. This connectivity scheme allows us to more efficiently execute three-qubit gates natively between two physical devices.We present direct-to-pulse implementations of several three-qubit gates, synthesized via optimal control, for compilation of three-qubit gates onto a superconducting-based architecture with access to four-level devices with the first experimental demonstration of four-level ququart gates designed through optimal control. We demonstrate strategies that temporarily use higher level states to perform Toffoli gates and always use higher level states to improve fidelities for quantum circuits. We find that these methods improve expected fidelities with increases of 2x across circuit sizes using intermediate encoding, and increases of 3x for fully-encoded ququart compilation.

Litteken, Andrew↗

DOE OSTI2022

Human behavior determinants of exposure to Anopheles vectors of malaria in Sumba, Indonesia

Malaria vector control interventions in Sumba, Indonesia, have not been able to eliminate malaria. Human drivers of exposure to Anopheles bites were investigated as part of a larger clinical trial evaluating the impact of a spatial repellent product on malaria incidence. Human behavioral observations (HBOs) evaluating temporal and spatial presence, sleeping behaviors, and insecticide treated net (ITN) use, were collected parallel to entomological collections—indoor and outdoor human landing catches (HLCs), and house hold surveys. Data demonstrates that mosquito access to humans, enabled by structurally open houses, is evident by the similar entomological landing rates both inside and outside households. The presence of animals inside houses was associated with increased mosquito entry–however, the number of humans present inside houses was not related to increased mosquito landing. Analyzing mosquito landing rates with human behavior data enables the spatial and temporal estimation of exposure to Anopheles bites, accounting for intervention (ITN) presence and usage. Human behavior adjusted exposure to Anopheles bites was found to be highest in the early in the evening, but continued at lower levels throughout the night. Over the night, most exposure (53%) occurred when people were indoors and not under the protection of nets (asleep or awake) followed by exposure outside (44%). Characterized gaps in protection are outdoor exposure as well as exposure indoors–when awake, and when asleep and not using ITNs. Interestingly, in the primary trial, even though there was not a significant impact of the spatial repellent on vector biting rates by themselves (16%), when factoring in human behavior, there was approximately 28% less exposure in the intervention arm than in the placebo arm. The treated arm had less human behavior adjusted bites in all spaces evaluated though there was proportionally higher exposure indoors. This analysis points to the importance of using HBOs both towards understanding gaps in protection as well as how interventions are evaluated. To mitigate ongoing transmission, understanding context specific spatial and temporal exposure based on the interactions of vectors, humans and interventions would be vital for a directed evidence-based control or elimination strategy.

60 APPLIED LIFE SCIENCES↗

DOE OSTI2024

Efficacy of commercial recombinant HVT vaccines against a North American clade 2.3.4.4b H5N1 highly pathogenic avian influenza virus in chickens

The outbreak of clade 2.3.4.4b H5 highly pathogenic avian influenza (HPAI) in North America that started in 2021 has increased interest in applying vaccination as a strategy to help control and prevent the disease in poultry. Two commercially available vaccines based on the recombinant herpes virus of turkeys (rHVT) vector were tested against a recent North American clade 2.3.4.4b H5 HPAI virus isolate: A/turkey/Indiana/22-003707-003/2022 H5N1 in specific pathogen free white leghorn (WL) chickens and commercial broiler chickens. One rHVT-H5 vaccine encodes a hemagglutinin (HA) gene designed by the computationally optimized broadly reactive antigen method (COBRA-HVT vaccine). The other encodes an HA gene of a clade 2.2 virus (2.2-HVT vaccine). There was 100% survival of both chicken types COBRA-HVT vaccinated groups and in the 2.2-HVT vaccinated groups there was 94.8% and 90% survival of the WL and broilers respectively. Compared to the 2.2-HVT vaccinated groups, WL in the COBRA-HVT vaccinated group shed significantly lower mean viral titers by the cloacal route and broilers shed significantly lower titers by the oropharyngeal route than broilers. Virus titers detected in oral and cloacal swabs were otherwise similar among both vaccine groups and chicken types. To assess antibody-based tests to identify birds that have been infected after vaccination (DIVA-VI), sera collected after the challenge were tested with enzyme-linked lectin assay-neuraminidase inhibition (ELLA-NI) for N1 neuraminidase antibody detection and by commercial ELISA for detection of antibodies to the NP protein. As early as 7 days post challenge (DPC) 100% of the chickens were positive by ELLA-NI. ELISA was less sensitive with a maximum of 75% positive at 10DPC in broilers vaccinated with 2.2-HVT. Both vaccines provided protection from challenge to both types of chickens and ELLA-NI was sensitive at identifying antibodies to the challenge virus therefore should be evaluated further for DIVA-VI.

60 APPLIED LIFE SCIENCES↗

DOE OSTI2026

Predicting initial trans-membrane pressure across cycles in the ultrafiltration process using random forest

With growing freshwater scarcity, direct potable reuse (DPR) systems that reclaim wastewater for drinking are becoming increasingly important for sustainable water supply. Reliable operation requires minimizing downtime in ultrafiltration (UF) units, where membrane fouling leads to elevated trans-membrane pressure (TMP). This study develops data-driven regression models based on random forest (RF) and autoregressive (AR) approaches to forecast the initial TMP at the start of each UF filtration cycle in a pilot-scale DPR system. The RF model consistently outperforms baseline methods, including historical mean, last observation carried forward, and AR models, across multiple forecast horizons, achieving the lowest root mean square error. To evaluate how different classes of process variables contribute to TMP dynamics over time, we examine the feature importance of independent input variables across multiple forecast horizons. This analysis provides insight into the temporal relevance of operational and sensor-derived features, guiding control and monitoring strategies. Additionally, the impact of hyperparameter tuning on TMP prediction performance is assessed for both direct and recursive RF modelling approaches. The proposed RF framework establishes a robust foundation for predictive monitoring and real-time optimization of UF operations, supporting sustainable and reliable water reuse.

direct potable reuse↗

DOE OSTI2026

Carbon Capture Pilot at Vicksburg Containerboard Mill (Final Technical Report)

This is the final technical report for the DOE-OCED project DE-CD0000051. The report provides the progress at the close of the project. The objective of the project is to design and build a large pilot plant for carbon dioxide (CO 2 ) capture from a pulp and paper (P&P) mill using RTI’s non-aqueous solvent (NAS) technology at a capacity of 120,000 t-CO 2 /year, with >90% CO 2 captured. The pilot plant will be used for testing and evaluating the NAS capture process using real flue gas from the P&P mill’s power boiler for a minimum of 1 year of parametric testing and a minimum of 2,000 hours of continuous long-term testing. The testing will provide data for process optimization and scale-up for the P&P industry, provide information on interaction of flue gas contaminants on solvent performance and degradation, and inform strategies for emission control. At the end of the project, the pilot plant will be managed by International Paper (IP), the host site owner, which will continue to capture CO 2 , sequester the captured CO 2 , and be eligible for the 45Q credit.

42 ENGINEERING↗

DOE OSTI2026

Optical-Gating of Spin-based Quantum States (Final Report)

This project developed a generalizable strategy for optical control of spin-based quantum states through the Photoisomerization-Induced Spin–Charge Excited State (PISCES) process, in which a photochromic spirooxazine ligand bound to an electronically bistable metal complex enables reversible, room-temperature optical switching of spin states in both dilute matrices and the solid state. A multidisciplinary team integrated synthesis, spectroscopy, theory, and surface science to establish design principles for opto-spintronic quantum materials. Systematic structure–property studies across four spirooxazine series revealed that donor–π–acceptor interactions govern thermal isomerization, which proceeds via a rotational pathway. Pulsed EPR measurements demonstrated millisecond-scale coherence times in cobalt-dioxolene-spirooxazine complexes, establishing their promise as optically addressable molecular qubits; the approach was extended to Cu(II), Ni(II), and lanthanide complexes, including optical modulation of zero-field splittings and clock transitions. Two-dimensional IR spectroscopy resolved picosecond ground-state population exchange dynamics, while ab initio calculations elucidated photoisomerization mechanisms and parametrized Hamiltonians for spin relaxation and decoherence. Toward device integration, the team fabricated 2D polymer scaffolds for covalent qubit organization, developed tip-enhanced Raman imaging of molecular monolayers, and demonstrated optical gating of gate voltage in spirooxazine-graphene field-effect transistors. The project produced numerous publications, dissertations, and presentations, and trained over 30 researchers.

2D polymers↗

DOE OSTI2024

Analyzing the Effects of Atmospheric Turbulent Fluctuations on the Wake Structure of Wind Turbines and Their Blade Vibrational Dynamics

In recent trends, a rising demand for renewable energy has driven wind turbines to larger proportions, where lighter blade designs are often adopted to reduce the costs associated with logistics and production. This causes modern utility-scale wind turbine blades to be inherently more flexible, and their amplified aeroelastic sensitivity results in complex multi-physics reactions to variant atmospheric conditions, including dynamic patterns of aerodynamic loading at the rotor and vortex structure evolutions within the wake. In this paper, we analyze the influence of inflow variance for wind turbines with large, flexible rotors through simulations of the National Rotor Testbed (NRT) turbine, located at Sandia National Labs’ Scaled Wind Farm Technology (SWiFT) facility in Lubbock, Texas. The Common Ordinary Differential Equation Framework (CODEF) modeling suite is used to simulate wind turbine aeroelastic oscillatory behavior and wind farm vortex wake interactions for a range of flexible NRT blade variations, operating in differing conditions of variant atmospheric flow. CODEF solutions of turbine operation in Steady-In-The-Average (SITA) wind conditions are compared to SITA wind conditions featuring a controlled gust-like pulse overimposed, to isolate the effects of typical wind fluctuations. Finally, simulations of realistic time-varying wind conditions from SWiFT meteorological tower measurements are compared to the solutions of SITA wind conditions. These increasingly complex atmospheric inflow variations are tested to show the differing effects evoked by various patterns of spatiotemporal atmospheric flow fluctuations. An analysis is presented for solutions of wind turbine aeroelastic response and vortex wake evolution, to elucidate the consequences of variant inflow, which pertain to wind turbine dynamics at an individual and farm-collective scale. The comparisons of simulated farm flow for SITA and measured fluctuating wind conditions show that certain regions of the wake contain up to a 12% difference in normalized axial velocity, due to the introduction of wind fluctuations. The findings of this study prove valuable for practical applications in wind farm control and optimization strategies, with particular significance for modern utility-scale wind power plants operating in variant atmospheric conditions.

Farrell, Alayna (ORCID:000000023555720X)↗

DOE OSTI2020

Portable Rabies Virus Sequencing in Canine Rabies Endemic Countries Using the Oxford Nanopore MinION

As countries with endemic canine rabies progress towards elimination by 2030, it will become necessary to employ techniques to help plan, monitor, and confirm canine rabies elimination. Sequencing can provide critical information to inform control and vaccination strategies by identifying genetically distinct virus variants that may have different host reservoir species or geographic distributions. However, many rabies testing laboratories lack the resources or expertise for sequencing, especially in remote or rural areas where human rabies deaths are highest. We developed a low-cost, high throughput rabies virus sequencing method using the Oxford Nanopore MinION portable sequencer. A total of 259 sequences were generated from diverse rabies virus isolates in public health laboratories lacking rabies virus sequencing capacity in Guatemala, India, Kenya, and Vietnam. Phylogenetic analysis provided valuable insight into rabies virus diversity and distribution in these countries and identified a new rabies virus lineage in Kenya, the first published canine rabies virus sequence from Guatemala, evidence of rabies spread across an international border in Vietnam, and importation of a rabid dog into a state working to become rabies-free in India. Taken together, our evaluation highlights the MinION’s potential for low-cost, high volume sequencing of pathogens in locations with limited resources.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2023

Design of a Continuous Electrochemical Purification Reactor for Corrosion Mitigation in Molten Chloride Salt Systems

The utility of molten chloride salts in concentrating solar power (CSP) is dependent on the ability to maintain low corrosive impurities. Without proper purification, the corrosion rates of containment alloys exceed the industry standard of corrosion—under 20 μm/year. An extensive body of literature focuses on the initial purification stage of molten chloride salts. However, occurrences such as maintenance, leaks, and so forth expose the salt to the atmosphere and reintroduce impurities. Therefore, it is critical to develop a purification strategy that can control impurity levels during CSP plant operation. Here we present the design and fabrication of a purification vessel to continuously remove impurities out of flowing molten salt.

Witteman, Liam↗

DOE OSTI2025

Predicting Initial Trans-Membrane Pressure for Optimized Operations in UF Unit Using Random Forest

With the growing scarcity of freshwater, innovative process design mechanisms like Reverse Osmosis (RO) are increasingly gaining attention among water treatment utilities to address the rising demand. Ensuring reliable water production necessitates efficient resource utilization, minimizing downtime in (ultra-filtration) UF systems. Recent advancements in machine learning (ML) have enabled the development of accurate data-driven models for Model Predictive Control (MPC), often requiring minimal prior knowledge of underlying physical processes. In this study, we present predictive regression models based on Random Forest (RF) and Auto-Regressive (AR) approaches to forecast the initial Trans-Membrane Pressure (TMP) for each filtration cycle in data generated by Direct Potable Reuse (DPR) systems. The proposed RF-based model demonstrates superior performance compared to baseline methods, including historical mean, Last Observation Carried Forward (LOCF), and naïve AR models, across various forecasting horizons in terms of root mean square error (RMSE) metric. To evaluate how different classes of process variables contribute to TMP dynamics over time, we examine the feature importance of independent covariates across multiple forecast horizons. This analysis provides insight into the temporal relevance of operational and sensor-derived features, guiding control and monitoring strategies. Additionally, the impact of hyperparameter tuning on TMP prediction performance is studied for both direct and recursive RF modelling approaches across increasing forecast horizons. Accurate prediction of initial TMP is critical for optimizing RO operations, as it enables the development of robust modelling frameworks by accurately estimating membrane fouling trends, thereby enhancing process efficiency and long-term reliability. The demonstrated efficacy of the RF-based approach highlights its potential as a tool for real-time decision-making in water treatment systems, paving the way for advanced process optimization and sustainable water resource management.

Mukherjee, Subrata [ORNL] (ORCID:0000000309930338)↗

DOE OSTI2023

Protecting and Defending against Autonomous Control Systems and Digital Twin Cyber Attacks: Response Strategy for Hyperparameter attacks of Digital Twin Machine Learning Models in Nuclear Power Plants (Final)

Navigating through the complex tapestry of technological advancements, "Response Strategy for Hyperparameter attacks of Digital Twin Machine Learning Model in Nuclear Power Plants" stands at the intersection of cybersecurity and nuclear power plant operations, embarking on a journey through the intricacies of securing digital twins against malicious cyber activities. As nuclear power plants progressively integrate digital twin technology and machine learning models to optimize operations and ensure system reliability, they inadvertently expose themselves to a new spectrum of vulnerabilities, notably in the realm of hyperparameter attacks. Hyperparameters, integral in machine learning model tuning and optimal performance of digital twins, have emerged as a target for adversaries aiming to destabilize the predictive capabilities and therefore, the operational accuracy of these digital entities within critical infrastructures like nuclear plants. This paper, therefore, meticulously threads the needle through the development of a robust response strategy, poised to shield these digital reflections against calculated hyperparameter manipulations, ensuring that the digital twin can effectively and securely function as a reliable proxy for its physical counterpart. The ensuing sections delve into the orchestrated maelstrom of multi-rate time-changing intelligent coordinated hyperparameter attacks and the implementation of event-triggered predictive control, laying down a structured, predictive, and responsive framework that safeguards the nexus where the digital and physical realms of nuclear power plants coalesce. The operational integrity of digital twins in nuclear power plants depends critically on the security of machine learning hyperparameters. This study makes two different contributions. First, a decision-based idea known as a multi-rate time changing intelligent coordinated hyperparameter attack is put forth. In this attack, many hyperparameters are repeatedly changed using both random and intelligent optimal techniques by the attacker. These assaults introduce varied rates at different attack steps, compromise various amounts of hyperparameters, and improve stealth and flexibility. Second, a technique is developed for event triggered predictive control to rapidly respond to potential hyperparameter attacks. This control integrates a sliding window framework, retaining a history of previous data points and employing linear regression to predict the next data point from the current dataset. The control gain K is determined using the Lyapunov-Krasovskii method, and subsequently, an action is developed. Finally, the outcome of the simulation demonstrates the viability of the proposed method for defending nuclear power plant digital twins from hyperparameter attacks.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2022

Reconfiguring band-edge states and charge distribution of organic semiconductor–incorporated 2D perovskites via pressure gating

Two-dimensional (2D) semiconductor heterostructures are key building blocks for many electronic and optoelectronic devices. Reconfiguring the band-edge states and modulating their interplay with charge carriers at the interface in a continuous manner have long been sought yet are challenging. Here, using organic semiconductor–incorporated 2D halide perovskites as the model system, we realize the manipulation of band-edge states and charge distribution via mechanical—rather than chemical or thermal—regulation. Compression induces band-alignment switching and charge redistribution due to the different pressure responses of organic and inorganic building blocks, giving controllable emission properties of 2D perovskites. We propose and demonstrate a “pressure gating” strategy that enables the control of multiple emission states within a single material. We also reveal that band-alignment transition at the organic-inorganic interface is intrinsically not well resolved at room temperature owing to the thermally activated transfer and shuffling of band-edge carriers. This work provides important fundamental insights into the energetics and carrier dynamics of hybrid semiconductor heterostructures.

42 ENGINEERING↗

DOE OSTI2026

Adaptive Control for Load-Following of Boiling Water Reactors Part I: Linear Systems and Fully-Observable Dynamics

Automation control is a key strategy to improve the economic competitiveness of nuclear power plants. Not only does it help reduce operational costs, but it also extends the value proposition of these plants to nontraditional markets, including unattended operations in remote villages and space. However, the dynamics of the operating environments of nuclear reactors are subject to changes over time, and there are no widely adopted methods to ensure that the automation strategy will remain effective over the extended durations required for these applications. Adaptive control is a discipline that offers the possibility to accommodate such changes online. However, it relies on mathematical assumptions that must be respected to ensure robustness and reliability. In this work, we derive an adaptive control formulation for linear systems in which all states are observable and apply it to an instance of load-follow operation for Boiling Water Reactors. We assumed uncertainty in two factors: the temperature coefficient and the control rod worth, both of which are affected over time by the evolution of the nuclear reactor core environment. With an arbitrary penalty factor of 5, we found that the mean absolute and integral time absolute errors can be reduced by more than 90%, underscoring the strength of adaptive control. To extend the application to more challenges, different uncertainties and load-follow trajectories, as well as new formulations that include non-linearity and partial observability, are currently being developed.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2022

Optimizing conformance control for gas injection EOR in unconventional reservoirs

Field observations have shown that interference between wells caused by connected fractures commonly exists in unconventional reservoirs. The well interference effect and conformance issues could lead to minimal enhanced oil recovery response (EOR) in actual operations if they are not properly controlled. A series of data analysis, modeling, and experimental activities were performed in this study to investigate the gas EOR strategies in the Bakken Formation. Employing the embedded discrete fracture modeling technology, a multiple-well, multiple-fracture model was developed to capture the well interference and conformance issues in the Bakken. The model made it possible to investigate the complex flow behavior between wells in the EOR (huff ‘n’ puff) processes. Alternative EOR and conformance control strategies using water and surfactant injections were studied to improve oil production performance based on experimental observations. Results showed that water injection could be used for conformance control in the Bakken because of its relatively low mobility compared to gas; however, water could also block oil flow around the conformance control wells because of the high interfacial tension between oil and water. Adding surfactant to the injection water is more effective for improving gas EOR performance since surfactant reduces the oil–water interfacial tension and contact angle effectively. Up to 9.4% more oil could be produced from the huff ‘n’ puff wells in 2 years of EOR operations when rich gas was injected at only 3 MMscf/d with 6000 psi of surfactant injection in the offset wells for conformance control.

42 ENGINEERING↗

DOE OSTI2020

Random Polymerization Strategy Leads to a Family of Donor Polymers Enabling Well‐Controlled Morphology and Multiple Cases of High‐Performance Organic Solar Cells

Abstract Developing high‐performance donor polymers is important for nonfullerene organic solar cells (NF‐OSCs), as state‐of‐the‐art nonfullerene acceptors can only perform well if they are coupled with a matching donor with suitable energy levels. However, there are very limited choices of donor polymers for NF‐OSCs, and the most commonly used ones are polymers named PM6 and PM7, which suffer from several problems. First, the performance of these polymers (particularly PM7) relies on precise control of their molecular weights. Also, their optimal morphology is extremely sensitive to any structural modification. In this work, a family of donor polymers is developed based on a random polymerization strategy. These polymers can achieve well‐controlled morphology and high‐performance with a variety of chemical structures and molecular weights. The polymer donors are D–A1–D–A2‐type random copolymers in which the D and A1 units are monomers originating from PM6 or PM7, while the A2 unit comprises an electron‐deficient core flanked by two thiophene rings with branched alkyl chains. Consequently, multiple cases of highly efficient NF‐OSCs are achieved with efficiencies between 16.0% and 17.1%. As the electron‐deficient cores can be changed to many other structural units, the strategy can easily expand the choices of high‐performance donor polymers for NF‐OSCs.

Liang, Jiaen↗

DOE OSTI2024

Carl T. Hayden Veterans Affairs Medical Center: Smart Buildings Case Study

The purpose of this smart buildings case study is to showcase a leading example of a GEB renovation project in the federal buildings space and provide key information on the technology and control upgrades, costs, and energy and utility bill savings. This case study also provides information and recommendations for selecting energy conservation measures (ECMs) and choosing energy and cost reduction strategies from the energy management team at the site. The findings from this successful GEB project can be used to help pave the way for additional GEB retrofits in the future. The Carl T. Hayden Veterans Affairs (VA) Medical Center in Phoenix, Arizona, demonstrates that GEB strategies and technologies can be realistically deployed today across buildings with substantial energy and cost savings. The project implemented both ECMs and grid-interactive technologies and controls strategies, making it a leading example of a smart, sustainable, and efficient commercial building.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2021

Deep reinforcement learning for dynamic control of fuel injection timing in multi-pulse compression ignition engines

Conventional compression-ignition (CI) engines have long offered high thermal efficiencies and torque across a wide range of loads, but often require extensive exhaust gas treatment that decreases efficiency to meet ever-increasing emissions regulations. One strategy to decrease emissions is to split the fuel injection into a series of smaller injections. In this paper, we explore a new way of discovering optimal control strategies for the next generation of CI engines using deep reinforcement learning (DRL). We outline a DRL procedure to maximize the weighted reward of engine work while minimizing end-of-cycle NO x emissions. Through the procedure outlined in this paper, we show that the DRL agent is able to reduce NO x emissions threefold while only decreasing network by 2%. We demonstrate the use of transfer learning (TL) across hierarchies of physical models to accelerate the learning process, making this approach feasible for a range of control problems within this space. This paper presents a framework and demonstration for using DRL to design control systems in technology areas such as multi-pulse engine control where a hierarchy of models combined with multi-objective rewards are used for optimal operation.

33 ADVANCED PROPULSION SYSTEMS↗