Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “control framework”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 739 records · Page 41
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

A mesoscopic digital twin that bridges length and time scales for control of additively manufactured metal microstructures

We present our recent development of an integrated mesoscale digital twin (DT) framework for relating processing conditions, microstructures, and mechanical responses of additively manufactured (AM) metals. In particular, focusing on the laser powder bed fusion technique, we describe how individual modeling and simulation capabilities are coupled to investigate and control AM microstructural features at multiple length and time scales. We review our prior case studies that demonstrate the integrated modeling schemes, in which high-fidelity melt pool dynamics simulations provide accurate local thermal profiles and histories to subsequent AM microstructure simulations. We also report our new mechanical response modeling results for predicted AM microstructures. In addition, we illustrate how our DT framework has been validated through modeling–experiment integration, as well as how it has been practically utilized to guide and analyze AM experiments. Finally, we share our perspectives on future directions of further development of the DT framework for more efficient, accurate predictions and wider ranges of applications.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Reinforcement Learning-Based Oscillation Dampening: Scaling Up Single-Agent Reinforcement Learning Algorithms to a 100-Autonomous-Vehicle Highway Field Operational Test

In this article, we explore the technical details of the reinforcement learning (RL) algorithms that were deployed in the largest field test of automated vehicles designed to smooth traffic flow in history as of 2023, uncovering the challenges and breakthroughs that come with developing RL controllers for automated vehicles. We delve into the fundamental concepts behind RL algorithms and their application in the context of self-driving cars, discussing the developmental process from simulation to deployment in detail, from designing simulators to reward function shaping. We present the results in both simulation and deployment, discussing the flow-smoothing benefits of the RL controller. From understanding the basics of Markov decision processes to exploring advanced techniques such as deep RL, our article offers a comprehensive overview and deep dive of the theoretical foundations and practical implementations driving this rapidly evolving field. We also showcase real-world case studies and alternative research projects that highlight the impact of RL controllers in revolutionizing autonomous driving. From tackling complex urban environments to dealing with unpredictable traffic scenarios, these intelligent controllers are pushing the boundaries of what automated vehicles can achieve. Furthermore, we examine the safety considerations and hardware-focused technical details surrounding deployment of RL controllers into automated vehicles. As these algorithms learn and evolve through interactions with the environment, ensuring their behavior aligns with safety standards becomes crucial. Here, we explore the methodologies and frameworks being developed to address these challenges, emphasizing the importance of building reliable control systems for automated vehicles.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2026

Field-Coupled Water Splitting with Metal-Free Donor–Acceptor Covalent Organic-Framework Junctions

Advancing metal-free electrocatalysts for hydrogen and oxygen evolution reactions (HER/OER) across acidic and alkaline media requires coordinated control of intermediate binding thermodynamics, interfacial charge delivery, and near-electrode transport dynamics. Here, we design amide-linked benzene–triazine covalent organic frameworks (BTA/TzTA-Hz COFs) and integrate them with carbon nanotubes (CNTs) to form COF–CNT junctions that establish a built-in interfacial electric field. Density functional theory (DFT) and electrostatic potential maps indicate complementary active motifs, with benzene-proximal fragments associated with HER and triazine-proximal motifs associated with OER. CNT integration shifts the contact-potential difference by ≈0.20 V, while operando electrochemical impedance spectroscopy suggests partially separable high-frequency junction-charging and lower-frequency Faradaic/transport responses. A 300 mT static magnetic field lowers the HER and OER overpotentials by tens of millivolts. Under anodic bias, the effective interfacial charging capacitance increases, and Mott–Schottky analysis shows an apparent ∼0.15 V flat-band shift with an essentially unchanged slope. Together, these observations are consistent with field-perturbed interfacial charging and altered bias partitioning. Field-dependent impedance and bubble imaging are consistent with magnetohydrodynamic convection that promotes bubble detachment and near-electrode mass transport for both half-reactions, and they reveal an OER-specific high-frequency perturbation under anodic bias. Under field, the heterostructure reaches an OER onset overpotential of ∼261 mV and requires an overpotential of 366 mV at 10 mA cm –2 in alkaline electrolyte. These results illustrate how reticular-framework chemistry, junction engineering, and both built-in and applied fields can program reactivity through interfacial electrostatics and near-electrode transport in organic-framework electrocatalysts.

Garcia-Enriquez, Lissette [Univ. of Texas at El Pa↗
DOE OSTI2022

Ionic liquids for carbon capture

This article covers cutting-edge research in ionic liquid-based materials and their impact on carbon capture. Ionic liquids boast high thermal stability, low vapor pressure, and great tunability. They can be deployed as either sorbents or supported liquid membranes for carbon capture and other gas separations. Absorption of CO 2 in ionic liquids can be achieved via physisorption or chemisorption, depending on the strength of the interaction. For physisorption, both CO 2 -anion and cation–anion interactions are important factors in dictating CO 2 solubility. For chemisorption, the reactivity with CO 2 can be tuned by the basicity of the anion while the stability of the ionic liquid can be enhanced by controlling the cation. Marrying ionicity of ionic liquids with porosity leads to novel porous ionic liquids that feature unique properties for facilitating gas transport, while interfacing ionic liquids with microporous membranes allow the ions to gate the pores for selective gas transport. Further, composite materials of ionic liquids with crystalline materials such as metal–organic frameworks offer scalable heterogeneous interfaces to promote selectivity. Future opportunities include controlling the interaction with CO 2 and its transport at the charged or electrified interface with the ionic-liquid electric double layer, as well as combining CO 2 capture and conversion with ionic liquids.

36 MATERIALS SCIENCE↗
DOE OSTI2026

Continental-Scale Controls on Hyporheic Respiration Revealed by Knowledge-Guided Machine Learning

Hyporheic zone sediments regulate organic matter turnover and in-stream respiration, yet controls on sediment respiration remain poorly constrained across heterogeneous river networks, limiting prediction of stream metabolism and carbon processing at continental scales. Here, we integrate observations from ~90 river corridors across the United States in the WHONDRS consortium with a knowledge-guided machine learning (KGML) framework that couples thermodynamic rate theory with machine learning to identify dominant controls on hyporheic respiration. Diagnostic analyses show that organic matter concentration and thermodynamic favorability define an upper bound on respiration potential, whereas biological catalytic capacity and physical accessibility jointly govern realized respiration rates through interaction effects. To represent unmeasurable accessibility constraints, we use the mechanistic model as a scaffold for KGML, allowing machine learning to target residual structure not explained by process theory. This hybrid framework improves predictive skill relative to both the mechanistic model alone and fully data-driven models while preserving interpretability. These results indicate that variability in hyporheic respiration is largely mechanistically structured and demonstrate how integrating process theory with explainable AI enhances predictive performance while enabling scalable synthesis of river corridor observations.

Zheng, Jianqiu↗
DOE OSTI2021

Assessing the Accuracy of a Borehole-Controlled Velocity Model of Yucca Flat, Nevada, Using Large-N Seismic Data

The Source Physics Experiment (SPE) aims to improve nuclear test monitoring capabilities through a series of chemical explosions in Yucca Flat within the Nevada National Security Site (NNSS) (Snelson et al., 2013). With geologic data from over 950 boreholes, Yucca Flat has excellent borehole control on stratigraphy. These data were used to create a Geologic Framework Model (GFM) of the basin to aid in the study of seismic wave propagation through the Earth. However, the seismic velocities of the geologic units in the GFM are less well-defined. With the acquisition of five new active source Large-N datasets, we can now quantitatively assess the accuracy of the seismic model previously controlled by borehole data alone.

58 GEOSCIENCES↗
DOE OSTI2020

Conifers depend on established roots during drought: results from a coupled model of carbon allocation and hydraulics

Trees may survive prolonged droughts by shifting water uptake to reliable water sources, but it is unknown if the dominant mechanism involves activating existing roots or growing new roots during drought, or some combination of the two. To gain mechanistic insights on this unknown, a dynamic root-hydraulic modeling framework was developed that set up a feedback between hydraulic controls over carbon allocation and the role of root growth on soil–plant hydraulics. The new model was tested using a 5 yr drought/heat field experiment on an established pi~non-juniper stand with root access to bedrock groundwater. Owing to the high carbon cost per unit root area, modeled trees initialized without adequate bedrock groundwater access experienced potentially lethal declines in water potential, while all of the experimental trees maintained nonlethal water potentials. Simulated trees were unable to grow roots rapidly enough to mediate the hydraulic stress, particularly during warm droughts. Alternatively, modeled trees initiated with root access to bedrock groundwater matched the hydraulics of the experimental trees by increasing their water uptake from bedrock groundwater when soil layers dried out. Therefore, the modeling framework identified a critical mechanism for drought response that required trees to shift water uptake among existing roots rather than growing new roots.

Mackay, D. Scott↗
DOE OSTI2021

Advanced Health Information Technology Analytic Framework and Application to Hazard Detection

Health Information Technology (HIT) aims to improve healthcare outcomes by organizing and analyzing various health-related data. With data accumulating at a staggering rate, the importance of real-time analytics has been increasing dramatically, shifting the focus of informatics from batch processing to streaming analytics. HIT is also facing unprecedented challenges in adapting to this new requirement and leveraging advanced IT technologies. This paper introduces a HIT data and compute platform that supports multi-granularity real-time analytics from heterogeneous data sources. The paper first identifies functional requirements and proposes a framework that satisfies the requirements using state-of-the-art big data technologies including Apache Kafka, Spark Structured Streaming Engine, and Delta Lake. To demonstrate its capability to support data analytics in multiple time granularities analytics, a statistical process control-based hazard detection algorithm has been implemented on top of the framework to detect unexpected hazards from order cancellation data of the Department of US Veterans Affairs (VA) in near real-time.

Kumar, Mohit↗
DOE OSTI2025

Advanced Reactor Safeguards & Security Program: Cybersecurity Scenarios

The use of digital control systems and automation in advanced nuclear power systems introduces different types of vulnerabilities compared to legacy (i.e. analog) control systems that cyber adversaries can exploit. These vulnerabilities pose a challenge to reactor operators and cyber operations staff due to the dynamic nature of the event in which a human response or a lack of response can potentially evolve into a worsening plant condition. Using the Department of Homeland Security Cyber and Infrastructure Security Agency’s (CISA) critical infrastructure exercise framework, this document presents several cyber security scenarios typical of digital control systems that could be used in advanced reactor designs. These scenarios can be used in tabletop exercises to evaluate cyber security posture or conduct training on different aspects of cyber security, including detection, threat hunting using indicators of compromise, evaluating incident response, risk mitigation, incident reporting, information sharing and recovery.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2026

From observation to replication: machine-learning-driven quantification and replication of fine-scale fish kinematics and behavior

Long-term quantification of fish behavior is essential for aquatic ecology, wildlife telemetry, and biomechanical device development. However, the observation duration required to obtain reliable behavioral and kinematic metrics remains unclear, and few tools exist to physically reproduce natural swimming motion for controlled experimentation. We address these challenges by developing a generalizable framework that models behavioral reliability (Spearman–Brown reliability index) as a function of observation duration and derives metric-specific monitoring thresholds. Using juvenile white sturgeon (Acipenser transmontanus) as a case study, we demonstrate that the minimum duration needed for reliable estimates varies substantially across kinematic features: to exceed a reliability of 0.8, total distance traveled requires 12 days, average curvature (mm?¹) 15 days, tail-beat frequency (Hz) 8 days, and average speed (body length/s) 17 days. We further bridge digital analysis and physical testing by developing a hardware-in-the-loop simulator that reconstructs machine-learning-derived swimming kinematics with high fidelity (correlation coefficient 0.98–0.99, RMSE 1.22–1.27 mm over a 5-minute segment). This platform enables realistic, repeatable motion stimuli for evaluating aquatic sensing technologies and bio-integrated devices under controlled conditions. Together, these contributions provide a scalable approach for designing long-term behavioral studies and a data-driven connection between ecological observation and robotic experimentation.

Hwang, SungJoo↗
DOE OSTI2024

Programmable Heisenberg interactions between Floquet qubits

Abstract The trade-off between robustness and tunability is a central challenge in the pursuit of quantum simulation and fault-tolerant quantum computation. In particular, quantum architectures are often designed to achieve high coherence at the expense of tunability. Many current qubit designs have fixed energy levels and consequently limited types of controllable interactions. Here by adiabatically transforming fixed-frequency superconducting circuits into modifiable Floquet qubits, we demonstrate an XXZ Heisenberg interaction with fully adjustable anisotropy. This interaction model can act as the primitive for an expressive set of quantum operations, but is also the basis for quantum simulations of spin systems. To illustrate the robustness and versatility of our Floquet protocol, we tailor the Heisenberg Hamiltonian and implement two-qubit iSWAP, CZ and SWAP gates with good estimated fidelities. In addition, we implement a Heisenberg interaction between higher energy levels and employ it to construct a three-qubit CCZ gate, also with a competitive fidelity. Our protocol applies to multiple fixed-frequency high-coherence platforms, providing a collection of interactions for high-performance quantum information processing. It also establishes the potential of the Floquet framework as a tool for exploring quantum electrodynamics and optimal control.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2023

Demonstrate FARM supervisory capabilities for a thermal energy storage problem for the DETAIL facility: IES Simulation Ecosystem Control System Development

The goal of the power dispatch problem for an Integrated Energy System (IES) is to adjust the power output and the heat flow of each component to maximize the profitability of the whole unit. Facilities that can integrate real-time digital signals, mock nuclear power, thermal energy storage and industrial heat use via high-temperature electrolysis were constructed at INL to support the research activities. The Dynamic Energy Technology and Integration Laboratory (DETAIL) houses the Microreactor Agile Non-nuclear Experimental Test Bed (MAGNET) and the Thermal Energy Distribution System (TEDS). In this report, the hierarchical control system architecture proposed in June 2023 milestone for the flexible operation of DETAIL facility is finalized and demonstrated. A brief description of the components and the corresponding Dymola models from the HYRBID repository is first provided. Then, the current control strategy is presented. In particular, the approach for generating the set-point trajectories to be fed to the PI controllers is analyzed, and its limits were identified. To preserve safe operation over both long-time and real-time horizons, the integration of a Supervisory Control layer embedding a modified version of FARM (Feasible Actuator Range Modifier) module is proposed. FARM is a component of the RAVEN-based FORCE framework designed to support HERON module at optimizing the operation of IES units. The proposed control system for DETAIL foresees FARM to be applied twice, i.e., the original version (“FARM-Validator”) aiding the solution of the power dispatch problem, and a modified version (“FARM-Supervisory”) coordinating the PID controllers. Despite the kernel of the two modules is the same, their tasks are quite different. The former intervenes at the beginning of each hour to prevent constraint violations over long time periods, the latter addresses real-time control tasks and monitors the response of constrained variables at a much finer time resolution. A tentative procedure for training the embedded Digital Twins with the experimental data is also proposed. Finally, the capabilities of the designed architecture and the impact of the added Supervisory Control layer are demonstrated by simulating a representative power dispatch scenario.

25 ENERGY STORAGE↗
DOE OSTI2024

Non-Stationary Policy Learning for Multi-Timescale Multi-Agent Reinforcement Learning

In multi-timescale multi-agent reinforcement learning (MARL), agents interact across different timescales. In general, policies for time-dependent behaviors, such as those induced by multiple timescales, are non-stationary. Learning non-stationary policies is challenging and typically requires sophisticated or inefficient algorithms. Motivated by the prevalence of this control problem in real-world complex systems, we introduce a simple framework for learning non-stationary policies for multi-timescale MARL. Our approach uses available information about agent timescales to define and learn periodic multi-agent policies. In detail, we theoretically demonstrate that the effects of non-stationarity introduced by multiple timescales can be learned by a periodic multi-agent policy. To learn such policies, we propose a policy gradient algorithm that parameterizes the actor and critic with phase-functioned neural networks, which provide an inductive bias for periodicity. The framework's ability to effectively learn multi-timescale policies is validated on a gridworld and building energy management environment.

control↗
DOE OSTI2021

Structural Insights into the Mechanisms and Pharmacology of K 2P Potassium Channels

Leak currents, defined as voltage and time independent flows of ions across cell membranes, are central to cellular electrical excitability control. The K 2P (KCNK) potassium channel class comprises an ion channel family that produces potassium leak currents that oppose excitation and stabilize the resting membrane potential in cells in the brain, cardiovascular system, immune system, and sensory organs. Due to their widespread tissue distribution, K 2P s contribute to many physiological and pathophysiological processes including anesthesia, pain, arrythmias, ischemia, hypertension, migraine, intraocular pressure regulation, and lung injury responses. Structural studies of six homomeric K 2P s have established the basic architecture of this channel family, revealed key moving parts involved in K 2P function, uncovered the importance of asymmetric pinching and dilation motions in the K 2P selectivity filter (SF) C-type gate, and defined two K 2P structural classes based on the absence or presence of an intracellular gate. Further, a series of structures characterizing K 2P :modulator interactions have revealed a striking polysite pharmacology housed within a relatively modestly sized (~70 kDa) channel. Binding sites for small molecules or lipids that control channel function are found at every layer of the channel structure, starting from its extracellular side through the portion that interacts with the membrane bilayer inner leaflet. This framework provides the basis for understanding how gating cues sensed by different channel parts control function and how small molecules and lipids modulate K 2P activity. Such knowledge should catalyze development of new K 2P modulators to probe function and treat a wide range of disorders.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

Cost-optimal selection of pH control for mineral scaling prevention in high recovery reverse osmosis desalination

Conference proceedings for Foundations of Computer Aided Process Design (FOCAPD) 2024 that details a cost optimization model for pH control to prevent mineral scaling in high recovery reverse osmosis. This work applies a framework for incorporating detailed water chemistry predictions such as precipitation, pH change, and mineral scaling tendencies with process-scale optimization. It demonstrates that the acid choice for pH control can have a significant impact on pretreatment costs.

Amusat, Oluwamayowa↗
DOE OSTI2024

Final Technical Report

The capture of CO2 and its simultaneously conversion to useful chemical fuels driven by solar energy represents one of the best solutions to resolve our growing energy and environmental concerns. The most critical challenge to this endeavor is the rational design of a photocatalytic architecture that can effectively couple a given photosensitizer (PS) with an appropriate catalyst, thereby enabling efficient photosensitization of a multi-electron reduction catalysis. This research program aims to address this challenge using an interdisciplinary approach that combines innovative material design and synthesis, fundamental mechanistic studies, and photocatalytic performance evaluation. The strategies include 1) constructing and investigating a novel class of 2D COF hybrid photocatalysts with an effective photoactive organic building block as PS and a precisely incorporated CO2 reduction molecular catalyst (MC); and 2) mechanistic origins of CO2 photoreduction using a set of complementary time-resolved and in situ spectroscopic techniques. The novelty of the proposed hybrid system lies in the unprecedented combination of the unique advantage of porous crystalline COF PS with the precise catalytic function of MC for photocatalytic CO2 reduction. In the periods of the support (09/01/2019-12/31/2022), we have made research progress in four projects: 1) Exploring 2D COFs with incorporated Mn complex for light driven CO2 reduction; 2) The dependence of excited state and charge transfer dynamics on monomer structure of 2D COFs; and 3) Control over Charge Separation by Imine Structural Isomerization in Covalent Organic Frameworks with Implications on CO2 Photoreduction; and 4) The impact of monomer structure on the photoluminescence properties of COFs. We found that both monomer structure and linker chemistry can effectively impact the excited state dynamics, charge transfer properties, and photoluminescence quantum yields, the important properties that dictate their applications in photocatalysis. In addition, we found that the direction of imine linker determines charge transfer direction and thus controls the types of catalytic reactions (e.g. water oxidation or CO2 reduction reactions). The result from these fundamental studies provides important information for correlating the structure of the COF photocatalysts with their photophysical properties and catalytic functions, paving the way for their novel application in photocatalysis. We expect that our findings will contribute to addressing current shortcomings of semiconductor- and molecular-based photocatalytic systems that suffer from inefficient light harvesting and charge separation and poor adsorption and activation of reactants. In turn, this research will contribute towards the development of novel photocatalytic systems for CO2 reduction to generate renewable chemical fuels and simultaneously address the problem of mitigating climate change due to CO2 accumulation. In addition, the experimental approaches employed in this research can be easily transferred to other energy technologies and are expected to broadly impact fields involving photocatalysis, optoelectronic devices, and solar energy conversion. The proposed research has also been integrated with educational activities and serve as a basis to raise awareness around the critical issues of global energy production and consumption, and to develop the next generation of solar energy scientists.

14 SOLAR ENERGY↗
DOE OSTI2026

Variational Optical Phase Learning on a Continuous-Variable Quantum Compiler

Quantum process learning is a fundamental primitive that draws inspiration from machine learning with the goal of better studying the dynamics of quantum systems. One approach to quantum process learning is quantum compilation, whereby an analog quantum operation is digitized by compiling it into a series of basic gates. While there has been significant focus on quantum compiling for discrete-variable systems, the continuous-variable (CV) framework has received comparatively less attention. We present an experimental implementation of a CV quantum compiler that uses two-mode squeezed light to learn a Gaussian unitary operation. We demonstrate the compiler by learning a parameterized linear phase unitary through the use of target and control phase unitaries to demonstrate a factor of 5.4 increase in the precision of the phase estimation and a 3.6-fold acceleration in the time-to-solution metric when leveraging quantum resources. We further show how our approach can be extended to higher-dimensional compilation tasks. Our results are enabled by the tunable control of our cost landscape via variable squeezing, thus providing a critical framework to simultaneously increase precision and reduce time-to-solution.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Network-Wide Traffic Signal Control Using Bilinear System Modeling and Adaptive Optimization

This study proposes a new multi-input multi-output optimal bilinear signal control method in which a bilinear dynamic model approximation is used to capture the nonlinear dynamics of the urban traffic networks. With signal green time splits as the control input and traffic delay changes as the output for each intersections in the network, a bilinear system model was developed, which, on the basis of linear system modeling, takes interactions among traffic delays and signal timing splits into consideration. Based on the bilinear system modeling framework, we conducted two steps in each time interval to derive traffic control strategies: (1) we used the normalized least-squared algorithm to estimate system parameters; and (2) we solved an online optimization problem to obtain the updated traffic control inputs for the signal timing that minimizes future traffic delays. We evaluated the proposed method in a microscopic traffic simulation environment (VISSIM) with a 35-intersection network of Bellevue city in Washington. Two different traffic demand patterns: (1) normal traffic demands; and (2) time-varying traffic demands were simulated to compare the performance of different control strategies. Experimental results show that (1) the proposed bilinear system model can better describe traffic system dynamics than linear-model based methods, such as our previously developed linear-quadratic regulator control; and (2) the proposed method outperforms the state-of-the-art signal control strategies, namely the max-pressure and the self-organizing traffic light control methods. We have also shown that the proposed method is applicable to all other possible network layouts and signal controller phasing structures.

42 ENGINEERING↗