Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “hierarchical system development”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Ion Gating in Nanopore Electrode Arrays with Hierarchically Organized pH-Responsive Block Copolymer Membranes

Inspired by biological ion channels, artificial nanopore-based architectures have been developed for smart ion/molecular transport control with potential applications to iontronics and energy conversion. Advances in nanofabrication technology enable simple, versatile construction methods, and post-fabrication functionalization delivers nanochannels with unique ion transport-control attributes. Here, we characterize a pH-responsive, charge-selective dual-gating block copolymer (BCP) membrane composed of polystyrene-b-poly(4-vinylpyridine) (PS 48400 -b-P4VP 21300 ), capable of self-organizing into highly ordered nanocylindrical domains. Because the PS-b-P4VP membrane exhibits pH-dependent structural transitions, it is suitable for designing intelligent pH-gated biomimetic channels, for example, exhibiting on–off transport switching at pH values near the pK a of P4VP with excellent anion permselectivity at pH < pK a . Introducing the BCP membrane onto nanopore electrode arrays (BCP@NEAs) allows the BCP to serve as a pH-responsive gate controlling ion transfer into the NEA nanopores. Such selectively transported and confined ions are detected by using a 100 nm gap dual-ring nanoelectrode structure capable of enhancing current output by efficient redox cycling with an amplification factor >10 2 . In addition, BCP@NEAs exhibit extraordinary pH-gated ion selectivity, resulting in a 3380-fold current difference between anion and cation probes at pH 3.0. Furthermore, this hierarchically organized BCP-gated NEA system can serve as a template for the development of other stimulus-responsive ion gates, for example, those based on temperature and ligand gating, thus exploiting the intrinsic advantages of NEAs, such as enhanced sensitivity based on redox cycling, which may lead to technological applications such as engineered biosensors and iontronic devices.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Transactive Energy System Deployment Over Insecure Communication Links

Here, in this paper, the privacy and security issues associated with the transactive energy system (TES) deployment over insecure communication links are addressed. In particular, it is ensured that 1) individual agents’ bidding information is kept private throughout hierarchical market-based interactions; and 2) any extraneous data injection attack can be quickly and easily detected. An implementation framework is proposed to enable the cryptography-based enhancement of privacy and security for the deployment of any general hierarchical systems including TESs. Under the proposed framework, a unified cryptography-based approach is developed to achieve both privacy and security simultaneously. Specifically, privacy preservation is realized by an enhanced Paillier encryption scheme, where a block design is proposed to significantly improve computational efficiency. Attack detection is further achieved by an enhanced Paillier digital signature scheme, where a stamp-concatenation mechanism is proposed to enable detection of data replace and reorder attacks. Simulation results verify the effectiveness of the proposed cyber-resilient design for transactive energy systems. Note to Practitioners—This paper is motivated by addressing the issues of cyber resiliency for practically deploying transactive energy system (TES) but it is also applicable to the problem of enhancing the privacy and security for any general hierarchical control systems. TES is an emerging control approach that engages energy suppliers and customers through market operations and uses the price to optimally allocate energy resources. While it has been shown to be promising for power system applications, the underlying market-based interactions raise significant concerns of privacy (data leakage) and security (data tampering). However, existing TES works only focus on the coordination mechanism instead of privacy and security issues. This paper proposes a new cryptography-based TES design for practical deployment. Specifically, to protect privacy, individual supply and demand amounts to be exchanged are all encrypted in a particular way such that the original amounts cannot be inferred from the encrypted amounts, while the desired computation for setting the market clearing price can be carried out over the encrypted amounts, thus generating an encrypted result which, when decrypted, matches that of the same computation over the original amounts. To achieve security, for each exchanged data, its sender generates a particular digital signature which is exchanged together with the data. This enables the receiver to automatically detect the integrity by checking whether a mathematical relationship holds for the pair of data and signature. In our future research, we will investigate more challenging scenarios where some suppliers and customers themselves could be corrupted and purposely submit distorted amounts.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

PETSc DMNetwork: A Library for Scalable Network PDE-Based Multiphysics Simulations

We present DMNetwork, a high-level package included in the PETSc library for the simulation of multiphysics phenomena over large-scale networked systems. The library aims at applications that have networked structures such as those in electrical, gas, and water distribution systems. DMNetwork provides data and topology management, parallelization for multiphysics systems over a network, and hierarchical and composable solvers to exploit the problem structure. DMNetwork eases the simulation development cycle by providing the necessary infrastructure through simple abstractions to define and query the network components. This article presents the design of DMNetwork, illustrates its user interface, and demonstrates its ability to solve multiphysics systems, such as an electric circuit, a network of power grid and water subnetworks, and transient hydraulic systems over large networks with more than 2 billion variables on extreme-scale computers using up to 30,000 processors.

extreme-scale computing↗
DOE OSTI2021

Real-time Simulation Framework for Hardware-in-the-Loop Testing of Multi-port Autonomous Reconfigurable Solar Power Plant (MARS)

Multiport autonomous reconfigurable solar power plant (MARS) has been proposed for integrated development of photovoltaic (PV) and energy storage system (ESS) that can connect to high-voltage direct current (HVdc) and alternating current (ac) transmission grid. To de-risk the development of this complex integrated system that consists of hundreds to thousands of power electronics modules, a controller hardware-in-the-loop (cHIL) test setup will be extremely beneficial. The cHIL testing can be used for evaluation of modules as well as the hierarchical control system in MARS. With the unique configuration of power electronics modules in MARS, it becomes necessary to develop custom-designed real-time simulation models in the cHIL setup in absence of off-the-shelf models. In this paper, high-fidelity dynamic model of MARS, control algorithms at the lower level, and required communication algorithms are developed and optimized for real-time performance in the cHIL setup. Real-time experimental results from the cHIL are provided.

Dong, Zerui↗
DOE OSTI2021

A Network-Aware Distributed Energy Resource Aggregation Framework for Flexible, Cost-Optimal, and Resilient Operation

To efficiently use the ubiquitous behind-the-meter distributed energy resources (DERs) in distribution systems for providing grid services, this paper presents a hierarchical control framework for DER optimal aggregation and control. We first develop a convex optimization model to evaluate the DER flexibility, and then use a convex model-predictive-control based approach to dispatch those DERs. The hierarchical control framework consists of a utility controller, community aggregators and multiple home energy management systems. The flexibility of the DERs is evaluated by each controller in the hierarchy such that the resultant flexibility is feasible given its operational domain. Based on the determined flexibility, the hierarchical controllers then compute optimal setpoints for the DERs to help the distribution system regulate node voltages and provide other distribution grid services. Numerical simulations performed on a model of a real distribution feeder in Colorado, using actual DER data in a residential community demonstrate that the proposed approach can effectively alleviate voltage issues and support resilient operation.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

Performance Evaluation of Intelligent Solar Control Software Through Hardware-in-the-Loop (CRADA Final Report)

Recent research has highlighted the potential for solar to act as a zero-marginal-cost and zero-emission flexibility resource on the bulk power system when operated with advanced control systems. To increase the performance of these systems, leading technologies, including machine learning (ML) and hierarchical inverter set point allocation, have been developed by Latimer Controls, Inc. to estimate the headroom of large PV plants for grid operation and control; however, these technologies lack comprehensive validation under real-world application scenarios. Latimer Controls, Inc. received two voucher awards for research at a national laboratory from the Department of Energy American Made Solar Prize Round 6. The National Renewable Energy Laboratory (NREL) was selected to collaborate with Latimer staff to conduct a performance evaluation of Latimer PV control software. The NREL team will develop a hardware-in-the-loop (HIL) testbed to perform testing and validation of the Latimer PV control technology in a de-risked yet realistic testbed environment. Latimer and NREL worked together to analyze the test data, draw conclusions from the results, and disseminate the resulting scientific findings. In this CRADA work, we propose to test and validate the real-world application of the Latimer Control solution in an HIL environment. We evaluate the performance of different flexible solar technologies in responding to automatic generation control signals in a closed-loop fashion. In particular, a data-driven potential high limit (PHL) estimation is developed for large solar plants to accurately estimate their headroom so that they have fast and short-time regulation and control capability to participate in grid services and respond to grid signals in real time (e.g., AGC). This PHL estimation algorithm is embedded in a hardware power plant controller (PPC) and tested with an IEEE-39 bus system model developed in RTDS. To account for the varying cloud conditions and diverse inverter dispatches, we developed a 135-MW PV plant with detailed modeling of 27 individual PV modules and inverters using RTDS. The real-world communications used in such big plants, such as ModBus TCP/IP for inverter level and DNP3 for plant level, were developed to emulate the real-world applications in big PV plants. The ML-based PHL estimation method is tested under nine separate weather scenarios against the ‘reference-control’ solution, hereafter referred to as the baseline solution. The baseline method reserves a subset of inverters (reference group) to operate at their PHL at all times and dispatches only the remaining inverters (control group) at curtailed levels to fulfill the flexibility need. Despite being successfully piloted by NREL in California in 2017 and Chile in 2020, there exist two gaps in the state of the art to fully unlock the flexibility of PV plants: a. There is a trade-off between the PHL estimation accuracy and the flexibility range. b. There lacks granularity in the PHL estimation to capture the variation across inverters. The Latimer solution seeks to address these gaps by applying machine learning methods to improve PHL estimation accuracy while accounting for variability at every inverter. Performance metrics were taken from the 2023 Georgia Power CARES utility-scale RFP. The results demonstrate that the ML-based approach outperforms the traditional baseline method in PHL estimation accuracy for 7 of 9 scenarios. The average PHL error across the nine scenarios was 7.40% for the ML-based method, 2.06% less than the 9.46% PHL error average across scenarios that was exhibited by the baseline method. Additionally, the PHL error was below 5% for at least 95% of the testing interval for 3 of 9 tested intervals with the ML approach, whereas it did not achieve this metric for any of the baseline tests. Overall, simulation results indicate the superior performance of an ML-based approach compared to the conventional baseline reference-control approach, showcasing its potential to support grid stability and operational efficiency. This laboratory HIL testing using real PPC, representative power system simulation models in real-time with detailed PV plant and inverter models, and real-world communication protocols gives us confidence that this machine learning based PHL estimation algorithm works well in the hardware PPC and therefore de-risks future field commissioning. The end goal of this project is to advance grid technology to address the grid operation challenges brought by solar plant’s variability and uncertainties in power generation.

14 SOLAR ENERGY↗
DOE OSTI2024

Macroscopic modeling of gas permeability in hierarchical micro/nanoporous media: A unified characterization of rarefaction using Klinkenberg theory and equivalent diameter

Estimating gas transport through a hierarchical micro/nanoporous system is challenging due to non-equilibrium gas dynamics. The primary difficulty lies in determining the rarefaction level, because identifying a representative flow dimension in a complex porous system with multiple pore scales is not straightforward. Our study performed a pore-level analysis for gas permeability in dual-scale porous media with varying porosity, throat size, and secondary pore size under different rarefaction conditions. We found that secondary porosity negatively affects permeability due to increased friction forces, with this influence growing as the secondary pore size and porosity increase until the secondary pore becomes comparable to the throat. However, rarefaction reduces the effects of secondary pores due to boundary slip. Traditional Knudsen number (Kn) calculations based on Darcy-defined height failed to accurately describe the rarefaction effects on gas permeability. Instead, we introduced an equivalent diameter to calculate the Kn, which provided an accurate normalization of apparent gas permeability independent of pore geometry. Furthermore, the extended Kozeny–Carman–Klinkenberg model developed in our previous study successfully yielded a macroscopic model for apparent gas permeability in hierarchical micro/nanoporous systems as a function of the traditional Darcy height and porosity.

04 OIL SHALES AND TAR SANDS↗
DOE OSTI2026

Compositional Reasoning for Hierarchical State Machines

Harel statecharts and its derivatives are popular graphical languages for specifying discrete control systems via hierarchical state machines. Separately, there has been a long line of work on specifying concurrent systems with process calculi which come equipped with an algebraic theory, the ability reason compositionally about various temporal properties, and strong type systems. While these two approaches to modeling systems are tantalizingly similar, the integrated reasoning principles that exist for process calculi have not been demonstrated in hierarchical state machines. A key issue is that operational theories for process calculi do not behave like control systems, and thus, there is virtually no tool support for modeling control systems with such languages. For a control system designer, bringing the integrated, more scalable reasoning from the process calculi to state-machine languages would enable the specification of more complex systems and a more modular systems development process. Our insight is that we can recover many important results from the process calculi in hierarchical state machines with local scope. We employ a structural operational semantics, which is ubiquitous in process and 𝜆-calculi but uncommon in hierarchical statemachine formalizations, to enable inductive reasoning about behavior. Taking inspiration from the structure of process calculi metatheories, we define a calculus of refinement and equivalence that we prove sound with respect to local notion of (bi)simulation. Furthermore, we prove that the calculus preserves the behavioral properties of reactivity, observational determinism, traces, and linear temporal properties. Our results are mechanized in the Rocq proof assistant.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

HCPerf: Driving Performance-Directed Hierarchical Coordination for Autonomous Vehicles

The rapid development of autonomous driving poses new research challenges to the on-vehicle computing system. In particular, the execution time of autonomous driving tasks highly depends on the specific driving environment. For instance, the execution time of configurable sensor fusion increases significantly as the scene becomes complex, which leads to end-to-end deadline misses from sensing to control and may cause accidents. Thus, a framework that can effectively utilize the system resources to guarantee the end-to-end deadlines of autonomous driving tasks as well as effectively prioritize the responsiveness and throughput of the control commands is crucial for autonomous driving. In this paper, we propose HCPerf, a performance-directed hierarchical coordination framework that intelligently coordinates the autonomous driving tasks with high execution time variation and complex dependencies according to the driving performance in real-time. Specifically, HCPerf mainly consists of two coordinators. The internal coordinator intelligently schedules the tasks according to the driving performance of the vehicle in order to help them meet the end-to-end deadlines while well prioritizing the responsiveness and throughput of the control commands. At the same time, the external coordinator dynamically tunes the rates of tasks according to the schedulability in order to efficiently utilize the system resource. We conduct extensive experiments on both simulation and hardware testbeds with the representative autonomous driving application. The results show that HCPerf can effectively improve the driving performance by 7.69%-45.94% in different driving scenarios.

Ma, Jialiang↗
DOE OSTI2024

Integrate Latimer Controls' Solution into RTAC (CRADA Final Report, CRD-23-24672)

Latimer Controls, Inc. was awarded two vouchers under the Department of Energy's American-Made Solar Prize Round 6 to conduct collaborative research at a national laboratory. The National Renewable Energy Laboratory (NREL) was selected as a partner to assist Latimer Controls in the performance evaluation of its photovoltaic (PV) control software. This collaboration focuses on developing a hardware-in-the-loop (HIL) testbed at NREL, which will be used to test and validate the Latimer PV control technology in a realistic yet de-risked environment. Both Latimer and NREL teams will work together to analyze the collected test data, derive insights, and disseminate the scientific findings. Recent studies underscore the potential of solar energy as a zero-marginal-cost and zero-emission flexibility resource within the bulk power system, particularly when integrated with advanced control systems. To enhance the performance of such systems, Latimer Controls has developed leading-edge technologies, including machine learning (ML) algorithms and hierarchical inverter set-point allocation methods. These innovations are designed to estimate the operational headroom of large PV plants for grid integration and control. However, comprehensive validation under real-world conditions remains necessary. To address this gap, the concurrent CRADA project proposes the real-world application and validation of the Latimer Control solution within a HIL environment. Initially, the Latimer algorithm was developed and tested within MATLAB Simulink, a platform suitable for research-level simulations and iterative development. However, transitioning this technology to a real solar site as an industry-ready solution necessitates implementation in a format compatible with widely used solar power plant controllers. In this additional CRADA work, the MATLAB Simulink-based logic will be translated into Structured Text, a programming language compliant with IEC 61131 standards, which is commonly used for custom logic implementations in industry-leading programmable logic controllers (PLCs), such as the Schweitzer SEL real-time automation controller (RTAC). This transition will facilitate the deployment of the Latimer Control solution in real-world solar power plants, thereby advancing the technology towards commercialization.

14 SOLAR ENERGY↗
DOE OSTI2024

Ab Initio-Based Bond Order Potential for Arsenene Polymorphs Developed via Hierarchical Reinforcement Learning

Arsenene, a less-explored two-dimensional material, holds the potential for applications in wearable electronics, memory devices, and quantum systems. This study introduces a bond-order potential model with Tersoff formalism, the ML-Tersoff, which leverages multireward hierarchical reinforcement learning (RL), trained on an ab initio data set. This data set covers a spectrum of properties for arsenene polymorphs, enhancing our understanding of its mechanical and thermal behaviors without the complexities of traditional models requiring multiple parameter sets. Our RL strategy utilizes decision trees coupled with a hierarchical reward strategy to accelerate convergence in high-dimensional continuous search spaces. Unlike the Stillinger-Weber approach, which demands separate formalisms for buckled and puckered forms, the ML-Tersoff model concurrently captures multiple properties of the two polymorphs by effectively representing the local environment, thereby avoiding the need for different atomic types. Here, we apply the ML model to understand the mechanical and thermal properties of the arsenene polymorphs and nanostructures. We observe an inverse relationship between the critical strain and temperature in arsenene. Thermal conductivity calculations in nanosheets show good agreement with ab initio data, reflecting a decrease in thermal conductivity attributable to increased anharmonic effects at higher temperatures. We also apply the model to predict the thermal behavior of arsenene nanotubes.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Extremely Scalable Distributed Computation of Contour Trees via Pre-Simplification

Contour trees offer an abstract representation of the level set topology in scalar fields and are widely used in topological data analysis and visualization. However, applying contour trees to large-scale scientific datasets remains challenging due to scalability limitations. Recent developments in distributed hierarchical contour trees have addressed these challenges by enabling scalable computation across distributed systems. Building on these structures, advanced analytical tasks—such as volumetric branch decomposition and contour extraction—have been introduced to facilitate large-scale scientific analysis. Despite these advancements, such analytical tasks substantially increase memory usage, which hampers scalability. In this paper, we propose a pre-simplification strategy to significantly reduce the memory overhead associated with analytical tasks on distributed hierarchical contour trees. We demonstrate enhanced scalability through strong scaling experiments, constructing the largest known contour tree—comprising over half a trillion nodes with complex topology—in under 15 minutes on a dataset containing 550 billion elements.

Li, Mingzhe [University of Utah]↗
DOE OSTI2021

Impact of Blockchain Delay on Grid-Tied Solar Inverter Performance: Preprint

This paper investigates the impact of the delay resulting from a blockchain, a promising security measure, for a hierarchical control system of inverters connected to the grid. The blockchain communication network is designed at the secondary control layer for resilience against cyberattacks. To represent the latency in the communication channel, a model is developed based on the complexity of the blockchain framework. Taking this model into account, this work evaluates the plant’s performance subject to communication delays, introduced by the blockchain, among the hierarchical control agents. In addition, this article considers an optimal model-based control strategy that performs the system’s internal control loop. The work shows that the blockchain’s delay size influences the convergence of the power supplied by the inverter to the reference at the point of common coupling. In the results section, real-time simulations on OPAL-RT are performed to test the resilience of two parallel inverters with increasing blockchain complexity.

41 EE - Solar Energy Technologies Office (EE-4S)↗
DOE OSTI2020

Integrating environmental understanding into freshwater floatovoltaic deployment using an effects hierarchy and decision trees

Abstract In an era of looming land scarcity and environmental degradation, the development of low carbon energy systems without adverse impacts on land and land-based resources is a global challenge. ‘Floatovoltaic’ energy systems—comprising floating photovoltaic (PV) panels over water—are an appealing source of low carbon energy as they spare land for other uses and attain greater electricity outputs compared to land-based systems. However, to date little is understood of the impacts of floatovoltaics on the hosting water body. Anticipating changes to water body processes, properties and services owing to floatovoltaic deployment represents a critical knowledge gap that may result in poor societal choices and water body governance. Here, we developed a theoretically-derived hierarchical effects framework for the assessment of floatovoltaic impacts on freshwater water bodies, emphasising ecological interactions. We describe how the presence of floatovoltaic systems may dramatically alter the air-water interface, with subsequent implications for surface meteorology, air-water fluxes and physical, chemical and biological properties of the recipient water body. We apply knowledge from this framework to delineate three response typologies—‘ magnitude’ , those for which the direction and magnitude of effect can be predicted; ‘ direction’ , those for which only the direction of effect can be predicted; and ‘ uncertain’ , those for which the response cannot be predicted—characterised by the relative importance of levels in the effects hierarchy. Illustrative decision trees are developed for an example water body response within each typology, specifically, evaporative water loss, cyanobacterial biomass, and phosphorus release from bed sediments, and implications for ecosystem services, including climate regulation, are discussed. Finally, the potential to use the new understanding of likely ecosystem perturbations to direct floatovoltaic design innovations and identify future research priorities is outlined, showcasing how inter-sectoral collaboration and environmental science can inform and optimise this low carbon, land-sparing renewable energy for ecosystem gains.

Environmental Sciences & Ecology↗
DOE OSTI2020

A Model-Predictive Hierarchical-Control Framework for Aggregating Residential DERs to Provide Grid Regulation Services: Preprint

This paper develops a hierarchical control fram-ework to aggregate and control behind-the-meter distributed energy resources (DERs), which will be ubiquitous in future distribution systems. Even though the increasing penetration of DERs will strain the power networks in terms of voltage regul-ation and coordination issues with existing transmission-level conventional generators, the distribution-level DERs can also be utilized to help provide flexibility to the power network while providing cost savings to the DER owners. Therefore, this paper develops a model-predictive control strategy to determine the available power flexibility, and to utilize the flexibility in an aggregated form to provide grid regulation services. Numerical simulations performed on the IEEE 37-bus test system demonstrate the efficacy of the proposed approach.

14 SOLAR ENERGY↗
DOE OSTI2021

Kinetically Controlled Formation of Semi-crystalline Conjugated Polymer Nanostructures

Conjugated polymer (CP) materials that are considered as an attractive choice for various electronic and optoelectronic applications possess highly heterogeneous complex structures that can span several orders of magnitude in length scale. This is due to the intricate coupling effects of weak secondary interactions and entropic forces that determine molecular organization in bulk polymer materials. Understanding the influence of molecular interactions on the emergence and evolution of nano- and microscale structures is of paramount importance to the guided design and development of condensed CP materials. Such understanding is even more critical for the rational design of hierarchical systems away from equilibrium, where weak molecular interactions can guide the system along competing kinetic pathways toward local energy minima and metastable architectures. In this work, we studied a promising concept for accessing various kinetically stabilized semi-crystalline CP nanostructures that are formed in the process of controlled chain-growth Kumada catalyst-transfer polymerization initiated by a small-molecule catalytic species which can exist in equilibrium between free and aggregated states. Specifically, we chose a small-molecule perylenedicarboximide (PDCI) polymerization catalytic initiator which has a strong tendency toward reversible supramolecular assembly–disassembly that can be controlled by temperature. Addition of a thiophene monomer to a solution of the PDCI initiator starts the chain-growth polymerization process, which produces distinct nanoscale semi-crystalline polythiophene structures formed under predominant kinetic control. Furthermore, we demonstrated that, depending on the reaction temperature (which affects the fine balance between the position of PDCI assembly–disassembly equilibrium, rate of polymerization, and solvent–solute interactions for the growing polythiophene chains), a range of kinetically trapped hierarchically organized semi-crystalline CP systems with substantially varying optoelectronic properties could be obtained. In addition to spectroscopic and electron microscopic studies, in order to better reveal the structural aspects of the generated polymer nanoscale systems, we carried out a series of X-ray diffraction and neutron scattering experiments which indicated complex hierarchical organization in these kinetically stabilized CP assembled materials. We expect that this in situ polymerization-based approach can lead to a general way to expand access to various semi-crystalline CP nanostructured materials with broadly tunable electronic and optical properties.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

Control over emergence and alignment of transient blisters in thermo-responsive gels using hierarchically patterned substrates

Surfaces with tunable microscale textures are vital in a large variety of technological applications, including heat transfer, antifouling and adhesion. To facilitate such broad-scale use, there is a need to create surfaces that undergo reconfigurable changes in topology and thus, enable switchable functionality. To date, there is a relative dearth of methods for engineering surfaces that can be actuated to change topography over a range of length scales, and hence, form tunable hierarchically structured layers. Combining modeling and experiments, we design a geometrically patterned, thermo-responsive poly (N-isopropylacrylamide) gel film that undergoes controllable hierarchical changes in topology with changes in temperature. At the bottom, the film is covalently bound to a solid, curved substrate; at the top, the film encompasses longitudinal rectangular ridges that are oriented perpendicular to the underlying cylindrical curves. At temperatures below lower critical solution temperature (LCST), the swollen gel exhibits 3D variations in polymer density and thickness defined by the gel's top and bottom topography. As the temperature rises above LCST, the interplay between the upper ridges and lower curves in the gel drives non-uniform, directional solvent transport, the nucleation and propagation of a phase-separated higher-density skin layer, and the resulting pressure buildup within the film. These different, interacting kinetic processes lead to an instability, which produces transient microscopic blisters in the film. Through simulations, we show how tuning the width of the ridges modifies the propagation of a skin layer and creates localized pressure build-up points, which enables control over the emergence, distribution, and alignment of the microscopic blisters. Futhermore, we provide a simple argument to predict the size of such microscopic features. Experiments confirm our predictions and further highlight how our computational model enables the rational design of topographical transitions in these tunable films. The development of actuatable, hierarchically structured films provides new routes for achieving switchable functionality in actuators, drug release systems and adhesives.

42 ENGINEERING↗
DOE OSTI2025

Model-based Hierarchical Reinforcement Learning for Improved Physical Security Design: A Prototype

Prior work in FY24 developed an adversarial AI agent aid in path analysis of physical protection systems. This agent, trained using a model-based reinforcement learning algorithm, was able to successfully learn the most vulnerable path in facilities. It was able to extend the current state of practice for physical protection design by exhibiting dynamic behavior based on current environmental conditions. Whereas PathTrace largely performs a static, graph-based analysis, the AI agent was able to make decisions based on relative position in the facility, current conditions (was the adversarial agnet discovered?), and proximity to secondary targets. The agent demonstrated some novel capabilities, but had limitations that need to be resolved before it can be used for production purposes. For example, the adversarial agent generalizes poorly and takes a relatively long time to train. Nonetheless, there is still considerable promise for developing the adversarial agent further in order to explore even richer, more dynamic behaviors (e.g., adversary motivations, environmental debris, and more). This work considers a complementary idea; development of a planning agent. The planning agent is envisioned as an auto-complete-like tool that can help accelerate security system design by human experts. The agent would respect existing barriers and sensors placed by a human expert while offering cost-effective suggestions (i.e., implicitly balancing effectiveness with cost) to improve the design. The goal is for this agent to be part of an expert’s toolbox, not to totally upend the current state-of-practice, or to displace human experts. The ultimate goal would be concurrent training of both the adversarial and planning agent together, to learn entirely through self-play. This would represent an entirely new way of performing system deign. We selected a hierarchical, model-based reinforcement learning algorithm to serve as the planning agent. This is an extension of concepts used in the prior FY24 adversarial agent work. There, we had a single agent acting an environment. Here, we have two different sub-agents (policies), working together, to form a complete agent. There is a manager policy, which can select abstract goals on slower time scales, and a worker, which performs primitive actions to reach goals selected by the manager. It is worth noting that this class of algorithm is challenging to work with. From our understanding, our work is one of the first successful uses of model-based reinforcement learning (MBRL) in nuclear energy1 , and likely the first hierarchical model-based reinforcement learning application in nuclear energy. Further, this work is one of the first known attempts to apply AI to perform a design tasks in nuclear energy. Consequently, there were significant implementation challenges and the bulk of the work was focused on successful implementation and algorithm design. The results presented here are very low technology readiness level as a consequence of the lack of related literature, but still represent a significant step forward in the pursuit of applied AI for design.

42 ENGINEERING↗