Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Path Forward”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

939 records · Page 53
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Model-based Hierarchical Reinforcement Learning for Improved Physical Security Design: A Prototype

Prior work in FY24 developed an adversarial AI agent aid in path analysis of physical protection systems. This agent, trained using a model-based reinforcement learning algorithm, was able to successfully learn the most vulnerable path in facilities. It was able to extend the current state of practice for physical protection design by exhibiting dynamic behavior based on current environmental conditions. Whereas PathTrace largely performs a static, graph-based analysis, the AI agent was able to make decisions based on relative position in the facility, current conditions (was the adversarial agnet discovered?), and proximity to secondary targets. The agent demonstrated some novel capabilities, but had limitations that need to be resolved before it can be used for production purposes. For example, the adversarial agent generalizes poorly and takes a relatively long time to train. Nonetheless, there is still considerable promise for developing the adversarial agent further in order to explore even richer, more dynamic behaviors (e.g., adversary motivations, environmental debris, and more). This work considers a complementary idea; development of a planning agent. The planning agent is envisioned as an auto-complete-like tool that can help accelerate security system design by human experts. The agent would respect existing barriers and sensors placed by a human expert while offering cost-effective suggestions (i.e., implicitly balancing effectiveness with cost) to improve the design. The goal is for this agent to be part of an expert’s toolbox, not to totally upend the current state-of-practice, or to displace human experts. The ultimate goal would be concurrent training of both the adversarial and planning agent together, to learn entirely through self-play. This would represent an entirely new way of performing system deign. We selected a hierarchical, model-based reinforcement learning algorithm to serve as the planning agent. This is an extension of concepts used in the prior FY24 adversarial agent work. There, we had a single agent acting an environment. Here, we have two different sub-agents (policies), working together, to form a complete agent. There is a manager policy, which can select abstract goals on slower time scales, and a worker, which performs primitive actions to reach goals selected by the manager. It is worth noting that this class of algorithm is challenging to work with. From our understanding, our work is one of the first successful uses of model-based reinforcement learning (MBRL) in nuclear energy1 , and likely the first hierarchical model-based reinforcement learning application in nuclear energy. Further, this work is one of the first known attempts to apply AI to perform a design tasks in nuclear energy. Consequently, there were significant implementation challenges and the bulk of the work was focused on successful implementation and algorithm design. The results presented here are very low technology readiness level as a consequence of the lack of related literature, but still represent a significant step forward in the pursuit of applied AI for design.

42 ENGINEERING↗
DOE OSTI2022

Plasma Wall Interaction with 3-D Plasma Boundaries

The interaction of the edge plasma and the material surfaces is one of the most critical challenges on the path to harness fusion power as new, fundamental energy source. This challenge typically combines the thrust to reach high density, low temperature (detached) plasmas in front of the divertor target plates as well as understanding the plasma material interaction (PMI) in particular in this regime. The combination of both research thrusts represents an extraordinarily challenging subject encompassing spatial scales spanning nanometers to meters in all states of matter and across a broad energy range. Modeling capabilities, which help to interpret data from nowadays experiments and enable extrapolation to future devices are urgently required. This is in particular true for toroidal magnetic confinement devices with three-dimensional (3D) plasma boundaries. Such plasma boundary geometries occur in tokamaks, when small amplitude magnetic perturbations are used to stabilize the unruly edge plasma or in stellarators, that are inherently 3D plasma confinement devices. In this project, the impact of 3D plasma boundaries on the plasma material interaction (PMI) was assessed. This work focused on plasma boundary conditions, in which high-density conditions at the material surfaces yield mitigation of the otherwise immense heat and particle loads that these materials would see. These so-called high recycling and eventually detached plasma regimes are of great interest for future reactor operation. In the project, key features that are unique to 3D boundaries were explored in comparison to canonically assumed axisymmetric plasma edge situations in tokamaks. In particular, the relevance of the 3D boundary situation in the extrapolation to the plasma boundary solution at ITER, the next step fusion energy experiment under construction as a multi-national, world-wide large-science experiment in southern France, has been explored. The EMC3-EIRENE plasma edge fluid and kinetic neutral transport code has been advanced to cope with the challenging and unprecedented conditions in the ITER boundary plasma including 3D fields that are planned to be used to suppress harmful edge instabilities, the so-called edge localized modes. This is a vital integration challenge for ITER and the results from this grant have provide a leading capability for this assessment. It was shown that the detachment process in a 3D edge solution for ITER follows the recycling regimes that are known from axisymmetric solutions, but that multiple plasma exhaust channels connected to the material surfaces are established which feature individual recycling characteristics. Because these channels touch the material surfaces in the divertor in a 3D geometry, the compatibility with the plasma material interaction (PMI), including erosion and impurity generation has been found to be an important part of the integration challenge. To address this, the fully 3D plasma material interaction code ERO2 has been adapted to these ITER specific geometries and a homogeneous mixing model was implemented, that allows to consider the mixing of Be and Was used at ITER in the PMI modeling. This model enhancement has been used to study non-local migration of Be in the JET ITER like wall configuration and it has been shown that with this model such complex migration processes in ITER relevant plasma shapes and with ITER relevant plasma boundary conditions can be addressed. The combined modeling approach using EMC3-EIRENE as a plasma boundary transport code and the ERO2 specialized PMI model will be an asset for the continued preparations of ITER operation as well as for Fusion Pilot Plant efforts that have emerged in the U.S. during the evolution of this grant. The predictive capability of this numerical tool has been validated at the DIII-D US national fusion facility. Here, dedicated plasma edge diagnostics were implemented to measure the impurity household around a 3D edge plasma during ELM suppression by 3D fields. Dedicated experiments with local material probes using these diagnostics and the state-of-the-art suite of boundary measurements at DIII-D have shown that the 3D perturbation of the plasma edge that is excreted by such 3D control fields yield a perturbation of the plasma boundary flux structure and hence also of the resulting PMI. The 3D boundary plasma is composed out of helical magnetic flux channels that intersect the divertor targets at an angle relative to the main guiding field, i.e., the toroidal magnetic field component of the tokamak. A similar effect has been measured as well on limiter surfaces during the startup campaign at the new stellarator experiment Wendelstein 7-X. These experiments ad initial analysis with the ERO plasma material interaction model, suggested that the place of erosion for a given particle from the surface and its re-deposition can be different in such 3D field geometries yielding potentially a significant level of net-erosion. This is not the case for axisymmetric solutions, where it was shown in the past that the eroded particles are effectively re-deposited into gaps produced by erosion at the same position and hence the net-erosion levels are small. For ITER, the quest to suppress the ELMs and at the same time maintain the integrity of the divertor is an issue, which these fundamental findings will help to resolve. The coupling of this work to the extrapolation in the ITER program has been addressed by both the PI and the lead numerical scientist being ITER Science Fellows in the duration of the contract and forward. A second focus in the exploration of 3D boundary effects on tokamaks and stellarators has been set on the measurement of helium exhaust features with such 3D fields. This is important because He represents the ash of the fusion process and needs to be exhausted. It was shown that 3D field application compatible with suppression of ELMs yields an increase of the helium exhaust performance. The ratio of the effective helium confinement time over the energy confinement time was reduced by almost 50% which demonstrated that the impact of helium accumulation in the plasma core with respect to the confinement of energy to sustain the fusion reaction is significantly improved with such 3D control fields. It was shown that this is the case for tokamaks as well as stellarators. At the Large helical Device in Japan, a similar enhancement of the helium exhaust features when small amplitude additional 3D fields were applied was measured. This is an important additional function of 3D field application and its impact on ITER is presently being studied in combination with investigations of helium exhaust in 3D field geometries of stellarator devices.

3D plasma edge transport↗
DOE OSTI2023

IACMI Project 4.7: Pultruded Textile Carbon Fiber for Spar Caps (Final Report)

The primary objective of this project was to demonstrate the potential to significantly reduce the cost of wind turbine blades with carbon fiber reinforced polymer (CFRP) structure. Applicability of textile carbon fibers (TCF) were evaluated for use in pultruded spar cap (SC) elements as a path to cost reduction for utility scale wind turbine blades. In earlier work for the Department of Energy (DOE) Wind Energy Technologies Office (WETO), a collaboration of Sandia National Laboratory (SNL), Oak Ridge National Laboratory (ORNL), and Montana State University has demonstrated potential for pultruded TCF to compete with infused fiberglass and commercially available carbon fiber pultruded sections for spar cap construction. In the design cases evaluated, the TCF sections fared well when compared on cost per unit composite stiffness and cost per unit composite compressive strength for those designs [1]. Both stiffness and compressive strength tend to be key factors in the design of blade composite Spar Cap which carry the bulk of the blade structural loads in bending. Spar Cap design tends to distribute largely symmetric tensile and compressive stresses to opposite sides of the spar structure, but since carbon fiber composite compressive strength is typically 20-50% lower than tensile strength, the compressive loading reaches failure levels well before the tensile loading. Stiffness is critical in containing the large tip deflection in high wind loading situations. However, materials and process development were very limited in the earlier study and the work in this project was expanded to make the comparative information more representative of what will be required in order to make further inroads towards implementation. Similar to that study, this project team confirmed that the primary materials of interest for pultruded spar cap elements should be thermoset (TS) resins reinforced by carbon fibers, utilizing as high a percentage of TCF as practical to benchmark cost and performance against commercial carbon fibers. To make the closest comparison possible and eliminate specific test article size, resin selection, and equipment/operational nuance effects, the team planned to pultrude sections with 100% commercially available carbon fiber (Panex 35 carbon fiber from Zoltek) as well as samples utilizing high fractions of TCF. The resin system chosen was based on formulations recommended by large wind industry supplier Hexion and consisted of Hexion resin RSL-4597, curing agent CCA-138, and internal mold release additive 117, along with common kaolin filler ASP400P from BASF. As commonly deployed in spar cap configurations, the team had a mold built to pultrude a rectangular spar cap element of 100mm width and 3mm thickness. The extremely limited number of samples produced for the earlier study were produced with a “generic” epoxy utilized for a variety of applications by the pultruder contracted to produce test articles for demonstration purposes. More importantly, those samples were produced at a fiber fraction only slightly over 50%. Based on feedback from our industrial advisory team for that project and strongly recommended by this project team, the consensus is that it is highly desirable to obtain fiber fractions of 65-68% for significant penetration in wind blade spar cap. Although this requirement has yet to be exhaustively confirmed in readily available information, this was established as a project goal and informally decided we needed to exceed 60% fiber fraction to gain serious industry consideration. Previous TCF pultrusion trials have been challenged by the lack of robust TCF packages, resulting in non-uniform tension across and between tows, as well as excess labor and waste for removal of interleaved paper. The non-uniform tension and associated intermingling of tows in textile acrylic fiber tows and associated difficulties created from broken filaments in carbon fiber conversion inhibit the ordered packing necessary to enhance fiber fraction elevation. (These “cross-overs” are not considered undesirable for textile applications and there is some sense that they might be advantageous for those applications). In addition to work that is ongoing at the acrylic fiber manufacturers to improve their formats, The Institute of Advanced Composites Manufacturing Innovation (IACMI) Project 6.12 (report PA16-0349-6.12-01) [2] has developed and demonstrated a more robust packaging and creeling approach that at least partially addresses these issues, thus improving control of the TCF feed into the pultrusion unit. It was hoped that these and other improvements currently being implemented would allow us to achieve fiber fractions at least approaching these fiber fraction targets. During this project, sections utilizing 100% commercially available carbon fiber reinforcement were produced as a baseline, as well as sections reinforced with about 94% TCF and the balance being commercially available fiber for comparison. The most important finding was that similar to results reported in the earlier WETO-funded project and results from tests of TCF reported at IACMI meetings, this work demonstrated that sections pultruded with TCF in an epoxy resin frequently utilized in actual spar cap production had stiffness and compressive strengths largely comparable to similar sections pultruded with a commercially available carbon fiber also frequently utilized in the wind industry. Although the amount of that data is limited, some of the tensile strength results were actually closer than would have been expected based on fiber strength results provided by the TCF and commercial fiber producers. The actual test data are reported and discussed in detail in Section 5. The pultruded sections dominated by TCF reinforcement were approximately 8-10% lower in fiber fraction than for the sections produced using commercial fiber alone, making direct comparison difficult. The COVID-19 project has provided significant insight into the current state-of-the-art with various TCF product forms. The data obtained in this project will guide the planned improvements at the precursor level, especially in attaining uniform tensioning and payout to facilitate enhanced fiber fractions and overall processability of the TCF composites. The project team is providing guidance to stakeholders concerning the attributes, needs, and potential demand for TCF in wind blade spar caps. Results achieved in this project are consistent with findings in the related work cited [1] and support this guidance and the high potential for this product type. TCF precursor-producing partners continue to express interest in enhancing their product forms and the team looks forward to working with these improved materials as they become available.

42 ENGINEERING↗