Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “REINFORCEMENT”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8
All sourcesNASA NTRSDOE OSTI
DOE OSTI2019

Two‐dimensional graphene oxide‐reinforced porous biodegradable polymeric nanocomposites for bone tissue engineering

Abstract This study investigates the mechanical properties and in vitro cytotoxicity of two‐dimensional (2D) graphene oxide nanoribbons and nanoplatelets (GONRs and GONPs) reinforced porous polymeric nanocomposites. Highly porous poly(propylene fumarate) (PPF) nanocomposites were prepared by dispersing 0.2 wt % single‐ and multiwalled SONRs (SWGONRs and MWGONRs) and GONPs. The mechanical properties of scaffolds were characterized using compression testing and in vitro cytocompatibility was assessed using QuantiFlour assay for cellularity and PrestoBlue assay for cell viability. Immunofluorescence was used to assess collagen‐I expression and deposition in the extracellular matrix. Porous PPF scaffolds were used as a baseline control and porous single and multiwalled carbon nanotubes (SWCNTs and MWCNTs) reinforced nanocomposites were used as positive controls. Results show that incorporation of 2D graphene nanomaterials leads to an increase in the mechanical properties of porous PPF nanocomposites with following the trend: MWGONRs > GONPs > SWGONRs > MWCNTs > SWCNTs > PPF control. MWGONRs showed the best enhancement of compressive mechanical properties with increases of up to 26% in compressive modulus (i.e., Young's modulus), ~60% in yield strength, and ~24% in the ultimate compressive strength. Addition of 2D nanomaterials did not alter the cytocompatibility of porous PPF nanocomposites. Furthermore, PPF nanocomposites reinforced with SWGONRs, MWGONRs, and GONPs show an improvement in the adsorption of collagen‐I compared to PPF baseline control. The results of this study show that 2D graphene nanomaterial reinforced porous PPF nanocomposites possess superior mechanical properties, cytocompatibility, and increased protein adsorption. The favorable cytocompatibility results opens avenues for in vivo safety and efficacy studies for bone tissue engineering applications. © 2019 Wiley Periodicals, Inc. J Biomed Mater Res Part A: 107A: 1143–1153, 2019.

Farshid, Behzad↗
DOE OSTI2018

Properties of Poly(Vinyl Alcohol)/Chitosan Nanocomposite Films Reinforced with Oil Palm Empty Fruit Bunch Amorphous Lignocellulose Nanofibers

The objective of this study was to investigate the properties of poly(vinyl alcohol)/chitosan nanocomposite films reinforced with different concentration of amorphous LCNFs. The properties analyzed were morphological, physical, chemical, thermal, biological, and mechanical characteristics. Oil palm empty fruit bunch LCNFs obtained from multi-mechanical stages were more dominated by amorphous region than crystalline part. Varied film thickness, swelling degree, and transparency of PVA/chitosan nanocomposite films reinforced with amorphous part were produced. Aggregated LCNFs, which reinforced PVA/chitosan polymer blends, resulted in irregular, rough, and uneven external surfaces as well as protrusions. Based on XRD analysis, there were two or three imperative peaks that indicated the presence of crystalline states. The increase in LCNFs concentration above 0.5% to PVA/chitosan polymer blends led to the decrease in crystallinity index of the films. A noticeable alteration of FTIR spectra, which included wavenumber and intensity, was obviously observed along with the inclusion of amorphous LCNFs. That indicated that a good miscibility between amorphous LCNFs and PVA/chitosan polymer blend generated chemical interaction of those polymers during physical blending. Reinforcement of PVA/chitosan polymer blends with amorphous LCNFs influenced the changes of T{sub g} (glass transition temperature), T{sub m} (melting point temperature), and T{sub max} (maximum degradation temperature). Three thermal phases of PVA/chitosan/LCNFs nanocomposite films were also observed, including absorbed moisture evaporation, PVA and chitosan polymer backbone structural degradation and LCNFs pyrolysis, and by-products degradation of these polymers. The addition of LCNFs 0.5% had the highest tensile strength and the addition of LCNFs above 0.5% decreased the strength. The incorporation of OPEFB LCNFs did not show anti-microbial and anti-fungal properties of the films. The addition of amorphous LCNFs 0.5% into PVA/chitosan polymer blends resulted in regular and smooth external surfaces, enhanced tensile strength, increased crystallinity index, and enhanced thermal stability of the films.

77 NANOSCIENCE AND NANOTECHNOLOGY↗
DOE OSTI2025

Evaluation of desiccation cracking characteristics of inorganic micro-fiber-reinforced engineered barrier material (IMEBM) for geological repository

Abstract Buffer material is crucial for the engineering barrier system to dispose of high-level radioactive waste in a geological repository. A reliable buffer material should be able to maintain good sealing characteristics and minimize desiccation cracking. In this study, the effectiveness of inorganic fiber-reinforced engineering barrier material in reducing desiccation cracks in bentonite was evaluated via desiccation tests, image analysis, and air permeability tests. The effects of fiber type (E-glass fiber and basalt fiber) and fiber content (0.0%, 0.5%, 1.0%, 1.5%, 3.0%, and 5.0% of dry weight of the bentonite) on the development of desiccation cracks in the fiber–bentonite mixtures with the same given initial moisture content were evaluated. The results indicated that the addition of fibers could significantly reduce the crack size and area in bentonite during the drying. Basalt fibers showed a slightly better reinforcement effect than E-glass fibers when the fiber content was lower than 3.0%. The addition of fibers prevented the development of penetrating cracks and significantly reduced the permeability of the bentonite after drying. The permeabilities of basalt fiber- and E-glass fiber-reinforced bentonite composites with 3% reinforcement were 5.81 × 10 –11 m 2 and 7.24 × 10 –11 m 2 , respectively, which were 64 and 51 times smaller than that of pure bentonite. X-ray–CT observation of the internal structure of the samples after drying showed that the addition of fibers significantly changed the crack morphology and potentially increased the tortuosity.

Feng, Yuan↗
DOE OSTI2019

Microstructure and Mechanical Properties of Powder Thixoforged Amorphous Ni{sub 55}Nb{sub 35}Si{sub 10}-Reinforced Al Matrix Composites

Powder thixoforging was used to produce amorphous Ni{sub 55}Nb{sub 35}Si{sub 10}-reinforced Al matrix composites from recycled Al powders obtained from ball-milled Al520 end-milled billets. The amorphous reinforcing material was uniformly dispersed in the Al matrix and bonded adequately with it without undesired interfacial reactions. The compressive yield strength of composites with 45% reinforcement content increased 248% to 794 MPa over as-cast samples. The maximum elongation and hardness of samples were 15%, and 60.4 HRA, respectively. The relative density of the unreinforced thixoforged sample was 99.8%, indicating near-perfect compaction of Al powders. The maximum elongation, hardness, and compressive yield strength of thixoforged monolithic matrix alloys were, respectively, 40%, 56.9 HRA, and 747 MPa (a 228% increase in CYS over the cast alloy). In contrast, cold-forged samples showed only 82% increase in compressive yield strength over the as-cast alloy. Powder thixoforging introduced in this study—even without reinforcement—delivers better mechanical properties compared to cold forging most likely due to the refinement and modification of the microstructure during powder ball milling.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Hybrid fiber metal composite laminate interlaminar reinforcement through metal interlocks

Aircraft and automobile industries are continually seeking high-performance and lightweight solutions. Fiber-reinforced composites in conjunction with metals are being considered in the form of hybrid materials. There is a continuous need for improvement of interfacial bonding between composite layers and metal constituents. In this study, an innovative hybrid fiber interlocking metal hooks laminate (FIMHL) system was developed in which fiber-reinforced thermoset composite, and metal sheets are mechanically bonded together using out of plane hooks stamped in the metal. Process optimization was performed to gain the full benefit of the through-thickness reinforcement. Microstructural analysis showed improved interaction between the metal hooks and the fiber layers which reduced porosity and resin richness. This was reflected in mechanical properties, as tensile and flexural strength of FIMHL was enhanced by 38.5 and 18.8%, respectively, after process optimization. Furthermore, normalized weight fraction (76.4%) properties of FIMHL also confirmed that the increase in mechanical properties of optimized panel were not only due to increased reinforcement (glass fiber + aluminum) volume fraction but also because of improved metal hooks and fibers interaction. There was no significant effect on lap shear and fracture toughness, as they depend on bend back behavior of the hooks. A bilinear traction-separation model was used to characterize mode-I interlaminar fracture toughness properties, and 4.5% variation was recorded when modeling and experimental values were compared.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Interlayer reinforcement of 3D printed concrete by the in-process deposition of U-nails

Highlights: • An in-process interlayer reinforcement approach for 3D concrete printing was proposed through the concurrent deposition of U-nails. • Significant strength and toughness improvement was achieved for U-nail reinforced 3D-printed concrete. • The bridge linking effect and dowel action of U-nails were analysed. • Response surface method were utilised to quantify the effects of U-nails on the interlayer bonding behaviour. 3D concrete printing has tremendous potential for construction manufacturing; however, weak interface bonding between adjacent layers remains a well-known issue that affects the mechanical properties of printed structures. The layers introduce anisotropy and reduce the capacity to resist tensile and shear loads. Reinforcements, inserted perpendicular to the printed layers to traverse the interfaces, can improve these limitations, but the insertion of reinforcements is difficult to achieve in practice, and there are few published studies exploring appropriate methods. This study presents a promising approach using U-shaped nails inserted into concrete during the printing process. The bridging effect and dowel action of the applied U-nails are visualised and analysed to elucidate the toughness improvement. The ultimate tensile strength and shear strength of 3D printed concrete are significantly increased by 145.0% and 220.0%, respectively. U-nails with a filament thickness of 2–2.5 mm are recommended to yield optimal improvement in the interlayer strength.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Internal arcing and lightning strike damage in short carbon fiber reinforced thermoplastic composites

Short carbon fiber reinforced thermoplastic composites (S-CFRTP) are currently used in interior parts of aircraft such as electronic circuitry and assemblies, and their usage in aircraft's exterior is also being studied. In this paper, we present a lightning strike study on S-CFRTPs. High performance thermoplastics such as a polyphenylene sulfide (PPS) reinforced with 50% weight (wt.) short carbon fiber (CF), a polyphenyl sulfone (PPSU) reinforced with 25 % wt. Short CF and a acrylonitrile butadiene styrene (ABS) with 20 % wt. short CF were tested against artificial lightning strikes. All samples were prepared using an extrusion compression molding (ECM) technique. A modified component A (100 kA) of lightning waveform, as defined by SAE ARP 5412-B, was applied. High speed imaging, thermography, scanning electron microscopy (SEM) and ultrasonic non-destructive evaluation were performed to understand the effect of lightning strikes on the thermoplastic panels. The results show that electrical conductivity of the composite, thermal stability of the polymers, and CF orientation significantly affected the damage from artificial lightning strikes. PPS composite had the highest resilience against lightning strike damage, retaining 95% and 89% residual flexural strength and modulus, respectively. CF exfoliation due to internal arcing was observed in the carbon fiber-reinforced ABS polymer (CF-ABS) composite. CF exfoliation damage has been reported for the first time.

36 MATERIALS SCIENCE↗
DOE OSTI2013

Strengthening behavior of chopped multi-walled carbon nanotube reinforced aluminum matrix composites

Strengthening behavior of the aluminum composites reinforced with chopped multi-walled carbon nanotubes (MWCNTs) or aluminum carbide formed during annealing at 500 °C has been investigated. The composites were fabricated by hot-rolling the powders which were ball-milled under various conditions. During the early annealing process, aluminum atoms can cluster inside the tube due to the diffusional flow of aluminum atoms into the tube, providing an increase of the strength of the composite. Further annealing induces the formation of the aluminum carbide phase, leading to an overall drop in the strength of the composites. While the strength of the composites can be evaluated according to the rule of mixture, a particle spacing effect can be additionally imparted on the strength of the composites reinforced with the chopped MWCNTs or the corresponding carbides since the reinforcing agents are smaller than the submicron matrix grains. - Highlights: • Strengthening behavior of chopped CNT reinforced Al-based composites is investigated. • Chopped CNTs have influenced the strength and microstructures of the composites. • Chopped CNTs are created under Ar- 3% H2 atmosphere during mechanical milling. • Strength can be evaluated by the rule of the mixture and a particle spacing effect.

36 MATERIALS SCIENCE↗
DOE OSTI2014

Development of an in-situ multi-component reinforced Al-based metal matrix composite by direct metal laser sintering technique — Optimization of process parameters

In the present investigation, an in-situ multi-component reinforced aluminum based metal matrix composite was fabricated by the combination of self-propagating high-temperature synthesis and direct metal laser sintering process. The different mixtures of Al, TiO{sub 2} and B{sub 4}C powders were used to initiate and maintain the self-propagating high-temperature synthesis by laser during the sintering process. It was found from the X-ray diffraction analysis and scanning electron microscopy that the reinforcements like Al{sub 2}O{sub 3}, TiC, and TiB{sub 2} were formed in the composite. The scanning electron microscopy revealed the distribution of the reinforcement phases in the composite and phase identities. The variable parameters such as powder layer thickness, laser power, scanning speed, hatching distance and composition of the powder mixture were optimized for higher density, lower porosity and higher microhardness using Taguchi method. Experimental investigation shows that the density of the specimen mainly depends upon the hatching distance, composition and layer thickness. On the other hand, hatching distance, layer thickness and laser power are the significant parameters which influence the porosity. The composition, laser power and layer thickness are the key influencing parameters for microhardness. - Highlights: • The reinforcements such as Al{sub 2}O{sub 3}, TiC, and TiB{sub 2} were produced in Al-MMC through SHS. • The density is mainly influenced by the material composition and hatching distance. • Hatching distance is the major influencing parameter on porosity. • The material composition is the significant parameter to enhance the microhardness. • The SEM micrographs reveal the distribution of TiC, TiB{sub 2} and Al{sub 2}O{sub 3} in the composite.

36 MATERIALS SCIENCE↗
DOE OSTI2017

Characterization of molybdenum particles reinforced Al6082 aluminum matrix composites with improved ductility produced using friction stir processing

Aluminum matrix composites (AMCs) reinforced with various ceramic particles suffer a loss in ductility. Hard metallic particles can be used as reinforcement to improve ductility. The present investigation focuses on using molybdenum (Mo) as potential reinforcement for Mo(0,6,12 and 18 vol.%)/6082Al AMCs produced using friction stir processing (FSP). Mo particles were successfully retained in the aluminum matrix in its elemental form without any interfacial reaction. A homogenous distribution of Mo particles in the composite was achieved. The distribution was independent upon the region within the stir zone. The grains in the composites were refined considerably due to dynamic recrystallization and pinning effect. The tensile test results showed that Mo particles improved the strength of the composite without compromising on ductility. The fracture surfaces of the composites were characterized with deeply developed dimples confirming appreciable ductility. - Highlights: •Molybdenum particles used as reinforcement for aluminum composites to improve ductility. •Molybdenum particles were retained in elemental form without interfacial reaction. •Homogeneous dispersion of molybdenum particles were observed in the composite. •Molybdenum particles improved tensile strength without major loss in ductility. •Deeply developed dimples on the fracture surfaces confirmed improved ductility.

36 MATERIALS SCIENCE↗
DOE OSTI2018

Evaluation of the microstructure and mechanical properties of WC particle reinforced aluminum matrix composites fabricated by friction stir processing

Highlights: • FSP was used for the preparation of aluminum matrix composites reinforced with WC particle. • WC particles were uniformly distributed in the composite. • WC particles refined the grains of aluminum matrix. • WC particles enhanced the hardness and tensile strength, but decreased the ductility. - Abstract: Tungsten carbide (WC) is an attractive reinforcing material for aluminum and its alloys. However, it is technically challenging to fabricate WC particle reinforced aluminum matrix composites (AMCs) with homogeneous distribution of WC particles by liquid state processing techniques because of large density gradient. The present work aim to produce WC particle reinforced aluminum matrix composites (AMCs) through friction stir processing (FSP) and analyze the effect of its volume fraction on the microstructural features and the mechanical behavior of the developed AMCs. Microstructural evaluation was conducted on the cross-sections of the samples by optical microscopy (OM), scanning electron microscopy (SEM) and electron backscattered diffraction (EBSD). Microhardness testing was conducted across the cross-sections of FSPed samples to obtain hardness profiles and tensile test was conducted on as-received Al and FSPed samples. The fabricated AMCs exhibited the homogeneous distribution of WC particle with no obvious particle clustering in the stir zone, irrespective of position and WC particle volume fraction. Excellent WC/Al interfacial bonding was obtained in all FSPed AMCs with obviously refined grains. The average size of WC particles after FSP was slightly reduced with the increased volume fraction. It was also found that increasing the volume fraction of WC particles favored the grain refinement, improved the hardness and strength, but decreased the ductility. This improvement in the hardness and strength was attributed to the grain refinement strengthening and homogeneous distribution of WC particles. The decreased ductility resulted from the introduction of more WC particles. Increasing the volume fraction of WC particles caused the nature of fracture to move towards brittle nature.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Additive manufacturing of carbon fiber-reinforced thermoset composites via in-situ thermal curing

Fiber-reinforced polymer composites are lightweight structural materials widely used in the transportation and energy industries. Current approaches for the manufacture of composites require expensive tooling and long, energy-intensive processing, resulting in a high cost of manufacturing, limited design complexity, and low fabrication rates. Here, we report rapid, scalable, and energy-efficient additive manufacturing of fiber-reinforced thermoset composites, while eliminating the need for tooling or molds. Use of a thermoresponsive thermoset resin as the matrix of composites and localized, remote heating of carbon fiber reinforcements via photothermal conversion enables rapid, in-situ curing of composites without further post-processing. Rapid curing and phase transformation of the matrix thermoset, from a liquid or viscous resin to a rigid polymer, immediately upon deposition by a robotic platform, allows for the high-fidelity, freeform manufacturing of discontinuous and continuous fiber-reinforced composites without using sacrificial support materials. This method is applicable to a variety of industries and will enable rapid and scalable manufacture of composite parts and tooling as well as on-demand repair of composite structures.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Optimizing thermodynamic trajectories using evolutionary and gradient-based reinforcement learning

Here using a model heat engine, we show that neural-network-based reinforcement learning can identify thermodynamic trajectories of maximal efficiency. We consider both gradient and gradient-free reinforcement learning. We use an evolutionary learning algorithm to evolve a population of neural networks, subject to a directive to maximize the efficiency of a trajectory composed of a set of elementary thermodynamic processes; the resulting networks learn to carry out the maximally efficient Carnot, Stirling, or Otto cycles. When given an additional irreversible process, this evolutionary scheme learns a previously unknown thermodynamic cycle. Gradient-based reinforcement learning is able to learn the Stirling cycle, whereas an evolutionary approach achieves the optimal Carnot cycle. Our results show how the reinforcement learning strategies developed for game playing can be applied to solve physical problems conditioned upon path-extensive order parameters.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2020

Hybrid Li-S pouch cell with a reinforced sulfide glass solid-state electrolyte film separator

Here, in this paper, sulfide glass electrolyte powder with a nominal composition of (Li 2 S) 60 (SiS 2 ) 28 (P 2 S 5 ) 12 is hot pressed at a 330°C and 12 MPa into separator films using non-woven fiberglass reinforcement. The reinforced separator films are 93% dense, bendable, and have an ionic conductivity of 0.7 mS/cm at room temperature. When integrated into hybrid Li-S coin cells with liquid electrolyte, these reinforced glass separators blocked the parasitic polysulfide shuttle sufficiently to enable reversible cycling without LiNO 3 co-salt. Furthermore, the scalability of the reinforced glass separator technology is demonstrated by assembling and testing a hybrid single-layer pouch cell.

25 ENERGY STORAGE↗
DOE OSTI2016

Properties of Geopolymer Composites Reinforced with Basalt Chopped Strand Mat or Woven Fabric

Geopolymers or polysialates are inorganic polymeric, ceramic‐like materials composed of alumina, silica, and alkali metal oxides that can be made without any thermal treatment. Additions of reinforcing phases vastly improve the mechanical properties and high‐temperature stability of the geopolymer. The processing and mechanical properties of both chopped strand mat as well as 2‐D woven fabric‐reinforced potassium geopolymer composites have been evaluated. Hand lay‐up and hydraulic press processing methods were used to produce composite panels. The room‐temperature tensile and flexural strength of chopped strand mat composites was 21.0 ± 3.1 and 31.7 ± 4.4 MP a, respectively, while those of basalt weave‐reinforced geopolymer composites reached 40.0 ± 5.9 and 45.2 ± 9.3 MP a, respectively. Composite microstructures were examined using optical microscopy as well as scanning electron microscopy ( SEM ). Mass, volume, and porosity fractions were also determined. The effect of high‐temperature treatments at 25°C, 300°C, 600°C, and 800°C were analyzed. Finally, Weibull statistical analysis was performed, which showed an increase in reliability when a reinforcement phase was added to K‐geopolymer.

Ribero, Daniel↗
DOE OSTI2026

Design Trade-Offs in Composite Fuel Cell Membranes: Effects of Reinforcement and Chemical Additives

Perfluorosulfonic acid (PFSA) membranes are critical components in proton exchange membrane fuel cells, where performance depends on balancing ionic conductivity, mechanical durability, and chemical stability. This study characterizes a composite membrane (NC700) featuring PFSA-impregnated expanded polytetrafluoroethylene (ePTFE) reinforcement and cerium-based radical scavengers, benchmarked against unreinforced NR211. Complementary techniques, including electron microscopy, X-ray scattering, infrared spectroscopy, thermogravimetric analysis, and dynamic mechanical analysis, identify the structural and compositional strategies employed in NC700. Water sorption isotherms reveal lower water uptake for NC700 across all conditions, attributed to reinforcement and cerium incorporation. Reinforcement reduces in-plane swelling from 11% to 2.1% at 90% RH, confirming strong swelling anisotropy, while maintaining mechanical properties at elevated temperatures. While the ionic conductivity of NC700 is approximately 10% lower than that of NR211, the reduced thickness yields a 40% decrease in calculated area-specific resistance, suggesting the composite architecture can favorably shift the conductivity-stability trade-off. The composite structure also reduces gas permeability, indicating potential for improved separator function alongside favorable transport properties. Systematic deconvolution of reinforcement and additive contributions shows that conductivity losses from cerium incorporation are largely offset by gains from the lower equivalent-weight polymer, providing quantitative relationships that may guide composite membrane design for fuel cells and other electrochemical applications.

25 ENERGY STORAGE↗
DOE OSTI2023

Evaluation of Desiccation Behavior in Basalt Microfiber–Reinforced Bentonite Clay for Geological Repositories of Nuclear Spent Fuel Using Digital Image Correlation

ABSTRACT Secure storage of nuclear spent fuel (NSF) is of great concern for protecting public health and safety. The preferred long-term solution is underground containment in geological repositories, where one or more engineered barrier materials (EBM) encapsulate the NSF and separate it from the natural rock. Bentonite clay is commonly used as an EBM due to its many advantageous properties including low hydraulic conductivity, which ensures limitation of water infiltration to the system and the subsequent risk of corrosion in NSF canisters. However, bentonite clay subjected to heating from nuclear decay may form desiccation cracking. This study conducted disk-shaped free shrinkage tests and ring-shaped restrained shrinkage tests of bentonite clay samples reinforced with basalt microfibers. Digital image correlation was used as a noncontact full-field displacement measurement to track the time-evolving shrinkage and desiccation cracking phenomena and make quantified comparisons between plain bentonite and bentonite with varying contents of basalt microfibers (i.e., 0.0, 0.5, 1.0, and 1.5 % wt.). Results indicate that plain bentonite and basalt microfiber-reinforced samples showed similar free shrinkage behavior, while desiccation cracking behavior was significantly altered by adding basalt microfibers. Microfiber reinforcement effectively reduced major cracks through a “crack-bridging” effect while causing minor cracks to initiate earlier and at higher moisture contents than plain bentonite. Results infer that reinforcing plain bentonite with inorganic microfibers can potentially control desiccation cracking, leading to safer and improved nuclear waste management.

Materials Science↗
DOE OSTI2025

Virtual to Physical: Reinforcement Learning to Optimize SNS Particle Accelerator Controls

Complex accelerators must have control systems that can handle dynamic nonlinear environments. This makes traditional control methods unsuitable as they can struggle to adapt to these uncertainties. This provides an ideal environment for reinforcement learning algorithms as they are adaptable and generalizable. We present a reinforcement learning pipeline that can effectively handle the dynamics of a complex accelerator. We test and prove our pipelines capabilities on multiple environments including the Spallation Neutron Source (SNS) and the Beam Test Facility (BTF) at Oakridge National Lab (ORNL). Due to the limited time available to train an online algorithm like reinforcement learning on a real accelerator, we utilize a virtual twin accelerator (VIRAC) developed by ORNL to pretrain the policy and show its ability to converge in the virtual environment. We then test the adaptability of the pretrained RL model by applying it on the real accelerator and comparing the results. Utilizing our Scientific Optimization and Controls Toolkit (SOCT) and open-source standards such as Gymnasium we create and solve for a MEBT orbit correction problem in the SNS and an emittance maximization problem in the BTF. We show how Twin Delayed Deep Deterministic Policy Gradient (TD3) can solve this optimization environment in the virtual accelerator and transfer this policy onto the real accelerator for inference and model retraining. We show how reinforcement learning can be utilized as a control system for complex accelerators and provide a model pipeline for how an implementation performs and can be adapted to new accelerator control problems.

Kasparian, Armen [Thomas Jefferson National Accele↗