SEARCH · Engineering Papers
Results for “Reinforcement learning”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Reinforcement learning framework for the mechanical design of microelectronic components under multiphysics constraints
Explore the source record for details and available documents.
Optimization of the FRIB beam dump: a hybrid genetic algorithm and reinforcement learning approach
The operational envelope of high-power-density systems, such as particle accelerators and advanced nuclear energy systems, is critically constrained by the need to manage extreme thermal loads. To address this, we present a novel hybrid optimization framework combining a genetic algorithm (GA) with a soft actor-critic (SAC) deep reinforcement learning agent. This framework was applied to a practical high-heat-flux problem: redesigning the beam dump at the Facility for Rare Isotope Beams (FRIB) for a power upgrade from 20 kW to 50 kW. The resulting design, validated by three-dimensional conjugate heat transfer simulations, suppresses hazardous hot spots and yields a markedly more uniform temperature distribution. This provides a robust operating margin, increasing the average power-handling capability by 72% relative to the current design, demonstrating the framework’s potential to solve complex thermal management challenges in both accelerator technology and advanced nuclear systems.
User-Centric Communication With Aerial Network for 6G: A Reinforcement Learning Approach
Meeting the diverse needs of user verticals requires innovative cellular architectures that can offer additional degrees of freedom to provide on-demand services. The terrestrial user-centric radio access network (UC-RAN) stands out as an excellent choice for this purpose. However, a drawback of UC-RAN is its tendency to prioritize high-priority verticals, often resulting in a subpar quality of experience for low-priority verticals. This issue is particularly exacerbated in hotspot areas. Here, to address this problem, we introduce an aerial network integrated with terrestrial UC-RAN to provide coverage to users which are not served by the terrestrial network. Furthermore, we analyze the impact of key configuration and optimization parameters (COPs), such as location, transmit power, altitude, and beamwidth of aerial base stations (ABSs) on system key performance indicators (KPIs), such as coverage, latency satisfaction, average spectral efficiency, and energy efficiency. We formulate a robust multiobjective function to maximize these KPIs without biasing toward any specific KPI(s). Finally, we propose a deep reinforcement learning optimization framework based on the state-of-the-art soft actor-critic algorithm to control ABS COPs and optimize system KPIs. Experimental evaluations demonstrate that the proposed optimization framework can converge to near-optimal solutions derived from the pseudo brute force in a few thousand epochs.
Deep RL for Fast Long-Horizon Operations Scheduling on NASA's Carruthers Geocorona Observatory Mission
Spacecraft operations scheduling is a highly constrained, long-horizon combinatorial optimization problem that traditionally relies on heuristics, constraint programming, or manual planning. We present a scalable deep reinforcement learning framework developed and deployed for NASA’s Carruthers Geocorona Observatory mission. Our framework introduces a macro-action abstraction known as activity blocks coupled with dynamic action-masking to navigate the intractably large search space and strictly enforce complex power, thermal, and instrument constraints. The resulting architecture generates globally feasible schedules with overwhelming probability, establishes operational trust, and executes a full training cycle in under six hours, circumventing the need for policy robustness by enabling rapid, on-demand retraining. Further, resulting schedules outperform baseline heuristics in scheduled science quality. The deep reinforcement learning framework was deployed as the default operational scheduler for the Carruthers Geocorona Observatory mission from the outset of the mission, demonstrating that deep reinforcement learning can be trusted for real spacecraft operations under complex, evolving constraints.
Manufacturing Process Development of a Carbon Fiber Reinforced Polymer Composite Shaft for Electric Motors
Electric aircraft applications require electric motors with increased specific power and efficiency. Composite structural components in motors are a potential solution for reducing motor mass, reducing magnetic losses, and limiting undesired conduction paths for fault, electromagnetic interference, or common-mode currents. In this report, manufacturing trials for a high-speed carbon fiber reinforced polymer composite motor shaft are presented. Four prototype shafts were produced using a hybrid biaxial/triaxial fabric that was circumferentially wrapped onto an additively manufactured high-temperature washout mandrel. An additional traditional overbraid approach was also evaluated and shows promise for high-rate, high-performance parts using automated manufacturing. This paper discusses the shaft design, manufacturing methods explored, material selection, the manufacturing trials, and the lessons learned. The results of this manufacturing investigation show feasibility for manufacturing composite shafts for electric motors.
Feedback, physics, and forecasts: The emerging paradigm of machine learning-driven battery research
Machine learning (ML) is reshaping how we understand, predict, and optimize electrochemical systems. In batteries, ML accelerates discovery across chemistry, design, and operation by transforming massive experimental and simulated datasets into predictive, interpretable models. This review consolidates a decade of progress in ML-driven battery innovation, from early-cycle feature extraction to operando image analysis and physics-informed modeling. We categorize approaches by data domain and physical fidelity, emphasizing interpretable ML for diagnostics, reinforcement learning for control, and multi-objective optimization for lifetime extension strategies. Additionally, we demonstrate how integrated models accelerate discovery, reduce testing time, and guide sustainable design. Economic analyses furthermore illustrate how these advances can lower cost per cycle and improve circularity. Together, these developments chart a path toward self-optimizing, sustainable battery technologies.
Micrometer: Micromechanics transformer for predicting full field mechanical responses of heterogeneous materials
Predicting mechanical responses of heterogeneous materials across scales remains a significant challenge. Traditional computational methods often struggle with complex and multiscale nature of these materials, limiting their effectiveness in real-world applications. Here, in this paper, we introduce Micrometer, a vision transformer based deep learning model designed to predict full field mechanical responses of heterogeneous materials, bridging the gap between computer vision and solid mechanics problems. We show that Micrometer, trained on a large-scale high-resolution dataset of 2D fiber-reinforced composites, can achieve state-of-the-art performance in predicting microscale strain fields across a wide range of material properties and loading conditions. Our model demonstrates accuracy and computational efficiency in applications such as computational homogenization and multiscale modeling, reducing computational time by up to two orders of magnitude compared to conventional numerical solvers while maintaining less than 1 % errors in predicting macroscale stress fields. Furthermore, we showcase Micrometer’s adaptability through transfer learning experiments on new materials with limited data, highlighting its potential to tackle diverse scenarios in computational solid mechanics. These results represent a significant step towards AI-driven innovation in materials science, addressing the limitations of traditional numerical methods and paving the way for more efficient simulations of heterogeneous materials across various industrial applications.
Large Language Model for Validation, Optical Calibration, and Learning (VOCAL) Distributed Temperature Sensing Interface
Distributed temperature sensing (DTS) using fiber optic sensors (FOS) offers a promising method for temperature measurements in advanced reactors, such as sodium fast reactors and molten salt cooled reactors. To support the calibration and validation of DTS measurements, Argonne National Laboratory developed the Validation, Optical Calibration, and Learning (VOCAL) software package. This report describes the integration of a local large language model (LLM) with a retrieval-augmented generation (RAG) system into the VOCAL interface to serve as an interactive user assistant. The LLM framework enhances the VOCAL platform’s accessibility to users by explaining interface components, clarifying inputs and outputs, and answering user queries dynamically in real-time. The accuracy of the LLM assistant performance was evaluated with 20 queries regarding the interface and its parameters using experimental data from the Thermal Hydraulic Experimental Test Article (THETA) facility. Results demonstrate that the LLM achieved a 95% accuracy rate, with a BERTScore of 0.8816 and SBERT value of 0.7417. Furthermore, validation of the RAG system within the LLM framework showed optimal accuracy with k-values between 1 and 2 using the k-refinement convergence test. The prompt perturbation analysis demonstrated good initial consistency for the RAG system, exhibiting the highest accuracy under punctuation variations and the greatest sensitivity under query reordering. Notably, the model’s errors were limited to data retrieval failures rather than factual hallucinations, reinforcing its baseline reliability. The integration of LLM provides a highly accurate, userfriendly enhancement to the VOCAL platform without disrupting its core computational capabilities for FOS calibration and validation.
In-Situ Scanning Electron Microscope Experiments for Microscale Mechanical Testing and Validated Modeling of Fiber Reinforced Thermoplastics
A novel, in-situ, scanning electron microscope (SEM) mechanical testing capability for materials at the microscale which provides experimental validation to a machine learning (ML) toolset for full-field validation of physics-based micromechanics models is being developed by researchers at NASA Glenn Research Center. These are enabling technologies for the integration of multiscale digital twins for materials into system level models which will result in the improved performance, material discovery, reduced production cost and time, rapid characterization, and prognostic structural health monitoring (SHM) for materials and structures for extreme environments in support of NASA space exploration missions. In order to bridge the material structure-to-system gap for digital twins, physics-based models must be experimentally validated at multiple length scales. Seminal microscale experiments, conducted at the Air Force Research Laboratory (AFRL), were limited to transverse compression of single-layer, unidirectional thermoset polymer matrix composite (PMC) micropillar specimens [1]. The early phases of the current project followed those initial results and setup to reproduce the compression testing of PMC material on the custom-built piezoelectric actuated micromechanical testing rig built by MicroTesting Solutions LLC. In this work, samples of thermoplastic PMC material were first machined into 3 mm cubes, and then further machining and final milling was done using a Focused Ion Beam (FIB). The initial experiment was done on a pillar roughly 20 µm x 20 µm x 40 µm tall. Additional pillars were milled with final sizes ranging from 20 µm x 20 µm x 40 µm tall to 40 µm x 40 µm x 65 µm tall. A speckle pattern for in-situ full-field measurements using Digital Image Correlation (DIC) was applied with platinum, which was coated on the surface, and then the FIB was used to mill away some of the coating to produce an irregular pattern of Pt on the pillar surface. The samples were loaded into the custom testing rig and placed into the SEM and loaded under compression until failure. Images were collected in the SEM during testing. Post-processing of the images was conducted using DIC to obtain full-field displacement and strain measurements elucidating the role of the matrix as well as fiber-fiber interaction at the microscale within the composite subjected to compression loading well into the non-linear regime of the material. Moreover, the evolution of fiber-matrix debonding and matrix cracking is observed in-situ at the microscale. This data, along with images segmented with a newly developed ML toolset [2], was used to create and validate physics-based micromechanics models. An image of the failed micropillar is shown in Figure 1. The techniques developed in the initial compression experiment was tailored to the validation needs of the models and expanded to include different sized samples as well as possibly tension and fatigue.
3D Reinforced Composites for Improved Impact Resistance in Spacesuits
Explore the source record for details and available documents.
Detection of Trace Silicone Contamination on Carbon Fiber Reinforced Composite (CFRP) Surfaces by Picosecond Laser Induced Breakdown Spectroscopy (LIBS)
Explore the source record for details and available documents.
Validation of Ultrasonic Techniques for Reinforcing Bar Stress Measurement in Concrete Structures Considering Temperature Effect
Explore the source record for details and available documents.
Finite Element Model for Air Permeability of Cracked Reinforced Concrete Plates
Explore the source record for details and available documents.
Coordinated Architectural and Chemical Reinforcement in the Crushing Mandible of a Soldier Termite
Explore the source record for details and available documents.
Design Trade-Offs in Composite Fuel Cell Membranes: Effects of Reinforcement and Chemical Additives
Perfluorosulfonic acid (PFSA) membranes are critical components in proton exchange membrane fuel cells, where performance depends on balancing ionic conductivity, mechanical durability, and chemical stability. This study characterizes a composite membrane (NC700) featuring PFSA-impregnated expanded polytetrafluoroethylene (ePTFE) reinforcement and cerium-based radical scavengers, benchmarked against unreinforced NR211. Complementary techniques, including electron microscopy, X-ray scattering, infrared spectroscopy, thermogravimetric analysis, and dynamic mechanical analysis, identify the structural and compositional strategies employed in NC700. Water sorption isotherms reveal lower water uptake for NC700 across all conditions, attributed to reinforcement and cerium incorporation. Reinforcement reduces in-plane swelling from 11% to 2.1% at 90% RH, confirming strong swelling anisotropy, while maintaining mechanical properties at elevated temperatures. While the ionic conductivity of NC700 is approximately 10% lower than that of NR211, the reduced thickness yields a 40% decrease in calculated area-specific resistance, suggesting the composite architecture can favorably shift the conductivity-stability trade-off. The composite structure also reduces gas permeability, indicating potential for improved separator function alongside favorable transport properties. Systematic deconvolution of reinforcement and additive contributions shows that conductivity losses from cerium incorporation are largely offset by gains from the lower equivalent-weight polymer, providing quantitative relationships that may guide composite membrane design for fuel cells and other electrochemical applications.
Polymer grafted aramid nanofiber reinforces immiscible waste polypropylene/poly(ethylene terephthalate)
Polypropylene (PP) and poly(ethylene terephthalate) (PET) are plastics commonly used for packaging because of their excellent barrier and mechanical properties. The properties of these plastics are often diminished after mechanical recycling, inevitably causing down-cycling. Furthermore, this problem is exacerbated when different kinds of polymers mix. Aramid nanofibers have the potential to improve the mechanical properties of polymers due to their excellent mechanical properties but their poor dispersion in polymers is a challenge. Grafting polymers onto nanofibers can help address this challenge. In this work, different loading levels (1%, 2%, and 5%) of polymer grafted aramid nanofibers (ANFs) are blended with waste PP/PET (90/10), simulating a PP waste stream containing traces of PET contaminants. Scanning electronic microscopy, rheology, and differential scanning calorimetry results show the affinity of PP functionalized aramid nanofibers (PP_ANF) towards the PP matrix. At 1 wt% of the nanofiber, the size of the PET droplets in the PP matrix of the PP_ANF blend range from 0.2 to 2.0 μm while that of unmodified ANF and PET_ANF blends are in the range of 0.1–6.2 and 0.5–7.4 μm, respectively. In summary, polymer grafted ANFs have the tendency of improving properties of its like polymers due to similarity in the grafting polymer and the polymer matrix.
Enhancement of the Physical and Mechanical Properties of Cellulose Nanofibril-Reinforced Lignocellulosic Foams for Packaging and Building Applications
Biobased foams have the potential to serve as eco-friendly alternatives to petroleum-based foams, provided they achieve comparable thermomechanical and physical properties. We propose a facile approach to fabricate eco-friendly cellulose nanofibril (CNF)-reinforced thermomechanical pulp (TMP) fiber-based foams via an oven-drying process with thermal conductivity as low as 0.036 W/(m·K) at a 34.4 kg/m3 density. Acrodur®, iron chloride (FeCl3), and cationic polyacrylamide (CPAM) were used to improve the foam properties. Acrodur® did not have any significant effect on the foamability and density of the foams. Mechanical, thermal, cushioning, and water absorption properties of the foams were dependent on the density and interactions of the additives with the fibers. Due to their high density, foams with CPAM and FeCl3 at a 1% additive dosage had significantly higher compressive properties at the expense of slightly higher thermal conductivity. There was slight increase in compressive properties with the addition of Acrodur®. All additives improved the water stability of the foams, rendering them stable even after 24 h of water absorption.