Engineering PapersSearch

SEARCH · Engineering Papers

Results for “Reinforcement learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

Deep RL for Fast Long-Horizon Operations Scheduling on NASA's Carruthers Geocorona Observatory Mission

Spacecraft operations scheduling is a highly constrained, long-horizon combinatorial optimization problem that traditionally relies on heuristics, constraint programming, or manual planning. We present a scalable deep reinforcement learning framework developed and deployed for NASA’s Carruthers Geocorona Observatory mission. Our framework introduces a macro-action abstraction known as activity blocks coupled with dynamic action-masking to navigate the intractably large search space and strictly enforce complex power, thermal, and instrument constraints. The resulting architecture generates globally feasible schedules with overwhelming probability, establishes operational trust, and executes a full training cycle in under six hours, circumventing the need for policy robustness by enabling rapid, on-demand retraining. Further, resulting schedules outperform baseline heuristics in scheduled science quality. The deep reinforcement learning framework was deployed as the default operational scheduler for the Carruthers Geocorona Observatory mission from the outset of the mission, demonstrating that deep reinforcement learning can be trusted for real spacecraft operations under complex, evolving constraints.

Geocorona

Manufacturing Process Development of a Carbon Fiber Reinforced Polymer Composite Shaft for Electric Motors

Electric aircraft applications require electric motors with increased specific power and efficiency. Composite structural components in motors are a potential solution for reducing motor mass, reducing magnetic losses, and limiting undesired conduction paths for fault, electromagnetic interference, or common-mode currents. In this report, manufacturing trials for a high-speed carbon fiber reinforced polymer composite motor shaft are presented. Four prototype shafts were produced using a hybrid biaxial/triaxial fabric that was circumferentially wrapped onto an additively manufactured high-temperature washout mandrel. An additional traditional overbraid approach was also evaluated and shows promise for high-rate, high-performance parts using automated manufacturing. This paper discusses the shaft design, manufacturing methods explored, material selection, the manufacturing trials, and the lessons learned. The results of this manufacturing investigation show feasibility for manufacturing composite shafts for electric motors.

Electric moto shaft

In-Situ Scanning Electron Microscope Experiments for Microscale Mechanical Testing and Validated Modeling of Fiber Reinforced Thermoplastics

A novel, in-situ, scanning electron microscope (SEM) mechanical testing capability for materials at the microscale which provides experimental validation to a machine learning (ML) toolset for full-field validation of physics-based micromechanics models is being developed by researchers at NASA Glenn Research Center. These are enabling technologies for the integration of multiscale digital twins for materials into system level models which will result in the improved performance, material discovery, reduced production cost and time, rapid characterization, and prognostic structural health monitoring (SHM) for materials and structures for extreme environments in support of NASA space exploration missions. In order to bridge the material structure-to-system gap for digital twins, physics-based models must be experimentally validated at multiple length scales. Seminal microscale experiments, conducted at the Air Force Research Laboratory (AFRL), were limited to transverse compression of single-layer, unidirectional thermoset polymer matrix composite (PMC) micropillar specimens [1]. The early phases of the current project followed those initial results and setup to reproduce the compression testing of PMC material on the custom-built piezoelectric actuated micromechanical testing rig built by MicroTesting Solutions LLC. In this work, samples of thermoplastic PMC material were first machined into 3 mm cubes, and then further machining and final milling was done using a Focused Ion Beam (FIB). The initial experiment was done on a pillar roughly 20 µm x 20 µm x 40 µm tall. Additional pillars were milled with final sizes ranging from 20 µm x 20 µm x 40 µm tall to 40 µm x 40 µm x 65 µm tall. A speckle pattern for in-situ full-field measurements using Digital Image Correlation (DIC) was applied with platinum, which was coated on the surface, and then the FIB was used to mill away some of the coating to produce an irregular pattern of Pt on the pillar surface. The samples were loaded into the custom testing rig and placed into the SEM and loaded under compression until failure. Images were collected in the SEM during testing. Post-processing of the images was conducted using DIC to obtain full-field displacement and strain measurements elucidating the role of the matrix as well as fiber-fiber interaction at the microscale within the composite subjected to compression loading well into the non-linear regime of the material. Moreover, the evolution of fiber-matrix debonding and matrix cracking is observed in-situ at the microscale. This data, along with images segmented with a newly developed ML toolset [2], was used to create and validate physics-based micromechanics models. An image of the failed micropillar is shown in Figure 1. The techniques developed in the initial compression experiment was tailored to the validation needs of the models and expanded to include different sized samples as well as possibly tension and fatigue.

Laura Wilson

Micromechanical Design of Carbon Nanotube Ribbon Reinforced Polymer Composite Materials

Lightweight materials are an important component of the design of aerospace structures. Carbon nanotube materials have been considered for this purpose due to the strength and stiffness of individual nanotubes, and the commercial availability of bulk formats such as fibers. These fibers can have a ribbon cross section which results in a different design space for their composites relative to traditional reinforcements which have a round cross section. This work applies brick-and-mortar micromechanical models and classical lamination theory with an inverse approach to investigate the design space of these composites. Using this approach, the influences of fiber geometry and axial and transverse mechanical properties are mapped. Finally, a sensitivity study is performed and the relative impacts of ±10% variations in the constituent material and geometric properties are ranked. Lamina axial moduli were found to range from a maximum of 3x to 1x minimum relative to a target quasi-isotropic laminate modulus depending on the anisotropy and shear modulus of the lamina. The fiber targets depended strongly on the fiber volume fraction in the lamina and the fiber axial modulus target was found to range from 4.8x to 3.2x the quasi-isotropic laminate target. The sensitivity analysis found that the largest driver of performance was the volume fraction, followed by the fiber axial modulus. While bio-based brick-and-mortar composites, such as nacre, can benefit from reinforcement aspect ratios above 10, for carbon nanotube ribbon (or carbon fiber)/polymer composites the sensitivity study indicated that the optimal cross-sectional aspect ratio was relatively smaller, potentially less than three.

Micromechanics

Influence of Processing Parameters on the Mechanical Properties of 3D Printed Borosilicate Particulate Reinforced Polymer Composites

Emerging composite materials are expanding the potential of additive manufacturing and enabling applications previously restricted by traditional manufacturing methods. The multi-phase nature of these composite materials combined with the complex in-ternal geometry of additively manufactured parts have enabled unique behavior, and potentially new applications. Additionally, these materials can be pyrolyzed to create dense metal, ceramic, and glass parts with geometries typically not achievable by tra-ditional processes. Additive manufacturing of borosilicate glass-based systems can open new applications in nuclear engineering, astronomy, and bone regrowth therapy. To elucidate the process-parameter relationship of borosilicate-polylactic acid (PLA) composites, mechanical testing was conducted and compared with a pure polylactic acid polymer baseline. Test specimens were fabricated by fused-filament fabrication with minimal post-processing. Yield strength, ultimate strength, and elastic modulus were calculated from stress-strain curves. Optical and scanning electron microscopy were conducted to observe the specimen microstructure before and after testing. The highest compressive yield strength for the composite was 28.22 MPa, and the highest compressive yield strength for PLA was 49.30 MPa. Print orientation was found to benefit the composite material but have a detrimental effect on the pure matrix material. An elastic modulus of 2.66 GPa was recorded for the borosilicate-PLA composite at 100% infill, 1 shell wall, and layer lines parallel to compression axis. Microscopy revealed that lower modulus composite specimens had the particulates re-distributed within the matrix. Tensile testing was done according to a polymer testing standard, which caused difficulties obtaining consistent fracture within the gauge length.

mechanical testing

Mechanical Properties of Carbon Fiber Reinforced Composites Exposed to Cryogenic Conditions and Space Radiation via Simulation and Testing

As NASA missions extend beyond low Earth orbit, increasing reliance is placed on carbon fiber reinforced polymer (CFRP) composites for spacecraft structures where mass efficiency, durability, and long-term reliability are critical. In service, these materials are subjected to a combination of ultraviolet radiation, vacuum, ionizing radiation, atomic oxygen, and extreme thermal excursions under sustained mechanical loading. Flight systems such as the Boeing Starliner and SpaceX Dragon employ external composite structures that will experience these environments for extended durations. Although prior spaceflight and ground studies have reported limited changes in bulk mechanical properties, the synergistic effects of these environments on composite microstructure, particularly at the fiber matrix interphase, remain insufficiently characterized and represent a potential qualification and reliability risk. This study investigates the effects of short-term cryogenic exposure on a radiation shielding carbon epoxy composite, SC2020, as a ground-based analog for space relevant thermal extremes. The SC2020 material system has previously flown on the International Space Station under the Materials International Space Station Experiment (MISSE) program. Composite specimens were exposed to liquid nitrogen for 6 and 24 hours and evaluated using a multiscale characterization framework that combined ASTM D3039 tensile testing, Atomic Force Microscopy (AFM) based interphase analysis, and helium gas permeability measurements. Tensile testing showed no statistically significant or permanent degradation in global strength or modulus following cryogenic exposure. In contrast, AFM measurements revealed reductions in interphase modulus, weakened adhesion, and increased nanoscale heterogeneity, indicating localized degradation mechanisms not captured by conventional bulk testing. Gas permeability measurements showed a progressive increase in helium diffusion with exposure duration, consistent with micro-void formation or partial interfacial debonding. The results indicate that cryogenic exposure initiates degradation at the fiber matrix interphase while leaving global mechanical properties largely unchanged over short durations. These findings underscore the importance of multiscale diagnostics for identifying early-stage damage mechanisms that may influence long term performance and qualification margins for spaceflight composite structures. The data presented establish a cryogenic baseline for comparison with forthcoming MISSE flight exposure results and support ongoing NASA Established Program to Stimulate Competitive Research (EPSCoR) efforts aimed at improving composite qualification methodologies, risk assessment, and reliability prediction for space environments.

composite reliability

MSFC Thermal Testing Lessons Learned Course. Section 3: Lessons Learned from Protoflight StarBurst Instrument Thermal Vacuum Test

MSFC thermal engineers will be presenting lessons learned while preparing and conducting thermal tests. This course will cover practical real world examples of thermal chamber and vacuum chamber testing from engineering development units to system level testing on flight hardware. Special topics include large scale testing preparation, requirement tailoring from parent documents, and cryogenic development testing.

thermal discipline

A Frank Discussion on Lessons Learned From Adopting and Applying NASA-STD-6030 for Spaceflight Systems

With the advancement and adoption of Additive Manufacturing (AM) for spaceflight systems, numerous lessons have been learned during the qualification and certification of AM components. The lessons learned covered in this presentation will provide an overview of the challenges faced by NASA centers and commercial partners working to design AM hardware that complies with NASA-STD-6030 Additive Manufacturing Requirements (AMR). Topics of interest include tailoring of requirements for specific projects, documentation requirements, and addressing conservative approaches towards mechanical property development and analysis. In addition to that, this presentation aims to impress that these lessons learned will influence the future revisions of the NASA technical standard to facilitate and advance AM technology adoption on NASA projects.

Additive Manufacturing

Improving Adhesive Bondline Time of Flight Predictions During Autoclave Cure Utilizing Machine Learning

Composite materials are increasingly being used in aerospace applications due to their superior strength-to-weight ratio compared to commonly used metals. A current limitation to widespread adoption is the certification of adhesively bonded joints. One approach to improving adhesive bonding in composites is accurately measuring the thickness of adhesive bondlines in composite laminates. Precise bondline thickness control is essential for aerospace applications where adhesive layer thickness directly affects joint fracture properties and structural performance. This study focused on implementing machine learning techniques to determine the ultrasonic time of flight (directly correlated to thickness) in adhesive bondlines throughout autoclave cure cycles. A high-temperature (use up to 180°C) ultrasonic scanning system was deployed in an autoclave to provide time of flight data through composite panels. Three experiments were conducted on the curing of 305 mm × 305 mm unidirectional composite panels. In the first experiment, a piecewise function was fit for the temperature correction factor to account for changing autoclave temperatures. Due to deficiencies in the first calibration experiment, a second experiment was run, and the results were used to train a machine learning model. The revised experiment, in combination with the machine learning model, significantly increased the accuracy of the bondline time of flight predictions (~14% error reduced to <1%). Data was processed using the Regression Learner Application in MATLAB®, with a Support Vector Machine selected for the model. The result was a machine learning algorithm capable of reliably quantifying ultrasonic time of flight through adhesive bondlines. The third experiment provided independent test data for the machine learning model, demonstrating that the model produces accurate predictions from data beyond its training set.

Machine Learning

Developmental and Cryogenic Thermal Vacuum (TVAC) Testing Lessons Learned

Developmental thermal vacuum (TVAC) testing is a critical step in maturing hardware designs and validating performance prior to flight qualification. Unlike qualification or acceptance testing, developmental testing provides flexibility to explore design margins, uncover integration challenges, and refine test approaches before formal verification activities begin. This presentation highlights the value of developmental testing while sharing common pitfalls encountered during developmental TVAC campaigns. Lessons learned from hands-on testing experience, including extensive developmental testing at cryogenic temperatures, will be shared in this presentation. Topics include test planning and preparation, instrumentation strategies, contamination control considerations, troubleshooting unexpected anomalies, and approaches for staying on schedule while meeting test objectives. The audience will gain practical insights and best practices that can improve test efficiency, reduce risk, and enhance the overall success of future developmental TVAC efforts.

Mackenzie Byrnes

CLDP/ISS Glovebox Technical Interchange Meeting

This presentation is designed to provide a high-level overview of the Microgravity Science Glovebox (MSG) and the Life Sciences Glovebox (LSG) facilities onboard the International Space Station. In addition, it provides metrics and lessons-learned information intended for the Commercial Low-Earth Orbit Development Program (CLDP) Partners.

glovebox

NASA Talks: Space Shuttle Columbia - Lessons Learned

On February 25, 2026, two NASA Talks were held regarding the Space Shuttle Columbia (Columbia Launch & Recovery, Columbia Reconstruction, Investigation, Causes & Key Takeaways). Crew & Thermal System Division (EC) partnered with Kennedy Space Center (KSC) and Engineering Directorate (EA) to bring these talks to Johnson Space Center (JSC) centering on what led up to and transpired after the Space Shuttle Columbia accident. Some recovered debris was on exhibit during the talks. NASA Mishap Program Specialist David Erickson and retired NASA Columbia Vehicle Manager Scott Thurston presented these talks. Mr. Erickson supports NASA mishap investigations and assists with the development of NASA's new Columbia Learning Center at KSC. Mr. Thurston brought a wealth of knowledge from his mission experience. These talks were timely and a solemn reminder of the critical importance of diligence, safety, and excellence in our work. EA Director Julie Kramer White welcomed the 400+ center-wide in-person audience, and EC Division Chief Rubik Sheth introduced the speakers. This event was held in the JSC Teague Auditorium, recorded, and executed by the EC in-house STAR Productions team.

Space Shuttle Columbia