Engineering PapersSearch

SEARCH · Engineering Papers

Results for “deep reinforcement learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

Deep RL for Fast Long-Horizon Operations Scheduling on NASA's Carruthers Geocorona Observatory Mission

Spacecraft operations scheduling is a highly constrained, long-horizon combinatorial optimization problem that traditionally relies on heuristics, constraint programming, or manual planning. We present a scalable deep reinforcement learning framework developed and deployed for NASA’s Carruthers Geocorona Observatory mission. Our framework introduces a macro-action abstraction known as activity blocks coupled with dynamic action-masking to navigate the intractably large search space and strictly enforce complex power, thermal, and instrument constraints. The resulting architecture generates globally feasible schedules with overwhelming probability, establishes operational trust, and executes a full training cycle in under six hours, circumventing the need for policy robustness by enabling rapid, on-demand retraining. Further, resulting schedules outperform baseline heuristics in scheduled science quality. The deep reinforcement learning framework was deployed as the default operational scheduler for the Carruthers Geocorona Observatory mission from the outset of the mission, demonstrating that deep reinforcement learning can be trusted for real spacecraft operations under complex, evolving constraints.

Geocorona

Physics-Guided Deep Learning for Complex System Health Management and Decision Making

The landscape of complex engineered systems is rapidly evolving, from smart manufacturing facilities to next-generation transportation vehicles. As these systems become increasingly sophisticated and interconnected, the need for advanced health management systems grows ever more critical. These systems must go beyond simple monitoring, actively predicting potential failures before they occur. This paradigm shift from fixed maintenance schedules to condition-based predictions is key to optimizing system performance, enhancing safety, and paving the way for autonomous decision-making across various industries. Whether in industrial processes, energy systems, or advanced transportation, the ability to anticipate and prevent failures is becoming a cornerstone of operational excellence. To accurately predict the future health of any complex system, knowledge of its current health state and future operational conditions is essential. Recent advancements in data-driven algorithms have generated growing interest in artificial intelligence for industrial applications. However, the limitations of pure data-driven methods, particularly in industries where data acquisition is costly and limited, have become apparent. This has led to a focus on blending physics with data-driven algorithms, mitigating the drawbacks of both approaches while emphasizing their respective advantages. This research proposes a novel framework for integrating physics-based performance models with deep learning algorithms for the prognostics of complex safety-critical systems. In this approach, physics-based models serve as a blueprint, capturing fundamental system behaviors, while deep learning algorithms, leveraging real-world sensor data, fill in gaps and identify subtle patterns indicative of potential problems. This hybrid methodology, utilizing techniques such as Physics-Informed Neural Networks (PINNs), offers a powerful solution for predicting system health. By fusing domain knowledge with data-driven insights, this approach promises more accurate, adaptable, and reliable models for health prediction. The resulting framework is versatile, applicable across various sectors including aerospace, manufacturing, and energy systems, ultimately contributing to safer, more efficient operations in our increasingly complex technological landscape.

Diagnostics

PERSIANN-Unet: A Global Deep Learning Framework for Near-Real-Time Precipitation Estimation Using Infrared Data

Access to high-quality, high-resolution, near-real-time precipitation data is essential for hydrological and meteorological research and disaster mitigation. Traditional tools such as rain gauges and radar networks, though effective, have limitations, including sparse coverage in remote areas and high operational costs. Satellite data, with its global coverage and high spatial and temporal resolutions, mitigates limitations in coverage. Satellite precipitation products like Hydro Estimator (HE), Integrated Multi-satellitE Retrievals for Global Precipitation Measurement (IMERG), and Precipitation Estimation from Remotely Sensed Information using Artificial Neural Networks (PERSIANN) utilize both geosynchronous thermal infrared (IR) and passive microwave (PMW) data in their operation. PMW sensors offer detailed atmospheric profiles but suffer from higher latency, whereas IR sensors provide lower latency but only capture cloud-top information. Despite this constraint, IR data remains attractive for low-latency precipitation estimation. Recent advances in deep learning, particularly convolutional neural networks (CNNs), have further improved satellite precipitation retrievals. This study introduces PERSIANN-Unet (PUnet or PERSIANN V3), a quasi-global algorithm covering 60°N–60°S that combines IR data, monthly climatology, and the UNet architecture to produce half-hourly precipitation estimates at 0.04° resolution. The product is evaluated against HE, IMERG, and PDIR-Now for 2022–2023. Results show that PUnet closely matches its training target, IMERG V07 Final, at the global scale, and performance is further evaluated against Stage IV as a reference over CONUS. Training PUnet on IMERG (2016–2021) leverages a high-quality, integrated PMW IR-gauge precipitation product while developing an IR-based framework not reliant on PMW availability. By operating on a single global image, PUnet avoids tile partitioning and blending steps, reducing edge discontinuities, and produces more spatially consistent precipitation fields across hemispheres.

Phu Nguyen

Manufacturing Process Development of a Carbon Fiber Reinforced Polymer Composite Shaft for Electric Motors

Electric aircraft applications require electric motors with increased specific power and efficiency. Composite structural components in motors are a potential solution for reducing motor mass, reducing magnetic losses, and limiting undesired conduction paths for fault, electromagnetic interference, or common-mode currents. In this report, manufacturing trials for a high-speed carbon fiber reinforced polymer composite motor shaft are presented. Four prototype shafts were produced using a hybrid biaxial/triaxial fabric that was circumferentially wrapped onto an additively manufactured high-temperature washout mandrel. An additional traditional overbraid approach was also evaluated and shows promise for high-rate, high-performance parts using automated manufacturing. This paper discusses the shaft design, manufacturing methods explored, material selection, the manufacturing trials, and the lessons learned. The results of this manufacturing investigation show feasibility for manufacturing composite shafts for electric motors.

Electric moto shaft

In-Situ Scanning Electron Microscope Experiments for Microscale Mechanical Testing and Validated Modeling of Fiber Reinforced Thermoplastics

A novel, in-situ, scanning electron microscope (SEM) mechanical testing capability for materials at the microscale which provides experimental validation to a machine learning (ML) toolset for full-field validation of physics-based micromechanics models is being developed by researchers at NASA Glenn Research Center. These are enabling technologies for the integration of multiscale digital twins for materials into system level models which will result in the improved performance, material discovery, reduced production cost and time, rapid characterization, and prognostic structural health monitoring (SHM) for materials and structures for extreme environments in support of NASA space exploration missions. In order to bridge the material structure-to-system gap for digital twins, physics-based models must be experimentally validated at multiple length scales. Seminal microscale experiments, conducted at the Air Force Research Laboratory (AFRL), were limited to transverse compression of single-layer, unidirectional thermoset polymer matrix composite (PMC) micropillar specimens [1]. The early phases of the current project followed those initial results and setup to reproduce the compression testing of PMC material on the custom-built piezoelectric actuated micromechanical testing rig built by MicroTesting Solutions LLC. In this work, samples of thermoplastic PMC material were first machined into 3 mm cubes, and then further machining and final milling was done using a Focused Ion Beam (FIB). The initial experiment was done on a pillar roughly 20 µm x 20 µm x 40 µm tall. Additional pillars were milled with final sizes ranging from 20 µm x 20 µm x 40 µm tall to 40 µm x 40 µm x 65 µm tall. A speckle pattern for in-situ full-field measurements using Digital Image Correlation (DIC) was applied with platinum, which was coated on the surface, and then the FIB was used to mill away some of the coating to produce an irregular pattern of Pt on the pillar surface. The samples were loaded into the custom testing rig and placed into the SEM and loaded under compression until failure. Images were collected in the SEM during testing. Post-processing of the images was conducted using DIC to obtain full-field displacement and strain measurements elucidating the role of the matrix as well as fiber-fiber interaction at the microscale within the composite subjected to compression loading well into the non-linear regime of the material. Moreover, the evolution of fiber-matrix debonding and matrix cracking is observed in-situ at the microscale. This data, along with images segmented with a newly developed ML toolset [2], was used to create and validate physics-based micromechanics models. An image of the failed micropillar is shown in Figure 1. The techniques developed in the initial compression experiment was tailored to the validation needs of the models and expanded to include different sized samples as well as possibly tension and fatigue.

Laura Wilson

Micromechanical Design of Carbon Nanotube Ribbon Reinforced Polymer Composite Materials

Lightweight materials are an important component of the design of aerospace structures. Carbon nanotube materials have been considered for this purpose due to the strength and stiffness of individual nanotubes, and the commercial availability of bulk formats such as fibers. These fibers can have a ribbon cross section which results in a different design space for their composites relative to traditional reinforcements which have a round cross section. This work applies brick-and-mortar micromechanical models and classical lamination theory with an inverse approach to investigate the design space of these composites. Using this approach, the influences of fiber geometry and axial and transverse mechanical properties are mapped. Finally, a sensitivity study is performed and the relative impacts of ±10% variations in the constituent material and geometric properties are ranked. Lamina axial moduli were found to range from a maximum of 3x to 1x minimum relative to a target quasi-isotropic laminate modulus depending on the anisotropy and shear modulus of the lamina. The fiber targets depended strongly on the fiber volume fraction in the lamina and the fiber axial modulus target was found to range from 4.8x to 3.2x the quasi-isotropic laminate target. The sensitivity analysis found that the largest driver of performance was the volume fraction, followed by the fiber axial modulus. While bio-based brick-and-mortar composites, such as nacre, can benefit from reinforcement aspect ratios above 10, for carbon nanotube ribbon (or carbon fiber)/polymer composites the sensitivity study indicated that the optimal cross-sectional aspect ratio was relatively smaller, potentially less than three.

Micromechanics

Influence of Processing Parameters on the Mechanical Properties of 3D Printed Borosilicate Particulate Reinforced Polymer Composites

Emerging composite materials are expanding the potential of additive manufacturing and enabling applications previously restricted by traditional manufacturing methods. The multi-phase nature of these composite materials combined with the complex in-ternal geometry of additively manufactured parts have enabled unique behavior, and potentially new applications. Additionally, these materials can be pyrolyzed to create dense metal, ceramic, and glass parts with geometries typically not achievable by tra-ditional processes. Additive manufacturing of borosilicate glass-based systems can open new applications in nuclear engineering, astronomy, and bone regrowth therapy. To elucidate the process-parameter relationship of borosilicate-polylactic acid (PLA) composites, mechanical testing was conducted and compared with a pure polylactic acid polymer baseline. Test specimens were fabricated by fused-filament fabrication with minimal post-processing. Yield strength, ultimate strength, and elastic modulus were calculated from stress-strain curves. Optical and scanning electron microscopy were conducted to observe the specimen microstructure before and after testing. The highest compressive yield strength for the composite was 28.22 MPa, and the highest compressive yield strength for PLA was 49.30 MPa. Print orientation was found to benefit the composite material but have a detrimental effect on the pure matrix material. An elastic modulus of 2.66 GPa was recorded for the borosilicate-PLA composite at 100% infill, 1 shell wall, and layer lines parallel to compression axis. Microscopy revealed that lower modulus composite specimens had the particulates re-distributed within the matrix. Tensile testing was done according to a polymer testing standard, which caused difficulties obtaining consistent fracture within the gauge length.

mechanical testing

Mechanical Properties of Carbon Fiber Reinforced Composites Exposed to Cryogenic Conditions and Space Radiation via Simulation and Testing

As NASA missions extend beyond low Earth orbit, increasing reliance is placed on carbon fiber reinforced polymer (CFRP) composites for spacecraft structures where mass efficiency, durability, and long-term reliability are critical. In service, these materials are subjected to a combination of ultraviolet radiation, vacuum, ionizing radiation, atomic oxygen, and extreme thermal excursions under sustained mechanical loading. Flight systems such as the Boeing Starliner and SpaceX Dragon employ external composite structures that will experience these environments for extended durations. Although prior spaceflight and ground studies have reported limited changes in bulk mechanical properties, the synergistic effects of these environments on composite microstructure, particularly at the fiber matrix interphase, remain insufficiently characterized and represent a potential qualification and reliability risk. This study investigates the effects of short-term cryogenic exposure on a radiation shielding carbon epoxy composite, SC2020, as a ground-based analog for space relevant thermal extremes. The SC2020 material system has previously flown on the International Space Station under the Materials International Space Station Experiment (MISSE) program. Composite specimens were exposed to liquid nitrogen for 6 and 24 hours and evaluated using a multiscale characterization framework that combined ASTM D3039 tensile testing, Atomic Force Microscopy (AFM) based interphase analysis, and helium gas permeability measurements. Tensile testing showed no statistically significant or permanent degradation in global strength or modulus following cryogenic exposure. In contrast, AFM measurements revealed reductions in interphase modulus, weakened adhesion, and increased nanoscale heterogeneity, indicating localized degradation mechanisms not captured by conventional bulk testing. Gas permeability measurements showed a progressive increase in helium diffusion with exposure duration, consistent with micro-void formation or partial interfacial debonding. The results indicate that cryogenic exposure initiates degradation at the fiber matrix interphase while leaving global mechanical properties largely unchanged over short durations. These findings underscore the importance of multiscale diagnostics for identifying early-stage damage mechanisms that may influence long term performance and qualification margins for spaceflight composite structures. The data presented establish a cryogenic baseline for comparison with forthcoming MISSE flight exposure results and support ongoing NASA Established Program to Stimulate Competitive Research (EPSCoR) efforts aimed at improving composite qualification methodologies, risk assessment, and reliability prediction for space environments.

composite reliability

The Deep Space Network: A Radio Communications Instrument for Deep Space Exploration

The primary purpose of the Deep Space Network (DSN) is to serve as a communications instrument for deep space exploration, providing communications between the spacecraft and the ground facilities. The uplink communications channel provides instructions or commands to the spacecraft. The downlink communications channel provides command verification and spacecraft engineering and science instrument payload data.

N A Renzetti

Advancing Wildfire Monitoring with TEMPO and ML tools: Hourly Smoke and Fire‑Front Mapping and Near‑Surface NO₂ Predictions

Wildfires impose substantial impacts on communities and regions downwind of wildfire smoke. We present a TEMPO‑enabled workflow that generates value‑added Level‑3 smoke‑plume masks and fire‑front maps for large wildfires, such as 2024 Park Fire, using the self‑supervised deep learning system SIT‑FUSE, along with near‑surface NO₂ predictions produced by a foundation model (Microsoft Aurora). We conclude by outlining a roadmap for expanding these capabilities to additional Western U.S. wildfire events and for delivering actionable tools to stakeholders. This open-source, reproducible workflow provides a scalable framework for cross-agency wildfire monitoring to overcome traditional limitations in smoke-cloud discrimination and air-quality forecasting by incorporating TEMPO data and beyond.

Xiaohua Pan

The Deep Space Network Progress Report 42-33, March and April 1976

This report describes work performed for the JPL/NASA Deep Space Network (DSN). Progress is presented on DSN supporting research and technology, advanced development and engineering, and implementation, and DSN operations which pertain to mission-independent or multiple-mission development as well as to support of flight projects. Each issue contains a description of the functions and facilities of the DSN.

JPL Staff

Preliminary Design and Implementation of the Baseline Digital Baseband Architecture for Advanced Deep Space Transponders

The baseline design and implementation of the digital baseband architecture for advanced deep space transponders is investigated and identified. Trade studies on the selection of the number of bits for the analog-to-digital converter (ADC) and optimum sampling schemes are presented. In addition, the proposed optimum sampling scheme is analyzed in detail. Descriptions of possible implementations for the digital baseband (or digital front end) and digital phase-locked loop (DPLL) for carrier tracking are also described.

T M Nguyen

Deep Electromagnetic Sounding of the Moon With Lunokhod 2 Data

Results of electromagnetic sounding distinguished an outer high resistance shell about 200 km thick in the moon's structure. A preliminary petrological interpretation of the moon's layers indicated their origin as a consequence of differentiation of the initial peridotite material. Upon melting, 20% to 40% of the material melts and is removed to form a high resistance basaltic shell underlain by a layer of spinal peridotites enriched in divalent iron oxides and having a reduced resistance.

L L Van'yan