Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “deep reinforcement learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

316 records · Page 4
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Investigating permafrost carbon dynamics in Alaska with artificial intelligence

Abstract Positive feedbacks between permafrost degradation and the release of soil carbon into the atmosphere impact land–atmosphere interactions, disrupt the global carbon cycle, and accelerate climate change. The widespread distribution of thawing permafrost is causing a cascade of geophysical and biochemical disturbances with global impacts. Currently, few earth system models account for permafrost carbon feedback (PCF) mechanisms. This research study integrates artificial intelligence (AI) tools and information derived from field-scale surveys across the tundra and boreal landscapes in Alaska. We identify and interpret the permafrost carbon cycling links and feedback sensitivities with GeoCryoAI, a hybridized multimodal deep learning (DL) architecture of stacked convolutionally layered, memory-encoded recurrent neural networks (NN). This framework integratesin-situmeasurements and flux tower observations for teacher forcing and model training. Preliminary experiments to quantify, validate, and forecast permafrost degradation and carbon efflux across Alaska demonstrate the fidelity of this data-driven architecture. More specifically, GeoCryoAI logs the ecological memory and effectively learns covariate dynamics while demonstrating an aptitude to simulate and forecast PCF dynamics—active layer thickness (ALT), carbon dioxide flux (CO 2 ), and methane flux (CH 4 )—with high precision and minimal loss (i.e. ALT RMSE : 1.327 cm [1969–2022]; CO 2 RMSE : 0.697µmolCO 2 m −2 s −1 [2003–2021]; CH 4 RMSE : 0.715 nmolCH 4 m −2 s −1 [2011–2022]). ALT variability is a sensitive harbinger of change, a unique signal characterizing the PCF, and our model is the first characterization of these dynamics across space and time.

Environmental Sciences & Ecology↗
DOE OSTI2024

Optimizing Deep Geothermal Drilling for Energy Sustainability in the Appalachian Basin

This study investigates the geological and geomechanical characteristics of the MIP 1S geothermal well in the Appalachian Basin to optimize drilling and address the wellbore stability issues encountered. Data from well logs, sidewall core analysis, and injection tests were used to derive elastic and rock strength properties, as well as stress and pore pressure profiles. A robust 1D-geomechanical model was developed and validated, correlating strongly with wellbore instability observations. This revealed significant wellbore breakout, widening the diameter from 12 ¼ inches to over 16 inches. Advanced technologies like Cerebro Force™ In-Bit Sensing were used to monitor drilling performance with high accuracy. This technology tracks critical metrics such as bit acceleration, vibration in the x, y, and z directions, Gyro RPM, stick-slip indicators, and bending on the bit. Cerebro Force™ readings identified hole drag caused by poor hole conditions, including friction between the drill string and wellbore walls and the presence of cuttings or debris. This led to higher torque and weight on bit (WOB) readings at the surface compared to downhole measurements, affecting drilling efficiency and wellbore stability. Optimal drilling parameters for future deep geothermal wells were determined based on these findings.

Environmental Sciences & Ecology↗
DOE OSTI2026

Distributed quantum approximate optimization algorithm on a quantum-centric supercomputing architecture

Quantum approximate optimization algorithm (QAOA) has shown promise in solving combinatorial optimization problems by providing quantum speedup on near-term gate-based quantum computing systems. However, QAOA faces challenges for high-dimensional problems due to the large number of qubits required and the complexity of deep circuits, limiting its scalability for real-world applications. In this study, we present a distributed QAOA (DQAOA), which leverages distributed computing strategies to decompose a large computational workload into smaller tasks that require fewer qubits and shallower circuits than are necessary to solve the original problem. These sub-problems are processed using a combination of high-performance and quantum computing resources. The global solution is iteratively updated by aggregating sub-solutions, allowing convergence toward the optimal solution. We demonstrate that DQAOA can handle considerably large-scale optimization problems (e.g., 1000-bit problem), achieving a high solution quality and short time-to-solution, outperforming existing strategies. Furthermore, we realize DQAOA on a quantum-centric supercomputing architecture, paving the way for practical applications of gate-based quantum computers in real-world optimization tasks. To extend DQAOA’s applicability to materials science, we further develop an active learning algorithm integrated with our DQAOA (AL-DQAOA), which involves machine learning, DQAOA, and active data production in an iterative loop. We successfully optimize photonic structures using AL-DQAOA, indicating that solving real-world optimization problems using gate-based quantum computing is feasible. We expect the proposed DQAOA to be applicable to a wide range of optimization problems and AL-DQAOA to find broader applications in material design.

Kim, Seongmin [ORNL] (ORCID:0000000159063004)↗
DOE OSTI2025

A Reductively Stable Electrolyte Realizes Deep Cycling Behavior in Anode‐free Sodium Batteries

For anode‐free sodium batteries to achieve practical consideration, highly reversible chemistries require exceptional ≥99.95% coulombic efficiencies that maintain over prolonged cycling periods. To do so, consumption of this severely limited sodium inventory must be restricted while metal nucleation processes that comprise the in situ formed metal anode are improved. Herein, we describe a fluorine‐free carborane electrolyte that satisfies these criteria by emphasizing reductive stability and weakly coordinating anion behavior as design principles. We find this approach promotes the development of a thin, robust SEI chemistry rich in both organic speciation and boron. The electrolyte described herein exhibits ideal metal nucleation behavior on one‐micron thin carbonaceous current collector surfaces and achieves a metal deposition/stripping efficiency near parity for 400 cycles. This novel anode chemistry is introduced to anode‐free full cell configurations where 87% of the initial discharge capacity is retained after 1000 cycles at 2.0 C. In conclusion, post‐test characterization of deep‐cycled anode‐free cells reveals suppressed capacity fade in these systems is attributed to the chemical stability of the carborane anion.

anode-free↗
DOE OSTI2026

Nuclear–Electronic Orbital General Rate Theory: Predicting Hydrogen Kinetic Isotope Effects in the Deep Tunneling Regime

Hydrogen transfer is a critical component of many chemical and biological processes. The ratio of rate constants for hydrogen and deuterium transfer defines the H/D kinetic isotope effect (KIE), which is a powerful tool for elucidating hydrogen transfer mechanisms. Interpretation of experimental H/D KIEs relies on accurate and affordable computational methods. However, due to their light mass, hydrogen and deuterium can undergo tunneling, which is challenging to describe in multidimensional molecular systems. Herein, we introduce the nuclear–electronic orbital general rate theory (NEO-GRT), which enables the efficient prediction of H/D KIEs based on full-dimensional molecular quantum chemistry calculations. The NEO-GRT approach describes the hydrogen transfer rate constant with a general expression that spans the vibrationally adiabatic and nonadiabatic hydrogen tunneling regimes. The input quantities are computed using NEO density functional theory, which treats the transferring hydrogen or deuterium nucleus quantum mechanically on the same level as the electrons. We investigate two intramolecular proton transfer reactions in organic molecules at temperatures down to 50 K to evaluate the performance of NEO-GRT by comparison to transition state theory and ring-polymer instanton theory. The KIEs computed with NEO-GRT agree with those calculated using ring-polymer instanton theory for the full-dimensional molecular systems at the same level of electronic structure theory. This agreement indicates that NEO-GRT captures the deep hydrogen tunneling effects, in contrast to transition state theory, which neglects such effects. Given its relatively low computational cost, NEO-GRT is a promising approach for predicting H/D KIEs in large organic and organometallic systems.

Hydrogen↗
DOE OSTI2025

Adsorptive behavior of poly (vinylidene fluoride) membranes for the recovery of lignin-derived hydrophobic deep eutectic solvents

Abstract Recently, membrane technology has gained significant traction as an energy-efficient alternative to traditional thermal processes for solvent recovery. Deep eutectic solvents (DESs) have emerged as sustainable alternatives to conventional organic solvents, yet a systematic methodology for selecting compatible membrane materials for their recovery remains underdeveloped. This study established a predictive framework for membrane material selection in hydrophobic DES applications using Hansen Solubility Parameters (HSP) with inverted criteria targeting materials with relative energy difference (RED) values greater than 1.0. Flat sheet membranes were fabricated via the non-solvent induced phase separation (NIPS) technique. Four NIPS fabricated polymer membranes were evaluated: polysulfone, cellulose acetate, polyvinylidene fluoride (PVDF) fabricated with polyethylene glycol (PEG) as a pore-forming agent, and polybenzimidazole (PBI). The HSP approach successfully predicted membrane-solvent compatibility, with polysulfone (RED = 0.6) and cellulose acetate (RED = 0.9) dissolving completely within 24 h, while PVDF (RED = 1.9) and PBI (RED = 1.1) maintained structural integrity throughout a 7-day exposure period. Furthermore, PVDF demonstrated superior performance with minimal weight gain (3.0%), hydrophobic surface characteristics (122° water contact angle), and enhanced mechanical properties following DES exposure. Comprehensive chemical and morphological characterization confirmed PVDF’s chemical stability and revealed a surface-selective interaction mechanism involving simultaneous PEG (pore-forming agent) extraction and DES component adsorption. Adsorption kinetics followed pseudo-first-order behavior with reversible characteristics, best described by the Temkin isotherm model (R² = 0.9987). PVDF membranes-maintained separation functionality with average lignin rejection (75.2 ± 7.69%) and demonstrated filtration permeability of 2.0 ± 0.34 LMH/bar. This methodology provides a rational approach for membrane selection in emerging solvent systems, contributing to the advancement of sustainable separation technologies for DES-based biomass processing applications.

Science & Technology - Other Topics↗
DOE OSTI2026

Aerosol-deep convection interaction based on joint cell-thermal tracking in Large Eddy Simulations during the TRACER campaign

In cumulus clouds, aerosol concentrations control cloud droplet concentrations, modifying cloud radiative properties, precipitation processes, and cloud electrification. However, mechanisms of aerosol-deep convection interactions are not well understood due to complex cloud dynamics and microphysics. We investigate the interaction of aerosols with isolated deep convection using Large Eddy Simulations of two cases during the TRacking Aerosol Convection interactions ExpeRiment (TRACER) near Houston, Texas, using a joint cell-thermal tracking algorithm. Cumulus thermals are droplet generators, since supersaturation and droplet nucleation coincide with thermal centers, where the strongest updrafts occur. Primary ice crystal formation does not take place inside thermals, but at layers where previous thermals detrained moisture. As subsequent thermals containing supercooled droplets penetrate these layers, hail and graupel form at or near these thermals. Higher aerosol concentrations result in higher droplet concentrations that suppress drizzle, delay warm rain processes, and transport more moisture aloft. This increases snow and ice amount, as well as graupel and hail, leading to more lightning. Polluted thermals initiate at slightly higher altitudes, and are slightly larger and faster, suggesting a weak invigoration. We also find more thermals per cell, but fewer isolated cells, since convection is more aggregated and intense, especially near the end of the 24 h simulation. Non-linear mesoscale feedback likely triggered by temperature and moisture responses to aerosol-thermal interactions causes the aggregation. Time-lagged aerosol-reinitialization experiments show that the mesoscale response is the predominant forcing for the invigoration. These changes happen within one day, on a smaller scale than previously suggested.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRSDate not supplied

MSFC Thermal Testing Lessons Learned Course. Section 3: Lessons Learned from Protoflight StarBurst Instrument Thermal Vacuum Test

MSFC thermal engineers will be presenting lessons learned while preparing and conducting thermal tests. This course will cover practical real world examples of thermal chamber and vacuum chamber testing from engineering development units to system level testing on flight hardware. Special topics include large scale testing preparation, requirement tailoring from parent documents, and cryogenic development testing.

thermal discipline↗
NASA NTRS1967

Space Programs Summary 37-43, Vol. VI, Space Exploration Programs and Space Sciences For the Period November 1 to December 31, 1966

The Space Programs Summary is a six-volume bimonthly publication designed to report on JPL space exploration programs and related supporting research and advanced development projects. The titles of all volumes of the Space Programs Summary are: Vol. I. The Lunar Program (Confidential) Vol. 11. The Planetary-Interplanetary Program (Confidential) Vol. 111. The Deep Space Network (Unclassified) Vol. IV. Supporting Research and Advanced Development (Unclassified) Vol. V. Supporting Research and Advanced Development (Confidential) Vol. VI. Space Exploration Programs and Space Sciences (Unclassified) The Space Programs Summary, Vol. VI, consists of: an unclassified digest of appropriate material from Vols. I, II, and III; an original presentation of the JPL quality assurance and reliability efforts, and the environmental- and dynamic-testing facility-development activities; and a reprint of the space science instrumentation studies of Vols. I and 11. This instrumentation work is conducted by the JPL Space Sciences Division and also by individuals of various colleges, universities, and other organizations. All such projects are supported by the Laboratory and are concerned with the development of instruments for use in the NASA space flight programs.

MARINER PROGRAM↗
NASA NTRS2022

Model Spread in Tropical Low Cloud Feedback Tied to Overturning Circulation Response to Warming

Among models participating in the Coupled Model Intercomparison Project phase 6 (CMIP6), here we show that the magnitude of the tropical low cloud feedback, which contributes considerably to uncertainty in estimates of climate sensitivity, is intimately linked to tropical deep convection and its effects on the tropical atmospheric overturning circulation. First, a reduction in tropical ascent area and an increased frequency of heavy precipitation result in high cloud reduction and upper-tropospheric drying, which increases longwave cooling and reduces subsidence weakening, favoring low cloud reduction (Radiation-Subsidence Pathway). Second, increased longwave cooling decreases tropospheric stability, which also reduces subsidence weakening and low cloudiness (Stability-Subsidence Pathway). In summary, greater high cloud reduction and upper-tropospheric drying (negative longwave feedback) lead to a more positive cloud feedback among CMIP6 models by contributing to a greater reduction in low cloudiness (positive shortwave feedback). Varying strengths of the two pathways contribute considerably to the intermodel spread in climate sensitivity.

Atmospheric dynamics↗
NASA NTRSDate not supplied

Enabling Mission Flexibility to Battery Driven Deep Space Endeavors With Generalized Battery-Health-Monitoring Using Physics-Based and Data-Driven Reduced-Order Models

The needs and requirements for an electrochemical energy storage for deep space exploration is well explored. It is often understood that different mission sites and environmental conditions require different battery chemistries or technologies. Additionally, various engineering solutions are deployed to overcome specific chemical challenges. One often overlooked need is the “health” monitoring of an electrochemical storage system. The term generalized health monitoring, as envisioned in this work, refers to the monitoring of various aspects such as electrode health, electrolyte health, reaction pathway health, cooling system health, sensor health, and BMS health [1]. Generalized health monitoring allows mission leads, engineers, and scientists to incorporate flexibility in mission designs, make on-the-fly mission changes, and extend the duration of science missions. Moreover, it enables automation and data-driven decision-making without compromising safety and performance. Recently, our group developed a hierarchy of thermal reduced-order models (TROM) by combining a physics-based modeling approach and data-driven model reduction techniques applied to flight data [2]. The resulting TROMs were found to be not only accurate but also identifiable from the flight data. Consequently, the coefficient of variance of the model parameters is small over the course of hundreds of flights, allowing for monitoring the parameter evolution trajectories as the battery ages and degrades. These parameters constitute the metrics of the generalized health of a battery. Monitoring their evolution allows such models to be used for anomaly detection and prognostics, improving early detection of abnormal behavior and thus enabling timely maintenance, longer battery life, and enhanced battery safety. For this presentation, the practicality of the thermal model will be validated on a pack of 14cells under various topology configurations such as 1S14P, 2P7S, 7S2P, and 1P14S. It is well known that manufacturing and non-uniform aging lead to variability in the performance of a cell, which is exacerbated by cell balancing during active load. Additionally, in extreme scenarios, the paramount objective is to complete the mission, regardless of the stresses on the battery. Topology-induced balancing issues further stress the battery. The goal of this study is to determine if the noise (identifiability) in the reduced-order thermal model parameters is sensitive to topology, cell spacing, cooling strategy, and manufacturing or age variability. The variability in cells is considered by assuming a multimodal distribution for microscopic parameters of a cell (such as porosity, tortuosity, reaction kinetics, volumetric thermal conductivity, and volumetric heat capacity). The compounded effect of manufacturing variability, topological selection, cooling strategies, and cell balancing ages each cell in a battery differently. The study aims to clarify whether the challenge in extracting maximum information depends on the minimum number of sensors or models used for data extraction.

Automation↗
NASA NTRSDate not supplied

A Frank Discussion on Lessons Learned From Adopting and Applying NASA-STD-6030 for Spaceflight Systems

With the advancement and adoption of Additive Manufacturing (AM) for spaceflight systems, numerous lessons have been learned during the qualification and certification of AM components. The lessons learned covered in this presentation will provide an overview of the challenges faced by NASA centers and commercial partners working to design AM hardware that complies with NASA-STD-6030 Additive Manufacturing Requirements (AMR). Topics of interest include tailoring of requirements for specific projects, documentation requirements, and addressing conservative approaches towards mechanical property development and analysis. In addition to that, this presentation aims to impress that these lessons learned will influence the future revisions of the NASA technical standard to facilitate and advance AM technology adoption on NASA projects.

Additive Manufacturing↗