SEARCH · Engineering Papers

Results for “REINFORCEMENT”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

All sources NASA NTRS DOE OSTI

NASA NTRS2010

Composite intersection reinforcement

An assembly and method for manufacturing a composite reinforcement for unitizing a structure are provided. According to one embodiment, the assembly includes a base having a plurality of pins extending outwardly therefrom to define a structure about which a composite fiber is wound to define a composite reinforcement preform. The assembly also includes a plurality of mandrels positioned adjacent to the base and at least a portion of the composite reinforcement preform, and a cap that is positioned over at least a portion of the plurality of mandrels. The cap is configured to engage each of the mandrels to support the mandrels and the composite reinforcement preform during a curing process to form the composite reinforcement.

Misciagna, David T.↗

NASA NTRS2013

Composite Intersection Reinforcement

Misciagna, David T.↗

DOE OSTI2024

Polymer-fiber-reinforced polymers with enhanced interfacial bonding between polypropylene fiber and polyethylene matrix

Self-reinforced composites (SRCs) consist of reinforcing fibers and a base matrix made of the same thermoplastic polymer, offering lightweight, recyclability, and sustainability benefits. However, limited research exists on composites where the reinforcing thermoplastic polymer fibers differ from the base thermoplastic matrix. Here, this study focuses on investigating the mechanical behavior of such composites and exploring different surface modification methods to enhance the fiber/matrix interfacial bonding using polypropylene fibers and a polyethylene matrix as an example. It is shown that surface treatment with a commercial adhesion promoter containing n-butyl acetate significantly improves the interfacial shear strength between polypropylene fibers and the polyethylene matrix, increasing it by 145% compared to other methods investigated. Additionally, increasing the length of the embedded polymer fiber in the matrix leads to a notable increase in specific interfacial energy. Consequently, the thermoplastic polymer-fiber-reinforced polymers (PFRPs) using surface-treated woven polypropylene fabrics and a polyethylene matrix exhibit a 20% higher tensile strength and a 65% higher toughness compared to non-treated PFRPs. This study also shows that specific mechanical properties (normalized by the composite density) of the investigated woven PFRPs are similar to those of non-treated SRCs under uni-axial tension. Particularly, their ductility outperforms carbon-/glass-/aramid-fiber-reinforced polymers by at least 6 times at a same fiber volume fraction. The investigation of such composites and the exploration of surface modification methods present important progress in the field of thermoplastic PFRPs, which serve as a solution for addressing concerns related to recyclability and sustainability.

Fiber pull-out↗

DOE OSTI2025

Graphene reinforced UHMWPE fibers

Thermoplastic polymers are increasingly used in electric vehicles, hydrogen fuel cell vehicles, and other decarbonization applications due to their lightweight and formability. Higher-strength polymers are needed to supplant metals in the vehicle structure, thereby reducing mass and improving efficiency. Ultra-high molecular weight polyethylene (UHMWPE) fibers possess one of the highest strength-to-weight ratios of technical polymers, and further improvement via reinforcement by nanofillers, such as graphene, will expand their performance envelope. Here, in this work, UHMWPE/graphene nanocomposite fibers were gel spun and characterized for their morphological, microstructural, thermal, and mechanical properties. The addition of a low fraction of graphene improved the tensile strength of the fibers by 25% and tensile modulus by 32%. Differential scanning calorimetry showed an increase in melting temperature and degree of crystallinity, which indicates improved coordination of the molecular chains induced by the addition of graphene. The reinforcement also affected the cross-sectional shape of the fibers; the aspect ratio of the fibers’ elliptical shape declined with increasing graphene content showing the skeletal effect of the graphene nanofillers in the polymer matrix. The reinforcing effect of graphene declined above a threshold concentration, and theoretical modeling was applied to demonstrate that increased agglomerates led to reduced properties. This work demonstrates a simple, effective method to produce graphene-reinforced UHMWPE fibers and lays a foundation for understanding the potential for leveraging graphene to form ultra-high-performance nanocomposite fibers for myriad engineering applications.

36 MATERIALS SCIENCE↗

DOE OSTI2020

Reinforcement learning based automated history matching for improved hydrocarbon production forecast

History matching aims to find a numerical reservoir model that can be used to predict the reservoir performance. An engineer and model calibration (data inversion) method are required to adjust various parameters/properties of the numerical model in order to match the reservoir production history. In this study, we develop deep neural networks within the reinforcement learning framework to achieve automated history matching that will reduce engineers’ efforts, human bias, automatically and intelligently explore the parameter space, and remove the need of large set of labeled training data. To that end, a fast-marching-based reservoir simulator is encapsulated as an environment for the proposed reinforcement learning. The deep neural-network-based learning agent interacts with the reservoir simulator within reinforcement learning framework to achieve the automated history matching. Reinforcement learning techniques, such as discrete Deep Q Network and continuous Deep Deterministic Policy Gradients, are used toth, used to train the learning agents. The continuous actions enable the Deep Deterministic Policy Gradients to explore more states at each iteration in a a learning episode; consequently, a better history matching is achieved using this algorithm as compared to Deep Q Network. For simplified dual-target composite reservoir models, the best history-matching performances of the discrete and continuous learning methods in terms of normalized root mean square errors are 0.0447 and 0.0038, respectively. Furthermore, our study shows that continuous action space achieved by the deep deterministic policy gradient drastically outperforms deep Q network.

42 ENGINEERING↗

DOE OSTI2020

Self-aligned concentrating immersion-lens arrays for patterning and efficiency recovery in scaffold-reinforced perovskite solar cells

In contrast to existing silicon, CIGS, and multi-junction cells that exhibit remarkable mechanical durability, perovskite solar cells have been shown to delaminate when subjected to the mechanical loads that occur during processing and field exposures, limiting their potential as a reliable solar technology. Mechanical reinforcement is thus essential for durable and reliable perovskite technologies. One current strategy to overcome the thermomechanical fragility of perovskite solar cells is to extrinsically shield them by introducing reinforcing scaffolds which partition the cell into many distinct microcells, but improvements in mechanical stability coincide with a reduced device efficiency due to parasitic absorption by the scaffold. We address this reduced efficiency by integrating concentrating immersion-lens arrays (CILAs) into scaffold-reinforced solar cells. These scaffolds are lithographically patterned by a maskless process, in which ultraviolet light is used to pattern the scaffolds through the CILAs, ensuring self-alignment and optical contact with the microcells. Perovskite devices are deposited into the microcells, and during operation, light is concentrated into the microcells and away from the insulating scaffolds, resulting in mechanically resilient solar cells with efficiencies comparable to planar devices. The CILAs also exhibit passive tracking of incident light—verified experimentally and with ray-tracing simulations—which is critical for optimal power output as the sun moves across the sky during the day. The simplicity of the fabrication process and the efficiency of the resulting scaffolded devices show that a lens-integrated scaffold-reinforced structure is a potential pathway to high-performance, robust, commercially viable perovskite solar cells.

14 SOLAR ENERGY↗

DOE OSTI2020

Surface-modified and oven-dried microfibrillated cellulose reinforced biocomposites: Cellulose network enabled high performance

Microfibrillated cellulose (MFC) is widely used as a reinforcement filler for biocomposites due to its unique properties. However, the challenge of drying MFC and the incompatibility between nanocellulose and polymer matrix still limits the mechanical performance of MFC-reinforced biocomposites. In this study, we used a water-based transesterification reaction to functionalize MFC and explored the capability of oven-dried MFC as a reinforcement filler for polylactic acid (PLA). Remarkably, this oven-dried, vinyl laurate–modified MFC improved the tensile strength by 38 % and Young’s modulus by 71 % compared with neat PLA. Our results suggested improved compatibility and dispersion of the fibrils in PLA after modification. This study demonstrated that scalable water-based surface modification and subsequent straightforward oven drying could be a facile method for effectively drying cellulose nanomaterials. We find that the method helps significantly disperse fibrils in polymers and enhances the mechanical properties of microfibrillar cellulose-reinforced biocomposites.

36 MATERIALS SCIENCE↗

DOE OSTI2018

Chloride induced reinforcement corrosion behavior in self-healing concrete with encapsulated polyurethane

Cracks in reinforced concrete structures accelerate the ingress of chlorides and therefore cause a higher risk for corrosion. In this research, autonomous healing of cracks by encapsulated polyurethane was investigated as a possible method to reduce reinforcement corrosion. Reinforced concrete beams were exposed weekly to a chloride solution and electrochemical parameters were measured to determine the influence of the self-healing mechanism on the corrosion process. The rebars were visually examined afterwards. For the cracked beams an active state of corrosion was detected within an exposure period of 10 weeks and clear pitting corrosion was observed on the rebars. Autonomous crack healing with low viscosity polyurethane could significantly reduce the corrosion in the propagation stage. For these specimens no visual damage to the rebars was detected. In conclusion, the application of self-healing concrete with a low viscosity polyurethane is able to enhance the durability of reinforced concrete structures in marine environments.

36 MATERIALS SCIENCE↗

DOE OSTI2025

Comprehensive assessment of deep reinforcement learning approaches for economic dispatch in nuclear-driven microgrids

As the electrical grid integrates more variable renewable energy sources such as wind and solar, the demand for distributed and flexible systems to address this increased variability becomes critical. Nuclear-driven microgrids provide a promising solution by offering stable generation to complement intermittent renewables, ensuring grid reliability and operating efficiency. This paper proposes a recurrent deep reinforcement learning framework for optimal economic dispatch in a nuclear-powered microgrid integrating renewable energy sources, small modular reactors, battery storage systems, and balance-of-plant dynamics. A three-agent control architecture is developed, where demand and renewable energy agents act as forecasters, and a reinforcement learning-based dispatch agent performs real-time energy allocation. A nonlinear programming formulation is first used to generate an optimal baseline for benchmarking. The proposed dispatch controller, based on Proximal Policy Optimization enhanced with Long Short-Term Memory networks, exploits temporal correlations in system dynamics by taking advantage of the time series used as inputs to improve policy robustness under uncertainty. Comparative analysis against established deep reinforcement learning methods, including Proximal Policy Optimization with a feedforward architecture, Soft Actor-Critic, and Twin Delayed Deep Deterministic Policy Gradient, demonstrates superior performance. Numerical results indicate that the proposed controller achieves a 0.39% cost reduction relative to the nonlinear programming benchmark and outperforms other learning-based methods by generating additional revenue of up to 0.35%. All reinforcement learning controllers compute dispatch actions in less than 0.3 s, resulting in a computational speedup of more than three orders of magnitude over the nonlinear programming baseline. The findings of this paper highlight their applicability for real-time operation and control in nuclear-integrated microgrids under volatile operating conditions.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2016

Unraveling the Mechanism of Nanoscale Mechanical Reinforcement in Glassy Polymer Nanocomposites

The mechanical reinforcement of polymer nanocomposites (PNCs) above the glass transition temperature, T g , has been extensively researched. However, not much is known about the origin of this effect below T g . In this paper, we unravel the mechanism of PNC reinforcement within the glassy state by directly probing nanoscale mechanical properties with atomic force microscopy and macroscopic properties with Brillouin light scattering. Our results unambiguously show that the "glassy" Young's modulus in the interfacial polymer layer of PNCs is two-times higher than in the bulk polymer, which results in significant reinforcement below T g . We ascribe this phenomenon to a high stretching of the chains within the interfacial layer. Since the interfacial chain packing is essentially temperature independent, these findings provide a new insight into the mechanical reinforcement of PNCs also above T g .

36 MATERIALS SCIENCE↗

DOE OSTI2025

Reinforcement Learning for Anomaly Detection in Nuclear Power Plant Operation and Maintenance

In nuclear power plants (NPPs), timely identification of sensor and human errors is critical to ensure safe and efficient plant operations. Anomaly detection models can be employed for this task. However, traditional anomaly detection approaches may have high dependency on labeled datasets and struggle with adaptability in complex, dynamic environments. Reinforcement learning (RL) has demonstrated significant potential in fault diagnosis and anomaly detection; however, its application to anomaly detection in NPPs remains a relatively underexplored research direction. Hence, to address this gap, in this study, we present a novel physics-informed reinforcement learning model, PIRL-AD: Physics-Informed Reinforcement Learning for Anomaly Detection, that integrates domain knowledge from calorimetric equations into the RL framework for enhanced sensor and human error anomaly detection. We evaluate the performance of PIRL-AD against a non-physics informed RL benchmark and a support vector machine (SVM) on data collected from a forced flow loop testbed. Experimental results suggest that PIRL-AD outperforms other baselines on a range of anomalous datasets that include both sensor and human-induced anomalies across key performance metrics, statistically outperforming the RL and SVM benchmarks with respect to geometric mean (respectively, 92.96% vs. 91.06% vs. 83.01%) and F1-score (respectively, 89.23% vs. 86.98% vs. 77.01%). Furthermore, the findings suggest the potential of physics-integrated reinforcement learning models for enhanced anomaly detection performance in NPPs.

Reinforcement learning↗

DOE OSTI2023

Material and component developments for the DEMO divertor using fibre reinforcement and additive manufacturing

Within the research along the European Fusion Roadmap, water-cooled divertor PFCs are foreseen in the design of a first fusion demonstration power plant (DEMO) in order to provide reliable heat removal capability. In the frame of this concerted attempt, the Max Planck Institute for Plasma Physics is concentrating on the development and testing of composite materials based on tungsten (W, preferred armour material) and copper (Cu, preferred heat sink material). W fibres (W f ) as monofilaments and yarns as reinforcement play a central role in these investigations due to their extraordinary properties concerning ductility already at room temperature and high tensile strength. Recent investigations on the impact of radiation damage suggest that the fibres retain their ductility upon irradiation. W reinforced with W fibres (W f /W) allows to overcome the intrinsic brittleness of W. Quantitative mechanical fracture tests of W f /W confirm the basic mechanisms of fibre reinforcement and the increased resistance to mechanical fatigue. The good wettability of W with liquid Cu and the absence of any metallurgical solubility make up an ideal material pairing for composite production. W fibre-reinforced Cu (W f /Cu) cooling tubes provide a rather high thermal conductivity (> 250 W mK -1 ) and at least twice the strength of CuCrZr in hoop direction in the temperature range up to at least 500 °C. Very recent neutron irradiation experiments confirm the sustainment of ductility of the W f /Cu composite. Numerical simulations suggest that thermal stresses in W-Cu PFCs could be strongly reduced by tailoring the local W and Cu volume fraction. This 'freely' distributed material composition can be achieved by means of additively manufactured W skeletons consecutively infiltrated by Cu. Investigations with W preforms produced by Laser Beam Powder Bed Fusion and infiltrated by Cu demonstrate the feasibility of this approach while testing of specifically prepared specimen is ongoing.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

DOE OSTI2020

Reinforcement Learning via Gaussian Processes with Neural Network Dual Kernels

While deep neural networks (DNNs) and Gaussian Processes (GPs) are both popularly utilized to solve problems in reinforcement learning, both approaches feature undesirable drawbacks for challenging problems. DNNs learn complex non-linear embeddings, but do not naturally quantify uncertainty and are often data-inefficient to train. GPs infer posterior distributions over functions, but popular kernels exhibit limited expressivity on complex and high-dimensional data. Fortunately, recently discovered conjugate and neural tangent kernel functions encode the behavior of overparameterized neural networks in the kernel domain. We demonstrate that these kernels can be efficiently applied to regression and reinforcement learning problems by analyzing a baseline case study.We apply GPs with neural network dual kernels to solve reinforcement learning tasks for the first time. We demonstrate, using the well understood mountain-car problem, that GPs empowered with dual kernels perform at least as well as those using the conventional radial basis function kernel. Finally, we conjecture that by inheriting the probabilistic rigor of GPs and the powerful embedding properties of DNNs, GPs using NN dual kernels will empower future reinforcement learning models on difficult domains.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2019

A Cooperative Multi-Agent Deep Reinforcement Learning Framework for Real-Time Residential Load Scheduling

Internet-of-Things (IoT) enabled monitoring and control capabilities are enabling increasing numbers of household users with controllable loads to actively participate in smart grid energy management. Realizing an efficient real-time energy management system that takes advantage of these developments requires novel techniques for managing the increased complexity of the control action space in resolving multiple challenges such as the uncertainty in energy prices and renewable energy output along with the need to satisy physical grid constraints such as transformer capacity. Addressing these challenges, we develop a multi-household energy management framework for residential units connected to the same transformer and containing DERs such as PV, ESS and controllable loads. The goal of our framework is to schedule controllable household appliances and ESS such that the cost of procuring electricity from the utility over a horizon is minimized while physical grid constraints are satisfied at each scheduling step. Traditional energy management frameworks either perform global optimization to satisfy grid constraints but suffer from high computational complexity (for example Integer Program, Mixed Integer Programming frameworks and centralized reinforcement learning) or perform decentralized real-time energy management without satisfying global grid constraints (for example multi-agent reinforcement learning with no cooperation). In contrast, we propose a cooperative multiagent reinforcement learning (MARL) framework that i) operates in real-time, and ii) performs explicit collaboration to satisfy global grid constraints. The novelty in our framework is two fold. Firstly, our framework trains multiple independent learners (IL) for each household in parallel using historical data and performs real-time inferencing of control actions using the most recent system state. Secondly, our framework contains a low complexity knapsack based cooperation agent which combines the outputs of ILs to minimize cost while satisfying grid constraints. Simulation results show that our cooperative MARL approach achieves significant cost improvement over centralized reinforcement learning and day-ahead planning baselines. Moreover, our approach strictly satisfies physical constraints with no apriori knowledge of system dynamics while the baseline approaches have occasional violations. We also measure the training and inference time by ranging the number of households from 1 to 25. Results show that our cooperative MARL approach scales best among various approaches.

14 SOLAR ENERGY↗

DOE OSTI2019

Progress on Grizzly Development for Reactor Pressure Vessels and Reinforced Concrete Structures

The Grizzly code has been under development for the U.S. Department of Energy’s Light Water Reactor Sustainability program to provide predictive tools for the evolution of material degradation in critical light water reactor structural components due to long-term exposure to the environmental conditions of normal reactor operation, and for the effects of this degradation on the safety of these components. This development has primarily targeted reactor pressure vessels and reinforced concrete structures. Work performed during Fiscal Year 2019 added important features for both of these types of structures. For probabilistic fracture mechanics analysis of reactor pressure vessels, capabilities were added to account for the effects of warm prestressing and residual stresses, as well as to model crack initiation, growth, and arrest. For modeling microstructure evolution in reactor pressure vessels, a cluster dynamics model for evolution of Mn-Ni-Si phases has been implemented. For modeling degraded reinforced concrete structures, capabilities to consider the combined effects of damage and creep in the concrete constitutive model and model nonlinear behavior of reinforcing bars has been added. These newly-developed features fill important gaps in Grizzly’s feature set for engineering-scale analysis of degraded reactor pressure vessels and reinforced concrete structures. Grizzly development in both of these areas has reached a point where it is ready for extensive testing on relevant engineering problems.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

NASA NTRSDate not supplied

Towards Autonomous Lunar Resource Excavation via Reinforcement Learning

To continue on a sustainable and flexible path, NASA needs to address the challenge of collecting and moving large amounts of regolith at the destination. NASA’s Regolith Advanced Surface Systems Operations Robot (RASSOR) is principally designed to mine and deliver regolith for In-Situ Resource Utilization (ISRU) processing. RASSOR’s design enables it to efficiently collect and deposit regolith, return collected material for processing, and myriad related ISRU activities. To reliably perform these operations on the lunar surface, RASSOR software and sensory systems need to be robust and maximize the information extracted from a reduced sensor payload. Herein, we present preliminary findings from the Intelligent Capabilities Enhanced RASSOR project. We created reduced-order simulation environments to develop autonomous trenching controllers via reinforcement learning and prototype state estimation architectures. The goal of reinforcement learning is for an agent to learn a policy (task strategy) through interactions with an environment. When the agent performs an action, a change occurs in environment state and a numerical reward is received which informs the agent whether the action performed was good or not. Since reinforcement learning algorithms learn through trial-and-error, a simulation is a desirable first environment for development and learning. We developed two simulations, the first is a 2D excavation simulation developed to facilitate parameter selection, and a 3D simulation developed using a game physics engine, to simulate simplified soil interactions and increase the fidelity of the dynamic models of the robotic agents. The development of this 3D simulation has enabled the training of additional sensing capabilities and research both at the granular mechanics and operations levels. We experimented with various virtual sensor payloads to identify a combination that enabled efficient excavation operation and learning. Our reward function is based on how much material is excavated per step. A penalty is also received for leaving the dig site and to smooth the acceleration of the drum arms. We implemented pseudo time-of-flight sensors to report distance from each drum to ground and the height above ground which was found to be more efficient than existing solutions. Our findings suggest that reinforcement learning for autonomous operations has learned viable trenching strategies within 3000 training episodes in our simplified 2D environment and helped identify desirable sensing capabilities, arrangements, and considerations such as the positioning of time-of-flight sensors. Future work includes expanding our simulation to more complex environments and scenarios, and transfer learning from simulation to RASSOR 2.0 hardware for deployment in the Regolith Test Bin at NASA's Kennedy Space Center.

rassor↗

NASA NTRSDate not supplied

Environment Adversarial Reinforcement Learning

This paper presents a training method for increasing performance of reinforcement learning agents. The method is named Environment Adversarial Reinforcement Learning. The method requires the reinforcement learning environment to be parameterizeable. Over the course of training, environment parameters are updated in a direction of increasing difficulty for the agent. The direction for these updates is found using a performance prediction network trained on data from tests of the agent under varying environment parameters. The method was tested on a CartPole environment. A 28-58\% improvement in mean return was found when comparing performance to a baseline reinforcement learning algorithm on both easy and hard versions of the task.

machine learning↗

DOE OSTI2024

Predicting the tensile and compressive modulus of electrospun fiber mat‐reinforced hydrogels using the Halpin–Tsai equations

Abstract The reinforcement of mechanically‐weak hydrogels to yield composites with increased stiffness, strength, or toughness is a well‐established approach. In particular, introducing electrospun nanofibers into hydrogels is a common strategy for biomedical applications, as the resulting hierarchical structure mimics biology and allows for control over fiber diameter and alignment and tuning of mechanical properties. However, further study of the link between the constituent materials and the mechanical properties of the composite is uncommon. One potential model to understand the mechanical properties of fiber‐reinforced hydrogels involves the Halpin–Tsai equations, which relate the modulus values of the fibers and hydrogel matrix and the fiber volume fraction, to the modulus of the composite. To assess the application of this model to fiber‐reinforced hydrogels, predicted values were compared with experimental values from mechanical testing of a poly(ethylene glycol) (PEG) matrix reinforced with an electrospun polycaprolactone (PCL) fiber mat. Although the equations described these systems well in tension, providing a facile approach to identify a fiber volume fraction that will achieve a desired modulus, the Halpin–Tsai approach was less successful under compression. This study motivates additional investigation of the role of structural features of hydrogel composites in determining mechanical properties to enable design of materials for specific applications.

Polymer Science↗