Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “REINFORCEMENT”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,711 records · Page 95

Rigid stiffener-reinforced flexible neural probes, and methods of fabrication using wicking channel-distributed adhesives and tissue insertion and extraction

A stiffener-reinforced microelectrode array probe and fabrication method using wicking channel-distributed adhesives which temporarily adheres a flexible device onto a rigid stiffener for insertion and extraction. Assembly is by dispensing a liquid adhesive into a narrow open groove wicking channel formed on the stiffener so that the adhesive is wicked along and fills the channel by capillary action, and adhering the adhesive-filled bonding side of the elongated section of the rigid substrate to a flexible device.

Shah, Kedar G.↗

Fiber and bundle orientations, matrix rich regions, and mechanical properties of fiber reinforced composites using thermal digital image correlation

Methods for assessing fiber and bundle orientations and mechanical properties of fiber reinforced composite materials using Thermal Digital Image Correlation (TDIC) are disclosed. In some examples, the method comprises exposing the composite material to a temperature change; imaging the composite material at a plurality of time points before, during and/or after the temperature change; and assessing the characteristic of the composite material based on the imaging. In others, temperature changes naturally occur during the cooling process after manufacturing can be employed for this method such as compression molding process, injection molding process, resin transfer molding processes and its variants.

36 MATERIALS SCIENCE↗

Covalent reinforcement of carbon nanotube assemblies

Disclosed here is a method of fabricating a covalently reinforced carbon nanotube (CNT) assembly. The method includes producing a CNT assembly by pulling entangled CNTs from a CNT array fabricated on a substrate, the CNT assembly including a plurality of CNTs that are aligned; and creating covalent bonding between the CNTs of the CNT assembly by applying a high energy ion irradiation to the CNT assembly.

Lepro Chavez, Xavier N.↗

Unsupervised, supervised and reinforced learning via spiking computation

The present invention relates to unsupervised, supervised and reinforced learning via spiking computation. The neural network comprises a plurality of neural modules. Each neural module comprises multiple digital neurons such that each neuron in a neural module has a corresponding neuron in another neural module. An interconnection network comprising a plurality of edges interconnects the plurality of neural modules. Each edge interconnects a first neural module to a second neural module, and each edge comprises a weighted synaptic connection between every neuron in the first neural module and a corresponding neuron in the second neural module.

Modha, Dharmendra S.↗

Large-Eddy Simulation of Flow Over Boeing Gaussian Bump Using Multiagent Reinforcement Learning Wall Model: Preprint

We develop a wall model for large-eddy simulation (LES) that takes into account various pressure-gradient effects using multi-agent reinforcement learning. The model is trained using low-Reynolds-number flow over periodic hills with agents distributed on the wall at various computational grid points. It utilizes a wall eddy-viscosity formulation as the boundary condition to apply the modeled wall shear stress. Each agent receives states based on local instantaneous flow quantities at an off-wall location, computes a reward based on the estimated wall-shear stress, and provides an action to update the wall eddy viscosity at each time step. The trained wall model is validated in wall-modeled LES of flow over periodic hills at higher Reynolds numbers, and the results show the effectiveness of the model on flow with pressure gradients. The analysis of the trained model indicates that the model is capable of distinguishing between the various pressure gradient regimes present in the flow. To further assess the robustness of the developed wall model, simulations of flow over the Boeing Gaussian bump are conducted at a Reynolds number of 2 x 10^6, based on the free-stream velocity and the bump width. The results of mean skin friction and pressure on the bump surface, as well as the velocity statistics of the flow field, are compared to those obtained from equilibrium wall model (EQWM) simulations and published experimental data sets. The developed wall model is found to successfully capture the acceleration and deceleration of the turbulent boundary layer on the bump surface, providing better predictions of skin friction near the bump peak and exhibiting comparable performance to the EQWM with respect to the wall pressure and velocity field. We also conclude that the subgrid-scale model is crucial to the accurate prediction of the flow field, in particular the prediction of separation.

boundary layer↗

Microstructures of short-carbon-fiber-reinforced SiC composites prepared by hot-pressing

Microstructures of short-carbon-fiber-reinforced silicon carbide composites, prepared by hot-pressing with MgO-Al{sub 2}O{sub 3}-Y{sub 2}O{sub 3} as sintering additives, were investigated by means of X-ray diffractometry, scanning electron microscopy, and transmission electron microscopy. The results showed that the composites could be densified at a relatively low temperature of 1800 deg. C via the liquid-phase-sintering mechanism. The amorphous interphase in the composites not only avoided the direct contact of the fibers with the matrix, but also improved the fiber/matrix bonding, so they could improve the densification of the composites and avoid the degeneration of the carbon fiber. The nano silicon carbide derived from polycarbosilane, could play a role of improving the relative density of the composites.

36 MATERIALS SCIENCE↗

Distributed reinforcement learning and consensus control of energy systems

Disclosed herein are methods, systems, and devices for utilizing distributed reinforcement learning and consensus control to most effectively generate and utilize energy. In some embodiments, individual turbines within a wind farm may communicate to reach a consensus as to the desired yaw angle based on the wind conditions.

King, Jennifer Rose Rose↗

Self-Driving Telescopes: Autonomous Scheduling of Astronomical Observation Campaigns with Offline Reinforcement Learning

Modern astronomical experiments are designed to achieve multiple scientific goals, from studies of galaxy evolution to cosmic acceleration. These goals require data of many different classes of night-sky objects, each of which has a particular set of observational needs. These observational needs are typically in strong competition with one another. This poses a challenging multi-objective optimization problem that remains unsolved. The effectiveness of Reinforcement Learning (RL) as a valuable paradigm for training autonomous systems has been well-demonstrated, and it may provide the basis for self-driving telescopes capable of optimizing the scheduling for astronomy campaigns. Simulated datasets containing examples of interactions between a telescope and a discrete set of sky locations on the celestial sphere can be used to train an RL model to sequentially gather data from these several locations to maximize a cumulative reward as a measure of the quality of the data gathered. We use simulated data to test and compare multiple implementations of a Deep Q-Network (DQN) for the task of optimizing the schedule of observations from the Stone Edge Observatory (SEO). We combine multiple improvements on the DQN and adjustments to the dataset, showing that DQNs can achieve an average reward of 87%+-6% of the maximum achievable reward in each state on the test set. This is the first comparison of offline RL algorithms for a particular astronomical challenge and the first open-source framework for performing such a comparison and assessment task.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

"Reinforcement Learning Based Oscillation Dampening: Scaling up Single-Agent RL algorithms to a 100 AV highway field operational test"

In this article, we explore the technical details of the reinforcement learning (RL) algorithms that were deployed in the largest field test of automated vehicles designed to smooth traffic flow in history as of 2023, uncovering the challenges and breakthroughs that come with developing RL controllers for automated vehicles. We delve into the fundamental concepts behind RL algorithms and their application in the context of self-driving cars, discussing the developmental process from simulation to deployment in detail, from designing simulators to reward function shaping. We present the results in both simulation and deployment, discussing the flow-smoothing benefits of the RL controller. From understanding the basics of Markov decision processes to exploring advanced techniques such as deep RL, our article offers a comprehensive overview and deep dive of the theoretical foundations and practical implementations driving this rapidly evolving field. We also showcase real-world case studies and alternative research projects that highlight the impact of RL controllers in revolutionizing autonomous driving. From tackling complex urban environments to dealing with unpredictable traffic scenarios, these intelligent controllers are pushing the boundaries of what automated vehicles can achieve. Furthermore, we examine the safety considerations and hardware-focused technical details surrounding deployment of RL controllers into automated vehicles. As these algorithms learn and evolve through interactions with the environment, ensuring their behavior aligns with safety standards becomes crucial. We explore the methodologies and frameworks being developed to address these challenges, emphasizing the importance of building reliable control systems for automated vehicles.

Jang, Kathy↗

Reinforcement Learning for Energy-Movement Optimization in Arduino-Based Robotics

Our goal is to develop a learning method for an Arduino-based robotthat maximizes travel distance and minimizes energy expenditure. • Will implement State ActionReward State Action (SARSA) reinforcement learning algorithm • Learning steps informed by state of environment • Rewards good decisions and punishes bad ones.

Gilmore, Blake↗

Reinforcement Learning for Distance Maximization in Energy-Constrained Robots

Our goal is to teach a robot to walk in an energy efficient way. Inspired by nature [1], we create a reinforcement learning method that balances distance traveled and energy consumption, which we call “utility.” Further, each step is symmetric to ensure equal strides while walking straight. We achieve our goal by rewarding decisions that lead to the best utility over several training iterations.

Pereira, Luiz Manella↗

Extreme Risk Mitigation in Reinforcement Learning using Extreme Value Theory

Risk-sensitive reinforcement learning (RL) has garnered significant attention in recent years due to the growing interest in deploying RL agents in real-world scenarios. A critical aspect of risk awareness involves modelling highly rare risk events (rewards) that could potentially lead to catastrophic outcomes. These infrequent occurrences present a formidable challenge for data-driven methods aiming to capture such risky events accurately. While risk-aware RL techniques do exist, they suffer from high variance estimation due to the inherent data scarcity. Our work proposes to enhance the resilience of RL agents when faced with very rare and risky events by focusing on refining the predictions of the extreme values predicted by the state-action value distribution. To achieve this, we formulate the extreme values of the state-action value function distribution as parameterized distributions, drawing inspiration from the principles of extreme value theory (EVT). We propose an extreme value theory based actor-critic approach, namely, Extreme Valued Actor-Critic (EVAC) which effectively addresses the issue of infrequent occurrence by leveraging EVT-based parameterization. Importantly, we theoretically demonstrate the advantages of employing these parameterized distributions in contrast to other risk-averse algorithms. Our evaluations show that the proposed method outperforms other risk averse RL algorithms on a diverse range of benchmark tasks, each encompassing distinct risk scenarios.

Wang, Yu↗

Covalent reinforcement of carbon nanotube assemblies

Disclosed here is a method of fabricating a covalently reinforced carbon nanotube (CNT) assembly. The method includes producing a CNT assembly by pulling entangled CNTs from a CNT array fabricated on a substrate, the CNT assembly including a plurality of CNTs that are aligned; and creating covalent bonding between the CNTs of the CNT assembly by applying a high energy ion irradiation to the CNT assembly.

Lepro Chavez, Xavier N.↗

Fiber reinforced aerogel composites

Fiber reinforced aerogel composites, including a transparent composite material that contains an aerogel and fibers embedded into the aerogel and/or bonded to one or more surfaces of the aerogel, and composites that contain an aerogel tile and an assemblage of fibers embedded into the aerogel tile or bonded to the aerogel tile that are useful as Cherenkov radiators for the detection and identification of subatomic particles. Also, methods of making and using the composites.

Pegg, Ian Louis↗