Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “RL”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
NASA NTRS1999

Designing Specification Languages for Process Control Systems: Lessons Learned and Steps to the Future

Previously, we defined a blackbox formal system modeling language called RSML (Requirements State Machine Language). The language was developed over several years while specifying the system requirements for a collision avoidance system for commercial passenger aircraft. During the language development, we received continual feedback and evaluation by FAA employees and industry representatives, which helped us to produce a specification language that is easily learned and used by application experts. Since the completion of the PSML project, we have continued our research on specification languages. This research is part of a larger effort to investigate the more general problem of providing tools to assist in developing embedded systems. Our latest experimental toolset is called SpecTRM (Specification Tools and Requirements Methodology), and the formal specification language is SpecTRM-RL (SpecTRM Requirements Language). This paper describes what we have learned from our use of RSML and how those lessons were applied to the design of SpecTRM-RL. We discuss our goals for SpecTRM-RL and the design features that support each of these goals.

Leveson, Nancy G.↗
NASA NTRS2000

Reinforcement Learning in Distributed Domains: Beyond Team Games

Distributed search algorithms are crucial in dealing with large optimization problems, particularly when a centralized approach is not only impractical but infeasible. Many machine learning concepts have been applied to search algorithms in order to improve their effectiveness. In this article we present an algorithm that blends Reinforcement Learning (RL) and hill climbing directly, by using the RL signal to guide the exploration step of a hill climbing algorithm. We apply this algorithm to the domain of a constellations of communication satellites where the goal is to minimize the loss of importance weighted data. We introduce the concept of 'ghost' traffic, where correctly setting this traffic induces the satellites to act to optimize the world utility. Our results indicated that the bi-utility search introduced in this paper outperforms both traditional hill climbing algorithms and distributed RL approaches such as team games.

Wolpert, David H.↗
NASA NTRS2004

Adaptive, Distributed Control of Constrained Multi-Agent Systems

Product Distribution (PO) theory was recently developed as a broad framework for analyzing and optimizing distributed systems. Here we demonstrate its use for adaptive distributed control of Multi-Agent Systems (MASS), i.e., for distributed stochastic optimization using MAS s. First we review one motivation of PD theory, as the information-theoretic extension of conventional full-rationality game theory to the case of bounded rational agents. In this extension the equilibrium of the game is the optimizer of a Lagrangian of the (Probability dist&&on on the joint state of the agents. When the game in question is a team game with constraints, that equilibrium optimizes the expected value of the team game utility, subject to those constraints. One common way to find that equilibrium is to have each agent run a Reinforcement Learning (E) algorithm. PD theory reveals this to be a particular type of search algorithm for minimizing the Lagrangian. Typically that algorithm i s quite inefficient. A more principled alternative is to use a variant of Newton's method to minimize the Lagrangian. Here we compare this alternative to RL-based search in three sets of computer experiments. These are the N Queen s problem and bin-packing problem from the optimization literature, and the Bar problem from the distributed RL literature. Our results confirm that the PD-theory-based approach outperforms the RL-based scheme in all three domains.

Bieniawski, Stefan↗
NASA NTRS1990

Light-stimulated cell expansion in bean (Phaseolus vulgaris L.) leaves. II. Quantity and quality of light required

The quantity and quality of light required for light-stimulated cell expansion in leaves of Phaseolus vulgaris L. have been determined. Seedlings were grown in dim red light (RL; 4 micromoles photons m-2 s-1) until cell division in the primary leaves was completed, then excised discs were incubated in 10 mM sucrose plus 10 mM KCl in a variety of light treatments. The growth response of discs exposed to continuous white light (WL) for 16 h was saturated at 100 micromoles m-2 s-1, and did not show reciprocity. Extensive, but not continuous, illumination was needed for maximal growth. The wavelength dependence of disc expansion was determined from fluence-response curves obtained from 380 to 730 nm provided by the Okazaki Large Spectrograph. Blue (BL; 460 nm) and red light (RL; 660 nm) were most effective in promoting leaf cell growth, both in photosynthetically active and inhibited leaf discs. Far-red light (FR; 730 nm) reduced the effectiveness of RL, but not BL, indicating that phytochrome and a separate blue-light receptor mediate expansion of leaf cells.

NASA Discipline Plant Biology↗
NASA NTRS2010

Evolution of Interplanetary Shocks and their CME Drivers

Shock-driving coronal mass ejections (CMEs) constitute the most energetic phenomena in the heliosphere. The shocks can be identified in a number of ways based on remote-sensing and in situ observations. Type II radio bursts are the earliest indicators of shocks that accelerate electrons to energies up to -10 keV. Solar energetic particle (SEP) events are always accompanied by long wavelength type II bursts indicating that the same shock accelerates ions and electrons. A recent investigation involving a large number of interplanetary (IP) shocks revealed that about 35% of them do not produce type II bursts (radio quiet, RQ) or SEPs. Comparison of the RQ shocks with the radio loud (RL) ones revealed some interesting results such as: (1) the lack of evidence for blast waves,(2) energetic particle enhancement in the shock front in -20% of RQ shocks, and (3) determination of the difference between the RQ and RL shocks in terms of the different kinematic properties of the associated CMEs. On the other hand the shock properties measured at I AU are not too different for the RQ and RL cases. This can be attributed to the interaction with the IP medium, which seems to erase the difference. Implications of this evolution for the geoeffectiveness is also discussed.

Gopalswamy, Natchimuthuk↗
NASA NTRS2010

Influences of the Driver and Ambient Medium Characteristics on the Formation of Shocks in the Solar Atmosphere

Traveling interplanetary (IP) shocks were discovered in the early 1960s, but their solar origin has been controversial. Early research focused on solar flares as the source of the shocks, but when coronal mass ejections (CMEs) were discovered, it became clear that fast CMEs clearly can drive the shocks. Type II radio bursts are excellent signatures of shocks near the Sun. The close correspondence between type II radio bursts and solar energetic particles (SEPs) makes it clear that the same shock accelerates ions and electrons. A recent investigation involving a large number of IP shocks revealed that about 35% of IP shocks do not produce type II bursts or SEPs. Comparing these radio quiet (RQ) shocks with the radio loud (RL) ones revealed some interesting results: (1) there is no evidence for blast waves, in that all IP shocks can be attributed to CMEs, (2) a small fraction (20%) of RQ shocks is associated with ion enhancements at the shocks when they move past the observing spacecraft, (3) the primary difference between the RQ and RL shocks can be traced to the different kinematic properties of the associated CMEs and the variation of the characteristic speeds of the ambient medium, and (4) the shock properties measured at 1 AU are not too different for the RQ and RL cases due to the interaction of the shock driver with the IP medium that seems to erase the difference.

Nat, Gopalswamy↗
NASA NTRS2010

Shock-Driving CMEs Near the Sun, in the Interplanetary Medium, and Near Earth

The excellent correspondence between type II radio bursts and solar energetic particles (SEPs) made it clear that the same shock accelerates ions and electrons. A recent investigation involving a large number of I shocks revealed that about 35% of IP shocks do not produce type II bursts (radio quiet) or SEPs. Comparing the RQ shocks with the radio loud (RL) ones revealed some interesting results, which will be summarized in this poster. (1) There is no evidence for blast waves. (2) Even a small fraction (20%) of RQ shocks is associated with ion enhancements at the shock when the shock passes the spacecraft. (3) The primary difference between the RQ and RL shocks can be traced to the different kinematic properties of the associated CMEs, although the shock properties measured at 1 AU are not too different for the RQ and RL cases. This can be attributed to the interaction with the IP medium, which seems to erase the difference. More details can be found in Astrophysical Journal 710, 1111, 2010 (http://adsabs.harvard.edu/absZ2009arXivO9l2.4719G).

Gopalswamy, N.↗
NASA NTRS2011

On Interplanetary Shocks Driven by Coronal Mass Ejections

Traveling interplanetary (IP) shocks were first detected in the early 1960s, but their solar origin has been controversial. Early research focused on solar flares as the source of the shocks, but when CMEs were discovered, it became clear that fast CMEs are the shock drivers. Type radio II bursts are excellent signatures of shocks near the Sun (Type II radio bursts were known long before the detection of shocks and CMEs). The excellent correspondence between type II bursts and solar energetic particle (SEP) events made it clear that the same shock accelerates ions and electrons. Shocks near the Sun are also seen occasionally in white-light coronagraphic images. In the solar wind, shocks are observed as discontinuities in plasma parameters such as density and speed. Energetic storm particle events and sudden commencement of geomagnetic storm are also indicators of shocks arriving at Earth. After an overview on these shock signatures, I will summarize the results of a recent investigation of a large number of IP shocks. The study revealed that about 35% of IP shocks do not produce type II bursts (radio quiet - RQ) or SEPs. Comparing the RQ shocks with the radio loud (RL) ones revealed some interesting results: (1) There is no evidence for blast wave shocks. (2) A small fraction (20%) of RQ shocks is associated with ion enhancements at the shock when the shock passes the spacecraft. (3) The primary difference between the RQ and RL shocks can be traced to the different kinematic properties of the associated CMEs. On the other hand the shock properties measured at 1 AU are not too different for the RQ and RL cases. This can be attributed to the interaction with the IP medium, which seems to erase the difference between the shocks.

Gopalswarmy, Nat↗
NASA NTRS2012

Coronal Mass Ejection-driven Shocks and the Associated Sudden Commencements-sudden Impulses

Interplanetary (IP) shocks are mainly responsible for the sudden compression of the magnetosphere, causing storm sudden commencement (SC) and sudden impulses (SIs) which are detected by ground-based magnetometers. On the basis of the list of 222 IP shocks compiled by Gopalswamy et al., we have investigated the dependence of SC/SIs amplitudes on the speed of the coronal mass ejections (CMEs) that drive the shocks near the Sun as well as in the interplanetary medium. We find that about 91% of the IP shocks were associated with SC/SIs. The average speed of the SC/SI-associated CMEs is 1015 km/s, which is almost a factor of 2 higher than the general CME speed. When the shocks were grouped according to their ability to produce type II radio burst in the interplanetary medium, we find that the radio-loud (RL) shocks produce a much larger SC/SI amplitude (average approx. 32 nT) compared to the radio-quiet (RQ) shocks (average approx. 19 nT). Clearly, RL shocks are more effective in producing SC/SIs than the RQ shocks. We also divided the IP shocks according to the type of IP counterpart of interplanetary CMEs (ICMEs): magnetic clouds (MCs) and nonmagnetic clouds. We find that the MC-associated shock speeds are better correlated with SC/SI amplitudes than those associated with non-MC ejecta. The SC/SI amplitudes are also higher for MCs than ejecta. Our results show that RL and RQ type of shocks are important parameters in producing the SC/SI amplitude.

Coronal mass ejections↗
NASA NTRS1964

Photographic Study of Liquid-Oxygen Boiling and Gas Injection in the Injector of a Chugging Rocket Engine

High-speed motion pictures were taken of conditions in the injector liquid-oxygen cavity of an RL-10 rocket engine during throttled engine operation. Photographs were taken during operation of the engine in the chugging region as the helium gas was injected to stabilize combustion, during operation at rated thrust, and during transition into chugging conditions as the gas injection was discontinued. Results of the investigation indicate that, during chugging rocket operation of the RL-10 engine, a high population of fairly large bubbles formed and collapsed within the liquid-oxygen cavity at the same frequency as the chamber pressure oscillations. When gaseous helium was injected into the liquid-oxygen cavity, a fog rapidly spread over the entire field of view, and the system immediately became stable. The injection of gaseous helium at rated conditions produced a very slight increase in engine performance but not enough to produce a net gain in a typical mission payload with the extra equipment needed. The inherent low-frequency system instability associated with the fuel system at low thrust levels was reduced by injecting either gaseous helium or hydrogen. Complete stabilization was achieved in some cases, and a reduction in the severity of the oscillations in others. This was apparently due to the ·anchoring of the phase change front to the location of the gas injection.

Conrad, E. William↗
NASA NTRS1973

Design study of RL10 derivatives. Volume 2: Engine design characteristics

The design characteristics of the RL-10 rocket engine are discussed. The results from critical elements evaluation, baseline engine design, parametric and special study tasks are presented. Critical element evaluation established the feasibility of various engine features such as tank head idle, pumped idle, autogenous tank pressurization, and two-phase pumping. Three baseline engines, derived from the RL-10 were conceptually designed. Parametric life and performance data were generated. Special studies were conducted to establish the impact on the engine design of environment, safety, interchangeability, and maintenance.

Adams, A.↗
NASA NTRS1980

Orbit transfer vehicle engine study. Volume 2: Technical report

The orbit transfer vehicle (OTV) engine study provided parametric performance, engine programmatic, and cost data on the complete propulsive spectrum that is available for a variety of high energy, space maneuvering missions. Candidate OTV engines from the near term RL 10 (and its derivatives) to advanced high performance expander and staged combustion cycle engines were examined. The RL 10/RL 10 derivative performance, cost and schedule data were updated and provisions defined which would be necessary to accommodate extended low thrust operation. Parametric performance, weight, envelope, and cost data were generated for advanced expander and staged combustion OTV engine concepts. A prepoint design study was conducted to optimize thrust chamber geometry and cooling, engine cycle variations, and controls for an advanced expander engine. Operation at low thrust was defined for the advanced expander engine and the feasibility and design impact of kitting was investigated. An analysis of crew safety and mission reliability was conducted for both the staged combustion and advanced expander OTV engine candidates.

Source record↗
NASA NTRS1992

Lunar Transportation Facilities and Operations Study, option 2

During the Option 2 period of the Lunar Transportation Facilities and Operations Study (LTFOS), a joint McDonnell Douglas Space Systems Company Kennedy Space Center (MDSSC-KSC) and National Aeronautics and Space Administration Kennedy Space Center (NASA-KSC) Study team conducted a comparison of the functional testing of the RL-10 and Space Shuttle Main Engine, a quick-look impact assessment of the Synthesis Group Report, and a detailed assessment of the Synthesis Group Report. The results of these KSC LTFOS team efforts are included. The most recent study task effort was a detailed assessment of the Synthesis Group Report. The assessment was conducted to determine the impact on planetary launch and landing facilities and operations. The result of that effort is a report entitled 'Analysis of the Synthesis Group Report, its Architectures and their Impacts on PSS Launch and Landing Operations' and is contained in Appendix A. The report is structured in a briefing format with facing pages as opposed to a narrative style. A quick-look assessment of the Synthesis Group Report was conducted to determine the impact of implementing the recommendations of the Synthesis Group on KSC launch facilities and operations. The data was documented in a presentation format as requested by Kennedy Space Center Technology and Advanced Projects Office and is included in Appendix B. Appendix C is a white paper on the comparison of the functional testing of the RL-10 and Space Shuttle Main Engine. The comparison was undertaken to provide insight regarding common test requirements that would be applicable to Lunar and Mars Excursion Vehicles (LEV and MEV).

Source record↗
NASA NTRS1996

Propagation of Electrical Excitation in a Ring of Cardiac Cells: A Computer Simulation Study

The propagation of electrical excitation in a ring of cells described by the Noble, Beeler-Reuter (BR), Luo-Rudy I (LR I), and third-order simplified (TOS) mathematical models is studied using computer simulation. For each of the models it is shown that after transition from steady-state circulation to quasi-periodicity achieved by shortening the ring length (RL), the action potential duration (APD) restitution curve becomes a double-valued function and is located below the original ( that of an isolated cell) APD restitution curve. The distributions of APD and diastolic interval (DI) along a ring for the entire range of RL corresponding to quasi-periodic oscillations remain periodic with the period slightly different from two RLs. The 'S' shape of the original APD restitution curve determines the appearance of the second steady-state circulation region for short RLs. For all the models and the wide variety of their original APD restitution curves, no transition from quasi-periodicity to chaos was observed.

Kogan, B. Y.↗
NASA NTRS1998

Modeling Controller Tasks for Safety Analysis

As control systems become more complex, the use of automated control has increased. At the same time, the role of the human operator has changed from primary system controller to supervisor or monitor. Safe design of the human computer interaction becomes more difficult. In this paper, we present a visual task modeling language that can be used by system designers to model human-computer interactions. The visual models can be translated into SpecTRM-RL, a blackbox specification language for modeling the automated portion of the control system. The SpecTRM-RL suite of analysis tools allow the designer to perform formal and informal safety analyses on the task model in isolation or integrated with the rest of the modeled system.

Brown, Molly↗
NASA NTRS1999

Institutional Memory Preservation at NASA Glenn Research Center

In this era of downsizing and deficit reduction, the preservation of institutional memory is a widespread concern for U.S. companies and governmental agencies. The National Aeronautical and Space Administration faces the pending retirement of many of the agency's long-term, senior engineers. NASA has a marvelous long-term history of success, but the agency faces a recurring problem caused by the loss of these engineers' unique knowledge and perspectives on NASA's role in aeronautics and space exploration. The current work describes a knowledge elicitation effort aimed at demonstrating the feasibility of preserving the more personal, heuristic knowledge accumulated over the years by NASA engineers, as contrasted with the "textbook" knowledge of launch vehicles. Work on this project was performed at NASA Glenn Research Center and elsewhere, and focused on launch vehicle systems integration. The initial effort was directed toward an historic view of the Centaur upper stage which is powered by two RL-10 engines. Various experts were consulted, employing a variety of knowledge elicitation techniques, regarding the Centaur and RL-10. Their knowledge is represented in searchable Web-based multimedia presentations. This paper discusses the various approaches to knowledge elicitation and knowledge representation employed, and assesses successes and challenges in trying to perform large-scale knowledge preservation of institutional memory. It is anticipated that strategies for knowledge elicitation and representation that have been developed in this grant will be utilized to elicit knowledge in a variety of domains including the complex heuristics that underly use of simulation software packages such as that being explored in the Expert System Architecture for Rocket Engine Numerical Simulators.

Coffey, J.↗
NASA NTRS2000

Adaptivity in Agent-Based Routing for Data Networks

Adaptivity, both of the individual agents and of the interaction structure among the agents, seems indispensable for scaling up multi-agent systems (MAS s) in noisy environments. One important consideration in designing adaptive agents is choosing their action spaces to be as amenable as possible to machine learning techniques, especially to reinforcement learning (RL) techniques. One important way to have the interaction structure connecting agents itself be adaptive is to have the intentions and/or actions of the agents be in the input spaces of the other agents, much as in Stackelberg games. We consider both kinds of adaptivity in the design of a MAS to control network packet routing. We demonstrate on the OPNET event-driven network simulator the perhaps surprising fact that simply changing the action space of the agents to be better suited to RL can result in very large improvements in their potential performance: at their best settings, our learning-amenable router agents achieve throughputs up to three and one half times better than that of the standard Bellman-Ford routing algorithm, even when the Bellman-Ford protocol traffic is maintained. We then demonstrate that much of that potential improvement can be realized by having the agents learn their settings when the agent interaction structure is itself adaptive.

Wolpert, David H.↗
NASA NTRS1998

Using Collective Intelligence to Route Internet Traffic

A Collective Intelligence (COIN) is a community of interacting reinforcement learning (RL) algorithms designed so that their collective behavior maximizes a global utility function. We introduce the theory of COINs, then present experiments using that theory to design COINs to control internet traffic routing. These experiments indicate that COINs outperform previous RL-based systems for such routing that have previously been investigated.

Wolpert, David H.↗