Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Operator learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 343 records · Page 19

Forecasting Propagation and Evolution of CMEs in an Operational Setting: What Has Been Learned

One of the major types of solar eruption, coronal mass ejections (CMEs) not only impact space weather, but also can have significant societal consequences. CMEs cause intense geomagnetic storms and drive fast mode shocks that accelerate charged particles, potentially resulting in enhanced radiation levels both in ions and electrons. Human and technological assets in space can be endangered as a result. CMEs are also the major contributor to generating large amplitude Geomagnetically Induced Currents (GICs), which are a source of concern for power grid safety. Due to their space weather significance, forecasting the evolution and impacts of CMEs has become a much desired capability for space weather operations worldwide. Based on our operational experience at Space Weather Research Center at NASA Goddard Space Flight Center (http://swrc.gsfc.nasa.gov), we present here some of the insights gained about accurately predicting CME impacts, particularly in relation to space weather operations. These include: 1. The need to maximize information to get an accurate handle of three-dimensional (3-D) CME kinetic parameters and therefore improve CME forecast; 2. The potential use of CME simulation results for qualitative prediction of regions of space where solar energetic particles (SEPs) may be found; 3. The need to include all CMEs occurring within a ~24 h period for a better representation of the CME interactions; 4. Various other important parameters in forecasting CME evolution in interplanetary space, with special emphasis on the CME propagation direction. It is noted that a future direction for our CME forecasting is to employ the ensemble modeling approach.

forecasting↗

Insights and Observations From Operating A Laser Communication Terminal on the International Space Station (ISS)

The Integrated Laser Communication Relay Demonstration (LCRD) Low Earth Orbit User Modem and Amplifier Terminal (ILLUMA-T) is the first user platform for NASA’s first laser communication relay, LCRD. ILLUMA-T is hosted on the International Space Station (ISS) as an external payload of the Japanese Experiment Module – Exposed Facility (JEM-EF) situated in slot 3. The LCRD payload is hosted on the STPSat-6 spacecraft, which orbits Earth in a geostationary orbit at position 112 W. The ILLUMA-T-to-LCRD system provides a bidirectional, space-to-ground laser communication relay link transferring data up to 1.2 Gbps utilizing two optical ground stations (OGS), OGS-1 in California and OGS-2 in Hawai’i. This paper describes lessons learned from operating the ILLUMA-T system and examines topics such as the end-to-end system availability, predictive versus actual ephemeris, acquisition adjustments, modem timing and handshaking, the terminal’s physical placement and accommodations, and experiment development, execution, and analysis. The authors of this paper operate both the LCRD and ILLUMA-T laser terminals on a daily basis including pass planning, procedure execution, acquisition analysis, and real-time terminal commanding and telemetry monitoring. LCRD is a joint project involving NASA Goddard Space Flight Center (GSFC), the California Institute of Technology Jet Propulsion Laboratory (JPL), and Massachusetts Institute of Technology Lincoln Laboratory (MIT LL). The ILLUMA-T payload is managed by NASA GSFC in Greenbelt, Maryland whose partners include the ISS program office at NASA’s Johnson Space Center (JSC) in Houston, Texas; the Huntsville Operations Support Center (HOSC) at Marshall Space Flight Center (MSFC) in Huntsville, Alabama; the Glenn Research Center (GRC) in Cleveland, Ohio; and the MIT LL in Lexington, Massachusetts. ILLUMA-T is funded by the Space Communications and Navigation (SCaN) Program at NASA Headquarters in Washington, D.C.

Laser Communications↗

The Johnson Space Center Management Information Systems (JSCMIS): An interface for organizational databases

The Management Information and Decision Support Environment (MIDSE) is a research activity to build and test a prototype of a generic human interface on the Johnson Space Center (JSC) Information Network (CIN). The existing interfaces were developed specifically to support operations rather than the type of data which management could use. The diversity of the many interfaces and their relative difficulty discouraged occasional users from attempting to use them for their purposes. The MIDSE activity approached this problem by designing and building an interface to one JSC data base - the personnel statistics tables of the NASA Personnel and Payroll System (NPPS). The interface was designed against the following requirements: generic (use with any relational NOMAD data base); easy to learn (intuitive operations for new users); easy to use (efficient operations for experienced users); self-documenting (help facility which informs users about the data base structure as well as the operation of the interface); and low maintenance (easy configuration to new applications). A prototype interface entitled the JSC Management Information Systems (JSCMIS) was produced. It resides on CIN/PROFS and is available to JSC management who request it. The interface has passed management review and is ready for early use. Three kinds of data are now available: personnel statistics, personnel register, and plan/actual cost.

Bishop, Peter C.↗

Machine Learning Pattern Recognition Algorithm With Applications to Coherent Laser Combination

Herein we analyze a new kind of machine learning algorithm designed to feedback stabilize coherently combined lasers. This algorithm learns differential, rather than absolute, values of action in phase space, in order to facilitate learning on initially unstable systems. Experiments have shown that this approach can control small-scale spatial beam combination with high stability. In this paper we analyze the algorithm's performance and limitations in depth, showing that it can continuously learn during operation in order to track changes. Using simulation, we extend the application to temporal combination, and show that it scales to more complex instances by combining 81 beams.

97 MATHEMATICS AND COMPUTING↗

Lunar Reconnaissance Orbiter (LRO) Thermal On-Orbit Performance

The Lunar Reconnaissance Orbiter (LRO) was launched on June 18, 2009. The nominal mission ended on September 15, 2010 and LRO is now on a four-year extended mission. The LRO performances in hot and cold cases are compared to pre-launch analysis predicts, and operational lessons learned are discussed. One instrument has required tighter-than-anticipated thermal control, and two others have frequently requested unanticipated calibration maneuvers that had to be evaluated for their thermal performance. A series of off nadir thermal analyses of the entire orbiter were performed prior to launch, and these predictions are compared to actual maneuvers, with a discussion of the process by which maneuvers can be rapidly evaluated for thermal concerns. On December 21st, 2010, LRO experienced its first severe Lunar Eclipse. Operationally, this required the Spacecraft to pre-heat its main avionics panel in order to minimize control heater power during the period when the Earth blocks the sun from the moon. The operational design and in-flight performance are summarized.

Baker, Charles↗

Cognitive Anti-Jamming Satellite-To-Ground Communications on NASA's SCaN Testbed

Machine learning aided cognitive anti-jamming communications is designed, developed and demonstrated on a live satellite-to-ground link. A wideband autonomous cognitive radio (WACR) is designed and implemented as a hardware-in-the- loop (HITL) prototype. The cognitive engine (CE) of the WACR is implemented on a PC while the software-defined radio (SDR) platform utilized two different radios for spectrum sensing and actual communications. The cognitive engine performs spectrum knowledge acquisition over the complete spectrum range available for the SATCOM system operation and learns an anti-jamming communications protocol to avoid both intentional jammers and inadvertent interferers using reinforcement learning. When the current satellite-to-ground link is jammed, the cognitive engine of the ground receiver directs the satellite transmitter to switch to a new channel that is predicted to be jammer-free for the longest possible duration. The end-to-end, closed-loop system was tested on the NASA Space Communications and Navigation (SCaN) Testbed on the International Space Station (ISS). The experimental results demonstrated the feasibility of satellite-to-ground cognitive anti-jamming communications along with excellent anti-jamming capability of machine learning aided cognitive protocols against several different types of jammers.

Jayaweera, Sudharman K.↗

Cognitive Anti-jamming Satellite-to-Ground Communications on NASA's SCaN Testbed

Machine learning aided cognitive anti-jamming communications is designed, developed and demonstrated on an experimental satellite-to-ground link. A wideband autonomous cognitive radio (WACR) is designed and implemented as a hardware-in the-loop (HITL) prototype. The cognitive engine (CE) of the WACR is implemented on a PC while the software-defined radio (SDR) platform utilized two different radios for spectrum sensing and actual communications. The cognitive engine performs spectrum knowledge acquisition over the complete spectrum range available for the SATCOM system operation and learns an anti-jamming communications protocol to avoid both intentional jammers and inadvertent interferers using reinforcement learning. When the current satellite-to-ground link is jammed, the cognitive engine of the ground receiver directs the satellite transmitter to switch to a new channel that is predicted to be jammer-free for the longest possible duration. The end-to-end, closed-loop system was tested with the NASA's Space Communications and Networking (SCaN) testbed on the International Space Station (ISS). The experimental results demonstrated the feasibility of satellite-to-ground cognitive anti-jamming communications along with excellent anti-jamming capability of machine-learning aided cognitive protocols against several different types of jammers.

Jayaweera, Sudharman K.↗

A reinforcement learning approach to long-horizon operations, health, and maintenance supervisory control of advanced energy systems

In this work, we develop a Reinforcement Learning (RL) approach to the supervisory control problem for advanced energy systems, such as novel nuclear reactors and other demand-driven, mission-critical, and component-health-sensitive energy plants. The inclusive problem landscape considered captures the stochastic confluence of plant performance, component health evolution, power demand from the grid, diverse maintenance actions, and operator-defined goals and constraints, all considered over meaningfully long-enough reasoning horizons. Key aspects of the proposed approach are a receding horizon control-inspired technique dictating time- or event-triggered supervisory policy (re-)constructions, as well as additional capability-enabling contributions such as timescale compression, to handle long reasoning horizons and uncertainty in parts of the problem, and practical yet demonstrably-effective handling of hybrid action spaces with continuous and discrete decision variables. The resulting algorithm consists of a simulation-based RL agent constructing stochastic supervisory control policies over nontrivial action spaces and for long horizons, applying the learned policy to the system for a much shorter interval, and perpetually repeating, to construct the next long-horizon policy. That next policy will only be applied, again, for a short interval, yet originally far-in-time events move progressively closer, their associated uncertainty decreases, and new events and aspects enter the reasoning horizon. The proposed methodology bridges fundamental receding horizon concepts with the unequivocally stronger and more scalable reasoning of contemporary RL. Numerical examples using Soft Actor–Critic Deep RL illustrate the operation and efficacy of the proposed technique for a power plant tasked with health-aware load following missions in a dynamic electricity market landscape.

97 MATHEMATICS AND COMPUTING↗

Development of human machine interface (HMI) for digital control rooms in nuclear power plants - 119

The analog control systems of traditional Nuclear Power Plants (NPPs) are being replaced by digital systems due to the fact that analog Instrumentation and Control (I and C) systems are becoming obsolete and such technology is no longer supported by manufacturers. The purpose of this study is to jointly evaluate the performance of an operator with a Human Machine Interface (HMI) in a NPP digital control room ensuring the efficiency and the safety of the NPP. The validity and the accuracy of the operators' actions are the primary goals that have to be preserved through the emergence of the HMI based in digital systems. The transition from analog to digital control systems leads to a more advanced support of the NPP; Video Display Units (VDUs) are used for monitoring the state of the NPP while alarm systems help for directing attention. The operators, in order to monitor information from the different VDUs, have to switch attention between different screens (alarms systems and control systems). Therefore, a well-established HMI is a significant challenge to the overall operation of the NPP, that actually helps the operators to learn from the available information in detecting possible anomalies and making the right decisions, to ensure safety, and in parallel to diminish the human error. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Software Defined Architectures for Data Analytics

Data analytics applications increasingly are complex workflows composed of phases with very different program behaviors (e.g., graph algorithms and machine learning, algorithms operating on sparse an dense data structures, etc). To reach the levels of efficiency required to process these workflows in real time, upcoming architectures will need to leverage even more workload specialization. If, at one end, we may find even more heterogenous processors composed by a myriad of specialized processing elements, at the other end we may see novel reconfigurable architectures, composed of sets of functional units and memories interconnected with (re)configurable on-chip networks, able to adapt dynamically to adapt the workload characteristics. Field Programmable Gate Arrays are more and more used for accelerating various workloads and, in particular, inferencing in machine learning, providing higher efficiency than other solutions. However, their fine grained nature still leads to issues for the design software and still makes dynamic reconfiguration impractical. Future, more coarse-grained architectures could offer the features to execute diverse workloads at high efficiency while providing better reconfiguration mechanisms for dynamic adaptability. Nevertheless, we argue that the challenges for reconfigurable computing remain in the software. In this position paper, we describe a possible toolchain for reconfigurable architectures targeted at data analytics.

FPGA, Dataflow, Reconfigurable Architectures, Soft↗

Using Artificial Intelligence and Machine Learning to Enhance Mission Design and Operations of the Habitable Worlds Observatory (HWO)

One key aspect in the development of HWO is the early deployment of artificial intelligence (AI) and machine learning (ML) to enhance mission science and operations. Our subtask group is part of the HWO AI/ML working group and focuses on AI and ML for mission operations. Our task group seeks to educate other HWO working groups about AI and ML capabilities for mission operations, investigate how to bridge technology gaps, and enable new capabilities particularly in the areas of observational scheduling, instrument health monitoring, and downlink operations. We focus on mission tasking / scheduling both for mission analysis in development and operations. AI and ML for mission scheduling includes: tools to support proposal calls and review, ensuring fairness in calls for proposals, community peer reviews and ease workloads, as well as in-flight and ground software development (e.g., using natural language processing (NLP) to support process automation from requirements). AI and ML for the mission’s development and operations include 1) anomaly detection and prediction (from onboard and ground based tools) to monitor the spacecraft’s health, 2) ground-based automated scheduling for mission operations including long-term and short-term planning and maintenance, and 3) flight system flexible execution (as flight proven for Spitzer and JWST) to enable robust execution despite execution variations, and 4) data analysis for prioritization (e.g., real-time data evaluation leading to autonomous actions and adjustments, high-priority identification, onboard data compression, etc.). Incorporation of ML and AI will enable HWO to address the major science questions related to exoplanet characterization, general astrophysics, and solar system exploration and also extend the boundaries of space mission technologies.

Mark Moussa↗

Transition metal impurities in silicon: computational search for a semiconductor qubit

Abstract Semiconductors offer a promising platform for physical implementation of qubits, but their broad adoption is presently hindered by limited scalability and/or very low operating temperatures. Learning from the nitrogen-vacancy centers in diamond, our goal is to find equivalent optically active point defect centers in crystalline silicon, which could be advantageous for their scalability and integration with classical devices. Transition metal (TM) impurities in silicon are common paramagnetic deep defects, but a comprehensive theoretical study of the whole 3 d series that considers generalized Koopmans’ condition is missing. We apply the HSE06(+U) method to examine their potential as optically active spin qubits and identify seven TM impurities that have optically allowed triplet–triplet transitions within the silicon band gap. These results provide the first step toward silicon-based qubits with higher operating temperatures for quantum sensing. Additionally, these point defects could lead to spin-photon interfaces in silicon-based qubits and devices for mid-infrared free-space communications.

36 MATERIALS SCIENCE↗

ICE-RASSOR: Intelligent Capabilities Enhanced Regolith Advanced Surface Systems Operations Robot

NASA’s Regolith Advanced Surface Systems Operations Robot (RASSOR) is principally designed to mine and deliver regolith for In-Situ Resource Utilization (ISRU)processing. RASSOR’s design enables it to efficiently collect and deposit regolith, return collected material for processing, and myriad related ISRU activities. To reliably perform these operations on the lunar surface, RASSOR software and sensory systems need to be robust and maximize the information extracted from a reduced sensor payload. Herein, we present preliminary findings from the Intelligent Capabilities Enhanced RASSOR project. We apply supervised learning using real data to estimate the soil mass collected without the need for mass flow rate monitors or other explicate sensing techniques. We also create a reduced-order simulation environment to develop autonomous trenching controllers via reinforcement learning and prototype state estimation architectures. Our initial results suggest that excavated regolith mass can be inferred within 2.9% RMS error of full scale, and reinforcement learning for autonomous operations has learned viable trenching strategies and helped identify desirable sensing capabilities, arrangements, and considerations. Future work includes regolith mass estimation during dynamic operation, expanding our simulation to more complex environments, and transfer learning from simulation to hardware.

machine learning↗

ICE-RASSOR: Intelligent Capabilities Enhanced Regolith Advanced Surface Systems Operations Robot

NASA’s Regolith Advanced Surface Systems Operations Robot (RASSOR) is principally designed to mine and deliver regolith for In-Situ Resource Utilization (ISRU) processing. RASSOR’s design enables it to efficiently collect and deposit regolith, return collected material for processing, and myriad related ISRU activities. To reliably perform these operations on the lunar surface, RASSOR software and sensory systems need to be robust and maximize the information extracted from on-board sensory. Herein, we present preliminary findings from the Intelligent Capabilities Enhanced RASSOR project. We apply supervised learning using real data to estimate the soil mass collected without the need for mass flow rate monitors or other explicate sensing techniques. We also create a reduced-order simulation environment to develop autonomous trenching controllers via reinforcement learning and proto-type state estimation architectures. Our initial results suggest that excavated regolith mass can be inferred within 2.9% RMS error of full scale, and reinforcement learning for autonomous operations has learned viable trenching strategies and helped identify desirable sensing capabilities, arrangements, and considerations. Future work includes regolith mass estimation during dynamic operation, expanding our simulation to more complex environments, and transfer learning from simulation to hardware.

machine learning↗

Enhancing the Operational Resilience of Advanced Reactors with Digital Twins by Recurrent Neural Networks

Because of a lack of operation data during abnormal and accident scenarios, along with the existence of uncertainty in the evaluation model for transient and accident analysis, the established abnormal and emergency operating procedures can be biased in characterizing the reactor states and ensuring operational resilience. To improve state awareness and ensure operational flexibility for minimizing effects on the system due to anomaly, digital twin (DT) technology is suggested to support operator's decision-making by effectively extracting and using knowledge of the current and future plant states from the knowledge base. To demonstrate DT's capability for recovering the complete states of reactors and for predicting the future reactor behaviors, this paper develops and assesses both the diagnosis and prognosis DTs in a nearly autonomous management and control system for an Experimental Breeder Reactor-II simulator during different loss-of-flow scenarios.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

First Results from the Mojave Volatiles Prospector (MVP) Field Campaign, a Lunar Polar Rover Mission Analog

The Mojave Volatiles Prospector (MVP) project is a science-driven field program with the goal to produce critical knowledge for conducting robotic exploration of the Moon. MVP will feed science, payload, and operational lessons learned to the development of a real-time, short-duration lunar polar volatiles prospecting mission. MVP achieves these goals through a simulated lunar rover mission to investigate the composition and distribution of surface and subsurface volatiles in a natural and a priori unknown environment within the Mojave Desert, improving our understanding of how to find, characterize, and access volatiles on the Moon. The MVP field site is the Mojave Desert, selected for its low, naturally occurring water abundance. The Mojave typically has on the order of 2-6% water, making it a suitable lunar analog for this field test. MVP uses the Near Infrared and Visible Spectrometer Subsystem (NIRVSS), Neutron Spectrometer Subsystem (NSS), and a downward facing GroundCam camera on the KREX-2 rover to investigate the relationship between the distribution of volatiles and soil crust variation. Through this investigation, we mature robotic in situ instruments and concepts of instrument operations, improve ground software tools for real time science, and carry out publishable research on the water cycle and its connection to geomorphology and mineralogy in desert environments. A lunar polar rover mission is unlike prior space missions and requires a new concept of operations. The rover must navigate 3-5 km of terrain and examine multiple sites in in just ~6 days. Operational decisions must be made in real time, requiring constant situational awareness, data analysis and rapid turnaround decision support tools. This presentation will focus on the first science results and operational architecture findings from the MVP field deployment relevant to a lunar polar rover mission.

Heldmann, Jennifer L.↗

Joint ptycho-tomography with deep generative priors

Abstract Joint ptycho-tomography is a powerful computational imaging framework to recover the refractive properties of a 3D object while relaxing the requirements for probe overlap that is common in conventional phase retrieval. We use an augmented Lagrangian scheme for formulating the constrained optimization problem and employ an alternating direction method of multipliers (ADMM) for the joint solution. ADMM allows the problem to be split into smaller and computationally more efficient subproblems: ptychographic phase retrieval, tomographic reconstruction, and regularization of the solution. We extend our ADMM framework with plug-and-play (PnP) denoisers by replacing the regularization subproblem with a general denoising operator based on machine learning. While the PnP framework enables integrating such learned priors as denoising operators, tuning of the denoiser prior remains challenging. To overcome this challenge, we propose a denoiser parameter to control the effect of the denoiser and to accelerate the solution. In our simulations, we demonstrate that our proposed framework with parameter tuning and learned priors generates high-quality reconstructions under limited and noisy measurement data.

97 MATHEMATICS AND COMPUTING↗

ICE-RASSOR: Intelligent Capabilities Enhanced

NASA’s Regolith Advanced Surface Systems Operations Robot (RASSOR) is principally designed to mine and deliver regolith for In-Situ Resource Utilization (ISRU) processing. RAS-SOR’s design enables it to efficiently collect and deposit regolith, return collected material for processing, and myriad related ISRU activities. To reliably perform these operations on the lunar sur-face, RASSOR software and sensory systems need to be robust and maximize the information extracted from on-board sensing. Herein, we present preliminary findings from the Intelligent Capabilities Enhanced RASSOR project. We apply supervised learning using real data to estimate the soil mass collected without the need for mass flow rate monitors or other explicate sensing techniques. We also create a reduced-order simulation environment to develop autonomous trenching controllers via reinforcement learning and proto-type state estimation architectures. Our initial results suggest that excavated regolith mass can be inferred within 2.9% RMS error of full scale, and reinforcement learning for autonomous operations has learned viable trenching strategies and helped identify desirable sensing capabilities, arrangements, and considerations. Future work includes regolith mass estimation during dynamic operation, expanding our simulation to more complex environments, and transfer learning from simulation to hardware.

machine learning↗