Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Autonomous Systems”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11

Unlocking Autonomous Telescopes through Reinforcement Learning: An Offline Framework and Insights from a Case Study

Optimizing observational astronomy campaigns is becoming a complex and expensive task for next-generation telescopes, where manual planning of observations may tend to reach suboptimal results in terms of optimization.Reinforcement Learning (RL) has been well-demonstrated as a valuable approach for training autonomous systems, and it may provide the basis for self-driving telescopes capable of scanning the sky and optimizing the scheduling for astronomy campaigns.We have developed a framework for the optimization of telescope scheduling using RL techniques, based on a dataset containing data on a discrete set of sky locations that the telescope should visit, and a reward metric. We compared several RL algorithms applied to an offline simulation dataset based at the Stone Edge Observatory, considering a discrete set of sky locations to visit and using “t-effective” as a reward metric, a measure of the quality of the data.Deep Q-Networks (DQNs), belonging to the class of value-based methods, have shown remarkable success in the optimization of astronomical observations in our dataset. In the full environment, the average reward value in each state was found to be 92%±5% of the maximum possible reward, while on the test set it resulted in 87%±9% of the maximum possible reward.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Robotic Staffing Augmentation

The Robotic Augmentation & Novel Applications team at Los Alamos National Laboratory is working to produce autonomous systems to augment staffing for tasks that are tedious, dangerous, or require high precision. This is intended to reduce risks to staff, programs and facilities while also freeing up personnel resources to better support laboratory missions, particularly pit manufacturing. The primary focus of this effort is to utilize cutting edge automation to augment long duration radiation surveys, allowing RCTs to work on critical production activities.

42 ENGINEERING↗

A Data-Driven Study of Rayleigh-Taylor Transition to Turbulence [Slides]

A temporal dynamics perspective of forgetting ICs; Autonomous system of neural ODEs of 0D dynamics; Steep growth of backward integration error quantifies forgetting; Does such a system exist in reality? (a low dim. dyn. sys. shadowing a projection of a high dim. dyn. sys.); Next: minimal QOIs to identify system; Extension to PDEs of 1D dynamics of DNS.

97 MATHEMATICS AND COMPUTING↗

Event-Driven 3D Sensing Architecture

Some events happen too quickly to capture twice. Whether tracking satellites, monitoring aircraft, observing autonomous systems, or recording high speed industrial processes, imaging systems often have only one opportunity to collect the right information. If a camera is focused on the wrong distance, uses the wrong exposure, or cannot keep pace with rapid motion, important details may be lost forever. Los Alamos National Laboratory has developed an event-driven imaging architecture that preserves more information during data collection than a conventional camera. Instead of committing to a single image, the system captures data that can later be used to digitally adjust focus and exposure while reconstructing the scene in three dimensions. The result is a more flexible approach for imaging dynamic environments where conventional cameras can struggle.

42 ENGINEERING↗

Design and implementation of an underwater sound recording device

To monitor the underwater sound and pressure waves generated by activities such as underwater blasting and pile driving, an autonomous system used to record underwater acoustic signals was designed. The device designed allows two hydrophones or other dynamic pressure sensors to be connected, filters out high frequency noise, has a gain that can be independently set for each sensor, and allows two hours of data to be collected. Two versions of the USR were created; one is submersible to a maximum depth of 300 m, and the other, although watertight, is not intended to be fully submersed. Tests were performed in the laboratory using a data acquisition system to send single-frequency sinusoidal voltages directly to the each component. These tests verified that the device performs as well as larger commercially available data acquisition systems, which are not suited for field use. A prototype of the device was used in a case study to investigate the effect of underwater rock blasting on juvenile Chinook salmon and rainbow trout. The case study demonstrated that the device was able to tolerate being operated in harsh environments, making it a valuable tool for collecting field measurements.

47 OTHER INSTRUMENTATION↗

Continuous Time Group Discovery in Dynamic Graphs

With the rise in availability and importance of graphs and networks, it has become increasingly important to have good models to describe their behavior. While much work has focused on modeling static graphs, we focus on group discovery in dynamic graphs. We adapt a dynamic extension of Latent Dirichlet Allocation to this task and demonstrate good performance on two datasets. Modeling relational data has become increasingly important in recent years. Much work has focused on static graphs - that is fixed graphs at a single point in time. Here we focus on the problem of modeling dynamic (i.e. time-evolving) graphs. We propose a scalable Bayesian approach for community discovery in dynamic graphs. Our approach is based on extensions of Latent Dirichlet Allocation (LDA). LDA is a latent variable model for topic modeling in text corpora. It was extended to deal with topic changes in discrete time and later in continuous time. These models were referred to as the discrete Dynamic Topic Model (dDTM) and the continuous Dynamic Topic Model (cDTM), respectively. When adapting these models to graphs, we take our inspiration from LDA-G and SSN-LDA, applications of LDA to static graphs that have been shown to effectively factor out community structure to explain link patterns in graphs. In this paper, we demonstrate how to adapt and apply the cDTM to the task of finding communities in dynamic networks. We use link prediction to measure the quality of the discovered community structure and apply it to two different relational datasets - DBLP author-keyword and CAIDA autonomous systems relationships. We also discuss a parallel implementation of this approach using Hadoop. In Section 2, we review LDA and LDA-G. In Section 3, we review the cDTM and introduce cDTMG, its adaptation to modeling dynamic graphs. We discuss inference for the cDTM-G and details of our parallel implementation in Section 4 and present its performance on two datasets in Section 5 before concluding in Section 6.

97 MATHEMATICS AND COMPUTING↗

Measuring the effectiveness of infrastructure-level detection of large-scale botnets

Botnets are one of the most serious security threats to the Internet and its end users. In recent years, utilizing P2P as a Command and Control (C&C) protocol has gained popularity due to its decentralized nature that can help hide the hotmaster's identity. Most bot detection approaches targeting P2P botnets either rely on behavior monitoring or traffic flow and packet analysis, requiring fine-grained information collected locally. This requirement limits the scale of detection. In this paper, we consider detection of P2P botnets at a high-level - the infrastructure level - by exploiting their structural properties from a graph analysis perspective. Using three different P2P overlay structures, we measure the effectiveness of detecting each structure at various locations (the Autonomous System (AS), the Point of Presence (PoP), and the router rendezvous) in the Internet infrastructure.

42 ENGINEERING↗

Distributed Reinforcement Learning with ADMM-RL

NREL researcher Peter Graf discusses distributed reinforcement learning with ADMM-RL as part of the Innovative Optimization and Control Methods for Highly Distributed Autonomous Systems workshop. NREL hosted the workshop to exchange ideas on state-of-the-art control and optimization strategies as well as get feedback on work being done at NREL.

97 MATHEMATICS AND COMPUTING↗

Toward Robustness Guarantees for Feedback-Based Optimization

NREL researcher Andrey Bernstein discusses the move toward robustness guarantees for feedback-based optimization as part of the Innovative Optimization and Control Methods for Highly Distributed Autonomous Systems workshop. NREL hosted the workshop to exchange ideas on state-of-the-art control and optimization strategies as well as get feedback on work being done at NREL.

24 POWER TRANSMISSION AND DISTRIBUTION↗

A Framework for Autonomous Wind Farms: Distributed Optimization for Wind

A presentation from NREL Researcher Jennifer King on Distributed Optimization for Wind as part of the Innovative Optimization and Control Methods for Highly Distributed Autonomous Systems workshop at NREL. The workshop brought together experts in the field of distributed optimization and control to exchange ideas on state-of-the-art control and optimization strategies as well as get feedback on work being done at NREL.

17 WIND ENERGY↗

Autonomous Eco-Driving with Traffic Light and Lead Vehicle Constraints: An Application of Best Constrained Interpolation

Eco-Driving is a critical technology for improving automotive transportation efficiency. It is achieved by modifying the driving trajectory over a particular route to minimize required propulsion energy. Eco-Driving can be approached as an optimal control problem subject to driving constraints such as traffic lights and positions of other vehicles. Best interpolation in a strip is a problem in approximation theory and optimal control. The solution to this problem is a cubic spline. In this research, we demonstrate the connection between Eco-Driving and best interpolation in the strip. By exploiting this connection, we are able to generate optimal Eco-Driving trajectories that could be driven with an autonomous system. Using the simulation tool FASTSim, we can evaluate the trajectories using conventional, hybrid electric, and fully electric vehicle models. Our results quantify the energy efficiency improvements that can be achieved with the proposed approach.

Mahmoud, Yara Hazem↗

Autonomous Eco-Driving with Traffic Light and Lead Vehicle Constraints: An Application of Best Constrained Interpolation

Eco-Driving is a critical technology for improving automotive transportation efficiency. It is achieved by modifying the driving trajectory over a particular route to minimize required propulsion energy. Eco-Driving can be approached as an optimal control problem subject to driving constraints such as traffic lights and positions of other vehicles. Best interpolation in a strip is a problem in approximation theory and optimal control. The solution to this problem is a cubic spline. In this research, we demonstrate the connection between Eco-Driving and best interpolation in the strip. By exploiting this connection, we are able to generate optimal Eco-Driving trajectories that could be driven with an autonomous system. Using the simulation tool FASTSim, we can evaluate the trajectories using conventional, hybrid electric, and fully electric vehicle models. Our results quantify the energy efficiency improvements that can be achieved with the proposed approach.

Mahmoud, Yara Hazem↗

Gaussian process for calibration and control of GlueX Central Drift Chamber

We have developed and implemented a machine learning based system to calibrate and control the GlueX Central Drift Chamber at Jefferson Lab, VA, in near real-time. The system monitors environmental and experimental conditions during data taking and uses those as inputs to a Gaussian process (GP) with learned prior. The GP predicts calibration constants in order to recommend a high voltage (HV) setting for the detector that maintains consistent detector performance (gain and resolution) throughout data taking. This approach is in stark contrast to traditional detector operations in which the detector operates at fixed HV and its calibration parameters vary quite considerably with time. Additionally, the ML based system utilizes uncertainty quantification to correct the recommended control parameters when appropriate. We will present results from the ML system autonomously during the Charged Pion Polarizability (CPP) experiment conducted in Hall D at Jefferson Lab.

McSpadden, Helen↗

Self-Driving Telescopes: Autonomous Scheduling of Astronomical Observation Campaigns with Offline Reinforcement Learning

Modern astronomical experiments are designed to achieve multiple scientific goals, from studies of galaxy evolution to cosmic acceleration. These goals require data of many different classes of night-sky objects, each of which has a particular set of observational needs. These observational needs are typically in strong competition with one another. This poses a challenging multi-objective optimization problem that remains unsolved. The effectiveness of Reinforcement Learning (RL) as a valuable paradigm for training autonomous systems has been well-demonstrated, and it may provide the basis for self-driving telescopes capable of optimizing the scheduling for astronomy campaigns. Simulated datasets containing examples of interactions between a telescope and a discrete set of sky locations on the celestial sphere can be used to train an RL model to sequentially gather data from these several locations to maximize a cumulative reward as a measure of the quality of the data gathered. We use simulated data to test and compare multiple implementations of a Deep Q-Network (DQN) for the task of optimizing the schedule of observations from the Stone Edge Observatory (SEO). We combine multiple improvements on the DQN and adjustments to the dataset, showing that DQNs can achieve an average reward of 87%+-6% of the maximum achievable reward in each state on the test set. This is the first comparison of offline RL algorithms for a particular astronomical challenge and the first open-source framework for performing such a comparison and assessment task.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Autonomous Radiation Mapping and Quantification using an Unmanned Ground Vehicle. Part II - Autonomous Navigation

Nuclear sites across the Unites States and other nations in the world, are prone to extreme radiation effects. To understand the radiation hazards, plan the cleanup efforts; and to meet the quality standards and guidelines, it is important to accurately characterize any nuclear facility. One of the current methods in characterizing facilities is the use of advanced autonomous systems. These are safe, efficient, and cost-effective tools, which can safely deploy state-of-the-art instrumentation without exposing workers to radiation risks. Conventional methods of taking radiation measurements by hand within or around the containment areas, and analyzing the collected data to obtain the result are: Ineffective, Puts scientists at risk of Radiation, Not cost-effective. The platform uses the Robotic Operating Systems (ROS) to integrate multiple sensors seamlessly. It can operate near real time by using a distributed processing system to handle large amounts of data: Surrounding cameras, A multi-channel 3D Lidar, Manipulator arm, High-performance gamma-ray spectrometer.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

From Chaos to Clarity: Autonomous Materials Discovery for Extreme Environments

The pursuit of advanced functional materials for energy applications demands an understanding of their behavior under the most challenging conditions. Extreme environments, characterized by intense radiation, high temperatures, and corrosive chemistries, push materials to their limits, often revealing unexpected behaviors and degradation pathways. Traditional materials research approaches, relying on trial-and-error experimentation, are often slow and resource-intensive, ill-suited to the complexities of extreme environments. This talk will explore the transformative potential of autonomous materials science in revolutionizing our understanding of materials synthesis and degradation in extreme environments. By integrating advanced microscopy techniques, artificial intelligence, and robotic experimentation, we can accelerate the discovery and design of resilient materials for a sustainable future. The presentation will highlight recent breakthroughs in autonomous microscopy, computer vision, and machine learning, showcasing their ability to unravel complex material transformations at the atomic scale. The talk will also delve into the challenges and opportunities associated with deploying autonomous systems to probe extreme environments, emphasizing the importance of robust algorithms, real-time data analysis, and adaptive experimentation. Our ultimate goal is to empower scientists with unprecedented capabilities to explore, understand, and engineer materials that can withstand the harshest conditions, paving the way for innovations in energy, aerospace, and beyond.

artificial intelligence↗

Shock wave structure for a fully ionized plasma

We study the structure of planar shock waves in a two-temperature model of a fully ionized plasma that includes electron heat conduction and energy exchange between electrons and ions. For steady flow in a reference frame moving with the shock, the model reduces to an autonomous system of ordinary differential equations which can be numerically integrated. A phase space analysis of the ODEs provides additional insight into the structure of the solutions. For example, below a threshold mach number the model produces fully dispersed shocks; while above another threshold mach number, the solutions contain embedded hydrodynamic shocks. Between these two threshold values, the appearance of embedded shocks depends on the electron diffusivity and the electron-ion coupling term. We also find that the ion temperature may continue to increase after the shock and reaches a maximum near the isothermal sonic point. We summarize the methodology for solving for two-temperature shocks, and show results for several values of shock strength and material parameters to quantify the shock structure and explore the range of possible solutions. Such solutions may be used to verify hydrodynamic codes that use similar plasma physics models.

97 MATHEMATICS AND COMPUTING↗

Semi autonomous mine detection system

CMMAD is a risk reduction effort for the AMDS program. As part of CMMAD, multiple instances of semi autonomous robotic mine detection systems were created. Each instance consists of a robotic vehicle equipped with sensors required for navigation and marking, a countermine sensors and a number of integrated software packages which provide for real time processing of the countermine sensor data as well as integrated control of the robotic vehicle, the sensor actuator and the sensor. These systems were used to investigate critical interest functions (CIF) related to countermine robotic systems. To address the autonomy CIF, the INL developed RIK was extended to allow for interaction with a mine sensor processing code (MSPC). In limited field testing this system performed well in detecting, marking and avoiding both AT and AP mines. Based on the results of the CMMAD investigation we conclude that autonomous robotic mine detection is feasible. In addition, CMMAD contributed critical technical advances with regard to sensing, data processing and sensor manipulation, which will advance the performance of future fieldable systems. As a result, no substantial technical barriers exist which preclude – from an autonomous robotic perspective – the rapid development and deployment of fieldable systems.

42 ENGINEERING↗