Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “autonomous behavior”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Detection of hazardous driving using machine learning

An autonomous driving system could create or exacerbate a hazardous driving situation due to incorrect machine learning, algorithm design, sensor limitations, environmental conditions or other factors. This technology presents solutions that use machine learning to detect when the autonomous driving system is in this state e.g., erratic or reckless driving and other behavior, in order to take remedial action to prevent a hazard such as a collision.

Shirvani, Philip↗
DOE OSTI2021

Enhancing the Operational Resilience of Advanced Reactors with Digital Twins by Recurrent Neural Networks

Because of a lack of operation data during abnormal and accident scenarios, along with the existence of uncertainty in the evaluation model for transient and accident analysis, the established abnormal and emergency operating procedures can be biased in characterizing the reactor states and ensuring operational resilience. To improve state awareness and ensure operational flexibility for minimizing effects on the system due to anomaly, digital twin (DT) technology is suggested to support operator's decision-making by effectively extracting and using knowledge of the current and future plant states from the knowledge base. To demonstrate DT's capability for recovering the complete states of reactors and for predicting the future reactor behaviors, this paper develops and assesses both the diagnosis and prognosis DTs in a nearly autonomous management and control system for an Experimental Breeder Reactor-II simulator during different loss-of-flow scenarios.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2021

Resilience-based Recovery Scheduling of Transportation Network in Mixed Traffic Environment: A Deep-Ensemble-Assisted Active Learning Approach

Devising effective post-hazard recovery strategies is critical in enhancing the resilience of transportation networks (TNs). However, existing work does not consider the multiclass users’ travel behavior in network functionality quantification and the metaheuristic solution procedures often suffer from extensive computational burden due to the exploration need in large solution space and the expensive functionality quantification. Here, this study develops a bilevel decision-making framework for the resilience-based recovery scheduling of the TN in a mixed traffic environment with connected and autonomous vehicles (CAVs) and human-driven vehicles (HDVs). The lower level quantifies the TN's functionality over time considering different travel behavior of CAV and HDV users arisen from their different levels of information perception. The upper level presents a novel deep-ensemble-assisted active learning approach to balance optimization performance and computational cost. This framework can help decision makers better quantify the TN's functionality to support effective recovery scheduling of TN with different mixed traffic scenarios ranging from HDV-only to future CAV-dominant traffic. The optimization approach bears the potential to be extended to solving general large-scale network recovery scheduling problems effectively and efficiently. The proposed methodology is demonstrated using a real-world traffic network in Southern California under earthquake considering deterministic and stochastic repair durations.

42 ENGINEERING↗
DOE OSTI2023

Smart Droplets Stabilized by Designer Surfactants: From Biomimicry to Active Motion to Materials Healing

The science and technologies of emulsion droplets have been a long‐term focus of extensive research endeavors for their practical utility across a breadth of industries, including pharmaceutical products, oil recovery processes, and the food sciences. However, with advances in materials chemistry and characterization tools, new emerging areas are arising with a focus on “smart droplets”. The versatility of emulsion droplets across is based on their ability to partition and create isolated systems with properties defined by the liquid–liquid interface, while preparative routes allow manipulation of droplet size, stability, and encapsulated contents. As described in this article, significant efforts are being devoted to creating new types of droplets by “activating” this interface through the incorporation of reactive structures that trigger droplet response to applied or environmental stimuli (e.g., pH, temperature, salt, or external fields). Moreover, parallels between droplets and live cells inspire efforts to conceive systems that resemble biological motifs or that can produce cellular behaviors that imitate biology (e.g., swarming, communication, or motion). Here, the authors highlight recent advances in smart droplets, with emphasis on organic, polymer, and/or particle surfactants that give rise to inter‐droplet communication (via aggregation, fusion, division, or mass transfer), droplet vehicles for controlled delivery, autonomous droplet motion, and tunable emulsion inversion. Especially emphasized is the macromolecular design to produce reactive and functional surfactants, which are crucial to responsive droplet behavior and their underlying mechanisms. More generally, the exquisite interplay between materials science and biology inspires the review of this research area that provides unique opportunities for insight and inspiration into the capabilities of new droplet designs.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Applications of Autonomous Data Collection and Active Learning

Advances in sensors and robotics have dramatically improved the diversity of experimental approaches available to the materials community. Autonomous data collection platforms, either custom-made or commercially available, provide researchers with novel tools with which to probe materials behavior and perform advanced materials characterization. The application of novel control algorithms and active learning approaches can create much more robust experimental data, or can be used to improve the performance of existing characterization tools. Five papers within this special topic focus on experimental and computational methodologies for use in automatic data collection routines for materials characterization. From novel platforms for materials discovery to new statistical frameworks for assessing the autonomous experimentation process, these five papers highlight the diverse range of applications of automation for advancing materials science.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Autonomous Tuning and Charge-State Detection of Gate-Defined Quantum Dots

Defining quantum dots in semiconductor-based heterostructures is an essential step in initializing solid-state qubits. With growing device complexity and increasing number of functional devices required for measurements, a manual approach to finding suitable gate voltages to confine electrons electrostatically is impractical. Here, we implement a two-stage device characterization and dot-tuning process, which first determines whether devices are functional and then attempts to tune the functional devices to the single or double quantum-dot regime. We show that automating well-established manual-tuning procedures and replacing the experimenter’s decisions by supervised machine learning is sufficient to tune double quantum dots in multiple devices without premeasured input or manual intervention. The quality of measurement results and charge states are assessed by four binary classifiers trained with experimental data, reflecting real device behavior. We compare and optimize eight models and different data preprocessing techniques for each of the classifiers to achieve reliable autonomous tuning, an essential step towards scalable quantum systems in quantum-dot-based qubit architectures.

Darulova, J↗
DOE OSTI2026

Toward Intelligent Multimodal Holography for Real-Time Chemical Imaging of Dynamic Ion Separation

Molecular-level visualization of ion transport and separation dynamics in complex environments is crucial for advancing energy systems, water purification, and critical materials recovery. Achieving this requires imaging platforms that combine structural sensitivity, chemical specificity, and real-time operation. Digital off-axis holography (DOAH) provides high-throughput, label-free quantitative phase imaging but inherently lacks chemical selectivity. Integrating DOAH with complementary spectroscopic channels such as fluorescence or hyperspectral imaging introduces the needed molecular specificity, while also creating challenges in multimodal data fusion, synchronization, and computational throughput. Artificial intelligence offers a powerful route to address these limitations by uniting physics-based reconstruction with data-driven interpretation. In this Perspective, we outline a framework for intelligent multimodal holography and demonstrate its potential using a preliminary AI-driven test case. Raw DOAH holograms of lanthanide solutions subjected to magnetic field gradients were analyzed using multi-agent AI workflows that autonomously selected reconstruction tools, extracted NMF components, and generated scientific claims consistent with true paramagnetic and diamagnetic behavior. This demonstration shows how AI-enabled reasoning can deliver real-time chemical–structural interpretation directly from raw holograms. Together, these advances define a path toward adaptive, intelligent holography platforms capable of supporting in situ chemical separations, dynamic ion transport analysis, and next-generation interfacial science.

Ricchiuti, Giovanna↗
DOE OSTI2020

Dedicated short range communications used as fail-safe in autonomous navigation

Here in this paper, we have analyzed scenarios for leader-follower vehicle convoys that have the potential to be unsafe, hazardous, or even fatal in order to provide insight on dangerous driving conditions for autonomous vehicle platoons. These scenarios were created in a simulation software called Prescan, and are made to reflect the behavior of the vehicle dynamics and sensor characteristics of a real-world vehicle convoy that is currently being tested at the American Center for Mobility (ACM) and sponsored by the Department of Energy (DOE), National Renewable Energy Laboratory (NREL), the U.S. Army Combat Capabilities Development Command - Ground Vehicle Systems Center (U.S. Army CC-DEVCOM) and the Michigan Department of Transportation (MDOT). The follower vehicle in this study is tested under multiple scenarios, equipped with a Dedicated Short Range vehicle-to-vehicle communication system (DSRC), a radar-based adaptive cruise control system (ACC) and a precision global positioning system (GPS).

42 ENGINEERING↗
DOE OSTI2024

Towards a High Fidelity Training Environment for Autonomous Cyber Defense Agents

Cyber defenders are overwhelmed by the frequency and scale of attacks against their networks. This problem will only be exacerbated as attackers leverage AI to automate their workflows. Autonomous cyber defense capabilities could aid defenders by automating operations and adapting dynamically to novel threats. However, existing training environments fall short in areas such as generalization, explainability, scalability, and transferability, making it intractable to train agents that will be effective in real networks. In this paper we take an important step towards creating autonomous cyber defense agents — we present a high fidelity training environment called Cyberwheel that includes both simulation and emulation capabilities. Cyberwheel simplifies customization of the training network and easily allows redefining the agent’s reward function, observation space, and action space to support rapid experimentation of novel approaches to agent design. It also provides visibility into agent behaviors necessary for agent evaluation and sufficient documentation / examples to lower the barrier to entry. As an example use case of Cyberwheel, we present initial results training an autonomous agent to deploy cyber deception strategies in simulation.

Oesch, T↗
DOE OSTI2021

Quantitative Evaluation of Autonomous Driving in CARLA

There has been a great deal of recent advancements in end-to-end imitation and reinforcement learning for self-driving vehicles. Despite this, there is a severe lack of standardized metrics for evaluating the performance of autonomous self-driving agents. Existing metrics are generally lacking in their ability to capture a wide range of driving behaviors and compare the severity of different failure cases. In this work, we introduce the Quantitative Evaluation for Driving metric, or QED, which assigns a quantitative score from 0-100 that captures the quality of driving for any driving agent. Our QED metric assesses different aspects of driving behavior including the ability to stay in the center of the lane, avoid weaving and erratic behavior, follow the speed limit, and avoid collisions, and it can be used under a wide range of driving scenarios. To show the effectiveness of our QED metric, we compare the scores generated by QED against scores assigned by human evaluators on a total of 30 different drivers and 6 different towns in the CARLA driving simulator. In ``easy'' evaluation scenarios, where it is relatively straightforward to distinguish better drivers from worse drivers, QED attains an average Pearson correlation of 0.96 and average Spearman correlation of 0.97 when compared against human evaluators. In ``hard'' evaluation scenarios, where it is far more ambiguous how to rank/score different types of bad driving behavior, QED attains an average Pearson correlation of 0.82 and average Spearman correlation of 0.75 when compared against human evaluators, which are both slighter higher than when we compare human evaluators against each other. While QED may not capture every characteristic that defines good driving, we consider it an important foundation for reproducibility and standardization in the community.

Gao, Shang↗
DOE OSTI2024

Interdependent Water And Power Infrastructure Model

The approach used is the Multi-Agent System (MAS) paradigms, where systems components are represented as agents, interacting both with each other, and with the environment in which they evolved. Agents behaviors correspond to components in the real Integrated Water-Power System. The model simulate actions and interactions of these (autonomous) agents to analyze their effects on the overall system. Agents in the water system capture components of water collection, treatment, transportation, distribution and use (e.g. pipe, canal, pump, water demands for agriculture, etc.). Agents in the power system capture components of power generation, transportation, distribution and use (electricity demands, sources, etc.).

Toba, Danho Ange Lionel [Idaho National Laboratory↗
DOE OSTI2022

Autonomous System Subversion Tactics: Prototypes and Recommended Countermeasures

One of the fielding requirements for Advanced and Small Modular Reactors (AR/SMR) is the ability to support remote and autonomous operations. Autonomous Control Systems (ACS) are found on platforms such as Autonomous Space Vehicles, Cruise Missiles, and advanced driver-assistance systems. Each of these ACS implementations depends upon a set of decision support subsystems responsible for supporting Autonomous Mission Managers (names vary based upon field and author preferences). These Autonomous Mission Managers receive inputs from system sensors (e.g., LIDAR collection from an automobile travelling down a street; transients from a nuclear reactor), and perform a set of classifications (e.g., Red Traffic Light; Small Pedestrian at 10m; Load Rejection; Single Coolant Pump Trip), and then use these classifications in combination with recommendation algorithms to achieve platform goals (e.g., Stop the Vehicle at the Traffic Light, Avoid the Small Pedestrian; Trip the Reactor to prevent a Safety Event). The design, implementation, and fielding of an ACS capability will alter the cyber-attack surface such that existing risk management plans will need to be updated to include how to protect and defend against data-science and decision-support-system attack classes. These attack classes would include protection of the design and training environments where algorithm selection and testing and training data would be obvious attack vectors. These attack classes would also require an informed set of detection and response procedures to identify anomalous behaviors and document best practices for anomaly assessment and vulnerability mitigation and remediation. Last year we published a Cyber Threat Assessment Methodology for Autonomous and Remote Operations for AR/SMRs along with a companion publication on Cyber Attack and Defense Use Cases. The focus of the methodology was on describing and enumerating ACS processes, components, and functions such that security engineers could: evaluate subversion options against the target; identify threat actor attributes and capabilities derived from each subversion option; and identify security controls and response countermeasures. The Use Cases document offered detailed methodology examples including an assessment of a Military Base SMR, an Autonomous System Decision Loop, and implementation of AR/SMR Machine Learning algorithms. Our proposal at the end of last year was to focus on implementation of subversion prototypes related to the last Use Case area: AR/SMR Machine Learning (ML) Algorithms. We included six attack scenarios in our Use Cases paper: a Poisoning Attack against ML functions implemented using an FPGA; a Trojaning Attack against ML classifiers exploiting the excitability of Nuclear Engineers; a Backdooring Attack against ML Training environments to ensure persistence of an attack vector; a False Positive Evasion Attack against multi-factor Access Control Systems using clever inputs; an Inference Attack against ML models by an Insider with access to the Operational environment; and an Adversarial Reprogramming Attack against a Material Access Control Video Surveillance System. At the beginning of this year these six attack scenarios were provided to our research teams at Georgia Tech and Idaho State University and each team successfully implemented a subversion attack against a ML implementation to include transient misclassifications. While this is a notable outcome from this type of research, this paper offers the reader insight into not only how to structure and execute these types of attacks, but into the thought process behind how the researcher investigated the problem space, performed initial algorithm implementation, and the trial-and-error behind arriving at the successful subversion prototypes. We include in this paper a set of associated Scenarios on how these subversion prototypes could be implemented and an initial set of guidance for AR/SMR architects, Nuclear Regulators, and Cyber Defenders to implement awareness and defense capabilities into their current operational portfolios.

42 ENGINEERING↗
DOE OSTI2021

mystic : software for autonomous discovery and design under uncertainty

Throughout the diverse range of science and engineering applications, there is a growing desire to develop computational methods that can reliably predict the behavior of complex systems. Specifically, there is a strategic need for tools that can robustly forecast the behavior of complex physical systems, where data may be high-dimensional, noisy, or sparse, and models of the system may be time-dependent or include uncertainty. We use mystic to build tools that leverage statistical learning, physics-informed learning, and active learning in the efficient generation of reliably predictive surrogates for complex physical systems. mystic is a robust, proven, open-source optimization and uncertainty quantification toolkit with over a decade of use in the design and optimization of neutron instrumentation, solar-powered drones, and gasguns, and in iterative tuning of models for Raman spectroscopy and elastoplastic materials strength. Recent developments have focused on automated learning of statistically robust surrogates under uncertainty, with applications in materials in extreme environments, nanostructures, materials simulations and strength models, and the failure of shielding under particle radiation. In 2020, McKerns demonstrated active learning of optimally robust surrogates with respect to new simulated data for molecular dynamics simulations of materials mixing in warm dense matter, and is currently applying active learning to the automated steering of particle accelerator beams and the optimal design and control of quantum optical sensor instrumentation.

42 ENGINEERING↗
DOE OSTI2023

Approaches for Synthesis and Deployment of Controller Models on Automated Vehicles for Car-following in Mixed Autonomy

This paper describes the software design patterns and vehicle interfaces that were employed to transition vehicle controllers from simulation environments to open-road field experiments. The approach relies on a life cycle that utilizes model-based design and code generation, along with agile software development, and both software and hardware-in-the-loop testing, with additional safety margins. Autonomous designs should consider the dynamics of mixed autonomy in traffic to safely operate among humans. The software that provides a vehicle’s behavior intelligence is often developed through simulation, which may have a mismatch between dynamics, or as a result of a reinforcement learning workflow, which may be a black box with challenges to analyze. In each of these cases, it is important to have research interfaces that provide strongly typed data streams accessible to researchers who are not software experts while continuing to satisfy safety and liveness constraints. This paper describes how we design the hardware platform interfaces and software design process for a mixed autonomy traffic experiment with a leader-follower scenario. Controller synthesis for these vehicles requires clearly articulated vehicle interfaces and software design patterns for successful onboard deployment. Testing strategies for such controllers are also described before algorithms are transitioned to full-scale field experiments with safety operators for the vehicles. Testing strategies include software-in-the-loop simulation testing, hardware-in-the-loop simulation, ghost-car testing, and read-only testing in live traffic. With our approach, we were not only able to validate our controller synthesized in scripts and simulation, but also able to scale deployment to multiple vehicles.

Bhadani, Rahul↗
DOE OSTI2025

From Data to Discovery: AI's Transformative Role in Thin Film Research

The advancement of thin film technologies is pivotal for progress in numerous fields, including energy, electronics, and quantum computing. However, the traditional trial-and-error approach to materials discovery is inherently slow and inefficient. This presentation will showcase how artificial intelligence (AI) is transforming thin film research by enabling a data-driven paradigm shift. We will highlight our past successes in applying AI to understand radiation damage in thin film oxides, demonstrating how graph analytics can unravel complex material behavior. Additionally, we will provide insights into our current work at the National Renewable Energy Laboratory, where we are leading the charge in autonomous materials science. Backed by a $14M investment in our characterization facility, we are developing AI-guided workflows that seamlessly integrate experimentation and AI-guided decision-making. By harnessing the power of AI, we aim to accelerate the discovery and design of high-performance thin films, propelling innovation across a multitude of industries.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Autonomous Acoustic Receiver System for 3D Tracking and Monitoring Real-Time Fish Survival (CRADA 448)

Develop technologies that reduce the delay between changing hydropower operations and the acquisition of knowledge regarding fish behavior and survival and to reduce the cost and effort to obtain behavioral information of fish that is both accurate and detailed. The technologies being proposed would allow hydropower operators to quickly understand the impact of operational changes on fish and allow fisheries researchers to study fish behavior in high resolution at locations that previously would have been unfeasible.

13 HYDRO ENERGY↗
DOE OSTI2021

Autonomous reinforcement learning agents for improving predictions and observations of extreme climate events

Primary Focus Area: This proposal addresses focus area 2, “Predictive modeling through the use of AI techniques.” Science Challenge: Extreme climate events associated with severe weather, coastal and inland flooding, droughts, heat waves and wildfires are expected to increase in frequency and severity in the future. Due to the complexity and chaotic behavior of the climate system, accurately predicting and observing extreme climate events requires a tremendous amount of human intervention to run predictive climate simulations and deploy measurement systems. Extreme events often unfold very quickly, leaving little time to iterate on simulations or re-position instruments. Through reinforcement learning, autonomous AI agents can be designed to make real-time decisions to characterize extreme climate events more efficiently through adaptive models and targeted observations.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Multi-Physics Investigation of a Natural Circulation Molten Salt Micro-Reactor that Utilizes an Experimental In-Pile Device to Improve Core Physics and System Thermal-Hydraulic Performance.

INL employee PhD Dissertation - The Molten Salt Reactor (MSR) concept is a rapidly evolving Generation IV design that has recently attracted favorable attention due to the potential for reducing waste generation, realizing passive safety features, and seizing on the opportunity for cost effective economics. This thesis investigates the performance benefit of a new device invented by the doctoral candidate. The device is referred to as a Wrapped Helix around an Inclined Plane or WHIP. The WHIP is protected under a provisional patent filed with the USA Patent Office on 28 September 2021 under application number 63/261,776, BEA docket number BA-1254. The WHIP device can be located in-core or near-core to promoted enhanced thermal-hydraulics and neutronics performance. While the WHIP can be employed in a variety of solid or liquid fuel designs, this thesis investigates the device’s benefit in the application of a natural-circulation, micro-molten salt nuclear battery concept (MsNB). This thesis will specifically investigate the temperature coefficient of the MsNB fuel (FLiNaK) using novel temperature sensitivity techniques unique to Serpent particle transport code, evaluate the WHIP’s thermal-hydraulic and neutronic performance effects using both established (STAR-CCM+) and novel (Python code developed to estimate the circulation effective delayed neutron fraction, ßef f ) analytical and numerical methods, evaluate the neutron noise behavior of the MsNB and how the WHIP may alter the character of the MsNB’s transfer function, and how the WHIP affects the autonomous, load-following performance under transient power conditions using Python code developed by the candidate. The sum body of this work, in part, has been published in three journal articles as the timing of the provisional patent process has allowed. Results show that creative utilization of WHIP engineering design and function reduces reactor system volume, fuel loading, control/stability in the buoyant regime

buoyant flow↗