SEARCH · Engineering Papers
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
SDRD Annual Report for FY21 detailing Trainham's project that investigated using unmanned aerial systems (drones) to get into difficult places such as deserts and tunnels to measure VOCs, etc. A complementary summary will be derived from this report.
We study multiagent reinforcement learning (MARL) with constraints. This setting is gaining importance as MARL algorithms find new applications in real-world systems ranging from power grids to drone swarms. Most constrained MARL (C-MARL) algorithms use a primal-dual approach to enforce constraints through a penalty function added to the reward. In this paper, we study the structural effects of the primal-dual approach on the constraints and value function. First, we show that using the constraint evaluation as the penalty leads to a weak notion of safety, but by making simple modifications to the penalty function, we can enforce meaningful probabilistic safety constraints. Second, we show that the penalty term changes the value function in a way that is easy to model, and demonstrate the consequences of not doing so. We conclude with simulations in a simple constrained multiagent environment to back up the theoretical results.
Constrained multiagent reinforcement learning (C-MARL) is gaining importance as MARL algorithms find new applications in real-world systems ranging from energy systems to drone swarms. Most C-MARL algorithms use a primal-dual approach to enforce constraints through a penalty function added to the reward. In this paper, we study the structural effects of this penalty term on the MARL problem. First, we show that the standard practice of using the constraint function as the penalty leads to a weak notion of safety. However, by making simple modifications to the penalty term, we can enforce meaningful probabilistic (chance and conditional value at risk) constraints. Second, we quantify the effect of the penalty term on the value function, uncovering an improved value estimation procedure. We use these insights to propose a constrained multiagent advantage actor critic (C-MAA2C) algorithm. Simulations in a simple constrained multiagent environment affirm that our reinterpretation of the primal-dual method in terms of probabilistic constraints is effective, and that our proposed value estimate accelerates convergence to a safe joint policy.
Good management of dismantling and decontamination (D and D) operations and activities is requiring safety, time saving and perfect radiological knowledge of the contaminated environment as well as optimization for personnel dose and minimization of waste volume. In the same time, Fukushima accident has imposed a stretch to the nuclear measurement operational approach requiring in such emergency situation: fast deployment and intervention, quick analysis and fast scenario definition. AREVA, as return of experience from his activities carried out at Fukushima and D and D sites has developed a novel multi-sensor solution as part of his D and D research, approach and method, a system with real-time 3D photo-realistic spatial radiation distribution cartography of contaminated premises. The system may be hand-held or mounted on a mobile device (robot, drone, e.g). In this paper, we will present our current development based on a SLAM technology (Simultaneous Localization And Mapping) and integrated sensors and detectors allowing simultaneous topographic and radiological (dose rate and/or spectroscopy) data acquisitions. This enabling technology permits 3D gamma activity cartography in real-time. (authors)
Nowadays, nuclear industry is facing a crucial need in establishing radiological characterization for the assessment and the monitoring of any remediation work. Regarding its experience in this domain, the French Commission for Atomic Energy and Alternative Energies (CEA) of Fontenay-aux-Roses, established an important feedback and developed a sound methodology for radiological characterization. A clean-up project is managed from the initial surface characterization to the final one, once volumes of contaminated soil have been removed. Samples are collected via recognized methods and data is gathered by real-time acquisition with different conveyance such as all-in-vehicles, cart, walking, helicopter or drone. Accurate radiological analyses are performed on site thanks to the mobile laboratories cluster, called SMaRT. It enables to realize long-time gamma spectroscopy, chemical preparation for alpha spectroscopy or beta liquid scintillation counting. Data is processed with geo-statistics via the software Kartotrak, 2D or 3D mapping are created with the associated uncertainty and probability map. Drilling profiles with geological data (layers composition, particles size, etc.) are studied in order to understand the behavior of the contamination in depth. Source term, contaminated volumes and sanitary impact are calculated in order to determine the optimum excavation depth. Finally, data is stored in an online site that insures the traceability of the whole process. This just-in-time production model allows a fast response and control of costs and avoids the disadvantages of radioactive material transport. This whole innovative process, developed inside the mobile platform, requires all these tools that have been used in France and continuously evolving for more than 10 years thanks to a learning organization. (authors)
Radioactive waste-management applications require good measurements to qualitatively and quantitatively characterize waste materials. Often these measurements must be done in situ, and the user wishes to learn something of the isotopic and spatial distribution of the source. Therefore, there is a need for a portable instrument that can map radioactive contamination and quantify sources. This presentation introduces several instruments that have been applied to this task, along with example measurements in relevant applications. All instruments are based on 3D-position-sensitive CdZnTe (CZT) detectors. This technology routinely achieves better than 1.1% FWHM energy resolution at 662 keV and operates at room temperature with a startup time under 2 minutes. All are packaged in portable enclosures with WiFi and Bluetooth capabilities for wireless communication. These capabilities allow the technology to be used in more advanced measurements in the field. A unique capability of these detectors is the ability to image the spatial distribution of gamma rays from a single stationary measurement. The first product, Polaris-H, has been in use at commercial nuclear power plants since 2013. The system, currently used at over 50% of the US nuclear-power fleet, integrates a 3D-position-sensitive CZT detector, associated readout electronics, an embedded computer, a battery with over 7-hour life, an optical camera, and a laser range finder in a portable water-proof enclosure. The system connects wirelessly to a tablet which displays a gamma-ray spectrum and isotope-specific images of the gamma-ray distribution in all directions in real time. The CZT detectors have a dynamic range from 50 keV up to 3 MeV. Coded aperture or pinhole imaging is used for energies below 250 keV, and Compton imaging is used for energies above 250 keV. List-mode data is saved to an external USB memory stick to enable more advanced analysis, including isotopic activity analysis, via H3D's post-processing software. Additional systems based on the same architecture have been developed to optimize the technology for other applications. These include Polaris-H Quad, which provides over 3 times the sensitivity for applications involving weaker sources, and Polaris-H Shield, which uses a collimator to provide images and isotope information over a narrower field of view in order to measure weaker sources in the presence of stronger sources of the same isotope. H3D has also developed custom systems that have been mounted on robots and drones that enable remote operation of the technology. Results from the measurements collected at commercial nuclear power plants and other applicable sites will be presented to show how these instruments can be used to detect, identify, and localize gamma-ray sources. Advanced analysis techniques to show the accurate quantification of the gamma-ray source will also be presented. Applications range from characterizing simple objects, to locating hottest points, estimating contamination distributions on an isotope-by-isotope basis, and differentiating scatter and direct emissions. (authors)
The rapid development of Li-ion batteries (LIBs) is due to their high energy-density storage capability, which makes them suitable for application in both vehicles (e.g., electrified car) and electronic devices (e.g., cell phone, laptop, etc.), which are currently ubiquitous. Another less common but important application of LIBs is the powering of equipment in extreme environments such as robots operating in a nuclear rescue mission, unmanned vehicles surveying environments exposed to radiation, or vehicles and probes for outer space exploration. In our previous study, coin cells with lithium metal serving as the reference and counter electrode were assembled with either an irradiated cathode or irradiated electrolyte. We have observed an increase in premature battery failure and degradation of capacity of the battery made from irradiated cathodes and battery made from the irradiated electrolyte. For the group with cathodes irradiated to a 9.8 Mrad cumulative dose, the resistance was 2-3 times higher than the control group. On the other hand, cells with irradiated electrolyte showed increased resistance even at very low dose levels. Most importantly, a significant color change to the irradiated electrolyte after a long-term storage in a glove box has been observed. However, the electrolyte did not show any noticeable change immediately after irradiation. We name this phenomenon latent effects, which is more significant than the damage received by batteries due to initial dose. Also, electrolyte irradiated to a medium dose (1.6 Mrad) showed a poorer performance (higher failure rate, higher resistance) than those cells which received high dose (5 Mrad). We attribute this to the latent effect because this group battery was unintentionally assembled 3 days after initial electrolyte irradiation. The existence of latent effects implies that in space missions or post-accident events, instruments equipped with LIBs may fail unpredictably at post-irradiation stages, even if they survive the initial dose or the performance tests conducted after the initial dose. These instruments may fail several days or even weeks after irradiation, depending on the initial cumulative dose and dosage rate. For comprehending the influence of latent effects on the entire battery instead of on the individual components, we performed an in-situ cycling of coin cells made in-house, where the batteries were cycled under irradiation and then cycled again to evaluate their overall capacity fade, cyclability, and cell resistance. Additionally we investigated the effects of battery fading due to radiation on the performance of a drone.
The feasibility and optimization of small unmanned mobile marine hydrokinetic (MHK) energy platforms for harvesting marine current energy in coastal and tidal waters are examined. A case study of a platform based on the use of a free-surface waterwheel (FSWW) mounted on an autonomous unmanned surface vehicle (USV) was conducted. Such platforms can serve as recharging stations for aerial drones (UAVs), enabling extension of the UAVs’ autonomous operating time. An unmanned MHK platform potentially meets this need with sustainable power harvested from water currents. For the case study, six different waterwheel configurations were field-tested in the Intracoastal Waterway of South Florida in support of determining the configuration that produced the most power. Required technologies for unmanned operations of the MHK platform were developed and tested. The data from the field-testing were analyzed to develop an empirical relation between the wheel’s theoretical hydrokinetic power produced and the mechanical power harnessed by the MHK platform with various waterwheel configurations during field-testing. The field data was also used to determine the electrical power generated by the FSWW configurations during field-testing. The study has led to the development of standardized testing procedures. The empirical relation is used to examine predicted power production through scaling up different physical aspects of the waterwheel.
Uncrewed aerial systems (UAS) have been an area of focus for the Office of International Nuclear Security within the US Department of Energy’s National Nuclear Security Administration and other foreign and domestic organizations for several years. This emerging technology provides significant capabilities to the nuclear security realm, but there are many things to consider when implementing them into an established security design or network. The goal of this paper is to discuss some of the benefits, challenges, and lessons learned with using UAS at nuclear facilities and during transport of material. Generic examples of UAS implementation will be used to facilitate a publicly releasable paper and presentation. The paper will start with a summary of the types and capabilities of UAS to provide a better understanding for people unfamiliar with current and new capabilities of these systems. Since there are many different types and sizes of UAS, this paper will focus on drones 55 lb and smaller. Then some of the use cases of UAS for security and challenges of employing them will be covered. Finally, lessons learned and some best practices that Oak Ridge National Laboratory has discovered from research, development, testing, and evaluation will be summarized.
With the transformational New Radio- Unlicensed (NR-U), 5G network can be operated with unlicensed and shared spectrum. Private 5G networks without any licensed bands, which are both highly expensive and usually available to only large commercial wireless providers, can now be used for a whole range of new applications including smart factories, warehouses, connected cars and drones. 5G’s support of a) massive machine type communication (mMTC) for a large number of connected devices with b) ultra-reliable low latency communication (URLLC) capability when needed, and c) up to 20 times higher data rate with enhanced mobile broadband (eMBB) than previously available, enables new and powerful capabilities in a wireless network. While these capabilities are transformational, necessary security and reliability requirements have to be satisfied when used in critical infrastructure such as factories, power plants, water systems, ports, and other industrial facilities. 5G standards have introduced significant security improvement over 4G/LTE as well as mitigations for new attack surfaces created by changes in the 5G network. This talk will discuss these security improvements and whether they meet the security properties required for mission critical communication over wireless.
The increasing accessibility and technological advancements of unmanned aerial vehicles (UAVs) pose legitimate concerns to nuclear non-proliferation efforts. To deter and combat unwanted or nefarious UAV activity near or around nuclear sensitive sites, the ability to quickly and easily detect drones becomes vital. Our team is exploring the use of ubiquitous smartphones as multi-modal sensors (microphone, accelerometer, gyroscope, etc.) to meet this challenge. In conjunction with Idaho National Lab, two UAV flight tests and one stationary in-air test were conducted and recorded with eight Samsung Galaxy S8 smartphones. This work presents initial characterization and annotation of acoustic signals associated with UAV activity.
This poster is for the LDRD Poster Session held at INL. The intent is to highlight the intent of the project which was to develop a resilient communication capability for the WSComm waveform. The poster shows notional pictures of communications being inhibited by a low power transmitter such as one found in modern drones. It then highlights interference tolerance performance and notionally shows that replay attacks may impede the signal. By implementing Transmission Security (TRANSEC), one can protect the waveform from such attacks.
To integrate unmanned aerial vehicles (UAVs) in future large-scale deployments, a new wireless communication paradigm, namely, the cellular-connected UAV has recently attracted interest. However, the line-of-sight dominant air-to-ground channels along with the antenna pattern of the cellular ground base stations (GBSs) introduce critical interference issues in cellular-connected UAV communications. In particular, the complex antenna pattern and the ground reflection (GR) from the down-tilted antennas create both coverage holes and patchy coverage for the UAVs in the sky, which leads to unreliable connectivity from the underlying cellular network. To overcome these challenges, in this paper, we propose a new cellular architecture that employs an extra set of co-channel antennas oriented towards the sky to support UAVs on top of the existing down-tilted antennas for ground user equipment (GUE). To model the GR stemming from the down-tilted antennas, we propose a path-loss model, which takes both antenna radiation pattern and configuration into account. Next, we formulate an optimization problem to maximize the minimum signal-to-interference ratio (SIR) of the UAVs by tuning the up-tilt (UT) angles of the up-tilted antennas. Since this is an NP-hard problem, we propose a genetic algorithm (GA) based heuristic method to optimize the UT angles of these antennas. After obtaining the optimal UT angles, we integrate the 3GPP Release-10 specified enhanced inter-cell interference coordination (eICIC) to reduce the interference stemming from the down-tilted antennas. Our simulation results based on the hexagonal cell layout show that the proposed interference mitigation method can ensure higher minimum SIRs for the UAVs over baseline methods while creating minimal impact on the SIR of GUEs.
We report high quality energy systems information is a crucial input to energy systems research, modeling, and decision-making. Unfortunately, actionable information about energy systems is often of limited availability, incomplete, or only accessible for a substantial fee or through a non-disclosure agreement. Recently, remotely sensed data (e.g., satellite imagery, aerial photography) have emerged as a potentially rich source of energy systems information. However, the use of these data is frequently challenged by its sheer volume and complexity, precluding manual analysis. Recent breakthroughs in machine learning have enabled automated and rapid extraction of useful information from remotely sensed data, facilitating large-scale acquisition of critical energy system variables. Here we present a systematic review of the literature on this emerging topic, providing an in-depth survey and review of papers published within the past two decades. We first taxonomize the existing literature into ten major areas, spanning the energy value chain. Within each research area, we distill and critically discuss major features that are relevant to energy researchers, including, for example, key challenges regarding the accessibility and reliability of the methods. We then synthesize our findings to identify limitations and trends in the literature as a whole, and discuss opportunities for innovation. These include the opportunity to extend the methods beyond electricity to broader energy systems and wider geographic areas; and the ability to expand the use of these methods in research and decision making as satellite data become cheaper and easier to access. We also find that there are persistent challenges: limited standardization and rigor of performance assessments; limited sharing of code, which would improve replicability; and a limited consideration of the ethics and privacy of data.
Longitudinal profiling of water quality via the deployment of sensors from watercraft has advanced the understanding of spatial patterns in large rivers and lakes; however, a similar approach in low- to mid-order streams is lacking. To fill this gap, we developed an unmanned surface vehicle (USV)-water quality measurement platform (the “AquaBOT”). The components of the AquaBOT included a nitrate sensor, multiparameter sonde (temperature, conductivity, turbidity, dissolved oxygen, chlorophyll), quantum sensor, and global positioning system (GPS) mounted to a small pontoon-style USV. The AquaBOT was tested in four streams and rivers in Iowa and Tennessee. All measured water quality parameters varied longitudinally, and greater ranges were generally observed along the low-order, agriculturally influenced streams in Iowa. Nitrate, in particular, was spatially heterogeneous. For example, during one run in early June, concentrations ranged from 10.5 to 12.5 mg N L –1 along a 2.3 km reach and hotspots were observed directly downstream of some tile drains. The spatial resolution of AquaBOT data collected in June was 10× higher than grab sampling data, and measurements were collected in less time and at a comparable cost. Here, the AquaBOT can complement existing measurement approaches and will lead to advancements in understanding the processes driving water quality along the stream-to-river continuum.
This dataset supports the implementation described in the manuscript "Breaking the Barrier of Human-Annotated Training Data for Machine-Learning-Aided Biological Research Using Aerial Imagery." It comprises UAV aerial imagery used to execute the code available at https://github.com/pixelvar79/GAN-Flowering-Detection-paper. For detailed information on dataset usage and instructions for implementing the code to reproduce the study, please refer to the GitHub repository.
Our Co-design team is from the University of Texas, working on a Department of Energy-funded project focused on the Beaumont-Port Arthur area. As part of this project, we will be developing climate-resilient design solutions for areas of the region. More on www.caee.utexas.edu.We used a DJI Mavic 2 Pro to capture aerial photos in Beaumont-Port Arthur, TX, in February 2023, including:I. Beaumont Soccer ClubII. Corps’ Port Arthur Resident OfficeIII. Halbouty Pump Station comprises its vicinityIV. Lamar University (Including Exxon Power Plants close to Lamar Univ.)V. MLK Boulevard for aerial images of the industry and the ship channelVI. Salt Water Barrier (include some aerial images about the Big Thicket)Aerial photos taken were through DroneDeploy autonomous flight, and models were processed through the DroneDeploy engine as well. All aerial photos are in .JPG format and contained in zipped files for each location.The processed data package including 3D models, geospatial data, mappings, point clouds, and the animation video of Halbouty Pump Station has various file types:- The Adobe Suite gives you great software to open .Tif files.- You can use LASUtility (Windows), ESRI ArcGIS Pro (Windows), or Blaze3D (Windows, Linux) to open a LAS file and view the data it contains.- Open an .OBJ file with a large number of free and commercial applications. Some examples include Microsoft 3D Builder, Apple Preview, Blender, and Autodesk.- You may use ArcGIS, Merkaartor, Blender (with the Google Earth Importer plug-in), Global Mapper, and Marble to open .KML files.- The .tfw world file is a text file used to georeference the GeoTIFF raster images, like the orthomosaic and the DSM. You need suitable software like ArcView to open a .TFW file.This dataset provides researchers with sufficient geometric data and the status quo of the land surface at the locations mentioned above. This dataset could streamline researchers' decision-making processes and enhance the design as well.In October 2023, we had our follow-up data collection, including:I. Beaumont Soccer ClubII. Shipping and Receiving Center at Lamar UniversityAfter the aerial collection, we obtained aerial photos of those two locations mentioned above, as well as processed data (such as point clouds and models).
Our Co-design team is from the University of Texas, working on a Department of Energy-funded project focused on the Beaumont-Port Arthur area. As part of this project, we will be developing climate-resilient design solutions for areas of the region. More on www.caee.utexas.edu.We captured aerial photos in the Port Arthur Coastal Neighborhood Community and the Golf Course on Pleasure Island, Texas, in June 2024.Aerial photos taken were through DroneDeploy autonomous flight, and models were processed through the DroneDeploy engine as well. All aerial photos are in .JPG format and contained in zipped files for each area.The processed data package includes 3D models, geospatial data, mappings, and point clouds. Please be aware that DTM, Elevation toolbox, Point cloud, and Orthomosaic use EPSG: 6588. And 3D Model uses EPSG: 3857.For using these data:- The Adobe Suite gives you great software to open .Tif files.- You can use LASUtility (Windows), ESRI ArcGIS Pro (Windows), or Blaze3D (Windows, Linux) to open a LAS file and view the data it contains.- Open an .OBJ file with a large number of free and commercial applications. Some examples include Microsoft 3D Builder, Apple Preview, Blender, and Autodesk.- You may use ArcGIS, Merkaartor, Blender (with the Google Earth Importer plug-in), Global Mapper, and Marble to open .KML files.- The .tfw world file is a text file used to georeference the GeoTIFF raster images, like the orthomosaic and the DSM. You need suitable software like ArcView to open a .TFW file.This dataset provides researchers with sufficient geometric data and the status quo of the land surface at the locations mentioned above. This dataset could streamline researchers' decision-making processes and enhance the design as well.