Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “learning rate”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 793 records · Page 44

Application of machine learning techniques for fast MeV x-ray spectra unfolding from filter stack spectrometer data

Recovery of MeV x-ray spectra from detector signals is difficult because the response matrix inversion is ill-conditioned and current methods are too slow for high-repetition-rate experiments. In this work, we make use of neural networks to unfold MeV x-ray spectra from measurements obtained with a filter stack spectrometer at rates of near 40 Hz. The neural network was trained on synthetic data and tested on both synthetic and experimental data, the latter obtained in two separate experiments performed at the Omega EP laser facility. We show here that this unfolding method has good performance on synthetic data and that it is a promising option for experimental data of up to 40 MeV. The accuracy on experimental data is verified by using a simple forward model to compare against measured values.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Designing Monte Carlo Simulation and an Optimal Machine Learning to Optimize and Model Space Missions

This paper investigates applying artificial intelligence (AI) algorithms to attitude control system of satellites to optimally tune the controller using high performance computing. This methodology is applied to the Virtual Telescope for X-ray Observation mission, which is a precise formation of two separate spacecraft observing multiple objects in the space in the X-ray domain. The mission is divided into phases based on the instrumentation and the mission goal. To reach an stable precise formation robust to stochastic slew and slew rate (i.e., Euler angles and angular velocities) in a minimal constrained time T , consumed energy of the attitude control system, denoted as E, and root-mean-square state error of attitude control system, denoted as e, are minimized. Monte-Carlo simulation is used for the sensitivity analysis of optimization and designing a controller. Deep neural networks (DNN), Gaussian processes (GP), and support vector regression (SVR) learn this optimization as a surrogate model, while their hyperparameters are optimized in a novel approach. THETA supercomputer at Argonne Leadership Computing Facility (ALCF) is used for optimizing the hyperparameters of DNN. The surrogate model meets the requirements of the mission, and it shows a better performance over the optimization and Monte-Carlo. The optimal DNN can satisfy the mission requirements e and T while reducing E for 90% compared to the other given methods.

42 ENGINEERING↗

Machine Learning-based Cyber-Physical Anomaly Detection in Wide Area Voltage Control Systems

Wide-area voltage control systems (WAVCS) are widely deployed in power grid to improve the voltage stability in transmission system using Flexible AC Transmission System (FACTS) devices. The WAVCS relies on wide-area measurement and control signals for closed-loop control of FACTS devices to improve the transient voltage stability in power grid in real-time. Since the WAVCS utilizes a cyber-layer communication during its normal operation, they are susceptible to cyber attacks from adversaries which can lead to a voltage collapse if the attacks go undetected and unmitigated. This paper proposes a supervised machine learning (ML)-based anomaly detection algorithm for detecting various stealthy cyber attacks in the context of WAVCS cybersecurity. In particular, a fuzzy logic-based wide-area controller, as proposed by the Bonneville Power Administration (BPA), is implemented on the Kundur’s four machine two-area system that is integrated with a static var compensator (SVC) to improve voltage profile on sensitive buses. Later, different types of data integrity attacks, including pulse and ramp attacks, are considered on the wide-area measurement and control signals to analyze the performance of the proposed anomaly detector. Our experimental evaluation shows a promising performance with a high true-positive rate (more than 99%) and low false-negative rate (less than 1%) while exhibiting a small prediction time.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Levelized cost of charging of extreme fast charging with stationary LMO/LTO batteries

Extreme DC fast charging for electric vehicles (EVs) could be competitive with the internal combustion engine refueling experience and enable longer-distance travel, which could help with EV adoption and decarbonization, but these systems have high capital costs and extremely variable high-power demands. Behind-the-meter systems (BTMS) could support extreme-fast-charging (XFC) stations to increase nationwide adoption of EVs. Here, this study examines the optimal break-even levelized cost of charging (LCOC) across 96 BTMS scenarios to enable low-wait XFC stations providing 200 miles of charge in 10 min. This research simulates LCOC via synthetic XFC-capable EV loads, machine-learned battery life models from testing data, and nonlinear optimal controls, co-minimizing complex utility costs and battery replacements. An aggregate optimal BTMS design treating each EV load as equal likely gives an optimal LCOC per utility rate, the average of which is $\$$0.59/kWh. In addition, the sensitivity of optimal and off-optimal design factors, the long-life LMO/LTO chemistry, and optimized controls are analyzed. The battery control model, based on battery stressors to compare chemistries, optimizes LMO/LTO resting state of charge and cycle depth without compromising cost reduction, which enables greater flexibility in operation. The LCOC savings due to replacement reduction are small, up to $\$$0.035/kWh (6%), with an average of $\$$0.02/kWh (3.5%). Compared with gasoline stations, the aggregate XFC station design achieves comparable speed, experience of service, and cost at $\$$3.81/gal gasoline, showing that EVs can replace gasoline vehicles even for longer-distance travel.

25 ENERGY STORAGE↗

Evaluation of Power Transmission Lines Hardening Scenarios Using a Machine Learning Approach

The power transmission infrastructure is vulnerable to extreme weather events, particularly hurricanes and tropical storms. A recent example is the damage caused by Hurricane Maria (H-Maria) in the archipelago of Puerto Rico in September 2017, where major failures in the transmission infrastructure led to a total blackout. Numerous studies have been conducted to examine strategies to strengthen the transmission system, including burying the power lines underground or increasing the frequency of tree trimming. However, few studies focus on the direct hardening of the transmission towers to accomplish an increase in resiliency. This machine learning-based study fills this need by analyzing three direct hardening scenarios and determining the effectiveness of these changes in the context of H-Maria. A methodology for estimating transmission tower damage is presented here in this study as well as an analysis of impact of replacing structures with a high failure rate with more resilient ones. We found the steel self-support-pole to be the best replacement option for the towers with high failure rate. Furthermore, the third hardening scenario, where all wooden poles were replaced, exhibited a maximum reduction in damaged towers in a single line of 66% while lowering the mean number of damaged towers per line by 10%.

54 ENVIRONMENTAL SCIENCES↗

Nuclear microreactor transient and load-following control with deep reinforcement learning

The economic feasibility of nuclear microreactors will depend on minimizing operating costs through advancements in autonomous control, especially when these microreactors are operating alongside other types of energy systems (e.g., renewable energy). This study explores the application of deep reinforcement learning (RL) for real-time drum control in microreactors, exploring performance in regard to load-following scenarios. By leveraging a point kinetics model with thermal and xenon feedback, we first establish a baseline using a single-output RL agent, then compare it against a traditional proportional–integral–derivative (PID) controller. This study demonstrates that RL controllers, including both single- and multi-agent RL (MARL) frameworks, can achieve similar or even superior load-following performance as traditional PID control across a range of load-following scenarios. In short transients, the RL agent was able to reduce the tracking error rate in comparison to PID by one half to one third. Over extended 300-minute load-following scenarios in which xenon feedback becomes a dominant factor, PID maintained better accuracy, but RL still remained within a 1% error margin despite being trained only on short-duration scenarios. This highlights RL’s strong ability to generalize and extrapolate to longer, more complex transients, affording substantial reductions in training costs and reduced overfitting. Furthermore, when control was extended to multiple drums, MARL enabled independent drum control as well as maintained reactor symmetry constraints without sacrificing performance---an objective that standard single-agent RL could not learn. We also found that, as increasing levels of Gaussian noise were added to the power measurements, the RL controllers were able to maintain lower error rates than PID, and to do so with at least 10% and upwards of 150% less control effort. These findings illustrate RL's potential for autonomous nuclear reactor control, laying the groundwork for future integration into high-fidelity simulations and experimental validation efforts.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗

Machine Learning to Predict Joint Performance in Epoxy Composites Based on Process Parameters

Polymer matrix composites are gaining popularity in the aerospace industry due to their high specific strength, fatigue properties, and processability. However, based on current FAA certification guidelines, manufacturers utilizing current state-of-the-art composites made with adhesive bonds commonly install redundant fasteners to guarantee the strength of these adhesively bonded composite parts. The number of fasteners in a single-aisle commercial transport aircraft is typically on the order of 105, which reduces manufacturing rate, increases cost tremendously, and reduces the advantage of the specific strength composites provide. Due to this, the Adhesive Free Bonding of Composites (AERoBOND) project at NASA Langley Research Center has developed a novel assembly process to manufacture complex composite parts without the use of adhesives and fasteners. However, optimization of the process is currently challenging due to the complex and interdependent process parameters. To assist with the optimization, four machine learning algorithms utilizing gradient boosting decision trees were created to provide predictions for the mechanical and characterization properties of the composite parts. Approximately 200 random states from each algorithm were tested, and the models from each state were isolated and analyzed based on their accuracy, a validation process, and their feature importance. This analysis concluded that the models created from the machine learning algorithms could accelerate a parametric study for the AERoBOND process by rapidly optimizing process parameters to achieve desired performance characteristics.

Brennen Michael Middleton↗

Accelerating Machine Learning Inference with GPUs in ProtoDUNE Data Processing

Abstract We study the performance of a cloud-based GPU-accelerated inference server to speed up event reconstruction in neutrino data batch jobs. Using detector data from the ProtoDUNE experiment and employing the standard DUNE grid job submission tools, we attempt to reprocess the data by running several thousand concurrent grid jobs, a rate we expect to be typical of current and future neutrino physics experiments. We process most of the dataset with the GPU version of our processing algorithm and the remainder with the CPU version for timing comparisons. We find that a 100-GPU cloud-based server is able to easily meet the processing demand, and that using the GPU version of the event processing algorithm is two times faster than processing these data with the CPU version when comparing to the newest CPUs in our sample. The amount of data transferred to the inference server during the GPU runs can overwhelm even the highest-bandwidth network switches, however, unless care is taken to observe network facility limits or otherwise distribute the jobs to multiple sites. We discuss the lessons learned from this processing campaign and several avenues for future improvements.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Analysis of biokinetic parameters reveals patterns in mercury accumulation across aquatic species

Mercury (Hg) is a potent neurotoxicant and poses a risk to human health through the ingestion of Hg-contaminated fish. Mercury, especially in its organic form methylmercury (MeHg), biomagnifies up food chains such that even small aqueous concentrations of Hg can result in significant concentrations of total Hg in fish. Understanding the ecological and human health risks associated with Hg and MeHg exposure requires an understanding of the factors that affect its bioaccumulation in aquatic species. We compiled estimates of three biokinetic parameters: uptake rate (k u ), assimilation efficiency (AE), and efflux rate (k e ). These parameters describe contaminant uptake from aqueous (k u ) and dietary (AE) exposure and the rate of excretion (k e ). We found parameter values for 38 and 34 different species of fish and aquatic invertebrates, respectively, and collected 502 parameter values in total. Here, we used a machine learning technique to establish the relationships between experimental and physiological variables and these parameter values. We found differences in which variables were associated with biokinetic parameter values for fish and aquatic invertebrates. The form of Hg was the most impactful variable, influencing values of all parameters except k u for invertebrates, for which aqueous exposure time was the only significant predicator variable. The parameter k e were the only values significantly influenced by more than one variable, with water type (freshwater, brackish, or marine), organism weight, and form of Hg significantly impacting parameter values for fish and/or invertebrates. To our knowledge, this study represents the most extensive review of biokinetic parameters of Hg and MeHg accumulation in aquatic organisms. Environmental parameters found to significantly impact Hg and MeHg bioaccumulation in past studies were not identified as important in our analyses across aquatic ecosystems and species. Our dataset and analysis reveal novel patterns that may help us better understand and manage Hg bioaccumulation.

54 ENVIRONMENTAL SCIENCES↗

Toward Statistical Real-Time Power Fault Detection

We propose statistical fault detection methodology based on high-frequency data streams that are becoming available in modern power grids. Our approach can be treated as an online (sequential) change point monitoring methodology. However, due to the mostly unexplored and very nonstandard structure of high-frequency power grid streaming data, substantial new statistical development is required to make this methodology practically applicable. The paper includes development of scalar detectors based on multichannel data streams, determination of data-driven alarm thresholds and investigation of the performance and robustness of the new tools. Due to a reasonably large database of faults, we can calculate frequencies of false and correct fault signals, and recommend implementations that optimize these empirical success rates.

bolted faults↗

A High-level Design for Bidirectional Data Streaming to High-Performance Computing Systems from External Science Facilities

Cutting-edge science is increasingly data-driven due to the emergence of scientific machine learning models that can guide scientists toward fruitful areas of exploration. Experimental science facilities such as light and neutron sources, particle colliders, and radio astronomy telescopes are also producing raw measurement data at rates that exceed available data storage and computing capacity at those facilities. As a result, scientific workflows are being developed that concurrently couple experiments at science facilities with high-performance computing (HPC) facilities to enable analysis of experimental data while the experiment is ongoing, and where analysis results are potentially fed back to the experiment for use in experimental control and/or steering in a time-sensitive manner. Our goal is to design, prototype, and deploy a new capability for the Oak Ridge Leadership Computing Facility (OLCF) that enables such workflows through support for bidirectional, memory-based streaming of data from external experiments into and out of OLCF HPC systems. This high-level design document describes the related work and motivating use cases that inform our understanding of the technical requirements for this capability, and describes a proposed architectural solution that meets these requirements and our plans for demonstrating the capability.

97 MATHEMATICS AND COMPUTING↗

Battery State of Health Estimator: Cooperative Research and Development Final Report

NREL has developed a software tool to enable Renewance to estimate the degradation of batteries from basic information such as the type of battery and the application of that battery during its first life, so that used batteries may be evaluated for potential repurposing at low cost. This software tool utilizes NREL's BLAST-Lite battery degradation modeling code, which was updated with additional models for commercially produced lithium-ion batteries as a part of this CRADA. The software tool enables users to input details such as battery type and application so that lifetime estimates can be made without any programming or expert battery knowledge. The application input loads in saved values for parameters such as cycles per year, depth-of-discharge, and other battery operating parameters from a file defined by Renewance. These parameters may be modified to refine simulations for specific batteries. The software tool also incorporates a degradation model optimization tool, whereby existing battery degradation models may be tuned according to measured battery health. This ensures that new models still predict degradation behaviors expected from a certain battery chemistry, but with the overall degradation rate tuned to a specific battery make and model. The new model can then be saved for estimating the degradation of other similar batteries. An additional task was planned to utilize machine-learning to enable battery health diagnosis from rapid EIS measurements to accelerate the screening of used batteries. This task was not completed due to lack of available data for training a machine-learning model. CRADA benefit to DOE, Participant, and US Taxpayer: Further development of open-source software tool BLAST-Lite for predicting the lifetime of commercially produced Lithium-ion batteries (NREL SWR-22-69).

25 ENERGY STORAGE↗

Impact of a process improvement program in a production software environment: Are we any better?

For the past 15 years, Computer Sciences Corporation (CSC) has participated in a process improvement program as a member of the Software Engineering Laboratory (SEL), which is sponsored by GSFC. The benefits CSC has derived from involvement in this program are analyzed. In the environment studied, it shows that improvements were indeed achieved, as evidenced by a decrease in error rates and costs over a period in which both the size and the complexity of the developed systems increased substantially. The principles and mechanics of the process improvement program, the lessons CSC has learned, and how CSC has capitalized on these lessons are also discussed.

Heller, Gerard H.↗

Anomalous on-orbit behaviour of the NASA Cosmic Background Explorer (COBE) Dewar

A brief summary of the nominal cryogenic performance of the Dewar is presented, with emphasis on several aspects of the helium and spacecraft dynamical behavior. The occurrence of temperature and pressure oscillators in the Dewar porous plug is examined. The impact of the internal instrument malfunctions and of external radiation sources on the performance of the Dewar and of the instruments is reviewed. From measurements of the COBE spacecraft spin rate, the spin coupling of the liquid helium to the walls of the Dewar was monitored. The spin measurements are analyzed and a model for the coupling is presented. A number of 'lessons learned' from the COBE mission are reviewed, and the applicability of these lessons to future missions involving cryogenic payloads is addressed.

Volz, S. M.↗

NASA GPM Status and Future Activities

The joint U.S.-Japan Global Precipitation Measurement (GPM) mission is approaching a decade of operations, and continues to pursue research, dataset production, and outreach related to precipitation. One key activity over the last year was the release of an improved “Version 07” of all GPM precipitation and latent heating products. This talk summarizes key improvements to the GPM products for which NASA has lead responsibility and provides some examples of the changes between Versions 06 and 07 in algorithm performance. One important operational change that affected Version 07 is that the scanning strategy for the Ka-band radar channel changed in May 2018; all products that depend on Ka were revised to accommodate this change. For example, in Version 07 the Goddard Profiling (GPROF) algorithm has implemented improvements in regions where orographic enhancement and suppression take place and where the surface is snowy/icy, and again covers radiometers reaching back to 1987. The Combined Radar Radiometer Algorithm (CORRA) now incorporates modified drop-size distribution constraints that substantially reduce bias. Revisions to the Convective-Stratiform Heating (CSH) algorithm employ new radiative transfer retrievals as well as accounting for terrain in the vertical coordinates. Each algorithm was adjusted to ensure continuity for each product across the boundary in 2014 between the predecessor Tropical Rainfall Measuring Mission (TRMM) and the GPM Core Observatory. The U.S. Science Team’s Integrated Multi-satellitE Retrievals for GPM (IMERG) was upgraded to account for distortions in the probability density function of regional precipitation rates due to weighted averaging in the Kalman filter used for “morphing” the passive microwave data. The talk will conclude by considering major issues that require continued attention, including the use of machine learning algorithms, the operational challenge of swarms of “small”, perhaps short-lived satellites, and estimates of the remaining lifespan of the Core Observatory.

Global Precipitation Measuremen↗

Ground Test Stand Development for One-step Electrochemical Production of High-Pressure Oxygen

NASA designed a test rig, High-Pressure Oxygen Generation Assembly (HPOGA) to test a novel method of electrolysis as an alternative technology to the state-of-the-art Oxygen Generation Assembly (OGA) currently on the International Space Station (ISS). This approach involves utilizing a specialized electrolysis cell stack designed to both generate and compress high-pressure oxygen up to 3600 PSIG. The design eliminates the need for an external compressor and hydrogen separator, streamlining the oxygen generation process. HPOGA tests the viability of an electrolysis cell stack for extended life usage. Within the system, there are several key subsystems: nitrogen, high/low pressure oxygen, hydrogen, water recirculation, and water injection. The water injection subsystem supplies deionized (DI) water to a centralized reservoir for consumption. Subsequently, a water recirculation loop transfers the DI water across the cathode side of the electrolysis cell stack with constant flow rate. The result is a supply of hydrogen in the water loop and oxygen accumulation on the anode side of the cell stack. Hydrogen is evaporated out as part of the hydrogen sub-system which also measures hydrogen/oxygen concentration for safety. The oxygen subsystem is responsible for managing high pressure oxygen, O2 exhaust, and conducting hydrogen/oxygen concentration measurements. The nitrogen subsystem serves dual functions, purging the hydrogen/oxygen subsystems, and regulating pressure in both high/low-pressure O2 sections via pneumatic back pressure regulators. Various sensors monitor pressure, temperature, humidity, gas concentration and flow rate in each subsystem. This paper presents the design and testing of a comprehensive test stand, which serves to operate and functionally verify the performance of the electrolysis cell while offering valuable lessons learned.

electrolysis↗

Learning quantum computers' errors using interpretable neural networks

Learning and reducing the errors and noise in quantum computing systems is necessary for achieving quantum computation’s promise. However, rapid advances in experimental quantum computing are making this task increasingly difficult, because state-of-the-art systems now contain hundreds of qubits and many characterization techniques are hard to apply at this scale. Furthermore, complex kinds of errors in these systems, such as crosstalk and non-Markovian effects, must be understood and decreased, but these errors are challenging to study with most existing methods. In this project, we explored using neural networks for scalable characterization of complex errors in quantum computers. We proposed and demonstrated characterizing a quantum computer’s errors with neural networks that have interpretable parameters corresponding to the rates of different kinds of errors, within a sparse Lindbladian parameterization for errors. To enable scaling to many qubit systems, these networks then predict how these errors combine within quantum circuits and impact their outcomes using an efficient approximations. We demonstrated these networks ability to learn coherent crosstalk errors and context-dependent errors in a simulated 4-qubit system.

97 MATHEMATICS AND COMPUTING↗

Rotational Dynamics and Transition Mechanisms of Surface-Adsorbed Proteins

Assembly of biomolecules at solid-water interfaces requires molecules to traverse complex orientation-dependent energy landscapes through processes that are poorly understood, largely due to the dearth of in-situ single molecule measurements and statistical analyses of the rotational dynamics that define directional selection. Emerging capabilities in high-speed atomic force microscopy and machine learning have allowed us to directly determine the orientational energy landscape and observe and quantify the rotational dynamics for protein nanorods on the surface of muscovite mica under a variety of conditions. Comparisons with kinetic Monte Carlo simulations show that the transition rates between adjacent orientation-specific energetic minima can largely be understood through traditional models of in-plane Brownian rotation across a biased energy landscape, with resulting transition rates that are exponential in the energy-barriers between states. However, transitions between more distant angular states are decoupled from barrier height, with jump-size distributions showing a power-law decay that is characteristic of a non-classical Levy-flight random walk, indicating that large jumps are enabled by alternative modes of motion via activated states. The findings provide new insights into the dynamics of biomolecules at solid-liquid interfaces that lead to self-assembly, epitaxial matching and other orientationally anisotropic outcomes and define a general procedure for exploring such dynamics with implications for hybrid biomolecular-inorganic materials design.

Orientational energy landscapes, Rotational dynami↗