Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “learning rate”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 883 records · Page 49
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

Rolling Root Mean Square Based Multimodal Anomaly Detection for Real Time Monitoring of Smart Grid

Reliable real-time monitoring is valuable for maintaining the operational integrity of modern electrical smart grids. Deployment of heterogeneous sensing technologies in substations has enabled high-resolution, multichannel waveform monitoring, but also introduces challenges for anomaly detection due to noise, baseline drift, and modality-dependent signal characteristics. In this work, we present a computationally efficient unsupervised method for multimodal event detection based on Rolling Root Mean Square based Event Detection (RRMSED). The method is developed using in-house, field deployed sensors collecting data at a utility substation. The sensing system comprises voltage and current sensors, triaxial accelerometers, and magnetometers, collectively capturing electrical, vibrational, and magnetic waveform measurements at high temporal resolution. RRMSED operates by extracting rolling RMS energy features and their first-order temporal differences from consecutive waveform segments for each channel and then applying channel-specific statistical thresholds learned from historical data. A persistence-based exceedance logic is employed to robustly identify transient events while suppressing impulsive noise, and to provide precise temporal localization with high resolution. The framework is designed for continuous server-side operation and can be deployed in real time without requiring complex models. Experiments on simulated waveform data with known ground truth demonstrate low false positive (FP) and false negative (FN) rates. Application to real substation data shows RRMSED to identify events that are not captured by conventional monitoring indicators including fast transient detection algorithm currently deployed in the system. These results indicate that rolling RMS based features provide an effective and practical basis for real-time multimodal event detection in smart-grid substations.

Mukherjee, Subrata [ORNL] (ORCID:0000000309930338)↗
DOE OSTI2020

The Port Hope Areas Initiative's Port Granby Project: The Decontamination of Site Equipment from a Low Level Waste Facility - 20330

The Port Hope Area Initiative (PHAI) is the Government of Canada's response to the community recommended solutions for the remediation and safe, long-term management of historic low-level radioactive waste (LLRW) that was the result of uranium and radium processing operations in the Municipality of Port Hope, Ontario from the 1930's to the 1980's. The Eldorado refinery, on the shores of Lake Ontario, began refining radium-226 from pitchblende ore, later transitioning to the refining of uranium ore. Process residues were deposited at the Welcome Waste Management Facility in Port Hope until the mid-1950's switching to the Port Granby Waste Management Facility (PGWMF), which continued to accept waste until the late 1980's. The Port Granby Project involves the construction of a new, secure long-term waste management facility (LTWMF) and supporting infrastructure, and the excavation and relocation of approximately 1,200,000 m{sup 3} of historic low-level radioactive waste and marginally contaminated soil from the PGWMF to the newly constructed LTWMF. Since the project's inception in 2016, the bulk of the material has since been moved to the final long term storage cell. This has taken over 500,000 person-hours and a large amount of one site heavy equipment to accomplish including excavators, bulldozers, rock trucks, baker tanks and vacuum trucks. While many of the pieces of heavy equipment and water management equipment has further work to do on site, several of the sites larger items have already undergone the decontamination process prior to release from the site. This process has posed a serious challenge as the waste has a caustic nature to it and over the last few years it has had time to work its way into the metallic structures and framework of the equipment. Coupled with the tight work spaces and in some cases confined work areas there have been many issues that needed to be addressed to successfully reach a state where items can be free released to the unrestricted limits of the sites license. This ongoing process has led to a more refined decontamination program at the Port Granby Facility and has had a rather high success rate considering the length of time the equipment has been exposed to the waste materials on site. This paper discusses the varied challenges of decontamination faced at a low-level radioactive waste facility with a focus on the following aspects: - Challenges faced regarding different equipment types and the solutions implemented by Wood to address these challenges; - An examination of various decontamination methods employed throughout the project; and - Lessons learned over three years of remediation work and how they impact the decontamination process. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2021

Machine Learning and Economic Models to Enable Risk-Informed Condition Based Maintenance of a Nuclear Plant Asset

The primary objective of this research is to address challenges in the implementation of risk-informed, condition-based predictive maintenance (PdM), which reduces operating costs while still maintaining the safety and reliability of commercial nuclear power plants (NPPs). To achieve the objective, risk models are being developed by taking advantage of advancements in data analytics, deep learning, machine learning (ML), and artificial intelligence (AI). The notable outcomes presented in the report include ? Development of a ML models using heterogeneous plant process and vibration data collected at different spatial and temporal resolutions from the Salem?s CWS to diagnose a circulating water pump (CWP) failure based on salient fault signatures. The developed diagnostic models are extendable to other faults associated with CWPs and CWP motors given associated fault signatures. ? Development of a natural language processing (NLP) technique to automatically classify the WO data into different categories. The developed NLP technique was validated on independent WO data. This automates the tedious and time-consuming activity of mining and classifying WOs by subject matter experts. ? Estimation of mean time between downtime (i.e., time duration between time instances when 1 or more CWPs are not available) and developed an approach to establish reliability of CWS components using unstructured WO data along with CWS plant process data. ? Formulation of economic model based on Markov chain models. The parameters of associated with the transition rate between different states of Markov chain models were estimated using WO data. The economic model formulation and discussion captures both time-independent and time-dependent parameter variation, leading to risk-informed decision-making.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2023

Denitrification and the challenge of scaling microsite knowledge to the globe

Here, our knowledge of microbial processes—who is responsible for what, the rates at which they occur, and the substrates consumed and products produced—is imperfect for many if not most taxa, but even less is known about how microsite processes scale to the ecosystem and thence the globe. In both natural and managed environments, scaling links fundamental knowledge to application and also allows for global assessments of the importance of microbial processes. But rarely is scaling straightforward: More often than not, process rates in situ are distributed in a highly skewed fashion, under the influence of multiple interacting controls, and thus often difficult to sample, quantify, and predict. To date, quantitative models of many important processes fail to capture daily, seasonal, and annual fluxes with the precision needed to effect meaningful management outcomes. Nitrogen cycle processes are a case in point, and denitrification is a prime example. Statistical models based on machine learning can improve predictability and identify the best environmental predictors but are—by themselves—insufficient for revealing process-level knowledge gaps or predicting outcomes under novel environmental conditions. Hybrid models that incorporate well-calibrated process models as predictors for machine learning algorithms can provide both improved understanding and more reliable forecasts under environmental conditions not yet experienced. Incorporating trait-based models into such efforts promises to improve predictions and understanding still further, but much more development is needed.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2020

Catalytic N 2 -to-NH 3 (or -N 2 H 4 ) Conversion by Well-Defined Molecular Coordination Complexes

Nitrogen fixation, the six-electron/six-proton reduction of N 2 , to give NH 3 , is one of the most challenging and important chemical transformations. Notwithstanding the barriers associated with this reaction, significant progress has been made in developing molecular complexes that reduce N 2 into its bioavailable form, NH 3 . This progress is driven by the dual aims of better understanding biological nitrogenases and improving upon industrial nitrogen fixation. In this review, we highlight both mechanistic understanding of nitrogen fixation that has been developed, as well as advances in yields, efficiencies, and rates that make molecular alternatives to nitrogen fixation increasingly appealing. We begin with a historical discussion of N 2 functionalization chemistry that traverses a timeline of events leading up to the discovery of the first bona fide molecular catalyst system and follow with a comprehensive overview of d-block compounds that have been targeted as catalysts up to and including 2019. Furthermore, we end with a summary of lessons learned from this significant research effort and last offer a discussion of key remaining challenges in the field.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

Classifying handedness in chiral nanomaterials using label error robust deep learning

Abstract High-throughput scanning electron microscopy (SEM) coupled with classification using neural networks is an ideal method to determine the morphological handedness of large populations of chiral nanoparticles. Automated labeling removes the time-consuming manual labeling of training data, but introduces label error, and subsequently classification error in the trained neural network. Here, we evaluate methods to minimize classification error when training from automated labels of SEM datasets of chiral Tellurium nanoparticles. Using the mirror relationship between images of opposite handed particles, we artificially create populations of varying label error. We analyze the impact of label error rate and training method on the classification error of neural networks on an ideal dataset and on a practical dataset. Of the three training methods considered, we find that a pretraining approach yields the most accurate results across label error rates on ideal datasets, where size and other morphological variables are held constant, but that a co-teaching approach performs the best in practical application.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Quantum optical classifier with superexponential speedup

Abstract Classification is a central task in deep learning algorithms. Usually, images are first captured and then processed by a sequence of operations, of which the artificial neuron represents one of the fundamental units. This paradigm requires significant resources that scale (at least) linearly in the image resolution, both in terms of photons and computational operations. Here, we present a quantum optical pattern recognition method for binary classification tasks. It classifies objects without reconstructing their images, using the rate of two-photon coincidences at the output of a Hong-Ou-Mandel interferometer, where both the input and the classifier parameters are encoded into single-photon states. Our method exhibits the behaviour of a classical neuron of unit depth. Once trained, it shows a constant $${{\mathcal{O}}}(1)$$ O ( 1 ) complexity in the number of computational operations and photons required by a single classification. This is a superexponential advantage over a classical artificial neuron.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2022

Near real-time streaming analysis of big fusion data

Experiments on fusion plasmas produce high-dimensional data time series with ever-increasing magnitude and velocity, but turn-around times for analysis of this data have not kept up. For example, many data analysis tasks are often performed in a manual, ad-hoc manner some time after an experiment. In this article, we introduce the Delta framework that facilitates near real-time streaming analysis of big and fast fusion data. By streaming measurement data from fusion experiments to a high-performance compute center, Delta allows computationally expensive data analysis tasks to be performed in between plasma pulses. This article describes the modular and expandable software architecture of Delta and presents performance benchmarks of individual components as well as of an example workflow. Focusing on a streaming analysis workflow where electron cyclotron emission imaging (ECEi) data is measured at KSTAR on the National Energy Research Scientific Computing Center's (NERSC's) supercomputer we routinely observe data transfer rates of about 4 Gigabit per second. In NERSC, a demanding turbulence analysis workflow effectively utilizes multiple nodes and graphical processing units and executes them in under 5 min. We further discuss how Delta uses modern database systems and container orchestration services to provide web-based real-time data visualization. For the case of ECEi data we demonstrate how data visualizations can be augmented with outputs from machine learning models. Here, by providing session leaders and physics operators, results of higher-order data analysis using live visualizations may make more informed decisions on how to configure the machine for the next shot.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2020

Autotuning of Double-Dot Devices In Situ with Machine Learning

The current practice of manually tuning quantum dots (QDs) for qubit operation is a relatively time-consuming procedure that is inherently impractical for scaling up and applications. In this work, we report on the in situ implementation of a recently proposed autotuning protocol that combines machine learning (ML) with an optimization routine to navigate the parameter space. In particular, we show that a ML algorithm trained using exclusively simulated data to quantitatively classify the state of a double-QD device can be used to replace human heuristics in the tuning of gate voltages in real devices. Here, we demonstrate active feedback of a functional double-dot device operated at millikelvin temperatures and discuss success rates as a function of the initial conditions and the device performance. Modifications to the training network, fitness function, and optimizer are discussed as a path toward further improvement in the success rate when starting both near and far detuned from the target double-dot range.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2024

Evolving Multi-hazard Machine Learning Modeling for Advanced Risk-Informed Infrastructure Resilience Assessment

The socioeconomic impacts of pipeline incidents have escalated over the past three decades, revealing the limitation of traditional risk modeling methods when applied to extensive pipeline networks. This research aims to develop machine learning (ML) models that effectively identify, rank, and predict the diverse hazards and socioeconomic consequences associated with pipeline incidents. Utilizing historical data on pipeline incidents alongside weather and oceanographic data from the 1980s onward, the Houston metropolitan area serves as a testbed for the proposed methodologies. The research segments the combined datasets into three consecutive periods, demonstrating the efficacy of the updated model in predicting future events, particularly concerning precipitation rate data. Despite the challenges posed by a relatively limited dataset, local-level ML modeling offers valuable insights into the spatial and temporal dynamics of multiple hazards that contribute to pipeline incidents. These findings hold significant implications for future research, particularly in understanding and mitigating risks in various locations across the Gulf Coast and other coastal regions.

42 ENGINEERING↗
DOE OSTI2023

Grey-box and ANN-based building models for multistep-ahead prediction of indoor temperature to implement model predictive control

Model-based predictive control (MPC) strategies for heating, ventilation, and air-conditioning (HVAC) systems present an opportunity to lower building energy consumption and operational costs. Such approaches rely on the development of a model to precisely forecast building thermal dynamics, such as room air temperature or heating/cooling rate, and make control-related decisions. The control-oriented modeling of building energy systems should be accurate in predicting indoor conditions and present low computational complexity. These features are the key challenge of implementing advanced control methods such as MPC. Extant studies on building modeling for MPC have focused on step-ahead forecasting techniques to forecast building thermal dynamics, while multistep-ahead forecasting is essential. Moreover, machine learning model suitable in case of the domain-based engineering expertise are also not available. To this aim, we perform a comparative analysis of the grey-box model based on a resistance-capacitance (RC) thermal network and a machine learning model composed of an artificial neural network (ANN) for multistep-ahead prediction of building thermal dynamics using current and historical data. Actual experimental data obtained from the Flexible Research Platform (FRP) in Oak Ridge National Laboratory (US) are used for estimation and validation purposes. The average root mean squared error (RMSE) of the grey-box and ANN models are 0.89 °C and 1.02°C, respectively. Finally, the results indicate that the grey-box model outperforms the ANN model in the considered validation periods in terms of accuracy and prediction stability.

42 ENGINEERING↗
DOE OSTI2023

Dynamics of Aqueous Electrolyte Solutions: Challenges for Simulations

This Perspective article focuses on recent simulation work on the dynamics of aqueous electrolytes. It is well-established that full-charge, nonpolarizable models for water and ions generally predict solution dynamics that are too slow in comparison to experiments. Models with reduced (scaled) charges do better for solution diffusivities and viscosities but encounter issues describing other dynamic phenomena such as nucleation rates of crystals from solution. Polarizable models show promise, especially when appropriately parametrized, but may still miss important physical effects such as charge transfer. First-principles calculations are starting to emerge for these properties that are in principle able to capture polarization, charge transfer, and chemical transformations in solution. Finally, while direct ab initio simulations are still too slow for simulations of large systems over long time scales, machine-learning models trained on appropriate first-principles data show significant promise for accurate and transferable modeling of electrolyte solution dynamics.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Predicting future well performance for environmental remediation design using deep learning

Here in this study, we developed a deep learning (DL) framework with a multi-channel three-dimensional convolutional neural network (MC3D-CNN) to predict well performance and thereby assist future environmental remediation design. Such prediction of extraction well performance at designated locations is critical for configuring pump-and-treat (P&T) well network design and operation, setting reasonable target closure dates for overall remedying, and estimating remedy costs. The framework is developed with operational and monitoring data routinely collected during P&T remedy operations, including well extraction and injection rates as well as in situ contaminant concentrations. Traditionally, the collected data were rarely used for purposes other than assessing past well performance and the accuracy of the conceptual site model. However, recent advances in data-driven computational approaches enable better use of the large datasets to inform future well performance, enhance site characterization, and improve remediation planning. In this study, we established a DL framework to integrate transient three-dimensional contaminant plumes and multiple aquifer properties (e.g., hydraulic conductivity and hydrostratigraphic maps) to identify characteristic patterns controlling and representing extraction well mass recovery, aiming at providing future mass recovery estimates for existing wells and candidate wells at any proposed locations. We evaluated our framework by using a realistic synthetic dataset generated from a well-calibrated flow and transport model used in the 200 West Area of the U.S. Department of Energy’s Hanford Site in southeastern Washington state. The multi-channel feature in our framework allows integration of various types and temporal densities of training datasets for DL model development. Overall, we found that the trained DL model achieved an accuracy of over 90% in ranking extraction well performance in validation datasets, and over 80% in predicting high-performance-ranking well locations. This data-informed approach provides a flexible tool to support adaptive site management, streamline decision-making, and potentially reduce remediation time and costs. Our DL framework can be used as a filtering tool to improve the current P&T network optimization design by reducing the number of candidate well locations.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

Tandem bulk oxygen diffusion and surface reactions in reducible metal oxides control redox cycle dynamics

The interplay between bulk oxygen diffusion and surface reactions in reducible metal oxides is key in heterogeneous catalysts, but direct measurements of oxygen mobility, transient kinetics, and in situ spectroscopies have been lacking. Here, we reveal complex dynamic behavior of ceria-zirconia by H 2 using transient kinetics via mass spectrometry and in situ Raman and near-ambient pressure x-ray photoelectron spectroscopies. Molecular dynamics simulations with a machine learning potential delineate competitive oxygen diffusion mechanisms, with an optimal mobility at intermediate reductions. We expose a compensation between vacancy availability and lattice distortion at intermediate to high reductions and Frenkel defects at low reductions, underscoring a potential deficiency of 16 O/ 18 O exchange experiments in deducing oxygen mobility. Vacancies in proximity require electron localization on Ce atoms further away. The continuous replenishment of surface oxygen results in a varying reduction rate, with H 2 dissociation being the rate-limiting step. Multiscale transient simulations, consistent with experiments, indicate catalysts of potentially spatially varying oxidation states. The approach is broadly applicable to reducible oxide materials.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Widespread underestimation of rain-induced soil carbon emissions from global drylands

Dryland carbon fluxes, particularly those driven by ecosystem respiration, are highly sensitive to water availability and rain pulses. However, the magnitude of rain-induced carbon emissions remains unclear globally. Here we quantify the impact of rain-pulse events on the carbon balance of global drylands and characterize their spatiotemporal controls. Using eddy-covariance observations of carbon, water and energy fluxes from 34 dryland sites worldwide, we produce an inventory of over 1,800 manually identified rain-induced CO2 pulse events. Based on this inventory, a machine learning algorithm is developed to automatically detect rain-induced CO2 pulse events. Our findings show that existing partitioning methods underestimate ecosystem respiration and photosynthesis by up to 30% during rain-pulse events, which annually contribute 16.9 ± 2.8% of ecosystem respiration and 9.6 ± 2.2% of net ecosystem productivity. We show that the carbon loss intensity correlates most strongly with annual productivity, aridity and soil pH. Finally, we identify a universal decay rate of rain-induced CO2 pulses and use it to bias-correct respiration estimates. Our research highlights the importance of rain-induced carbon emissions for the carbon balance of global drylands and suggests that ecosystem models may largely underrepresent the influence of rain pulses on the carbon cycle of drylands.

Nguyen, Ngoc B↗
DOE OSTI2021

Strength in Rotary Friction Welding of Five Dissimilar Nickel-Based Superalloys

Advanced manufacturing processes improve the cost and quality of goods. Rotary friction welding is a fast, energy-efficient, and reliable joining process for metals, but new applications are hindered by large development costs for each new alloy. Each alloy set has different welding characteristics; therefore, lessons learned from a single alloy are not always broadly applicable. To establish knowledge that is applicable across multiple alloys, a family of different superalloys were welded to discover process trends that were applicable beyond a single alloy set. In this study, weld symmetry did not correlate to weld strength across alloy systems. Some alloys’ strongest welds occurred at maximum symmetry, whereas high asymmetry was associated with different alloys’ maximum strength. High feed rates, high welding forces, low energy, and low temperatures all resulted in high-strength welds across all alloy and geometry combinations. Tensile strengths greater than 95% of base-metal strength were recorded for most alloy systems.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Simple Statistical Models for Predicting Overpressure Due to CO2 and Low-Salinity Waste-Fluid Injection into Deep Saline Formations

Deep saline aquifers have been used for waste-fluid disposal for decades and are the proposed targets for large-scale CO2 storage to mitigate CO2 concentration in the atmosphere. Due to relatively limited experience with CO2 injection in deep saline formations and given that the injection targets for CO2 sometimes are the same as waste-fluid disposal formations, it could be beneficial to model and compare both practices and learn from the waste-fluid disposal industry. In this paper, we model CO2 injection in the Patterson Field, which has been proposed as a site for storage of 50 Mt of industrial CO2 over 25 years. We propose general models that quickly screen the reservoir properties and calculate pressure changes near and far from the injection wellbore, accounting for variable reservoir properties. The reservoir properties we investigated were rock compressibility, injection rate, vertical-to-horizontal permeability ratio, average reservoir permeability and porosity, reservoir temperature and pressure, and the injectant total dissolved solids (TDS) in cases of waste-fluid injection. We used experimental design to select and perform simulation runs, performed a sensitivity analysis to identify the important variables on pressure build-up, and then fit a regression model to the simulation runs to obtain simple proxy models for changes in average reservoir pressure and bottomhole pressure. The CO2 injection created more pressure compared to saline waste-fluids, when similar mass was injected. However, we found a more significant pressure buildup at the caprock-reservoir interface and lower pressure buildup at the bottom of the reservoir when injecting CO2 compared with waste-fluid injection.

Ansari, Esmail↗
DOE OSTI2020

Probing for Artifacts: Detecting Imagenet Model Evasions

While deep learning models have made incredible progress across a variety of machine learning tasks, they remain vulnerable to adversarial examples crafted to fool otherwise trustworthy models. In this work we approach this problem through the lens of a detection framework. We propose a classification network that uses the hidden layer activations of a trained model as inputs to detect adversarial artifacts in an input. We train this classification network simultaneously against multiple adversarial algorithms to create a more robust detector and show higher detection rates than several alternatives. The novelty of our approach is in the scale and scope of probing Imagenet models for adversarial artifacts. In addition, we propose an improvement to feature squeezing, another common adversarial example detection method.

Rounds, Jeremiah↗