Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “learning efficiency”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 721 records · Page 40
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Improving the Freight Productivity of a Heavy-Duty, Battery Electric Truck by Intelligent Energy Management

This project aimed to enhance the range and reduce the operating costs of battery electric Class 8 trucks traveling over 250 miles daily. This was achieved through the development and implementation of an intelligent-Energy Management System (i-EMS) that leverages vehicle and operations data, physics-aware machine learning algorithms, and vehicle-to-cloud (V2C) connectivity. The project hypothesized that advanced machine learning algorithms and real-time data analytics could significantly improve the energy efficiency and range of these trucks. Key objectives included developing a physics-aware machine learning algorithm, implementing an i-EMS with V2C connectivity and physics-aware spatial data analytics (PSDA), and validating the system’s effectiveness with fleet partners HEB Companies and Murphy Logistics. Extensive data collection from vehicle operations, including vehicle characteristics, road conditions, and payload, was conducted. A machine learning algorithm was developed to predict energy consumption and enable proactive decision-making. The i-EMS was implemented on two Volvo VNR BEVs, with operators receiving charging and routing recommendations. Charging stations were installed at depot locations in Texas and Minnesota, with an additional on-route charger in Minnesota. Significant findings included a 14% range improvement for Murphy Logistics on a highway-driving eco-route and a 22% range improvement for HEB Companies on a city-driving eco-route. The i-EMS utilized rule-based methods and physics-based algorithms to predict and reduce energy consumption, with real-time monitoring and analysis through V2C connectivity enabling proactive decision-making. The project demonstrated the feasibility and economic viability of battery electric Class 8 trucks for long-haul operations, showcasing the potential of physics-aware machine learning in optimizing energy management. The successful implementation of the i-EMS in real-world scenarios validates its practical application and effectiveness, paving the way for the widespread adoption of battery electric vehicles in the freight transportation industry.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2023

Early Fault Detection in Particle Accelerator Power Electronics Using Ensemble Learning

Early fault detection and fault prognosis are crucial to ensure efficient and safe operations of complex engineering systems such as the Spallation Neutron Source (SNS) and its power electronics (high voltage converter modulators). Following an advanced experimental facility setup that mimics SNS operating conditions, the authors successfully conducted 21 early fault detection experiments, where fault precursors are introduced in the system to a degree enough to cause degradation in the waveform signals, but not enough to reach a real fault. Nine different machine learning techniques based on ensemble trees, convolutional neural networks, support vector machines, and hierarchical voting ensembles are proposed to detect the fault precursors. Although all 9 models have shown a perfect and identical performance during the training and testing phase, the performance of most models has decreased in the next test phase once they got exposed to realworld data from the 21 experiments. The hierarchical voting ensemble, which features multiple layers of diverse models, maintains a distinguished performance in early detection of the fault precursors with 95% success rate (20/21 tests), followed by adaboost and extremely randomized trees with 52% and 48% success rates, respectively. The support vector machine models were the worst with only 24% success rate (5/21 tests). The study concluded that a successful implementation of machine learning in the SNS or particle accelerator power systems would require a major upgrade in the controller and the data acquisition system to facilitate streaming and handling big data for the machine learning models. In addition, this study shows that the best performing models were diverse and based on the ensemble concept to reduce the bias and hyperparameter sensitivity of individual models.

43 PARTICLE ACCELERATORS↗
DOE OSTI2022

In-situ irradiation-induced studies of grain growth kinetics of nanocrystalline UO 2

The thermal conductivity of UO 2 fuel needs to be high enough to dissipate the heat generated from the fission reaction. Since grain size affects thermal conductivity and grain size can evolve with irradiation, it is critical to understand in-reactor UO 2 grain growth. Most studies of grain growth in UO 2 are based on thermally driven processes at elevated temperatures. However, studies have shown that grain growth can occur even at cryogenic temperatures by ballistic processes. Such irradiation-induced grain growth in UO 2 is yet to be studied. Advanced in-situ Kr ion irradiation and transmission electron microscopy were systematically performed on nanocrystalline UO 2 thin films at temperatures ranging from 50 K to 1073 K; grain growth was observed at all temperatures. A combination of manual and machine learning techniques was used to measure and plot grain size evolution against irradiation fluence at various irradiation temperatures. The machine learning method has significantly improved the analysis efficiency and reduced human labors. The grain diameter data were fitted using classical grain growth and thermal spike models to describe grain growth kinetics with and without irradiation effect. Grain growth during low temperature irradiation (≤ 475 K) can be well described by the thermal spike model. Above 475 K, there were additional thermally assisted processes that further accelerate the grain growth. At the highest irradiation temperature about 1075 K, both irradiation-induced dislocation loops and cavities/bubbles were observed to form in the UO 2 . In this report, the effects of irradiation-induced defects on grain growth kinetics are discussed.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2019

Fast neural network training on a cluster of GPUs for action recognition with high accuracy

In this work, we propose algorithms and techniques to accelerate training of deep neural networks for action recognition on a cluster of GPUs. The convergence analysis of our algorithm shows it is possible to reduce communication cost and at the same time minimize the number of iterations needed for convergence. We customize the Adam optimizer for our distributed algorithm to improve efficiency. In addition, we employ transfer-learning to further reduce training time while improving validation accuracy. For the UCF101 and HMDB51 datasets, the validation accuracies achieved are 93.1% and 67.9% respectively. With an additional end-to-end trained temporal stream, the validation accuracies achieved for UCF101 and HMDB51 are 93.47% and 81.24% respectively. As far as we know, these are the highest accuracies achieved with the two-stream approach using ResNet that does not involve computationally expensive 3D convolutions or pretraining on much larger datasets.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

UEMtomaton: A Source-Available Platform to Aid in Start-up of Ultrafast Electron Microscopy Labs

The steady rise in the number of ultrafast electron microscopy (UEM) labs, in addition to the opacity and lack of detailed descriptions of current approaches that would enable point-by-point construction, has created an opportunity for sharing common methods and instrumentation for (for example) automating data acquisition to assist in efficient lab start-up and to learn about common and robust protocols. In the spirit of open sharing of methods, we provide here a description of an entry-level method and user interface (UI) for automating UEM experiments, and we provide access to the source code and scripts (source-available) for ease of implementation or as a starting reference point for those entering or seeking to enter the field (https://github.com/CEMSFlannigan/UEMtomaton/releases/tag/v1.0). Core instrumentation and physical connections in the UEM lab at Minnesota are described. Interface communication schemes consisting of duo server-client pairs between critical components – the optical delay stage and the UEM digital camera – are presented, with emphasis placed on describing the logic and communications sequence designed to conduct automated series acquisitions. An application designed and programmed with C++/CLI as Windows Forms in Microsoft Visual Studio – dubbed UEMtomaton – is also presented. Key to the UI layout is centralization of the automation tasks and establishment of communication within the software rather than by interfacing with each individual workstation. It is our hope that this note provides useful insight for current and future UEM researchers, particularly with respect to generalizability and portability of the approach to emerging labs. Here, we note that while this basic, entry-level approach is certainly not the most sophisticated or comprehensive of those currently in use, we feel there is nevertheless value in clearly communicating a proven straightforward method to hopefully lower the barrier to entry into the field.

47 OTHER INSTRUMENTATION↗
DOE OSTI2021

NEXTorch: A Design and Bayesian Optimization Toolkit for Chemical Sciences and Engineering

Automation and optimization of chemical systems require well-informed decisions on what experiments to run to reduce time, materials, and/or computations. Data-driven active learning algorithms have emerged as valuable tools to solve such tasks. Bayesian optimization, a sequential global optimization approach, is a popular active-learning framework. Past studies have demonstrated its efficiency in solving chemistry and engineering problems. Here we introduce NEXTorch, a library in Python/PyTorch, to facilitate laboratory or computational design using Bayesian optimization. NEXTorch offers fast predictive modeling, flexible optimization loops, visualization capabilities, easy interfacing with legacy software, and multiple types of parameters and data type conversions. It provides GPU acceleration, parallelization, and state-of-the-art Bayesian optimization algorithms and supports both automated an d human-in-the-loop optimization. The comprehensive online documentation introduces Bayesian optimization theory and several examples from catalyst synthesis, reaction condition optimization, parameter estimation, and reactor geometry optimization. NEXTorch is open-source and available on GitHub

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Exploring the frontiers of condensed-phase chemistry with a general reactive machine learning potential

Abstract Atomistic simulation has a broad range of applications from drug design to materials discovery. Machine learning interatomic potentials (MLIPs) have become an efficient alternative to computationally expensive ab initio simulations. For this reason, chemistry and materials science would greatly benefit from a general reactive MLIP, that is, an MLIP that is applicable to a broad range of reactive chemistry without the need for refitting. Here we develop a general reactive MLIP (ANI-1xnr) through automated sampling of condensed-phase reactions. ANI-1xnr is then applied to study five distinct systems: carbon solid-phase nucleation, graphene ring formation from acetylene, biofuel additives, combustion of methane and the spontaneous formation of glycine from early earth small molecules. In all studies, ANI-1xnr closely matches experiment (when available) and/or previous studies using traditional model chemistry methods. As such, ANI-1xnr proves to be a highly general reactive MLIP for C, H, N and O elements in the condensed phase, enabling high-throughput in silico reactive chemistry experimentation.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Neural network representations of multiphase Equations of State

Abstract Equations of State model relations between thermodynamic variables and are ubiquitous in scientific modelling, appearing in modern day applications ranging from Astrophysics to Climate Science. The three desired properties of a general Equation of State model are adherence to the Laws of Thermodynamics, incorporation of phase transitions, and multiscale accuracy. Analytic models that adhere to all three are hard to develop and cumbersome to work with, often resulting in sacrificing one of these elements for the sake of efficiency. In this work, two deep-learning methods are proposed that provably satisfy the first and second conditions on a large-enough region of thermodynamic variable space. The first is based on learning the generating function (thermodynamic potential) while the second is based on structure-preserving, symplectic neural networks, respectively allowing modifications near or on phase transition regions. They can be used either “from scratch” to learn a full Equation of State, or in conjunction with a pre-existing consistent model, functioning as a modification that better adheres to experimental data. We formulate the theory and provide several computational examples to justify both approaches, highlighting their advantages and shortcomings.

Science & Technology - Other Topics↗
DOE OSTI2016

Adaptive Sequential Monte Carlo for Multiple Changepoint Analysis

Process monitoring and control requires detection of structural changes in a data stream in real time. This paper introduces an efficient sequential Monte Carlo algorithm designed for learning unknown changepoints in continuous time. The method is intuitively simple: new changepoints for the latest window of data are proposed by conditioning only on data observed since the most recent estimated changepoint, as these observations carry most of the information about the current state of the process. The proposed method shows improved performance over the current state of the art. Another advantage of the proposed algorithm is that it can be made adaptive, varying the number of particles according to the apparent local complexity of the target changepoint probability distribution. This saves valuable computing time when changes in the changepoint distribution are negligible, and enables re-balancing of the importance weights of existing particles when a significant change in the target distribution is encountered. The plain and adaptive versions of the method are illustrated using the canonical continuous time changepoint problem of inferring the intensity of an inhomogeneous Poisson process, although the method is generally applicable to any changepoint problem. Performance is demonstrated using both conjugate and non-conjugate Bayesian models for the intensity. Lastly, appendices to the article are available online, illustrating the method on other models and applications.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2019

Layer dependence of graphene-diamene phase transition in epitaxial and exfoliated few-layer graphene using machine learning

The study of the nanomechanics of graphene—and other 2D materials—has led to the discovery of exciting new properties in 2D crystals, such as their remarkable in-plane stiffness and out of plane flexibility, as well as their unique frictional and wear properties at the nanoscale. Recently, nanomechanics of graphene has generated renovated interest for new findings on the pressure-induced chemical transformation of a few-layer thick epitaxial graphene into a new ultra-hard carbon phase, named diamene. Here in this work, by means of a machine learning technique, we provide a fast and efficient tool for identification of graphene domains (areas with a defined number of layers) in epitaxial and exfoliated films, by combining data from atomic force microscopy (AFM) topography and friction force microscopy (FFM). Through the analysis of the number of graphene layers and detailed Å-indentation experiments, we demonstrate that the formation of ultra-stiff diamene is exclusively found in 1-layer plus buffer layer epitaxial graphene on silicon carbide (SiC) and that an ultra-stiff phase is not observed in neither thicker epitaxial graphene (2-layer or more) nor exfoliated graphene films of any thickness on silicon oxide (SiO 2 ).

36 MATERIALS SCIENCE↗
DOE OSTI2024

Circumventing data imbalance in magnetic ground state data for magnetic moment predictions

Abstract Magnetic materials play a crucial role in the transition to more sustainable forms of energy and electric vehicles. There is an anticipated shortage in magnetic materials in the future, and as a result there is an urgent need to discover and design new magnetic materials. Computational magnetic material design using density functional theory is daunting because of the challenge in identifying magnetic ground states from a combinatorially large set of possibilities. Machine learning offers a path forward by enabling efficient surrogate models that can more readily enumerate these states, but there is a dearth of training data available, and what is available tends to be imbalanced with too much non-magnetic data. In this work we show that the discrete and previously tackled data imbalance that exists at the level of the magnetic ordering leads to an imbalanced continuous distribution with many zeros when the data is unraveled at the atomic magnetic moment level, which subsequently leads to models with low accuracy for magnetic properties. We mitigate this by using a two-part model framework. Our scheme is able to classify atoms into magnetic and non-magnetic with an F1 score and Matthew’s correlation coefficient (MCC) of ~91% and then to provide an implicit embedding representation that maps directly onto the magnitude of the magnetic moment with a mean absolute error of 0.1 μ B . Beyond screening for new magnetic materials, we demonstrate an additional practical use case of our scheme: the provision of good initial guesses for magnetic moments in first-principles electronic relaxations. Such initialization is shown to lead to faster convergence to configurations that lie closer to the ground state.

Computer Science↗
DOE OSTI2025

Enhancing Automotive Intrusion Detection Through Multi-Modal Fusion: A CAN FD-LiDAR Approach

As vehicles become smarter and more autonomous, they increasingly depend on advanced sensors and communication technologies to operate securely. However, such growing dependence on technology—whether it’s CAN (Controller Area Network) for internal communication or LiDAR (Light Detection and Ranging) for sensing the world around them—also expands the attack surface for the types of cyber attacks. Traditional intrusion detection systems (IDS) typically monitor these systems in isolation, limiting their ability to detect sophisticated, crosssystem attacks. To address this, we propose a multi-modal fusion approach that combines real-world CAN FD signals (from the HCRL dataset) with LiDAR features (from the nuScenes dataset) to enhance attack detection. Our method employs a twostage ensemble approach. Calibrated XGBoost and LightGBM models initially process CAN FD (Fuzzing Data) and LiDAR data independently, detecting timing anomalies and space abnormalities. They are subsequently logarithmically combined with a logistic regression meta-model along with 17 engineered features capturing cross-modal behavior, prediction conflicts, and nonlinear interactions. This approach achieves an AUC of 0.87 and an F1-score of 0.82, surpassing single-modality baselines and early fusion methods, at merely 2 ms inference latency. Compared with deep learning competitors, it is 3 times more efficient, providing a lightweight, interpretable, and real time solution to automotive cybersecurity.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2016

MO-FG-BRC-00: Joint AAPM-ESTRO Symposium: Advances in Experimental Medical Physics

Experimental research in medical physics has expanded the limits of our knowledge and provided novel imaging and therapy technologies for patients around the world. However, experimental efforts are challenging due to constraints in funding, space, time and other forms of institutional support. In this joint ESTRO-AAPM symposium, four exciting experimental projects from four different countries are highlighted. Each project is focused on a different aspect of radiation therapy. From the USA, we will hear about a new linear accelerator concept for more compact and efficient therapy devices. From Canada, we will learn about novel linear accelerator target design and the implications for imaging and therapy. From France, we will discover a mature translational effort to incorporate theranostic nanoparticles in MR-guided radiation therapy. From Germany, we will find out about a novel in-treatment imaging modality for particle therapy. These examples of high impact, experimental medical physics research are representative of the diversity of such efforts that are on-going around the globe. J. Robar, Research is supported through collaboration with Varian Medical Systems and Brainlab AGD. Westerly, This work is supported by the Department of Radiation Oncology at the University of Colorado School of Medicine. COI: NONEK. Parodi, Part of the presented work is supported by the DFG (German Research Foundation) Cluster of Excellence MAP (Munich-Centre for Advanced Photonics) and has been carried out in collaboration with IBA.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2016

MO-FG-BRC-01: MR-Guided Radiation Therapy with Gadolinium Nanoparticles: From Chalkboard to First Clinical Trials

Experimental research in medical physics has expanded the limits of our knowledge and provided novel imaging and therapy technologies for patients around the world. However, experimental efforts are challenging due to constraints in funding, space, time and other forms of institutional support. In this joint ESTRO-AAPM symposium, four exciting experimental projects from four different countries are highlighted. Each project is focused on a different aspect of radiation therapy. From the USA, we will hear about a new linear accelerator concept for more compact and efficient therapy devices. From Canada, we will learn about novel linear accelerator target design and the implications for imaging and therapy. From France, we will discover a mature translational effort to incorporate theranostic nanoparticles in MR-guided radiation therapy. From Germany, we will find out about a novel in-treatment imaging modality for particle therapy. These examples of high impact, experimental medical physics research are representative of the diversity of such efforts that are on-going around the globe. J. Robar, Research is supported through collaboration with Varian Medical Systems and Brainlab AGD. Westerly, This work is supported by the Department of Radiation Oncology at the University of Colorado School of Medicine. COI: NONEK. Parodi, Part of the presented work is supported by the DFG (German Research Foundation) Cluster of Excellence MAP (Munich-Centre for Advanced Photonics) and has been carried out in collaboration with IBA.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2016

MO-FG-BRC-02: Low-Z Switching Linear Accelerator Targets: New Options for Image Guidance and Dose Enhancement in Radiotherapy

Experimental research in medical physics has expanded the limits of our knowledge and provided novel imaging and therapy technologies for patients around the world. However, experimental efforts are challenging due to constraints in funding, space, time and other forms of institutional support. In this joint ESTRO-AAPM symposium, four exciting experimental projects from four different countries are highlighted. Each project is focused on a different aspect of radiation therapy. From the USA, we will hear about a new linear accelerator concept for more compact and efficient therapy devices. From Canada, we will learn about novel linear accelerator target design and the implications for imaging and therapy. From France, we will discover a mature translational effort to incorporate theranostic nanoparticles in MR-guided radiation therapy. From Germany, we will find out about a novel in-treatment imaging modality for particle therapy. These examples of high impact, experimental medical physics research are representative of the diversity of such efforts that are on-going around the globe. J. Robar, Research is supported through collaboration with Varian Medical Systems and Brainlab AGD. Westerly, This work is supported by the Department of Radiation Oncology at the University of Colorado School of Medicine. COI: NONEK. Parodi, Part of the presented work is supported by the DFG (German Research Foundation) Cluster of Excellence MAP (Munich-Centre for Advanced Photonics) and has been carried out in collaboration with IBA.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2016

MO-FG-BRC-03: Design and Construction of a Dielectiric Wall Accelerator

Experimental research in medical physics has expanded the limits of our knowledge and provided novel imaging and therapy technologies for patients around the world. However, experimental efforts are challenging due to constraints in funding, space, time and other forms of institutional support. In this joint ESTRO-AAPM symposium, four exciting experimental projects from four different countries are highlighted. Each project is focused on a different aspect of radiation therapy. From the USA, we will hear about a new linear accelerator concept for more compact and efficient therapy devices. From Canada, we will learn about novel linear accelerator target design and the implications for imaging and therapy. From France, we will discover a mature translational effort to incorporate theranostic nanoparticles in MR-guided radiation therapy. From Germany, we will find out about a novel in-treatment imaging modality for particle therapy. These examples of high impact, experimental medical physics research are representative of the diversity of such efforts that are on-going around the globe. J. Robar, Research is supported through collaboration with Varian Medical Systems and Brainlab AGD. Westerly, This work is supported by the Department of Radiation Oncology at the University of Colorado School of Medicine. COI: NONEK. Parodi, Part of the presented work is supported by the DFG (German Research Foundation) Cluster of Excellence MAP (Munich-Centre for Advanced Photonics) and has been carried out in collaboration with IBA.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2016

MO-FG-BRC-04: Ionacoustic Imaging for Particle Range Verification

Experimental research in medical physics has expanded the limits of our knowledge and provided novel imaging and therapy technologies for patients around the world. However, experimental efforts are challenging due to constraints in funding, space, time and other forms of institutional support. In this joint ESTRO-AAPM symposium, four exciting experimental projects from four different countries are highlighted. Each project is focused on a different aspect of radiation therapy. From the USA, we will hear about a new linear accelerator concept for more compact and efficient therapy devices. From Canada, we will learn about novel linear accelerator target design and the implications for imaging and therapy. From France, we will discover a mature translational effort to incorporate theranostic nanoparticles in MR-guided radiation therapy. From Germany, we will find out about a novel in-treatment imaging modality for particle therapy. These examples of high impact, experimental medical physics research are representative of the diversity of such efforts that are on-going around the globe. J. Robar, Research is supported through collaboration with Varian Medical Systems and Brainlab AGD. Westerly, This work is supported by the Department of Radiation Oncology at the University of Colorado School of Medicine. COI: NONEK. Parodi, Part of the presented work is supported by the DFG (German Research Foundation) Cluster of Excellence MAP (Munich-Centre for Advanced Photonics) and has been carried out in collaboration with IBA.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2024

Avian Activity Classification Using Recurrent Networks to Fuse Videos with Metadata on Imbalanced Datasets

Activity classification plays a crucial role in various real-life scenarios involving both humans and animals. There is an increasing need for precise activity classification focused on avian-solar interactions, as the usage of solar energy facilities, such as photovoltaic array power stations, has been observed to impact bird species richness, behavior, and activity. However, there has been no work to develop an automated system to monitor and classify these avian-solar interactions. All current methods rely on human observers, which is time and human resources costly and subject to errors related to searcher efficiency. With the recent success of Deep Learning models in activity classification problems, this paper develops a recurrent neural network-based model to automatically classify six avian activities around solar energy facilities. Our proposed model integrates critical feature engineering metadata with video frame data, enabling improved learning and more accurate activity classification. Furthermore, we address the challenge of data imbalance during training and demonstrate the efficacy of our model in detecting and classifying different activities within video tracks. Additionally, we analyze the saliency/backpropagation map of the trained proposed model and validate its decision-making rationale.

Avian activity classification; bidirectional LSTM;↗