Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “learning rate”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 685 records · Page 38
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

FeederGAN: Synthetic Feeder Generation via Deep Graph Adversarial Nets

This paper presents a novel, automated, generative adversarial networks (GAN) based synthetic feeder generation mechanism, abbreviated as FeederGAN. FeederGAN digests real feeder models represented by directed graphs via a deep learning framework powered by GAN and graph convolutional networks (GCN). Information of a distribution feeder circuit is extracted from its model input files so that the device connectivity is mapped onto the adjacency matrix and the device characteristics, such as circuit types (i.e., 3-phase, 2-phase, and 1-phase) and component attributes (e.g., length and current ratings), are mapped onto the attribute matrix. Then, Wasserstein distance is used to optimize the GAN and GCN is used to discriminate the generated graphs from the actual ones. A greedy method based on graph theory is developed to reconstruct the feeder using the generated adjacency and attribute matrices. Furthermore, our results show that the GAN generated feeders resemble the actual feeder in both topology and attributes verified by visual inspection and by empirical statistics obtained from actual distribution feeders.

42 ENGINEERING↗
DOE OSTI2021

Machine-Learned Manifold-Based Models for Large Eddy Simulation of Turbulent Combustion

Reduced-order manifold combustion models are commonly used to lower the cost of reacting Large Eddy Simulations (LES) and may be derived either from physical principles as in flamelet models or from data-driven methods like Principal Component Analysis (PCA). In either case, neural networks are increasingly used as part of these models to provide a nonlinear mapping between a small set of pre-defined variables that parameterize the manifold and outputs of interest, such as reaction rates. In this work, we propose a new manifold-based modeling approach that combines the definition of the manifold-parameterizing variables (linear combinations of species), the nonlinear mapping to the outputs, and closure of filtered quantities for LES into the structure of a single neural network. This allows the process used to train the neural network to simultaneously optimize both the functional form of the model and the identities of the inputs to the model. The new approach can flexibly incorporate thermochemical data from any combustion system; if trained on data from 1D flames it can be interpreted as an optimized flamelet model, but it can also be used to learn models from data from more complex configurations. This work presents a priori evaluations of the new approach in both contexts. Evaluation using data from 1D premixed flames demonstrates the physical interpretability of the manifold variables generated by the new approach. Evaluation using data from direct numerical simulations of turbulent flames shows improved predictions relative to either flamelet or PCA-based models in a more complex configuration.

47 OTHER INSTRUMENTATION↗
DOE OSTI2025

Radiative forcing from the 2020 shipping fuel regulation is large but hard to detect

Reduction in aerosol cooling unmasks greenhouse gas warming, exacerbating the rate of future warming. The strict sulfur regulation on shipping fuel implemented in 2020 (IMO2020) presents an opportunity to assess the potential impacts of such emission regulations and the detectability of deliberate aerosol perturbations for climate intervention. Here we employ machine learning to capture cloud natural variability and estimate a radiative forcing of +0.074 ±0.005 W m -2 related to IMO2020 associated with changes in shortwave cloud radiative effect over three low-cloud regions where shipping routes prevail. We find low detectability of the cloud radiative effect of this event, attributed to strong natural variability in cloud albedo and cloud cover. Regionally, detectability is higher for the southeastern Atlantic stratocumulus deck. These results raise concerns that future reductions in aerosol emissions will accelerate warming and that proposed deliberate aerosol perturbations such as marine cloud brightening will need to be substantial in order to overcome the low detectability.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Trainability of ReLU networks and Data-dependent Initialization

Here, in this paper, we study the trainability of rectified linear unit (ReLU) networks at initialization. A ReLU neuron is said to be dead if it only outputs a constant for any input. Two death states of neurons are introduced–tentative and permanent death. A network is then said to be trainable if the number of permanently dead neurons is sufficiently small for a learning task. We refer to the probability of a randomly initialized network being trainable as trainability. We show that a network being trainable is a necessary condition for successful training, and the trainability serves as an upper bound of training success rates. In order to quantify the trainability, we study the probability distribution of the number of active neurons at initialization. In many applications, overspecified or overparameterized neural networks are successfully employed and shown to be trained effectively. With the notion of trainability, we show that overparameterization is both a necessary and a sufficient condition for achieving a zero training loss. Furthermore, we propose a data-dependent initialization method in an overparameterized setting. Numerical examples are provided to demonstrate the effectiveness of the method and our theoretical findings.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Predicting and Controlling Corrosion (Abbreviated Final Report)

Corrosion accumulates significant replacement costs in the transportation, utility, manufacturing, and infrastructure sectors. It also underpins several of LLNL’s core missions in stockpile stewardship, defense, and energy security. Whereas most corrosion and aging models are empirically parameterized to describe well-defined conditions late in the reaction, the factors that determine the early stages of corrosion—during which mitigation could be most impactful— are poorly understood. This project addressed the critical need for new approaches to predict the kinetics of corrosion initiation based on firm physical and chemical understanding. The activities encompassed degradation of relevant metals in both hydrogen-rich and environmental corrosion scenarios. The team integrated state-of-the-art multiscale simulation, in situ characterization, and data science within three technical thrusts: hydriding of Ti alloys; aqueous corrosion of Al and Ni-Cr alloys; and degradation of additively manufactured 316L stainless steel. In each case, novel capabilities were developed to identify and track the impacts of key atomistic, compositional, and microstructural features on the metal systems. For hydriding, protocols were developed to tightly integrate multiscale models, advanced multimodal characterization, and machine learning to determine how hydrogen interacts with native passivating surface oxides and nucleates new undesired phases, shedding new light on the critical role of grain boundaries, interfaces, and atomically disordered regions. For aqueous corrosion, the project demonstrated methods to predict dissolution rates of metal surfaces in corrosive solutions, to measure and understand microstructural and grain orientation effects on corrosion susceptibility, and to investigate competing growth and dissolution kinetics of surface oxides. For additively manufactured metals, analysis using state-of-the-art microscopy techniques revealed the role of specific heterogeneities invoked during laser processing, including cellular structure, dislocations, and precipitates, on corrosion susceptibility. In addition to new capabilities and understanding, the project provided an avenue for workforce development, as well as key partnerships with stakeholders in corrosion science.

08 HYDROGEN↗
DOE OSTI2024

EV Champion Training Webinar 1: ZEV and EV Charging Fundamentals [Slides]

The Electric Vehicle (EV) Champion Training Series, hosted by the National Renewable Energy Laboratory (NREL), is tailored for fleet managers, facility managers, and other stakeholders involved in the deployment of EVs and charging stations. This series equips participants with the skills and knowledge necessary to become subject matter experts in EV implementation. This is the first training in a four-part series and serves as an introductory training. This training covers fundamental topics such as EV and charging technology, utility basics, and financial considerations for EVs. Additionally, this session introduces the Federal Fleet ZEV Ready Center framework, a one-stop location for federal fleet electrification resources. Participants will gain a solid foundation to support the effective deployment and management of EVs and their infrastructure. Visit the Federal Fleet ZEV Ready Center website to learn more about the ZEV Ready Center process. EV Champion Training Webinar 1: ZEV and EV Charging Fundamentals will enable attendees to: Identify EV and EV charging technology fundamentals; Recognize EV market and GSA Schedule options; Identify utility basics, incentives, and rates as they relate to EV charging; and Identify methods to calculate life cycle costs for EVs and gasoline vehicles.

30 DIRECT ENERGY CONVERSION↗
DOE OSTI2026

Interpretable Deep Learning for Advancing Field-Enhanced Catalysis

This DOE Early Career project developed a physics-informed, interpretable AI-and-modeling framework to understand and exploit electric-field effects in heterogeneous catalysis, with ammonia cracking and synthesis as a representative pathway. The team built and validated methods to map local electric fields on metal surfaces and nanoparticles, showing that low-coordination features (tips/edges/corners) can concentrate fields by several-fold relative to flat facets. Using DFT-generated datasets, the project created physics-guided machine learning models that rapidly predict local electric fields and field-dependent adsorption energetics with near-DFT accuracy while reducing computational cost by orders of magnitude. These predictions were integrated with microkinetic modeling to quantify how field-dipole interactions reshape reaction energetics and mechanisms, enabling large increases in predicted catalytic rates and substantial reductions in operating temperature under favorable field conditions. To accelerate discovery of earth-abundant catalysts, the project combined interpretable ML screening (with electronic-structure descriptors identified as key drivers) with a generative inverse-design workflow based on diffusion models and physics constraints. The resulting closed-loop approach, linking simulation, mechanistic modeling, and AI, provides reusable tools and datasets for designing catalysts and operating conditions in field-enhanced catalysis, with broad relevance to electrostatic catalysis, plasma catalysis, electrocatalysis, and other energy-related chemical transformations.

30 DIRECT ENERGY CONVERSION↗
DOE OSTI2025

Projected increases in tropical cyclone-induced U.S. electric power outage risk

Abstract While power outages caused by tropical cyclones (TCs) already pose a great threat to coastal communities, how—and why—these risks will change in a warming climate is poorly understood. To address this need, we develop a robust machine learning model to capture TC-induced power outage risk. When applied to 900 000 synthetic TCs downscaled from simulated historical and future climate conditions under a strong warming scenario, we find outage risk in the United States and Puerto Rico is expected to increase broadly by the end of the century, with some states seeing increases of 60% and higher. Further, we discover that rising rainfall rates will play an increasingly important role in TC-induced power outage risk as the climate changes, explaining more than 50% of the projected change in risk in some regions. These insights are important for guiding decision-makers in their future outage risk investment and mitigation plans.

Grid Resilience↗
DOE OSTI2021

Chapter 4: What We Can Learn from Measuring Metabolic Fluxes in Cyanobacteria

Cyanobacteria with the capability of oxygen-evolving photosynthesis play a vital role in the global carbon, oxygen, and nitrogen cycles. From a biochemical perspective, all phenotypic traits and functions of cyanobacteria are derived from the potential of their metabolism and mirrored in metabolic fluxes through an integrated metabolic network. Metabolic flux, the rate of turnover of molecules through a metabolic pathway, is therefore of great importance for an in-depth understanding of the role of cyanobacteria in the biosphere. Recent interest in cyanobacteria metabolic fluxes is also motivated by the prospect to utilize their light-driven CO2 fixation for sustainable production of valuable chemicals and biofuels. Valorization of cyanobacterial metabolism will require engineering of the native metabolic network - a challenge that can benefit from a quantitative understanding of metabolic reactions taking place intracellularly. In this chapter, we will discuss some intriguing questions relevant to metabolic fluxes in cyanobacteria: How are metabolic fluxes predicted or measured? What do we know about the fluxome inside various cyanobacteria thus far? How are they different between strains as well as in different conditions? And how can we use fluxomics information to guide metabolic engineering and synthetic biology? This chapter will highlight updated knowledge on cyanobacterial metabolism. Specifically, we will focus on providing readers a quantitative vision to understand how this photosynthetic model works.

BASIC BIOLOGICAL SCIENCES,INORGANIC, ORGANIC, PHYS↗
DOE OSTI2020

The Spatiotemporal Evolution of Granular Microslip Precursors to Laboratory Earthquakes

Laboratory earthquake experiments provide important observational constraints for our understanding of earthquake physics. Here we leverage continuous waveform data from a network of piezoceramic sensors to study the spatial and temporal evolution of microslip activity during a shear experiment with synthetic fault gouge. We combine machine learning techniques with ray theoretical seismology to detect, associate, and locate tens of thousands of microslip events within the gouge layer. Microslip activity is concentrated near the center of the system but is highly variable in space and time. While microslip activity rate increases as failure approaches, the spatiotemporal evolution can differ substantially between stick-slip cycles. These results illustrate that even within a single, well-constrained laboratory experiment, the dynamics of earthquake nucleation can be highly complex.

58 GEOSCIENCES↗
DOE OSTI2025

Dynamic in-context learning with conversational models for data extraction and materials property prediction

The advent of natural language processing and large language models (LLMs) has revolutionized the extraction of data from unstructured scholarly papers. However, ensuring data trustworthiness remains a significant challenge. In this paper, we introduce PropertyExtractor, an open-source tool that leverages advanced conversational LLMs such as Google gemini-pro and OpenAI gpt-4, blends zero-shot with few-shot in-context learning, and employs engineered prompts for the dynamic refinement of structured information hierarchies—enabling autonomous, efficient, scalable, and accurate identification, extraction, and verification of material property data. Our tests on material data demonstrate precision and recall that exceed 95% with an error rate of ∼9%, highlighting the effectiveness and versatility of the toolkit. Finally, databases for 2D material thicknesses, a critical parameter for device integration, and energy bandgap values are developed using PropertyExtractor. In particular, for the thickness database, the rapid evolution of the field has outpaced both experimental measurements and computational methods, creating a significant data gap. Our work addresses this gap and showcases the potential of PropertyExtractor as a reliable and efficient tool for the autonomous generation of various material property databases, advancing the field.

Ekuma, Chinedu E. (ORCID:0000000258527556)↗
DOE OSTI2022

Performance Evaluations of Noisy Approximate Quantum Fourier Arithmetic

The Quantum Fourier Transform (QFT) grants competitive advantages, especially in resource usage and circuit approximation, for performing arithmetic operations on quantum computers, and offers a potential route towards a numerical quantum-computational paradigm. In this paper, we utilize efficient techniques to implement QFT-based integer addition and multiplications. These operations are fundamental to various quantum applications including Shor’s algorithm, weighted sum optimization problems in data processing and machine learning and quantum algorithms requiring inner products. We carry out performance evaluations of these implementations based on IBM’s superconducting qubit architecture using different compatible noise models. We isolate the sensitivity of the component quantum circuits on both one-/two-qubit gate error rates, and the number of the arithmetic operands’ superposed integer states. We analyze performance, and identify the most effective approximation depths for quantum add and quantum multiply within the given context. We observe significant dependency of the optimal approximation depth on the degree of machine noise and the number of superposed states in certain performance regimes. Finally, we elaborate on the algorithmic challenges - relevant to signed, unsigned, modular and non-modular versions - that could also be applied to current implementations of QFT-based subtraction, division, exponentiation, and their potential tensor extensions. Here, we analyze performance trends in our results and speculate on possible future development within this computational paradigm.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Addressing the Split Incentive Challenge for Enhanced Solar Adoption in Multifamily Rental Properties [Abstract]

The split incentive problem is particularly pronounced in rental markets, where landlords prioritize investments that directly increase property value or rental income. Since energy savings from solar photovoltaic (PV) systems primarily benefit tenants, landlords may perceive little return on investment unless mechanisms exist to recapture some of the financial gains. The primary objective of this project is to develop a publicly available, web-based tool to analyze the U.S. Department of Energy’s ResStock database, which models the U.S. residential building stock. The tool allows users to filter buildings by location, type, HVAC system, square footage, and other characteristics, and outputs typical electric load profiles. By leveraging location-specific electric load data, Fram Energy aims to advance business strategies that address the split incentive barrier and promote the adoption of solar PV installations in rental properties. In addition, a machine learning model will be developed to weigh the marginal contribution of building features across the dataset in predicting electricity demand, supporting guided decision making in forecasting electric load profiles. Lastly, based on each building’s location, load profile, and utility’s electricity rate, an optimized solar photovoltaic array and battery energy storage system will be sized to provide energy arbitrage opportunities.

14 SOLAR ENERGY↗
DOE OSTI2024

Depot Charging Schedule Optimization for Medium- and Heavy-Duty Battery-Electric Trucks

Charge management, which lowers charging costs for fleets and prevents straining the electrical grid, is critical to the successful deployment of medium- and heavy-duty battery-electric trucks (MHD BETs). This study introduces an energy demand and cost management framework that optimizes depot charging for MHD BETs by combining an energy consumption machine learning model and a linear program optimization model. The framework considers key factors impacting real-world MHD BET operations, including vehicle and charger configurations, duty cycles, use cases, geographic and climate conditions, operation schedules, and utilities’ time-of-use (TOU) rates and demand charges. The framework was applied to a hypothetical fleet of 100 MHD BETs in California under three different utilities for 365 days, with results compared to unmanaged charging. The optimized charging solution avoided more than 90% of on-peak charging, reduced fleet charging peak load by 64–75%, and lowered fleet energy variable costs by 54–64%. This study concluded that the proposed charge management framework significantly reduces energy costs and peak loads for MHD BET fleets while making recommendations for fleet electrification infrastructure planning and the design of utility TOU rates and demand charges.

Song, Shuhan↗
DOE OSTI2023

Battery Charge Curve Prediction via Feature Extraction and Supervised Machine Learning

Real-time onboard state monitoring and estimation of a battery over its lifetime is indispensable for the safe and durable operation of battery-powered devices. In this study, a methodology to predict the entire constant-current cycling curve with limited input information that can be collected in a short period of time is developed. A total of 10 066 charge curves of LiNiO 2 -based batteries at a constant C-rate are collected. With the combination of a feature extraction step and a multiple linear regression step, the method can accurately predict an entire battery charge curve with an error of < 2% using only 10% of the charge curve as the input information. The method is further validated across other battery chemistries (LiCoO 2 -based) using open-access datasets. The prediction error of the charge curves for the LiCoO 2 -based battery is around 2% with only 5% of the charge curve as the input information, indicating the generalization of the developed methodology for predicting battery cycling curves. The developed method paves the way for fast onboard health status monitoring and estimation for batteries during practical applications.

25 ENERGY STORAGE↗
DOE OSTI2025

A hybrid neural architecture: Online attosecond x-ray characterization

The emergence of high-repetition-rate x-ray free-electron lasers (XFELs), such as SLAC’s LCLS-II, serves as our canonical example for autonomous controls that necessitate high-throughput diagnostics paired with streaming computational pipelines capable of single-shot analysis with extremely low latency. We present the deterministic characterization with an integrated parallelizable hybrid resolver architecture, a hybrid machine learning framework designed for fast, accurate analysis of XFEL diagnostics using angular streaking-based sinogram images. This architecture integrates convolutional neural networks and bidirectional long short-term memory models to denoise input, identify x-ray sub-spike features, and extract sub-spike relative delays with sub-30 attosecond temporal resolution. Deployed on low-latency hardware, it achieves over 10 kHz throughput with 168.3 μs inference latency, indicating scalability to 14 kHz with field-programmable gate array integration. By transforming regression tasks into classification problems and leveraging optimized error encoding, we achieve high precision with low-latency performance that is critical for real-time streaming event selection and experimental control feedback signals. This represents a key development in real-time control pipelines for next-generation autonomous science, generally, and high repetition-rate x-ray experiments in particular.

Accelerator Physics (physics.acc-ph)↗
DOE OSTI2026

The Hydropower Game: An Interactive Learning Tool for the Future Hydropower Workforce

This report documents a Seedling project supported by the U.S. Department of Energy (DOE) Water Power Technologies Office (WPTO), conducted by Argonne National Laboratory (ANL) and the National Laboratory of the Rockies (NLR). The Seedling and Sapling Program provides small grants over short duration to enable early-stage research at national laboratories. This funding mechanism is intended to cultivate innovative ideas and expand research road maps in hydropower and marine energy technologies. Under this Seedling award, the project team developed an educational outreach tool, or “serious game”, built in Python and powered by the Pygame library, aimed at teaching fundamental hydropower concepts through an engaging, interactive learning experience. The game features multiple lessons covering several hydropower topics while allowing for expansion and customization in the instance of future funding availability: • Hydropower Plant Types: Players explore and compare the mechanics and applications of run-of-river, dam hydropower, and pumped-storage hydropower. • Flow Dynamics and Power Generation: Interactive tasks demonstrate how release rate and hydraulic head combine to determine power output. • Grid Operations and Load Following: Simulations illustrate how hydropower facilities respond to fluctuating electricity demand to balance the grid. • Market Integration: Levels scaffold understanding of how hydropower interfaces with the broader energy market, including operational and economic considerations. The tool was showcased at several science, technology, engineering, and mathematics (STEM) outreach events, where it was demoed to students, educators, and the general public. These events provided valuable opportunities to collect feedback on the gameplay, storyline, and educational objectives from a wide audience. The game was presented at STEMapalooza, Introduce a Girl to Engineering Day, STEMCON, and Clean Currents 2025. Insights gathered during these demonstrations informed refinements to the game’s user experience and strengthened its effectiveness as an educational tool for teaching hydropower concepts. This report outlines the game’s design philosophy, educational objectives, technical implementation, user experience insights, and potential for broader deployment within educational and workforce development contexts. It emphasizes how gamified learning can demystify complex hydropower science and inspire interest in water-power technologies. The project’s success demonstrates the value of Seedling funding in fostering creative, lowcost educational tools that support DOE’s mission to advance energy literacy and innovation. The report concludes with recommendations for expanding the tool by adding new levels, integrating assessment metrics, and exploring commercialization or deployment pathways through future Sapling funding. The official webpage of the Hydropower Game, which includes a link to the educational tool, can be accessed at www.anl.gov/hydropower/hydropower-game.

13 HYDRO ENERGY↗
DOE OSTI2022

Time-series forecasting using manifold learning, radial basis function interpolation, and geometric harmonics

We address a three-tier numerical framework based on nonlinear manifold learning for the forecasting of high-dimensional time series, relaxing the “curse of dimensionality” related to the training phase of surrogate/machine learning models. At the first step, we embed the high-dimensional time series into a reduced low-dimensional space using nonlinear manifold learning (local linear embedding and parsimonious diffusion maps). Then, we construct reduced-order surrogate models on the manifold (here, for our illustrations, we used multivariate autoregressive and Gaussian process regression models) to forecast the embedded dynamics. Finally, we solve the pre-image problem, thus lifting the embedded time series back to the original high-dimensional space using radial basis function interpolation and geometric harmonics. The proposed numerical data-driven scheme can also be applied as a reduced-order model procedure for the numerical solution/propagation of the (transient) dynamics of partial differential equations (PDEs). In conclusion, we assess the performance of the proposed scheme via three different families of problems: (a) the forecasting of synthetic time series generated by three simplistic linear and weakly nonlinear stochastic models resembling electroencephalography signals, (b) the prediction/propagation of the solution profiles of a linear parabolic PDE and the Brusselator model (a set of two nonlinear parabolic PDEs), and (c) the forecasting of a real-world data set containing daily time series of ten key foreign exchange rates spanning the time period 3 September 2001–29 October 2020.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗