Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “modeling and optimization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Neural architecture codesign for fast physics applications

We develop a pipeline to streamline neural architecture codesign for physics applications to reduce the need for ML expertise when designing models for novel tasks. Our method employs neural architecture search and network compression in a two-stage approach to discover hardware efficient models. This approach consists of a global search stage that explores a wide range of architectures while considering hardware constraints, followed by a local search stage that fine-tunes and compresses the most promising candidates. We exceed performance on various tasks and show further speedup through model compression techniques such as quantization-aware-training and neural network pruning. We synthesize the optimal models to high level synthesis code for FPGA deployment with the hls4ml library. Additionally, our hierarchical search space provides greater flexibility in optimization, which can easily extend to other tasks and domains. We demonstrate this with two case studies: Bragg peak finding in materials science and jet classification in high energy physics, achieving models with improved accuracy, smaller latencies, or reduced resource utilization relative to the baseline models.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2024

CI-MOR Final Report: Analysis and Validation of Critical Infrastructure Models using Model Order Reduction

This report summarizes the research and capabilities developed as part of the project “Analysis and Validation of Critical Infrastructure Models using Model Order Reduction” (CI-MOR) LDRD project. CI-MOR research enables the solution of large, complex optimization models that naturally arise in national security challenges involving critical infrastructures. Specifically, CI-MOR researchers developed methods to (1) rigorously approximate complex, nonlinear optimization formulations, (2) identify alternative near-optimal solutions, (3) accelerate optimization workflows used for complex applications, and (4) rigorously integrate domain knowledge in stochastic-process models. This report provides an overview of the research done in CI-MOR, and we describe application exemplars used to illustrate CI-MOR capabilities. Furthermore, we describe the software developed by CI-MOR that researchers can leverage to analyze new applications.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Hydropower operation in future power grid with various renewable power integration

Hydropower generation may play an increasingly important role in the power grid under increasing contribution of variable renewable sources such as wind and solar. An improved understanding of the changes to hydropower dispatch under future higher VRE grid conditions reveals research gap that should be informed power grid planning and reservoir water releases policies considering multiple other water uses and varying hydrologic condition. Here this study aims to understand the role of hydropower in a changing power grid by employing a production cost model, PLEXOS, across future power system scenarios, planning horizons, and regions. We explore optimized hydropower dispatch to understand its potential role in minimizing the system cost and renewable curtailment. We also examine the sensitivity of hydropower revenue under various grid scenarios of the Eastern U.S. and hydrology conditions. Results indicate hydropower generation follows net load and compensates for the variability of solar and wind generation. Although energy prices are lower during some periods in the future grid scenarios, there is a potential for higher revenue for hydropower by providing both energy and ancillary services during times of stress. Additionally, hydropower revenue is sensitive to hydrology in the SERC region, which we considered as an example. The feasibility of hydropower dispatching with higher ramps between low and high hourly-capacity factors, as indicated in the optimization model, requires further study to consider other water use and ecology constraints.

13 HYDRO ENERGY↗
DOE OSTI2025

tsSLOPE

This project implements the interface that reads a machine learning (ML) model trained in Python to be used in Julia to inform a JuMP optimization model.

Chiang, Nai Yun [Lawrence Livermore National Labor↗
DOE OSTI2025

A matheuristic for design and dispatch of a utility-connected distributed energy system

Modeling distributed power generation systems often requires complicated mathematical expressions that present challenges for commercial optimization solvers. Here, this paper presents a matheuristic to solve a mixed-integer optimization model that informs decisions regarding the design and dispatch of a utility-connected microgrid. We deploy a genetic algorithm to search the system design space and a linear program to solve the economic dispatch problem. The model is a component of a web tool that requires solutions within a few minutes. Our method yields objective function values within 5% of an exogenously produced optimal in fewer than 30 seconds for 90% of our test cases compared to only 10% of our test cases by a traditional optimization solver in the same amount of time.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

Techno-economic implications and cost of forecasting errors in solar PV power production using optimized deep learning models

Accurate solar Photovoltaic (PV) power forecasting is important for enhancing both the performance and economic feasibility of PV systems. This study evaluates several deep learning models, including Dense Neural Networks (DNN), Long Short-Term Memory (LSTM), Convolutional Neural Networks (CNN), and a hybrid LSTMCNN model, for predicting PV power production one day in advance. Prior to optimization, the models exhibited relatively high errors, with the best model (DNN) achieving a Root Mean Square Error (RMSE) of 31.13 kW and a coefficient of determination (R 2 ) of 62.15 %. After employing Bayesian optimization, the LSTM-CNN model demonstrated the best performance, with the RMSE reduced to 9.79 kW and R 2 improved to 97.62 %, showcasing significant enhancement in predictive accuracy. Here, the economic evaluation considered three cases: rewards for underestimation (0.08 USD/kWh), no rewards, and penalties for both over-and underestimation (120 % of the utility tariff). In the rewards scenario, the LSTM-CNN model reduced the Levelized Cost of Electricity (LCOE) by 4 %, while in the penalty scenario, a backup diesel generator would have increased the LCOE by 49 %. Additionally, the LSTM-CNN model minimized financial losses, achieving the lowest penalties and maximizing net cash flow compared to other models, demonstrating its overall technical and economic superiority.

Deep learning↗
DOE OSTI2026

Phase Picking Beyond Local Distances: Where Waveform Filtering Still Matters for Deep Learning Models

Waveform filtering is a standard step in traditional seismic phase picking but often receives little attention in deep learning workflows, where models are typically trained on raw or minimally processed waveforms. Although this strategy performs well for local events, we show that performance can degrade substantially at regional distances. To address this limitation, we introduce two ways to incorporate multiband-filtered waveforms into deep learning phase pickers. The stacking approach concatenates filtered inputs along the channel dimension, while the branching approach processes each frequency band through a dedicated network branch before feature fusion. Both approaches can substantially improve performance across epicentral distances of 0° to 20°, but their effectiveness depends strongly on the selected frequency bands. Tests with multiple filter banks show that filter-bank design should be treated as part of model optimization rather than as a fixed preprocessing choice. Grad-CAM analysis of the branching model indicates that band importance varies among waveform samples and across training realizations, with only a weak overall preference for the 0.25 to 0.5 Hz band. These results show that no single filter band is consistently optimal and demonstrate that explicit feature engineering remains valuable for robust deep learning-based seismic phase picking.

58 GEOSCIENCES↗
DOE OSTI2020

Integrating Electric Vehicle Charging Infrastructure into Commercial Buildings and Mixed-Use Communities: Design, Modeling, and Control Optimization Opportunities: Preprint

This paper discusses modeling and field studies of controlled EV charging that have been performed with the goal of minimizing requirements for infrastructure upgrades, minimizing building peak demand charges, and maximizing the use of on-site generation. We present a large-scale workplace charging pilot of a demand-controlled scheduled EV charging system with over 250 active daily commuters, successfully demonstrating management of aggregate charging power to avoid new infrastructure investments, mitigate peak demand charges, and provide cost-effective workplace charging to users. In addition to understanding opportunities for demand management, integrating these controllable loads into the energy modeling process for new buildings will also be necessary. This paper then presents an example energy modeling process that evaluates the potential effects of EV charging on building load profiles and infrastructure requirements for a mixed-use community. Finally, we discuss an illustration of how EV charging can be controlled to be synergistic with other building loads and distributed generation.

buildings↗
DOE OSTI2022

Contextual Active Online Model Selection with Expert Advice

How can we collect the most useful labels to learn a model selection policy, when presented with arbitrary heterogeneous data streams? In this paper, we formulate this task as a contextual active model selection problem, where at each round the learner receives an unlabeled data point along with a context. The goal is to output the best model for any given context without obtaining an excessive amount of labels. In particular, we focus on the task of selecting pre-trained classifiers, and propose a contextual active model selection algorithm (CAMS), which relies on a novel uncertainty sampling query criterion defined on a given policy class for adaptive model selection. In comparison to prior art, our algorithm does not assume a globally optimal model. We provide rigorous theoretical analysis for the regret and query complexity under both adversarial and stochastic settings. Our experiments on several benchmark classification datasets demonstrate the algorithm’s effectiveness in terms of both regret and query complexity. Notably, to achieve the same accuracy, CAMS incurs less than 10% of the label cost when compared to the best online model selection baselines on CIFAR10.

Liu, Xuefeng↗
DOE OSTI2020

Calibration of CDM-Based Creep Constitutive Model Using Accelerated Creep Test (ACT) Data

In conventional creep testing (CCT) a specimen is subject to constant load and temperature for a long-duration until creep rupture occurs. Conventional testing can be costly when considering the number of experiments needed to characterize the creep response of a material over a range of stress and temperature. To predict long-term creep-rupture properties, the time-temperature-stress superposition principle (TTSSP) approach has been employed where stress and/or temperature is applied at an elevated level; the result of which are extrapolated down to low stress and/or temperature conditions. These methods have been successful in predicting minimum-creep-strain-rate (MCSR) and stress-rupture (SR) but suffer from an inability to predict the creep deformation curve or account for changes in deformation mechanisms or aging that occurs at long-duration. An accelerated technique, termed the Stepped isostress method (SSM) allows the accelerated testing of materials to determine their creep deformation response. Unlike TTSSP tests, the SSM test employs a single specimen where the stress is periodically step increased until rupture. The SSM creep deformation curve is processed (time and strain shifted) to produce an accelerated creep deformation curve that represent the creep deformation curve at the initial stress level in SSM. A processing procedure for metals has yet to be developed. The research objective of this study is to develop a processing procedure for SSM test data using a creep-damage constitutive model. Triplicate SSM tests were conducted on Ni-based superalloy Inconel 718 at 650°C with stress being periodically increased until rupture. Triplicate CCT tests were conducted at the initial stress level of the SSM tests. The Sine-hyperbolic (Sinh) creep-damage model was employed in this study. The Sinh creep-damage constitutive model is based on coupled creep strain rate and damage evolution equations; where both rates are dependent on the current state of damage. Calibration is two-step: analytical and numerical optimization. Each stepped creep deformation curve is tackled quasi-analytically to determine MCSR and SR related material constants and accumulated damage. The damage accumulated at the end of each step was then passed onto subsequent steps to calibrate the MCSR, rupture prediction, and damage evolution. Numerical optimization was applied to optimize model constants involved in the creep strain constitutive equations in order to generate best-fitted Sinh creep deformation curves. The Sinh model predictions were compared to the SSM and CCT data. The Sinh model satisfactorily predicts the SSM data and thus the calibrated material constants provides a good estimate of rupture found in the CCT data. Calibration using SSM data reduces the number of tests needed to calibrate a model; significantly reducing costs. A single SSM test replaces numerous creep tests at different stresses.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Techno-economic optimization of renewable urea production for sustainable agriculture and CO 2 utilization

Abstract Urea is the most used nitrogen fertilizer due to its ease of storage, transportation, and application. It is made by combining ammonia and carbon dioxide (CO 2 ), both of which are produced predominantly from fossil fuels at present. The recent momentum behind ammonia production using renewable-powered electrolysis offers an opportunity to both make urea in a more sustainable way and utilize CO 2 from external sources. In this work, we present a techno-economic optimization model to minimize the cost of making urea in this way. The model allows for time-varying chemical production in response to renewable variability by simultaneously optimizing production facility design and hourly operation. We performed a case study for Minnesota considering the use of byproduct CO 2 from bioethanol production. We found that the present-day levelized cost of renewable urea is between $268 mt −1 and $413 mt −1 at likely implementable production scales up to 250 000 mt yr −1 . This is within the range of historical conventional urea prices while offering at least 78% carbon intensity reduction. Projecting to 2030, there is a clear economic case for renewable urea production with levelized cost as low as $135 mt −1 due to technology improvement and electrolysis manufacturing expansion, facilitating a urea production scale increase to 525 000 mt yr −1 . Optimal facilities use wind energy, with hydrogen and ammonia production operating in a flexible, time-varying way to minimize battery and hydrogen storage capacities. Urea production operates near steady state due to the relatively low cost of intermediate ammonia buffer storage. A mix of imported methane and locally produced hydrogen are used to provide heat for steam consumed in the urea synthesis.

Chemistry↗
DOE OSTI2024

Mixture-of-Experts for Multi-Domain Defect Identification in Non-Destructive Inspection

Composite materials are widely used in aircraft structures because of their superior mechanical properties. However, their complex failure modes require sophisticated inspection methods to ensure structural integrity. Ultrasonic testing (UT) is a common non-destructive inspection (NDI) technique for aircraft composites that can detect internal and external defects with high resolution and accuracy. Despite their effectiveness, traditional UT methods rely on the manual interpretation of ultrasonic signals, which is time-consuming, labor-intensive, and subjective. Furthermore, processing such large-scale data, particularly across materials of varying thicknesses, significantly increases the computational demands of deep learning model optimization. To overcome these challenges, we propose an efficient sparse mixture-of-experts (MoE) model with a multi-level loss function and introduce four novel training objectives to improve computational efficiency and accuracy in identifying surface defects in composite aircraft materials. Here, we evaluated our approach on material with multiple thicknesses or domains comprising various defects. Our experimental results demonstrate higher accuracy and F1-Score, with only 10% training epochs compared to baseline MoE.

composite materials↗
DOE OSTI2020

Prediction of the development of islet autoantibodies through integration of environmental, genetic, and metabolic markers

The Environmental Determinants of the Diabetes in the Young (TEDDY) study has prospectively followed, from birth, children at increased genetic risk of type 1 diabetes. We evaluated the potential of machine learning to identify new biomarkers that predict imminent (within 6 months) development of persistent islet autoantibodies to insulin, GAD or IA-2 in TEDDY participants through integration of time-invariant risk factors with time-varying metabolomics. The predictive modeling was initiated with over 220 potential biomarkers; through ensemble-based feature evaluation, the optimal model included 42 biomarkers, returning a cross-validated receiver operating characteristic area under the curve of 0.74. The model identified a principal set of 20 time-invariant markers, including 16 single nucleotide polymorphisms and two HLA-DR genotypes, gestational age, and exposure to a prebiotic formula. Integration of the metabolome identified 22 high-priority metabolites and lipids, including adipic acid and ceramide d42:0, that predicted development of islet autoantibodies, dependent upon the time horizon. The majority (86%) of metabolites that predicted development of islet autoantibodies belonged to 3 pathways: lipid oxidation, phospholipase A2 signaling, and pentose phosphate pathway. TEDDY data suggest that these metabolic processes may play a role in triggering islet autoimmunity.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

Energy storage in combined gas-electric energy transitions models: The case of California

California’s vision for a net-zero future by 2045 relies heavily on variable renewable energy systems. Thus, energy storage - particularly long-duration storage - could play a fundamental role in reliably supplying low-carbon electricity. We study energy storage using the BRIDGES model, a combined gas-electric capacity expansion model for California across multiple investment periods (2025-2045), modeled with progressively decreasing carbon emission targets to a zero emissions by 2045. This least-cost optimization model includes renewable gas production via power-to-gas, long-term storage of energy in gaseous form, electric energy storage such as through batteries and hydrogen storage, and renewable energy generation, all with capacity tracking and investment. Multiple scenarios are evaluated to examine the sensitivity of the optimal storage portfolio to system-level and sector-level parameters. The scenario results show that all electric energy storage systems - which vary in storage duration - are deployed and required in a net-zero California in 2045, amounting to around 75 GW of storage capacity. Lithium ion systems make up approximately 80% of this power capacity and supply most short-run storage needs. Hydrogen storage - in the form of a power-to-gas-to-power system - emerges as a replacement to conventional natural gas storage, comprising most of the total energy storage capacity (~ 4 TWh). This capacity is less than 5% of the current natural gas storage capacity (94 TWh), indicating sufficient room for repurposing part of the gas infrastructure. A demand-side sensitivity analysis proves that higher electricity demand correlates with more builds of Li-ion batteries, while higher industrial heat demand leads to more builds of long-duration storage systems in a net-zero economy. Furthermore, power-to-gas systems satisfy part of the industrial heat demand by locally supplying renewable gas, which overtakes the traditional centralized gas storage and transfers through pipelines, casting significant doubts on the future of the large-scale gas infrastructure.

03 NATURAL GAS↗
DOE OSTI2025

Inference of phase field fracture models

The phase field approach to modeling fracture uses a diffuse damage field to represent cracks. This representation mollifies singularities that arise in computations with sharp interface models and some of the resultant difficulties in the mathematical and numerical treatment of fracture. Phase field fracture models have proven effective at representing crack propagation, branching, and merging. Specific formulations, beginning with brittle fracture, have also been shown to converge to classical solutions. Extensions to cover the range of material failure, including ductile and cohesive fracture, lead to an array of possible models. There exists a large body of literature focusing on this class of models and on the impact of model form on the predicted crack evolution. However, there have not been systematic studies into how optimal models may be chosen. Here, we take a first step in this direction by developing formal methods for identification of the best parsimonious model of phase field fracture given full-field data on the damage and deformation fields. We consider some of the main models that have been used for the degradation of elastic response due to damage and its propagation. Our approach builds upon Variational System Identification (VSI), a weak form variant of the Sparse Identification of Nonlinear Dynamics (SINDy). Furthermore, in this first communication we focus on synthetically generated data but we also consider central issues associated with the use of experimental full-field data, such as data sparsity and noise.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2024

Development of Steady-State and Dynamic Mass and Energy Constrained Neural Networks for Distributed Chemical Systems Using Noisy Transient Data

The paper presents the development of algorithms for mass and energy constrained neural network models that can exactly conserve the overall mass and energy of distributed chemical process systems, even though the noisy transient data used for optimal model training violate the same. In contrast to approximately satisfying mass and energy balance constraints of a system by soft penalization of objective function, algorithms have been developed for solving equality-constrained nonlinear optimization problems, thus providing the guarantee of exactly satisfying the system mass and energy conservation laws. For developing dynamic mass-energy constrained network models for distributed systems, hybrid series and parallel dynamic-static neural networks have been leveraged. The developed algorithms for solving both the training and forward problems are validated using both steady-state and dynamic data in the presence of various noise characteristics. The developed data-driven algorithms are flexible to exactly satisfy mass and energy balance constraints for dynamic chemical processes if the system holdup information is available. The proposed network structures and algorithms are applied to the development of data-driven lumped and distributed models of an adiabatic superheater/reheater system, a nonisothermal continuous stirred tank reactor, as well as an electrically heated plug-flow reactor system where one form of energy gets transformed to another. It has been observed that the mass-energy constrained neural networks yield a root mean squared error of <1% with respect to the system truth for the case studies evaluated in this work.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

The value of in-reservoir energy storage for flexible dispatch of geothermal power

Geothermal systems making use of advanced drilling and well stimulation techniques have the potential to provide tens to hundreds of gigawatts of clean electricity generation in the United States by 2050. With near-zero variable costs, geothermal plants have traditionally been envisioned as providing “baseload” power, generating at their maximum rated output at all times. However, as variable renewable energy sources (VREs) see greater deployment in energy markets, baseload power is becoming increasingly less competitive relative to flexible, dispatchable generation and energy storage. Herein we conduct an analysis of the potential for future geothermal plants to provide both of these services, taking advantage of the natural properties of confined, engineered geothermal reservoirs to store energy in the form of accumulated, pressurized geofluid and provide flexible load-following generation. We develop a linear optimization model based on multi-physics reservoir simulations that captures the transient pressure and flow behaviors within a confined, engineered geothermal reservoir. We then optimize the investment decisions and hourly operations of a power plant exploiting such a reservoir against a set of historical and modeled future electricity price series. Further, we find that operational flexibility and in-reservoir energy storage can significantly enhance the value of geothermal plants in markets with high VRE penetration, with energy value improvements of up to 60% relative to conventional baseload plants operating under identical conditions. Across a range of realistic subsurface and operational conditions, our modeling demonstrates that confined, engineered geothermal reservoirs can provide large and effectively free energy storage capacity, with round-trip storage efficiencies comparable to those of leading grid-scale energy storage technologies. Optimized operational strategies indicate that flexible geothermal plants can provide both short- and long-duration energy storage, prioritizing output during periods of high electricity prices. Sensitivity analysis assesses the variation in outcomes across a range of subsurface conditions and cost scenarios.

15 GEOTHERMAL ENERGY↗