Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Model optimization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,153 records · Page 64

Machine learning-driven design and self-sensing capabilities of automotive bumper lattices for adaptive impact response

We present a novel approach to design an automotive bumper energy absorber using carbon fiber reinforced polymer composites, optimized to meet conflicting performance requirements for two distinct impact scenarios. The design must satisfy both a low-speed (2.5 mph) pendulum intrusion test, simulating vehicle-to-vehicle collisions, and a high-speed (25 mph) leg flexion test, replicating pedestrian impacts. These tests demand opposing deformation characteristics: high flexibility (deformation < 85 mm) for the former and high stiffness (deformation < 22 mm) for the latter. To address these contradictory requirements, we developed a machine learning (ML) framework for inverse optimization of lattice designs and material selection. Unlike traditional iterative design processes, our ML model directly outputs optimal design parameters and material choices based on target performance inputs. The energy absorber was fabricated using advanced additive manufacturing techniques, including extrusion deposition and digital light processing. The integration of carbon fibers provides multifunctionality to the bumper structure, enabling self-sensing capabilities through changes in electrical resistivity under compression. This electrical response demonstrates high repeatability under multiple cycles at 2% compression and exhibits distinct signatures during crack formation under high deformation. This research offers adaptive performance through innovative design methodologies and smart material integration. The approach has potential applications in various fields requiring adaptive energy absorption and real-time structural health monitoring.

Chawla, Komal [ORNL] (ORCID:0000000190327565)↗

Attribute-Guided Adversarial Training for Robustness to Natural Perturbations

We report while existing work in robust deep learning has focused on small pixel-level norm-based perturbations, this may not account for perturbations encountered in several real world settings. In many such cases although test data might not be available, broad specifications about the types of perturbations (such as an unknown degree of rotation) may be known. We consider a setup where robustness is expected over an unseen test domain that is not i.i.d. but deviates from the training domain. While this deviation may not be exactly known, its broad characterization is specified a priori, in terms of attributes. We propose an adversarial training approach which learns to generate new samples so as to maximize exposure of the classifier to the attributes-space, without having access to the data from the test domain. Our adversarial training solves a min-max optimization problem, with the inner maximization generating adversarial perturbations, and the outer minimization finding model parameters by optimizing the loss on adversarial perturbations generated from the inner maximization. We demonstrate the applicability of our approach on three types of naturally occurring perturbations --- object-related shifts, geometric transformations, and common image corruptions. Our approach enables deep neural networks to be robust against a wide range of naturally occurring perturbations. We demonstrate the usefulness of the proposed approach by showing the robustness gains of deep neural networks trained using our adversarial training on MNIST, CIFAR-10, and a new variant of the CLEVR dataset.

97 MATHEMATICS AND COMPUTING↗

Datasets for Widespread Residential Space Heating Electrification in Texas

In this experiment, we explore long term patterns in electricity demand driven by the dual effects of full electrification of space heating in Texas (by adoption of electric heat pumps), and climate change. We use a predictive model of electricity demand, climate projections, and an open source nodal power system (DC Optimal Power Flow) model of the Electric Reliability Council of Texas (ERCOT) system. Heat pumps are a more energy efficient way of providing space heating and cooling in homes. We attempt to exhaustively investigate the impacts of full residential space heating electrification by adoption of heat pumps for the segment of Texas households that currently rely on fossil fuels (about 40%), while simultaneously incorporating climate change meteorological variables. We explore a range of scenarios of heat pump efficiency and climate uncertainty over a long period of future years (2020-2099). In total, the simulation experiment generates 1,280 simulation years of hourly data. We report and analyze results in form of impacts on residential load, total load, peak load, seasonality of peaking, and reliability measured by occurrence and frequency of loss of load events. While the experiment is for ERCOT, the insights and approach can be applied to other regions. The results from the analysis can inform system planners on a range of potential capacity requirements/ reliability implications and/or risks of full space heating electrification via the adoption of electric heat pumps, given the uncertainty in the scenarios/ climate futures. The dataset includes model output for residential, non residential and total load, and the results from the GO ERCOT model runs for 4 RCP Scenarios (RCP 4.5 Cooler, RCP 4.5 Hotter, RCP 8.5 Cooler, RCP 8.5 Hotter), 4 Heating electrification Scenarios (Base , Standard Efficiency HP, High Efficiency HP, Ultra-High Efficiency HP) over 80 years (2020-2099). The metrological variables at BA scale were weighted weighted using population projections consistent with the SSP3 scenario.

Climate Change↗

Robust scalable initialization for Bayesian variational inference with multi-modal Laplace approximations

Predictive modeling typically relies on Bayesian model calibration to provide uncertainty quantification. Variational inference utilizing fully independent (“mean-field”) Gaussian distributions are often used as approximate probability density functions. This simplification is attractive since the number of variational parameters grows only linearly with the number of unknown model parameters. However, the resulting diagonal covariance structure and unimodal behavior can be too restrictive to provide useful approximations of intractable Bayesian posteriors that exhibit highly non-Gaussian behavior, including multimodality. High-fidelity surrogate posteriors for these problems can be obtained by considering the family of Gaussian mixtures. Gaussian mixtures are capable of capturing multiple modes and approximating any distribution to an arbitrary degree of accuracy, while maintaining some analytical tractability. Unfortunately, variational inference using Gaussian mixtures with full-covariance structures suffers from a quadratic growth in variational parameters with the number of model parameters. The existence of multiple local minima due to strong nonconvex trends in the loss functions often associated with variational inference present additional complications, These challenges motivate the need for robust initialization procedures to improve the performance and computational scalability of variational inference with mixture models. In this work, we propose a method for constructing an initial Gaussian mixture model approximation that can be used to warm-start the iterative solvers for variational inference. The procedure begins with a global optimization stage in model parameter space. In this step, local gradient-based optimization, globalized through multistart, is used to determine a set of local maxima, which we take to approximate the mixture component centers. Around each mode, a local Gaussian approximation is constructed via the Laplace approximation. Finally, the mixture weights are determined through constrained least squares regression. The robustness and scalability of the proposed methodology is demonstrated through application to an ensemble of synthetic tests using high-dimensional, multimodal probability density functions. Here, the practical aspects of the approach are demonstrated with inversion problems in structural dynamics.

97 MATHEMATICS AND COMPUTING↗

Coordinated Optimization and Control of Residential Solid State Power Substations in Electrical Distribution Network

This paper proposes a computationally efficient mixed integer linear programming (MILP) model for the coordinated optimization of solid-state power substations (SSPSs) in a feeder considering the full unbalanced three-phase structure of the distribution grid and its characteristics. The proposed model determines the optimal real and reactive power of each SSPS at the point of common coupling (PCC) that minimizes the operating cost and maximizes the system performance, e.g., voltage regulation and phase balancing. To improve the computational efficiency, an inscribed octagon is introduced to approximate the quadratic capacity constraints of components. Numerical simulation results show the effectiveness of the proposed model and significant improvements in voltage profiles and power imbalance between phases.

Liu, Guodong↗

Autonomous alloy composition optimization using molecular dynamics guided by a large language model

Here, we present an autonomous materials discovery framework that couples a large language model (LLM) with molecular dynamics (MD) simulations to optimize Fe–Cr–Mn alloy compositions for tensile strength. Starting from six distinct compositions, the LLM operated as an intelligent agent, iteratively proposing changes based on prior simulation results and constraints. Over 50 iterations per case, the LLM adaptively explored the composition space, identifying high-strength regions, not easily accessible by conventional methods. The highest strength, 18.7 GPa, was achieved with Fe 71 Cr 25 Mn 4 composition, identified from a Fe 75 Cr 20 Mn 5 starting point. The LLM autonomously adjusted its strategy in real time, demonstrating closed-loop decision-making using commodity hardware. This approach showcases the potential of LLMs as scientific co-pilots, capable of accelerating materials discovery and generalizable to other domains like biology and drug design.

Autonomy↗

Thermal Energy Storage Model Development within the Integrated Energy Systems Hybrid Repository

This publication details newly created energy storage models developed within the HYBRID Modelica repository as part of the Department of Energy Office of Nuclear Energy (DOE-NE) Integrated Energy Systems (IES) program, led by Idaho National Laboratory (INL). Model development to-date includes creation of dynamic systems-level models of concrete, latent heat, and packed-bed thermocline energy storage technologies for deployment in the IES-based HYBRID repository. Models are developed using the latest publicly available data and incorporate the possibility of control strategy inclusion for use with the existing IES modeling, analysis, and optimization toolset. Simulations showcase the abilities of each technology to cyclically charge and discharge when exposed to time-varying boundary conditions. In addition, low-level surrogate models for some of the thermal energy storage technologies were created using Python. These lower order Python files are much cheaper to run (i.e., computationally faster) and thus operate well when incorporated within the stochastic optimization problems run for the IES program. Moreover, economic data was collected for use within the INL-developed Framework for Optimization of ResourCes and Economics (FORCE). This information is incorporated within the FORCE platform. This work has resulted in creation of systems-level models for concrete, latent heat, and thermocline thermal energy storage systems with associated control systems. Now that these models are available, they can be utilized within different integrated energy park concepts to understand optimal system operation, control, and dispatching. Moreover, given the generic nature of the models, industrial partner technologies (e.g., Storworks Power, EnergyNest) can be quickly added to the repository using the existing models as a basis. Additional dynamic models for thermal energy storage concepts can be developed and added to the HYBRID repository as needed.

25 ENERGY STORAGE↗

Post-Disturbance Dynamic Distribution System Restoration with DGs and Mobile Resources

Distributed generations (DGs) can act as emergency power supplies when distribution systems suffer from outages. However, the generation capabilities of DGs are generally limited by a number of factors including weather conditions, fuel limitations, etc. In this context, mobile resources that are able to reallocate resources to desired locations are regarded as important complements to conventional fixed DGs in assisting distribution system restoration. In this paper, a distribution system restoration model with DGs and mobile resources is proposed. Firstly, the dispatch and allocation of mobile resources are modeled with respect to the characteristics of the traffic network. Then the developed mobile resource models are integrated into the distribution system restoration model to co-optimize the scheduling of DGs and mobile resources. Uncertainty factors are managed by a model predictive control approach so that system operators can dynamically adjust the restoration strategy with the up-to-date information. The effectiveness of the proposed method is validated through an IEEE 13-bus test system.

distributed generations (DGs)↗

A Novel Physiologically Based Model of Creatinine Renal Disposition to Integrate Current Knowledge of Systems Parameters and Clinical Observations

Creatinine is the most common clinical biomarker of renal function. As a substrate for renal transporters, its secretion is susceptible to inhibition by drugs, resulting in transient increase in serum creatinine and false impression of damage to kidney. Novel physiologically based models for creatinine were developed here and (dis)qualified in a stepwise manner until consistency with clinical data. Data from a matrix of studies were integrated, including systems data (common to all models), proteomics‐informed in vitro – in vivo extrapolation of all relevant transporter clearances, exogenous administration of creatinine (to estimate endogenous synthesis rate), and inhibition of different renal transporters (11 perpetrator drugs considered for qualification during creatinine model development and verification on independent data sets). The proteomics‐informed bottom‐up approach resulted in the underprediction of creatinine renal secretion. Subsequently, creatinine‐trimethoprim clinical data were used to inform key model parameters in a reverse translation manner, highlighting best practices and challenges for middle‐out optimization of mechanistic models.

Scotcher, Daniel↗

Predicting the Evolution of Shallow Cumulus Clouds With a Lotka‐Volterra Like Model

Abstract In numerical weather prediction and climate models, boundary‐layer clouds are controlled by a wide range of subgrid‐scale processes. However, understanding the nature of these processes and their role in the evolution of the cloud size distribution as a whole has been elusive. To address this issue, we adopt a novel empirical framework from the field of population dynamics to model the evolution of cloud size statistics by using the shallow cumulus properties obtained from a large‐eddy simulation (LES). Our approach involves representing the cloud size distribution and the total cloud area using a revised Lotka‐Volterra model and ridge linear model, respectively. The physical interpretation of the total cloud area and coefficients obtained from the optimization of the models reveals three stages probably interpreted by dominant processes: the formation of new clouds, the growth of single clouds, and a steady state with organized transitions involving the growth and decay of multiple clouds. Furthermore, we showcase the potential of this framework to serve as a component of scale‐aware parameterizations of shallow‐convective clouds in atmospheric models.

54 ENVIRONMENTAL SCIENCES↗

Improved joint X-ray and neutron refinement procedure in Phenix

Neutron diffraction is one of the three crystallographic techniques (X-ray, neutron and electron diffraction) used to determine the atomic structures of molecules. Its particular strengths derive from the fact that H (and D) atoms are strong neutron scatterers, meaning that their positions, and thus protonation states, can be derived from crystallographic maps. However, because of technical limitations and experimental obstacles, the quality of neutron diffraction data is typically much poorer (completeness, resolution and signal to noise) than that of X-ray diffraction data for the same sample. Further, refinement is more complex as it usually requires additional parameters to describe the H (and D) atoms. The increase in the number of parameters may be mitigated by using the `riding hydrogen' refinement strategy, in which the positions of H atoms without a rotational degree of freedom are inferred from their neighboring heavy atoms. However, this does not address the issues related to poor data quality. Therefore, neutron structure determination often relies on the presence of an X-ray data set for joint X-ray and neutron (XN) refinement. In this approach, the X-ray data serve to compensate for the deficiencies of the neutron diffraction data by refining one model simultaneously against the X-ray and neutron data sets. To be applicable, it is assumed that both data sets are highly isomorphous, and preferably collected from the same crystals and at the same temperature. However, the approach has a number of limitations that are discussed in this work by comparing four separately re-refined neutron models. To address the limitations, a new method for joint XN refinement is introduced that optimizes two different models against the different data sets. This approach is tested using neutron models and data deposited in the Protein Data Bank. The efficacy of refining models with H atoms as riding or as individual atoms is also investigated.

36 MATERIALS SCIENCE↗

Performance Evaluation of Gray-box and Machine Learning Models of a Thermal Energy Storage System with Active Insulation

An interior partition wall integrated with active thermal storage and a dynamic insulation system was built and then installed in an office building in Oak Ridge, Tennessee, TN. This smart wall, termed the Empower Wall, was equipped with embedded pipes in the building envelope core component and an additional pipe network enclosing rigid insulation to switch on and off the active insulation dynamically. The performance of the wall's contribution to cooling load reduction under different parameters has been investigated in previous publications. Aiming to be deployed into model predictive control and other optimization methods, simplified and reliable models for the developed wall and the room accommodating it are required. They are needed to characterize the properties and thermal response of both Empower Wall and building envelope, which form an essential component for accurate indoor temperature or cooling/heating demand prediction. In this study, simplified gray-box and regression models as well as machine learning model were developed and the performance of them were compared and analyzed.

Cui, Borui↗

Machine-Learning Assisted Identification of Battery Life Models

Predictive battery life models are commonly utilized to extrapolate degradation trends observed during accelerated aging tests for simulation of degradation in real-world applications. Thus, fitting accelerated aging data as accurately as possible and with low uncertainty is crucial for making believable projections of battery lifetime, but it is challenging to identify algebraic expressions that accurately fit multivariate degradation trends. A review of models published in literature reveal some common expressions for fitting calendar aging data, which is only dependent on temperature and state-of-charge, but no consistency across many models for fitting cycle aging data, indicating the need for a statistically rigorous data driven approach for developing empirical models. This talk will describe a machine-learning assisted method for identification of predictive battery life models utilizing bilevel optimization and symbolic regression. Bilevel optimization with cross-validation is used to statistically determine cell- and stress-dependent model parameters, while symbolic regression identifies both linear and multiplicative candidate expressions to predict stress-dependent degradation rates by selecting low-order subsets of features from a generated feature library. Because model expressions are identified empirically, it is crucial to ensure resulting models behave according to physical expectations, so the stability of models for interpolation or extrapolation is interrogated qualitatively through simulation and quantitatively through cross-validation and uncertainty quantification via bootstrap resampling. This model identification approach substantially improves upon models identified purely using expert judgement in terms of both accuracy and uncertainty. Model simulation and validation is then conducted by deriving a state-equation form of the predictive model, enabling simulation of battery aging under dynamic stresses. This enables validation of the predictive battery model on lab-based tests with varying conditions or on drive-cycle or application-cycle testing protocols. Parameter uncertainty can be carried forward into model simulation, giving lifetime estimates and confidence windows for cell- or system-level lifetime. The financial impact of battery model uncertainty can be estimated by incorporating uncertainty into a technoeconomic model.

battery↗

Impact of Higher Fidelity Design Iterations on Critical System Criteria

Nuclear criticality experiments are effective at informing the performance of nuclear data libraries across many applications. This work explores the implications of refining critical experiment MCNP models from their low fidelity optimization phase to penultimate neutronic models. Specifically, this work is focused on two series of plutonium fueled experiments funded through internal programs at Los Alamos National Laboratory building off previous efforts under the EUCLID (Experiments Underpinned by Computational Learning for Improvements in Nuclear Data) collaboration. Thales, the first of the two collaborations, is a fast spectrum Ta-reflected plutonium experiment to support operations at PF-4. The second experiment are twin configurations designed to target the intermediate energy cross sections in 239 Pu. Motivation for this experiment stems from the PARallel Approach of Differential and InteGral Measurements (PARADIGM) collaboration which hopes to achieve a significant reduction in 239 Pu cross section uncertainties in the intermediate region.

97 MATHEMATICS AND COMPUTING↗

Uncertainty quantification of mass models using ensemble Bayesian model averaging

Developments in the description of the masses of atomic nuclei have led to various nuclear mass models that provide predictions for masses across the whole chart of nuclides. These mass models play an important role in understanding the synthesis of heavy elements in the rapid neutron capture ( r ) process. However, it is still a challenging task to estimate the size of uncertainty associated with the predictions of each mass model. In this work, a method called ensemble Bayesian model averaging (EBMA) is introduced to quantify the uncertainty of one-neutron separation energies (S 1 n ) which are directly relevant in the calculations of r -process observables. Here, this Bayesian method provides a natural way to perform model averaging, selection, and uncertainty quantification, by combining the mass models as a mixture of normal distributions whose parameters are optimized against the experimental data, employing the Markov chain Monte Carlo method using the no-u-turn sampler. The EBMA model optimized with all the experimental S 1 n from the AME2003 nuclides are shown to provide reliable uncertainty estimates when tested with the new data in the AME2020.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Optimization of nutrient utilization efficiency and productivity for algal cultures under light and dark cycles using genome-scale model process control

Abstract Algal cultivations are strongly influenced by light and dark cycles. In this study, genome-scale metabolic models were applied to optimize nutrient supply during alternating light and dark cycles of Chlorella vulgaris . This approach lowered the glucose requirement by 75% and nitrate requirement by 23%, respectively, while maintaining high final biomass densities that were more than 80% of glucose-fed heterotrophic culture. Furthermore, by strictly controlling glucose feeding during the alternating cycles based on model-input, yields of biomass, lutein, and fatty acids per gram of glucose were more than threefold higher with cycling compared to heterotrophic cultivation. Next, the model was incorporated into open-loop and closed-loop control systems and compared with traditional fed-batch systems. Closed-loop systems which incorporated a feed-optimizing algorithm increased biomass yield on glucose more than twofold compared to standard fed-batch cultures for cycling cultures. Finally, the performance was compared to conventional proportional-integral-derivative (PID) controllers. Both simulation and experimental results exhibited superior performance for genome-scale model process control (GMPC) compared to traditional PID systems, reducing the overall measured value and setpoint error by 80% over 8 h. Overall, this approach provides researchers with the capability to enhance nutrient utilization and productivity of cell factories systematically by combining genome-scale models and controllers into an integrated platform with superior performance to conventional fed-batch and PID methodologies.

59 BASIC BIOLOGICAL SCIENCES↗

Efficient Optimization of Energy Recovery From Geothermal Reservoirs With Recurrent Neural Network Predictive Models

Improving the long-term energy production performance of geothermal reservoirs can be accomplished by optimizing field development and management plans. Reliable prediction models, however, are needed to evaluate and optimize the performance of the underlying reservoirs under various operation and development strategies. In traditional frameworks, physics-based simulation models are used to predict the energy production performance of geothermal reservoirs. However, detailed simulation models are not trivial to construct, require a reliable description of the reservoir conditions and properties, and entail high computational complexity. Data-driven predictive models can offer an efficient alternative for use in optimization workflows. This paper presents an optimization framework for net power generation in geothermal reservoirs using a variant of the recurrent neural network (RNN) as a data-driven predictive model. The RNN architecture is developed and trained to replace the simulation model for computationally efficient prediction of the objective function and its gradients with respect to the well control variables. The net power generation performance of the field is optimized by automatically adjusting the mass flow rate of production and injection wells over 12 years, using a gradient-based local search algorithm. Two field-scale examples are presented to investigate the performance of the developed data-driven prediction and optimization framework. Furthermore, the prediction and optimization results from the RNN model are evaluated through comparison with the results obtained by using a numerical simulation model of a real geothermal reservoir.

15 GEOTHERMAL ENERGY↗

Optimization of harvest and logistics for multiple lignocellulosic biomass feedstocks in the northeastern United States

A mixed-integer linear programming model was developed to optimize the multiple biomass feedstock supply chains, including feedstock establishment, harvest, storage, transportation, and preprocessing. The model was applied for analyses of multiple biomass feedstocks at county level for 13 states in the northeastern United States. In the base case with a demand of 180,000 dry Mg/year of biomass, the delivered costs ranged from $\$67.90$ to $\$86.97$ per dry Mg with an average of $\$79.58$ /dry Mg. The biomass delivered costs by county were from $\$67.90$ to 150.81 per dry Mg across the northeastern U.S. Considered the entire study area, the delivered cost averaged $\$85.30$ /dry Mg for forest residues, $\$84.47$ /dry Mg for hybrid willow, $\$99.68$ for switchgrass and $\$97.87$ per dry Mg for Miscanthus. Seventy seven out of 387 counties could be able to deliver biomass at $84 per dry Mg or less a target set by US DOE by 2022. A sensitivity analysis was also conducted to evaluate the effects of feedstock availability, feedstock price, moisture content, procurement radius, and facility demand on the delivered cost. Lastly, our results showed that procurement radius, facility capacity, and forest residue availability were the most sensitive factors affecting the biomass delivered costs.

09 BIOMASS FUELS↗