Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Inverse Optimization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 955 records · Page 53

NSGA-PINN: A Multi-Objective Optimization Method for Physics-Informed Neural Network Training

This paper presents NSGA-PINN, a multi-objective optimization framework for the effective training of physics-informed neural networks (PINNs). The proposed framework uses the non-dominated sorting genetic algorithm (NSGA-II) to enable traditional stochastic gradient optimization algorithms (e.g., ADAM) to escape local minima effectively. Additionally, the NSGA-II algorithm enables satisfying the initial and boundary conditions encoded into the loss function during physics-informed training precisely. We demonstrate the effectiveness of our framework by applying NSGA-PINN to several ordinary and partial differential equation problems. In particular, we show that the proposed framework can handle challenging inverse problems with noisy data.

Lu, Binghang (ORCID:0009000160016632)↗

An inverse source location algorithm for radiation portal monitor applications

Radiation portal monitors are being deployed at border crossings throughout the world to prevent the smuggling of nuclear and radiological materials; however, a tension exists between security and the free-flow of commerce. Delays at ports-of-entry have major economic implications, so it is imperative to minimize portal monitor screening time. We have developed an algorithm to locate a radioactive source using a distributed array of detectors, specifically for use at border crossings. To locate the source, we formulated an optimization problem where the objective function describes the least-squares difference between the actual and predicted detector measurements. The predicted measurements are calculated by solving the 3-D deterministic neutron transport equation given an estimated source position. The source position is updated using the steepest descent method, where the gradient of the objective function with respect to the source position is calculated using adjoint transport calculations. If the objective function is smaller than the convergence criterion, then the source position has been identified. This paper presents the derivation of the underlying equations in the algorithm as well as several computational test cases used to characterize its accuracy.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Application of the inverse fast multipole method as a preconditioner in a 3D Helmholtz boundary element method

Here we investigate an efficient preconditioning of iterative methods (such as GMRES) for solving dense linear systems Ax = b that follow from a boundary element method (BEM) for the 3D Helmholtz equation, focusing on the low-frequency regime. While matrix–vector products in GMRES can be accelerated through the low-frequency fast multipole method (LFFMM), the BEM often remains computationally expensive due to the large number of GMRES iterations. We propose the application of the inverse fast multipole method (IFMM) as a preconditioner to accelerate the convergence of GMRES. The IFMM is in essence an approximate direct solver that uses a multilevel hierarchical decomposition and low-rank approximations. The proposed IFMM-based preconditioning has a tunable parameter ε that balances the cost to construct a preconditioner M, which is an approximation of A -1 , and the cost to perform the iterative process by means of M. Namely, using a small (respectively, large) value of ε takes a long (respectively, short) time to construct M, while the number of iterations can be small (respectively, large). A comprehensive set of numerical examples involving various boundary value problems with complicated geometries and mixed boundary conditions is presented to validate the efficiency of the proposed method. We show that the IFMM preconditioner (with a nearly optimal ε of 10 -2 ) clearly outperforms some common preconditioners for the BEM, achieving 1.2–10.8 times speed-up of the computations, in particular when the scale of the underlying scatterer is about five wavelengths or more. In addition, the IFMM preconditioner is capable of solving complicated problems (in a reasonable amount of time) that BD preconditioner can not.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

VinaMPI: Facilitating multiple receptor high-throughput virtual docking on high-performance computers

The program VinaMPI has been developed to enable massively large virtual drug screens on leadership-class computing resources, using a large number of cores to decrease the time-to-completion of the screen. VinaMPI is a massively parallel Message Passing Interface (MPI) program based on the multithreaded virtual docking program AutodockVina, and is used to distribute tasks while multithreading is used to speed-up individual docking tasks. VinaMPI uses a distribution scheme in which tasks are evenly distributed to the workers based on the complexity of each task, as defined by the number of rotatable bonds in each chemical compound investigated. VinaMPI efficiently handles multiple proteins in a ligand screen, allowing for high-throughput inverse docking that presents new opportunities for improving the efficiency of the drug discovery pipeline. VinaMPI successfully ran on 84,672 cores with a continual decrease in job completion time with increasing core count. The ratio of the number of tasks in a screening to the number of workers should be at least around 100 in order to have a good load balance and an optimal job completion time. The code is freely available and downloadable. Lastly, the instructions for downloading and using the code are provided in the Supporting Information.

97 MATHEMATICS AND COMPUTING↗

Power-law and exponential rank distributions: A panoramic Gibbsian perspective

Rank distributions are collections of positive sizes ordered either increasingly or decreasingly. Many decreasing rank distributions, formed by the collective collaboration of human actions, follow an inverse power-law relation between ranks and sizes. This remarkable empirical fact is termed Zipf’s law, and one of its quintessential manifestations is the demography of human settlements — which exhibits a harmonic relation between ranks and sizes. In this paper we present a comprehensive statistical-physics analysis of rank distributions, establish that power-law and exponential rank distributions stand out as optimal in various entropy-based senses, and unveil the special role of the harmonic relation between ranks and sizes. Our results extend the contemporary entropy-maximization view of Zipf’s law to a broader, panoramic, Gibbsian perspective of increasing and decreasing power-law and exponential rank distributions — of which Zipf’s law is one out of four pillars.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Feasibility of DEIM for retrieving the initial field via dimensionality reduction

When parameter estimation is solved in a high-dimensional space, the dimensionality reduction strategy becomes the primary consideration for alleviating the tremendous computational cost. Here, the discrete empirical interpolation method (DEIM) is explored to retrieve the initial condition (IC) by combining the polynomial chaos (PC) based ensemble Kalman filter (i.e. PC-EnKF), where a non-intrusive PC expansion is considered as a surrogate model in place of the forward model in the prediction step of the ensemble Kalman filter, resulting in fewer forward model integrations but with a comparable accuracy as Monte Carlo-based approaches. The DEIM acts as a hyper-reduction tool to provide the low-dimensional input for the high-dimensional initial field, which can be reconstructed using the information on the sparse interpolation grid points that is adaptively obtained through PC-EnKF data assimilation method. Thus an innovative framework to reconstruct the IC is developed. The detailed procedure at each assimilation iteration includes: the determination of the spatial interpolation points, the estimation of the initial values on the interpolation locations using the optimal observations, and the reconstruction of IC in the full space. The current study uses the reconstruction field of initial conditions of the Navier-Stokes equations as an example to illustrate the efficacy of our method. The experimental results demonstrate the proposed algorithm achieves a satisfactory reconstruction for the initial field. The proposed method helps to extend the applicable area of DEIM in solving inverse problems.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Scaling quantum approximate optimization on near-term hardware

The quantum approximate optimization algorithm (QAOA) is an approach for near-term quantum computers to potentially demonstrate computational advantage in solving combinatorial optimization problems. However, the viability of the QAOA depends on how its performance and resource requirements scale with problem size and complexity for realistic hardware implementations. Here, we quantify scaling of the expected resource requirements by synthesizing optimized circuits for hardware architectures with varying levels of connectivity. Assuming noisy gate operations, we estimate the number of measurements needed to sample the output of the idealized QAOA circuit with high probability. We show the number of measurements, and hence total time to solution, grows exponentially in problem size and problem graph degree as well as depth of the QAOA ansatz, gate infidelities, and inverse hardware graph degree. These problems may be alleviated by increasing hardware connectivity or by recently proposed modifications to the QAOA that achieve higher performance with fewer circuit layers.

97 MATHEMATICS AND COMPUTING↗

On the engulfment of antifreeze proteins by ice

Antifreeze proteins (AFPs) are remarkable biomolecules that suppress ice formation at trace concentrations. To inhibit ice growth, AFPs must not only bind to ice crystals, but also resist engulfment by ice. The highest supercooling, ΔT*, for which AFPs are able to resist engulfment is widely believed to scale as the inverse of the separation, L, between bound AFPs, whereas its dependence on the molecular characteristics of the AFP remains poorly understood. By using specialized molecular simulations and interfacial thermodynamics, here, we show that in contrast with conventional wisdom, ΔT* scales as L –2 and not as L –1 . We further show that ΔT* is proportional to AFP size and that diverse naturally occurring AFPs are optimal at resisting engulfment by ice. By facilitating the development of AFP structure–function relationships, we hope that our findings will pave the way for the rational design of AFPs.

Science & Technology - Other Topics↗

Inverse planning for IMRT with nonuniform beam profiles using total-variation regularization (TVR)

Purpose: Radiation therapy with high dose rate and flattening filter-free (FFF) beams has the potential advantage of greatly reduced treatment time and out-of-field dose. Current inverse planning algorithms are, however, not customized for beams with nonuniform incident profiles and the resultant IMRT plans are often inefficient in delivery. The authors propose a total-variation regularization (TVR)-based formalism by taking the inherent shapes of incident beam profiles into account. Methods: A novel TVR-based inverse planning formalism is established for IMRT with nonuniform beam profiles. The authors introduce a TVR term into the objective function, which encourages piecewise constant fluence in the nonuniform FFF fluence domain. The proposed algorithm is applied to lung and prostate and head and neck cases and its performance is evaluated by comparing the resulting plans to those obtained using a conventional beamlet-based optimization (BBO). Results: For the prostate case, the authors' algorithm produces acceptable dose distributions with only 21 segments, while the conventional BBO requires 114 segments. For the lung case and the head and neck case, the proposed method generates similar coverage of target volume and sparing of the organs-at-risk as compared to BBO, but with a markedly reduced segment number. Conclusions: TVR-based optimization in nonflat beam domain provides an effective way to maximally leverage the technical capacity of radiation therapy with FFF fields. The technique can generate effective IMRT plans with improved dose delivery efficiency without significant deterioration of the dose distribution.

60 APPLIED LIFE SCIENCES↗

Modeling the potential impact on the US blood supply of transfusing critically ill patients with fresher stored red blood cells

Although some studies have suggested that transfusion recipients may have better medical outcomes if transfused with red blood cell units stored for a short time, the overall body of evidence shows mixed results. It is important to understand how using fresher stored red blood cell units for certain patient groups may affect blood availability. Based on the Stock-and-Flow simulation model of the US blood supply developed by Simonetti et al. 2014, we evaluated a newly implemented allocation method of preferentially transfusing fresher stored red blood cell units to a subset of high-risk group of critically ill patients and its potential impact on supply. Simulation results showed that, depending on the scenario, the US blood total supply might be reduced between 2-42%, when compared to the standard of care in transfusion medicine practice. Among our simulated scenarios, we observed that the number of expired red blood cell units modulated the supply levels. The age threshold of the required red blood cell units was inversely correlated with both the supply levels and the number of transfused units that failed to meet that age threshold. Conclusion To our knowledge, this study represents the first attempt to develop a comprehensive framework to evaluate the impact of preferentially transfusing fresher stored red blood cells to the higher-risk critically ill patients on supply. Model results show the difficulties to identify an optimal scenario.

59 BASIC BIOLOGICAL SCIENCES↗

Optimization of Stereotactic Radiotherapy Treatment Delivery Technique for Base-Of-Skull Meningiomas

This study compares static conformal field (CF), intensity modulated radiotherapy (IMRT), and dynamic arcs (DA) for the stereotactic radiotherapy of base-of-skull meningiomas. Twenty-one cases of base-of-skull meningioma (median planning target volume [PTV] = 21.3 cm{sup 3}) previously treated with stereotactic radiotherapy were replanned with each technique. The plans were compared for Radiation Therapy Oncology Group conformity index (CI) and homogeneity index (HI), and doses to normal structures at 6 dose values from 50.4 Gy to 5.6 Gy. The mean CI was 1.75 (CF), 1.75 (DA), and 1.66 (IMRT) (p < 0.05 when comparing IMRT to either CF or DA plans). The CI (IMRT) was inversely proportional to the size of the PTV (Spearman's rho = -0.53, p = 0.01) and at PTV sizes above 25 cm{sup 3}, the CI (IMRT) was always superior to CI (DA) and CI (CF). At PTV sizes below 25 cm{sup 3}, there was no significant difference in CI between each technique. There was no significant difference in HI between plans. The total volume of normal tissue receiving 50.4, 44.8, and 5.6 Gy was significantly lower when comparing IMRT to CF and DA plans (p < 0.05). There was significantly improved dose sparing for the brain stem and ipsilateral temporal lobe with IMRT but no significant difference for the optic chiasm or pituitary gland. These results demonstrate that stereotactic IMRT should be considered to treat base-of-skull meningiomas with a PTV larger than 25 cm{sup 3}, due to improved conformity and normal tissue sparing, in particular for the brain stem and ipsilateral temporal lobe.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

A Multiyear Gridded Data Ensemble of Surface Biogenic Carbon Fluxes for North America: Evaluation and Analysis of Results

Accurate and fine-scale estimates of biogenic carbon fluxes are critical for measuring and monitoring the biosphere's responses and feedback to the climate system. Currently available data products from flux towers and model-intercomparison projects struggle to adequately represent spatiotemporal dynamics of surface biogenic carbon fluxes, and to quantify their uncertainties, which also are crucial to atmospheric inversion systems. To address these gaps, we introduce a new perturbed-parameter model ensemble with the CASA model to estimate surface biogenic carbon fluxes at monthly and 3-hourly scales for North America at ~500-m and 5-km resolutions. We first use the Extended Fourier Amplitude Sensitivity Testing to choose the three most sensitive parameters to be perturbed, maximum light use efficiency (E max ), optimal temperature of photosynthesis (T opt ), and temperature response of respiration (Q 10 ). The initial range for each parameter is broadly sampled for the L1 ensemble, but then we pruned E max with site-level primary productivity to derive an L2 ensemble with narrower uncertainty ranges. Ensembles are strongly correlated with site-level results at both monthly and 3-hourly scales, and the spread across L1/L2 ensemble members encompasses the range of AmeriFlux observations. Monthly variability in the L2 ensemble mean is 85% of the observed variability. The L2 ensemble outperforms diverse data products with the highest Taylor skill scores at diurnal to annual scales. Finally, the ensemble's seasonality agrees well with other models for most biome types and in high and middle latitudes, but inconsistencies are found in subtropical and tropical ecoregions and for annual totals over North America.

54 ENVIRONMENTAL SCIENCES↗

Approximate Bayesian Model Inversion for PDEs with Heterogeneous and State-Dependent Coefficients

We present two approximate Bayesian inference methods for parameter estimation in partial differential equation (PDE) models with space-dependent and state-dependent parameters. We demonstrate that these methods provide accurate and cost-effective alternatives to Markov Chain Monte Carlo simulation. We assume a parameterized Gaussian prior on the unknown functions, and approximate the posterior density by a parameterized multivariate Gaussian density. The parameters of the prior and posterior are estimated from sparse observations of the PDE model's states and the unknown functions themselves by maximizing the evidence lower bound (ELBO), a lower bound on the log marginal likelihood of the observations. The first method, Laplace-EM, employs the expectation maximization algorithm to maximize the ELBO, with a Laplace approximation of the posterior on the E-step, and minimization of a Kullback-Leibler divergence on the M-step. The second method, DSVI-EB, employs the doubly stochastic variational inference (DSVI) algorithm, in which the ELBO is maximized via gradient-based stochastic optimization, with nosiy gradients computed via simple Monte Carlo sampling and Gaussian backpropagation. We apply these methods to identifying diffusion coefficients in linear and nonlinear diffusion equations, and we find that both methods provide accurate estimates of posterior densities and the hyperparameters of Gaussian priors. While the Laplace-EM method is more accurate, it requires computing Hessians of the physics model. The DSVI-EB method is found to be less accurate but only requires gradients of the physics model.

approximate Bayesian inference, model inversion, v↗

Modeling the viscoplastic behavior of a semicrystalline polymer

In this study, a complex constitutive relation is identified using inverse modeling with the nominal mechanical response as sole experimental input. The methodology is illustrated for a semicrystalline thermoplastic in the presence of strain localization at finite deformations. The experimental database includes cylindrical tensile bars, compression pins and round notched bars loaded at strain rates spanning up to five decades and temperatures below and above T g . The data is organized into a calibration set and a validation set. The response of tensile specimens is determined using finite element analyses and a two-phase constitutive relation for semicrystalline polymers that accounts for temperature- and rate-sensitive plastic flow, pressure-sensitivity, small-strain softening and large-strain orientational hardening of the amorphous phase, along with the evolution of crystallinity. The large number of constitutive parameters is identified using an optimization tool coupled with the finite element solver and the calibration set from experiments. The methodology is shown to be successful in predicting the response of round notched bars and replicating the effects of temperature and strain rate on the severity of necking in tensile bars. The proposed model identification strategy is both simple and effective in comparison with other elaborate methods that attempt to access intrinsic behavior directly from high-fidelity experimental measurements.

36 MATERIALS SCIENCE↗

A persistent adjoint method with dynamic time-scaling and an application to mass action kinetics

In this article, we consider an optimization problem where the objective function is evaluated at the fixed-point of a contraction mapping parameterized by a control variable, and optimization takes place over this control variable. Since the derivative of the fixed-point with respect to the parameter can usually not be evaluated exactly, an adjoint dynamical system can be used to estimate gradients. Using this estimation procedure, the optimization algorithm alternates between derivative estimation and an approximate gradient descent step. We analyze a variant of this approach involving dynamic time-scaling, where after each parameter update the adjoint system is iterated until a convergence threshold is passed. Here, we prove that, under certain conditions, the algorithm can find approximate stationary points of the objective function. We demonstrate the approach in the settings of an inverse problem in chemical kinetics, and learning in attractor networks.

97 MATHEMATICS AND COMPUTING↗

Modeling hydrogen markets: Energy system model development status and decarbonization scenario results

Hydrogen can be used as an energy carrier and chemical feedstock to reduce greenhouse gas emissions, especially in difficult-to-decarbonize markets such as medium- and heavy-duty vehicles, aviation and maritime, iron and steel, and the production of fuels and chemicals. Significant literature has been accumulated on engineering-based assessments of various hydrogen technologies, and real-world projects are validating technology performance at larger scales and for low-carbon supply chains. While energy system models continue to be updated to track this progress, many are currently limited in their representation of hydrogen, and as a group they tend to generate highly variable results under decarbonization constraints. Here, the present work provides insights into the development status and decarbonization scenario results of 15 energy system models participating in study 37 of the Stanford Energy Modeling Forum (EMF37), focusing on the U.S. energy system. The models and scenario results vary widely in multiple respects: hydrogen technology representation, scope and type of hydrogen end-use markets, relative optimism of hydrogen technology input assumptions, and market uptake results reported for 2050 under various decarbonization assumptions. Most models report hydrogen market uptake increasing with decarbonization constraints, though some models report high carbon prices being required to achieve these increases and some find hydrogen does not compete well when assuming optimistic assumptions for all advanced decarbonization technologies. Across various scenarios, hydrogen market success tends to have an inverse relationship to success with direct air capture (DAC) and carbon capture and storage (CCS) technologies. While most model-scenario combinations predict modest hydrogen uptake by 2050 – <10 million metric tons (MMT) – aggregating the top 10 % of market uptake results across sectors suggests an upper range demand potential of 42–223 MMT. The high degree of variability across both modeling methods and market uptake results suggests that increased harmonization of both input assumptions and subsector competition scope would lead to more consistent results across energy system models. The wide variability in results indicates strongly divergent conclusions on the role of hydrogen in a decarbonized energy future.

08 HYDROGEN↗

The chemical composition of the sun from helioseismic and solar neutrino data

We perform a quantitative analysis of the solar composition problem by using a statistical approach that allows us to combine the information provided by helioseismic and solar neutrino data in an effective way. We include in our analysis the helioseismic determinations of the surface helium abundance and of the depth of the convective envelope, the measurements of the {sup 7}Be and {sup 8}B neutrino fluxes, and the sound speed profile inferred from helioseismic frequencies. We provide all the ingredients to describe how these quantities depend on the solar surface composition, different from the initial and internal composition due to the effects of diffusion and nuclear reactions, and to evaluate the (correlated) uncertainties in solar model predictions. We include error sources that are not traditionally considered such as those from inversion of helioseismic data. We, then, apply the proposed approach to infer the chemical composition of the Sun. Our result is that the opacity profile of the Sun is well constrained by the solar observational properties. In the context of a two-parameter analysis in which elements are grouped as volatiles (i.e., C, N, O, and Ne) and refractories (i.e., Mg, Si, S, and Fe), the optimal surface composition is found by increasing the abundance of volatiles by (45 ± 4)% and that of refractories by (19 ± 3)% with respect to the values provided by Asplund et al. (2009, ARA and A, 47, 481). This corresponds to the abundances ε{sub O} = 8.85 ± 0.01 and ε{sub Fe} = 7.52 ± 0.01, which are consistent at the ∼1σ level with those provided by Grevesse and Sauval (1998, SSRv, 85, 161). As an additional result of our analysis, we show that the best fit to the observational data is obtained with values of input parameters of the standard solar models (radiative opacities, gravitational settling rate, and the astrophysical factors S {sub 34} and S {sub 17}) that differ at the ∼1σ level from those presently adopted.

79 ASTRONOMY AND ASTROPHYSICS↗