Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “model weights”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

Models for predicting objective function weights in prostate cancer IMRT

Purpose: To develop and evaluate the clinical applicability of advanced machine learning models that simultaneously predict multiple optimization objective function weights from patient geometry for intensity-modulated radiation therapy of prostate cancer. Methods: A previously developed inverse optimization method was applied retrospectively to determine optimal objective function weights for 315 treated patients. The authors used an overlap volume ratio (OV) of bladder and rectum for different PTV expansions and overlap volume histogram slopes (OVSR and OVSB for the rectum and bladder, respectively) as explanatory variables that quantify patient geometry. Using the optimal weights as ground truth, the authors trained and applied three prediction models: logistic regression (LR), multinomial logistic regression (MLR), and weighted K-nearest neighbor (KNN). The population average of the optimal objective function weights was also calculated. Results: The OV at 0.4 cm and OVSR at 0.1 cm features were found to be the most predictive of the weights. The authors observed comparable performance (i.e., no statistically significant difference) between LR, MLR, and KNN methodologies, with LR appearing to perform the best. All three machine learning models outperformed the population average by a statistically significant amount over a range of clinical metrics including bladder/rectum V53Gy, bladder/rectum V70Gy, and dose to the bladder, rectum, CTV, and PTV. When comparing the weights directly, the LR model predicted bladder and rectum weights that had, on average, a 73% and 74% relative improvement over the population average weights, respectively. The treatment plans resulting from the LR weights had, on average, a rectum V70Gy that was 35% closer to the clinical plan and a bladder V70Gy that was 29% closer, compared to the population average weights. Similar results were observed for all other clinical metrics. Conclusions: The authors demonstrated that the KNN and MLR weight prediction methodologies perform comparably to the LR model and can produce clinical quality treatment plans by simultaneously predicting multiple weights that capture trade-offs associated with sparing multiple OARs.

60 APPLIED LIFE SCIENCES↗

Embedded training of neural-network subgrid-scale turbulence models

We report that the weights of a deep neural-network model are optimized in conjunction with the governing flow equations to provide a model for subgrid-scale stresses in a temporally developing plane turbulent jet at Reynolds number Re 0 = 6000 . The objective function for training is first based on the instantaneous filtered velocity fields from a corresponding direct numerical simulation, and the training is by a stochastic gradient descent method, which uses the adjoint Navier-Stokes equations to provide the end-to-end sensitivities of the model weights to the velocity fields. In-sample and out-of-sample testing on multiple dual-jet configurations show that its required mesh density in each coordinate direction for prediction of mean flow, Reynolds stresses, and spectra is half that needed by the dynamic Smagorinsky model for comparable accuracy. The same neural-network model trained directly to match filtered subgrid-scale stresses, without the constraint of being embedded within the flow equations during the training, fails to provide a qualitatively correct prediction. The coupled formulation is generalized to train based only on mean-flow and Reynolds stresses, which are more readily available in experiments. The mean-flow training provides a robust model, which is important, though a somewhat less accurate prediction for the same coarse meshes, as might be anticipated due to the reduced information available for training in this case. The anticipated advantage of the formulation is that the inclusion of resolved physics in the training increases its capacity to extrapolate. This is assessed for the case of passive scalar transport, for which it outperforms established models due to improved mixing predictions.

42 ENGINEERING↗

A Case Study on a Combination NDVI Forecasting Model Based on the Entropy Weight Method

It is critically meaningful to accurately predict NDVI (Normalized Difference Vegetation Index), which helps guide regional ecological remediation and environmental managements. In this study, a combination forecasting model (CFM) was proposed to improve the performance of NDVI predictions in the Yellow River Basin (YRB) based on three individual forecasting models, i.e., the Multiple Linear Regression (MLR), Artificial Neural Network (ANN), and Support Vector Machine (SVM) models. The entropy weight method was employed to determine the weight coefficient for each individual model depending on its predictive performance. Results showed that: (1) ANN exhibits the highest fitting capability among the four orecasting models in the calibration period, whilst its generalization ability becomes weak in the validation period; MLR has a poor performance in both calibration and validation periods; the predicted results of CFM in the calibration period have the highest stability; (2) CFM generally outperforms all individual models in the validation period, and can improve the reliability and stability of predicted results through combining the strengths while reducing the weaknesses of individual models; (3) the performances of all forecasting models are better in dense vegetation areas than in sparse vegetation areas.

54 ENVIRONMENTAL SCIENCES↗

Improving Kinetic Consistency Across Elastic Model Transitions With Quadratic Inequality Constrained Weighted Least Squares (WLSQI)

Flexible body modeling presents a large challenge in the development of simulations to aid in design of flight control systems for launch and landing vehicles. Typically, the flexible body model is not a single continuous model but are rather discrete sets of Linear Time Invariant (LTI) Finite Element Models (FEM) incremented by propellant levels. This introduces the problem of smoothly transitioning modal and physical states of the vehicle when switching from one FEM to the next. This paper introduces a new approach to optimally transition flexible body states with weighted least squares, building off previous methods.

Convex Optimization↗

Improving Kinetic Consistency Across Elastic Model Transitions With Quadratic Inequality Constrained Weighted Least Squares (WLSQI)

Flexible body modeling presents a large challenge in the development of simulations to aid in design of flight control systems for launch and landing vehicles. Typically, the flexible body model is not a single continuous model but are rather discrete sets of Linear Time Invariant (LTI) Finite Element Models (FEM) incremented by propellant levels. This introduces the problem of smoothly transitioning modal and physical states of the vehicle when switching from one FEM to the next. This paper introduces a new approach to optimally transition flexible body states with weighted least squares, building off previous methods.

GN&C↗

Ab Initio Polariton Spectra of ZnTPP Molecules Collectively Coupled Inside an Optical Cavity

Exciton-polaritons are quasi-particles formed by the quantum mechanical hybridization of electronic and photonic excitations. Despite extensive investigations, a fundamental understanding of molecular polariton spectra and the polariton delocalization from an ab initio theoretical perspective remains elusive. We simulate experimentally measured linear transmission spectroscopy of many Zinc(II) tetraphenylporphyrin (ZnTPP) molecules collectively coupled to a cavity from first principles. Our theoretical approach incorporates many low-lying electronic excitations in ZnTPP molecules, as well as collective light-matter couplings between ZnTPP and the quantized radiation modes, both of which are shown to be the key to accurately recovering the experimental spectra. We further analyzed to what extent the polariton and dark states are delocalized over many molecules, for the first time, using fully ab initio descriptions of the molecules. We finally investigate the line width as a function of detuning, providing new theoretical insights into the experimentally observed motional narrowing behavior. Our work presents first-ofits- kind theoretical studies on molecular polariton spectra, offering a new perspective on molecular polariton formation in realistic ab initio molecular systems whose rich, many-state nature provides spectral features enabled by the high density of electronic states beyond simple quantum optics models.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Language Model Combination and Adaptation Using Weighted Finite State Transducers

In speech recognition systems language model (LMs) are often constructed by training and combining multiple n-gram models. They can be either used to represent different genres or tasks found in diverse text sources, or capture stochastic properties of different linguistic symbol sequences, for example, syllables and words. Unsupervised LM adaption may also be used to further improve robustness to varying styles or tasks. When using these techniques, extensive software changes are often required. In this paper an alternative and more general approach based on weighted finite state transducers (WFSTs) is investigated for LM combination and adaptation. As it is entirely based on well-defined WFST operations, minimum change to decoding tools is needed. A wide range of LM combination configurations can be flexibly supported. An efficient on-the-fly WFST decoding algorithm is also proposed. Significant error rate gains of 7.3% relative were obtained on a state-of-the-art broadcast audio recognition task using a history dependently adapted multi-level LM modelling both syllable and word sequences

Liu, X.↗

Comparison and multi-model inference of excess risks models for radiation-related solid cancer

In assessments of detrimental health risks from exposures to ionising radiation, many forms of risk to dose–response models are available in the literature. The usual practice is to base risk assessment on one specific model and ignore model uncertainty. The analysis illustrated here considers model uncertainty for the outcome all solid cancer incidence, when modelled as a function of colon organ dose, using the most recent publicly available data from the Life Span Study on atomic bomb survivors of Japan. Seven recent publications reporting all solid cancer risk models currently deemed plausible by the scientific community have been included in a model averaging procedure so that the main conclusions do not depend on just one type of model. The models have been estimated with different baselines and presented for males and females at various attained ages and ages at exposure, to obtain specially computed model-averaged Excess Relative Risks (ERR) and Excess Absolute Risks (EAR). Monte Carlo simulated estimation of uncertainty on excess risks was accounted for by applying realisations including correlations in the risk model parameters. Three models were found to weight the model-averaged risks most strongly depending on the baseline and information criteria used for the weighting. Fitting all excess risk models with the same baseline, one model dominates for both information criteria considered in this study. Based on the analysis presented here, it is generally recommended to take model uncertainty into account in future risk analyses.

63 RADIATION, THERMAL, AND OTHER ENVIRON. POLLUTAN↗

Future Projections of the Large-Scale Meteorology Associated with California Heat Waves in CMIP5 Models

Previous work showed that climate models capture historical large-scale meteorological patterns (LSMPs) associated with California Central Valley heat waves including both ways these heat waves form. This work examines what models predict under the Representative Concentration Pathway (RCP) 4.5 and RCP8.5 scenarios. Model performance varies, so a multimodel average weights each model based on its historical performance in four parameters. An LSMP index (LSMPi) defined using upper atmosphere variables captures dates of past extreme surface temperature maxima. LSMPi correlates well with all values of California Central Valley-average surface maximum temperature. LSMPi distributions in future simulations shift ~0.6 standard deviations higher between 1961–2000 and 2061–2100 for RCP8.5 data. Based on the historical climatology, future scenarios show a large increase in the frequency and duration of heat waves in every model. Four times as many heat waves occur and their median duration doubles, using historical thresholds. Of the two ways heat waves form, Type 1 has similar frequency in the future. But, Type 2 becomes much more common because Type 2 has a preexisting hot anomaly in Southwestern Canada, much like the historical to future climatological change in that region (a “global warming” signal). The 20-year return value anomaly increases by 30–40%. The average of the 50 hottest temperatures increases 3.5–6 K depending on the scenario. When extreme values are defined using the future climatology, the models and their average have no consistent increase or decrease of distribution properties such as shape, scale, and return values of the extremes compared to historical values.

54 ENVIRONMENTAL SCIENCES↗

Taking climate model evaluation to the next level

We report that earth system models are complex and represent a large number of processes, resulting in a persistent spread across climate projections for a given future scenario. Owing to different model performances against observations and the lack of independence among models, there is now evidence that giving equal weight to each available model projection is suboptimal. This Perspective discusses newly developed tools that facilitate a more rapid and comprehensive evaluation of model simulations with observations, process-based emergent constraints that are a promising way to focus evaluation on the observations most relevant to climate projections, and advanced methods for model weighting. Lastly, these approaches are needed to distill the most credible information on regional climate changes, impacts, and risks for stakeholders and policy-makers.

54 ENVIRONMENTAL SCIENCES↗

Stabilising falling liquid film flows using feedback control

Falling liquid films become unstable due to inertial effects when the fluid layer is sufficiently thick or the slope sufficiently steep. This free surface flow of a single fluid layer has industrial applications including coating and heat transfer, which benefit from smooth and wavy interfaces, respectively. Here, we discuss how the dynamics of the system are altered by feedback controls based on observations of the interface height, and supplied to the system via the perpendicular injection and suction of fluid through the wall. In this study, we model the system using both Benney and weighted-residual models that account for the fluid injection through the wall. We find that feedback using injection and suction is a remarkably effective control mechanism: the controls can be used to drive the system towards arbitrary steady states and travelling waves, and the qualitative effects are independent of the details of the flow modelling. Furthermore, we show that the system can still be successfully controlled when the feedback is applied via a set of localised actuators and only a small number of system observations are available, and that this is possible using both static (where the controls are based on only the most recent set of observations) and dynamic (where the controls are based on an approximation of the system which evolves over time) control schemes. This study thus provides a solid theoretical foundation for future experimental realisations of the active feedback control of falling liquid films.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Data-Driven Robust M-LS-SVR-Based NARX Modeling for Estimation and Control of Molten Iron Quality Indices in Blast Furnace Ironmaking

Optimal operation of an industrial blast furnace (BF) ironmaking process largely depends on a reliable measurement of molten iron quality (MIQ), which is not feasible using the conventional sensors. This paper proposes a novel data-driven robust modeling method for online estimation and control of MIQ indices. First, to completely capture the nonlinear dynamics of the BF process, the nonlinear autoregressive exogenous (NARX) model is constructed for the MIQ indices. Then, considering that the standard least-squares support vector regression (LS-SVR) cannot directly cope with the multi-output problem, the multi- task transfer learning is proposed to design a novel multi-output LS-SVR (M-LS-SVR) for learning of the NARX model. Furthermore, a novel M-estimator is proposed to reduce the interference of outliers and improve the robustness of the M-LS- SVR model. Since the weights of different outlier data are properly given by the weight function, their corresponding contributions on modeling can be properly distinguished, thus a robust modeling result can be achieved. Finally, a novel multi- objective evaluation index on modeling performance is developed by comprehensively considering the root mean square error of modeling and the correlation coefficient on trend fitting, based on which the NSGA-II algorithm is used to globally optimize the model parameters. Both experiments using industrial data and industrial applications illustrate that the proposed method can eliminate the adverse effect caused by the fluctuation of data in BF process efficiently, which indicates its stronger robustness and higher accuracy. Moreover, control testing shows that the developed model can be well applied to realize data-driven control of the BF process.

blast cavities, Control↗

Taking Climate Model Evaluation to the Next Level

Earth system models are complex and represent a large number of processes, resulting in a persistent spread across climate projections for a given future scenario. Owing to different model performances against observations and the lack of independence among models, there is now evidence that giving equal weight to each available model projection is suboptimal. This Perspective discusses newly developed tools that facilitate a more rapid and comprehensive evaluation of model simulations with observations, process-based emergent constraints that are a promising way to focus evaluation on the observations most relevant to climate projections, and advanced methods for model weighting. These approaches are needed to distil the most credible information on regional climate changes, impacts, and risks for stakeholders and policy-makers.

Eyring, Veronika↗

Multidisciplinary Approach to Aerospike Nozzle Design

A model of a linear aerospike rocket nozzle that consists of coupled aerodynamic and structural analyses has been developed. A nonlinear computational fluid dynamics code is used to calculate the aerodynamic thrust, and a three-dimensional finite-element model is used to determine the structural response and weight. The model will be used to demonstrate multidisciplinary design optimization (MDO) capabilities for relevant engine concepts, assess performance of various MDO approaches, and provide a guide for future application development. In this study, the MDO problem is formulated using the multidisciplinary feasible (MDF) strategy. The results for the MDF formulation are presented with comparisons against separate aerodynamic and structural optimized designs. Significant improvements are demonstrated by using a multidisciplinary approach in comparison with the single-discipline design strategy.

Korte, J. J.↗

Multidisciplinary Approach to Linear Aerospike Nozzle Optimization

A model of a linear aerospike rocket nozzle that consists of coupled aerodynamic and structural analyses has been developed. A nonlinear computational fluid dynamics code is used to calculate the aerodynamic thrust, and a three-dimensional fink-element model is used to determine the structural response and weight. The model will be used to demonstrate multidisciplinary design optimization (MDO) capabilities for relevant engine concepts, assess performance of various MDO approaches, and provide a guide for future application development. In this study, the MDO problem is formulated using the multidisciplinary feasible (MDF) strategy. The results for the MDF formulation are presented with comparisons against sequential aerodynamic and structural optimized designs. Significant improvements are demonstrated by using a multidisciplinary approach in comparison with the single- discipline design strategy.

Korte, J. J.↗

Eulerian finite element simulations of the drop weight impact test with a dislocation Density-based continuum model

During a drop weight impact test, the kinetic energy of the falling weight is transferred into the sample resting on the anvil. The plastic deformation in the sample is an important mechanism for the dissipation of the input kinetic energy. We use Eulerian finite element analysis to simulate the deformation and temperature evolution in a 1,3,5-trinitro-1,3,5-triazine (RDX) sample consisting of multiple crystals. In Eulerian finite element simulations, the mesh moves relative to the material. After every change of position between the mesh and the material, the state variables are interpolated to the new mesh position, i.e., advection. In an effort to reduce the advection errors, we use a rate form of a dislocation density-based continuum model by Luscher et al. Here, the simulations predict localization of plastic deformation, and plastic dissipation as a significant source of heat generation.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗