Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Nonlinear models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,243 records · Page 69
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

Rates of Sea‐Level Rise Are Highly Sensitive to Ice Viscosity Parameters in Model Benchmarks

Glacier flow plays a major role in current and future rates of globally averaged sea-level rise. The viscosity of glacial ice, controlling the rate of flow, decreases as stress increases and is highly sensitive to the value of the stress exponent, $n$, in the constitutive equation for viscous flow. Glaciologists and climate modelers almost exclusively assume $n=3$ when modeling ice flow and projecting sea-level rise through forward modeling. However, recent work suggests that $n\approx 4$ better fits observations, prompting the question: How sensitive are projections of sea-level rise to the value of $n$? We use an established community ice flow model and standard benchmark experiments designed as an idealized representation of Pine Island Glacier, West Antarctica. While initializing an $n=3$ model to match observations of an $n=4$ ice sheet is possible, we find that incorrectly assuming $n=3$ when in fact $n=4$ dramatically underestimates rates of sea-level rise. The scale of this error grows nonlinearly with the magnitude of the climate forcing, acting to increase projection uncertainties. Additionally, we find that models often account for this stress-dependent rheology mismatch during model initialization in a way that masks this rheological effect in the short term while leaving model outputs vulnerable to larger biases in longer-term projections. Initializations to observations of Pine Island Glacier display similar rheology-mismatch fingerprints to our idealized example.

climate sensitivity↗
DOE OSTI2024

Semi-supervised Learning of Dynamical Systems with Neural Ordinary Differential Equations: A Teacher-Student Model Approach

Modeling dynamical systems is crucial for a wide range of tasks, but it remains challenging due to complex nonlinear dynamics, limited observations, or lack of prior knowledge. Recently, data-driven approaches such as Neural Ordinary Differential Equations (NODE) have shown promising results by leveraging the expressive power of neural networks to model unknown dynamics. However, these approaches often suffer from limited labeled training data, leading to poor generalization and suboptimal predictions. On the other hand, semi-supervised algorithms can utilize abundant unlabeled data and have demonstrated good performance in classification and regression tasks. We propose TS-NODE, the first semi-supervised approach to modeling dynamical systems with NODE. TS-NODE explores cheaply generated synthetic pseudo rollouts to broaden exploration in the state space and to tackle the challenges brought by lack of ground-truth system data under a teacher-student model. TS-NODE employs an unified optimization framework that corrects the teacher model based on the student's feedback while mitigating the potential false system dynamics present in pseudo rollouts. TS-NODE demonstrates significant performance improvements over a baseline Neural ODE model on multiple dynamical system modeling tasks.

Wang, Yu↗
DOE OSTI2025

Linking Pressure to Electrochemical Evolution in Solid-State Conversion Cathode Composites

Conversion-type cathodes, such as sulfur, FeS 2 , and FeF 3 , offer high theoretical capacities in solid-state lithium batteries but are hindered by substantial volume changes during cycling, leading to interfacial contact loss, crack formation, and microstructural degradation. Here, we investigate the relationships between electrochemical, mechanical, and structural evolution in solid-state electrode composites with these three active materials. Using real-time stack-pressure monitoring, synchrotron X-ray absorption spectroscopy, and electrokinetic modeling, we elucidate how stress evolution is linked to reversible and irreversible redox reactions. Nonlinear stack pressure evolution in cells with sulfur, FeS 2 , and FeF 3 electrode composites is found to arise from material-specific volume changes, the balance of volume change between the working and counter electrode, and the formation of distinct reaction intermediates. The three materials exhibit distinct stack pressure evolution, which is closely related to the different reaction processes in the materials, as demonstrated with X-ray absorption spectroscopy measurements. Through mesoscale modeling, we relate the experimental measurements to species evolution at the particle scale and track the dynamic coexistence of intermediate phases. Our findings highlight the importance of designing for volume changes of a given active material in solid-state battery systems.

batteries↗
DOE OSTI2022

Dark Energy Survey Year 3 results: Exploiting small-scale information with lensing shear ratios

Using the first three years of data from the Dark Energy Survey (DES), we use ratios of small-scale galaxy-galaxy lensing measurements around the same lens sample to constrain source redshift uncertainties, intrinsic alignments and other systematics or nuisance parameters of our model. Instead of using a simple geometric approach for the ratios as has been done in the past, we use the full modeling of the galaxy-galaxy lensing measurements, including the corresponding integration over the power spectrum and the contributions from intrinsic alignments and lens magnification. We perform extensive testing of the small-scale shear-ratio (SR) modeling by studying the impact of different effects such as the inclusion of baryonic physics, nonlinear biasing, halo occupation distribution descriptions and lens magnification, among others, and using realistic N -body simulations of the DES data. We validate the robustness of our constraints in the data by using two independent lens samples with different galaxy properties, and by deriving constraints using the corresponding large-scale ratios for which the modeling is simpler. The results applied to the DES Y3 data demonstrate how the ratios provide significant improvements in constraining power for several nuisance parameters in our model, especially on source redshift calibration and intrinsic alignments. For source redshifts, SR improves the constraints from the prior by up to 38% in some redshift bins. Such improvements, and especially the constraints it provides on intrinsic alignments, translate to tighter cosmological constraints when shear ratios are combined with cosmic shear and other 2pt functions. In particular, for the DES Y3 data, SR improves S 8 constraints from cosmic shear by up to 31%, and for the full combination of probes ( 3 × 2 pt ) by up to 10%. The shear ratios presented in this work are used as an additional likelihood for cosmic shear, 2 × 2 pt and the full 3 × 2 pt in the fiducial DES Y3 cosmological analysis.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2020

Application of Koopman operator for model-based control of fracture propagation and proppant transport in hydraulic fracturing operation

This work explores the application of the recently developed Koopman operator approach for model identification and feedback control of a hydraulic fracturing process. Controlling fracture propagation and proppant transport with precision is a challenge due in large part to the difficulty of constructing approximate models that accurately capture the characteristic moving boundary and highly-coupled dynamics exhibited by the process. Koopman operator theory is particularly attractive here as it offers a way to explicitly construct linear representations for even highly nonlinear dynamics. The method is data-driven and relies on lifting the states to an infinite-dimensional space of functions called observables where the dynamics are governed by a linear Koopman operator. Here this work considers two problems: (a) fracture geometry control, and (b) proppant concentration control. In both cases, an approximate linear model of the corresponding dynamics is constructed and used to design a model predictive controller (MPC). The manuscript shows that in the case of highly nonlinear dynamics, as observed in the proppant concentration, use of canonical functions in the observable basis fails. In such cases, a priori system knowledge can be leveraged to choose the required basis. The numerical experiments demonstrate that the Koopman linear model shows excellent agreement with the real system and successfully achieves the desired target values maximizing the oil and gas productivity. Additionally, due to its linear structure, the Koopman models allow convex MPC formulations that avoid any issues associated with nonlinear optimization.

42 ENGINEERING↗
DOE OSTI2024

Multi-Fidelity Modeling and Control for Building Temperature Control

The ability to control energy loads such as a building's heating, ventilation, and air conditioning (HVAC) system can help facilitate increased penetration of variable renewable energy sources into the electric grid. To be able to control these HVAC systems more effectively, detailed simulations of the corresponding building physics is becoming increasingly important. These detailed simulations can be complex, nonlinear, and can require immense computational power when used in an advanced control method such as model predictive control (MPC), prompting the need to explore less computationally intensive strategies. In this work, a multi-fidelity approach is proposed to combine samples from a complex, high-fidelity model with a simple, low-fidelity model within the MPC control loop. More specifically, the parameters of a reduced-order, linear building model are periodically updated with knowledge from its high-fidelity counterpart - an EnergyPlus model - in an online fashion using a Gaussian Process surrogate model. Hence, highly accurate predictions of current and future conditions in a building are maintained with a substantially reduced computational burden compared to using the high-fidelity models alone. In other words, this linear parameter varying model preserves the low computational requirements of a low-order linear model while accurately modeling a building's dynamics. This allows a building controller to take highly informed actions without requiring a large computational budget.

building modeling↗
DOE OSTI2022

Modeling approaches for addressing unrelaxable bound constraints with unconstrained optimization methods

We explore novel approaches for solving nonlinear optimization problems with unrelaxable bound constraints, which must be satisfied before the objective function can be evaluated. Our method reformulates the unrelaxable bound-constrained problem as an unconstrained optimization problem that is amenable to existing unconstrained optimization methods. The reformulation relies on a domain warping to form a merit function; the choice of the warping determines the level of exactness with which the unconstrained problem can be used to find solutions to the bound-constrained problem, as well as key properties of the unconstrained formulation such as smoothness. We develop theory when the domain warping is a multioutput sigmoidal warping, and we explore the practical elements of applying unconstrained optimization methods to the formulation. Here, we develop an algorithm that exploits the structure of the sigmoidal warping to guarantee that unconstrained optimization algorithms applied to the merit function will find a stationary point to the desired tolerance.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Deterministic symbolic regression with derivative information: General methodology and application to equations of state

Symbolic regression methods simultaneously determine the model functional form and the regression parameter values by generating expression trees. Symbolic regression can capture the complexity of real–world phenomena but the use of deterministic optimization for symbolic regression has been limited due to the complexity of the search space of existing formulations. Herein we present a novel deterministic mixed–integer nonlinear programming formulation for symbolic regression that incorporates derivative constraints through auxiliary expression trees. By applying the chain rule to mathematical operations, binary expression trees are capable of representing the calculation of first and second derivatives. We apply this formulation to illustrative examples using derivative information to show increased model discrimination capability. In addition, we perform a case study of a thermodynamic equation of state to gain insight on valid functional forms with thermodynamics–based constraints on the first and second derivatives.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

A modal wave-packet model for the multi-mode Richtmyer–Meshkov instability

In this work, a model for multimode perturbations subject to the Richtmyer–Meshkov (RM) instability is presented and compared with simulations and experiments for conditions relevant to inertial confinement fusion. The model utilizes the single mode response to the RM impulse whereby its amplitude h(k, t) first grows with an initial velocity V 0 ∝ kh(k, 0) that eventually decays in time as 1/kV 0 t. Both the growth and saturation stages are subject to nonlinearities since they depend explicitly on the initial amplitude. However, rather than using the individual mode amplitude h(k, t), nonlinearity is taken to occur when the root-mean-square amplitude h rms (k, t) of a wave-packet within wavenumbers k ± δk becomes comparable to 1/k. This is done because nearby sidebands can act in unison for an auto-correlation distance 1/δk beyond nonlinearity as observed in the beam-plasma instability. Thus, the nonlinear saturation amplitude for each mode is reduced from the usual 1/k by a phase space factor that depends on the physical dimensionality, as in the Haan model for the Rayleigh–Taylor instability. In addition, for RM, the average value of kh rms for the initial spectrum is used to calculate a nonlinear factor F NL that reduces V 0 , as observed for single modes. For broadband perturbations, the model describes self-similar growth ∝t θ as successively longer wavelength modes reach saturation. The growing and saturated modes must be discerned because only the former promote θ and are enhanced by reshock and spherical convergence. All of these flows are described here by the model in good agreement with simulations and experiments.

42 ENGINEERING↗
DOE OSTI2021

Integrating deep neural networks with full-waveform inversion: Reparameterization, regularization, and uncertainty quantification

Full-waveform inversion (FWI) is an accurate imaging approach for modeling the velocity structure by minimizing the misfit between recorded and predicted seismic waveforms. However, the strong nonlinearity of FWI resulting from fitting oscillatory waveforms can trap the optimization in local minima. We have adopted a neural-network-based full-waveform inversion (NNFWI) method that integrates deep neural networks with FWI by representing the velocity model with a generative neural network. Neural networks can naturally introduce spatial correlations as regularization to the generated velocity model, which suppresses noise in the gradients and mitigates local minima. Furthermore, the velocity model generated by neural networks is input to the same partial differential equation (PDE) solvers used in conventional FWI. The gradients of the neural networks and PDEs are calculated using automatic differentiation, which back propagates gradients through the acoustic PDEs and neural network layers to update the weights of the generative neural network. Experiments on 1D velocity models, the Marmousi model, and the 2004 BP model determine that NNFWI can mitigate local minima, especially for imaging high-contrast features such as salt bodies, and it significantly improves the inversion in the presence of noise. Adding dropout layers to the neural network model also allows analyzing the uncertainty of the inversion results through Monte Carlo dropout. NNFWI opens a new pathway to combine deep learning and FWI for exploiting the characteristics of deep neural networks and the high accuracy of PDE solvers. Because NNFWI does not require extra training data and optimization loops, it provides an attractive and straightforward alternative to conventional FWI.

58 GEOSCIENCES↗
DOE OSTI2022

LOKI

LOKI is a simulation code that models weakly-coupled plasma evolution using Eulerian kinetic models in four phase space dimensions. The code is useful to understand basic plasma nonlinear plasma physics phenomena - in particular, wave-particle and wave-wave resonances that occur in laser plasma interactions. LOKI can simulate fundamental physical process in low-density plasmas on a scale of hundreds of light wavelengths. It does so by solving the relativistic Vlasov and Valsov-Fokker-Planck differential transport equations describing the collision less and low-collisionality evolution of charged particles in electromagnetic fields in two configuration space and two velocity space dimensions. Two principle electromagnetic models are provided: electrostatic (Poisson's Equation) and electromagnetic (Maxwell's equations).

DIMITS, ANDRIS↗
DOE OSTI2025

Kernel Manifolds: Nonlinear‐Augmentation Dimensionality Reduction Using Reproducing Kernel Hilbert Spaces

This paper generalizes recent advances on quadratic manifold (QM) dimensionality reduction by developing kernel methods-based nonlinear-augmentation dimensionality reduction. QMs, and more generally feature map-based nonlinear corrections, augment linear dimensionality reduction with a nonlinear correction term in the reconstruction map to overcome approximation accuracy limitations of purely linear approaches. While feature map-based approaches typically learn a least squares optimal polynomial correction term, we generalize this approach by learning an optimal nonlinear correction from a user-defined reproducing kernel Hilbert space. Our approach allows one to impose arbitrary nonlinear structure on the correction term, including polynomial structure, and includes feature map and radial basis function-based corrections as special cases. Furthermore, our method has relatively low training cost and has monotonically decreasing error as the latent space dimension increases. In conclusion, we compare our approach to proper orthogonal decomposition and several recent QM approaches on data from several example problems.

kernel methods↗
DOE OSTI2020

Data-driven learning of nonlocal physics from high-fidelity synthetic data

A key challenge to nonlocal models is the analytical complexity of deriving them from first principles, and frequently their use is justified a posteriori. Here, we extract nonlocal models from data, circumventing these challenges and providing data-driven justification for the resulting model form. Extracting data-driven surrogates is a major challenge for machine learning (ML) approaches, due to nonlinearities and lack of convexity — it is particularly challenging to extract surrogates which are provably well-posed and numerically stable. Our scheme not only yields a convex optimization problem, but also allows extraction of nonlocal models whose kernels may be partially negative while maintaining well-posedness even in small-data regimes. To achieve this, based on established nonlocal theory, we embed in our algorithm sufficient conditions on the non-positive part of the kernel that guarantee well-posedness of the learnt operator. These conditions are imposed as inequality constraints to meet the requisite conditions of the nonlocal theory. We demonstrate this workflow for a range of applications, including reproduction of manufactured nonlocal kernels; numerical homogenization of Darcy flow associated with a heterogeneous periodic microstructure; nonlocal approximation to high-order local transport phenomena; and approximation of globally supported fractional diffusion operators by truncated kernels.

42 ENGINEERING↗
DOE OSTI2021

Estimates of Alpha/Beta (α/β) Ratios for Individual Late Rectal Toxicity Endpoints: An Analysis of the CHHiP Trial

Changes in fraction size of external beam radiation therapy exert nonlinear effects on subsequent toxicity. Commonly described by the linear-quadratic model, fraction size sensitivity of normal tissues is expressed by the α/β ratio. We sought to study individual α/β ratios for different late rectal effects after prostate external beam radiation therapy.

62 RADIOLOGY AND NUCLEAR MEDICINE↗
DOE OSTI2023

PCAfold 2.0—Novel tools and algorithms for low-dimensional manifold assessment and optimization

We describe an update to our open-source Python package, PCAfold, designed to help researchers generate, analyze and improve low-dimensional data manifolds. In the current version, PCAfold 2.0, we introduce novel tools and algorithms for assessing and optimizing low-dimensional manifolds. This includes a method that generates a “map” of local feature sizes that can help pinpoint researchers to problematic regions on a manifold. We introduce a novel cost function that characterizes the quality of a manifold topology with a single number. We develop two algorithms for feature selection based on principal component analysis (PCA) that use the cost function as an objective function to minimize. We introduce a quantity of interest (QoI)-aware dimensionality reduction strategy where data projections are computed using an artificial neural network and are directly optimized towards representing various projection-independent and projection-dependent QoIs. We also introduce an implementation of partition of unity networks (POUnets) for efficient reconstruction of QoIs from low-dimensional manifolds based on combining neural network classification with localized polynomial regression. Our software can be broadly applicable in all domains of science and engineering that aim to reduce data dimensionality, as well as in the fundamental research on representation learning.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Active Site Engineering via Optimizing the Heterogeneous Support Structure for Single-Atom Catalysis

Supported single-atom catalysts show a large range of activities and selectivities that depend on the local environment of the catalytic sites. Here a theory-based optimization strategy is presented that is based on a density functional theory determination of the transition states and intermediates for a low-dimensional coordinate representation of the heterogeneity of the active sites. The approach is applied to a vanadium catalyst on an amorphous SiO 2 support that involves a large kinetic network described using a full chemistry model. Without assuming a priori scaling relations or mechanism reduction, the optimal state of heterogeneity is found to lie at atomic configurations where the activation energies for two distinct key chemical processes are equal. It is found a posteriori that the behavior of the system is consistent with linear free energy scaling relations in the randomness parameters. The energetic span theory proves quite useful in reducing the full chemistry model to a small number of key reactions. The use of a nonlinear optimization algorithm in combination with energetic span theory provides significant simplification in treating disordered systems.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

Plasma thermal-chemical instability of low-temperature dimethyl ether oxidation in a nanosecond-pulsed dielectric barrier discharge

Plasma stability in reactive mixtures is critical for various applications from plasma-assisted combustion to gas conversion. To generate stable and uniform plasmas and control the transition towards filamentation, the underlying physics and chemistry need a further look. Here, this work investigates the plasma thermal-chemical instability triggered by dimethyl-ether (DME) low-temperature oxidation in a repetitive nanosecond pulsed dielectric barrier discharge. First, a plasma-combustion kinetic mechanism of DME/air is developed and validated using temperature and ignition delay time measurements in quasi-uniform plasmas. Then the multi-stage dynamics of thermal-chemical instability is experimentally explored: the DME/air discharge was initially uniform, then contracted to filaments, and finally became uniform again before ignition. By performing chemistry modeling and analyzing the local thermal balance, it is found that such nonlinear development of the thermal-chemical instability is controlled by the competition between plasma-enhanced low-temperature heat release and the increasing thermal diffusion at higher temperature. Further thermal-chemical mode analysis identifies the chemical origin of this instability as DME low-temperature chemistry. This work connects experiment measurements with theoretical analysis of plasma thermal-chemical instability and sheds light on future chemical control of the plasma uniformity.

repetitive nanosecond pulses↗
DOE OSTI2022

Second-order magnetic responses in quantum magnets: Magnetization under ac magnetic fields

Here we investigate second-order magnetic responses of quantum magnets against ac magnetic fields. We focus on the case where the z component of the spin is conserved in the unperturbed Hamiltonian and the driving field is applied in the xy plane. We find that linearly polarized driving fields induce a second-harmonic response, while circularly polarized fields generate only a zero-frequency response, leading to a magnetization with a direction determined by the helicity. Employing an unbiased numerical method, we demonstrate the nonlinear magnetic effect driven by the circularly polarized field in the XXZ model and show that the magnitude of the magnetization can be predicted by the dynamical spin structure factor in the linear response regime.

36 MATERIALS SCIENCE↗