Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Nonlinear projection”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6

Multifidelity Ensemble Kalman Filtering Using Surrogate Models Defined by Theory-Guided Autoencoders

Data assimilation is a Bayesian inference process that obtains an enhanced understanding of a physical system of interest by fusing information from an inexact physics-based model, and from noisy sparse observations of reality. The multifidelity ensemble Kalman filter (MFEnKF) recently developed by the authors combines a full-order physical model and a hierarchy of reduced order surrogate models in order to increase the computational efficiency of data assimilation. The standard MFEnKF uses linear couplings between models, and is statistically optimal in case of Gaussian probability densities. This work extends the MFEnKF into to make use of a broader class of surrogate model such as those based on machine learning methods such as autoencoders non-linear couplings in between the model hierarchies. We identify the right-invertibility property for autoencoders as being a key predictor of success in the forecasting power of autoencoder-based reduced order models. We propose a methodology that allows us to construct reduced order surrogate models that are more accurate than the ones obtained via conventional linear methods. Numerical experiments with the canonical Lorenz'96 model illustrate that nonlinear surrogates perform better than linear projection-based ones in the context of multifidelity ensemble Kalman filtering. We additionality show a large-scale proof-of-concept result with the quasi-geostrophic equations, showing the competitiveness of the method with a traditional reduced order model-based MFEnKF.

97 MATHEMATICS AND COMPUTING↗

Multigrid Algorithms with Projection and Prolongation over Elements of the Phase Space for K-Eigenvalue Transport Problems

This paper describes new multilevel acceleration methods for solving the multigroup neu- tron transport eigenvalue problems. These multilevel algorithms use different projection and prolongation operators in the phase space. The Nonlinear Diffusion Acceleration (NDA) method with multiple grids in energy is formulated with the prolongation oper- ator based on multiplication iterative correction and linear-in-energy mapping. Another multilevel NDA method uses the projection operator with coarsening in energy between the high-order transport and low-order NDA equations. The third algorithm is formu- lated with the partial-current based CMFD low-order equations and applies projection operators in space and energy. The numerical results are presented.

Cornejo, Luke↗

Wide-Bandgap Semiconductor Amplifiers for Fusion Plasma Heating and Control

This paper discusses power electronics developed under the ARPA-E GAMOW program to support nuclear fusion power production. The goal of this project was to develop and assess the potential for wide-bandgap (WBG) semiconductor devices in power electronics to enable high-efficiency and high-voltage solid-state systems for fusion plasma generation, heating, and control. The power electronics use an architecture in which multiple high-power boards can be combined to produce megawatt-level power, where using multiple boards provides high reliability. Two main areas of power electronics boards are developed in this project for fusion plasma heating and control applications: (1) pulse generation and control and (2) radiofrequency generation. The first area is for boards capable of driving high-voltage millisecond pulses at high duty cycles. The envisioned application of these pulses is in plasma control of magnetohydrodynamic instabilities, plasma position, and edge-localized modes. Pulse-width modulation allows for the implementation of a wide variety of linear and nonlinear control systems. The boards developed for this project could actuate control coils based on digital input signals and can be parallelized to provide megawatts of output power. The design of the pulse generator is a low-side load switch. A load switch was designed and constructed that utilized 2-kV-rated field-effect transistor (FET)-based cascodes developed by Qorvo under this project to perform initial testing of these cascodes. The second area is being implemented using class E amplifiers with WBG devices and a reactance steering network to handle inductive or capacitive plasma loads. Applications include ion cyclotron resonance heating (ICRH) and high-harmonic fast-wave (HHFW) heating. A class E reactance steering network is demonstrated in modeling and experiment with a resistive-inductive load that models an inductively-coupled plasma. Power combining of boards with class E reactance steering networks is also simulated and demonstrated experimentally, to enable scaling up to high power. Modeling of high-power-density cooling and remaining useful life is conducted to enable reliable, effectively cooled high-power electronics for fusion applications.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Modeling and Control of the Automated Radiator Inspection Device

Many of the operations performed at the Kennedy Space Center (KSC) are dangerous and repetitive tasks which make them ideal candidates for robotic applications. For one specific application, KSC is currently in the process of designing and constructing a robot called the Automated Radiator Inspection Device (ARID), to inspect the radiator panels on the orbiter. The following aspects of the ARID project are discussed: modeling of the ARID; design of control algorithms; and nonlinear based simulation of the ARID. Recommendations to assist KSC personnel in the successful completion of the ARID project are given.

Dawson, Darren↗

Train Like a (Var)Pro: Efficient Training of Neural Networks with Variable Projection

Deep neural networks (DNNs) have achieved state-of-the-art performance across a variety of traditional machine learning tasks, e.g., speech recognition, image classification, and segmentation. The ability of DNNs to efficiently approximate high-dimensional functions has also motivated their use in scientific applications, e.g., to solve partial differential equations and to generate surrogate models. In this paper, we consider the supervised training of DNNs, which arises in many of the above applications. We focus on the central problem of optimizing the weights of the given DNN such that it accurately approximates the relation between observed input and target data. Devising effective solvers for this optimization problem is notoriously challenging due to the large number of weights, nonconvexity, data sparsity, and nontrivial choice of hyperparameters. To solve the optimization problem more efficiently, we propose the use of variable projection (VarPro), a method originally designed for separable nonlinear least-squares problems. Our main contribution is the Gauss--Newton VarPro method (GNvpro) that extends the reach of the VarPro idea to nonquadratic objective functions, most notably cross-entropy loss functions arising in classification. These extensions make GNvpro applicable to all training problems that involve a DNN whose last layer is an affine mapping, which is common in many state-of-the-art architectures. In our four numerical experiments from surrogate modeling, segmentation, and classification, GNvpro solves the optimization problem more efficiently than commonly used stochastic gradient descent (SGD) schemes. Finally, GNvpro finds solutions that generalize well, and in all but one example better than well-tuned SGD methods, to unseen data points.

97 MATHEMATICS AND COMPUTING↗

Nonlinear analyses of composite aerospace structures in sonic fatigue

This report summarizes the semiannual research progress, accomplishments, and future plans performed under the NASA Langley Research Center Grant No. NAG-1-1358. The primary research effort of this project is the development of analytical methods for the prediction of nonlinear random response of composite aerospace structures subjected to combined acoustic and thermal loads. The progress, accomplishments, and future plates on four sonic fatigue research topics are described. The sonic fatigue design and passive control of random response of shape memory alloy hybrid composites presented in section 4, which is suited especially for HSCT, is a new initiative.

Mei, Chuh↗

Functional expansion representations of artificial neural networks

In the past few years, significant interest has developed in using artificial neural networks to model and control nonlinear dynamical systems. While there exists many proposed schemes for accomplishing this and a wealth of supporting empirical results, most approaches to date tend to be ad hoc in nature and rely mainly on heuristic justifications. The purpose of this project was to further develop some analytical tools for representing nonlinear discrete-time input-output systems, which when applied to neural networks would give insight on architecture selection, pruning strategies, and learning algorithms. A long term goal is to determine in what sense, if any, a neural network can be used as a universal approximator for nonliner input-output maps with memory (i.e., realized by a dynamical system). This property is well known for the case of static or memoryless input-output maps. The general architecture under consideration in this project was a single-input, single-output recurrent feedforward network.

Gray, W. Steven↗

S-OPT: A Points Selection Algorithm for Hyper-Reduction in Reduced Order Models

While projection-based reduced order models can reduce the dimension of full order solutions, the resulting reduced models may still contain terms that scale with the full order dimension. Hyper-reduction techniques are sampling-based methods that further reduce this computational complexity by approximating such terms with a much smaller dimension. The goal of this work is to introduce the points selection algorithm developed by Shin and Xiu as a hyper-reduction method. The selection algorithm was originally proposed as a stochastic collocation method for uncertainty quantification. Since the algorithm aims at maximizing a quantity $\mathcal{S}$ that measures both the column orthogonality and the determinant, we refer to the algorithm as S-OPT. Numerical examples are provided to demonstrate the performance of S-OPT and to compare its performance with a gappy proper orthogonal decomposition (POD) algorithm. Here, we found that using the S-OPT algorithm is shown to predict the full order solutions with higher accuracy than gappy POD especially when the number of sampling points is small, although we note that S-OPT shows slow asymptotic convergence with respect to the number of samples for some applications, e.g., Lagrangian hydrodynamics.

97 MATHEMATICS AND COMPUTING↗

Variational objective analysis for cyclone studies

Significant accomplishments during 1987 to 1988 are summarized with regard to each of the major project components. Model 1 requires satisfaction of two nonlinear horizontal momentum equations, the integrated continuity equation, and the hydrostatic equation. Model 2 requires satisfaction of model 1 plus the thermodynamic equation for a dry atmosphere. Model 3 requires satisfaction of model 2 plus the radiative transfer equation. Model 4 requires satisfaction of model 3 plus a moisture conservation equation and a parameterization for moist processes.

Achtemeier, Gary L.↗

Free-Surface and Contact Line Motion of Liquid in Microgravity

This project involves fundamental studies of the role of nonlinearity in determining the motion of liquid masses under the principal influences of surface tension, viscosity and inertia. Issues to be explored are relevant to aspects of terrestrial processes, as well as being immediately applicable to fluid management in a low-gravity environment. Specific issues include: (1) the mechanic's of liquid masses in large-amplitude motions, (2) the influence of bounding surfaces on the motion, and (3) the ability of such surfaces to control liquid motion by wetting forces, especially when they are augmented by various surface treatments. Mathematical techniques include asymptotic analysis of the governing equations, for problem simplification, and numerical simulation, using both boundary-element and finite-difference methods. The flow problem is divided into an 'outer' or inviscid potential-flow region and one or more inner, or viscous dominated, regions. Relevant to one inner region, the vicinity of the contact line, we discuss time-dependent simulation of slow droplet motion, on a surface of variable wettability, using the lubrication approximation. The simulation uses a disjoining pressure model and reproduces realistic wetting-dewetting behavior.

Schwartz, Leonard W.↗

Reduced-Order Modeling of a Heaving Airfoil

A reduced-order model of a flapping airfoil is developed using Proper Orthogonal Decomposition (POD). The proper basis functions, developed from snapshots of full Navier-Stokes simulations, are used for a Galerkin projection of the governing equations. The resulting coupled, nonlinear ordinary di.erential equations have a low dimension because the first few basis members capture most of the energy of the flow. The reduced-order model is used to simulate heaving motions that are both similar to and different from the motion(s) used to generate the basis functions, and the errors in the model are quantified. Several methods are used to generate mode sets that can be used over a range of heaving parameters, including snapshots from one, two, and multiple Navier-Stokes simulations. As snapshots from additional simulations are added to the decomposition, the mode sets become richer and can simulate a wider range of parameter space, at some computational cost. Whereas the POD method is fully applicable in three dimensions, the simulation technique based on a body-fixed and body-fitted grid suffers large overhead when extended to three dimensions. To reduce the overhead, an embedding technique is discussed which embeds the solid wing into a fixed Cartesian grid. The wing, which can now have multiple pieces and also be flexible, is represented by a distribution of body forces. This distribution is determined to give exactly the flow around a flapping wing.

Haj-Hariri, H.↗

Explaining drivers of housing prices with nonlinear hedonic regressions

Housing markets play a critical role in shaping the spatial and demographic evolution of urban areas. Simulating housing price dynamics can enhance projections of future urban development outcomes. However, traditional hedonic regressions for housing prices, which neglect nonlinear interactions among explanatory variables, often exhibit limited predictive performance. While machine learning (ML) methods can provide a more flexible representation of the relationships between predictors, they are often regarded as “black boxes” due to their complexity and lack of transparency. Interpretable ML techniques provide a promising route by combining the flexibility of ML methods with approaches to analyze the relationships between inputs and outputs. In this study, we employ interpretable ML to analyze the patterns driving the housing market in Baltimore, Maryland, USA. We train an Artificial Neural Network (ANN) to predict Baltimore housing prices based on structural characteristics (e.g., home size, number of stories) and locational attributes (e.g., distance to the city center). We then conduct sensitivity and Partial Dependence Plot (PDP) analyses to interpret the fitted ANN model. We find that the ML model achieves higher predictive accuracy and explains 16 % more of housing price variance than a traditional linear regression model. The interpretable ML model also reveals more nuanced and realistic nonlinear relationships between housing sales price and predictors as well as interactive effects underlying Baltimore home price dynamics. For instance, while the linear model indicates a steady housing price increase over time, our interpretable ML model detects a post-2008 decline, with smaller properties experiencing the sharpest drop.

97 MATHEMATICS AND COMPUTING↗

Elastomeric Structural Attachment Concepts for Aircraft Flap Noise Reduction - Challenges and Approaches to Hyperelastic Structural Modeling and Analysis

Airframe noise is a significant part of the overall noise of transport aircraft during the approach and landing phases of flight. Airframe noise reduction is currently emphasized under the Environmentally Responsible Aviation (ERA) and Fixed Wing (FW) Project goals of NASA. A promising concept for trailing-edge-flap noise reduction is a flexible structural element or link that connects the side edges of the deployable flap to the adjacent main-wing structure. The proposed solution is distinguished by minimization of the span-wise extent of the structural link, thereby minimizing the aerodynamic load on the link structure at the expense of increased deformation requirement. Development of such a flexible structural link necessitated application of hyperelastic materials, atypical structural configurations and novel interface hardware. The resulting highly-deformable structural concept was termed the FLEXible Side Edge Link (FLEXSEL) concept. Prediction of atypical elastomeric deformation responses from detailed structural analysis was essential for evaluating feasible concepts that met the design constraints. The focus of this paper is to describe the many challenges encountered with hyperelastic finite element modeling and the nonlinear structural analysis of evolving FLEXSEL concepts. Detailed herein is the nonlinear analysis of FLEXSEL concepts that emerged during the project which include solid-section, foamcore, hollow, extended-span and pre-stressed concepts. Coupon-level analysis performed on elastomeric interface joints, which form a part of the FLEXSEL topology development, are also presented.

Sreekantamurthy, Thammaiah↗

Adaptive nonlinear optimization of the signal-to-noise ratio of an array subject to a constraint.

Investigation of a stochastic projected gradient algorithm which can be used to find a constrained optimum point for a concave or convex objective function subject to nonlinear constraints. When the constraint consists of only one linear equation, convergence to the constrained optimum value is proven, and bounds are obtained for the rate of convergence of the algorithm to the constrained optimum value. This algorithm is then applied to the nonlinear problem of automatically making an array of detectors form a beam in a desired direction in space when unknown interfering noise is present so as to maximize the signal-to-noise ratio subject to a constraint on the supergain ratio.

Winkler, L. P.↗

Parallel-in-Time Methods for Method-of-Lines Discretizations of Nonlinear Hyperbolic PDEs and Systems (Final Report)

The work for the subcontract is situated in the area of parallel-in-time integration for hyperbolic partial differential equations (PDEs). Parallel-in-time integration is an active area of research due to its ability to enable faster numerical simulations for applications throughout many areas of science. The work in this subcontract builds on a variety of results that were obtained, as part of the work performed for Subcontract No. B648355, for the Multigrid Reduction-in-Time (MGRIT) method from [1] applied to hyperbolic PDEs. This subcontract extends these results further to more efficient methods and to the case of method-of-lines discretizations for nonlinear hyperbolic PDES and systems of PDEs. The following is a summary of the research performed and results achieved during milestone periods 1, 2 and 3 by the PI (Hans De Sterck) and Postdoctoral Research Associate (Oliver Krzysik), for required tasks 1-4 (as listed in the Statement of Work): Research over the previous year has been split into three main projects: (i) solution of acoustic equation system; (ii) solution of nonlinear scalar hyperbolic PDEs; (iii) solution of nonlinear hyperbolic systems of PDEs.

97 MATHEMATICS AND COMPUTING↗

Variational multiscale reinforcement learning for discovering reduced order closure models of nonlinear spatiotemporal transport systems

Abstract A central challenge in the computational modeling and simulation of a multitude of science applications is to achieve robust and accurate closures for their coarse-grained representations due to underlying highly nonlinear multiscale interactions. These closure models are common in many nonlinear spatiotemporal systems to account for losses due to reduced order representations, including many transport phenomena in fluids. Previous data-driven closure modeling efforts have mostly focused on supervised learning approaches using high fidelity simulation data. On the other hand, reinforcement learning (RL) is a powerful yet relatively uncharted method in spatiotemporally extended systems. In this study, we put forth a modular dynamic closure modeling and discovery framework to stabilize the Galerkin projection based reduced order models that may arise in many nonlinear spatiotemporal dynamical systems with quadratic nonlinearity. However, a key element in creating a robust RL agent is to introduce a feasible reward function, which can be constituted of any difference metrics between the RL model and high fidelity simulation data. First, we introduce a multi-modal RL to discover mode-dependant closure policies that utilize the high fidelity data in rewarding our RL agent. We then formulate a variational multiscale RL (VMRL) approach to discover closure models without requiring access to the high fidelity data in designing the reward function. Specifically, our chief innovation is to leverage variational multiscale formalism to quantify the difference between modal interactions in Galerkin systems. Our results in simulating the viscous Burgers equation indicate that the proposed VMRL method leads to robust and accurate closure parameterizations, and it may potentially be used to discover scale-aware closure models for complex dynamical systems.

97 MATHEMATICS AND COMPUTING↗

The 1996 Mid-Atlantic Winter Flood: Exploring Climate Risk through a Storyline Approach

Abstract This article explores the application of thermodynamic perturbations to a historical midlatitude, wintertime, rain-on-snow flood event to evaluate how similar events may evolve under different climate forcings. In particular, we generate a hindcast of the 1996 Mid-Atlantic flood using an ensemble of 14-km variable-resolution simulations completed with the U.S. Department of Energy’s global Energy Exascale Earth System Model (E3SM). We show that the event is skillfully reproduced over the Susquehanna River Basin (SRB) by E3SM when benchmarked against in situ observational data and high-resolution reanalyses. In addition, we perform five counterfactual experiments to simulate the flood under preindustrial conditions and four different levels of warming as projected by the Community Earth System Model Large Ensemble. We find a nonlinear response in simulated surface runoff and streamflow as a function of atmospheric warming. This is attributed to changing contributions of liquid water input from a shallower initial snowpack (decreased snowmelt), increased surface temperatures and rainfall rates, and increased soil water storage. Flooding associated with this event peaks from around +1 to +2 K of global average surface warming and decreases with additional warming beyond this. There are noticeable timing shifts in peak runoff and streamflow associated with changes in the flashiness of the event. This work highlights the utility of using storyline approaches for communicating climate risk and demonstrates the potential nonlinearities associated with hydrologic extremes in areas that experience ephemeral snowpack, such as the SRB.

Meteorology & Atmospheric Sciences↗

Projection-based multifidelity linear regression for data-scarce applications

Surrogate modeling for systems with high-dimensional quantities of interest remains challenging, particularly when training data are costly to acquire. This work develops multifidelity methods for multiple-input multiple-output linear regression targeting data-limited applications with high-dimensional outputs. Multifidelity methods integrate many inexpensive low-fidelity model evaluations with limited, costly high-fidelity evaluations. We introduce two projection-based multifidelity linear regression approaches with linear and nonlinear features that leverage principal component basis vectors for dimensionality reduction and combine multifidelity data through: (i) a direct data augmentation using low-fidelity data, and (ii) a data augmentation incorporating explicit linear corrections between low-fidelity and high-fidelity data. The data augmentation approaches combine high-fidelity and low-fidelity data into a unified training set and train the linear regression model through weighted least squares with fidelity-specific weights. We introduce a proximity-based weighting scheme with automatic weight selection strategy through cross-validation. Here, the proposed multifidelity linear regression methods are demonstrated on approximating the surface pressure field of a hypersonic vehicle in flight and the temperature field on an aircraft disc braking system. In an ultra low-data regime of no more than twelve high-fidelity samples, multifidelity linear regression achieves approximately 2% – 12% improvement in median accuracy and a higher R 2 score relative to single-fidelity methods at comparable computational cost.

data augmentation↗