Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “gradient methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 577 records · Page 32

Effects of Jacobian Matrix Regularization on the Detectability of Adversarial Samples

The well-known vulnerability of Deep Neural Networks to adversarial samples has led to a rapid cycle of increasingly sophisticated attack algorithms and proposed defenses. While most contemporary defenses have been shown to be vulnerable to carefully configured attacks, methods based on gradient regularization and out-of-distribution detection have attracted much interest recently by demonstrating higher resilience to a broad range of attack algorithms. However, no study has yet investigated the effect of combining these techniques. In this paper, we consider the effect of Jacobian matrix regularization on the detectability of adversarial samples on the CIFAR-10 image benchmark dataset. We find that regularization has a significant effect on detectability, and in some cases can make an undetectable attack on a baseline model detectable. In addition, we give evidence that regularization may mitigate the known weaknesses of detectors to high-confidence adversarial samples. The defenses we consider here are highly generalizable, and we believe they will be useful for further investigations to transfer machine learning robustness to other data domains.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

Samoa Updater: An Application of the Levenberg-Marquardt Method to Update DELFIC Predictions Using Field Measurements

The US Department of Energy (DOE) Forensics Operations (DFO) is a member of the Ground Collections Task Force (GCTF), which is responsible for sample collection of radiological debris for attribution should a nuclear detonation ever occur in the United States. The DFO runs the Defense Land Fallout Interpretive Code (DELFIC) Fallout Planning Tool to predict the deposition of fallout from a nuclear detonation. This prediction is refined using the DELFIC Updater tool, which takes ground measurements and adjusts DELFIC inputs to minimize the difference between prediction and observation, yielding improved predictions of fallout in locations both measured and not yet measured. Samoa, a framework for uncertainty analysis and optimization, is used to improve DELFIC predictive fallout modeling. This new capability using Samoa, dubbed “Samoa Updater,” is compared with the current DELFIC Updater, a brute-force sampling approach. Samoa Updater uses the Levenberg– Marquardt (LM) method, a gradient-based nonlinear least squares approach that uses the functional shape of the input space to increase optimization speed. In simulated test cases Samoa Updater yields faster and more accurate solutions than the current Updater.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

What Makes You Hold on to That Old Car? Joint Insights From Machine Learning and Multinomial Logit on Vehicle-Level Transaction Decisions

What makes you hold on to that old car? While the vast majority of household vehicles are still powered by conventional internal combustion engines, the progress of adopting emerging vehicle technologies will critically depend on how soon the existing vehicles are transacted out of the household fleet. Leveraging a nationally representative longitudinal data set, the Panel Study of Income Dynamics, this study examines how household decisions to dispose of or replace a given vehicle are: 1) influenced by the vehicle’s attributes, 2) mediated by households’ concurrent socio-demographic and economic attributes, and 3) triggered by key life cycle events. Coupled with a newly developed machine learning interpretation tool, TreeExplainer, we demonstrate an innovative use of machine learning models to augment traditional logit modeling to both generate behavioral insights and improve model performance. We find the two gradient-boosting-based methods, CatBoost and LightGBM, are the best performing machine learning models for this problem. The multinomial logistic model can achieve similar performance levels after its model specification is informed by TreeExplainer. Both machine learning and multinomial logit models suggest that while older vehicles are more likely to be disposed of or replaced than newer ones, such probability decreases as the vehicles serve the family longer. Pickup trucks and sport utility vehicles are less likely to be disposed of or replaced than cars, and leased vehicles are more likely to be transacted than owned vehicles. We find that married families, families with higher education levels, homeowners, and older families tend to keep their vehicles longer. Life events such as childbirth, residential relocation, and change of household composition and income are found to increase vehicle disposal and/or replacement. We provide additional insights on the timing of vehicle replacement or disposal, in particular, the presence of children and childbirth events are more strongly associated with vehicle replacement among younger parents.

33 ADVANCED PROPULSION SYSTEMS↗

Approximate analysis of thermal convection in a crystal-growth cell for Spacelab 3

The transient and steady thermal convection in microgravity is described. The approach is applicable to many three dimensional flows in containers of various shapes with various thermal gradients imposed. The method employs known analytical solutions to two dimensional thermal flows in simpler geometries, and does not require recourse to numerical calculations by computer.

Dressler, R. F.↗

Determination of the isotopic composition of atmospheric methane and its application in the Antarctic

A procedure for establishing the C-13/C-12 ratio and the C-14 abundance in the atmospheric methane is discussed. The method involves air sample collection, measurement of the methane mixing ratio by gas chromotography followed by quantitative conversion of the methane in the air samples to CO2 and H2O, and analysis of the resulting CO2 for the C-13/C-12 ratio by stable isotope ratio mass spectrometry and measurement of C-14 content by accelerator mass spectrometry. The carbon isotropic composition of methane in air collected at Baring Head, New Zealand, and in air collected on aircraft flights between New Zealand and Antarctica is determined by the method, and no gradient in the composition between Baring Head and the South Pole station is found. As the technique is refined, and more data is gathered, small seasonal and long-term variations in C-13 are expected to be resolved.

Lowe, David C.↗

Model-based parameter estimation using cardiovascular response to orthostatic stress

This paper presents a cardiovascular model that is capable of simulating the short-term (< or approximately equal to 3 min) transient hemodynamic response to gravitational stress and a gradient-based optimization method that allows for the automated estimation of model parameters from simulated or experimental data. We perform a sensitivity analysis of the transient heart rate response to determine which parameters of the model impact the heart rate dynamics significantly. We subsequently include only those parameters in the estimation routine that impact the transient heart rate dynamics substantially. We apply the estimation algorithm to both simulated and real data and showed that restriction to the 20 most important parameters does not impair our ability to match the data.

Non-NASA Center↗

Simulation of a Periodic Jet in a Crossflow with a RANS Solver Using an Unstructured Grid

A second-order unstructured-grid code, developed and used primarily for steady aerodynamic simulations, is applied to the synthetic jet in a cross flow. The code, FUN3D, is a vertex-centered finite-volume method originally developed by Anderson[1, 2], and is currently supported by members of the Fast Adaptive Aerospace Tools team at NASA Langley. Used primarily for design[3] and analysis[4] of steady aerodynamic configurations, FUN3D incorporates a discrete adjoint capability, and supports parallel computations using MPI. A detailed description of the FUN3D code can be found in the references given above. The code is under continuous development and contains a variety of flux splitting algorithms for the inviscid terms, two methods for computing gradients, several turbulence models, and several solution methodologies; all in varying states of development. Only the most robust and reliable components, based on experiences with steady aerodynamic simulations, were employed in this work. As applied in this work, FUN3D solves the Reynolds averaged Navier-Stokes equations using the one equation turbulence model of Spalart and Allmaras[5]. The spatial discretization is formed on unstructured meshes using a vertex-centered approach. The inviscid terms are evaluated by a flux-difference splitting formulation using least-squares reconstruction and Roe-type approximate Riemann fluxes. Green-Gauss gradient evaluations are used for viscous and turbulence modeling terms. The discrete spatial operator is combined with a backward time operator which is then solved iteratively using point or line Gauss-Seidel and local time stepping in a pseudo time. For steady flows, the physical time step is set to infinity and the pseudo time step is ramped up with the iteration count. A second-order backward in time operator is used for time accurate flows with 20 to 50 steps in the pseudo time applied at each physical time step. For this effort, FUN3D was modified to support spatially varying boundary and initial conditions, and unsteady boundary conditions. Also, a specialized in/out flow boundary condition was implemented to model the action of the diaphragm. This boundary condition is described below in more detail. The grids were generated using the internally developed codes GridEX[6] for meshing the surfaces and inviscid regions of the domain, and for CAD access; and MesherX[7] for meshing the viscous regions. Grid spacing in on the surfaces and in the inviscid regions are indirectly controlled by specifying sources. The viscous layers are generated using an advancing layer technique. MeshersX allows the user to control the spatial variation of the first step off the surface, growth rates, and the termination criterion by providing small problem dependent subroutines.

Atkins, H. L.↗

A Comprehensive Characterization of Microorganisms and Allergens in Spacecraft Environment

The determination of risk from infectious disease during long-duration missions is composed of several factors including the concentration and the characteristics of the infectious agent. Thus, a thorough knowledge of the microorganisms aboard spacecraft is essential in mitigating infectious disease risk to the crew. While stringent steps are taken to minimize the transfer of potential pathogens to spacecraft, several medically significant organisms have been isolated from both the Mir and International Space Station (ISS). Historically, the method for isolation and identification of microorganisms from spacecraft environmental samples depended upon their growth on culture media. Unfortunately, only a fraction of the organisms may grow on a culture medium, potentially omitting those microorganisms whose nutritional and physical requirements for growth are not met. Thus, several pathogens may not have been detected, such as Legionella pneumophila, the etiological agent of Legionnaire s disease. We hypothesize that environmental analysis using non-culture-based technologies will reveal microorganisms, allergens, and microbial toxins not previously reported in spacecraft, allowing for a more complete health assessment. The development of techniques for this flight experiment, operationally named SWAB, has already provided advances in NASA laboratory processes and beneficial information toward human health risk assessment. The translation of 16S ribosomal DNA sequencing for the identification of bacteria from the SWAB experiment to nominal operations has increased bacterial speciation of environmental isolates from previous flights three fold compared to previous conventional methodology. The incorporation of molecular-based DNA fingerprinting using repetitive sequence-based polymerase chain reaction (rep-PCR) into the capabilities of the laboratory has provided a methodology to track microorganisms between crewmembers and their environment. Both 16S ribosomal DNA identification and bacterial fingerprinting have improved NASA s capability to better understand spacecraft environments and determine the source of contamination events. Preflight sampling has been completed for air, surface, and water samples. In-flight sample collection has been completed for a total of 8 air and surface sample collection sessions. In-flight hardware has performed well and the surface sampling device received positive feedback from the crew for its ease of use. While processing and analysis continue for these samples, early results have begun to provide information on the spacecraft environment. Using a method called Denaturing Gradient Gel Electrophoresis (DGGE), several air and samples were evaluated to determine the types of organisms that were present. Using only molecular techniques, DGGE does not depend on any microbial growth on culture media, allowing a more comprehensive assessment of the spacecraft interior. Preliminary results have identified several microorganisms that would not have been isolated using current technology, though none of these organisms would be considered medically significant. Interestingly, the isolation of Gram negative organisms is greater using DGGE than conventional media based isolation. The cause of this finding is unclear, though it may be the result of the technique s ability to isolate both viable and non-viable bacteria. The next phase of the SWAB sample analysis is the use of quantitative polymerase chain reaction (QPCR) to look for specific medically significant organisms. While not as broad as DGGE, QPCR is much more sensitive and may reveal findings that were not seen during the initial evaluation. Together, this information will lead toward an accurate microbial risk assessment to help set flight requirements to protect the safety, health, and performance of the crew.

Castro, V.A.↗

Improved Creep Measurements for Ultra-High Temperature Materials

Our team has developed a novel approach to measuring creep at extremely high temperatures using electrostatic levitation (ESL). This method has been demonstrated on niobium up to 2300 C, while ESL has melted tungsten (3400 C). This method has been extended to lower temperatures and higher stresses and applied to new materials, including a niobium-based superalloy, MASC. High-precision machined spheres of the sample are levitated in the NASA MSFC ESL, a national user facility and heated with a laser. The samples are rotated with an induction motor at up to 30,000 revolutions per second. The rapid rotation loads the sample through centripetal acceleration, producing a shear stress of about 60 MPa at the center, causing the sample to deform. The deformation of the sample is captured on high-speed video, which is analyzed by machine-vision software from the University of Massachusetts. The deformations are compared to finite element models to determine the constitutive constants in the creep relation. Furthermore, the non-contact method exploits stress gradients within the sample to determine the stress exponent in a single test.

Hyers, Robert W.↗

Optimization of Turbine Engine Cycle Analysis with Analytic Derivatives

A new engine cycle analysis tool, called Pycycle, was recently built using the OpenMDAO framework. This tool uses equilibrium chemistry based thermodynamics, and provides analytic derivatives. This allows for stable and efficient use of gradient-based optimization and sensitivity analysis methods on engine cycle models, without requiring the use of finite difference derivative approximation methods. To demonstrate this, a gradient-based design optimization was performed on a multi-point turbofan engine model. Results demonstrate very favorable performance compared to an optimization of an identical model using finite-difference approximated derivatives.

Turbine engine↗

Analysis of Progressive Damage in Cross-Ply and Quasi-Isotropic Panels Subjected to Quasi-Static Indentation

The performance of a three-dimensional continuum damage mechanics (CDM) model for intralaminar damage, coupled with a cohesive zone model for delamination, is examined for damage prediction in cross-ply and quasi-isotropic laminated plates subjected to quasi-static transverse indentation. Details of the CDM model based on the deformation gradient decomposition (DGD) method and the finite element (FE) modeling strategy are presented and discussed. Critical features of the damage model and FE modeling approach are assessed by comparing analysis predictions to experimental data for cross-ply and quasi-isotropic panels in which damage is dominated by complex interactions between matrix cracks and delaminations.

Song, Kyongchan↗

A Mixed Integer Efficient Global Optimization Algorithm with Multiple Infill Strategy - Applied to a Wing Topology Optimization Problem

With the advancement in high performance computing and numerical optimization techniques,engineering design optimization problems are becoming more complex, larger scale,higher fidelity, and computationally more demanding, requiring longer run times than ever before. There exists methodologies and techniques that can address some of these challenges but very few can address all, and most are limited in the extent that these concerns can be addressed. With the goal of addressing such challenging engineering problems, we developed anew optimization framework, named AMIEGO, that combines concepts from surrogate-based optimization approaches, gradient-based numerical methods, Partial Least Squares, evolutionary algorithms, and Branch-and-Bound, providing newer capabilities that were not previouslyperceived. However, the original version of this framework, in the process of adaptive samplingto explore and exploit the design space, finds only a single sample point per iteration. The efforthere builds upon this previously developed optimization framework to include multiple infillsampling capability that combines the concept of generalized expected improvement function,unsupervised learning, and multi-objective evolutionary technique. To demonstrate, AMIEGOwith the multiple infill capability (called AMIEGO-MIMOS) solves a series of increasingly difficultengineering design optimization problems. The results reveal the performance of the newapproach is problem dependent. When applied to a ten-bar truss problem, the newly proposedmultiple infill strategy consistently leads to a better design solutions when compared to theexisting CPTV method (implemented with the context of the AMIEGO framework). On theother hand, when applied to a mixed-integer high fidelity wing topology optimization problem- MIMOS, despite showing a steeper convergence at the start, eventually leads to an inferiorsolution as compared to CPTV approach. These results also reveal that a small number ofstarting points, in general, are sufficient to lead to a good overall solution.

Mixed-integer optimization↗

Sizing and Topology Design of an Aeroelastic Wingbox Under Uncertainty

The goals of this work are to use a nested optimizer to conduct simultaneous sizing (inner level) and topology (outer level) design of a wingbox, considering uncertainties in the safety factors used to define the aeroelastic constraints. These uncertainties, propagated via sampling-driven polynomial chaos, are explicitly introduced at the inner level of the method, during gradient-based sizing optimization, resulting in a stochastic optimal sizing distribution. Measures of robustness in the total structural mass are then passed to the outer level, where a global optimizer evolves the topology parameters. The results demonstrate design choices needed to improve robustness in the face of uncertain safety factors, and the various physical mechanisms driving this process.

Stanford, Bret K.↗

Progress on Inverse Estimation Technique of Non-Linear Pitch Damping Coefficient Curves Using Free-Flight CFD Generated Trajectories

Characterization of entry vehicle pitch damping coefficient curves is crucial to ensure appropriate re-entry and overall mission success. The pitch damping coefficient (C_(m_q )+C_(m_α ̇ )) is used to encapsulate the oscillatory growth or decay of a body during a trajectory. The inverse estimation technique utilizes an existing Free-Flight CFD (FF-CFD) dataset and wraps a reconstruction algorithm in an optimizer. The reconstruction integrates the planar equations of motion derived by Schoenenberger, Queen [1] using Python’s scipy.integrate.solve_ivp. The optimizer’s objective function is the normalized 𝐿2 residual of the angle of attack peaks between the reconstructed trajectory and the original data produced with FF-CFD. Inclusion of the peak times in this residual calculation allows for simultaneous optimization of the pitch moment coefficient, C_(m_α ). This residual equation is shown below in Eq. 1. The optimizer scipy.optimize.minimize was used with the gradient-based Powell method for the analysis presented, however the differential evolution method was investigated as means of comparison, and was found to produce marginally lower residual values with prohibitively longer run times. Further, the pitch damping curve is found by fitting a cubic interpolation function to a set of (α, (C_(m_q )+C_(m_α ̇ ))) control points, where the α points are held constant and the (C_(m_q )+C_(m_α ̇ )) values are the optimized parameters. The pitch moment curve uses a linear interpolation between the minimum and maximum α in the dataset. FF-CFD generated trajectories using the Dragonfly capsule geometry with the Genesis ballistic range model parameters were simulated and used for this analysis. These FF-CFD trajectories simulate planar motion, as restricted by the reconstructing the equations of motion, of three different cases: 1-DoF (free-to-pitch), 2-DoF (free-to-pitch and heave), and 3-DoF (free-to-pitch, heave, and decelerate). Pitch damping coefficient curves generated using this inverse estimation curve technique with FF-CFD 1-DoF Dragonfly data are found in Fig. 1. Preliminary results reconstructing ballistic range shots using these FF-CFD derived predictions of the pitch damping curve (Fig. 1) are shown in Fig. 2. It should be noted that the ballistic range shot used a Genesis model whereas the FF-CFD data used a Dragonfly geometry, however these geometries are similar.

entry↗

Efficient Subset Simulation using Hamiltonian Neural Network enhanced Markov Chain Monte Carlo Methods

The Monte Carlo method delivers an unbiased estimate of the probability of failure. However, the variance of the estimate depends on the number of evaluated samples. This number must be very large for estimations of a low probability of failure. If the evaluation of each sample is computationally expensive, the crude Monte Carlo simulation strategy is impracticable. Therefore, subset simulations are used to reduce the required number of evaluations. Subset simulations require a Markov Chain Monte Carlo sampler, such as the random walk Metropolis-Hastings algorithm. The algorithm, however, struggles with sampling in low-probability regions, especially if they are narrow. As a consequence, advanced Markov Chain Monte Carlo simulations have been developed. In particular, the Hamiltonian Monte Carlo method explores the target distribution rapidly. Driven by the idea of Hamiltonian dynamics, this sampler provides a non-random walk through the target distribution. The incorporation of subset simulation and Hamiltonian Monte Carlo methods has shown promising results for reliability analysis. One downside of the Hamiltonian Monte Carlo method is that gradient evaluations are computationally expensive, especially when dealing with high-dimensional problems and evaluating long trajectories. We show that integrating Hamiltonian neural networks in Hamiltonian Monte Carlo simulations significantly speeds up the sampling task. Furthermore, the enhancement of adaptive trajectory length within the Hamiltonian Monte Carlo results in the efficient proposal of the following states. Based on this recent enhancement, we provide a fast sampling strategy for subset simulations using Hamiltonian neural networks to replace the evaluation of the gradient and significantly speed up the Hamiltonian Monte Carlo simulation.

97 MATHEMATICS AND COMPUTING↗

Dynamic Learning of Correlation Potentials for a Time-Dependent Kohn-Sham System

We develop methods to learn the correlation potential for a time-dependent Kohn-Sham (TDKS) system in one spatial dimension. We start from a low-dimensional two-electron system for which we can numerically solve the time-dependent Schr¨odinger equation; this yields electron densities suitable for training models of the correlation potential. We frame the learning problem as one of optimizing a least-squares objective subject to the constraint that the dynamics obey the TDKS equation. Applying adjoints, we develop efficient methods to compute gradients and thereby learn models of the correlation potential. Our results show that it is possible to learn values of the correlation potential such that the resulting electron densities match ground truth densities. We also show how to learn correlation potential functionals with memory, demonstrating one such model that yields reasonable results for trajectories outside the training set.

97 MATHEMATICS AND COMPUTING↗

Adaptive Model-Free Vehicle Path-Tracking via Fast-Converging Prescribed-Time Newton-Based Extremum-Seeking Control

Model-free control (MFC) offers a simple and effective approach to automated vehicle path-tracking without requiring an explicit plant model for control law design. However, gain tuning in MFC is typically carried out through trial-and-error, which can be time-consuming and may lead to suboptimal performance. To address this limitation, extremum-seeking-based adaptive MFC has shown promise by enabling real-time adaptation of control gains, without relying on a predefined vehicle model. Nonetheless, existing ESC approaches often suffer from slow convergence. This paper integrates MFC, employing longitudinal and lateral ultra-local models of a rear-wheel-drive vehicle, with a novel prescribed-time (PT) Newton-based extremum-seeking control (ESC) strategy that ensures rapid convergence of control gains within the prescribed time. Unlike conventional gradient-based ESC methods, the PT Newton-based ESC leverages artificial delays and time-periodic gains, not only to guarantee convergence within the specified time, but also to compensate for feedback delays. Simulation results demonstrate that the proposed approach significantly improves gain adaptation speed and tracking accuracy. This work advances adaptive model-free vehicle control by offering a high-performance, delay-resilient alternative to existing ESCMFC frameworks.

Waleed khan, Muhammad [The University of Texas at ↗

Trapped-ion entangling gates with bichromatic pair of microwave fields and magnetic field gradient

A trapped-ion quantum logic gate and a method of operating the trapped-ion quantum logic gate are provided. The trapped-ion quantum logic gate includes at least one ion having two internal states and forming a qubit having a qubit transition frequency ω 0 0, a magnetic field gradient, and two microwave fields. Each of the two microwave fields has a respective frequency that is detuned from the qubit transition frequency ω 0 by frequency difference δ. The at least one ion has a Rabi frequency Ω μ due to the two microwave fields and a Rabi frequency Ω g due to the magnetic field gradient. The method includes applying the magnetic field gradient and the two microwave fields to the at least one ion such that a quantity Ω g /δ is in a range between zero and 5×10 −2 .

Sutherland, Robert Tyler↗