SEARCH · Engineering Papers

Results for “nonlinear least squares”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

All sources NASA NTRS DOE OSTI

DOE OSTI2021

Dakota, A Multilevel Parallel Object-Oriented Framework for Design Optimization, Parameter Estimation, Uncertainty Quantification, and Sensitivity Analysis (V.6.16 User's Manual)

The Dakota toolkit provides a flexible and extensible interface between simulation codes and iterative analysis methods. Dakota contains algorithms for optimization with gradient and nongradient-based methods; uncertainty quantification with sampling, reliability, and stochastic expansion methods; parameter estimation with nonlinear least squares methods; and sensitivity/variance analysis with design of experiments and parameter study methods. These capabilities may be used on their own or as components within advanced strategies such as surrogate-based optimization, mixed integer nonlinear programming, or optimization under uncertainty. By employing object-oriented design to implement abstractions of the key components required for iterative systems analyses, the Dakota toolkit provides a flexible and extensible problem-solving environment for design and performance analysis of computational models on high performance computers. This report serves as a user's manual for the Dakota software and provides capability overviews and procedures for software execution, as well as a variety of example studies.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2021

Dakota, A Multilevel Parallel Object-Oriented Framework for Design Optimization, Parameter Estimation, Uncertainty Quantification, and Sensitivity Analysis: Version 6.16 Theory Manual

The Dakota toolkit provides a flexible and extensible interface between simulation codes and iterative analysis methods. Dakota contains algorithms for optimization with gradient and nongradient-based methods; uncertainty quantification with sampling, reliability, and stochastic expansion methods; parameter estimation with nonlinear least squares methods; and sensitivity/variance analysis with design of experiments and parameter study methods. These capabilities may be used on their own or as components within advanced strategies such as surrogate-based optimization, mixed integer nonlinear programming, or optimization under uncertainty. By employing object-oriented design to implement abstractions of the key components required for iterative systems analyses, the Dakota toolkit provides a flexible and extensible problem-solving environment for design and performance analysis of computational models on high performance computers. This report serves as a theoretical manual for selected algorithms implemented within the Dakota software. It is not intended as a comprehensive theoretical treatment, since a number of existing texts cover general optimization theory, statistical analysis, and other introductory topics. Rather, this manual is intended to summarize a set of Dakota-related research publications in the areas of surrogate-based optimization, uncertainty quantification, and optimization under uncertainty that provide the foundation for many of Dakota’s iterative analysis capabilities.

97 MATHEMATICS AND COMPUTING↗

NASA NTRS2009

Reaction Wheel Disturbance Model Extraction Software - RWDMES

The RWDMES is a tool for modeling the disturbances imparted on spacecraft by spinning reaction wheels. Reaction wheels are usually the largest disturbance source on a precision pointing spacecraft, and can be the dominating source of pointing error. Accurate knowledge of the disturbance environment is critical to accurate prediction of the pointing performance. In the past, it has been difficult to extract an accurate wheel disturbance model since the forcing mechanisms are difficult to model physically, and the forcing amplitudes are filtered by the dynamics of the reaction wheel. RWDMES captures the wheel-induced disturbances using a hybrid physical/empirical model that is extracted directly from measured forcing data. The empirical models capture the tonal forces that occur at harmonics of the spin rate, and the broadband forces that arise from random effects. The empirical forcing functions are filtered by a physical model of the wheel structure that includes spin-rate-dependent moments (gyroscopic terms). The resulting hybrid model creates a highly accurate prediction of wheel-induced forces. It accounts for variation in disturbance frequency, as well as the shifts in structural amplification by the whirl modes, as the spin rate changes. This software provides a point-and-click environment for producing accurate models with minimal user effort. Where conventional approaches may take weeks to produce a model of variable quality, RWDMES can create a demonstrably high accuracy model in two hours. The software consists of a graphical user interface (GUI) that enables the user to specify all analysis parameters, to evaluate analysis results and to iteratively refine the model. Underlying algorithms automatically extract disturbance harmonics, initialize and tune harmonic models, and initialize and tune broadband noise models. The component steps are described in the RWDMES user s guide and include: converting time domain data to waterfall PSDs (power spectral densities); converting PSDs to order analysis data; extracting harmonics; initializing and simultaneously tuning a harmonic model and a wheel structural model; initializing and tuning a broadband model; and verifying the harmonic/broadband/structural model against the measurement data. Functional operation is through a MATLAB GUI that loads test data, performs the various analyses, plots evaluation data for assessment and refinement of analysis parameters, and exports the data to documentation or downstream analysis code. The harmonic models are defined as specified functions of frequency, typically speed-squared. The reaction wheel structural model is realized as mass, damping, and stiffness matrices (typically from a finite element analysis package) with the addition of a gyroscopic forcing matrix. The broadband noise model is realized as a set of speed-dependent filters. The tuning of the combined model is performed using nonlinear least squares techniques. RWDMES is implemented as a MATLAB toolbox comprising the Fit Manager for performing the model extraction, Data Manager for managing input data and output models, the Gyro Manager for modifying wheel structural models, and the Harmonic Editor for evaluating and tuning harmonic models. This software was validated using data from Goodrich E wheels, and from GSFC Lunar Reconnaissance Orbiter (LRO) wheels. The validation testing proved that RWDMES has the capability to extract accurate disturbance models from flight reaction wheels with minimal user effort.

Blaurock, Carl↗

NASA NTRS2017

Rotational Raman-Based Temperature Measurements in a High-Velocity Turbulent Jet

Spontaneous rotational Raman scattering spectroscopy is used to acquire the first ever high quality, spatially-resolved measurements of the mean and root mean square (rms) temperature fluctuations in turbulent, high-velocity heated jets. Raman spectra in air were obtained across a matrix of radial and axial locations downstream from a 50 mm diameter nozzle operating from subsonic to supersonic conditions over a wide range of temperatures and Mach numbers, in accordance with the Tanna matrix frequently used in jet noise studies. These data were acquired in the hostile, high noise (115 dB) environment of a large scale open air test facility at NASA Glenn Research Center (GRC). Temperature estimates were determined by performing nonlinear least squares fitting of the single shot spectra to the theoretical rotational Stokes spectra of N2 and O2, using a custom in-house code developed specifically for this investigation. The laser employed in this study was a high energy, long-pulsed, frequency doubled Nd:YAG laser. One thousand single-shot spectra were acquired at each spatial coordinate. Mean temperature and rms temperature variations were calculated at each measurement location. Excellent agreement between the averaged and single-shot temperatures was observed with an accuracy better than 2.5 percent for temperature, and rms variations in temperature between +/-2.2 percent at 296 K and +/-4.5 percent at 850 K. The results of this and planned follow-on studies will support NASA GRC's development of physics-based jet noise prediction, turbulence modeling and aeroacoustic source modeling codes.

Randy J Locke↗

NASA NTRS2017

Rotational Raman-Based Temperature Measurements in a High-Velocity Turbulent Jet

Randy J Locke↗

DOE OSTI2021

MFNets: data efficient all-at-once learning of multifidelity surrogates as directed networks of information sources

We present an approach for constructing a surrogate from ensembles of information sources of varying cost and accuracy. The multifidelity surrogate encodes connections between information sources as a directed acyclic graph, and is trained via gradient-based minimization of a nonlinear least squares objective. While the vast majority of state-of-the-art assumes hierarchical connections between information sources, our approach works with flexibly structured information sources that may not admit a strict hierarchy. The formulation has two advantages: (1) increased data efficiency due to parsimonious multifidelity networks that can be tailored to the application; and (2) no constraints on the training data—we can combine noisy, non-nested evaluations of the information sources. Finally, numerical examples ranging from synthetic to physics-based computational mechanics simulations indicate the error in our approach can be orders-of-magnitude smaller, particularly in the low-data regime, than single-fidelity and hierarchical multifidelity approaches.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2023

Direct Estimation of Parameters in ODE Models Using WENDy: Weak-Form Estimation of Nonlinear Dynamics

Abstract We introduce the Weak-form Estimation of Nonlinear Dynamics (WENDy) method for estimating model parameters for non-linear systems of ODEs. Without relying on any numerical differential equation solvers, WENDy computes accurate estimates and is robust to large (biologically relevant) levels of measurement noise. For low dimensional systems with modest amounts of data, WENDy is competitive with conventional forward solver-based nonlinear least squares methods in terms of speed and accuracy. For both higher dimensional systems and stiff systems, WENDy is typically both faster (often by orders of magnitude) and more accurate than forward solver-based approaches. The core mathematical idea involves an efficient conversion of the strong form representation of a model to its weak form, and then solving a regression problem to perform parameter inference. The core statistical idea rests on the Errors-In-Variables framework, which necessitates the use of the iteratively reweighted least squares algorithm. Further improvements are obtained by using orthonormal test functions, created from a set of $$C^{\infty }$$ C ∞ bump functions of varying support sizes.We demonstrate the high robustness and computational efficiency by applying WENDy to estimate parameters in some common models from population biology, neuroscience, and biochemistry, including logistic growth, Lotka-Volterra, FitzHugh-Nagumo, Hindmarsh-Rose, and a Protein Transduction Benchmark model. Software and code for reproducing the examples is available at https://github.com/MathBioCU/WENDy .

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2026

Gradient-informed Hamiltonian Monte Carlo for multicomponent CALPHAD model optimization and uncertainty quantification

CALPHAD model parameter optimization is inherently challenging due to non-smooth objective functions, high-dimensional parameter spaces, and the need for uncertainty quantification (UQ). Traditional weighted nonlinear least squares approaches are computationally efficient but local, whereas black-box global optimizers and ensemble Markov Chain Monte Carlo (MCMC) methods provide broader exploration at substantial computational cost. The objective of this work is to combine the global exploration capability of gradient-informed Hamiltonian Monte Carlo – specifically the No-U-Turn Sampler (NUTS) – with local deterministic refinement using BFGS to efficiently optimize multicomponent CALPHAD models with minimal manual intervention. Analytic gradients are computed via the Jansson derivative framework. The methodology is demonstrated on the Cr—Fe binary system and extended to the Cr—Fe—Ni ternary system with 32 degrees of freedom. For Cr—Fe, NUTS achieves comparable or superior optimality relative to ensemble MCMC while requiring over an order-of-magnitude fewer likelihood evaluations. Parameter uncertainties are quantified through NUTS sampling and propagated to thermodynamic observables using local expansion, demonstrating a novel modular approach that combines binary and ternary parameter subsets without requiring global relaxation. These results establish gradient-informed exploration as a scalable strategy for multicomponent CALPHAD optimization and provide a practical route towards efficient higher-order database development with quantified uncertainty.

36 MATERIALS SCIENCE↗

DOE OSTI2023

Data-Driven Modeling of a High Capacity Cryogenic System for Control Optimization

The Cryogenic Moderator System (CMS) is responsible for maintaining a steady flow of cold neutrons for numerous physics experiments at the Spallation Neutron Source (SNS) in Oak Ridge National Laboratory (ORNL). Sudden losses in beam power, known as beam trips, cause a major disturbance to the CMS due to large step changes in cooling demands. Ongoing efforts on upgrading the neutron beam power from 1.4 to 2.0MW are expected to generate larger transients that can further strain the CMS subsystems if they are not properly controlled. To manage such disturbances, four flow valves and one electric heater are adjusted by five decentralized proportional-integral-derivative (PID) controllers. However, the original PID gains were calibrated empirically based only on tracking performance and not based on disturbance rejection. To address this issue without compromising current CMS operations, a control-oriented model was developed to recalibrate the PID controllers offline. The zero-dimensional (0-D) model was based on simple physics-based principles and data-driven system identification techniques. The CMS was broken into several subsystems for analysis, each of which corresponds to a parametric model tied to the thermodynamic states of the working fluid. The model parameters were identified using the nonlinear least squares method where the residuals were calculated from available sensor data. Simulation results show that the proposed model can capture the dynamics of the CMS at steady state and during beam trips.

Maldonado Puente, Bryan↗

DOE OSTI2025

Current interrupt method for calculating the electrochemical impedance in a solid oxide electrolysis stack

Here, in this work the time domain response of Solid Oxide Electrolysis Cells (SOEC) to a current interruption was transformed into the frequency domain using a carrier function Laplace transform, which is fit to the experimental data using a MATLAB Complex Nonlinear Least Squares (CNLS) solver. The hardware implementation, consisting principally of a high-speed switch and a fast-logging Analog to Digital Converter (ADC), was assembled and tested using a calibration module to assess the accuracy, repeatability, and speed of acquisition of the prototype device as compared against a calibrated commercial impedance spectrometer. Additionally, the current interrupt device and commercial FRA were used to acquire the impedance spectra of a four cell SOEC stack with a large, 300 cm 2 , active cell area.

SOEC↗

DOE OSTI2022

Simultaneous Observations of Surface Layer Profiles of Humidity, Temperature, and Wind Using Scanning Lidar Instruments

We demonstrate the combination of three Doppler lidars (DLs), a water vapor differential absorption lidar and a temperature rotational Raman lidar for the investigation of the interactions between the land-surface and the atmospheric boundary layer. This combination of scanning lidars was operated for the first time during the Land-Atmosphere Feedback Experiment at the Atmospheric Radiation Measurement program's Southern Great Plain site, Oklahoma, USA, in August 2017, and provided simultaneous surface layer profiles of horizontal wind, humidity and temperature. The horizontal wind profiles were determined using the dual-Doppler method with two DLs. The scans were performed above four towers providing atmospheric variables and fluxes. These combined lidar data allowed for the estimation of the friction velocity as well as the surface latent and sensible heat fluxes. For this purpose, profiles calculated with Monin-Obukhov similarity theory were fitted with the Levenberg-Marquardt nonlinear least squares curve-fitting method to the measured surface-layer lidar profiles. We present case studies of three 50-min periods to illustrate the new method. The measurements resulted in friction velocities of 0.31, 0.29, and 0.38 ms –1 , sensible surface heat fluxes of 312.1, 234.1, and 183.3 Wm –2 and latent surface heat fluxes of 251.8, 227.3, and 274.4 Wm –2 . These values were compared with the in-situ measurements of the towers. Considering the sampling differences and the error analyses, the results agree within 25.1%, 42.5%, and 28.8%, respectively, demonstrating that this synergy of scanning active remote sensing systems can be used to derive surface fluxes with reasonable accuracy.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2025

Derivative-free stochastic optimization via adaptive sampling strategies

In this paper, we present a novel derivative-free framework for solving unconstrained stochastic optimization problems. Many problems in fields ranging from simulation optimization to reinforcement learning to quantum computing involve settings where only stochastic function values are obtained via a zeroth-order oracle, which has no available gradient information and necessitates the usage of derivative-free optimization methodologies. Our approach includes estimating gradients using stochastic function evaluations and integrating adaptive sampling techniques to control the accuracy in these stochastic approximations. Our framework encapsulates several gradient estimation techniques, including standard finite-difference, Gaussian smoothing, sphere smoothing, randomized coordinate finite-difference, and randomized subspace finite-difference methods. We provide theoretical convergence guarantees for our framework and analyze the worst-case iteration and sample complexities associated with each gradient estimation method. Finally, we demonstrate the empirical performance of the methods on logistic regression and nonlinear least squares problems.

Adaptive sampling↗

DOE OSTI2026

ReMU: regional minimal updating for model-based derivative-free optimization

Derivative-free optimization (DFO) problems are optimization problems where derivative information is unavailable or extremely difficult to obtain. Model-based DFO solvers have been applied extensively in scientific computing. Powell's NEWUOA (2004) [Powell, The NEWUOA software for unconstrained optimization without derivatives, in Large-Scale Nonlinear Optimization, Nonconvex Optimization and its Applications Vol. 83, G. Di Pillo and M. Roma, eds., Springer, 2006, pp. 255–297] and Wild's POUNDerS (2014) [Wild, Solving derivative-free nonlinear least squares problems with POUNDERS, in Advances and Trends in Optimization with Engineering Applications, T. Terlaky, M.F. Anjos, and S. Ahmed, eds., SIAM, 2017, pp. 529–540] explore the numerical power of the minimal norm Hessian (MNH) model for DFO and contributed to the open discussion on building better models with fewer data to achieve faster numerical convergence. Another decade later, we propose the regional minimal updating (ReMU) models, and extend the previous models into a broader class, including the H 2 norm models [Xie and Yuan, Least H 2 norm updating of quadratic interpolation models for derivative-free trust-region algorithms, IMA J. Numer. Anal. 46 (2025), pp. 21–50]. This paper shows motivation behind ReMU models, computational details, theoretical and numerical results on particular extreme points and the barycentre of ReMU's weight coefficient region, and the associated KKT matrix error and distance. Novel metrics, such as the truncated Newton step error, are proposed to numerically understand the new models' properties. A new algorithmic strategy, based on iteratively adjusting the ReMU model type, is also proposed, and shows numerical advantages by combining and switching between the barycentric model and the classic least Frobenius norm model in an online fashion.

derivative-free trust-region methods↗

DOE OSTI2020

Algorithms in Diffraction Profile Analysis

This chapter introduces several approaches to crystallographic structure refinement from diffraction profile data including the Rietveld method, global optimization methods, and Bayesian modeling. First, the Rietveld method and related nonlinear least squares approaches to analyzing diffraction profiles are briefly discussed. We then review the most common algorithms within global optimization as alternative methods of structure solution: grid search, simulated annealing, and genetic algorithms. As the Rietveld method is the standard tool for analyzing diffraction profile data, we catalogue its challenges and limitations. A Bayesian approach to diffraction profile analysis is presented as an alternative, along with several sampling algorithms including Gibbs sampling, variants of Metropolis sampling, Hamiltonian Monte Carlo, and approximate Bayesian computing. These sampling algorithms are applied to the fitting of a neutron diffraction profile from a National Institute of Standards and Technology silicon standard reference material, and their results are compared.

Singh, Susheela↗

DOE OSTI2022

Investigating the Influence of Ni, ZrO 2 , and Y 2 O 3 from SOFC Anodes on Siloxane Deposition

Siloxanes, as a type of impurity in biogas, can poison the Ni-YSZ anode of SOFCs. However, the influence of individual components of the anode, such as Ni, ZrO 2 , and Y 2 O 3 , on the siloxane deposition process has not been investigated extensively. In this study, Ni, ZrO 2 , and Y 2 O 3 pellets were exposed to H 2 + N 2 + H 2 O + D4 (octamethylcyclotetrasiloxane, 2.5 ppmv) and H 2 + N 2 + D4 (2.5 ppmv siloxane) gas mixtures at 750 °C to investigate their affinity and tolerance for siloxane degradation. Surface morphology analysis and electrochemical analysis including electrochemical impedance spectroscopy (EIS), related distribution of relaxation times (DRT) analysis and equivalent circuit modeling with complex nonlinear least square (CNLS) fitting were conducted. Here, a microstructure parameter—tortuosity factor to porosity ratio $\tau /\varepsilon $ calculated by diffusion polarization resistance was utilized for siloxane deposition evaluation. After comparing pellets surface morphology changes before and after experiments and $\tau /\varepsilon $ change following the contamination, Ni is considered as a major factor in siloxane deposition reactions in Ni-YSZ anode.

25 ENERGY STORAGE↗

DOE OSTI2021

A Novel Multiphysics Multiscale Multiporosity Shale Gas Transport Model for Geomechanics/Flow Coupling in Steady and Transient States

Summary A novel multiphysics multiscale multiporosity shale gas transport (M3ST) model was developed to investigate shale gas transport in both transient and steady states. The microscale model component contains a kerogen domain and an inorganic matrix domain, and each domain has its own geomechanical and gas transport properties. Permeabilities of various shale cores were measured in the laboratory using a pulse decay permeameter (PDP) with different pore pressure and confining stress combinations. The PDP-measured apparent permeability as a function of pore pressure under two effective stresses was fitted using the microscale M3ST model component based on nonlinear least squares fitting (NLSF), and the fitted model parameters were able to provide accurate model predictions for another effective stress. The parameters and petrophysical properties determined in the steady state were then used in the transient-state, continuum-scale M3ST model component, which performed history matching of the evolutions of the upstream and downstream gas pressures. In addition, a double-exponential empirical model was developed as a powerful alternative to the M3ST model to fit laboratory-measured apparent permeability under various effective stresses and pore pressures. The developed M3ST model and the research findings in this study provided critical insights into the role of the multiphysics mechanisms, including geomechanics, fluid dynamics and transport, and the Klinkenberg effect on shale gas transport across different spatial scales in both steady and transient states.

Engineering↗

DOE OSTI2021

TAO Users Manual (Rev. 3.15)

The Toolkit for Advanced Optimization (TAO) focuses on the development of algorithms and software for the solution of large-scale optimization problems on high-performance architectures. Areas of interest include unconstrained and bound-constrained optimization, nonlinear least squares problems, optimization problems with partial differential equation constraints, and variational inequalities and complementarity constraints. The development of TAO was motivated by the scattered support for parallel computations and the lack of reuse of external toolkits in current optimization software. Our aim is to produce high-quality optimization software for computing environments ranging from workstations and laptops to massively parallel high-performance architectures. Our design decisions are strongly motivated by the challenges inherent in the use of large-scale distributed memory architectures and the reality of working with large, often poorly structured legacy codes for specific applications.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2024

Samoa Updater: An Application of the Levenberg-Marquardt Method to Update DELFIC Predictions Using Field Measurements

The US Department of Energy (DOE) Forensics Operations (DFO) is a member of the Ground Collections Task Force (GCTF), which is responsible for sample collection of radiological debris for attribution should a nuclear detonation ever occur in the United States. The DFO runs the Defense Land Fallout Interpretive Code (DELFIC) Fallout Planning Tool to predict the deposition of fallout from a nuclear detonation. This prediction is refined using the DELFIC Updater tool, which takes ground measurements and adjusts DELFIC inputs to minimize the difference between prediction and observation, yielding improved predictions of fallout in locations both measured and not yet measured. Samoa, a framework for uncertainty analysis and optimization, is used to improve DELFIC predictive fallout modeling. This new capability using Samoa, dubbed “Samoa Updater,” is compared with the current DELFIC Updater, a brute-force sampling approach. Samoa Updater uses the Levenberg– Marquardt (LM) method, a gradient-based nonlinear least squares approach that uses the functional shape of the input space to increase optimization speed. In simulated test cases Samoa Updater yields faster and more accurate solutions than the current Updater.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗