SEARCH · Engineering Papers

Results for “functional generalized linear model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

All sources NASA NTRS DOE OSTI

DOE OSTI2020

Energy-Casimir, dynamically accessible, and Lagrangian stability of extended magnetohydrodynamic equilibria

The formal stability analysis of Eulerian extended magnetohydrodynamics (XMHD) equilibria is considered within the noncanonical Hamiltonian framework by means of the energy-Casimir variational principle and the dynamically accessible stability method. Specifically, we find explicit sufficient stability conditions for axisymmetric XMHD and Hall MHD (HMHD) equilibria with toroidal flow and for equilibria with arbitrary flow under constrained perturbations. The dynamically accessible, second-order variation of the Hamiltonian, which can potentially provide explicit stability criteria for generic equilibria, is also obtained. Moreover, we examine the Lagrangian stability of the general quasineutral two-fluid model written in terms of MHD-like variables, by finding the action and the Hamiltonian functionals of the linearized dynamics, working within a mixed Lagrangian-Eulerian framework. Upon neglecting electron mass, we derive a HMHD energy principle, and in addition, the perturbed induction equation arises from Hamilton’s equations of motion in view of a consistency condition for the relation between the perturbed magnetic potential and the canonical variables.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

DOE OSTI2020

The Generality of the GUGA MRCI Approach in COLUMBUS for Treating Complex Quantum Chemistry

The core part of the program system COLUMBUS allows highly efficient calculations using variational multireference (MR) methods in the framework of configuration interaction with single and double excitations (MR-CISD) and averaged quadratic coupled-cluster calculations (MR-AQCC), based on uncontracted sets of configurations and the graphical unitary group approach (GUGA). The availability of analytic MR-CISD and MR-AQCC energy gradients and analytic nonadiabatic couplings for MR-CISD enables exciting applications including, e.g., investigations of π-conjugated biradicaloid compounds, calculations of multitudes of excited states, development of diabatization procedures, and furnishing the electronic structure information for on-the-fly surface nonadiabatic dynamics. With fully variational uncontracted spin-orbit MRCI, COLUMBUS provides a unique possibility of performing high-level calculations on compounds containing heavy atoms up to lanthanides and actinides. Crucial for carrying out all of these calculations effectively is the availability of an efficient parallel code for the CI step. Configuration spaces of several billion in size now can be treated quite routinely on standard parallel computer clusters. Emerging developments in COLUMBUS, including the all configuration mean energy multiconfiguration self-consistent field method and the graphically contracted function method, promise to allow practically unlimited configuration space dimensions. Spin density based on the GUGA approach, analytic spin-orbit energy gradients, possibilities for local electron correlation MR calculations, development of general interfaces for nonadiabatic dynamics, and MRCI linear vibronic coupling models conclude this overview.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

DOE OSTI2020

hi_class background evolution, initial conditions and approximation schemes

Cosmological datasets have great potential to elucidate the nature of dark energy and test gravity on the largest scales available to observation. Theoretical predictions can be computed with hi_class (www.hiclass-code.net), an accurate, fast and flexible code for linear cosmology, incorporating a wide range of dark energy theories and modifications to general relativity. We introduce three new functionalities into hi_class: (1) Support for models based on covariant Lagrangians, including a constraint-preserving integration scheme for the background evolution and a series of worked-out examples: Galileon, nKGB, quintessence (monomial, tracker) and Brans-Dicke. (2) Consistent initial conditions for the scalar-field perturbations in the deep radiation era, identifying the conditions under which modified-gravity isocurvature perturbations may grow faster than adiabatic modes leading to a loss of predictivity. (3) An automated quasistatic approximation scheme allowing order-of-magnitude improvement in computing performance without sacrificing accuracy for wide classes of models. These enhancements bring the treatment of dark energy and modified gravity models to the level of detail comparable to software tools restricted to standard $\Lambda$CDM cosmologies. Finally, the hi_class code is publicly available (https://github.com/miguelzuma/hi_class_public), ready to explore current data and prepare for next-generation experiments.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2020

Perturbation theory for modeling galaxy bias: validation with simulations of the Dark Energy Survey

We describe perturbation theory (PT) models of galaxy bias for applications to photometric galaxy surveys. We model the galaxy-galaxy and galaxy-matter correlation functions in configuration space and validate against measurements from mock catalogs designed for the Dark Energy Survey (DES). We find that an effective PT model with five galaxy bias parameters provides a good description of the 3D correlation functions above scales of 4 Mpc/$h$ and $z < 1$. Our tests show that at the projected precision of the DES-Year 3 analysis, two of the non-linear bias parameters can be fixed to their co-evolution values, and a third (the $k^2$ term for higher derivative bias) set to zero. The agreement is typically at the 2 percent level over scales of interest, which is the statistical uncertainty of our simulation measurements. To achieve this level of agreement, our {\it fiducial} model requires using the full non-linear matter power spectrum (rather than the 1-loop PT one). We also measure the relationship between the non-linear and linear bias parameters and compare them to their expected co-evolution values. We use these tests to motivate the galaxy bias model and scale cuts for the cosmological analysis of the Dark Energy Survey; our conclusions are generally applicable to all photometric surveys.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2023

Linear model decision trees as surrogates in optimization of engineering applications

Machine learning models are promising as surrogates in optimization when replacing difficult to solve equations or black-box type models. This work demonstrates the viability of linear model decision trees as piecewise-linear surrogates in decision-making problems. Linear model decision trees can be represented exactly in mixed-integer linear programming (MILP) and mixed-integer quadratic constrained programming (MIQCP) formulations. Furthermore, they can represent discontinuous functions, bringing advantages over neural networks in some cases. We present several formulations using transformations from Generalized Disjunctive Programming (GDP) formulations and modifications of MILP formulations for gradient boosted decision trees (GBDT). We then compare the computational performance of these different MILP and MIQCP representations in an optimization problem and illustrate their use on engineering applications. Importantly, we observe faster solution times for optimization problems with linear model decision tree surrogates when compared with GBDT surrogates using the Optimization and Machine Learning Toolkit (OMLT).

42 ENGINEERING↗

DOE OSTI2024

Linear Time-Invariant Models of a Large Cumulus Ensemble

Abstract Methods in system identification are used to obtain linear time-invariant state-space models that describe how horizontal averages of temperature and humidity of a large cumulus ensemble evolve with time under small forcing. The cumulus ensemble studied here is simulated with cloud-system-resolving models in radiative–convective equilibrium. The identified models extend steady-state linear response functions used in past studies and provide accurate descriptions of the transfer function, the noise model, and the behavior of cumulus convection when coupled with two-dimensional gravity waves. A novel procedure is developed to convert the state-space models into an interpretable form, which is used to elucidate and quantify memory in cumulus convection. The linear problem studied here serves as a useful reference point for more general efforts to obtain data-driven and interpretable parameterizations of cumulus convection.

Meteorology & Atmospheric Sciences↗

DOE OSTI2026

6⁢𝐻-perovskite dimer lattice with antiferromagnetic interactions: Ba 3⁢ Zn 1−𝑥⁢ Ca 𝑥 ⁢Ru 2 ⁢O 9

Here, we investigate the magnetic behavior of the 6⁢𝐻-perovskite dimer lattice Ba 3 ⁢Zn 1−𝑥 ⁢Ca 𝑥 ⁢Ru 2 ⁢O 9 using analytical theory, density functional theory, inelastic neutron scattering, and modeling of historical magnetization and neutron-scattering data. A dimer mean-field theory built upon classical Luttinger–Tisza analysis generates a phase diagram revealing a transition from a nonmagnetic singlet to a finite-moment ground state as interdimer couplings increase. A (generalized) linear spin-wave theory captures multiplet mixing, excitation gap closing, and fluctuation-induced moment suppression. Density-functional-theory calculations on selected compounds, together with neutron spectroscopy of dilute Ba 3 ⁢Zn⁢(Ru 1−𝑥 ⁢Sb 𝑥 ) 2 ⁢O 9 , confirm the exchange hierarchy, enabling quantification of previously published experiments within this framework. Our results identify three mechanisms for magnetic moment suppression—quantum fluctuations, ligand hybridization, and nonmagnetic-singlet/magnetic-multiplet mixing.

Pajerowski, Daniel M. [Oak Ridge National Laborato↗

DOE OSTI2020

Fouling modeling and prediction approach for heat exchangers using deep learning

In this article, we develop a generalized and scalable statistical model for accurate prediction of fouling resistance using commonly measured parameters of industrial heat exchangers. This prediction model is based on deep learning where a scalable algorithmic architecture learns non-linear functional relationships between a set of target and predictor variables from large number of training samples. Here, the efficacy of this modeling approach is demonstrated for predicting fouling in an analytically modeled cross-flow heat exchanger, designed for waste heat recovery from flue-gas using room temperature water. The performance results of the trained models demonstrate that the mean absolute prediction errors are under 10 –4 KW –1 for flue-gas side, water side and overall fouling resistances. The coefficients of determination (R 2 ), which characterize the goodness of fit between the predictions and observed data, are over 99%. Even under varying levels of measurement noise in the inputs, we demonstrate that predictions over an ensemble of multiple neural networks achieves better accuracy and robustness to noise. We find that the proposed deep-learning fouling prediction framework learns to follow heat exchanger flow and heat transfer physics, which we confirm using locally interpretable model agnostic explanations around randomly selected operating points. Overall, we provide a robust algorithmic framework for fouling prediction that can be generalized and scaled to various types of industrial heat exchangers.

42 ENGINEERING↗

DOE OSTI2021

Whetstone v.0.9.2

Whetstone is a deep learning software library for spiking/binary threshold neuromorphic hardware. Built to integrate with Keras models, Whetstone provides a collection of layers, callbacks, and utility functions designed to allow the training of integrate-and-fire neurons rather than traditional analog activation functions (e.g. rectified linear units). Generally, training a network for neuromorphic hardware is challenging due to the discontinuity of the activation function. Whetstone overcomes this challenge by using ever-closer continuous approximations of a threshold activation, modified during training time. This allows rapid and consistent training for ultra-low powered neuromorphic hardware.

Severa, William↗

DOE OSTI2021

Gauge invariance of light-matter interactions in first-principle tight-binding models

In this work, we study the different ways of introducing light-matter interaction in first-principle tight-binding (TB) models. The standard way of describing optical properties is the velocity gauge, defined by linear coupling to the vector potential. In finite systems a transformation to represent the electromagnetic radiation by the electric field instead is possible, albeit subtleties arise in periodic systems. The resulting dipole gauge is a multi-orbital generalization of the Peierls substitution. In this work we investigate the accuracy for both pathways, with particular emphasis on gauge invariance, for TB models constructed from maximally localized Wannier functions. This approach accurately captures the light-matter interaction close to the Fermi level. Focusing on paradigmatic two-dimensional materials, we construct first-principle models and calculate the response to electromagnetic fields in linear response and for strong excitations. Benchmarks against fully converged first-principle calculations allow for ascertaining the accuracy of the TB models. We find that the dipole gauge provides a more accurate description than the velocity gauge in all cases. The main deficiency of the velocity gauge is an imperfect cancellation of paramagnetic and diamagnetic current. Formulating a corresponding sum rule however provides a way to explicitly enforce this cancellation. This procedure corrects the TB models in the velocity gauge, yielding excellent agreement with dipole gauge and thus restoring gauge invariance.

2-dimensional systems↗

DOE OSTI2026

Latent space dynamics identification for interface tracking with application to shock-induced pore collapse

Capturing sharp, evolving interfaces remains a central challenge in reduced-order modeling, especially when data is limited and the system exhibits localized nonlinearities or discontinuities. Here, we propose LaSDI-IT (Latent Space Dynamics Identification for Interface Tracking), a data-driven framework that combines low-dimensional latent dynamics learning with explicit interface-aware encoding to enable accurate and efficient modeling of physical systems involving moving material boundaries. At the core of LaSDI-IT is a revised autoencoder architecture that jointly reconstructs the physical field and an indicator function representing material regions or phases, allowing the model to track complex interface evolution without requiring detailed physical models or mesh adaptation. The latent dynamics are learned through linear regression in the encoded space and generalized across parameter regimes using Gaussian process interpolation with greedy sampling. We demonstrate LaSDI-IT on the problem of shock-induced pore collapse in high explosives, a process characterized by sharp temperature gradients and dynamically deforming pore geometries. The method achieves relative prediction errors below 9% across the parameter space, accurately recovers key quantities of interest such as pore area and hot spot formation, and matches the performance of dense training with only half the data. This latent dynamics prediction was 10 6 times faster than the conventional high-fidelity simulation, proving its utility for multi-query applications. These results highlight LaSDI-IT as a general, data-efficient framework for modeling discontinuity-rich systems in computational physics, with potential applications in multiphase flows, fracture mechanics, and phase change problems.

Gaussian process↗

DOE OSTI2022

Bayesian Monte Carlo Evaluation Framework for Imperfect Data and Models [Abstract]

Nuclear data evaluation methods conventionally make the following assumptions: prior and posterior probability distribution functions (PDFs) of all model parameters and data are normal (Gaussian); the linear approximation is sufficiently accurate for minimization of a cost function (even for non-linear models); and that both the model (of, e.g., neutron cross section) and experimental data (including their covariance data) are perfect. These assumptions are inherent to the well-known generalized linear least squares (GLLS) minimization method commonly used for evaluations of resolved resonance region (RRR) neutron cross sections. However, these assumptions are often not justified due to the presence of non-normal PDFs, non-linear models (e.g. R -matrix formalism), and inherent imperfections in data and models (e.g. discrepant data sets, discrepancies between the previous evaluation and newly measured data, or imperfect covariance data). We remove the said assumptions in a mathematical framework of Bayes’ theorem, and implement it using the Metropolis-Hastings Monte Carlo method. Parameters of a new kind are introduced to parameterize inherent imperfections, e.g. , any discrepancies between the theoretical model and measured data. These new parameters enable evaluators to quantify their expert judgement about any discrepancies or imperfections in a reproducible manner. We demonstrate the framework with an ongoing evaluation of 233 U in the eV region using the ENDF-B/VIII library and transmission data measured by Guber, et al. , and compare the posterior parameters to those obtained by conventional evaluation methods.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2020

Quantum Non-Equilibrium Dynamics Prediction of Electronic Transport Coefficients in Non-Linear Regimes

The goal of this work was to develop unique LLNL capabilities for the computational prediction of electrical, optical and thermal transport properties from quantum simulations. Using a recently developed theory of microscopic quantum transport, we were able to model compressed metallic hydrogen and it’s non-linear and out-of-equilibrium contributions in electrical and thermal transport. This theory was implemented in the open-source, real-space time-dependent density functional theory code Octopus. This model is general and widely applicable to high energy density systems that are important to LLNL and NNSA mission areas.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

DOE OSTI2020

Multiscale Approach to Fast ModSim for Laser Processing of Metals for Future Nuclear Deterrence Environments

Predicting performance of parts produced using laser-metal processing remains an out- standing challenge. While many computational models exist, they are generally too computationally expensive to simulate the build of an engineering-scale part. This work develops a reduced order thermal model of a laser-metal system using analytical Green's function solutions to the linear heat equation, representing a step towards achieving a full part performance prediction in an "overnight" time frame. The developed model is able to calculate a thermal history for an example problem 72 times faster than a traditional FEM method. The model parameters are calibrated using a non-linear solution and microstructures and residual stresses calculated and compared to a non-linear case. The calibrated model shows promising agreement with a non-linear solution.

36 MATERIALS SCIENCE↗

DOE OSTI2021

Using diverse potentials and scoring functions for the development of improved machine-learned models for protein–ligand affinity and docking pose prediction

The advent of computational drug discovery holds the promise of significantly reducing the effort of experimentalists, along with monetary cost. More generally, predicting the binding of small organic molecules to biological macromolecules has far-reaching implications for a range of problems, including metabolomics. However, problems such as predicting the bound structure of a protein–ligand complex along with its affinity have proven to be an enormous challenge. In recent years, machine learning-based methods have proven to be more accurate than older methods, many based on simple linear regression. Nonetheless, there remains room for improvement, as these methods are often trained on a small set of features, with a single functional form for any given physical effect, and often with little mention of the rationale behind choosing one functional form over another. Moreover, it is not entirely clear why one machine learning method is favored over another. Here, we endeavor to undertake a comprehensive effort towards developing high-accuracy, machine-learned scoring functions, systematically investigating the effects of machine learning method and choice of features, and, when possible, providing insights into the relevant physics using methods that assess feature importance. Here, we show synergism among disparate features, yielding adjusted R 2 with experimental binding affinities of up to 0.871 on an independent test set and enrichment for native bound structures of up to 0.913. When purely physical terms that model enthalpic and entropic effects are used in the training, we use feature importance assessments to probe the relevant physics and hopefully guide future investigators working on this and other computational chemistry problems.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2023

Disjunctive optimization model and algorithm for long-term capacity expansion planning of reliable power generation systems

This paper proposes a new optimization model and algorithm for long-term capacity expansion planning of reliable power generation systems. The model optimizes both investment decisions (e.g., size, location, and time to install, retire and decommission facilities) and operation decisions (e.g., on/off status, operating capacity, and expected power output). It is also able to optimize reserve systems (or backup systems), as well as the main systems, to improve power systems reliability. An impact of operational strategies of generators (i.e., participating in electricity production vs. remaining as idle units during operation) on power systems reliability is considered. Probability of equipment failures and capacity failure states are used to rigorously estimate the power systems reliability depending on design and operation strategies. The optimization model is formulated with Generalized Disjunctive Programming (GDP), which is reformulated as a mixed-integer linear programming (MILP) model using the Hull relaxation. Two reliability-related penalties, such as downtime penalty and unmet demand penalty, are included in the objective function to maximize reliability while minimizing the total net present cost. Furthermore, a bilevel decomposition with tailored cuts is developed to reduce computational times of the multi-scale optimization model. The effectiveness of the proposed model is shown by comparing the results with the results obtained from the expansion planning models that do not explicitly consider reliability. In conclusion, we also show that the proposed bilevel decomposition is computationally efficient for solving large scale problems through 5-years and 10-years planning case studies.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

DOE OSTI2021

Revisiting matrix-based inversion of scanning mobility particle sizer (SMPS) and humidified tandem differential mobility analyzer (HTDMA) data

Abstract. Tikhonov regularization is a tool for reducing noise amplification during data inversion. This work introduces RegularizationTools.jl, a general-purpose software package for applying Tikhonov regularization to data. The package implements well-established numerical algorithms and is suitable for systems of up to ∼ 1000 equations. Included is an abstraction to systematically categorize specific inversion configurations and their associated hyperparameters. A generic interface translates arbitrary linear forward models defined by a computer function into the corresponding design matrix. This obviates the need to explicitly write out and discretize the Fredholm integral equation, thus facilitating fast prototyping of new regularization schemes associated with measurement techniques. Example applications include the inversion involving data from scanning mobility particle sizers (SMPSs) and humidified tandem differential mobility analyzers (HTDMAs). Inversion of SMPS size distributions reported in this work builds upon the freely available software DifferentialMobilityAnalyzers.jl. The speed of inversion is improved by a factor of ∼ 200, now requiring between 2 and 5 ms per SMPS scan when using 120 size bins. Previously reported occasional failure to converge to a valid solution is reduced by switching from the L-curve method to generalized cross-validation as the metric to search for the optimal regularization parameter. Higher-order inversions resulting in smooth, denoised reconstructions of size distributions are now included in DifferentialMobilityAnalyzers.jl. This work also demonstrates that an SMPS-style matrix-based inversion can be applied to find the growth factor frequency distribution from raw HTDMA data while also accounting for multiply charged particles. The outcome of the aerosol-related inversion methods is showcased by inverting multi-week SMPS and HTDMA datasets from ground-based observations, including SMPS data obtained at Bodega Marine Laboratory during the CalWater 2/ACAPEX campaign and co-located SMPS and HTDMA data collected at the US Department of Energy observatory located at the Southern Great Plains site in Oklahoma, USA. Results show that the proposed approaches are suitable for unsupervised, nonparametric inversion of large-scale datasets as well as inversion in real time during data acquisition on low-cost reduced-instruction-set architectures used in single-board computers. The included software implementation of Tikhonov regularization is freely available, general, and domain-independent and thus can be applied to many other inverse problems arising in atmospheric measurement techniques and beyond.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2026

Learning genetic perturbation effects with variational causal inference

Advances in sequencing technologies have enhanced the understanding of gene regulation in cells. In particular, Perturb-seq has enabled high-resolution profiling of the transcriptomic response to genetic perturbations at the single-cell level. This understanding has implications in functional genomics and potentially for identifying therapeutic targets. Various computational models have been developed to predict perturbational effects. While deep learning models excel at interpolating observed perturbational data, they tend to overfit in the lack of enough data and may not generalize well to unseen perturbations. In contrast, mechanistic models, such as linear causal models based on gene regulatory networks, hold greater potential for extrapolation, as they encapsulate regulatory information that can predict responses to unseen perturbations. However, their application has been limited to small studies due to overly simplistic assumptions, making them less effective in handling noisy, large-scale single-cell data. We propose a hybrid approach that combines a mechanistic causal model with variational deep learning, termed Single Cell Causal Variational Autoencoder (SCCVAE). The mechanistic model employs a learned regulatory network to represent perturbational changes as shift interventions that propagate through the learned network. SCCVAE integrates this mechanistic causal model into a variational autoencoder, generating rich, comprehensive transcriptomic responses. Our results indicate that SCCVAE exhibits superior performance over current state-of-the-art baselines for extrapolating to predict unseen perturbational responses. Additionally, for the observed perturbations, the latent space learned by SCCVAE allows for the identification of functional perturbation modules and simulation of single-gene knockdown experiments of varying penetrance, presenting a robust tool for interpreting and interpolating perturbational responses at the single-cell level.

59 BASIC BIOLOGICAL SCIENCES↗