Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Operator inference”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11

Mixed‐Phase Clouds Over the Southern Ocean as Observed From Satellite and Surface Based Lidar and Radar

Abstract This study investigates the occurrence of mixed‐phase clouds (MPC, i.e., cloud layers containing both liquid and ice water at sub‐freezing temperatures) over the Southern Ocean (SO) using space‐ and surface‐based lidar and radar observations. The occurrence of supercooled clouds is dominated by geometrically thin (<1 km) layers that rarely contain ice. We diagnose layers that are geometrically thicker than 1 km to contain ice ~65% and ~4% of the time from below by surface remote sensors and from above by orbiting remote sensors, respectively. We examine the discrepancy in MPC occurrence statistics as diagnosed from below and above the cloud layer. From above, we find that MPC occurrence has a gradient associated with the Antarctic Polar Front near 55°S with a rare occurrence of satellite‐derived MPC south of that latitude. In contrast, surface sensors find ice in 33% of supercooled liquid water layers. We infer using observing system simulation experiments and data analysis that space‐based lidar cannot identify the occurrence of MPC except when secondary ice‐forming processes operate in convection that is, sufficiently strong to loft ice crystals to cloud tops. We conclude that the CALIPSO phase statistics of MPC have a severe low bias in MPC occurrence. Based on surface‐based statistics in the SO, we present a parameterization of the frequency of MPC as a function of cloud top temperature that differs substantially from that used in recent climate model simulations.

54 ENVIRONMENTAL SCIENCES↗

Quantum optimal control of superconducting qubits based on machine-learning characterization

Implementing fast and high-fidelity quantum operations using open-loop quantum optimal control relies on having an accurate model of the quantum dynamics. Any deviations between this model and the complete dynamics of the device, such as the presence of spurious modes or pulse distortions, can degrade the performance of optimal controls in practice. Here, we propose an experimentally simple approach to realize optimal quantum controls tailored to the device parameters and environment while specifically characterizing this quantum system. Concretely, we use physics-inspired machine learning to infer an accurate model of the dynamics from experimentally available data and then optimize our experimental controls on this trained model. We show the power and feasibility of this approach by optimizing arbitrary single-qubit operations in detailed numerical simulations of a superconducting transmon qubit. Furthermore, we demonstrate that this framework produces an accurate description of the device dynamics under arbitrary controls, together with the precise pulses achieving arbitrary single-qubit gates with a high fidelity of ∼99.99%.

Artificial neural networks↗

On the influence of over-parameterization in manifold based surrogates and deep neural operators

Constructing accurate and generalizable approximators (surrogate models) for complex physico-chemical processes exhibiting highly non-smooth dynamics is challenging. The main question is what type of surrogate models we should construct and should these models be under-parameterized or over-parameterized. In this work, we propose new developments and perform comparisons for two promising approaches: manifold-based polynomial chaos expansion (m-PCE) and the deep neural operator (DeepONet), and we examine the effect of over-parameterization on generalization. While m-PCE enables the construction of a mapping by first identifying low-dimensional embeddings of the input functions, parameters, and quantities of interest (QoIs), a neural operator learns the nonlinear mapping via the use of deep neural networks. Here, we demonstrate the performance of these methods in terms of generalization accuracy by solving the 2D time-dependent Brusselator reaction-diffusion system with uncertainty sources, modeling an autocatalytic chemical reaction between two species. We first propose an extension of the m-PCE by constructing a mapping between latent spaces formed by two separate embeddings of the input functions and the output QoIs. To further enhance the accuracy of the DeepONet, we introduce weight self-adaptivity in the loss function. We demonstrate that the performance of m-PCE and DeepONet is comparable for cases of relatively smooth input-output mappings. However, when highly non-smooth dynamics is considered, DeepONet shows higher approximation accuracy. We also find that for m-PCE, modest over-parameterization leads to better generalization, both within and outside of distribution, whereas aggressive over-parameterization leads to over-fitting. In contrast, an even highly over-parameterized DeepONet leads to better generalization for both smooth and non-smooth dynamics. Furthermore, we compare the performance of the above models with another recently proposed operator learning model, the Fourier Neural Operator, and show that its over-parameterization also leads to better generalization. Taken together, our studies show that m-PCE can provide very good accuracy at very low training cost, whereas a highly over-parameterized DeepONet can provide better accuracy and robustness to noise but at higher training cost. In both methods, the inference cost is negligible.

97 MATHEMATICS AND COMPUTING↗

Correcting for filter-based aerosol light absorption biases at the Atmospheric Radiation Measurement program's Southern Great Plains site using photoacoustic measurements and machine learning

Abstract. Measurement of light absorption of solar radiation by aerosols is vital for assessing direct aerosol radiative forcing, which affects local and global climate. Low-cost and easy-to-operate filter-based instruments, such as the Particle Soot Absorption Photometer (PSAP), that collect aerosols on a filter and measure light attenuation through the filter are widely used to infer aerosol light absorption. However, filter-based absorption measurements are subject to artifacts that are difficult to quantify. These artifacts are associated with the presence of the filter medium and the complex interactions between the filter fibers and accumulated aerosols. Various correction algorithms have been introduced to correct for the filter-based absorption coefficient measurements toward predicting the particle-phase absorption coefficient (Babs). However, the inability of these algorithms to incorporate into their formulations the complex matrix of influencing parameters such as particle asymmetry parameter, particle size, and particle penetration depth results in prediction of particle-phase absorption coefficients with relatively low accuracy. The analytical forms of corrections also suffer from a lack of universal applicability: different corrections are required for rural and urban sites across the world. In this study, we analyzed and compared 3 months of high-time-resolution ambient aerosol absorption data collected synchronously using a three-wavelength photoacoustic absorption spectrometer (PASS) and PSAP. Both instruments were operated on the same sampling inlet at the Department of Energy's Atmospheric Radiation Measurement program's Southern Great Plains (SGP) user facility in Oklahoma. We implemented the two most commonly used analytical correction algorithms, namely, Virkkula (2010) and the average of Virkkula (2010) and Ogren (2010)–Bond et al. (1999) as well as a random forest regression (RFR) machine learning algorithm to predict Babs values from the PSAP's filter-based measurements. The predicted Babs was compared against the reference Babs measured by the PASS. The RFR algorithm performed the best by yielding the lowest root mean square error of prediction. The algorithm was trained using input datasets from the PSAP (transmission and uncorrected absorption coefficient), a co-located nephelometer (scattering coefficients), and the Aerosol Chemical Speciation Monitor (mass concentration of non-refractory aerosol particles). A revised form of the Virkkula (2010) algorithm suitable for the SGP site has been proposed; however, its performance yields approximately 2-fold errors when compared to the RFR algorithm. To generalize the accuracy and applicability of our proposed RFR algorithm, we trained and tested it on a dataset of laboratory measurements of combustion aerosols. Input variables to the algorithm included the aerosol number size distribution from the Scanning Mobility Particle Sizer, absorption coefficients from the filter-based Tricolor Absorption Photometer, and scattering coefficients from a multiwavelength nephelometer. The RFR algorithm predicted Babs values within 5 % of the reference Babs measured by the multiwavelength PASS during the laboratory experiments. Thus, we show that machine learning approaches offer a promising path to correct for biases in long-term filter-based absorption datasets and accurately quantify their variability and trends needed for robust radiative forcing determination.

54 ENVIRONMENTAL SCIENCES↗

An Adaptive-Importance-Sampling-Enhanced Bayesian Approach for Topology Estimation in an Unbalanced Power Distribution System

The reliable operation of a power distribution system relies on a good prior knowledge of its topology and its system state. Although crucial, due to the lack of direct monitoring devices on the switch statuses, the topology information is often unavailable or outdated for the distribution system operators for real-time applications. Apart from the limited observability of the power distribution system, other challenges are the nonlinearity of the model, the complicated, unbalanced structure of the distribution system, and the scale of the system. To overcome the above challenges, we, in this paper, propose a Bayesian-inference framework that allows us to simultaneously estimate the topology and the state of a three-phase, unbalanced power distribution system. Specifically, by using the very limited number of measurements available that are associated with the forecast load data, we efficiently recover the full Bayesian posterior distributions of the system topology under both normal and outage operation conditions. This is performed through an adaptive importance sampling procedure that greatly alleviates the computational burden of the traditional Monte-Carlo (MC)-sampling-based approach while maintaining a good estimation accuracy. The simulations conducted on the IEEE 123-bus test system and an unbalanced 1282-bus system reveal the excellent performances of the proposed method.

24 POWER TRANSMISSION AND DISTRIBUTION↗

XRD-PUAT (X-Ray Diffraction - Parameter Uncertainty Analysis Toolkit)

This XRD uncertainty toolkit was built to investigate uncertainty and local least squares topology over a specified parameter space on a single histogram in a gpx GSAS-II file. The parameter uncertainty can be investigated using either a frequentist F-test approach or a Bayesian Inference statistical inversion method on a weighted least squares or peak fit refinements.SAND Number: SAND2020-12227 M Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Moore, Alexander↗

Graph neural network for neutrino physics event reconstruction

Liquid argon time projection chamber (LArTPC) detector technology offers a wealth of high-resolution information on particle interactions, and leveraging that information to its full potential requires sophisticated automated reconstruction techniques. Here, this article describes NUGRAPH 2, a graph neural network for low-level reconstruction of simulated neutrino interactions in a LArTPC detector. Simulated neutrino interactions in the MicroBooNE detector geometry are described as heterogeneous graphs, with energy depositions on each detector plane forming nodes on planar subgraphs. The network utilizes a multihead attention message-passing mechanism to perform background filtering and semantic labeling on these graph nodes, identifying those associated with the primary physics interaction with 98.0% efficiency and labeling them according to particle type with 94.9% efficiency. The network operates directly on detector observables across multiple two-dimensional representations but utilizes a three-dimensional-context-aware mechanism to encourage consistency between these representations. Model inference takes 0.12 s / event on a CPU and 0.005 s / event batched on a GPU. This architecture is designed to be a general-purpose solution for particle reconstruction in neutrino physics, with the potential for deployment across a broad range of detector technologies, and offers a core convolution engine that can be leveraged for a variety of tasks beyond the two described in this paper.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Large Evolutionary Rate Heterogeneity among and within HIV-1 Subtypes and CRFs

HIV-1 is a fast-evolving, genetically diverse virus presently classified into several groups and subtypes. The virus evolves rapidly because of an error-prone polymerase, high rates of recombination, and selection in response to the host immune system and clinical management of the infection. The rate of evolution is also influenced by the rate of virus spread in a population and nature of the outbreak, among other factors. HIV-1 evolution is thus driven by a range of complex genetic, social, and epidemiological factors that complicates disease management and prevention. Here, we quantify the evolutionary (substitution) rate heterogeneity among major HIV-1 subtypes and recombinants by analyzing the largest collection of HIV-1 genetic data spanning the widest possible geographical (100 countries) and temporal (1981–2019) spread. We show that HIV-1 substitution rates vary substantially, sometimes by several folds, both across the virus genome and between major subtypes and recombinants, but also within a subtype. Across subtypes, rates ranged 3.5-fold from 1.34 × 10−3 to 4.72 × 10−3 in env and 2.3-fold from 0.95 × 10−3 to 2.18 × 10−3 substitutions site−1 year−1 in pol. Within the subtype, 3-fold rate variation was observed in env in different human populations. It is possible that HIV-1 lineages in different parts of the world are operating under different selection pressures leading to substantial rate heterogeneity within and between subtypes. We further highlight how such rate heterogeneity can complicate HIV-1 phylodynamic studies, specifically, inferences on epidemiological linkage of transmission clusters based on genetic distance or phylogenetic data, and can mislead estimates about the timing of HIV-1 lineages.

59 BASIC BIOLOGICAL SCIENCES↗

Phenomenological R -Matrix parameterization of direct, doorway, and compound nuclear reactions [Abstract]

Although formal expressions for scattering matrix accounting for direct, doorway, and compound nuclear (CN) resonant reactions have been derived several decades ago in both the transition ( T -)matrix formalism and the reactance ( K -)matrix formalism, the absence of corresponding expressions in phenomenological R -matrix formalism has limited the application of the latter to CN resonant reactions only. We remove this limitation by parameterizing direct, doorway, and CN resonant reactions in a phenomenological R -matrix scattering matrix, and provide a parameterization for a corresponding Reich-Moore approximation of eliminated capture channels. Direct reactions induce (previously neglected) mixing among the incoming or outgoing R -matrix channel wave functions, parameterized by real and orthonormal channel-rotation matrix, M , whereby the original scattering matrix U is transformed into M T UM . Any real and orthonormal matrix, M , can be equivalently expressed as e η , where η is a real and skew-symmetric 2 rotation-generating matrix that subsequently yields a more intuitive parameterization of eliminated direct capture reactions in Reich-Moore approximation. A phenomenological R -matrix parameterization of doorway reactions is inferred by equating the expression for reactance ( K -)matrix, given in terms of Brune’s alternative R -matrix parameterization, to a corresponding expression derived using Feshbach’s projection operator formalism. Assuming that all doorway states, just like CN states, are confined within spheres defined by R -matrix channel radii, a new R -matrix-like term induced by doorway states is gleaned, wherein each doorway state is parameterized by its energy, width, and the strength of its coupling to each CN state. Since a Reich-Moore approximation for retained-channel scattering matrix ought to approximate the effect of eliminated capture channels taking place via direct, doorway, or CN reactions, each of the three kinds of reactions contributing to the capture entails a corresponding Reich-Moore parameterization in a first-order approximation: direct contribution is parameterized by introducing finite diagonal elements of a retained-channel rotation-generating matrix, doorway contribution is parameterized by doorway capture widths, while CN contribution is parameterized by conventional Reich-Moore capture widths. We will present evidence of direct and doorway reactions observed in recent measurements of resolved resonance cross sections at the Gaerttner LINAC Center at Rensselaer Polytechnic Institute, and will outline a path for implementing this new R -matrix parameterization into the SAMMY nuclear data evaluation code.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Shepherding Metadata Through the Building Lifecycle

Many different digital representations of a building are produced over the course of its lifecycle. These representations contain the metadata required to support different stages of the building, from initial planning and design, to construction and commissioning, through operations, audits, retrofits and maintenance. However, because of differences in the semantics, structure and syntax of these representations, the metadata they contain is not interoperable. We present a novel method for leveraging these representations to create a unified, authoritative Brick metadata model for a building that can be continually maintained over the course of the building lifecycle. A simple synchronization protocol relays inferred Brick metadata from existing metadata sources such as gbXML, BuildingSync, Project Haystack and Modelica to a central integration server, which merges the metadata into a valid Brick model.

Fierro, Gabe↗

Agentic framework for programmatic crystal structure generation using a fine-tuned worker–supervisor large language model

Platinum group metals (PGMs) underpin many catalytic technologies but face severe supply constraints, motivating the search for alternative materials and computational methods to accelerate discovery. While atomistic simulation tools such as Pymatgen and ASE have streamlined structure manipulation, they require detailed inputs, limiting accessibility for experimentalists and slowing early-stage exploration. Here, in this study, we present an AI-driven agentic framework that orchestrates worker–supervisor large language models (LLMs). The worker translates natural-language prompts of varying abstraction into valid crystallographic structures using a compact LLM fine-tuned with low-rank adaptation on a curated text–code–CIF dataset, emphasizing energy-efficient training. Benchmarking against the baseline CodeGen-350M-mono model shows that fine-tuning reduces hallucination rates from 100% to as low as 5% and improves structural match accuracy to up to 82% for fully specified inputs. Accuracy declines with decreasing prompt detail but remains nontrivial even when only stoichiometry and space group are provided, underscoring the LLM’s capacity for crystallographic inference. The supervisor Claude LLM evaluates the outputs and triggers iterative refinement through the worker’s built-in structure manipulation capabilities (e.g., supercell scaling, strain, vacancy, and substitution operations). We further demonstrate use cases for technologically relevant catalysts, including IrO 2 , pyrochlore Pb 2 Ir 2 O 7 , Ni 2 FeO 4 , and Ni 3 Mo, where the framework generates physically consistent structures that can be refined via geometry optimization. This work introduces a low-energy, language-driven pathway for integrating human and machine intelligence in materials design, paving the way for AI-assisted synthesis planning and high-throughput screening of complex oxides.

AI agent↗

HEPCloud Operations at Fermilab—The First Five Years

The HEPCloud Facility at Fermilab has now been in production operation for five years. This facility is a unified provisioning gateway to US high performance computing centers, including NERSC, OLCF, and ALCF, other large supercomputers run by the NSF, and commercial clouds. HEPCloud delivers hundreds of millions of core-hours yearly for CMS. HEPCloud also serves other Fermilab experiments including DUNE, Mu2e, Muon g-2, and NOvA. In this paper we present the practical considerations of operating a distributed facility such as HEPCloud. We also mention some of the interesting research and development that HEPCloud has been used for including GPU-based machine learning inference servers, and tests of Quantum Computing.

Timm, Steven [Fermilab]↗

The Scattered Light Time-history Diagnostic suite at the National Ignition Facility

The Scattered Light Time-history Diagnostic (SLTD) is being implemented at the National Ignition Facility (NIF) to greatly expand the angular coverage of absolute scattered-light measurements for direct- and indirect-drive inertial confinement fusion (ICF) experiments. The SLTD array will ultimately consist of 15 units mounted at a variety of polar and azimuthal angles on the NIF target chamber, complementing the existing NIF backscatter suite. Each SLTD unit collects and diffuses scattered light onto a set of three optical fibers, which transport the light to filtered photodiodes to measure scattered light in different wavelength bands: stimulated Brillouin scattering (350 nm–352 nm), stimulated Raman scattering (430 nm–760 nm), and ω/2 (695 nm–745 nm). SLTD measures scattered light with a time resolution of ~1 ns and a signal-to-noise ratio of up to 500. Currently, six units are operational and recording data. Measurements of the angular dependence of scattered light will strongly constrain models of laser energy coupling in ICF experiments and allow for a more robust inference of the total laser energy coupled to implosions.

47 OTHER INSTRUMENTATION↗

Time-resolved CO 2 , CO, and N 2 vibrational population measurements in Ns pulse discharge plasmas

Abstract Time-resolved CO 2 and N 2 vibrational populations and translational-rotational temperature are measured in a CO 2 –N 2 plasma sustained by a ns pulse discharge burst in plane-to-plane geometry. Time-resolved, absolute number density of CO generated in the plasma is also inferred from the experimental data. CO 2 and CO vibrational populations are measured by mid-IR, tunable quantum cascade laser absorption spectroscopy, and N 2 vibrational populations are measured by the ns broadband vibrational CARS. Transient excitation of N 2 and CO 2 asymmetric stretch vibrational energy modes is detected during the discharge burst. The time-resolved rate of CO generation does not correlate with N 2 or CO 2 ( ν 3 ) vibrational temperatures, indicating that CO 2 dissociation via the vibrational excitation is insignificant at the present conditions. The rate of CO generation decreases gradually during the discharge burst. The estimated specific energy cost of the CO product is close to that of N atoms in pure nitrogen, measured previously at similar operating conditions. Comparison of the experimental data with the kinetic modeling analysis indicates that CO 2 dissociation in collisions with electronically excited N 2 molecules is the dominant channel of CO generation at the present conditions, although the inferred CO yield in these processes is significantly lower than 1. The effect of vibrational energy transfer between N 2 and CO 2 on the plasma chemical processes is insignificant. The kinetic model underpredicts a rapid reduction of the N 2 and CO 2 ( ν 3 ) vibrational temperatures during the later half of the discharge burst and in the afterglow. V–T relaxation of N 2 by N and O atoms generated in the ns pulse discharge plasma does not affect the vibrational relaxation rate in a significant way. However, rapid V–T relaxation of CO 2 by O atoms has a significant effect on the relaxation rate. The difference between the experimental data and the modeling predictions may be due to the unknown scaling of the CO 2 –O V–T rates with the vibrational quantum number.

Physics↗

A resolution independent neural operator

The Deep operator network (DeepONet) is a powerful yet simple neural operator architecture that utilizes two deep neural networks to learn mappings between infinite-dimensional function spaces. This architecture is highly flexible, allowing the evaluation of the solution field at any location within the desired domain. However, it imposes a strict constraint on the input space, requiring all input functions to be discretized at the same locations; this limits its practical applications. Here, in this work, we introduce a general framework for operator learning from input–output data with arbitrary number and locations of sensors. This begins by introducing a resolution-independent DeepONet (RI-DeepONet), enabling it to handle input functions that are arbitrarily, but sufficiently finely, discretized. To this end, we propose two dictionary learning algorithms to adaptively learn a set of appropriate continuous basis functions, parameterized as implicit neural representations (INRs), from correlated signals defined on arbitrary point cloud data. These basis functions are then used to project arbitrary input function data as a point cloud onto an embedding space (i.e., a vector space of finite dimensions) with dimensionality equal to the dictionary size, which can be directly used by DeepONet without any architectural changes. In particular, we utilize sinusoidal representation networks (SIRENs) as trainable INR basis functions. The introduced dictionary learning algorithms are then used in a similar way to learn an appropriate dictionary of basis functions for the output function data, which defines a new neural operator architecture referred to as the R esolution I ndependent N eural O perator (RINO). In the RINO, the operator learning task simplifies to learning a mapping from the coefficients of input basis functions to the coefficients of output basis functions. We demonstrate the robustness and applicability of RINO in handling arbitrarily (but sufficiently richly) sampled input and output functions during both training and inference through several numerical examples.

Deep operator network (DeepONet)↗

Bayesian inference of structured latent spaces from neural population activity with the orthogonal stochastic linear mixing model

The brain produces diverse functions, from perceiving sounds to producing arm reaches, through the collective activity of populations of many neurons. Determining if and how the features of these exogenous variables (e.g., sound frequency, reach angle) are reflected in population neural activity is important for understanding how the brain operates. Often, high-dimensional neural population activity is confined to low-dimensional latent spaces. However, many current methods fail to extract latent spaces that are clearly structured by exogenous variables. This has contributed to a debate about whether or not brains should be thought of as dynamical systems or representational systems. Here, we developed a new latent process Bayesian regression framework, the orthogonal stochastic linear mixing model (OSLMM) which introduces an orthogonality constraint amongst time-varying mixture coefficients, and provide Markov chain Monte Carlo inference procedures. We demonstrate superior performance of OSLMM on latent trajectory recovery in synthetic experiments and show superior computational efficiency and prediction performance on several real-world benchmark data sets. We primarily focus on demonstrating the utility of OSLMM in two neural data sets: μ ECoG recordings from rat auditory cortex during presentation of pure tones and multi-single unit recordings form monkey motor cortex during complex arm reaching. We show that OSLMM achieves superior or comparable predictive accuracy of neural data and decoding of external variables (e.g., reach velocity). Most importantly, in both experimental contexts, we demonstrate that OSLMM latent trajectories directly reflect features of the sounds and reaches, demonstrating that neural dynamics are structured by neural representations. Together, these results demonstrate that OSLMM will be useful for the analysis of diverse, large-scale biological time-series datasets.

59 BASIC BIOLOGICAL SCIENCES↗

Detectors and beam monitors based on wide bandgap semiconductors at cryogenic temperatures

Wide-bandgap semiconductors, such as single-crystal diamond and sapphire, can be used to measure the flux of passing particles through a particle-induced conductivity effect. We recently demonstrated a diamond-based, electrodeless electron beam halo monitor. This monitor utilized a thin diamond blade placed within an open, high-quality microwave resonator. The blade partially intercepted the beam and changes in the RF properties of the resonator were used to infer beam parameters. To enhance the sensitivity of our semiconductor sensors, we propose two new techniques: (1) biasing the semiconductor sensor to support avalanche multiplication of free carriers, and (2) operating at cryogenic temperatures to reduce intrinsic semiconductor losses and increase the mobility of induced carriers. These techniques are applicable not only to particle beam diagnostics but also to the detection of various types of ionizing radiation.

Accelerator Physics↗