Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Reduced order representation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

Compressed basis GMRES on high-performance graphics processing units

Krylov methods provide a fast and highly parallel numerical tool for the iterative solution of many large-scale sparse linear systems. To a large extent, the performance of practical realizations of these methods is constrained by the communication bandwidth in current computer architectures, motivating the investigation of sophisticated techniques to avoid, reduce, and/or hide the message-passing costs (in distributed platforms) and the memory accesses (in all architectures). This article leverages Ginkgo’s memory accessor in order to integrate a communication-reduction strategy into the (Krylov) GMRES solver that decouples the storage format (i.e., the data representation in memory) of the orthogonal basis from the arithmetic precision that is employed during the operations with that basis. Given that the execution time of the GMRES solver is largely determined by the memory accesses, the cost of the datatype transforms can be mostly hidden, resulting in the acceleration of the iterative step via a decrease in the volume of bits being retrieved from memory. Together with the special properties of the orthonormal basis (whose elements are all bounded by 1), this paves the road toward the aggressive customization of the storage format, which includes some floating-point as well as fixed-point formats with mild impact on the convergence of the iterative process. We develop a high-performance implementation of the “compressed basis GMRES” solver in the Ginkgo sparse linear algebra library using a large set of test problems from the SuiteSparse Matrix Collection. We demonstrate robustness and performance advantages on a modern NVIDIA V100 graphics processing unit (GPU) of up to 50% over the standard GMRES solver that stores all data in IEEE double-precision.

97 MATHEMATICS AND COMPUTING↗

Reduced-order modeling on a near-term quantum computer

Quantum computing is an advancing area of research in which computer hardware and algorithms are developed to take advantage of quantum mechanical phenomena. In recent studies, quantum algorithms have shown promise in solving linear systems of equations as well as systems of linear ordinary differential equations (ODEs) and partial differential equations (PDEs). Reducedorder modeling (ROM) algorithms for studying fluid dynamics have shown success in identifying linear operators that can describe flowfields, where dynamic mode decomposition (DMD) is a particularly useful method in which a linear operator is identified from data. In this work, DMD is reformulated as an optimization problem to propagate the state of the linearized dynamical system on a quantum computer. This reformulation was chosen as a means of facilitating implementation on a near-term quantum computer. Quadratic unconstrained binary optimization (QUBO), a technique for optimizing quadratic polynomials in binary variables, allows for quantum annealing algorithms to be applied. A quantum circuit model (quantum approximation optimization algorithm, QAOA) is utilized to obtain predictions of the state trajectories. Results are shown for the quantum-ROM predictions for flow over a 2D cylinder at Re = 220 and flow over a NACA0009 airfoil at Re = 500 and α = 15°. The quantum-ROM predictions are found to depend on the number of bits utilized for a fixed point representation and the truncation level of the DMD model. Comparisons with DMD predictions from a classical computer algorithm are made, as well as an analysis of the computational complexity and prospects for future, more fault-tolerant quantum computers.

97 MATHEMATICS AND COMPUTING↗

Scalable modular dynamic molten salt reactor system model with decay heat

Nodal dynamic models allow rapid reduced-order simulations of complex systems. This paper presents a publicly available system dynamic model of a molten salt reactor system with a topology of the Molten Salt Reactor Experiment (MSRE), in MATLAB/Simulink, building upon a model previously published and validated with MSRE data. It adds scaling of nominal power, dynamic representation of decay heat generation, a generic decay heat removal system, improved documentation, modularity, and test cases. One hour of system transient runs in less than 10 min on a laptop. This model is intended for first order engineering calculations, developing insights into system transient behavior, equipment sizing, parameter sensitivity studies. The model contains an easy to use toolkit which can be customized and expanded to describe any molten salt reactor system. Finally, scenarios involving off-normal transients are presented. Relation between shutdown reactivity insertions, decay heat removal, core recriticality, and safe shutdown conditions are discussed.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

PCAfold 2.0—Novel tools and algorithms for low-dimensional manifold assessment and optimization

We describe an update to our open-source Python package, PCAfold, designed to help researchers generate, analyze and improve low-dimensional data manifolds. In the current version, PCAfold 2.0, we introduce novel tools and algorithms for assessing and optimizing low-dimensional manifolds. This includes a method that generates a “map” of local feature sizes that can help pinpoint researchers to problematic regions on a manifold. We introduce a novel cost function that characterizes the quality of a manifold topology with a single number. We develop two algorithms for feature selection based on principal component analysis (PCA) that use the cost function as an objective function to minimize. We introduce a quantity of interest (QoI)-aware dimensionality reduction strategy where data projections are computed using an artificial neural network and are directly optimized towards representing various projection-independent and projection-dependent QoIs. We also introduce an implementation of partition of unity networks (POUnets) for efficient reconstruction of QoIs from low-dimensional manifolds based on combining neural network classification with localized polynomial regression. Our software can be broadly applicable in all domains of science and engineering that aim to reduce data dimensionality, as well as in the fundamental research on representation learning.

97 MATHEMATICS AND COMPUTING↗

Data reduction through optimized scalar quantization for more compact neural networks

Raw data generation for several existing and planned large physics experiments now exceeds TB/s rates, generating untenable data sets in very little time. Those data often demonstrate high dimensionality while containing limited information. Meanwhile, Machine Learning algorithms are now becoming an essential part of data processing and data analysis. Those algorithms can be used offline for post processing and post data analysis, or they can be used online for real time processing providing ultra low latency experiment monitoring. Both use cases would benefit from data throughput reduction while preserving relevant information: one by reducing the offline storage requirements by several orders of magnitude and the other by allowing ultra fast online inferencing with low complexity Machine Learning models. Moreover, reducing the data source throughput also reduces material cost, power and data management requirements. In this work we demonstrate optimized nonuniform scalar quantization for data source reduction. This data reduction allows lower dimensional representations while preserving the relevant information of the data, thus enabling high accuracy Tiny Machine Learning classifier models for online fast inferences. We demonstrate this approach with an initial proof of concept targeting the CookieBox, an array of electron spectrometers used for angular streaking, that was developed for LCLS-II as an online beam diagnostic tool. We used the Lloyd-Max algorithm with the CookieBox dataset to design an optimized nonuniform scalar quantizer. Optimized quantization lets us reduce input data volume by 69% with no significant impact on inference accuracy. When we tolerate a 2% loss on inference accuracy, we achieved 81% of input data reduction. Finally, the change from a 7-bit to a 3-bit input data quantization reduces our neural network size by 38%.

97 MATHEMATICS AND COMPUTING↗

Extended dynamic mode decomposition for model reduction in fluid dynamics simulations

High computational cost and storage/memory requirements of fluid dynamics simulations constrain their usefulness as a predictive tool. Reduced-order models (ROMs) provide a viable solution to this challenge by extracting the key underlying dynamics of a complex system directly from data. We investigate the efficacy and robustness of an extended dynamic mode decomposition (xDMD) algorithm in constructing ROMs of three-dimensional cardiovascular computations. Focusing on the ROMs' accuracy in representation and interpolation, we relate these metrics to the truncation rank of singular value decomposition, which underpins xDMD and other approaches to ROM construction. Our key innovation is to relate the truncation rank to the singular values of the original flow problem. This result establishes a priori guidelines for the xDMD deployment and its likely success as a means of data compression and reconstruction of the system's dynamics from dominant spatiotemporal structures present in the data.

Mechanics↗

Adaptive Anomaly Detection for Dynamic Clinical Event Sequences

Over the past decade, health information technology (IT) has enabled the amount of digital information stored in electronic health records (EHRs) to expand greatly. However, according to some studies, hazards in health IT can lead to changes in clinical decisions, care processes, and care outcomes, as well as other issues. Thus, the effects of health IT hazards on patient safety have been at the forefront of recent patient safety research. Nonetheless, hazard detection in health IT remains a challenge. In this paper, the authors assume that safety-related issues in health IT would exhibit anomalous characteristics in EHR data. Although all hazards will exhibit some anomalous characteristics, not all anomalies can be regarded as hazards. The authors hypothesize that errors in health IT could lead to interruptions in the sequence of clinical actions. To this end, the problem of detecting anomalous sequences in big EHR data is considered. This paper focuses on dynamic event sequences, which are a series of clinical actions in motion. The authors propose an adaptive anomaly detection approach that uses higher-order network representation to detect anomalous sequences. Furthermore, the authors propose a contiguous subsequence anomaly detection approach that identifies abnormal subsequences in the detected anomalous sequences. The proposed approaches are tested by using synthetic and real-world EHR data. The proposed methods outperform existing state of the art anomaly detection techniques. To reduce the computational complexity associated with the operational implementation of the proposed approaches, the Apache Spark environment was leveraged, and a much shorter run time together with improved performance were achieved, especially for data with more than 60,000 sequences.

Niu, Haoran↗

Parametric reduced-order modeling for component-oriented treatment and localized nonlinear feature inclusion

Abstract We propose coupling a physics-based reduction framework with a suited response decomposition technique to derive a component-oriented reduction (COR) approach, which is suitable for assembly systems featuring localized nonlinearities. Dependencies on influencing parameters are injected into the reduced-order model (ROM), thus ensuring robustness and validity over a domain of parametric inputs, while capturing nonlinear effects. The implemented approach employs individual component modes to capture localized features while additionally relying on reduced modes of a global nature to approximate the system’s dynamics accurately. The global modes are derived from a linear monolithic system, defined as a result of a coordinate separation scheme, which permits the proposed COR-ROM to naturally couple the response between linear and nonlinear subdomains. The derived low-order representation utilizes a proper orthogonal decomposition projection and is additionally reinforced with the inclusion of a hyper-reduction technique to capture the underlying high-fidelity model response while providing accelerated computations. The resulting approach is exemplified in the synthetic case studies of a four-story shear frame with multiple nonlinear regions driven by hysteresis and a large-scale kingpin connection featuring plasticity.

Vlachas, Konstantinos (ORCID:000000029124219X)↗

Improved reference system for the corrected rigid spheres equation of state model

The Corrected Rigid Spheres (CRIS) EOS model, developed from fluid perturbation theory using a hard sphere reference system, has been successfully used to calculate the EOS of many materials, including gases and metals. The radial distribution function (RDF) plays a pivotal role in choosing the sphere diameter, through a variational principle, as well as the thermodynamic response. Despite its success, the CRIS model has some shortcomings in that it predicts too large a temperature for liquid-vapor critical points, can break down at large compression, and is computationally expensive. In this paper, we first demonstrate that an improved analytic representation of the hard sphere RDF does not alleviate these issues. Relaxing the strict adherence of the RDF to hard spheres allows an accurate fit to the isotherms and vapor dome of the Lennard-Jones fluid using an arbitrary reference system. Second order correction are eliminated, limiting the breakdown at large compression and significantly reducing the computation cost. The transferrability of the new model to real systems is demonstrated on argon, with an improved vapor dome compared to the original CRIS model.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Probing atomic-scale symmetry breaking by rotationally invariant machine learning of multidimensional electron scattering

Abstract The 4D scanning transmission electron microscopy (STEM) method maps the structure and functionality of solids on the atomic scale, yielding information-rich data sets describing the interatomic electric and magnetic fields, structural and electronic order parameters, and other symmetry breaking distortions. A critical bottleneck is the dearth of analytical tools that can reduce complex 4D-STEM data to physically relevant descriptors. We propose an approach for the systematic exploration of 4D-STEM data using rotationally invariant variational autoencoders (rrVAE), which disentangle the general rotation of the object from other latent representations. The implementation of purely rotational rrVAE is discussed as are applications to simulated data for graphene and zincblende structures. The rrVAE analysis of experimental 4D-STEM data of defects in graphene is illustrated and compared to the classical center-of-mass analysis. This approach is universal for probing symmetry-breaking phenomena in complex systems and can be implemented for a broad range of diffraction methods.

36 MATERIALS SCIENCE↗

Oceanographic Conditions. 2007 - 2040. North Slope Alaska.

Complete representations of oceanographic conditions require spatial and temporal information about the significant wave height (Hs), peak wave period (Tp), wind speed, wind direction, wave direction, water level, salinity, and temperature. This data develops location-independent typologies to reduce the number of boundary conditions needed to assess nearshore oceanographic environments in both a Historical (2007-2019) and Future (2020-2040) timespan along the Alaskan North Slope. Wave information for both time spans were generated from WaveWatch III, Delft3D-FLOW, and Delft3D-WAVE simulations forced by wind conditions from reanalysis data (e.g., ASRv2 and ERA5) for the historical simulations while projected conditions were obtained from downscaled GFDL-CM3 forced under RCP8.5 conditions. Salinity was generated from GOFS 3.1 for the years between 2008-2015 and skin temperature of the ocean was obtained from ASRv2 reanalysis data for the years between 2007-2016. To identify generalized oceanographic typologies, K-means clustering was applied to the energy-weighted joint-probability distribution of Hs and Tp at six sites along the North Slope of Alaska. Distributions of wave and wind direction, wind speed, and water level associated with locaiton-indepndent centroids were assigned single values to describe a reduced order, typological rendition of offshore oceanographic conditions. These final typologies and their constituent data are provided here and can be used to evaluate the change in ocean energy over the next two decades in response to climate change and provide insight into expected consequences such as coastal erosion and flooding. A full assessment of the findings and techniques developed can be found in: Eymold, W.K., Flanary, C., Erikson, L., Nederhoff, K., Chartrand, C.C., Jones, C., Kasper, J., and Bull, D.L. Typological Representation of the Offshore Oceanographic Environment along the Alaskan North Slope. Continental Shelf Research (2022). 10.1016/j.csr.2022.104795

54 ENVIRONMENTAL SCIENCES↗

Sampling and resolution characteristics in reduced order models of shallow water equations: Intrusive vs nonintrusive

We investigate the sensitivity of reduced order models (ROMs) to training data spatial resolution as well as sampling rate. In particular, we consider proper orthogonal decomposition (POD), coupled with Galerkin projection (POD-GP), as an intrusive reduced order modeling technique. For non-intrusive ROMs, we consider two frameworks. The first is using dynamic mode decomposition (DMD), and the second is based on artificial neural networks (ANNs). For ANN, we utilized a residual deep neural network, and for DMD we have studied two versions of DMD approaches; one with hard thresholding and the other with sorted bases selection. Also, we highlight the differences between mean-subtracting the data (centering) and using the data without mean-subtraction. We tested these ROMs using a system of 2D shallow water equations for four different numerical experiments, adopting combinations of sampling rates and spatial resolutions. For these cases, we found that the DMD basis obtained with hard threshodling is sensitive to sampling rate. The sorted DMD algorithm helps to mitigate this problem and yields more stabilized and converging solution. Furthermore, we demonstrate that both DMD approaches without mean subtraction provide significantly more accurate results than DMD with mean-subtracting the data. On the other hand, POD is relatively insensitive to sampling rate and yields better representation of the flow field. Meanwhile, spatial resolution has little effect on both POD and DMD performances. Here, the numerical results reveal that an ANN on POD subspace (POD-ANN) performs remarkably better than POD-GP and DMD in capturing system dynamics, even with a small number of modes.

42 ENGINEERING↗

X-ray diffraction under grazing incidence conditions

Material properties frequently relate to structures at or near surfaces, particularly in thin films. As a result, it is essential to understand these structures at the molecular and atomistic levels. The most accurate and widely used techniques for characterizing crystallographic order are based on X-ray diffraction. When dealing with thin films or interfaces, standard approaches, such as single crystal or powder diffraction, are not suitable. However, X-ray diffraction under grazing incidence conditions can provide the required information. Here, in this Primer, grazing incidence X-ray diffraction (GIXD) is comprehensively introduced, starting from basic considerations on X-ray diffraction at crystals with reduced dimensionality and the optical properties of X-rays, followed by a more in-depth description of an experimental performance, including X-ray sources, goniometers and detectors. Experimental errors, limitations and reproducibility are discussed. Various applications, from highly ordered inorganic single crystal surfaces to weakly ordered polymer thin films, are presented to illustrate the potential of GIXD. Data visualizations, representations and evaluation strategies are summarized, based on the example of anthracene thin films. The Primer compiles information relevant to perform high-quality GIXD experiments, evaluate data and interpret results, to extend knowledge about X-ray diffraction from surfaces, interfaces and thin films.

36 MATERIALS SCIENCE↗

Nonadditive Interactions Unlock Small-Particle Mobility in Binary Colloidal Monolayers

We examine the organization and dynamics of binary colloidal monolayers composed of micron-scale silica particles interspersed with smaller-diameter silica particles that serve as minority component impurities. These binary monolayers are prepared at the surface of ionic liquid droplets over a range of size ratios (σ = 0.16–0.66) and are studied with low-dose minimally perturbative scanning electron microscopy (SEM). The high resolution of SEM imaging provides direct tracking of all particle coordinates over time, enabling a complete description of the microscopic state. In these bidisperse size mixtures, particle interactions are nonadditive because interfacial pinning to the droplet surface causes the equators of differently sized particles to lie in separate planes. By varying the size ratio, we control the extent of nonadditivity in order to achieve phase behavior inaccessible to additive 2D systems. Across the range of size ratios, we tune the system from a mobile small-particle phase (σ < 0.24) to an interstitial solid (0.24 < σ < 0.33) and furthermore to a disordered glass (σ > 0.33). These distinct phase regimes are classified through measurements of hexagonal ordering of the large-particle host lattice and the lattice’s capacity for small-particle transport. Altogether, we explain these structural and dynamic trends by considering the combined influence of interparticle interactions and the colloidal packing geometry. Our measurements are reproduced in molecular dynamics simulations of 2D nonadditive disks, suggesting an efficient method for describing confined systems with reduced dimensionality representations.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

EMPHATIC Silicon Strip Detector Efficiencies

EMPHATIC is an experiment at Fermilab which aims to reduce current neutrino flux uncertainties. This report discusses the limitations current neutrino flux uncertainties places on large scale neutrino experiments, provides background on the EMPHATIC experiment, and details the project of determining the efficiency of the Silicon Strip Detectors (SSDs) used in EMPHATIC. As part of the data analysis process and in order to increase the accuracy of EMPHATIC’s simulations a representation of efficiency of each SSD is required. To achieve this a data-driven analysis was performed on EMPHATIC's collected data using the Root and Art frameworks. Visual and numerical representations of efficiency were determined. The average efficiency over all SSDs is 98.58\%, however this number deflated as it includes known bad channels.

Olson, Virginia [Illinois U., Urbana (main)]↗

Determining the Efficiency of EMPHATICs Silicon Strip Detectors (SSDs)

EMPHATIC is an experiment at Fermilab which aims to reduce current neutrino flux uncertainties. This report discusses the limitations current neutrino flux uncertainties places on large scale neutrino experiments, provides background on the EMPHATIC experiment, and details the project of determining the efficiency of the Silicon Strip Detectors (SSDs) used in EMPHATIC. As part of the data analysis process and in order to increase the accuracy of EMPHATIC’s simulations a representation of efficiency of each SSD is required. To achieve this a data-driven analysis was performed on EMPHATIC's collected data using the Root and Art frameworks. Visual and numerical representations of efficiency were determined. The average efficiency over all SSDs is 98.58\%, however this number deflated as it includes known bad channels.

Olson, V. [Illinois U., Urbana (main)]↗

Nonlinear manifold-based reduced order model

Traditional linear subspace reduced order models (LS-ROMs) are able to accelerate physical simulations, in which the intrinsic solution space falls into a subspace with a small dimension, i.e., the solution space has a small Kolmogorov n-width. However, for physical phenomena not of this type, e.g., any advection-dominated flow phenomena such as in traffic flow, atmospheric flows, and air flow over vehicles, a low-dimensional linear subspace poorly approximates the solution. To address cases such as these, we have developed a fast and accurate physicsinformed neural network ROM, namely nonlinear manifold ROM (NM-ROM), which can better approximate high-fidelity model solutions with a smaller latent space dimension than the LSROMs. Our method takes advantage of the existing numerical methods that are used to solve the corresponding full order models. The efficiency is achieved by developing a hyper-reduction technique in the context of the NM-ROM. Numerical results show that neural networks can learn a more efficient latent space representation on advection-dominated data from 1D and 2D Burgers’ equations. A speedup of up to 2.6 for 1D Burgers’ and a speedup of 11.7 for 2D Burgers’ equations are achieved with an appropriate treatment of the nonlinear terms through a hyper-reduction technique. Finally, a posteriori error bounds for the NM-ROMs are derived that take account of the hyper-reduced operators.

97 MATHEMATICS AND COMPUTING↗

Reducing Qubit Requirements while Maintaining Numerical Precision for the Variational Quantum Eigensolver: A Basis-Set-Free Approach

We present a basis-set-free approach to the variational quantum eigensolver using an adaptive representation of the spatial part of molecular wave functions.Our approach directly determines system-specific representations of qubit Hamiltonians while fully omitting globally defined basis sets. In this work, we use directly determined pair-natural orbitals on the level of second-order perturbation theory. This results in compact qubit Hamiltonians with high numerical accuracy. We demonstrate initial applications with compact Hamiltonians on up to 22 qubits where conventional representation would for the same systems require 40–100 or more qubits. Here, we further demonstrate reductions in the quantum circuits through the structure ofthe pair-natural orbitals.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗