Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Computational efficiency”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,027 records · Page 57

MoE-Inference-Bench: Performance Evaluation of Mixture of Expert Large Language and Vision Models

Mixture of Experts (MoE) models have enabled the scaling of Large Language Models (LLMs) and Vision Language Models (VLMs) by achieving massive parameter counts while maintaining computational efficiency. However, MoEs introduce several inference-time challenges, including load imbalance across experts and the additional routing computational overhead. To address these challenges and fully harness the benefits of MoE, a systematic evaluation of hardware acceleration techniques is essential. We present MoE-Inference-Bench, a comprehensive study to evaluate MoE performance across diverse scenarios. We analyze the impact of batch size, sequence length, and critical MoE hyperparameters such as FFN dimensions and number of experts on throughput. We evaluate several optimization techniques on Nvidia H100 GPUs, including pruning, Fused MoE operations, speculative decoding, quantization, and various parallelization strategies. Our evaluation includes MoEs from the Mixtral, DeepSeek, OLMoE and Qwen families. The results reveal performance differences across configurations and provide insights for the efficient deployment of MoEs.

Chitty-Venkata, Krishna Teja↗

The application of the mesh-free method in the numerical simulations of the higher-order continuum structures

This paper attempts to study the application of mesh-free method in the numerical simulations of the higher-order continuum structures. A high-order bending beam considers the effect of the third-order derivative of deflections, and can be viewed as a one-dimensional higher-order continuum structure. The moving least-squares method is used to construct the shape function with the high-order continuum property, the curvature and the third-order derivative of deflections are directly interpolated with nodal variables and the second- and third-order derivative of the shape function, and the mesh-free computational scheme is establish for beams. The coupled stress theory is introduced to describe the special constitutive response of the layered rock mass in which the bending effect of thin layer is considered. The strain and the curvature are directly interpolated with the nodal variables, and the mesh-free method is established for the layered rock mass. The good computational efficiency is achieved based on the developed mesh-free method, and some key issues are discussed.

97 MATHEMATICS AND COMPUTING↗

Real-Time Compton Imaging for the GammaTracker Handheld CdZnTe Detector

We are currently developing a handheld radioisotope identifier containing 18 position-sensitive CdZnTe crystals. In addition to isotope identification, the device performs basic Compton imaging to determine the location of suspected sources. This paper presents two computationally efficient algorithms for this purpose. The first algorithm traces individual Compton cones onto the unit sphere, whereas the second algorithm computes the intersection of two Compton cones and the unit sphere. Simulations demonstrate that the algorithms are suitable for determining the directionality, even with features such as uncertainty calculations omitted. The one-cone algorithm works more efficiently at high count rates, but the two-cone algorithm generates fewer image artifacts.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Three-dimensional boundary element thermal shape sensitivity analysis

A computationally efficient and accurate shape design sensitivity analysis approach for the thermal response of 3D solid objects is presented which utilizes a direct, singular, boundary element analysis formulation. The theoretical formulation for the primary response (the surface temperature and normal heat flux) sensitivities and the secondary response (tangential components of the heat flux, vector, interior point temperature and heat flux vector components) sensitivities are presented. A number of computational issues related to the overall efficiency of implementation of these formulations are discussed. Numerical results are presented to demonstrate the accuracy and efficiency of this approach.

Prasad, K. G.↗

The efficient calculation of chemically reacting flow

A semi-implicit finite volume formulation is used to study flows with chemical reactions. In this formulation the source terms resulting from the chemical reactions are treated implicitly and the resulting system of partial differential equations is solved using two time-stepping schemes. The first is based on the Runge-Kutta method while the second is based on an Adams predictor-corrector method. Results show that improvements in computational efficiency depend to a large extent on the manner in which the source term is treated. Further, analysis and computation indicate that the Runge-Kutta method is more efficient than the Adams methods. Finally, an adaptive time stepping scheme is developed to study problems involving shock ignition. Calculations for a hydrogen-air system agree well with other methods.

Eklund, D. R.↗

Rate constants of chemical reactions from semiclassical transition state theory in full and one dimension

Semiclassical Transition State Theory (SCTST), a method for calculating rate constants of chemical reactions, offers gains in computational efficiency relative to more accurate quantum scattering methods. In full-dimensional (FD) SCTST, reaction probabilities are calculated from third and fourth potential derivatives along all vibrational degrees of freedom. However, the computational cost of FD SCTST scales unfavorably with system size, which prohibits its application to larger systems. In this study, the accuracy and efficiency of 1-D SCTST, in which only third and fourth derivatives along the reaction mode are used, are investigated in comparison to those of FD SCTST. Potential derivatives are obtained from numerical ab initio Hessian matrix calculations at the MP2/cc-pVTZ level of theory, and Richardson extrapolation is applied to improve the accuracy of these derivatives. Reaction barriers are calculated at the CCSD(T)/cc-pVTZ level. Results from FD SCTST agree with results from previous theoretical and experimental studies when Richardson extrapolation is applied. Results from our implementation of 1-D SCTST, which uses only 4 single-point MP2/cc-pVTZ energy calculations in addition to those for conventional TST, agree with FD results to within a factor of 5 at 250 K. This degree of agreement and the efficiency of the 1-D method suggest its potential as a means of approximating rate constants for systems too large for existing quantum scattering methods.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Using the boundary-layer equations in three-dimensional viscous flow simulation

A simple and computationally efficient algorithm for solving the unsteady three dimensional boundary layer equations in a time accurate or relaxation mode is presented. The algorithm is used to compute the separated flow over a 6:1 ellipsoid at angle of attack and the transonic flow over a finite wing with shock induced separation. These results are compared to available experimental data. A method of using the boundary layer algorithm to accelerate a Navier-Stokes computation is also presented. Example computations indicate that a boundary layer algorithm can be used to improve both the accuracy and efficiency of a Navier-Stokes algorithm.

Vandalsem, William R.↗

Model reduction for fractured porous media: a machine learning approach for identifying main flow pathways

Discrete fracture networks (DFN) are often used to model flow and transport in fractured porous media. The accurate resolution of flow and transport behavior on a large DFN involving thousands of fractures is computationally expensive. This makes uncertainty quantification studies of quantities of interest such as travel time through the network computationally intractable, since hundreds to thousands of runs of the DFN model are required to get bounds on the uncertainty of the predictions. Prior works on the subject demonstrated that the complexity of a DFN could be reduced by considering a sub-network of it (often termed a “backbone” sub-network), one whose flow and transport properties were then shown to be similar to that of the full network. The technique is tantamount to partitioning the complete set of fractures of a network into two disjoint sets, one of which is the backbone sub-network while the other its complement. It is in this context that we present a system-reduction technique for DFNs using supervised machine learning via a Random Forest Classifier that selects a backbone sub-network from the full set of fractures. The in-sample errors (in terms of precision and recall scores) of the trained classifier are found to be very accurate indicators of the out-of-sample errors, thus exhibiting that the classifier generalizes well to test data. Moreover, this system-reduction technique yields sub-networks as small as 12% of the full DFN that still recover transport characteristics of the full network such as the peak dosage and tailing behavior for late times. Most importantly, the sub-networks remain connected, and their size can be controlled by a single dimensionless parameter. Furthermore, measures of KL-divergence and KS-statistic for the breakthrough curves of the sub-networks with respect to the full network show physically realistic trends in that the measures decrease monotonically as the size of the sub-networks increase. In conclusion, the computational efficiency gained by this technique depends on the size of the sub-network, but large reductions in computational time can be expected for small sub-networks, yielding as much as 90% computational savings for sub-networks that are as small as 10-12% of the full network.

97 MATHEMATICS AND COMPUTING↗

Adaptive reduction of constitutive model-form error using a posteriori error estimation techniques

In engineering practice, models are typically kept as simple as possible for ease of setup and use, computational efficiency, maintenance, and overall reduced complexity to achieve robustness. In solid mechanics, a simple and efficient constitutive model may be favored over one that is more predictive, but is difficult to parameterize, is computationally expensive, or is simply not available within a simulation tool. In order to quantify the modeling error due to the choice of a relatively simple and less predictive constitutive model, we adopt the use of a posteriori model-form error-estimation techniques. Based on local error indicators in the energy norm, an algorithm is developed for reducing the modeling error by spatially adapting the material parameters in the simpler constitutive model. The resulting material parameters are not material properties per se , but depend on the given boundary-value problem. As a first step to the more general nonlinear case, we focus here on linear elasticity in which the “complex” constitutive model is general anisotropic elasticity and the chosen simpler model is isotropic elasticity. As a result, the algorithm for adaptive error reduction is demonstrated using two examples: (1) A transversely-isotropic plate with hole subjected to tension, and (2) a transversely-isotropic tube with two side holes subjected to torsion.

42 ENGINEERING↗

Representation of correlation statistics functions in heterogeneous materials using layered fast spherical harmonics expansion

Statistical correlation function, including two-point function, is one of the popular methods to digitize microstructure quantitatively. This paper investigated how to represent statistical correlations using layered fast spherical harmonics expansion. A set of spherical harmonics coefficients may be used to represent the corresponding microstructures. It is applied to represent carbon nanotube composite microstructures to demonstrate how efficiently and precisely the harmonics coefficients will characterize the microstructure. This microstructure representation methodology will dramatically improve the computational efficiencies for future works in microstructure reconstruction and property prediction.

77 NANOSCIENCE AND NANOTECHNOLOGY↗

The role of quantum computing in advancing scientific high-performance computing: A perspective from the ADAC institute

Quantum computing (QC) has gained significant attention over the past two decades due to its potential for speeding up classically demanding tasks. This transition from an academic focus to a thriving commercial sector is reflected in substantial global investments. While advancements in qubit counts and functionalities continue at a rapid pace, current quantum systems still lack the scalability for practical applications, facing challenges such as too high error rates and limited coherence times. Here, this perspective paper examines the relationship between QC and high-performance computing (HPC), highlighting their complementary roles in enhancing computational efficiency. It is widely acknowledged that even fully error-corrected QC will not be suited for all computational tasks. Rather, future compute infrastructures are anticipated to employ quantum acceleration within hybrid systems that integrate HPC and QC. While QC can enhance classical computing, traditional HPC remains essential for maximizing quantum acceleration. This integration is a priority for supercomputing centers and companies, sparking innovation to address the challenges of merging these technologies. The novelty of this work lies in its unique perspective, reflecting the collective insights of the Accelerated Data Analytics and Computing (ADAC) Institute, a global consortium of over 20 leading HPC centers. Recognizing the growing importance of QC, ADAC established a Quantum Computing Working Group in 2023 to foster collaboration and knowledge-sharing among its members. This paper synthesizes insights from the group’s collaborative efforts and incorporates findings from a member survey that captures shared experiences, ongoing projects, and strategic directions. By outlining the current landscape and challenges of QC integration into HPC ecosystems, this work offers HPC specialists practical and forward-looking guidance on the opportunities and implications of QC in computationally intensive endeavors.

Accelerated Data Analytics and↗

Improving Resilience of Bus Bunching Holding Strategy through a Rolling Horizon Approach

Providing public transportation with quality service is critical to attracting more passengers to the system. However, high-demand routes are prone to the so-called bus bunching -- a tendency of buses to group as a consequence of variations in travel times and demands. Bus holding is applied to overcome this effect. In this study, we present a novel method for bus holding in which the control law is based only on the buses' position using a computationally efficient rolling horizon approach. The method uses similar inputs as linear control approaches while not increasing significantly the computational time. However, the method overcomes key a weakness of the linear control approach thanks to the explicit constraint handling that always ensures the control action effectiveness. Simulation experiments in a validation case and a model-specific for a bus rapid transit line in Curitiba, Brazil showed a reduced holding time and improved resilience, delivering more than 20% reduction in delay time accounting for the on-board and station delays.

33 ADVANCED PROPULSION SYSTEMS↗

Calibrating constitutive models with full‐field data via physics informed neural networks

Abstract The calibration of solid constitutive models with full‐field experimental data is a long‐standing challenge, especially in materials that undergo large deformations. In this paper, we propose a physics‐informed deep‐learning framework for the discovery of hyperelastic constitutive model parameterizations given full‐field surface displacement data and global force‐displacement data. Contrary to the majority of recent literature in this field, we work with the weak form of the governing equations rather than the strong form to impose physical constraints upon the neural network predictions. The approach presented in this paper is computationally efficient, suitable for irregular geometric domains, and readily ingests displacement data without the need for interpolation onto a computational grid. A selection of canonical hyperelastic material models suitable for different material classes is considered including the Neo–Hookean, Gent, and Blatz–Ko constitutive models as exemplars for general non‐linear elastic behaviour, elastomer behaviour with finite strain lock‐up, and compressible foam behaviour, respectively. We demonstrate that physics informed machine learning is an enabling technology and may shift the paradigm of how full‐field experimental data are utilized to calibrate constitutive models under finite deformations.

Hamel, Craig M.↗

Workshop on Advanced Computing for Connected and Automated Vehicles

To safely and reliably operate without a human driver, connected and automated vehicles (CAVs) require more advanced computing hardware and software solutions than are implemented today in vehicles that provide driver-assistance features. A workshop was held to discuss advanced microelectronics and computing approaches that can help meet future energy and computational requirements for CAVs. Workshop questions were posed as follows: will highly automated vehicles be viable with conventional computing approaches or will they require a step-change in computing; what are the energy requirements to support on-board sensing and computing; and what advanced computing approaches could reduce the energy requirements while meeting their computational requirements? At present, there is no clear convergence in the computing architecture for highly automated vehicles. However, workshop participants generally agreed that there is a need to improve the computing performance per watt by at least 10x to advance the degree of automation. Participants suggested that DOE and the national laboratories could play a near-term role by developing benchmarks for determining and comparing CAV computing performance, developing public data sets to support algorithm and software development, and contributing precompetitive advancements in energy efficient computing.

33 ADVANCED PROPULSION SYSTEMS↗

A Novel Deep Reinforcement Learning Approach to Traffic Signal Control with Connected Vehicles

The advent of connected vehicle (CV) technology offers new possibilities for a revolution in future transportation systems. With the availability of real-time traffic data from CVs, it is possible to more effectively optimize traffic signals to reduce congestion, increase fuel efficiency, and enhance road safety. The success of CV-based signal control depends on an accurate and computationally efficient model that accounts for the stochastic and nonlinear nature of the traffic flow. Without the necessity of prior knowledge of the traffic system’s model architecture, reinforcement learning (RL) is a promising tool to acquire the control policy through observing the transition of the traffic states. In this paper, we propose a novel data-driven traffic signal control method that leverages the latest in deep learning and reinforcement learning techniques. By incorporating a compressed representation of the traffic states, the proposed method overcomes the limitations of the existing methods in defining the action space to include more practical and flexible signal phases. The simulation results demonstrate the convergence and robust performance of the proposed method against several existing benchmark methods in terms of average vehicle speeds, queue length, wait time, and traffic density.

42 ENGINEERING↗

Long-term orbit prediction for the Venus Radar Mapper Mission using an averaging method

A set of singly averaged equations of motion are presented and applied to long-term orbit prediction of an orbiting spacecraft around a slowly rotating planet, using the Venus Radar Mapper Mission as an example. The equations of motion used are valid for all eccentricities less than one. The disturbing potentials used include nonsphericity of the Venus gravity field and third-body effects due to the sun. Recursive relationships are used in the expansion and evaluation of these potentials and their respective partial derivatives. Special care is taken to optimize computational efficiency. The averaging method is compared with high precision Cowell's method using a desktop microcomputer and shows computational saving of about two orders of magnitude.

Kwok, J. H.↗

A three-dimensional incompressible flow simulation method and its application to the Space Shuttle main engine. II Turbulent flow

An implicit finite difference code cast in general curvilinear coordinates is further developed for three-dimensional incompressible turbulent flows. The code is based on the method of pseudocompressibility and utilizes the Beam and Warming implicit approximate factorization algorithm to achieve computational efficiency. A multiple-zone method is further extended to include composite-grids to overcome the excessive computer memory required for solving turbulent flows in complex three-dimensional geometries. A simple turbulence model is proposed for internal flows. The code is being used for the Space Shuttle Main Engine (SSME) internal flow analyses.

Chang, J. L. C.↗

New techniques for reversible compression of multispectral data

While spatial correlations are adequately exploited by standard lossless image compression techniques, little success has been attained in exploiting spectral correlations when dealing with multispectral image data. In this paper, we present some new lossless image compression techniques that capture spectral correlations as well as spatial correlation in a simple and elegant manner. The schemes are based on the notion of a prediction tree, which defines a non-causal prediction model for an image. We present a backward adaptive technique and a forward adaptive technique. We then give a computationally efficient way of approximating the backward adaptive technique. The approximation gives good results and is extremely easy to compute. Simulation results show that for high spectral resolution images, significant savings can be made by using spectral correlations in addition to spatial correlations. Furthermore, the increase in complexity incurred in order to make these gains is minimal.

Memon, N. D.↗