Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “performance gain”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Simplifying activations with linear approximations in neural networks

A key step in Neural Networks is activation. Among the different types of activation functions, sigmoid, tanh, and others involve the usage of exponents for calculation. From a hardware perspective, exponential implementation implies the usage of Taylor series or repeated methods involving many addition, multiplication, and division steps, and as a result are power-hungry and consume many clock cycles. We implement a piecewise linear approximation of the sigmoid function as a replacement for standard sigmoid activation libraries. This approach provides a practical alternative by leveraging piecewise segmentation, which simplifies hardware implementation and improves computational efficiency. In this paper, we detail piecewise functions that can be implemented using linear approximations and their implications for overall model accuracy and performance gain. Our results show that for the DenseNet, ResNet, and GoogLeNet architectures, the piecewise linear approximation of the sigmoid function provides faster execution times compared to the standard TensorFlow sigmoid implementation while maintaining comparable accuracy. Specifically, for MNIST with DenseNet, accuracy reaches 99.91% (Piecewise) vs. 99.97% (Base) with up to 1.31x speedup in execution time. For CIFAR-10 with DenseNet, accuracy improves to 98.97% (Piecewise) vs. 99.40% (Base) while achieving 1.24x faster execution. Similarly, for CIFAR-100 with DenseNet, the accuracy is 97.93% (Piecewise) vs. 98.39% (Base), with a 1.18x execution time reduction. These results confirm the proposed method’s capability to efficiently process large-scale datasets and computationally demanding tasks, offering a practical means to accelerate deep learning models, including LSTMs, without compromising accuracy.

Activation function↗
DOE OSTI2023

Characterization of solid particle candidates for application in thermal energy storage and concentrating solar power systems

Thermal energy storage (TES) enables concentrating solar power to remain competitive in the renewable energy mix by firming up intermittent solar resource and providing grid services such as load shifting. Free from siting constraints, stand-alone TES systems show promise as a low-cost alternative to traditional pumped-storage hydropower or compressed air energy storage. At the core of all TES technologies is a storage medium, the selection of which governs many aspects of system design and operation. Although the majority of commercial installations utilize molten salts, solid particles can demonstrate stability over wider temperature ranges. This amounts to increased energy storage densities and corresponding reductions in system cost which is essential in achieving low-cost energy storage. In this work, eight solid particle candidates are systematically identified and screened for application in a specific particle-TES system. The five most promising candidates (CARBO CP and HSP, calcined flint clay (CFC), brown fused alumina (BFA), and silica sand) are further characterized by size and morphology for fluidization suitability, flowability for particle transport, and thermal stability. Calcined flint clay and brown fused alumina are eventually down-selected due to thermal instability at the target operational temperature of 1200 °C. Although the physical characteristics of CARBO outperform silica sand in all categories examined, the marginal performance gains are considered insufficient to justify the additional media cost so silica sand is selected as the leading candidate. Within the silica sand (α-quartz) space, the high end of Geldart Group B particles is identified to satisfy the target fluidization regime for the application of interest without compromising particle flowability. Here, in focused testing, Silica 460 is shown to exhibit sufficient stability through long-duration (500-hour) thermal and cyclic testing (1200 °C), 10-hour testing at 1400 °C, and in contact with candidate refractory containment materials. Finally, an average heat capacity of 1.1 J/g∙ °C is measured over 300-1200 °C with a quartz inversion enthalpy (ΔH α-β ) of 10.7J/g.

14 SOLAR ENERGY↗
DOE OSTI2020

Macroscopic Nonuniformities in Metal Grids Formed by Cracked Film Lithography Result in 19.3% Efficient Solar Cells

Cracked film lithography (CFL) is an emerging method for patterning transparent conductive metal grids. CFL can be vacuum- and Ag-free, and it forms more durable grids than nanowire approaches. In spite of CFL’s promising transmittance/grid sheet resistance/wire spacing tradeoffs, previous solar cell demonstrations have had relatively low performance. This work introduced macroscopic nonuniformities in the grids to improve the short-circuit current density/fill factor tradeoff in small area Cu(In,Ga)Se2 cells. Furthermore, the performance of optimized baseline grids was matched by CFL grids with microscopic openings and macroscopic patterns, culminating in a 19.3%-efficient cell. Simulations show that uniform CFL grids are enhanced by patterning because it leads to better balance among shadowing, grid resistance and transparent conductive oxide resistance losses. Thin-film module efficiency calculations were performed to highlight the performance gains that metal grids can enable by eliminating the transparent conductive oxide losses and widening monoliths. Adding the patterned CFL grids demonstrated in this work to CIGS modules is predicted to reach 0.7% higher efficiency (absolute) than screen-printed grids.

14 SOLAR ENERGY↗
DOE OSTI2020

Performance and Accuracy Implications of Parallel Split Physics-Dynamics Coupling in the Energy Exascale Earth System Atmosphere Model

Simultaneous calculation of atmospheric processes is faster than calculating processes one at a time. This type of parallelism is beneficial or perhaps even necessary to provide good performance on modern supercomputers, which achieve faster performance through increased processor count rather than improved clock speed. The scalability of the Energy Exascale Earth System Model (E3SM) Atmosphere Model (EAM) is limited by the fluid dynamics which scales up to the number of mesh cells in the global mesh. In contrast, the suite of physics parameterizations in EAM is scalable up to the total number of physics columns, which is an order of magnitude greater than the number of mesh cells. A proposed solution to unlocking the greater potential performance from the physics suite is to solve the physics and dynamics in parallel. This work represents a first attempt at parallel splitting of the grid-scale fluid dynamics model and the subgrid-scale physics parameterizations in a global atmosphere model. We will demonstrate that switching to parallel physics-dynamics coupling extends the scalability of the EAM to up to 3 times the previous peak scalability limit and is up to 20% faster than the sequentially split coupling at the highest core counts and the same time step. Decadal simulations of both coupling approaches show very little impact to the model climate. This improved performance does not come without drawbacks, however. Parallel splitting requires a shorter time step and other modifications which largely offset performance gains. A mass fixer is required for conservation. Techniques for mitigating these issues are also discussed.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Regularization via f -Divergence: An Application to Multi-Oxide Spectroscopic Analysis

In this paper, we explore the application of convolutional neural networks (CNNs) for predicting the chemical composition of complex geologic samples in a simulated Martian atmospheric environment. Specifically, we aim to characterize oxide weight percentages (wt.%) of rock samples analyzed by remote Laser-Induced Breakdown Spectroscopy (LIBS), framing the problem as a multi-target regression task . Neural networks trained on LIBS spectra are prone to overfitting due to high spectral complexity, limited labeled data, and measurement noise. While regularization is critical for improving generalization, common methods (e.g., ℓ 2 regularization) impose constraints not directly tied to data distribution properties. We propose a novel regularization method based on a specific ƒ-divergence induced by a graph-based estimator, designed to constrain the distributional discrepancy between predictions and targets. This regularizer serves a dual purpose: (a) mitigating overfitting by enforcing a constraint on the distributional difference between predictions and noisy targets, and (b) acting as an auxiliary loss that penalizes large divergences. To enable backpropagation, we develop a differentiable approximation of this particular ƒ-divergence, making the method feasible for neural networks. Experiments on ChemCam and SuperCam LIBS calibration spectra show that mathematical equation-divergence regularization outperforms or matches standard regularization methods (ℓ 1 , ℓ 2 , dropout) and the classical baseline, partial least squares (PLS). Combining ƒ-divergence regularization with standard regularization yields further performance gains, indicating that distributional regularization is useful in this context giving a promising direction for robust model training in planetary science applications. Source code is publicly available at Klein and Li (2025), https://doi.org/10.11578/dc.20250530.7.

58 GEOSCIENCES↗
DOE OSTI2020

DDxNet: a deep learning model for automatic interpretation of electronic health records, electrocardiograms and electroencephalograms

Effective patient care mandates rapid, yet accurate, diagnosis. With the abundance of non-invasive diagnostic measurements and electronic health records (EHR), manual interpretation for differential diagnosis has become time-consuming and challenging. This has led to wide-spread adoption of AI-powered tools, in pursuit of improving accuracy and efficiency of this process. While the unique challenges presented by each modality and clinical task demand customized tools, the cumbersome process of making problem-specific choices has triggered the critical need for a generic solution to enable rapid development of models in practice. In this spirit, we develop DDxNet, a deep architecture for time-varying clinical data, which we demonstrate to be well-suited for diagnostic tasks involving different modalities (ECG/EEG/EHR), required level of characterization (abnormality detection/phenotyping) and data fidelity (single-lead ECG/22-channel EEG). Using multiple benchmark problems, we show that DDxNet produces high-fidelity predictive models, and sometimes even provides significant performance gains over problem-specific solutions.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2025

Delay-resolved spectroscopy in terahertz photonic circuits

Photonic integrated circuits incorporating intersubband transitions are ideal for mid-infrared and terahertz nanophotonics. However, the design of epitaxies has long been inhibited by two factors: the modest predictivity of ab initio theory and the absence of absolute intersubband gain and loss measurements under operating conditions. Existing measurements either yield inaccurate gain profiles or do not accurately assess dependence on frequency, bias, and temperature. Here, we present a delay-resolved absolute-referencing method for accurate gain evaluation without these limitations, addressing a long-standing challenge. By creating a photonic circuit that allows broadband pulses to traverse different lengths of a gain medium, we measure the absolute transmission of intersubband structures. Gain profiles match theoretical predictions at lower temperatures, with gain and dispersion clamping after lasing, and faster-than-expected degradation occurs at higher temperatures. Our approach provides a precise experimental evaluation of temperature-dependent gain performance and gives insight into optimizing temperature performance and frequency comb designs.

Optical spectroscopy↗
DOE OSTI2026

A variational framework for residual-based adaptivity in neural PDE solvers and operator learning

Residual-based adaptive strategies are widely used in scientific machine learning yet remain largely heuristic. We introduce a variational framework that formalizes these methods through convex transformations of the residual, where different transformations correspond to distinct objective functionals. For instance, exponential weights target uniform error minimization, while linear weights recover quadratic error minimization. This perspective reveals adaptive weighting as a means of selecting sampling distributions that optimize a primal objective, directly linking discretization choices to error metrics. This principled approach yields three key benefits: it enables systematic design of adaptive schemes, reduces discretization error by lowering estimator variance, and enhances learning dynamics by improving gradient signal-to-noise ratio. Extending the framework to operator learning, we demonstrate substantial performance gains across diverse optimizers and architectures. Our results provide a theoretical perspective for residual-based adaptivity and establish a foundation for principled discretization and training.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Measurements of enhanced performance in an indirect drive inertial confinement fusion experiment when reducing the contact area of the capsule support

Experimental results from indirectly driven inertial confinement fusion experiments testing the performance gained from using an alternate capsule tent support are reported. The polar tent describes an alternate geometry for the thin membrane used to support the Deuterium–Tritium (DT) filled capsule. In this work, the contact area is reduced by 23 times by locating the tent support close to the poles of the capsule. The polar tent experiments are repeats of previous 3 shock 1.63 MJ, 400 TW high foot experiments and use a 165 μm thick silicon doped carbon hydrogen plastic (CH) shell. Using the polar tent support, we report a DT neutron yield of 1.07 ×1016, 76% higher than the expected Y DT ∝V 7.7 scaling. This is, at the time of writing, the highest neutron yield to date from a CH shell implosion. Furthermore, we find that the inferred pressure when using the polar tent is significantly above the model based on analytic scaling even when accounting for tent effects. Analysis of x-ray and neutron images shows the reduction of lobes produced by nominal tent features. The reduction of these features in the polar tent experiments leads to decreased low mode (P2 and P4) asymmetry compared to the nominal tent results.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2020

Impact of dopant-induced optoelectronic tails on open-circuit voltage in arsenic-doped Cd(Se)Te solar cells

Fluctuations refer to inhomogeneity in the distribution of donors and acceptors at the nanometer scale and occur in many compound solar cell materials such as Cu(In,Ga)Se 2 , Cu 2 ZnSn(S,Se) 4 , and CdSe x Te 1-x . In this work, numerical simulations show that these fluctuations produce not only electrostatic potential variation, but also, local changes in the carrier density and effective bandgap. For a CdSe x Te 1-x absorber doped with arsenic, simulations and cathodoluminescence data within single grains demonstrate how donor and acceptor densities—consistent with capacitance-voltage and secondary-ion mass-spectrometry data—produce tails in photoluminescence, quantum efficiency, and absorption measurements. Using multiple theoretical approaches, we demonstrate that the fluctuations can hinder expected performance gains from increased carrier density, and we describe the significant open-circuit voltage deficit observed in the CdSe x Te 1-x :As solar technology. Our results demonstrate that it is critical to characterize and reduce carrier compensation to realize a higher efficiency.

14 SOLAR ENERGY↗
DOE OSTI2021

Assessment of Screen-Covered Grooved Sodium Heat Pipes for Microreactor Applications

New nuclear reactor designs that incorporate heat pipes are being investigated for possible near-term deployment in terrestrial applications. Here, this study explores the use of screen-covered axially grooved sodium heat pipes and their applicability for providing heat removal for microreactors. A sodium working fluid is appropriate for microreactors operating in the 5 to 20 MW(thermal) range at approximately 650°C. HTPIPE, a legacy software code, was validated for the case of screen-covered grooves and used to perform steady-state analyses to determine the performance limits of a proposed heat pipe design. The performance limits of a sodium heat pipe with a screen-covered square grooved wick structure is compared to that of an equivalent heat pipe with an annular wick. In a horizontal orientation at an operating temperature of 650°C,the performance limits for the heat pipe with an annular wick configuration are 15% higher than for the screen-covered grooved wick. At operating temperatures below 777°C, the annular wick outperforms the screen-covered grooved wick, and at temperatures above 777°C, the screen-covered grooved wick outperforms the annular wick. However, the marginal performance gain at higher temperatures may not justify the use of heat pipes with a screen-covered grooved wick structure due to increased manufacturing costs.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2024

Smart pixel sensors: towards on-sensor filtering of pixel clusters with deep learning

Highly granular pixel detectors allow for increasingly precise measurements of charged particle tracks. Next-generation detectors require that pixel sizes will be further reduced, leading to unprecedented data rates exceeding those foreseen at the High- Luminosity Large Hadron Collider. Signal processing that handles data incoming at a rate of $\mathcal{O}$(40 MHz) and intelligently reduces the data within the pixelated region of the detector at rate will enhance physics performance at high luminosity and enable physics analyses that are not currently possible. Using the shape of charge clusters deposited in an array of small pixels, the physical properties of the traversing particle can be extracted with locally customized neural networks. In this first demonstration, we present a neural network that can be embedded into the on-sensor readout and filter out hits from low momentum tracks, reducing the detector's data volume by 57.1%–75.7%. The network is designed and simulated as a custom readout integrated circuit with 28 nm CMOS technology and is expected to operate at less than 300 μW with an area of less than 0.2 mm 2 . The temporal development of charge clusters is investigated to demonstrate possible future performance gains, and there is also a discussion of future algorithmic and technological improvements that could enhance efficiency, data reduction, and power per area.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2023

Suppressing Quantum Circuit Errors Due to System Variability

We present a quantum circuit optimization technique that takes into account the variability in error rates that is inherent across present-day noisy quantum computing platforms. This method can be run after qubit routing or postcompilation and consists of computing isomorphic subgraphs to input circuits and scoring each using heuristic cost functions derived from system calibration data. Using an independent standard algorithmic test suite, we show that it is possible to recover on average nearly 40% of missing fidelity using better qubit selection via efficient to compute cost functions. We demonstrate additional performance gains by considering qubit placement over multiple quantum processors. The overhead from these tools is minimal with respect to other compilation steps, such as qubit routing, as the number of qubits increases. As such, our method can be used to find qubit mappings for problems at the scale of quantum advantage and beyond.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2025

Multi-Label Classification with Constraint-Based Learning for Hierarchical Consistency

We explore the limitations of traditional crossentropy loss in a hierarchical multi-label classification setting and introduce a novel loss function. This function is designed to integrate hierarchical constraints directly into the training process. By incorporating such constraints into the loss, our approach slightly improves the logical consistency of predictions in structured domains. We demonstrate the efficacy of our approach through experiments on primary site and histology classification by using electronic pathology reports. These results show that our proposed hierarchical loss function enhances the model's ability to produce predictions that are logically consistent with the natural data hierarchies, and it slightly improves predictive accuracy. Our framework may be extended to other hierarchical domains, however the performance gains are context specific.

Shivanna, Abhishek [ORNL] (ORCID:0009000665228593)↗
DOE OSTI2021

Early Evaluation of Fugaku A64FX Architecture Using Climate Workloads

The Energy Exascale Earth System Model (E3SM) Project is an ongoing, state-of-the-science Earth system modeling, simulation, and prediction project that targets efficient utilization of U.S. Department of Energy’s (DOE) supercomputers to meet the science needs of the nation and the mission needs of DOE. This work focuses on our early evaluation of the A64FX architecture on Fugaku supercomputer using E3SM benchmarks. We will present results that track hardware trends, facilitate architecture comparison and the specific impact on our workload using an atmospheric model benchmark. We have two variants of the code written in Fortran and C++/Kokkos respectively which were used to collect data on a variety of CPU and GPU platforms. Furthermore, we have conducted a comparative evaluation of the compilers on the A64FX architecture and found GNU to be the best performer for our workload. Our experience so far indicates that Fugaku/A64FX shows promising energy efficiency (performance/Watt) with further performance gains possible through architecture-aware optimization efforts.

Sreepathi, Sarat↗
DOE OSTI2026

Optimal Client Sampling in Federated Learning with Client-level Heterogeneous Differential Privacy

Federated Learning with client-level differential privacy (DP) provides a promising framework for collaboratively training models while rigorously protecting clients’ privacy. However, classic approaches like DP-FedAvg struggle when clients have heterogeneous privacy requirements, as they must uniformly enforce the strictest privacy level across all clients, leading to excessive DP noise and significant degradation in model utility. Existing methods to improve the model utility in such heterogeneous privacy settings often assume a trusted server and are largely heuristic, resulting in suboptimal performance and lacking strong theoretical foundations. Here, in this work, we address these challenges under a practical attack model where both clients and the server are honest-but-curious. We propose GDPFed, which partitions clients into groups based on their privacy budgets and achieves client-level DP within each group to reduce the privacy budget waste and hence improve the model utility. Based on the privacy and convergence analysis of GDPFed, we find that the magnitude of DP noise depends on both model dimensionality and the per-group client sampling ratios. To further improve the performance of GDPFed, we introduce GDPFed+, which integrates model sparsification to eliminate unnecessary noise and optimizes per-group client sampling ratios to minimize convergence error. Extensive empirical evaluations on multiple benchmark datasets demonstrate the effectiveness of GDPFed+, showing substantial performance gains compared with state-of-the-art methods.

Xu, Jiahao [Univ. of Nevada, Reno, NV (United Stat↗
DOE OSTI2020

PLEXUS: A Pattern-Oriented Runtime System Architecture for Resilient Extreme-Scale High-Performance Computing Systems

For high-performance computing (HPC) system designers and users, meeting the myriad challenges of next-generation exascale supercomputing systems requires rethinking their approach to application and system software design. Among these challenges, providing resiliency and stability to the scientific applications in the presence of high fault rates requires new approaches to software architecture and design. As HPC systems become increasingly complex, they require intricate solutions for detection and mitigation for various modes of faults and errors that occur in these large-scale systems, as well as solutions for failure recovery. These resiliency solutions often interact with and affect other system properties, including application scalability, power and energy efficiency. Therefore, resilience solutions for HPC systems must be thoughtfully engineered and deployed.In previous work, we developed the concept of resilience design patterns, which consist of templated solutions based on well-established techniques for detection, mitigation and recovery. In this paper, we use these patterns as the foundation to propose new approaches to designing runtime systems for HPC systems. The instantiation of these patterns within a runtime system enables flexible and adaptable end-to-end resiliency solutions for HPC environments. The paper describes the architecture of the runtime system, named Plexus, and the strategies for dynamically composing and adapting pattern instances under runtime control. This runtime-based approach enables actively balancing the cost-benefit trade-off between performance overhead and protection coverage of the resilience solutions. Based on a prototype implementation of PLEXUS, we demonstrate the resiliency and performance gains achieved by the pattern-based runtime system for a parallel linear solver application.

Hukerikar, Saurabh↗
DOE OSTI2024

Error-controlled Progressive Retrieval of Scientific Data under Derivable Quantities of Interest

The unprecedented amount of scientific data has introduced heavy pressure on the current data storage and transmission systems. Progressive compression has been proposed to mitigate this problem, which offers data access with on-demand precision. However, existing approaches only consider precision control on primary data, leaving uncertainties on the quantities of interest (QoIs) derived from it. In this work, we present a progressive data retrieval framework with guaranteed error control on derivable QoIs. Our contributions are three-fold. (1) We carefully derive the theories to strictly control QoI errors during progressive retrieval. Our theory is generic and can be applied to any QoIs that can be composited by the basis of derivable QoIs proved in the paper. (2) We design and develop a generic progressive retrieval framework based on the proposed theories, and optimize it by exploring feasible progressive representations. (3) We evaluate our framework using five real-world datasets with a diverse set of QoIs. Experiments demonstrate that our framework can faithfully respect any user-specified QoI error bounds in the evaluated applications. This leads to over 2.02× performance gain in data transfer tasks compared to transferring the primary data while guaranteeing a QoI error that is less than 1E-5.

Wu, Xuan↗