Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “error performance”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

Robustness of deep learning algorithms in astronomy -- galaxy morphology studies

Deep learning models are being increasingly adopted in wide array of scientific domains, especially to handle high-dimensionality and volume of the scientific data. However, these models tend to be brittle due to their complexity and overparametrization, especially to the inadvertent adversarial perturbations that can appear due to common image processing such as compression or blurring that are often seen with real scientific data. It is crucial to understand this brittleness and develop models robust to these adversarial perturbations. To this end, we study the effect of observational noise from the exposure time, as well as the worst case scenario of a one-pixel attack as a proxy for compression or telescope errors on performance of ResNet18 trained to distinguish between galaxies of different morphologies in LSST mock data. We also explore how domain adaptation techniques can help improve model robustness in case of this type of naturally occurring attacks and help scientists build more trustworthy and stable models.

79 ASTRONOMY AND ASTROPHYSICS↗

EFCOG Human Performance Improvement Task Group: Task 20-2, Asking Better Error Precursor Questions for Effective Job Planning, Pre-Job Briefs, and Event Investigations

The second principle of human performance states: “error-likely situations are predictable, manageable, and preventable.” An error-likely situation comes into play when task-related factors exceed the capabilities of the individual, creating a mismatch at the point when the individual is “touching” either the physical or the paper plant. The simple presence of adverse conditions cannot be error-likely unless a specific action is to occur within that set of adverse conditions.

99 GENERAL AND MISCELLANEOUS↗

Performance and power modeling and prediction using MuMMI and 10 machine learning methods

Energy-efficient scientific applications require insight into how high performance computing system features impact the applications' power and performance. This insight can result from the development of performance and power models. Here, in this article, we use the modeling and prediction tool MuMMI (Multiple Metrics Modeling Infrastructure) and 10 machine learning methods to model and predict performance and power consumption and compare their prediction error rates. We use an algorithm-based fault-tolerant linear algebra code and a multilevel checkpointing fault-tolerant heat distribution code to conduct our modeling and prediction study on the Cray XC40 Theta and IBM BG/Q Mira at Argonne National Laboratory and the Intel Haswell cluster Shepard at Sandia National Laboratories. Our experimental results show that the prediction error rates in performance and power using MuMMI are less than 10% for most cases. By utilizing the models for runtime, node power, CPU power, and memory power, we identify the most significant performance counters for potential application optimizations, and we predict theoretical outcomes of the optimizations. Based on two collected datasets, we analyze and compare the prediction accuracy in performance and power consumption using MuMMI and 10 machine learning methods.

97 MATHEMATICS AND COMPUTING↗

HP-MDR: High-performance and Portable Data Refactoring and Progressive Retrieval with Advanced GPUs

Scientific applications produce vast amounts of data, posing grand challenges in the underlying data management and analytic tasks. Progressive compression is a promising way to address this problem, as it allows for on-demand data retrieval with significantly reduced data movement cost. However, most existing progressive methods are designed for CPUs, leaving a gap for them to unleash the power of today’s heterogeneous computing systems with GPUs.In this work, we propose HP-MDR, a high-performance and portable data refactoring and progressive retrieval framework for GPUs. Our contributions are four-fold: (1) We carefully optimize the bitplane encoding and lossless encoding, two key stages in progressive methods, to achieve high performance on GPUs; (2) We propose pipeline optimization and incorporate it with data refactoring and progressive retrieval workflows to further enhance the performance for large data process; (3) We leverage our framework to enable high-performance data retrieval with guaranteed error control for common Quantities of Interest; (4) We evaluate HP-MDR and compare it with state of the arts using five real-world datasets. Experimental results demonstrate that HP-MDR delivers an average 13.68 × and 6.31 × throughput in data refactoring and progressive retrieval tasks, respectively. It also leads to 11.22 × throughput for recomposing required data representations under Quantity-of-Interest error control and 6.04 × performance for the corresponding end-to-end data retrieval, when compared with state-of-the-art solutions.

Li, Yanliang [University of Oregon]↗

Quantifying the impact of precision errors on quantum approximate optimization algorithms

The quantum approximate optimization algorithm (QAOA) is a hybrid quantum-classical algorithm that seeks to achieve approximate solutions to optimization problems by iteratively alternating between intervals of controlled quantum evolution. Here, we examine the effect of analog precision errors on QAOA performance from the perspective of both algorithmic training and performance guarantees. Leveraging cumulant expansions, we recast the faulty QAOA as a control problem in which precision errors are expressed as multiplicative control noise and derive bounds on the performance of QAOA. We show using both analytical techniques and numerical simulations that fixed precision implementations of QAOA circuits are subject to an exponential degradation in performance dependent upon the number of optimal QAOA layers and magnitude of the precision error. Despite this significant reduction, we show that it is possible to mitigate precision errors in QAOA via digitization of the variational parameters at the cost of increasing circuit depth.

quantum algorithms↗

Robust Design Under Uncertainty in Quantum Error Mitigation

Error mitigation techniques are crucial to achieving near-term quantum advantage. Classical postprocessing of quantum computation outcomes is a popular approach for error mitigation, which includes methods, such as zero noise extrapolation, virtual distillation, and learning-based error mitigation. However, these techniques have limitations due to the propagation of uncertainty resulting from the finite shot number of a quantum measurement. In this work, we introduce general and unbiased methods for quantifying the uncertainty and error of error-mitigated observables based on the strategic sampling of error mitigation outcomes. We then extend our approach to demonstrate the optimization of performance and robustness of error mitigation under uncertainty. To illustrate our methods, we apply them to zero noise extrapolation and Clifford date regression in the ground state of the XY model simulated using depolarizing and International Business Machines Corporation (IBM) Toronto noise models, respectively. In particular, we optimize the choice of noise levels and the allocation of shots for zero noise extrapolation and the distribution of the training circuits for Clifford data regression. While our methods are readily applicable to any postprocessing-based error mitigation approach, in practice they must not be prohibitively expensive—even though they perform optimizations of the error mitigation hyperparameters requiring sampling of a statistical distribution of error mitigation outcomes. By leveraging surrogate-based optimization, we show that our methods can efficiently perform optimal design for a zero noise extrapolation implementation. We then further demonstrate the transferability of learned zero noise extrapolation hyperparameters to other similar circuits.

97 MATHEMATICS AND COMPUTING↗

Optimization of an Impedance-Matched Test Fixture with the Modal Projection Error

Across many industries and engineering disciplines, components and systems are designed and deployed into their operational environment of intended use. It is the desire of the design agency to be able to predict whether their component or system will function in its shock and vibration environments or if it will fail due to mechanical stresses. One method to determine if the component will survive the shock and vibration environments is to expose the component to the operational environment in a laboratory. One difficulty in executing a representative laboratory test is that the component may not have the same boundary condition in the laboratory as in the operational configuration. This paper examines the use of parameterized optimization to design the test fixture in order to better match the operational configuration. Several frequency and modal-based objective functions are examined for the optimization. The study shows that the Modal Projection Error objective function performs the best of the functions studied. The efficacy of the Modal Projection Error is demonstrated with respect to dynamic test fixture design on several analytical and experimental exemplars.

dynamic↗

An Assessment of Receiver Algorithms for Distributed Massive MIMO Systems: Investigating Design Solutions and Performance

This study investigates receiver design solutions for distributed Massive Multiple Input Multiple Output (D-m MIMO) systems, taking into account parameters such as number of access points as well as concerns related to channel estimates that use single-carrier frequency-domain equalization (SC-FDE). A significant contribution of this research is the integration of Low-Density Parity-Check (LDPC) codes to simplify coding complexity and enhance communication efficiency. The research examines different receiver designs, such as spatial antenna correlation and sophisticated channel estimation methods. The authors propose integrating LDPC codes into the receiver architecture to simplify computations and enhance error correction and decoding. Moreover, the paper examines performance evaluation measures and approaches, highlighting the trade-offs among complexity, spectral efficiency, and error performance. The comparative analysis indicates the benefits, in terms of performance, of incorporating LDPC codes and improving system throughput and dependability. We examine four distinct receiver algorithms: zero-forcing (ZF), minimum mean square error (MMSE), maximum ratio combining (MRC), and equal gain combining (EGC). The study shows that MRC and EGC receivers work well in D-m MIMO because they make the receiver system less computationally demanding.

Gashtasbi, Ali↗

A Two-Level Model Predictive Control-Based Approach for Building Energy Management including Photovoltaics, Energy Storage, Solar Forecasting and Building Loads

This paper uses a two-level model predictive control-based approach for the coordinated control and energy management of an integrated system that includes photovoltaic (PV) generation, energy storage, and building loads. Novel features of the proposed local controller include (1) the ability to simultaneously manage building loads and energy storage to achieve different operational objectives such as energy efficiency, economic cost efficiency, demand response and grid optimization through the design of specific power trajectory tracking performance functionals, (2) an energy trim function that minimizes the impact of solar forecasting errors on system performance, and (3) the design of a state of charge controller that uses day-ahead forecast of solar power and building loads to intialize energy storage at the start of each day. The local controller is tested in simulation using an exemplary system with PV generation, energy storage and dispatchable building loads. Two sample days with different PV forecasts and multiple case scenarios are considered, and the performance of the algorithm in managing the real and reactive net building load trajectories and the ramp rate of PV injections into the utility network are evaluated. The simulations are based on actual forecasted and measured PV data, and the results show that the local controller meets the tracking requirements for real and reactive power within the operating constraints of the building.

14 SOLAR ENERGY↗

Evaluation of New Additions to OLI Software in Predicting Mercuric and Mercurous Species in Liquid Waste Operations

Speciation of mercury during the pretreatment steps of tank waste processing is critical to successful mercury removal prior to vitrification during Liquid Waste Operations (LWO) at SRS. OLI software has been used to predict mercury speciation and activity throughout LWO. The OLI software operates based on a thermodynamic framework called the Mixed Solvent Electrolyte (MSE) framework. The MSE framework allows prediction in theoretically infinitely dilute to concentrated mixtures (e.g., purely solute solutions). Before modification to the MSE framework databanks, certain critical mercury species were missing in the MSE databank, and some thermodynamic data needed to be updated for the OLI software to accurately predict mercury chemical species in SRS waste tanks. To better reflect streams across LWO, new mercury species were integrated into the MSE database. To evaluate the changes to the OLI MSE framework per the Technical Task Request (TTR) and the Task Technical and Quality Assurance Plan (TTQAP), waste stream compositions from Tanks 38, 43, and Tank 50 decontaminated salt solution (DSS) were used as model inputs. Models were developed and executed using both the old and new databases. Compositional analyses from caustic Tank 50 DSS and caustic Tanks 38 and 43 were used as the input streams. These streams represent the most comprehensive chemical data sets where both mercury and tank constituents were measured together. Results for Tank 50 DSS predict HgO as the predominant species in both databases. Both methyl and dimethyl Hg species are present when the new database is ‘on’ and are not predicted with the new database turned ‘off’. The new database predicts a greater amount of HgO and a greater fraction of it in the solid phase. Pourbaix diagrams (potential vs. pH) generated for each Tank 50 DSS were identical regardless of which database was used. Elemental Hg and HgO were predicted in the water stable region under basic conditions. Tanks 38 and 43 follow similar trends as the Tank 50 DSS models. Unlike Tanks 38 and 50 DSS, the Tank 43 Pourbaix plot shows a region of stability for an aqueous HgOHCO3 - species between approximately pH 7-11. In all streams, when MeHg+ is included in the inputs, the new database predicts aqueous MeHgOH as the dominant species. If elemental or dimethyl mercury is in the waste stream, the new database model predicts they are unchanged and remain in those states and quantities. Additionally, the total mercury values are reported for both the measured input data and the OLI output data for all considered tanks. The summary indicates that the percentage error between the measured and calculated values is less than 1% in all cases The reconciliations and generation of the Pourbaix diagrams for Tank 50 DSS took approximately ten times longer with the new database ‘on’. In addition, over the course of that time, models with the new database ‘on’ were more likely to crash or display an error. Some modest performance improvements were noted when modeling with an i7 processor versus an i5. An example error is found in Appendix A. Furthermore, Appendix B provides V&V for two chemical systems analyzed with the OLI software, results were satisfactory. It is recommended to utilize the new databases (i.e., HCO.ddb and SR-Hg.ddb) in future Savannah River Mission Completion applications of OLI to represent pseudo steady-state. Furthermore, the integration and utilization of the new databases (i.e., HCO.ddb and SR-Hg.ddb) in modeling applications (e.g., Aspen) is also recommended.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Novel Lightweight, Low-Cost Heliostat for Concentrating Solar Power (SBIR Phase I Final Report)

The overall goal of this Department of Energy (DOE) SBIR Phase I project was to demonstrate the feasibility of the L.Garde, Inc. heliostat mirror facet for use in concentrated solar power applications. Prior to this Phase I project, L.Garde, Inc. developed a design for a lightweight and low cost mirror facet and successfully fabricated small scale (0.667 m 2 ) with a mirror surface flatness of 0.7 mrad. Therefore, the focus of the Phase I effort was to (1) demonstrate scalability by fabricating larger size mirrors while retaining the same mirror surface flatness, (2) demonstrate the design can withstand operating environment conditions through field testing, and (3) perform cost analysis to show the heliostat mirror facet design can meet DoE goals of < 12 kg/m2 and <$30/m 2 . During the Phase I project, L.Garde successfully fabricated large area (1.395 m 2 ) heliostat mirror facets, with a mass per unit area of 8 kg/m 2 and a cost of $29.80/m 2 . Surface flatness measurements (using contact probe technique) were performed on the mirror surface and results showed a flatness of 0.68 mrad, which were in agreement with previously fabricated small scale mirror facets. Slope error measurements was also performed on the mirror surface and results showed a slope error of 0.77 mrad which also was in agreement with previously fabricated small scale mirror facets. One large area mirror facet was subjected to a three (3) month field test. Surface flatness and slope error measurements were performed on the mirror surface after the field test and results were 0.663 mrad and 0.58 mrad respectively. The large scale heliostat mirror facets were also subjected to accelerated aging. However, during this exposure we observed failure due to the breaking of the mirror facets. Further investigation into the source of the failure showed that the mirror component alone showed signs of degradation during the same accelerated aging test. We believe that moisture ingress is occurring when subjected to high humidity, leading to buildup of water with the layers of protective paints and resulting in mirror breakage when water expands in freezing conditions. In order to mitigate or eliminate this issue, a new weatherproofing strategy may be implemented or a new mirror component may be used that is able to survive accelerated aging conditions.

14 SOLAR ENERGY↗

Round Robin Measurements of Molten Salt Properties for LiF-NaF-KF (FLiNaK) and NaCl-KCl Mixtures

The development, operation, and regulation of nuclear reactors that utilize molten salts as fuel or as heat transfer media require knowledge of the thermal properties of the salt systems and quantification of the corresponding uncertainties. Knowledge of molten salt properties is also necessary for applications in material synthesis, processing, separations, solar thermal power generation, and energy storage. A round robin was conducted with national laboratory and university participants from twenty-one laboratories in five countries to compare property measurements, to better understand uncertainties, and to identify possible best practices. Two salt mixtures, each from a common batch, were distributed to participants for evaluation: equimolar NaCl-KCl and 45.0LiF-13.7NaF-41.3KF mol % (FLiNaK). Measurements were performed to determine the major constituent composition, oxygen content, density, thermal expansivity, melting point, and thermal conductivity. Error analysis was performed on each measurement for uncertainty quantification for each type of property that was explored. Finally, the resulting discussion of the methodologies used in this work is meant to lay the groundwork for the development of standard methods and reference materials for future high-temperature property measurements on halide melts.

11 - NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Implementation and (Inverse Modified) Error Analysis for Implicitly Templated ODE-Nets

We focus on learning unknown dynamics from data using ODE-nets templated on implicit numerical initial value problem solvers. First, we perform inverse modified error analysis of the ODE-nets using unrolled implicit schemes for ease of interpretation. It is shown that training an ODE-net using an unrolled implicit scheme returns a close approximation of an inverse modified differential equation (IMDE). In addition, we establish a theoretical basis for hyperparameter selection when training such ODE-nets, whereas current strategies usually treat numerical integration of ODE-nets as a black box. We thus formulate an adaptive algorithm which monitors the level of error and adapts the number of (unrolled) implicit solution iterations during the training process, so that the error of the unrolled approximation is less than the current learning loss. This helps accelerate training while maintaining accuracy. Several numerical experiments are performed to demonstrate the advantages of the proposed algorithm compared to nonadaptive unrollings and validate the theoretical analysis. Here, we also note that this approach naturally allows for incorporating partially known physical terms in the equations, giving rise to what is termed “gray box” identification.

ODE-nets↗

Wave resource characterization at regional and nearshore scales for the U.S. Alaska coast based on a 32-year high-resolution hindcast

A wave resource characterization was performed for the southern coast of Alaska based on a 32-year hindcast covering the period from 1979 to 2010. The characterization closely followed International Electrotechnical Commission (IEC) Technical Specifications. An unstructured-grid Simulating WAves Nearshore (SWAN) model, which had an approximate spatial resolution of 300 m within 30 km from the nearest shoreline, was developed. Additionally, extensive model validation and error characterization was performed. The model was found to perform well with an average absolute percent error of 8.6% in significant wave height, averaged over 18 buoys. Statistics for the six IEC wave resource parameters were calculated and aggregated at 20 km from shore to quantify the incident wave power and its variability at a regional scale. The southern coast of the Aleutian Archipelago was found to have the most available wave energy in the region. A nearshore resource assessment was performed by evaluating resource hotspots located 1 km from shore. More than 900 nearshore stations had an Optimum Hotspot Identifier value of 5 (kW/m) at diverse water depths, thereby positioning Alaska as a promising location for wave energy development.

54 ENVIRONMENTAL SCIENCES↗

Neural network based prediction of no-wall β N limits due to ideal external kink instabilities

Multi-layer perceptron based neural networks (NNs) are trained to predict the Troyon no-wall beta limits due to the onset of low-n (n = 1 – 3, n is the toroidal mode number) ideal external kink instabilities in tokamak plasmas. It is revealed that a well-trained NN can predict the n = 1 no-wall beta limit within 10% relative error. The NN performance is somewhat worse for the n = 2 and 3 no-wall beta limits, but still a relative error within 20% is achievable. The trained NNs well reproduce the known dependences of the no-wall beta limits on the plasma pressure (pressure peaking factor) and current (plasma internal inductance) profiles. Other scalings are further easily established with NNs, for parametric dependences such as on the aspect ratio, the elongation and triangularity of the plasma boundary shape. These NN-based Troyon beta limit predictors can be incorporated into integrated modeling platforms, or directly implemented as a real time stability estimator for the purpose of disruption avoidance or mitigation during experiments.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Optimization-Inspired Pin-Fin Array for Supercritical Carbon Dioxide Recuperator

Additively manufactured heat exchangers are one possible route to cost-effective sCO 2 power cycles. In this paper, experimental results are obtained for two helical pin fin tubes that were designed following parametric optimization of the fin array. Neither the numerical optimization nor the experimental testing have been previously reported in the literature. The two tube designs were, (1) the optimization inspired design, and (2) the optimization-inspired design with a fin diameter increased by a factor of 2. To characterize the print, the designs were scanned using X-ray computed tomography to measure feature sizes and heat transfer area. The optimization was conducted in a commercial, computational fluid dynamics code. The code solved the Reynolds Averaged Navier-Stokes (RANS) and energy equations with turbulence closure provided by the shear stress transport (SST) k-ω model. In the experiments, the Nusselt number augmentation was measured using the Wilson plot technique and the friction factor was determined with mass flow and pressure drop measurements. The experimental testing indicated that the optimization-inspired design had a friction factor that was four times less than the baseline tube design at equal Nusselt number. Additionally, the optimization-inspired design had a 14% improvement in Nusselt number, at equal friction factor, relative to the best performing computational fluid dynamics (CFD) trial points. Tube design (2), with the larger diameter pin fins, had similar performance, within experimental error, as the tube with the smaller diameter pin fins (1). Both tubes achieved overall fin array efficiencies near 1. A performance factor, V/V 0 , equal to the volume of the enhanced heat exchanger divided by the volume of the baseline (no-fins) heat exchanger, is recommended to quantify internal cooling performance. In conclusion, the experimental shell and tube heat exchanger, using the additively manufactured tube, is competitive with printed circuit heat exchangers in its pressure drop class and could be further improved by optimizing a shell-and-tube heat exchanger utilizing this heat transfer enhancement feature.

42 ENGINEERING↗

Extending the computational reach of a superconducting qutrit processor

Quantum computing with qudits is an emerging approach that exploits a larger, more connected computational space, providing advantages for many applications, including quantum simulation and quantum error correction. Nonetheless, qudits are typically afflicted by more complex errors and suffer greater noise sensitivity which renders their scaling difficult. In this work, we introduce techniques to tailor arbitrary qudit Markovian noise to stochastic Weyl–Heisenberg channels and mitigate noise that commutes with our Clifford and universal two-qudit gate in generic qudit circuits. We experimentally demonstrate these methods on a superconducting transmon qutrit processor, and benchmark their effectiveness for multipartite qutrit entanglement and random circuit sampling, obtaining up to 3× improvement in our results. To the best of our knowledge, this constitutes the first-ever error mitigation experiment performed on qutrits. Our work shows that despite the intrinsic complexity of manipulating higher-dimensional quantum systems, noise tailoring and error mitigation can significantly extend the computational reach of today’s qudit processors.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Evaluating Probabilistic Deep Learning Methods for Uncertainty Quantification of Precipitation Bias Correction

Climate models often exhibit biases in their precipitation predictions, particularly underestimating high-intensity events and overestimating low precipitation. Deep learning approaches offer promising solutions, but their epistemic uncertainty associated with a deep learning–based bias correction method has not previously been quantified for reliable downstream climate impact studies. While methods for capturing the epistemic uncertainty in deep learning frameworks exist, there is currently no consensus on the best method. In this work, we compare three uncertainty quantification (UQ) methods—Deep Ensembles (DEns), Monte Carlo Dropout (MCD), and Flipout—by assessing the reliability of their uncertainty estimates using standard measures such as sharpness and calibration. These UQ methods are applied to an existing deep learning precipitation bias correction model known as UFNet: a coupled U-Net and fully connected neural network. The methods utilized to assess the models’ uncertainties are 1) calibration, which ensures that the expected probabilities of the model align with reality and 2) sharpness, which is a measure of the precision of the model’s probabilistic predictions. Of the three UQ methods evaluated, the DEns and MCD methods demonstrated the best-calibrated performance (expected calibration error of 0.36 and 0.35, respectively), compared to Flipout (0.58). In contrast, Flipout had the sharpest predictions and the highest metric performance in bias correcting precipitation—especially for higher-order moments such as kurtosis with a spatial correlation of 72% compared to 32% and 55% spatial correlation for DEns and MCD, respectively. Of the three UQ methods, MCD was found to be the most suitable method for UQ purposes based on its calibration, sharpness, and computational requirements.

Bayesian methods↗