Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “error performance”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12

Neural Ordinary Differential Equations for Nonlinear System Identification

Neural ordinary differential equations (NODE) have been recently proposed as a promising approach for nonlinear system identification tasks. In this work, we systematically compare their predictive performance with current state-of-the-art nonlinear and classical linear methods. In particular, we present a quantitative study comparing NODE's performance against neural state-space models and classical linear system identification methods and evaluate their inference speed and prediction performance on open-loop errors across eight different dynamical systems. The experiments show that NODEs can consistently improve the prediction accuracy by order of magnitude compared to benchmark methods. Besides improved accuracy, we also observed that NODEs are less sensitive to hyperparameters compared to neural state-space models by paying the cost of increased computation at the inference time.

machine leaning, system identification, physics in↗

A Tidal Hydrodynamic Model for Cook Inlet, Alaska, to Support Tidal Energy Resource Characterization

Cook Inlet in Alaska has been identified as a prime site in the U.S. for potential tidal energy development, because of its enormous tidal power potential that accounts for nearly one-third of the national total. As one important step to facilitate tidal energy development, a tidal hydrodynamic model based on the unstructured-grid, finite-volume community ocean model (FVCOM) was developed for Cook Inlet to characterize the tidal stream energy resource. The model has a grid resolution that varies from about 1000 m at the open boundary to 100–300 m inside the Inlet. Extensive model validation was achieved by comparing model predictions with field observations for tidal elevation and velocity at various locations in Cook Inlet. The error statistics confirmed the model performs reasonably well in capturing the tidal dynamics in the system, e.g., R2 > 0.98 for tidal elevation and generally > 0.9 for velocity. Model results suggest that tides in Cook Inlet evolve from progressive waves at the entrance to standing waves at the upper Inlet, and that semi-diurnal tidal constituents are amplified more rapidly than diurnal constituents. The model output was used to identify hotspots that have high energy potential and warrant additional velocity and turbulence measurements such as East Foreland, where averaged power density exceeds 5 kw/m2. Lastly, a tidal energy extraction simulation was conducted for a hypothetical turbine farm configuration at the Forelands cross section to evaluate tidal energy extraction and resulting changes in far-field hydrodynamics.

16 TIDAL AND WAVE POWER↗

Comparison of Human Performance between Operators and Students Using Rancor Microworld Simulator: A Preliminary Result

This paper describes an experiment using the Rancor Microworld simulator to probe into differences in human performance between students and actual operators. Six human performance measures – 1) time, 2) error, 3) workload, 4) situational awareness, 5) attention patterns, and 6) number of manipulations – are measured from experiments. The experiment has been conducted for 11 operators and 20 students so far. More experiments and analyses will be continued. Further experimental studies using Rancor Microworld are expected to be able to collect additional data that may be missing from full-scope studies and contribute to items that can support human reliability data.

99 GENERAL AND MISCELLANEOUS↗

Airport Delay Prediction with Temporal Fusion Transformers

Since flight delay hurts passengers, airlines, and airports, its prediction becomes crucial for the decision-making of all stakeholders in the aviation industry and thus has been attempted by various previous research. However, previous delay predictions are often categorical and at a highly aggregated level. To improve that, this study proposes to apply the novel Temporal Fusion Transformer model and predict numerical airport arrival delays at quarter hour level for U.S. top 30 airports. Inputs to our model include airport demand and capacity forecasts, historic airport operation efficiency information, airport wind and visibility conditions, as well as en-route weather and traffic conditions. The results show that our model achieves satisfactory performance measured by small prediction errors on the test set. In addition, the interpretability analysis of the model outputs identifies the important input factors for delay prediction.

Liu, Ke [University of California Berkeley]↗

DUNE – Simulation Validation of Fermilab Detector Reconstruction

DUNE (Deep Underground Neutrino Experiment) is Fermilab’s flagship international experiment designed to study neutrinos by sending an intense beam from Illinois to detectors located 1,300 kilometers away at the Sanford Underground Research Facility (SURF) in South Dakota. To prepare for such a large-scale experiment, physicists develop detailed simulations to produce mock data sets which are analyzed by the CAFAna framework. During my internship, I developed software using the CAFAna framework to analyze simulated detector data and generated plots to make data trends easier to interpret and identify patterns. My analysis has uncovered inconsistencies in reconstructed neutrino tracks, duplicated reconstructed tracks causing sporadic spikes in the data, and unnatural differences in energy levels between interaction types. These analyses help verify that the improvements to detector simulations do not introduce unintended resolution errors and ensure proper reconstruction performance, supporting DUNE’s goal of making precise neutrino measurements and advancing the Department of Energy’s mission of fundamental scientific discovery.

Vershaw, Andre [Unlisted, US, IL; Fermilab] (ORCID↗

Quench process modeling & simulation in the heat-treatment of critical aerospace components

To manufacture light-weight, advanced metal alloy components for gas turbine engines, quench heat-treatment processes are typically used. By quenching the component from elevated temperatures, the alloy sometimes undergoes a solid-state phase transformation which produces special microstructures with the required, enhanced mechanical properties. However, the quenching can also lead to cracks forming in the component. Addressing the quench cracking problems adds a significant burden to the cost, schedule, and energy demand of manufacture. Currently, optimizing the quench process to mitigate or avoid the cracking is performed largely by trial-and-error, relying heavily on costly experimental (thermocouple)trials to understand the local thermal gradients which cause the cracks to form. In this first part (Phase 1) of the work, high-performance computing is employed to establish the ability of modern CFD (computational fluid dynamics) to alleviate or wholly replace the experimental quenching trials by virtual testing. A Baseline CFD model is defined and its accuracy established to be comparable to(and which usually exceeds) the accuracy of existing HTC (heat-transfer coefficient) based simulation methods of quenching. As a first-principles based approach, “calibration” of the Baseline CFD model is independent of the quench process itself, but instead relies on the accuracy of the underlying (modeled),generic two-phase fluid processes which cannot be currently resolved by CFD for large, industrial-scale cases. A novel, high-fidelity DNS capability has been developed and verified to examine and further improve upon the mean-field closure submodels on which the Baseline CFD approach is based.1

99 GENERAL AND MISCELLANEOUS↗

Quench process modeling & simulation in the heat-treatment of critical aerospace components

To manufacture light-weight, advanced metal alloy components for gas turbine engines, quench heat-treatment processes are typically used. By quenching the component from elevated tempera-tures, the alloy sometimes undergoes a solid-state phase transformation which produces special microstructures with the required, enhanced mechanical properties. However, the quenching can also lead to cracks forming in the component. Addressing the quench cracking problems adds a significant burden to the cost, schedule, and energy demand of manufacture. Currently, optimizing the quench process to mitigate or avoid the cracking is performed largely by trial-and-error, relying heavily on costly experimental (thermocouple) trials to understand the local thermal gradients which cause the cracks to form. In this first part (Phase 1) of the work, high-performance computing is employed to establish the ability of modern CFD (computational fluid dynamics) to alleviate or wholly replace the experimental quenching trials by virtual testing. A baseline CFD model is defined and its accuracy established to be comparable to (and which usually exceeds) the accuracy of existing HTC (heat-transfer correlation) based simulation methods of quenching. As a first-principles based approach, “calibration” of the Baseline CFD model is independent of the quench process itself, but instead relies on the accuracy of the underlying (modeled), generic two-phase fluid processes which cannot be currently resolved by CFD for large, industrial-scale cases. A novel, high-fidelity DNS capability has been developed and verified to examine and further improve upon the mean-field closure submodels on which the Baseline CFD approach is based.

36 MATERIALS SCIENCE↗

PELICAN Status Report for Year 2021

The Pressure Drop Experimental Loop for Investigations of Core Assemblies in Advanced Nuclear Reactors, PELICAN, is a novel experimental facility designed and constructed to recreate the prototypic full scale hydraulic flow conditions for the Versatile Test Reactor (VTR) currently under development by the U.S. Department of Energy. To support VTR design efforts, PELICAN is used to replicate VTR’s primary heat transport system (PHTS) in the core assembly region. The measurement objectives for data generated from this test facility are to mimic the prototypic VTR assembly and to meet the validation needs for code calculations and simulations of the reference design for the VTR core. These objectives focus on the need to validate pressure drop results across the various segments of the fuel assembly, including the axial reflectors, fuel, and transition regions, as they relate directly to the pumping power and safety behavior of the reactor. In the following sections, the major milestones for the experimental work performed on PELICAN over the calendar year (CY) 2021 are presented. In the next section, we discuss the assembly and shakedown testing of the facility. In Section 3, an analysis of the errors in the major measurements is performed. In Section 4 and 5 we present the results from the first set of test articles placed inside the loop. The design of the remaining test articles as part of the full assembly are shown in Section 6 and the conclusion and path forward for the following year, CY22 is given in the final section.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Comparison of Motion Analysis Systems in Tracking Upper Body Movement of Myoelectric Bypass Prosthesis Users

Current literature lacks a comparative analysis of different motion capture systems for tracking upper limb (UL) movement as individuals perform standard tasks. To better understand the performance of various motion capture systems in quantifying UL movement in the prosthesis user population, this study compares joint angles derived from three systems that vary in cost and motion capture mechanisms: a marker-based system (Vicon), an inertial measurement unit system (Xsens), and a markerless system (Kinect). Ten healthy participants (5F/5M; 29.6 ± 7.1 years) were trained with a TouchBionic i-Limb Ultra myoelectric terminal device mounted on a bypass prosthetic device. Participants were simultaneously recorded with all systems as they performed standardized tasks. Root mean square error and bias values for degrees of freedom in the right elbow, shoulder, neck, and torso were calculated. The IMU system yielded more accurate kinematics for shoulder, neck, and torso angles while the markerless system performed better for the elbow angles. By evaluating the ability of each system to capture kinematic changes of simulated upper limb prosthesis users during a variety of standardized tasks, this study provides insight into the advantages and limitations of using different motion capture technologies for upper limb functional assessment.

42 ENGINEERING↗

Application-level benchmarking of quantum computers using nonlocal game strategies

In a nonlocal game, two noncommunicating players cooperate to convince a referee that they possess a strategy that does not violate the rules of the game. Quantum strategies allow players to optimally win some games by performing joint measurements on a shared entangled state, but computing these strategies can be challenging. We present a variational quantum algorithm to compute quantum strategies for nonlocal games by encoding the rules of a nonlocal game into a Hamiltonian. We show how this algorithm can generate a short-depth optimal quantum strategy for a graph coloring game with a quantum advantage. This quantum strategy is then evaluated on fourteen different quantum hardware platforms to demonstrate its utility as a benchmark. Finally, we discuss potential sources of errors that can explain the observed decreased performance of the executed task and derive an expression for the number of samples required to accurately estimate the win rate in the presence of noise.

nonlocal games↗

Assessment of the errors of high-fidelity two-qubit gates in silicon quantum dots

Achieving high-fidelity entangling operations between qubits consistently is essential for the performance of multi-qubit systems. Solid-state platforms are particularly exposed to errors arising from materials-induced variability between qubits, which leads to performance inconsistencies. Here we study the errors in a spin qubit processor, tying them to their physical origins. We use this knowledge to demonstrate consistent and repeatable operation with above 99% fidelity of two-qubit gates in the technologically important silicon metal-oxide-semiconductor quantum dot platform. Analysis of the physical errors and fidelities in multiple devices over extended periods allows us to ensure that we capture the variation and the most common error types. Physical error sources include the slow nuclear and electrical noise on single qubits and contextual noise that depends on the applied control sequence. Furthermore, we investigate the impact of qubit design, feedback systems and robust gate design to inform the design of future scalable, high-fidelity control strategies. Our results highlight both the capabilities and challenges for the scaling-up of silicon spin-based qubits into full-scale quantum processors.

Quantum dots↗

Benchmarking Quantum Chemistry Computations with Variational, Imaginary Time Evolution, and Krylov Space Solver Algorithms

Quantum chemistry is a key application area for noisy-intermediate scale quantum (NISQ) devices, and therefore serves as an important benchmark for current and future quantum computer performance. Previous benchmarks in this field have focused on variational methods for computing ground and excited states of various molecules, including a benchmarking suite focused on the performance of computing ground states for alkali-hydrides under an array of error mitigation methods. State-of-the-art methods to reach chemical accuracy in hybrid quantum-classical electronic structure calculations of alkali hydride molecules on NISQ devices from IBM are outlined here. Here it is demonstrated how to extend the reach of variational eigensolvers with symmetry preserving Ansätze. Next, it is outlined how to use quantum imaginary time evolution and Lanczos as a complementary method to variational techniques, highlighting the advantages of each approach. Finally, a new error mitigation method is demonstrated which uses systematic error cancellation via hidden inverse gate constructions, improving the performance of typical variational algorithms. These results show that electronic structure calculations have advanced rapidly, to routine chemical accuracy for simple molecules, from their inception on quantum computers a few short years ago, and they point to further rapid progress to larger molecules as the power of NISQ devices grows.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Implementation of a Model Predictive Control Strategy to Regulate Temperature Inside Plug-Flow Solar Reactor With Countercurrent Flow

Abstract Solar-driven thermochemical energy storage systems are proven to be promising energy carriers (solar fuels) to utilize solar energy by using reactive solid-state pellets. However, the production of solar fuel requires a quasi-steady-state process temperature, which represents the main challenge due to the transient nature of solar power. In this work, an adaptive model predictive controller (MPC) is presented to regulate the temperature inside a tubular solar reactor to produce solid-state solar fuel for long-term thermal storage systems. The solar reactor system consists of a vertical tube heated circumferentially over a segment of its length by concentrated solar power, and the reactive pellets (MgMn2O4) are fed from the top end and flow downwards through the heated tube. A countercurrent flowing gas supplied from the lower end interacts with flowing pellets to reduce it thermochemically at a temperature range of 1000—1500 °C. A low-order physical model was developed to simulate the dynamics of the solar reactor including the reaction kinetics, and the proposed model was validated numerically by using a 7-kW electric furnace. The numerical model then was utilized to design the MPC controller, where the control system consists of an MPC code linked to an adaptive system identification code that updates system parameters online to ensure system robustness against external disturbances (sudden change in the flow inside the reactor), model mismatches, and uncertainty. The MPC controller parameters are tuned to enhance the system performance with minimum steady-state error and overshoot. The controller is tested to track different temperature ranges between 500 °C and 1400 °C with different particles/gas mass flowrates and ramping temperature profiles. Results show that the MPC controller successfully regulated the reactor temperature within ± 1 °C of its setpoint and maintained robust performance with minimum input effort when subjected to sudden changes in the amount of flowing media and the presence of chemical reaction.

Engineering↗

Improving Low‐Cloud Fraction Prediction Through Machine Learning

Abstract In this study, we evaluated the performance of machine learning (ML) models (XGBoost) in predicting low‐cloud fraction (LCF), compared to two generations of the community atmospheric model (CAM5 and CAM6) and ERA5 reanalysis data, each having a different cloud scheme. ML models show a substantial enhancement in predicting LCF regarding root mean squared errors and correlation coefficients. The good performance is consistent across the full spectrums of atmospheric stability and large‐scale vertical velocity. Employing an explainable ML approach, we revealed the importance of including the amount of available moisture in ML models for representing spatiotemporal variations in LCF in the midlatitudes. Also, ML models demonstrated marked improvement in capturing the LCF variations during the stratocumulus‐to‐cumulus transition (SCT). This study suggests ML models' great potential to address the longstanding issues of “too few” low clouds and “too rapid” SCT in global climate models.

Geology↗

Analysis of Reactive Power Load Modeling Techniques for PV Impact Studies [Slides]

The increasing availability of advanced metering infrastructure (AMI) data has led to significant improvements in load modeling accuracy. However, since many AMI devices were installed to facilitate billing practices, few utilities record or store reactive power demand measurements from their AMI. When reactive power measurements are unavailable, simplifying assumptions are often applied for load modeling purposes, such as applying constant power factors to the loads. The objective of this work is to quantify the impact that reactive power load modeling practices can have on distribution system analysis, with a particular focus on evaluating the behaviors of distributed photovoltaic (PV) systems with advanced inverter capabilities. Quasi-static time-series simulations were conducted after applying a variety of reactive power load modeling approaches, and the results were compared to a baseline scenario in which real and reactive power measurements were available at all customer locations on the circuit. Overall, it was observed that applying constant power factors to loads can lead to significant errors when evaluating customer voltage profiles, but that performing per-phase time-series reactive power allocation can be utilized to reduce these errors by about 6x, on average, resulting in more accurate evaluations of advanced inverter functions.

14 SOLAR ENERGY↗

Optimizing Error-Bounded Lossy Compression for Scientific Data on GPUs

Error-bounded lossy compression is a critical technique for significantly reducing scientific data volumes. With ever-emerging heterogeneous high-performance computing (HPC) architecture, GPU-accelerated error-bounded compressors (such as CUSZ and cuZFP) have been developed. However, they suffer from either low performance or low compression ratios. To this end, we propose CUSZ+ to target both high compression ratios and throughputs. We identify that data sparsity and data smoothness are key factors for high compression throughputs. Our key contributions in this work are fourfold: (1) We propose an efficient compression workflow to adaptively perform run-length encoding and/or variable-length encoding. (2) We derive Lorenzo reconstruction in decompression as multidimensional partial-sum computation and propose a fine-grained Lorenzo reconstruction algorithm for GPU architectures. (3) We carefully optimize each of CUSZ kernels by leveraging state-of-the-art CUDA parallel primitives. (4) We evaluate CUSZ+ using seven real-world HPC application datasets on V100 and A100 GPUs. Experiments show CUSZ+ improves the compression throughputs and ratios by up to 18.4x and 5.3x, respectively, over CUSZ on the tested datasets.

Tian, Jiannan↗

A non-intrusive optical (NIO) approach to characterize heliostats in utility-scale power tower plants: Sensitivity study

Power towers, a type of concentrating power tower technology, use a large number of heliostats to concentrate sunlight and produce renewable energy. Optical errors of heliostats can cause drastic losses in the efficiency of power-tower plants. Accurately measuring optical errors is crucial to assessing and improving plant performance. This analysis discusses an innovate non-intrusive optical (NIO) approach to measure slope, canting, and tracking errors by detecting distortions in the reflected tower structure in heliostat images. Further in this work a sensitivity study is carefully conducted to determine the uncertainty requirements to allow the method to calculate slope errors with an accuracy of 0.25 mrad. Measurement uncertainty sources include camera resolution and position uncertainty, tower position uncertainty, and number of collected images. Each uncertainty source is investigated to determine its impact on the accuracy of the slope-error calculation. A combination of theoretical results and experimental results obtained from data collected on a heliostat at Sandia National Laboratories is used to determine and validate uncertainty requirements. The analysis shows that a measurement uncertainty of 0.25 mrad can be realized by realistically controlling uncertainty sources when implementing the NIO method. It demonstrates the superior performance of NIO in performing in-situ optical characterization.

14 SOLAR ENERGY↗

Positioning Accuracy in a Concurrent Robot-CNC Hybrid Manufacturing System

Abstract Additive manufacturing (AM) has gained notoriety for offering advantages over traditional manufacturing methods, such as increased design complexity and flexibility. However, it has not found widespread use beyond rapid prototyping. One hindrance to the acceptance of AM processes in industry is the time and cost of fabrication per component. While metal AM by itself can be inexpensive, extra manufacturing steps in the form of subtractive manufacturing (SM) may need to be performed to reach final part tolerances, leading to hybrid additive-subtractive manufacturing (HASM) of a part, which increases time and cost. A potential area to reduce cost is through increasing the efficiency of the HASM process by conducting additive and subtractive manufacturing simultaneously. Usually, HASM is performed in a process where AM is completed in one machine or cell and transferred to another machine or cell for SM in a sequential assembly line process. This efficiency decreases part cost, but high aspect ratio parts or parts with internal geometry that require interleaved additive deposition and machining cannot be produced. One unexplored solution to simultaneous HASM that allows for interleaved operations is to operate the deposition head and machining spindle concurrently within the same machine envelope, known as concurrent HASM (CHASM). In this type of process, both AM and SM occur simultaneously on a batch of small parts or a single large part, maintaining a high efficiency without sacrificing the full range of complex geometries that AM allows for. A potential approach to the single-machine method could be to combine a robot and mill within the same envelope. A challenge to this approach, however, is control of both systems. Most machine controllers have limited external communication or, if a robot has been integrated, only offer movement of either the robot or mill at any given time. As a result, systems must pause either the AM or SM process to switch between them rather than working simultaneously. The present work investigates the positional accuracy of such a CHASM system comprised of a robotic arm and a 3-axis mill. Open-loop tests with limited communication between machines are performed on the system to verify positional error during concurrent robot-mill movements. Under certain conditions, it is demonstrated that position error can stay within 2 mm for the duration of a single layer; however, these tests show that, generally, the open-loop positioning performance of the system is inadequate for CHASM without part-specific hand-tuning of parameters. Based on these results, a set of requirements for successful robot-CNC CHASM is proposed for future integrations.

Goodwin, Jesse↗