Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “error testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16

Artificial Neural Network Models for Octane Number and Octane Sensitivity: A Quantitative Structure Property Relationship Approach to Fuel Design

Octane sensitivity (OS), defined as the research octane number (RON) minus the motor octane number (MON) of a fuel, has gained interest among researchers due to its effect on knocking conditions in internal combustion engines. Compounds with a high OS enable higher efficiencies, especially within advanced compression ignition engines. RON/MON must be experimentally tested to determine OS, requiring time, funding, and specialized equipment. Thus, predictive models trained with existing experimental data and molecular descriptors (via quantitative structure-property relationships (QSPRs)) would allow for the preemptive screening of compounds prior to performing these experiments. Here, the present work proposes two methods for predicting the OS of a given compound: using artificial neural networks (ANNs) trained with QSPR descriptors to predict RON and MON individually to compute OS (derived octane sensitivity (dOS)), and using ANNs trained with QSPR descriptors to directly predict OS. Twenty-five ANNs were trained for both RON and MON and their test sets achieved an overall 6.4% and 5.2% error, respectively. Twenty-five additional ANNs were trained for both dOS and OS; dOS calculations were found to have 15.3% error while predicting OS directly resulted in 9.9% error. A chemical analysis of the top QSPR descriptors for RON/MON and OS is conducted, highlighting desirable structural features for high-performing molecules and offering insight into the inner mathematical workings of ANNs; such chemical interpretations study the interconnections between structural features, descriptors, and fuel performance showing that connectivity, structural diversity, and atomic hybridization consistently drive fuel performance.

09 BIOMASS FUELS↗

Adaptive Time Step Control for Multirate Infinitesimal Methods

Multirate methods have been used for decades to temporally evolve initial-value problems in which different components evolve on distinct time scales, and thus use of different step sizes for these components can result in increased computational efficiency. Generally, such methods select these different step sizes based on experimentation or stability considerations. For problems that evolve on a single time scale, adaptivity approaches that strive to control local temporal error are widely used to achieve numerical results of a desired accuracy with minimal computational effort, while alleviating the need for manual experimentation with different time step sizes. However, there is a notable gap in the publication record on the development of adaptive time step controllers for multirate methods. In this paper, we extend the single-rate controller work of Gustafsson [ACM Trans. Math. Software, 20 (1994), pp. 496-517] to the multirate method setting. Specifically, we develop controllers based on polynomial approximations to the principal error functions for both the "fast" and "slow" time scales within multirate infinitesimal (MRI) methods. We additionally investigate a variety of approaches for estimating the errors arising from each time scale within MRI methods. We then numerically evaluate the proposed multirate controllers and error estimation strategies on a range of multirate test problems, comparing their performance against an estimated optimal performance. Through this work, we combine the most performant of these approaches to arrive at a set of multirate adaptive time step controllers that robustly achieve desired solution accuracy with minimal computational effort.

97 MATHEMATICS AND COMPUTING↗

Efficient, Predictive Tomography of Multi-Qubit Quantum Processors

After decades of R&D, quantum computers comprising more than 2 qubits are appearing. If this progress is to continue, the research community requires a capability for precise characterization (“tomography”) of these enlarged devices, which will enable benchmarking, improvement, and finally certification as mission-ready. As world leaders in characterization -- our gate set tomography (GST) method is the current state of the art – the project team is keenly aware that every existing protocol is either (1) catastrophically inefficient for more than 2 qubits, or (2) not rich enough to predict device behavior. GST scales poorly, while the popular randomized benchmarking technique only measures a single aggregated error probability. This project explored a new insight: that the combinatorial explosion plaguing standard GST could be avoided by using an ansatz of few-qubit interactions to build a complete, efficient model for multi-qubit errors. We developed this approach, prototyped it, and tested it on a cutting-edge quantum processor developed by Rigetti Quantum Computing (RQC), a US-based startup. We implemented our new models within Sandia’s PyGSTi open-source code, and tested them experimentally on the RQC device by probing crosstalk. We found two major results: first, our schema worked and is viable for further development; second, while the Rigetti device is indeed a “real” 8-qubit quantum processor, its behavior fluctuated significantly over time while we were experimenting with it and this drift made it difficult to fit our models of crosstalk to the data.

97 MATHEMATICS AND COMPUTING↗

Modular Autonomous Experimentation for Biological Applications

The Modular Autonomous Research System (MARS) was created to address a key challenge in scientific discovery: experiments are often slow, require significant manual labor, and generate data that is not easily integrated across different tools. This limits how quickly scientists can explore new materials, processes, and chemical reactions. Our motivation was to design a system that makes research faster, more reliable, and adaptable by combining automation with artificial intelligence. By doing so, we aimed to reduce human error, accelerate discovery, and allow researchers to quickly test many possibilities that would otherwise take months or years. Our approach was to build a flexible platform that connects laboratory robots, measurement instruments, and a central data system, all guided by artificial intelligence. MARS integrates liquid handling robots, robotic arms, and plate readers with an intelligent decision-making system that chooses the most informative experiments to run next. This creates a closed loop where experiments are performed automatically, the data is analyzed in real time, and new conditions are immediately tested. Through this work, we demonstrated that MARS can carry out multiple experiments with little or no human intervention, adapt to different scientific problems, and handle uncertain or noisy measurements in a robust way. The results show that modular and intelligent automation can significantly accelerate the pace of discovery, providing a model for future self-driving laboratories. This approach addresses the growing scientific need for adaptable, data-driven research platforms that can keep up with the complexity and scale of modern science.

59 BASIC BIOLOGICAL SCIENCES↗

The Cognitive Effects of Machine Learning Aid in Domain-Specific and Domain-General Tasks.

With machine learning (ML) technologies rapidly expanding to new applications and domains, users are collaborating with artificial intelligence-assisted diagnostic tools to a larger and larger extent. But what impact does ML aid have on cognitive performance, especially when the ML output is not always accurate? Here, we examined the cognitive effects of the presence of simulated ML assistance—including both accurate and inaccurate output—on two tasks (a domain-specific nuclear safeguards task and domain-general visual search task). Patterns of performance varied across the two tasks for both the presence of ML aid as well as the category of ML feedback (e.g., false alarm). These results indicate that differences such as domain could influence users’ performance with ML aid, and suggest the need to test the effects of ML output (and associated errors) in the specific context of use, especially when the stimuli of interest are vague or ill-defined

97 MATHEMATICS AND COMPUTING↗

Data Collection and Analysis Challenges and Mitigation Strategies for Quantitative Human Factors Research Studies in Nuclear Power Plant Modernization

The United States (U.S.) Department of Energy (DOE) Light Water Reactor Sustainability (LWRS) program Plant Modernization Pathway is conducting targeted research and development (R&D) to address aging and reliability concerns with the legacy instrumentation and control and related information systems of the U.S. LWR fleet. In this effort, the application of human factors engineering (HFE) provides an important role in ensuring new digital plant technologies enable broad innovation and business improvement with continued operational safety. Evaluation is a key activity in HFE, which often occurs iteratively through the system design lifecycle. While qualitative methods are important in collecting information of how users perform tasks through observations, quantitative methods are equally important in assessing system design based on performance. In collecting and analyzing this quantitative data, there are notable challenges in the nuclear HFE domain that may threaten the validity and reliability of the inferences made in these studies. Notable challenges include small sample size and limited resources, large error variance and small effect size, an “adding test features to losing degrees of freedom” dilemma, non-normal distribution, and heterogeneity of variance. The results in control room usability studies are often statistically non-significant, which makes it hard to interpret. This work discusses these challenges across different scientific viewpoints and provides real-world examples of these challenges in practice. Collectively, the objective of this work is to position these challenges to the larger data science community as a means of identifying future opportunities to address these issues.

99 GENERAL AND MISCELLANEOUS↗

Probabilistic Analysis of Uncertainty in ATRC Flux Profiles

ATRC is a replica of the larger ATR design and is used to conduct research and obtain data such as flux measurements, excess reactivity, and loading requirements before being loaded into ATR. One method for determining the impact an experiment will have at ATR is by looking at the axial flux profile along the fuel rod in the corresponding ATRC experiment; however, flux wand measurements includes large amounts of variation which makes drawing conclusions from the data difficult. This poster describes a definitive method to propagate the uncertainty from ATRC measurements using Python code.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Total experimental uncertainty in hydrodynamic testing of a semisubmersible wind turbine, considering numerical propagation of systematic uncertainty

Quantifying the uncertainty in experimental results is a vital step in properly validating numerical simulation tools for designing floating wind turbines; without a good understanding of the experimental uncertainties, it is impossible to confirm if numerical simulation tools can capture the physics with acceptable accuracy. Recent validation studies suggest that the wave-induced, low-frequency surge and pitch motions of semisubmersible-type floating wind turbines are consistently underpredicted by numerical simulations, but it has not been possible to state whether or not this underprediction is within the level of experimental error. Here, previously assessed systematic uncertainty components in hydrodynamic tests of the OC5-DeepCwind semisubmersible are propagated to response metrics of interest using numerical simulation tools, and combined with the system's random uncertainty to obtain the total experimental uncertainty. The uncertainty in the low-frequency response metrics is found to be most sensitive to the system properties (e.g., mooring stiffness and center of gravity), and also the wave elevation. The results of the present study suggest that the underprediction of the low-frequency response behavior observed in previous validation studies is larger than the experimental uncertainty.

17 WIND ENERGY↗

Model validation and error attribution for a drifting qubit

Qubit performance is often reported in terms of a variety of single-value metrics, each providing a facet of the underlying noise mechanism limiting performance. However, the value of these metrics may drift over long timescales, and reporting a single number for qubit performance fails to account for the low-frequency noise processes that give rise to this drift. Here, in this work, we demonstrate how we can use the distribution of these values to validate or invalidate candidate noise models. We focus on the case of randomized benchmarking (RB), where typically a single error rate is reported but this error rate can drift over time when multiple passes of RB are performed. We show that using a statistical test as simple as the Kolmogorov-Smirnov statistic on the distribution of RB error rates can be used to rule out noise models, assuming the experiment is performed over a long enough time interval to capture relevant low frequency noise. With confidence in a noise model, we show how care must be exercised when performing error attribution using the distribution of drifting RB error rate.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Evaluation of Drilling Performance at The Geysers with Machine Learning Methods Using Geologic Data

A recent well, GDC-36, was drilled in The Geysers Geothermal Field served in a Department of Energy-industry to demonstrate improved drilling performance with polycrystalline diamond compact (PDC) bits. Both PDC and roller cone drill bits were used to drill this well. Key challenges encountered during drilling included lost circulation in the mud-drilled section, and bit damage interfacial severity in the deeper, air-drilled section. The objective of this study is to evaluate the drilling performance in relation to the local geological characteristics using machine learning methods. By applying K-clustering to the sonic log data, we were able to identify areas correlated with measured lost circulation. Also, the boundaries defined by clustering of the mineralogical and lithological data from the mud logs correlate well with interfacial severity during drilling. A random forest model was employed to build correlation between drilling data and rock strength. The confined compressive strength (CCS) of the rock in the training of the machine learning model was inferred from the dipole sonic log. The R-squared of the testing data is 0.78, and the RMSE (Root Mean Squared Error) is 0.06. The trained model was used to forecast rock strength for the section where sonic log data are not available. CCS could also be inferred from mud logs provided the relationship between mineralogy and rock strength is established through core testing data.

15 GEOTHERMAL ENERGY↗

Commissioning of SRF Cavity Analyzer System

Research and development in Superconducting Radio Frequency (SRF) cavities manufacturing, surface treatment, preparation, and doping techniques for the improvement of cavities performance necessitate reliable cavities’ intrinsic quality factor measurement with accurate and repeatable results. Fermilab Vertical Test Stand facility (VTS) performs ~270 cavities tests per year, including R&D cavities as well as production cavities at each step of their preparation for the placement in accelerator’s cryomodules. Current Fermilab VTS testing system is based on the scalar approach of power measurement, which neglects potential error factors of the RF networks with distributed parameters, hence the assessed measurement errors of such a system might be slightly underestimated. Alternative approach, utilizing a vector measurement (amplitude and phase) of RF signals in the setup with a cavity as a device under test, promises an enhanced accuracy and results traceability. New cavity an alyser system based on this approach (Vector VTS) was developed by D. Frolov et al. and currently undergoes a commissioning process. Basic underlying principles of the system will be presented with the methods of quality factor extraction from S-parameters measurement of multiport cavities and brief error analysis will be discussed. The system architecture will be shown with main components parameters and ensuing testing capabilities. Multiple tests results will be discussed with a cross-check comparison of the results obtained with a conventional testing method. System advantages such as automated calibration process and additional features as a built- in microphonics measurement capability will be presented.

Netepenko, A.↗

Predicting oxidation damage of ultra high-temperature carbide ceramics in extreme environments using machine learning

Determining the oxidation resistance of UHTC carbides in extreme environments is challenging theoretically and experimentally due to the high dimensional complexity of influencing variables and intricate testing setups. Herein we demonstrate the use of machine learning (ML) models trained with experimental literature data to predict the oxide thickness of UHTC carbides exposed to air based on composition, mean grain size, relative densification, holding time, and temperature. A multi-dimensional database with 76 occurrences is created containing experimental results of Hf, Zr, and Ta carbides plus additives. In this study, the preprocessed database is then used to train ML models to predict their oxidation behavior. The trained model predicts the oxidation damage in the form of an average oxide thickness in UHTC carbides with a Mean Absolute Error (MAE) of ±65.45 μm for samples in the testing set that developed thicknesses up to 1000 μm. The model successfully predicted oxidation damage for a recession rate lower than 60 μm/min. It is noticed that the ensemble method MAE is increased to ±134.34 μm while forecasting the oxidation of samples with a recession rate higher than the threshold. The unprecedented approach is a novel way to predict the damage through the oxidation of carbide compounds before processing for a smarter design with room for improvement.

36 MATERIALS SCIENCE↗

Fluorescent amplification for next generation sequencing (FA-NGS) library preparation

BACKGROUND: Next generation sequencing (NGS) has become a universal practice in modern molecular biology. As the throughput of sequencing experiments increases, the preparation of conventional multiplexed libraries becomes more labor intensive. Conventional library preparation typically requires quality control (QC) testing for individual libraries such as amplification success evaluation and quantification, none of which occur until the end of the library preparation process. RESULTS: In this study, we address the need for a more streamlined high-throughput NGS workflow by tethering real-time quantitative PCR (qPCR) to conventional workflows to save time and implement single tube and single reagent QC. We modified two distinct library preparation workflows by replacing PCR and quantification with qPCR using SYBR Green I. qPCR enabled individual library quantification for pooling in a single tube without the need for additional reagents. Additionally, a melting curve analysis was implemented as an intermediate QC test to confirm successful amplification. Sequencing analysis showed comparable percent reads for each indexed library, demonstrating that pooling calculations based on qPCR allow for an even representation of sequencing reads. To aid the modified workflow, a software toolkit was developed and used to generate pooling instructions and analyze qPCR and melting curve data. CONCLUSIONS: We successfully applied fluorescent amplification for next generation sequencing (FA-NGS) library preparation to both plasmids and bacterial genomes. As a result of using qPCR for quantification and proceeding directly to library pooling, the modified library preparation workflow has fewer overall steps. Therefore, we speculate that the FA-NGS workflow has less risk of user error. The melting curve analysis provides the necessary QC test to identify and troubleshoot library failures prior to sequencing. While this study demonstrates the value of FA-NGS for plasmid or gDNA libraries, we speculate that its versatility could lead to successful application across other library types.

59 BASIC BIOLOGICAL SCIENCES↗

Error Analysis on Numerical Integration Algorithms in a Hypoelasticity Framework

This report determines local truncation errors for common stress integration algorithms used in explicit finite element codes with hypoelastic material models. The hypoelastic integration algorithms in question utilize an operator splitting procedure in a rotation neutralized configuration, where the stress response is determined from de- coupling the total deformation into rotational and strain dependent components. This document analyzes the error in evolving the stress given a one-step time increment Δt and compares the errors associated with both the rotational and strain components of the operator splitting method. A slight modification to a traditional algorithm is proposed and studied, where the rate of deformation is appropriately rotated from the midstep configuration at t n+1/2 to the end step configuration at t n+1 before the constitutive evaluation. The proposed modification either completely eliminates the error associated with the rotation rate or is of the same order of magnitude as the original algorithm for the three test cases considered in this report. These cases consist of an unaxial stretch with a constant true strain rate with a rigid body rotation, an uniaxial stretch with a constant engineering strain rate with a rigid body rotation, and a simple shear deformation. All three cases are compared to a closed form solution, and in almost every test case the alternative algorithm yields the most accurate one-step local truncation error.

97 MATHEMATICS AND COMPUTING↗

Improved Representation of Horizontal Variability and Turbulence in Mesoscale Simulations of an Extended Cold-Air Pool Event

Abstract Cold-air pools (CAPs), or stable atmospheric boundary layers that form within topographic basins, are associated with poor air quality, hazardous weather, and low wind energy output. Accurate prediction of CAP dynamics presents a challenge for mesoscale forecast models in part because CAPs occur in regions of complex terrain, where traditional turbulence parameterizations may not be appropriate. This study examines the effects of the planetary boundary layer (PBL) scheme and horizontal diffusion treatment on CAP prediction in the Weather Research and Forecasting (WRF) Model. Model runs with a one-dimensional (1D) PBL scheme and Smagorinsky-like horizontal diffusion are compared with runs that use a new three-dimensional (3D) PBL scheme to calculate turbulent fluxes. Simulations are completed in a nested configuration with 3-km/750-m horizontal grid spacing over a 10-day case study in the Columbia River basin, and results are compared with observations from the Second Wind Forecast Improvement Project. Using event-averaged error metrics, potential temperature and wind speed errors are shown to decrease both with increased horizontal grid resolution and with improved treatment of horizontal diffusion over steep terrain. The 3D PBL scheme further reduces errors relative to a standard 1D PBL approach. Error reduction is accentuated during CAP erosion, when turbulent mixing plays a more dominant role in the dynamics. Last, the 3D PBL scheme is shown to reduce near-surface overestimates of turbulence kinetic energy during the CAP event. The sensitivity of turbulence predictions to the master length-scale formulation in the 3D PBL parameterization is also explored. Significance Statement In this article, we demonstrate how a new framework for modeling atmospheric turbulence improves cold pool predictions, using a case study from January 2017 in the Columbia River basin (U.S. Pacific Northwest). Cold pools are regions of cold, stagnant air that form within valleys or basins, and improved forecasts could help to mitigate the risks they pose to air quality, transportation, and wind energy production. For the chosen case study, our tests show a reduction in temperature and wind speed errors by up to a factor of 2–3 relative to standard model options. These results strongly motivate continued development of the framework as well as its application to other complex weather events.

17 WIND ENERGY↗

Novel Lightweight, Low-Cost Heliostat for Concentrating Solar Power (SBIR Phase I Final Report)

The overall goal of this Department of Energy (DOE) SBIR Phase I project was to demonstrate the feasibility of the L.Garde, Inc. heliostat mirror facet for use in concentrated solar power applications. Prior to this Phase I project, L.Garde, Inc. developed a design for a lightweight and low cost mirror facet and successfully fabricated small scale (0.667 m 2 ) with a mirror surface flatness of 0.7 mrad. Therefore, the focus of the Phase I effort was to (1) demonstrate scalability by fabricating larger size mirrors while retaining the same mirror surface flatness, (2) demonstrate the design can withstand operating environment conditions through field testing, and (3) perform cost analysis to show the heliostat mirror facet design can meet DoE goals of < 12 kg/m2 and <$30/m 2 . During the Phase I project, L.Garde successfully fabricated large area (1.395 m 2 ) heliostat mirror facets, with a mass per unit area of 8 kg/m 2 and a cost of $29.80/m 2 . Surface flatness measurements (using contact probe technique) were performed on the mirror surface and results showed a flatness of 0.68 mrad, which were in agreement with previously fabricated small scale mirror facets. Slope error measurements was also performed on the mirror surface and results showed a slope error of 0.77 mrad which also was in agreement with previously fabricated small scale mirror facets. One large area mirror facet was subjected to a three (3) month field test. Surface flatness and slope error measurements were performed on the mirror surface after the field test and results were 0.663 mrad and 0.58 mrad respectively. The large scale heliostat mirror facets were also subjected to accelerated aging. However, during this exposure we observed failure due to the breaking of the mirror facets. Further investigation into the source of the failure showed that the mirror component alone showed signs of degradation during the same accelerated aging test. We believe that moisture ingress is occurring when subjected to high humidity, leading to buildup of water with the layers of protective paints and resulting in mirror breakage when water expands in freezing conditions. In order to mitigate or eliminate this issue, a new weatherproofing strategy may be implemented or a new mirror component may be used that is able to survive accelerated aging conditions.

14 SOLAR ENERGY↗

5ω Optical Thomson Scattering Report

The 5ω Optical Thomson Scattering system on the National Ignition Facility (NIF) is a diagnostic designed to measure temporally and spatially resolved plasma conditions in Inertial Confinement Fusion (ICF) Hohlraums. The system was proposed in 2014 and a phased approach to implementation was developed. In phase one the collection system was designed, built, and fielded on the NIF to be used for 3ω Thomson scattering measurements and background measurements near 211 nm (5ω. The initial commissioning experiment for the collection system was completed in Oct. 2016. Commissioning of the collection system continued through 2017 and the system is now fielded for a range of user experiments and regularly produces publication quality data. A dedicated 5ω probe laser was designed and built to allow Thomson scattering measurements in the presence of 2 MJ of 3ω drive energy. Due to scattered light (spectral reflections, laser-plasma instabilities, and unconverted drive energy) from the 3w drive lasers typical wavelengths (2ω and 4ω) fielded at other laser facilities like the Nova Laser Facility and the Omega Laser Facility were unable to meeting the signal to background requirements in design studies. A 10 Joule 5ω probe was proposed as a solution that met requirements. This 10 Joule laser was more energetic than previously fielded 5w lasers by 2-3 orders of magnitude. As part of a risk reduction plan, phase two of the project was to develop a 1 Joule, 5ω laser to demonstrate conversion efficiency >20% from 1ω to 5ω and make initial Thomson scattering measurements in the first few nanoseconds of an ICF laser pulse. Initial tests of the 5w conversion were completed at the Laboratory for Laser Energetics (LLE) and produced record 5ω energies. Based on these results from LLE, a 1 Joule, 5w laser system was designed for the NIF in 2018 and commissioning began in 2019. Commissioning of the 5ω laser system continued through 2023 and was eventually paused in Q1 of FY24 due to completing resource constraints. Commissioning of the 5w laser system proved incredibly challenging. Multiple issues were identified during commissioning and resolved, but issues remain. Currently there is not a clear understanding of why 5ω scattered has not been detected on the OTS collection system. Based on offline measurements, calculations, and preshot measurements the system appears to meet all requirements. Potential target physics issues have been investigated and do not appear to be an issue. The current hypothesis is that there is an error in one or more aspects of the offline testing not translating to expected performance when the system is fielded on the NIF. Additional full system testing in-situ utilizing the complete OTS system and NIF target chamber center time is needed to further test potential failure modes.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Accurate Ultrasonic Thickness Measurement for Arbitrary Time-Variant Thermal Profile

Ultrasonic thickness measurement of mechanical structures is one of the most popular and commonly used nondestructive methods for various kinds of process control and corrosion monitoring. With ultrasonic propagation speed being temperature-dependent, the thickness measurement can be performed reliably only when the thermal profile is completely known. Most conventional techniques assume the temperature of the test structure is uniform and at room temperature across its thickness. Such assumptions may lead to large errors in the thickness measurement, especially when there are significant temperature variations across the thickness. State-of-the-art techniques use external temperature measurements or implement iterative methods to compensate for the unknown thermal profiles. However, such techniques produce unsatisfactory results when the heat distribution is complex or varies rapidly with time. In this work, we propose a two-sensors technique, using both compressive and shear excitations, with a non-iterative rapid data processing method for accurate thickness measurement under arbitrary time-variant thermal profile. The independent behavior of shear and compressive waves is used to formulate a real-time thickness estimation technique. The developed technique is experimentally validated on a steel plate with fixed acoustic sensors. Test results show that the error in thickness estimation can be reduced by up to 98% compared to conventional thickness gauging methods.

36 MATERIALS SCIENCE↗