Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “error testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 973 records · Page 54

NEON AOP foliar trait maps, maps of model uncertainty estimates, and conifer map, East River, CO 2018

This data package contains mapped trait estimates and their uncertainties, and conifer map, for the National Ecological Observatory Network's Airborne Observation Platform survey data acquired over the Upper East River, Colorado in 2018. For full details, please see associated reference. in brief, trait models were developed independently for needle and non-needle leaf species using partial least squares regression (PLSR) using ground data from additional datasets: doi:10.15485/1618130, doi:10.15485/1618132, and doi:10.15485/1631278, merged with extracted spectral data from doi:10.15485/1618131. We separated vegetated pixels into needle and non-needle classes in order to generate a classification map based on the spectral differences between these leaf types (conifer.tif). We trained a deep learning model with custom architecture, detailed in Chadwick et al. In Press. The model performed with 0.998 true positive rate and 0.982 true negative rate, with ‘positives’ being non-needle identification. We then utilized PLSR to generate models of foliar traits for each leaf type. So that we could also map uncertainty in these predictions, we generated ten different models for needle and non-needle leaf species using different testing holdout sets of discrete sites. Each of these models was developed with a 100-fold cross validation procedure that utilized a 70% training set and 30% validation set with each fold, and then assessed based on the 10% of testing sites that were not included in that model’s development. The mean predicted value across the 10 models is used for the trait estimate in each pixel across the study area. The models are applied according to the leaf type designation in the conifer.tif map. The errors are the standard deviation across the 10 different models developed, with high error suggesting instability in model prediction and areas where values may not be reliable for ecological inference. These maps are only applied to areas with a NDVI > 0.5 to exclude non-vegetated areas. Shade masks could be applied to these data (doi:10.15485/1618131), but have not been for this data package. These data are also available on Google Earth Engine: https://code.earthengine.google.com/?asset=users/kdc/ER_NEON

54 ENVIRONMENTAL SCIENCES↗

An Analytical Model of Erosive Wear of BioMass Comminution Components

An analytical erosion model that relates critical process parameters (speed and impingement angle) to critical material attributes of inorganic mineral species in feedstock (density, size, aspect ratio) and substrate (hardness, toughness, and fatigue ductility) was applied to model wear in pretreatment milling operations. Results of the model were compared to experimental measurements of wear produced using the Accelerated Wear Test (AWT) rig at Idaho National Laboratory (INL). Results showed that there is good agreement between predicted and measured performance, and that a quality-by-design (QbD) tool can be developed to predict component reliability based on scientific engineering principles in lieu of trial-and-error approaches.

09 BIOMASS FUELS↗

Secure State Estimation with Asynchronous Measurements for Coordinated Cyber Attack Detection in Active Distribution Systems

Coordinated cyber attacks tamper with measurement data to disrupt the situational awareness of active distribution systems. Various sensors report measurements asynchronously at different rates, which introduces challenges during state estimation. In addition, this forces cyber intruders to exert greater effort to compromise multiple communication channels and launch coordinated attacks. Therefore, multi-channel and asynchronous measurements could be harnessed to develop more secure cyber defense strategies. In this paper, a prediction-correction-based multi-rate observer is designed to exploit the value of asynchronous measurements for the detection of coordinated false data injection (FDI) attacks. First, a time-function-dependent prediction-correction strategy is proposed to adjust the sampling interval for each sensor’s measurement. Then, an observer is designed based on the trade-off between estimation error and the optimal period of the most recent sampling instant, with the convergence of estimation error with the maximum permitted sampling interval. Moreover, the conditions for exponential stability are developed using the Lyapunov–Krasovskii functional technique. Next, a coordinated FDI attack detection strategy is developed based on the dual nonlinear minimization problem. The proposed attack detection and secure state estimation strategies are tested on the IEEE 13-node system. Simulation results show that these schemes are effective in enhancing attack detection based on asynchronous measurements or compromised data.

asynchronous measurements↗

Unbinned extraction of $γ$ from $B\to DK$ with normalizing flows

We introduce an unbinned method for extracting the CKM angle $γ$ from the decay chain $B^\pm \to (D \to K_S π^+ π^-) K^\pm$ using normalizing flows (NFs). The NFs, trained on $D$ decay data, learn a faithful continuous representation of the amplitude and strong phase variation over the $D\to K_Sπ^+π^-$ Dalitz plot whose fidelity improves with increased data sample sizes. With this input, the $B$ decay data can be used to extract the parameters $r_B$, $δ_B$, and $γ$. We test the method on Monte Carlo generated data, where it successfully recovers the injected value of $γ$ within uncertainties. The present implementation propagates statistical uncertainties from finite training data via an ensemble of independently trained flows, and does not attempt to capture the effects of systematic experimental errors. We explore two versions of the method that differ in how the trigonometric constraint on phase variation is encoded, and comment on the possible extension to Bayesian NFs, which would provide direct uncertainty estimates on the learned densities without requiring ensemble training.

Grossman, Yuval [Cornell U., LEPP]↗

A nodal transport method for coupled fast-thermal reactor analysis

We report that for efficient core analyses of coupled fast-thermal reactors, a new deterministic method has been developed based on the variational nodal transport method of VARIANT. A new multigroup cross section generation procedure was devised by combining Monte Carlo lattice calculations for thermal assemblies and the two-step procedure of the MC 2 -3 code for fast assemblies. To reduce assembly homogenization errors in nodal transport calculations, a new nodal equivalence method was developed based on the partial current discontinuity factor (PCDF) and incorporated in VARIANT. A practical procedure to calculate PCDFs with fixed source supercell calculations was also devised. The performance of the proposed method was investigated using a test problem derived from the versatile coupled test reactor (VCTR) design. The new procedure produced multigroup cross sections accurately for all assemblies. VARIANT transport calculations with PCDFs produced accurate multiplication factor and power distribution compared to reference Serpent-2 Monte Carlo solutions.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Comparing Classical and Machine Learning Force Fields for Modeling Deformation of Metal–Organic Frameworks Relevant for Direct Air Capture

Deformation of metal–organic frameworks (MOFs) induced by adsorbate molecules can affect adsorption properties such as capacity and selectivity, but most computational studies of MOFs assume framework rigidity to simplify calculations. Although flexible force fields (FFs) for MOFs have been parametrized for specific materials, the generality of FFs for reliably modeling adsorbate-induced deformation to accuracy nearing that of density functional theory (DFT) has not been established. This work confirms using DFT calculations that adsorbate-induced deformation can affect CO 2 and H 2 O adsorption energies in a considerable fraction of MOFs promising for direct air capture (DAC). We then benchmark the efficacy of several general-purpose FFs in describing adsorbate-induced deformation for DAC against DFT. Our results show that current classical FFs are insufficient for describing MOF deformation, especially in cases of interest for DAC where strong interactions exist between adsorbed molecules and MOF frameworks. Some emerging machine learning force fields (MLFFs) we tested, particularly CHGNet, MACE-MP-0, and Equiformer V2, appear to be more promising than the classical FF for emulating the deformation behavior described by DFT. The best performing FF (CHGNet), however, fails to achieve the accuracy required for practical predictions with a mean absolute adsorption energy error of 0.124 eV.

adsorption↗

Field-Array Benchmark of Commercial Bifacial PV Technologies with Publicly Available Data

We present results for a 75-kW field array deployed with rows of 5 different commercially available bifacial technologies. Four PERC (multi and mono) and 1 Silicon Heterojunction manufacturers are represented. Reference strings of equivalent monofacial PV modules are also installed in the 10-row field. High accuracy string-level DC monitoring and module-level measurements have been recorded for six months. Analysis indicates performance within expectation, with a cumulative model mean error within +/- 2% for both bifacial and monofacial models and cumulative bifacial energy gain between 6-9%. A custom-module to measure shading loss from the torque-tube was installed. One month data shows up to 6% irradiance non-uniformity. A fixed-tilt test-site with 3 years of bifacial data is also presented, with a bifacial gain of 3%.

41 EE - Solar Energy Technologies Office (EE-4S)↗

Power Flow Models of Grid-Forming Inverters in Unbalanced Distribution Grids

Load unbalance in electric distribution systems is unavoidable. Unbalanced load currents will lead to negative sequence (NS) voltages that may damage electric equipment. Unbalanced power flow analysis is a common tool to detect and mitigate NS voltage issues and requires accurate models of grid components. While traditional source models are available, grid-forming (GFM) inverter models are not well developed. GFM inverters implement various control strategies, which affect their power flow models. Here, in this paper, a novel GFM inverter model considering control effects is proposed. We show that for some control methods, unbalanced system loading will lead to unbalanced terminal voltages of the GFM inverters, which are modeled through an equivalent negative sequence impedance. The proposed models are initially validated using a simple test circuit. Then, they are applied in the power flow analysis on the IEEE 13-bus and 34-bus systems to demonstrate the accuracy improvement over the state-of-the-art. Using time-domain simulations as benchmarks, we show that the proposed models reduce the calculation error of negative sequence voltages by at least 25% in unbalanced distribution systems.

24 POWER TRANSMISSION AND DISTRIBUTION↗

CFL Optimized Forward–Backward Runge–Kutta Schemes for the Shallow-Water Equations

Abstract We present the formulation and optimization of a Runge–Kutta-type time-stepping scheme for solving the shallow-water equations, aimed at substantially increasing the effective allowable time step over that of comparable methods. This scheme, called FB-RK(3,2), uses weighted forward–backward averaging of thickness data to advance the momentum equation. The weights for this averaging are chosen with an optimization process that employs a von Neumann–type analysis, ensuring that the weights maximize the admittable Courant number. Through a simplified local truncation error analysis and numerical experiments, we show that the method is at least second-order in time for any choice of weights and exhibits low dispersion and dissipation errors for well-resolved waves. Further, we show that an optimized FB-RK(3,2) can take time steps up to 2.8 times as large as a popular three-stage, third-order strong stability-preserving Runge–Kutta method in a quasi-linear test case. In fully nonlinear shallow-water test cases relevant to oceanic and atmospheric flows, FB-RK(3,2) outperforms SSPRK3 in admittable time step by factors roughly between 1.6 and 2.2, making the scheme approximately twice as computationally efficient with little to no effect on solution quality. Significance Statement The purpose of this work is to develop and optimize time-stepping schemes for models relevant to oceanic and atmospheric flows. Specifically, for the shallow-water equations we optimize for schemes that can take time steps as large as possible while retaining solution quality. We find that our optimized schemes can take time steps between 1.6 and 2.2 times larger than schemes that cost the same number of floating point operations, translating directly to a corresponding speedup. Our ultimate goal is to use these schemes in climate-scale simulations.

54 ENVIRONMENTAL SCIENCES↗

Photovoltaic System Health-State Architecture for Data-Driven Failure Detection

The timely detection of photovoltaic (PV) system failures is important for maintaining optimal performance and lifetime reliability. A main challenge remains the lack of a unified health-state architecture for the uninterrupted monitoring and predictive performance of PV systems. To this end, existing failure detection models are strongly dependent on the availability and quality of site-specific historic data. The scope of this work is to address these fundamental challenges by presenting a health-state architecture for advanced PV system monitoring. The proposed architecture comprises of a machine learning model for PV performance modeling and accurate failure diagnosis. The predictive model is optimally trained on low amounts of on-site data using minimal features and coupled to functional routines for data quality verification, whereas the classifier is trained under an enhanced supervised learning regime. The results demonstrated high accuracies for the implemented predictive model, exhibiting normalized root mean square errors lower than 3.40% even when trained with low data shares. The classification results provided evidence that fault conditions can be detected with a sensitivity of 83.91% for synthetic power-loss events (power reduction of 5%) and of 97.99% for field-emulated failures in the test-bench PV system. Finally, this work provides insights on how to construct an accurate PV system with predictive and classification models for the timely detection of faults and uninterrupted monitoring of PV systems, regardless of historic data availability and quality. Such guidelines and insights on the development of accurate health-state architectures for PV plants can have positive implications in operation and maintenance and monitoring strategies, thus improving the system’s performance.

photovoltaics↗

Comparison of Machine Learning-Based Predictive Models of the Nutrient Loads Delivered from the Mississippi/Atchafalaya River Basin to the Gulf of Mexico

Predicting nutrient loads is essential to understanding and managing one of the environmental issues faced by the northern Gulf of Mexico hypoxic zone, which poses a severe threat to the Gulf’s healthy ecosystem and economy. The development of hypoxia in the Gulf of Mexico is strongly associated with the eutrophication process initiated by excessive nutrient loads. Due to the complexities in the excessive nutrient loads to the Gulf of Mexico, it is challenging to understand and predict the underlying temporal variation of nutrient loads. The study was aimed at identifying an optimal predictive machine learning model to capture and predict nonlinear behavior of the nutrient loads delivered from the Mississippi/Atchafalaya River Basin (MARB) to the Gulf of Mexico. For this purpose, monthly nutrient loads (N and P) in tons were collected from US Geological Survey (USGS) monitoring station 07373420 from 1980 to 2020. Machine learning models—including autoregressive integrated moving average (ARIMA), gaussian process regression (GPR), single-layer multilayer perceptron (MLP), and a long short-term memory (LSTM) with the single hidden layer—were developed to predict the monthly nutrient loads, and model performances were evaluated by standard assessment metrics—Root Mean Square Error (RMSE) and Correlation Coefficient (R). The residuals of predictive models were examined by the Durbin–Watson statistic. The results showed that MLP and LSTM persistently achieved better accuracy in predicting monthly TN and TP loads compared to GPR and ARIMA. In addition, GPR models achieved slightly better test RMSE score than ARIMA models while their correlation coefficients are much lower than ARIMA models. Moreover, MLP performed slightly better than LSTM in predicting monthly TP loads while LSTM slightly outperformed for TN loads. Furthermore, it was found that the optimizer and number of inputs didn’t show effects on the LSTM performance while they exhibited impacts on MLP outcomes. This study explores the capability of machine learning models to accurately predict nonlinearly fluctuating nutrient loads delivered to the Gulf of Mexico. Further efforts focus on improving the accuracy of forecasting using hybrid models which combine several machine learning models with superior predictive performance for nutrient fluxes throughout the MARB.

54 ENVIRONMENTAL SCIENCES↗

Assessing mass balance-based inverse modeling methods via a pseudo-observation test to constrain NO x emissions over South Korea

This study constrains NO x emissions by utilizing mass balance–based inverse modeling methods and examines the optimization of inverse modeling conditions through a pseudo-observation test for South Korea, which has complex topography. Here, we applied mass balance–based inverse modeling methods such as Basic Mass Balance (BMB), Finite Difference Mass Balance (FDMB), and Iterative Finite Difference Mass Balance (IFDMB). We performed a numerical simulation of air quality using the Community Multi-scale Air Quality (CMAQ) model to calculate the NO 2 column density required for the inverse modeling. The pseudo-observation test was performed according to season, modeling resolution, and regridding methodology of satellite observation data to identify various conditions while applying the inverse modeling for South Korea. Comparing the inverse modeling results from the BMB, FDMB, and IFDMB methods, IFDMB was the most effective method in constraining NO x emissions in the South Korean region since it minimized smearing effects (i.e., transport-induced errors) through iterative calculations. The accuracy of the constrained NO x emissions using mass balance–based inversions in South Korea was the highest in the summer due to the minimized smearing effects, and the 9 km resolution modeling was the most efficient for inverse modeling of the region. In addition, the results of inverse modeling varied depending on the regridding methods, implying the importance of using a suitable regridding method and modeling resolution. This study used pseudo-observations, but the inversions are expected to be applied based on actual satellite data in the future.

54 ENVIRONMENTAL SCIENCES↗

High-Resolution Measurement of Soil Thermal Properties and Moisture Content Using a Novel Heated Fiber Optics Approach

Hydrological parameters are scale dependent. Efficient monitoring techniques capable of measuring hydrological parameters, such as soil moisture content (θ), over a wide range of spatial scales are essential for understanding the complexity of water and energy movement across the landscape. Techniques to measure θ over spatial scales in the range from centimeters to thousands of meters, however, are sorely lacking. Recent improvements in the distributed temperature sensing (DTS) technology supported the development of novel techniques to fill that gap. However, improvements in the accuracy and applicability of DTS techniques are still needed. This study investigates the possibility of improving the accuracy of the fiber optics dual-probe heat-pulse (FO-DPHP) DTS technique by using a new design to maintain the spacing between the FO-DPHP probes and by introducing a novel data interpretation approach. The accuracy of the novel FO-DPHP design was tested at different θ in a sand column experiment. The FO-DPHP measurements obtained using traditional and novel data interpretation approaches were compared against independent measurements from several calibrated soil water content (EC5) sensors. Monte-Carlo analyses were also performed to assess the impact of DTS measurement errors on the accuracy achieved using the data interpretation approaches. The novel design and data interpretation approach allowed for accurate measurements of soil thermal properties and θ without the need to perform a hard-to-achieve soil-specific calibration. Measured θ had mean errors and standard deviations <0.03 and <0.01 m 3 m -3 , respectively, for moisture conditions ranging from dry to near saturation. The standard deviation in the measured heat capacity was <0.01 MJ m -3 K -1 .

42 ENGINEERING↗

Supervised learning and the finite-temperature string method for computing committor functions and reaction rates

A central object in the computational studies of rare events is the committor function. Though costly to compute, the committor function encodes complete mechanistic information of the processes involving rare events, including reaction rates and transition-state ensembles. Under the framework of transition path theory, Rotskoff et al. [Proceedings of the 2nd Mathematical and Scientific Machine Learning Conference, Proceedings of Machine Learning Research (PLMR, 2022), Vol. 145, pp. 757–780] proposes an algorithm where a feedback loop couples a neural network that models the committor function with importance sampling, mainly umbrella sampling, which collects data needed for adaptive training. Here, in this work, we show additional modifications are needed to improve the accuracy of the algorithm. The first modification adds elements of supervised learning, which allows the neural network to improve its prediction by fitting to sample-mean estimates of committor values obtained from short molecular dynamics trajectories. The second modification replaces the committor-based umbrella sampling with the finite-temperature string (FTS) method, which enables homogeneous sampling in regions where transition pathways are located. We test our modifications on low-dimensional systems with non-convex potential energy where reference solutions can be found via analytical or finite element methods, and show how combining supervised learning and the FTS method yields accurate computation of committor functions and reaction rates. We also provide an error analysis for algorithms that use the FTS method, using which reaction rates can be accurately estimated during training with a small number of samples. The methods are then applied to a molecular system in which no reference solution is known, where accurate computations of committor functions and reaction rates can still be obtained.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Demonstration of TOFFEE: A Response Uncertainty Quantification Tool

A key characteristic in neutron transport is nuclear data. Cross-section uncertainty is not used in MCNP6.3 to propagate response uncertainty without external analysis. Here, the TOol For Fast Error Estimation (TOFFEE) is a Python-based code developed to automate the propagation of cross-section uncertainty for MCNP evaluations. TOFFEE implements the sandwich rule to calculate the uncertainty from cross sections with sensitivity coefficients from MCNP6.3 and ENDF/B covariance data. In this paper, TOFFEE has been tested with benchmark experiments, and it has been compared to the uncertainty quantification capabilities of Sampler and TSUNAMI, within SCALE, to verify the application’s capabilities.

97 MATHEMATICS AND COMPUTING↗

New dark matter analysis of milky way dwarf satellite galaxies with madhatv2

We obtain bounds on dark matter annihilation using 14 years of publicly available Fermi-LAT data from a set of 54 dwarf spheroidal galaxies, using spectral information from 16 energy bins. We perform this analysis using our updated and publicly available code , which can be used to test a variety of models for dark matter particle physics and astrophysics in an accessible manner. In particular, we note that including Carina III in the analysis strengthens constraints on s -wave annihilation into two-body Standard Model final states by a factor of ∼ 3 but broadens the error on the constraint due to the large uncertainty of its J -factor. Our findings illustrate the importance of verifying if Carina III is in fact a dwarf spheroidal galaxy and measuring more precisely its J -factor. More generally, they highlight the significance of forthcoming discoveries of nearby ultrafaint dwarfs for dark matter indirect detection. Published by the American Physical Society 2024

Astronomy & Astrophysics↗

Suppressing Quantum Circuit Errors Due to System Variability

We present a quantum circuit optimization technique that takes into account the variability in error rates that is inherent across present-day noisy quantum computing platforms. This method can be run after qubit routing or postcompilation and consists of computing isomorphic subgraphs to input circuits and scoring each using heuristic cost functions derived from system calibration data. Using an independent standard algorithmic test suite, we show that it is possible to recover on average nearly 40% of missing fidelity using better qubit selection via efficient to compute cost functions. We demonstrate additional performance gains by considering qubit placement over multiple quantum processors. The overhead from these tools is minimal with respect to other compilation steps, such as qubit routing, as the number of qubits increases. As such, our method can be used to find qubit mappings for problems at the scale of quantum advantage and beyond.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Visual and genetic stock identification of a test fishery to forecast Columbia River spring Chinook salmon stocks 2 weeks into the future

Abstract Modern fisheries management strives to balance opposing goals of protection for weak stocks and opportunity for harvesting healthy stocks. Test fisheries can aid management of anadromous fishes if they can forecast the strength and timing of an annual run with adequate time to allow fisheries planning. Integration of genetic stock identification (GSI) can further maximize utility of test fisheries by resolving run forecasts into weak‐ and healthy‐stock subcomponents. Using 5 years (2017–2022) of test fishery data, our study evaluated accuracy, resolution, and lead time of predictions for stock‐specific run timing and abundance of Columbia River spring Chinook salmon ( Oncorhynchus tshawytscha ). We determined if this test fishery (1) could use visual stock identification (VSI) to forecast at the coarse stock resolution (i.e., classification of “lower” vs. “upriver” stocks) upon which current management is based and (2) could be enhanced with GSI to forecast at higher stock resolution. VSI accurately identified coarse stocks (83.3% GSI concordance), and estimated a proxy for abundance (catch per unit effort, CPUE) of the upriver stock in the test fishery that was correlated ( R 2 = 0.90) with spring Chinook salmon abundance at Bonneville dam (Rkm 235). Salmon travel rates (~8.6 Rkm/day) provided predictions with 2‐week lead time prior to dam passage. Importantly, GSI resolved this predictive ability as finely as the hatchery broodstock level. Lower river stock CPUE in the test fishery was correlated with abundance at Willamette Falls (Rkm 196, R 2 = 0.62), but could not be as finely resolved as achieved for upriver stocks. We described steps to combine VSI and GSI to provide timely in‐season information and with prediction accuracy of ~12.4 mean absolute percentage error and high stock resolution to help plan Columbia River mainstem fisheries.

Hess, Jon E.↗