Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “error estimation and analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,441 records · Page 80

Evaluating the potential of short-term instrument deployment to improve distributed wind resource assessment

Distributed wind projects, which are connected at the distribution level of an electricity system or in off-grid applications to serve specific or local energy needs, often rely solely on wind resource models to establish wind speed and energy generation expectations. Historically, anemometer loan programs have provided an affordable avenue for more accurate onsite wind resource assessment, and the lowering cost of lidar systems has shown similar advantages for more recent assessments. While a full 12 months of onsite wind measurement is the standard for correcting model-based long-term wind speed estimates for utility-scale wind farms, the time and capital investment involved in gathering onsite measurements must be reconciled with the energy needs and funding opportunities that drive expedient deployment of distributed wind projects. Much literature exists to quantify the performance of correcting long-term wind speed estimates with 1 or more years of observational data, but few studies explore the impacts of correcting with months-long observational periods. This study aims to answer the question of how short you can go in terms of the observational time period needed to make impactful improvements to model-based long-term wind speed estimates. Three algorithms, multivariable linear regression, adaptive regression splines, and regression trees, are evaluated for their skill at correcting long-term wind resource estimates from the European Centre for Medium-Range Weather Forecasts Reanalysis version 5 (ERA5) using months-long periods of observational data from 66 locations across the US. On average, correction with even 1 month of observations provides significant improvement over the baseline ERA5 wind speed estimates and produces median bias magnitudes and relative errors within 0.22 m s −1 and 4 percentage points of the median bias magnitudes and relative errors achieved using the standard 12 months of data for correction. However, in cases when the shortest observational periods (1 to 2 months) used for correction are not well correlated with the overlapping ERA5 reference, the resultant long-term wind speed errors are worse than those produced using ERA5 without correction. Summer months, which are characterized by weaker relative wind speeds and standard deviations for most of the evaluation sites, tend to produce the worst results for long-term correction using months-long observations. The three tested algorithms perform similarly for long-term wind speed bias; however, regression trees perform notably worse than multivariable linear regression and adaptive regression splines in terms of correlation when using 6 months or less of observational data for correction. Translating the analysis to wind energy, median relative errors in the capacity factor are on average within 10 % using 1 month of training. If the observation period used for correction is not well correlated with the reference data, however, misrepresentation of the observed capacity factor can be substantial. The risk associated with poor correlation between the observed and reference datasets decreases with increasing training period length. In the worst-correlation scenarios, the median capacity factor relative errors from using 1, 3, and 6 months are within 47 %, 26 %, and 16 %, respectively.

17 WIND ENERGY↗

A Differentiable Hydrology Approach for Modeling With Time-Varying Parameters

In the analysis of observational data with mathematical models, it is often desirable to let one or more model parameters vary with time to account for changing environmental conditions or to offer more flexibility. A standard approach for dynamic models is to allow for the number of parameters to grow as a function of time, leading to a high-dimensional inference problem for long data records. We propose using Hamiltonian Monte Carlo, a gradient-based Markov chain Monte Carlo (MCMC) method, to perform Bayesian inference for time-varying parameters (TVP) in hydrology models. As derivatives of model error functions with regard to parameters are not available in closed form, we implemented the GR4J rainfall-runoff models in Theano/PyMC3, and Jax/NumPyro, allowing for the application of automatic differentiation techniques. A simulation experiment assessing the viability of these methods for recovering underlying temporal variation in parameters indicates that a discrete Gaussian random walk-based prior appears to be best suited across a range of scenarios while the continuous-time Gaussian process compares relatively poorly. In an analysis of 20 years of daily real-world streamflow records from the Model Parameter Estimation Experiment (MOPEX) hydrology data set with increasing data sparsity and at multiple temporal resolutions, we find that TVP inference with gradient-based MCMC is a flexible and reliable approach for analyzing hydrology models with dynamic parameter sets.

54 ENVIRONMENTAL SCIENCES↗

Sources of error and methods to improve accuracy in interface state density analysis using quasi-static capacitance–voltage measurements in wide bandgap semiconductors

Characterizing interface trap states in commercial wide bandgap devices using frequency-based measurements requires unconventionally high probing frequencies to account for both fast and slow traps associated with wide bandgap materials. The C - ψs technique has been suggested as a viable quasi-static method for determining the interface trap state densities in wide bandgap systems, but the results are shown to be susceptible to errors in the analysis procedure. Here this work explores the primary sources of errors present in the C - ψs technique using an analytical model that describes the apparent response for wide bandgap MOS capacitor devices. Measurement noise is shown to greatly impact the linear fitting routine of the 1/C$^{*2}_s$ vs Ψ s plot to calibrate the additive constant in the surface potential/gate voltage relationship, and an inexact knowledge of the oxide capacitance is also shown to impede interface trap state analysis near the band edge. In addition, a slight nonlinearity that is typically present throughout the 1/C$^{*2}_s$ vs Ψ s plot hinders the accurate estimation of interface trap densities, which is demonstrated for a fabricated n-SiC MOS capacitor device. Methods are suggested to improve quasi-static analysis, including a novel method to determine an approximate integration constant without relying on a linear fitting routine.

42 ENGINEERING↗

Gamma-ray burster recurrence timescales

Three optical transients have been found which are associated with gamma-ray bursters (GRBs). The deduced recurrence timescale for these optical transients (tau sub opt) will depend on the minimum brightness for which a flash would be detected. A detailed analysis using all available data of tau sub opt as a function of E(gamma)/E(opt) is given. For flashes similar to those found in the Harvard archives, the best estimate of tau sub opt is 0.74 years, with a 99% confidence interval from 0.23 years to 4.7 years. It is currently unclear whether the optical transients from GRBs also give rise to gamma-ray events. One way to test this association is to measure the recurrence timescale of gamma-ray events tau sub gamma. A total of 210 gamma-ray error boxes were examined and it was found that the number of observed overlaps is not significantly different from the number expected from chance coincidence. This observation can be used to place limits on tau sub gamma for an assumed luminosity function. It was found that tau sub gamma is approx. 10 yr if bursts are monoenergetic. However, if GRBs have a power law luminosity function with a wide dynamic range, then the limit is tau sub gamma 0.5 yr. Hence, the gamma-ray data do not require tau sub gamma and tau sub opt to be different.

Schaefer, B. E.↗

Mass Inferencing Model Creation And Deployment To Lunar Excavation Robot, RASSOR

NASA’s Regolith Advanced Surface Systems Operations Robot (RASSOR) Excavator is a teleoperated mobile robotic platform with a unique space regolith excavation capability. This research project developed functionality for inferencing regolith mass ingested during RASSOR operation, enhancing RASSOR’s ability to successfully complete ISRU missions. Radio wave propagation time to the Moon and back is ~2.56 seconds. Though teleoperation is possible with this delay, autonomous capability that enables RASSOR to plan and execute excavation missions intelligently and efficiently is preferred. To teleoperate or run autonomously, it is crucial for the quantity of regolith mass ingested by RASSOR to be available as a system state for efficient operation (e.g. knowledge of whether drums are full informs the task of highest priority, whether it be continuing to dig, or returning to a processing plant to offload regolith). A configurable data reduction and analysis pipeline was created to allow for straightforward incorporation of new data, such as that from lunar excavation, to improve model performance in new environments. Four distinct modeling approaches were employed in developing a mass inferencing approach that could work on RASSOR. All four models take in system states and output a mass prediction for each set of the robot’s bucket drums. Initial results from deployment to RASSOR and testing in a simulated lunar environment show that the models have <10% mean error during robot operation. Future work includes refinement of a model that estimates regolith mass in real-time during excavation as well as further testing of the developed models on the hardware.

ROS↗

Predicting Initial Trans-Membrane Pressure for Optimized Operations in UF Unit Using Random Forest

With the growing scarcity of freshwater, innovative process design mechanisms like Reverse Osmosis (RO) are increasingly gaining attention among water treatment utilities to address the rising demand. Ensuring reliable water production necessitates efficient resource utilization, minimizing downtime in (ultra-filtration) UF systems. Recent advancements in machine learning (ML) have enabled the development of accurate data-driven models for Model Predictive Control (MPC), often requiring minimal prior knowledge of underlying physical processes. In this study, we present predictive regression models based on Random Forest (RF) and Auto-Regressive (AR) approaches to forecast the initial Trans-Membrane Pressure (TMP) for each filtration cycle in data generated by Direct Potable Reuse (DPR) systems. The proposed RF-based model demonstrates superior performance compared to baseline methods, including historical mean, Last Observation Carried Forward (LOCF), and naïve AR models, across various forecasting horizons in terms of root mean square error (RMSE) metric. To evaluate how different classes of process variables contribute to TMP dynamics over time, we examine the feature importance of independent covariates across multiple forecast horizons. This analysis provides insight into the temporal relevance of operational and sensor-derived features, guiding control and monitoring strategies. Additionally, the impact of hyperparameter tuning on TMP prediction performance is studied for both direct and recursive RF modelling approaches across increasing forecast horizons. Accurate prediction of initial TMP is critical for optimizing RO operations, as it enables the development of robust modelling frameworks by accurately estimating membrane fouling trends, thereby enhancing process efficiency and long-term reliability. The demonstrated efficacy of the RF-based approach highlights its potential as a tool for real-time decision-making in water treatment systems, paving the way for advanced process optimization and sustainable water resource management.

Mukherjee, Subrata [ORNL] (ORCID:0000000309930338)↗

On the Accuracy of CFD-Based Pressure Drop Predictions for Right-Angle Ducts

The predictive capability of computational fluid dynamics (CFD) codes for turbulent flow through curved ducts is of significant importance to the design and performance analysis of modern rocket engine flowpaths. Code calibration and validation studies for this class of flow are desireable to estimate the performance margin and operating range of components designed using Navier-Stokes methods. Parametric experimental studies such as that of Weske (NACA ARR W-39) provided a wealth of performance data for the design of single- and compound elbow configurations with various cross-sections, curvature and aspect ratios at varying Reynolds numbers. In that work, the majority of data is presented in the form of loss coefficients, characterizing pressure losses due to duct curvature, and including losses due to wall friction. Using measured friction coefficients, losses of equivalent straight lengths of duct are subtracted, resulting in performance curves useful for design computations. These data are currently used in a CFD-based parametric study covering a broad range of operating conditions. Of particular interest for the accuracy of CFD predictions are the effects on pressure loss due to inlet boundary layer thickness (dependent on upstream development length), and the wall treatment for the turbulence equations (conventional wall functions vs. wall integration using a two-layer model). The experimental data are reassessed in the form of an error analysis, and are compared with CFD predictions for 18 computational cases. Grid-independence, grid spacing, and convergence requirements of the cases are discussed. Conclusions regarding the relative importance of the parametric variables will be presented.

Brankovic, Andreja↗

The Gmao Hybrid 4d-Envar Observing System Simulation Experiment Framework.

This work describes the extension of the Global Modeling and Assimilation Office (GMAO) Observing System Simulation Experiment (OSSE) framework to use a hybrid 4D-EnVar scheme instead of 3D-Var. The original 3D-Var and hybrid 4D-EnVar OSSEs use the same version of the data assimilation system (DAS) so that a direct comparison is possible in terms of the validation with respect to their corresponding real cases. Rather than quantifying the differences between the two data assimilation methodologies, a short inter-comparison of upgrading from a 3D- to a 4D-OSSE is provided to highlight aspects where this change matters to the OSSE community and to identify features of data assimilation that can only be explored in a four-dimensional OSSE framework. A short validation of the hybrid 4D-EnVar OSSE shows that conclusions from previous assessments of the 3D-Var OSSE in its ability to mimic the behavior of the real system still hold with the same caveats. Furthermore, some aspects of the ensemble configuration and behavior are discussed along with forecast sensitivity to observation impacts (FSOI). Estimates of error standard deviations are shown to be smaller in the hybrid 4D-EnVar OSSE but with little impact on the character of the error. A discussion on future work directions focuses on exploring the four-dimensional aspect such as the error distribution within the assimilation window or four-dimensional handling of high-temporal density observations.

Data assimilation↗

How to avoid multiple scattering in strongly scattering SANS and USANS samples

Small Angle Neutron Scattering (SANS) and Ultra Small Angle Neutron Scattering (USANS) are the only available experimental techniques to provide seamless non-destructive measurements of the geometry of the accessible and inaccessible pore structure of rocks from sub-nanopore size to the scale of macropores. They have therefore become the measurement of choice for tight reservoir rocks such as organic rich shales. A simplifying assumption in the analysis is, however, that during the path of neutrons through the sample each neutron is only scattered once. Shales are samples with a high scattering power and Multiple Scattering (MS) may occur which requires special modelling for deconvolution of the results. The approach to avoid MS is to simply reduce the sample thickness to <0.15–0.5 mm. Here, in this work, we present a systematic method on wavelength selection and preparation of samples to optimise extraction of microstructural data and minimise parasitic errors. Experimentally measured SAS transmission (TSAS) values are used as a practical criterion for estimation of the extent of MS. Generous beamtime allocations allowed robust testing revealing that sample thicknesses can be twice as thick as predicted using the standard protocol. Analysing thicker samples is particularly beneficial for statistically relevant characterisation of heterogeneous samples making the new protocol the method of choice for such samples.

(U)SANS↗

Lithospheric flexure beneath the Freyja Montes foredeep, Venus - Constraints on lithospheric thermal gradient and heat flow

Analysis of Venera 15 and 16 radar images and topographic data from the Freyja Montes region on Venus suggests that this mountain belt formed as a result of a sequence of underthrusts of the lithosphere of the North Polar Plains beneath the highlands of Ishtar Terra. The lithospheric flexure hypothesis is tested, and the effective thickness Te of the elastic lithosphere of the underthrusting portion of the North Polar Plains is estimated by fitting individual topographic profiles to deflection curves for a broken elastic plate. The theoretical curves fit the observed topographic profiles to within measurement error for values of flexural rigidity D in the range (0.8-3) x 10 to the 22nd N m, equivalent to Te in the range 11-18 km.

Solomon, Sean C.↗

Early experiences building a software quality prediction model

Early experiences building a software quality prediction model are discussed. The overall research objective is to establish a capability to project a software system's quality from an analysis of its design. The technical approach is to build multivariate models for estimating reliability and maintainability. Data from 21 Ada subsystems were analyzed to test hypotheses about various design structures leading to failure-prone or unmaintainable systems. Current design variables highlight the interconnectivity and visibility of compilation units. Other model variables provide for the effects of reusability and software changes. Reported results are preliminary because additional project data is being obtained and new hypotheses are being developed and tested. Current multivariate regression models are encouraging, explaining 60 to 80 percent of the variation in error density of the subsystems.

Agresti, W. W.↗

Attitude stability of LDEF: Refinement of results from the silver pinhole camera

A measurement was previously described of the angular offset and attitude stability of the LDEF spacecraft using a simple pinhole camera device in the UAH experiment A0114. This device uses a silver surface to record the impact zone of atmospheric atomic oxygen passing through a small pinhole on the front surface of the satellite. The shape and size of this zone are well defined if the satellite velocity and gas temperature are known. The circular symmetry of the zone would be distorted by oscillation of the LDEF about its stable attitude, or by the effect of the co-rotation of the Earth's atmosphere for cases of satellites in nonequatorial orbits. The observed ellipticity of 1.05 with the major axis in the yaw direction is equivalent to an oscillation of + or - 0.2 deg about the stable attitude. The uncertainty in that measurement was estimated at about 0.1 deg. A refined analysis based on summing distributions of flux versus incidence angle for a large number of orbital positions, and including a co-rotating atmosphere, indicates that the combined distributions produce a result consistent with the measured exposed spot. It is suggested that, within the precision of the measurements, no actual oscillation of the LDEF is required to produce the results. Thus, the LDEF may have maintained a stable attitude to better than 0.1 deg, even under conditions of maximum aerodynamic perturbation when the silver oxygen record was made. This error is some two orders of magnitude lower than the predicted uncertainty in yaw oscillation and may indicate that the predict methodologies are too conservative.

Peters, P. N.↗

Utility of Satellite Magnetic Observations for Estimating Near-Surface Magnetic Anomalies

Regional to continental scale magnetic anomaly maps are becoming increasingly available from airborne, shipborne, and terrestrial surveys. Satellite data are commonly considered to fill the coverage gaps in regional compilations of these near-surface surveys. For the near-surface Antarctic magnetic anomaly map being produced by the Antarctic Digital Magnetic Anomaly Project (ADMAP), we show that near-surface magnetic anomaly estimation is greatly enhanced by the joint inversion of the near-surface data with the satellite observations relative to the conventional technique such as minimum curvature. Orsted observations are especially advantageous relative to the Magsat data that have order-of-magnitude greater measurement errors, albeit at much lower orbital altitudes. CHAMP is observing the geomagnetic field with the same measurement accuracy as the Orsted mission, but at the lower orbital altitudes covered by Magsat. Hence, additional significant improvement in predicting near-surface magnetic anomalies can result as these CHAMP data are available. Our analysis also suggests that considerable new insights on the magnetic properties of the lithosphere may be revealed by a further order-of-magnitude improvement in the accuracy of the magnetometer measurements at minimum orbital altitude.

Kim, Hyung Rae↗

Version 4 of the SMAP Level-4 Soil Moisture Algorithm and Data Product

The NASA Soil Moisture Active Passive (SMAP) mission Level-4 Soil Moisture (L4_SM) product provides global, 3-hourly, 9-km resolution estimates of surface (0-5 cm) and root-zone (0-100 cm) soil moisture with a mean latency of ~2.5 days. The underlying L4_SM algorithm assimilates SMAP radiometer brightness temperature (Tb) observations into the NASA Catchment land surface model using a spatially-distributed ensemble Kalman filter. Version 4 of the L4_SM modeling system includes a reduction in the upward recharge of surface soil moisture from below under non-equilibrium conditions, resulting in reduced bias and improved dynamic range of L4_SM surface soil moisture compared to earlier versions. This change and additional technical modifications to the system reduce the mean and standard deviation of the observation-minus-forecast Tb residuals and overall soil moisture analysis increments while maintaining the skill of the L4_SM soil moisture estimates versus independent in situ measurements; the average, bias-adjusted RMSE in Version 4 is 0.039 m(exp 3) m(exp -3) for surface and 0.026 m(exp 3) m(exp -3) for root-zone soil moisture. Moreover, the coverage of assimilated SMAP observations in Version 4 is near-global owing to the use of additional satellite Tb records for algorithm calibration. L4_SM soil moisture uncertainty estimates are biased low (by 0.01-0.02 m(exp 3) m(exp -3)) against actual errors (computed versus in situ measurements). L4_SM runoff estimates, an additional product of the L4_SM algorithm, are biased low (by 35 mm year (exp -1)) against streamflow measurements. Compared to Version 3, bias in Version 4 is reduced by 46% for surface soil moisture uncertainty estimates and by 33% for runoff estimates.

RMSE↗

A Novel Machine Learning Method for Surface PM2.5 Estimations from Geostationary Satellites

Particulate matter (PM) with a diameter of less or equal to 2.5 μm, known as PM , affects human health as it penetrates the respiratory system. The Environmental Protection Agency (EPA) measures the atmospheric concentration of PM using air quality monitors stationed throughout the Continental United States (CONUS). Such measurements are points on a spatial domain and therefore, might not be representative of the air quality at nearby areas considering that the composition of the atmosphere is highly variable from place to place. Satellite based AOD permits a spatially uniform means of estimating PM and new geostationary satellites provide high temporal and spatial resolution estimation of AOD. However, the concentration of PM is non-linearly dependent on other atmospheric parameters that include relative humidity, temperature, and height of the planetary boundary layer. This information may be estimated at similar spatial and temporal resolutions as AOD from numerical modeling such as from the National Oceanic and Atmospheric Administration’s (NOAA) High Resolution Rapid Refresh (HRRR) model which resolves near real-time atmospheric conditions over the CONUS. The estimation of PM concentration is a multi-parametric problem that considers the effect of temporal dependencies among the different parameters. Deep learning approaches are appropriate for such complex estimation problems as they intrinsically capture relations among multiple non-linear parameters. This study compares deep-learning methods to traditional regression analysis to demonstrate the capabilities of these methods in predicting PM2.5 concentrations. Additionally, a novel ensemble learning approach is employed to identify scientific processes that could further improve the estimation of PM concentration. Utilizing Long Short-Term Memory (LSTM) neural networks, which are suitable for multivariate time series estimation problems as they are capable of learning long-term dependencies, individual models are created for each EPA station and trained on the aforementioned dataset collocated over each station. Individual station models are merged if the model's performance is improved by reducing the root mean squared error (RMSE) metric. This ensemble training method ultimately reduces the RMSE value. Evaluation of these results provide insights into physical processes and related observable parameters that may contribute to PM concentrations. Identified parameters evaluated to be statistically different between the merged and unmerged models are expected to improve overall performance. These new parameters are then utilized for reevaluation of the deep learning methods with an extreme gradient boosting model with an RMSE of 5.5 providing the best results.

George Priftis↗

Sensitivity analysis of short-arc station coordinate determinations from range data

The accurate determination of the geocentric coordinates of a tracking station is essential for most geodetic and geophysical satellite applications. Since most of these satellites are close to the earth, the geopotential model is a dominant source of error which significantly influences station coordinate determinations. Other sources, such as GM error and drag, also influence the accuracy of the station coordinate determination. One technique for reducing the effect of these errors is to use short-arcs consisting of a few passes of the satellite over the tracking station. This paper analyzes the sensitivity of short-arc station coordinate estimates to various errors in the physical model, to the number of observations, and to the station-satellite geometry using simulated as well as real data.

Schutz, B. E.↗

Sensitivity analysis of short-arc station coordinate determinations from range data

The accurate determination of the geocentric coordinates of a tracking station is essential for most geodetic and geophysical satellite applications. Since most of these satellites are close to the earth, the geopotential model is a dominant source of error which significantly influences station coordinate determinations. Other sources, such as GM error and drag, also influence the accuracy of the station coordinate determination. One technique for reducing the effect of these errors is to use short-arcs consisting of a few passes of the satellite over the tracking station. This paper analyzes the sensitivity of short-arc station coordinate estimates to various errors in the physical model, to the number of observations, and to the station-satellite geometry using simulated as well as real data.

Schutz, B. E.↗

Analysis of Modified SMI Method for Adaptive Array Weight Control

An adaptive array is used to receive a desired signal in the presence of weak interference signals which need to be suppressed. A modified sample matrix inversion (SMI) algorithm controls the array weights. The modification leads to increased interference suppression by subtracting a fraction of the noise power from the diagonal elements of the covariance matrix. The modified algorithm maximizes an intuitive power ratio criterion. The expected values and variances of the array weights, output powers, and power ratios as functions of the fraction and the number of snapshots are found and compared to computer simulation and real experimental array performance. Reduced-rank covariance approximations and errors in the estimated covariance are also described.

Dilsavor, Ronald Louis↗