Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “error indicators”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 325 records · Page 18

Altitude Registration of Limb-Scattered Radiation

One of the largest constraints to the retrieval of accurate ozone profiles from UV backscatter limb sounding sensors is altitude registration. Two methods, the Rayleigh scattering attitude sensing (RSAS) and absolute radiance residual method (ARRM), are able to determine altitude registration to the accuracy necessary for long-term ozone monitoring. The methods compare model calculations of radiances to measured radiances and are independent of onboard tracking devices. RSAS determines absolute altitude errors, but, because the method is susceptible to aerosol interference, it is limited to latitudes and time periods with minimal aerosol contamination. ARRM, a new technique introduced in this paper, can be applied across all seasons and altitudes. However, it is only appropriate for relative altitude error estimates. The application of RSAS to Limb Profiler (LP) measurements from the Ozone Mapping and Profiler Suite (OMPS) on board the Suomi NPP (SNPP) satellite indicates tangent height (TH) errors greater than 1 km with an absolute accuracy of +/-200 m. Results using ARRM indicate a approx. 300 to 400m intra-orbital TH change varying seasonally +/-100 m, likely due to either errors in the spacecraft pointing or in the geopotential height (GPH) data that we use in our analysis. ARRM shows a change of approx. 200m over 5 years with a relative accuracy (a long-term accuracy) of 100m outside the polar regions.

Ozone profiles↗

Evaluating probabilistic deep learning methods for uncertainty quantification of temperature downscaling

Deep learning (DL) has emerged as a promising tool for downscaling coarse-resolution climate data to high-resolution outputs, enabling improved regional climate predictions. A critical aspect of DL-based downscaling is the incorporation of uncertainty quantification (UQ), which enhances the interpretability and reliability of predictions—key factors for climate risk assessment and decision-making. This study develops a DL model to downscale 2 m temperature across the contiguous United States using reanalysis datasets. We systematically evaluate three epistemic UQ methods—deep ensembles (DEns), Monte Carlo dropout (MCD), and Flipout—based on their probabilistic accuracy, downscaling performance, sensitivity to geographical features, and computational efficiency. Results indicate that MCD generally outperforms Flipout and DEns in terms of calibration and downscaling accuracy. However, DEns demonstrate lower calibration errors in coastal regions, indicating its higher confidence within these areas. Flipout, in contrast, is more sensitive to elevation gradients and exhibits higher calibration errors in mountainous regions. Hence, the choice of UQ method for this task depends on the specific requirements of the application. For applications that prioritize overall calibration, downscaling accuracy, and computational efficiency, MCD is a strong candidate. These findings highlight the importance of selecting UQ methods based on application-specific requirements, such as geographical context and computational constraints. By addressing the trade-offs between UQ methods, this study provides actionable insights for improving the reliability, scalability, and utility of DL-based downscaling in climate science.

Environmental sciences↗

Effects of Control Stick Parameters on Human Controller Response

A fixed base laboratory tracking study was conducted to determine the effects of stick displacement and stick force characteristics on human tracking performance. Three different levels of control stick force/displacement characteristics and stick electrical gain were varied to observe their influence on RMS (Root Mean Square) tracking error and RMS control activity (stick output). The results indicated that both RMS tracking error and RMS control activity were influenced by the three different levels of control stick force/displacement characteristics and stick electrical gain. The human neuromotor time constant was affected by the electrical control gain of the stick while the spring stiffness of the stick influenced the time delay characteristics of the human response behavior.

Repperger, D. W.↗

Attitude determination error analysis - General model and specific application

This paper presents a comprehensive approach to filter and dynamics modeling for attitude determination error analysis. The discussion includes models for both batch least-squares and sequential estimators, a specific dynamic model for attitude determination error analysis of a three-axis stabilized spacecraft equipped with strapdown gyros, and the incorporation of general attitude sensor observations. An analyst using this approach to perform an error analysis chooses a subset of the spacecraft parameters to be 'solve-for' parameters, which are to be estimated, and another subset to be 'consider' parameters, which are assumed to have errors but not to be estimated. The result of the error analysis is an indication of overall uncertainties in the 'solve-for' parameters, as well as the contributions of the various error sources to these uncertainties, including those of errors in the a priori 'solve-for' estimates, of measurement noise, of dynamic noise (also known as process noise or plant noise), and of 'consider' parameter uncertainties. The analysis of attitude, star tracker alignment, and gyro bias uncertainties for the Gamma Ray Observatory spacecraft provide a specific example of the use of a general-purpose software package incorporating these models.

Markley, F. Landis↗

Comparison of Procedures for Dual and Triple Closely Spaced Parallel Runways

A human-in-the-loop high fidelity flight simulation experiment was conducted, which investigated and compared breakout procedures for Very Closely Spaced Parallel Approaches (VCSPA) with two and three runways. To understand the feasibility, usability and human factors of two and three runway VCSPA, data were collected and analyzed on the dependent variables of breakout cross track error and pilot workload. Independent variables included number of runways, cause of breakout and location of breakout. Results indicated larger cross track error and higher workload using three runways as compared to 2-runway operations. Significant interaction effects involving breakout cause and breakout location were also observed. Across all conditions, cross track error values showed high levels of breakout trajectory accuracy and pilot workload remained manageable. Results suggest possible avenues of future adaptation for adopting these procedures (e.g., pilot training), while also showing potential promise of the concept.

triple approaches↗

A Wavelet based Suboptimal Kalman Filter for Assimilation of Stratospheric Chemical Tracer Observations

A suboptimal Kalman filter system which evolves error covariances in terms of a truncated set of wavelet coefficients has been developed for the assimilation of chemical tracer observations of CH4. This scheme projects the discretized covariance propagation equations and covariance matrix onto an orthogonal set of compactly supported wavelets. Wavelet representation is localized in both location and scale, which allows for efficient representation of the inherently anisotropic structure of the error covariances. The truncation is carried out in such a way that the resolution of the error covariance is reduced only in the zonal direction, where gradients are smaller. Assimilation experiments which last 24 days, and used different degrees of truncation were carried out. These reduced the covariance size by 90, 97 and 99 % and the computational cost of covariance propagation by 80, 93 and 96 % respectively. The difference in both error covariance and the tracer field between the truncated and full systems over this period were found to be not growing in the first case, and growing relatively slowly in the later two cases. The largest errors in the tracer fields were found to occur in regions of largest zonal gradients in the constituent field. This results indicate that propagation of error covariances for a global two-dimensional data assimilation system are currently feasible. Recommendations for further reduction in computational cost are made with the goal of extending this technique to three-dimensional global assimilation systems.

Tangborn, Andrew↗

The effect of on/off indicator design on state confusion, preference, and response time performance, executive summary

Investigated are five designs of software-based ON/OFF indicators in a hypothetical Space Station Power System monitoring task. The hardware equivalent of the indicators used in the present study is the traditional indicator light that illuminates an ON label or an OFF label. Coding methods used to represent the active state were reverse video, color, frame, check, or reverse video with check. Display background color was also varied. Subjects made judgments concerning the state of indicators that resulted in very low error rates and high percentages of agreement across indicator designs. Response time measures for each of the five indicator designs did not differ significantly, although subjects reported that color was the best communicator. The impact of these results on indicator design is discussed.

Donner, Kimberly A.↗

The Effect of Initial Displacement of the Center Support on the Buckling of a Column Continuous over Three Supports

The test indicate that "an indiscriminate single application of the Southwell method (for analyzing Exp. Observations in problems of elastic stability)--can result in definite and measurable errors" The test also indicate "that the effect of curvature due to bending on the critical load for the compression flange material of a box beam is probably small and can be neglected." We have not found this to be true in our tests. It is believed that the effect of curvature, together with a small amount of fixity at the ribs, tends to force the stiffeners to bow in each bay thus effectively increasing their end fixity and thereby raising their allowable loads.

Lunquist, Eugene E.↗

Strain gage measurement errors in the transient heating of structural components

Significant strain-gage errors may exist in measurements acquired in transient thermal environments if conventional correction methods are applied. Conventional correction theory was modified and a new experimental method was developed to correct indicated strain data for errors created in radiant heating environments ranging from 0.6 C/sec (1 F/sec) to over 56 C/sec (100 F/sec). In some cases the new and conventional methods differed by as much as 30 percent. Experimental and analytical results were compared to demonstrate the new technique. For heating conditions greater than 6 C/sec (10 F/sec), the indicated strain data corrected with the developed technique compared much better to analysis than the same data corrected with the conventional technique.

Richards, W. Lance↗

Monte Carlo analysis of inaccuracies in estimated aircraft parameters caused by unmodeled flight instrumentation errors

An output error estimation algorithm was used to evaluate the effects of both static and dynamic instrumentation errors on the estimation of aircraft stability and control parameters. A Monte Carlo error analysis, using simulated cruise flight data, was performed for a high-performance military aircraft, a large commercial transport, and a small general aviation aircraft. The results indicate that unmodeled instrumentation errors can cause inaccuracies in the estimated parameters which are comparable to their nominal values. However, the corresponding perturbations to the estimated output response trajectories and characteristics equation pole locations appear to be relatively small. Control input errors and dynamic lags were found to be in the most significant of the error sources evaluated.

Hodge, W. F.↗

Assimilating Remote Sensing Observations of Leaf Area Index and Soil Moisture for Wheat Yield Estimates: An Observing System Simulation Experiment

Observing system simulation experiments were used to investigate ensemble Bayesian state updating data assimilation of observations of leaf area index (LAI) and soil moisture (theta) for the purpose of improving single-season wheat yield estimates with the Decision Support System for Agrotechnology Transfer (DSSAT) CropSim-Ceres model. Assimilation was conducted in an energy-limited environment and a water-limited environment. Modeling uncertainty was prescribed to weather inputs, soil parameters and initial conditions, and cultivar parameters and through perturbations to model state transition equations. The ensemble Kalman filter and the sequential importance resampling filter were tested for the ability to attenuate effects of these types of uncertainty on yield estimates. LAI and theta observations were synthesized according to characteristics of existing remote sensing data, and effects of observation error were tested. Results indicate that the potential for assimilation to improve end-of-season yield estimates is low. Limitations are due to a lack of root zone soil moisture information, error in LAI observations, and a lack of correlation between leaf and grain growth.

Nearing, Grey S.↗

What Can We Learn from One Billion Ground System Log Messages?

Shortage of log-based data in a ground system they have traditionally been the under achievers in a satellite ground system. This is due to several factors: Once log messages scroll out of view on the TTC event console window they are soon forgotten. Application and system log files are scattered across directories within a system, across a multitude of servers, and across one or more databases making access cumbersome. Typical tools to perform log file content searching are generally crude and typically only employed as part of trouble-shooting exercises.As we move towards satellite constellations and fleets and add even more status information, the number of messages keeps growing. One mission now estimates that they could generate 3,000,000 messages per day 1 billion per year - for the life of their mission. What to do with those 1 billion messages? That is the challenge. With the recent technological advances in the management of large data sets, text-based processing, and data analytics, there are now capabilities that we can provide to the ground system engineers and satellite operators to address what we postulate are missed opportunities. Advanced real-time log analysis can allow us to be less reactionary in favor of being more proactive. Analytics goals include the ability to: Identify root cause of unexpected events, failures or error conditions enabled by correlating disparate data. Detect security breaches attempts before they are successful. Help admins ensure IT resources continue running optimally. Identify trends and patterns that may indicate impending failures or error conditions for valuable assets before they happen. Compare satellites in a fleet or constellation in terms of number of alarms, number of command sent to them, etc.. Answer questions like "Are the operations support needs increasing over the past year?" or "Have we seen this combination of alarm conditions before?" But really, once the tools are readily available the users will start realizing what can be done with their new powers. In this presentation we will show the results of analyzing millions of actual mission operations log messages, how the results can be displayed to the user, and how new products now available as open source can be applied to the challenges of large scale time-tagged text-based mission operations messages. Flight operations team members believe that this is a powerful new option for how they assess overall system and space asset health. Technical descriptions of the design, tools, and storage will be provided. One billion messages? Bring'em on!

Orsborne, Sharon↗

Effects of flight instrumentation errors on the estimation of aircraft stability and control derivatives

An error analysis program based on an output error estimation method was used to evaluate the effects of sensor and instrumentation errors on the estimation of aircraft stability and control derivatives. A Monte Carlo analysis was performed using simulated flight data for a high performance military aircraft, a large commercial transport, and a small general aviation aircraft for typical cruise flight conditions. The effects of varying the input sequence and combinations of the sensor and instrumentation errors were investigated. The results indicate that both the parameter accuracy and the corresponding measurement trajectory fit error can be significantly affected. Of the error sources considered, instrumentation lags and control measurement errors were found to be most significant.

Bryant, W. H.↗

Toward a systematic improvement of the fixed-node approximation in diffusion Monte Carlo for solids—A case study in diamond

While Diffusion Monte Carlo (DMC) is in principle an exact stochastic method for ab initio electronic structure calculations, in practice, the fermionic sign problem necessitates the use of the fixed-node approximation and trial wavefunctions with approximate nodes (or zeros). This approximation introduces a variational error in the energy that potentially can be tested and systematically improved. Here, we present a computational method that produces trial wavefunctions with systematically improvable nodes for DMC calculations of periodic solids. These trial wavefunctions are efficiently generated with the configuration interaction using a perturbative selection made iteratively (CIPSI) method. A simple protocol in which both exact and approximate results for finite supercells are used to extrapolate to the thermodynamic limit is introduced. This approach is illustrated in the case of the carbon diamond using Slater–Jastrow trial wavefunctions including up to one million Slater determinants. Fixed-node DMC energies obtained with such large expansions are much improved, and the fixed-node error is found to decrease monotonically and smoothly as a function of the number of determinants in the trial wavefunction, a property opening the way to a better control of this error. The cohesive energy extrapolated to the thermodynamic limit is in close agreement with the estimated experimental value. Interestingly, this is also the case at the single-determinant level, thus, indicating a very good error cancellation in carbon diamond between the bulk and atomic total fixed-node energies when using single-determinant nodes.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Towards Realistic and High Fidelity Models for Nuclear Reactor Power Synthesis Simulation with Self-Powered Neutron Detectors

As presented in this report, a weighting function–based inferencing method is being applied to synthesize the power distribution in next-generation and university research reactors based on simulated self power neutron detector (SPND) responses. The overall goal is to assess the impacts of sensor uncertainty and true power distribution perturbations on the error in the synthesized power distribution. Regarding sensor uncertainty, the NuScale Small Modular Reactor (SMR) and the Westinghouse AP1000 serve as testbeds for analyzing the impact of varying the sensor uncertainty, as well as varying the number of sensors per sensor string in the reactor core. The reactor models are informed by Monte Carlo N-Particle (MCNP) neutron flux tallies. For the NuScale SMR and Westinghouse AP1000, the SPND response functions (i.e., the response of the SPNDs to individual segments of fuel) were determined homogeneously. Regarding an analysis of power distribution perturbation detection, the Texas A&M Testing, Research, Isotopes, General Atomics Reactor (TAMU TRIGA) reactor was used as a demonstration case with one particular arrangement of SPNDs; the response functions for this reactor model were determined heterogeneously, making this a uniquely high-fidelity demonstration of perturbation detection. Finally, SPND models generated in the Geometry and Tracking 4 (Geant4) code have been generated and tested for comparison with traditionally implemented analytical SPND models, with the intent for Geant4 integration with the full methodological framework. SPND current outputs as a function of distance from some fuel assembly segment in the NuScale SMR are compared with the analytically determined currents. Results from the sensor uncertainty simulations for the NuScale SMR and AP1000 indicate that the average error in the inferred power distribution on the fuel assembly segment level is reasonably low, being slightly less than the random uncertainty applied to all respective SPNDs in both cores. For example, if all SPNDs in the core have a random uncertainty of 5%, then the corresponding fuel assembly segment level error (i.e. difference between the true and inferred local power) is ~2–3%. However, the maximum error in the inferred power distribution on the fuel assembly segment level can be considerably high (>15%) when SPND random uncertainties start to exceed ~3%. In general, the average and maximum errors in the inferred power distribution were slightly higher in the AP1000 as opposed to the NuScale SMR for the sensor string configurations considered herein. Another result determined from analysis of the sensor uncertainty simulations was that increasing the number of SPNDs per string does not clearly reduce inferred power distribution error and can in fact make the error large in some cases; however, this assessment may skewed due to imposed iteration limits. Results from the perturbation detection demonstration using the high-fidelity TAMU TRIGA model indicate that, given the arrangement of 17 SPND strings and 4 SPNDs per string considered herein, there is a clear, provable ability to infer a localized Gaussian-type peak perturbation in the 3D power distribution. Such a perturbation was detected with an average fuel assembly segment level error of 0.19%, and the general visualization of the detected perturbation clearly indicates that the magnitude and shape were appropriately resolved. Finally, the electrical current output generated by the Geant4 modeled SPND indicates significant magnitude differences than the analytically modeled SPND, demonstrating the need for accurate SPND models which account for finite sensor geometry effects to inform the power synthesis work described herein.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Effects of error, chimera, bias, and GC content on the accuracy of amplicon sequencing

ABSTRACT Targeted amplicon sequencing is widely used in microbial ecology studies. However, sequencing artifacts and amplification biases are of great concern. To identify sources of these artifacts, a systematic analysis was performed using mock communities comprised of 16S rRNA genes from 33 bacterial strains. Our results indicated that while sequencing errors were generally isolated to low-abundance operational taxonomic units, chimeric sequences were a major source of artifacts. Singleton and doubleton sequences were primarily chimeras. Formation of chimeric sequences was significantly correlated with the GC content of the targeted sequences. Low-GC-content mock community members exhibited lower rates of chimeric sequence formation. GC content also had a large impact on sequence recovery. The quantitative capacity was notably limited, with substantial recovery variations and weak correlation between anticipated and observed strain abundances. The mock community strains with higher GC content had higher recovery rates than strains with lower GC content. Amplification bias was also observed due to the differences in primer affinity. A two-step PCR strategy reduced the number of chimeric sequences by half. In addition, comparative analyses based on the mock communities showed that several widely used sequence processing pipelines/methods, including DADA2, Deblur, UCLUST, UNOISE, and UPARSE, had different advantages and disadvantages in artifact removal and rare species detection. These results are important for improving sequencing quality and reliability and developing new algorithms to process targeted amplicon sequences. IMPORTANCE Amplicon sequencing of targeted genes is the predominant approach to estimate the membership and structure of microbial communities. However, accurate reconstruction of community composition is difficult due to sequencing errors, and other methodological biases and effective approaches to overcome these challenges are essential. Using a mock community of 33 phylogenetically diverse strains, this study evaluated the effect of GC content on sequencing results and tested different approaches to improve overall sequencing accuracy while characterizing the pros and cons of popular amplicon sequence data processing approaches. The sequencing results from this study can serve as a benchmarking data set for future algorithmic improvements. Furthermore, the new insights on sequencing error, chimera formation, and GC bias from this study will help enhance the quality of amplicon sequencing studies and support the development of new data analysis approaches.

59 BASIC BIOLOGICAL SCIENCES↗

Estimating Alpine Snow Depth by Combining Multi-Frequency Passive Radiance Observations with Ensemble Snowpack Modeling

This paper presents a physically-based snow depth retrieval algorithm adapted for deep mountainous snowpack and airborne multifrequency (10.7, 18.7, 37.0 and 89.0 GHz) passive microwave (PM) radiance observations from a single flight. The algorithm employs a single forecast-analysis cycle of a traditional sequential assimilation scheme. It uses an ensemble of multi-layer snowpack model runs to resolve snow microstructure and melt-refreeze crusts, andmicrowave radiative transfer models to relate snow properties to microwave measurements.Snow depth was retrieved at a 120 m spatial resolution over three 1 km2 Intensive Study Area (ISA) within the Rabbit Ears Meso-Cell Study Area (MSA) from the NASA Cold Land Processes Experiment (CLPX) in Colorado (United States) for one date in February 2003. When evaluated against in situ observations, root mean square error (RMSE) of the snow depth from the assimilation was 13.3 cm for areas with low (<5 %) forest cover, which was a reduction of 48 % in the RMSE compared with the modeled snow depth when the PM observations were not assimilated; indicating a ~5% relative error of the posterior snow depth with respect to the average snow depth (200 cm) measured at these pixels. For pixels with forest cover ranging from 5-15% and 15-30%, results were improved (R2 increased from 0.65 to 0.71 and from 0 to 0.38, respectively) by introducing a forest radiative transfer model during the assimilation.

Airborne Multifrequency↗