Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Bias”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
NASA NTRS2014

Estimating Sampling Biases and Measurement Uncertainties of AIRS-AMSU-A Temperature and Water Vapor Observations Using MERRA Reanalysis

We use MERRA (Modern Era Retrospective-Analysis for Research Applications) temperature and water vapor data to estimate the sampling biases of climatologies derived from the AIRS/AMSU-A (Atmospheric Infrared Sounder/Advanced Microwave Sounding Unit-A) suite of instruments. We separate the total sampling bias into temporal and instrumental components. The temporal component is caused by the AIRS/AMSU-A orbit and swath that are not able to sample all of time and space. The instrumental component is caused by scenes that prevent successful retrievals. The temporal sampling biases are generally smaller than the instrumental sampling biases except in regions with large diurnal variations, such as the boundary layer, where the temporal sampling biases of temperature can be +/- 2 K and water vapor can be 10% wet. The instrumental sampling biases are the main contributor to the total sampling biases and are mainly caused by clouds. They are up to 2 K cold and greater than 30% dry over mid-latitude storm tracks and tropical deep convective cloudy regions and up to 20% wet over stratus regions. However, other factors such as surface emissivity and temperature can also influence the instrumental sampling bias over deserts where the biases can be up to 1 K cold and 10% wet. Some instrumental sampling biases can vary seasonally and/or diurnally. We also estimate the combined measurement uncertainties of temperature and water vapor from AIRS/AMSU-A and MERRA by comparing similarly sampled climatologies from both data sets. The measurement differences are often larger than the sampling biases and have longitudinal variations.

MERRA↗
DOE OSTI2025

Bias-Variance Trade-Off in Physics-Informed Neural Networks with Randomized Smoothing for High-Dimensional PDEs

Physics-Informed Neural Networks (PINNs) have triggered a paradigm shift in scientific computing, leveraging mesh-free properties and robust approximation capabilities. While proving effective for low-dimensional partial differential equations (PDEs), the computational cost of PINNs remains a hurdle in high-dimensional scenarios. This is particularly pronounced when computing high-order and high-dimensional derivatives in the physics-informed loss. Randomized Smoothing PINN (RS-PINN) introduces Gaussian noise for stochastic smoothing of the original neural net model, enabling the use of Monte Carlo methods for derivative approximation, which eliminates the need for costly automatic differentiation. Despite its computational efficiency, especially in the approximation of high-dimensional derivatives, RS-PINN introduces biases in both loss and gradients, negatively impacting convergence, especially when coupled with stochastic gradient descent (SGD) algorithms. We present a comprehensive analysis of biases in RS-PINN, attributing them to the nonlinearity of the Mean Squared Error (MSE) loss as well as the intrinsic nonlinearity of the PDE itself. We propose tailored bias correction techniques, delineating their application based on the order of PDE nonlinearity. The derivation of an unbiased RS-PINN allows for a detailed examination of its advantages and disadvantages compared to the biased version. Specifically, the biased version has a lower variance and runs faster than the unbiased version, but it is less accurate due to the bias. To optimize the bias-variance trade-off, we combine the two approaches in a hybrid method that balances the rapid convergence of the biased version with the high accuracy of the unbiased version. In addition to methodological contributions, we present an enhanced implementation of RS-PINN. Extensive experiments on diverse high-dimensional PDEs, including Fokker-Planck, Hamilton-Jacobi-Bellman (HJB), viscous Burgers’, Allen-Cahn, and Sine-Gordon equations, illustrate the bias-variance trade-off and highlight the effectiveness of the hybrid RS-PINN. Empirical guidelines are provided for selecting biased, unbiased, or hybrid versions, depending on the dimensionality and nonlinearity of the specific PDE problem.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS2013

Simultaneous Estimation of Model State Variables and Observation and Forecast Biases Using a Two-Stage Hybrid Kalman Filter

In this paper, we present a two-stage hybrid Kalman filter to estimate both observation and forecast bias in hydrologic models, in addition to state variables. The biases are estimated using the discrete Kalman filter, and the state variables using the ensemble Kalman filter. A key issue in this multi-component assimilation scheme is the exact partitioning of the difference between observation and forecasts into state, forecast bias and observation bias updates. Here, the error covariances of the forecast bias and the unbiased states are calculated as constant fractions of the biased state error covariance, and the observation bias error covariance is a function of the observation prediction error covariance. In a series of synthetic experiments, focusing on the assimilation of discharge into a rainfall-runoff model, it is shown that both static and dynamic observation and forecast biases can be successfully estimated. The results indicate a strong improvement in the estimation of the state variables and resulting discharge as opposed to the use of a bias-unaware ensemble Kalman filter. Furthermore, minimal code modification in existing data assimilation software is needed to implement the method. The results suggest that a better performance of data assimilation methods should be possible if both forecast and observation biases are taken into account.

Data Assimilation↗
NASA NTRS2021

Seasonal Bias in Global Ocean Color Observations

In this study we identify a seasonal bias in the ocean color satellite derived remote sensing reflectances (Rrs(λ); sr-1) at the ocean color validation site, MOBY (Marine Optical BuoY). The seasonal bias in Rrs(λ) is present to varying degrees in all ocean color satellites examined, including VIIRS (Visible Infrared Imaging Radiometer Suite), SeaWiFS (Sea-viewing Wide Field-of-view Sensor), and MODIS (Moderate Resolution Imaging Spectrometer). The relative bias in Rrs has spectral dependence. Products derived from Rrs(λ) are affected by the bias to varying degrees, with particulate backscattering varying up to 50% over a year, chlorophyll varying up to 25% over a year, and absorption from phytoplankton or dissolved material varying by up to 15%. The propagation of Rrs(λ) bias into derived products is broadly confirmed on regional and global scales using Argo floats and data from the CALIOP (Cloud-Aerosol Lidar with Orthogonal Polarization) instrument aboard the CALIPSO (Cloud-Aerosol Lidar and Infrared Pathfinder) satellite. The artifactual seasonality in ocean color is prominent in areas of low biomass (i.e., subtropical gyres) and is not easily discerned in areas of high biomass. While we have eliminated several candidates that could cause the biases in Rrs(λ), there are still outstanding questions regarding potential contributions from atmospheric corrections. Specifically, we provide evidence that the aquatic bidirectional reflectance distribution function may in part cause the observed seasonal bias, but this does not preclude an additional effect of the aerosol estimation. Our investigation highlights the contributions that atmospheric correction schemes can make in introducing biases in Rrs (λ) and we recommend more simulations to discern these influence Rrs (λ) biases. Community efforts are needed to find the root cause of the seasonal bias because all past, present, and future data are or will be affected until a solution is implemented.

satellite ocean color↗
NASA NTRSDate not supplied

Bias in Planning Algorithms

Does bias exist in planning algorithms? If so, how does bias manifest, and how important is this bias? Answering this question requires a formal, mathematical definition of bias. We formally define bias as the distance between the probability distributions of solutions returned by various algorithms, and the uniform distribution over solutions. We show in this paper that deterministic algorithms are inherently biased, as they don’t return all solutions, and that this property holds even when algorithms return a set of plans instead of just one plan. Exceptions are problem instances or problem classes for which only a single solution exists. We then discuss changing the definition of bias to compare the probability distributions of properties of sets of plans instead of individual plans. We show the property bias is smaller than the bias of actual plans. Finally, we show that entropy is a proxy for the more complex and more expensive distance measurement between pairs of probability distributions. We then describe a roadmap for future investigations of bias in planning.

Planning Scheduling Algorithms↗
NASA NTRS2024

Quantifying Volumetric Scattering Bias in ICESat-2 and Operation IceBridge Altimetry Over Greenland Firn and Aged Snow

The Ice, Cloud, and Land Elevation Satellite-2 (ICESat-2) mission has collected surface elevation measurements for over 5 years. ICESat-2 carries an instrument that emits laser light at 532 nm, and ice and snow absorb weakly at this wavelength. Previous modeling studies found that melting snow could induce significant bias to altimetry signals, but there is no formal assessment on ICESat-2 acquisitions during the melting season. We performed two case studies over the Greenland Ice Sheet to quantify bias in ICESat-2 signals over snow: one to validate Airborne Topographic Mapper (ATM) data against Next Generation Airborne Visible/Infrared Imaging Spectrometer (AVIRIS-NG) grain sizes, and a second to estimate ICESat-2 bias relative to ATM. We used snow optical grain sizes derived from ATM and AVIRIS-NG to attribute altimetry bias to snowpack properties. For the first case study, the mean and standard deviation of optical grain sizes were 340 ± 65 µm (AVIRIS-NG) and 670 ± 420 µm (ATM). A mean altimetry bias of 4.81 ± 1.76 cm was found for ATM, with larger biases linked to increases in grain size. In the second case study, we found a mean grain size of 910 ± 381 µm and biases of 6.42 ± 1.77 cm (ICESat-2) and 9.82 ± 0.97 cm (ATM). The grain sizes and densities needed to recreate biases with a model are uncommon in nature, so we propose that additional surface attributes must be considered to characterize ICESat-2 bias over snow. The altimetry biases are within the accuracy requirements of the ICESat-2 mission, but we cannot rule out more significant errors over coarse-grained snow.

Zachary Fair↗
DOE OSTI2025

Reduction of Pacific Double‐ITCZ Bias by Convection Parameterization in NCAR CESM2.2

Abstract The impact of convective closure on the double‐ITCZ bias in the NCAR CESM2.2 is investigated in this study. The standard CESM2.2 simulates a remarkable double‐ITCZ bias in the central and eastern Pacific, especially in boreal winter and spring. Modifications to the closure in convection parameterization scheme greatly reduce the double‐ITCZ bias in all seasons, demonstrating that convection parameterization can substantially influence the double‐ITCZ bias in CESM2.2. Further analyses suggest that convection parameterization can modulate the tropical atmosphere‐ocean feedback processes, through which it influences the SST in the southern ITCZ region and hence the double‐ITCZ bias. The changes in the upper ocean temperature advection induced by modified convective closure plays important roles in reducing the warm SST bias and double‐ITCZ precipitation bias in the southern ITCZ region. The modified convective closure improves the low‐level cloud and shortwave cloud radiative forcing in the southeastern Pacific. However, surface heat flux plays only a limited role in reducing warm SST bias and double ITCZ bias because the impacts of shortwave radiation changes are largely canceled by changes in longwave radiation and latent heat flux.

Song, Xiaoliang [Scripps Institution of Oceanograp↗
NASA NTRS2012

Cognitive Bias in the Verification and Validation of Space Flight Systems

Cognitive bias is generally recognized as playing a significant role in virtually all domains of human decision making. Insight into this role is informally built into many of the system engineering practices employed in the aerospace industry. The review process, for example, typically has features that help to counteract the effect of bias. This paper presents a discussion of how commonly recognized biases may affect the verification and validation process. Verifying and validating a system is arguably more challenging than development, both technically and cognitively. Whereas there may be a relatively limited number of options available for the design of a particular aspect of a system, there is a virtually unlimited number of potential verification scenarios that may be explored. The probability of any particular scenario occurring in operations is typically very difficult to estimate, which increases reliance on judgment that may be affected by bias. Implementing a verification activity often presents technical challenges that, if they can be overcome at all, often result in a departure from actual flight conditions (e.g., 1-g testing, simulation, time compression, artificial fault injection) that may raise additional questions about the meaningfulness of the results, and create opportunities for the introduction of additional biases. In addition to mitigating the biases it can introduce directly, the verification and validation process must also overcome the cumulative effect of biases introduced during all previous stages of development. A variety of cognitive biases will be described, with research results for illustration. A handful of case studies will be presented that show how cognitive bias may have affected the verification and validation process on recent JPL flight projects, identify areas of strength and weakness, and identify potential changes or additions to commonly used techniques that could provide a more robust verification and validation of future systems.

Larson, Steve↗
NASA NTRSDate not supplied

Cold-Point Tropopause Temperature Bias in Reanalyses Modulated By Equatorial Waves

In this reanalysis inter-comparison study, we compare the modeled Cold-point tropopause temperature (CPT from model level data) near the equator to that of multi-mission GNSS-RO within a preliminary time period of 2007-2011. The known reanalysis CPT temperature warm bias is studied relative to the phase of equatorial waves filtered from GNSS-RO at tropopause level. This uncovers a common denominator in the CPT temperature bias behavior in all reanalyses: - When equatorial waves are present, within their cold phase the reanalysis bias is increased by over 1K, i.e. >1K on top of the reanalysis average warm bias. - Within an equatorial wave’s warm phase, the opposite is observed, with the reanalysis CPT temperature bias even being reversed at higher equatorial wave amplitudes, i.e. the modeled CPT becoming too cold in these cases. - With no equatorial wave anomalies present, the reanalysis bias remains at the average reported in previous inter-comparisons that looked at zonal-mean CPT biases. Inertia-Gravity and Mixed Rossby-Gravity waves show this behavior most clearly, Kelvin waves show a similar modulation but with half of the magnitude, and equatorial Rossby wave modulation of CPT reanalysis bias is still apparent but with further decreased magnitude. This hints on a time-space scale-dependence, with medium-smaller-scale and faster equatorial waves influencing CPT reanalysis bias the most. For comparison, the large-scale and slow-moving MJO does not show any of the effects described above. Current work focuses on the data assimilation response of the reanalysis systems, again relative to the equatorial wave’s phases.

Tropopause↗
NASA NTRS1999

An Analysis of Gravity-Field Estimation Based on Intersatellite Dual-1-Way Biased Ranging

The GRACE (Gravity Recovery And Climate Experiment) mission is designed to make global, highly accurate measurements of the Earth's gravity field with high spatial resolution. Ancillary GPS occultation measurements are also to be carried out for atmospheric monitoring. In the dual-1-way biased ranging of this mission, the range between two satellites separated by 100 to 200 km in nearly polar, coplanar, circular orbits, is measured to very high precision, to within an additive constant, through the exchange of K- and Ka-band sinusoidal signals. Such biased ranging data, along with GPS L-band range and phase data, can be processed and fit over successive multiday intervals to obtain accurate estimates of the Earth's gravity field. This report approximately models and analyzes this process, from the generation of the RF signals at the two satellites through the extraction of the geopotential. The steps include generation of the transmitted signals, processing the received signals to extract high-rate baseband phase, carrying out a dual-1-way combination of baseband phase to extract high-rate biased range for each band, combining K- and Ka-band ranges to correct for the ionosphere effect, and processing the resulting high-rate biased range values to extract three types of reduced-rate observables: biased range, range rate and range acceleration. The version of dual-1-way biased ranging developed by this report improves upon previous versions in a number of ways: highly accurate satellite-timetag corrections derived from concurrent GPS data, better baseband phase extraction using highly digital processing, highly accurate USO-rate calibration derived from concurrent GPS data, an improved method for extracting high-rate biased range from baseband phase, improved filtering for extracting reduced- rate observables from high-rate biased range, and parallel extraction of three observable types.

SINUSOIDAL SIGNALS↗
NASA NTRS1990

Bias and design in software specifications

Implementation bias in a specification is an arbitrary constraint in the solution space. Presented here is a model of bias in software specifications. Bias is defined in terms of the specification process and a classification of the attributes of the software product. Our definition of bias provides insight into both the origin and the consequences of bias. It also shows that bias is relative and essentially unavoidable. Finally, we describe current work on defining a measure of bias, formalizing our model, and relating bias to software defects.

Straub, Pablo A.↗
NASA NTRS2012

Adaptive Control in the Presence of Simultaneous Sensor Bias and Actuator Failures

The problem of simultaneously accommodating unknown sensor biases and unknown actuator failures in uncertain systems is considered in a direct model reference adaptive control (MRAC) setting for state tracking using state feedback. Sensor biases and actuator faults may be present at the outset or may occur at unknown instants of time during operation. A modified MRAC law is proposed, which combines sensor bias estimation with control gain adaptation for accommodation of sensor biases and actuator failures. This control law is shown to provide signal boundedness in the resulting system. For the case when an external asymptotically stable sensor bias estimator is available, an MRAC law is developed to accomplish asymptotic state tracking and signal boundedness. For a special case wherein biases are only present in the rate measurements and bias-free position measurements are available, an MRAC law is developed using a model-independent bias estimator, and is shown to provide asymptotic state tracking with signal boundedness.

Joshi, Suresh M.↗
NASA NTRS2018

A Realization of Bias Correction Method in the GMAO Coupled System

Over the past several decades, a tremendous effort has been made to improve model performance in the simulation of the climate system. The cold or warm sea surface temperature (SST) bias in the tropics is still a problem common to most coupled ocean atmosphere general circulation models (CGCMs). The precipitation biases in CGCMs are also accompanied by SST and surface wind biases. The deficiencies and biases over the equatorial oceans through their influence on the Walker circulation likely contribute the precipitation biases over land surfaces. In this study, we introduce an approach in the CGCM modeling to correct model biases. This approach utilizes the history of the model's short-term forecasting errors and their seasonal dependence to modify model's tendency term and to minimize its climate drift. The study shows that such an approach removes most of model climate biases. A number of other aspects of the model simulation (e.g. extratropical transient activities) are also improved considerably due to the imposed pre-processed initial 3-hour model drift corrections. Because many regional biases in the GEOS-5 CGCM are common amongst other current models, our approaches and findings are applicable to these other models as well.

Chang, Yehui↗
NASA NTRS2018

CALIPSO IIR Version 2 Level 1b Calibrated Radiances: Analysis and Reduction of Residual Biases in the Northern Hemisphere

Version 2 of the Level 1b calibrated radiances of the Imaging Infrared Radiometer (IIR) on board the Cloud-Aerosol Lidar and Infrared Satellite Observation (CALIPSO) satellite has been released recently. This new version incorporates corrections of small but systematic seasonal calibration biases previously revealed in Version 1 data products mostly north of 30° N. These biases – of different amplitudes in the three IIR channels 8.65 µm (IIR1), 10.6 µm (IIR2), and 12.05 µm (IIR3) – were made apparent by a striping effect in images of IIR inter-channel brightness temperature differences (BTDs) and through seasonal warm biases of nighttime IIR brightness temperatures in the 30–60° N latitude range. The latter were highlighted through observed and simulated comparisons with similar channels of the Moderate Resolution Imaging Spectroradiometer (MODIS) on board the Aqua spacecraft. To characterize the calibration biases affecting Version 1 data, a semi-empirical approach is developed, which is based on the in-depth analysis of the IIR internal calibration procedure in conjunction with observations such as statistical comparisons with similar MODIS/Aqua channels. Two types of calibration biases are revealed: an equalization bias affecting part of the individual IIR images and a global bias affecting the radiometric level of each image. These biases are observed only when the temperature of the instrument increases, and they are found to be functions of elapsed time since night-to-day transition, regardless of the season. Correction coefficients of Version 1 radiances could thus be defined and implemented in the Version 2 code. As a result, the striping effect seen in Version 1 is significantly attenuated in Version 2. Systematic discrepancies between nighttime and daytime IIR–MODIS BTDs in the 30–60° N latitude range in summer are reduced from 0.2 K in Version 1 to 0.1 K in Version 2 for IIR1–MODIS29. For IIR2–MODIS31 and IIR3–MODIS32, they are reduced from 0.4 K to close to zero, except for IIR3–MODIS32 in June, where the night-minus-day difference is around −0.1 K.

Garnier, Anne↗
NASA NTRS2020

Attribution of Chemistry-Climate Model Initiative (CCMI) Ozone Radiative Flux Bias from Satellites

The top-of-atmosphere (TOA) outgoing longwave flux over the 9.6-μm ozone band is a fundamental quantity for understanding chemistry-climate coupling. However, observed TOA fluxes are hard to estimate as they exhibit considerable variability in space and time that depend on the distributions of clouds, ozone (O3), water vapor (H2O), air temperature (Ta), and surface temperature (Ts). Benchmarking present day fluxes and quantifying the relative influence of their drivers is the first step for estimating climate feedbacks from ozone radiative forcing and predicting radiative forcing evolution. To that end, we constructed observational instantaneous radiative kernels (IRKs) under clear-sky conditions, representing the sensitivities of the TOA flux in the 9.6-μm ozone band to the vertical distribution of geophysical variables, including O3, H2O, Ta, and Ts based upon the Aura Tropospheric Emission Spectrometer (TES) measurements. Applying these kernels to present-day simulations from the Chemistry-Climate Model Initiative (CCMI) project as compared to a 2006 reanalysis assimilating satellite observations, we show that the models have large differences in TOA flux, attributable to different geophysical variables. In particular, model simulations continue to diverge from observations in the tropics, as reported in previous studies of the Atmospheric Chemistry Climate Model Inter-comparison Project (ACCMIP) simulations. The principal culprits are tropical mid and upper tropospheric ozone followed by tropical lower tropospheric H2O. Five models out of the eight studied here have TOA flux biases exceeding 100 mWm-2 attributable to tropospheric ozone bias. Another set of five models have flux biases over 50 mWm-2 due to H2O. On the other hand, Ta radiative bias is negligible in all models (no more than 30 mWm-2). We found that AM3 and CMAM have the lowest TOA flux biases globally but are a result of cancellation of opposite biases due to difference processes. Overall, the multi-model ensemble mean bias is –133±98 mWm-2, indicating that they are too atmospherically opaque due to trapping too much radiation in the atmosphere by overestimated tropical tropospheric O3 and H2O. Having too much O3 and H2O in the troposphere would have different impacts on the sensitivity of TOA flux to O3 and these competing effects add more uncertainties on the ozone radiative forcing. We find that the inter-model TOA outgoing longwave radiation (OLR) difference is well anti-correlated with their ozone band flux bias. This suggests that there is significant radiative compensation in the calculation of model outgoing longwave radiation.

Aura Tropospheric Emission Spectrometer (TES) meas↗
DOE OSTI2025

Machine learning-assisted identification of potential sources of bias in measurements of prompt-fission neutron spectra

Unrecognized sources of uncertainty (USU) can bias the reported mean and/or covariance of experimental nuclear data. These biases, in turn, can propagate through evaluated nuclear data to application simulations or may poorly inform nuclear theory that is fitted to the experimental data. Such unknown sources of bias must be tied to the inherent physical constituents of the measurements such as the characteristics of a detector response or a background reduction technique. Here, in this article, a sparse Bayesian learning model is used to support experts in their efforts to identify and characterize USU in experimental prompt fission neutron spectra (PFNS) for spontaneous fissioning of 252 Cf by linking observed biases to features of the measurement system. Three different bias components were found. The first acts as a verification case for the algorithm as it identifies a bias coming from a well-known source related to the use of 6 Li in the neutron detection system. The second two cases demonstrate how this method can benefit the evaluation of experimental nuclear data by identifying, quantifying, and relating unknown biases to potential causes.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2025

Evaluating algorithmic bias on biomarker classification of breast cancer pathology reports

Objectives: This work evaluated algorithmic bias in biomarkers classification using electronic pathology reports from female breast cancer cases. Bias was assessed across 5 subgroups: cancer registry, race, Hispanic ethnicity, age at diagnosis, and socioeconomic status. Materials and Methods: We utilized 594 875 electronic pathology reports from 178 121 tumors diagnosed in Kentucky, Louisiana, New Jersey, New Mexico, Seattle, and Utah to train 2 deep-learning algorithms to classify breast cancer patients using their biomarkers test results. We used balanced error rate (BER), demographic parity (DP), equalized odds (EOD), and equal opportunity (EOP) to assess bias. Results: We found differences in predictive accuracy between registries, with the highest accuracy in the registry that contributed the most data (Seattle Registry, BER ratios for all registries >1.25). BER showed no significant algorithmic bias in extracting biomarkers (estrogen receptor, progesterone receptor, human epidermal growth factor receptor 2) for race, Hispanic ethnicity, age at diagnosis, or socioeconomic subgroups (BER ratio <1.25). DP, EOD, and EOP all showed insignificant results. Discussion: We observed significant differences in BER by registry, but no significant bias using the DP, EOD, and EOP metrics for socio-demographic or racial categories. This highlights the importance of employing a diverse set of metrics for a comprehensive evaluation of model fairness. Conclusion: A thorough evaluation of algorithmic biases that may affect equality in clinical care is a critical step before deploying algorithms in the real world. We found little evidence of algorithmic bias in our biomarker classification tool. Artificial intelligence tools to expedite information extraction from clinical records could accelerate clinical trial matching and improve care.

60 APPLIED LIFE SCIENCES↗
NASA NTRS2012

Cognitive Bias in Systems Verification

Working definition of cognitive bias: Patterns by which information is sought and interpreted that can lead to systematic errors in decisions. Cognitive bias is used in diverse fields: Economics, Politics, Intelligence, Marketing, to name a few. Attempts to ground cognitive science in physical characteristics of the cognitive apparatus exceed our knowledge. Studies based on correlations; strict cause and effect is difficult to pinpoint. Effects cited in the paper and discussed here have been replicated many times over, and appear sound. Many biases have been described, but it is still unclear whether they are all distinct. There may only be a handful of fundamental biases, which manifest in various ways. Bias can effect system verification in many ways . Overconfidence -> Questionable decisions to deploy. Availability -> Inability to conceive critical tests. Representativeness -> Overinterpretation of results. Positive Test Strategies -> Confirmation bias. Debiasing at individual level very difficult. The potential effect of bias on the verification process can be managed, but not eliminated. Worth considering at key points in the process.

Cognitive bias↗