Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Error Mitigation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 541 records · Page 30

Fast Sensitivity-Based Optimal Trajectory Updates for Descent Operations Subject to Time Constraints

The ability to meet a controlled time of arrival during a continuous descent operation will enable environmentally friendly and fuel efficient descent operations while simultaneously maintaining airport throughput. Previous work showed that guidance strategies based on a frequent recalculation of the optimal trajectory during the descent result in excellent environmental impact mitigation figures while meeting operational constraints in the presence of modelling errors. However, the time lag of recalculating the trajectory using traditional optimisation algorithms could lead to performance degradation and stability issues. This paper proposes an alternative strategy, which allows for fast updates of the optimal trajectory based on parametric sensitivities. Promising results show that the performance of this method is comparable to that of instantaneously recalculating the optimal descent trajectory at each time sample.

Dalmau, Ramon↗

Uncertainty in Servicing and Assembly Tasks for Space Robotic Manipulators

This presentation will discuss a subset of the sources of uncertainty that impact autonomous in-space servicing, assembly, and manufacturing missions. These include robotic manipulator modeling uncertainties in both kinematics and dynamics, perception error associated machine learning models for pose estimation, and sensor noise. Mitigation strategies will be discussed including the incorporation of capture envelopes in the design of robotic tools and selection of robot goal poses to minimize end-effector sensitivity in manipulators with redundant degrees of freedom.

robotics↗

Understanding Effective Diameter and Its Application to Terrestrial Radiation in Ice Clouds

The cloud property known as "effective diameter" or "effective radius", which in essence is the cloud particle size distribution (PSD) volume at bulk density divided by its projected area, is used extensively in atmospheric radiation transfer, climate modeling and remote sensing. This derives from the assumption that PSD optical properties can be uniquely described in terms of their effective diameter, D(sub e), and their cloud water content (CWC), henceforth referred to as the D(sub e)-CWC assumption. This study challenges this assumption, showing that while the D(sub e)-CWC assumption appears generally valid for liquid water clouds, it appears less valid for ice clouds in regions where (1) absorption is not primarily a function of either the PSD ice water content (IWC) or the PSD projected area, and (2) where wave resonance (i.e. photon tunneling) contributes significantly to absorption. These two regions often strongly coincide at terrestrial wavelengths when De less than ~60 m, which is where this D(sub e)-CWC assumption appears poorest. Treating optical properties solely in terms of D(sub e) and IWC may lead to errors up to 24%, 26% and 20% for terrestrial radiation in the window region regarding the absorption and extinction coefficients and the single scattering albedo, respectively. Outside the window region, errors may reach 33% and 42% regarding absorption and extinction. The magnitude and sign of these errors can change rapidly with wavelength, which may produce significant errors in climate modeling, remote sensing and other applications concerned with the wavelength dependence of radiation. Where the D(sub e)-CWC assumption breaks down, ice cloud optical properties appear to depend on D(sub e), IWC and the PSD shape. Optical property parameterizations in climate models and remote sensing algorithms based on historical PSD measurements may exhibit errors due to previously unknown PSD errors (i.e. the presence of ice artifacts due to the shattering of larger ice particles on the probe inlet tube during sampling). More recently developed cloud probes are designed to mitigate this shattering problem. Using realistic PSD shapes for a given temperature (and/or IWC) and cloud type may minimize errors associated with PSD shape in ice optics parameterizations and remote sensing algorithms. While this topic was investigated using two ice optics schemes (the Yang et al., 2005 database and the modified anomalous diffraction approximation, or MADA), a physical understanding of the limitations of the D(sub e)-IWC assumption was made possible by using MADA. MADA allows one to approximate the contribution of photon tunneling to absorption relative to other optical processes, which reveals that part of the error regarding the D(sub e)-IWC assumption can be associated with tunneling. By relating the remaining error to the radiation penetration depth in bulk ice (DELTA L) due to absorption, the domain where the D(sub e)-IWC assumption is weakest was described in terms of D(sub e) and DELTA L.

Mitchell, D. L.↗

Error field impact on mode locking and divertor heat flux in NSTX-U

During the 2016 NSTX-U experimental campaign, locked modes in the plasma edge presented clear evidence of the presence of error fields. Extensive metrology and plasma response modeling with IPEC and M3D-C1 have been conducted to understand the various sources of error fields in NSTX-U as built in 2016, and to determine which of these sources have the greatest effect on the plasma. In particular, modeling finds that the error field from misalignment of the toroidal field (TF) coils may have a significant effect on the plasma. The response to the TF error field is shown to depend on the presence of a q = 1 surface, in qualitative agreement with experimental observations. It is found that certain characteristics of the TF error field present new challenges for error field correction. Specifically, the error field spectrum differs significantly from that of coils on the low-field side (such as the NSTX-U error field correction coils), and does not resonate strongly with the dominant kink mode, thus potentially requiring a multi-mode correction. Moreover, to mitigate heat fluxes using poloidal flux expansion, the pitch angle at the divertor plates must be small (~1°). It is shown that uncorrected error fields may result in potentially significant local perturbation to the pitch angle. Estimates for coil alignment tolerances in NSTX-U are derived based on consideration of both heat flux and core resonant fields independently.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Soil Moisture Active Passive (SMAP) Project Algorithm Theoretical Basis Document SMAP L1B Radiometer Data Product: L1B_TB

The purpose of the Soil Moisture Active Passive (SMAP) radiometer calibration algorithm is to convert Level 0 (L0) radiometer digital counts data into calibrated estimates of brightness temperatures referenced to the Earth's surface within the main beam. The algorithm theory in most respects is similar to what has been developed and implemented for decades for other satellite radiometers; however, SMAP includes two key features heretofore absent from most satellite borne radiometers: radio frequency interference (RFI) detection and mitigation, and measurement of the third and fourth Stokes parameters using digital correlation. The purpose of this document is to describe the SMAP radiometer and forward model, explain the SMAP calibration algorithm, including approximations, errors, and biases, provide all necessary equations for implementing the calibration algorithm and detail the RFI detection and mitigation process. Section 2 provides a summary of algorithm objectives and driving requirements. Section 3 is a description of the instrument and Section 4 covers the forward models, upon which the algorithm is based. Section 5 gives the retrieval algorithm and theory. Section 6 describes the orbit simulator, which implements the forward model and is the key for deriving antenna pattern correction coefficients and testing the overall algorithm.

microwave radiometers↗

Defining the Relationship Between Human Error Classes and Technology Intervention Strategies

The modus operandi in addressing human error in aviation systems is predominantly that of technological interventions or fixes. Such interventions exhibit considerable variability both in terms of sophistication and application. Some technological interventions address human error directly while others do so only indirectly. Some attempt to eliminate the occurrence of errors altogether whereas others look to reduce the negative consequences of these errors. In any case, technological interventions add to the complexity of the systems and may interact with other system components in unforeseeable ways and often create opportunities for novel human errors. Consequently, there is a need to develop standards for evaluating the potential safety benefit of each of these intervention products so that resources can be effectively invested to produce the biggest benefit to flight safety as well as to mitigate any adverse ramifications. The purpose of this project was to help define the relationship between human error and technological interventions, with the ultimate goal of developing a set of standards for evaluating or measuring the potential benefits of new human error fixes.

Wiegmann, Douglas A.↗

The Effects of Charge Transfer Inefficiency (CTI) on Galaxy Shape Measurements

(Abridged) We examine the effects of charge transfer inefficiency (CTI) during CCD readout on galaxy shape measurements required by studies of weak gravitational lensing. We simulate a CCD readout with CTI such as that caused by charged particle radiation damage. We verify our simulations on data from laboratory-irradiated CCDs. Only charge traps with time constants of the same order as the time between row transfers during readout affect galaxy shape measurements. We characterize the effects of CTI on various galaxy populations. We baseline our study around p-channel CCDs that have been shown to have charge transfer efficiency up to an order of magnitude better than several models of n-channel CCDs designed for space applications. We predict that for galaxies furthest from the readout registers, bias in the measurement of galaxy shapes, Delta(e), will increase at a rate of 2.65 +/- 0.02 x 10^(-4) per year at L2 for accumulated radiation exposure averaged over the solar cycle. If uncorrected, this will consume the entire shape measurement error budget of a dark energy mission within about 4 years. Software mitigation techniques demonstrated elsewhere can reduce this by a factor of ~10, bringing the effect well below mission requirements. CCDs with higher CTI than the ones we studeied may not meet the requirements of future dark energy missions. We discuss ways in which hardware could be designed to further minimize the impact of CTI.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

THE PRECISION AND ACCURACY OF EARLY EPOCH OF REIONIZATION FOREGROUND MODELS: COMPARING MWA AND PAPER 32-ANTENNA SOURCE CATALOGS

As observations of the Epoch of Reionization (EoR) in redshifted 21 cm emission begin, we assess the accuracy of the early catalog results from the Precision Array for Probing the Epoch of Reionization (PAPER) and the Murchison Wide-field Array (MWA). The MWA EoR approach derives much of its sensitivity from subtracting foregrounds to <1% precision, while the PAPER approach relies on the stability and symmetry of the primary beam. Both require an accurate flux calibration to set the amplitude of the measured power spectrum. The two instruments are very similar in resolution, sensitivity, sky coverage, and spectral range and have produced catalogs from nearly contemporaneous data. We use a Bayesian Markov Chain Monte Carlo fitting method to estimate that the two instruments are on the same flux scale to within 20% and find that the images are mostly in good agreement. We then investigate the source of the errors by comparing two overlapping MWA facets where we find that the differences are primarily related to an inaccurate model of the primary beam but also correlated errors in bright sources due to CLEAN. We conclude with suggestions for mitigating and better characterizing these effects.

79 ASTRONOMY AND ASTROPHYSICS↗

Postprocessing techniques for gradient percolation predictions on the square lattice

In this work, we revisit the classic problem of site percolation on a regular square lattice. In particular, we investigate the effect of quantization bias errors on percolation threshold predictions for large probability gradients and propose a mitigation strategy. We demonstrate through extensive computational experiments that the assumption of a linear relationship between probability gradient and percolation threshold used in previous investigations is invalid. Moreover, we demonstrate that, due to skewness in the distribution of occupation probabilities visited the average does not converge monotonically to the true percolation threshold. Furthermore, we identify several alternative metrics which do exhibit monotonic (albeit not linear) convergence and document their observed convergence rates.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Vulnerabilities in Artificial Intelligence and Machine Learning Applications and Data

Artificial intelligence (AI) applications driven by machine learning (ML) are transformational technologies within the international nuclear security regime. Advancements realized by AI—faster and improved data insights, more efficient and automated processes, reductions in human error—enable nuclear security applications such as behavior analysis for insider threat mitigation, source tracking of stolen nuclear material, and facial recognition software for physical protection. In addition to the advantages, however, there are also inherent vulnerabilities and threats associated with its use and risk mitigations must be built into any AI/ML-enabled systems. This work provides a background on AI and ML and different data types used in the field, including open-source intelligence information (OSINT) that is discoverable by AI tools and application data that are used by AI tools for decision-making and automation. Current and potential AI applications and vulnerabilities related to their use within the nuclear security regime are also discussed.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

Quench process modeling & simulation in the heat-treatment of critical aerospace components

To manufacture light-weight, advanced metal alloy components for gas turbine engines, quench heat-treatment processes are typically used. By quenching the component from elevated temperatures, the alloy sometimes undergoes a solid-state phase transformation which produces special microstructures with the required, enhanced mechanical properties. However, the quenching can also lead to cracks forming in the component. Addressing the quench cracking problems adds a significant burden to the cost, schedule, and energy demand of manufacture. Currently, optimizing the quench process to mitigate or avoid the cracking is performed largely by trial-and-error, relying heavily on costly experimental (thermocouple)trials to understand the local thermal gradients which cause the cracks to form. In this first part (Phase 1) of the work, high-performance computing is employed to establish the ability of modern CFD (computational fluid dynamics) to alleviate or wholly replace the experimental quenching trials by virtual testing. A Baseline CFD model is defined and its accuracy established to be comparable to(and which usually exceeds) the accuracy of existing HTC (heat-transfer coefficient) based simulation methods of quenching. As a first-principles based approach, “calibration” of the Baseline CFD model is independent of the quench process itself, but instead relies on the accuracy of the underlying (modeled),generic two-phase fluid processes which cannot be currently resolved by CFD for large, industrial-scale cases. A novel, high-fidelity DNS capability has been developed and verified to examine and further improve upon the mean-field closure submodels on which the Baseline CFD approach is based.1

99 GENERAL AND MISCELLANEOUS↗

Quench process modeling & simulation in the heat-treatment of critical aerospace components

To manufacture light-weight, advanced metal alloy components for gas turbine engines, quench heat-treatment processes are typically used. By quenching the component from elevated tempera-tures, the alloy sometimes undergoes a solid-state phase transformation which produces special microstructures with the required, enhanced mechanical properties. However, the quenching can also lead to cracks forming in the component. Addressing the quench cracking problems adds a significant burden to the cost, schedule, and energy demand of manufacture. Currently, optimizing the quench process to mitigate or avoid the cracking is performed largely by trial-and-error, relying heavily on costly experimental (thermocouple) trials to understand the local thermal gradients which cause the cracks to form. In this first part (Phase 1) of the work, high-performance computing is employed to establish the ability of modern CFD (computational fluid dynamics) to alleviate or wholly replace the experimental quenching trials by virtual testing. A baseline CFD model is defined and its accuracy established to be comparable to (and which usually exceeds) the accuracy of existing HTC (heat-transfer correlation) based simulation methods of quenching. As a first-principles based approach, “calibration” of the Baseline CFD model is independent of the quench process itself, but instead relies on the accuracy of the underlying (modeled), generic two-phase fluid processes which cannot be currently resolved by CFD for large, industrial-scale cases. A novel, high-fidelity DNS capability has been developed and verified to examine and further improve upon the mean-field closure submodels on which the Baseline CFD approach is based.

36 MATERIALS SCIENCE↗

The Fifth International Workshop on Ice Nucleation phase 2 (FIN-02): laboratory intercomparison of ice nucleation measurements

Abstract. The second phase of the Fifth International Ice Nucleation Workshop (FIN-02)involved the gathering of a large number of researchers at the KarlsruheInstitute of Technology's Aerosol Interactions and Dynamics of the Atmosphere(AIDA) facility to promote characterization and understanding of icenucleation measurements made by a variety of methods used worldwide.Compared to the previous workshop in 2007, participation was doubled,reflecting a vibrant research area. Experimental methods involved sampling ofaerosol particles by direct processing ice nucleation measuring systems fromthe same volume of air in separate experiments using different ice nucleatingparticle (INP) types, and collections of aerosol particle samples ontofilters or into liquid for sharing amongst measurement techniques thatpost-process these samples. In this manner, any errors introduced bydifferences in generation methods when samples are shared across laboratorieswere mitigated. Furthermore, as much as possible, aerosol particle sizedistribution was controlled so that the size limitations of different methodswere minimized. The results presented here use data from the workshop toassess the comparability of immersion freezing measurement methods activatingINPs in bulk suspensions, methods that activate INPs in condensation and/orimmersion freezing modes as single particles on a substrate, continuous flowdiffusion chambers (CFDCs) directly sampling and processing particles wellabove water saturation to maximize immersion and subsequent freezing ofaerosol particles, and expansion cloud chamber simulations in which liquidcloud droplets were first activated on aerosol particles prior to freezing.The AIDA expansion chamber measurements are expected to be the closestrepresentation to INP activation in atmospheric cloud parcels in thesecomparisons, due to exposing particles freely to adiabatic cooling. The different particle types used as INPs included the minerals illite NX andpotassium feldspar (K-feldspar), two natural soil dusts representative of arable sandy loam(Argentina) and highly erodible sandy dryland (Tunisia) soils, respectively,and a bacterial INP (Snomax ® ). Consideredtogether, the agreement among post-processed immersion freezing measurementsof the numbers and fractions of particles active at different temperaturesfollowing bulk collection of particles into liquid was excellent, withpossible temperature uncertainties inferred to be a key factor in determiningINP uncertainties. Collection onto filters for rinsing versus directly intoliquid in impingers made little difference. For methods that activatedcollected single particles on a substrate at a controlled humidity at orabove water saturation, agreement with immersion freezing methods was good inmost cases, but was biased low in a few others for reasons that have not beenresolved, but could relate to water vapor competition effects. AmongstCFDC-style instruments, various factors requiring (variable) highersupersaturations to achieve equivalent immersion freezing activation dominatethe uncertainty between these measurements, and for comparison with bulkimmersion freezing methods. When operated above water saturation to includeassessment of immersion freezing, CFDC measurements often measured at orabove the upper bound of immersion freezing device measurements, but oftenunderestimated INP concentration in comparison to an immersion freezingmethod that first activates all particles into liquid droplets prior tocooling (the PIMCA-PINC device, or Portable Immersion Mode Cooling chAmber–Portable Ice Nucleation Chamber), and typically slightly underestimated INPnumber concentrations in comparison to cloud parcel expansions in the AIDAchamber; this can be largely mitigated when it is possible to raise therelative humidity to sufficiently high values in the CFDCs, although this isnot always possible operationally. Correspondence of measurements of INPs among direct sampling andpost-processing systems varied depending on the INP type. Agreement was bestfor Snomax ® particles in the temperature regimecolder than −10 ∘ C, where their ice nucleation activity is nearlymaximized and changes very little with temperature. At temperatures warmer than −10 ∘ C, Snomax ® INP measurements (allvia freezing of suspensions) demonstrated discrepancies consistent withprevious reports of the instability of its protein aggregates that appear tomake it less suitable as a calibration INP at these temperatures. ForArgentinian soil dust particles, there was excellent agreement across allmeasurement methods; measures ranged within 1 order of magnitude for INPnumber concentrations, active fractions and calculated active site densitiesover a 25 to 30 ∘ C range and 5 to 8 orders of correspondingmagnitude change in number concentrations. This was also the case for alltemperatures warmer than −25 ∘ C in Tunisian dust experiments. Incontrast, discrepancies in measurements of INP concentrations or active sitedensities that exceeded 2 orders of magnitude across a broad range of temperaturemeasurements found at temperatures warmer than −25 ∘ C in a previous study werereplicated for illite NX. Discrepancies also exceeded 2 orders of magnitude attemperatures of −20 to −25 ∘ C for potassium feldspar (K-feldspar), but these coincidedwith the range of temperatures at which INP concentrations increase rapidly atapproximately an order of magnitude per 2 ∘ C cooling forK-feldspar. These few discrepancies did not outweigh the overall positive outcomes of theworkshop activity, nor the future utility of this data set or future similarefforts for resolving remaining measurement issues. Measurements of the samematerials were repeatable over the time of the workshop and demonstratedstrong consistency with prior studies, as reflected by agreement of databroadly with parameterizations of different specific or general (e.g., soildust) aerosol types. The divergent measurements of the INP activity of illiteNX by direct versus post-processing methods were not repeated for otherparticle types, and the Snomax ® datademonstrated that, at least for a biological INP type, there is no expectedmeasurement bias between bulk collection and direct immediately processedfreezing methods to as warm as −10 ∘ C. Since particle size rangeswere limited for this workshop, it can be expected that for atmosphericpopulations of INPs, measurement discrepancies will appear due to thedifferent capabilities of methods for sampling the full aerosol sizedistribution, or due to limitations on achieving sufficient watersupersaturations to fully capture immersion freezing in direct processinginstruments. Overall, this workshop presents an improved picture of presentcapabilities for measuring INPs than in past workshops, and providesdirection toward addressing remaining measurement issues.

54 ENVIRONMENTAL SCIENCES↗

Sleep Disruption Medical Intervention Forecasting (SDMIF) Module for the Integrated Medical Model

The NASA Integrated Medical Model (IMM) assesses the risk, including likelihood and impact of occurrence, of all credible in-flight medical conditions. Fatigue due to sleep disruption is a condition that could lead to operational errors, potentially resulting in loss of mission or crew. Pharmacological consumables are mitigation strategies used to manage the risks associated with sleep deficits. The likelihood of medical intervention due to sleep disruption was estimated with a well validated sleep model and a Monte Carlo computer simulation in an effort to optimize the quantity of consumables. METHODS: The key components of the model are the mission parameter program, the calculation of sleep intensity and the diagnosis and decision module. The mission parameter program was used to create simulated daily sleep/wake schedules for an ISS increment. The hypothetical schedules included critical events such as dockings and extravehicular activities and included actual sleep time and sleep quality. The schedules were used as inputs to the Sleep, Activity, Fatigue and Task Effectiveness (SAFTE) Model (IBR Inc., Baltimore MD), which calculated sleep intensity. Sleep data from an ISS study was used to relate calculated sleep intensity to the probability of sleep medication use, using a generalized linear model for binomial regression. A human yes/no decision process using a binomial random number was also factored into sleep medication use probability. RESULTS: These probability calculations were repeated 5000 times resulting in an estimate of the most likely amount of sleep aids used during an ISS mission and a 95% confidence interval. CONCLUSIONS: These results were transferred to the parent IMM for further weighting and integration with other medical conditions, to help inform operational decisions. This model is a potential planning tool for ensuring adequate sleep during sleep disrupted periods of a mission.

Lewandowski, Beth↗

Adapting the Reconfigurable SpaceCube Processing System for Multiple Mission Applications

This paper will detail the use of SpaceCube in multiple space flight applications including the Hubble Space Telescope Servicing Mission 4 (HST-SM4), an International Space Station (ISS) radiation test bed experiment, and the main avionics subsystem for two separate ISS attached payloads. Each mission has had varying degrees of data processing complexities, performance requirements, and external interfaces. We will show the methodology used to minimize the changes required to the physical hardware, FPGA designs, embedded software interfaces, and testing.This paper will summarize significant results as they apply to each mission application. In the HST-SM4 application we utilized the FPGA resources to accelerate portions of the image processing algorithms more than 25 times faster than a standard space processor in order to meet computational speed requirements. For the ISS radiation on-orbit demonstration, the main goal is to show that we can rely on the commercial FPGAs and processors in a space environment. We describe our FPGA and processor radiation mitigation strategies that have resulted in our eight PowerPCs being available and error free for more than 99.99 of the time over the period of four years. This positive data and proven reliability of the SpaceCube on ISS resulted in the Department of Defense (DoD) selecting SpaceCube, which is replacing an older and slower computer currently used on ISS, as the main avionics for two upcoming ISS experiment campaigns. This paper will show how we quickly reconfigured the SpaceCube system to meet the more stringent reliability requirements

SpaceCube↗

Feasibility of “Weak GPS” Real-Time Positioning/Timing at Lunar Distance

There are multiple Global Navigation Satellite Systems (GNSS’s), comprising over 100 navigation satellites in the Earth’s medium and high orbits. Most of these satellites have antennas that point Nadir to earth, and transmit navigation signals so vehicles on Earth’s surface and in its vicinity can perform trilateration and estimate its 3-dimenional (3D) positioning. The sidelobes of these antennas can occasionally point to the Moon. It is postulated that a lunar vehicle carrying a large enough receiving antenna can occasionally detects and receives four or more sidelobes of these weak GNSS signals, thus enabling the vehicle to perform 3D positioning using an onboard GNSS receiver. We propagate the orbits of the GNSS satellites from United States’ Global Positioning Satellite (GPS) constellation, the Europe’s Galileo constellation, and the Russia’s GLONASS constellation, a total of 81 satellites. We simulate the visibility of these satellites by a lunar vehicle in a Near Rectilinear Halo Orbit (NRHO), based on the assumption that the lunar vehicle is “in-view” of a GNSS satellite as long as it falls within the 40- degree beam-width of the satellite. We also simulate the 3D positioning performance as a function of satellites’ ephemeris errors and pseudo-range errors. The preliminary results show that the lunar vehicle can “see” 5 – 13 satellites, and achieve a 3D positioning error (one-sigma) of 200 – 300 meters based on reasonable ephemeris and pseudo- range error assumptions. We also consider the case of using relative positioning to mitigate the GNSS satellites’ ephemeris biases. That is, by assuming a reference receiver with accurately known positioning that is close to the lunar vehicle, and computing the relative position of the lunar vehicle relative to the reference.

Cheung, Kar-Ming↗

Measures of model performance based on the log accuracy ratio

Quantitative assessment of modeling and forecasting of continuous quantities uses a variety of approaches. We review existing literature describing metrics for forecast accuracy and bias, concentrating on those based on relative errors and percentage errors. Of these accuracy metrics, the mean absolute percentage error (MAPE) is one of the most common across many fields and has been widely applied in recent space science literature and we highlight the benefits and drawbacks of MAPE and proposed alternatives. We then introduce the log accuracy ratio, and derive from it two metrics: the median symmetric accuracy; and the symmetric signed percentage bias. Robust methods for estimating the spread of a multiplicative linear model using the log accuracy ratio are also presented. The developed metrics are shown to be easy to interpret, robust, and to mitigate the key drawbacks of their more widely-used counterparts based on relative errors and percentage errors. Their use is illustrated with radiation belt electron flux modeling examples.

54 ENVIRONMENTAL SCIENCES↗

A GENERAL STUDY OF THE INFLUENCE OF CATASTROPHIC PHOTOMETRIC REDSHIFT ERRORS ON COSMOLOGY WITH COSMIC SHEAR TOMOGRAPHY

A goal of forthcoming imaging surveys is to use weak gravitational lensing shear measurements to constrain dark energy. A challenge to this program is that redshifts to the lensed, source galaxies must be determined using photometric, rather than spectroscopic, information. We quantify the importance of uncalibrated photometric redshift outliers to the dark energy goals of forthcoming imaging surveys in a manner that does not assume any particular photometric redshift technique or template. In so doing, we provide an approximate blueprint for computing the influence of specific outlier populations on dark energy constraints. We find that outlier populations whose photo-z distributions are tightly localized about a significantly biased redshift must be controlled to a per-galaxy rate of (1-3) x 10{sup -3} to insure that systematic errors on dark energy parameters are rendered negligible. In the complementary limit, a subset of imaged galaxies with uncalibrated photometric redshifts distributed over a broad range must be limited to fewer than a per-galaxy error rate of F {sub cat} {approx}< (2-4) x 10{sup -4}. Additionally, we explore the relative importance of calibrating the photo-z's of a core set of relatively well-understood galaxies as compared to the need to identify potential catastrophic photo-z outliers. We discuss the degradation of the statistical constraints on dark energy parameters induced by excising source galaxies at high- and low-photometric redshifts, concluding that removing galaxies with photometric redshifts z {sup ph} {approx}> 2.4 and z {sup ph} {approx}< 0.3 may mitigate damaging catastrophic redshift outliers at a relatively small ({approx}<20%) cost in statistical error. In an Appendix, we show that forecasts for the degradation in dark energy parameter constraints due to uncertain photometric redshifts depend sensitively on the treatment of the nonlinear matter power spectrum. In particular, previous work using Peacock and Dodds may have overestimated the photo-z calibration requirements of future surveys.

79 ASTRONOMY AND ASTROPHYSICS↗