Results for “error metric” — Page 16

DOE OSTI2024

Security of quantum position-verification limits Hamiltonian simulation via holography

We investigate the link between quantum position-verification (QPV) and holography established in [1] using holographic quantum error correcting codes as toy models. By inserting the “temporal” scaling of the AdS metric by hand via the bulk Hamiltonian interaction strength, we recover a toy model with consistent causality structure. This leads to an interesting implication between two topics in quantum information: if position-based verification is secure against attacks with small entanglement then there are new fundamental lower bounds for resources required for one Hamiltonian to simulate another.

AdS-CFT Correspondence↗

DOE OSTI2021

CarcSeq Measurement of Rat Mammary Cancer Driver Mutations and Relation to Spontaneous Mammary Neoplasia

Abstract The ability to deduce carcinogenic potential from subchronic, repeat dose rodent studies would constitute a major advance in chemical safety assessment and drug development. This study investigated an error-corrected NGS method (CarcSeq) for quantifying cancer driver mutations (CDMs) and deriving a metric of clonal expansion predictive of future neoplastic potential. CarcSeq was designed to interrogate subsets of amplicons encompassing hotspot CDMs applicable to a variety of cancers. Previously, normal human breast DNA was analyzed by CarcSeq and metrics based on mammary-specific CDMs were correlated with tissue donor age, a surrogate of breast cancer risk. Here we report development of parallel methodologies for rat. The utility of the rat CarcSeq method for predicting neoplastic potential was investigated by analyzing mammary tissue of 16-week-old untreated rats with known differences in spontaneous mammary neoplasia (Fischer 344, Wistar Han, and Sprague Dawley). Hundreds of mutants with mutant fractions ≥ 10−4 were quantified in each strain, most were recurrent mutations, and 42.5% of the nonsynonymous mutations have human homologs. Mutants in the mammary-specific target of the most tumor-sensitive strain (Sprague Dawley) showed the greatest nonsynonymous/synonymous mutation ratio, indicative of positive selection consistent with clonal expansion. For the mammary-specific target (Hras, Pik3ca, and Tp53 amplicons), median absolute deviation correlated with percentages of rats that develop spontaneous mammary neoplasia at 104 weeks (Pearson r = 1.0000, 1-tailed p = .0010). Therefore, this study produced evidence CarcSeq analysis of spontaneously occurring CDMs can be used to derive an early metric of clonal expansion relatable to long-term neoplastic outcome.

McKim, Karen L.↗

DOE OSTI2025

Characteristics of the IBEX Ribbon and Their Implications for a Source Region Outside the Heliopause

This paper presents a comprehensive exploration of the Interstellar Boundary Explorer energetic neutral atom (ENA) ribbon, focusing on its spatial and temporal variations over 14 yr. Methodological advancements, including a refined map modeling procedure and a new ribbon separation technique with appropriate error propagation, enable a detailed investigation of the ribbon’s features. Utilizing statistically robust metrics, this study reveals details of the ribbon across energy and time. Key findings include energy- and time-dependent variations in flux, angular radius, ribbon profile width, and higher moments. By applying these metrics, we reveal new complexity to the evolution of the ribbon over time, highlighting the nuanced relationship between it and the solar wind. Furthermore, the study examines for the first time the ribbon as it passes through the starboard/heliotail region (Lon EC 120°–180°), revealing properties distinct from other portions of the ribbon. The analysis uncovers an anticorrelation between ribbon width and flux, which provides quantitative support for a multisource ribbon created by a combination of solar wind neutrals that generate a spatiall narrow ribbon component and heliosheath neutrals giving rise to a broad component. Finally, differences in the temporal evolution of the ENA flux at different energies provide additional support that the location of the ribbon source region is beyond the heliopause.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2025

Enabling Robust Exoplanet Atmospheric Retrievals with Gaussian Processes

Atmospheric retrievals are essential tools for interpreting exoplanet transmission and eclipse spectra, enabling quantitative constraints on the chemical composition, aerosol properties, and thermal structure of planetary atmospheres. The James Webb Space Telescope (JWST) offers unprecedented spectral precision, resolution, and wavelength coverage, unlocking transformative insights into the formation, evolution, climate, and potential habitability of planetary systems. However, this opportunity is accompanied by challenges: modeling assumptions and unaccounted-for noise or signal sources can bias retrieval outcomes and their interpretation. To address these limitations, we introduce a Gaussian process (GP)-aided atmospheric retrieval framework that flexibly accounts for unmodeled features and correlated noise in exoplanet spectra. We validate this method on synthetic JWST observations, and show that GP-aided retrievals reduce bias in inferred abundances and better capture model–data mismatches than traditional approaches. We also introduce the concept of mean squared error to quantify the trade-off between bias and variance, arguing that this metric more accurately reflects retrieval performance than bias alone. We then reanalyze the NIRISS/SOSS JWST transmission spectrum of WASP-96 b, finding that GP-aided retrievals yield broader constraints on CO 2 and H 2 O, possibly alleviating tension between previous retrieval results and equilibrium predictions. Our GP framework provides precise and accurate constraints while highlighting regions where models fail to explain the data. As JWST matures and future facilities come online, a deeper understanding of the limitations of both data and models will be essential, and GP-enabled retrievals like the one presented here offer a principled path forward.

Rotman, Yoav [Arizona State Univ., Tempe, AZ (Unit↗

NASA NTRS2007

Safety Performance of Airborne Separation: Preliminary Baseline Testing

The Safety Performance of Airborne Separation (SPAS) study is a suite of Monte Carlo simulation experiments designed to analyze and quantify safety behavior of airborne separation. This paper presents results of preliminary baseline testing. The preliminary baseline scenario is designed to be very challenging, consisting of randomized routes in generic high-density airspace in which all aircraft are constrained to the same flight level. Sustained traffic density is varied from approximately 3 to 15 aircraft per 10,000 square miles, approximating up to about 5 times today s traffic density in a typical sector. Research at high traffic densities and at multiple flight levels are planned within the next two years. Basic safety metrics for aircraft separation are collected and analyzed. During the progression of experiments, various errors, uncertainties, delays, and other variables potentially impacting system safety will be incrementally introduced to analyze the effect on safety of the individual factors as well as their interaction and collective effect. In this paper we report the results of the first experiment that addresses the preliminary baseline condition tested over a range of traffic densities. Early results at five times the typical traffic density in today s NAS indicate that, under the assumptions of this study, airborne separation can be safely performed. In addition, we report on initial observations from an exploration of four additional factors tested at a single traffic density: broadcast surveillance signal interference, extent of intent sharing, pilot delay, and wind prediction error.

Consiglio, Maria C.↗

NASA NTRS2014

The Uncertainty of Biomass Estimates from Modeled ICESat-2 Returns Across a Boreal Forest Gradient

The Forest Light (FLIGHT) radiative transfer model was used to examine the uncertainty of vegetation structure measurements from NASA's planned ICESat-2 photon counting light detection and ranging (LiDAR) instrument across a synthetic Larix forest gradient in the taiga-tundra ecotone. The simulations demonstrate how measurements from the planned spaceborne mission, which differ from those of previous LiDAR systems, may perform across a boreal forest to non-forest structure gradient in globally important ecological region of northern Siberia. We used a modified version of FLIGHT to simulate the acquisition parameters of ICESat-2. Modeled returns were analyzed from collections of sequential footprints along LiDAR tracks (link-scales) of lengths ranging from 20 m-90 m. These link-scales traversed synthetic forest stands that were initialized with parameters drawn from field surveys in Siberian Larix forests. LiDAR returns from vegetation were compiled for 100 simulated LiDAR collections for each 10 Mg · ha(exp -1) interval in the 0-100 Mg · ha(exp -1) above-ground biomass density (AGB) forest gradient. Canopy height metrics were computed and AGB was inferred from empirical models. The root mean square error (RMSE) and RMSE uncertainty associated with the distribution of inferred AGB within each AGB interval across the gradient was examined. Simulation results of the bright daylight and low vegetation reflectivity conditions for collecting photon counting LiDAR with no topographic relief show that 1-2 photons are returned for 79%-88% of LiDAR shots. Signal photons account for approximately 67% of all LiDAR returns, while approximately 50% of shots result in 1 signal photon returned. The proportion of these signal photon returns do not differ significantly (p greater than 0.05) for AGB intervals greater than 20 Mg · ha(exp -1). The 50m link-scale approximates the finest horizontal resolution (length) at which photon counting LiDAR collection provides strong model fits and minimizes forest structure uncertainty in the synthetic Larix stands. At this link-scale AGB greater than 20 Mg · ha(exp -1) has AGB error from 20-50% at the 95% confidence level. These results suggest that the theoretical sensitivity of ICESat-2 photon counting LiDAR measurements alone lack the ability to consistently discern differences in inferred AGB at 10 Mg · ha(exp -1) intervals in sparse forests characteristic of the taiga-tundra ecotone.

LiDAR↗

NASA NTRS2015

Effects of Resolution and Spectral Nudging in Simulation the Effects of Wintertime Atmospheric River Landfalls in the Western US

Landfalling atmospheric rivers (ARs) play a crucial role in the climate of the US Pacific coast region as they are frequently related with heavy precipitation and flash flooding events. Thus, the capability of climate models to accurately simulate AR landfalls and their key hydrologic effects is an important practical concern for WUS, from flood forecasting to future water resources projections. In order to examine the effects of model configuration, including the resolution and spectral nudging, in simulating the climatology of key weather events in the conterminous US, a NASA team has performed a hindcast experiment using the GEOS5 global and the NU-WRF regional models for Nov 1999 - Oct 2010. This study examines the skill of these hindcasts, with different models and their configurations, in simulating key footprints of landfalling ARs in the WUS region. Using an AR-landfall chronology based on the vertically-integrated water vapor flux calculated from the MERRA2 reanalysis, we have analyzed the observed and simulated precipitation and temperature anomalies associated with wintertime AR landfalls along the US Pacific coast. Model skill is measured using metrics including regional means, a skill score based on correlations and mean-square errors, and Taylor diagrams in four WUS Bukovsky regions. Results show that the AR-related anomalies of precipitation is more reliable than of surface temperatures. Model skill also varies according to regions. The AR temperature anomalies are well simulated in most of the WUS region except PNW. For precipitation, simulations with finer spatial resolution tend to generate larger spatial variability and agree better with the PRISM data in most regions. Such a resolution dependence of spatial variability is not found for temperatures; e.g., the MERRA2 reanalysis often outperforms, with similar spatial variability and higher pattern correlations with the PRISM data, finer-resolution NU-WRF runs in simulating temperature variations within subregions. Results from this study will be summarized to assist future (regional) climate experiments for climate change impact assessments and developing adaptationmitigation strategies, the key elements of the National Climate Assessment.

Simulation↗

NASA NTRS2015

Enabling Performance-Based Navigation Arrivals: Development and Simulation Testing of the Terminal Sequencing and Spacing System

NASA has developed an advanced arrival management capability for terminal controllers, known as Terminal Sequencing and Spacing (TSS). TSS increases use of performance-based navigation (PBN) arrival procedures during periods of high traffic demand. It extends two Federal Aviation Administration's operational systems with terminal metering and controller spacing tools. Sixteen high-fidelity human-in-the-loop simulations, involving more than five hundred hours of evaluation time, were conducted to mature TSS from proof-of- concept design to fully functional prototype. These simulations modeled arrival procedures at several U.S. airports, incorporated a broad range of traffic demand profiles and wind conditions, and used controllers with extensive operational experience. Two fundamental metrics are evaluated for these simulations: PBN Success Rate and Inter-Arrival Spacing Error. The PBN Success Rate shows a definitive trend when TSS is used. It increases from 42 percent for today's operations to 68 percent for terminal metering only and 92 percent for terminal metering with controller-managed spacing tools. Meanwhile, the Inter-Arrival Spacing Error improves 25 to 35 percent when TSS is used compared to not used. The TSS technology was transferred to the FAA and, and it is targeted for deployment to several busy airports in the U.S. starting in 2018.

terminal metering↗

NASA NTRSDate not supplied

Evaluating the Impact of Geostationary Sounders in the Context of International Coordination

The proposed NOAA/NASA Geostationary eXtended Observations (GeoXO) program plans to include a hyperspectral infrared (IR) sounder (GXS) on its central satellite, joining international counterparts. Ahead of launch, the NASA Global Modeling and Assimilation Office (GMAO) assessed the potential effectiveness of GXS both as a lone sounder in a GEO orbit and as part of a global ring of such instruments. Using an observing system simulation experiment (OSSE) framework from a global numerical weather prediction (NWP) perspective, the ability of GXS and the global ring to improve weather prediction of thermodynamic variables was assessed both globally and regionally. GXS dominated regional analysis and forecast improvements and contributed significantly to global increases in forecast skill. However, more sustained global improvements on the order of 4 days rely on international partnerships. Over CONUS, the FSOI metric showed the GXS observations provide the strongest radiance impact on the moist energy error norm reduction. Additionally, GXS shows the capability to improve hurricane forecast track errors, resulting in improved forecast warnings. Overall, the persistent atmospheric profile information from GXS over much of the western hemisphere provide an opportunity to improve the representation of weather systems and their forecasts.

Erica L. McGrath-Spangler↗

NASA NTRSDate not supplied

Evaluating the Impact of Geostationary Sounders in the Context of International Coordination

The proposed NOAA/NASA Geostationary eXtended Observations (GeoXO) program plans to include a hyperspectral infrared (IR) sounder (GXS) on its central satellite, joining international counterparts. Ahead of launch, the NASA Global Modeling and Assimilation Office (GMAO) assessed the potential effectiveness of GXS both as a lone sounder in a GEO orbit and as part of a global ring of such instruments. Using an observing system simulation experiment (OSSE) framework from a global numerical weather prediction (NWP) perspective, the ability of GXS and the global ring to improve weather prediction of thermodynamic variables was assessed both globally and regionally. GXS dominated regional analysis and forecast improvements and contributed significantly to global increases in forecast skill. However, more sustained global improvements on the order of 4 days rely on international partnerships. Over CONUS, the FSOI metric showed the GXS observations provide the strongest radiance impact on the moist energy error norm reduction. Additionally, GXS shows the capability to improve hurricane forecast track errors, resulting in improved forecast warnings. Overall, the persistent atmospheric profile information from GXS over much of the western hemisphere provide an opportunity to improve the representation of weather systems and their forecasts.

Erica McGrath-Spangler↗

NASA NTRS2015

Sensor Selection for Aircraft Engine Performance Estimation and Gas Path Fault Diagnostics

This paper presents analytical techniques for aiding system designers in making aircraft engine health management sensor selection decisions. The presented techniques, which are based on linear estimation and probability theory, are tailored for gas turbine engine performance estimation and gas path fault diagnostics applications. They enable quantification of the performance estimation and diagnostic accuracy offered by different candidate sensor suites. For performance estimation, sensor selection metrics are presented for two types of estimators including a Kalman filter and a maximum a posteriori estimator. For each type of performance estimator, sensor selection is based on minimizing the theoretical sum of squared estimation errors in health parameters representing performance deterioration in the major rotating modules of the engine. For gas path fault diagnostics, the sensor selection metric is set up to maximize correct classification rate for a diagnostic strategy that performs fault classification by identifying the fault type that most closely matches the observed measurement signature in a weighted least squares sense. Results from the application of the sensor selection metrics to a linear engine model are presented and discussed. Given a baseline sensor suite and a candidate list of optional sensors, an exhaustive search is performed to determine the optimal sensor suites for performance estimation and fault diagnostics. For any given sensor suite, Monte Carlo simulation results are found to exhibit good agreement with theoretical predictions of estimation and diagnostic accuracies.

Gas Turbine Engines↗

NASA NTRS2015

Sensor Selection for Aircraft Engine Performance Estimation and Gas Path Fault Diagnostics

This paper presents analytical techniques for aiding system designers in making aircraft engine health management sensor selection decisions. The presented techniques, which are based on linear estimation and probability theory, are tailored for gas turbine engine performance estimation and gas path fault diagnostics applications. They enable quantification of the performance estimation and diagnostic accuracy offered by different candidate sensor suites. For performance estimation, sensor selection metrics are presented for two types of estimators including a Kalman filter and a maximum a posteriori estimator. For each type of performance estimator, sensor selection is based on minimizing the theoretical sum of squared estimation errors in health parameters representing performance deterioration in the major rotating modules of the engine. For gas path fault diagnostics, the sensor selection metric is set up to maximize correct classification rate for a diagnostic strategy that performs fault classification by identifying the fault type that most closely matches the observed measurement signature in a weighted least squares sense. Results from the application of the sensor selection metrics to a linear engine model are presented and discussed. Given a baseline sensor suite and a candidate list of optional sensors, an exhaustive search is performed to determine the optimal sensor suites for performance estimation and fault diagnostics. For any given sensor suite, Monte Carlo simulation results are found to exhibit good agreement with theoretical predictions of estimation and diagnostic accuracies.

Gas Turbine Engines↗

NASA NTRS2016

Sensor Selection for Aircraft Engine Performance Estimation and Gas Path Fault Diagnostics

This paper presents analytical techniques for aiding system designers in making aircraft engine health management sensor selection decisions. The presented techniques, which are based on linear estimation and probability theory, are tailored for gas turbine engine performance estimation and gas path fault diagnostics applications. They enable quantification of the performance estimation and diagnostic accuracy offered by different candidate sensor suites. For performance estimation, sensor selection metrics are presented for two types of estimators including a Kalman filter and a maximum a posteriori estimator. For each type of performance estimator, sensor selection is based on minimizing the theoretical sum of squared estimation errors in health parameters representing performance deterioration in the major rotating modules of the engine. For gas path fault diagnostics, the sensor selection metric is set up to maximize correct classification rate for a diagnostic strategy that performs fault classification by identifying the fault type that most closely matches the observed measurement signature in a weighted least squares sense. Results from the application of the sensor selection metrics to a linear engine model are presented and discussed. Given a baseline sensor suite and a candidate list of optional sensors, an exhaustive search is performed to determine the optimal sensor suites for performance estimation and fault diagnostics. For any given sensor suite, Monte Carlo simulation results are found to exhibit good agreement with theoretical predictions of estimation and diagnostic accuracies.

Diagnosis↗

NASA NTRS2012

Uncertainty Quantification for Polynomial Systems via Bernstein Expansions

This paper presents a unifying framework to uncertainty quantification for systems having polynomial response metrics that depend on both aleatory and epistemic uncertainties. The approach proposed, which is based on the Bernstein expansions of polynomials, enables bounding the range of moments and failure probabilities of response metrics as well as finding supersets of the extreme epistemic realizations where the limits of such ranges occur. These bounds and supersets, whose analytical structure renders them free of approximation error, can be made arbitrarily tight with additional computational effort. Furthermore, this framework enables determining the importance of particular uncertain parameters according to the extent to which they affect the first two moments of response metrics and failure probabilities. This analysis enables determining the parameters that should be considered uncertain as well as those that can be assumed to be constants without incurring significant error. The analytical nature of the approach eliminates the numerical error that characterizes the sampling-based techniques commonly used to propagate aleatory uncertainties as well as the possibility of under predicting the range of the statistic of interest that may result from searching for the best- and worstcase epistemic values via nonlinear optimization or sampling.

Crespo, Luis G.↗

NASA NTRS1989

High rate concatenated coding systems using bandwidth efficient trellis inner codes

High-rate concatenated coding systems with bandwidth-efficient trellis inner codes and Reed-Solomon (RS) outer codes are investigated for application in high-speed satellite communication systems. Two concatenated coding schemes are proposed. In one the inner code is decoded with soft-decision Viterbi decoding, and the outer RS code performs error-correction-only decoding (decoding without side information). In the other, the inner code is decoded with a modified Viterbi algorithm, which produces reliability information along with the decoded output. In this algorithm, path metrics are used to estimate the entire information sequence, whereas branch metrics are used to provide reliability information on the decoded sequence. This information is used to erase unreliable bits in the decoded output. An errors-and-erasures RS decoder is then used for the outer code. The two schemes have been proposed for high-speed data communication on NASA satellite channels. The rates considered are at least double those used in current NASA systems, and the results indicate that high system reliability can still be achieved.

Deng, Robert H.↗

NASA NTRS1986

Error control techniques for satellite and space communications

High rate concatenated coding systems with trellis inner codes and Reed-Solomon (RS) outer codes for application in satellite communication systems are considered. Two types of inner codes are studied: high rate punctured binary convolutional codes which result in overall effective information rates between 1/2 and 1 bit per channel use; and bandwidth efficient signal space trellis codes which can achieve overall effective information rates greater than 1 bit per channel use. Channel capacity calculations with and without side information performed for the concatenated coding system. Concatenated coding schemes are investigated. In Scheme 1, the inner code is decoded with the Viterbi algorithm and the outer RS code performs error-correction only (decoding without side information). In scheme 2, the inner code is decoded with a modified Viterbi algorithm which produces reliability information along with the decoded output. In this algorithm, path metrics are used to estimate the entire information sequence, while branch metrics are used to provide the reliability information on the decoded sequence. This information is used to erase unreliable bits in the decoded output. An errors-and-erasures RS decoder is then used for the outer code. These two schemes are proposed for use on NASA satellite channels. Results indicate that high system reliability can be achieved with little or no bandwidth expansion.

Costello, D. J., Jr.↗

NASA NTRS1983

Metric analysis and data validation across FORTRAN projects

The desire to predict the effort in developing or explaining the quality of software has led to the proposal of several metrics. As a step toward validating these metrics, the Software Engineering Laboratory (SEL) has analyzed the software science metrics, cyclomatic complexity, and various standard program measures for their relation to effort (including design through acceptance testing), development errors (both discrete and weighted according to the amount of time to locate and fix), and one another. The data investigated are collected from a project FORTRAN environment and examined across several projects at once, within individual projects and by reporting accuracy checks demonstrating the need to validate a database. When the data comes from individual programmers or certain validated projects, the metrics' correlations with actual effort seem to be strongest. For modules developed entirely by individual programmers, the validity ratios induce a statistically significant ordering of several of the metrics' correlations. When comparing the strongest correlations, neither software science's E metric cyclomatic complexity not source lines of code appears to relate convincingly better with effort than the others.

Basili, Victor R.↗

NASA NTRS2019

Quantifying the Storm Time Thermospheric Neutral Density Variations Using Model and Observations

Accurate determination of thermospheric neutral density holds crucial importance for satellited rag calculations. The problem is twofold and involves the correct estimation of the quiet time climatology and storm time variations. In this work, neutral density estimations from two empirical and threephysics based models of the ionosphere thermosphere are compared with the neutral densities along the Challenging MicroSatellite Payload satellite track for six geomagnetic storms. Storm time variations are extracted from neutral density by (1) subtracting the mean difference between model and observation (bias),(2) setting climatological variations to zero, and (3) multiplying model data with the quiet time ratio between the model and observation. Several metrics are employed to evaluate the model performances. We find that the removal of bias or climatology reveals actual performance of the model in simulating the storm time variations. When bias is removed, depending on event and model, storm time errors in neutral density can decrease by an amount of 113% or can increase by an amount of 12% with respect to error in models with quiet time bias. It is shown that using only average and maximum values of neutral density to determine the model performances can be misleading since a model can estimate the averages fairly well but may not capture the maximum value or vice versa. Since each of the metrics used for determining model performances provides different aspects of the error, among these, we suggest employing mean absolute error, prediction efficiency, and normalized root mean square error together as a standard set ofmetrics for the neutral density.

Eyiguler, E. Ceren Kalafatoglu↗