Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “testing statistics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16

Calibration of the DSCOVR EPIC Visible and NIR Channels using Multiple LEO Radiometers

The first five years of operation of the Deep Space Climate Observatory (DSCOVR) Earth Polychromatic Imaging Camera (EPIC) at the Lagrange one point have produced results that uniquely complement the data from currently operating low orbit Earth-observing instruments. In this paper we describe an updated unified approach to EPIC calibration. In this approach, calibration coefficients and their trends were obtained by comparing EPIC observations to the measurements from polar orbiting radiometers. In this study L1B reflectances from Moderate Resolution Imaging Spectroradiometer (MODIS) onboard the Aqua and Terra satellites, Multi-angle Imaging Spectroradiometer (MISR) onboard Terra and Visible Infrared Imaging Radiometer (VIIRS) onboard the Suomi National Polar-orbiting Partnership (Suomi NPP) spacecraft were used to infer calibration coefficients for four EPIC visible and near-infrared channels: 443 nm, 551 nm, 680 nm, and 780 nm. EPIC Version three measurements made between June 2015 and August 2020 were used for comparison. The calibration procedure identifies the most homogeneous low Earth orbit radiometer scenes matching scattering angles that are temporarily and spatially collocated with EPIC observations. These scenes are used to determine reflectance to count (R/C) ratios in spectrally analogous channels. Seasonal average R/C ratios were analyzed to obtain EPIC calibration gains and trends. The trends for the full dataset period are not statistically significant except in the 443 nm channel. No significant changes in calibration were found after the instrument’s exit from safe hold in March 2020. The R/C ratios were also used to determine the differences in EPIC gains resulting from separate calibrations: against MODIS Aqua or Terra, as well as against forward or aftward MISR cameras. Statistical tests indicate that the differences between the two datasets are not significant except in the 780 nm channels where Aqua-derived coefficients may be around 2% lower compared to Terra. The dependence of EPIC calibration gains on the instrument scattering angle and on DSCOVR-Earth distance were investigated. Lastly, model Low Earth Orbit (LEO) reflectances calculated to match the EPIC viewing geometry were employed to study how EPIC calibration coefficients depend on EPIC-LEO viewing geometry differences. The effect of LEO and EPIC angular mismatch on calibration was shown to be small.

deep space climate observatory/earth polychromatic↗

Improved State Estimation in Distorted Magnetic Fields

The magnetic field of the Earth – besides varying naturally – may be disturbed locally by the (man-made) environment. State estimation and corresponding navigation frameworks that use magnetometers on-board of mobile platforms suffer from severe performance loss or failure upon local magnetic distortions if these are not detected and mitigated adequately. Advanced estimators include the magnetic variation in the state vector. However, Cartesian coordinates, although widely used in the literature, suffer from observability issues when it comes to disturbance detection. This paper shows the importance of representing the magnetic variation in a spherical coordinate system and subsequent improvements with respect to the common representation in Cartesian coordinates. The spherical representation improves estimator consistency and allows for accurate and fast mitigation of magnetic disturbances through consistent statistical tests which leads to better system state estimates in magnetically distorted areas. The approach is validated by performing tests with simulated and real-world data on embedded hardware.

Brommer, Christian↗

Comparison of Clouds and Cloud Feedback between AMIP5 and AMIP6

We examine the changes in clouds and cloud feedback between Phase 5 (AMIP5) and Phase 6 (AMIP6) of the Atmospheric Model Intercomparison Project. Each model is perturbed by uniformly increasing the sea surface temperature by 4 K. The simulated cloud fraction, the perturbed states and cloud radiative kernels are used to derive cloud feedback in the shortwave (SW), longwave (LW) and their sum (Net). Compared to AMIP5, the cloud fraction in AMIP6 increases by 9.1%, while the perturbation leads to a 0.25% decrease. The Net cloud feedback at the top of the atmosphere (TOA) is almost double (174%). Statistical tests support that this change is mainly due to an increase in the surface SW cloud feedback caused by optically thick, middle and low clouds. The contribution of the atmospheric Net component (12%) stems from the increase in the atmospheric LW cloud feedback, likely to play a role in weakening (strengthening) the northward (southward) meridional atmospheric energy transport, while the opposite is true for the surface LW and Net cloud feedback in the meridional oceanic energy transport. The substantial increase in cloud feedback at the TOA primarily contributes to the higher climate sensitivity. The cloud feedback spread in AMIP6 is comparable to that in AMIP5.

Clouds↗

Evaluating the Efficacy of Conditional Variational Autoencoders in Generating Synthetic Single Nuclei RNA-Seq Data for Space Biology Research

Astronauts are subject to unique stressors during spaceflight, leading to changes in their cellular function. However, neither astronauts nor model organisms respond the same to spaceflight, and research implicates a contribution of omics components in differential responses. Understanding how gene expression affects astronaut health is critical for the success of long-term space missions, prompting interest in developing personalized predictive models leveraging artificial intelligence (AI) and machine learning (ML) techniques. Developing such models requires extensive data, which is challenging to obtain and share. This study explores the use of conditional variational autoencoders (CVAEs) to synthetically generate single-nuclei RNA-seq (snRNA-seq) data. CVAEs build on standard variational autoencoders (VAEs) by conditioning data generation on covariates like sample identity and mission parameters, enhancing the relevance of generated data for specific contexts. For our work, we built two CVAEs with varying degrees of sparsity to optimize both interpretability and generative power. We train and validate models on existing snRNA-seq data collected from the brain tissue of mice subjected to spaceflight conditions and their ground control counterparts. We evaluate model performance using statistical tests and visualizations to compare synthetic data to real data. We aim to demonstrate that these prototype CVAE architectures could be used in future space biology work and that this is a method worth further exploring.

Sarah Golts↗

Distribution Development for Residual Inventory at the New York West Valley Site - 20400

The New York State Energy Research and Development Authority (NYSERDA) is the owner of the Western New York Nuclear Service Center (WNYNSC), a 1,351 ha site located approximately 48 km south of Buffalo, New York. In 1962, Nuclear Fuel Services, Inc. (NFS) entered into Agreements with the Atomic Energy Commission and New York State to construct the first commercial reprocessing plant of nuclear fuel in the United States. NFS, a private company, built and operated the spent fuel reprocessing plant and waste disposal facilities, processing 640 Mg of spent nuclear fuel from 1966 to 1972 under an Atomic Energy Commission license. Nuclear fuel reprocessing operations ended in 1972 and never reopened, leaving behind radioactive and chemical wastes. Operations led to contamination in a number of facilities and locations. Some of that contamination has migrated from waste disposal zones to other layers, formations, and features on and off the WNYNSC. Phase I decommissioning activities are ongoing and involve the removal of a number of areas and structures that have been associated with contamination. The purpose of this work is to outline the approach for characterizing contamination not associated with disposed wastes, contaminated structures, or specific releases. In this work, the term, residual radiological activity, is used to describe environmental contamination that exists subsequent to the completion of Phase I decommissioning activities, that is not associated with disposed wastes, contaminated structures, or specific releases. Contamination from the Site was quantified relative to data that characterize the concentrations of radionuclides that exist in background. Background concentrations are those present in the area but having no influence from Site related activities. The existence of residual radiological activity that is elevated relative to background has the potential to contribute to future risks to human health and the environment. As a consequence, the residual inventory information is used to inform the West Valley Probabilistic Performance Assessment (PPA) model to characterize potential future risks to human health and the environment. The centralized West Valley Data Management System (DMS) was the source of information for the data assembled in this analysis. The DMS is a fairly large compilation consisting of thousands of records from investigation studies, with sample dates ranging from 1990 to present. Samples from monitoring wells, boreholes, geoprobe studies, surface water, surface soils, storm water outfalls, ventilation stack filters, plant and animal tissues, and more are included in the DMS. Results are typically reported in units of activity per unit volume. For the purpose of the analyses presented here, all results were converted into consistent units of pCi per unit volume. Since 1990, data have been collected from various locations across the WNYNSC at different times with varying frequency over the course of several decades. As a consequence, a number of potential issues can arise with respect to the assembly of a dataset that is deemed adequate for the characterization of residual radiological activity. These issues were assessed and resolved to the extent possible through careful consideration of the properties of the distributions. The intent was to use data which characterize the current state of the Site. Radionuclides can be designated to one of several groups depending on their origin. In this work the groups considered were 1) Naturally Occurring Radioactive Material (NORM), 2) fallout, and 3) Other (including power plant, medical research, etc). This grouping is a useful construct with respect to the interpretation of fixed laboratory results. For example, NORM radionuclides that exist within a decay chain should have approximately equivalent distributions of concentrations if they are representative of background conditions. Insights such as these can be used as a check to identify sample results that need to be further investigated or omitted due to issues associated with reported results from fixed laboratory analyses. This type of analysis provided a foundation for the assessment of the adequacy of sample results for use in subsequent components of an assessment. The general process for the assessment of residual radiological contamination at the Site consists of a sequence of several steps. First, for each analyte, several statistical tests were performed to assess the weight of evidence against the null hypothesis that the mean of the distribution of concentrations was equal to zero. If the mean of the distribution of concentrations for a given radionuclide was not found to be greater than zero, then it was removed from consideration as a component of the residual radiological contamination. If there was significant evidence to reject the hypothesis of the mean being equal to zero, the second step was to compare the distribution of the data from the Site to that of the corresponding background. A suite of tests was used to compare the distributions of the site and background data. The results of these tests were collectively used to determine if site data are elevated relative to background. The third step was to develop distributions using a Bayesian framework to characterize the distribution of mean of the increment present above background for each of the radionuclides. The Bayesian model implemented allowed for the comparison of site-specific records to background concentrations to better approximate contamination attributed to the Site. A final screening step was employed for radionuclides that exceed background. This screening step compared 95% upper confidence limits (UCLs) from the increment distribution developed in the previous step to the risk screening levels. This approach yields a list of analytes that were determined to be elevated relative to background.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Validating Mixtures of 233 U, 235 U, and 239 Pu for the Sum-of-Fractions Method

The Sum-of-Fractions method is a technique used to assure that homogeneous mixtures of fissile and fissionable isotopes are below a minimum margin of k eff or reactivity. Current work by Pacific Northwest National Laboratory examines different mixtures of 233 U, 235 U, and 239 Pu to determine critical mass limits for mixtures of transuranic actinides lacking a validation basis. To provide a validation basis for these limits, the work presented here describes the results of a sensitivity and uncertainty analysis of various mixtures of these isotopes in various concentrations moderated and reflected by light water and polyethylene. The TSUNAMI-1D sequence in the SCALE code system was used to generate sensitivity coefficients for three different concentrations of mixtures of 233 U, 235 U, and 239 Pu. The TSUNAMI-IP sequence was then used for similarity assessment (c k ) with critical benchmark experiment sensitivity data files (SDFs) from the Oak Ridge National Laboratory Verified, Archived Library of Inputs and Data and the Nuclear Energy Agency SDF database. The VADER sequence in SCALE was used for statistical testing and to generate upper subcritical limits from the data to develop a basis for validating critical mass limits.

07 ISOTOPE AND RADIATION SOURCES↗

Material Accountancy Performance Indicator Toolkit

The MAPIT - Material Accountancy Performance Indicator Toolkit includes statistical tests and calculations based on open literature that calculate safeguards metrics. The tool can be used with user supplied datasets or with the several included datasets which are generated from models that are maintained at Sandia National Laboratories. The models are not included with the software. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525. SAND2021-0467 O

Shoman, Nathan↗

Statistical studies of animal response data from USF toxicity screening test method

Statistical examination of animal response data obtained using Procedure B of the USF toxicity screening test method indicates that the data deviate only slightly from a normal or Gaussian distribution. This slight departure from normality is not expected to invalidate conclusions based on theoretical statistics. Comparison of times to staggering, convulsions, collapse, and death as endpoints shows that time to death appears to be the most reliable endpoint because it offers the lowest probability of missed observations and premature judgements.

Hilado, C. J.↗

Experimental control in software reliability certification

There is growing interest in software 'certification', i.e., confirmation that software has performed satisfactorily under a defined certification protocol. Regulatory agencies, customers, and prospective reusers all want assurance that a defined product standard has been met. In other industries, products are typically certified under protocols in which random samples of the product are drawn, tests characteristic of operational use are applied, analytical or statistical inferences are made, and products meeting a standard are 'certified' as fit for use. A warranty statement is often issued upon satisfactory completion of a certification protocol. This paper outlines specific engineering practices that must be used to preserve the validity of the statistical certification testing protocol. The assumptions associated with a statistical experiment are given, and their implications for statistical testing of software are described.

Trammell, Carmen J.↗

The X square statistic and goodness of fit test

The X square statistic is a useful measure of the discrepancy between the actual distribution of a set of data points and the theoretical distribution of a random variable of which the data points supposedly are values. Thus the X square statistic is frequently used in goodness of fit tests.

Argentiero, P. D.↗

Automated vehicle microscopic energy consumption study (AV-Micro): Data collection and model development

While the Adaptive Cruise Control (ACC) system in automated vehicles (AVs) is expected to impact transportation energy significantly, existing AV energy consumption models only directly adopt those developed with Human-driven Vehicle (HV) data without even slight adaptation or calibration to accommodate unique AV energy consumption features. This study will investigate how accurately HV data-based models can predict the energy consumption of AVs. Empirical trajectory data and corresponding instantaneous energy consumption rates from both AVs and HVs were collected. We adopted two classical HV data-based models to fit these data. The calibration results indicated that these models yield around 20 30% prediction errors for AVs. To further improve the prediction accuracy, this study designed an AV-Micro model by incorporating components of multiple classic energy consumption models that better capture ACC energy consumption features, including piecewise driving behavior. With this, the AV-Micro model achieves lower than 10% prediction errors. The AV-Micro model’s high consistency across different test runs was verified with statistical significance tests, demonstrating its adaptability in different driving profiles. To confirm the discrepancies between the energy consumption features of AVs and HVs, more statistical significance tests were conducted to show that the AV-Micro model cannot be directly applied to HV data. The findings by calibrated AV-Micro models revealed that AVs consume approximately 80.5–146.4 J more energy than HVs for each meter traveled. Furthermore, the frequency analysis of energy consumption indicates that there is still some room for AVs to improve energy efficiency, particularly given their larger amplitude high-frequency fluctuations.

33 ADVANCED PROPULSION SYSTEMS↗

Improve Fuel Economy through Formulation Design and Modeling

The target of performance level of this project is overall FE >2% when a combination of Valvoline’s engine oil, axle oil and transmission fluid are applied to a medium duty Class-6 truck, which was measured by the SAE J1321 vehicle level fuel consumption test. The statistical analysis of test results showed that all four combinations of Valvoline’s five candidate oils have this potential at the 95% confidence.

02 PETROLEUM↗

On the appropriateness of applying chi-square distribution based confidence intervals to spectral estimates of helicopter flyover data

The validity of applying chi-square based confidence intervals to far-field acoustic flyover spectral estimates was investigated. Simulated data, using a Kendall series and experimental acoustic data from the NASA/McDonnell Douglas 500E acoustics test, were analyzed. Statistical significance tests to determine the equality of distributions of the simulated and experimental data relative to theoretical chi-square distributions were performed. Bias and uncertainty errors associated with the spectral estimates were easily identified from the data sets. A model relating the uncertainty and bias errors to the estimates resulted, which aided in determining the appropriateness of the chi-square distribution based confidence intervals. Such confidence intervals were appropriate for nontonally associated frequencies of the experimental data but were inappropriate for tonally associated estimate distributions. The appropriateness at the tonally associated frequencies was indicated by the presence of bias error and noncomformity of the distributions to the theoretical chi-square distribution. A technique for determining appropriate confidence intervals at the tonally associated frequencies was suggested.

Rutledge, Charles K.↗