Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “methods: statistical”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11

Reliability Models and Attributable Risk

The intention of this report is to bring a developing and extremely useful statistical methodology to greater attention within the Safety, Reliability, and Quality Assurance Office of the NASA Johnson Space Center. The statistical methods in this exposition are found under the heading of attributable risk. Recently the Safety, Reliability, and Quality Assurance Office at the Johnson Space Center has supported efforts to introduce methods of medical research statistics dealing with the survivability of people to bear on the problems of aerospace that deal with the reliability of component hardware used in the NASA space program. This report, which describes several study designs for which attributable risk is used, is in concert with the latter goals. The report identifies areas of active research in attributable risk while briefly describing much of what has been developed in the theory of attributable risk. The report, which largely is a report on a report, attempts to recast the medical setting and language commonly found in descriptions of attributable risk into the setting and language of the space program and its component hardware.

Jarvinen, Richard D.↗

Systematic analysis of coding and noncoding DNA sequences using methods of statistical linguistics

We compare the statistical properties of coding and noncoding regions in eukaryotic and viral DNA sequences by adapting two tests developed for the analysis of natural languages and symbolic sequences. The data set comprises all 30 sequences of length above 50 000 base pairs in GenBank Release No. 81.0, as well as the recently published sequences of C. elegans chromosome III (2.2 Mbp) and yeast chromosome XI (661 Kbp). We find that for the three chromosomes we studied the statistical properties of noncoding regions appear to be closer to those observed in natural languages than those of coding regions. In particular, (i) a n-tuple Zipf analysis of noncoding regions reveals a regime close to power-law behavior while the coding regions show logarithmic behavior over a wide interval, while (ii) an n-gram entropy measurement shows that the noncoding regions have a lower n-gram entropy (and hence a larger "n-gram redundancy") than the coding regions. In contrast to the three chromosomes, we find that for vertebrates such as primates and rodents and for viral DNA, the difference between the statistical properties of coding and noncoding regions is not pronounced and therefore the results of the analyses of the investigated sequences are less conclusive. After noting the intrinsic limitations of the n-gram redundancy analysis, we also briefly discuss the failure of the zeroth- and first-order Markovian models or simple nucleotide repeats to account fully for these "linguistic" features of DNA. Finally, we emphasize that our results by no means prove the existence of a "language" in noncoding DNA.

NASA Discipline Number 14-10↗

Why Use Geo-statistics For Nuclear Decommissioning Projects? - 15567

Before nuclear facilities are dismantled, and contaminated sites remediated, their initial radiological state must be characterized. Combining historical information, non-destructive measurements and lab analysis results, the statistical method of geo-statistics allows all available data for 2D or 3D contamination mapping to be integrated and enhanced, and helps quantify estimation uncertainties. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Multi-Axis Accelerometer Calibration System

A low-cost, portable, and simplified system has been developed that is suitable for in-situ calibration and/or evaluation of multi-axis inertial measurement instruments. This system overcomes facility restrictions and maintains or improves the calibration quality for users of accelerometer-based instruments with applications in avionics, experimental wind tunnel research, and force balance calibration applications. The apparatus quickly and easily positions a multi-axis accelerometer system into a precisely known orientation suitable for in-situ quality checks and calibration. In addition, the system incorporates powerful and sophisticated statistical methods, known as response surface methodology and statistical quality control. These methods improve calibration quality, reduce calibration time, and allow for increased calibration frequency, which enables the monitoring of instrument stability over time.

Finley, Tom↗

Quantifying uncertainty in analysis of shockless dynamic compression experiments on platinum. II. Bayesian model calibration

Dynamic shockless compression experiments provide the ability to explore material behavior at extreme pressures but relatively low temperatures. Typically, the data from these types of experiments are interpreted through an analytic method called Lagrangian analysis. Here, in this work, alternative analysis methods are explored using modern statistical methods. Specifically, Bayesian model calibration is applied to a new set of platinum data shocklessly compressed to 570 GPa. Several platinum equation-of-state models are evaluated, including traditional parametric forms as well as a novel non-parametric model concept. The results are compared to those in Paper I obtained by inverse Lagrangian analysis. The comparisons suggest that Bayesian calibration is not only a viable framework for precise quantification of the compression path, but also reveals insights pertaining to trade-offs surrounding model form selection, sensitivities of the relevant experimental uncertainties, and assumptions and limitations within Lagrangian analysis. The non-parametric model method, in particular, is found to give precise unbiased results and is expected to be useful over a wide range of applications. The calibration results in estimates of the platinum principal isentrope over the full range of experimental pressures to a standard error of 1.6%, which extends the results from Paper I while maintaining the high precision required for the platinum pressure standard.

Brown, Justin Lee↗

Statistical Influence

Advancing the spread and practice of statistics enhances an organization’s ability to successfully achieve their mission. While there may be leadership mandates to employ statistical methods, often the spread of statistical concepts flourishes more effectively through the practice of statistical influence. At first glance, the term influence may seem to imply a passive and unenthusiastic posture toward promoting organizational change. However, a classical definition states that ,“In a general sense, influence denotes power whose operation is invisible and known only by its effects, or a power whose cause and operation are unseen.” This definition articulates the powerful and yet subtle aspects of influence that embodies the theme of this presentation. Stated plainly, powerful statistical concepts become more widely known and engrained primarily through demonstrated impact; a strategy known only by its effects. In this presentation, elements of statistical influence are exemplified through practice at NASA.

Peter A. Parker↗

The National Climate Data Base (NCDB): A Bias-Corrected High-Resolution Climate Dataset

Assessing renewable energy resources under future climate scenarios has been highlighted in recent years to analyze and understand potential impacts of future change in renewable generation on the power sector. Solar energy is well-known as the most plentiful among various renewable resources and usually converted to electricity using photovoltaics (PV) technologies, and the global deployment of PV technology has increased rapidly in recent decades. In this study, we develop a statistical technique to downscale the future projection of solar irradiance for PV energy-related applications. A set of Regional Climate Model (RCM)-based projections obtained from the North American Coordinated Regional Climate Downscaling Experiment (NA-CORDEX) are used as inputs to statistical methods to generate high-resolution global horizontal irradiance (GHI) over the contiguous United States (CONUS). The main steps of the statistical downscaling method include (1) regridding RCM output (0.22 degree and daily resolutions) to handle the modeled-observed data sets on a common grid, (2) correcting bias of RCM GHI using satellite-derived observation, and (3) implementing temporal and spatial downscaling to generate GHI at 8-km and hourly resolution. Basically, complex physical processes and interactions between solar radiation and various atmospheric constituents lead solar irradiance to be highly variable and uncertain. Underrepresentation of clouds from the RCM parameterizations is the main source of error and uncertainty in modeling solar irradiance. Thus, we adapt and use the high-quality satellite-derived data from the National Solar Radiation Database (NSRDB) to analyze the bias and error of RCM GHI as well as estimate the statistical parameters for spatial and temporal downscaling. This presentation will summarize the comprehensive analysis conducted to produce and assess the results under two climate scenarios (RCP4.5 and RCP8.5). We will also present a detailed validation demonstrating the strengths of the proposed downscaling method and future extension of this research.

climate data↗

The National Climate Database (NCDB): An Unbiased 100-Year Dataset for PV Modeling

In this study, we develop a statistical technique to downscale the future projection of solar irradiance for photovoltaics (PV) energy-related applications. A set of Regional Climate Model (RCM)-based projections obtained from the North American Coordinated Regional Climate Downscaling Experiment (NA-CORDEX) are used as inputs to statistical methods to generate high-resolution global horizontal irradiance (GHI) over the contiguous United States (CONUS). The main steps of the statistical downscaling method include (1) regridding RCM output (0.22 degree and daily resolutions) to handle the modeled-observed data sets on a common grid, (2) correcting bias of RCM GHI using satellite-derived observation, and (3) implementing temporal and spatial downscaling to generate GHI at 8-km and hourly resolution. Basically, complex physical processes and interactions between solar radiation and various atmospheric constituents lead solar irradiance to be highly variable and uncertain. Underrepresentation of clouds from the RCM parameterizations is the main source of error and uncertainty in modeling solar irradiance. Thus, we adapt and use the high-quality satellite-derived data from the National Solar Radiation Database (NSRDB) to analyze the bias and error of RCM GHI as well as estimate the statistical parameters for spatial and temporal downscaling. This presentation will summarize the comprehensive analysis conducted to produce and assess the results under two climate scenarios (RCP4.5 and RCP8.5). We will also present a detailed validation demonstrating the strengths of the downscaling method, a summary of the 100-year dataset from 2001-2100, and future extension of this research.

bias correction↗

8760-Based Method for Representing Variable Generation Capacity Value in Capacity Expansion Models

Capacity expansion models (CEMs) are widely used to evaluate the least-cost portfolio of electricity generators, transmission, and storage needed to reliably serve load over many years or decades. CEMs can be computationally complex and are often forced to estimate key parameters using simplified methods to achieve acceptable solve times or for other reasons. In this paper, we discuss one of these parameters -- capacity value (CV). We first provide a high-level motivation for and overview of CV. We next describe existing modeling simplifications and an alternate approach for estimating CV that utilizes hourly '8760' data of load and VG resources. We then apply this 8760 method to an established CEM, the National Renewable Energy Laboratory's (NREL's) Regional Energy Deployment System (ReEDS) model (Eurek et al. 2016). While this alternative approach for CV is not itself novel, it contributes to the broader CEM community by (1) demonstrating how a simplified 8760 hourly method, which can be easily implemented in other power sector models when data is available, more accurately captures CV trends than a statistical method within the ReEDS CEM, and (2) providing a flexible modeling framework from which other 8760-based system elements (e.g., demand response, storage, and transmission) can be added to further capture important dynamic interactions, such as curtailment.

14 SOLAR ENERGY↗

Developing and applying quantifiable metrics for diagnostic and experiment design on Z

This project applies methods in Bayesian inference and modern statistical methods to quantify the value of new experimental data, in the form of new or modified diagnostic configurations and/or experiment designs. We demonstrate experiment design methods that can be used to identify the highest priority diagnostic improvements or experimental data to obtain in order to reduce uncertainties on critical inferred experimental quantities and select the best course of action to distinguish between competing physical models. Bayesian statistics and information theory provide the foundation for developing the necessary metrics, using two high impact experimental platforms on Z as exemplars to develop and illustrate the technique. We emphasize that the general methodology is extensible to new diagnostics (provided synthetic models are available), as well as additional platforms. We also discuss initial scoping of additional applications that began development in the last year of this LDRD.

97 MATHEMATICS AND COMPUTING↗

SU-F-P-64: The Impact of Plan Complexity Parameters On the Plan Quality and Deliverability of Volumetric Modulated Arc Therapy with Canonical Correlation Analysis

Purpose: To evaluate the impact of complexity indices on the plan quality and deliverability of volumetric modulated arc therapy (VMAT), and to determine the most significant parameters in the generation of an ideal VMAT plan. Methods: A multi-dimensional exploratory statistical method, canonical correlation analysis (CCA) was adopted to study the correlations between VMAT parameters of complexity, quality and deliverability, as well as their contribution weights with 32 two-arc VMAT nasopharyngeal cancer (NPC) patients and 31 one-arc VMAT prostate cancer patients. Results: The MU per arc (MU/Arc) and MU per control point (MU/CP) of NPC were 337.8±25.2 and 3.7±0.3, respectively, which were significantly lower than those of prostate cancer patients (MU/Arc : 506.9±95.4, MU/CP : 5.6±1.1). The plan complexity indices indicated that two-arc VMAT plans were more complex than one-arc VMAT plans. Plan quality comparison confirmed that one-arc VMAT plans had a high quality than two-arc VMAT plans. CCA results implied that plan complexity parameters were highly correlated with plan quality with the first two canonical correlations of 0.96, 0.88 (both p<0.001) and significantly correlated with deliverability with the first canonical correlation of 0.79 (p<0.001), plan quality and deliverability was also correlated with the first canonical correlation of 0.71 (p=0.02). Complexity parameters of MU/CP, segment area (SA) per CP, percent of MU/CP less 3 and planning target volume (PTV) were weighted heavily in correlation with plan quality and deliveability . Similar results obtained from individual NPC and prostate CCA analysis. Conclusion: Relationship between complexity, quality, and deliverability parameters were investigated with CCA. MU, SA related parameters and PTV volume were found to have strong effect on the plan quality and deliverability. The presented correlation among different quantified parameters could be used to improve the plan quality and the efficiency of the radiotherapy process when creating a complex VMAT plan.

60 APPLIED LIFE SCIENCES↗

AI for Science: Report on the Department of Energy (DOE) Town Halls on Artificial Intelligence (AI) for Science

The report documents the DOE Town Halls held during 2019 at Argonne National Laboratory, Oak Ridge National Laboratory, Lawrence Berkeley National Laboratory, and in Washington, DC. From July to October 2019, the Argonne, Oak Ridge, and Berkeley National Laboratories hosted a series of four town hall meetings attended by more than 1,000 U.S. scientists and engineers. The goal of the town hall series was to examine scientific opportunities in the areas of artificial intelligence (AI), Big Data, and high-performance computing (HPC) in the next decade, and to capture the big ideas, grand challenges, and next steps to realizing these opportunities. In this report and in the Department of Energy (DOE) laboratory community, we use the term “AI for Science” to broadly represent the next generation of methods and scientific opportunities in computing, including the development and application of AI methods (e.g., machine learning, deep learning, statistical methods, data analytics, automated control, and related areas) to build models from data and to use these models alone or in conjunction with simulation and scalable computing to advance scientific research. The AI for Science town hall discussions focused on capturing the transformational uses of AI that employ HPC and/or data analysis, leveraging data sets from HPC simulations or instruments and user facilities, and addressing scientific challenges unique to DOE user facilities and the agency’s wide-ranging fundamental and applied science enterprise.

36 MATERIALS SCIENCE↗

A criterion for establishing life limits

The development of a rigorous statistical method that would utilize hardware-demonstrated reliability to evaluate hardware capability and provide ground rules for safe flight margin is discussed. A statistical-based method using the Weibull/Weibayes cumulative distribution function is described. Its advantages and inadequacies are pointed out. Another, more advanced procedure, Single Flight Reliability (SFR), determines a life limit which ensures that the reliability of any single flight is never less than a stipulated value at a stipulated confidence level. Application of the SFR method is illustrated.

Skopp, G. H.↗

Estimating Software Reliability for Space Launch Vehicles in Probabilistic Risk Assessment (PRA)

It is acutely recognized in the Probabilistic Risk assessment (PRA) field that software plays a defining role in overall system reliability for all modern systems across a wide variety of industries. Regardless if the software is embedded firmware for working components or elements, part of a Human-Machine-Interface, or automated command and control logic, the success of the software to fulfill its function under nominal and off-nominal environments will be a dominant contributor to system reliability. It is also recognized that software reliability prediction and estimation is one of the more challenging and questionable aspects of any PRA or system analyses due to the nature of software and its integration with physics based systems. Irrespective of this dichotomy, any incorporation of software reliability methods requires that the contributions are accountable, quantitative, and tractable. This paper provides a brief overview of software reliability methods, establishes some minimum requirements that the methods should incorporate for completeness, and provides a logic structure for applying software reliability. Model resolution will be discussed that supports current testing plans and trade studies. We will provide initial recommendations for use in the NASA PRA and present a future dynamic option for software and PRA. Space Launch Vehicle Software is recognized to be reliable in static conditions, yet relatively vulnerable to a set of failure modes in changing environments/flight phases. Two quantitative methods were chosen to incorporate software reliability into a Space Launch Vehicle PRA accounting for phase adjustments. One method predicts latent software failure using statistical methods, and the second provides estimates of coding errors and software operating system failures based on test and historical data, respectively. Software uncertainty will also be discussed. We determined that recommendations for PRA software reliability should be modeled at the software module level where multiple software components compose a module and combinations of the software architecture can lead to a functional failure.

Novack, Steven↗

Estimating Software Reliability for Space Launch Vehicles in Probabilistic Risk Assessment (PRA)

It is acutely recognized in the Probabilistic Risk Assessment (PRA) field that software plays a defining role in overall system reliability for all modern systems across a wide variety of industries. Regardless of whether the software is embedded firmware for working components or elements, part of a Human-Machine-Interface, or automated command and control logic, the success of the software to fulfill its function under nominal and off-nominal environments will be a dominant contributor to system reliability. It is also recognized that software reliability prediction and estimation is one of the more challenging and questionable aspects of any PRA or system analyses due to the nature of software and its integration with physics based systems. Irrespective of this dichotomy, any incorporation of software reliability methods requires that the contributions are accountable, quantitative, and tractable. This paper provides a brief overview of software reliability methods, establishes some minimum requirements that the methods should incorporate for completeness, and provides a logic structure for applying software reliability. Model resolution will be discussed that supports current testing plans and trade studies. We will provide initial recommendations for use in the National Aeronautics and Space Administration (NASA) PRA and present a future dynamic option for software and PRA. Space Launch Vehicle software is recognized to be reliable in static conditions, yet relatively vulnerable to a set of failure modes in changing environments/flight phases. Two quantitative methods were chosen to incorporate software reliability into a Space Launch Vehicle PRA accounting for phase adjustments. One method predicts latent software failure using statistical methods, and the second provides estimates of coding errors and software operating system failures based on test and historical data. Software uncertainty will also be discussed. It is determined that recommendations for PRA software reliability should be modeled at the software module level where multiple software components compose a module and combinations of the software architecture can lead to a functional failure.

Steven D. Novack↗

Low Count and Background Radionuclides Analysis - 20488

The US Department of Energy (DOE) is often faced with the need to evaluate radionuclides at low concentrations. When site sample data are likely to be close to threshold activity concentrations of interest, then the means by which the radiochemical analysis is performed and reported is critical. This situation can occur when differentiating from zero (presence/absence) for radionuclides that do not occur naturally, close comparison with environmental background for naturally occurring radionuclides, close comparison with a risk- or dose-based threshold concentrations of interest, or even comparisons across studies. There are several analytical issues that are of concern, but the two that appear to cause incorrect decisions to be made most often involve establishing detection limits and subtracting ambient background conditions in the laboratory. These issues are not critical when radionuclide activity concentrations are large relative to thresholds of concern, but they seem to be poorly understood when it matters. When the comparisons are important and are likely to be close to a threshold of interest, then the general contract with the analytical laboratories needs to be changed so that the right or appropriate data are obtained. The concern is that important decisions are made incorrectly more often as greater scrutiny is placed on DoE's radionuclide cleanup or monitoring decisions by the public and other stakeholders. Examples are presented of problems that have been observed for different projects, both within and outside the realm of DOE and NRC remediation and radioactive waste disposal problems, and solutions are offered that should lead to better data from which important decisions need to be made. The first example is from Los Alamos National Laboratory (LANL) and involves radionuclide concentrations in soil and rock beneath LANL's Material Disposal Area (MDA) G. An initial review of the data led to a conclusion that americium and plutonium are a long way present beneath MDA G. A more thorough review of the data that accounted properly for ambient background and the detection limits that had been established led to the opposite conclusion. Another example is from the Nevada National Security Site where tritium results from one of the wells were unexpectedly high. Proper understanding and analysis of ambient background led to the conclusion that the increased concentrations were not so obvious, and that a different contract with the analytical laboratory was needed to provide more appropriate data to support a better determination. Other examples are used from regulatory review of projects in Nevada, where background levels and secular equilibrium for naturally occurring radionuclides are not established correctly because of analytical issues. The same basic issues have also been found to create difficulties analyzing historical data from the West Valley Demonstration Project. There is evidence in the data that the apparent lack of secular equilibrium where it is expected to exist is related to ambient background subtraction or other analytical issues. A final example is presented for analysis of Tc-99 in samples of depleted uranium. In this case, two different studies that were performed only three months apart provide quite different results. The US Environmental Protection Agency (EPA) established the data quality objectives (DQO) process in the mid-1980's to establish decision performance criteria for data collection. EPA guidance (EPA G-4, for example) clearly distinguishes between DQOs and measurement performance objectives (MQOs) that should be addressed for laboratory analysis of samples. The language of DQOs and MQOs has become confused over time it seems, and the subsequent effects seem to include a lack of attention to decision performance and a routine approach to measurement quality. In order to better address radionuclide sample analysis when the concentrations are close to thresholds of concern, which might be zero for some radionuclides, background for others, and risk-based thresholds for yet others, it is important that routine laboratory analysis methods are adjusted, and that the project team and the laboratory work closely together to ensure that the data meets the MQO requirements of laboratory analysis and reporting of results, and that the MQOs effectively support project-specific DQOs. This basic approach will be applied in Los Alamos in the coming year to the collection of moisture data from underneath MDA T that will be analyzed for americium and neptunium isotopes. Proper understanding of the radiochemistry methods and reporting, and of appropriate statistical methods is critical to the success of such projects, ensuring that the right decisions are made. (authors)

07 ISOTOPE AND RADIATION SOURCES↗