Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Statistical Testing Approach”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Development of an Uncertainty Model for the National Transonic Facility

This paper introduces an uncertainty model being developed for the National Transonic Facility (NTF). The model uses a Monte Carlo technique to propagate standard uncertainties of measured values through the NTF data reduction equations to calculate the combined uncertainties of the key aerodynamic force and moment coefficients and freestream properties. The uncertainty propagation approach to assessing data variability is compared with ongoing data quality assessment activities at the NTF, notably check standard testing using statistical process control (SPC) techniques. It is shown that the two approaches are complementary and both are necessary tools for data quality assessment and improvement activities. The SPC approach is the final arbiter of variability in a facility. Its result encompasses variation due to people, processes, test equipment, and test article. The uncertainty propagation approach is limited mainly to the data reduction process. However, it is useful because it helps to assess the causes of variability seen in the data and consequently provides a basis for improvement. For example, it is shown that Mach number random uncertainty is dominated by static pressure variation over most of the dynamic pressure range tested. However, the random uncertainty in the drag coefficient is generally dominated by axial and normal force uncertainty with much less contribution from freestream conditions.

Walter, Joel A.↗

Evaluation of PCR Systems for Field Screening of Bacillus anthracis

There is little published data on the performance of hand-portable polymerase chain reaction (PCR) instruments that could be used by first responders to determine if a suspicious powder contains a potential biothreat agent. We evaluated five commercially available hand-portable PCR instruments for detection of Bacillus anthracis (Ba). We designed a cost-effective, statistically-based test plan that allows instruments to be evaluated at performance levels ranging from 0.85-0.95 lower confidence bound (LCB) on the probability of detection (POD) at confidence levels of 80-95%. We assessed specificity using purified genomic DNA from 13 Ba strains and 18 Bacillus near neighbors, interference with 22 common hoax powders encountered in the field, and PCR inhibition when Ba spores were spiked into these powders. Our results indicated that three of the five instruments achieved >0.95 LCB on the POD with 95% confidence at test concentrations of 2,000 genome equivalents/mL (comparable to 2,000 spores/mL), displaying more than sufficient sensitivity for screening suspicious powders. These instruments exhibited no false positive results or PCR inhibition with common hoax powders, and reliably detected Ba spores spiked into common hoax powders, though some issues with instrument controls were observed. Our testing approach enables efficient instrument performance testing to a statistically rigorous and cost-effective test plan to generate performance data that will allow users to make informed decisions regarding the purchase and use of biodetection equipment in the field.

59 BASIC BIOLOGICAL SCIENCES↗

Understanding Dynamical Systems in High-Dimensional Parameter Spaces (Final Report)

In the last few decades, computational models, especially of the complex dynamical systems of greatest interest, i.e., climate, high energy density science, combustion, etc. have become increasingly accurate and sophisticated. Consequently, they are now routinely used to predict outcomes of experiments or to inform design decisions. However, many such simulations depend on a (large) number of parameters in order to, for example, approximate physical phenom whose exact solution is unknown or describe material properties in situations with little or no experimental data. Choosing these parameters and understanding how the outcomes of such a simulation changes with respect to the inputs are rapidly becoming some of the primary challenges in many application areas. Simulations have long been too complex for humans to fully comprehend and thus are often treated as black-box systems. The inputs to the systems are typically a collection of parameters with expert-selected ranges, and the outputs are various quantities of interest (QoIs) describing the performance of the system. Therefore, the fundamental challenge can be described as one of understanding a high-dimensional (many input parameters), multi-variate (many QoIs) function. Unfortunately, existing analysis tools are only of limited use for this task as most techniques can neither deal with many input dimensions nor offer opportunities to jointly study several QoIs. Furthermore, data analysis has long relied on an exploratory process in which scientist first visualize the available data, for example, using scatter plots or 3D renderings, form new hypotheses on some phenomena of interest, and subsequently test these hypotheses using dedicated analysis or statistics approaches. However, for high-dimensional functions this exploration is difficult if not impossible using existing tools as there are too many QoIs to simultaneously observe, and visualizations of high-dimensional spaces are abstract and difficult to understand if they exist at all. The goal of this project is to build new analysis techniques and tool that offer high level insights for exploring high-dimensional scientific data. And to extend existing approach beyond single scalar functions and instead consider multiple QoIs simultaneously.

97 MATHEMATICS AND COMPUTING↗

Material Control & Accounting Modeling Developments for a Generic TRISO Fuel Fabrication Facility

The Material Protection, Accounting, and Control Technologies (MPACT) program utilizes modeling and simulation to assess Material Control and Accountability (MC&A) concerns for a variety of nuclear facilities. The Sandia National Laboratories (SNL)-developed Fissile Facility Flow Modeler (F3M) and the Material Accountancy Performance Indicator Toolkit (MAPIT) have historically provided MPACT with the capability to analyze MC&A approaches for nuclear facilities to determine that these facilities meet regulatory requirements. In FY25, improvements on the application of the F3M and MAPIT tools to simulate a generic TRi-structural ISOtropic (TRISO) fuel fabrication facility were successfully completed. The generic TRISO fuel fabrication F3M model captures the entire TRISO fuel fabrication process and is adaptable to any final TRISO fuel form, including spherical pebbles and cylindrical compacts loaded into graphite prismatic blocks. Comprehensive F3M/MAPIT functionality for the generic TRISO fuel fabrication model has been demonstrated. This modeling framework can be applied to support the U.S. Department of Energy and domestic nuclear industry stakeholders in developing MC&A approaches for advanced fuel fabrication facilities via statistical tests that demonstrate compliance to regulatory requirements.

97 MATHEMATICS AND COMPUTING↗

Safeguarding a Lunar Rover with Wald's Sequential Probability Ratio Test

The virtual bumper is a safeguarding mechanism for autonomous and remotely operated robots. In this paper we take a new approach to the virtual bumper system by using an old statistical test. By using a modified version of Wald's sequential probability ratio test we demonstrate that we can reduce the number of false positive reported by the virtual bumper, thereby saving valuable mission time. We use the concept of sequential probability ratio to control vehicle speed in the presence of possible obstacles in order to increase certainty about whether or not obstacles are present. Our new algorithm reduces the chances of collision by approximately 98 relative to traditional virtual bumper safeguarding without speed control.

safeguarding↗

Improved Test Planning and Analysis Through the Use of Advanced Statistical Methods

The goal of this work is, through computational simulations, to provide statistically-based evidence to convince the testing community that a distributed testing approach is superior to a clustered testing approach for most situations. For clustered testing, numerous, repeated test points are acquired at a limited number of test conditions. For distributed testing, only one or a few test points are requested at many different conditions. The statistical techniques of Analysis of Variance (ANOVA), Design of Experiments (DOE) and Response Surface Methods (RSM) are applied to enable distributed test planning, data analysis and test augmentation. The D-Optimal class of DOE is used to plan an optimally efficient single- and multi-factor test. The resulting simulated test data are analyzed via ANOVA and a parametric model is constructed using RSM. Finally, ANOVA can be used to plan a second round of testing to augment the existing data set with new data points. The use of these techniques is demonstrated through several illustrative examples. To date, many thousands of comparisons have been performed and the results strongly support the conclusion that the distributed testing approach outperforms the clustered testing approach.

Green, Lawrence L.↗

A Statistical Approach to Safety Margin Evaluation of Irradiation Experiments in the ATR

The current safety basis of the INL Advanced Test Reactor requires that irradiation experiments meet minimum safety margins to critical heat flux and flow instability during anticipated reactor fault conditions. Compliance to these requirements may be demonstrated by calculating safety margins using safety factors that account for uncertainties, or using a statistical approach to quantify the uncertainty in the safety margins. Safety margins obtained from the first approach are conservative since the individual events leading to the cumulative safety factor are assumed to occur simultaneously at their maximum uncertainty. The statistical approach is less conservative in the case where the uncertainties are not too large, and may reduce the conservatism resulting from an overabundance of safety factors. This report describes the procedure for safety margin evaluation using a statistical approach and identifies the important thermal-hydraulic variables to consider in an uncertainty analysis. In particular, safety margins to critical heat flux and flow instability are evaluated for three recent high power fueled experiments (MP-1, FSP-1 and AFIP-6) using RELAP5 coupled to RAVEN to perform statistical analysis and uncertainty quantification. The results demonstrate adequate safety margins to critical heat flux and flow instability during an anticipated loss of commercial power to the reactor.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

A Method for Retrieving Ground Flash Fraction from Satellite Lightning Imager Data

A general theory for retrieving the fraction of ground flashes in N lightning observed by a satellite-based lightning imager is provided. An "exponential model" is applied as a physically reasonable constraint to describe the measured optical parameter distributions, and population statistics (i.e., mean, variance) are invoked to add additional constraints to the retrieval process. The retrieval itself is expressed in terms of a Bayesian inference, and the Maximum A Posteriori (MAP) solution is obtained. The approach is tested by performing simulated retrievals, and retrieval error statistics are provided. The ability to retrieve ground flash fraction has important benefits to the atmospheric chemistry community. For example, using the method to partition the existing satellite global lightning climatology into separate ground and cloud flash climatologies will improve estimates of lightning nitrogen oxides (NOx) production; this in turn will improve both regional air quality and global chemistry/climate model predictions.

Koshak, William J.↗

An Exact and Near-Exact Distribution Approach to the Behrens–Fisher Problem

The Behrens–Fisher problem occurs when testing the equality of means of two normal distributions without the assumption that the two variances are equal. This paper presents approaches based on the exact and near-exact distributions for the test statistic of the Behrens–Fisher problem, depending on different combinations of even or odd sample sizes. We present the exact distribution when both sample sizes are odd and the near-exact distribution when one or both sample sizes are even. The near-exact distributions are based on a finite mixture of generalized integer gamma (GIG) distributions, used as an approximation to the exact distribution, which consists of an infinite series. The proposed tests, based on the exact and the near-exact distributions, are compared with Welch’s t-test through Monte Carlo simulations, in particular for small and unbalanced sample sizes. The results show that the proposed approaches are competent solutions to the Behrens–Fisher problem, exhibiting precise sizes and better powers than Welch’s approach for those cases. Numerical studies show that the Welch’s t-test tends to be a bit more conservative than the test statistics based on the exact or near-exact distribution, in particular when sample sizes are small and unbalanced, situations in which the proposed exact or near-exact distributions obtain higher powers than Welch’s t-test.

Hong, Serim↗

Reducing Communication Overhead in Federated Learning for Network Anomaly Detection with Adaptive Client Selection

Communication overhead in federated learning (FL) poses a significant challenge for network anomaly detection systems, where the myriad of client configurations and network conditions can severely impact system efficiency and detection accuracy. While existing approaches attempt to address this through individual optimization techniques, they often fail to maintain the delicate balance between reduced overhead and detection performance. This paper presents an adaptive FL framework that dynamically combines batch size optimization, client selection, and asynchronous updates to achieve efficient anomaly detection. Through extensive profiling and experimental analysis on two distinct datasets-UNSW-NBIS for general network traffic and ROAD for automotive networks-our framework reduces communication overhead by 97.6%; (from 700.0s to 16.8s) compared to synchronous baseline approaches while maintaining comparable detection accuracy (95.10%; vs. 95.12%;). Statistical validation using Mann-Whitney U test confirms significant improvements (p < 0.05) over existing FL approaches across both datasets, demonstrating the framework's adaptability to different network security contexts. Detailed profiling analysis reveals the efficiency gains through dramatic reductions in GPU operations and memory transfers while maintaining robust detection performance under varying client conditions.

Marfo, William [University of Texas at El Paso]↗

Evaluation of a Head-Worn Display System as an Equivalent Head-Up Display for Low Visibility Commercial Operations

Research, development, test, and evaluation of fight deck interface technologies is being conducted by the National Aeronautics and Space Administration (NASA) to proactively identify, develop, and mature tools, methods, and technologies for improving overall aircraft safety of new and legacy vehicles operating in the Next Generation Air Transportation System (NextGen). One specific area of research was the use of small Head-Worn Displays (HWDs) to serve as a possible equivalent to a Head-Up Display (HUD). A simulation experiment and a fight test were conducted to evaluate if the HWD can provide an equivalent level of performance to a HUD. For the simulation experiment, airline crews conducted simulated approach and landing, taxi, and departure operations during low visibility operations. In a follow-on fight test, highly experienced test pilots evaluated the same HWD during approach and surface operations. The results for both the simulation and fight tests showed that there were no statistical differences in the crews' performance in terms of approach, touchdown and takeoff; but, there are still technical hurdles to be overcome for complete display equivalence including, most notably, the end-to-end latency of the HWD system.

Arthur, Jarvis (Trey) J., III↗

Advanced Techniques for Assessment of Postural and Locomotor Ataxia, Spatial Orientation, and Gaze Stability

In addition to adapting to microgravity, major neurovestibular problems of space flight include postflight difficulties with standing, walking, turning corners, and other activities that require stable upright posture and gaze stability. These difficulties inhibit astronauts' ability to stand or escape from their vehicle during emergencies. The long-ter7n goal of the NSBRI is the development of countermeasures to ameliorate the effects of long duration space flight. These countermeasures must be tested with valid and reliable tools. This project aims to develop quantitative, parametric approaches for assessing gaze stability and spatial orientation during normal gait and when gait is perturbed. Two of this year's most important findings concern head fixation distance and ideal trajectory analysis. During a normal cycle of walking the head moves up and down linearly. A simultaneous angular pitching motion of the head keeps it aligned toward an imaginary point in space at a distance of about one meter in front of a subject and along the line of march. This distance is called the head fixation distance. Head fixation distance provides the fundamental framework necessary for understanding the functional significance of the vestibular reflexes that couple head motion to eye motion. This framework facilitates the intelligent design of counter-measures for the effects of exposure to microgravity upon the vestibular ocular reflexes. Ideal trajectory analysis is a simple candidate countermeasure based upon quantifying body sway during repeated up and down stair stepping. It provides one number that estimates the body sway deviation from an ideal sinusoidal body sway trajectory normalized on the subject's height. This concept has been developed with NSBRI funding in less than one year. These findings are explained in more detail below. Compared to assessments of the vestibuo-ocular reflex, analysis of vestibular effects on locomotor function is relatively less well developed and quantified. We are improving this situation by applying methodologies such as nonlinear orbital stability to quantify responses and by using multivariate statistical approaches to link together the responses across separate tests. In this way we can exploit the information available and increase the ability to discriminate between normal and pathological responses. Measures of stability and orientation are compared to measures such as dynamic visual acuity and with balance function tests. The responses of normal human subjects and of patients having well documented pathophysiologies are being characterized. When these studies are completed, we should have a clearer idea about normal and abnormal patterns of eye, head, and body movements during locomotion and their stability in a wide range of environments. We plan eventually to use this information to validate the efficacy of candidate neurovestibular and neuromuscular rehabilitative techniques. Some representative studies made during this year are summarized.

Wall, Conrad., III↗

Tools for Water Ingress Testing

The Safety Storage and Engineering Team, as part of the Production Support Services division (PSS-2), is tasked with ensuring the safety of containers used for handling and storage of nuclear materials. As part of this work, water ingress tests are conducted to evaluate the water-tightness of containers intended for in-glovebox use. In collaboration, the statistics group of the Computer and Computational Sciences Division (CCS-6) provided support in developing a statistically defensible approach for determining appropriate sample sizes for water ingress testing. Water ingress testing involves multiple measurements on multiple containers. Our approach uses a simple random effects model to analyze a pilot data set, implementing prediction limits to evaluate the efficacy of collecting additional data. Although this study capitalizes on available data, our approach can be used with estimates of the ratio of between and within variability and average values, often available from past testing or expert knowledge. An interactive Shiny tool was developed as a final user-friendly product for future testing. The Shiny interface is an open-source package providing a framework for building web applications. Raw data exploration and prediction interval-based sample size assessments can quickly be conducted by the engineering team without needing to interact with the underlying code.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

X-ray digital industrial radiography (DIR) for local liquid velocity (V{sub LL}) measurement in trickle bed reactors (TBRs): Validation of the technique

Local liquid velocity measurements in Trickle Bed Reactors (TBRs) are one of the essential components in its hydrodynamic studies. These measurements are used to effectively determine a reactor's operating condition. This study was conducted to validate a newly developed technique that combines Digital Industrial Radiography (DIR) with Particle Tracking Velocimetry (PTV) to measure the Local Liquid Velocity (V{sub LL}) inside TBRs. Three millimeter-sized Expanded Polystyrene (EPS) beads were used as packing material. Three validation procedures were designed to test the newly developed technique. All procedures and statistical approaches provided strong evidence that the technique can be used to measure the V{sub LL} within TBRs.

42 ENGINEERING↗

Verification of Maximal Oxygen Uptake in Active Military Personnel During Treadmill Running

Figueiredo, PS, Looney, DP, Pryor, JL, Doughty, EM, McClung, HL, Vangala, SV, Santee, WR, Beidleman, BA, and Potter, AW. Verification of maximal oxygen uptake in active military personnel during treadmill running. J Strength Cond Res 36(4): 1053–1058, 2022—It is unclear whether verification tests are required to confirm “true” maximal oxygen uptake ($\dot{V}_{o2}$max) in modern warfighter populations. Our study investigated the prevalence of $\dot{V}_{o2}$max attainment in U.S. Army soldiers performing a traditional incremental running test. In addition, we examined the utility of supramaximal verification testing as well as repeated trials for familiarization for accurate $\dot{V}_{o2}$max assessment. Sixteen U.S. Army soldiers (1 woman, 15men; age, 21±2 years; height, 1.73±0.06m; body mass, 71.6±10.1 kg) completed 2 laboratory visits, each with an incremental running test (modified Astrand protocol) and a verification test (110% maximal incremental test speed) on a motorized treadmill. We evaluated $\dot{V}_{o2}$max attainment during incremental testing by testing for the definitive $\dot{V}_{o2}$ plateau using a linear least-squares regression approach. Peak oxygen uptake ($\dot{V}_{o2}$peak) was considered statistically equivalent between tests if the 90% confidence interval around the mean difference was within 62.1 ml·kg -1 ·min -1 . Oxygen uptake plateaus were identified in 14 of 16 volunteers for visit 1 (87.5%) and all 16 volunteers for visit 2 (100%). Peak oxygen uptake was not statistically equivalent, apparent from the mean difference in $\dot{V}_{o2}$peak measures between the incremental test and verification test on visit 1 (2.3 ml·kg -1 ·min -1 , [1.3–3.2]) or visit 2 (1.1 ml·kg -1 ·min -1 [0.2–2.1]). Interestingly, $\dot{V}_{o2}$peak was equivalent, apparent from the mean difference in $\dot{V}_{o2}$peak measures between visits for the incremental tests (0.0ml·kg -1 ·min -1 [-0.8to 0.9]) but not the verification tests (-1.2 ml·kg -1 ·min -1 [-2.2 to -0.2]). Modern U.S. Army soldiers can attain $\dot{V}_{o2}$max by performing a modified Astrand treadmill running test. Additional familiarization and verification tests for confirming $\dot{V}_{o2}$max in healthy active military personnel may be unnecessary.

60 APPLIED LIFE SCIENCES↗

The precise time-dependent solution of the Fokker–Planck equation with anomalous diffusion

We study the time behavior of the Fokker–Planck equation in Zwanzig’s rule (the backward-Ito’s rule) based on the Langevin equation of Brownian motion with an anomalous diffusion in a complex medium. The diffusion coefficient is a function in momentum space and follows a generalized fluctuation–dissipation relation. We obtain the precise time-dependent analytical solution of the Fokker–Planck equation and at long time the solution approaches to a stationary power-law distribution in nonextensive statistics. As a test, numerically we have demonstrated the accuracy and validity of the time-dependent solution. - Highlights: • The precise time-dependent solution of the Fokker–Planck equation with anomalous diffusion is found. • The anomalous diffusion satisfies a generalized fluctuation–dissipation relation. • At long time the time-dependent solution approaches to a power-law distribution in nonextensive statistics. • Numerically we have demonstrated the accuracy and validity of the time-dependent solution.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Statistics for Testing Under Adverse Conditions

Here we develop a statistical basis for limited adverse testing. This type of testing simultaneously evaluates system performances against minimum requirements and minimizes costs, particularly for large scale engineering projects. Because testing is often expensive and narrow in scope, the data obtained is relatively limited—precisely the opposite of the recent “large data” movement but no less compelling. Although a remarkably common approach for industrial and large-scale government projects, a statistical basis for adverse testing remains poorly explored. Here we prove mathematically, under specific conditions, that setting each independent variable to an adverse condition leads to a similar level of adversity in the dependent variable. For example, setting all normally distributed independent variables to at least their 95th percentile values leads to a result at the 95th percentile. The analysis considers sample size estimates to clarify the value of replicates in this type of testing, determines how many of the independent variables must be set to adverse condition values, and highlights the essential assumptions, so that engineers, statisticians, and subject matter experts know when this statistical framework may be applied successfully.

42 ENGINEERING↗

Statistical Sampling Plan for AGR-5/6/7 Fuel Materials

Kernels, coated particles, and compacts will be manufactured to predefined specifications for irradiation in the AGR 5/6/7 experiments. Many tests will be performed for quality assurance and most of these tests correspond to criteria that have to be met with 95% confidence, based on random samples. This report describes the statistical acceptance testing methods and gives minimum sample sizes for kernels to achieve 95% confidence. Coated particles and compacts will be addressed in revisions to this report. The methods used for sample size determination are described in detail in INL/EXT 05 00349, Statistical Methods Handbook for Advanced Gas Reactor Fuel Materials (Einerson 2005). The statistical approach is to collect a representative sample, apply an acceptance test to the sample, and accept or reject the product based on this test for each criterion. The criteria or “product specifications” are contained in SPC-1352, “AGR 5/6/7 Fuel Specification,” Revision 1 and are duplicated in this plan.