Engineering PapersSearch

SEARCH · Engineering Papers

Results for “hypothesis testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

The influence of land-atmosphere interactions on variability of the North American Monsoon

Our project focused on the influence of land-atmosphere interactions on variability of North American Monsoon System (NAMS) precipitation is summarized in seven published manuscripts (listed below). Three of these manuscripts (Matsui et al. 2003; Matsui et al. 2005; Small and Kurc 2003) were completed solely with support from this NASA project. The remaining four were completed with additional support from NOAA. Our primary results are summarized: 1) Test of Rocky Mountains snowcover-NAMS rainfall hypothesis. Testing radiation and convective precipitation parameterization in MM5. Analysis of soil moisture-radiation feedbacks in semiarid environments from field observations and modeling.

Small, Eric

Characterization of Machine Variability and Progressive Heat Treatment in Selective Laser Melting of Inconel 718

The absence of an economy of scale in spaceflight hardware makes additive manufacturing an immensely attractive option for propulsion components. As additive manufacturing techniques are increasingly adopted by government and industry to produce propulsion hardware in human-rated systems, significant development efforts are needed to establish these methods as reliable alternatives to conventional subtractive manufacturing. One of the critical challenges facing powder bed fusion techniques in this application is variability between machines used to perform builds. Even with implementation of robust process controls, it is possible for two machines operating at identical parameters with equivalent base materials to produce specimens with slightly different material properties. The machine variability study presented here evaluates 60 specimens of identical geometry built using the same parameters. 30 samples were produced on machine 1 (M1) and the other 30 samples were built on machine 2 (M2). Each of the 30-sample sets were further subdivided into three subsets (with 10 specimens in each subset) to assess the effect of progressive heat treatment on machine variability. The three categories for post-processing were: stress relief, stress relief followed by hot isostatic press (HIP), and stress relief followed by HIP followed by heat treatment per AMS 5664. Each specimen (a round, smooth tensile) was mechanically tested per ASTM E8. Two formal statistical techniques, hypothesis testing for equivalency of means and one-way analysis of variance (ANOVA), were applied to characterize the impact of machine variability and heat treatment on six material properties: tensile stress, yield stress, modulus of elasticity, fracture elongation, and reduction of area. This work represents the type of development effort that is critical as NASA, academia, and the industrial base work collaboratively to establish a path to certification for additively manufactured parts. For future flight programs, NASA and its commercial partners will procure parts from vendors who will use a diverse range of machines to produce parts and, as such, it is essential that the AM community develop a sound understanding of the degree to which machine variability impacts material properties.

Prater, T.

Characterization of Machine Variability and Progressive Heat Treatment in Selective Laser Melting of Inconel 718

The absence of an economy of scale in spaceflight hardware makes additive manufacturing an immensely attractive option for propulsion components. As additive manufacturing techniques are increasingly adopted by government and industry to produce propulsion hardware in human‐rated systems, significant development efforts are needed to establish these methods as reliable alternatives to conventional subtractive manufacturing. One of the critical challenges facing powder bed fusion techniques in this application is variability between machines used to perform builds. Even with implementation of robust process controls, it is possible for two machines operating at identical parameters with equivalent base materials to produce specimens with slightly different material properties. The machine variability study presented here evaluates 60 specimens of identical geometry built using the same parameters. 30 samples were produced on machine 1 (M1) and the other 30 samples were built on machine 2 (M2). Each of the 30‐sample sets were further subdivided into three subsets (with 10 specimens in each subset) to assess the effect of progressive heat treatment on machine variability. The three categories for post‐processing were: stress relief, stress relief followed by hot isostatic press (HIP), and stress relief followed by HIP followed by heat treatment per AMS 5664. Each specimen (a round, smooth tensile) was mechanically tested per ASTM E8. Two formal statistical techniques, hypothesis testing for equivalency of means and one‐way analysis of variance (ANOVA), were applied to characterize the impact of machine variability and heat treatment on six material properties: tensile stress, yield stress, modulus of elasticity, fracture elongation, and reduction of area. This work represents the type of development effort that is critical as NASA, academia, and the industrial base work collaboratively to establish a path to certification for additively manufactured parts. For future flight programs, NASA and its commercial partners will procure parts from vendors who will use a diverse range of machines to produce parts and, as such, it is essential that the AM community develop a sound understanding of the degree to which machine variability impacts material properties.

Prater, Tracie

Upwind Buildings Effects on Test Section Performance of the NFAC 80- by 120-Foot Wind Tunnel

In 2013, a new development began that would put multi-story buildings within the exclusion zone of the 80- by 120- Foot Wind Tunnel (80x120) inlet that exceeded the then existing building height restriction. This raised questions concerning whether the tunnel could operate within the acceptable turbulence limits of ≤ 0.5% in the axial direction over 75% area in the wind tunnel test section. The goal of this testing was to determine the validity of this hypothesis. Testing was performed using the 1/50th-scale model of the 80- by 120-FootWind Tunnel within the full-scale facility test section to characterize the model’s test section turbulence levels as a function of wind direction with the presence of the upwind buildings that are currently being constructed. This paper reports the first testing performed to date on the 80x120 inlet as-built under controlled test conditions for wind magnitude and wind onset direction for a variety of buildings in the inlet external flow field, including no buildings (the control case). This testing determined that, at rated operational conditions the upwind blockages caused no increase in turbulence intensity levels measured in the test section and, in some limited cases, caused the turbulence levels to decrease. Lastly, looking at generic rectangular blockages showed that, to have a discernible effect on test section turbulence levels, scaled 100-ft tall blockages need to be within 600 ft of the existing inlet.

Upwind Buildings Effects

An algorithmic approach to crustal deformation analysis

In recent years the analysis of crustal deformation measurements has become important as a result of current improvements in geodetic methods and an increasing amount of theoretical and observational data provided by several earth sciences. A first-generation data analysis algorithm which combines a priori information with current geodetic measurements was proposed. Relevant methods which can be used in the algorithm were discussed. Prior information is the unifying feature of this algorithm. Some of the problems which may arise through the use of a priori information in the analysis were indicated and preventive measures were demonstrated. The first step in the algorithm is the optimal design of deformation networks. The second step in the algorithm identifies the descriptive model of the deformation field. The final step in the algorithm is the improved estimation of deformation parameters. Although deformation parameters are estimated in the process of model discrimination, they can further be improved by the use of a priori information about them. According to the proposed algorithm this information must first be tested against the estimates calculated using the sample data only. Null-hypothesis testing procedures were developed for this purpose. Six different estimators which employ a priori information were examined. Emphasis was put on the case when the prior information is wrong and analytical expressions for possible improvements under incompatible prior information were derived.

Iz, Huseyin Baki

Fault detection using a two-model test for changes in the parameters of an autoregressive time series

This article describes an investigation of a statistical hypothesis testing method for detecting changes in the characteristics of an observed time series. The work is motivated by the need for practical automated methods for on-line monitoring of Deep Space Network (DSN) equipment to detect failures and changes in behavior. In particular, on-line monitoring of the motor current in a DSN 34-m beam waveguide (BWG) antenna is used as an example. The algorithm is based on a measure of the information theoretic distance between two autoregressive models: one estimated with data from a dynamic reference window and one estimated with data from a sliding reference window. The Hinkley cumulative sum stopping rule is utilized to detect a change in the mean of this distance measure, corresponding to the detection of a change in the underlying process. The basic theory behind this two-model test is presented, and the problem of practical implementation is addressed, examining windowing methods, model estimation, and detection parameter assignment. Results from the five fault-transition simulations are presented to show the possible limitations of the detection method, and suggestions for future implementation are given.

Scholtz, P.

Vector wind profile gust model

To enable development of a vector wind gust model suitable for orbital flight test operations and trade studies, hypotheses concerning the distributions of gust component variables were verified. Methods for verification of hypotheses that observed gust variables, including gust component magnitude, gust length, u range, and L range, are gamma distributed and presented. Observed gust modulus has been drawn from a bivariate gamma distribution that can be approximated with a Weibull distribution. Zonal and meridional gust components are bivariate gamma distributed. An analytical method for testing for bivariate gamma distributed variables is presented. Two distributions for gust modulus are described and the results of extensive hypothesis testing of one of the distributions are presented. The validity of the gamma distribution for representation of gust component variables is established.

Adelfang, S. I.

Individual Response Trends to Urban Air Mobility Noise in A Laboratory Study

Advanced Air Mobility, of which Urban Air Mobility (UAM) is a subset, presents new opportunities for more dynamic aviation transportation systems. It is essential to understand the human response to the noise of these vehicles for sustainable operations. This research aims to investigate the relationship between the noise level and number of events on individual human annoyance to UAM vehicle noise. A “noise and number” laboratory psychoacoustic study was conducted in the Exterior Effects Room at NASA Langley Research Center in January 2023. A total of 38 participants listened to 4-minute audio clips of UAM vehicle flyover noise and provided their annoyance response on an 11-point numerical scale. A test hypothesis was that annoyance to multiple flyovers can be found by adding the annoyance responses to individual flyovers. Results for the overall test subject pool suggest that annoyance grows faster than hypothesized as the number of aircraft events increases. This trend of faster annoyance growth only seems to hold when the individual flyovers are heard as distinct events. Parsing the data down to individuals provides further insight into the mechanisms contributing to the increased annoyance with number of events.

noise and number

Sequential Wald Test Employing a Constrained Filter Bank: Application to Spacecraft Conjunctions

A binary Wald sequential probability ratio test that uses the residuals of norm-inequality-constrained Kalman filters for its likelihood ratio may be employed for a class of compound hypothesis tests on non-stationary systems. The hypotheses concern an inequality constraint on the norm of some elements of the system state. Each of two filters minimizes the summed-squares of its estimation errors subject to one or the other direction of the inequality constraint. This solution is motivated by the problem of satellite conjunction assessment, wherein the constraint concerns the close approach distance between two space objects. The outcome of the test can inform decisions concerning risk mitigation maneuvers.

J. Russell Carpenter

Satellite Conjunction Assessment Risk Analysis for "Dilution Region" Events: Issues and Operational Approaches

An important activity within Space Traffic Management is the detection and prevention of possible on-orbit collisions between space objects. The principal parameter for assessing collision likelihood is the probability of collision, which is widely accepted among conjunction assessment practitioners; but it possesses a known deficiency in that it can produce a false sense of safety when the orbital position uncertainties for the conjuncting objects are high. The probability of collision is said to be “diluted” in such a situation and to understate the possible risk; certain approaches have been recommended by researchers to provide (largely conservative) risk estimates and remediation methodologies in these cases. The present analysis explores two of the main proposals for quantifying and remediating possible risk in the dilution region and quantifies their operational implications. These implications with regard to imputed additional workload are considerable, especially in anticipating the conjunction event levels expected with the deployment of the USAF Space Fence radar. This effort has been undertaken as part of a larger enterprise that seeks to clarify the philosophical and statistical underpinnings of the conjunction risk assessment process. The analysis presented herein argues that a form of hypothesis testing is implicitly used in conjunction assessment risk analysis, and that there are a number of conceptual and practical reasons for constructing the associated null hypothesis to counsel against a satellite conjunction remediation action. In short, it is concluded that, for the purposes of determining whether a conjunction remediation action should be pursued, dilution-region probabilities of collision should be treated no differently from those produced under other circumstances.

Probability of collision

Surveillance system and method having an adaptive sequential probability fault detection test

System and method providing surveillance of an asset such as a process and/or apparatus by providing training and surveillance procedures that numerically fit a probability density function to an observed residual error signal distribution that is correlative to normal asset operation and then utilizes the fitted probability density function in a dynamic statistical hypothesis test for providing improved asset surveillance.

Herzog, James P.

Surveillance system and method having an adaptive sequential probability fault detection test

System and method providing surveillance of an asset such as a process and/or apparatus by providing training and surveillance procedures that numerically fit a probability density function to an observed residual error signal distribution that is correlative to normal asset operation and then utilizes the fitted probability density function in a dynamic statistical hypothesis test for providing improved asset surveillance.

Bickford, Randall L.

Surveillance System and Method having an Adaptive Sequential Probability Fault Detection Test

System and method providing surveillance of an asset such as a process and/or apparatus by providing training and surveillance procedures that numerically fit a probability density function to an observed residual error signal distribution that is correlative to normal asset operation and then utilizes the fitted probability density function in a dynamic statistical hypothesis test for providing improved asset surveillance.

Bickford, Randall L.

Automated system function allocation and display format: Task information processing requirements

An important consideration when designing the interface to an intelligent system concerns function allocation between the system and the user. The display of information could be held constant, or 'fixed', leaving the user with the task of searching through all of the available information, integrating it, and classifying the data into a known system state. On the other hand, the system, based on its own intelligent diagnosis, could display only relevant information in order to reduce the user's search set. The user would still be left the task of perceiving and integrating the data and classifying it into the appropriate system state. Finally, the system could display the patterns of data. In this scenario, the task of integrating the data is carried out by the system, and the user's information processing load is reduced, leaving only the tasks of perception and classification of the patterns of data. Humans are especially adept at this form of display processing. Although others have examined the relative effectiveness of alphanumeric and graphical display formats, it is interesting to reexamine this issue together with the function allocation problem. Currently, Johnson Space Center is the test site for an intelligent Thermal Control System (TCS), TEXSYS, being tested for use with Space Station Freedom. Expert TCS engineers, as well as novices, were asked to classify several displays of TEXSYS data into various system states (including nominal and anomalous states). Three different display formats were used: fixed, subset, and graphical. The hypothesis tested was that the graphical displays would provide for fewer errors and faster classification times by both experts and novices, regardless of the kind of system state represented within the display. The subset displays were hypothesized to be the second most effective display format/function allocation condition, based on the fact that the search set is reduced in these displays. Both the subset and the graphic display conditions were hypothesized to be processed more efficiently than the fixed display conditions.

Czerwinski, Mary P.

Using the Bootstrap Method for a Statistical Significance Test of Differences between Summary Histograms

A new method is proposed to compare statistical differences between summary histograms, which are the histograms summed over a large ensemble of individual histograms. It consists of choosing a distance statistic for measuring the difference between summary histograms and using a bootstrap procedure to calculate the statistical significance level. Bootstrapping is an approach to statistical inference that makes few assumptions about the underlying probability distribution that describes the data. Three distance statistics are compared in this study. They are the Euclidean distance, the Jeffries-Matusita distance and the Kuiper distance. The data used in testing the bootstrap method are satellite measurements of cloud systems called cloud objects. Each cloud object is defined as a contiguous region/patch composed of individual footprints or fields of view. A histogram of measured values over footprints is generated for each parameter of each cloud object and then summary histograms are accumulated over all individual histograms in a given cloud-object size category. The results of statistical hypothesis tests using all three distances as test statistics are generally similar, indicating the validity of the proposed method. The Euclidean distance is determined to be most suitable after comparing the statistical tests of several parameters with distinct probability distributions among three cloud-object size categories. Impacts on the statistical significance levels resulting from differences in the total lengths of satellite footprint data between two size categories are also discussed.

Xu, Kuan-Man

Cross-Cutting Computational Modeling Project: Integrative Modeling Approach

A wide range of computational models and analyses have been applied to spaceflight risk assessment and countermeasure development. The benefits of using computational modeling to enhance Human Research Program (HRP) goals include the ability to mathematically represent physiological systems, integrate multiple, discrete experimental measures, span multiple temporal and spatial scales, determine important factors within the system and provide estimates of unmeasurable quantities. In the area of application, computational models provide a means of developing simulations to test hypotheses, determining key factors of the system to aid experimental design and bridging gaps in sparse data by mathematically simulating large populations. Specifically, computational models and their supporting analysis tools have the proven potential to integrate analyses of risk factors to enhance mission planning and preparation capabilities and to inform spacecraft design and countermeasure development. Appropriately applied, computational models may allow intelligent, unbiased physiological parameter assessment to enable hypothesis testing and model based design of experiments. HRP recently formed the Computational Modeling Project (CMP), managed out of Glenn Research Center, as a cross-cutting activity aimed at leveraging the growing power and acceptance of computational modeling in informing clinical, physiological, and biological studies. This presentation will provide an overview of the challenges and opportunities in implementing various forms of computational models in support of the HRPs path to risk reduction.

biomechanics

The resolution of point sources of light as analyzed by quantum detection theory

The resolvability of point sources of incoherent light is analyzed by quantum detection theory in terms of two hypothesis-testing problems. In the first, the observer must decide whether there are two sources of equal radiant power at given locations, or whether there is only one source of twice the power located midway between them. In the second problem, either one, but not both, of two point sources is radiating, and the observer must decide which it is. The decisions are based on optimum processing of the electromagnetic field at the aperture of an optical instrument. In both problems the density operators of the field under the two hypotheses do not commute. The error probabilities, determined as functions of the separation of the points and the mean number of received photons, characterize the ultimate resolvability of the sources.

Helstrom, C. W.