Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Statistical Testing Approach”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14
All sourcesNASA NTRSDOE OSTI
NASA NTRS2002

Flight Test Evaluation of the Airborne Information for Lateral Spacing (AILS) Concept

The Airborne Information for Lateral Spacing (AILS) concept is designed to support independent parallel approach operations to runways spaced as close as 2,500 feet. This report briefly describes the AILS operational concept and the results of a flight test of one implementation of this concept. The focus of this flight test experiment was to validate a prior simulator study, evaluating pilot performance, pilot acceptability, and minimum miss-distances for the rare situation in which an aircraft on one approach intrudes into the path of an aircraft on the other approach. Although the flight data set was not meant to be a statistically valid sample, the trends acquired in flight followed those of the simulator and therefore met the intent of validating the findings from the simulator. Results from this study showed that the design-goal mean miss-distance of 1,200 feet to potential collision situations was surpassed with an actual mean miss-distance of 1,859 feet. Pilot reaction times to the alerting system, which was an operational concern, averaged 0.65 seconds, were well below the design goal reaction time of 2.0 seconds. From the results of both of these tests, it can be concluded that this operational concept, with supporting technology and procedures, may provide an operationally viable means for conducting simultaneous, independent instrument approaches to runways spaced as close as 2500 ft.

Abbott, Terence S.↗
DOE OSTI2020

Combining Three-Dimensional Modeling with Artificial Intelligence to Increase Specificity and Precision in Peptide–MHC Binding Predictions

The reliable prediction of the affinity of candidate peptides for the MHC is important for predicting their potential antigenicity and thus influences medical applications, such as decisions on their inclusion in T cell–based vaccines. In this study, we present a rapid, predictive computational approach that combines a popular, sequence-based artificial neural network method, NetMHCpan 4.0, with three-dimensional structural modeling. We find that the ensembles of bound peptide conformations generated by the programs MODELLER and Rosetta FlexPepDock are less variable in geometry for strong binders than for low-affinity peptides. In tests on 1271 peptide sequences for which the experimental dissociation constants of binding to the well-characterized murine MHC allele H-2D b are known, by applying thresholds for geometric fluctuations the structure-based approach in a standalone manner drastically improves the statistical specificity, reducing the number of false positives. Furthermore, filtering candidates generated with NetMHCpan 4.0 with the structure-based predictor led to an increase in the positive predictive value (PPV) of the peptides correctly predicted to bind very strongly (i.e., Kd < 100 nM) from 40 to 52% (p = 0.027). The combined method also significantly improved the PPV when tested on five human alleles, including some with limited data for training. Overall, an average increase of 10% in the PPV was found over the standalone sequence-based method. The combined method should be useful in the rapid design of effective T cell–based vaccines.

60 APPLIED LIFE SCIENCES↗
NASA NTRS2010

Roles of Engineering Correlations in Hypersonic Entry Boundary Layer Transition Prediction

Efforts to design and operate hypersonic entry vehicles are constrained by many considerations that involve all aspects of an entry vehicle system. One of the more significant physical phenomenon that affect entry trajectory and thermal protection system design is the occurrence of boundary layer transition from a laminar to turbulent state. During the Space Shuttle Return To Flight activity following the loss of Columbia and her crew of seven, NASA's entry aerothermodynamics community implemented an engineering correlation based framework for the prediction of boundary layer transition on the Orbiter. The methodology for this implementation relies upon similar correlation techniques that have been is use for several decades. What makes the Orbiter boundary layer transition correlation implementation unique is that a statistically significant data set was acquired in multiple ground test facilities, flight data exists to assist in establishing a better correlation and the framework was founded upon state of the art chemical nonequilibrium Navier Stokes flow field simulations. Recent entry flight testing performed with the Orbiter Discovery now provides a means to validate this engineering correlation approach to higher confidence. These results only serve to reinforce the essential role that engineering correlations currently exercise in the design and operation of entry vehicles. The framework of information related to the Orbiter empirical boundary layer transition prediction capability will be utilized to establish a fresh perspective on this role, and to discuss the characteristics which are desirable in a next generation advancement. The details of the paper will review the experimental facilities and techniques that were utilized to perform the implementation of the Orbiter RTF BLT Vsn 2 prediction capability. Statistically significant results for multiple engineering correlations from a ground testing campaign will be reviewed in order to describe why only certain correlations were selected for complete implementation to support the Shuttle Program. Historical Orbiter flight data on early boundary layer transition due to protruding gap fillers will be described in relation to the selected empirical correlations. In addition, Orbiter entry flight testing results from the BLT Flight Experiment will be discussed in relation to these correlations. Applicability of such correlations to the entry design problem will be reviewed, and finally a perspective on the desirable characteristics for a next generation capability based on high fidelity physical models will be provided.

Campbell, Charles H.↗
DOE OSTI2019

Statistical change detection of building energy consumption: Applications to savings estimation

The surge in interval meter data availability and associated activity in energy data analytics has inspired new interest in advanced methods for building efficiency savings estimation. Statistical and machine learning approaches are being explored to improve the energy baseline models used to measure and verify savings. One outstanding challenge is the ability to identify and account for operational changes that may confound savings estimates. In the measurement and verification (M&V) context, ‘non-routine events’ (NREs) cause changes in building energy use that are not attributable to installed efficiency measures, and not accounted for in the baseline model’s independent variables. In the M&V process NREs must be accounted for as ‘adjustments’ to appropriately attribute the estimated energy savings to the specific efficiency interventions that were implemented. Currently this is a manual and custom process, conducted using professional judgment and engineering expertise. As such it remains a barrier in scaling and standardizing meter-based savings estimation. Here in this work, a data driven methodology was developed to (partially) automate, and therefore streamline the process of detecting NREs in the post-retrofit period and making associated savings adjustments. The proposed NRE detection algorithm is based on a statistical change point detection method and a dissimilarity metric. The dissimilarity metric measures the proximity between the actual time series of the post-retrofit energy consumption and the projected baseline, which is generated using a statistical baseline model. The suggested approach for NRE adjustment involves the NRE detection algorithm, the M&V practitioner, and a regression modeling algorithm. The performance of the detection and adjustment algorithm was evaluated using a simulation-generated test data set, and two benchmark algorithms. Results show a high true positive detection rate (75%-100% across the test cases), higher than ideal false positive detection rates (20%-70%), and low errors in energy adjustment (<0.7%). These results indicate that the algorithm holds for helping M&V practitioners to streamline the process of handling NREs. Moreover, the change point algorithm and underlying statistical principles could prove valuable for other building analytics applications such as anomaly detection and fault diagnostics.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2023

A unified catalogue-level reanalysis of stage-III cosmic shear surveys

ABSTRACT Cosmological parameter constraints from recent galaxy imaging surveys are reaching percent-level accuracy on the effective amplitude of the lensing signal, S8. The upcoming Legacy Survey of Space and Time (LSST) of the Vera C. Rubin Observatory will produce subpercent level measurements of cosmological parameters, providing a milestone test of the ΛCDM model. To supply guidance to the upcoming LSST analysis, it is important to understand thoroughly the results from different recent galaxy imaging surveys and assess their consistencies. In this work, we perform a unified catalogue-level reanalysis of three cosmic shear data sets: the first year data from the Dark Energy Survey (DES-Y1), the 1000 deg2 data set from the Kilo-Degree Survey (KiDS-1000), and the first year data from the Hyper Suprime-Cam Subaru Strategic Program (HSC-Y1). We utilize a pipeline developed and rigorously tested by the LSST Dark Energy Science Collaboration to perform the reanalysis and assess the robustness of the results to analysis choices. We find the S8 constraint to be robust to two different small-scale modelling approaches, and varying choices of cosmological priors. Our unified analysis allows the consistency of the surveys to be rigorously tested, and we find the three surveys to be statistically consistent. Due to the partially overlapping footprint, we model the cross-covariance between KiDS-1000 and HSC-Y1 approximately when combining all three data sets, resulting in a 1.6–1.9 per cent constraint on S8 given different assumptions on the cross-covariance.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Modeling Flow and Transport in Fractured Rock using Machine Learning [Slides]

Fractured systems in the subsurface play a role in many natural and engineered applications such as geologic carbon sequestration, hydraulic fracturing and underground nuclear test detection. Structural information (fracture size, orientation, etc.) plays a key role in governing the dominant physics for these systems but can only be known statistically. Traditional modeling approaches either ignore or idealize structural information at these larger scales because we lack a computational framework that utilizes it in its entirety. The work presented here integrates computational physics, machine learning and graph theory to make a paradigm shift from computationally intensive high-fidelity models to coarse-scale graphs without loss of critical structural information. We exploit the underlying discrete structure of fracture networks in systems considering flow through fractures and fracture propagation. We demonstrate that compact graph representations require significantly fewer degrees of freedom (dof) to capture micro-fracture information and further accelerate these models with Machine Learning.

58 GEOSCIENCES↗
NASA NTRS1974

Processing electrophysiological signals for the monitoring of alertness

Mathematical techniques are described for processing EEG signals associated with varying states of alertness. Fast algorithms for implementing real-time computations of alertness estimates were developed. A realization of the phase-distortionless digital filter is presented which approaches real-time filtering and a transform for EEG signals. This transform provides information for the alertness estimates and can be performed in real time. A statistical test for stationarity in EEG signals is being developed that will provide a method for determining the duration of the EEG signals necessary for estimating the short-time power or energy spectra for nonstationary analysis of EEG signals.

Lai, D. C.↗
NASA NTRS1990

The systematic radial downflow in the transition region of the quiet sun from limb-to-limb observations of the C IV resonance lines

This paper presents absolute velocities of C IV 1548, 1550 nm measured as a function of position along the solar equator, which was free of both active regions and coronal holes, and uniformly representative of the quiet sun. These observations were made with moderate spatial resolution (18 arcsec) using an EUV spectrometer dedicated to measuring absolute wavelengths (velocities) by direct comparison with a platinum spectrum generated on board the sounding rocket. On the assumption that systematic horizontal motions cancel statistically so that the line-of-sight velocities approach zero at the limb, a net radial downflow of 7.5 + or - 1.0 km/sec was found. The assumption was tested using the wavelength reference and found to be valid within the absolute accuracy of the rest wavelengths of the C IV lines.

Rottman, Gary J.↗
NASA NTRS2002

The Role of Formal Experiment Design in Hypersonic Flight System Technology Development

Hypersonic airbreathing engine (scramjet) powered vehicles are being considered to replace conventional rocket-powered launch systems. Effective utilization of scramjet engines requires careful integration with the air vehicle. This integration synergistically combines aerodynamic forces with propulsive cycle functions of the engine. Due to the highly integrated nature of the hypersonic vehicle design problem, the large flight envelope, and the large number of design variables, the use of a statistical design approach in design is effective. Modern Design-of-Experiments (MDOE) has been used throughout the Hyper-X program, for both systems analysis and experimental testing. Application of MDOE fall into four categories: (1) experimental testing; (2) studies of unit phenomena; (3) refining engine design; and (4) full vehicle system optimization. The MDOE process also provides analytical models, which are also used to document lessons learned, supplement low-level design tools, and accelerate future studies. This paper will discuss the design considerations for scramjet-powered vehicles, specifics of MDOE utilized for Hyper-X, and present highlights from the use of these MDOE methods within the Hyper-X Program.

McClinton, Charles R.↗
NASA NTRS2004

The X-Ray Variable Sky

A novel approach to search for rapid time variability of every source, whether persistent or transient, within the entire ROSAT detector field has been developed. Semi-automated software statistically tests the photon arrival time event list for source variability and reports significant (greater than 5 sigma) variable enhancement in the photon count rate on time scales ranging from 5-500 seconds. The computational algorithms have been thoroughly tested, and are able to discriminate between false detections induced by instrumental effects, and real X-ray variable sources (XRVs); when carefully scrutinized by the PI. The analysis has proven to be successful, with both periodic and transient XRVs having been found. Some of these are entirely new discoveries, while others have been detected in previous X-ray missions, yet their nature remained elusive since source identification and analysis had yet to be performed. On average, one new (unidentified) XRV is found per ROSAT PSPC field analyzed. In some cases the XRVs show only a transient signature (a burst type event) with no persistent X-ray or other known (optical) counterpart. The ambitious goal of this project was to process as much of the ROSAT PSPC archive data as feasibly possible to discover XRVs and analyze this data.

Stringfellow, Guy↗
DOE OSTI2015

Identification of the threshold security applied for fuel under reactivity-initiated conditions by self-organizing maps and neural networks - 14386

In recent times, we have 439 reactors distributed in 31 countries that give about 377 GW, covering around 12% of world capacity of energy. Currently, it accounts for an estimated 40 serious accidents reported in nuclear power plants. In this article, turns out the behavior of fuel rod in light-water reactors under accident conditions. Besides, we investigate deeply about reactivity-initiated accidents, by introducing Nordheim-Fuchs model as state equations. The early research showed that pre-irradiated fuels and afterward subjected to a rapid pulse of energy. It adopts the key items necessary to check the threshold of failure. These items are few limits as burning the fuel; the value applied to the peak of energy, pulse width, oxidation layer, and cladding. The kinetic equations of nuclear reactors modeled as a non-linear system. In this way, it can apply the paradigm of artificial intelligence using the self-organized maps. Where the goal is to find the cluster of failure for irradiated fuels until 75 GWd/MTU. The second model based on statistical is the logistic regression theory. Hence, the tests carried out and compared against the results found by neural networks for classification of clusters. It proofs that both approaches present capacity to find the flaws accurately of about 80% of cases. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
NASA NTRS2011

Sub-Shot Noise Power Source for Microelectronics

Low-current, high-impedance microelectronic devices can be affected by electric current shot noise more than they are affected by Nyquist noise, even at room temperature. An approach to implementing a sub-shot noise current source for powering such devices is based on direct conversion of amplitude-squeezed light to photocurrent. The phenomenon of optical squeezing allows for the optical measurements below the fundamental shot noise limit, which would be impossible in the domain of classical optics. This becomes possible by affecting the statistical properties of photons in an optical mode, which can be considered as a case of information encoding. Once encoded, the information describing the photon (or any other elementary excitations) statistics can be also transmitted. In fact, it is such information transduction from optics to an electronics circuit, via photoelectric effect, that has allowed the observation of the optical squeezing. It is very difficult, if not technically impossible, to directly measure the statistical distribution of optical photons except at extremely low light level. The photoelectric current, on the other hand, can be easily analyzed using RF spectrum analyzers. Once it was observed that the photocurrent noise generated by a tested light source in question is below the shot noise limit (e.g. produced by a coherent light beam), it was concluded that the light source in question possess the property of amplitude squeezing. The main novelty of this technology is to turn this well-known information transduction approach around. Instead of studying the statistical property of an optical mode by measuring the photoelectron statistics, an amplitude-squeezed light source and a high-efficiency linear photodiode are used to generate photocurrent with sub-Poissonian electron statistics. By powering microelectronic devices with this current source, their performance can be improved, especially their noise parameters. Therefore, a room-temperature sub-shot noise current source can be built that will be beneficial for a very broad range of low-power, low-noise electronic instruments and applications, both cryogenic and room-temperature. Taking advantage of recent demonstrations of the squeezed light sources based on optical micro-disks, this sub-shot noise current source can be made compatible with the size/power requirements specific of the electronic devices it will support.

Strekalov, Dmitry V.↗
DOE OSTI2026

Improvement of Drop‐Hammer Impact Testing for Safety Assessment of High Explosives Using 10‐mg Samples

Here, in this study, we established an improved method for drop-hammer impact testing of small quantities of high explosives (10 mg). We performed about seven hundred impact tests under various experimental conditions (e.g., sandpaper vs bare anvil, different sample masses, drop-weights, and striker diameters) to determine an optimal set of conditions and reaction detection methods (e.g., gas analysis, video, and sound recordings) that give the most statistically reliable results with 10 mg samples. We used both Frequentist and Bayesian statistical approaches to compare estimates of the drop height (DH50) that initiates a reaction 50% of the time, and to quantify the associated uncertainty. Gas analysis proved to be the most reliable reaction detection method, showing unambiguous rises in HE decomposition products (e.g., CO 2 ) even when the other indicators (e.g., sound, video) were inconclusive. The impact tests performed with a bare anvil showed much better reproducibility than those conducted with sandpaper, reducing the largest uncertainty observed in the data sets by a factor of 1.7. The DH 50 values obtained from three different sample masses (10, 20, and 35 mg) fell within the uncertainties of the measurements. We demonstrated the improved procedure (i.e., 10-mg samples, gas analysis, bare anvil, and Bayesian approach) on a variety of PETN samples having different surface areas and thermal histories.

PETN↗
DOE OSTI2017

Line-of-sight effects in strong lensing: putting theory into practice

We present a simple method to accurately infer line of sight (LOS) integrated lensing effects for galaxy scale strong lens systems through image reconstruction. Our approach enables us to separate weak lensing LOS effects from the main strong lens deflector. We test our method using mock data and show that strong lens systems can be accurate probes of cosmic shear with a precision on the shear terms of ± 0.003 (statistical error) for an HST-like dataset. We apply our formalism to reconstruct the lens COSMOS 0038+4133 and its LOS. In addition, we estimate the LOS properties with a halo-rendering estimate based on the COSMOS field galaxies and a galaxy-halo connection. The two approaches are independent and complementary in their information content. We find that when estimating the convergence at the strong lens system, performing a joint analysis improves the measure by a factor of two compared to a halo model only analysis. Furthermore the constraints of the strong lens reconstruction lead to tighter constraints on the halo masses of the LOS galaxies. Joint constraints of multiple strong lens systems may add valuable information to the galaxy-halo connection and may allow independent weak lensing shear measurement calibrations.

79 ASTRONOMY AND ASTROPHYSICS↗
NASA NTRS1996

Calibration improvements to electronically scanned pressure systems and preliminary statistical assessment

Orifice-to-orifice inconsistencies in data acquired with an electronically-scanned pressure system at the beginning of a wind tunnel experiment forced modifications to the standard, instrument calibration procedures. These modifications included a large increase in the number of calibration points which would allow a critical examination of the calibration curve-fit process, and a subsequent post-test reduction of the pressure data. Evaluation of these data has resulted in an improved functional representation of the pressure-voltage signature for electronically-scanned pressures sensors, which can reduce the errors due to calibration curve fit to under 0.10 percent of reading compared to the manufacturer specified 0.10 percent of full scale. Application of the improved calibration function allows a more rational selection of the calibration set-point pressures. These pressures should be adjusted to achieve a voltage output which matches the physical shape of the pressure-voltage signature of the sensor. This process is conducted in lieu of the more traditional approach where a calibration pressure is specified and the resulting sensor voltage is recorded. The fifteen calibrations acquired over the two-week duration of the wind tunnel test were further used to perform a preliminary, statistical assessment of the variation in the calibration process. The results allowed the estimation of the bias uncertainty for a single instrument calibration; and, they form the precursor for more extensive and more controlled studies in the laboratory.

Everhart, Joel L.↗
DOE OSTI2020

Predicting Biological Cleanliness: An Empirical Bayes Approach for Spacecraft Bioburden Accounting

To comply with the international planetary protection policy set forth by the Committee on Space Research and NASA Agency level requirements, spacecraft destined to biologically sensitive planetary bodies have to minimize terrestrial biological contamination. Analysis, testing and inspection are the standard forward verification activities that are used to demonstrate compliance with the biological contamination requirements. For testing of spacecraft surface areas, a swab or wipe sample is collected from surfaces prior to last access and subsequently processed in the lab using NASA Approved Planetary Protection Methods for Culture Based Assays. Raw data resulting from this assay is then statistically treated employing a mathematical paradigm stemming from the 1970’s Viking Lander Project to generate the bioburden density and total microbial bioburden present. This standard approach arbitrarily accounts for error and provides an upper conservative bound as it reports the maximum number of spores estimated to be present on flight hardware surfaces. A bioburden density estimate factors in the following variables: the observed bioburden count, representative volume processed, sampling efficiencies. Notably, to account for error in the approach, a 0 observed count is arbitrarily changed to a count of 1 for each hardware grouping. The data generated by spacecraft bioburden verification campaigns in the past have resulted in <80% of wipes and <90% of swabs containing a bioburden count of 0. As such, having a robust and well documented statistical approach for dealing with the probability of low incident rates is necessary to be able to estimate spacecraft bioburden. Being able to statistically describe the bioburden distribution and associated confidence level is a gamechanger for the development of bioburden allocations during mission design and will allow for tighter management of risk throughout spacecraft build. Thus, Empirical Bayes statistical approach was evaluated to estimate the microbial bioburden on spacecraft to mitigate the aforementioned mathematical concerns and provide a probabilistic bioburden distribution of the flight hardware surface. For application of this approach to performing bioburden calculations, a range of non-informative prior assumptions on hardware surfaces are explored for Bayesian analyses while informative priors using posterior distributions from prior assays are utilized for Empirical Bayes analyses. Several non-informative priors are currently under investigation to assess fitness including use of these priors to serve as a foundation to build off of NASA specification values or a basis of risk to account for unknowns during the integration and testing process. Informative priors under consideration are generated using sampled bioburden values from hardware originating within like processing environments (e.g. vendor cleaning process or similar assembly process), temporal spacecraft status events as a prediction for hardware cleanliness of future samples, and heritage system bioburden actuals to predict allocation for subsequent missions. Informative priors and probabilistic bioburden distributions are then validated using data sets from the Mars Exploration Rover, Mars Science Laboratory, and InSight missions. Using Empirical Bayes approach to generate a probabilistic bioburden distribution as demonstrated through mission use cases provides a valid approach for use in the end-to-end requirements verification process.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

A Bayesian approach to evaluation of soil biogeochemical models

Abstract. To make predictions about the carbon cycling consequences of rising global surface temperatures, Earth system scientists rely on mathematical soil biogeochemical models (SBMs). However, it is not clear which models have better predictive accuracy, and a rigorous quantitative approach for comparing and validating the predictions has yet to be established. In this study, we present a Bayesian approach to SBM comparison that can be incorporated into a statistical model selection framework. We compared the fits of linear and nonlinear SBMs to soil respiration data compiled in a recent meta-analysis of soil warming field experiments. Fit quality was quantified using Bayesian goodness-of-fit metrics, including the widely applicable information criterion (WAIC) and leave-one-out cross validation (LOO). We found that the linear model generally outperformed the nonlinear model at fitting the meta-analysis data set. Both WAIC and LOO computed higher overfitting risk and effective numbers of parameters for the nonlinear model compared to the linear model, conditional on the data set. Goodness of fit for both models generally improved when they were initialized with lower and more realistic steady-state soil organic carbon densities. Still, testing whether linear models offer definitively superior predictive performance over nonlinear models on a global scale will require comparisons with additional site-specific data sets of suitable size and dimensionality. Such comparisons can build upon the approach defined in this study to make more rigorous statistical determinations about model accuracy while leveraging emerging data sets, such as those from long-term ecological research experiments.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2014

Scaling Relationships Based on Scaled Tank Mixing and Transfer Test Results

This report documents the statistical analyses performed (by Pacific Northwest National Laboratory for Washington River Protection Solutions) on data from 26 tests conducted using two scaled tanks (43 and 120 inches) in the Small Scale Mixing Demonstration platform. The 26 tests varied several test parameters, including mixer-jet nozzle velocity, base simulant, supernatant viscosity, and capture velocity. For each test, samples were taken pre-transfer and during five batch transfers. The samples were analyzed for the concentrations (lbs/gal slurry) of four primary components in the base simulants (gibbsite, stainless steel, sand, and ZrO2). The statistical analyses including modeling the component concentrations as functions of test parameters using stepwise regression with two different model forms. The resulting models were used in an equivalent performance approach to calculate values of scaling exponents (for a simple geometric scaling relationship) as functions of the parameters in the component concentration models. The resulting models and scaling exponents are displayed in tables and graphically. The sensitivities of component concentrations and scaling exponents to the test parameters are presented graphically. These results will serve as inputs to subsequent work by other researchers to develop scaling relationships that are applicable to full-scale tanks.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗