Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “test effectiveness”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 415 records · Page 23

Mechanistic Multiscale Uncertainty Propagation in Support of Accelerated Fuel Qualification

Taking a nuclear fuel concept through the research, development, and qualification stages has historically taken on the order of 20 to 25 years because of extensive irradiation tests required for a variety of conditions. The concept of accelerated fuel qualification (AFQ) has been proposed to increase the innovation pace for nuclear fuels. The goal of AFQ is not to replace the traditional qualification approach but rather to reduce the total number of experiments required to ensure approval from the regulatory authority. Of the many AFQ approaches being explored, advanced modeling—and, in particular, mechanistic modeling—is in a uniquely cross-cutting position to reduce the number of required integral tests through the inclusion of separate-effects testing, while helping to extrapolate reactor performance during rare events. We make the case that propagation of uncertainty through various computational length scales helps contextualize mechanistic modeling. We will utilize UO 2 fission gas diffusion predictions from the atomistically informed cluster dynamics code Centipede to inform fuel performance rodlet simulations using the BISON finite element code as the metric for showing how multiscale mechanistic uncertainty quantification can help reduce uncertainty in fuel performance. In conclusion, by quantifying uncertainty and its reduction through multiscale modeling, the qualification process may be accelerated through the reduction of costly irradiation experiments.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Direct sensitivity analysis on the parameterization of crystal plasticity models

Various methods for calibrating crystal plasticity finite element (CPFE) models lead to non-unique input parameter values, which subsequently introduce uncertainty in the predicted mechanical response. Sensitivity analysis (SA) conducted on crystal plasticity models is used to identify how variability in these parameters contribute to output uncertainty. Traditional SA on CPFE parameters uses simplified surrogate models to save computational time. However, the accuracy of the surrogate models depends on the quantity of training data used, and any modeling error can propagate into the SA results, potentially affecting their reliability. In this work, the elementary effects test (EET) method, a global SA technique using direct CPFE simulations was employed, and the results obtained were compared with the First Order Second Moment (FOSM) method. ExaConstit, an open-source GPU-enabled CPFE code, was used to perform the simulations and direct SA. The EET method was accurately able to capture the non-linear effects of all the input parameters on the output and is a valuable approach for reliably attributing parameter sensitivities in CPFE models. Based on the results, efficient strategies to perform future parameter calibration and SA are discussed. Additionally, the SA trends observed in different single crystal orientations closely mirrored the activity of the slip systems.

Elementary Effects Test↗

Coverage Metrics for Requirements-Based Testing: Evaluation of Effectiveness

In black-box testing, the tester creates a set of tests to exercise a system under test without regard to the internal structure of the system. Generally, no objective metric is used to measure the adequacy of black-box tests. In recent work, we have proposed three requirements coverage metrics, allowing testers to objectively measure the adequacy of a black-box test suite with respect to a set of requirements formalized as Linear Temporal Logic (LTL) properties. In this report, we evaluate the effectiveness of these coverage metrics with respect to fault finding. Specifically, we conduct an empirical study to investigate two questions: (1) do test suites satisfying a requirements coverage metric provide better fault finding than randomly generated test suites of approximately the same size?, and (2) do test suites satisfying a more rigorous requirements coverage metric provide better fault finding than test suites satisfying a less rigorous requirements coverage metric? Our results indicate (1) only one coverage metric proposed -- Unique First Cause (UFC) coverage -- is sufficiently rigorous to ensure test suites satisfying the metric outperform randomly generated test suites of similar size and (2) that test suites satisfying more rigorous coverage metrics provide better fault finding than test suites satisfying less rigorous coverage metrics.

Staats, Matt↗

Space Flight Requirements for Fiber Optic Components; Qualification Testing and Lessons Learned

"Qualification" of fiber optic components holds a very different meaning than it did ten years ago. In the past, qualification meant extensive prolonged testing and screening that led to a programmatic method of reliability assurance. For space flight programs today, the combination of using higher performance commercial technology, with shorter development schedules and tighter mission budgets makes long term testing and reliability characterization unfeasible. In many cases space flight missions will be using technology within years of its development and an example of this is fiber laser technology. Although the technology itself is not a new product the components that comprise a fiber laser system change frequently as processes and packaging changes occur. Once a process or the materials for manufacturing a component change, even the data that existed on its predecessor can no longer provide assurance on the newer version. In order to assure reliability during a space flight mission, the component engineer must understand the requirements of the space flight environment as well as the physics of failure of the components themselves. This can be incorporated into an efficient and effective testing plan that "qualifies" a component to specific criteria defined by the program given the mission requirements and the component limitations. This requires interaction at the very initial stages of design between the system design engineer, mechanical engineer, subsystem engineer and the component hardware engineer. Although this is the desired interaction what typically occurs is that the subsystem engineer asks the components or development engineers to meet difficult requirements without knowledge of the current industry situation or the lack of qualification data. This is then passed on to the vendor who can provide little help with such a harsh set of requirements due to high cost of testing for space flight environments. This presentation is designed to guide the engineers of design, development and components, and vendors of commercial components with how to make an efficient and effective qualification test plan with some basic generic information about many space flight requirements. Issues related to the ~ physics of failure, acceptance criteria and lessons learned will also be discussed to assist with understanding how to approach a space flight mission in an ever changing commercial photonics industry.

Ott, Melanie N.↗

Testing of lift/cruise fan exhaust deflector

A lift/cruise exhaust deflector system for the LF336/A tip turbine lift fan was designed, built, and tested to determine the design and performance characteristics of a large-scale, single swivel nozzle thrust vectoring system. The exhaust deflector static testing was performed at the Ames Research Center outside static test stand facilities. The test hardware was installed on a hydraulic lift platform to permit both in and out of ground effect testing. The exhaust flow of the LF336/A lift fan was vectored from 0 degrees through 130 degrees during selected fan speeds to obtain performance at different operating conditions. The system was operated with and without flow vanes installed in the small radius bends to evaluate the system performance based on a proposed method of improving the internal flow losses. The program also included testing at different ground heights, to the nozzle exhaust plane, to obtain ground effect data, and the testing of two methods of thrust spoiling using a duct bypass door system and nozzle flap system.

Schlundt, D. W.↗

Characterizing the Joint Effect of Diverse Test-Statistic Correlation Structures and Effect Size on False Discovery Rates in a Multiple-Comparison Study of Many Outcome Measures

In their 2009 Annals of Statistics paper, Gavrilov, Benjamini, and Sarkar report the results of a simulation assessing the robustness of their adaptive step-down procedure (GBS) for controlling the false discovery rate (FDR) when normally distributed test statistics are serially correlated. In this study we extend the investigation to the case of multiple comparisons involving correlated non-central t-statistics, in particular when several treatments or time periods are being compared to a control in a repeated-measures design with many dependent outcome measures. In addition, we consider several dependence structures other than serial correlation and illustrate how the FDR depends on the interaction between effect size and the type of correlation structure as indexed by Foerstner s distance metric from an identity. The relationship between the correlation matrix R of the original dependent variables and R~, the correlation matrix of associated t-statistics is also studied. In general R~ depends not only on R, but also on sample size and the signed effect sizes for the multiple comparisons.

Feiveson, Alan H.↗

Jet Engine Bird Ingestion Simulations: Comparison of Rotating to Non-Rotating Fan Blades

Bird strike events in commercial airliners are a fairly common occurrence. According to data collected by the US Department of Agriculture, over 80,000 bird strikes were reported in the period 1990 to 2007 in the US alone (Ref. 1). As a result, bird ingestion is an important factor in aero engine design and FAA certification. When it comes to bird impacts on engine fan blades, the FAA requires full-scale bird ingestion tests on an engine running at full speed to pass certification requirements. These rotating tests are complex and very expensive. To reduce development costs associated with new materials for fan blades, it is desirable to develop more cost effective testing procedures than full-scale rotating engine tests for material evaluation. An impact test on a nonrotating single blade that captures most of the salient physics of the rotating test would go a long way towards enabling large numbers of evaluative material screening tests. NASA Glenn Research Center has been working to identify a static blade test procedure that would be effective at reproducing similar results as seen in rotating tests. The current effort compares analytical simulations of a bird strike on various non-rotating blades to a bird strike simulation on a rotating blade as a baseline case. Several different concepts for simulating the rotating loads on a non-rotating blade were analyzed with little success in duplicating the deformation results seen in the rotating case. The rotating blade behaves as if it were stiffer than the non-rotating blade resulting in less plastic deformation from a given bird impact. The key factor limiting the success of the non-rotating blade simulations is thought to be the effect of gyroscopics. Prior to this effort, it was anticipated the difficulty would be in matching the prestress in the blade due to centrifugal forces Additional work is needed to verify this assertion, and to determine if a static test procedure can simulate the gyroscopic effects in a suitable manner. This paper describes the various non-rotating concepts analyzed, and demonstrates the effect believed to be gyroscopic in nature on the results

Howard, Samuel A.↗

Jet Engine Bird Ingestion Simulations: Comparison of Rotating to Non-Rotating Fan Blades

Bird strike events in commercial airliners are a fairly common occurrence. According to data collected by the US Department of Agriculture, over 80,000 bird strikes were reported in the period 1990-2007 in the US alone [1]. As a result, bird ingestion is an important factor in aero engine design and FAA certification. When it comes to bird impacts on engine fan blades, the FAA requires full-scale bird ingestion tests on an engine running at full speed to pass certification requirements. These rotating tests are complex and very expensive. To reduce development costs associated with new materials for fan blades, it is desirable to develop more cost effective testing procedures than full-scale rotating engine tests for material evaluation. An impact test on a non-rotating single blade that captures most of the salient physics of the rotating test would go a long way towards enabling large numbers of evaluative material screening tests. NASA Glenn Research Center has been working to identify a static blade test procedure that would be effective at reproducing similar results as seen in rotating tests. The current effort compares analytical simulations of a bird strike on various nonrotating blades to a bird strike simulation on a rotating blade as a baseline case. Several different concepts for simulating the rotating loads on a non-rotating blade were analyzed with little success in duplicating the deformation results seen in the rotating case. The rotating blade behaves as if it were stiffer than the non-rotating blade resulting in less plastic deformation from a given bird impact. The key factor limiting the success of the non-rotating blade simulations is thought to be the effect of gyroscopics. Prior to this effort, it was anticipated the difficulty would be in matching the pre-stress in the blade due to centrifugal forces Additional work is needed to verify this assertion, and to determine if a static test procedure can simulate the gyroscopic effects in a suitable manner. This paper describes the various non-rotating concepts analyzed, and demonstrates the effect believed to be gyroscopic in nature on the results.

Howard, Samuel A.↗

A First Look at 22 nm FDSOI SRAM Single-Event Test Results

We will present the first ever single-event effects testing results on a 22 nm fully-depleted silicon-on-insulator test chip. The 128 MB SRAMs were irradiated with heavy ions and the results are compared to previous technology generations.

Silicon-on-insulator↗

Intern Poster Session

This poster has been developed for display during the 2023 Intern Poster Session. The poster is apart of the Nuclear Research and Experiments category. The focus of this poster is on the modifications made to the design of an integral effect test (IET) facility currently being designed for a new Small Modular Reactor (SMR) design. My contributions made to the IET facility are laid out along with an explanation on some of the aspects of designing a new nuclear reactor. This poster covers the ideas and importance of scaling and IET facilities with the context of the standards set by the NRC. There are also graphics of some other examples of IET facilities developed for other reactor designs. My contributions include designing the piping and instrumentation layout of the IET facility using CAD software. This is a key step in the process of designing this IET facility and needs to be designed to avoid excessive head loss.

42 ENGINEERING↗

EV SALaD 2023 Demonstration: Best Practices and Mitigations for Protecting EVSE Infrastructure

The Electric Vehicle Secure Architecture Laboratory Demonstration (EV SALaD) program is a demonstration of cybersecurity best practices for high-power electric vehicle (EV) charging infrastructure led by Idaho National Laboratory (INL), in collaboration with other DOE National Laboratories participating in the EVs at Scale Consortium.a Sandia National Laboratories (SNL) and Pacific Northwest National Laboratory (PNNL) participated in the first 2-year (FY22-23) demonstration cycle for EV SALaD. This report documents the FY23 demonstration, the second in a series of demonstrations and collaborations in deploying and operating cybersecure EV charging infrastructure. It includes a summary of improvements from the FY22 demonstration, technical analysis of the FY23 demonstration, how the research demonstrates cyber-physical and cybersecurity best practices for high-power EV charging infrastructure, and related impacts to national and energy security. For EV SALaD, the FY22 demonstration focused on the detection, ranking, and prioritization of anomalous events for high-power EV charging. The FY23 demonstration additionally included the demonstration of cybersecurity best practices, which included protection and mitigation solutions to prevent, respond, and recover from anomalous events. During the demonstrations, the multi-lab EV SALaD team conducted a Test Effect Payload (TEP)b evaluation on extreme fast charger (XFC) hardware equipped with Cerberus, a detection and response solution, to demonstrate anomaly detection and mitigation cybersecurity best practices against cyber-enabled events.

33 ADVANCED PROPULSION SYSTEMS↗

Seismic isolation of two dimensional periodic foundations

Phononic crystal is now used to control acoustic waves. When the crystal goes to a larger scale, it is called periodic structure. The band gaps of the periodic structure can be reduced to range from 0.5 Hz to 50 Hz. Therefore, the periodic structure has potential applications in seismic wave reflection. In civil engineering, the periodic structure can be served as the foundation of upper structure. This type of foundation consisting of periodic structure is called periodic foundation. When the frequency of seismic waves falls into the band gaps of the periodic foundation, the seismic wave can be blocked. Field experiments of a scaled two dimensional (2D) periodic foundation with an upper structure were conducted to verify the band gap effects. Test results showed the 2D periodic foundation can effectively reduce the response of the upper structure for excitations with frequencies within the frequency band gaps. When the experimental and the finite element analysis results are compared, they agree well with each other, indicating that 2D periodic foundation is a feasible way of reducing seismic vibrations.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Powered low-aspect-ratio Wing In Ground effect (WIG) aerodynamic characteristics

A wing-in-ground effect configuration was investigated. The configuration used large diameter, low pressure ratio fans mounted about 0.76 wing chord ahead of the wing leading edge to achieve a power augmented ram wing during operation in ground effect. Tests of both in and out of ground effect aerodynamic transition characteristics from very low speeds to cruise speeds are described. The investigation provided a number of conclusions concerning the aerodynamic/propulsive performance interaction. While power augmented lift is required for low speed flight, there is a thrust loss when the efflux is trapped under the wing which reduced the effective thrust to weight available for acceleration by about a third of the installed thrust to weight ratio.

Thomas, J. L.↗

Formal functional test designs with a test representation language

The application of the category-partition method to the test design phase of hardware, software, or system test development is discussed. The method provides a formal framework for reducing the total number of possible test cases to a minimum logical subset for effective testing. An automatic tool and a formal language were developed to implement the method and produce the specification of test cases.

Hops, J. M.↗

Selection of the Space Station Freedom (SSF) Flat Collector Circuit (FCC) insulation material

The topics are presented in viewgraph form and include the following: function of the Space Station Freedom (SSF) Flat Collector Circuit (FCC); requirements of the FCC which affect the selection of the insulation material; data to support the selection of the FCC insulation material; development history; modified design; coverlay testing; effects on modified design on FCC; arc tracking tests performed on FCC; and arc tracking test results.

Emerson, Dawn↗

A Systematic Approach to Hardware Qualification

A systematic approach for the development of a hardware qualification approach is described. This approach stems from the need to break the "Catch-22" of not being able to fly new technology because it hasn't flown. A physics of failure approach is used to identify failure modes and the impact and likelihood of these failures on the mission requirements is plotted in a Requirements Matrix. These same failure modes are plotted against the effectiveness of the available Preventions, Analyses, Control and Tests (PACTs) at screening for, or eliminating, these failure modes in a Test Effectiveness Matrix. Matrix multiplication results in a ranked set of PACTs which can be sorted according to cost and redundancy with other PACTs. This, and other information which results from the process, will allow project managers to make more informed decisions regarding the cost and risk tradeoffs inherent in any qualification program.

hardware↗