Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “TEST AND EVALUATION”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 505 records · Page 28

Test and Evaluation Metrics of Crew Decision-Making And Aircraft Attitude and Energy State Awareness

NASA has established a technical challenge, under the Aviation Safety Program, Vehicle Systems Safety Technologies project, to improve crew decision-making and response in complex situations. The specific objective of this challenge is to develop data and technologies which may increase a pilot's (crew's) ability to avoid, detect, and recover from adverse events that could otherwise result in accidents/incidents. Within this technical challenge, a cooperative industry-government research program has been established to develop innovative flight deck-based counter-measures that can improve the crew's ability to avoid, detect, mitigate, and recover from unsafe loss-of-aircraft state awareness - specifically, the loss of attitude awareness (i.e., Spatial Disorientation, SD) or the loss-of-energy state awareness (LESA). A critical component of this research is to develop specific and quantifiable metrics which identify decision-making and the decision-making influences during simulation and flight testing. This paper reviews existing metrics and methods for SD testing and criteria for establishing visual dominance. The development of Crew State Monitoring technologies - eye tracking and other psychophysiological - are also discussed as well as emerging new metrics for identifying channelized attention and excessive pilot workload, both of which have been shown to contribute to SD/LESA accidents or incidents.

Bailey, Randall E.↗

OpenCGRA: An Open-Source Unified Framework for Modeling,Testing, and Evaluating CGRAs

Coarse-grained reconfigurable arrays (CGRAs),loosely defined as arrays of functional units (e.g, adder, sub-tractor, multiplier, divider, or larger multi-operation units, butsmaller than a general-purpose core) interconnected through aNetwork-on-Chip, provide higher flexibility than domain-specificASIC accelerators while offering increased hardware efficiencywith respect to fine-grained reconfigurable devices, such as FieldProgrammable Gate Arrays (FPGAs). The fast evolving fieldsof machine learning and edge computing, which are seeing acontinuous flow of novel algorithms and larger models, makeCGRAs ideal target architectures to allow domain specializationwithout loosing too much generality. They also generally offerquicker and more effective reconfigurability than FPGAs, po-tentially allowing adaptation during actual algorithm execution,and implement a dataflow programming paradigm that adaptswell to these emerging workloads. Designing and generating aCGRA, however, still requires to define the type and number ofthe specific functional units, implement their interconnect andthe network topology, and perform its simulation and validation,given a variety of workloads of interest.In this paper, we propose OpenCGRA, a Python-based unifiedframework that integrates generation, modeling, testing and eval-uation for CGRAs. OpenCGRA is the first open-source integratedframework able to support the full top-to-bottom design flow forspecializing and implementing CGRAs: modeling at different ab-straction levels (functional level, cycle level, register-transfer level),generation, simulation, testing at different granularities (unit test-ing, integration testing, property-based testing), and characteriza-tion (area, power, and timing). OpenCGRAs will be made availableon GitHub.

CGRA, synthesis↗

Testing to Evaluate Processes Expected to Occur during MSR Salt Spill Accidents

Obtaining a license for a new nuclear reactor requires the identification and assessment of the potential consequences of specified accident scenarios, which are achieved using accident progression models. Those models need to be parameterized and validated using experimental data, but existing experimental data addressing processes relevant to molten salt reactor accidents are sparse. Specifically, experimental data that quantify the sensitives of important processes to the initial conditions of the spill, the ambient environment, and the containment features are needed to parameterize individual process models. Integrated experiments that simulate accident scenarios are also needed to provide data for model validation, but these experiments will require the use of proven methods to quantify the processes under evaluation. The overarching objectives of this work are to develop the methods for simulating the targeted processes, to determine the effectiveness of the methods in producing the data required for model development, to generate data that can be used to parameterize individual process models, and to provide key insights into the behavior of spilled molten salt that should be considered in models. Experimental methods were designed to quantify aspects of individual processes expected to occur during or after a molten salt spill accident that will affect the fate of spilled molten salt and the radionuclides within. These processes include 1) molten salt spreading and heat transfer, 2) molten salt flowing and freezing in tubing, 3) stainless steel corrosion kinetics in molten salt, and 4) molten salt splashing and aerosol generation. The initial tests described in this report were conducted using eutectic FLiNaK to demonstrate the test methods, the data that are generated, and the analyses of the data to derive values needed for modeling. The primary variables that were tested include initial salt temperature and the presence of volatile surrogate fission products (e.g., cesium and iodine). The developed methods are shown to be effective in quantifying the desired processes and can be applied to study more complex salt compositions of interest to molten salt reactor developers, a wide range of environmental conditions of interest to modelers, and additional variables relevant to salt spill accidents. The developed methods and insights gained from laboratory tests can also be incorporated in future large-scale integrated tests used to simulate molten salt spill accidents.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Immersive Technologies for Human-in-the-Loop Lunar Surface Simulations

NASA, the National Aeronautics and Space Administration, continually seeks innovative solutions to enhance its operations, particularly in the realms of testing, evaluation, and training for future missions. Immersive technologies, such as virtual, augmented, and mixed reality have proven to be powerful tools for immersing users in realistic, interactive, and engaging environments. This paper explores how the Simulation and Graphics Branch at NASA’s Johnson Space Center (JSC) leverages immersive technology, modern commercial rendering engines, and physics-based systems simulations to develop human-in-the-loop systems for humanity’s return to the Moon through the Artemis program. When NASA returns to the Moon, astronauts will travel to the Moon’s South Pole where lighting conditions will cause a more complex operational environment. Human-in-the-loop simulations play a crucial role in NASA’s mission planning, spacecraft and space systems development, and evaluation of operational scenarios. The development of immersive environments such as a lunar rover mockup at a video wall enables engineers and astronauts to simulate and experience mission scenarios, integrated spacecraft systems, and operational procedures in a relevant environment before deployment. By integrating realistic virtual environments, immersive technology allows for the visualization and interaction with virtual spacecraft models, mission landscapes, and complex operational tasks. This approach helps identify potential design flaws, operational challenges, and safety considerations. It also provides valuable insights for risk reduction and helps improve mission efficiency and effectiveness. With advanced motion tracking systems and custom virtual environments, data can be gathered and evaluated to help NASA refine training protocols, develop specialized training procedures, and optimize human-robotic interactions for future space missions. Furthermore, immersive technology offers opportunities for future training initiatives at NASA. The Virtual Reality Laboratory at JSC has pioneered training with Virtual Reality (VR) since the Hubble Space Telescope repair missions in the early 1990’s. Extended Reality (XR) simulations enable astronauts to rehearse complex spacewalks, spacecraft maneuvers, and extravehicular activities in a safe and controlled environment. By replicating the physical and cognitive challenges of space missions, immersive training experiences enhance astronauts’ situational awareness, decision-making abilities, and adaptability to unexpected scenarios. Additionally, immersive technology facilitates collaborative training, allowing geographically dispersed crew and mission control personnel to engage in synchronized simulations, fostering teamwork and effective communication. The adoption of immersive technology in NASA’s testing, evaluation, and future training programs has yielded significant benefits. By incorporating human-in-the-loop simulations for studies involving Extra Vehicular Activities (EVA), surface mobility and landing systems, NASA can identify and mitigate risks, optimize operational procedures, and enhance mission success. Ultimately, immersive simulation experiences can empower astronauts to better navigate the complexities of space missions, ensuring their safety, productivity, and success in the dynamic and challenging environments they will experience at the Lunar South Pole.

HITL↗

Characterization of deliberately nickel-doped silicon wafers and solar cells

Microstructural and electrical evaluation tests were performed on nickel-doped p-type silicon wafers before and after solar cell fabrication. The concentration levels of nickel in silicon were 5 x 10 to the 14th power, 4 x 10 to the 15th power, and 8 x 10 to the 15th power atoms/cu cm. It was found that nickel precipitated out during the growth process in all three ingots. Clumps of precipitates, some of which exhibited star shape, were present at different depths. If the clumps are distributed at depths approximately 20 micron apart and if they are larger than 10 micron in diameter, degradation occurs in solar cell electrical properties and cell conversion efficiency. The larger the size of the precipitate clump, the greater the degradation in solar cell efficiency. A large grain boundary around the cell effective area acted as a gettering center for the precipitates and impurities and caused improvement in solar cell efficiency. Details of the evaluation test results are given.

Salama, A. M.↗

Fenestration System Performance Research, Testing, and Evaluation

The US DOE was and is instrumental to NFRC's beginning and its continued success. The 2005 to 2009 funding enables NFRC to continue expanding and create new, improved ratings procedures. Research funded by the US DOE enables increased fenestration energy rating accuracy. International harmonization efforts supported by the US DOE allow the US to be the global leader in fenestration energy ratings. Many other governments are working with the NFRC to share its experience and knowledge toward development of their own national fenestration rating process similar to the NFRC's. The broad and diverse membership composition of NFRC allows anyone with a fenestration interest to come forward with an idea or improvement to the entire fenestration community for consideration. The NFRC looks forward to the next several years of growth while remaining the nation's resource for fair, accurate, and credible fenestration product energy ratings. NFRC continues to improve its rating system by considering new research, methodologies, and expanding to include new fenestration products. Currently, NFRC is working towards attachment energy ratings. Attachments are blinds, shades, awnings, and overhangs. Attachments may enable a building to achieve significant energy savings. An NFRC rating will enable fair competition, a basis for code references, and a new ENERGY STAR product category. NFRC also is developing rating methods to consider non specular glazing such as fritted glass. Commercial applications frequently use fritted glazing, but no rating method exists. NFRC is testing new software that may enable this new rating and contribute further to energy conservation. Around the world, many nations are seeking new energy conservation methods and NFRC is poised to harmonize its rating system assisting these nations to better manage and conserve energy in buildings by using NFRC rated and labeled fenestration products. As this report has shown, much more work needs to be done to continues research to improve existing ratings and develop new ones. NFRC needs to continue the work it has begun in several nations to implement the NFRC rating system that has been introduced. Many nations are eager to accept the expertise NFRC can offer to achieve energy conservation goals. NFRC looks forward to a continues partnership with the US Department of Energy to cooperatively achieve both.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

FY22 X-Hab: Colorado School of Mines: Planetary Resource & In-Situ Material Habitat Outfitting for Space Exploration (PRISM-HOUSE)

The Colorado School of Mines (CSM) was awarded a project under the Moon to Mars eXploration Systems and Habitation (M2M X-Hab) Academic Innovation Challenge on June 10, 2021 for the proposed Planetary Resource & In-Situ Material Habitat Outfitting for Space Exploration (PRISM-HOUSE) lunar habitat system. The project deliverables have been executed concurrently with coursework in the CSM Space Resources program, specifically for the Space Resources Project I & II classes. A team was established in the fall semester of 2021 and a Systems Engineering process was followed to brainstorm initial concepts, determine objectives, flow down top-level requirements, and identify areas for which the project could best further the understanding of the overall system through targeted detailed design and design evaluation testing. This report summarizes the overall project, as well as specific work completed in the spring semester of 2022. PRISM-HOUSE is a lunar habitat system that is deployed on the lunar surface robotically and supports safe, long-term human occupancy while maximizing the use of in-situ resources and minimizing the mass of supplies and equipment that must be delivered from Earth. In this report, the team provides an overview and description of the objectives, the system, and how the current design was selected from various alternatives, as well as the resulting products of systems engineering tasks such as product and specification trees and flow-down requirements. A review of current risks and planned mitigation are reviewed. Four key PRISM-HOUSE systems are explored: the inflatable Habitat, External Structures & Environmental Protection (ESEP), Human Interior Goods (HIG), and ECLSS & Remote Outfitting (E&RO); for each, the team provides a detailed system description and an overview of analyses performed supporting final design, followed by a review of each Design Evaluation Test (DET) performed and resulting conclusions. The report closes with a suggestion of next steps.

Peter Corwin↗

Acciona Solar Technology Performance Evaluation: Cooperative Research and Development Final Report, CRADA Number CRD-10-384

Under this agreement, NREL will work with Acciona to conduct joint testing, evaluation, and data collection related to Acciona's solar technologies and systems. This work includes, but is not limited to, testing and evaluation of solar component and system technologies, data collection and monitoring, performance evaluation, reliability testing, and analysis. This work will be conducted at Acciona's Nevada Solar One (NSO) power plant and NREL test facilities. Specific projects will be developed on a task order basis. Each task order will identify the name of the project and deliverables to be produced under the task order. Each task order will delineate an estimated completion date based on a project's schedule. Any reports developed under this CRADA must be reviewed by both NREL and Acciona and approved by each organization prior to publication of results or documents.

14 SOLAR ENERGY↗

Realistic simulation of reduced-dose CT with noise modeling and sinogram synthesis using DICOM CT images

Purpose: Reducing the patient dose while maintaining the diagnostic image quality during CT exams is the subject of a growing number of studies, in which simulations of reduced-dose CT with patient data have been used as an effective technique when exploring the potential of various dose reduction techniques. Difficulties in accessing raw sinogram data, however, have restricted the use of this technique to a limited number of institutions. Here, we present a novel reduced-dose CT simulation technique which provides realistic low-dose images without the requirement of raw sinogram data. Methods: Two key characteristics of CT systems, the noise equivalent quanta (NEQ) and the algorithmic modulation transfer function (MTF), were measured for various combinations of object attenuation and tube currents by analyzing the noise power spectrum (NPS) of CT images obtained with a set of phantoms. Those measurements were used to develop a comprehensive CT noise model covering the reduced x-ray photon flux, object attenuation, system noise, and bow-tie filter, which was then employed to generate a simulated noise sinogram for the reduced-dose condition with the use of a synthetic sinogram generated from a reference CT image. The simulated noise sinogram was filtered with the algorithmic MTF and back-projected to create a noise CT image, which was then added to the reference CT image, finally providing a simulated reduced-dose CT image. The simulation performance was evaluated in terms of the degree of NPS similarity, the noise magnitude, the bow-tie filter effect, and the streak noise pattern at photon starvation sites with the set of phantom images. Results: The simulation results showed good agreement with actual low-dose CT images in terms of their visual appearance and in a quantitative evaluation test. The magnitude and shape of the NPS curves of the simulated low-dose images agreed well with those of real low-dose images, showing discrepancies of less than +/−3.2% in terms of the noise power at the peak height and +/−1.2% in terms of the spatial frequency at the peak height. The magnitudes of the noise measured for 12 different combinations the phantom size, tube current, and reconstruction kernel for the simulated and real low-dose images were very similar, with differences of 0.1 to 4.7%. Thep value for a statistical testing of the difference in the noise magnitude ranged from 0.99 to 0.11, showing that there was no difference statistically between the noise magnitudes of the real and simulated low-dose images using our method. The strength and pattern of the streak noise in an anthropomorphic phantom was also consistent with expectations. Conclusions: A novel reduced-dose CT simulation technique was developed which uses only CT images while not requiring raw sinogram data. Our method can provide realistic simulation results under reduced-dose conditions both in terms of the noise magnitude and the textual appearance. This technique has the potential to promote clinical research for patient dose reductions.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Chapter 8 - Testing and Evaluation Methods for Protection Systems

In this chapter, we aim to present different approaches used formally and informally for the evaluation of protection devices and schemes. This chapter starts with presenting background on generalization of protection device components, followed by the resources necessary to evaluate the protection system. Further, this chapter presents the different approaches used in protection evaluation with their advantages and disadvantages. Finally, this chapter closes by presenting background on technology readiness level metrics. Technology readiness level metric is borrowed from the space industry for the purpose of comparing the maturity of the different protection technologies and using the appropriate evaluation methods from the list presented here.

power systems↗