Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “evaluation framework”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 775 records · Page 43

A comparison of single-cycle versus multi-cycle proof testing strategies

Proof testing was a useful supplement to conventional nondestructive evaluation (NDE) of space shuttle main engine (SSME) components. Since many of these components involve thin sections and high toughness materials, such as Inconel 718, conventional single-cycle proof test logic is not applicable due to the propensity for stable crack growth during the proof tests. Experience with five-cycle proof testing of SSME components is summarized and a framework is outlined for understanding multi-cycle proof testing using the fracture mechanics concept of a resistance curve. Extreme value statistics are also used to propose an empirical approach to compare the advantages and disadvantages of single- versus multi-cycle proof testing. The importance of the initial flaw size distribution and specimen thickness in such a comparison is also discussed.

Hudak, Stephen J., Jr.↗

Soil moisture retrieval in the Oberpfaffenhofen testsite using MAC Europe AIRSAR data

Soil moisture content is an important parameter in many disciplines of science like hydrology, meteorology, agriculture and others. Microwave remote sensing technique has a high potential in measuring the dielectric constant of soils, which is strongly governed by the soil moisture. Much excellent work has been done on investigating the relationship between backscattering coefficient and soil moisture. Most of these studies are measured in a laboratory or are carried out with a multitemporal data set. This means, that the variation in the backscattering coefficient is only related to the soil moisture because all other parameters influencing the backscattering like surface roughness, vegetation cover, plant geometry, phenology of plants and row direction are kept constant. In this study the sensitivity of the backscattering coefficient to soil moisture of corn fields is investigated. In the framework of the MAC-Europe Campaign in June 1991, the NASA/JPL three-frequency polarimetric AIRSAR system collected data over the test site Oberpfaffenhofen. The AIRSAR campaign in Oberpfaffenhofen was complemented with intensive ground truth measurements. The sampled corn fields are nearly in the range of the same incidence angle (approximately 20 deg) and belong to different soil types. The evaluation was carried out at a single data set. The results show that the backscattering, measured at P-band, can be described with only two parameters very well. The main parameter influencing the backscattering is the soil moisture content; the second subordinated parameter is the row direction.

Wever, Tobias↗

Benchmark and Framework for Encouraging Research on Multi-Threaded Testing Tools

A problem that has been getting prominence in testing is that of looking for intermittent bugs. Multi-threaded code is becoming very common, mostly on the server side. As there is no silver bullet solution, research focuses on a variety of partial solutions. In this paper (invited by PADTAD 2003) we outline a proposed project to facilitate research. The project goals are as follows. The first goal is to create a benchmark that can be used to evaluate different solutions. The benchmark, apart from containing programs with documented bugs, will include other artifacts, such as traces, that are useful for evaluating some of the technologies. The second goal is to create a set of tools with open API s that can be used to check ideas without building a large system. For example an instrumentor will be available, that could be used to test temporal noise making heuristics. The third goal is to create a focus for the research in this area around which a community of people who try to solve similar problems with different techniques, could congregate.

Havelund, Klaus↗

Technology alternatives for the SPS

Emerging technologies may offer advantages over those selected for the reference design adopted for the SPS. While it is not possible to list all the technological innovations that may affect the SPS, it is feasible to develop a systematic methodology for assessing technical alternatives. This may be of value in evaluating proposed technologies and identifying high priority areas for research. Such a methodology includes involves (1) variation of guidelines; (2) analysis of system functions; (3) analysis of system sensitivity; (4) analysis of technology status and risk; and (5) external costs, problem areas, and criticisms of the SPS concept. The methodology is a first step towards the creation of a formal decision analytic framework which can support design choices and program decisions as development proceeds.

Glaser, P.↗

Active control of instabilities in laminar boundary-layer flow. Part 1: An overview

This paper (the first in a series) focuses on using active-control methods to maintain laminar flow in a region of the flow in which the natural instabilities, if left unattended, lead to turbulent flow. The authors review previous studies that examine wave cancellation (currently the most prominent method) and solve the unsteady, nonlinear Navier-Stokes equations to evaluate this method of controlling instabilities. It is definitely shown that instabilities are controlled by the linear summation of waves (i.e., wave cancellation). Although a mathematically complete method for controlling arbitrary instabilities has been developed (but not yet tested), the review, duplication, and physical explanation of previous studies are important steps for providing an independent verification of those studies, for establishing a framework for subsequent work which will involve automated transition control, and for detailing the phenomena by which the automated studies can be used to expand knowledge of flow control.

Joslin, Ronald D.↗

Processing Spacecraft Data Without Confusion

Producing multiple versions of the same data product for the same time frame with the same remotely sensed inputs can be a recipe for disaster. Yet, amidst the commotion of satellite launch and early operations (LEO), such data processing is needed. After LEO, the situation gets worse. Processing newly arriving data ("forward processing") is augmented with reprocessing and algorithm development, comparison, evaluation, and testing -- often happening all at the same time. The problem can be analyzed in three main parts -- maintaining multiple versions of algorithms and data so that end-product users are not overwhelmed,allocating computer resources efficiently, and simplifying production operations so that va st amounts of data can be processed with minimal staff and fewer errors. OMIDAPS provides a framework for execution of algorithms that transform lower level data acquired by OMI on NASA's Aura satellite into higher level science data products. In contrast to traditional science data processing systems, we address all parts of the problem with an innovative approach allowing multiple data processing to run within a single physical system. The data products, imports, exports, and execution planning are all segregated into distinct "ArchiveSets." This paper describes reasons for multiple concurrent productions on a typical satellite data processing project using OMI as an example. It describes the virtual data processing system concept and its advantages over separate physical processing strings. It explores the specific implementation of the virtual systems within OMIDAPS and discusses some of the implications of our approach and describes how virtual processing is used to accomplish the overall mission of OMI data processing.

Tilmes, Curt↗

Automation of PCXMC and ImPACT for NASA Astronaut Medical Imaging Dose and Risk Tracking

To automate astronaut organ and effective dose calculations from occupational X-ray and computed tomography (CT) examinations incorporating PCXMC and ImPACT tools and to estimate the associated lifetime cancer risk per the National Council on Radiation Protection & Measurements (NCRP) using MATLAB(R). Methods: NASA follows guidance from the NCRP on its operational radiation safety program for astronauts. NCRP Report 142 recommends that astronauts be informed of the cancer risks from reported exposures to ionizing radiation from medical imaging. MATLAB(R) code was written to retrieve exam parameters for medical imaging procedures from a NASA database, calculate associated dose and risk, and return results to the database, using the Microsoft .NET Framework. This code interfaces with the PCXMC executable and emulates the ImPACT Excel spreadsheet to calculate organ doses from X-rays and CTs, respectively, eliminating the need to utilize the PCXMC graphical user interface (except for a few special cases) and the ImPACT spreadsheet. Results: Using MATLAB(R) code to interface with PCXMC and replicate ImPACT dose calculation allowed for rapid evaluation of multiple medical imaging exams. The user inputs the exam parameter data into the database and runs the code. Based on the imaging modality and input parameters, the organ doses are calculated. Output files are created for record, and organ doses, effective dose, and cancer risks associated with each exam are written to the database. Annual and post-flight exposure reports, which are used by the flight surgeon to brief the astronaut, are generated from the database. Conclusions: Automating PCXMC and ImPACT for evaluation of NASA astronaut medical imaging radiation procedures allowed for a traceable and rapid method for tracking projected cancer risks associated with over 12,000 exposures. This code will be used to evaluate future medical radiation exposures, and can easily be modified to accommodate changes to the risk calculation procedure.

Bahadori, Amir↗

An Evaluation of Size-Resolved Cloud Microphysics Scheme Numerics for use with Radar Observations Part II: Condensation and Evaporation

Accurate numerical modeling of clouds and precipitation is essential for weather forecasting and climate change research. While size-resolved (bin) cloud microphysics models predict particle size distributions without imposing shapes, results are subject to artificial size distribution broadening owing to numerical diffusion associated with various processes. Whereas Part 1 addressed collision-coalescence, here we investigate numerical diffusion that occurs in solving condensation and evaporation. In a parcel model framework, all of the numerical schemes examined converge to one solution of condensation and evaporation as the mass grid is refined, and the advection-based schemes are recommended over the reassigning schemes. Including Eulerian vertical advection in a column limits the convergence to some extent, but that limitation occurs at a sufficiently fine mass grid, and the number of iterations in solving vertical advection should be minimized to reduce numerical diffusion. Insubstantial numerical diffusion in solving condensation can be amplified if collision-coalescence is also active, which in turn can be substantially diminished if turbulence effects on collision are incorporated. Large-eddy simulations of a drizzling stratocumulus field reveal that changes in moments of Doppler spectra obtained using different mass grids are consistent with those obtained from the simplified framework, and that spectral moments obtained using a mass grid designed to effectively reduce numerical diffusion are generally closer to observations. Notable differences between the simulations and observations still exist, and our results suggest a need to consider whether factors other than numerical diffusion in the fundamental process schemes employed can cause such differences.

Cloud microphysics↗

Evaluating Faulty State Occurrence in Wildfire UAS Missions Using Markov Chains

As autonomous technology advances, unmanned aircraft systems are increasingly integrated into emergency response missions, such as wildfire response. These systems must be be safe with less risk than non-autonomous counter parts, yet quantifying the risk associated with present-day and future systems conventionally relies solely on expert opinion and little data. Instead, combining narrative mishap reports with probabilistic analysis can provide a method for evolutionary and timely risk analysis. In this paper, we present a framework for a data-driven probabilistic risk assessment style analysis, where hazard events and rates originate from documented UAS mishaps. The framework is applied to a UAS mapping mission in wildfire response, including a fault tree analysis, event tree analysis, and probabilistic analysis using Markov Chains. The analysis provides an enumeration of hazards in the system, hazard events that can lead to faults, the probability of a mission experiencing any fault, the probability of experiencing a specific fault, and the expected time spent until faulty states occur in present-day operations.

risk analysis↗

Evaluating Faulty State Occurrence in Wildfire UAS Missions Using Markov Chains

As autonomous technology advances, unmanned aircraft systems are increasingly integrated into emergency response missions, such as wildfire response. These systems must be be safe with less risk than non-autonomous counter parts, yet quantifying the risk associated with present-day and future systems conventionally relies solely on expert opinion and little data. Instead, combining narrative mishap reports with probabilistic analysis can provide a method for evolutionary and timely risk analysis. In this paper, we present a framework for a data-driven probabilistic risk assessment style analysis, where hazard events and rates originate from documented UAS mishaps. The framework is applied to a UAS mapping mission in wildfire response, including a fault tree analysis, event tree analysis, and probabilistic analysis using Markov Chains. The analysis provides an enumeration of hazards in the system, hazard events that can lead to faults, the probability of a mission experiencing any fault, the probability of experiencing a specific fault, and the expected time spent until faulty states occur in present-day operations.

risk analysis↗

Expert decision-making strategies

A recognition-primed decisions (RPD) model is employed as a framework to investigate crew decision-making processes. The quality of information transfer, a critical component of the team RPD model and an indicator of the team's 'collective consciouness', is measured and analyzed with repect to crew performance. As indicated by the RPD model, timing and patterns of information search transfer were expected to reflect extensive and continual situation assessment, and serial evaluation of alternative states of the world or decision response options.

Mosier, Kathleen L.↗

Overview of Transonic to Hypersonic Stage Separation Tool Development for Multi-Stage-to-Orbit Concepts

An overview of research efforts at NASA in support of the stage separation and ascent aerothermodynamics research program is presented. The objective of this work is to develop a synergistic suite of experimental, computational, and engineering tools and methods to apply to vehicle separation across the transonic to hypersonic speed regimes. Proximity testing of a generic bimese wing-body configuration is on-going in the transonic (Mach numbers 0.6, 1.05, and 1.1), supersonic (Mach numbers 2.3, 3.0, and 4.5) and hypersonic (Mach numbers 6 and 10) speed regimes in four wind tunnel facilities at the NASA Langley Research Center. An overset grid, Navier-Stokes flow solver has been enhanced and demonstrated on a matrix of proximity cases and on a dynamic separation simulation of the bimese configuration. Steady-state predictions with this solver were in excellent agreement with wind tunnel data at Mach 3 as were predictions via a Cartesian-grid Euler solver. Experimental and computational data have been used to evaluate multi-body enhancements to the widely-used Aerodynamic Preliminary Analysis System, an engineering methodology, and to develop a new software package, SepSim, for the simulation and visualization of vehicle motions in a stage separation scenario. Web-based software will be used for archiving information generated from this research program into a database accessible to the user community. Thus, a framework has been established to study stage separation problems using coordinated experimental, computational, and engineering tools.

Murphy, Kelly J.↗

Assessment Of Polsar And Insar Time-Series From The 2019 Nasa Am-Pm Campaign For Above-Ground Biomass Estimation

The forthcoming launch of the NASA-ISRO Synthetic ApertureRadar (NISAR) mission will open the path to a new typeof L-band measurements constituted by dense time-series ofpolarimetric backscatter and interferometric coherence withunprecedented spatial and temporal sampling. Here, we startthe development of a theoretical framework that links L-bandbackscatter time-series with interferometric coherence measurements.The water-cloud-model (WCM) and an extendedversion of the random-motion-over-ground (RMoG) modelare adopted to express radar measurements in terms of forestabove-ground biomass and tree height. Time-series datacollected during the 2019 UAVSAR AM-PM campaign inSoutheastern United States are used to evaluate the correlationof various PolSAR- and InSAR-derived parameters withfield-measured above-ground biomass.

Lavalle, Marco↗

Mars Terrain Segmentation with Less Labels

Planetary rover systems need to perform terrain segmentation to identify drivable areas as well as identify specific types of soil for sample collection. The latest Martian terrain segmentation methods rely on supervised learning which is very data hungry and difficult to train where only a small number of labeled samples are available. Moreover, the semantic classes are defined differently for different applications (e.g., rover traversal vs. geological) and as a result the network has to be trained from scratch each time, which is an inefficient use of resources. This research proposes a semi-supervised learning framework for Mars terrain segmentation where a deep segmentation network trained in an unsupervised manner on unlabeled images is transferred to the task of terrain segmentation trained on few labeled images. The network incorporates a backbone module which is trained using a contrastive loss function and an output atrous convolution module which is trained using a pixel-wise cross-entropy loss function. Evaluation results using the metric of segmentation accuracy show that the proposed method with contrastive pre-training outperforms plain supervised learning by 2%-10%. Moreover, the proposed model is able to achieve a segmentation accuracy of 91.1% using only 161 training images (1% of the original dataset) compared to 81.9% with plain supervised learning.

Wilson, Brian D↗

An investigation of fighter aircraft agility

This report attempts to unify in a single document the results of a series of studies on fighter aircraft agility funded by the NASA Ames Research Center, Dryden Flight Research Facility and conducted at the University of Kansas Flight Research Laboratory during the period January 1989 through December 1993. New metrics proposed by pilots and the research community to assess fighter aircraft agility are collected and analyzed. The report develops a framework for understanding the context into which the various proposed fighter agility metrics fit in terms of application and testing. Since new metrics continue to be proposed, this report does not claim to contain every proposed fighter agility metric. Flight test procedures, test constraints, and related criteria are developed. Instrumentation required to quantify agility via flight test is considered, as is the sensitivity of the candidate metrics to deviations from nominal pilot command inputs, which is studied in detail. Instead of supplying specific, detailed conclusions about the relevance or utility of one candidate metric versus another, the authors have attempted to provide sufficient data and analyses for readers to formulate their own conclusions. Readers are therefore ultimately responsible for judging exactly which metrics are 'best' for their particular needs. Additionally, it is not the intent of the authors to suggest combat tactics or other actual operational uses of the results and data in this report. This has been left up to the user community. Twenty of the candidate agility metrics were selected for evaluation with high fidelity, nonlinear, non real-time flight simulation computer programs of the F-5A Freedom Fighter, F-16A Fighting Falcon, F-18A Hornet, and X-29A. The information and data presented on the 20 candidate metrics which were evaluated will assist interested readers in conducting their own extensive investigations. The report provides a definition and analysis of each metric; details of how to test and measure the metric, including any special data reduction requirements; typical values for the metric obtained using one or more aircraft types; and a sensitivity analysis if applicable. The report is organized as follows. The first chapter in the report presents a historical review of air combat trends which demonstrate the need for agility metrics in assessing the combat performance of fighter aircraft in a modern, all-aspect missile environment. The second chapter presents a framework for classifying each candidate metric according to time scale (transient, functional, instantaneous), further subdivided by axis (pitch, lateral, axial). The report is then broadly divided into two parts, with the transient agility metrics (pitch lateral, axial) covered in chapters three, four, and five, and the functional agility metrics covered in chapter six. Conclusions, recommendations, and an extensive reference list and biography are also included. Five appendices contain a comprehensive list of the definitions of all the candidate metrics; a description of the aircraft models and flight simulation programs used for testing the metrics; several relations and concepts which are fundamental to the study of lateral agility; an in-depth analysis of the axial agility metrics; and a derivation of the relations for the instantaneous agility and their approximations.

Valasek, John↗

Numerical Evaluation of Mode 1 Stress Intensity Factor as a Function of Material Orientation For BX-265 Foam Insulation Material

Foam; a cellular material, is found all around us. Bone and cork are examples of biological cell materials. Many forms of man-made foam have found practical applications as insulating materials. NASA uses the BX-265 foam insulation material on the external tank (ET) for the Space Shuttle. This is a type of Spray-on Foam Insulation (SOFI), similar to the material used to insulate attics in residential construction. This foam material is a good insulator and is very lightweight, making it suitable for space applications. Breakup of segments of this foam insulation on the shuttle ET impacting the shuttle thermal protection tiles during liftoff is believed to have caused the space shuttle Columbia failure during re-entry. NASA engineers are very interested in understanding the processes that govern the breakup/fracture of this complex material from the shuttle ET. The foam is anisotropic in nature and the required stress and fracture mechanics analysis must include the effects of the direction dependence on material properties. Material testing at NASA MSFC has indicated that the foam can be modeled as a transversely isotropic material. As a first step toward understanding the fracture mechanics of this material, we present a general theoretical and numerical framework for computing stress intensity factors (SIFs), under mixed-mode loading conditions, taking into account the material anisotropy. We present mode I SIFs for middle tension - M(T) - test specimens, using 3D finite element stress analysis (ANSYS) and FRANC3D fracture analysis software, developed by the Cornel1 Fracture Group. Mode I SIF values are presented for a range of foam material orientations. Also, NASA has recorded the failure load for various M(T) specimens. For a linear analysis, the mode I SIF will scale with the far-field load. This allows us to numerically estimate the mode I fracture toughness for this material. The results represent a quantitative basis for evaluating the strength and fracture properties of anisotropic foam insulation material.

Knudsen, Erik↗

Increasing Mathematics and Science Achievement for Culturally Diverse Students through Teaching Training

The purpose of this proposal was to field test and evaluate a Teacher Training program that would prepare teachers to increase the motivation and achievement of culturally diverse students in the areas of science and mathematics. Designed as a three year program, this report covers the first two years of the training program at the Ronald McNair School in the Ravenswood School district, using the resources of the NASA Ames Research Center and the California Framework for Mathematics and Science.

Mahon, Lee↗

Plans for Assimilating AQUA data at NASA's DAO

NASA's Data Assimilation Office (DAO) is expanding its work with TIROS Operational Vertical Sounder (TOVS) to assimilate data from the advanced instruments which will fly on NASA's AQUA satellite in early 2002. The Atmospheric Infrared Sounder (AIRS), which has over 2000 channels, together with the Advanced Microwave Sounding Unit-A (AMSU-A) and the Humidity Sounder Brazil (HSB) will provide many technical challenges for data assimilation centers. One of the primary concerns is how best to subset the data in order to efficiently extract information about the Earth's atmosphere and surface. This includes static and dynamic channel selection as well as pixel thinning. The DAO is currently experimenting with simulated AIRS/AMSU/HSB radiances within the framework of our finite volume data assimilation system (NDAS) using the OPTRAN radiative transfer code developed as part of the NOAA/NASA Joint Center for Satellite Data Assimilation. The short-term goals include the assessment of the cost of processing various data subsets and preparation for near-real-time assimilation within a few months of launch. We will also discuss plans and tools for evaluating the quality of AIRS data including radiances and level 2 products from the AIRS science team.

Frank, Donald↗