Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Process based assessment”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Evidence-Based Process for Assessing Teamwork Competencies in Applicant Performance in High-Risk, Operational Occupations

In this work, we provide a detailed look at how behavioral competencies necessary for high-risk, operational jobs, including task- and person-oriented aspects of teamwork, leadership, and followership, should be defined and operationalized in context. These competencies are thought to positively predict performance in aerospace professions. Indeed, the assessments applied in high stakes selection contexts and the way associated behavioral competencies are evaluated must be carefully considered to ensure that optimal applicants are selected. We provide insight into the behavioral competency development and measurement process, elaborating upon particularly critical competencies (i.e., team orientation) and describing challenges to measurement.

Isabel Bilotta↗

NASA Human System Risk Assessment Process

NASA utilizes an evidence based system to perform risk assessments for the human system for spaceflight missions. The center of this process is the multi-disciplinary Human System Risk Board (HSRB). The HSRB is chartered from the Chief Health and Medical Officer (OCHMO) at NASA Headquarters. The HSRB reviews all human system risks via an established comprehensive risk and configuration management plan based on a project management approach. The HSRB facilitates the integration of human research (terrestrial and spaceflight), medical operations, occupational surveillance, systems engineering and many other disciplines in a comprehensive review of human system risks. The HSRB considers all factors that influence human risk. These factors include pre-mission considerations such as screening criteria, training, age, sex, and physiological condition. In mission factors such as available countermeasures, mission duration and location and post mission factors such as time to return to baseline (reconditioning), post mission health screening, and available treatments. All of the factors influence the total risk assessment for each human risk. The HSRB performed a comprehensive review of all potential inflight medical conditions and events and over the course of several reviews consolidated the number of human system risks to 30, where the greatest emphasis is placed for investing program dollars for risk mitigation. The HSRB considers all available evidence from human research and, medical operations and occupational surveillance in assessing the risks for appropriate mitigation and future work. All applicable DRMs (low earth orbit for 6 and 12 months, deep space for 30 days and 1 year, a lunar mission for 1 year, and a planetary mission for 3 years) are considered as human system risks are modified by the hazards associated with space flight such as microgravity, exposure to radiation, distance from the earth, isolation and a closed environment. Each risk has a summary two-page assessment representing the state of knowledge/evidence of that risk, available risk mitigations, traceability to the Space Flight Human System Standards (SFHSS) and program requirements, and future work required. These data then can drive coordinated budgets across the Human Research Program, the International Space Station, Crew Health and Safety and Advanced Exploration System budgets to provide the most economical and timely mitigations. The risk assessments were completed for the 6 DRMs and serve as the baseline for which subsequent research and technology development and crew health care portfolios can be assessed. The HSRB reviews each risk at least annually or when new evidence/information is available that adds to the body of evidence. The current status of each risk can be reported to program management for operations, budget reviews and general oversight of the human system risk management program.

Francisco, D.↗

A Strategy to Integrate Probabilistic Risk Assessment into Design and Development Processes for Aerospace Based pon Mars Exploration Rover Experiences

This paper will discuss the Probabilistic Risk Assessment (PRA) effort and its involvement with related activities during the development of the Mars Exploration Rover (MER). The Rovers were launched 2003.June.10 (Spirit) and 2003.July.7 (Opportunity), and both have proven very successful. Although designed for a 90-day mission, the Rovers have been operating for over two earth years. This paper will review aspects of how the MER project integrated PRA into the design and development process. A companion paper (Development of the Mars Exploration Rover PRA) will describe the MER PRA and design changes from those results.

Probabilistic Risk Assessment (PRA)↗

The experience factory: Can it make you a 5? or what is its relationship to other quality and improvement concepts?

The concepts of quality improvements have permeated many businesses. It is clear that the nineties will be the quality era for software and there is a growing need to develop or adapt quality improvement approaches to the software business. Thus we must understand software as an artifact and software as a business. Since the business we are dealing with is software, we must understand the nature of software and software development. The software discipline is evolutionary and experimental; it is a laboratory science. Software is development not production. The technologies of the discipline are human based. There is a lack of models that allow us to reason about the process and the product. All software is not the same; process is a variable, goals are variable, etc. Packaged, reusable, experiences require additional resources in the form of organization, processes, people, etc. There have been a variety of organizational frameworks proposed to improve quality for various businesses. The ones discussed in this presentation include: Plan-Do-Check-Act, a quality improvement process based upon a feedback cycle for optimizing a single process model/production line; the Experience Factory/Quality Improvement Paradigm, continuous improvements through the experimentation, packaging, and reuse of experiences based upon a business's needs; Total Quality Management, a management approach to long term success through customer satisfaction based on the participation of all members of an organization; the SEI capability maturity model, a staged process improvement based upon assessment with regard to a set of key process areas until you reach a level 5 which represents a continuous process improvement; and Lean (software) Development, a principle supporting the concentration of the production on 'value added' activities and the elimination of reduction of 'not value added' activities.

Basili, Victor R.↗

Assessment of Edge-Based Viscous Method for Corner-Flow Solutions on Graphics Processing Units

A highly efficient, edge-based viscous (EBV) discretization method has been recently implemented in a practical, unstructured-grid, node-centered, finite-volume flow solver and evaluated for Reynolds-averaged Navier-Stokes (RANS) formulations. In comparison to a well-established cell-based viscous (CBV) method, the EBV method has demonstrated multifold acceleration of all viscous-kernel computations on general unstructured mixed-element grids. The viscous kernels include evaluation of viscous fluxes, diffusion terms in turbulence models, and the corresponding Jacobian terms. In this paper, an EBV implementation of a nonlinear extension of the Spalart-Allmaras turbulence model, SA-neg-QCR2000, is presented and verified. The SA-neg-QCR2000 model is used for simulating turbulent corner flows. Previously reported EBV computations have been conducted on traditional computing architectures based on central processing units (CPU). This paper assesses benefits of the EBV method on modern high-performance computing architectures based on graphics processing units (GPU). The GPU implementations of the CBV and EBV methods are verified by comparing solutions and iterative convergence with those observed in CPU computations on the same grids. A comprehensive assessment of the EBV speedup on CPU and GPU architectures is presented for established benchmark corner flows, namely, a supersonic flow through a long square duct and a subsonic flow around a NASA juncture flow model.

CFD↗

Assessment of Edge-Based Viscous Method for Corner-Flow Solutions on Graphics Processing Units

A highly efficient, edge-based viscous (EBV) discretization method has been recently implemented in a practical, unstructured-grid, node-centered, finite-volume flow solver and evaluated for Reynolds-averaged Navier-Stokes (RANS) formulations. In comparison to a well-established cell-based viscous (CBV) method, the EBV method has demonstrated multifold acceleration of all viscous-kernel computations on general unstructured mixed-element grids. The viscous kernels include evaluation of viscous fluxes, diffusion terms in turbulence models, and the corresponding Jacobian terms. In this paper, an EBV implementation of a nonlinear extension of the Spalart-Allmaras turbulence model, SA-neg-QCR2000, is presented and verified. The SA-neg-QCR2000 model is used for simulating turbulent corner flows. Previously reported EBV computations have been conducted on traditional computing architectures based on central processing units (CPU). This paper assesses benefits of the EBV method on modern high-performance computing architectures based on graphics processing units (GPU). The GPU implementations of the CBV and EBV methods are verified by comparing solutions and iterative convergence with those observed in CPU computations on the same grids. A comprehensive assessment of the EBV speedup on CPU and GPU architectures is presented for established benchmark corner flows, namely, a supersonic flow through a long square duct and a subsonic flow around a NASA juncture flow model.

CFD↗

A unified process for systems identification based on performance assessment

Many modern spacecraft are complex multi-body dynamic systems where the bodies are connected by several active control systems for pointing and isolation. Mission requirements indicate that many structural modes and possibly some nonlinear effects will require characterization. Thus, even characterization at the subsystem level will become more difficult than usual. System level characterization difficulties will be compounded by the fact that only limited ground testing will be possible on the full up system, and flight testing will be restricted by an extremely limited measurements set. The object of the present discussion is the application of matrix majorant theory to the problem of assessing dynamic system performance when knowledge of the system is uncertain. We show how majorants provide an effective tool to relate required performance output to system identification test quality in terms of residual uncertainty in input-output relations, parameter values, nonlinearities, and interactions. The underlying machinery consists of the block-norm matrix which is a nonnegative matrix each of whose elements is the norm of a block of a suitably partitioned matrix. A matrix which bounds the block-norm matrix in the sense of nonnegative matrices, i.e., element by element is known as a majorant.

Hyland, C.↗

Conceptual design for aerospace vehicles

The designers of aircraft and more recently, aerospace vehicles have always struggled with the problems of evolving their designs to produce a machine which would perform its assigned task(s) in some optimum fashion. Almost invariably this involved dealing with more variables and constraints than could be handled in any computationally feasible way. With the advent of the electronic digital computer, the possibilities for introducing more variable and constraints into the initial design process led to greater expectations for improvement in vehicle (system) efficiency. The creation of the large scale systems necessary to achieve optimum designs has, for many reason, proved to be difficult. From a technical standpoint, significant problems arise in the development of satisfactory algorithms for processing of data from the various technical disciplines in a way that would be compatible with the complex optimization function. Also, the creation of effective optimization routines for multi-variable and constraint situations which could lead to consistent results has lagged. The current capability for carrying out the conceptual design of an aircraft on an interdisciplinary bases was evaluated to determine the need for extending this capability, and if necessary, to recommend means by which this could be carried out. Based on a review of available documentation and individual consultations, it appears that there is extensive interest at Langley Research Center as well as in the aerospace community in providing a higher level of capability that meets the technical challenges. By implication, the current design capability is inadequate and it does not operate in a way that allows the various technical disciplines to participate and cooperately interact in the design process. Based on this assessment, it was concluded that substantial effort should be devoted to developing a computer-based conceptual design system that would provide the capability needed for the near-term as well as framework for development of more advanced methods to serve future needs.

Gratzer, Louis B.↗

Assessing Vegetation Function with Imaging Spectroscopy

Healthy vegetation function supports diverse biological communities and ecosystem processes, and provides crops, forest products, forage, and countless other benefits. Vegetation function can be assessed by examining dynamic processes and by evaluating plant traits, which themselves are dynamic. Using both trait-based and process-based approaches, spectroscopy can assess vegetation function at multiple scales using a variety of sensors and platforms ranging from proximal to airborne and satellite measurements. Since spectroscopic data are defined by the instruments and platforms available, along with their corresponding spatial, temporal and spectral scales, and since these scales may not always match those of the function of interest, consideration of scale is a necessary focus. For a full understanding of vegetation processes, combined (multi-scale) sampling methodsusing empirical and theoretical approaches are required, along with improved informatics.

Gamon, J. A.↗

Quantifying Cybersecurity Risk for NASA Missions

An end-to-end cyber risk assessment process is presented that is based on the combination of guidelines from the National Institute of Standards & Technology (NIST), the standard 5x5 risk matrix, and quantitative methods for generating loss exceedance curves. The NIST guidelines provide a framework for cyber risk assessment, and the standard 5x5 matrix is widely used across the industry for the representation of risk across multiple disciplines. Loss exceedance curves are a means of quantitatively assessing the loss that occurs due to a given risk profile. Combining these different techniques enables us to follow the guidelines, adhere to standard 5x5 risk management practices and develop quantitative metrics simultaneously. Our quantification process is based on the consideration of the NASA and JPL Cost Risk assessment modeling techniques as we define the cost associated with the cybersecurity risk profile of a mission as a function of the mission cost.

Miller, Robert L.↗

Complex Decision-Making Applications for the NASA Space Launch System

The Space Shuttle program is ending and elements of the Constellation Program are either being cancelled or transitioned to new NASA exploration endeavors. NASA is working diligently to select an optimum configuration for the Space Launch System (SLS), a heavy lift vehicle that will provide the foundation for future beyond LEO large ]scale missions for the next several decades. Thus, multiple questions must be addressed: Which heavy lift vehicle will best allow the agency to achieve mission objectives in the most affordable and reliable manner? Which heavy lift vehicle will allow for a sufficiently flexible exploration campaign of the solar system? Which heavy lift vehicle configuration will allow for minimizing risk in design, test, build and operations? Which heavy lift vehicle configuration will be sustainable in changing political environments? Seeking to address these questions drove the development of an SLS decisionmaking framework. From Fall 2010 until Spring 2011, this framework was formulated, tested, fully documented, and applied to multiple SLS vehicle concepts at NASA from previous exploration architecture studies. This was a multistep process that involved performing FOM-based assessments, creating Pass/Fail gates based on draft threshold requirements, performing a margin-based assessment with supporting statistical analyses, and performing sensitivity analysis on each. This paper discusses the various methods of this process that allowed for competing concepts to be compared across a variety of launch vehicle metrics. The end result was the identification of SLS launch vehicle candidates that could successfully meet the threshold requirements in support of the SLS Mission Concept Review (MCR) milestone.

Lyles, Garry↗

A Successful Infusion Process for Enabling Lunar Exploration Technologies

The NASA Vision for Space Exploration begins with a more reliable flight capability to the International Space Station and ends with sending humans to Mars. An important stepping stone on the path to Mars encompasses human missions to the Moon. There is little doubt throughout the stakeholder community that new technologies will be required to enable this Vision. However, there are many factors that influence the ability to successfully infuse any technology including the technical risk, requirement and development schedule maturity, and, funds available. This paper focuses on effective infusion processes that have been used recently for the technologies in development for the lunar exploration flight program, Constellation. Recent successes with Constellation customers are highlighted for the Exploration Technology Development Program (ETDP) Projects managed by NASA Glenn Research Center (GRC). Following an overview of the technical context of both the flight program and the technology capability mapping, the process is described for how to effectively build an integrated technology infusion plan. The process starts with a sound risk development plan and is completed with an integrated project plan, including content, schedule and cost. In reality, the available resources for this development are going to change over time, necessitating some level of iteration in the planning. However, the driving process is based on the initial risk assessment, which changes only when the overall architecture changes, enabling some level of stability in the process.

Over, Ann P.↗

Advancing the State-of-the-Practice for Liquid Rocket Engine Injector Design

Current shortcomings in both the overall injector design process and its underlying combustion stability assessment methodology are rooted in the use of empirically based or low fidelity representations of complex physical phenomena and geometry details that have first order effects on performance, thermal environments and combustion stability. The result is a design and analysis capability that is often inadequate to reliably arrive at a suitable injector design in an efficient manner. Specifically, combustion instability has been particularly difficult to predict and mitigate. Large hydrocarbon-fueled booster engines have been especially problematic in this regard. Where combustion instability has been a problem, costly and time-consuming redesign efforts have often been an unfortunate consequence. This paper presents an overview of a recently completed effort at NASA Marshall Space Flight Center to advance the state-of-the-practice for liquid rocket engine injector design. Multiple perturbations of a gas-centered swirl coaxial (GCSC) element that burned gaseous oxygen and RP-1 were designed, assessed for combustion stability, and tested. Three designs, one stable, one marginally unstable and one unstable, were used to demonstrate both an enhanced overall injector design process and an improved combustion stability assessment process. High-fidelity results from state-of-the-art computational fluid dynamics CFD simulations were used to substantially augment and improve the injector design methodology. The CFD results were used to inform and guide the overall injector design process. They were also used to upgrade selected empirical or low-dimensional quantities in the ROCket Combustor Interactive Design (ROCCID) stability assessment tool. Hot fire single element injector testing was used to verify both the overall injector designs and the stability assessments. Testing was conducted at the Air Force Research Laboratory and at Purdue University. Companion papers provide details of the overall injector design process, full- and sub-scale testing, ROCCID-based stability assessments and the CFD simulations.

Tucker, P. K.↗

A unifying framework for rigid multibody dynamics and serial and parallel computational issues

A unifying framework for various formulations of the dynamics of open-chain rigid multibody systems is discussed. Their suitability for serial and parallel processing is assessed. The framework is based on the derivation of intrinsic, i.e., coordinate-free, equations of the algorithms which provides a suitable abstraction and permits a distinction to be made between the computational redundancy in the intrinsic and extrinsic equations. A set of spatial notation is used which allows the derivation of the various algorithms in a common setting and thus clarifies the relationships among them. The three classes of algorithms viz., O(n), O(n exp 2) and O(n exp 3) or the solution of the dynamics problem are investigated. Researchers begin with the derivation of O(n exp 3) algorithms based on the explicit computation of the mass matrix and it provides insight into the underlying basis of the O(n) algorithms. From a computational perspective, the optimal choice of a coordinate frame for the projection of the intrinsic equations is discussed and the serial computational complexity of the different algorithms is evaluated. The three classes of algorithms are also analyzed for suitability for parallel processing. It is shown that the problem belongs to the class of N C and the time and processor bounds are of O(log2/2(n)) and O(n exp 4), respectively. However, the algorithm that achieves the above bounds is not stable. Researchers show that the fastest stable parallel algorithm achieves a computational complexity of O(n) with O(n exp 4), respectively. However, the algorithm that achieves the above bounds is not stable. Researchers show that the fastest stable parallel algorithm achieves a computational complexity of O(n) with O(n exp 2) processors, and results from the parallelization of the O(n exp 3) serial algorithm.

Fijany, Amir↗

Characterization of Ceramic Matrix Composite Combustor Components: Pre and Post Exposure

The pursuit of lower emissions and higher performance from gas turbine engines requires the development of innovative concepts and the use of advanced materials for key engine components. One key engine component is the combustor, where innovative design and material improvements have the potential to lower emissions. Efforts to develop a High Speed Civil Transport with low emissions were focused on the evaluation of combustor concepts with liners fabricated from a ceramic matrix composite of silicon carbide fibers in a silicon carbide matrix (SiC/SiC). The evaluation of SiC/SiC composites progressed from simple coupons (to establish a first-order database and identify operant failure mechanisms and damage accumulation processes), to feature-based subelements (to assess fabricability and in situ material response), to actual components (to assess structural integrity, dimensional, and compositional fidelity) tested under simulated engine conditions. As in the case of all evolutionary material and process work, a key element to resolving fabrication issues is the evaluation of witness areas taken from fabricated components before testing the actual component. The witness material from these components allowed microstructural and mechanical testing to be performed and compared to the ideal, flat panel, conditions and data that are typical of basic characterization. This also allowed samples of similar design to be taken from components after 115 hours of combustion exposure. Testing consisted of tensile, double notch shear, ring burst, and thermal conductivity that sampled various regions of the components. The evaluation of the witness material allowed an understanding of the fabrication process, highlighting critical issues, in an early phase of the learning curve development of these configuration and material unique parts. Residual property testing, after exposure, showed if degradation of the material under actual service conditions was occurring. This paper will present the results of this critical testing. Evaluations that consider the degree of complexity of the fabricated part were established to relate in situ performance to that of flat panel based coupons. Nondestructive evaluation was used throughout the evaluation process. These results will also be discussed as an aid in understanding the test results.

Ojard, G.↗

John F. Kennedy Space Center, Safety, Reliability, Maintainability and Quality Assurance, Survey and Audit Program

This document is the product of the KSC Survey and Audit Working Group composed of civil service and contractor Safety, Reliability, and Quality Assurance (SR&QA) personnel. The program described herein provides standardized terminology, uniformity of survey and audit operations, and emphasizes process assessments rather than a program based solely on compliance. The program establishes minimum training requirements, adopts an auditor certification methodology, and includes survey and audit metrics for the audited organizations as well as the auditing organization.

Source record↗

A Scenario-Based Approach to Assess Continuity Gaps in Earth Observations

Decision analysis processes outlined in systems engineering references, such as the Systems Engineering Body of Knowledge [1] or the NASA Systems Engineering Handbook [2], recommend following a series of steps to support decision-making for engineering applications. These steps are consistent across the literature and typically involve defining objectives, defining relevant criteria against which candidate alternatives can be assessed, selecting an evaluation method, assessing alternatives, and making a recommendation based on this assessment. These approaches are well-suited to assess systems for which sets of common objectives and constraints can be identified. A vast body of literature describes their application to numerous engineering problems, and many methods have been developed since the middle of the 20th century to support the assessment of candidate alternatives for such systems [3, 4, 5, 6]. These approaches, however, show some limitations when decisions pertain to systems of systems. These collections of individual systems typically do not share a common set of objectives and constraints, tend to be highly complex, and the definition of assessable, high-value candidate alternatives poses a challenge due to interdependencies. The formulation, development, operation, and funding of Earth observing missions are such that gaps may occur between missions, therefore impacting the continuity of measurements. These Earth observing mission architectures constitute systems of systems for which a common set of objectives and constraints can be challenging to define. When tasked with assessing gaps that may occur for a series of spaceborne missions that address similar science parameters, the authors therefore proposed to depart from the traditional objective- and criteria-based approach and instead adopted a scenario-based approach. This approach does not require a prioritized set of common objectives; rather, it assesses the impact of possible decisions on the system-of-systems and characterizes its possible future states. It also offers the flexibility to adjust assumptions, update inputs, and refine supporting models over time, while enabling the rapid, early identification of challenges and key decision points. By simulating the impact of potential decisions on the entirety of the system-of-systems, the approach enables the synchronization of multiple decisions that typically occur at the level of the individual system. This paper provides an overview of the approach that was developed to assess continuity gaps for a series of operational and planned spaceborne Earth observing missions, a description of its application to the problem at hand, and a discussion of currently known limitations.

scenario earth observations continuity gaps↗