Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Judgment”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 487 records · Page 27

Increasing Pilot’s Understanding of Future Automation State – an Evaluation of an Automation State and Trajectory Prediction System

A pilot in the loop flight simulation study was conducted at NASA Langley Research Center to evaluate a trajectory prediction system. The trajectory prediction system computes a five-minute prediction of the lateral and vertical path of the aircraft given the current and intent state of the automation. The prediction is shown as a graphical representation so the pilots can form an accurate mental model of the future state. Otherwise, many automation changes and triggers are hidden from the flight crew or need to be consolidated to understand if a change will occur and the exact timing of the change. Varying dynamic conditions like deceleration can obscure the future trajectory and the ability to meet constraints, especially in the vertical dimension. Current flight deck indications of flight path assume constant conditions and do not adequately support the flight crew to make correct judgments regarding constraints. The study was conducted using ten commercial airline crews from multiple airlines, paired by airline to minimize procedural effects. Scenarios spanned a range of conditions that provided evaluation in a realistic environment with complex traffic and weather conditions. In particular, scenarios probed automation state and loss of state awareness. The technology was evaluated and contrasted with current state-of-the-art flight deck capabilities modeled from the Boeing 787. Objective and subjective data were collected from aircraft parameters, questionnaires, audio/video recordings, head/eye tracking data, and observations. This paper details findings about the trajectory prediction system including recommendations about further study.

Etherington, Timothy J.↗

Comparing Unstructured Adaptive Mesh Solutions for the High Lift Common Research Model Airfoil

Discretization error is a common source of uncertainty in Computational Fluid Dynamics (CFD) analyses. Traditional means of controlling discretization error through fixed-mesh refinement studies has proven to be difficult particularly when modeling complex geometries and flow fields. One reason for this is that mesh generation in today’s production CFD workflow is often a labor intensive process that is heavily dependent on user judgment. Unstructured mesh adaptation is known to be an efficient way to control discretization errors in CFD. Adaptive methods replace user based decision making with automated processes that optimize a mesh to reduce discretization error. This paper compares the application of multiple solution adaptive techniques in combination with multiple flow solvers to solve for the flow field about a 2D airfoil section of the NASA High-Lift Common Research Model (HL-CRM). By driving the adaptive mesh processes to a similar level of mesh convergence, the ability to achieve consistent results between multiple adaptive techniques and flow solvers is demonstrated. Mesh convergence for the various adaptive mesh approaches is compared identifying potential areas for improvement and providing mesh generation guidance for future workshops.

mesh adaptation high-lift 2D airfoil↗

Comparing Unstructured Adaptive Mesh Solutions for the High Lift Common Research Model Airfoil

Discretization error is a common source of uncertainty in Computational Fluid Dynamics (CFD) analyses. Traditional means of controlling discretization error through fixed-mesh refinement studies has proven to be difficult particularly when modeling complex geometries and flow fields. One reason for this is that mesh generation in today’s production CFD workflow is often a labor intensive process that is heavily dependent on user judgment. Unstructured mesh adaptation is known to be an efficient way to control discretization errors in CFD. Adaptive methods replace user based decision making with automated processes that optimize a mesh to reduce discretization error. This paper compares the application of multiple solution adaptive techniques in combination with multiple flow solvers to solve for the flow field about a 2D airfoil section of the NASA High-Lift Common Research Model (HL-CRM). By driving the adaptive mesh processes to a similar level of mesh convergence, the ability to achieve consistent results between multiple adaptive techniques and flow solvers is demonstrated. Mesh convergence for the various adaptive mesh approaches is compared identifying potential areas for improvement and providing mesh generation guidance for future workshops.

mesh adaptation↗

CFD 2030 Grand Challenge: CFD-in-the-Loop Monte Carlo Flight Simulation for Space Vehicle Design

Flight qualification of space vehicles is markedly different from those typically employed for aircraft. The concept of an extensive flight test campaign for a space vehicle does not exist, and vehicle designers must look to alternative techniques for demonstrating robust and reliable performance of their vehicles prior to operational flight. A space vehicle may undergo only a handful of flight tests in its development cycle, with each flight representing a drastically different flight phase or flight configuration. For instance, NASA’s Space Launch System (SLS) launch vehicle and Orion spacecraft will only see a total of four flight demonstrations before flying a crew on its first operational mission, and each flight demonstrates a unique vehicle configuration and/or set of flight conditions. The SLS will be flown only one time before it becomes operational (Artemis 1). The Orion spacecraft Crew Module (CM) will have been tested twice, once on a Delta IV launch vehicle (Exploration Flight Test 1) and once as a fully integrated system with the SLS launch vehicle (Artemis 1). The Orion Launch abort system will have been tested twice, once in a pad abort scenario (Pad Abort 1) and once in an inflight abort scenario (Ascent Abort 2) on a modified Peacekeeper booster. Both of these latter tests involve only a boiler plate CM, not a functional Orion spacecraft. Thus, unlike aircraft, there is very little opportunity for engineers to assess and evaluate their preflight predictions. Instead, space vehicle designers rely on Monte Carlo flight simulations with detailed dispersions of predicted nominal flight behavior to determine how robust their design is to errors and uncertainties in the flight conditions their vehicle may encounter. These Monte Carlo analyses entail thousands of trajectory simulations to demonstrate that the vehicle can meet design requirements at a specified level of reliability. From an aerodynamics and aerothermodynamics perspective, these trajectory simulations are fueled by an extensive aerodynamic database that covers the complete range of expected flight conditions, vehicle configurations, and flight attitudes expected in a given mission. Today, these databases amount to a table of engineering parameters that can be quickly interrogated by the trajectory simulator. The aerodynamic and aerothermodynamic databases are assembled via a series of ground tests, empirical and analytical analysis, physics-based computational analysis, applicable past flight performance data, and in some cases, engineering judgment. These databases generally take years to assemble for a new space vehicle system and in the case of SLS/Orion, over a decade of test and analysis have been expended to develop the extensive databases required to cover the myriad of configurations and potential flight conditions required for the system. Recently, it has been proposed that Computational Fluid Dynamic (CFD) and computing capability may be reaching a point where it is foreseeable that CFD could be integrated directly into the production trajectory simulation tools used to design NASA’s space vehicles. To demonstrate this, NASA has embarked on two demonstrations of this type of capability, one where six degree of freedom flight trajectory simulation equations are embedded in an existing CFD solver and another where a production CFD solver is loosely coupled with a production trajectory simulation tool. These efforts represent an initial demonstration of a future approach to flight trajectory simulation, but they are a far cry from the capability required to perform a full-up CFD-in-the-loop Monte Carlo trajectory simulation. Therefore, this represents a viable grand challenge for computational methods addressing space vehicle design and development. The final paper/presentation will discuss the many hurdles, beyond simply raw computational power, to realizing this grand challenge and how they map directly to the CFD Vision 2030 ojectives. Among these are the wide range of flight conditions, including accelerating/decelerating flight, encountered by a space vehicle during launch and/or entry. The vehicle can also encounter numerous configuration changes, some of which can be quite drastic, during the course of its flight, so robust, automated geometry modeling, grid generation, and adaptation will play a huge role in reaching this goal. Multiply this by 1000’s of trajectory simulations occurring simultaneously in a given Monte Carlo analysis, and the problem readily scales to absorb virtually any size of supercomputer envisioned today. The concept of CFD-in-the-loop Monte Carlo trajectory simulation poses a formidable challenge for emerging and future computing systems, and it has the potential to shave years off the development cycle for aerodynamic and aerothermodynamic performance predictions as compared to today’s space vehicle design approach.

CFD 2030↗

Error Localization Examples: Looking for a Needle in a Hay-stack

Finite element models (FEM) are routinely developed and used during fabrication of high dollar-value hardware. NASA as part of the pre-flight certification of launch vehicles routinely conducts vibration and static tests to calibrate models used for flight-risk assessments. As part of the calibration process, certain areas in the model are modified, using engineering judgment and sensitivity analysis, to match the test results. Unfortunately, tools to identify problem areas in the FEM using test data directly are scarce. Over the years, Error Localization Algorithms (ELA) have been proposed with very limited success. Recently, the Analytical Dynamics Model Improvement (ADMI) algorithm, which computes closed-form mass and stiffness corrections to match the test data exactly, have been shown to be effective for error localization. The paper will present several FEM example problems where ELA is used with simulated test data to determine FEM problem areas. For each example, the correct answer is shown along with ELA results. It is shown that the ELA process is able to identify general problem areas in the FEM, which are consistent with known model perturbations. However, in most cases the ELA identified area of improvement is larger than the true answer. Nonetheless, with proper optimization tools, calibration results using the ELA identified areas provide excellent results.

error localization↗

Independent Analyses of Galveston QSF18 Social Survey

A set of independent analyses was performed of the findings of NASA’s QSF18 data collection exercise in Galveston, TX. These analyses included development of regression-based and other dosage-response relationships between the prevalence of annoyance with low-amplitude sonic booms and Perceived Level measures of single event and cumulative exposure. They also included detailed analyses of the effects of panelist attrition; of participation reminder messages sent to panelists; the ability to determine panelist locations at the time of exposure; and the effects of rattle and vibration on annoyance judgments, among other topics. The report summarizes the implications of its findings for the design of studies of community response to carpet booms created during future deployments of NASA’s X-59 aircraft, and recommends several design measures to improve the efficiency of data collection.

sonic boom↗

Error Localization Examples: Looking for a Needle in a Haystack

Finite element models (FEM) are routinely developed and used during fabrication of high dollar-value hardware. NASA, as part of the pre-flight certification of launch vehicles, routinely conducts vibration and static tests to calibrate models used for flight-risk assessments. During model calibration, certain areas of the model are modified, using engineering judgment and sensitivity analysis, to match the test results. Unfortunately, tools to identify problem areas in the FEM using test data directly are scarce and infrequently applied. Over the years, error localization algorithms have been proposed with very limited success. Recently, the Analytical Dynamics Model Improvement (ADMI) algorithm, which computes closed-form mass and stiffness corrections to match the test data exactly, have been shown to be an effective Error Localization Algorithm (ELA). The paper discusses three examples where ELA is used with simulated test data to locate problem areas. To gain confidence in the approach, the exact answer is shown along with ELA results. Results show that ELA is able to identify general problem areas consistent with known problem areas. In all examples, the ELA identified area is larger than the exact problem area. Nonetheless, with proper optimization tools, calibration results using the ELA identified areas provide excellent results.

model calibration↗

Measurement Uncertainty Analysis of 6x9 Icing Research Tunnel (IRT)

This paper presents the results of the measurement uncertainty analysis that was performed on the aero-thermal characteristics of the 6- by 9-Foot Icing Research Tunnel (IRT) at the NASA Glenn Research Center. The engineering judgments and statistical methods used to determine the elemental uncertainties are described. Instrumentation uncertainty was quanti ed using MANTUS (Measurement Analysis Tool for Uncertainty in Systems) and instrument speci cation sheets. The Monte Carlo method was used to propagate systematic components of uncertainty in order to quantify the uncertainty of the Variables of Interest (VOI). A detailed description of the Monte Carlo method and the MANTUS tool can be found in the Uncertainty Analysis of the NASA Glenn 8x6 Supersonic Wind Tunnel report [1]. Detailed uncertainty results for test section airspeed and temperature as well as other variables of interest are described within this document.

6x9 Icing Research Tunnel↗

Uncertainty Analysis of the CE-12 Free-Jet Probe Calibration Facility

This paper presents methods and results of a detailed measurement uncertainty analysis thf at was performed for the Free Jet Calibration Facility (CE-12) located at the NASA Glenn Research Center. Results for systematic uncertainty estimates in a number of fluid properties of the free jet flow are presented. Systematic uncertainty captures inaccuracies due to measurement process, calibration, installation effects or other similar sources which may introduce bias. MANTUS (Measurement Analysis Tool for Uncertainty in Systems) was used to quantify instrumentation uncertainty and engineering judgment was used to quantify other systematic uncertainty sources. The Monte Carlo method was used to propagate systematic uncertainties to determine the uncertainties of various calculated variables of interest.

CE-12↗

The Death of Airmanship: The Urgent Need to Understand Pilot Skills and Knowledge

Aviation awards a special name—airmanship—for the quality of being highly competent in foundational piloting skills, which seem to comprise primarily judgment, decision making, stick-and-rudder skills, and a bit of intuition. The term, which has a mystical quality, has historically resisted analysis; airmanship is acquired solely through experience. The graying of the Boomers and the extreme turbulence of the last few years in commercial aviation have led to a significant loss of those pilots who started out in simpler, round-dial airplanes and made a tortured transition to glass. Those pilots were comfortable disengaging the autopilot at any time, and more importantly, they continued to stay mentally engaged with flight and systems management even as automation continued to encroach on traditional pilot roles. As an industry, we need to prepare for the loss of these pilots by understanding the elements of airmanship and finding a way to replace the competency. The goal is to eliminate “airmanship” by understanding it...by demystifying it. Human factors/cognitive engineering offers tools and methods to develop a system interface that supports skilled performance from the human/technology team. In this presentation, I will talk about my efforts to understand the elements of skilled performance so that they can be trained, or supported by the interface in a seamless manner Specific topics will include the limits of SOP, monitoring for flight path management, alerting non-normals, and autoflight/mode confusion.

pilot skills↗

Methods for Developing Successful Systems Engineers

Systems Engineering (SE) is a complex and challenging field that incorporates the knowledge of systems engineering processes, the ability to synthesize a wide-range of engineering disciplines, and the ability to lead a team of people to successfully accomplish the goals of a project. It requires hard technical skills and soft-skill leadership savvy. As a result, three main development needs are identified: 1) Knowledge of SE processes, the benefits of these processes to a project and their tailored application 2) Knowledge of a wide-range of engineering disciplines, how they interrelate in a system, and the development of sound technical judgement 3) Team leadership to direct and motivate a team of subsystem and discipline experts This paper describes the establishment of a comprehensive training and development program for Systems Engineers at NASA Ames Research Center that addresses in part each of these three areas from the perspective of the implementing manager. A variety of methods have been utilized including the establishment of a SE Community of Practice, a unique and innovative web tool, on-line videos, classroom training in NASA’s 17 Common Technical Processes, guidance on the tailored application of these processes, monthly technical talks, mentoring in both technical judgment and team leadership, and NASA’s Leadership Development Programs. While much of professional SE development must come through project experience, the approaches listed above can accelerate development. The diversity of skills required of Systems Engineering demands a multi-faceted approach to successfully train and develop this critical skill.

development↗

Methods for Developing Successful Systems Engineers

Systems Engineering (SE) is a complex and challenging field that incorporates the knowledge of systems engineering processes, the ability to synthesize a wide-range of engineering disciplines, and the ability to lead a team of people to successfully accomplish the goals of a project. It requires hard technical skills and soft-skill leadership savvy. As a result, three main development needs are identified: 1. Knowledge of SE processes, the benefits of these processes to a project and their tailored application 2. Knowledge of a wide-range of engineering disciplines, how they interrelate in a system, and the development of sound technical judgement 3. Team leadership to direct and motivate a team of subsystem and discipline experts This paper describes the establishment of a comprehensive training and development program for Systems Engineers at NASA Ames Research Center that addresses in part each of these three areas from the perspective of the implementing manager. A variety of methods have been utilized including the establishment of a SE Community of Practice, a unique and innovative web tool, on-line videos, classroom training in NASA’s 17 Common Technical Processes, guidance on the tailored application of these processes, monthly technical talks, mentoring in both technical judgment and team leadership, and NASA’s Leadership Development Programs. While much of professional SE development must come through project experience, the approaches listed above can accelerate development. The diversity of skills required of Systems Engineering demands a multi-faceted approach to successfully train and develop this critical skill.

development↗

EMU Helmet Free Water Transport Assessment for the HAB in Support of Eva 80

After water was reported in the EMU helmet during ISS US EVA-80, mitigation strategies were created to attempt to arrest the motion of any droplets that enter the helmet for future Extravehicular Activities (EVAs). This included adding absorbent materials into the interior of the helmet. To assess the effectiveness of this strategy, a computational fluid dynamics (CFD) model of a human mannikin head in the EMU helmet was used to track water droplets and quantify how much water is likely to be caught by the absorbent material. A combination of engineering judgment, tests, and CFD results were used to develop the expected path of droplets in the helmet, to account for the simplifications necessary in modeling two-phase flow.

Abigail Rose Baukus↗

Low-cost Quantification of Fluid Flow Parameter Sensitivity using Reduced-order Modeling

Uncertainty quantification of computational fluid dynamics (CFD) simulations is a complicated procedure which still relies in many cases on engineering judgment and factors of safety. This is in part because the computational cost of measuring the simulation's sensitivity to all meaningful parameters (e.g., body surface roughness) and hyperparameters (e.g., subiteration convergence criterion) is intractable for even a single simulation. Reduced-order modeling dramatically lowers this computational cost of simulating fluid flows, but usually only where similar data is already available. In this work, fluid reduced-order models are utilized to quantify a flow's sensitivity to certain physical parameters for the purposes of improved uncertainty quantification. Characteristic observability and sensitivity are both explored. The resulting sensitivity quantifications enable more informed CFD frameworks and more rigorous uncertainty bounds on the resulting data.

uncertainty quantification↗

Low-cost Quantification of Fluid Flow Parameter Sensitivity using Reduced-order Modeling

Uncertainty quantification of computational fluid dynamics (CFD) simulations is a complicated procedure which still relies in many cases on engineering judgment and factors of safety. This is in part because the computational cost of measuring the simulation's sensitivity to all meaningful parameters (e.g., body surface roughness) and hyperparameters (e.g., subiteration convergence criterion) is intractable for even a single simulation. Reduced-order modeling dramatically lowers this computational cost of simulating fluid flows, but usually only where similar data is already available. In this work, fluid reduced-order models are utilized to quantify a flow's sensitivity to certain physical parameters for the purposes of improved uncertainty quantification. Characteristic observability and sensitivity are both explored. The resulting sensitivity quantifications enable more informed CFD frameworks and more rigorous uncertainty bounds on the resulting data.

uncertainty quantification↗

A Summary of the Development and Validation of the Scale for Habitat Usability (SHU)

Usability is an important concept to consider when designing space habitats/vehicles. In addition to objective outcomes (success rate, net habitable volume etc.), collecting users’ subjective judgments via comments and questionnaires can provide valuable data for evaluating conceptual designs, identifying potential layout issues, improving concept of operations, substantiating design changes, or selecting between competing mockups. Historically at NASA, there has been no “gold standard” questionnaire for capturing users’ subjective viewpoint regarding habitat design. To address this gap a Human Research Program (HRP) study was conducted to create a new measurement tool: the Scale for Habitat Usability (SHU).

Usability↗

Uncertainty Analysis of the NASA Glenn 8- by 6-Foot Supersonic Wind Tunnel 2019 Characterization Test 14-Foot, 5.8 Percent Test Section Porosity

This paper presents methods and results of a measurement uncertainty analysis that was performed for the 8- by 6-foot Supersonic Wind Tunnel located at the NASA Glenn Research Center. The uncertainty analysis is based on data collected during a characterization test following major structural modifications to the facility and upgrades to the facility’s data and control systems. The statistical methods and engineering judgments used to estimate elemental uncertainties are described in this report. The Monte Carlo method of propagating uncertainty was selected to determine the uncertainty of calculated variables of interest. A description of the Monte Carlo method as applied for this analysis is provided. The primary variable of interest (VOI) for this facility is free stream Mach number. In addition to determining the uncertainty in Mach number, the uncertainty in free stream values of static pressure, total pressure, dynamic pressure, total temperature, static temperature, Reynolds number, and air speed were also calculated. Uncertainty results are presented as random (unpredictable variation in repeated measurements), systematic (potential offset between observed and true value), and total (random and systematic combined) uncertainty for Mach number. Systematic uncertainty results are presented for the other VOIs. Individual uncertainty sources are presented both dimensionally and as percent contributions to uncertainty in all VOIs, to aid in the identification of primary uncertainty sources.

Uncertainty Analysis↗

EMU Helmet Free Water Transport Assessment for the HAB in Support of Eva 80

After water was reported in the EMU helmet during ISS US EVA-80, mitigation strategies were created to attempt to arrest the motion of any droplets that enter the helmet for future Extravehicular Activities (EVAs). This included adding absorbent materials into the interior of the helmet. To assess the effectiveness of this strategy, a computational fluid dynamics (CFD) model of a human mannikin head in the EMU helmet was used to track water droplets and quantify how much water is likely to be caught by the absorbent material. A combination of engineering judgment, tests, and CFD results were used to develop the expected path of droplets in the helmet, to account for the simplifications necessary in modeling two-phase flow.

Abigail Baukus↗