Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Judgment”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 451 records · Page 25

Reliability Quantification of Advanced Stirling Convertor (ASC) Components

The Advanced Stirling Convertor, is intended to provide power for an unmanned planetary spacecraft and has an operational life requirement of 17 years. Over this 17 year mission, the ASC must provide power with desired performance and efficiency and require no corrective maintenance. Reliability demonstration testing for the ASC was found to be very limited due to schedule and resource constraints. Reliability demonstration must involve the application of analysis, system and component level testing, and simulation models, taken collectively. Therefore, computer simulation with limited test data verification is a viable approach to assess the reliability of ASC components. This approach is based on physics-of-failure mechanisms and involves the relationship among the design variables based on physics, mechanics, material behavior models, interaction of different components and their respective disciplines such as structures, materials, fluid, thermal, mechanical, electrical, etc. In addition, these models are based on the available test data, which can be updated, and analysis refined as more data and information becomes available. The failure mechanisms and causes of failure are included in the analysis, especially in light of the new information, in order to develop guidelines to improve design reliability and better operating controls to reduce the probability of failure. Quantified reliability assessment based on fundamental physical behavior of components and their relationship with other components has demonstrated itself to be a superior technique to conventional reliability approaches based on utilizing failure rates derived from similar equipment or simply expert judgment.

Shah, Ashwin R.↗

Habitat Utilization Assessment - Building in Behaviors

Habitability, and the associated architectural and design attributes of an environment, is a powerful performance shaping factor. By identifying how inhabitants use an area, we can draw conclusions about what design or architectural attributes cause what behaviors and systematically design in desired human performance. We are analyzing how a crew uses a long duration habitat and work environment during a four-day underwater mission and identifying certain architectural and design attributes that are related to, and potential enablers of, certain crew behaviors. By identifying how inhabitants use the habitat, we can draw conclusions about what habitability attributes cause what behaviors and systematically design in desired human performance (applicable to NASA's Bioastronautics Human Behavior and Performance Critical Path Roadmap question 6.12). This assessment replicates a methodology reported in a chapter titled "Sociokinetic Analysis as a Tool for Optimization of Environmental Design" by C. Adams.' That study collected video imagery of certain areas of a closed habitat during a 91 day test and from that data calculated time spent in different volumes during the mission, and characterized the behaviors occurring in certain habitat volumes thus concluding various rules for design of such habitats. This study assesses the utilization of the Aquarius Habitat, an underwater station, which will support six Aquanauts for a fourteen-day mission during which the crew will perform specific scientific and engineering studies. Video is recorded for long uninterrupted periods of time during the mission and from that data the time spent in each area is calculated. In addition, qualitative and descriptive analysis of the types of behaviors in each area is performed with the purpose of identifying any behaviors that are not typical of a certain area. If a participant uses an area in a way different from expected, a subsequent analysis of the features of that area may result in conclusions of performance shaping factors. With the addition of this study, we can make comparisons between the two different habitats and begin drawing correlation judgments about design features and behavior. Ideally, this methodology should be repeated in additional Aquarius missions and other analog environments because the real information will come from comparisons between habitats.

Whitmore, Mihriban↗

De-Trending Techniques: Methods for Cleaning Questionable Shock Data

Not all zero shifted acceleration data can De-trended using this technique. DC shifts, improper AC coupling, Circuit noise/EMI/EMR, Equivalent RC circuit gain response/Circuit saturation(Slew Rate Limited), fixture grounding and wiring losses can all contribute to bad shock data being recorded. Some data that is zero-shifted or exhibit large instantaneous velocity shifts is inherently bad and a retest is warranted. Clean Acceleration-Time history data can be bad upon examining the Velocity & Displacement profiles. Laser Vibrometers provide a high level of accuracy for pyrotechnic shock testing. Engineering judgment and experience will determine the validity of Shock data.

Grillo, Vincent J.↗

Collaborative Supervised Learning for Sensor Networks

Collaboration methods for distributed machine-learning algorithms involve the specification of communication protocols for the learners, which can query other learners and/or broadcast their findings preemptively. Each learner incorporates information from its neighbors into its own training set, and they are thereby able to bootstrap each other to higher performance. Each learner resides at a different node in the sensor network and makes observations (collects data) independently of the other learners. After being seeded with an initial labeled training set, each learner proceeds to learn in an iterative fashion. New data is collected and classified. The learner can then either broadcast its most confident classifications for use by other learners, or can query neighbors for their classifications of its least confident items. As such, collaborative learning combines elements of both passive (broadcast) and active (query) learning. It also uses ideas from ensemble learning to combine the multiple responses to a given query into a single useful label. This approach has been evaluated against current non-collaborative alternatives, including training a single classifier and deploying it at all nodes with no further learning possible, and permitting learners to learn from their own most confident judgments, absent interaction with their neighbors. On several data sets, it has been consistently found that active collaboration is the best strategy for a distributed learner network. The main advantages include the ability for learning to take place autonomously by collaboration rather than by requiring intervention from an oracle (usually human), and also the ability to learn in a distributed environment, permitting decisions to be made in situ and to yield faster response time.

Wagstaff, Kiri L.↗

Spacecraft Water Exposure Guidelines for Selected Contaminants

To protect space crews from contaminants in potable and hygiene water. the National Aeronautics and Space Administration (NASA) requested that the National Research Council (NRC) provide guidance on how to develop water exposure guidelines and subsequently review NASA's development of exposure guidelines for specific chemicals. The exposure guidelines are to be similar to those established by the NRC for airborne contaminants (NRC 1992; 1994; 1996a,b; 2000a). The NRC was asked to consider only chemical contaminants, and not microbial agents. The NRC convened the Subcommittee on Spacecraft Water Exposure Guidelines to address this task, and the subcommittee's first report, Methods for Developing Spacecraft Water Exposure Guidelines, was published in 2000 (NRC 2000b). A summary of that report is provided. Spacecraft water exposure guidelines (SWEGs) are to he established for exposures of l, 10, 100, and 1,000 days (d). The 1-d SWEG is the concentration of a substance in water that is judged acceptable for the performance of specific tasks during rare emergency conditions lasting for periods up to 24 hours (h). The 1-d SWEG is intended to prevent irreversible harm and degradation in crew performance. Temporary discomfort is permissible as long as there is no effect on judgment, performance, or ability to respond to an emergency. Longer-term SWEGs are intended to prevent adverse health effects (either immediate or delayed) and degradation in crew performance that could result from continuous exposure in closed spacecraft for as long as 1,000 d. In contrast with the 1-d SWEG, longer-term SWEGs are intended to provide guidance for exposure under the expected normal operating conditions in spacecraft.

Source record↗

Selected Lessons Learned in Space Shuttle Orbiter Propulsion and Power Subsystems

Over its 30 years of space flight history, plus the nearly 10 years of design, development test and evaluation, the Space Shuttle Orbiter is full of lessons learned in all of its numerous and complex subsystems. In the current paper, only selected lessons learned in the areas of the Orbiter propulsion and power subsystems will be described. The particular Orbiter subsystems include: Auxiliary Power Unit (APU), Hydraulics and Water Spray Boiler (WSB), Mechanical Flight Controls, Main Propulsion System (MPS), Fuel Cells and Power Reactant and Storage Devices (PRSD), Orbital Maneuvering System (OMS), Reaction Control System (RCS), Electrical Power Distribution (EPDC), electrical wiring and pyrotechnics. Given the complexity and extensive history of each of these subsystems, and the limited scope of this paper, it is impossible to include most of the lessons learned; instead the attempt will be to present a selected few or key lessons, in the judgment of the authors. Each subsystem is presented separate, beginning with an overview of the hardware and their function, a short description of a few historical problems and their lessons, followed by a more comprehensive table listing of the major subsystem problems and lessons. These tables serve as a quick reference for lessons learned in each subsystem. In addition, this paper will establish common lessons across subsystems as well as concentrate on those lessons which are deemed to have the highest applicability to future space flight programs.

Hernandez, Francisco J.↗

Towards Measurement of Confidence in Safety Cases

Arguments in safety cases are predominantly qualitative. This is partly attributed to the lack of sufficient design and operational data necessary to measure the achievement of high-dependability targets, particularly for safety-critical functions implemented in software. The subjective nature of many forms of evidence, such as expert judgment and process maturity, also contributes to the overwhelming dependence on qualitative arguments. However, where data for quantitative measurements is systematically collected, quantitative arguments provide far more benefits over qualitative arguments, in assessing confidence in the safety case. In this paper, we propose a basis for developing and evaluating integrated qualitative and quantitative safety arguments based on the Goal Structuring Notation (GSN) and Bayesian Networks (BN). The approach we propose identifies structures within GSN-based arguments where uncertainties can be quantified. BN are then used to provide a means to reason about confidence in a probabilistic way. We illustrate our approach using a fragment of a safety case for an unmanned aerial system and conclude with some preliminary observations

Denney, Ewen↗

Determining the Optimal Number of Clusters with the Clustergram

Cluster analysis aids research in many different fields, from business to biology to aerospace. It consists of using statistical techniques to group objects in large sets of data into meaningful classes. However, this process of ordering data points presents much uncertainty because it involves several steps, many of which are subject to researcher judgment as well as inconsistencies depending on the specific data type and research goals. These steps include the method used to cluster the data, the variables on which the cluster analysis will be operating, the number of resulting clusters, and parts of the interpretation process. In most cases, the number of clusters must be guessed or estimated before employing the clustering method. Many remedies have been proposed, but none is unassailable and certainly not for all data types. Thus, the aim of current research for better techniques of determining the number of clusters is generally confined to demonstrating that the new technique excels other methods in performance for several disparate data types. Our research makes use of a new cluster-number-determination technique based on the clustergram: a graph that shows how the number of objects in the cluster and the cluster mean (the ordinate) change with the number of clusters (the abscissa). We use the features of the clustergram to make the best determination of the cluster-number.

Fluegemann, Joseph K.↗

Advancing Aeronautics: A Decision Framework for Selecting Research Agendas

Publicly funded research has long played a role in the development of aeronautics, ranging from foundational research on airfoils to development of the air-traffic control system. Yet more than a century after the research and development of successful controlled, sustained, heavier-than-air flight vehicles, there are questions over the future of aeronautics research. The field of aeronautics is relatively mature, technological developments within it have become more evolutionary, and funding decisions are sometimes motivated by the continued pursuit of these evolutionary research tracks rather than by larger factors. These developments raise questions over whether public funding of aeronautics research continues to be appropriate or necessary and at what levels. Tightened federal budgets and increasing calls to address other public demands make these questions sharper still. To help it address the questions of appropriate directions for publicly funded aeronautics research, the National Aeronautics and Space Administration's (NASA's) Aeronautics Research Mission Directorate (ARMD) asked the RAND Corporation to assess the elements required to develop a strategic view of aeronautics research opportunities; identify candidate aeronautic grand challenges, paradigms, and concepts; outline a framework for evaluating them; and exercise the framework as an example of how to use it. Accordingly, this research seeks to address these questions: What aeronautics research should be supported by the U.S. government? What compelling and desirable benefits drive government-supported research? How should the government--especially NASA--make decisions about which research to support? Advancing aeronautics involves broad policy and decisionmaking challenges. Decisions involve tradeoffs among competing perspectives, uncertainties, and informed judgment.

AERONAUTICS↗

Aeromedical Disposition and Waiver Consideration for ISS Crewmembers

Aeromedical certification of astronauts and cosmonauts traveling to the International Space Station is a multi?-tiered process that involv es standards agreed to by the partner agencies, and participation by the individual agency aeromedical boards and a multilateral space medi cine board. Medical standards are updated continually by a multilater al working group. The boards operate by consensus and strive to achie ve effective decision making through experience, medical judgment, medical evidence and risk modeling. The aim of the certification process is to minimize the risk to the ISS program of loss of mission object ives due to human health issues.

Taddeo, Terrance↗

Mars Science Laboratory Rover Integrated Pump Assembly Bellows Jamming Failure

The Mars Science Laboratory rover and spacecraft utilize two mechanically pumped fluid loops for heat transfer to and from the internal electronics assemblies and the Radioisotope Thermo-Electric Generator (RTG). The heat transfer fluid is Freon R-11 (CFC-11) which has a large coefficient of thermal expansion. The Freon within the heat transfer system must have a volume for safe expansion of the fluid as the system temperature rises. The device used for this function is a gas-over-liquid accumulator. The accumulator uses a metal bellows to separate the fluid and gas sections. During expansion and contraction of the fluid in the system, the bellows extends and retracts to provide the needed volume change. During final testing of a spare unit, the bellows would not extend the full distance required to provide the needed expansion volume. Increasing the fluid pressure did not loosen the jammed bellows either. No amount of stroking the bellows back and forth would get it to pass the jamming point. This type of failure, if it occurred during flight, would result in significant overpressure of the heat transfer system leading to a burst failure at some point in the system piping. A loss of the Freon fluid would soon result in a loss of the mission. The determination of the source of the jamming of the bellows was quite elusive, leading to an extensive series of tests and analyses. The testing and analyses did indicate the root cause of the failure, qualitatively. The results did not provide a set of dimensional limits for the existing hardware design that would guarantee proper operation of the accumulator. In the end, a new design was developed that relied on good engineering judgment combined with the test results to select a reliable enough solution that still met other physical constraints of the hardware, the schedule, and the rover system.

bellows↗

Application of Statistically Derived CPAS Parachute Parameters

The Capsule Parachute Assembly System (CPAS) Analysis Team is responsible for determining parachute inflation parameters and dispersions that are ultimately used in verifying system requirements. A model memo is internally released semi-annually documenting parachute inflation and other key parameters reconstructed from flight test data. Dispersion probability distributions published in previous versions of the model memo were uniform because insufficient data were available for determination of statistical based distributions. Uniform distributions do not accurately represent the expected distributions since extreme parameter values are just as likely to occur as the nominal value. CPAS has taken incremental steps to move away from uniform distributions. Model Memo version 9 (MMv9) made the first use of non-uniform dispersions, but only for the reefing cutter timing, for which a large number of sample was available. In order to maximize the utility of the available flight test data, clusters of parachutes were reconstructed individually starting with Model Memo version 10. This allowed for statistical assessment for steady-state drag area (CDS) and parachute inflation parameters such as the canopy fill distance (n), profile shape exponent (expopen), over-inflation factor (C(sub k)), and ramp-down time (t(sub k)) distributions. Built-in MATLAB distributions were applied to the histograms, and parameters such as scale (sigma) and location (mu) were output. Engineering judgment was used to determine the "best fit" distribution based on the test data. Results include normal, log normal, and uniform (where available data remains insufficient) fits of nominal and failure (loss of parachute and skipped stage) cases for all CPAS parachutes. This paper discusses the uniform methodology that was previously used, the process and result of the statistical assessment, how the dispersions were incorporated into Monte Carlo analyses, and the application of the distributions in trajectory benchmark testing assessments with parachute inflation parameters, drag area, and reefing cutter timing used by CPAS.

Romero, Leah M.↗

A Step-Wise Approach to Elicit Triangular Distributions

Adapt/combine known methods to demonstrate an expert judgment elicitation process that: 1.Models expert's inputs as a triangular distribution, 2.Incorporates techniques to account for expert bias and 3.Is structured in a way to help justify expert's inputs. This paper will show one way of "extracting" expert opinion for estimating purposes. Nevertheless, as with most subjective methods, there are many ways to do this.

Greenberg, Marc W.↗

Work Practice Simulation of Complex Human-Automation Systems in Safety Critical Situations: The Brahms Generalized berlingen Model

The transition from the current air traffic system to the next generation air traffic system will require the introduction of new automated systems, including transferring some functions from air traffic controllers to on­-board automation. This report describes a new design verification and validation (V&V) methodology for assessing aviation safety. The approach involves a detailed computer simulation of work practices that includes people interacting with flight-critical systems. The research is part of an effort to develop new modeling and verification methodologies that can assess the safety of flight-critical systems, system configurations, and operational concepts. The 2002 Ueberlingen mid-air collision was chosen for analysis and modeling because one of the main causes of the accident was one crew's response to a conflict between the instructions of the air traffic controller and the instructions of TCAS, an automated Traffic Alert and Collision Avoidance System on-board warning system. It thus furnishes an example of the problem of authority versus autonomy. It provides a starting point for exploring authority/autonomy conflict in the larger system of organization, tools, and practices in which the participants' moment-by-moment actions take place. We have developed a general air traffic system model (not a specific simulation of Überlingen events), called the Brahms Generalized Ueberlingen Model (Brahms-GUeM). Brahms is a multi-agent simulation system that models people, tools, facilities/vehicles, and geography to simulate the current air transportation system as a collection of distributed, interactive subsystems (e.g., airports, air-traffic control towers and personnel, aircraft, automated flight systems and air-traffic tools, instruments, crew). Brahms-GUeM can be configured in different ways, called scenarios, such that anomalous events that contributed to the Überlingen accident can be modeled as functioning according to requirements or in an anomalous condition, as occurred during the accident. Brahms-GUeM thus implicitly defines a class of scenarios, which include as an instance what occurred at Überlingen. Brahms-GUeM is a modeling framework enabling "what if" analysis of alternative work system configurations and thus facilitating design of alternative operations concepts. It enables subsequent adaption (reusing simulation components) for modeling and simulating NextGen scenarios. This project demonstrates that BRAHMS provides the capacity to model the complexity of air transportation systems, going beyond idealized and simple flights to include for example the interaction of pilots and ATCOs. The research shows clearly that verification and validation must include the entire work system, on the one hand to check that mechanisms exist to handle failures of communication and alerting subsystems and/or failures of people to notice, comprehend, or communicate problematic (unsafe) situations; but also to understand how people must use their own judgment in relating fallible systems like TCAS to other sources of information and thus to evaluate how the unreliability of automation affects system safety. The simulation shows in particular that distributed agents (people and automated systems) acting without knowledge of each others' actions can create a complex, dynamic system whose interactive behavior is unexpected and is changing too quickly to comprehend and control.

complex systems↗

Force Limiting Vibration Tests Evaluated from both Ground Acoustic Tests and FEM Simulations of a Flight Like Vehicle System Assembly

Marshall Space Flight Center has conducted a series of ground acoustic tests with the dual goals of informing analytical judgment, and validating analytical methods when estimating vibroacoustic responses of launch vehicle subsystems. The process of repeatedly correlating finite element-simulated responses with test-measured responses has assisted in the development of best practices for modeling and post-processing. In recent work, force transducers were integrated to measure interface forces at the base of avionics box equipment. Other force data was indirectly measured using strain gauges. The combination of these direct and indirect force measurements has been used to support and illustrate the advantages of implementing the Force Limiting approach for equipment qualification tests. The comparison of force response from integrated system level tests to measurements at the same locations during component level vibration tests provides an excellent illustration. A second comparison of the measured response cases from the system level acoustic tests to finite element simulations has also produced some principles for assessing the suitability of Finite Element Models (FEMs) for making vibroacoustics estimates. The results indicate that when FEM models are employed to guide force limiting choices, they should include sufficient detail to represent the apparent mass of the system in the frequency range of interest.

Smith, Andrew↗

Neither Pollyanna nor Chicken Little: Thoughts on the Ethics of Automation

This paper has raised issues concerning the ethics of automation in aviation systems, and outlined ways of thinking about the issues that may help in ethical decision making. It is very easy to be carried along by technology and the Pollyanna view, but just because we can do something, doesn't mean we should - which is perhaps a little milder than the Chicken Little view. Both views have merits, and we would view ethical decisions as ones that more appropriately balance or reconcile these conflicting viewpoints. We have set out some of the background to the problems of automation in aviation systems, but are aware that there is much more that could be said (considering military UAS, for example). We hope, however, that the brief introduction provides a foundation for the ethical questions that we have set out. The underlying aim in proposing ESCs is to make understanding ethical issues easier so that ethically-informed decisions can be made. Whilst we have not linked the discussion directly back to specific ethical decisions, we believe that making explicit those issues on which such judgments are based is a contribution to ethically informed decision making. We also believe that the four principles set out by the RAEng are reflected in this approach. We acknowledge that what we have set out, especially the ideas of ESC, goes some way beyond current practice and principles and there are significant technical issues to resolve before such an approach could be implemented. It is hoped, however, that the ideas will help improve the production and presentation of safety cases in a range of industries not just aviation - a Pollyanna view, of course!

Holloway, C. Michael↗

New York City Panel on Climate Change 2015 Report: Climate Observations and Projections - Chapter 1

During 2013 and 2014, numerous international (IPCC, 2013) and national (Melillo et al., 2014; Gordon, 2014) reports have concluded that human activities are changing the climate, leading to increased vulnerability and risk. Since the industrial revolution, fossil fuel burning, industrial activity, and land use changes have led to a 40% increase in heat-trapping carbon dioxide (CO2), and an approximately 150% increase in methane (CH4), another powerful greenhouse gas (GHG), has been observed. Global temperatures have increased by close to 1 C since 1880 as the upper oceans have warmed and polar ice has retreated. These and other climate changes are projected to accelerate as greenhouse gas concentrations continue to rise. In the coming decades, climate change is extremely likely to bring warmer temperatures in the New York metropolitan region (see Box. 1.1 and Fig.1.1 for key definitions and terms). Heat waves are very likely to increase; total annual precipitation will likely increase and brief, intense rainstorms are very likely to increase. Because of incomplete knowledge about exactly how much climate change will occur, choosing among policies for reducing future damages requires prudent risk management (Yohe and Leichenko, 2010; Kunreuther et al., 2013). Given differing risk tolerances among stakeholders, a risk management approach allows for a range of possible climate change outcomes to be examined with associated uncertainties surrounding their likelihoods. The New York City Panel on Climate Change 2 (NPCC2) projections can be used to inform planning across multiple governmental scales (e.g., city, county, state) in the New York metropolitan region. Such coordinated efforts can serve as test cases for successful local, state, and federal coordination for integrated climate adaptation initiatives. This chapter describes the global climate system, and presents observed temperature and precipitation trends and projections for the region. Chapter 2 (NPCC, 2015) focuses on sea level rise and possible changes in coastal storms. Chapter 3 and Chapter 4 (NPCC, 2015) describe efforts to better understand the region's vulnerability to coastal flooding during coastal storms. The treatment of likelihood related to the NPCC projections is similar to that developed by the Intergovernmental Panel on Climate Change Fourth and Fifth Assessment Reports (IPCC, 2007; 2013), with six likelihood categories (Box 1.1 and Fig. 1.1). The assignment of climate hazards to these categories is based on observed data, global climate model simulations, published literature, and expert judgment.

climate change↗

A Team Mental Model Perspective of Pre-Quantitative Risk

This study was conducted to better understand how teams conceptualize risk before it can be quantified, and the processes by which a team forms a shared mental model of this pre-quantitative risk. Using an extreme case, this study analyzes seven months of team meeting transcripts, covering the entire lifetime of the team. Through an analysis of team discussions, a rich and varied structural model of risk emerges that goes significantly beyond classical representations of risk as the product of a negative consequence and a probability. In addition to those two fundamental components, the team conceptualization includes the ability to influence outcomes and probabilities, networks of goals, interaction effects, and qualitative judgments about the acceptability of risk, all affected by associated uncertainties. In moving from individual to team mental models, team members employ a number of strategies to gain group recognition of risks and to resolve or accept differences.

Cooper, Lynne P.↗