Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Process based assessment”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10

A Briefing on Metrics and Risks for Autonomous Decision-Making in Aerospace Applications

Significant technology advances will enable future aerospace systems to safely and reliably make decisions autonomously, or without human interaction. The decision-making may result in actions that enable an aircraft or spacecraft in an off-nominal state or with slightly degraded components to achieve mission performance and safety goals while reducing or avoiding damage to the aircraft or spacecraft. Some key technology enablers for autonomous decision-making include: a continuous state awareness through the maturation of the prognostics health management field, novel sensor development, and the considerable gains made in computation power and data processing bandwidth versus system size. Sophisticated algorithms and physics based models coupled with these technological advances allow reliable assessment of a system, subsystem, or components. Decisions that balance mission objectives and constraints with remaining useful life predictions can be made autonomously to maintain safety requirements, optimal performance, and ensure mission objectives. This autonomous approach to decision-making will come with new risks and benefits, some of which will be examined in this paper. To start, an account of previous work to categorize or quantify autonomy in aerospace systems will be presented. In addition, a survey of perceived risks in autonomous decision-making in the context of piloted aircraft and remotely piloted or completely autonomous unmanned autonomous systems (UAS) will be presented based on interviews that were conducted with individuals from industry, academia, and government.

Frost, Susan↗

Distributed Schemes for Integrated Arrival Departure Surface (IADS) Scheduling

The objective of the NRA is to investigate and develop integrated scheduling solutions for arrival, departure and surface operations. The option year briefing summarizes simulation-based analyses of the departure metering process to investigate strategic queue management strategies and their robustness to uncertainty, assess the impact of delaying departures at their gates on blocking the arrivals destined for the same gates, and evaluate the effects and benefits of relaxing current-day MIT constraints when ATD-2 is in operation.

ATD-2↗

Nasa Conjunction Assessment Risk Analysis Updated Requirements Architecture

The NASA Conjunction Assessment Risk Analysis (CARA) program has been performing routine on-orbit satellite conjunction risk analysis for unmanned NASA spacecraft since 2005, and has developed a robust operations procedure and set of recommended best practices for operational conjunction assessment. However, a number of recent developments in Space Situational Awareness and commercial space operations conduct, such as the immanent deployment of much more sensitive space sensing systems and the launching of much larger satellite constellations, have begun to challenge these standard collision risk parameters and calculations. In response CARA has pursued a multi-year evaluation initiative to re-examine risk assessment algorithms and techniques, to develop needed improvements, and to assemble analysis-based operational requirements. This paper gives an overview of the principal parts of the Conjunction Assessment (CA) risk assessment process used at CARA, outlines the technical challenges that each part presents, surveys the possible solutions, and then indicates which particular solution is being recommended for NASA.

Newman, Lauri K.↗

NASA Conjunction Assessment Risk Analysis (CARA) Updated Requirements Architecture

The NASA Conjunction Assessment Risk Analysis (CARA) program has been performing routine on-orbit satellite conjunction risk analysis for unmanned NASA spacecraft since 2005, and has developed a robust operations procedure and set of recommended best practices for operational conjunction assessment. However, a number of recent developments in Space Situational Awareness and commercial space operations conduct, such as the immanent deployment of much more sensitive space sensing systems and the launching of much larger satellite constellations, have begun to challenge these standard collision risk parameters and calculations. In response CARA has pursued a multi-year evaluation initiative to re-examine risk assessment algorithms and techniques, to develop needed improvements, and to assemble analysis-based operational requirements. This paper gives an overview of the principal parts of the Conjunction Assessment (CA) risk assessment process used at CARA, outlines the technical challenges that each part presents, surveys the possible solutions, and then indicates which particular solution is being recommended for NASA.

Newman, L. K.↗

Automated Metadata Scoring Approaches for Earth Observation Data

The Common Metadata Repository (CMR) contains metadata records describing NASA’s Earth observation data products which are archived across 12 data centers also known as Distributed Active Archive Centers (DAACs). To ensure that NASA’s data is discoverable, accessible, and usable, the Analysis and Review of CMR (ARC) Team, located at Marshall Space Flight Center, assesses the quality of these metadata records. The ARC team currently uses a combination of automated and manual methods to check metadata records for quality dimensions such as completeness, correctness, and consistency. In addition to these quality assessments, the team is currently exploring various metadata scoring methods in order to provide normalized results across the twelve DAACs. This method is conducted by using automated methods to assess metadata fields and then provide a numeric score, or grade, based on the analysis. To implement this process, two different approaches have been theorized and are currently being explored by the ARC team. This presentation will describe ARC's two proposed methodologies in more detail, and the pros and cons to using these metadata scoring methods.

Jenny Wood↗

Measurement System Analysis of a Novel Phase-Based Ultrasonic NDE Technique for Bond Strength Measurement

Fiber reinforced polymer parts have shown tremendous benefits in aerospace structural applications, but their qualification and certification for use in safety critical areas are currently hindered by the lack of a capable non-destructive evaluation (NDE) method or technique for the inspection of these adhesively bonded parts. Conventional NDE methods and techniques typically detect gross bond defects in a qualitative (Pass/Fail) manner. These techniques struggle to detect weak or kissing bonds. Also, there are no widely adopted NDE methods or techniques for measuring interfacial bond strength or detecting kissing bonds. Bond strength is currently ensured by process control and semi-destructive testing. Results from recent research from other authors, including but not limited to mechanical testing, have shown an excellent correlation between interfacial stiffness of an adhesively bonded joint and the adhesive bond strength of that joint. In this paper, a measurement system analysis (MSA) of a novel phase-based ultrasonic NDE Technique, developed at NASA Langley Research Center, is presented for bond strength measurement to assess at an increased level the measurement process and identify components of variation in that measurement process.

Ultrasound↗

Reliability growth modeling analysis of the space shuttle main engines based upon the Weibull process

The Weibull process, identified as the inhomogeneous Poisson process with the Weibull intensity function, is used to model the reliability growth assessment of the space shuttle main engine test and flight failure data. Additional tables of percentage-point probabilities for several different values of the confidence coefficient have been generated for setting (1-alpha)100-percent two sided confidence interval estimates on the mean time between failures. The tabled data pertain to two cases: (1) time-terminated testing, and (2) failure-terminated testing. The critical values of the three test statistics, namely Cramer-von Mises, Kolmogorov-Smirnov, and chi-square, were calculated and tabled for use in the goodness of fit tests for the engine reliability data. Numerical results are presented for five different groupings of the engine data that reflect the actual response to the failures.

Wheeler, J. T.↗

Research Needs for Developing Qualification Standards for Flight Simulation Training Devices with Head Mounted Displays

This presentation discusses research needs to support evidence-based qualification standards for Flight Simulation Training Devices (FSTDs) with head mounted displays (HMDs). Currently, the FAA and EASA have no qualification standards specifically for FSTDs using HMDs and extended reality (XR) visuals, and existing qualification standards may not be sufficient. Special Conditions can be prescribed for the evaluation and qualification of individual devices, but these Special Conditions need to be assessed and adjusted on a case-by-case basis resulting in an elaborate process. Furthermore, test tolerances used in Special Conditions are often based on conventional visual systems and may not be adequate. This presentation first identifies gaps in the current knowledge of using HMDs in pilot training, and, more specifically, using HMDs in the training of manual aircraft control with motion cues. Next, research is proposed to help close these gaps, inform the development of qualification criteria and tolerances, and guide efforts to update regulations. The Vertical Motion Simulator (VMS) at NASA Ames Research Center, with its large motion capability, is currently undergoing significant upgrades including a state-of-the-art out-the-window visual system. In addition, an HMD capability will be introduced to use in conjunction with the conventional visual system. With its long history of setting standards in the simulation industry, the VMS is the ultimate tool to conduct research that could help accelerate the development of standards for the use of HMDs in FSTDs. The goal of the talk is ultimately to spark a discussion about the research needs and priorities to best serve the development of new qualification standards.

XR↗

Thematic Mapper Image Production in the Engineering Checkout Phase

Thematic Mapper data processing during LANDSAT 4's first year was performed on an engineering evaluation basis. Fully corrected products were created for some 282 scenes during this period using software and systems based upon the intended full production systems to become operational following the evaluation period. The engineering systems included substantial software and procedures for assessing spacecraft, instrument and ground processing algorithmic behavior. The data systems are described in terms of performance objectives, processing organization and data flow, quality assurance measurements and achievement of goals. The a priori implementation of TM radiometric and geometric corrections is described. Changes to processing suggested by or implemented on the basis of on-orbit data analysis are discussed. Spacecraft, instrument and algorithmic performance are evaluated.

Fischel, D.↗

A Rapid Assessment of a Lunar Surface Laboratory Module

Johnson Space Center has piloted an innovation team known as the Forge to perform rapid turnaround, concurrent engineering studies. The Forge is intended to be able to pull together a team of strategically selected domain experts to innovatively solve a specified problem within a short period of time. The Forge’s inaugural project was the development of a Lunar Surface Laboratory Module concept. The lab module is intended as an option for the NASA Lunar Architecture Team and may allow for increased science productivity and return on investment than with only the Surface Habitat. The Forge team developed two concepts, a stationary laboratory and a mobile laboratory. Human factors evaluations have been conducted to determine the acceptability of the resulting design concepts. The human factors evaluations conducted include a card sort evaluation of the laboratories by science discipline and the System Usability Scale (SUS). The card sort focused subject matter expert expectations for the relative positioning of the laboratory functional areas, determining whether a given lab area should be adjacent to, or separated from, another. The SUS focused on layout efficiency. Both used human factors personnel and both life and physical scientists as subject matter experts. Each of these evaluations will focus primarily on objective data with limited subjective comments, reducing the time required for processing responses. The results of the card sort and SUS evaluations and their implications will be discussed. Based on the evaluation data, an overall acceptability of the Lunar Surface Laboratory Module produced by the Forge study can be determined. Lessons learned and recommendations for future use of human factors rapid assessment processes in early design trades will also be provided.

Forge↗

Rapid Assessment of a Lunar Surface Laboratory Module

Johnson Space Center has piloted an innovation team known as the Forge to perform rapid turnaround, concurrent engineering studies. The Forge is intended to be able to pull together a team of strategically selected domain experts to innovatively solve a specified problem within a short period of time. The Forge’s inaugural project was the development of a Lunar Surface Laboratory Module concept. The lab module is intended as an option for the NASA Lunar Architecture Team and may allow for increased science productivity and return on investment than with only the Surface Habitat. The Forge team developed two concepts, a stationary laboratory and a mobile laboratory. Human factors evaluations have been conducted to determine the acceptability of the resulting design concepts. The human factors evaluations conducted include a card sort evaluation of the laboratories by science discipline and the System Usability Scale (SUS). The card sort is focused subject matter expert expectations for the relative positioning of the laboratory functional areas, determining whether a given lab area should be adjacent to, or separated from, another. The SUS will focus on layout efficiency. Both will use human factors personnel and both life and physical scientists as subject matter experts. Each of these evaluations will focus primarily on objective data with limited subjective comments, reducing the time required for processing responses. The results of the card sort and SUS evaluations and their implications will be discussed. Based on the evaluation data, an overall acceptability of the Lunar Surface Laboratory Module produced by the Forge study can be determined. Lessons learned and recommendations for future use of human factors rapid assessment processes in early design trades will also be provided.

Human Factors↗

Risk analysis methodology survey

NASA regulations require that formal risk analysis be performed on a program at each of several milestones as it moves toward full-scale development. Program risk analysis is discussed as a systems analysis approach, an iterative process (identification, assessment, management), and a collection of techniques. These techniques, which range from simple to complex network-based simulation were surveyed. A Program Risk Analysis Handbook was prepared in order to provide both analyst and manager with a guide for selection of the most appropriate technique.

Batson, Robert G.↗

Expendable launch vehicles technology: A report to the US Senate and the US House of Representatives

As directed in Public Law 100-657, Commercial Space Launch Act Amendments of 1988, and consistent with National Space Policy, NASA has prepared a report on a potential program of research on technologies to reduce the initial and recurring costs, increase reliability, and improve performance of expendable launch vehicles for the launch of commercial and government spacecraft into orbit. The report was developed in consultation with industry and in recognition of relevant ongoing and planned NASA and DoD technology programs which will provide much of the required launch systems technology for U.S. Government needs. Additional efforts which could be undertaken to strengthen the technology base are identified. To this end, focus is on needs for launch vehicle technology development and, in selected areas, includes verification to permit private-sector new technology application at reduced risk. If such a program were to be implemented, it would entail both government and private-sector effort and resources. The additional efforts identified would augment the existing launch vehicle technology programs. The additional efforts identified have not been funded, based upon agency assessments of relative priority vis-a-vis the existing programs. Throughout the consultation and review process, the industry representatives stressed the overriding importance of continuing the DoD/NASA Advanced Launch Development activity and other government technology programs as a primary source of essential launch vehicle technology.

Source record↗

History of Reliability and Quality Assurance at Kennedy Space Center

This Kennedy Historical Document (KHD) provides a unique historical perspective of the organizational and functional responsibilities for the manned and un-manned programs at Kennedy Space Center, Florida. As systems become more complex and hazardous, the attention to detailed planning and execution continues to be a challenge. The need for a robust reliability and quality assurance program will always be a necessity to ensure mission success. As new space missions are defined and technology allows for continued access to space, these programs cannot be compromised. The organizational structure that has provided the reliability and quality assurance functions for both the manned and unmanned programs has seen many changes since the first group came to Florida in the 1950's. The roles of government and contractor personnel have changed with each program and organizational alignment has changed based on that responsibility. The organizational alignment of the personnel performing these functions must ensure independent assessment of the processes.

Childers, Frank M.↗

Spatially-Coordinated Airborne Data and Complementary Products for Aerosol, Gas, Cloud, and Meteorological Studies: the Nasa Activate Dataset

The NASA Aerosol Cloud meTeorology Interactions oVer the western ATlantic Experiment (ACTIVATE) produced a unique dataset for research into aerosol–cloud–meteorology interactions, with applications extending from process-based studies to multi-scale model intercomparison and improvement as well as to remote-sensing algorithm assessments and advancements. ACTIVATE used two NASA Langley Research Center aircraft, a HU-25 Falcon and King Air, to conduct systematic and spatially coordinated flights over the northwest Atlantic Ocean, resulting in 162 joint flights and 17 other single-aircraft flights between 2020 and 2022 across all seasons. Data cover 574 and 592 cumulative flights hours for the HU-25 Falcon and King Air, respectively. The HU-25 Falcon conducted profiling at different level legs below, in, and just above boundary layer clouds (< 3 km) and obtained in situ measurements of trace gases, aerosol particles, clouds, and atmospheric state parameters. Under cloud-free conditions, the HU-25 Falcon similarly conducted profiling at different level legs within and immediately above the boundary layer. The King Air (the high-flying aircraft) flew at approximately ∼ 9 km and conducted remote sensing with a lidar and polarimeter while also launching dropsondes (785 in total). Collectively, simultaneous data from both aircraft help to characterize the same vertical column of the atmosphere. In addition to individual instrument files, data from the HU-25 Falcon aircraft are combined into “merge files” on the publicly available data archive that are created at different time resolutions of interest (e.g., 1, 5, 10, 15, 30, 60 s, or matching an individual data product's start and stop times). This paper describes the ACTIVATE flight strategy, instrument and complementary dataset products, data access and usage details, and data application notes. The data are publicly accessible through https://doi.org/10.5067/SUBORBITAL/ACTIVATE/DATA001 (ACTIVATE Science Team, 2020).

Aerosol Cloud meTeorology Interactions oVer the we↗

Setting the Bar for the Replacement of the Probability of Collision Metric

To date, satellite conjunction assessment (CA) risk analysis has largely embraced the probability of collision (Pc) as the omnibus metric to evaluate collision likelihood, and its use in such assessments has mostly been straightforward: at the point at which a conjunction mitigation decision is required, the calculated Pc is compared to a threshold; and if the calculated Pc exceeds that threshold, then a mitigation action is warranted. With only minor variation, this approach is employed by major CA risk assessment centers (e.g., NASA, EUSST, CNES, JAXA) and is advanced as the preferred method in the published CA best practices handbooks. Despite this near unanimity of operational practice, there is a major strain of secondary literature critical of the Pc and willing to propose alternatives. Alfano (2005) pointed out the ability of the Pc to underrepresent the risk in certain situations and counselled a maximum Pc construct. Carpenter (2017, 2019) reiterated this criticism and proposed using instead a confidence interval on the miss distance. Balch et al. (2019) identified what they argued was a defect in the entire Bayesian Pc construct and believed that the use of a more conservative methodology based on covariance ellipsoid overlap was necessary. Delande (2022) introduced the framework of collision “plausibility” to the risk assessment process and sketched out how this might be used operationally. Elkantassi (2022) published a full development of the miss distance confidence interval approach and applied it to several worked examples. While these different approaches to collision risk assessment do differ in their details, they all converge on two central points: first, the Pc’s failure to give an adequate expression of the risk in dilution region situations is a fatal flaw; and second, a conjunction should be presumed risky and in need of mitigation until the evidence of the situation can establish otherwise. These criticisms, if correct, would counsel a number of modifications to current CA operational practice; as such, they force a re-examination of fundamental aspects of the CA problem, including the following: 1. Is the CA risk assessment a probability problem, a statistics problem, or something else? 2. If it is a statistics problem, does it lend itself naturally to a hypothesis test construction? 3. If it can be construed as a hypothesis test, what form should the null hypothesis take, to wit: what constraints exist on the choice of the null hypothesis, what selections are in best alignment with all of the attendant parameters of the problem, and what is implied philosophically by different choices? 4. What are the implications of using the different proposed risk assessment parameters for CA? This question should be answered both in determining how frequently the dilution region situation cited by the critics of the Pc actually appears in an operationally significant manner and the missed detection and false alarm rates of all of the proposed risk assessment metrics, compared both to the Pc and to each other. This paper explores and offers preliminary answers to the above questions, presenting a researched treatment of the philosophical nature of the CA problem and the null hypothesis choice that achieves the greatest consistency with all of the different aspects of operational CA conduct. It then profiles all of the different proposed risk assessment metrics enumerated in the earlier paragraph against an extremely large database of conjunction events at both the 550km and 700km altitudes. The combination of the philosophical exploration of the CA problem and the results of the profiling activity articulates what a risk assessment metric will need to demonstrate, in terms of both innate construction and performance, in order to be a true competitor to the Pc.

conjunction assessment↗

Fluid Distribution for In-space Cryogenic Propulsion

The ultimate goal of this task is to enable the use of a single supply of cryogenic propellants for three distinct spacecraft propulsion missions: main propulsion, orbital maneuvering, and attitude control. A fluid distribution system is sought which allows large propellant flows during the first two missions while still allowing control of small propellant flows during attitude control. Existing research has identified the probable benefits of a combined thermal management/power/fluid distribution system based on the Solar Integrated Thermal Management and Power (SITMAP) cycle. Both a numerical model and an experimental model are constructed in order to predict the performance of such an integrated thermal management/propulsion system. This research task provides a numerical model and an experimental apparatus which will simulate an integrated thermal/power/fluid management system based on the SITMAP cycle, and assess its feasibility for various space missions. Various modifications are done to the cycle, such as the addition of a regeneration process that allows heat to be transferred into the working fluid prior to the solar collector, thereby reducing the collector size and weight. Fabri choking analysis was also accounted for. Finally the cycle is to be optimized for various space missions based on a mass based figure of merit, namely the System Mass Ratio (SMR). -. 1 he theoretical and experimental results from these models are be used to develop a design code (JETSIT code) which is able to provide design parameters for such a system, over a range of cooling loads, power generation, and attitude control thrust levels. The performance gains and mass savings will be compared to those of existing spacecraft systems.

Lear, William↗

PCB Quality Metrics that Drive Reliability (PD 18)

Risk based technology infusion is a deliberate and systematic process which defines the analysis and communication methodology by which new technology is applied and integrated into existing and new designs, identifies technology development needs based on trends analysis and facilitates the identification of shortfalls against performance objectives. This presentation at IPC Works Asia Aerospace 2019 Events provides the audience a snapshot of quality variations in printed wiring board quality, as assessed, using experiences in processing and risk analysis of PWB structural integrity coupons. The presentation will focus on printed wiring board quality metrics used, the relative type and number of non-conformances observed and trend analysis using statistical methods. Trend analysis shows the top five non-conformances observed across PWB suppliers, the root cause(s) behind these non-conformance and suggestions of mitigation plans. The trends will then be matched with the current state of the PWB supplier base and its challenges and opportunities. The presentation further discusses the risk based SMA approaches and methods being applied at GSFC for evaluating candidate printed wiring board technologies which promote the adoption of higher throughput and faster processing technology for GSFC missions.

Sood, Bhanu↗