SEARCH · Engineering Papers

Results for “regulatory decisions”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10

All sources NASA NTRS DOE OSTI

NASA NTRS2021

Tracking Smoke from a Prescribed Fire and its Impacts on Local Air Quality using Temporally Resolved GOES-16 ABI Aerosol Optical Depth (AOD)

Aerosol optical depth (AOD) retrieved from the GOES-16 Advanced Baseline Imager (ABI) was used to track a smoke plume from a prescribed fire in northeastern Virginia on 8 March 2020. Weather and atmospheric conditions created a favorable environment to transport the plume through the Washington, D.C., and Baltimore, Maryland, metro areas in the afternoon and concentrate smoke near the surface, degrading air quality for several hours. ABI AOD with 5-min temporal resolution and 2-km spatial resolution definitively identified the timing and geographic extent of the plume during daylight hours. Comparison to AERONET AOD indicates that ABI AOD captured the relative change in AOD due to passage of the smoke, with a mean absolute error of 0.047. Ground-based measurements of fine particulate matter (PM2.5) confirm deteriorations in air quality coincident with the progression of the smoke. Ceilometer aerosol backscatter profiles verify plume transport timing and indicate that smoke aerosols were well mixed in a shallow boundary layer. This event illustrates the advantages of using multiple datasets to analyze the impacts of aerosols on ambient air quality. Given the quickly evolving nature of the event over several hours, ABI AOD provided information for the public and decision-makers that was not available from any other source, including polar-orbiting satellite sensors. This study suggests that PM2.5 concentrations estimated from ABI AOD can be used to fill in the gaps in nationwide regulatory PM2.5 monitor networks and may be a valuable addition to EPA’s PM2.5 NowCast of current air quality conditions.

satellite observations↗

DOE OSTI2025

ACCELERATED DEPLOYMENT OF NOVEL MATERIALS BASED ON RELIABILITY INTEGRITY MANAGEMENT USING CUMULATIVE DAMAGE MODELING

There is currently no widely agreed, detailed general method for licensing a novel plant incorporating novel materials (or materials being deployed in novel environments); in many such situations, there are no directly applicable engineering code cases for decision-makers (including regulators) to rely on. This paper discusses a framework for solving this problem that is based on the Reliability and Integrity Management (RIM) approach delineated in ASME BPVC Section XI Division 2. NRC Regulatory Guide 1.246, Rev. 0, endorses, with conditions, the subject portion of the 2019 ASME Code. The proposed framework is meant to support development of a licensing case by addressing certain remaining technical challenges. The framework discussed here is compatible with the Licensing Modernization Project, but applying it in a specific case will call for advances in the state of practice, if not the state of the art. The RIM approach calls for applicants to (a) allocate reliability targets to plant structures, systems, and components (SSCs), (b) show that they are able to relate the currently observed physical condition of each SSC in the program to its failure probability well enough to determine whether the target reliability allocations are being satisfied, allowing for uncertainty related to the novelty of the materials/designs/operating environments, and (c) be able to demonstrate that the proposed program of surveillances will reliably detect unacceptable degradation of an SSC before SSC failure occurs. A modeling approach potentially applicable to item (b), based on cumulative damage modeling rather than failure rates, is briefly illustrated.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2020

Sensitive Resources Assessment and Forest Analysis for The SSP-2A Parcel and Proposed Oak Ridge Enhanced Technology and Training Center (ORETTC), Oak Ridge, Tennessee

This report summarizes current knowledge of natural and cultural resources associated with potential land use changes within an 81-acre (32.8-hectare) parcel, termed SSP-2A, on the US Department of Energy’s (DOE’s) Oak Ridge Reservation (ORR) in Oak Ridge, Tennessee (Figure 1). A primary goal for the work presented here was to evaluate potential impacts to sensitive resources within the SSP-2A parcel that might result from land disturbance and construction of the Oak Ridge Enhanced Technology and Training Center (ORETTC). In addition to on-the-ground surveys of the ORETTC footprint and SSP-2A parcel during summer 2020 (Figure 1), this report leverages historical (pre-1995) and contemporary (1995–present) data from additional sources such as the Tennessee Department of Environment and Conservation (TDEC). The individuals who obtained and compiled the data that are presented here are familiar with and routinely assess, manage, and research sensitive resources on the ORR. This report should facilitate more environmentally sound decisions during planning and development of the ORETTC, provide a foundation for further assessment of sensitive and cultural resources associated with the broader SSP-2A parcel (should additional actions take place), and help project managers address regulatory guidance and DOE policy on sustainable development. Those who reference this report must consider that the timing of surveys does not permit complete delineation of resources. Data deficiencies are indicated where possible. Additional surveys may be required to account for seasonal patterns of various threatened and endangered species (e.g., bats), and additional assessment will be required if activities extend beyond the ORETTC site (Figure 2).

54 ENVIRONMENTAL SCIENCES↗

NASA NTRS2021

A Systematic Approach to Developing Paths Towards Airborne Vehicle Autonomy

Advanced Air Mobility (AAM) demands greater levels of aircraft autonomy than are currently implemented today. To enable this requirement, novel aircraft functionalities and technologies as well as supporting airworthiness and operational regulations are required. A structured method to derive a comprehensive list of aircraft level decision-making functions is defined and applied. The resulting function set is programmed into an ontology, and enables autonomous decision-making through the application of a defined decision-making process. Paths to implementing the functions are generated by applying a structured four step method. By surveying current technologies, airspace, procedures and regulations, the paths generation method defines incremental paths to autonomy that the current regulatory environment can support. Opportunities to implement novel technologies and functions are identified, and regulatory mechanisms supporting their implementation are underscored. The analysis provides the tools to further define aircraft functions and paths to their implementation, while demonstrating that for particular use cases, aircraft autonomy is attainable in the medium-term.

Paul Vajda↗

DOE OSTI2022

Case study on the novel permitting and authorization of PacWave South, a US grid-connected wave energy test facility: Development, challenges, and insights

Marine energy (i.e., energy from waves, tides, currents, and rivers) in the United States is a nascent industry. In particular, permitting processes—an uncertainty for industry advancement that can be costly and time consuming to navigate—have rarely been tested and used for marine energy. The novelty of the marine energy industry and utilization of open ocean permitting processes that were not originally developed for marine energy have led to extensive efforts to gain consensus amongst state and federal regulatory agencies to authorize marine energy projects. In 2021, Oregon State University successfully completed permitting of a wave energy test facility, called PacWave South, off the coast of Oregon, which is designed to advance wave energy research and development. This article documents the multi-year process that Oregon State University used to receive federal and state authorization for a pre-permitted commercial-scale grid connected facility by detailing the development of the test facility, management of uncertainty and challenges, and key decisions. The PacWave South case study provides insights for the larger marine energy community as the industry advances towards commercialization.

16 TIDAL AND WAVE POWER↗

DOE OSTI2020

Vendor-Independent Design Requirements for a Boiling Water Reactor Safety System Upgrade

This Vendor-Independent License Amendment Request (LAR) Framework Document is a research product developed for the Idaho National Laboratory Light Water Reactor Sustainability (LWRS) Program. It was developed by MPR Associates, Inc. with technical input from LWRS and Exelon Generation personnel. To accomplish the purpose of this research, an operating plant (Limerick Generating Station [LGS]) was used as a reference to provide a concrete example and to present a "top-down" view of design concepts consistent with functional requirements baseline documents (references X and Y) also developed for this research. While this document is written in a framework to support a complete LAR submittal, its purpose is to communicate research concepts and provide an example of how to present digital information necessary to address expectations with regard to leveraging the Alternate Review Process as provided in Digital Instrumentation and Controls Interim Staff Guidance #06, Revision 2, Licensing Process. To leverage that process, this research document presupposes that a utility would select a vendor platform which has been prequalified for safety-related by the United States Nuclear Regulatory Commission. While this document is written using the Exelon Generation Limerick Generating Station (LGS) Units 1 and 2 as a baseline, this document is a research product. This document contains no commitments and makes no binding design decisions for Exelon Generation. Exelon Generation is leveraging this research to support their in-progress LGS Plant Protection System (PPS) upgrade efforts and plans to leverage it for their Redundant Reactor Control System (RRCS) replacement. The LWRS Program appreciates the research support provided by Exelon Generation in the generation of this document.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

DOE OSTI2023

West Valley Demonstration Project (WVDP) (Annual Site Environmental Report (ASER), Calendar Year 2022)

The report, prepared for the U.S. Department of Energy West Valley Demonstration Project office (DOE-WVDP), summarizes the environmental protection program at the WVDP for calendar year (CY) 2022. Monitoring and surveillance of the facilities used by the DOE are conducted to verify protection of public health and safety and the environment. The report is a key component of DOE’s effort to keep the public informed of environmental conditions at the WVDP. The quality assurance protocols applied to the environmental monitoring program ensure the validity and accuracy of the monitoring data. In addition to demonstrating compliance with environmental laws, regulations, and directives, evaluation of data collected in 2022 continued to indicate that WVDP activities pose no threat to public health or safety, or to the environment.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

NASA NTRS1972

A Critique of Cab Regulatory Policy

The regulatory policies of the Civil Aviation Board are discussed. The objectives of the Civil Aviation Board are defined. Specific actions of the Civil Aviation Board with respect to passenger fares, rate levels, and load factors are presented. The decisions on successful and unsuccessful mergers of airlines during the 1938 to 1972 time period are analyzed. Tables of data are presented to show the economic aspects of airline operations during 1955, 1960, and 1970.

management methods↗

DOE OSTI2026

Performing Numerical Analysis of Cybersecurity Options Using Dynamic Risk Analysis Tool EMRALD

Cyberattacks can have many different attack paths, durations, and goals. There are also many different mitigation options involving hardware, software, and/or humans. Considering a cyber threat should involve defense-in-depth methods and a quantitative or numerical evaluation of overall effectiveness against dynamic, time-dependent attacks to make cost and risk-informed decisions. Typical cyberattack modeling methods only provide a qualitative evaluation. The main areas of cybersecurity are confidentiality, integrity, and availability. For companies with cyber-physical systems such as advanced nuclear reactors, cyber-related safety is a requirement set by North American Electric Reliability and the U.S. Nuclear Regulatory Commission. They are also concerned about availability or reliability as a business case. As cyber threats are evolving to a business-for-hire structure, more attacks may focus on disrupting business success and reliability, causing financial and economic stability risk. Companies want to know business reliability and recovery from those threats, and that requires modeling physical behavior of the targets. Dynamic-state-based and Markov-based modeling provides a method for better cyber scenario modeling with different tools having issues such as state-base explosion. Dynamic modeling enables time and conditional features not found in other numerical evaluation methods. EMRALD (Event Modeling Risk Assessment using Lined Diagrams) is a dynamic risk analysis modeling and simulation tool and has features that reduce modeling issues. It has been used to model different time-dependent events including plant behavior and operator procedures. As a general modeling tool, EMRALD can also be used to model cyberattack scenarios with varying mitigation options and quantify effectiveness, producing numerical data for risk-informed decisions. This paper uses EMRALD to demonstrate that dynamic numerical risk analysis can be used for cyber threat modeling to provide insights for design decision-making and optimize defense strategies. Keywords: cyber modeling; cyber-physical systems; numerical cyber modeling

97 - MATHEMATICS AND COMPUTING↗

DOE OSTI2022

Computational Tools and Workflows for Quantitative Risk Assessment and Decision Support for Geologic Carbon Storage Sites: Progress and Insights from the U.S. DOE’s National Risk Assessment Partnership

The 2005 Intergovernmental Panel on Climate Change (IPCC) Special Report on CCS raised the profile of CO2 capture and storage (CCS) as an important technology for reducing greenhouse gas (GHG) emissions. CCS is now recognized as a key component of most climate change mitigation scenarios. Since publication of that report the international research, development, and deployment (RD&D) community has advanced key technical aspects, clarified regulatory requirements, explored value chain and infrastructure solutions, and developed incentive paradigms to enable and promote large-scale deployment of CCS. These efforts have included research to better characterize geologic storage resources, to improve injection performance and storage efficiency, to assess and manage subsurface environmental risks, and to advance monitoring technologies to assure system conformance. These efforts have helped to build confidence in the viability of geologic carbon storage (GCS), but stakeholder concerns about long-term risks and liability associated with GCS remain a hurdle to broad acceptance and large-scale deployment of CCS. Since 2010, the U.S. DOE’s National Risk Assessment Partnership (NRAP) – a research collaboration between five contributing national laboratories – has worked to establish and demonstrate methods and tools to quantify and manage the subsurface environmental risks associated with GCS, amidst uncertainty. This work supports the Office of Fossil Energy and Carbon Management Carbon Transport and Storage Program’s goal of advancing safe and secure commercial-scale GCS deployment. To address the technical challenge of simulating the physical response of the GCS site to large-scale CO2 injection, NRAP has adopted an approach that relies on coupling computationally efficient reduced-order and/or data-driven proxy models of important system components (i.e., storage reservoir, sealing caprock, leakage pathways, intermediate formations, overlying groundwater aquifers, and the atmosphere) in integrated assessment framework. That integrated model of the physical system is complemented with fit-for purpose functionality to support site characterization and risk-related decisions. The recently released NRAP Phase II toolset includes the Open-Source Integrated Assessment Model (NRAP-Open-IAM) for evaluation of trends in leakage risk and potential impact, tools to support monitoring design optimization (Designs for Risk Evaluation and Management – DREAM v3.0 and Passive Seismic Monitoring Tool - PSMT), and tools for state of stress evaluation (State-of-Stress Analysis Tool - SOSAT) and forecasting induced seismicity risk. The NRAP team has also released a pair of reports describing conceptual workflows to incorporate physics-based, quantitative risk assessment into many of the design, planning, operation, and closure decisions for GCS projects. An online catalogue highlights published studies where these tools and methods are demonstrated. In this presentation, the utility of these products to assess risks and address key stakeholder questions will be highlighted through examples, and related insights about the safety and security of geologic carbon storage in qualified storage sites will be discussed. The prospect of rapid, large-scale deployment of GCS technology to aggressively reduce anthropogenic CO2 emissions requires careful consideration of interference between multiple commercial-scale storage projects within a basin. Going forward, NRAP is expanding and adapting site-scale risk quantification tools and methods to enable assessment of risks and inform management decisions for basin-scale deployment. Increasingly, this work will leverage next-generation approaches for surrogate modelling, fast prediction, and advanced visualization enabled by machine learning and artificial intelligence to promote virtual learning, scenario evaluation, and augment risk-based decision making.

quantitative risk assessment, geologic carbon stor↗

DOE OSTI2025

PSA 2025 DPRA for Cyber Optimization

Cyberattacks can have many different attack paths, durations, and goals. There are also many different mitigation options involving hardware, software, and/or humans. Evaluating defense options should include quantitative evaluation of overall effectiveness to make cost and risk-informed decisions. Typical cyberattack modeling methods only provide a qualitative evaluation and have difficulty with time dependent scenarios. The main areas of cybersecurity are confidentiality, integrity, and availability. For companies with cyber-physical systems such as advanced nuclear reactors, cyber-related integrity is a requirement set by the U.S. Nuclear Regulatory Commission. But companies are also concerned about availability or reliability as a business case. As cyber threats are evolving to a business-for-hire structure, more attacks focus on disrupting business success and reliability, causing financial and economic stability risk. Companies want reliability analysis while optimizing cost, which requires more than safety modeling methods. Dynamic-state-based and Markov-based modeling provides a method for better cyber scenario modeling with timing and conditional features not found in other numerical evaluation methods. EMRALD (Event Modeling Risk Assessment using Lined Diagrams) is a dynamic risk analysis modeling and simulation tool and has features that reduce modeling issues such as state-base explosion found in Markov-based tools. It has been used to model different time-dependent events including plant behavior and operator procedures. As a general modeling tool, EMRALD can also be used to model cyberattack scenarios with varying mitigation options and quantify effectiveness, producing numerical data for risk-informed decisions. This paper uses EMRALD to demonstrate that dynamic risk analysis can be used for cyber threat modeling to provide insights for design decision-making and optimize defense strategies.

97 - MATHEMATICS AND COMPUTING↗

DOE OSTI2025

West Valley Demonstration Project (WVDP) Annual Site Environmental Report (ASER) for Calendar Year 2024

The report, prepared for the U.S. Department of Energy West Valley Demonstration Project office (DOE-WVDP), summarizes the environmental protection program at the WVDP for calendar year (CY) 2024. Monitoring and surveillance of the facilities used by the DOE are conducted to verify protection of public health and safety and the environment. The report is a key component of DOE’s effort to keep the public informed of environmental conditions at the WVDP. The quality assurance protocols applied to the environmental monitoring program ensure the validity and accuracy of the monitoring data. In addition to demonstrating compliance with environmental laws, regulations, and directives, evaluation of data collected in 2024 continued to indicate that WVDP activities pose no threat to public health or safety, or to the environment.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2026

West Valley Demonstration Project (WVDP) Annual Site Environmental Report (ASER) for Calendar Year 2025

The report, prepared for the U.S. Department of Energy West Valley Demonstration Project office (DOE-WVDP), summarizes the environmental protection program at the WVDP for calendar year (CY) 2025. Monitoring and surveillance of the facilities used by the DOE are conducted to verify protection of public health and safety and the environment. The report is a key component of the DOE’s effort to keep the public informed of environmental conditions at the WVDP. The quality assurance protocols applied to the environmental monitoring program ensure the validity and accuracy of the monitoring data. In addition to demonstrating compliance with environmental laws, regulations, and directives, the evaluation of data collected in 2025 continued to indicate that WVDP activities posed no threat to public health or safety, or to the environment.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

DOE OSTI2024

Relating Measured Component Damage to Assessed Component Reliability in Reliability Integrity Management (RIM)

There is currently no widely agreed detailed general method for licensing a novel plant incorporating novel materials (or materials being deployed in novel environments); in many such situations, there are no directly applicable engineering code cases for decision-makers (including regulators) to rely on. It may be possible to develop an approach to licensing such a plant that is based on the Reliability and Integrity Management (RIM) approach delineated in ASME BPVC Section XI Division 2. NRC Regulatory Guide 1.246, Rev.0, endorses, with conditions, the subject portion of the ASME Code. But that portion of the ASME code is written at a very high level, and there are fundamental technical challenges associated with applying it literally to licensing a real plant. In the RIM approach, applicants need to do the following (among other things): • Allocate target reliabilities to structures, systems, and components (SSCs) that collectively support the top-level plant safety and availability objectives; • Understand failure modes of those SSCs, and the degradation mechanisms that could lead to those failure modes; • Develop and propose a program of surveillances that will identify degradation prior to failure of SSCs; • Provide a means of reporting results, taking actions for anomalous or undesirable conditions, and give the regulator assurance of continued safe operations. Applying RIM in a specific case will call for advances in the state of practice of relating physical observables to functional reliability of certain component types. Except where a given level of damage corresponds to a failed (or nearly failed) state, it is not practical to establish a precise quantitative relationship between physical observables and reliability. This paper focuses on managing risk of passive component failures based on observable damage parameters. A simple approach to cumulative damage modeling will be illustrated with a view to possible use in RIM applications.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2020

Electric Distribution System Planning with DERs - High-level Assessment of Tools and Methods

This document addresses analytical tools and methods to support electric distribution system planning with distributed energy resources (DERs) and grid modernization, drawing on leading-edge research and examples from around the United States. In this report, tools include computer models and software, as well as other analytical aids and practices that support distribution system planning. At its core, distribution system planning is about supporting investment decisions. Enhanced and integrated distribution system planning allows utilities to move from a passive reactive role to smart proactive planning with respect to DERs. Distribution system planning can increase transparency around utility distribution system investments before they are brought to the regulatory body for cost recovery, can support deferring traditional infrastructure investments, and can provide information and incentives to customers and third parties about where DERs can help the grid. A growing number of states are beginning to consider a comprehensive distribution system planning process that addresses the costs and benefits of DERs, reflects more choices coming from the customer/third-party domains, is integrated with resource and transmission planning, and incorporates planning scenarios that reflect the dynamic and changing nature of the electricity system

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2025

Alabama Carbon Storage: Bringing Data to the People

The Gulf Coastal Plain of Alabama has proven potential for geologic carbon storage and current interest in the area for large carbon capture and storage (CCS) projects is high. Extensive CCS relevant data exist in the records of the Geological Survey of Alabama and State Oil and Gas Board of Alabama, however, most of this data is not publicly available or is scattered in separate databases, file cabinets, and tables in publications. The “Alabama Carbon Storage: Data Sharing and Engagement” (ACS-DSE) project seeks to accelerate the responsible development of large CCS projects in the Gulf Coastal Plain of Alabama and offshore in state waters through a publicly accessible database of geologic carbon storage models and data across the region. The ACS-DSE draws on the over 150 years of geologic research and over 20 years of experience in CCS research to place relevant geologic, geophysical, and infrastructure data on a single web platform. Datasets available will include formation depths and elevations, geologic structures, reservoir properties, digital well logs (LAS files), existing penetrations, and geologic models. In addition to downloadable datasets, links to CCS related regulatory agencies and other sources of information will be included (for example, Class VI UIC permitting regulations and pipeline regulations). By making these datasets and models available in commonly used formats on a public website, the project will increase transparency in decision making and decrease the data acquisition time for industry.

01 COAL, LIGNITE, AND PEAT↗

DOE OSTI2026

Ten questions concerning Large Language Models (LLMs) for building applications

Large Language Models (LLMs) are emerging as powerful AI tools capable of transforming how building information is collected, processed, analyzed, and applied across diverse research areas. Their capabilities can help building operators, facility managers and other stakeholders such as designers, architects and engineers by providing actionable insights for decision-making across planning, construction, operations, and maintenance of buildings and facilities. This paper explores ten key questions concerning the role of LLMs in shaping sustainable, intelligent, and human-centric buildings. From fundamental definitions to advanced applications, we examine how LLMs facilitate decision-making across the life cycle of buildings and energy systems. LLMs can enhance life cycle assessments (LCA), building energy simulations, and real-time data integration, empowering more efficient and adaptive human-AI environments. They can also contribute to streamlining regulatory compliance, improving post-occupancy evaluations, and fostering more inclusive and participatory design processes. Additionally, this paper addresses the ethical challenges posed by LLMs, such as bias, data privacy, and environmental impacts, and explores their potentials in advancing intelligent digital twins (DT) for ongoing building operations and maintenance. Built upon our applied research using LLMs and the review of tools, datasets, and research gaps, we provide a forward-looking perspective on how LLMs can drive innovation, collaboration, and productivity in the built environment while supporting ethical and effective implementation.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

NASA NTRS2011

A Human Factors Approach to Bridging Systems and Introducing New Technologies

The application of human factors in aviation has grown to cover a wide range of disciplines and methods capable of assessing human-systems integration at many levels. For example, at the individual level, pilot workload may be studied while at the team level, coordinated workload distribution may be the focal point. At the organizational level, the way in which individuals and teams are supported by training and standards, policies and procedures may introduce additional, relevant topics. A consideration of human factors at each level contributes to our understanding of successes and failures in pilot performance, but this system focused on the flight deck alone -- is only one part of the airspace system. In the FAA's NextGen plan to overhaul the National Airspace System (NAS), new capabilities will enhance flightdeck systems (pilots), flight operations centers (dispatchers) and air traffic control systems (controllers and air traffic managers). At a minimum, the current roles and responsibilities of these three systems are likely to change. Since increased automation will be central to many of the enhancements, the role of automation is also likely to change. Using NextGen examples, a human factors approach for bridging complex airspace systems will be the main focus of this presentation. It is still crucial to consider the human factors within each system, but the successful implementation of new technologies in the NAS requires an understanding of the collaborations that occur when these systems intersect. This human factors approach to studying collaborative systems begins with detailed task descriptions within each system to establish a baseline of the current operations. The collaborative content and context are delineated through the review of regulatory and advisory materials, letters of agreement, policies, procedures and documented practices. Field observations and interviews also help to fill out the picture. Key collaborative functions across systems are identified and placed on a phase-of-flight timeline including information requirements, decision authority and use of automation, as well as level of frequency and criticality.

Kanki, Barbara G.↗