Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Decision making”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 541 records · Page 30
All sourcesNASA NTRSDOE OSTI
NASA NTRS2019

Pilot Evaluation of Proposed Go-Around Criteria for Transport Category Aircraft

The primary objective of this study was to capture pilot feedback and decision-making with regard to proposed, hypothetical, go-around criteria that were developed based on previous research. A secondary objective of the study was to assess crew members' awareness of the aircraft state on approach. An experiment was conducted using Boeing 737-800 and Airbus A330-200 level D full-flight simulators, in which pilots flew multiple approaches which were on the borderline of the proposed go-around criteria at 300 ft. Pilots were instructed that they could either execute a go-around or land the airplane on each run, forcing a decision for the borderline cases at 300 ft. Pilots were instructed to go around if the aircraft was outside of the go-around criteria at 300 ft or if either pilot was uncomfortable with the approach. The results revealed that: 1) the most important factors which drove go-around decision-making during the experiment were airspeed and localizer deviation, 2) the objective data suggested that the 300-ft gate is viable, although many pilots were still uncomfortable with that gate height; perhaps more emphasis on checking stability at 1,000 ft and 500 ft would make more pilots comfortable with the 300-ft go-around gate, 3) allowing for momentary deviations should be considered, and 4) the acceptability of the criteria is highly dependent on given pilot's risk tolerance. Overall, the proposed criteria performed well, and most pilots would find the criteria acceptable with some minor adjustments.

go-arounds↗
NASA NTRS2017

Experiences in Applying Earth Observing Satellite Technology in SERVIR Regions with an Emphasis on Disasters: Successes, Lessons and Paths Forward

Earth observing satellites offer a unique perspective of our environment from the vantage point of space. Repeated measurements of the Earths subsystems such as the biosphere, atmosphere, lithosphere, hydrosphere, and of humans interactions with their environments, allow for a better understanding of Earth system processes, and they can provide input for decision making in areas of environmental management and disaster risk reduction. SERVIR is a joint initiative of the US National Aeronautics and Space Administration (NASA) and the US Agency for International Development (USAID) that began in 2005 and has been active in applying Earth observations for sustainable development in many regions around the world, recently the Lower Mekong and West Africa regions. This talk will highlight some successes achieved and lessons learned through SERVIR in Central America, Eastern Southern Africa, and the Hindu Kush-Himalaya region, focusing on disasters. We will also present opportunities for enhanced decision making with Earth observations and geospatial technologies in the Lower Mekong region.

SERVIR↗
NASA NTRS1993

Risk management for the Space Exploration Initiative

Probabilistic Risk Assessment (PRA) is a quantitative engineering process that provides the analytic structure and decision-making framework for total programmatic risk management. Ideally, it is initiated in the conceptual design phase and used throughout the program life cycle. Although PRA was developed for assessment of safety, reliability, and availability risk, it has far greater application. Throughout the design phase, PRA can guide trade-off studies among system performance, safety, reliability, cost, and schedule. These studies are based on the assessment of the risk of meeting each parameter goal, with full consideration of the uncertainties. Quantitative trade-off studies are essential, but without full identification, propagation, and display of uncertainties, poor decisions may result. PRA also can focus attention on risk drivers in situations where risk is too high. For example, if safety risk is unacceptable, the PRA prioritizes the risk contributors to guide the use of resources for risk mitigation. PRA is used in the Space Exploration Initiative (SEI) Program. To meet the stringent requirements of the SEI mission, within strict budgetary constraints, the PRA structure supports informed and traceable decision-making. This paper briefly describes the SEI PRA process.

Buchbinder, Ben↗
NASA NTRS2016

The Cognitive Challenges of Flying a Remotely Piloted Aircraft

A large variety of Remotely Piloted Aircraft (RPA) designs are currently in production or in development. These aircraft range from small electric quadcopters that are flown close to the ground within visual range of the operator, to larger systems capable of extended flight in airspace shared with conventional aircraft. Before RPA can operate routinely and safely in civilian airspace, we need to understand the unique human factors associated with these aircraft. The task of flying an RPA in civilian airspace involves challenges common to the operation of other highly-automated systems, but also introduces new considerations for pilot perception, decision-making, and action execution. RPA pilots participated in focus groups where they were asked to recall critical incidents that either presented a threat to safety, or highlighted a case where the pilot contributed to system resilience or mission success. Ninety incidents were gathered from focus-groups. Human factor issues included the impact of reduced sensory cues, traffic separation in the absence of an out-the-window view, control latencies, vigilance during monotonous and ultra-long endurance flights, control station design considerations, transfer of control between control stations, the management of lost link procedures, and decision-making during emergencies. Some of these concerns have received significant attention in the literature, or are analogous to human factors of manned aircraft. The presentation will focus on issues that are poorly understood, and have not yet been the subject of extensive human factors study. Although many of the reported incidents were related to pilot error, the participants also provided examples of the positive contribution that humans make to the operation of highly-automated systems.

remote pilot station↗
NASA NTRS2009

An Operational Perspective of Total Lightning Information

The close and productive collaborations between the NWS Warning and Forecast Office, the Short Term Prediction and Research Transition Center at NASA Marshall Space Flight Center and the University of Alabama in Huntsville have provided a unique opportunity for science sharing and technology transfer. One significant technology transfer that has provided immediate benefits to NWS forecast and warning operations is the use of data from the North Alabama Lightning Mapping Array. This network consists of ten VHF receivers deployed across northern Alabama and a base station located at the National Space Science and Technology Center. Preliminary investigations done at WFO Huntsville, along with other similar total lightning networks across the country, have shown distinct correlations between the time rate-of-change of total lightning and trends in intensity/severity of the parent convective cell. Since May 2003 when WFO HUN began receiving these data - in conjunction with other more traditional remotely sensed data (radar, satellite, and surface observations) -- have improved the situational awareness of the WFO staff. The use of total lightning information, either from current ground based systems or future space borne instrumentation, may substantially contribute to the NWS mission, by enhancing severe weather warning and decision-making processes. Operational use of the data has been maximized at WFO Huntsville through a process that includes forecaster training, product implementation, and post event analysis and assessments. Since receiving these data, over 50 surveys have been completed highlighting the use of total lightning information during significant events across the Tennessee Valley. In addition, around 150 specific cases of interest have been archived for collaborative post storm analysis. From these datasets, detailed trending information from radar and total lightning can be compared to corresponding damage reports. This presentation will emphasize the effective use of total lightning information in warning decision making along with best practices for implementation of new technologies into operations.

Nadler, David J.↗
NASA NTRS2017

Parameter Validation for Evaluation of Spaceflight Hardware Reusability

Within recent years, there has been an influx of companies around the world pursuing reusable systems for space flight. Much like NASA, many of these new entrants are learning that reusable systems are complex and difficult to acheive. For instance, in its first attempts to retrieve spaceflight hardware for future reuse, SpaceX unsuccessfully tried to land on a barge at sea, resulting in a crash-landing. As this new generation of launch developers continues to develop concepts for reusable systems, having a systematic approach for determining the most effective systems for reuse is paramount. Three factors that influence the effective implementation of reusability are cost, operability and reliability. Therefore, a method that integrates these factors into the decision-making process must be utilized to adequately determine whether hardware used in space flight should be reused or discarded. Previous research has identified seven features that contribute to the successful implementation of reusability for space flight applications, defined reusability for space flight applications, highlighted the importance of reusability, and presented areas that hinder successful implementation of reusability. The next step is to ensure that the list of reusability parameters previously identified is comprehensive, and any duplication is either removed or consolidated. The characteristics to judge the seven features as good indicators for successful reuse are identified and then assessed using multiattribute decision making. Next, discriminators in the form of metrics or descriptors are assigned to each parameter. This paper explains the approach used to evaluate these parameters, define the Measures of Effectiveness (MOE) for reusability, and quantify these parameters. Using the MOEs, each parameter is assessed for its contribution to the reusability of the hardware. Potential data sources needed to validate the approach will be identified.

Childress-Thompson, Rhonda↗
NASA NTRS2017

Parameter Validation for Evaluation of Spaceflight Hardware Reusability

Within recent years, there has been an influx of companies around the world pursuing reusable systems for space flight. Much like NASA, many of these new entrants are learning that reusable systems are complex and difficult to acheive. For instance, in its first attempts to retrieve spaceflight hardware for future reuse, SpaceX unsuccessfully tried to land on a barge at sea, resulting in a crash-landing. As this new generation of launch developers continues to develop concepts for reusable systems, having a systematic approach for determining the most effective systems for reuse is paramount. Three factors that influence the effective implementation of reusability are cost, operability and reliability. Therefore, a method that integrates these factors into the decision-making process must be utilized to adequately determine whether hardware used in space flight should be reused or discarded. Previous research has identified seven features that contribute to the successful implementation of reusability for space flight applications, defined reusability for space flight applications, highlighted the importance of reusability, and presented areas that hinder successful implementation of reusability. The next step is to ensure that the list of reusability parameters previously identified is comprehensive, and any duplication is either removed or consolidated. The characteristics to judge the seven features as good indicators for successful reuse are identified and then assessed using multiattribute decision making. Next, discriminators in the form of metrics or descriptors are assigned to each parameter. This paper explains the approach used to evaluate these parameters, define the Measures of Effectiveness (MOE) for reusability, and quantify these parameters. Using the MOEs, each parameter is assessed for its contribution to the reusability of the hardware. Potential data sources needed to validate the approach will be identified.

Childress-Thompson, Rhonda↗
NASA NTRS2024

Smallsat 2024 - Starling Cubesat Swarm Technology Demonstration Flight Results

The Starling swarm of four 6U CubeSats launched in July 2023 to test four key technologies to enable future swarm missions: 1) Mobile Ad-Hoc Networking (MANET) over a crosslink radio network 2) Autonomous onboard decision-making for operations 3) Optical-based absolute and relative navigation 4) Autonomous maneuver planning and execution The Starling team implemented the Better Approach to Mobile Ad-hoc Networking (B.A.T.M.A.N.) protocol to automatically manage the crosslink network of four satellites. The B.A.T.M.A.N. protocol uses a decentralized approach to managing a multi-hop mesh network of devices, in this case, a satellite swarm. The four satellites were able to successfully establish a network at multiple data rates and demonstrate file transfer and command issuance between spacecraft over the network. Starling incorporated Distributed Spacecraft Autonomy's (DSA) software to demonstrate onboard decision-making. The DSA software takes L1/L2 band GPS measurements and uses them to estimate the relative Total Electron Count (TEC) in the ionosphere. The onboard software then determines if there are any features of interest and provides that information to the other satellites over the crosslink network. The swarm of satellites then reaches a consensus on the optimal TEC observation strategy and adjusts its measurement collection tactics autonomously. The Starling Formation-Flying Optical Experiment (StarFOX), produced by Stanford's Space Rendezvous Laboratory, uses the onboard star trackers to collect images of the other swarm spacecraft and produce angles-only navigation estimates. This system is envisioned to be valuable in applications in which Global Navigation Satellite Systems (GNSS) are not available, such as in cis-lunar or deep space. StarFOX successfully applied its algorithms to multiple simultaneous spacecraft targets using the star tracker imagery. Finally, Starling used Emergent Space's Cluster Flight Application (CFA) software suite for the Reconfiguration and Orbit Maintenance Experiments Onboard (ROMEO) demonstration of autonomously planning and executing propulsive maneuvers. Large swarms will need to be able to maintain formation requirements with minimal operator involvement, especially as the size of the swarm scales up. Results from the ROMEO experiment are presented. Starling is funded by the Small Spacecraft Technology (SST) program out of NASA's Space Technology Mission Directorate (STMD).

distributed systems↗
NASA NTRSDate not supplied

An Orbit Determination Comparison Study and Demonstration for Rendezvous and Docking in a Near Rectilinear Halo Orbit from the Lunar Surface

For the upcoming NASA Artemis III mission and those that follow, both the Human Landing System (HLS) and Orion programs are invested in understanding the impacts of ground tracking performance in supporting rendezvous and docking in a Near Rectilinear Halo Orbit (NRHO). Several critical questions must be answered to ensure mission success and crew safety and an assortment of analysis tools are being incorporated to address them. Two of these tools, LINCOV and MONTE, are currently providing program decision making results through HLS Insight, HLS NASA-collaborations, and Orion/Gateway cross-program analysis. To ensure consistency in the orbit determination performance, a comparison trade-study is performed using a low-lunar orbit to NRHO rendezvous scenario anticipated for the upcoming Artemis missions. An overview of the two analysis tools is provided along with a detailed step-by-step evaluation of the core capabilities and models related to the orbit determination process. This incremental comparison effort reveals both tools produce consistent solutions for the criteria investigated to within 0.3\% difference in the absolute position state estimate at key decision making epochs with all errors sources activated.

orbit determination↗
NASA NTRSDate not supplied

NASA DEVELOP’s Approach to Co-Production and Collaborative STEM Engagement

The NASA DEVELOP Program conducts 50-60 projects each year with the goal of bringing the benefits of NASA Earth science to local decision-making challenges. DEVELOP, part of NASA’s Applied Sciences’ Capacity Building Program, connects end users with students, recent graduates, and early and transitioning career professionals through 10-week rapid feasibility studies. These projects are a collaboration between NASA, DEVELOP office host locations (universities and other federal installations), project partners (federal agencies, state and local governments, non-profit and for-profit organizations, and international organizations), and the project teams who conduct them. The projects take place under the guidance of science advisors from NASA, academia, and partner organizations, and introduces communities to new applications of NASA Earth observations data with the desired outcome of informed decision-making. This presentation will highlight the DEVELOP model of co-production and programmatic collaboration, lessons learned in partnering, and evaluation activities that look at the impact of the program’s efforts.

Capacity Building↗
NASA NTRSDate not supplied

Integrating Earth Observations and Socioeconomic Data to Address Health, Equity, and Environmental Justice

Access to reliable data about the characteristics of populations is a crucial component of decision making, policy development, and the assessment of progress towards strategic goals. Social determinants of health provide insight into the status of social and economic conditions within populations that have profound effects on public health, equity, and vulnerability. International frameworks such as the Sustainable Development Goals (SDGs) fundamentally focus on equality, but to efficiently address targets and indicators, socioeconomic data and Earth observations must be integrated to help identify populations most vulnerable to the impacts of climate change, natural disasters, health disparities, and poor policy planning. The ability to identify vulnerable populations with data analysis has the potential to empower community stakeholders with spatial awareness needed to inform decision-making that addresses equity and environmental justice issues within their communities. The EPA defines environmental justice (EJ) as “the fair treatment and meaningful involvement of all people regardless of race, color, national origin, or income with respect to the development, implementation and enforcement of environmental laws, regulations and policies.” NASA’s Earth Science Division (ESD) recognizes the benefits that Earth observations with NASA satellites create by equipping individuals with the knowledge to address community challenges. NASA’s Socioeconomic Data and Applications Center (SEDAC) supports the integration of socioeconomic and Earth science data as an “informational gateway.” This integration of data is advancing health, equity, and environmental justice initiatives.

Natasha Johnson-Griffin↗
NASA NTRS2004

Autonomous In-Situ Resources Prospector

This presentation will describe the concept of an autonomous, intelligent, rover-based rapid surveying system to identify and map several key lunar resources to optimize their ISRU (In Situ Resource Utilization) extraction potential. Prior to an extraction phase for any target resource, ground-based surveys are needed to provide confirmation of remote observation, to quantify and map their 3-D distribution, and to locate optimal extraction sites (e.g. ore bodies) with precision to maximize their economic benefit. The system will search for and quantify optimal minerals for oxygen production feedstock, water ice, and high glass-content regolith that can be used for building materials. These are targeted because of their utility and because they are, or are likely to be, variable in quantity over spatial scales accessible to a rover (i.e., few km). Oxygen has benefits for life support systems and as an oxidizer for propellants. Water is a key resource for sustainable exploration, with utility for life support, propellants, and other industrial processes. High glass-content regolith has utility as a feedstock for building materials as it readily sinters upon heating into a cohesive matrix more readily than other regolith materials or crystalline basalts. Lunar glasses are also a potential feedstock for oxygen production, as many are rich in iron and titanium oxides that are optimal for oxygen extraction. To accomplish this task, a system of sensors and decision-making algorithms for an autonomous prospecting rover is described. One set of sensors will be located in the wheel tread of the robotic search vehicle providing contact sensor data on regolith composition. Another set of instruments will be housed on the platform of the rover, including VIS-NIR imagers and spectrometers, both for far-field context and near-field characterization of the regolith in the immediate vicinity of the rover. Also included in the sensor suite are a neutron spectrometer, ground-penetrating radar, and an instrumented cone penetrometer for subsurface assessment. Output from these sensors will be evaluated autonomously in real-time by decision-making software to evaluate if any of the targeted resources has been detected, and if so, to quantify their abundance. Algorithms for optimizing the mapping strategy based on target resource abundance and distribution are also included in the autonomous software. This approach emphasizes on-the-fly survey measurements to enable efficient and rapid prospecting of large areas, which will improve the economics of ISRU system approaches. The mature technology will enable autonomous rovers to create in-situ resource maps of lunar or other planetary surfaces, which will facilitate human and robotic exploration.

Dissly, R. W.↗
NASA NTRS2007

The Real Time Mission Monitor: A Situational Awareness Tool For Managing Experiment Assets

The NASA Real Time Mission Monitor (RTMM) is a situational awareness tool that integrates satellite, airborne and surface data sets; weather information; model and forecast outputs; and vehicle state data (e.g., aircraft navigation, satellite tracks and instrument field-of-views) for field experiment management RTMM optimizes science and logistic decision-making during field experiments by presenting timely data and graphics to the users to improve real time situational awareness of the experiment's assets. The RTMM is proven in the field as it supported program managers, scientists, and aircraft personnel during the NASA African Monsoon Multidisciplinary Analyses experiment during summer 2006 in Cape Verde, Africa. The integration and delivery of this information is made possible through data acquisition systems, network communication links and network server resources built and managed by collaborators at NASA Dryden Flight Research Center (DFRC) and Marshall Space Flight Center (MSFC). RTMM is evolving towards a more flexible and dynamic combination of sensor ingest, network computing, and decision-making activities through the use of a service oriented architecture based on community standards and protocols.

Blakeslee, Richard↗
NASA NTRS2011

Investigation of the Impact of User Gaming in the Next Generation National Airspace System

Over the past three decades, growth in the demand for air transportation has exceeded the growth in the national airspace system (NAS) capacity. Systems operating near capacity inevitably have delays and NAS d elays have increased in recent years. The desire to minimize delay costs has placed attention on the NAS air traffic management (ATM) syste m.One initiative that has helped to provide user representation in the ATM solution is the collaborative decision making (CDM) process. CDM addresses this issue by bringing users (referred to here as airline operation centers [AOCs]) and ATM providers together for information e xchange and cooperative planning. Such cooperative planning has been instituted, for instance, for the purpose of planning airport slot control strategies and rerouting strategies. While the CDM initiatives ha ve met with much success, they have also introduced the potential for AOCs to manipulate the system in unforeseen, unintended, and perhaps undesirable ways, from a system-wide, synoptic perspective. This type of manipulation is sometimes referred to as "gaming" the system. This study uses a high-fidelity simulation tool to investigate several models of user decision making behavior which could be considered to be gaming behavior and the emergent system dynamics and interactions between AOCs and traffic management.

Hunter, George C.↗
NASA NTRSDate not supplied

Enhancing In-Flight Structural Health Monitoring of Vertical Lift Vehicles Operating in an Urban Environment

In-situ airframe sensors have long been considered a potential solution for structural health monitoring that could change the design, certification, operation and maintenance paradigms of flight vehicles. In this approach, large networks of sensors covering the entire, or most of, an airframe throughout its operational lifetime would support real-time decisions on airworthiness and obviate the need to overbuild components or perform multiple cycles of structural qualification testing and inspections. This concept would go beyond the current practice of placing select sensors in strategic locations or relying on such sensors only during airframe qualification flights and inspections. For vehicles in the emerging urban air mobility space, reducing weight associated with overbuilds and shortening down-time associated with inspections are critical for improving safety and affordability. In practice, the wide-scale use of in-situ sensors as primary assurance for structural health has not been demonstrated to be feasible or the best solution. A sensor integration testbed was developed as a platform to evaluate the potential of multiple sensor types to enable decision making on airworthiness. We report on the initial runs of this testbed with multiple sensors attached to a common test article. Metal foil strain gauges, eddy current, fiber optic, guided wave (acoustic emission and ultrasonic)and carbon nanotube roving sensors were affixed to the test article. Baseline as well as post damage initiation and fatiguing data are presented and discussed. Despite the relative simplicity of the test article, the interpretation of the as-captured test data was generally not conclusive or did not have wide enough coverage. This result emphasizes the challenges and current limitations both in testing and the practical broad application of embedded sensors as the determinative elements in critical decision making on wide-scale structural health.

Vertical Lift Vehicles↗
NASA NTRSDate not supplied

Enhancing In-Flight Structural Health Monitoring of Vertical Lift Vehicles Operating in an Urban Environment

In-situ airframe sensors have long been considered a potential solution for structural health monitoring that could change the design, certification, operation, and maintenance paradigms of flight vehicles. In this approach, large networks of sensors covering the entire, or most of, an airframe throughout its operational lifetime would support real-time decisions on airworthiness and obviate the need to overbuild components or perform multiple cycles of structural qualification testing and inspections. This concept would go beyond the current practice of placing select sensors in strategic locations or relying on such sensors only during airframe qualification flights and inspections. For vehicles in the emerging urban air mobility space, reducing weight associated with overbuilds and shortening down-time associated with inspections are critical for improving safety and affordability. In practice, the wide-scale use of in-situ sensors as primary assurance for structural health has not been demonstrated to be feasible or the best solution. A sensor integration testbed was developed as a platform to evaluate the potential of multiple sensor types to enable decision making on airworthiness. We report on the initial runs of this testbed with multiple sensors attached to a common test article. Metal foil strain gauges, eddy current, fiber optic, guided wave (acoustic emission and ultrasonic) and carbon nanotube roving sensors were affixed to the test article. Baseline as well as post damage initiation and fatiguing data are presented and discussed. Despite the relative simplicity of the test article, the interpretation of the as-captured test data was generally not conclusive or did not have wide enough coverage. This result emphasizes the challenges and current limitations both in testing and the practical broad application of embedded sensors as the determinative elements in critical decision making on wide-scale structural health.

Vertical Lift Vehicles↗
NASA NTRSDate not supplied

Earth Independent Medical Operations (EIMO)

Inherent in interplanetary space travel are unprecedented challenges that could threaten mission success and negatively impact crew health and performance. Return to definitive care is essentially untenable and resources will be constrained with practically no re-supply capability. Access to ground-based medical expertise will be significantly delayed under nominal conditions with exacerbation during conjunction or prolonged dust storms. Taken together, these challenges necessitate the development of a progressively autonomous medical operational support system to assist the crew medical officer (CMO). While support from ground based medical experts will remain indispensable for pre-mission planning, the approach to management of acute/emergent medical contingencies will require a gradual transition of medical care and decision making from terrestrial to space-based assets, enabling support of astronaut health and performance and reducing overall mission risk. To progressively enable EIMO, a series of meetings were convened with subject matter experts from within NASA, academia and industry to facilitate mapping of the path to support autonomous medical operations. Topics explored in these meetings included the scope of data (storage capacity, usage, transmission rate and bandwidth, computing capacity), CMO training, supply and resource management and task load balance. Recommendations from these meetings will inform the EIMO Concept of Operations and definition of the associated requirements culminating in updates to the NASA 3001 standards. The EIMO project team will work with stakeholders to conceptualize a clinical decision support system (CDSS) to assist the CMO in response to medical contingencies when terrestrial support is delayed or otherwise unavailable. The CDSS will be a system of systems that will utilize data from numerous input vectors. Successful deployment of the CDSS will facilitate medical decision making while decreasing the cognitive load leading to an improvement in task load balancing. Additional benefits of the envisioned CDSS include assistance with inventory management, locating resources, storage/retrieval of medical records, highlighting trends in recorded data, in addition to providing a consult for diagnosis and treatment. More advanced features might include passive monitoring to identify early warning signs of behavioral or medical anomalies to possibly pre-empt onset of conditions that would compromise crew health and performance.

Benjamin Easter↗
NASA NTRS2022

Event Report for The Ethical Artificial Intelligence Quantification Workshop

Artificial Intelligence (AI) is a powerful emerging technology area which requires special attention to using it ethically. AI ethics is still an emerging field, and the partners for this workshop and report seek to move AI ethics discussion ahead by experimenting with ways to measure AI ethics criteria. The following document describes the outcomes and learnings from The Ethical Artificial Intelligence Quantification Workshop held at the National Institute for Aerospace (NIA), Hampton, Virginia on May 12th, 2022. The purpose of the workshop was for participants to evaluate and experiment-with the methodology and process presented by AIEthics.World in cooperation with Intel Corporation. The meeting participants learned about the Ethical AI Certification and Maturity Model™ and applied the methodology to selected notional AI systems. The workshop facilitated the evaluation of the maturity of the AI system according to ethical considerations relevant to NASA, NIA and other participants. The workshop consisted of three main phases. The first phase focused on understanding and summarizing NASA’s ethical approaches, mission and values based on published documentation, discussions and individual insights & opinions of participants. This information was prioritized, weighted, ordered, and quantified in phase two, to formulate an alignment between human values (ethics) and their applicability to AI systems during all lifecycle phases. The first two phases were summarized as a form of ethical genealogy for artificial intelligence, specific to NASA’s ethical approaches. In the third and last phase of the workshop the participants evaluated notional examples of artificial intelligence to qualify and quantify its ability to adhere to the organizational ethics approaches, using the Ethical AI Certification and Maturity Model™. The workshop uses the concept of genealogy, in the traditional sense: the study and traceability of lines of ancestors in the process of evolutionary development from earlier forms. However, as it is applied to an Ethical AI definition, it is providing the insights to the necessary and mandatory traceability of content, data, metrics, telemetry, elements, and structures which are used in the AI’s lifecycle to foster and measure AI ethics in all steps of its lifecycle. The Ethical Artificial Intelligence Quantification Workshop provided NASA with the opportunity to apply the Ethical AI Certification and Maturity Model™, in combination with existing and well-known decision-making and quality control methods to identify the metrics and measurements for an Ethical AI and assess its ethical condition and quality aligned with NASA ethics approaches. The result of the workshop is the capacity for NASA to apply the maturity model assessment to its AI Systems as desired and if necessary, publish the ability of these AI Systems to adhere to the organizational ethical goals. AI ethics frameworks need to be customized for each application domain, for example, individual NASA Mission Directorates. General principles that work in one area such as AI/Machine Learning-based text analysis (the ethics of information-extraction) may need to be adapted for another such as sense-and-avoid decision-making in a flight environment. The workshop was conducted among approximately twenty NASA subject matter experts, so the elements noted above should be considered examples, not definitive NASA ethical AI principles, genealogy, etc. Generating a definitive AI ethics framework for an organization as diverse as NASA would require far more discussion, debate, review, etc. However, the workshop provided valuable insight into mechanisms and processes for quantifying AI ethical qualities.

Artificial Intelligence↗