SEARCH · Engineering Papers

Results for “ask an expert”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

All sources NASA NTRS DOE OSTI

DOE OSTI2024

Demonstration and Evaluation of Explainable and Trustworthy Predictive Technology for Condition-based Maintenance

The domestic nuclear power plant (NPP) fleet has historically relied on labor-intensive and time-consuming predictive maintenance (PdM) programs, thus driving up operation and maintenance (O&M) costs to achieve high-capacity factors. Artificial intelligence (AI) and machine-learning (ML) can help simplify complex problems such as diagnosing equipment degradation to enable more effective decision-making efforts. The benefits of AI will be felt through more efficient plant O&M, improved work processes, and better integration of people and technology. Together, these benefits hold the promise to make nuclear power more sustainable by reducing O&M costs while improving employee engagement. While AI and ML technologies hold significant promise for the nuclear industry, there are challenges or barriers to their adoption. Explainability and trustworthiness of AI are two salient challenges that need to be addressed for wider deployment of these technologies in NPPs. This research focuses specifically on addressing the explainability and trustworthiness of AI technologies to advance the human, technical, and organization (HTO) readiness levels in adopting a risk-informed PdM strategy at commercial NPPs. In addition, this approach can be adapted to enhance the acceptability of AI in other nuclear applications with a few application-specific modifications. The technical approach ensuring wider adoption of AI technologies was developed by Idaho National Laboratory (INL)—in collaboration with Public Service Enterprise Group (PSEG), Nuclear, LLC—by utilizing the circulating water system (CWS) at two PSEG-owned plant sites for demonstration. Focused user studies were performed in collaboration with subject matter experts (SMEs) from PSEG and other nuclear domains to enhance human and organization readiness by building trust in AI-informed technologies. VIsualization for PrEdictive maintenance Recommendation (VIPER)—a Battelle Energy Alliance, LLC, copyrighted software—was developed and expanded to provide a user-centric visualization by incorporating inputs from the collaborating utility, human factors engineering guidelines, and data analysts. The VIPER software enables users, who may be unfamiliar with ML in general, to be interactively engaged by asking technical questions about PdM, work orders, diagnosis results and their confidence levels, the kind of data being used, and the types of ML algorithms employed. This interactive engagement enhances explainability and builds trust. One of the enabling accomplishments was the integration of large language models (LLMs), both text-based and vision-based, in the VIPER software.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2026

Leveraging ARM Data to Improve Models for Predictive Understanding of Energy and Security Challenges

Extreme weather and natural hazards can disrupt the energy sector, affecting demand, generation, transmission, distribution, consumption and operational planning at regional and national scales. These disruptions stem from a broad range of atmospheric phenomena, including winter storms, freezing rain, wet snow loading, severe convection, flooding and landslides, wildfires, prolonged heat, and drought. Many of these same phenomena can also affect national security through impacts to transportation and infrastructure. To support the U.S. Department of Energy (DOE) focus on energy resilience and national security, the Atmospheric Radiation Measurement (ARM) User Facility is uniquely positioned to contribute measurement data, analyses, and modeling frameworks that can significantly improve predictive understanding of these hazards to mitigate their effects. To explore this opportunity, ARM convened a two-part virtual workshop in November 2025. The workshop engaged interdisciplinary experts in atmospheric science, energy systems, modeling, and operations. The goal of the meeting was to engage with these interdisciplinary experts to address three questions: • What are examples of atmospheric processes that represent significant risks to energy security or national security and where are those risks greatest? • What measurements or measurement strategies would improve ARM’s capacity to address these issues? • How can ARM and users of the ARM facility better work with the Energy Exascale Earth System Model (E3SM) and multi-sector modeling communities to apply ARM data to improving E3SM simulations of these phenomena? Participants were asked to submit white papers ahead of the meeting to initiate thinking on these themes and to help organize discussions. Workshop sessions were then organized around themes identified in the white papers. First from the white papers and then through subsequent discussions, workshop participants identified many examples that address the three questions listed above. Participants called out energy system vulnerabilities to weather phenomena such as the impact of freezing rain, strong winds, and excessive heat on power grids. They also noted the effects that weather phenomena could have on energy demand or supply (e.g., through effects of extreme temperatures). They called out security vulnerabilities such as impacts to crops from aerosol-borne pathogens and risks to industry due to melting permafrost in the Arctic. In all, over a dozen meteorological phenomena were linked to energy or security vulnerabilities. For many of the identified phenomena, participants pointed out where ARM was well poised to address issues (e.g., through measurements of cloud microphysics to inform studies of freezing rain) but also noted needs for additional measurements or modified measurement strategies. For example, adaptive scanning of severe weather would be valuable for probing winter storms or severe convection. Participants pointed out the value in integrating external observations with ARM measurements and with applying artificial intelligence (AI) to ARM observation analysis and they advocated for using model simulations to help optimize measurement strategies through Observing System Simulation Experiments (OSSEs). It was clear from the workshop that there are many ways that ARM observations can be used to mitigate energy and security concerns, but meeting participants were also asked to identify what they considered to be the greatest opportunities by ranking issues pertaining to the three workshop questions. This was accomplished through a survey administered to participants between the two virtual sessions. The highest-priority phenomena identified were winter storms, severe convection, and arctic processes. Discussion in the second session, therefore, focused primarily on these three areas, which were most fully developed in exploring ARM opportunities. Nevertheless, it was also clear that ARM has opportunities to contribute to all the identified topics. This report describes the workshop, including input from discussion and white papers (Sections 2 and 3) and a list of priority recommendations (section 4). Many other ideas for ARM contributions are discussed in individual white papers (Appendix D).

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

DOE OSTI2021

High Energy Physics Network Requirements Review (Final Report, July-October 2020)

Throughout 2020, ESnet and the Office of High Energy Physics (HEP) of the DOE SC organized an ESnet requirements review of HEP-supported activities. Preparation for this event included identification of key stakeholders: program and facility management, research groups, technology providers, and a number of external observers. These individuals were asked to prepare formal case study documents about their relationship to the HEP program to build a complete understanding of the current, near-term, and long-term status, expectations, and processes that will support the science going forward. A series of pre-planning meetings better prepared case study authors for this task, along with guidance on how the review would proceed in a virtual fashion.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

DOE OSTI2025

Extraction and Analysis of Time Series Data from Building Automation Systems Using Large Language Models

Semantic schemas like Haystack 4, Brick and ASHRAE standard 223 enable the structured, standardized, and machine-readable representation of building data, facilitating interoperability, data integration, and advanced analytics. However, extracting information from these models requires specialized expertise in SPARQL and other programming languages, skills that are not commonly found among building professionals. Recent advancements in Large Language Models (LLMs), such as ChatGPT, enable the construction of queries using natural language, making it easier for individuals to interact with these systems in a manner that resembles everyday speech. However, these methods have not yet been tested on building semantic ontologies. This paper introduces a novel workflow and tool for enabling users to ask questions about a specific building's data, using natural language and receive answers automatically generated by GPT-4o. Our approach integrates semantic ontologies with advanced LLM capabilities to automate three critical steps: (1) generating SPARQL queries to retrieve time series references from ontological models, (2) extracting the corresponding time series data from the Building Automation System, and (3) performing computations and visualizations tailored to the user's query. The proposed method simplifies access to BAS data, allowing both domain experts and non-specialists to conduct sophisticated analyses without needing extensive technical knowledge of semantic web technologies. By demonstrating this pipeline, we facilitate more accessible and scalable data-driven decision-making in building operations and management.

Mulayim, Ozan Baris↗

DOE OSTI2025

Extraction and Analysis of Time Series Data from Building Automation Systems Using Large Language Models

Mulayim, Ozan Baris↗

NASA NTRS2016

Summary Report for the Technical Interchange Meeting on Development of Baseline Material Properties and Design Guidelines for In-Space Manufacturing Activities

NASA Marshall Space Flight Center (MSFC) and the Agency as a whole are currently engaged in a number of in-space manufacturing (ISM) activities that have the potential to reduce launch costs, enhance crew safety, and provide the capabilities needed to undertake long-duration spaceflight. The recent 3D Printing in Zero-G experiment conducted on board the International Space Station (ISS) demonstrated that parts of acrylonitrile butadiene styrene (ABS) plastic can be manufactured in microgravity using fused deposition modeling (FDM). This project represents the beginning of the development of a capability that is critical to future NASA missions. Current and future ISM activities will require the development of baseline material properties to facilitate design, analysis, and certification of materials manufactured using in-space techniques. The purpose of this technical interchange meeting (TIM) was to bring together MSFC practitioners and experts in materials characterization and development of baseline material properties for emerging technologies to advise the ISM team as we progress toward the development of material design values, standards, and acceptance criteria for materials manufactured in space. The overall objective of the TIM was to leverage MSFC's shared experiences and collective knowledge in advanced manufacturing and materials development to construct a path forward for the establishment of baseline material properties, standards development, and certification activities related to ISM. Participants were asked to help identify research and development activities that will (1) accelerate acceptance and adoption of ISM techniques among the aerospace design community; (2) benefit future NASA programs, commercial technology developments, and national needs; and (3) provide opportunities and avenues for further collaboration.

Prater, T. J.↗

DOE OSTI2026

Asi Nuclear Energy Sensors Data Portal Chatbot And Data Structuring Tool

The Idaho National Laboratory (INL) is advancing the development of an AI-powered chatbot and data structuring tool specifically designed to accelerate data mining processes for sensor-related information and seamlessly integrate the results into the ASI Sensors Data Portal (https://nes.energy.gov/). By doing so, the software aims to enhance the accessibility, usability, and organization of sensor data for nuclear energy applications. The software initial phase focuses on retrieving comprehensive datasets, prioritizing the past five years of publicly available information from the Office of Scientific and Technical Information (OSTI). These datasets will be meticulously processed to ensure compatibility, employing cleaning and preprocessing steps to eliminate irrelevant, incomplete, or corrupted information, thus establishing a robust foundation for subsequent AI use. The data will serve as the backbone for training an AI model and chatbot, which will act as an interactive tool enabling users to ask complex, context-specific questions and receive accurate, validated answers derived from constrained literature. In parallel, the project incorporates a data structuring process supported by AI to organize sensor information from multiple sources into a standardized format. This structured data will include detailed sensor specifications, such as measurement range, applications, accuracy, and operating conditions, generated and documented with AI. These specifications will be systematically integrated into the sensor portal. To maintain the highest levels of accuracy and relevance, all AI-generated outputs will be reviewed and validated by subject matter experts (SMEs), with additional fields or parameters added as needed. Future stages of the project aim to expand the dataset beyond OSTI to include other sources and potentially incorporate unclassified controlled information (UCI) with restricted access protocols to address security and confidentiality requirements.

Mapes, NormanJ. [Idaho National Laboratory (INL), ↗

NASA NTRSDate not supplied

U.S. Spacesuit Knowledge Capture – Creation, Curation, and Dissemination

The U.S. spacesuit is a special system that has intrigued and fascinated the world since Neil Armstrong set foot on the Moon in 1969. With over 50 years since that momentous achievement, NASA is planning to land the first woman and next man on the Moon in the near future. This goal begets the need to build a new spacesuit, a spacesuit created from the legacy knowledge of the Extravehicular Mobility Unit (EMU), combined with knowledge gained from technology development over the decades. As NASA transitions to its new horizon, the U.S. Spacesuit Knowledge Capture (SKC) Program is poised to help. The SKC Program’s primary function has been to capture, curate, and disseminate spacesuit-related knowledge among scientists, engineers, and technicians. The SKC Program was created in 2007 to capture knowledge primarily from spacesuit subject-matter experts (SMEs) who were retiring from NASA. These SMEs had 30 to 50 years of spacesuit knowledge. Over the years, the SKC Program has evolved and expanded its scope with a current focus on complementing the buildup of the Exploration EMU (xEMU) at the Johnson Space Center. As part of this focus, the SKC Program recently teamed with the xEMU Community of Practice (CoP) for knowledge sharing. The xEMU CoP provides a forum where early career engineers, professionals new to human spaceflight, and the xEMU community can come together regularly to seek guidance, share knowledge, meet their peers, discover resources, and ask questions. The CoP created an environment where the knowledge can be easily and routinely captured and recorded. The recorded events are archived and curated in an SKC Program library and disseminated as appropriate. This paper details the roles that the SKC Program and CoP play in the xEMU buildup, along with the navigation of the creation, curation, and dissemination processes.

Cinda Chullen↗

NASA NTRS1991

An autonomous fault detection, isolation, and recovery system for a 20-kHz electric power distribution test bed

Future space explorations will require long term human presence in space. Space environments that provide working and living quarters for manned missions are becoming increasingly larger and more sophisticated. Monitor and control of the space environment subsystems by expert system software, which emulate human reasoning processes, could maintain the health of the subsystems and help reduce the human workload. The autonomous power expert (APEX) system was developed to emulate a human expert's reasoning processes used to diagnose fault conditions in the domain of space power distribution. APEX is a fault detection, isolation, and recovery (FDIR) system, capable of autonomous monitoring and control of the power distribution system. APEX consists of a knowledge base, a data base, an inference engine, and various support and interface software. APEX provides the user with an easy-to-use interactive interface. When a fault is detected, APEX will inform the user of the detection. The user can direct APEX to isolate the probable cause of the fault. Once a fault has been isolated, the user can ask APEX to justify its fault isolation and to recommend actions to correct the fault. APEX implementation and capabilities are discussed.

Quinn, Todd M.↗

DOE OSTI2020

RadResponder Nationwide Drill 2020: FRMAC participation After Action Report

On February 11th, 2020 FRMAC participated in the 2020 RadResponder nationwide drill involving survey data review and approval. During this drill, dozens of organizations from across the country participated in uploading simulated survey results to their own RadResponder event and reviewing those data given some "best-practice" guidelines. FRMAC participated in this drill to learn how this process is carried out in RadResponder and to determine some areas of improvement that will make FRMACs use of RadResponder more effective and efficient. As drill participants, the four FRMAC staff each set up their own RadResponder events so they could work independently to work through each step. Each were given an import file with 60 survey measurements to import and review. At the end of the drill a hotwash was held where users were able to ask questions and receive feedback from Chainbridge and FRMAC participants. In summary, several areas for improvement have been identified and will be categorized as items that need immediate attention (Bugs), areas for improvement in the near-term (change requests), and ideas on how the overall process can be improved (feature requests). The items presented in this report by no means reflect all the required changes FRMAC Monitoring and Sampling and Assessment will need to carry out their procedures in RadResponder but do represent a step in the right direction. A full review and exercise of the FRMAC process will need to be conducted with more subject matter experts to discover all the required features FRMAC needs to carry out their mission.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2021

International collaboration framework for the calculation of performance loss rates: Data quality, benchmarks, and trends (towards a uniform methodology)

Abstract The IEA PVPS Task 13 group, experts who focus on photovoltaic performance, operation, and reliability from several leading R&D centers, universities, and industrial companies, is developing a framework for the calculation of performance loss rates of a large number of commercial and research photovoltaic (PV) power plants and their related weather data coming across various climatic zones. The general steps to calculate the performance loss rate are (i) input data cleaning and grading; (ii) data filtering; (iii) performance metric selection, corrections, and aggregation; and finally, (iv) application of a statistical modeling method to determine the performance loss rate value. In this study, several high‐quality power and irradiance datasets have been shared, and the participants of the study were asked to calculate the performance loss rate of each individual system using their preferred methodologies. The data are used for benchmarking activities and to define capabilities and uncertainties of all the various methods. The combination of data filtering, metrics (performance ratio or power based), and statistical modeling methods are benchmarked in terms of (i) their deviation from the average value and (ii) their uncertainty, standard error, and confidence intervals. It was observed that careful data filtering is an essential foundation for reliable performance loss rate calculations. Furthermore, the selection of the calculation steps filter/metric/statistical method is highly dependent on one another, and the steps should not be assessed individually.

14 SOLAR ENERGY↗

DOE OSTI2022

Comparing Legacy Waste Management to Advanced Reactor Waste Management

The Nuclear Energy Agency (NEA) and Natural Resources Canada (NRCan) are organizing an international workshop on the implementation of radioactive waste management and decommissioning strategies in small modular reactors (SMRs) and advance reactor technologies. The event will take place in Ottawa, Canada on 7-10 November 2022. The workshop will convene participants from various fields of expertise in the areas of radioactive waste management, decommissioning, nuclear science and development, transportation, as well as young professionals, communication experts and researchers. The goal of the workshop is to devise a guideline document that will serve implementers in understanding key issues in decommissioning and waste management of new reactors from the design perspective, aiding in the licensing process and in future decommissioning and waste management activities. DOE has invested considerably in the innovation of advanced reactors. Interaction in this workshop allows INL and DOE to articulate the importance of looking at the back-end of the fuel cycle for advanced reactors. The back-end of the fuel cycle is important to the success of advanced reactors, and DOE may need to manage this material in the future after it is discharged from reactors. I have been asked to present at the track titled "Operational and Design Optimization Consideration Related to Decommissioning and Radioactive Waste Management for SMRs/Advanced Reactors".

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

NASA NTRS1997

Alternative Perspectives on Risk: Individual Differences in Problem Structuring

Team decision making involves contributions of multiple players toward a common goal. While much has been written about the importance of developing shared mental models in order for teams to work together effectively, little has been done to determine the value of alternative perspectives on problem solving and decision making. Early studies of expertise contrasted experts with novices and noted that the two groups differ in the way they structure problems and in their selection of information as salient. Little attention has been given to differences among experts who differ in their specializations. A series of experiments was conducted to determine: (1) what dimensions of flight-related problem situations pilots judge to be most important when making flight-relevant decisions; and (2) whether pilots in different crew positions differ in the way they interpret problems relating to flight decisions. A sorting task was used to identify underlying dimensions judged as salient to individual pilots. Captains, first officers, and flight engineers from two major carriers participated in the study. Twenty-two flight scenarios were developed based on ASRS reports. Pilots were required to make judgments about how they would respond in each case and to sort the scenarios on the basis of similarity of decision factors. They were also asked to provide a verbal label that described each of their sorted categories. A second study required a different group of pilots (also captains, first officers and flight engineers) to sort on predetermined bases.

Orasanu, Judith↗

NASA NTRS1991

Composites: A viable option

While it sounded great to be asked to talk about composites, I found it difficult to select subject areas that would be of real interest. My choice is based on saying some things about where the maturity of the composite aircraft structures is today and what that means in terms of future criteria for application. This focus was the basis for my title selection. The other issue that will be addressed was requested by NASA and focuses on composites structures cost. This fits well with the state-of-the-art interpretations I will discuss first, since the cost issue must be viewed from both the current status and future points of view. The difficulty in presenting something in these areas is not in the subjects themselves but in trying to present a real world viewpoint to an audience of composite experts. So, with recognition of the expertise of the audience, I hope you will see something in this presentation about how to view composite aircraft structure.

Mccarty, John E.↗

NASA NTRS2004

To Boldly Go: America's Next Era in Space. The Universe Now and Beyond

Dr. France Cordova, NASA's Chief Scientist opened this, the third session in the NASA Administrator's Seminar Series, by asking the following question: 'What would be a bold and aspiring agenda for America's next era in space?' It aimed at answering the following questions: What do we know about the universe? How do we know it? (Dr. Cordova also mentioned that the first seminar was about the definition of cellular life and how to recognize it, and featured as speakers, Dr. Lynn Margoles and Dr. Leslie Orgle.) Administrator Daniel S. Goldin was introduced; he welcomed the attendees, and remarked that NASA personnel have a critical need to explain to Congress and the public why a space program is important. Congress and the public pay for the space programs. Therefore the programs' importance cannot remain in the sole domain of scientists. The first speaker, Dr. Vera Ruben of the Department of Terrestrial Magnetism at the Carnegie Institute of Washington, was introduced as an art historian expert in cosmology and an observational astronomer. Dr. Ruben brought up a number of questions regarding the substance, location, and origin of dark matter, radiation, galaxies, and the lumpy structure of galaxies in space, as well as the age and density of our universe. The next speaker was Dr. Bohdan Paczynski, a theoretical astrophysicist from Princeton University's Department of Astrophysical Sciences. The final speaker, Dr. Linda Schale is a cosmologist from the University of Texas at Austin. She was said to be a 'paleontologist of the human mind' who tries 'to understand mechanisms people use to understand the world'. The concluding discussion centered on why NASA scientists don t communicate better with people who are not highly educated. This is a big concern because to continue its work, NASA needs to communicate the importance of its goals to the average person. Additional information is included in the original extended abstract.

Source record↗

NASA NTRS2000

The Spacecraft Materials Selector: An Artificial Intelligence System for Preliminary Design Trade Studies, Materials Assessments, and Estimates of Environments Present

Institutions need ways to retain valuable information even as experienced individuals leave an organization. Modern electronic systems have enough capacity to retain large quantities of information that can mitigate the loss of experience. Performance information for long-term space applications is relatively scarce and specific information (typically held by a few individuals within a single project) is often rather narrowly distributed. Spacecraft operate under severe conditions and the consequences of hardware and/or system failures, in terms of cost, loss of information, and time required to replace the loss, are extreme. These risk factors place a premium on appropriate choice of materials and components for space applications. An expert system is a very cost-effective method for sharing valuable and scarce information about spacecraft performance. Boeing has an artificial intelligence software package, called the Boeing Expert System Tool (BEST), to construct and operate knowledge bases to selectively recall and distribute information about specific subjects. A specific knowledge base to evaluate the on-orbit performance of selected materials on spacecraft has been developed under contract to the NASA SEE program. The performance capabilities of the Spacecraft Materials Selector (SMS) knowledge base are described. The knowledge base is a backward-chaining, rule-based system. The user answers a sequence of questions, and the expert system provides estimates of optical and mechanical performance of selected materials under specific environmental conditions. The initial operating capability of the system will include data for Kapton, silverized Teflon, selected paints, silicone-based materials, and certain metals. For situations where a mission profile (launch date, orbital parameters, mission duration, spacecraft orientation) is not precisely defined, the knowledge base still attempts to provide qualitative observations about materials performance and likely exposures. Prior to the NASA contract, a knowledge base, the Spacecraft Environments Assistant (SEA,) was initially developed by Boeing to estimate the environmental factors important for a specific spacecraft mission profile. The NASA SEE program has funded specific enhancements to the capability of this knowledge base. The SEA qualitatively identifies over 25 environmental factors that may influence the performance of a spacecraft during its operational lifetime. For cases where sufficiently detailed answers are provided to questions asked by the knowledge base, atomic oxygen fluence levels, proton and/or electron fluence and dose levels, and solar exposure hours are calculated. The SMS knowledge base incorporates the previously developed SEA knowledge base. A case history for previous flight experiment will be shown as an example, and capabilities and limitations of the system will be discussed.

Pippin, H. G.↗

NASA NTRS2011

Climate Change Impacts and Responses: Societal Indicators for the National Climate Assessment

The Climate Change Impacts and Responses: Societal Indicators for the National Climate Assessment workshop, sponsored by the National Aeronautics and Space Administration (NASA) for the National Climate Assessment (NCA), was held on April 28-29, 2011 at The Madison Hotel in Washington, DC. A group of 56 experts (see list in Appendix B) convened to share their experiences. Participants brought to bear a wide range of disciplinary expertise in the social and natural sciences, sector experience, and knowledge about developing and implementing indicators for a range of purposes. Participants included representatives from federal and state government, non-governmental organizations, tribes, universities, and communities. The purpose of the workshop was to assist the NCA in developing a strategic framework for climate-related physical, ecological, and socioeconomic indicators that can be easily communicated with the U.S. population and that will support monitoring, assessment, prediction, evaluation, and decision-making. The NCA indicators are envisioned as a relatively small number of policy-relevant integrated indicators designed to provide a consistent, objective, and transparent overview of major variations in climate impacts, vulnerabilities, adaptation, and mitigation activities across sectors, regions, and timeframes. The workshop participants were asked to provide input on a number of topics, including: (1) categories of societal indicators for the NCA; (2) alternative approaches to constructing indicators and the better approaches for NCA to consider; (3) specific requirements and criteria for implementing the indicators; and (4) sources of data for and creators of such indicators. Socioeconomic indicators could include demographic, cultural, behavioral, economic, public health, and policy components relevant to impacts, vulnerabilities, and adaptation to climate change as well as both proactive and reactive responses to climate change. Participants provided inputs through in-depth discussion in breakout sessions, plenary sessions on break-out results, and several panels that provided key insights about indicators, lessons learned through experience with developing and implementing indicators, and thoughts on how the NCA could proceed to develop indicators for the NCA.

Kenney, Melissa A.↗

NASA NTRS2018

NASA Pilot-Engaged Expert Response Using IBM Watson Technology: Prototype Evaluation of Knowledge Retrieval System

NASA Langley Research Center and IBM have been investigating the use of IBM Watson technology in aerospace research and development. One application of Watson technology is the Pilot-Engaged Expert Response (PEER) use case. The PEER system is envisioned as an in-cockpit advisor that will act as a source of situationally-relevant information for pilots and other flight crew members to assist in decision making about real-time events and situations that arise in the course of aircraft operations. PEER will make available vast stores of knowledge and information quickly and directly, putting important informational resources where they are needed most. IBM has worked with NASA to develop an architecture and articulate a roadmap for the development of the PEER system. That vision is built around Watson Discovery Advisor (WDA) software solution, derived from IBM's Jeopardy!-winning automatic question answering system. PEER makes use of WDA's sophisticated question-answering capabilities as its core, adding important User Interface components and other customizations for the cockpit environment, including communication with flight systems and other external data sources. The development plan for PEER includes four development stages, with the current project constituting the first phase. In this project, a prototype instance of PEER was successfully adapted to the aviation domain, enabling users to ask questions about aviation topics and receive useful and accurate answers to these questions. Major tasks accomplished include the development of procedures for domain adaptation through automatic lexicon extraction from domain glossaries; generation of question-answer training data which was used to train the system; and assessment of the effectiveness of domain adaptation, which showed a dramatic improvement in the ability of the PEER system to answer domain-relevant questions. In addition, the vision for the PEER system was pushed forward by the articulation of a plan for the automatic enhancement of question-answering with contextual information. This initial phase focused on two main goals: 1) the targeted domain adaptation of the underlying WDA system to the aviation domain; and, 2) the design of the software systems needed to leverage flight-contextual data. Domain adaptation of the WDA system proceeds via three main activities: Domain data ingestion, lexical customization and model training. A textual corpus consisting of 1,147 individual documents with more than 7.5 million words of text was ingested into the system and this served as the basis of all further development. A domain lexicon of over 3,500 aviation-domain terms was semi-automatically generated from domain documents and used to train the system. In addition, a set of over 500 question-answer (QA) pairs relevant to the PEER use case was developed; these were used to train and assess the system. These important first steps established the basis for the PEER system. In addition, steps were taken towards the integration of the PEER system into the cockpit environment with the development of a functional design for the Contextual Data Augmentation (CDA) subsystem. This subsystem brings to bear contextual data to improve system responses. It has three main submodules: the Contextual Data Collection module, the Contextual Data Selection module, and the Contextual QA Augmentation module. These modules form a processing pipeline that addresses the problems associated with automatically integrating information from external resources into the knowledge-retrieval mechanism.

Machine learning↗