Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “machine learning, artificial intelligence”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14

ClimSim: A large multi-scale dataset for hybrid physics-ML climate emulation

Modern climate projections lack adequate spatial and temporal resolution due to computational constraints. A consequence is inaccurate and imprecise predictions of critical processes such as storms. Hybrid methods that combine physics with machine learning (ML) have introduced a new generation of higher fidelity climate simulators that can sidestep Moore’s Law by outsourcing compute-hungry, short, high-resolution simulations to ML emulators. However, this hybrid ML-physics simulation approach requires domain-specific treatment and has been inaccessible to MLexperts because of lack of training data and relevant, easy-to-use workflows. Wepresent ClimSim, the largest-ever dataset designed for hybrid ML-physics research. It comprises multi-scale climate simulations, developed by a consortium of climate scientists and ML researchers. It consists of 5.7 billion pairs of multivariate input and output vectors that isolate the influence of locally-nested, high-resolution, high-fidelity physics on a host climate simulator’s macro-scale physical state. The dataset is global in coverage, spans multiple years at high sampling frequency, and is designed such that resulting emulators are compatible with downstream coupling into operational climate simulators. We implement a range of deterministic and stochastic regression baselines to highlight the ML challenges and their scoring. The data (https://huggingface.co/datasets/LEAP/ClimSim_high-res2) and code(https://leap-stc.github.io/ClimSim)arereleasedopenlytosupport the development of hybrid ML-physics and high-fidelity climate simulations for the benefit of science and society.

artificial intelligence, machine learning↗

Report on Workshop on Artificial Intelligence in Strategic Planning and Science Prioritization

This report details the observations from a two-day virtual workshop, held May 12-13, 2020, focused on whether, and how, artificial intelligence (AI) could assist humans in strategic planning, specifically in science and technology prioritization. The participants identified several “key challenges” that AI might tackle in this area. To further understand the value of these key challenges the workshop then developed related test cases that would demonstrate specifically how AI/machine learning (ML) could provide assistance to humans. Approximately 40 subject matter experts (SMEs), with backgrounds in AI, strategic planning for science, and scientific data, were gathered for the conference. This report collates the details of the output of the workshop. The “best” test cases include (in no particular order):Use of AI to assist in selecting Decadal Survey priorities. * Use of AI to identify new, or previously unidentified, science topics for prioritization. * Using AI to better label and increase discoverability of scientific literature and proposals. * Use of AI to enhance current observation capabilities for scientific missions. * Using AI to mitigate biases in selection of proposal reviewers and membership of advisory committees. Examination of these test cases indicates that Natural Language Processing (NLP) is a common capability found in most of the ”best” (top-rated) test cases and is a valuable, multi-purpose tool which enables ML in this area.

strategic planning↗

Risk-informed Graded Approach for Reliability and Performance Assessment for Advanced Condition Monitoring Techniques

With the shift away from time-based maintenance and toward condition-based maintenance, and to reduce overall maintenance costs, there has been an upsurge in the usage and development of advanced condition monitoring (ACM) techniques for real-time monitoring of nuclear power plant (NPP) components. ACM is particularly useful in the development of digital twins, which are designed to predict the failure or degradation of plant components. Successful implementation of ACM requires an assessment to inform the development of a risk-informed approach to evaluate the use of ACM to meet Nuclear Regulatory Committee (NRC) regulations for in-service testing (IST) programs. This includes the monitoring and diagnostics of reactor components and systems in current, new, and advanced reactors. A key component in ACM is the usage of machine learning (ML) and artificial intelligence (AI) algorithms that can employ real-time data from instrumentation and sensors to detect and predict reactor component degradations. Such predictive capabilities enable early detection of component degradation so as to help plant personnel plan and execute necessary maintenance. For successful implementation of ML/AI in ACM such that regulatory requirements are met, a risk-informed graded approach is needed to assess the reliability and performance of ML/AI for ACM. The American Society for Mechanical Engineers (ASME) developed their Operations and Maintenance (O&M) Code to provide guidance on safe, reliable O&M of NPPs. The IST section of the O&M Code specifically establishes requirements for IST and examination to gauge operational readiness of components in water-cooled NPPs. This paper presents a state-of-the-art review of how reliability and risk assessment can be integrated with ACM to assess component performance by non-nuclear industries. This is followed by different methodologies and approaches for conducting performance and reliability assessments so as to meet IST requirements for NPP components.

99 - GENERAL AND MISCELLANEOUS↗

Analysis of an optical imaging system prototype for autonomously monitoring zooplankton in an aquaculture facility

Traditional approaches to biomonitoring in aquatic systems, such as sample collection, sorting, and identification, require significant time and effort, thereby limiting the spatiotemporal resolution of sample collection. Additionally, collection and preservation of samples for subsequent taxonomic identification and enumeration leads to mortality of organisms. Recent advances in technologies that utilize optical imaging and machine learning have provided new opportunities to expedite biomonitoring and lead to significant cost savings. These technologies can be advantageous to scientists or managers that conduct routine biomonitoring to inform operations, as in the case of aquaculture facilities. The Small Aquatic Organism optical imaging system (SAO) is a high-throughput optical imaging and classification prototype system that relies on computer vision and machine learning (Support Vector Machines, or SVMs) to autonomously identify and enumerate aquatic organisms. The SAO provides a more sustainable method of collecting large volumes of data and has the benefit of being used in situ. In this study, we tested the performance of the SAO in providing comparable results to manual zooplankton community monitoring in ten ponds at an aquaculture facility. We performed a side-by-side study comparing the sampling methods of plankton tow nets, where major zooplankton taxonomic classes were manually identified and enumerated, to sampling with the SAO. Vouchered samples were used to develop a training library for the SAO, where classes consisted of water boatman and zooplankton groups: cladocerans, copepod adults, copepod nauplii, and rotifers. SAO imagery was manually classified and compared with predicted results for validation. Accuracy for the SVM classifier of the SAO was 37.4 %. Convolutional Neural Networks (CNN) and Random Forest classifiers were also applied to SAO imagery and image features for comparison. The best CNN model and our Random Forest model had accuracies of 80.4 % and 46.6 % respectively. Challenges faced included the small size of copepod nauplii and rotifers and the limited resolution of the imaging camera, although there are tradeoffs between imaging resolution and the sample processing rate. Furthermore, our comparison shows that advancement in both optical imaging and ML are needed in order for the SAO prototype to yield comparable results to manual community monitoring in an aquaculture facility.

54 ENVIRONMENTAL SCIENCES↗

Self-adaptive weights based on balanced residual decay rate for physics-informed neural networks and deep operator networks

Physics-informed deep learning has emerged as a promising alternative for solving partial differential equations. However, for complex problems, training these networks can still be challenging, often resulting in unsatisfactory accuracy and efficiency. In this work, we demonstrate that the failure of plain physics-informed neural networks arises from the significant discrepancy in the convergence rate of residuals at different training points, where the slowest convergence rate dominates the overall solution convergence. Based on these observations, we propose a pointwise adaptive weighting method that balances the residual decay rate across different training points. The performance of our proposed adaptive weighting method is compared with current state-of-the-art adaptive weighting methods on benchmark problems for both physics-informed neural networks and physics-informed deep operator networks. In conclusion, through extensive numerical results we demonstrate that our proposed approach of balanced residual decay rates offers several advantages, including bounded weights, high prediction accuracy, fast convergence rate, low training uncertainty, low computational cost, and ease of hyperparameter tuning.

Balanced convergence rate↗

Machine-Learning-Based Mapping and Modeling of Solar Energy with Ultra-High Spatiotemporal Granularity

Despite the rapid growth of solar energy, we still lack a dynamic, high-fidelity database that tracks the spatiotemporal variations of solar PVs and their associated infrastructures across different places at a spatially resolved scale. The absence of such data presents a barrier to various applications such as solar PV growth projection, solar energy integration, solar incentive design, and climate risk assessment. In this project, we aim to bridge this gap by developing AI-based algorithms to extract granular information about solar PV installations and their associated infrastructures (i.e., distribution grids) from widely available unstructured data like remote sensing images and street views. As a result, we have built the Solar Energy Atlas, a fine-grained, large-scale geospatial overlay of distributed solar PVs and distribution grids. On top of it, we have advanced the understanding of solar adoption and distribution grid vulnerability to climate-induced extremes. Our major contributions can be summarized as follow: (1) By developing new AI algorithms, we have built the most comprehensive solar PV spatiotemporal database covering the entire US. This is the first time we obtained the exact GPS locations, size, subtype, and installation year information for rooftop solar PVs across the US. This database can be used for solar PV growth projection, solar energy integration, solar energy policy analysis and design, and spatially-resolved climate risk assessment. (2) Leveraging this database, we have uncovered the socioeconomic driving factors that are correlated with earlier onset of solar adoption and higher saturated adoption levels. We have identified the heterogeneity in the effects of different types of financial incentives on solar adoption and provided implications for tailoring incentive design based on local income levels to promote equitable solar adoption. (3) We have developed a distribution grid GIS mapping algorithm which can obtain granular geospatial and topology information about distribution grids using multi-modal open data, reducing the dependency on hard-to-obtain smart meter data of conventional approaches. It shows effectiveness in both the U.S. and Sub-Saharan Africa. Using this algorithm, we have uncovered the non-uniform vulnerability of distribution grids to wildfires in California in the aspects of undergrounding protection and Distributed Energy Resources (DER) preparedness. This has provided important implications for improving the affordability and equity of grid adaptation approaches. (3) We have made our produced database publicly available and provided user-friendly interface to enable various stakeholders and the general public to interact with the data. We have also integrated the produced data into the Data Commons platform to enable the public to access the data and correlate it with other location-specific characteristics simply using natural language as queries. The impact of our project is three-fold: (1) New algorithms for mapping solar PVs and distribution grids across space and time, which are open source to facilitate researchers and industry; (2) New databases of solar PVs and distribution grids that have been made publicly available for engineering, social, and policy applications; (3) New understandings and actionable insights on the potential approaches to promoting solar adoption and reducing energy infrastructure vulnerabilities. In this report, we start by discussing the project background and motivation (section 5), followed by the overview of project objectives (section 6). Results and discussion for each task are presented in section 7. Significant accomplishments are summarized in section 8. This report will be concluded by discussing the paths forwards (section 9), products (section 10), and team roles (section 11).

14 SOLAR ENERGY↗

Artificial Intelligence Medical Support for Long-Duration Space Missions

We envision an artificial intelligence (AI) based system that will provide support and recommendations to the crew medical officer (CMO) and ground flight surgeon during long-duration space missions. Such a system would be pretrained on the knowledgebase of clinical knowledge on Earth, minimizing the amount of Earth data that needs to be transferred into space. Then during deployment, the system would be constantly refined through active learning from diverse streams of data from sensors in the spacecraft, data collected daily from individual astronauts, and human-in-the-loop feedback from the crew. The model could be interrogated for predictions and recommendations on personalized crew health based on the overall status of the spacecraft, medicinal stores, and status of other crew members. Adaptation techniques would be used to incorporate spaceflight data that have very different distributions from the training data due to the extreme environment. Edge computing and the most advanced neuromorphic processing would enable computation in scenarios with low power and bandwidth, while dimensionality reduction would be employed to ensure that the input data streams from spaceflight are as small as possible. In order to realize this long-term vision, several hardware and software aspects need to be developed and assembled. First, models pretrained on Earth biomedical data would need to be evaluated for predictive accuracy, and the best one selected. That model would need to be adapted to learn from diverse, sparse, and inconsistently measured data streams, as well as human-in-the-loop feedback. A data integration, standardization, and dimensionality reduction methodology would need to be developed to handle all data types and feed them into the model. Once the software and data infrastructure is developed, it would need to be integrated with small footprint compute processors and tested in high-radiation, high-vibration, unregulated temperature situations. As a short-term goal, we recommend to focus on the development of the data and model software structure. Several large language models (LLM) already exist that have been trained on Earth biomedical and clinical knowledgebases, including BioMedLLM, Med-PaLM, SPOKE LLM, and Foresight. These models need to be evaluated for accuracy and the best one chosen for a proof-of-concept structure, while maintaining awareness of the accelerating AI field and incorporating any newly improved model architectures as needed. Then, we recommend to develop a database of synthetic data types to mimic the diverse data streams that are expected in a long-duration space mission. This should include environmental and microbial data from the spacecraft, non-invasive data from wearables and point-of-care devices employed by astronauts, and more invasive molecular and physiological monitoring of clinical and biomarker data from astronauts. The data standardization methodology should be developed, and these data streams used to refine the clinical LLM. Several scenarios should be developed that could plausibly come up in a long-duration space mission, and changes or aberrations introduced to the data at specific times to mimic these scenarios. Then, question and answer tasks should be designed to interrogate the model for predictions and recommendations, with acceptable answers already identified.

Artificial Intelligence↗

MindSynchro

This report presents the developments and results of MindSynchro project as part of DOE OE FOA 1861. DOE and Pacific Northwest National Laboratory (PNNL) have made available to FOA awardees datasets containing years of real historical data recorded from various phasor measurement units (PMUs) which are installed in three large US interconnections: Texas (IC A), Western (IC B), and Eastern (IC C). The main goal of the project, which was successfully achieved, was to develop methods for detection and identification of events which are relevant for power grid operation. Tasks performed for achieving the project goals included data exploration and pre-processing, the development and application of physics-based features, data analysis and labeling based on unsupervised learning approaches, training and testing of DSSL models for classification of events which are relevant for power grid operation, and deployment of solutions to cloud environments. The methods developed in the project can potentially provide relevant benefits to power grid asset owners/operators in general in terms of situational awareness. Two main types of outcomes can be provided by these tools: Identification of specific relevant power grid event types: Semi-supervised ML methods developed in the project can adequately employ not only the relatively scarce labeled data but also the large amount of available unlabeled data to train models for detection of specific event types. Such methods enable the application of trained models for the detection of events in a population of PMUs much larger than that associated to the labeled events. Support in data labeling / label validation: Labels are critical for training of models for identification of specific types of events. However, labeling large amounts of data is a manual and tedious process. This means that such process is error prone and is not scalable. Methods developed in the project, based on ensembles of clustering models, have been successfully employed for turning manual labeling into a scalable process. Accurate identification of specific relevant events can provide the operators with immediate situational awareness that could otherwise require hours or days of analysis from domain experts. We envision that such methods could be initially employed in support of post-mortem analysis of events and, as confidence is gained, they could be employed for online/real-time support, providing, among other benefits, insights for avoiding major events which could happen due to a combination of smaller ones. On the longer term, related methods could potentially be employed to improve protection and control.

24 POWER TRANSMISSION AND DISTRIBUTION↗

ReSpike: A Co-Design Framework for Evaluating SNNs on ReRAM-Based Neuromorphic Processors

With Moore’s law approaching its end, traditional von Neumann architectures are struggling to keep up with the exceeding performance and memory requirements of artificial intelligence and machine learning algorithms. Unconventional computing approaches such as neuromorphic computing that leverage spiking neural networks (SNNs) to perform computation are gaining traction and seek the paradigm shift necessary to sustain the increasing demands of modern applications. Novel memory technologies, such as resistive RAM (ReRAM), employ a crossbar architecture that possesses the inherent capability of efficiently computing vector-matrix multiplication—a dominant operation in SNNs. The prospect of naturally mapping SNNs to the crossbar structures provides a unique opportunity for achieving a high-performance, power-efficient neuromorphic system. In this work, we present ReSpike, which is a new framework, behavioral simulator, and architectural design based on ReRAM crossbar architectures, enabling modeling and co-design to achieve efficient execution of SNNs. We drive this co-design forward by quantifying the impact that ReRAM cell nonidealities have on the corresponding accuracy of an SNN application.

Asifuzzaman, Kazi [ORNL] (ORCID:0000000240044791)↗

Envisioning U.S. Climate Predictions and Projections to Meet New Challenges

In the face of a changing climate, the understanding, predictions, and projections of natural and human systems are increasingly crucial to prepare and cope with extremes and cascading hazards, determine unexpected feedbacks and potential tipping points, inform long-term adaptation strategies, and guide mitigation approaches. Increasingly complex socio-economic systems require enhanced predictive information to support advanced practices. Such new predictive challenges drive the need to fully capitalize on ambitious scientific and technological opportunities. These include the unrealized potential for very high-resolution modeling of global-to-local Earth system processes across timescales, reduction of model biases, enhanced integration of human systems and the Earth Systems, better quantification of predictability and uncertainties; expedited science-to-service pathways, and co-production of actionable information with stakeholders. Enabling technological opportunities include exascale computing, advanced data storage, novel observations and powerful data analytics, including artificial intelligence and machine learning. Looking to generate community discussions on how to accelerate progress on U.S. climate predictions and projections, representatives of Federally-funded U.S. modeling groups outline here perspectives on a six-pillar national approach grounded in climate science that builds on the strengths of the U.S. modeling community and agency goals. This calls for an unprecedented level of coordination to capitalize on transformative opportunities, augmenting and complementing current modeling center capabilities and plans to support agency missions. Tangible outcomes include projections with horizontal spatial resolutions finer than 10 km, representing extremes and associated risks in greater detail, reduced model errors, better predictability estimates, and more customized projections to support next generation climate services.

54 ENVIRONMENTAL SCIENCES↗

pnnl/HypoGen

An innovative workflow for automatic knowledge discovery in material science, combining experimental automation with advanced machine learning and artificial intelligence techniques

Yin, Tim [Pacific Northwest National Laboratory (P↗

Analytics-at-scale of Sensor Data for Digital Monitoring in Nuclear Plants: 2nd Annual Report

For economic reasons, the nuclear industry is witnessing premature closure of nuclear power plants, despite excellent safety records. Operations and Maintenance (O&M) activities are some of the largest costs in operating legacy light-water plants. By reducing O&M costs, nuclear energy can become more economically competitive with other energy sources. This can be achieved by leveraging machine-learning and artificial intelligence technologies to develop data-driven algorithms to better diagnose potential faults within the system. Improved accuracy of the models can lead to a reduction in unnecessary maintenance, thus reducing costs associated with parts, labor, and unnecessary planned, forced, or extended outages. To address these challenges, the goal of this project is to perform research and development in the area of digital monitoring, i.e., the application of advanced sensor technologies (particularly wireless sensor technologies) and data science based analytic capabilities, to advance online monitoring and predictive maintenance in nuclear plants and improve plant performance (efficiency gain and economic competitiveness). This report summarizes the fiscal year 2020 research progress encompassing (1) different wireless vibration sensor and data indicators used to assess the health of a plant asset; (2) development of diagnostic models for fault detection; and (3) development of prognostic models for estimating the health of the system up to 7 days ahead.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Brain Connectivity Workshop Series Report

The National Institutes of Health (NIH) BRAIN Initiative aims to accelerate development and application of technologies that show how individual brain cells in complex neural circuits interact at the speed of thought and action. Complete wiring diagrams of the mammalian brain will revolutionize the capabilities of researchers to formulate and test models of how activity within brain circuits drives coordinated function and behavior. A top priority for the BRAIN Initiative, motivated by the strategic guidance of the BRAIN 2.0 Working Group report, is to muster the resources and foster the collaborations needed to generate these wiring diagrams at the level of long-range projections (“projectomes”) and synapses (“connectomes”) in whole mammalian brains, including those from rodents, humans, and other large-brained mammals. Achieving the scale and resolution necessary to characterize and use these projectomes and connectomes will not only push the boundaries of current imaging and computational capabilities to generate faster, cheaper, and more scalable technologies, but also drive broad innovation in data science, artificial intelligence, and machine learning.

42 ENGINEERING↗

Unified Language Frontend for Physic-Informed AI/ML

Artificial intelligence and machine learning (AI/ML) are becoming important tools for scientific modeling and simulation as in several other fields such as image analysis and natural language processing. ML techniques can leverage the computing power available in modern systems and reduce the human effort needed to configure experiments, interpret and visualize results, draw conclusions from huge quantities of raw data, and build surrogates for physics based models. Domain scientists in fields like fluid dynamics, microelectronics and chemistry can automate many of their most difficult and repetitive tasks or improve the design times by use of the faster ML-surrogates. However, modern ML and traditional scientific highperformance computing (HPC) tend to use completely different software ecosystems. While ML frameworks like PyTorch and TensorFlow provide Python APIs, most HPC applications and libraries are written in C++. Direct interoperability between the two languages is possible but is tedious and error-prone. In this work, we show that a compiler-based approach can bridge the gap between ML frameworks and scientific software with less developer effort and better efficiency. We use the MLIR (multi-level intermediate representation) ecosystem to compile a pre-trained convolutional neural network (CNN) in PyTorch to freestanding C++ source code in the Kokkos programming model. Kokkos is a programming model widely used in HPC to write portable, shared-memory parallel code that can natively target a variety of CPU and GPU architectures. Our compiler-generated source code can be directly integrated into any Kokkosbased application with no dependencies on Python or cross-language interfaces.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Full-scale Demonstration of Multi-process Sensor at a Cycling PC-fired Boiler

The main objective of this research program is to design, manufacture, and demonstrate a miniaturized, multi-process, monitoring system (mMPMS) for boiler condition management and easy system deployment to obtain a higher spatial resolution. This system will facilitate a Condition-Based Maintenance (CBM) philosophy that actively monitors the health of assets to predict and prevent failures and maximize availability and generating capacity at a reduced cost. CBM systems can provide boiler data that the advanced process control (APC) system can utilize for plant performance optimization, which is increasingly relevant as coal power plants shift from predominantly base-load operation to predominantly transient operation involving large load swings. The mMPMS is based on an electrochemical sensor that provides a real-time indication of the risk of damage to key locations in the radiant or convective section of a coal-fired boiler such as metal loss rates, heat flux, metal surface temperature, and deposit thickness. These indications can be utilized to optimize boiler performance as well as improve boiler availability in conjunction with corresponding operating conditions. This monitoring system was developed and tested in the high-temperature regions of coal-fired utility boilers in this project but can be applied to many other industries and applications as well. This project leveraged the existing electrochemical noise-based monitoring system and the new sensor design is small enough to be installed through the webbing of the waterwalls without the need for long shut-downs to bend tubes and to make it feasible to obtain high spatial resolution in the boiler. Data is transferred to the plant distributed control system (DCS) and any other control system. The sensor body that houses the sensor assembly was designed to ensure good conductive contact with boiler tubes to ensure the sensor is held at an identical temperature to the tube surface temperature. The data acquisition and signal conditioning modules were redesigned into a small footprint with optimized cooling of the module. System software was developed specifically for the new signal conditioning module and is compatible with plant PLCs. After the preliminary testing at a pilot-scale facility, the three mMPMS were installed at a full-scale pulverized coal-fired plant, PacifiCorp’s Hunter 3. The systems were demonstrated over 20,000 hours at the plant during regular operation. Also, the sensor data was fed to the plant’s advanced process control system to evaluate the corrosion control by the operation changes and utilized to understand the impacts of load cycling with different ramping up and down speeds. At the end of the project, the systems were converted to the permanent installation at the power plant to be used with the advanced process control system installed at the plant.

Advanced Sensors, Corrosion, Ash Deposition, Optim↗

Celebrating 10 Years of the Sub-Seasonal to Seasonal Prediction Project and Looking to the Future

The conference clearly demonstrated the increasing interest and growth of the scientific community working on the development and application of sub-seasonal to seasonal prediction since the start of the World Weather Research Programme (WWRP)/World Climate Research Programme (WCRP) sub-seasonal to seasonal (S2S) prediction project in 2013. The conference, which was held at the University of Reading (United Kingdom), was organized into three main themes as briefly summarized below, with eleven invited talks, 74 oral contributed talks, and 101 posters. The conference also included a two-hour breakout session, wherein eight groups discussed the current state and prospect for S2S prediction, and an early career researcher event. A summary of these discussions and recommendations is presented below. The conference web page (https://research.reading.ac.uk/s2s-summit2023/) is archived at the University of Reading. Introductory comments by representatives of the World Meteorological Organization (WMO) WWRP and WCRP emphasized the importance of the weather–climate linkage, targeted by S2S forecasts (from 2 weeks to a season ahead), addressing the challenges of creating “end-to-end” forecasts that encompass the entire climate-services chain from the prediction science and forecast, to the development and issuing of forecast products tailored to informing user-decisions. They also emphasized the efficacy of multi-model ensemble efforts and databases to foster collaborations internationally and between operational centres and academia. Although the WWRP/WCRP S2S project comes to an end in 2023, S2S prediction will remain an important focus for WWRP and WCRP. In WWRP, a new project called SAGE (Sub-seasonal to seasonal predictions for Agriculture and Environment) will start in 2024. Another important legacy of the S2S project will be the maintenance of the S2S database (Vitart et al. 2017) and the establishment of a WMO Lead Center for sub-seasonal prediction multi-model ensemble (LC-SSPMME) which will provide real-time multi-model S2S climate information. In two keynote presentations, Prof. Brian Hoskins (University of Reading) and Dr. Gilbert Brunet (Australian Bureau of Meteorology) discussed the potential of S2S predictability and the ongoing journey for understanding and improving these predictions. This conference was a sequel to the International Conference on Sub-seasonal to Seasonal Prediction (Robertson et al., 2014) which took place in College Park (Maryland, USA) in February 2014 to celebrate the start of the WWRP/WCRP S2S project, and to WCRP and WWRP conferences in Boulder, USA, in 2018 (Merryfield et al., 2020). A significant development compared to the previous S2S conferences was the large number of presentations on research to operation (R2O) and S2S applications and on the use of artificial intelligence and machine learning (AI/ML) methods for S2S prediction. Some of these methods provide empirical S2S forecasts which are competitive with state-of-the-art dynamical models. Other presentations demonstrated that AI/ML can provide alternative calibration of dynamical model outputs to traditional methods. Several talks and posters highlighted the increasing use of AI/ML, including deep learning, in S2S forecast post-processing and using AI to identify higher flow-dependent skill. Finally, some presentations demonstrated the value of AI/ML methods for a better understanding of S2S sources of predictability and attribution of extreme events.

S. J. Woolnough↗

Requirement Discovery Using Embedded Knowledge Graph With ChatGPT

The field of Advanced Air Mobility (AAM) is witnessing a transformation with innovations such as electric aircraft and increasingly automated airspace operations. Within AAM, the Urban Air Mobility (UAM) con-cept focuses on providing air-taxi services in densely populated urban areas. This research introduces the utilization of Large Language Models (LLMs), such as OpenAI's GPT-4, to enhance the UAM Requirement discovery process. This study explores two distinct approaches to leverage LLMs in the context of UAM Requirement discovery. The first approach evaluates the LLM's ability to provide responses without relying on additional outside systems, such as a relational or graph database. Instead, a vector store provides relevant information to the LLM based on the user’s question, a process known as Retrieval Augmented Generation (RAG). The second approach integrates the LLM with a graph database. The LLM acts as an intermediary between the user and the graph database, translating user questions into cypher queries for the database and database responses into human-readable answers for the user. Our team implemented and tested both solutions to analyze require-ments within a UAM dataset. This paper will talk about our approaches, implementations, and findings related to both approaches.

systems engineering↗

Towards an Aviation Large Language Model by Fine-tuning and Evaluating Transformers

In the aviation domain, there are many applications for machine learning and artificial intelligence tools that utilize natural language. For example, there is a desire to know the commonalities in written safety reports such as voluntary post incidents reports or create more accurate transcripts of air traffic management conversations. Another use-case is the possibility of extracting airspace procedures and constraints currently written in documents such as Letters of Agreement (LOA) which is used as the evaluation case in this paper. These applications can benefit from the use of state-of-the-art Natural Language Processing (NLP) techniques when adapted to the language/phraseology specific to the aviation domain. This paper evaluates the viability of transferring pre-trained large language models to the aviation domain by adapting transformer based models using aviation datasets. This paper utilized two datasets to adapt a ‘Robustly Optimized Bidirectional Encoder Representations from Transformers Approach’ (RoBERTa) model and two down-stream classification tasks to assess its performance. These datasets are all built upon Letters of Agreement which are Federal Aviation Administration (FAA) documents that formalize airspace operations across the national airspace system. The first two datasets are used for the adaptation of RoBERTa to the aviation domain and were of different sizes to assess the number of documents needed to adapt to the aviation domain. They contain many examples of ‘aviation English’ using domain specific terminology and phrasing which serves as a representative basis to perform the unsupervised adaptation. The second dataset is a separate set of LOA documents with two sets of classification labels to be used for evaluation; one at the document level and one at the line level. These down-stream evaluations allowed the measurement of improvement by adapting RoBERTa. The accuracy increased by 4-6% on both tasks and the F1 score on the class of interest increased by 4-8% from the adaptation.

Air Traffic Management↗