Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Domain knowledge”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,063 records · Page 59
All sourcesNASA NTRSDOE OSTI
NASA NTRS1991

Robust fault diagnosis of physical systems in operation

Ideas are presented and demonstrated for improved robustness in diagnostic problem solving of complex physical systems in operation, or operative diagnosis. The first idea is that graceful degradation can be viewed as reasoning at higher levels of abstraction whenever the more detailed levels proved to be incomplete or inadequate. A form of abstraction is defined that applies this view to the problem of diagnosis. In this form of abstraction, named status abstraction, two levels are defined. The lower level of abstraction corresponds to the level of detail at which most current knowledge-based diagnosis systems reason. At the higher level, a graph representation is presented that describes the real-world physical system. An incremental, constructive approach to manipulating this graph representation is demonstrated that supports certain characteristics of operative diagnosis. The suitability of this constructive approach is shown for diagnosing fault propagation behavior over time, and for sometimes diagnosing systems with feedback. A way is shown to represent different semantics in the same type of graph representation to characterize different types of fault propagation behavior. An approach is demonstrated that threats these different behaviors as different fault classes, and the approach moves to other classes when previous classes fail to generate suitable hypotheses. These ideas are implemented in a computer program named Draphys (Diagnostic Reasoning About Physical Systems) and demonstrated for the domain of inflight aircraft subsystems, specifically a propulsion system (containing two turbofan systems and a fuel system) and hydraulic subsystem.

Abbott, Kathy Hamilton↗
DOE OSTI2021

Catalysts by pyrolysis: Direct observation of chemical and morphological transformations leading to transition metal-nitrogen-carbon materials

Transition metal-nitrogen-carbon materials (M-N-C catalysts) are promising electrocatalysts in polymer electrolyte fuel cells (PEFCs) and electrolyzer applications. High temperature treatment in inert atmosphere (pyrolysis) is the essential, most common method for the synthesis of M-N-C catalysts and critical to achieve high electrocatalytic activity and electronic conductivity. To this day, despite many uses and successful implementations in materials manufacturing, pyrolysis has been an entirely empirical technology, with process control and optimization relying exclusively on “Edisonian” approach. The knowledge gap in the mechanism about how the precursor is being transformed into catalysts hinders further development of the M-N-C catalysts regardless of the precursor class and processing protocols. In this work, we probed the morphological evolution and chemical transformation of a nitrogen-containing charge transfer organic salt, mixed with transition metal (iron) salt and amorphous silica powder (precursor) during the pyrolysis process via a combination of in situ synchrotron and laboratory-based diagnostic techniques. The pyrolysis process is found to be divided into three stages. During a controlled temperature ramp, the selected organic N-C precursor (nicarbazin) began melting and decomposing just below 400 °C, forming a certain number of micrometer-scale pores and pathways. With increase in temperature from 400 °C to 900 °C, amorphous carbon domains started forming, and reduced (metallic) iron nanoclusters appeared, being dispersed uniformly throughout the carbonaceous matrix. When temperature advanced above 900 °C, graphitization of carbon commenced, associated with appearance and evolution of atomically dispersed metal-nitrogen moieties in the carbonaceous matrix. As the graphitization advanced further, a secondary process of agglomeration of metal nanoparticles occurred. Multi-analytical technique observations conducted here provide a base for rational design and optimization of M-N-C electrocatalysts via pyrolysis.

36 MATERIALS SCIENCE↗
NASA NTRS2011

The Challenge of Configuring Model-Based Space Mission Planners

Mission planning is central to space mission operations, and has benefited from advances in model-based planning software. Constraints arise from many sources, including simulators and engineering specification documents, and ensuring that constraints are correctly represented in the planner is a challenge. As mission constraints evolve, planning domain modelers need help with modeling constraints efficiently using the available source data, catching errors quickly, and correcting the model. This paper describes the current state of the practice in designing model-based mission planning tools, the challenges facing model developers, and a proposed Interactive Model Development Environment (IMDE) to configure mission planning systems. We describe current and future technology developments that can be integrated into an IMDE.

model-based systems↗
DOE OSTI2023

An expectation–maximization framework for comprehensive prediction of isoform-specific functions

Advances in RNA sequencing technologies have achieved an unprecedented accuracy in the quantification of mRNA isoforms, but our knowledge of isoform-specific functions has lagged behind. There is a need to understand the functional consequences of differential splicing, which could be supported by the generation of accurate and comprehensive isoform-specific gene ontology annotations. We present isoform interpretation, a method that uses expectation–maximization to infer isoform-specific functions based on the relationship between sequence and functional isoform similarity. We predicted isoform-specific functional annotations for 85 617 isoforms of 17 900 protein-coding human genes spanning a range of 17 430 distinct gene ontology terms. Comparison with a gold-standard corpus of manually annotated human isoform functions showed that isoform interpretation significantly outperforms state-of-the-art competing methods. We provide experimental evidence that functionally related isoforms predicted by isoform interpretation show a higher degree of domain sharing and expression correlation than functionally related genes. We also show that isoform sequence similarity correlates better with inferred isoform function than with gene-level function.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

PagMYB128 regulates secondary cell wall formation by direct activation of cell wall biosynthetic genes during wood formation in poplar

The biosynthesis of cellulose, lignin, and hemicelluloses in plant secondary cell walls (SCWs) is regulated by a hierarchical transcriptional regulatory network. Here, this network features orthologous transcription factors shared between poplar and Arabidopsis, highlighting a foundational similarity in their genetic regulation. However, knowledge on the discrepant behavior of the transcriptional-level molecular regulatory mechanisms between poplar and Arabidopsis remains limited. In this study, we investigated the function of PagMYB128 during wood formation and found it had broader impacts on SCW formation compared to its Arabidopsis ortholog, AtMYB103. Transgenic poplar trees overexpressing PagMYB128 exhibited significantly enhanced xylem development, with fiber cells and vessels displaying thicker walls, and an increase in the levels of cellulose, lignin, and hemicelluloses in the wood. In contrast, plants with dominant repression of PagMYB128 demonstrated the opposite phenotypes. RNA sequencing and reverse transcription – quantitative polymerase chain reaction showed that PagMYB128 could activate SCW biosynthetic gene expression, and chromatin immunoprecipitation along with yeast one-hybrid, and effector–reporter assays showed this regulation was direct. Further analysis revealed that PagSND1 (SECONDARY WALL-ASSOCIATED NAC-DOMAIN PROTEIN1) directly regulates PagMYB128 but not cell wall metabolic genes, highlighting the pivotal role of PagMYB128 in the SND1-driven regulatory network for wood development, thereby creating a feedforward loop in SCW biosynthesis.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

Genomes to ecosystem function: Targeting critical knowledge gaps in methanogenesis and translation to updated global biogeochemical models

Natural freshwater temperate wetland systems currently represent the largest natural source of atmospheric methane, but are relatively understudied using systems biology tools (e.g. meta-omics) compared to other high producing methane systems (e.g. peat, tropical, or reconstructed wetlands). Using field investigations at the NOAA operated sentinel site on Lake Erie, methane producing activities and responses to geochemical conditions will be determined along seasonal and spatial gradients (Objective 1). Here, a combination of high-throughput activity and gas measurements, combined with high-resolution systems biology and analytical methods, will provide in depth knowledge of the microbiological, chemical, and physical constraints on methane production in wetlands. Using laboratory microcosms, the formation of anoxic microsites and their capacity to facilitate methane production in wetland soils will be simulated (Objective 2). This objective will validate the findings from the field investigations, offering a more controlled environment for teasing out the role of different yet interrelated variables. Lastly, these field and laboratory data will be used for multi-scale, process-level evaluation of an ecosystem biogeochemical model that accommodates these newly identified processes and parameterizes representation of these processes along relevant environmental gradients (Objective 3).This research will identify multiple interacting geochemical, ecological, and metabolic constraints that are poorly understood, oversimplified, or missing in global biogeochemical methane models. This proposal targets the role of oxygen limitation on methane processes in soil domains, to improve reactive transport models of microbial carbon cycling across terrestrial-aquatic soils and generate data on nutrient cycling activities in Great Lake wetlands. This information could provide new insights into the microbial controllers of Lake Erie eutrophication.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

Beyond Pristine Metal–Organic Frameworks: Preparation of Hollow MOFs and Their Composites for Catalysis, Sensing, and Adsorption Removal Applications

Metal–organic frameworks (MOFs) have been broadly applied to numerous domains with a substantial surface area, tunable pore size, and multiple unsaturated metal sites. Recently, hollow MOFs have greatly attracted the scientific community due to their internal cavities and gradient pore structures. Hollow MOFs have a higher tunability, faster mass-transfer rates, and more accessible active sites when compared to traditional, solid MOFs. Hollow MOFs are also considered to be candidates for some functional material carriers. For example, composite materials such as hollow MOFs and metal nanoparticles, metal oxides, and enzymes have been prepared. These composite materials integrate the characteristics of hollow MOFs with functional materials and are broadly used in many aspects. This review describes the preparation strategies of hollow MOFs and their composites as well as their applications in organic catalysis, electrochemical sensing, and adsorption separation. Finally, we hope that this review provides meaningful knowledge about hollow-MOF composites and their derivatives and offers many valuable references to develop hollow-MOF-based applied materials.

36 MATERIALS SCIENCE↗
NASA NTRS1981

Computing aerodynamic sound using advanced statistical turbulence theories

It is noted that the calculation of turbulence-generated aerodynamic sound requires knowledge of the spatial and temporal variation of Q sub ij (xi sub k, tau), the two-point, two-time turbulent velocity correlations. A technique is presented to obtain an approximate form of these correlations based on closure of the Reynolds stress equations by modeling of higher order terms. The governing equations for Q sub ij are first developed for a general flow. The case of homogeneous, stationary turbulence in a unidirectional constant shear mean flow is then assumed. The required closure form for Q sub ij is selected which is capable of qualitatively reproducing experimentally observed behavior. This form contains separation time dependent scale factors as parameters and depends explicitly on spatial separation. The approximate forms of Q sub ij are used in the differential equations and integral moments are taken over the spatial domain. The velocity correlations are used in the Lighthill theory of aerodynamic sound by assuming normal joint probability.

Hecht, A. M.↗
DOE OSTI2022

Easy axis anisotropy creating high contrast magnetic zones on magnetic tunnel junctions based molecular spintronics devices (MTJMSD)

Abstract Magnetic tunnel junction-based molecular spintronics device (MTJMSD) may enable novel magnetic metamaterials by chemically bonding magnetic molecules and ferromagnets (FM) with a vast range of magnetic anisotropy. MTJMSD have experimentally shown intriguing microscopic phenomenon such as the development of highly contrasting magnetic phases on a ferromagnetic electrode at room temperature. This paper focuses on Monte Carlo Simulations (MCS) on MTJMSD to understand the potential mechanism and explore fundamental knowledge about the impact of magnetic anisotropy. The selection of MCS is based on our prior study showing the potential of MCS in explaining experimental results (Tyagi et al. in Nanotechnology 26:305602, 2015). In this paper, MCS is carried out on the 3D Heisenberg model of cross-junction-shaped MTJMSDs. Our research represents the experimentally studied cross-junction-shaped MTJMSD where paramagnetic molecules are covalently bonded between two FM electrodes along the exposed side edges of the magnetic tunnel junction (MTJ). We have studied atomistic MTJMSDs properties by simulating a wide range of easy-axis anisotropy for the case of experimentally observed predominant molecule-induced strong antiferromagnetic coupling. Our study focused on understanding the effect of anisotropy of the FM electrodes on the overall MTJMSDs at various temperatures. This study shows that the multiple domains of opposite spins start to appear on an FM electrode as the easy-axis anisotropy increases. Interestingly, MCS results resembled the experimentally observed highly contrasted magnetic zones on the ferromagnetic electrodes of MTJMSD. The magnetic phases with starkly different spins were observed around the molecular junction on the FM electrode with high anisotropy.

36 MATERIALS SCIENCE↗
DOE OSTI2023

On the role of methyl groups in the molecular architectures of mesophase pitches

The role of methyl groups on the liquid–crystal structure of mesophase pitches was investigated by combining experimental characterizations and atomic-scale computational modeling, using three pitches synthesized from different precursors. Of the three pitches, C-9 alkyl benzene and naphthalene-based pitches have 13 and 7 methyl groups per average polyaromatic hydrocarbon, respectively. By contrast, mesophase produced from a coal-tar pitch has about one methyl group. The coal tar–based mesophase pitch is hydrogen deficient or more aromatic compared with C-9 alkyl benzene- and naphthalene-based pitches. Additionally, X-ray diffraction data showed that average coherent domain sizes of C-9 alkyl benzene (3.7 nm) and naphthalene-based (3.6 nm) pitches with more methyl groups are larger than that of coal tar–based mesophase (2.4 nm). Based on the identified features, the influence of the methyl group on the layering structures was investigated via molecular dynamics simulations. The results revealed that methyl groups are critical in mesophase layering in C-9 alkyl benzene- and naphthalene-based pitches, by reducing CH-π interaction. However, similar alignment could be achieved without the same degree of methyl substitutions for the coal tar-based pitch because of stronger π-π interaction than the other precursors. The insights from this study contribute to our understanding of the formation of conventional mesophase pitch and have implications for the processing of coal-derived materials. In conclusion, this knowledge is vital to produce valuable products like carbon fiber and graphite from pitches.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

Exploration of Domain Aware Machine Learning for Grid Analytics: Transfer-Learnt Energy Models to Assist Buildings Control with Sparse Field Data

Buildings are a primary consumer of energy in the United States and are also increasingly being perceived as providers of grid services such as load shifting, shedding and modulation. High fidelity models of building energy consumption are needed to set appropriate baselines for measurement and verification (M&V) of controllers designed for energy efficient operation of buildings and to enable buildings to provide grid services via. participation in demand response programs. State-of-the-art building energy modeling techniques either rely on Physics based models, or extensive instrumentation of the building envelope to gather “big” data to train machine learning based models such as deep neural networks. While Physics based models are often limited by their accuracy, it is not always feasible to gather a significant amount of field data required to train machine learning based models with sufficient accuracy. In this paper, we explore the use of transfer learning-based strategies to address unsatisfactory accuracy of models for estimating building energy consumption when available field data for training is sparse or of unacceptable quality. In particular, we transfer knowledge in the form of data and parameters, from Physics based simulation frameworks to the field to improve the model accuracy, thus resulting in a Physics-informed Machine Learning framework. We evaluated the efficacy of our approach on field data collected from six commercial buildings and our results indicate that the proposed transfer learning based models provide comparative (and in some cases better) accuracy than state-of-the-art machine learning and deep learning solutions, with just one month of field data.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
NASA NTRS2004

SemanticOrganizer: A Customizable Semantic Repository for Distributed NASA Project Teams

SemanticOrganizer is a collaborative knowledge management system designed to support distributed NASA projects, including diverse teams of scientists, engineers, and accident investigators. The system provides a customizable, semantically structured information repository that stores work products relevant to multiple projects of differing types. SemanticOrganizer is one of the earliest and largest semantic web applications deployed at NASA to date, and has been used in diverse contexts ranging from the investigation of Space Shuttle Columbia's accident to the search for life on other planets. Although the underlying repository employs a single unified ontology, access control and ontology customization mechanisms make the repository contents appear different for each project team. This paper describes SemanticOrganizer, its customization facilities, and a sampling of its applications. The paper also summarizes some key lessons learned from building and fielding a successful semantic web application across a wide-ranging set of domains with diverse users.

Keller, Richard M.↗
DOE OSTI2021

MindSynchro

This report presents the developments and results of MindSynchro project as part of DOE OE FOA 1861. DOE and Pacific Northwest National Laboratory (PNNL) have made available to FOA awardees datasets containing years of real historical data recorded from various phasor measurement units (PMUs) which are installed in three large US interconnections: Texas (IC A), Western (IC B), and Eastern (IC C). The main goal of the project, which was successfully achieved, was to develop methods for detection and identification of events which are relevant for power grid operation. Tasks performed for achieving the project goals included data exploration and pre-processing, the development and application of physics-based features, data analysis and labeling based on unsupervised learning approaches, training and testing of DSSL models for classification of events which are relevant for power grid operation, and deployment of solutions to cloud environments. The methods developed in the project can potentially provide relevant benefits to power grid asset owners/operators in general in terms of situational awareness. Two main types of outcomes can be provided by these tools: Identification of specific relevant power grid event types: Semi-supervised ML methods developed in the project can adequately employ not only the relatively scarce labeled data but also the large amount of available unlabeled data to train models for detection of specific event types. Such methods enable the application of trained models for the detection of events in a population of PMUs much larger than that associated to the labeled events. Support in data labeling / label validation: Labels are critical for training of models for identification of specific types of events. However, labeling large amounts of data is a manual and tedious process. This means that such process is error prone and is not scalable. Methods developed in the project, based on ensembles of clustering models, have been successfully employed for turning manual labeling into a scalable process. Accurate identification of specific relevant events can provide the operators with immediate situational awareness that could otherwise require hours or days of analysis from domain experts. We envision that such methods could be initially employed in support of post-mortem analysis of events and, as confidence is gained, they could be employed for online/real-time support, providing, among other benefits, insights for avoiding major events which could happen due to a combination of smaller ones. On the longer term, related methods could potentially be employed to improve protection and control.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

Mondo: integrating disease terminology across communities

Precision medicine aims to enhance diagnosis, treatment, and prognosis by integrating multimodal data at the point of care. However, challenges arise due to the vast number of diseases, differing methods of classification, and conflicting terminological coding systems and practices used to represent molecular definitions of disease. This lack of interoperability artificially constrains the potential for diagnosis, clinical decision support, care outcome analysis, as well as data linkage across research domains to support the development or repurposing of therapeutics. There is a clear and pressing need for a unified system for managing disease entities⁠—including identifiers, synonyms, and definitions. To address these issues, we created the Mondo disease ontology—a community-driven, open-source, unified disease classification system that harmonizes diverse terminologies into a consistent, computable framework. Mondo integrates key medical and biomedical terminologies, including Online Mendelian Inheritance in Man (OMIM), Orphanet, Medical Subject Headings (MeSH), National Cancer Institute Thesaurus (NCIt), and more, to provide a comprehensive and accurate representation of disease concepts with fully provenanced and attributed links back to the sources. Mondo can be used as the handle for curation of gene–disease associations utilized in diagnostic applications, research applications such as computational phenotyping, and in clinical coding systems in clinical decision support by pointing the clinician to the numerous knowledge resources linked to the Mondo identifier. Mondo's community-centric approach, stewarded by the Monarch Initiative's expertise in ontologies, ensures that the ontology remains adaptable to the evolving needs of biomedical research and clinical communities, as well as the knowledge providers.

biomedical informatics↗
NASA NTRS2012

A Regional CO2 Observing System Simulation Experiment Using ASCENDS Observations and WRF-STILT Footprints

Knowledge of the spatiotemporal variations in emissions and uptake of CO2 is hampered by sparse measurements. The recent advent of satellite measurements of CO2 concentrations is increasing the density of measurements, and the future mission ASCENDS (Active Sensing of CO2 Emissions over Nights, Days and Seasons) will provide even greater coverage and precision. Lagrangian atmospheric transport models run backward in time can quantify surface influences ("footprints") of diverse measurement platforms and are particularly well suited for inverse estimation of regional surface CO2 fluxes at high resolution based on satellite observations. We utilize the STILT Lagrangian particle dispersion model, driven by WRF meteorological fields at 40-km resolution, in a Bayesian synthesis inversion approach to quantify the ability of ASCENDS column CO2 observations to constrain fluxes at high resolution. This study focuses on land-based biospheric fluxes, whose uncertainties are especially large, in a domain encompassing North America. We present results based on realistic input fields for 2007. Pseudo-observation random errors are estimated from backscatter and optical depth measured by the CALIPSO satellite. We estimate a priori flux uncertainties based on output from the CASA-GFED (v.3) biosphere model and make simple assumptions about spatial and temporal error correlations. WRF-STILT footprints are convolved with candidate vertical weighting functions for ASCENDS. We find that at a horizontal flux resolution of 1 degree x 1 degree, ASCENDS observations are potentially able to reduce average weekly flux uncertainties by 0-8% in July, and 0-0.5% in January (assuming an error of 0.5 ppm at the Railroad Valley reference site). Aggregated to coarser resolutions, e.g. 5 degrees x 5 degrees, the uncertainty reductions are larger and more similar to those estimated in previous satellite data observing system simulation experiments.

Wang, James S.↗
NASA NTRSDate not supplied

NASA’s Safety, Reliability, and Mission Assurance Digital Future

The evolution from “document-centric” to “data-centric” and “model-centric” information leveraging structured data and model-based approaches is at the heart of digital engineering transformational efforts underway across industry and government. It is these approaches that pave the way for data lakes, Authoritative Sources of Truth (ASOTs), and systems- of-systems interoperability and the corresponding transformational benefits thereof. Such benefits include increased data availability, data access equity, data traceability, real-time analytics, batch analytics, and (most importantly) acceleration of the time-to-value and time-to-insights associated with engineering products and analyses. The longer-term benefits of reusability, customization and traceability are even more promising. For Safety and Mission Assurance (SMA), and Mission Success (SMS) activities; realization of such benefits is essential to provide engineers and analysts alike vital information when needed to support critical decision making throughout the entire life cycle. The SMA community often operate in parallel with engineering activities, for which information exchange with relevant context is paramount. Far too often, such information lags key decision points and/or is absent of the robust, integrated, knowledge needed, given inherent barriers associated with traditional document-centric means to data sharing, analysis, and reporting. This paper provides an overview of how NASA’s Office of Safety and Mission Assurance (OSMA) is evolving its policies, standards, guidance, and training to transform to eliminate such barriers, thus realizing the benefits emerging in this new digital era. A roadmap for achieving this digital future is presented along with key building blocks involving use and implementation of concepts such as: Objectives-Hierarchies, Objective-Driven Requirements, Accepted Standards, Safety and Assurance Cases, data digitization (i.e., ontologies, structured data, and model-centric data), FAIR (Findable, Accessible, Interoperable, & Reusable) and/or FAIRUST (Findable, Accessible, Interoperable, Reusable, Understandable, Secure, and Trusted) principles [1]. This paper also describes how OSMA, leveraging the Agency’s overall commitment to Digital Transformation (DT), is using the power of Policy, “Digital” Domain representation, Product Evolution, and Community Outreach and Engagement as part of a strategic vision and roadmap to evolve and transform its SMA organizations to become better able to serve its stakeholders and customers. Future publications will elaborate on these building blocks and deeper concepts.

Authoritative Source of Truth (ASOT),↗
DOE OSTI2021

Fluid dynamic simulation and analysis of water-cooling systems for the Electron-Ion Collider

The Electron-Ion Collider is the newest large-scale project at Brookhaven National Laboratory. The collider’s purpose is to provide further advancements in the knowledge of the universe’s origin by accelerating particles near the speed of light. Our project for this 3.8 km ring was to create a thermal hydraulic steady-state simulation design of the water-cooling system to be cost-effective and energy efficient, as envisioned by Charlie Foltz, the EIC Infrastructure Division Director. The system would include a supply and return header, which cools several thousand components of the ring. The water would then be returned and cooled down using a system of cooling towers and plate and frame heat exchangers. Due to the size of the system and the complexity of the network analysis, a fluid dynamic simulation software, AFT Fathom, was used. Since previous methods of maintaining systems relied on building upon smaller real-life models and implementing empirical data, this flow model was unique and first of a kind in the domain of accelerator design, construction and operation. Therefore, our hydraulic team piloted a new method to perform network analysis on a large scale cooling system. We successfully created several test scenarios for system behavior in a shorter time compared to the method of performing hand calculations. Cooling specifications for heat rejection, pressure drop, flow rate, and pipe sizing were changed based on the individual systems of the vacuum, radio frequency (RF), magnet and power supply, and cryogenics sections. Finally, we used DOE guidelines to perform life-cycle cost analysis with net present value and carbon saving analysis on the systems where pipe size could be optimized.

43 PARTICLE ACCELERATORS↗
NASA NTRSDate not supplied

SafeAeroBERT: Towards a Safety-Informed Aerospace-Specific Language Model

As aviation systems continue to operate with high traffic, large amounts of documents containing safety-relevant data continue to be generated via reporting systems such as the Aviation Safety Reporting System (ASRS). Advanced natural language processing techniques, specifically pre-trained language models, have shown great success in domain-specific applications; however, the text in aviation safety reports is inundated with jargon and thus not fully utilized by general pre-trained models. In this research, we work towards developing a safety-informed aerospace-specific language model by pre-training a Bidirectional Encoder Representations from Transformer (BERT) model on reports from the Aviation Safety Reporting System and the National Transportation Safety Board. The resulting model, called SafeAeroBERT, is fine-tuned for the specific task of document classification, and can be further tuned for named-entity recognition, relation detection, information retrieval, and summarization. Results from the classification task are compared between SafeAeroBERT, the base BERT, and SciBERT models and show SafeAeroBERT outperforms the general BERT and SciBERT on classifying reports about weather and procedure. SafeAeroBERT can be used on custom tasks, not limited to document classification, and is intended to aid an intelligent knowledge manager for safety report repositories.

Aviation↗