Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Transfer Learning Model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

pyCRTM: A Python Interface for the Community Radiative Transfer Model

The Community Radiative Transfer Model (CRTM) is a powerful and versatile scalar radiative transfer model for satellite data assimilation and remote sensing applications. It is implemented as an object-oriented Fortran library, enabling flexible code development and optimal runtime performance on clusters. The downsides of the Fortran interface are a steep learning curve for students and the reduced productivity of users that is typical for static compiled languages, in contrast to dynamic interpreted languages like Python. pyCRTM is a new software framework that directly interfaces the CRTM Fortran data structures and procedures in Python, leveraging both the simplicity and ease of use of Python syntax as well as the flexibility arising from the vast contemporary Python ecosystem. The goal of pyCRTM is to lower the barrier of entry for university students to learn and use the CRTM and to boost the productivity of researchers seeking to create new methods in radiative transfer and data assimilation, or seeking to apply the CRTM to study atmospheric phenomena without having to go through the pre-existing complexity of the CRTM Fortran interface.

Python↗

Document Classification Techniques for Aviation Letters of Agreement

Often when working with technical documents, it is helpful to classify them into specific categories. In this paper, we conduct a thorough review of natural language processing techniques to perform this classification task on Letters of Agreement (LOAs), technical aviation documents outlining rules for utilizing US airspace. We evaluate multiple techniques, including Transfer Learning, for representing the text in the documents as embeddings: unigram and bigram Term Frequency Inverse Document Frequency (TFIDF), Word2Vec, Doc2Vec, GloVe and RoBERTa. We investigate a wide range of classification models: K-Nearest Neighbors, Random Forest, Support Vector Machines (SVM), Logistic Regression, Naive Bayes, Feed-Forward Neural Network, Convolutional Neural Networks (CNNs) and Long-Short Term Memory (LSTM). By comparing the different methods, we found the best overall approach for our task was to use unigram TFIDF representations with SVM while also gaining insight into how the other methodologies performed on a small technical datasets.

Aayushi Batra↗

Orbital Fluid Transfer System

An automated fluid and power interface system needs to be developed for future space missions which require on orbit consumable replenishment. Current method of fluid transfer require manned vehicles and extravehicular activity. Currently the US does not have an automated capability for consumable transfer on-orbit. This technology would benefit both Space Station and long duration satellites. In order to provide this technology the Automated Fluid Interface System (AFIS) was developed. The AFIS project was an advanced development program aimed at developing a prototype satellite servicer for future space operations. This mechanism could transfer propellants, cryogens, fluids, gasses, electrical power, and communications from a tanker unit to the orbiting satellite. The development of this unit was a cooperative effort between Marshall Space Flight Center in Huntsville, Alabama, and Moog, Inc. in East Aurora, New York. An engineering model was built and underwent substantial development testing at Marshall Space Flight Center (MSFC). While the AFIS is not suitable for spaceflight, testing and evaluation of the AFIS provided significant experience which would be beneficial in building a flight unit. The lessons learned from testing the AFIS provided the foundation for the next generation fluid transfer mechanism, the Orbital Fluid Transfer System (OFTS). The OFTS project was a study contract with MSFC and Moog, Inc. The OFTS was designed for the International Space Station (ISS), but its flexible design could used for long duration satellite missions and other applications. The OFTS was designed to be used after docking. The primary function was to transfer bipropellants and high pressure gases. The other items addressed by this task included propellant storage, hardware integration, safety and control system issues. A new concept for high pressure couplings was also developed. The results of the AFIS testing provided an excellent basis for the OFTS design. The OFTS meet the servicing requirements for ISS and could also provide the automated fluid and power interface system needed for on orbit consumable resupply of spacecraft into the new century.

Johnston, A. S., (Nick)↗

Modeling solar magnetic structures

Some ideas in the theoretical study of force-free magnetic fields and magnetostatic fields, which are relevant to the effort of using magnetograph data as inputs to model the quasi-static, large-scale magnetic structures in the solar atmosphere are discussed. Basic physical principles will be emphasized. An attempt will be made to assess what we may learn, physically, from the models based on these ideas. There is prospect for learning useful physics and this ought to be an incentive for intensifying the efforts to improve vector magnetograph technology and to solve the basic radiative-transfer problems encountered in the interpretation of magnetograph raw data.

Low, B. C.↗

Tests characterizing bioprocessor hardware for analytical modeling

The tests outlined in this paper were used to characterize the hardware components of the Salad Machine, a small NASA-developed bioprocessor. The data from these tests are presented, and the methods by which this data can be integrated into system mathematical models are briefly discussed. The subsystems and physical processes discussed include the lighting system, the air loop (condensing heat exchanger and the blower), heat transfer to the surroundings, and leakage. Through this effort it was learned that in the development of a test protocol, care should be taken to order the tests such that environmental parameters, particularly humidity, require as few large adjustments as possible. Sensor calibration and installation take a substantial amount of time, which should be built into the test schedule. Two properties were particularly hard to quantify: the air flow rate and the energy from the lighting system entering into the growth volume. Flow rate can be measured using the appropriate device for the system configuration and airflow. Lighting system radiation level was measured using three methods. The results of these methods varied substantially, putting off conclusive quantification of this value.

Gustavino, S.↗

Flight Evaluation of the Army/NASA Variable Stability Fly-by-Wire Rotorcraft Aircrew Systems Concept Airborne Laboratory (RASCAL) JUH-60A

NASA Ames Research Center and the U.S. Army Aeroflight dynamics Directorate (AFDD) have performed initial flight evaluations of the Research Flight Control System (RFCS) integrated into the Army/NASA Rotorcraft Aircrew Systems Concepts Airborne Laboratory (RASCAL) JUH-GOA. The highly modified JUH-GOA Black Hawk helicopter is a full authority, high bandwidth, variable stability, in-flight simulator designed to support development of advanced flight control, sensor, and integrated display and control technologies in a fail safe environment. Preparation for flight test required an extensive hazard analysis and ground testing to ensure proper system operation. A hardware in the loop development facility was utilized to evaluate control law stability following software changes, assess servo hardover upset conditions during manual and monitor disengagements and provide pilot familiarization of test techniques and software changes prior to flight. First engagement of the RFCS was conducted on 31 Aug 2001. RFCS transfer system operation, envelope expansion and a limited rate monitor evaluation have been completed with low bandwidth and model following control laws. The presentation will discuss the following - System overview including aircraft modifications and integrated development facilities used with the RASCAL facility. - Preliminary hazard identification and mitigation prior to flight test. - Ground testing used to qualify the RFCS transfer system and verify fault monitor operation. - Flight test results of low-bandwidth and model following control law evaluations including maneuver agility, control limitations, fault monitor reliability, and recovery from manual and monitor disengagement. - Lessons learned including test techniques using a passive three-axis sidearm controller, the value of the development facility in reducing risk and crew coordination issues related to the operation of a full authority, variable stability platform. - Future research and modifications planned for the RASCAL aircraft.

Dave Arterburn↗

Open-Source Data Engineering at NASA: CCMC's Approach to Managing Petabyte-Scale Heliophysics Data

The Community Coordinated Modeling Center (CCMC) at NASA Goddard Space Flight Center (GSFC) leads heliophysics research by providing open access to numerous models and their outputs. Our resources are available on-demand and continuously updated with real-time data, covering sun-earth interactions across multiple domains. These domains include coronal, heliosphere, inner and global magnetosphere, ionosphere, thermosphere, and lower atmosphere interactions. Operating in a hybrid environment, CCMC utilizes both self-owned hardware and Amazon Web Services (AWS) cloud infrastructure. Managing petabytes of data across multiple locations necessitates robust data engineering solutions. To address this challenge, CCMC has adopted industry-standard and open-source tools. We use Apache Airflow as our primary data engineering platform, Python for scripting and data processing, and GitLab for version control and CI/CD. Additionally, we employ Kubernetes for containerized services, Grafana and Prometheus for metrics and monitoring, and Terraform and Puppet for reproducible infrastructure as code. This presentation will discuss lessons learned from our data engineering experiences, platforms evaluated but found unsuitable for our scientific data requirements, and specific techniques developed to enhance data transfer speed and reliability. By using these technologies effectively, CCMC continues to advance heliophysics research through efficient data management and open-access modeling.

space weather↗

A Machine Learning Framework for Error Compensation in Radiative Transfer Calculations

Radiative heat transfer influences the amount of heat flux transferred to the surface of the hypersonic vehicle, which is essential to evaluate the performance of thermal protection systems. The radiative heat flux is found to be computationally prohibitive while accounting for the variation in spatial, angular, and spectral domains. A new methodology has been recently developed to alleviate the cost of computation in the spectral domain by constructing flow-agnostic reduced-order models (ROMs). The developed spectral ROM databases provide grouping strategies that account for non-equilibrium absorption and emission as well as interaction between disparate species due to spectral overlap in associated radiative processes. However, the developed ROMs need to be optimized for a specific combination of interacting gas species and would need to re-calibrated in case individual species are added/omitted. In this work, we use various machine learning (ML) techniques to approximate the radiative intensities determined by a ROM optimized for a specific gas mixture. The ML model relies on the ROM databases developed for a single species which ignores any spectral overlap. Thus, radiation evaluation starts with a simple summation of radiative intensities predicted using these non-calibrated ROMs for the contributing species. The ML framework then provides a correction to account for the interplay in the frequency, i.e., emission of photons by one species and absorption by another, and yields mixture-specific radiation fields. Once trained on the individual ROM databases, the ML framework offers instantaneous corrections that serves as a time/cost effective alternative to the optimization of ROMs for a specific gas mixture. The ML framework is trained on both the high fidelity and ROM evaluated line of sight (LOS) data from Orion, Stardust, and FIRE II cases to obtain a general purpose correction model for earth re-entry scenarios when radiation contributions from both atomic nitrogen and atomic oxygen are considered. A geometric length scale parameter is used in the training process to account for errors introduced in the ROM databases as a consequence of high optical thickness. The efficacy of the ML framework is underscored through extensive analysis of train and test errors with respect to all the re-entry scenarios. The applicability of such an ML framework was further corroborated by embedding it in a state-of-the-art US3D - NERO system for determining the radiative heat flux transferred to the hypersonic vehicle surface.

Radiation↗

NASA SmallSat LEARN Forum Briefing: BioSentinel

We will focus on the technologies developed for BioSentinel, primarily the science payloads. One of them, the BioSensor, is a microfluidics-based instrument that houses a series of fluidic cards and manifolds. The fluidic cards can be loaded with microbial organisms to study the effect of the space environment on biology. For BioSentinel, we used the budding yeast as our model organism to study the response to the radiation environment in both low Earth orbit (ISS) and in deep space. The second instrument is a radiation spectrometer. This sensor allows the quantification of ionizing radiation as well as the characterization of the different particles based on the linear energy transfer or LET. Given that BioSentinel launched this past November (Artemis I), part of the presentation will include lessons learned and how we will apply them to future missions, including LEIA. LEIA was recently selected for a mission to the lunar surface on a CLPS lander vehicle, and is primarily based at NASA Ames.

BioSentinel↗

Artificial Intelligence Medical Support for Long-Duration Space Missions

We envision an artificial intelligence (AI) based system that will provide support and recommendations to the crew medical officer (CMO) and ground flight surgeon during long-duration space missions. Such a system would be pretrained on the knowledgebase of clinical knowledge on Earth, minimizing the amount of Earth data that needs to be transferred into space. Then during deployment, the system would be constantly refined through active learning from diverse streams of data from sensors in the spacecraft, data collected daily from individual astronauts, and human-in-the-loop feedback from the crew. The model could be interrogated for predictions and recommendations on personalized crew health based on the overall status of the spacecraft, medicinal stores, and status of other crew members. Adaptation techniques would be used to incorporate spaceflight data that have very different distributions from the training data due to the extreme environment. Edge computing and the most advanced neuromorphic processing would enable computation in scenarios with low power and bandwidth, while dimensionality reduction would be employed to ensure that the input data streams from spaceflight are as small as possible. In order to realize this long-term vision, several hardware and software aspects need to be developed and assembled. First, models pretrained on Earth biomedical data would need to be evaluated for predictive accuracy, and the best one selected. That model would need to be adapted to learn from diverse, sparse, and inconsistently measured data streams, as well as human-in-the-loop feedback. A data integration, standardization, and dimensionality reduction methodology would need to be developed to handle all data types and feed them into the model. Once the software and data infrastructure is developed, it would need to be integrated with small footprint compute processors and tested in high-radiation, high-vibration, unregulated temperature situations. As a short-term goal, we recommend to focus on the development of the data and model software structure. Several large language models (LLM) already exist that have been trained on Earth biomedical and clinical knowledgebases, including BioMedLLM, Med-PaLM, SPOKE LLM, and Foresight. These models need to be evaluated for accuracy and the best one chosen for a proof-of-concept structure, while maintaining awareness of the accelerating AI field and incorporating any newly improved model architectures as needed. Then, we recommend to develop a database of synthetic data types to mimic the diverse data streams that are expected in a long-duration space mission. This should include environmental and microbial data from the spacecraft, non-invasive data from wearables and point-of-care devices employed by astronauts, and more invasive molecular and physiological monitoring of clinical and biomarker data from astronauts. The data standardization methodology should be developed, and these data streams used to refine the clinical LLM. Several scenarios should be developed that could plausibly come up in a long-duration space mission, and changes or aberrations introduced to the data at specific times to mimic these scenarios. Then, question and answer tasks should be designed to interrogate the model for predictions and recommendations, with acceptable answers already identified.

Artificial Intelligence↗

Advances in Hyperspectral Image Classification Methods for Vegetation and Agricultural Cropland Studies

Hyperspectral data are becoming more widely available via sensors on airborne and unmanned aerial vehicle (UAV) platforms, as well as proximal platforms. While space-based hyperspectral data continue to be limited in availability, multiple spaceborne Earth-observing missions on traditional platforms are scheduled for launch, and companies are experimenting with small satellites for constellations to observe the Earth, as well as for planetary missions. Land cover mapping via classification is one of the most important applications of hyperspectral remote sensing and will increase in significance as time series of imagery are more readily available. However, while the narrow bands of hyperspectral data provide new opportunities for chemistry-based modeling and mapping, challenges remain. Hyperspectral data are high dimensional, and many bands are highly correlated or irrelevant for a given classification problem. For supervised classification methods, the quantity of training data is typically limited relative to the dimension of the input space. The resulting Hughes phenomenon, often referred to as the curse of dimensionality, increases potential for unstable parameter estimates, overfitting, and poor generalization of classifiers. This is particularly problematic for parametric approaches such as Gaussian maximum likelihood–based classifiers that have been the backbone of pixel-based multispectral classification methods. This issue has motivated investigation of alternatives, including regularization of the class covariance matrices, ensembles of weak classifiers, development of feature selection and extraction methods, adoption of nonparametric classifiers, and exploration of methods to exploit unlabeled samples via semi-supervised and active learning. Data sets are also quite large, motivating computationally efficient algorithms and implementations. This chapter provides an overview of the recent advances in classification methods for mapping vegetation using hyperspectral data. Three data sets that are used in the hyperspectral classification literature (e.g., Botswana Hyperion satellite data and AVIRIS airborne data over both Kennedy Space Center and Indian Pines) are described in Section 3.2 and used to illustrate methods described in the chapter. An additional high-resolution hyperspectral data set acquired by a SpecTIR sensor on an airborne platform over the Indian Pines area is included to exemplify the use of new deep learning approaches, and a multiplatform example of airborne hyperspectral data is provided to demonstrate transfer learning in hyperspectral image classification. Classical approaches for supervised and unsupervised feature selection and extraction are reviewed in Section 3.3. In particular, nonlinearities exhibited in hyperspectral imagery have motivated development of nonlinear feature extraction methods in manifold learning, which are outlined in Section 3.3.1.4. Spatial context is also important in classification of both natural vegetation with complex textural patterns and large agricultural fields with significant local variability within fields. Approaches to exploit spatial features at both the pixel level (e.g., co-occurrence–based texture and extended morphological attribute profiles [EMAPs]) and integration of segmentation approaches (e.g., HSeg) are discussed in this context in Section 3.3.2. Recently, classification methods that leverage nonparametric methods originating in the machine learning community have grown in popularity. An overview of both widely used and newly emerging approaches, including support vector machines (SVMs), Gaussian mixture models, and deep learning based on convolutional neural networks is provided in Section 3.4. Strategies to exploit unlabeled samples, including active learning and metric learning, which combine feature extraction and augmentation of the pool of training samples in an active learning framework, are outlined in Section 3.5. Integration of image segmentation with classification to accommodate spatial coherence typically observed in vegetation is also explored, including as an integrated active learning system. Exploitation of multisensor strategies for augmenting the pool of training samples is investigated via a transfer learning framework in Section 3.5.1.2. Finally, we look to the future, considering opportunities soon to be provided by new paradigms, as hyperspectral sensing is becoming common at multiple scales from ground-based and airborne autonomous vehicles to manned aircraft and space-based platforms.

Pasolli, Edoardo↗

The NASA Turbulent Heat Flux Experiments: Summary and Lessons Learned

The Turbulent Heat Flux (THX) experiments were conducted at NASA Glenn Research Center (GRC) in order to collect measurements of velocities and temperatures for computational fluid dynamics (CFD) validation of heated flows, with a focus on propulsion system components. The experiments spanned 5 phases; four of which were conducted in the GRC AeroAcoustic Propulsion Laboratory (AAPL) using the Small Hot Jet Flow Rig (SHJAR). In addition to making velocity measurements with Particle Image Velocimetry (PIV), the THX experiments introduced a new Raman-scattering based capability to measure temperatures. Computational studies were also conducted for each of the experimental configurations, in order to provide a baseline of expected CFD results and conduct an assessment of the capability of various CFD approaches for calculating flows where the turbulent transport of heat was important. Two of the collected sets of data were used for American Institute of Aeronautics and Astronautics (AIAA) Propulsion Aerodynamic Workshops (PAWs). The data set from the 5th phase, collected for heated supersonic jets, was also used to construct new validation cases for the NASA Turbulence Model Resource (TMR). This paper provides an overview of the experiments and associated computations for each of the 5 test phases. Key experimental findings are presented. Lessons learned are provided concerning the effect of computational modeling choice on accuracy of predicting turbulent flows where thermal transport is important. Emphasis is placed on comparing Reynolds- averaged Navier-Stokes approaches with large-eddy simulation approaches. The benefits of utilizing a conjugate heat transfer method in conjunction with CFD solver for film cooling is demonstrated.

RANS↗

The NASA Turbulent Heat Flux (THX) Experiments: Summary and Lessons Learned

The Turbulent Heat Flux (THX) experiments were conducted at NASA Glenn Research Center (GRC) in order to collect measurements of velocities and temperatures for computational fluid dynamics (CFD) validation of heated flows, with a focus on propulsion system components. The experiments spanned 5 phases; four of which were conducted in the GRC AeroAcoustic Propulsion Laboratory (AAPL) using the Small Hot Jet Flow Rig (SHJAR). In addition to making velocity measurements with Particle Image Velocimetry (PIV), the THX experiments introduced a new Raman-scattering based capability to measure temperatures. Computational studies were also conducted for each of the experimental configurations, in order to provide a baseline of expected CFD results and conduct an assessment of the capability of various CFD approaches for calculating flows where the turbulent transport of heat was important. Two of the collected sets of data were used for American Institute of Aeronautics and Astronautics (AIAA) Propulsion Aerodynamic Workshops (PAWs). The data set from the 5th phase, collected for heated supersonic jets, was also used to construct new validation cases for the NASA Turbulence Model Resource (TMR). This paper provides an overview of the experiments and associated computations for each of the 5 test phases. Key experimental findings are presented. Lessons learned are provided concerning the effect of computational modeling choice on accuracy of predicting turbulent flows where thermal transport is important. Emphasis is placed on comparing Reynolds-averaged Navier-Stokes approaches with large-eddy simulation approaches. The benefits of utilizing a conjugate heat transfer method in conjunction with CFD solver for film cooling is demonstrated.

RANS↗

NESC GN&C TDT Workshop on 2D Image Motion Optical Transfer Functions, Pointing Performance Analysis, and Requirements

What You Will Learn: The focus is on payload imaging performance due to pointing motion. Some historical background on pointing performance analysis is given. The Optical Transfer Function (OTF) and Modulation Transfer Function (MTF) are defined. The imaging performance due to pointing motion is measured by image motion optical transfer functions (IM OTF). IM OTFs are defined for displacement, smear, and jitter motions, which are all rigorously defined. Deterministic and Statistical IM OTFs are briefly derived and graphically illustrated and compared. The IM OTFs are parameterized by pointing error metrics(PEM), which are means and covariances of displacement, smear, and jitter. Emphasis is on procedures and algorithms to evaluate the image motion optical transfer functions and pointing error metrics. Three procedures are covered, which depend on whether the pointing error data is from time-domain simulation, frequency-domain analysis, or stochastic modeling. A method to evaluate the relative contribution of disturbance sources and to identify the most significant contributors is presented. The presentation includes pertinent discussion of flexible structures and control-structure interaction. No single book can adequately cover this subject, so a book is not required for the course. A list of selected articles, reports, documents, and books is provided for reference and further study. Mathis kept to the minimum necessary to convey principles; lengthy derivations are left to the reference material. Graphics are used to illustrate concepts. As with any such learning endeavor, the knowledge gained will be retained and strengthened through actual practice.c©2019–2021 Mark E. Pittelkau— 5

NASA Engineering and Safety Center (NESC)↗

Knowledge acquisition and interface design for learning on demand systems

The rapid changes in our world precipitated by technology have created new problems and new challenges for education and training. A knowledge 'explosion' is occurring as our society moves toward a service oriented economy that relies on information as the major resource. Complex computer systems are beginning to dominate the workplace, causing alarming growth and change in many fields. The rapidly changing nature of the workplace, especially in fields related to information technology, requires that our knowledge be updated constantly. This characteristic of modern society poses seemingly unsolvable instructional problems involving coverage and obsolescence. The sheer amount of information to be learned is rapidly increasing, while at the same time some information becomes obsolete in light of new information. Education, therefore, must become a lifelong process that features learning of new material and skills as needed in relation to the job to be done. Because of the problems cited above, the current model of learning in advance may no longer be feasible in our high-technology world. In many cases, learning in advance is impossible because there are simply too many things to learn. In addition, learning in advance can be time consuming, and often results in decontextualized knowledge that does not readily transfer to the work environment. The large and growing discrepancy between the amount of potentially relevant knowledge available and the amount a person can know and remember makes learning on demand an important alternative to current instructional practices. Learning on demand takes place whenever an individual must learn something new in order to perform a task or make a decision. Learning on demand is a promising approach for addressing the problems of coverage and obsolescence because learning is contextualized and integrated into the task environment rather than being relegated to a separate phase that precedes work. Learning on demand allows learners to see for themselves the usefulness of new knowledge for actual problem situations, thereby increasing the motivation for learning new information. Finally, learning on demand makes new information relevant to the task at hand, leading to more informed decision making, better quality products, and improved performance.

Nelson, Wayne A.↗

BioSentinel: Leading the Way for Deep Space CubeSat Missions

Flagship science missions are not alone in Deep Space thanks to BioSentinel, a 6U spacecraft launched on Artemis-1. BioSentinel is one of the longest operating CubeSats beyond cislunar space. The subsystems and COTS components of the BioSentinel bus are a template for future deep space missions, and the lessons learned from over a year of operations will enable improved performance for the next missions. BioSentinel achieved its unprecedented performance for an SLS secondary payload due to preparation, planning, and a robust design. Pre-launch antenna and interface testing with both DSN and ESA confirmed command and data pathways and allowed for operational flexibility in the critical early hours post-deployment. Mission Operations simulations prior to launch identified potential risks and primed operators to respond in flight, preparing the team to react quickly to successfully detumble the spacecraft and enter a power-positive state. The spacecraft would not have survived without the inclusion of the trailblazing 3D-printed composite cold gas propulsion system. The non-standard tank geometry enabled efficient use of the limited space available in the CubeSat, as well as the capability to detumble the spacecraft and manage momentum, while providing sufficient margin to execute potential delta-V maneuvers. The Iris radio has operated for over 18 months with no significant issues. Initial Iris performance estimates have been accurate throughout the mission. BioSentinel continues to collect data on thermal conditions and to validate our performance models with real-world knowledge. We have received exemplary support from our DSN partners. Following the conclusion of the primary science mission, the Linear Energy Transfer (LET) Spectrometer continued to collect solar and galactic radiation data from its location in heliocentric orbit. The free space dataset offered by the BioSentinel LET is a valuable source of data for model validation and future mission planning. As the spacecraft travels farther from Earth it is poised to provide longitudinally distributed measurements of solar particle events during solar maximum. The lessons learned from BioSentinel suggest key areas to enhance performance. The ability to upload modified flight software can increase the stability of memory management. Additional heaters in the propulsion system design have already proven successful on the Starling mission. Streamlining mission operations can reduce costs, increase data return, and better utilize DSN time. Enhancements such as these will facilitate reliable, long-duration deep space exploration using the proven BioSentinel 6U CubeSat bus.

BioSentinel↗

Towards an Aviation Large Language Model by Fine-tuning and Evaluating Transformers

In the aviation domain, there are many applications for machine learning and artificial intelligence tools that utilize natural language. For example, there is a desire to know the commonalities in written safety reports such as voluntary post incidents reports or create more accurate transcripts of air traffic management conversations. Another use-case is the possibility of extracting airspace procedures and constraints currently written in documents such as Letters of Agreement (LOA) which is used as the evaluation case in this paper. These applications can benefit from the use of state-of-the-art Natural Language Processing (NLP) techniques when adapted to the language/phraseology specific to the aviation domain. This paper evaluates the viability of transferring pre-trained large language models to the aviation domain by adapting transformer based models using aviation datasets. This paper utilized two datasets to adapt a ‘Robustly Optimized Bidirectional Encoder Representations from Transformers Approach’ (RoBERTa) model and two down-stream classification tasks to assess its performance. These datasets are all built upon Letters of Agreement which are Federal Aviation Administration (FAA) documents that formalize airspace operations across the national airspace system. The first two datasets are used for the adaptation of RoBERTa to the aviation domain and were of different sizes to assess the number of documents needed to adapt to the aviation domain. They contain many examples of ‘aviation English’ using domain specific terminology and phrasing which serves as a representative basis to perform the unsupervised adaptation. The second dataset is a separate set of LOA documents with two sets of classification labels to be used for evaluation; one at the document level and one at the line level. These down-stream evaluations allowed the measurement of improvement by adapting RoBERTa. The accuracy increased by 4-6% on both tasks and the F1 score on the class of interest increased by 4-8% from the adaptation.

Air Traffic Management↗

Towards an Aviation Large Language Model by Fine-tuning and Evaluating Transformers

In the aviation domain, there are many applications for machine learning and artificial intelligence tools that utilize natural language. For example, there is a desire to know the commonalities in written safety reports such as voluntary post incidents reports or create more accurate transcripts of air traffic management conversations. Another use-case is the possibility of extracting airspace procedures and constraints currently written in documents such as Letters of Agreement (LOA) which is used as the evaluation case in this paper. These applications can benefit from the use of state-of-the-art Natural Language Processing (NLP) techniques when adapted to the language/phraseology specific to the aviation domain. This paper evaluates the viability of transferring pre-trained large language models to the aviation domain by adapting transformer based models using aviation datasets. This paper utilized two datasets to adapt a ‘Robustly Optimized Bidirectional Encoder Representations from Transformers Approach’ (RoBERTa) model and two down-stream classification tasks to assess its performance. These datasets are all built upon Letters of Agreement which are Federal Aviation Administration (FAA) documents that formalize airspace operations across the national airspace system. The first two datasets are used for the adaptation of RoBERTa to the aviation domain and were of different sizes to assess the number of documents needed to adapt to the aviation domain. They contain many examples of ‘aviation English’ using domain specific terminology and phrasing which serves as a representative basis to perform the unsupervised adaptation. The second dataset is a separate set of LOA documents with two sets of classification labels to be used for evaluation; one at the document level and one at the line level. These down-stream evaluations allowed the measurement of improvement by adapting RoBERTa. The accuracy increased by 4-6% on both tasks and the F1 score on the class of interest increased by 4-8% from the adaptation.

Air Traffic Management↗