Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “training data quality”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6

Space shuttle main engine anomaly data and inductive knowledge based systems: Automated corporate expertise

Progress is reported on the development of SCOTTY, an expert knowledge-based system to automate the analysis procedure following test firings of the Space Shuttle Main Engine (SSME). The integration of a large-scale relational data base system, a computer graphics interface for experts and end-user engineers, potential extension of the system to flight engines, application of the system for training of newly-hired engineers, technology transfer to other engines, and the essential qualities of good software engineering practices for building expert knowledge-based systems are among the topics discussed.

Modesitt, Kenneth L.↗

Local governments LANDSAT applications program

The approach used to develop the internal capabilities of local governments to handle and evaluate LANDSAT data included remote sensing training, development of a low-cost digital image processing system, and technical assistance. Cost sharing, program management and coordination, and networking were also employed to address problems related to land use, water resources, environmental assessment, and air quality as experienced by urban planners. Local experiences gained in Atlanta, Georgia; Henrico County, Virginia; Oklahoma City; Oklahoma; and San Jose, California are described. Policy recommendations formulated for transferring remote sensing technologies to local governments are included.

Source record↗

Crew safety

Crew safety in the manned spaceflight is usually associated with a small group for safety and quality assurance. Crew safety is actually an integral part of all program phases from conception through final implementation. Factors associated with improving safety at each phase of development are discussed. Topics discussed include design, manufacture, hardware/software checkout, management reviews, training and simulation, and data retrieval and analysis. Crew safety is best accomplished by flying a successful mission.

Slayton, D. K.↗

Principal Investigator-in-a-Box

Human performance in orbit is currently limited by several factors beyond the intrinsic awkwardness of motor control in weightlessness. Cognitive functioning can be affected by such factors as cumulative sleep loss, stress and the psychological effects of long-duration small-group isolation. When an astronaut operates a scientific experiment, the performance decrement associated with such factors can lead to lost or poor quality data and even the total loss of a scientific objective, at great cost to the sponsors and to the dismay of the Principal Investigator. In long-duration flights, as anticipated on the International Space Station and on any planetary exploration, the experimental model is further complicated by long delays between training and experiment, and the large number of experiments each crew member must perform. Although no documented studies have been published on the subject, astronauts report that an unusually large number of simple errors are made in space. Whether a result of the effects of microgravity, accumulated fatigue, stress or other factors, this pattern of increased error supports the need for a computerized decision-making aid for astronauts performing experiments. Artificial intelligence and expert systems might serve as powerful tools for assisting experiments in space. Those conducting space experiments typically need assistance exactly when the planned checklist does not apply. Expert systems, which use bits of human knowledge and human methods to respond appropriately to unusual situations, have a flexibility that is highly desirable in circumstances where an invariably predictable course of action/response does not exist. Frequently the human expert on the ground is unavailable, lacking the latest information, or not consulted by the astronaut conducting the experiment. In response to these issues, we have developed "Principal Investigator-in-a-Box," or [PI], to capture the reasoning process of the real expert, the Principal Investigator, and combine that with real-time data available in space in order to advise the astronaut about how to proceed in real time. [PI] advises the astronaut during the progress of an experiment in much the same way a real Principal Investigator might do while looking over the astronaut's shoulder. In its original application, [PI] mimicked several of the tasks of the Principal Investigator, including data quality monitoring, troubleshooting, prescheduling, protocol management and "interesting data" detection. The proposed research focuses on the efficacy of this technique as applied to the data quality monitoring and troubleshooting aspects of [PI].

Young, Laurence R.↗

Extreme Tele-Echocardiography: Methodology for Remote Guidance of In-Flight Echocardiography Aboard the International Space Station

Methods: In the year before launch of an ISS mission, potential astronaut echocardiographic operators participate in 5 sessions to train for echo acquisitions that occur roughly monthly during the mission, including one exercise echocardiogram. The focus of training is familiarity with the study protocol and remote guidance procedures. On-orbit, real-time guidance of in-flight acquisitions is provided by a sonographer in the Telescience Center of Mission Control. Physician investigators with remote access are able to relay comments on image quality to the sonographer. Live video feed is relayed from the ISS to the ground via the Tracking and Data Relay Satellite System with a 2- second transmission delay. The expert sonographer uses these images, along with twoway audio, to provide instructions and feedback. Images are stored in non-compressed DICOM format for asynchronous relay to the ground for subsequent off-line analysis. Results: Since June, 2009, a total of 27 resting echocardiograms and 5 exercise studies have been performed during flight. Average acquisition time has been 45 minutes, reflecting 26,000 km of ISS travel per study. Image quality has been adequate in all studies, and remote guidance has proven imperative for fine-tuning imaging and prioritizing views when communication outages limit the study duration. Typical resting studies have included 27 video loops and 30 still-frame images requiring 750 MB of storage. Conclusions: Despite limited crew training, remote guidance allows research-quality echocardiography to be performed by non-experts aboard the ISS. Analysis is underway and additional subjects are being recruited to define the impact of microgravity on cardiac structure and systolic and diastolic function.

Martin, David S.↗

Enriching the Twitter Stream Increasing Data Mining Yield and Quality Using Machine Learning

Social media data streams are important sources of real-time and historical global information for science applications. At the NASA Goddard Earth Sciences Data and Information Services Center (GES DISC), we are exploring the Twitter data stream for its potential in augmenting the validation program of NASA Earth science missions, specifically the Global Precipitation Measurement (GPM) mission. We have implemented a tweet processing infrastructure that outputs classified precipitation tweets. Inputs are "passive" tweets, along with a smaller number of tweets from "active" participants, i.e., those knowingly contributing to our effort. The "active" tweets, presumably of higher quality, enrich the Twitter stream. "Active" sources include data scraped from other social media (e.g., public Facebook posts) and data from existing crowdsourcing programs (e.g., mPING reports). In addition, there is likely relevant precipitation information in images and documents that are the end points of links often included in tweets. Information derived from these "active" sources could then be tweeted into the Twitter stream, thus enriching its quality. The objective of our current work is to mine these tweet­ linked images and documents, using neural networks, to increase the information content and quality related to precipitation. For images, we classified them as either precipitation-related or not. For training and validation, we used images obtained via the Google custom search API. We created two models: (1) by training a simple Convolutional Neural Network and (2) by using transfer learning principles to adapt a pre-trained object recognition model. For documents, both those linked to tweets and the tweet contents, we trained Hierarchical Attention Networks to determine precipitation occurrence, type, and intensity. For training and validation, we used a keyword-filtered tweet data set labelled with ground truth data from Dark Sky (an API to retrieve weather-related labels) and the National Severe Storms Laboratory's Multi­ Radar/Multi-Sensor (MRMS) system. Our results demonstrated the efficacy of our machine learning approaches for enriching the Twitter stream, to derive information potentially useful for validation of earth science satellite data.

Albayrak, Arif↗

Simulation of the XV-15 tilt rotor research aircraft

The effective use of simulation from issuance of the request for proposal through conduct of a flight test program for the XV-15 Tilt Rotor Research Aircraft is discussed. From program inception, simulation complemented all phases of XV-15 development. The initial simulation evaluations during the source evaluation board proceedings contributed significantly to performance and stability and control evaluations. Eight subsequent simulation periods provided major contributions in the areas of control concepts; cockpit configuration; handling qualities; pilot workload; failure effects and recovery procedures; and flight boundary problems and recovery procedures. The fidelity of the simulation also made it a valuable pilot training aid, as well as a suitable tool for military and civil mission evaluations. Simulation also provided valuable design data for refinement of automatic flight control systems. Throughout the program, fidelity was a prime issue and resulted in unique data and methods for fidelity evaluation which are presented and discussed.

Churchill, G. B.↗

Space biology initiative program definition review. Trade study 1: Automation costs versus crew utilization

A significant emphasis upon automation within the Space Biology Initiative hardware appears justified in order to conserve crew labor and crew training effort. Two generic forms of automation were identified: automation of data and information handling and decision making, and the automation of material handling, transfer, and processing. The use of automatic data acquisition, expert systems, robots, and machine vision will increase the volume of experiments and quality of results. The automation described may also influence efforts to miniaturize and modularize the large array of SBI hardware identified to date. The cost and benefit model developed appears to be a useful guideline for SBI equipment specifiers and designers. Additional refinements would enhance the validity of the model. Two NASA automation pilot programs, 'The Principal Investigator in a Box' and 'Rack Mounted Robots' were investigated and found to be quite appropriate for adaptation to the SBI program. There are other in-house NASA efforts that provide technology that may be appropriate for the SBI program. Important data is believed to exist in advanced medical labs throughout the U.S., Japan, and Europe. The information and data processing in medical analysis equipment is highly automated and future trends reveal continued progress in this area. However, automation of material handling and processing has progressed in a limited manner because the medical labs are not affected by the power and space constraints that Space Station medical equipment is faced with. Therefore, NASA's major emphasis in automation will require a lead effort in the automation of material handling to achieve optimal crew utilization.

Jackson, L. Neal↗

Guidance and Control Software Project Data - Volume 2: Development Documents

The Guidance and Control Software (GCS) project was the last in a series of software reliability studies conducted at Langley Research Center between 1977 and 1994. The technical results of the GCS project were recorded after the experiment was completed. Some of the support documentation produced as part of the experiment, however, is serving an unexpected role far beyond its original project context. Some of the software used as part of the GCS project was developed to conform to the RTCA/DO-178B software standard, "Software Considerations in Airborne Systems and Equipment Certification," used in the civil aviation industry. That standard requires extensive documentation throughout the software development life cycle, including plans, software requirements, design and source code, verification cases and results, and configuration management and quality control data. The project documentation that includes this information is open for public scrutiny without the legal or safety implications associated with comparable data from an avionics manufacturer. This public availability has afforded an opportunity to use the GCS project documents for DO-178B training. This report provides a brief overview of the GCS project, describes the 4-volume set of documents and the role they are playing in training, and includes the development documents from the GCS project. Volume 2 contains three appendices: A. Guidance and Control Software Development Specification; B. Design Description for the Pluto Implementation of the Guidance and Control Software; and C. Source Code for the Pluto Implementation of the Guidance and Control Software

Hayhurst, Kelly J.↗

Guidance and Control Software Project Data - Volume 3: Verification Documents

The Guidance and Control Software (GCS) project was the last in a series of software reliability studies conducted at Langley Research Center between 1977 and 1994. The technical results of the GCS project were recorded after the experiment was completed. Some of the support documentation produced as part of the experiment, however, is serving an unexpected role far beyond its original project context. Some of the software used as part of the GCS project was developed to conform to the RTCA/DO-178B software standard, "Software Considerations in Airborne Systems and Equipment Certification," used in the civil aviation industry. That standard requires extensive documentation throughout the software development life cycle, including plans, software requirements, design and source code, verification cases and results, and configuration management and quality control data. The project documentation that includes this information is open for public scrutiny without the legal or safety implications associated with comparable data from an avionics manufacturer. This public availability has afforded an opportunity to use the GCS project documents for DO-178B training. This report provides a brief overview of the GCS project, describes the 4-volume set of documents and the role they are playing in training, and includes the verification documents from the GCS project. Volume 3 contains four appendices: A. Software Verification Cases and Procedures for the Guidance and Control Software Project; B. Software Verification Results for the Pluto Implementation of the Guidance and Control Software; C. Review Records for the Pluto Implementation of the Guidance and Control Software; and D. Test Results Logs for the Pluto Implementation of the Guidance and Control Software.

Hayhurst, Kelly J.↗

Machine Learning for Predicting Team Functioning in HERA Missions

Team functioning is integral to success in future long term space exploration missions. Proactively detecting declines in team functioning can mitigate conflict and ensure mission success. This project developed a speech-based artificial intelligence (AI) system that unobtrusively predicts degradation in team functioning, including performance and cohesion, in the Human Exploration Research Analog (HERA) Campaigns 4 and 5. The AI system conducted automated analysis of the prosodic (tone of voice) and linguistic (language content) components of speech, modeling interpersonal dynamics at both the turn-taking and day-wide levels. We investigated team functioning via observing structured interactions (i.e., multi-mission space exploration vehicle-extra vehicular activity [MMSEV-EVA], team interaction battery [TIB]) and unstructured interactions before the MMSEV-EVA task. We developed machine learning models to predict team functioning (objective task accuracy, self reported team efficacy and self reported team cohesion) by analyzing OpenSmile acoustic features, linguistic descriptors extracted via the linguistic inquiry and word count (LIWC) dictionary, and semantic embeddings. In the TIB, static models using logistic regression and random forests were not able to predict task accuracy, but predicted team efficacy and cohesion during both the decision making and relational tasks to a moderate level (60-70%). Majority voting on the individual turns to predict day long team efficacy further increased accuracies (70-80%). Finally, long short-term memory (LSTM) models showed the best performance across all variables (80-91%), including task performance. In the MMSEV-EVA, static models achieved an accuracy of 60% with majority voting, which increased to 80% through the incorporation of mission day as a variable, accounting for the learning effect. A key finding across both tasks was the "team-dependent" nature of these interactions; models achieved much higher accuracy when trained on prior days of the same team's data rather than attempting to generalize across entirely different teams, with even 1-2 days of prior data per team achieving 5-15% improvement over team-independent models. In addition, the incorporation of pre-task data from the same team also improves model performance, e.g., incorporating data from the decision-making task of the TIB, which preceded the relational task, improved the prediction of team efficacy and cohesion during the latter. We compared model performance when trained on machine-generated data compared to data that had been further corrected by human annotators. Overall, models trained on human-corrected data exhibited a modest improvement in performance, particularly when acoustic features were used. We found no significant correlation between word error rate (WER) and model accuracy (r(55) = -0.08, p = 0.51), but model’s accuracy was significantly higher for medium/high quality transcription (0.74 (SD = 0.48)) compared to the low-quality group (0.64 (SD = 0.36)) (t(63)=2.82, p = 0.006). Based on these, several design recommendation emerge, that could inform Standards at NASA. Models predicting team functioning should incorporate at least one to two days of historical interaction data, include brief pre-task discussions, and explicitly model temporal learning effects, especially for longer operational tasks. Minimum quality standards for automated speech-processing pipelines are needed, given the performance gains observed with manually corrected acoustic data. Finally, systems should leverage both acoustic features and language embeddings in complementary ways, with modality choices and fusion strategies tailored to mission context, task demands, and data quality requirements.

Shrivatsa Mishra↗

Coordinated Science Campaign Scheduling for Sensor Webs

Future Earth observing missions will study different aspects and interacting pieces of the Earth's eco-system. Scientists are designing increasingly complex, interdisciplinary campaigns to exploit the diverse capabilities of multiple Earth sensing assets. In addition, spacecraft platforms are being configured into clusters, trains, or other distributed organizations in order to improve either the quality or the coverage of observations. These simultaneous advances in the design of science campaigns and in the missions that will provide the sensing resources to support them offer new challenges in the coordination of data and operations that are not addressed by current practice. For example, the scheduling of scientific observations for satellites in low Earth orbit is currently conducted independently by each mission operations center. An absence of an information infrastructure to enable the scheduling of coordinated observations involving multiple sensors makes it difficult to execute campaigns involving multiple assets. This paper proposes a software architecture and describes a prototype system called DESOPS (Distributed Earth Science Observation Planning and Scheduling) that will address this deficiency.

Edgington, Will↗

Applying Geospatial Technologies for International Development and Public Health: The USAID/NASA SERVIR Program

Background: SERVIR -- the Regional Visualization and Monitoring System -- helps people use Earth observations and predictive models based on data from orbiting satellites to make timely decisions that benefit society. SERVIR operates through a network of regional hubs in Mesoamerica, East Africa, and the Hindu Kush-Himalayas. USAID and NASA support SERVIR, with the long-term goal of transferring SERVIR capabilities to the host countries. Objective/Purpose: The purpose of this presentation is to describe how the SERVIR system helps the SERVIR regions cope with eight areas of societal benefit identified by the Group on Earth Observations (GEO): health, disasters, ecosystems, biodiversity, weather, water, climate, and agriculture. This presentation will describe environmental health applications of data in the SERVIR system, as well as ongoing and future efforts to incorporate additional health applications into the SERVIR system. Methods: This presentation will discuss how the SERVIR Program makes environmental data available for use in environmental health applications. SERVIR accomplishes its mission by providing member nations with access to geospatial data and predictive models, information visualization, training and capacity building, and partnership development. SERVIR conducts needs assessments in partner regions, develops custom applications of Earth observation data, and makes NASA and partner data available through an online geospatial data portal at SERVIRglobal.net. Results: Decision makers use SERVIR to improve their ability to monitor air quality, extreme weather, biodiversity, and changes in land cover. In past several years, the system has been used over 50 times to respond to environmental threats such as wildfires, floods, landslides, and harmful algal blooms. Given that the SERVIR regions are experiencing increased stress under larger climate variability than historic observations, SERVIR provides information to support the development of adaptation strategies for nations affected by climate change. Conclusions: SERVIR is a platform for collaboration and cross-agency coordination, international partnerships, and delivery of web-based geospatial information services and applications. SERVIR makes a variety of geospatial data available for use in studies of environmental health outcomes.

Hemmings, Sarah↗

Florida Water Resources: Assessing Coastal Resiliency Across Florida's Aquatic Preserves Response To Hurricane Forces

Intensifying weather events, sea level rise, and extensive coastal development in Southwestern Florida are escalating the need for Florida’s mangrove conservation. These mangroves are imperative for coastline stabilization, habitat provision for native species, and water quality management. Our partner, the Florida Department of Environmental Protection (FDEP), Office of Resilience and Coastal Protection is tasked with monitoring and conserving the Charlotte Harbor, Estero Bay, Rookery Bay, and Pinellas County Aquatic Preserves. We developed the Growth, Resilience, and Optical Vegetation Evaluator (GROVE) Google Earth Engine toolset for partners to determine mangrove forest extent through time, analyze mangrove forest health, and collect several water quality parameters within the preserves from January 2002–August 2022. The toolset provides easily accessible data from Landsat 7 Enhanced Thematic Mapper Plus (ETM+), Landsat 8 Operational Land Imager (OLI), Landsat 9 Operational Land Imager 2 (OLI-2), and the Shuttle Radar Topography Mission (SRTM). Using training datasets of known mangrove forest locations, we also established a machine learning approach to create mangrove extent maps. Maps from all four preserves indicated migration of mangrove forests inland as the greatest areas of change were transitional zones. Additionally, normalized difference vegetation index (NDVI), normalized difference turbidity index (NDTI), and chlorophyll-a maps were generated for the partners. This project provides decision makers with a useful tool for understanding temporal changes in Florida’s aquatic preserves, identifying areas of ecological stress, and providing actionable data to make informed plans for mangrove preservation.

Samuel Perrello↗

Landsat-D thematic mapper simulation using aircraft multispectral scanner data

A simulation of imagery from the upcoming Landsat-D Thematic Mapper was accomplished by using selected channels of aircraft 24-channel multispectral scanner data. The purpose was to simulate Thematic Mapper 30-meter resolution imagery, to compare its spectral quality with the original aircraft MSS data, and to determine changes in thematic classification accuracy for the simulated imagery. The original resolution of approximately 7.5 meters IFOV and simulated resolution of 15, 30, and 60 meters were used to indicate the trend of spectral quality and classification accuracy. The study was based in a 6.5 square kilometer area of urban Los Angeles having a diversity of land use. The original imagery was reduced in resolution by two related methods: pixel matrix averaging, and matrix smoothing with a unity box filter, followed by matrix averaging. Thematic land use classification using training sites and a Bayesian maximum-likelihood algorithm was performed at three levels of standard deviation - 1.0, 2.0, and 3.0 sigma. Plots of relative standard deviation showed that for larger training sites with a normal distribution of data, as the resolution decreased, the distribution range of density values decreased. Also, the classification accuracies for three levels of standard deviation increased as resolution decreased. However, the indication is that a point of diminishing returns had been reached, and 30 meters IFOV should be the best for multispectral classification of urban scenes.

Clark, J.↗

An Update on GPM and TRMM Data Services at NASA GES DISC

The Goddard Earth Sciences (GES) Data and Information Services Center (DISC) is home to data archives of the NASA-JAXA Global Precipitation Measurement (GPM), the Tropical Rainfall Measuring Mission (TRMM), and other NASA missions and projects. To maximize the use of NASA data products in scientific research and applications as well as for societal benefits, we provide data and information services that make datasets easy to find and use through simplification of data access for users at all levels around the world. Over the years, user-friendly data services have been developed at GES DISC, including data subsetting, format conversion, online visualization and analysis (i.e. Giovanni), user support system, etc. We routinely analyze questions, feedback, and use cases from users and algorithm developers around the world as well as best practices and new technology to improve existing services and formulate new data services. Interaction between users and algorithm developers is an important process for identifying issues in products, collecting user requirements, and improving product quality and usability. Staff members regularly communicate with algorithm developers with user questions and concerns through conferences and workshops. We publish peer-reviewed papers and articles in major Earth science journals and book chapters to describe NASA global and regional precipitation datasets and services with examples. News articles about GPM and TRMM datasets associated with significant events are regularly posted in the GES DISC Web portal and social media. We also actively participate in training activities. In this presentation, we present our latest activities about GPM and TRMM data services, data/service metrics, and future plans at GES DISC.

Liu, Z.↗

Enhancing Air Traffic Control Planning with Automatic Speech Recognition

The decisions made during the Federal Aviation Administration Air Traffic Control System Command Center's planning teleconferences hold significant sway over the National Airspace System. Held every two hours, these teleconferences convene air traffic managers and stakeholders from across the nation to discuss airspace conditions, weather, and constraints, leading to the formulation and adjustment of traffic management initiatives. Given the critical nature of these decisions, the need for accurate and efficient record-keeping is paramount. In recent years, the application of automatic speech recognition has gained popularity across diverse industries, including aviation. While traditional applications focus on transcribing air traffic control communication, this paper explores a unique application of automatic speech recognition by converting the audio from planning teleconferences into text transcriptions. This innovative approach addresses key challenges in the field, presenting potential benefits for quality assurance, real-time participation, and downstream natural language processing tasks. A notable breakthrough in the machine learning community, namely the transformer neural network architecture, forms the backbone of the proposed solution in this paper. The transformer architecture's role in this research represents a paradigm shift in the efficiency of automatic speech recognition models. By reducing the amount of in-domain training data required, this architecture allows for the fine-tuning of such models like Whisper, originally pretrained on vast English speech datasets. The adaptability of the transformer architecture proves invaluable in capturing the nuances of aviation terminology and specific language used in planning teleconferences. Leveraging the Whisper model as a baseline, our research details the fine-tuning and validation using a dataset comprising 20 hours of meticulously transcribed planning teleconferences. Notably, the baseline pretrained Whisper model exhibited a word error rate of 18.77%. Through the fine-tuning process, the model achieved a substantial improvement, demonstrating an impressive performance with a reduced word error rate of 6.82%. This substantial decrease in WER not only highlights the effectiveness of the transformer architecture but also emphasizes the practical advancements achieved through the application of automatic speech recognition in this specific domain. The utilization of automatic speech recognition in planning teleconferences in this work introduces several novelties. Firstly, the creation of text transcriptions offers a valuable tool for quality assurance and facilitates the efficient review of teleconferences. This is an important aspect of the proposed solution, given the time-sensitive and high-stakes nature of decisions made during these meetings. Furthermore, text-searchable transcriptions provide a streamlined approach for locating and validating critical information, potentially saving hours of manual effort in searching through audio recordings. Moreover, our research identifies a key use case for external facilities and stakeholders. In situations where attendance at the planning teleconference is not feasible, having access to text transcriptions in real-time or shortly after the teleconference ends, proves to be a time-saving and informative resource. This feature enhances collaboration and ensures that stakeholders can stay abreast of important discussions and decisions even in their absence. Despite the efficiency gains facilitated by the transformer architecture in automatic speech recognition technology, it is essential to acknowledge the human factors in data creation. Subject matter experts play a crucial role in accurately transcribing planning teleconferences due to the specificity and complexity of the information discussed. The research dataset, consisting of 20 hours of transcribed planning teleconferences, forms the foundation for fine-tuning and validating the Whisper model. The achieved word error rate of 6.82% demonstrates promising advancements, particularly in recognizing essential aviation terminology within the teleconferences. In conclusion, this paper presents a comprehensive exploration of the application of automatic speech recognition in Air Traffic Control System Command Center planning teleconferences, leveraging the transformer architecture for enhanced efficiency. The novel contributions lie in the improved accessibility of decision-making records, real-time participation opportunities for external stakeholders, and the potential for downstream natural language processing advancements. As the aviation industry continues to evolve, the integration of automatic speech recognition technologies holds the promise of revolutionizing decision-making processes and contributing to the overall safety and efficiency of air traffic management.

ATM↗

A New Machine Learning Based Analysis for Improving Satellite Retrieved Atmospheric Composition Data: OMI SO2 as an Example

Despite recent progress, satellite retrievals of anthropogenic SO2 still suffer from relatively low signal-tonoise ratios. In this study, we demonstrate a new machine learning data analysis method to improve the quality of satellite SO2 products. In the absence of large ground-truth datasets for SO2, we start from SO2 slant column densities (SCDs) retrieved from the Ozone Monitoring Instrument (OMI) using a data-driven, physically based algorithm and calculate the ratio between the SCD and the root mean square (rms) of the fitting residuals for each pixel. To build the training data, we select presumably clean pixels with small SCD / rms ratios (SRRs) and set their target SCDs to zero. For polluted pixels with relatively large SRRs, we set the target to the original retrieved SCDs. We then train neural networks (NNs) to reproduce the target SCDs using predictors including SRRs for individual pixels, solar zenith, viewing zenith and phase angles, scene reflectivity, and O3 column amounts, as well as the monthly mean SRRs. For data analysis, we employ two NNs: (1) one trained daily to produce analyzed SO2 SCDs for polluted pixels each day and (2) the other trained once every month to produce analyzed SCDs for less polluted pixels for the entire month. Test results for 2005 show that our method can significantly reduce noise and artifacts over background regions. Over polluted areas, the monthly mean NN-analyzed and original SCDs generally agree to within ±15 %, indicating that our method can retain SO2 signals in the original retrievals except for large volcanic eruptions. This is further confirmed by running both the NN-analyzed and original SCDs through a topdown emission algorithm to estimate the annual SO2 emissions for ∼ 500 anthropogenic sources, with the two datasets yielding similar results. We also explore two alternative approaches to the NN-based analysis method. In one, we employ a simple linear interpolation model to analyze the original SCD retrievals. In the other, we develop a PCA–NN algorithm that uses OMI measured radiances, transformed and dimension-reduced with a principal component analysis (PCA) technique, as inputs to NNs for SO2 SCD retrievals. While the linear model and the PCA–NN algorithm can reduce retrieval noise, they both underestimate SO2 over polluted areas. Overall, the results presented here demonstrate that our new data analysis method can significantly improve the quality of existing OMI SO2 retrievals. The method can potentially be adapted for other sensors and/or species and enhance the value of satellite data in air quality research and applications.

Can Li↗