Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “dissemination”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,387 records · Page 77
All sourcesNASA NTRSDOE OSTI
NASA NTRS2017

The Mars Reconnaissance Orbiter Mission: Continuing a Record of Exploration from Mars Orbit

The Mars Reconnaissance Orbiter (MRO) has been on station in its low altitude, sun-synchronous, primary science orbit since September 2006 performing both scientific and Mars programmatic support functions. The spacecraft is a very capable remote sensing science platform carrying six science payloads supporting seven investigations and a UHF telecommunications radio (Electra) for surface relay. Developed to support a mix of nadir mapping and targeted, highresolution surface observations, the spacecraft’s powerful telecommunications and command & data handling (C&DH) subsystems communicate an average of 16 hours a day with the Deep Space Network (DSN). To date, more than 300 TB of scientific data has been returned to Earth. All of the original science payloads are active with standard and new observing modes contributing to the advancement of Mars science through peer-reviewed paper publications and the timely dissemination of their data to the science community as a whole. Results from the science teams have revealed an amazing diversity of ancient aqueous environments and ongoing surface change is evident through gully formation, avalanches, and cratering. Extending the MRO-MGS climate record to a decade of Mars years is contributing to a better understanding of current atmospheric and polar processes. In addition to its fundamental scientific objectives, MRO is a critical element of NASA’s Mars Exploration Program (MEP) providing needed infrastructure support for landed and future missions. Using its Electra telecommunications payload, MRO provides landers and rovers critical event coverage during their entry, descent, and landing (EDL) phases and UHF relay support once they are on the Martian surface. MRO’s high-resolution imagers are used to scout potential landing sites and certify safe zones for landing. As MRO begins its Fourth Extended Mission, the spacecraft remains fully capable of carrying out an ambitious science observing plan and the programmatic tasks assigned to it. In addition to highlighting recent discoveries of the mission, this paper describes recent challenges the spacecraft engineers have faced in flight and the plans for extending spacecraft life well into the 2020’s.

Tamppari, Leslie K.↗
NASA NTRS2017

Implementation of (O-)CGR in The ONE

Routing in Delay-/Disruption-Tolerant Networking (DTN) requires specific solutions as link impairments prevent the use of ordinary Internet algorithms, based on a timely dissemination of network topology information. Among DTN routing algorithms there is a dichotomy between opportunistic and deterministic (scheduled) solutions. The former are numerous and apply to terrestrial environments; CGR is the most widely supported algorithm designed for scheduled connectivity, and it is usually applied to space networks. However, in an attempt to provide a unified approach, an opportunistic variant of CGR, Opportunistic CGR (OCGR) has been recently proposed by some of the authors. Performance evaluations are normally carried out for opportunistic solutions by means of simulators, such as The ONE considered in this paper. CGR by contrast is more often studied by means of small testbeds. As the simulation approach could be complementary for CGR, and essential for OCGR, the authors have recently ported both of them into The ONE, by developing and releasing as free software a specific additional package. The aim of this paper is to show the rationale of this choice and discuss the many challenges that needed to be tackled to achieve this primary goal.

Tempesta, G.↗
NASA NTRS2021

Challenges and opportunities for enhancing food security and greenhouse gas mitigation in smallholder farming in sub-Saharan Africa. A review

Smallholder farmers struggle to achieve food security in many countries of sub-Saharan Africa (SSA). It is urgently required to find appropriate practices for enhancing crop production while avoiding large increases in greenhouse gas (GHG) emissions in SSA. This review aims to identify common smallholder farming practices for enhancing crop production, to assess how these affect GHG emissions and to identify strategies that not only enhance crop production but also mitigate GHG emissions in SSA. To increase crop production and ensure food security, smallholder farmers usually expand agricultural land, develop water harvesting and irrigation techniques and increase cropping intensity and fertilizer use. These practices may result in changing carbon stocks and GHG emissions, potentially creating trade-offs between food security and GHG mitigation. Agricultural land expansion at the expense of forests is the most dominant source of GHG emissions in SSA. While water harvesting and irrigation can increase soil organic carbon, they can trigger GHG emissions. Increasing cropping intensity can enhance the decomposition of soil organic matter, thus releasing carbon dioxide. Increasing nitrogen fertilizer use can enhance soil organic carbon, but also leads to increasing nitrous oxide emissions. An integrated land, water and nutrient management strategy is necessary to enhance crop production and mitigate GHG emissions. Among the most relevant strategies found, agroforestry practices in degraded and marginal lands could replace expanding agricultural croplands. In addition, water management, via adequate rainwater harvesting and irrigation techniques, together with appropriate nutrient management should be considered. Therefore, a land-water-nutrient nexus (LWNN) approach will enable an integrated and sustainable solution to increasing crop production and mitigating GHG emissions. Various technical, economic and policy barriers hinder implementing the LWNN approach on the ground, but these may be overcome through developing appropriate technologies, disseminating them through farmer to farmer approaches and developing specific policies to address smallholder land tenure issues and motivate long-term investment.

Sub-Sahara Africa↗
NASA NTRSDate not supplied

Coordinated analyses of hydrated Kuiper Belt dust

We report on coordinated mineralogical, chemical, and isotopic analyses of hydrated carbon-rich interplanetary dust particles (IDPs). We focus on hydrated IDPs that contain high solar flare track densities consistent with an origin in outer Solar System bodies such as Edgeworth-Kuiper belt objects (EKBOs) [1]. We are searching for evidence of the heavy water reservoir predicted by self-shielding models [2]. The IDPs were embedded in sulfur and microtome thin sections were obtained for Fourier-transform infrared (FTIR), transmission electron microscopy (TEM), and nanoSIMS analyses. The IDPs were only partly microtomed and the remainder was extracted from the sulfur and pressed into In or Au for high precision O isotopic analyses. The hydrated IDPs in this study are compact low-porosity objects with a mineralogy dominated by fine-grained saponite and lesser serpentine, Fe-Ni sulfides, Mg-Fe carbonates, rare crystaline silicates, and abundant organic matter. The C in the IDPs is abundant (typically >4X CI) and occurs as isolated nanoglobules and finely disseminated within the phyllosilicate matrix of the IDPs. TEM analyses of the nanoglobules show O-rich, S-depleted rims with higher carbonyl functionality than their cores. FTIR spectra show strong aliphatic C-H stretches consistent with the presence of short-chain aliphatic hydrocarbons in these IDPs. The oxygen isotopic compositions measured in 6 IDPs all plot within error of the CCAM line [3]. For several of the IDPs we were able to obtain multiple analyses. The ∆^(17)O values range from -23‰ up to +3.4‰ with most analyses clustering above the terrestrial fractionation line. The O isotopic compositions and the high C contents of these IDPs are distinct from known hydrated carbonaceous chondrites. The track-rich hydrated IDPs record parent body aqueous alteration effects through interactions with 16O-poor H2O on a EKBO parent body. The aqueous alteration activity likely resulted from the heat generated by collisional processes among EKBOs given that these objects are believed to have accreted late after the decay of 26Al [4].

Lindsay P. Keller↗
NASA NTRSDate not supplied

Identifying Emerging Safety Threats Through Topic Modeling in the Aviation Safety Reporting System: A Covid-19 Study

The NASA Aviation Safety Reporting System (ASRS) is a voluntary, confidential aviation safety reporting system. The ASRS receives reports from pilots, air traffic controllers, flight attendants, and others involved in aviation operations. The reports are de-identified and coded by ASRS expert safety analysts, and a short descriptive synopsis is written to describe the safety issue. The de-identified reports are then disseminated to the aviation community in many ways, including via an online database, Safety Alert Bulletins, For Your Information Notices, and the CALLBACK newsletter. In this work, we consider whether we can improve the grouping, linking, and understanding of safety concerns through topic modeling. Specifically, we use topic modeling as a building block to identify emerging safety threats over time. This unsupervised approach, we argue, offers the flexibility to identify new emerging themes in this large dataset by constructing different timelines based on the content similarity of ASRS report narratives. This method's unsupervised nature improves upon related research, which is limited to pre-defined labels and therefore can not fully capture emerging safety threats. We apply our method to all ASRS reports in 2020 to assess if the generated timelines can highlight COVID-19 as it is emerging as a safety threat in incoming ASRS reports. We perform both a quantitative and qualitative evaluation of the automatically constructed timelines. The qualitative evaluation is performed by describing the evolution of top terms in the timelines, generated by our method, which we found explicitly convey the themes of COVID-19. Separately, we use a set of 1,213 COVID-19 reports from 2020 that were manually identified by ASRS analysts to quantitatively evaluate the COVID-19 reports distribution across the timelines. Our results have shown that COVID-19 emergence can be identified using the top terms that were generated by topic modeling. The top terms in topic modeling therefore can serve as a summary alternative to manually inspecting reports. Moreover, leveraging the manually identified COVID-19 reports, we found the manually identified timelines accounted for over 70% of the COVID-19 reports curated by the ASRS analysts, which demonstrates the potential of this approach for facilitating the understanding of safety concerns as they emerge and evolve. This method shows great potential to understand aerospace safety threats and other narrative- driven incident report databases.

ASRS↗
NASA NTRS2020

Harnessing Big Data to Support the Conservation and Rehabilitation of Mangrove Forests Globally

Mangrove forests are found on sheltered coastlines in tropical, subtropical, and some warm temperate regions. These forests support unique biodiversity and provide a range of benefits to coastal communities, but as a result of large-scale conversion for aquaculture, agriculture, and urbanization, mangroves are considered increasingly threatened ecosystems. Scientific advances have led to accurate and comprehensive global datasets on mangrove extent, structure, and condition, and these can support evaluation of ecosystem services and stimulate greater conservation and rehabilitation efforts. To increase the utility and uptake of these products, in this Perspective we provide an overview of these recent and forthcoming global datasets and explore the challenges of translating these new analyses into policy action and on-the-ground conservation. We describe a new platform for visualizing and disseminating these datasets to the global science community, non-governmental organizations, government officials, and rehabilitation practitioners and highlight future directions and collaborations to increase the uptake and impact of large-scale mangrove research.

mangrove↗
NASA NTRS2021

GA-ASI Final Report and Program Wrap-up for NASA System Integration and Operationalization (SIO)

The NASA SIO demonstration flight of April 3, 2020 represents a successful culmination of 18 months of coordinated effort between GA-ASI, NASA, the FAA, Collins Aerospace, and Honeywell Aerospace to operate a Medium Altitude, Long Endurance (MALE) Unmanned Aircraft System (UAS) safely in the National Airspace System (NAS) using industry leading prototype technologies. The GA-ASI team consisted of technical experts, program managers, engineers, mechanics, flight technicians, flight crews, and numerous other subject matter experts. This final report describes the most significant and potentially impactful aspects of the planning, integration, test, and flight aspects of this effort. GA-ASI successfully integrated the key technologies needed for UAS to fly in the NAS onto our prototype SkyGuardian UAS, which was designed to meet the most stringent airworthiness standards applicable to an aircraft of its size category. A proven Detect and Avoid (DAA) system, developed by GA-ASI and utilizing Honeywell Aerospace technology was integrated onto SkyGuardian for the first time, along with datalink radios from Collins Aerospace that meet the new civil standard for Control and Non-Payload Communication (CNPC) links. GA-ASI also obtained approvals from the FAA and FCC to operate the reconfigured UAS. The SIO demonstration flight represented a commercial aerial surveying operation conducted at medium altitude (>10,000ft above mean sea level). The aircraft’s onboard sensors were used to capture photographic, infrared and radar imagery of public and commercial infrastructure and land, and to subsequently produce the types of data products that would provide business value to potential customers. These survey services would supplement or replace services currently provided by manned airplanes and helicopters, small drones or satellites. A “virtual” mission was also planned, to show what additional survey data could have been captured during the flight if additional sensors had been installed on the aircraft’s external hardpoints. This revision of the final report focuses on information of value to the wider UAS community, and avoids propriety data to facilitate broad dissemination. It also includes a description of GA-ASI’s engagement with the FAA following the SIO flight, which led to the award of an updated Special Airworthiness Certificate in the Experimental Category (SAC-EC) and a Certificate of Waiver or Authorization (COA) allowing operation of the SkyGuardian UAS using its DAA system to satisfy right-of-way rules, instead of a chase plane. The associated operational limitations are described to illustrate the further steps that would be needed to remove those limitations for unhindered commercial operations.

Flight demonstration↗
NASA NTRS2020

PERSIANN Dynamic Infrared–Rain Rate (PDIR-Now): A Near-Real-Time, Quasi-Global Satellite Precipitation Dataset

This study presents the Precipitation Estimation from Remotely Sensed Information Using Artificial Neural Networks–Dynamic Infrared Rain Rate (PDIR-Now) near-real-time precipitation dataset. This dataset provides hourly, quasi-global, infrared-based precipitation estimates at 0.04° × 0.04° spatial resolution with a short latency (15–60 min). It is intended to supersede the PERSIANN–Cloud Classification System (PERSIANN-CCS) dataset previously produced as the near-real-time product of the PERSIANN family. We first provide a brief description of the algorithm’s fundamentals and the input data used for deriving precipitation estimates. Second, we provide an extensive evaluation of the PDIR-Now dataset over annual, monthly, daily, and subdaily scales. Last, the article presents information on the dissemination of the dataset through the Center for Hydrometeorology and Remote Sensing (CHRS) web-based interfaces. The evaluation, conducted over the period 2017–18, demonstrates the utility of PDIR-Now and its improvement over PERSIANN-CCS at all temporal scales. Specifically, PDIR-Now improves the estimation of rain/no-rain days as demonstrated by a critical success index (CSI) of 0.53 compared to 0.47 of PERSIANN-CCS. In addition, PDIR-Now improves the estimation of seasonal and diurnal cycles of precipitation as well as regional precipitation patterns erroneously estimated by PERSIANN-CCS. Finally, an evaluation is carried out to examine the performance of PDIR-Now in capturing two extreme events, Hurricane Harvey and a cluster of summer thunderstorms that occurred over the Netherlands, where it is shown that PDIR-Now adequately represents spatial precipitation patterns as well as subdaily precipitation rates with a correlation coefficient (CORR) of 0.64 for Hurricane Harvey and 0.76 for the Netherlands thunderstorms.

Rainfall↗
NASA NTRSDate not supplied

GL4U: Training the next generation of bioinformaticians, one omics datatype at a time

Spaceflight modifies gene expression in every organism examined to date, including humans. Understanding how these gene expression changes affect physiology is crucial for the development of countermeasures to enable long-duration manned missions. NASA’s GeneLab project provides researchers open access to multi-omics data, including genetic and gene expression data, from spaceflight experiments that can be mined to understand the effects of spaceflight on biological systems. To ensure new knowledge generation through data re-use, it is important to maximize the number of scientists who utilize GeneLab data. Training students on the GeneLab platform is the best way to create long-term adopters of this NASA database and its tools. Turning students into future instructors and advocates will also accelerate the dissemination of these data and tools to the broader scientific community. Therefore, in collaboration with the GeneLab Educational Working Group (EWG), GeneLab has created GeneLab for Colleges and Universities (GL4U). GL4U provides space biology-relevant training in bioinformatics to the next generation of scientists through direct and indirect approaches. The GeneLab team plans to host two annual data processing bootcamps, one for college-level students (direct) and one for college educators (indirect – training of trainers), in which participants learn to analyze GeneLab’s space-relevant omics data. During the bootcamp, educators will receive materials and training to enable them to run the bootcamp at their home institutions or alternatively to adapt the content to implement within existing courses, thereby extending the reach of this initiative. The GL4U direct training pilot program was conducted in June 2021 in collaboration with USRA and San Jose State University (SJSU). During the pilot, SJSU students participated in a week-long bootcamp consisting of space biology-specific lectures and hands-on instruction using Jupyter Notebooks to analyze RNA sequence data. This pilot demonstrates the capacity of GL4U for training young scientists and encouraging data re-use.

Jonathan Matthew Galazka↗
NASA NTRSDate not supplied

Recent Discoveries in Simulant Behavior and Regolith Handling

The past few years have seen an exciting increase in visibility for the use of in-situ resources to achieve sustainability at the Moon and Mars. This visibility and inclusion in the mission architectures has led to an explosion in the research and development of mining and processing of regolith at the Moon. However, there are still many fundamental issues regarding digging, transporting, and processing of lunar and Mars regolith that may slow the progress by multiple teams who need to understand these issues before proceeding with hardware development. The objective of this project is to utilize the same team of soil and thermal experts and unique facilities to allow for efficient and fast generation of fundamental data and dissemination of critical results to the larger community. The capability gaps being addressed include how to dig up hard, frozen resources, transport to the processing site, lifting/depositing into a hopper or reactor, and extracting the water, all without losing the primary product to the environment. Soil Seals: Much attention has been focused on the challenges with regolith inlet/outlet valves that must seal in process gases after being repeatedly ex-posed to abrasive regolith and dust particles. One possible solution that has been proposed is to design the inlet hopper or duct such that the bulk of regolith pro-vides sufficient sealing of the reactor. Tests are planned to parametrically measure the maximum del-ta-pressure that can be maintained across a column of soil before ‘blow-out’ occurs. Variables to be examined include column height and width, simulant type, and compaction.

Simulant↗
NASA NTRS2021

Perceive: Proactive Exploration of Risky Concept Emergence for Identifying Vulnerabilities & Exposures

National databases that collect various kinds of textual threat reports such as ASRS, CERT, and NVD manually process their reports individually. They then offer data products to disseminate the aggregate information, like newsletters, alerts or individual report searching. The goal of this research is to connect these individual reports thematically and temporally to identify emerging or recurring threats, by analyzing large collections of text, source code, collaboration and communication patterns. This capability, I argue, enables us to identify the emergence and recurrence of such themes, and the contexts in which they re-occur, facilitating faster and more capable mitigation. I propose two models to shed light on this goal: An empirical model of vulnerabilities as bugs, the commit flow model, and one of the vulnerabilities and aviation safety threats as topics, the topic flow model. I use as gold standard existing manual workflows in both domains, reflected in the existing data products by these organizations, and empirically evaluate if the automated model scan match or outperform existing manual practices.

ASRS↗
NASA NTRSDate not supplied

Improving Geolocation Accuracy of the Advanced Meteorological Imager on the GEO-KOMPSAT-2A

GeoNEX is a collaborative project led by scientists from NASA and many other international institutes to generate Earth monitoring products using data streams from the latest geostationary (GEO) sensors. Its consistent processing and common gridding systems can produce research-quality data products from GEO sensors and leverage GEO-GEO or GEO-LEO (low earth orbit) synergistic uses. Currently, GeoNEX has produced and disseminated L1G (geometrically corrected Level 1 products) from GOES 16/17 ABIs and Himawari-8 AHI, but a new Korean geostationary sensor (Advanced Meteorological Imager, AMI) onboard Geo-KOMPSAT-2A covering a large proportion of Asia and all of Oceania is in development. Our recent efforts on assessing geolocation accuracy in ABI and AHI suggest a nontrivial residual exists in both level 1B data with varying spatiotemporal patterns. The findings urge us to prioritize identifying and correcting geolocation residuals of AMI to generate accurate and consistent GeoNEX top-of-atmosphere (TOA) reflectance products and following processing chains. Here we implement a phase correlation correction approach to a visible band (0.64 μm, 500 m) using landmarks prepared from finer scale digital terrain models. We characterize spatiotemporal patterns (e.g., diurnal & daily) of geolocation residuals of AMI before and after correction. We then assess stability of datasets and quantify impact of unexpected geolocation errors on terrestrial monitoring. The geolocation corrected AMI data are further compared with GeoNEX AHI L1G products which are able to create unique stereo-type observations with AMI through leveraging the similarities of spectral bands and the sun-target-sensor geometry. Further, we discuss challenges in utilizing the GEO-GEO (e.g., AMI & AHI) satellite data for potential applications.

Geostationary Satellites↗
NASA NTRS2021

Crop-CASMA - A Web GIS Tool for Cropland Soil Moisture Monitoring and Assessment Based on SMAP Data

Timely, frequent, and complete cropland soil moisture information acquired throughout the growing season is critical for agricultural policy, production, food security, and food prices. The NASA Soil Moisture Active and Passive (SMAP) mission provides a reliable data source for cropland soil moisture assessment. This paper presents Crop-CASMA- a web GIS application tool for cropland soil moisture monitoring and assessment based on SMAP data. This interactive Web service-based GIS application tool enables CONUS SMAP derived soil moisture data visualization, dissemination, and analytics. In this paper, we describe the Crop-CASMA application system architecture, the application implementation, and the data it serves. In addition, we also present a few snapshots of the Crop-CASMA data for cropland soil moisture monitoring. The release of Crop-CASMA greatly enhances the user experience and facilitates using soil moisture data products for crop condition monitoring and decision support.

Zhengwei Yang↗
NASA NTRS2021

PyHC Integration Strategy Workshop Report

We present a report on the 2021 PyHC (Python in Heliophysics Community) virtual workshop held August 30-31st, 2021. This workshop pulled together leading developers in PyHC to discuss how the community could improve integration between PyHC projects by uncovering high-value shared (or "key") challenges and suggested possible solutions to these challenges. The results of the workshop show that there are many potential concrete actions which could be taken to improve PyHC software and their associated projects. Key challenges may be grouped into items which involve sustaining/improving/expanding the community, improving information dissemination and undertaking technical goals to better integrate and coalesce projects. Suggested solutions to challenges ranged from smaller and/or straight forward efforts to more detailed, long-term solutions.

Heliophysics↗
NASA NTRSDate not supplied

Lessons Learned in the Implementation of a Training Knowledge Management System for the SERVIR Network

The SERVIR program is a unique partnership between NASA, the U.S. Agency for International Development (USAID), focusing on building capacity to use Earth observations for addressing development challenges. In that context, between 2004 and 2020, the program delivered approximately 365 trainings to almost 10,000 professionals. More recently, between November 2020 and August 2021, the SERVIR network executed some 55 training events addressing SERVIR’s 4 priority thematic areas, and roughly a quarter of SERVIR trainings overall have focused on themes related to Ecological Forecasting. Due to the ongoing COVID-19 pandemic, almost four-fifths of recent training events have been virtual, with the remainder being in-person under limited circumstances. The large number of training events delivered represents both an opportunity and a challenge in terms of knowledge management. While the training materials developed can later be reused in other parts of the SERVIR network, prior to recently, the lack of a central repository for those materials has prevented wider dissemination and use. The recently developed Training Knowledge Management System (TKMS) is now becoming an integral part of the SERVIR Capacity Building Framework, supporting the exchange of resources and methods for conducting training activities across the network. This presentation focuses on the structure of this system, as well as on the anticipated benefits for the User Communities for Earth Observations of Terrestrial Systems.

training↗
NASA NTRS2021

Developing a strategy for the national coordinated soil moisture monitoring network

Soil moisture is a critical land surface variable, affecting a wide variety of climatological, agricultural, and hydrological processes. Determining the current soil moisture status is possible via a variety of methods, including in situ monitoring, remote sensing, and numerical modeling. Although all of these approaches are rapidly evolving, there is no cohesive strategy or framework to integrate these diverse information sources to develop and disseminate coordinated national soil moisture products that will improve our ability to understand climate variability. The National Coordinated Soil Moisture Monitoring Network initiative has developed a national strategy for network coordination with NOAA's National Integrated Drought Information System. The strategy is currently in review within NOAA, and work is underway to implement the initial milestones of the strategy. This update reviews the goals and steps being taken to establish this national-scale coordination for soil moisture monitoring in the United States.

Michael H. Cosh↗
NASA NTRSDate not supplied

A Survey Protocol to Assess Meaningfulness and Usefulness of Automated Topic Finding in the NASA Aviation Safety Reporting System

Context: The NASA Aviation Safety Reporting System (ASRS) is a voluntary confidential aviation safety reporting system. The ASRS receives reports from pilots, air traffic controllers, flight attendants and other involved in aviation operations. The reports are de-identified and coded by ASRS expert safety analysts and a short descriptive synopsis is written to describe the safety issue. The de-identified reports are then disseminated to the aviation community in a number of ways including entry into an online database, Safety Alert Bulletins and For Your Information Notices, and the CALLBACK newsletter. Key to these publications are the timely processing (de-identification, coding and summarization) of new reports, which is currently done by ASRS expert safety analysts. Thus, we believe topic modelling could decrease effort in ASRS, if topics are comprehensible. Aim: We propose a methodology to evaluate whether automated topic finding using topic modelling provides meaningful and useful topics. Method: We extend the total error survey methodology to evaluate user topic comprehension of machine learning outputs. To accomplish this we performed a literature review to identify existing methods and define a construct for topic comprehension, utilizing existing ASRS synopsis writing practices to more precisely define meaningfulness and usefulness. Results: A survey protocol was created that addresses the limitations of other survey protocols found in the literature review, which we found lacking in rationale and clear protocol definition. Conclusion: The surveying of user understanding in machine learning outputs presents challenges due to the explosion of parameters to control for and the lack of systematic approach presented in the literature. More reproducible work and survey protocols are needed in the literature and our work is one step towards that direction.

topic finding↗