Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “TRUST”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 649 records · Page 36

Shift Happens: Building Robust AI Models with Domain Adaptation

Artificial Intelligence (AI) is revolutionizing physics research—from probing the large-scale structure of the Universe to modeling subatomic interactions and fundamental forces. Yet, a major challenge persists: AI models trained on simulations or old experiment / astronomical survey often perform poorly when applied to new data—exposing issues of dataset (domain) shift, model robustness, and uncertainty in predictions. This summer school session will introduce students to common challenges in applying AI across domains and present solutions based on domain adaptation—a set of techniques designed to improve model generalization under domain shift. We will cover foundational ideas, practical strategies, and current research frontiers in this area. Through examples in astrophysics, we'll explore how domain adaptation can help bridge the gap between synthetic and real-world data, improve trust in model outputs, and advance scientific discovery. The concepts discussed are broadly applicable across physics and other scientific disciplines, making this a valuable topic for anyone interested in building robust, transferable AI models for science.

Ciprijanovic, A. [Fermilab] (ORCID:000000031281719↗

AI in Astrophysics: Tackling Domain Shift, Model Robustness and Uncertainty

Artificial Intelligence (AI) is revolutionizing physics research from probing the large-scale structure of the Universe to modeling subatomic interactions and fundamental forces. Yet, a major challenge persists: AI models trained on simulations or old experiment / astronomical survey often perform poorly when applied to new data exposing issues of dataset (domain) shift, model robustness, and uncertainty in predictions. This talk will introduce common challenges in applying AI across domains and present solutions based on domain adaptation a set of techniques designed to improve model generalization under domain shift. We will cover foundational ideas, practical strategies, and current research frontiers in this area. Through examples in astrophysics, we'll explore how domain adaptation can help bridge the gap between synthetic and real-world data, improve trust in model outputs, and advance scientific discovery.

Ciprijanvoic, Aleksandra [Fermilab] (ORCID:0000000↗

Outcomes of PAX sapiens-Supported Global Wildlife Data Sharing Conferences for Enhanced One Health Security (GWDSC)

Across two consecutive Global Wildlife Data Sharing Conferences supported by PAX sapiens—Year 1 (May 2024) at Pacific Northwest National Laboratory and Year 2 (2025) in Ciudad Real, Spain—the initiative converted wildlife data sharing from aspiration into operational reality, producing measurable impacts in platform development, data mobilization, standards harmonization, and international partnership formation. The conferences addressed a critical gap in global health security: while 75% of emerging infectious diseases affect both humans and animals and over 60% originate in wildlife, wildlife health surveillance has historically lagged behind human and agricultural sectors due to fragmented databases, inconsistent terminology, uneven capacity, and limited cross-border coordination. By convening practitioners, government agencies, international organizations, academic institutions, and NGOs, the GWDSC catalyzed trust-based relationships and practical workflows that enable earlier detection, better risk assessment, and more effective prevention of threats at the wildlife–domestic animal–human–environment interface.

54 ENVIRONMENTAL SCIENCES↗

Reese Housing Power Project (Final Technical Report)

The Reese Housing Power Project is located on Tribal trust land in Colusa, CA and expands existing medium-voltage distribution to seven new households with the addition of medium-voltage cabling, step down transformers, smart meters, and street lighting for the new development. The Tribe utilized their existing Co-Generation power plant and micro grid to supply the new homes with highly reliable power with fewer interruptions and at a reduced rate compared with the local utility. The project gives the Tribe greater independence from traditional power sources and provides jobs for the community. The project reduces electric energy costs, increases Tribe self-reliance, and provides highly reliable electric power to seven tribal members’ homes. Construction of the project also provided jobs for the community.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Corral Summit Pumped Storage Hydropower Hybrid: Site Suitability Assessment

In 2024, Idaho National Laboratory (INL) and Pacific Northwest National Laboratory (PNNL) initiated a technical-assistance project to support Cat Creek Energy, LLC, (CCE) in evaluating site suitability for the proposed Corral Summit Pumped Storage Hydropower (PSH) project in south-central Idaho near Mackay Reservoir. The Corral Summit facility incorporates battery storage and photovoltaic (PV) solar arrays in a Trybrid configuration to deliver large-volume long-duration (LVLD) storage solutions for rural electric cooperatives in eastern Idaho. The evaluation process focused on determining the most-suitable location for the upper reservoir of the PSH system, guided by a comprehensive assessment framework spanning multiple categories, including physical characteristics, environmental constraints, building infrastructure, regulatory constraints, cultural resources and sensitivity, social factors, and power market and grid integration. Each site was analyzed based on a ranking scale (0–1), which scores ranging from “severely disfavored” to “highly favored,” allowing detailed comparisons of site-specific conditions. Categories such as hydraulic head, utilities corridor, land ownership, and transmission-grid limitations emerged as key contributors to the overall assessment. Site 2 (Idaho Trust) demonstrated a slight advantage over Site 1 (Bureau of Land Management) primarily due to favorable outcomes in regulatory constraints, building infrastructure, and power-market integration. However, Site 1 outperformed Site 2 in factors related to physical characteristics and social factors. The report emphasizes the need for further evaluation of both sites before clear determination of which site is preferred, due to the limited information available on either site at the time of this report. Key areas of evaluation to clearly define the preferred site are ecological impacts, cultural-resource surveys, and economic-feasibility assessments. For successful project execution, recommended follow-up actions include seismic and geotechnical surveys, groundwater and habitat monitoring, regulatory reviews of water rights and right-of-way agreements, cultural engagement with local tribal governments, and enhanced stakeholder strategies. These efforts will ensure the Corral Summit Trybrid facility meets local energy needs while balancing environmental, social, and regulatory responsibilities.

13 - HYDRO ENERGY↗

Utilizing Time Reversal Ultrasonics to Detect the Removal of Nuclear Materials from Geological Repositories (FY26 Mid-Year)

Detecting unauthorized nuclear material removal from storage environments, such as geological repositories, is a critical safeguards task essential to ensuring the integrity and non-diversion of nuclear materials. However, this process is fraught with significant technical challenges. Storage configurations often involve tightly packed nuclear material containers or obstructed environments, making detection of removal events exceedingly difficult. Optical surveillance cameras, which are commonly used for monitoring, suffer from substantial limitations, including restricted coverage, reliance on line-of-sight measurements, and vulnerability to environmental conditions in certain storage scenarios. As the global inventory of monitored nuclear materials increases and storage configurations become more complex— such as deep geological repositories, inaccessible storage vaults, and tightly packed containers—there is an urgent need for innovative detection technologies that can reliably identify unauthorized diversion events in these challenging environments. The challenge of detecting nuclear material removal in complex storage environments is both significant and urgent. Preventing unauthorized access, diversion, or tampering with nuclear materials is a cornerstone of global nuclear safeguards and nonproliferation efforts. Current detection methods are increasingly inadequate as storage configurations become more intricate and inaccessible. The limitations of existing technologies—such as their inability to detect changes behind obstructions, reliance on costly and labor-intensive processes, and vulnerability to environmental conditions—pose risks to the effectiveness of safeguards systems. Addressing this challenge is critical to maintaining international trust in nuclear safeguards frameworks and ensuring compliance with nonproliferation agreements. Our project builds on the proven concept of TRU technology that can address this unmet need. TRU has demonstrated exceptional spatial sensitivity and change detection capabilities in complex non-line-ofsight environments, making it uniquely suited for detecting unauthorized nuclear material removal in challenging storage configurations. Unlike optical methods, TRU is not limited by line-of-sight constraints or environmental conditions, enabling reliable detection of subtle alterations even behind obstructions. By leveraging TRU’s ability to identify removal or tampering events, we aim to develop a robust detection system that enhances safeguards in geological repositories, storage vaults, and other complex environments.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

Technical Assessment of the Application of Digital Twin and Prognostic Tools for Condition Monitoring

This report was prepared for the U.S. Nuclear Regulatory Commission (NRC) to present use cases of the application of advanced technologies toward meeting the current and future regulatory requirements for maintenance and condition monitoring of structures, systems, and components (SSCs). The advanced technologies considered in this work, collectively referred to as digital twin (DT) technologies, are advanced sensors and instrumentation, data analytics, machine learning and artificial intelligence (ML/AI), and physics-based models. The report presents two use cases of reactor coolant pumps (RCPs) and heat pipes in nuclear power plants (NPPs) with technical and regulatory considerations and opportunities in using advanced technologies for conditional monitoring. Key findings from the exploration of these considerations are as follows: - Uncertainties in sensor data and model predictions must be rigorously addressed through validation and verification processes - Regulatory compliance is paramount, necessitating data driven models to be developed in line with existing codes and standards, as well as considering potential future guidelines for advanced reactors - Explainability and transparency in ML/AI models are essential for developing operator trust and regulatory review, including methods that enhance the interpretability of complex data-driven predictions - Condition monitoring programs must be evaluated for their effectiveness in reducing maintenance-preventable function failures (MPFF) and aligning with plant performance criteria - The deployment of advanced technologies for condition monitoring could lead to a transition from periodic to continuous monitoring, thereby optimizing maintenance schedules - Collaborative efforts between industry stakeholders, regulatory bodies, and technology developers are crucial for the successful adoption of advanced technologies for condition monitoring systems in nuclear facilities In summary, the introduction of advanced technologies into condition monitoring programs represents a significant leap forward in the domain of NPP maintenance. By harnessing the capabilities of advanced sensors, data analytics, and ML/AI, NPP operators can transition from a time-based to a condition-based maintenance approach. This shift can potentially enhance the reliability and safety of critical plant components while optimizing maintenance efforts and minimizing unnecessary outages. The NRC is continuing to explore the regulatory aspects of advanced technologies as part of inservice inspection and inservice testing (ISI and IST) programs by pursuing additional research in this technical area.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗

PV Operations Software Transparency: A PVMAC Industry Snapshot

The rapid growth of photovoltaic (PV) deployment has increased reliance on software platforms for monitoring, workflow automation, diagnostics, and performance analytics. As these tools play a central role in asset management and operations and maintenance (O&M), greater transparency in methodologies, data handling, and validation practices benefits the broader PV ecosystem. To better understand current practices and identify opportunities for improved clarity and interoperability, 24 software providers contributed detailed responses through the PV O&M Analytics Collaborative (PVMAC) initiative, the first structured questionnaire of its kind in the industry, covering onboarding, interoperability, data quality, diagnostics, AI/ML, and other operational categories. These providers represent over 1.1 TW of solar assets under management. The analysis shows broad adoption of digital twins, AI/ML, and API integrations, but also highlights challenges in onboarding processes, inconsistent definitions and methodologies, variability in key performance indicator (KPI) calculations, and limited independent validation. Greater standardization, clearer documentation, and stronger validation frameworks could improve transparency, comparability, and trust across PV operations software platforms.

14 SOLAR ENERGY↗

Yet Another NLA Library: T-LAPACK

In recent years, Randomized numerical linear algebra (RandNLA) proved to be more than a theoretical novelty: projects like RandLAPACK demonstrate its practical value across architectures, and projects like RandBLAS build trust in randomization as a tool for high-performance NLA. This BoF considers two main questions. First, what are the pressing issues in software standards and implementation that need to be resolved for RandNLA to become a core component of HPC? Second, how can we mobilize a community effort to make progress on these issues? The BoF will engage the audience to discuss the idea of growing the role of RandNLA in high-performance computing and what it would take to scale from niche prototypes to robust, production-quality software libraries.

97 MATHEMATICS AND COMPUTING↗

Supplement Analysis for the Proposed Shipment of High Burnup Research Cask to Idaho National Laboratory for Research and Development Purposes

DOE needs to continue with the HBUSFDP and transfer the HBURC to a facility capable of examination and testing of HBU SNF. These types of facilities do not exist at NAPS but are available at DOE national laboratories. The removal and eventual opening of the TN-32B research cask will provide DOE with the opportunity to gather data that will support continued safe storage of SNF at existing nuclear power plants, or a future federal consolidated storage facility. This effort will also help build public trust and confidence by demonstrating DOE’s ability to safely and securely transport commercial SNF using the certified Atlas rail consist.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

What Is the Agent Doing? Visualizing Agentic AI Querying Workflows

We explore how visualizations can help users understand what an AI agent is doing as it builds and runs queries over data. As part of the LinkQ system, a natural language interface for querying knowledge graphs with a large language model (LLM), we designed two complementary views: A State Diagram that shows where the agent is within a larger workflow, and a Live Action Display that gives real-time updates about the agent's current task. In a study with 14 practitioners, we found that these visuals helped participants build stronger mental models of the agent's behavior while also increasing their confidence in the system. However, we also observed that users sometimes trusted incorrect outputs simply because the agent appeared to be doing the "right" thing. Our findings point to both the value and risk of visualizing agent behavior in interactive AI systems.

97 MATHEMATICS AND COMPUTING↗

Product Defect Detection System: SYSM- 5620 Final Project

Retail sales is a growing market estimated to up to seven percent year over year. With this growing market there is also a trend in growing rate of retail returns, estimated just last year at $\$$850 billion. Retail stores must ensure that products available for purchase remain safe, undamaged, and acceptable to customers throughout their time in the store. This job exists regardless of the specific solution used because stores are always responsible for preventing damaged or defective products from reaching customers and when they fail to this is categorized under operation inefficiencies which accounts for an estimated $\$$12 billion in returns. When defective items remain on the sales floor, stores may experience increased returns, reduced customer satisfaction, loss of customer trust, and potential safety concerns depending on the product type. As a result, the core job to be done is to identify defective products quickly, remove them from the sales floor before they are purchased, and preserve useful information about the defect so that the store can improve its handling, stocking, and supplier coordination over time. The need for a more reliable process is especially important in high volume retail environments where employees manage large numbers of products across many aisles, shelves, and storage areas. In these settings, manual inspection alone can be inconsistent and difficult to sustain at the individual item level. At the same time, broader retail trends continue to emphasize operational efficiency, product visibility, and improved customer experience, creating an opportunity for more automated and data driven defect detection methods.

42 ENGINEERING↗

DOE BSSD Performance Management Metrics Report Q2

The vision of the National Microbiome Data Collaborative (NMDC) centers on the concept of connecting data, people, and ideas to advance microbiome innovation and discovery. Building data infrastructure, while key to NMDC’s ability to execute on our vision, can only go so far in creating scientific impact. By fostering strong community partnerships and developing a set of robust community outreach and training programs, we are able to turn our products – the Submission Portal, NMDC EDGE, and the Data Portal – into tools that empower the scientific community. Our multi-pronged community building approach spans individual researchers, research teams, consortia and scientific societies, and institutions and federal agencies. To foster a collaborative and inclusive community-centered environment, we have identified three strategic objectives to promote an inclusive and connected community: (1) recognize and support the diverse research needs and perspectives of the microbiome research community; (2) promote best practices across the microbiome community, from researchers to funders, through community-driven practices (FAIR, CARE, and TRUST); and (3) build a microbiome ecosystem that enables scientific discovery and innovation across stakeholders. These strategic objectives allow our team to focus on impact across a diverse range of activities, from launching the American Society for Microbiology (ASM) Microbiome Data Prize to supporting the Ambassador and Champions programs fostering learning and building a collaborative network. We broadly communicate our work through social media (X/Twitter, LinkedIn, and Instagram), The Microbiome Standard (our quarterly newsletter), and Annual Reports. All our work is underpinned by a strong commitment to diversity, equity, and inclusion as articulated in our Action Plan that tracks progress towards key metrics. A core component of our engagement strategy is user research. User research ensures the Submission Portal, NMDC EDGE, Data Portal, and the new Field Notes mobile app are designed with and for the scientific community. Our user research efforts consist of asking researchers exploratory questions to collect information on researcher priorities, methodologies, and perceptions to ensure that we are aware of the current state of microbiome research. Our usability testing provides researchers with prototypes or test environments of the NMDC products, and we capture valuable information on how users interact with the products to make improvements. Given the diverse nature of microbiome work, we acknowledge that we are not aware of all pressing data challenges and thus rely on the research community to help us identify the most important issues to prioritize. To date, we have conducted 24 interviews and one beta-testing call with 10 participants across all NMDC products, which have generated 321 insights and 120 action items. Herein, we describe the ways we engage with the microbiome research community to advance the NMDC mission.

59 BASIC BIOLOGICAL SCIENCES↗

Corral Summit Pumped Storage Hydropower Hybrid Site Suitability Assessment (Rev.1)

In 2024, Idaho National Laboratory (INL) and Pacific Northwest National Laboratory (PNNL) initiated a technical-assistance project to support Cat Creek Energy, LLC, (CCE) in evaluating site suitability for the proposed Corral Summit Pumped Storage Hydropower (PSH) project in south-central Idaho near Mackay Reservoir. The Corral Summit facility incorporates battery storage and photovoltaic (PV) solar arrays in a Trybrid configuration to deliver large-volume long-duration (LVLD) storage solutions for rural electric cooperatives in eastern Idaho. The evaluation process focused on determining the most-suitable location for the upper reservoir of the PSH system, guided by a comprehensive assessment framework spanning multiple categories, including physical characteristics, environmental constraints, building infrastructure, regulatory constraints, cultural resources and sensitivity, social factors, and power market and grid integration. Each site was analyzed based on a ranking scale (0–1), which scores ranging from “severely disfavored” to “highly favored,” allowing detailed comparisons of site-specific conditions. Categories such as hydraulic head, utilities corridor, land ownership, and transmission-grid limitations emerged as key contributors to the overall assessment. Site 2 (Idaho Trust) demonstrated a slight advantage over Site 1 (Bureau of Land Management) primarily due to favorable outcomes in regulatory constraints, building infrastructure, and power-market integration. However, Site 1 outperformed Site 2 in factors related to physical characteristics and social factors. The report emphasizes the need for further evaluation of both sites before clear determination of which site is preferred, due to the limited information available on either site at the time of this report. Key areas of evaluation to clearly define the preferred site are ecological impacts, cultural-resource surveys, and economic-feasibility assessments. For successful project execution, recommended follow-up actions include seismic and geotechnical surveys, groundwater and habitat monitoring, regulatory reviews of water rights and right-of-way agreements, cultural engagement with local tribal governments, and enhanced stakeholder strategies. These efforts will ensure the Corral Summit Trybrid facility meets local energy needs while balancing environmental, social, and regulatory responsibilities.

13 - HYDRO ENERGY↗

Scaling Sustainable Biochar Research & Commercialization for Agriculture & Conservation: A Summary from a Stakeholder Convening

Biochar is a carbon-rich substance with the potential to increase soil carbon sequestration, reduce greenhouse gas (GHG) emissions and improve soil health. When used as part of soil health management systems, biochar can provide multiple synergistic benefits for the agricultural sector and society, while also supporting the production of renewable, climate-neutral biofuels. Establishing a pyrolysis biochar bioenergy industry (PBBI) is necessary to harness the environmental benefits of biochar. To galvanize the necessary coordination to support a PBBI, the Foundation for Food & Agriculture Research (FFAR), the National Center for Appropriate Technology (NCAT), and American Farmland Trust (AFT) co-hosted a virtual convening event on biochar research and commercialization in March 2022. Participants represented a diverse set of stakeholders, including biochar producers, agricultural producers, and members of nonprofit, industry and government agencies. This whitepaper offers a summary of the convening, as well as insights from subsequent stakeholder engagement. Sustainably sourced, fit-for-purpose biochar can be a powerful tool in the soil health management systems and climate-smart toolbox, with decades of research supporting the soil, environment, production, and climate benefits. However, because biochar represents a range of feedstocks, processes and products, there is a critical need to: • Coordinate efforts to characterize and test the application of biochar types across locations with diverse soil and management conditions • Address research and decision-support gaps • Support the growing industry These objectives can be addressed or advanced through a coordinated strategy. To support establishment of this strategy, the convening participants identified key gaps in implementation and research. The experiences of foresters, ranchers, and farmers already using biochar, some of whom participated in the convening, helped inform priorities. Key gaps include: • Practical, applied on-farm research • Supporting management for agricultural productivity • Maximum benefits for conservation • Decision support • Life Cycle Assessment (LCA) • Quantification of climate mitigation potential Existing research gaps include: • Potential synergies among biochar, soil organic matter, and enhanced rock weathering • Development of new storage reservoirs for biochar in industrial products Convening participants further provided next steps for rapidly developing a PBBI to produce sustainable, fit-for-purpose biochars that increase soil health and mitigate climate change. Participants also stressed the need for actionable, coordinated, large-scale research relevant to commercial production in the next five years. To have a chance to reduce greenhouse gas emissions, we need an array of tools that would aid in mitigation; a coordinated strategy to enable biochar to be an effective tool in the climate-smart toolbox must be created; We cannot wait 50 years.

54 ENVIRONMENTAL SCIENCES↗

Best Practices for Grid Communications

As the grid evolves, the communications architecture will need to evolve with it. That architecture affords a structured means by which the evolving complexities of the modern electric grid can be managed. This document provides best practices that can be implemented in the grid of today and evolve towards the grid and grid architecture of the future. The evolving grid and its control communications increasingly rely on commercial communications providers and a variety of technologies, from wireless (e.g., 5G, microwave, Wi-Fi) to wireline (fiber, copper) to radio communications (P25, other repeater-based systems), and all these communications systems rely on electric power. A reliable and resilient grid must account for this complex set of interdependencies in its planning activities, especially those involving restoration and recovery. The participation of all relevant parties in both planning and exercising of plans can prevent unexpected conditions that impede the reliable operation and recovery of the grid. Best practices for grid communications include using a Network Management System to document the operational state, define and monitor baselines, detect changes, and accelerate response to abnormalities. If transitioning from SONET to IP/packet-based systems, translating grid requirements into communications requirements for latency, bandwidth and throughput, IP packet delay variation, packet loss, and availability should inform and drive technology planning and selection as well as that communication system’s Quality of Service (QoS) policies and Service Level Agreements (SLAs). Secure and reliable timing is another key component of a reliable and resilient grid that can operate through adverse events. A trusted internal NTP configuration, an integrated and diverse timing delivery system, optimizing the timing architecture based on the transport technologies of the communications system, and using established standards can deliver the level of timing accuracy required by a range of time-sensitive power system applications.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Explainable Artificial Intelligence Recommendation System by Leveraging the Semantics of Adverse Childhood Experiences: Proof-of-Concept Prototype Development

The study of adverse childhood experiences and their consequences has emerged over the past 20 years. Although the conclusions from these studies are available, the same is not true of the data. Accordingly, it is a complex problem to build a training set and develop machine-learning models from these studies. Classic machine learning and artificial intelligence techniques cannot provide a full scientific understanding of the inner workings of the underlying models. This raises credibility issues due to the lack of transparency and generalizability. Explainable artificial intelligence is an emerging approach for promoting credibility, accountability, and trust in mission-critical areas such as medicine by combining machine-learning approaches with explanatory techniques that explicitly show what the decision criteria are and why (or how) they have been established. Hence, thinking about how machine learning could benefit from knowledge graphs that combine “common sense” knowledge as well as semantic reasoning and causality models is a potential solution to this problem. In this study, we aimed to leverage explainable artificial intelligence, and propose a proof-of-concept prototype for a knowledge-driven evidence-based recommendation system to improve mental health surveillance. We used concepts from an ontology that we have developed to build and train a question-answering agent using the Google DialogFlow engine. In addition to the question-answering agent, the initial prototype includes knowledge graph generation and recommendation components that leverage third-party graph technology. To showcase the framework functionalities, we here present a prototype design and demonstrate the main features through four use case scenarios motivated by an initiative currently implemented at a children’s hospital in Memphis, Tennessee. Ongoing development of the prototype requires implementing an optimization algorithm of the recommendations, incorporating a privacy layer through a personal health library, and conducting a clinical trial to assess both usability and usefulness of the implementation. This semantic-driven explainable artificial intelligence prototype can enhance health care practitioners’ ability to provide explanations for the decisions they make.

adverse childhood experiences↗

Mining and Validating Social Media Data for COVID-19–Related Human Behaviors Between January and July 2020: Infodemiology Study

Background: Health authorities can minimize the impact of an emergent infectious disease outbreak through effective and timely risk communication, which can build trust and adherence to subsequent behavioral messaging. Monitoring the psychological impacts of an outbreak, as well as public adherence to such messaging, is also important for minimizing long-term effects of an outbreak. Objective: We used social media data from Twitter to identify human behaviors relevant to COVID-19 transmission, as well as the perceived impacts of COVID-19 on individuals, as a first step toward real-time monitoring of public perceptions to inform public health communications. Methods: We developed a coding schema for 6 categories and 11 subcategories, which included both a wide number of behaviors as well codes focused on the impacts of the pandemic (eg, economic and mental health impacts). We used this to develop training data and develop supervised learning classifiers for classes with sufficient labels. Classifiers that performed adequately were applied to our remaining corpus, and temporal and geospatial trends were assessed. We compared the classified patterns to ground truth mobility data and actual COVID-19 confirmed cases to assess the signal achieved here. Results: We applied our labeling schema to approximately 7200 tweets. The worst-performing classifiers had F1 scores of only 0.18 to 0.28 when trying to identify tweets about monitoring symptoms and testing. Classifiers about social distancing, however, were much stronger, with F1 scores of 0.64 to 0.66. We applied the social distancing classifiers to over 228 million tweets. We showed temporal patterns consistent with real-world events, and we showed correlations of up to –0.5 between social distancing signals on Twitter and ground truth mobility throughout the United States. Conclusions: Behaviors discussed on Twitter are exceptionally varied. Twitter can provide useful information for parameterizing models that incorporate human behavior, as well as for informing public health communication strategies by describing awareness of and compliance with suggested behaviors.

60 APPLIED LIFE SCIENCES↗