Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “community data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 631 records · Page 35

TPSAS-NF1676L-20321-DND

NASA has conducted airborne tropospheric chemistry studies for about three decades. These field campaigns have generated a great wealth of observations, including a wide range of the trace gases and aerosol properties. Even though the spatial and temporal coverage is limited, the aircraft data offer high resolution and comprehensive simultaneous coverage of many variables, e.g. ozone precursors, intermediate photochemical species, and photochemical products. The recent NASA Earth Venture Program has generated an unprecedented amount of aircraft observations in terms of the sheer number of measurements and data volume. The ASDC Toolset for Airborne Data (TAD) is being designed to meet the user community needs for aircraft data for scientific research on climate change and air quality relevant issues.

Aubrey Beach↗

Benefits of Using Remote Sensing for Health Alerts and Chronic Respiratory Exposures

Respiratory diseases such as asthma can be triggered by environmental conditions that can be monitored using Earth observing data and environmental forecast models. Frequent dust storms in the southwestern United States, the annual cycle of juniper pollen events in the spring, and increased aerosol and ozone concentrations in summer, are health concerns shared by the community at large. Being able to forecast the occurrence of these events would help the health care community prepare for increased visits to emergency rooms, as well as allow public health officials to issue alerts to affected persons. This information also is important to epidemiologists for analyzing long-term trends and impacts of these events on the health and well-being of the community. Earth observing data collected by remote sensing platforms are important for improving the performance of models that can forecast these events, and in turn, improve products and information for decision-making by public health authorities. This presentation will discuss the benefits of using remote sensing data for forecasting environmental events that can adversely affect individuals with respiratory ailments. The presentations will include a brief discussion on relevant Earth observing data, the forecast models used, and societal benefits of the resulting products and information. Several NASA-funded projects will be highlighted as examples

Luvall, J. C.↗

WCRP Task Team for the Intercomparison of Reanalyses (TIRA): Motivation and Progress

Reanalyses have proven to be an important resource for weather and climate related research, as well as societal applications at large. Several centers have emerged to produce new atmospheric reanalyses in various forms every few years. In addition, land and ocean communities are producing disciplinary uncoupled reanalyses. Current research and development in reanalysis is directed at (1) extending the length of reanalyzed period and (2) use of coupled Earth system models for climate reanalysis. While WCRPs involvement in the reanalyses communities through its Data Advisory Council (WDAC) has been substantial, for example in organizing international conferences on reanalyses, a central team of reanalyses expertise is not in place in the WCRP structure. The differences among reanalyses and their inherent uncertainties are some of the most important questions for both users and developers of reanalyses. Therefore, a collaborative effort to systematically assess and intercompare reanalyses would be a logical progression that fills the needs of the community and contributes to the WCRP mission. The primary charge to the TIRA is to develop a reanalysis intercomparison project plan that will attain the following objectives.1)To foster understanding and estimation of uncertainties in reanalysis data by intercomparison and other means 2)To communicate new developments and best practices among the reanalyses producing centers 3)To enhance the understanding of data and assimilation issues and their impact on uncertainties, leading to improved reanalyses for climate assessment 4)To communicate the strengths and weaknesses of reanalyses, their fitness for purpose, and best practices in the use of reanalysis datasets by the scientific community. This presentation outlines the need for a task team on reanalyses, their intercomparison, the objectives of the team and progress thus far.

WDA↗

Datum: A Scientific Metadata Catalog

The data catalog market is currently flooded with a myriad of different products, but none serve the scientific community well. There are cloud-native tools like Databricks, Snowflake,to on-premise solutions like Collibra and Datahub. The common failing of all these tools however, is their inability to serve the scientific data community directly. Most catalogs are targeted towards financial, health, or user data - not sensor or scientific domain data. They also prioritize integrations that often don’t exist or are just starting to be used in the scientific realm - all while ignoring common scientific tools and file types. Datum is a catalog which targets the scientific data directly, including the tools and networks in which those tools are used. We work with the producers and consumers of the data where they are, targeting cloud and on-premise with a focus on classified networks. Datum is an Erlang/Elixir application. Technical Features Note: The features listed below are still under development and may change, slightly, upon final delivery of the product. File Formats - Datum has the ability to read additional metadata and provides processing pipelines for the following file formats: Plain Text, PDF, LaTeX, HTML, Open Document Format (.odt), XML, CSV/TSV (and other standard delimiters), OpenDocument Database and Spreadsheets, Geo-Referenced TIFF, Common Data Format, HDF/HDF5, LabView TDMS, Excel, DeltaTables, Parquet, Apache Iceberg, Apache Hudi and many others. Metadata Collection - Scanners for the local and networked file systems and cloud storage providers. Network integration with common databases such as MSSQL and MySQL. User Plugin System - Users are able to provide either file processing, metadata extraction, or sampling plugins in the programming language of their choice. Authentication/Authorization -: OIDC integration, SCIM provisioning and EntraID integration out of the box. Full user and group management system with a “least privilege” operating mode. Governance - Customizable data governance platform; dictate and enforce required metadata, enforce data embargos, and enforce user agreements and NDAs before data access. Ability to create health checks on data, rejecting abandoned or poorly curated data and automatically removing it from the search index. Ability for users to submit corrections. Search - Semantic search is a first class citizen. No licenses to expensive, external software required. Integrated use of vectors and vector-based search allows for AI agent integration at all levels of operation. Metadata Model - Display and control data’s lineage and connections to other data and data directories. Data is modeled after a filesystem - an organization instantly recognizable and navigable by most any user. CLI and SDK - Ships with a Command Line Interface (CLI) tool and with a fully-featured Python SDK. This allows for rapid and programmatic use of Datum by every level of user. Minimal Infrastructure - Datum ships as a single executable file and can be run on any operating system and most CPU architectures. Datum has no reliance on external databases, search indexing tools, or other outside services - and it runs equally well on edge computing devices, cloud services, or in a clustered HPC environment.

darrington, john↗

Phytoplankton exudates and lysates support distinct microbial consortia with specialized metabolic and ecophysiological traits

Marine dissolved organic matter, which originates from phytoplankton, holds as much carbon as Earth’s atmosphere; yet, the biological processes governing its fate are primarily studied under idealized laboratory conditions or through indirect measures such as genome sequencing. In this work, we used isotope labeling to directly quantify uptake of complex carbon pools from the two primary sources of marine organic carbon (diatoms and cyanobacteria) by a natural microbial community. Furthermore, our data show that carbon pools are partitioned into distinct microbial lineages whose physiological properties and resource acquisition strategies match the chemical nature of their preferred substrates. Our results provide ecological and functional insights into the patterns of microbial community structure changes that occur during marine phytoplankton blooms.

59 BASIC BIOLOGICAL SCIENCES↗

Data sharing and retrieval using OAI-PMH

There is a growing consensus for the need to store and archive digital data, particularly for publicly funded research. Long-term preservation of that data generally requires some form of institutional archive, such as those directed to particular scientific communities of practice. Given that data is often of use to multiple communities of practice, which may have differing norms for data and metadata structure and semantics, effective standards for data and metadata exchange are important factors for users to be able to find and retrieve data. Toolsets that provide a coherent presentation of information across multiple standards are important for data search and access. One such toolset, Mercury, is a open-source metadata harvesting, data discovery, and access system, built for researchers to search for, share and obtain spatiotemporal data used across a range of climate and ecological sciences. Mercury is used across multiple projects to provide a coherent search interface for spatiotemporal data described in any of several metadata formats. Mercury has recently been extended to enable harvesting and distribution of metadata using the Open Archive Initiative Protocol for Metadata Handling (OAI-PMH). In this paper we describe Mercury s capabilities with multiple metadata formats, in general, and, more specifically, the results of our OAI-PMH implementations and the lessons learned.

99 GENERAL AND MISCELLANEOUS↗

Locating Seismic Events with Local-Distance Data

As the seismic monitoring community advances toward detecting, identifying, and locating ever-smaller natural and anthropogenic events, the need is constantly increasing for higher resolution, higher fidelity data, models, and methods for accurately characterizing events. Local-distance seismic data provide robust constraints on event locations, but also introduce complexity due to the significant geologic heterogeneity of the Earth’s crust and upper mantle, and the relative sparsity of data that often occurs with small events recorded on regional seismic networks. Identifying the critical characteristics for improving local-scale event locations and the factors that impact location accuracy and reliability is an ongoing challenge for the seismic community. Using Utah as a test case, we examine three data sets of varying duration, finesse, and magnitude to investigate the effects of local earth structure and modeling parameters on local-distance event location precision and accuracy. We observe that the most critical elements controlling relocation precision are azimuthal coverage and local-scale velocity structure, with tradeoffs based on event depth, type, location, and range.

42 ENGINEERING↗

2.2.5.401 - Ocean Observing Prize

The Powering the Blue Economy: Ocean Observing Prize is a $2.4M contest that challenges innovators to develop solutions that integrate marine renewable energy with ocean observation platforms to revolutionize our ability to monitor, manage, and understand the ocean. Competitors are challenged to design, build, and test novel, wave-powered, self-charging autonomous underwater vehicle (AUV) systems that could be suitable for a 6-month deployment in the Atlantic Ocean to monitor hurricane formation. Through engagement with the end user ocean observing community, the team identified challenges in a lack of data on storm intensity, endangering coastal communities. This challenge could be addressed by collecting data before, during, and after a hurricane develops and strengthens at sea. Amassing this data, however, requires an ocean observing system that can be deployed at sea for long periods, waiting for approaching storms. To help solve this problem, competitors are working to integrate wave energy capture with AUV systems to collect this data, helping to better protect coastal communities from oncoming storms. Solutions developed through this prize aim to enable long-term collection of data before, during, and after a hurricane that will help better forecast storm intensity. The prize mechanism provides an environment to accelerate technology development for innovators and helps to improve awareness of marine energy and its ability to provide power to blue economy applications.

coastal communities↗

The ModelSEED Biochemistry Database for the integration of metabolic annotations and the reconstruction, comparison and analysis of metabolic models for plants, fungi and microbes

Abstract For over 10 years, ModelSEED has been a primary resource for the construction of draft genome-scale metabolic models based on annotated microbial or plant genomes. Now being released, the biochemistry database serves as the foundation of biochemical data underlying ModelSEED and KBase. The biochemistry database embodies several properties that, taken together, distinguish it from other published biochemistry resources by: (i) including compartmentalization, transport reactions, charged molecules and proton balancing on reactions; (ii) being extensible by the user community, with all data stored in GitHub; and (iii) design as a biochemical ‘Rosetta Stone’ to facilitate comparison and integration of annotations from many different tools and databases. The database was constructed by combining chemical data from many resources, applying standard transformations, identifying redundancies and computing thermodynamic properties. The ModelSEED biochemistry is continually tested using flux balance analysis to ensure the biochemical network is modeling-ready and capable of simulating diverse phenotypes. Ontologies can be designed to aid in comparing and reconciling metabolic reconstructions that differ in how they represent various metabolic pathways. ModelSEED now includes 33,978 compounds and 36,645 reactions, available as a set of extensible files on GitHub, and available to search at https://modelseed.org and KBase.

59 BASIC BIOLOGICAL SCIENCES↗

An Overview of NASA’s Airborne and Field Data Resource Center

A key recommendation from NASA’s 2022 Airborne and Field Data Workshop called for the development of a virtual Resource Center for all stakeholders across the data lifecycle of airborne and field Earth observations. The agency’s Earth Science Data and Information System (ESDIS) Project and Airborne Data Management Group (ADMG) have worked in concert to establish the newly launched NASA Airborne and Field Data Resource Center (AFDRC) to provide a single entry point for a wide assortment of information on and the effective, responsible stewardship of non-satellite observational data. The AFDRC compiles access to many existing resources, but does so in a newly organized way that integrates availability to increase efficiency and holistic understanding while simplifying users’ experience. Initially launched in fall of 2023, the AFDRC is a NASA Earthdata domain website that clarifies several previously disparate resources and provides newly updated information, including: Learning Resources: Educational resources to broaden understanding of the role airborne and field observations play in advancing understanding of our planet and NASA’s role in collecting and archiving these data. Support for data users to Find and Access Data: Advanced contextual browse/search capabilities that efficiently link researchers to data products suitable for their science objectives - this includes linking to NASA’s Catalog of Archived Suborbital Earth Science Investigations (CASEI). Working with Data: Tools specific to individual types of suborbital Earth Science data and their (inter-)disciplinary communities to provide access as well as guidance for their application. Stewardship Responsibilities: Resources for data producers with to lessen requirement burdens at the time of data transfer, and information for data stewards with consistent, authoritative guidance on best practices and agency- and/or community- specific archival procedures. This presentation will give an overview of the motivation for NASA’s AFDRC, approach for the design and content, iterative community-driven improvements, promote the use of the AFDRC, and solicit additional feedback from airborne and field data user communities.

Sara Lubkin↗

Accelerating Lossy and Lossless Compression on Emerging BlueField DPU Architectures

Data compression has become a crucial technique in addressing performance bottlenecks caused by increasing data volumes in High-Performance Computing (HPC), Big Data, and Deep Learning (DL). Despite its potential to boost system performance, recent studies have identified significant challenges with existing compression methods, mainly due to their high computational demands amidst continuously growing data sizes. Concurrently, the advent of Data Processing Units (DPUs), equipped with programmable System-on-Chip (SoC) and specialized compression accelerators, offers a promising opportunity to alter the landscape of data compression. This paper explores the complexities and potential of leveraging NVIDIA BlueField DPUs to accelerate lossy and lossless compression. Towards this, we introduce PEDAL, an innovative library that leverages the hardware capabilities of DPUs to unify and optimize data compression designs. Moreover, we seamlessly co-design PEDAL with the popular MPICH MPI library, demonstrating up to 101x speedup in compression time and 88x decrease in communication latency. Drawing on these achievements, we share our experience with various research communities about accelerating data compression on DPUs in communication-oriented HPC scenarios.

Li, Yuke↗

Hacking Limnology Workshop and DSOS22: Creating a Community of Practice for the Nexus of Data Science, Open Science, and the Aquatic Sciences

The 2nd Aquatic Ecosystem Modeling-Junior (AEMON-J) Hacking Limnology Workshop and 3rd Virtual Summit: Incorporating Data Science and Open Science in the Aquatic Sciences (DSOS) took place on 25–29 July 2022. These virtual events were developed to bring together researchers from diverse backgrounds to share developments in data-intensive research in the aquatic sciences and train participants in cutting-edge data analysis methods related to remote sensing, data pipelines, and modeling of aquatic ecosystems.

54 ENVIRONMENTAL SCIENCES↗

Fire and Drought Affect Multiple Aspects of Diversity in a Migratory Bird Stopover Community

Drought and high-severity, stand-replacing wildfires can have substantial impacts on the composition of avian communities, including stop-over communities during migration. An inextricable link exists between drought and wildfire, each operating and impacting across different timescales. Many studies have found nonlinear avian abundance trends in breeding community time series data that include pre- and post-fire observations, describing an initial decrease in abundance followed by rapid increases that can attenuate over time. Here, we use a fall bird-banding dataset to evaluate shifts in a drought-impacted avian community following wildfire from taxonomic, functional, and phylogenetic perspectives. We looked at the community as a whole and also categorized birds as residents, migrants, and breeders to assess potential varying responses at the study site. We observed post-fire shifts in functional and phylogenetic diversity that corresponded to changes in vegetation. An influx of migratory insectivores post-fire drove much of the variation between pre- and post-fire avian communities and toward a more related, less phylogenetically dispersed community. A concurrent monsoon season drought was also associated with functional and phylogenetic diversity, highlighting the intertwined pulse press effects on avian communities. Overall, our results suggest that, although bird communities are immediately impacted by fire-driven resource changes, they can rebound over time, it is unclear how long-term drought may continue to shape the composition of these avian communities.

59 BASIC BIOLOGICAL SCIENCES↗