Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “community data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,441 records · Page 80

VisIt: An End-User Tool for Visualizing and Analyzing Very Large Data

VisIt is a popular open source tool for visualizing and analyzing data. It owes its success to its foci of increasing data understanding, large data support, and providing a robust and usable product, as well as its underlying design that fits today's supercomputing landscape. In this short paper, we describe the VisIt project and its accomplishments. The VisIt project's three focal points - understanding data, large data, and delivering a product - together form a powerful environment for analyzing data from HPC simulations. It is used in varied ways: it enables visualization scientists, computational code developers, and the physicists that run these codes to perform a broad range of data understanding activities, including debugging, making movies, and exploring data. The user interface portion of its design provides a powerful paradigm for analyzing data while the data processing portion of its design is well suited for big data. This in turn has led to many successes: in scaling up to high levels of concurrency and large data sizes, in providing a 'home' for large data algorithms, in understanding how to best use supercomputers, and, most importantly, in helping users understand their data. Further, despite significant upcoming changes in supercomputing architecture, VisIt's future appears bright, as it enjoys vibrant user and developer communities.

99 GENERAL AND MISCELLANEOUS↗

Towards A Flexible Data Fusion Tool Incorporating Model, Satellite, Regulatory Monitor and Low-Cost Sensor Data for Air Quality Estimation and Forecasting

Air quality managers, researchers, and concerned community scientists around the world have a variety of sources for air quality information, ranging from traditional regulatory monitoring networks and atmospheric chemistry models to remote sensing data products and low-cost sensor networks. However, the ability to incorporate data from these disparate sources and synthesize a comprehensive overview of the local air quality situation remains a considerable barrier for many end-users. This presentation will outline a tool, currently in development, which will address this need using a flexible data fusion approach. The tool will make use of air quality forecast model outputs (primarily from the NASA GEOS-CF composition forecast modeling system), satellite remote sensing data (from instruments including MODIS, VIIRS, TROPOMI, plus TEMPO for the US when available), and in-situ data from official regulatory and/or low-cost networks where these are available. The ability to incorporate data from low-cost sensor networks will be a key feature of the tool; it will make use of other available data sources to calibrate the low-cost sensor data on a regional scale, then use these calibrated low-cost sensor data for localized updating to resolve finer-scale air quality patterns. Development of this tool is taking place with the help of national and international partners and end-user groups, coordinated through the US EPA and the United Nations Environment Programme (UNEP). The tool is being developed on the Google Earth Engine cloud computing platform to facilitate integration of diverse data sources and free access by a broad community of end-users. Stewardship of the tool will be passed to US EPA and UNEP to support future activities with end-users in the US and around the world, and the tool itself will remain freely accessible. We hope that this tool will lower the barrier to entry for various user groups worldwide, including community scientists, who struggle to integrate disparate data sources to gain insight into their local air quality situations. This presentation will cover the early stages of the development of the tool, including the underlying methods and some pilot case studies in integrating low-cost sensor data.

global models↗

Functional gene arrays-based analysis of fecal microbiomes in patients with liver cirrhosis

Background: Human gut microbiota plays an important role in the pathogenesis of cirrhosis complications. Although the phylogenetic diversity of intestinal microbiota in patients with liver cirrhosis has been examined in several studies, little is known about their functional composition and structure. Results: To characterize the functional gene diversity of the gut microbiome in cirrhotic patients, we recruited a total of 42 individuals, 12 alcoholic cirrhosis patients, 18 hepatitis B virus (HBV)-related cirrhosis patients, and 12 normal controls. We determined the functional structure of these samples using a specific functional gene array, which is a combination of GeoChip for monitoring biogeochemical processes and HuMiChip specifically designed for analyzing human microbiomes. Our experimental data showed that the microbial community functional composition and structure were dramatically distinctive in the alcoholic cirrhosis. Various microbial functional genes involved in organic remediation, stress response, antibiotic resistance, metal resistance, and virulence were highly enriched in the alcoholic cirrhosis group compared to the control group and HBV-related cirrhosis group. Cirrhosis may have distinct influences on metabolic potential of fecal microbial communities. The abundance of functional genes relevant to nutrient metabolism, including amino acid metabolism, lipid metabolism, nucleotide metabolism, and isoprenoid biosynthesis, were significantly decreased in both alcoholic cirrhosis group and HBV-related cirrhosis group. Significant correlations were observed between functional gene abundances and Child-Pugh scores, such as those encoding aspartate-ammonia ligase, transaldolase, adenylosuccinate synthetase and IMP dehydrogenase. Conclusions: Functional gene array was utilized to study the gut microbiome in alcoholic and HBV-related cirrhosis patients and controls in this study. Our array data indicated that the functional composition of fecal microbiomes was heavily influenced by cirrhosis, especially by alcoholic cirrhosis. This study provides new insights into the functional potentials and activity of gut microbiota in cirrhotic patients with different etiologies.

59 BASIC BIOLOGICAL SCIENCES↗

Citywide indoor air sampling mirrors wastewater and clinical for environmental surveillance of respiratory viruses

Wastewater surveillance of respiratory pathogens can provide timely estimates of viral activity and disease trends in a population. Indoor air surveillance could be used similarly with some advantages but remains largely unvalidated at the community -scale. Here, an indoor air surveillance program was employed as part of public health environmental surveillance in Chicago, Illinois, USA. Ten air samplers were placed in healthcare and congregate living settings across the city. Weekly air samples were evaluated for influenza A, influenza B, respiratory syncytial virus, and SARS -CoV-2 over two respiratory virus seasons (2023 -2025). Citywide, aggregated air sample positivity and viral load were closely correlated with local clinical case and wastewater surveillance data across all respiratory viruses. Virus trends in air data often preceded clinical and wastewater, although this varied across pathogens and respiratory virus seasons. Further, whole -genome sequencing of SARS -CoV-2 showed close correlation of variant proportions across all datasets. At the building -scale, air samples obtained from a single sampling device provided efficient respiratory virus surveillance, with respiratory pathogen levels mirroring citywide clinical surveillance data. These data demonstrate that air surveillance can provide respiratory virus case and variant trend data at a building or community -scale, serving as an alternative or complementary tool for public health environmental surveillance.

Wilton, Rosemarie↗

Data for Intra- and inter-annual variability of nitrification in the rhizosphere of field-grown bioenergy sorghum

These data were collected in 2018 and 2019 at the University of Illinois Energy Farm (N 40.063607, W 88.206926). During each growing season, bulk and rhizosphere soil were collected from replicate Sorghum bicolor nitrogen use efficiency trial plots at three separate time points (approximately July 1, August 1, and September 1). We measured soil moisture, pH, soil nitrate and ammonium, potential nitrification, potential denitrification, and extracted and sequenced the V4 region of the 16S rRNA gene for microbial community analysis. All microbial sequence data is archived in the National Center for Biotechnology Information’s (NCBI) Sequence Read Archive (accession number SRP326979, project number PRJNA741261).

bioenergy↗

Use of the SRI electronic satellite image analysis console for mapping southern Arizona plant communities from ERTS-1 imagery

Cloud-free imagery covering the Tucson, Ariz., region for the period from August 22 to November 2, 1972, was used to determine the utility of ERTS-1 data for discriminating boundaries between plant communities. The following studies were made from imagery analyzed by use of an Electronic Satellite Image Analysis Console: (1) console-generated color composites from MSS-5 and MSS-6 bands were recorded photographically from the console color monitor. The color photographs were then used to compare with short-term changes in vegetative cover observed on the ground; (2) using the console, microdensitometric traces were made along selected traverses to quantify changes in scene irradiance across the image field; (3) quantitative plant coverage data, collected at ground-truth stations along the traverses, were compared with the densitometric values.

Turner, R. M.↗

Matminer: An open source toolkit for materials data mining

As materials data sets grow in size and scope, the role of data mining and statistical learning methods to analyze these materials data sets and build predictive models is becoming more important. This manuscript introduces matminer, an open-source, Python-based software platform to facilitate data-driven methods of analyzing and predicting materials properties. Matminer provides modules for retrieving large data sets from external databases such as the Materials Project, Citrination, Materials Data Facility, and Materials Platform for Data Science. It also provides implementations for an extensive library of feature extraction routines developed by the materials community, with 47 featurization classes that can generate thousands of individual descriptors and combine them into mathematical functions. Finally, matminer provides a visualization module for producing interactive, shareable plots. These functions are designed in a way that integrates closely with machine learning and data analysis packages already developed and in use by the Python data science community. We explain the structure and logic of matminer, provide a description of its various modules, and showcase several examples of how matminer can be used to collect data, reproduce data mining studies reported in the literature, and test new methodologies.

97 MATHEMATICS AND COMPUTING↗

The Pacific Northwest National Laboratory library of bacterial and archaeal proteomic biodiversity

This dataset deposition announces the submission to public repositories of the PNNL Biodiversity Library, a large collection of global proteomics data for 112 bacterial and archaeal organisms. The data comprises 35,162 tandem mass spectrometry (MS/MS) datasets from ~10 years of research. All data has been searched, annotated and organized in a consistent manner to promote reuse by the community. Protein identifications were cross-referenced with KEGG functional annotations which allows for pathway oriented investigation. We present the data as a freely available community resource. A variety of data re-use options are described for computational modeling, proteomics assay design and bioengineering. Instrument data and analysis files are available at ProteomeXchange via the MassIVE partner repository under the identifiers PXD001860 and MSV000079053.

59 BASIC BIOLOGICAL SCIENCES↗

Frozen Freedom: Unleashing Grocery Store Demand Flexibility: Preprint

Grocery stores consumed approximately 3% of total electricity used by commercial buildings in the U.S. in 2018 (EIA 2018), representing a unique end-use load profile characterized by the critical use of refrigerated display cases. Exploring demand response (DR) scenarios in grocery stores presents an opportunity to enhance the efficiency and sustainability of surrounding communities. In addition, recent studies demonstrate that implementing control algorithms considering demand flexibility strategies can lead to load and peak reductions in standalone refrigerated display cases. Because small business grocery stores operate on thin margins, the energy bill cost savings DR might provide could make a positive difference toward continued operations. Still, uncertainty remains about the extent of demand flexibility potential controls could provide when coupling refrigeration with whole building operation. To enhance economic viability and grid stability, it is essential to quantify the load flexibility capability of grocery stores. Advanced controls can optimize energy consumption by responding to load shedding, shifting, and DR events, as well as daily Time-of-Use (TOU) rates without compromising food safety. Using both quantitative data and interviews with community-based organizations, we developed a full-size store model and two small store models with controlled refrigerated cases, HVAC, and lighting systems based on actual grocery store properties. Through simulations, we have assessed load flexibility strategies with varied DR events. The results highlight potential for energy and peak reduction with advanced or basic controls. However, interviews and data indicate that more support is needed to make DR strategies consistently accessible to small grocery stores.

demand flexibility↗

MISIP: a data standard for the reuse and reproducibility of any stable isotope probing-derived nucleic acid sequence and experiment

DNA/RNA-stable isotope probing (SIP) is a powerful tool to link in situ microbial activity to sequencing data. Every SIP dataset captures distinct information about microbial community metabolism, process rates, and population dynamics, offering valuable insights for a wide range of research questions. Data reuse maximizes the information derived from the labor and resource-intensive SIP approaches. Yet, a review of publicly available SIP sequencing metadata showed that critical information necessary for reproducibility and reuse was often missing. Here, we outline the Minimum Information for any Stable Isotope Probing Sequence (MISIP) according to the Minimum Information for any (x) Sequence (MIxS) framework and include examples of MISIP reporting for common SIP experiments. Our objectives are to expand the capacity of MIxS to accommodate SIP-specific metadata and guide SIP users in metadata collection when planning and reporting an experiment. The MISIP standard requires 5 metadata fields—isotope, isotopolog, isotopolog label, labeling approach, and gradient position—and recommends several fields that represent best practices in acquiring and reporting SIP sequencing data (e.g., gradient density and nucleic acid amount). The standard is intended to be used in concert with other MIxS checklists to comprehensively describe the origin of sequence data, such as for marker genes (MISIP-MIMARKS) or metagenomes (MISIP-MIMS), in combination with metadata required by an environmental extension (e.g., soil). The adoption of the proposed data standard will improve the reuse of any sequence derived from a SIP experiment and, by extension, deepen understanding of in situ biogeochemical processes and microbial ecology.

Simpson, Abigayle↗

PyDDA: A New Pythonic Wind Retrieval Package

PyDDA (Pythonic Direct Data Assimilation) is a new community framework aimed at wind retrievals that depends only upon utilities in the SciPy ecosystem such as scipy, numpy, and dask. It can support retrievals of winds using information from weather radar networks constrained by high resolution forecast models over grids that cover thousands of kilometers at kilometer-scale resolution. Unlike past wind retrieval packages, this package can be installed using anaconda for easy installation and, with a focus on ease of use can retrieve winds from gridded radar and model data with just a few lines of code. The package is currently available for download at https://github.com/openradar/PyDDA.

Radar↗

Extending HPF for advanced data parallel applications

The stated goal of High Performance Fortran (HPF) was to 'address the problems of writing data parallel programs where the distribution of data affects performance'. After examining the current version of the language we are led to the conclusion that HPF has not fully achieved this goal. While the basic distribution functions offered by the language - regular block, cyclic, and block cyclic distributions - can support regular numerical algorithms, advanced applications such as particle-in-cell codes or unstructured mesh solvers cannot be expressed adequately. We believe that this is a major weakness of HPF, significantly reducing its chances of becoming accepted in the numeric community. The paper discusses the data distribution and alignment issues in detail, points out some flaws in the basic language, and outlines possible future paths of development. Furthermore, we briefly deal with the issue of task parallelism and its integration with the data parallel paradigm of HPF.

Chapman, Barbara↗

Utilization of Ancillary Data Sets for SMAP Algorithm Development and Product Generation

Algorithms being developed for the Soil Moisture Active Passive (SMAP) mission require a variety of both static and ancillary data. The selection of the most appropriate source for each ancillary data parameter is driven by a number of considerations, including accuracy, latency, availability, and consistency across all SMAP products and with SMOS (Soil Moisture Ocean Salinity). It is anticipated that initial selection of all ancillary datasets, which are needed for ongoing algorithm development activities on the SMAP algorithm testbed at JPL, will be completed within the year. These datasets will be updated as new or improved sources become available, and all selections and changes will be documented for the benefit of the user community. Wise choices in ancillary data will help to enable SMAP to provide new global measurements of soil moisture and freeze/thaw state at the targeted accuracy necessary to tackle hydrologically-relevant societal issues.

ONeill, P.↗

A Multi-scale Approach to Urban Thermal Analysis

An environmental consequence of urbanization is the urban heat island effect, a situation where urban areas are warmer than surrounding rural areas. The urban heat island phenomenon results from the replacement of natural landscapes with impervious surfaces such as concrete and asphalt and is linked to adverse economic and environmental impacts. In order to better understand the urban microclimate, a greater understanding of the urban thermal pattern (UTP), including an analysis of the thermal properties of individual land covers, is needed. This study examines the UTP by means of thermal land cover response for the Salt Lake City, Utah, study area at two scales: 1) the community level, and 2) the regional or valleywide level. Airborne ATLAS (Advanced Thermal Land Applications Sensor) data, a high spatial resolution (10-meter) dataset appropriate for an environment containing a concentration of diverse land covers, are used for both land cover and thermal analysis at the community level. The ATLAS data consist of 15 channels covering the visible, near-IR, mid-IR and thermal-IR wavelengths. At the regional level Landsat TM data are used for land cover analysis while the ATLAS channel 13 data are used for the thermal analysis. Results show that a heat island is evident at both the community and the valleywide level where there is an abundance of impervious surfaces. ATLAS data perform well in community level studies in terms of land cover and thermal exchanges, but other, more coarse-resolution data sets are more appropriate for large-area thermal studies. Thermal response per land cover is consistent at both levels, which suggests potential for urban climate modeling at multiple scales.

Gluch, Renne↗

The Role of Metadata Standards in EOSDIS Search and Retrieval Applications

Metadata standards play a critical role in data search and retrieval systems. Metadata tie software to data so the data can be processed, stored, searched, retrieved and distributed. Without metadata these actions are not possible. The process of populating metadata to describe science data is an important service to the end user community so that a user who is unfamiliar with the data, can easily find and learn about a particular dataset before an order decision is made. Once a good set of standards are in place, the accuracy with which data search can be performed depends on the degree to which metadata standards are adhered during product definition. NASA's Earth Observing System Data and Information System (EOSDIS) provides examples of how metadata standards are used in data search and retrieval.

Pfister, Robin↗

Taming Big Data Variety in the Earth Observing System Data and Information System

Although the volume of the remote sensing data managed by the Earth Observing System Data and Information System is formidable, an oft-overlooked challenge is the variety of data. The diversity in satellite instruments, science disciplines and user communities drives cost as much or more as the data volume. Several strategies are used to tame this variety: data allocation to distinct centers of expertise; a common metadata repository for discovery, data format standards and conventions; and services that further abstract the variations in data.

Information Systems↗

DOE BSSD Performance Management Metrics Report Q3

Microbiome data is complex, spanning information from microbial genomes within diverse communities, protein and metabolite readouts, and contextual information (metadata) captured from the environments from which these samples were collected. While the variety and scale of microbiome data generation has dramatically expanded over the past twenty years, infrastructure to support data management, sharing, and access has lagged. New ways to improve interoperability across existing resources and advancing community standards are necessary to support how researchers create, use, and reuse data. The National Microbiome Data Collaborative (NMDC) aims to advance a microbiome data sharing network through infrastructure, data standards, and community building.

54 ENVIRONMENTAL SCIENCES↗