Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “community data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 703 records · Page 39

What (and How) MERRA-2 Reanalysis Data are Used in Applied Sciences

The Modern Era Retrospective-analysis for Research and Applications, Version 2 (MERRA-2) is the global atmospheric data reanalysis for the satellite era produced by NASA’s Global Modeling and Assimilation Office (GMAO), using the Goddard Earth Observing System Model (GEOS)version 5.12.4. The data are officially distributed by the NASA Goddard Earth Sciences Data and Information Services Center (GES DISC). MERRA-2 data have been widely used by the Earth sciences and application community. Since MERRA-2 data were released in early 2016, the number of registered data users has grown steadily from 1,252 in 2016 to 6477 in 2020. By the end of October 2021, ~16 petabytes (over 360 million files) of data have been distributed to more than 18,900 users. Searching in Google Scholar (https://scholar.google.com/), we have found over 7,000 articles, published between January 2017 and May 2021, involving the use ofMERRA-2 data. The figure shows the numbers for various application areas in which theMERRA-2 data have been used, covering almost all of the application areas defined in NASA Applied Sciences (http://appliedsciences.nasa.gov). The largest number of articles are found in disaster research, with the subcategories ordered in flood, wildfires, hurricanes and cyclones, and other forms of severe weather. In this presentation, we will discuss the preliminary findings from a review of the selected literature that uses MERRA-2 data in applied sciences. The current analytic and interoperable data services at GES DISC are listed, such as the on-the-fly subset and analysis service, NASA Giovanni; THREDDS Data Server(TDS); and Python Jupyter notebooks. In addition, we will introduce two new services for supporting the open sciences: My Dashboard and Related Publications.

data management↗

Community Energy Planning: Best Practices and Lessons Learned in NREL's Work with Communities

The clean energy transition is accelerating due to local, state, and national actions combined with external market forces. Regardless of where goals are set and decisions are made, clean energy deployment occurs on the ground in communities. As a result, communities increasingly need technical expertise and assistance with planning for and managing the energy transition. Building on decades of work with state, local, and tribal jurisdictions, the National Renewable Energy Laboratory (NREL) increasingly provides community-driven modeling, analysis, and technical assistance to enable more data-driven and equitable community energy planning. To inform and enhance NREL's capabilities in community energy planning and provide a resource for others working in this space, the Joint Institute for Strategic Energy Analysis (JISEA) Sustainable Communities Catalyzer supported this best-practices presentation based on interviews with seasoned NREL practitioners and a literature review on equitable community energy planning. Findings include five best practices for community energy planning that NREL practitioners and others can apply to strengthen their impact: 1) do your homework in preparation for community interactions; 2) be humble, authentic, and honest in your interactions with community members; 3) respect community agency in every step of the process; 4) meet the community where they are; 5) democratize participation.

best practices↗

Limb Correction of RGB Composite Imagery for Improved Interpretation

RGB (Red‐Green‐Blue) imagery, created by integrating several spectral channels into one composite image, is currently used by the operational weather community to aid in quick, real‐time analysis of atmospheric processes. However, the limb effect - a result of an increasing optical path length of the absorbing atmosphere between the satellite and the earth as scan angle increases - interferes with the qualitative interpretation of RGB composites at large scan angles. It also makes the comparison of similar products from multiple satellite sensors difficult. Recent work has indicated that correcting for the limb effect in the basic channel imagery using simple statistical relationships greatly improves the utility of the derived RGB imagery. However, it is hypothesized that the limb correction coefficients vary with respect to latitude, season, cloud cover, and surface albedo. This poster will highlight an improved approach to the limb correction of RGB imagery using varying coefficients. The Joint Center for Satellite and Data Assimilation (JCSDA) Community Radiative Transfer Model (CRTM) was used to simulate top of atmosphere brightness temperatures at varying scan angles for infrared channels corresponding to the Aqua and Terra Moderate Resolution Imaging Spectroradiometer (MODIS), Suomi NPP Visible Infrared Imaging Radiometer Suite (VIIRS), and Meteosat‐10 Spinning Enhanced Visible and Infrared Imager (SEVIRI) sensors. A subset of European Center for Medium‐Range Weather Forecasts (ECMWF) temperature, specific humidity, and ozone mixing ratio profiles from March 2013 through February 2014 were used as input to the CRTM. The simulated brightness temperatures were used to determine the best fit slope of the linear relationship between the natural log of the cosine of the scan angle and the difference of the simulated brightness temperature at nadir and on the limb. The correction coefficients were then analyzed for variability with respect to latitude, season, cloud cover, and surface type and used to produce improved limb corrected imagery. Applications of the results will be presented.

Elmer, Nicholas↗

Community Geothermal: Soil Conductivity, Borehole Design, Energy Models, and Load Data for a Residential System Development - Hinesburg, VT

This dataset contains materials from the Coalition for Community-Supported Affordable Geothermal Energy Systems (C2SAGES) project, which evaluated the techno-economic feasibility of a community geothermal system for a residential development in Hinesburg, VT. The dataset includes detailed soil conductivity test reports, energy models, borehole design reports, hourly energy loads for heating, cooling, and hot water, and design layouts. EnergyPlus was used to model building energy loads, and Modelica software was applied for geothermal loop sizing based on these loads and soil conductivity results. Python scripts for network design further refined the models. Key files include PDF reports on borehole design (with projections for 1-year, 15-year, and 30-year systems), soil conductivity test results, EnergyPlus modeling outputs, and 2D/3D design drawings in PDF, DWG, and DXF formats. Python notebooks for network design and OnePipe model files are also provided, with Modelica required for viewing certain files. Outputs and modeling data are in various formats including CSV, JPG, HTML, and IDF, with units and data clearly labeled to support understanding of system design and performance for the proposed geothermal solution.

15 GEOTHERMAL ENERGY↗

Working Group on Virtual Data Integration

This report is the outcome of a workshop commissioned by the U.S. Department of Energy’s (DOE) Climate and Environmental Sciences Division (CESD) to examine current and future data infrastructure requirements foundational for achieving CESD scientific mission goals in advancing a robust, predictive understanding of Earth’s climate and environmental systems. Over the past several years, data volumes in CESD disciplines have risen sharply to unprecedented levels (tens of petabytes). Moreover, the complexity and diversity of this research data— including simulations, observations, and reanalysis— have grown significantly, posing new challenges for data capture, storage, verification, analysis, and integration. With the trends of increased data volume (in the hundreds of petabytes), more complex analysis processes, and growing cross-disciplinary collaborations, it is timely to investigate whether the CESD community has the computational and data support needed to fully realize the scientific potential of its data collections. In recognition of the challenges, a partnership is forming across CESD and among national and international agencies to examine the viability of creating an integrated, collaborative data infrastructure: a Virtual Laboratory. The overarching goal of this report is to identify the community’s key data technology requirements and high-priority development needs for sustaining and growing its scientific discovery potential. The report also aims to map these requirements to existing solutions and to identify gaps in current services, tools, and infrastructure that will need to be addressed in the short, medium, and long term to advance scientific progress.

54 ENVIRONMENTAL SCIENCES↗

Project Update for “Designing Nuclear-data Measurements that Resolve Discrepancies in Existing Data” [Slides]

AIACHNE has made key progress this past year and will contribute to the larger scientific community. We recovered input data for the current 252 Cf(sf) PFNS evaluation that was previously lost. We render a standard to the best of our ability reproducible. We critically reviewed past data as input for ML & new standard evaluation that will impact PFNS of all major actinides. We developed a unique AI/ ML code that highlights which measurement features are related to bias and are working towards open-sourcing it for the community. Features that were identified as related to bias follow physics’ intuition and bring new understanding of exp effects and might help us for other reactions and isotopes. The results highlight that EXFOR is a goldmine of features that could help us understand experiment bias (if they are easy to parse).

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

ESIP Earth Sciences Data Analytics (ESDA) Cluster - Work in Progress

The purpose of this poster is to promote a common understanding of the usefulness of, and activities that pertain to, Data Analytics and more broadly, the Data Scientist; Facilitate collaborations to better understand the cross usage of heterogeneous datasets and to provide accommodating data analytics expertise, now and as the needs evolve into the future; Identify gaps that, once filled, will further collaborative activities. Objectives Provide a forum for Academic discussions that provides ESIP members a better understanding of the various aspects of Earth Science Data Analytics Bring in guest speakers to describe external efforts, and further teach us about the broader use of Data Analytics. Perform activities that:- Compile use cases generated from specific community needs to cross analyze heterogeneous data- Compile sources of analytics tools, in particular, to satisfy the needs of the above data users- Examine gaps between needs and sources- Examine gaps between needs and community expertise- Document specific data analytics expertise needed to perform Earth science data analytics Seek graduate data analytics Data Science student internship opportunities.

science data analysis↗

Processing Contexts for Experimental HEP Data

This document provides, for those not closely associated with the experimental High Energy Physics (HEP) community, an introduction to data input and output requirements for a variety of data processing tasks. Examples in it are drawn from the art event processing framework, and from experiments and projects using art, most notably the LArSoft and NuTools projects.

97 MATHEMATICS AND COMPUTING↗

Blodgett Forest CA Warming Experiment phospholipid fatty acid and branched glycerol dialkyl glycerol tetraethers data 2018 from: "Whole-soil warming decreases abundance and modifies the community structure of microorganisms in the subsoil but not in surface soil".

This data package contains phospholipid fatty acid and branched glycerol dialkyl glycerol tetraethers data used for the paper: “Whole-soil warming decreases abundance and modifies the community structure of microorganisms in the subsoil but not in surface soil”. SOIL, https://doi.org/10.5194/soil-2021-14.On April 2018 (after 4.5 years of warming), we collected soil cores down to 90 cm depth from the whole soil profile warming experiment at the University of California Blodgett Forest Research Station, in the Sierra Nevada foothills near Georgetown, CA at 1370 m above sea level. Cores were collected from 6 experimental plots (three replicated blocks); samples were collected in 10 cm increments from 0 to 90 cm depth.This data package includes a file in .csv format and a file in .xlsx format, which can be accessed and processed using MS Excel or R. Phospholipid fatty acid and branched glycerol dialkyl glycerol tetraethers concentrations are provided as processed data files.

54 ENVIRONMENTAL SCIENCES↗

BASS. XXV. DR2 Broad-line-based Black Hole Mass Estimates and Biases from Obscuration

We present measurements of broad emission lines and virial estimates of supermassive black hole masses (M BH ) for a large sample of ultrahard X-ray-selected active galactic nuclei (AGNs) as part of the second data release of the BAT AGN Spectroscopic Survey (BASS/DR2). Our catalog includes M BH estimates for a total of 689 AGNs, determined from the Hα, Hβ, Mg II λ2798, and/or C IV λ1549 broad emission lines. The core sample includes a total of 512 AGNs drawn from the 70 month Swift/BAT all-sky catalog. We also provide measurements for 177 additional AGNs that are drawn from deeper Swift/BAT survey data. We study the links between M BH estimates and line-of-sight obscuration measured from X-ray spectral analysis. We find that broad Hα emission lines in obscured AGNs ($\mathrm{log}({N}_{{\rm{H}}}/{\mathrm{cm}}^{-2})\gt 22.0$) are on average a factor of ${8.0}_{-2.4}^{+4.1}$ weaker relative to ultrahard X-ray emission and about ${35}_{-12}^{\,+7}$% narrower than those in unobscured sources (i.e., $\mathrm{log}({N}_{{\rm{H}}}/{\mathrm{cm}}^{-2})\lt 21.5$). This indicates that the innermost part of the broad-line region is preferentially absorbed. Consequently, current single-epoch M BH prescriptions result in severely underestimated (>1 dex) masses for Type 1.9 sources (AGNs with broad Hα but no broad Hβ) and/or sources with $\mathrm{log}({N}_{{\rm{H}}}/{\mathrm{cm}}^{-2})\gtrsim 22.0$. We provide simple multiplicative corrections for the observed luminosity and width of the broad Hα component (L[bHα] and FWHM[bHα]) in such sources to account for this effect and to (partially) remedy M BH estimates for Type 1.9 objects. As a key ingredient of BASS/DR2, our work provides the community with the data needed to further study powerful AGNs in the low-redshift universe.

79 ASTRONOMY AND ASTROPHYSICS↗

Data Crosscutting Requirements Review

In April 2013, a diverse group of researchers from the U.S. Department of Energy (DOE) scientific community assembled to assess data requirements associated with DOE-sponsored scientific facilities and large-scale experiments. Participants in the review included facilities staff, program managers, and scientific experts from the offices of Basic Energy Sciences, Biological and Environmental Research, High Energy Physics, and Advanced Scientific Computing Research. As part of the meeting, review participants discussed key issues associated with three distinct aspects of the data challenge: 1) processing, 2) management, and 3) analysis. These discussions identified commonalities and differences among the needs of varied scientific communities. They also helped to articulate gaps between current approaches and future needs, as well as the research advances that will be required to close these gaps. Moreover, the review provided a rare opportunity for experts from across the Office of Science to learn about their collective expertise, challenges, and opportunities. The "Data Crosscutting Requirements Review" generated specific findings and recommendations for addressing large-scale data crosscutting requirements.

ASCR↗

Vitamin interdependencies predicted by metagenomics-informed network analyses and validated in microbial community microcosms

Abstract Metagenomic or metabarcoding data are often used to predict microbial interactions in complex communities, but these predictions are rarely explored experimentally. Here, we use an organism abundance correlation network to investigate factors that control community organization in mine tailings-derived laboratory microbial consortia grown under dozens of conditions. The network is overlaid with metagenomic information about functional capacities to generate testable hypotheses. We develop a metric to predict the importance of each node within its local network environments relative to correlated vitamin auxotrophs, and predict that a Variovorax species is a hub as an important source of thiamine. Quantification of thiamine during the growth of Variovorax in minimal media show high levels of thiamine production, up to 100 mg/L. A few of the correlated thiamine auxotrophs are predicted to produce pantothenate, which we show is required for growth of Variovorax , supporting that a subset of vitamin-dependent interactions are mutualistic. A Cryptococcus yeast produces the B-vitamin pantothenate, and co-culturing with Variovorax leads to a 90-130-fold fitness increase for both organisms. Our study demonstrates the predictive power of metagenome-informed, microbial consortia-based network analyses for identifying microbial interactions that underpin the structure and functioning of microbial communities.

59 BASIC BIOLOGICAL SCIENCES↗

Comparison of Two Statistical Models for Low Boom Dose-response Relationships with Correlated Responses

This study compares two statistical models to construct summary dose-response curves for low boom community noise surveys. Data from two NASA field surveys are used that consist of multiple responses per survey participant. These data require an approach that accounts for the correlation among repeated annoyance observations from the same participant. A multilevel model accounts for the correlation by allowing estimated parameters to vary with each survey participant. On the other hand, a population average model utilizes generalized estimating equations and accounts for the correlation via a userspecified within-subject correlation structure. A visual comparison of the dose-response curves for these two methods reveals similar results. When comparing specific points along the summary curves, the multilevel model yields more precise confidence bounds than the population average model. The similarity between the summary curves derived from each model lends validity to both approaches for approximating a population representative summary curve, though modeling assumptions may lend favor to the multilevel logistic modeling approach over the population average model.

dose-response↗

FIRED (Fire Events Delineation): An Open, Flexible Algorithm and Database of US Fire Events Derived from the MODIS Burned Area Product (2001–2019)

Harnessing the fire data revolution, i.e., the abundance of information from satellites, government records, social media, and human health sources, now requires complex and challenging data integration approaches. Defining fire events is key to that effort. In order to understand the spatial and temporal characteristics of fire, or the classic fire regime concept, we need to critically define fire events from remote sensing data. Events, fundamentally a geographic concept with delineated spatial and temporal boundaries around a specific phenomenon that is homogenous in some property, are key to understanding fire regimes and more importantly how they are changing. Here, we describe Fire Events Delineation (FIRED), an event-delineation algorithm, that has been used to derive fire events (N = 51,871) from the MODIS MCD64 burned area product for the coterminous US (CONUS) from January 2001 to May 2019. The optimized spatial and temporal parameters to cluster burned area pixels into events were an 11-day window and a 5-pixel (2315 m) distance, when optimized against 13,741 wildfire perimeters in the CONUS from the Monitoring Trends in Burn Severity record. The linear relationship between the size of individual FIRED and Monitoring Trends in Burn Severity (MTBS) events for the CONUS was strong (R2 = 0.92 for all events). Importantly, this algorithm is open-source and flexible, allowing the end user to modify the spatio-temporal threshold or even the underlying algorithm approach as they see fit. We expect the optimized criteria to vary across regions, based on regional distributions of fire event size and rate of spread. We describe the derived metrics provided in a new national database and how they can be used to better understand US fire regimes. The open, flexible FIRED algorithm could be utilized to derive events in any satellite product. We hope that this open science effort will help catalyze a community-driven, data-integration effort (termed OneFire) to build a more complete picture of fire.

54 ENVIRONMENTAL SCIENCES↗

A Testbed Demonstration of an Intelligent Archive in a Knowledge Building System

The last decade's influx of raw data and derived geophysical parameters from several Earth observing satellites to NASA data centers has created a data-rich environment for Earth science research and applications. While advances in hardware and information management have made it possible to archive petabytes of data and distribute terabytes of data daily to a broad community of users, further progress is necessary in the transformation of data into information, and information into knowledge that can be used in particular applications in order to realize the full potential of these valuable datasets. In examining what is needed to enable this progress in the data provider environment that exists today and is expected to evolve in the next several years, we arrived at the concept of an Intelligent Archive in context of a Knowledge Building System (IA/KBS). Our prior work and associated papers investigated usage scenarios, required capabilities, system architecture, data volume issues, and supporting technologies. We identified six key capabilities of an IA/KBS: Virtual Product Generation, Significant Event Detection, Automated Data Quality Assessment, Large-Scale Data Mining, Dynamic Feedback Loop, and Data Discovery and Efficient Requesting. Among these capabilities, large-scale data mining is perceived by many in the community to be an area of technical risk. One of the main reasons for this is that standard data mining research and algorithms operate on datasets that are several orders of magnitude smaller than the actual sizes of datasets maintained by realistic earth science data archives. Therefore, we defined a test-bed activity to implement a large-scale data mining algorithm in a pseudo-operational scale environment and to examine any issues involved. The application chosen for applying the data mining algorithm is wildfire prediction over the continental U.S. This paper reports a number of observations based on our experience with this test-bed. While proof-of-concept for data mining scalability and utility has been a major goal for the research reported here, it was not the only one. The other five capabilities of an WKBS named above have been considered as well, and an assessment of the implications of our experience for these other areas will also be presented. The lessons learned through the testbed effort and presented in this paper will benefit technologists, scientists, and system operators as they consider introducing IA/KBS capabilities into production systems.

Ramapriyan, Hampapuram↗

The parallelism motifs of genomic data analysis

Genomic datasets are growing dramatically as the cost of sequencing continues to decline and small sequencing devices become available. Enormous community databases store and share these data with the research community, but some of these genomic data analysis problems require large-scale computational platforms to meet both the memory and computational requirements. These applications differ from scientific simulations that dominate the workload on high-end parallel systems today and place different requirements on programming support, software libraries and parallel architectural design. For example, they involve irregular communication patterns such as asynchronous updates to shared data structures. We consider several problems in high-performance genomics analysis, including alignment, profiling, clustering and assembly for both single genomes and metagenomes. We identify some of the common computational patterns or ‘motifs’ that help inform parallelization strategies and compare our motifs to some of the established lists, arguing that at least two key patterns, sorting and hashing, are missing. This article is part of a discussion meeting issue ‘Numerical algorithms for high-performance computational science’.

59 BASIC BIOLOGICAL SCIENCES↗

Report on HEP/ASCR Data Summit

Representatives from the HEP and ASCR communities met at Germantown on April 2-3, 2013, to discuss issues in carrying out science with large datasets and associated data-intensive computing tasks. The authors of this report acknowledge the important contributions made by all of the ASCR and HEP participants at the data summit and thank them for their efforts. During the meeting, HEP scientists made a series of presentations highlighting how they as a community interact with data, what tools they have developed in doing so, and the challenges to be faced moving forward. From the presentations and discussions, it became clear that the emerging data-intensive challenges span all HEP frontiers. Furthermore, since HEP is building fewer machines and experiments, there is increased emphasis in further optimizing the extraction of science results from the data by staying informed about the latest technologies and taking advantage of those that are particularly relevant. The joint summit proved to be very useful, as it not only familiarized the ASCR team with HEP science, but it also made apparent to the HEP group that there are significant common issues across the three HEP research frontiers that, in the past, have traditionally been addressed separately within each domain. A number of potential areas of common interest across the ASCR and HEP communities were identified. They cover the full range from pure R&D to focused assistance in the development and optimization of specific applications. It was generally agreed that HEP data management tools and techniques are already state of the art, and meet current needs. The community has extensive experience with management and analysis of large data sets. Properly planned joint HEP-ASCR research could incorporate transformational advances in developing tools for future applications. Both communities expressed the need to have viable models for maintenance of such tools and software, once developed.

97 MATHEMATICS AND COMPUTING↗

DISCo-microbe: design of an identifiable synthetic community of microbes

Microbiomes are extremely important for their host organisms, providing many vital functions and extending their hosts’ phenotypes. Natural studies of host-associated microbiomes can be difficult to interpret due to the high complexity of microbial communities, which hinders our ability to track and identify individual members along with the many factors that structure or perturb those communities. For this reason, researchers have turned to synthetic or constructed communities in which the identities of all members are known. However, due to the lack of tracking methods and the difficulty of creating a more diverse and identifiable community that can be distinguished through next-generation sequencing, most such in vivo studies have used only a few strains. To address this issue, we developed DISCo-microbe, a program for the design of an identifiable synthetic community of microbes for use in in vivo experimentation. The program is composed of two modules; (1) create, which allows the user to generate a highly diverse community list from an input DNA sequence alignment using a custom nucleotide distance algorithm, and (2) subsample, which subsamples the community list to either represent a number of grouping variables, including taxonomic proportions, or to reach a user-specified maximum number of community members. As an example, we demonstrate the generation of a synthetic microbial community that can be distinguished through amplicon sequencing. The synthetic microbial community in this example consisted of 2,122 members from a starting DNA sequence alignment of 10,000 16S rRNA sequences from the Ribosomal Database Project. We generated simulated Illumina sequencing data from the constructed community and demonstrate that DISCo-microbe is capable of designing diverse communities with members distinguishable by amplicon sequencing. Using the simulated data we were able to recover sequences from between 97–100% of community members using two different post-processing workflows. Furthermore, 97–99% of sequences were assigned to a community member with zero sequences being misidentified. We then subsampled the community list using taxonomic proportions to mimic a natural plant host–associated microbiome, ultimately yielding a diverse community of 784 members. DISCo-microbe can create a highly diverse community list of microbes that can be distinguished through 16S rRNA gene sequencing, and has the ability to subsample (i.e., design) the community for the desired number of members and taxonomic proportions. Although developed for bacteria, the program allows for any alignment input from any taxonomic group, making it broadly applicable. The software and data are freely available from GitHub and Python Package Index (PYPI).

16S rRNA↗