Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “community data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6

Digital Rocks Portal (Digital Porous Media): Connecting data, simulation and community

Digital Rocks Portal (DRP, https://www.digitalrocksportal.org) organizes and preserves imaged datasets and experimental measurements of porous materials in subsurface, and beyond, with the mission to connect them to simulation and analysis, as well as educate the research community. We have over 150 projects represented in more than 200 publications, and an active community that reuses the data, most recently in multiple machine learning applications for automating image analysis as well as the prediction of transport. Such automation is crucial for performing formation evaluation tasks in near-real time. We present benchmark datasets that have played a role in recent machine learning prediction successes in the field. We further discuss the vision for further research advances, educational materials, as well as growth and sustainability plan of this digital rock physics community resource. In particular, we are in the process of expanding into a broader repository of engineered porous materials, specifically those for energy storage and the portal will transition to Digital Porous Media (DPM) in near future.

58 GEOSCIENCES↗

Xarray Climate Data Analysis Tools

xCDAT is an extension of xarray for climate data analysis on structured grids. It serves as a modern successor to the Community Data Analysis Tools (CDAT) library. Xarray is an "open source project and Python package that introduces labels in the form of dimensions, coordinates, and attributes on top of raw NumPy-like arrays, which allows for more intuitive, more concise, and less error-prone user experience. Xarray includes a large and growing library of domain-agnostic functions for advanced analytics and visualization with these data structures" (source: https://xarray.dev/). The goal of xCDAT is to provide generalizable features and utilities for simple and robust analysis of climate data. xCDAT's design philosophy is focused on reducing the overhead required to accomplish certain tasks in xarray. Some key xCDAT features are inspired by or ported from the core CDAT library, while others leverage powerful libraries in the xarray ecosystem (e.g., xESMF and cf_xarray) to deliver robust APIs.

Vo, Tom↗

Tessera: Open source software for accelerated data science

Extracting useful, actionable information from data can be a formidable challenge for the safeguards, nonproliferation, and arms control verification communities. Data scientists are often on the “front-lines” of making sense of complex and large datasets. They require flexible tools that make it easy to rapidly reformat large datasets, interactively explore and visualize data, develop statistical algorithms, and validate their approaches—and they need to perform these activities with minimal lines of code. Existing commercial software solutions often lack extensibility and the flexibility required to address the nuances of the demanding and dynamic environments where data scientists work. To address this need, Pacific Northwest National Laboratory developed Tessera, an open source software suite designed to enable data scientists to interactively perform their craft at the terabyte scale. Tessera automatically manages the complicated tasks of distributed storage and computation, empowering data scientists to do what they do best: tackling critical research and mission objectives by deriving insight from data. We illustrate the use of Tessera with an example analysis of computer network data.

Sego, Landon H.↗

A Guide to Using GitHub for Developing and Versioning Data Standards and Reporting Formats

Abstract Data standardization combined with descriptive metadata facilitate data reuse, which is the ultimate goal of the Findable, Accessible, Interoperable, and Reusable (FAIR) principles. Community data or metadata standards are increasingly created through an approach that emphasizes collaboration between various stakeholders. Such an approach requires platforms for collaboration on the development process that centers on sharing information and receiving feedback. Our objective in this study was to conduct a systematic review to identify data standards and reporting formats that use version control for developing data standards and to summarize common practices, particularly in earth and environmental sciences. Out of 108 data standards and reporting formats identified in our review, 32 used GitHub as the version control platform, and no other platforms were used. We found no universally accepted methodology for developing and publishing data standards. Many GitHub repositories did not use key features that could help developers to gather user feedback, or to create and revise standards that build on previous work. We provide guidance for community‐driven standard development and associated documentation on GitHub based on a systematic review of existing practices.

54 ENVIRONMENTAL SCIENCES↗

The MolSSI QCArchive project: An open-source platform to compute, organize, and share quantum chemistry data

The Molecular Sciences Software Institute's (MolSSI) Quantum Chemistry Archive (QCArchive) project is an umbrella name that covers both a central server hosted by MolSSI for community data and the Python-based software infrastructure that powers automated computation and storage of quantum chemistry (QC) results. The MolSSI-hosted central server provides the computational molecular sciences community a location to freely access tens of millions of QC computations for machine learning, methodology assessment, force-field fitting, and more through a Python interface. Facile, user-friendly mining of the centrally archived quantum chemical data also can be achieved through web applications found at the website. The software infrastructure can be used as a standalone platform to compute, structure, and distribute hundreds of millions of QC computations for individuals or groups of researchers at any scale. The QCArchiveInfrastructure is open-source (BSD-3C), code repositories can be found at github, and releases can be downloaded via PyPI and Conda. This article is categorized under: Electronic Structure Theory > Ab Initio Electronic Structure Methods Software > Quantum Chemistry Data Science > Computer Algorithms and Programming

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Application of Data Cubes for Improving Detection of Water Cycle Extreme Events

As part of an ongoing NASA-funded project to remove a longstanding barrier to accessing NASA data (i.e., accessing archived time-step array data as point-time series), for the hydrology and other point-time series-oriented communities, "data cubes" are created from which time series files (aka "data rods") are generated on-the-fly and made available as Web services from the Goddard Earth Sciences Data and Information Services Center (GES DISC). Data cubes are data as archived rearranged into spatio-temporal matrices, which allow for easy access to the data, both spatially and temporally. A data cube is a specific case of the general optimal strategy of reorganizing data to match the desired means of access. The gain from such reorganization is greater the larger the data set. As a use case of our project, we are leveraging existing software to explore the application of the data cubes concept to machine learning, for the purpose of detecting water cycle extreme events, a specific case of anomaly detection, requiring time series data. We investigate the use of support vector machines (SVM) for anomaly classification. We show an example of detection of water cycle extreme events, using data from the Tropical Rainfall Measuring Mission (TRMM).

water cycle extreme events↗

Modernization efforts for the R -Matrix code SAMMY [Abstract]

The R-Matrix code SAMMY is a widely used nuclear data evaluation code focused on the resolved range, which includes corrections for experimental effects. The code is still mostly written in Fortran 77, and uses a memory management system suitable for the time of its initial writing (1984). A modernization effort is under way to bring the code in-line with modern software development practices. A continuous-integration testing framework was added, automating the large existing set of test cases. It is run on every commit. The memory management was updated to current standard practices suitable for modern software analysis tools. The code can be obtained from https://code.ornl.gov/RNSD/SAMMY. The resonance parameters and covariance information are now stored in C++ objects shared by SAMMY and AMPX, the processing code that generates nuclear data libraries for SCALE. This allows for easier maintenance and access to the resonance parameters inside and outside of SAMMY. This feature is already used by accessing and changing parameters in memory in the Bayesian Monte Carlo Evaluation Framework for Cross Sections Nuclear Data and Integral Benchmark Experiments project, Further plans include the switch to the ENDF reading and writing routines in AMPX, as these routines are more robust, easier to maintain, and support more features. Of note here is support for the new GNDS format. Previously it wasn’t easy to share the full covariance matrix for evaluations containing more than one isotope due to limitations on the ENDF format; this is now supported in GNDS. The data are currently available in a binary SAMMY format and can be exported to GNDS to make them more widely available and sharable. The next step will be to use the same resonance processing code at 0K in AMPX and SAMMY as one of the available Reich-Moore R-Matrix formalism. The first step toward this goal is to isolate the reconstruction into a module that takes resonance parameters as its input and does not depend on SAMMY global parameters. This goal has been achieved and it should now be possible to more easily change the resonance formalism and add enhancements as the Phenomenological R-Matrix parameterization of direct, doorway, and compound nuclear reactions discussed elsewhere on this conference. This concerted modernization and enhancement effort provides multiple advantages to the nuclear data community. It will allow parameter optimization using enhanced formalisms, including experimental effects, that better match complex experimental data. Then those evaluated parameters can immediately be passed off to AMPX to be reconstructed with the exact same cross section model and be put into a data library for subsequent testing using SCALE and the Valid Benchmark suite or other suitable benchmark suites.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Preliminary Designs for Criticality Safety Benchmarks—Iron/Steel/Chromium Series

The nuclear criticality safety community uses critical benchmarks extensively when analyzing nuclear systems. Having benchmarks sensitive to important materials of interest helps to ensure safety and constrain results. Critical benchmarks are also invaluable to the nuclear data community, which uses these benchmarks as a check and measure of quality of nuclear data libraries. Additionally, integral benchmarks are often used to validate the performance of computational tools for simulating nuclear systems. Many integral benchmarks have been documented in the International Criticality Safety Benchmark Evaluation Project (ICSBEP) handbook, the International Reactor Physics Experiment Evaluation Project (IRPhEP) handbook, and the Shielding Integral Benchmark Archive Database (SINBAD). The National Criticality Experiments Research Center (NCERC), operated by Los Alamos National Laboratory, is the only general purpose critical experiments facility in the United States of America. NCERC regularly designs and executes critical experiments and other measurements useful to a wide variety of fields including nuclear criticality safety, commercial nuclear energy, nonproliferation, and nuclear data. NCERC has recently developed tools to visualize gaps and deficiencies in existing criticality benchmarks – this work is still ongoing. Through this work and other reviews, some high priority deficiencies have been identified. This paper aims to highlight three areas where additional critical benchmarks would be useful to the nuclear criticality safety community and various other groups. Additionally, NCERC is seeking feedback in regard to these proposed measurements to make sure they are as useful to as many communities as possible.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Data Democratization: Challenges and Opportunities

Democratizing Earth data is one of the challenges many organizations around the world face in order to maximize the use of their Earth data for research, applications, education, and societal benefits. For example, at the NASA Goddard Earth Sciences (GES) Data and Information Services Center (DISC), over 1600 global and regional datasets in several NASA Earth science focus areas, including atmospheric composition, water and energy cycles, and climate variability, are archived and distributed to the public. Giovanni, the Geospatial Interactive Online Visualization and Analysis Infrastructure, was developed by GES DISC to facilitate data access and exploration, especially for novice users of Earth science. With Giovanni, users can analyze and visualize over 2000 Earth science variables (e.g., precipitation, aerosol, surface wind) without downloading data, software, the expert understanding of data formats and structures, and coding skills, lowering the barrier to data analysis/comparison by preprocessing and accessing to the data. Results of data analysis and visualization can be accessed in several popular formats (e.g., NetCDF, CSV). As a result of Giovanni's efforts, more than 3000 referral papers have been published in various fields. In spite of this, Giovanni is still difficult to use for some users. For instance, if one searches for "precipitation," it will return over 150 related variables. The question is, which one to use? Furthermore, variables from different data providers (e.g., satellites and models) are named differently with different units, further confusing users, especially those outside the communities. Data democratization is complex and multifaceted. Challenges include service and data discovery, user experiences, visualization, data quality, trustworthiness, and more. In this presentation, we will examine Giovanni as an example of challenges and opportunities in developing data democratization services.

data democratization↗

NASA’s Global Precipitation Measurement Mission: Leveraging Stakeholder Engagement & Applications Activities to Inform Decision-making

The application of satellite precipitation estimates from NASA’s Global Precipitation Measurement (GPM) Mission for decision-making has been a focus for the mission since launch. As a result, GPM data have enabled a range of applications that address societal needs, including water resource management, crop forecasting, ecological monitoring, disaster response, public health, aviation, weather forecasting, and climate modeling, among others. GPM applications activities have continued to focus on user engagement through in person trainings and interviews, workshops, webinars, and educational outreach activities. The goals of these efforts are to synthesize community data needs in order to effectively support and enable decision-making across agencies, academia and the global community. While these efforts have helped the GPM mission establish a large stakeholder community that encompasses federal and state partners, academic institutions, nd private and nonprofit companies, there remains difficulties associated with accessing, processing, and applying the data to support or enable applications. In this article, we present GPM applications strategies and approaches used to enhance the applications value of GPM data, and most importantly, demonstrate how these efforts have and can inform different decision-making contexts. This work also provides a discussion on key lessons learned from the user community and how this information can be utilized to help better support and shape applications approaches for future NASA Earth Science missions.

Satellite precipitation↗

Tripal, a community update after 10 years of supporting open source, standards-based genetic, genomic and breeding databases

Abstract Online, open access databases for biological knowledge serve as central repositories for research communities to store, find and analyze integrated, multi-disciplinary datasets. With increasing volumes, complexity and the need to integrate genomic, transcriptomic, metabolomic, proteomic, phenomic and environmental data, community databases face tremendous challenges in ongoing maintenance, expansion and upgrades. A common infrastructure framework using community standards shared by many databases can reduce development burden, provide interoperability, ensure use of common standards and support long-term sustainability. Tripal is a mature, open source platform built to meet this need. With ongoing improvement since its first release in 2009, Tripal provides full functionality for searching, browsing, loading and curating numerous types of data and is a primary technology powering at least 31 publicly available databases spanning plants, animals and human data, primarily storing genomics, genetics and breeding data. Tripal software development is managed by a shared, inclusive governance structure including both project management and advisory teams. Here, we report on the most important and innovative aspects of Tripal after 11 years development, including integration of diverse types of biological data, successful collaborative projects across member databases, and support for implementing FAIR principles.

59 BASIC BIOLOGICAL SCIENCES↗

Grassroots Efforts To Quantify and Improve the Academic Climate of an R1 STEM Department: Using Evidence-Based Discussions To Foster Community

Women and some racial and ethnic groups remain underrepresented in chemistry departments across the United States, and generally, efforts to improve representation have resulted in minimal or no improvements in the last 10 years. Here, we present the outcomes of a graduate-student-led initiative that sought to assess the issues affecting inclusivity, diversity, and wellness within the Department of Chemistry at the University of California, Berkeley. We report how the results of a department-tailored academic climate survey were used to develop a method to foster open, productive discussion among graduate students, postdoctoral researchers, and faculty. This event format led to an improved understanding of the challenges facing our community members, as well as the identification of strategies that can be used to make the Department of Chemistry more welcoming for all members. We report the success of this student-led effort to highlight the value of assessing diversity and inclusion at the department-level, as well as the benefits of using community data to stimulate productive, evidence-based discussions. Furthermore, we envision that these methods can be implemented within any research-focused academic community to promote positive cultural change.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

A global gridded dataset for cloud vertical structure from combined CloudSat and CALIPSO observations

Abstract. The vertical structure of clouds has a profound effect on the global energy budget, the global circulation, and the atmospheric hydrological cycle. The CloudSat and Cloud-Aerosol Lidar and Infrared Pathfinder Satellite Observations (CALIPSO) missions have taken complementary, colocated observations of cloud vertical structure for over a decade. However, no globally gridded dataset is available to the public for the full length of this unique combined data record. Here we present the 3S-GEOPROF-COMB product (Bertrand et al. 2023, https://doi.org/10.5281/zenodo.8057791), a globally gridded (level 3S) community data product summarizing geometrical profiles (GEOPROF) of hydrometeor occurrence from combined (COMB) CloudSat and CALIPSO data. Our product is calculated from the latest release (R05) of per-orbit (level-2) combined cloud mask profiles. We process a set of cloud cover, vertical cloud fraction, and sampling variables at 2.5, 5, and 10° spatial resolutions and monthly and seasonal temporal resolutions. We address the 2011 reduction in CloudSat data collection with Daylight-Only Operations (DO-Op) mode by subsampling pre-2011 data to mimic DO-Op collection patterns, thereby allowing users to evaluate the impact of the reduced sampling on their analyses. We evaluate our data product against CloudSat-only and CALIPSO-only global-gridded data products as well as four comparable surface-based sites, underscoring the added value of the combined product. Interest in the product is anticipated for the study of cloud processes, cloud–climate interactions, and as a candidate baseline climate data record for comparison to follow-up satellite missions, among other uses.

Bertrand, Leah (ORCID:0009000001607558)↗

A Parameter-masked Mock Data Challenge for Beyond-two-point Galaxy Clustering Statistics

The past few years have seen the emergence of a wide array of novel techniques for analyzing high-precision data from upcoming galaxy surveys, which aim to extend the statistical analysis of galaxy clustering data beyond the linear regime and the canonical two-point (2pt) statistics. We test and benchmark some of these new techniques in a community data challenge named “Beyond-2pt,” initiated during the Aspen 2022 Summer Program “Large-Scale Structure Cosmology beyond 2-Point Statistics,” whose first round of results we present here. The challenge data set consists of high-precision mock galaxy catalogs for clustering in real space, in redshift space, and on a light cone. Participants in the challenge have developed end-to-end pipelines to analyze mock catalogs and extract unknown (“masked”) cosmological parameters of the underlying ΛCDM models with their methods. The methods represented are density-split clustering, nearest neighbor statistics, BACCO power spectrum emulator, void statistics, LEFTfield field-level inference using effective field theory (EFT), and joint power spectrum and bispectrum analyses using both EFT and simulation-based inference. In this work, we review the results of the challenge, focusing on problems solved, lessons learned, and future research needed to perfect the emerging beyond-2pt approaches. The unbiased parameter recovery demonstrated in this challenge by multiple statistics and the associated modeling and inference frameworks supports the credibility of cosmology constraints from these methods. The challenge data set is publicly available, and we welcome future submissions from methods that are not yet represented.

Krause, Elisabeth [Univ. of Arizona, Tucson, AZ (U↗

Nuclear Data for Astrophysics Research: A New Online Paradigm

Our knowledge of a wide range of astrophysical processes depends crucially on nuclear physics data. While new nuclear information is being generated at an ever-increasing rate, the methods to process this information into astrophysical simulations have changed little over the decades and cannot keep pace. Working online, 'cloud computing', may be the methodology breakthrough needed to ensure that the latest nuclear data quickly gets into astrophysics codes. The successes of the first utilization of cloud computing for nuclear astrophysics will be described. The advantages of cloud computing for the broader nuclear data community are also discussed.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Transportability of exogenous microbial community correlates with interwell connectivity in deep aquifers

Subsurface resource engineering operations often utilize continuous injection of externally-sourced water into geological reservoirs for formation pressure maintenance, resource recovery or energy/waste storage. Such injected water generally contains naturally occurring microbes. Little is known, however, about how the injectate microbes transport through geological media as a community, how such transportability is affected by injector-producer connectivity, and whether such knowledge can be utilized for flowpath characterization. In this study, we analyzed daily-to-weekly timeseries microbial community data from the injected- and produced-fluids of a ten-month flow test at a deep, well-characterized engineered aquifer. We found that the injectate microbial community was distinct from the indigenous community at the amplicon sequence variant (ASV) level, and that the transportability of injectate community towards a given producer, quantified by an “nASV-Overlap” metric we propose, had strong and significant positive correlation with known injector-producer connectivities at our site. This suggests that the better the connectivity, the higher the probability for more injectate species to flow through the interwell region and arrive at a producer. Because interwell connectivity is an important yet usually unknown parameter in subsurface resource engineering, such correlation in turn points to nASV-Overlap as a useful indicator of interwell connectivity for aquifer characterization and long-term monitoring. Based on our findings, an nASV-Overlap-based microbial tracing approach was developed for characterizing and monitoring the relative connectivities across multiple producers with a given injector. A side-by-side comparison between the new nASV-Overlap approach and traditional artificial tracer methods is presented, and their respective strengths and limitations are discussed.

Deep biosphere↗

Community structure – Ecosystem function relationships in the Congo Basin methane cycle depend on the physiological scale of function

Belowground ecosystem processes can be highly variable and difficult to predict using microbial community data. Here, we argue that this stems from at least three issues: (a) complex covariance structure of samples (with environmental conditions or spatial proximity) can make distinguishing biotic drivers a challenge; (b) communities can control ecosystem processes through multiple mechanisms, making the identification of these controls a challenge; and (c) ecosystem function assessments can be broad in physiological scale, encapsulating multiple processes with unique microbially mediated controls. In this work, we test these assertions using methane (CH 4 )-cycling processes in soil samples collected along a wetland-to-upland habitat gradient in the Congo Basin. We perform our measurements of function under controlled laboratory conditions and statistically control for environmental covariates to aid in identifying biotic drivers. We divide measurements of microbial communities into four attributes (abundance, activity, composition, and diversity) that represent different forms of community control. Lastly, our process measurements differ in physiological scale, including broader processes (gross methanogenesis and methanotrophy) that involve more mediating groups, to finer processes (hydrogenotrophic methanogenesis and high-affinity CH 4 oxidation) with fewer mediating groups. We observed that finer scale processes can be more readily predicted from microbial community structure than broader scale processes. In addition, the nature of those relationships differed, with broad processes limited by abundance while fine-scale processes were associated with diversity and composition. These findings demonstrate the importance of carefully defining the physiological scale of ecosystem function and performing community measurements that represent the range of possible controls on ecosystem processes.

54 ENVIRONMENTAL SCIENCES↗

xCDAT: A Python Package for Simple and Robust Analysis of Climate Data

xCDAT (Xarray Climate Data Analysis Tools) is an open-source Python package that extends Xarray (Hoyer & Hamman, 2017) for climate data analysis on structured grids. xCDAT streamlines analysis of climate data by exposing common climate analysis operations through a set of straightforward APIs. Some of xCDAT’s key features include spatial averaging, temporal averaging, and regridding. These features are inspired by the Community Data Analysis Tools (CDAT) library (Dean N. Williams et al., 2009) (D. N. Williams, 2014) (Doutriaux et al., 2019) and leverage powerful packages in the Xarray ecosystem including xESMF (Zhuang et al., 2023), xgcm (Abernathey et al., 2022), and CF xarray (Cherian et al., 2023). To ensure general compatibility across various climate models, xCDAT operates on datasets that are compliant with the Climate and Forecast (CF) metadata conventions (Hassell et al., 2017).

54 ENVIRONMENTAL SCIENCES↗