Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “community data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,747 records · Page 97

ICESat-2 Atmospheric Channel Description, Data Processing and First Results

The Advanced Topographic Laser Altimeter System (ATLAS) was launched aboard the Ice Cloud and land-Elevation Satellite-2 (ICESat-2) satellite in September 2018. ATLAS is a single wavelength (532 nm) lidar system designed to acquire high resolution measurements of the earth's surface while also obtaining atmospheric backscatter from molecules, clouds, and aerosols. Because ATLAS is optimized for altimetry, the atmospheric data acquired is unique in many respects and requires non-standard analysis techniques. For example, the high repetition rate laser limits the vertical extent of the profiles to just 14 km and causes atmospheric scattering from above 15 km to be added to the scattering in the lower 0–14 km profile. In addition, the limited vertical range of the acquired profiles renders it difficult to compute the magnitude of the solar background and hinders the application of standard calibration techniques. Despite these limitations, methods have been developed to successfully produce data products that have value to the atmospheric community for cloud and aerosol research and are currently available at the National Snow and Ice Data Center (NSIDC). In this paper we describe the ICESat-2 atmospheric channel and the methods used to process the ATLAS raw photon count data to obtain calibrated backscatter and higher level products such as layer heights and type, blowing snow, column optical depth and apparent surface reflectance.

Stephen P Palm↗

Implementing Clean Energy Transitions for Small Communities: NREL Supports Sierra Club Florida in Efforts to Help Florida Communities Achieve 100% Renewable Energy

Sierra Club Florida's "Clean Energy for All" campaign helps communities in Florida transition to 100% clean energy. The organization sought the help of National Renewable Energy Laboratory (NREL) analysts to achieve to achieve two goals: (1) create a Clean Energy Toolkit to help communities in Florida and across the country find data and and analysis to achieve clean energy goals, and (2) provide direct analysis of local clean energy potential for two Florida communities, the cities of Tallahassee and Sarasota.

clean energy toolkit↗

Restructuring Big Data to Improve Data Access and Performance in Analytic Services Making Research More Efficient for the Study of Extreme Weather Events and Application User Communities

By developing and enhancing various services and tools, the GES DISC provides users with the capability to access and visualize data, and to make comparisons of data from multiple sensor and models via a number of cross-discipline projects. Discovering Data via Faceted Web Interface Web interface to data products and services Search and Download mechanisms Dataset Landing Pages Accessing Data through Interoperable Services: GDS – GrADS Data Server OPeNDAP - Open-source Project for a Network Data Access Protocol WMS – OGC service GIS connector – allowing IS tools to access data easier (coming soon) HTTPS -- direct online access Downloading Data Basics: Subset and egridding Service – Parameter, Spatial, Time, Vertical, Mean averaging, format conversion, and regridding for L3/L4 gridded data Swath Data Subsetter – Parameter, spatial subset of L2 /L1 data. Visualizing Data Online: Giovanni –Visualization and Analysis L3/L4 gridded data AIRS NRT Viewer – AIRS near-real-time DQVis – L2 data quality visualization

data cube↗

Microbial Community Analysis with Ribosomal Gene Fragments from Shotgun Metagenomes

Shotgun metagenomic sequencing does not depend on gene-targeted primers or PCR amplification; thus, it is not affected by primer bias or chimeras. However, searching rRNA genes from large shotgun Illumina data sets is computationally expensive, and no approach exists for unsupervised community analysis of small-subunit (SSU) rRNA gene fragments retrieved from shotgun data. We present a pipeline, SSUsearch, to achieve the faster identification of short-subunit rRNA gene fragments and enabled unsupervised community analysis with shotgun data. It also includes classification and copy number correction, and the output can be used by traditional amplicon analysis platforms. Shotgun metagenome data using this pipeline yielded higher diversity estimates than amplicon data but retained the grouping of samples in ordination analyses. We applied this pipeline to soil samples with paired shotgun and amplicon data and confirmed bias against Verrucomicrobia in a commonly used V6-V8 primer set, as well as discovering likely bias against Actinobacteria and for Verrucomicrobia in a commonly used V4 primer set. In conclusion, this pipeline can utilize all variable regions in SSU rRNA and also can be applied to large-subunit (LSU) rRNA genes for confirmation of community structure.

59 BASIC BIOLOGICAL SCIENCES↗

Joint Genome Institute Analysis Workflow Service (JAWS) v2.7

The U.S. Department of Energy Joint Genome Institute (JGI) has developed the JGI Analysis Workflow Service (JAWS) as a distributed framework to run computational workflows across diverse high-performance computing (HPC) and cloud environments. JAWS enhances the reusability, scalability, and robustness of scientific workflows by orchestrating data movement, code execution, and results retrieval across multiple DOE facilities. At its core, JAWS integrates the Cromwell workflow engine to run workflows expressed in the Workflow Description Language (WDL), ensuring portability and interoperability. To provide consistent runtime environments, JAWS employs container technologies such as Shifter, Apptainer, and Docker. Workflow tasks are managed via HTCondor on HPC backends, while Globus ensures secure and efficient data transfer between sites. JAWS is deployed as a multi-site workflow manager across national laboratory computing facilities, with dedicated instances supporting community projects such as the National Microbiome Data Collaborative (NMDC) and KBase. This distributed, service-oriented architecture enables users to "write once, run anywhere," providing scalable, production-quality workflow execution.

Kirton, Edward↗

Verrucomicrobia are prevalent in north-temperate freshwater lakes and display class-level preferences between lake habitats

The bacterial phylum Verrucomicrobia was formally described two decades ago and originally believed to be a minor member of many ecosystems; however, it is now recognized as ubiquitous and abundant in both soil and aquatic systems. Nevertheless, knowledge of the drivers of its relative abundance and within-phylum habitat preferences remains sparse, especially in lake systems. Here, we documented the distribution of Verrucomicrobia in 12 inland lakes in Southeastern Michigan, a Laurentian Great Lake (Lake Michigan), and a freshwater estuary, which span a gradient in lake sizes, depths, residence times, and trophic states. A wide range of physical and geochemical parameters was covered by sampling seasonally from the surface and bottom of each lake, and by separating samples into particle-associated and free-living fractions. On average, Verrucomicrobia was the 4 th most abundant phylum (range 1.7–41.7%). Fraction, season, station, and depth explained up to 70% of the variance in Verrucomicrobia community composition and preference for these habitats was phylogenetically conserved at the class-level. When relative abundance was linearly modeled against environmental data, Verrucomicrobia and non-Verrucomicrobia bacterial community composition correlated to similar quantitative environmental parameters, although there were lake system-dependent differences and > 55% of the variance remained unexplained. A majority of the phylum exhibited preference for the particle-associated fraction and two classes (Opitutae and Verrucomicrobiae) were identified to be more abundant during the spring season. This study highlights the high relative abundance of Verrucomicrobia in north temperate lake systems and expands insights into drivers of within-phylum habitat preferences of the Verrucomicrobia.

54 ENVIRONMENTAL SCIENCES↗

Biological soil crusts: diminutive communities of potential global importance

Biological soil crusts (biocrusts) are widespread, diverse communities of cyanobacteria, fungi, lichens, and mosses living on soil surfaces, primarily in drylands. Biocrusts can locally govern primary production, soil fertility, hydrology, and surface energy balance, with considerable variation in these functions across alternate community states. Further, these communities have been implicated in Earth system functioning via potential influences on global biogeochemistry and climate. Biocrusts are easily destroyed by disturbances and appear to be exceptionally vulnerable to warming temperatures and altered precipitation inputs, signaling possible losses of dryland functions with global change. Despite these concerns, we lack sufficient spatiotemporal data on biocrust function, cover, and community structure to confidently assess their ecological roles across the extensive dryland biome. Here, we present the case for cross-scale research and restoration efforts coupled with remote-sensing and modeling approaches that improve our collective understanding of biocrust responses to global change and the ecological roles of these diminutive communities at global scales.

54 ENVIRONMENTAL SCIENCES↗

MycoCosm, an Integrated Fungal Genomics Resource

MycoCosm is a web-based interactive fungal genomics resource, which was first released in March 2010, in response to an urgent call from the fungal community for integration of all fungal genomes and analytical tools in one place (Pan-fungal data resources meeting, Feb 21-22, 2010, Alexandria, VA). MycoCosm integrates genomics data and analysis tools to navigate through over 100 fungal genomes sequenced at JGI and elsewhere. This resource allows users to explore fungal genomes in the context of both genome-centric analysis and comparative genomics, and promotes user community participation in data submission, annotation and analysis. MycoCosm has over 4500 unique visitors/month or 35000+ visitors/year as well as hundreds of registered users contributing their data and expertise to this resource. Its scalable architecture allows significant expansion of the data expected from JGI Fungal Genomics Program, its users, and integration with external resources used by fungal community.

59 BASIC BIOLOGICAL SCIENCES↗

The lipidomics reporting checklist a framework for transparency of lipidomic experiments and repurposing resource data

The rapid increase in lipidomic studies has led to a collaborative effort within the community to establish standards and criteria for producing, documenting, and disseminating data. Creating a dynamic checklist that condenses key information about lipidomic experiments into common terminology will enhance the field's consistency, comparability, and repeatability. Here, we describe the structure and rationale of the established Lipidomics Minimal Reporting Checklist to increase transparency in lipidomics research.

59 BASIC BIOLOGICAL SCIENCES↗

Data fusion for a vision-aided radiological detection system: Calibration algorithm performance

In order to improve the ability to detect, locate, track and identify nuclear/radiological threats, the University of Florida nuclear detection community has teamed up with the 3D vision community to collaborate on a low cost data fusion system. The key is to develop an algorithm to fuse the data from multiple radiological and 3D vision sensors as one system. The system under development at the University of Florida is being assessed with various types of radiological detectors and widely available visual sensors. A series of experiments were devised utilizing two EJ-309 liquid organic scintillation detectors (one primary and one secondary), a Microsoft Kinect for Windows v2 sensor and a Velodyne HDL-32E High Definition LiDAR Sensor which is a highly sensitive vision sensor primarily used to generate data for self-driving cars. Each experiment consisted of 27 static measurements of a source arranged in a cube with three different distances in each dimension. The source used was Cf-252. The calibration algorithm developed is utilized to calibrate the relative 3D-location of the two different types of sensors without need to measure it by hand; thus, preventing operator manipulation and human errors. The algorithm can also account for the facility dependent deviation from ideal data fusion correlation. Use of the vision sensor to determine the location of a sensor would also limit the possible locations and it does not allow for room dependence (facility dependent deviation) to generate a detector pseudo-location to be used for data analysis later. Using manually measured source location data, our algorithm-predicted the offset detector location within an average of 20 cm calibration-difference to its actual location. Calibration-difference is the Euclidean distance from the algorithm predicted detector location to the measured detector location. The Kinect vision sensor data produced an average calibration-difference of 35 cm and the HDL-32E produced an average calibration-difference of 22 cm. Using NaI and He-3 detectors in place of the EJ-309, the calibration-difference was 52 cm for NaI and 75 cm for He-3. In conclusion, the algorithm is not detector dependent; however, from these results it was determined that detector dependent adjustments are required.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

The SPICE concept - An approach to providing geometric and other ancillary information needed for interpretation of data returned from space science instruments

The Navigation Ancillary Information Facility (NAIF), acting under the direction of NASA's Office of Space Science and Applications, and with substantial participation of the planetary science community, is designing and implementing an ancillary data system - called SPICE - to assist scientists in planning and interpreting scientific observations taken from spaceborne instruments. The principal objective of the implemented SPICE system is that it will hold the essential geometric and related ancillary information needed to recover the full value of science instrument data, and that it will facilitate correlations of individual instrument datasets with data obtained from other instruments on the same or other spacecraft.

Acton, Charles H., Jr.↗

Surface Biology & Geology Pathfinder Data Analysis Pipeline

NASA's future global orbital mission, currently in development as the Surface Biology and Geology (SBG) Designated Observable study, will acquire relatively high resolution solar-reflected spectroscopy and thermal infrared observations. Innovative processes must be utilized for handling the high volume of data anticipated to be collected, which is anticipated to exceed 100 terabytes/day, greater than NASA's total extant airborne hyperspectral data collection. Collecting, processing/re-processing, disseminating, and exploiting this volume of data presents new challenges. To begin addressing them, NASA is drawing upon the expertise developed from its astrophysics programs to address Earth science and applications. Specifically, NASA is adapting the science processing operations technology developed for the Kepler and TESS planet-hunting missions for imaging spectroscopy data processing. This technology development has been the foundation for the remarkable scientific successes of Kepler and TESS. The Kepler/TESS data processing technology provides a scalable architecture for robust, repeatable, and replicable science and application products while enabling the Earth science community to develop, test, and implement new algorithms. Our effort to leverage this existing capability has begun by ingesting data and applying workflows from the EO-1/Hyperion 17-year mission archive that provides globally sampled visible through shortwave infrared spectra that are representative of SBG data types and volumes. This pathfinding data processing system will help define the solutions to processing SBG data volumes and will enable the scientific community to interact with the data and processing pipeline to create new science products.

Jenkins, Jon↗

gcamfaostat: An R package to prepare, process, and synthesize FAOSTAT data for global agroeconomic and multisector dynamic modeling

The gcamfaostat R package is designed for the preparation, processing, and synthesis of the Food and Agriculture Organization (FAO) Statistics (FAOSTAT) agroeconomic data. The primary purpose is to facilitate FAOSTAT data use in global economic and multisector dynamic models while ensuring transparency, traceability, and reproducibility. Here, we provide an overview of the development of gcamfaostat (v1.0) and demonstrate its capabilities in generating and maintaining agroeconomic data required for the Global Change Analysis Model (GCAM). Our initiative seeks to enhance the quality and accessibility of data for the global agroeconomic modeling community, with the aim of fostering more robust and harmonized outcomes in a collaborative, efficient, and open-source framework. One of the important features of the package is the possibility to construct the FAO Food Balance Sheets at the disaggregated commodity level (with over 500 commodities), which provides a comprehensive and detailed data input for a variety of analytical and modeling applications. The processed data and visualizations offered by gcamfaostat can also be valuable to a broader audience interested in gaining insights into the intricacies of global agriculture.

97 MATHEMATICS AND COMPUTING↗

Extension of the sasCIF format and its applications for data processing and deposition

Recent advances in small-angle scattering (SAS) experimental facilities and data analysis methods have prompted a dramatic increase in the number of users and of projects conducted, causing an upsurge in the number of objects studied, experimental data available and structural models generated. To organize the data and models and make them accessible to the community, the Task Forces on SAS and hybrid methods for the International Union of Crystallography and the Worldwide Protein Data Bank envisage developing a federated approach to SAS data and model archiving. Within the framework of this approach, the existing databases may exchange information and provide independent but synchronized entries to users. At present, ways of exchanging information between the various SAS databases are not established, leading to possible duplication and incompatibility of entries, and limiting the opportunities for data-driven research for SAS users. In this work, a solution is developed to resolve these issues and provide a universal exchange format for the community, based on the use of the widely adopted crystallographic information framework (CIF). The previous version of the sasCIF format, implemented as an extension of the core CIF dictionary, has been available since 2000 to facilitate SAS data exchange between laboratories. The sasCIF format has now been extended to describe comprehensively the necessary experimental information, results and models, including relevant metadata for SAS data analysis and for deposition into a database. Processing tools for these files ( sasCIFtools ) have been developed, and these are available both as standalone open-source programs and integrated into the SAS Biological Data Bank, allowing the export and import of data entries as sasCIF files. Software modules to save the relevant information directly from beamline data-processing pipelines in sasCIF format are also developed. Lastly, this update of sasCIF and the relevant tools are an important step in the standardization of the way SAS data are presented and exchanged, to make the results easily accessible to users and to promote further the application of SAS in the structural biology community.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

Advancing Open Science through Public-Private Partnerships

Rapid technology developments are changing the way data-driven research is performed within the science community. With the emergence of cloud computing, this has quickly become a viable approach for enabling “science at scale”. Researchers are no longer hindered by obstacles of data management and data wrangling, allowing them to quickly discover, access and perform analysis on extremely large datasets. Infrastructures that move data out of institutional silos and into a computational platform, will ensure that data and tools are accessible to all users. NASA’s Interagency Implementation and Advanced Concepts Team (IMPACT) seeks to address these rapid technology developments by establishing Space Act Agreements with selected partners from the public-private sector working in the area of cloud computing. These agreements aim to explore new opportunities with commercial cloud providers to accelerate open science and enable discovery, access and use of data sets on the cloud. In addition, they will also help establish training workshops for the science community to help researchers utilize the cloud for science. In this talk, we will present an overview of current and new partnerships we are developing to support open science and open data initiatives.

Elizabeth Fancher↗

A method to provide rapid in situ determination of tip radius in dynamic atomic force microscopy

We provide a method to characterize the tip radius of an atomic force microscopy in situ by monitoring the dynamics of the cantilever in ambient conditions. The key concept is that the value of free amplitude for which transitions from the attractive to repulsive force regimes are observed, strongly depends on the curvature of the tip. In practice, the smaller the value of free amplitude required to observe a transition, the sharper the tip. This general behavior is remarkably independent of the properties of the sample and cantilever characteristics and shows the strong dependence of the transitions on the tip radius. The main advantage of this method is rapid in situ characterization. Rapid in situ characterization enables one to continuously monitor the tip size during experiments. Further, we show how to reproducibly shape the tip from a given initial size to any chosen larger size. This approach combined with the in situ tip size monitoring enables quantitative comparison of materials measurements between samples. These methods are set to allow quantitative data acquisition and make direct data comparison readily available in the community.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Novel functional and distributed approaches to data analysis available in ROOT

The bright future of particle physics at the Energy and Intensity frontiers poses exciting challenges to the scientific software community. The traditional strategies for processing and analyzing data are evolving in order to (i) offer higher-level programming model approaches and (ii) exploit parallelism to cope with the ever increasing complexity and size of the datasets. This contribution describes how the ROOT framework, a cornerstone of software stacks dedicated to particle physics, is preparing to provide adequate solutions for the analysis of large amount of scientific data on parallel architectures. The functional approach to parallel data analysis provided with the ROOT TDataFrame interface is then characterized. The design choices behind this new interface are described also comparing with other widely adopted tools such as Pandas and Apache Spark. The programming model is illustrated highlighting the reduction of boilerplate code, composability of the actions and data transformations as well as the capabilities of dealing with different data sources such as ROOT, JSON, CSV or databases. Details are given about how the functional approach allows transparent implicit parallelization of the chain of operations specified by the user. The progress done in the field of distributed analysis is examined. In particular, the power of the integration of ROOT with Apache Spark via the PyROOT interface is shown. In addition, the building blocks for the expression of parallelism in ROOT are briefly characterized together with the structural changes applied in the building and testing infrastructure which were necessary to put them in production.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Validating the Funnel, Filter Paper, and Drainage Method for Maximum Water Holding Capacity Over a Wide Range of Soil Textures

The data provided includes the results of maximum water holding capacity using the funnel, filter paper, and drainage (FFPD) method, as well as soil water retention curves generated from the water desorption method (via pressure cells) for a full range of soil textures. It will also include data from sensitivity trials to test readily available materials and varying conditions the FFPD method could be expanded to use for more accessibility to community scientists. The format will be in data tables.

Nelson, Jessica↗