Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “community data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 919 records · Page 51

Lessons Learned From Smallsat Microwave Sounders Data Assimilation in the NASA Goddard Earth Observing System (GEOS)

The NASA Time-Resolved Observations of Precipitation structure and storm Intensity with a Constellation of Smallsats (TROPICS) mission is a constellation of small satellites carrying state-of-art microwave temperature and humidity sounders with 12 channels between 91 GHz and 205 GHz frequency. Including TROPICS-pathfinder, launched on 30 June 2021, five TROPICS satellites operate and provide temperature and humidity data to NWP and atmospheric retrieval communities. This study evaluates the quality of radiance data from these five satellites. It assesses data impacts on NASA Goddard Earth Observing System (GEOS) global NWP analysis and forecasts while seeking answers to the following key questions: 1. What information do TROPICS satellites bring to NWP analysis? 2. How will TROPICS data assimilation affect NWP forecasts, including tropical cyclone analysis and forecasts? 3. What are the benefits of having multiple TROPICS satellites in NWP forecasts? 4. What are the weaknesses regarding instrument stability, consistency, and data quality of these CubeSats? 5. Can multiple TROPICS make similar impacts as conventional MW sensors such as ATMS or GPM Microwave Imager (GMI)? The sensitivities of each TROPICS channel to temperature, water vapor, cloud, and precipitation are examined in various weather conditions. Results from observing system experiments assimilating TROPICS radiance are used for evaluation metrics, including forecast skills and fit to other observations such as radiosondes and microwave and infrared sounders. Finally, the lessons learned from using these cube satellite radiance data in the GEOS atmospheric data assimilation system are shared.

Min-Jeong Kim↗

Surface and subsurface oceanographic features drive forage fish distributions and aggregations: Implications for prey availability to top predators in the US Northeast Shelf ecosystem

Abstract Forage fishes are a critical food web link in marine ecosystems, aggregating in a hierarchical patch structure over multiple spatial and temporal scales. Surface‐level forage fish aggregations (FFAs) represent a concentrated source of prey available to surface‐ and shallow‐foraging marine predators. Existing survey and analysis methods are often imperfect for studying forage fishes at scales appropriate to foraging predators, making it difficult to quantify predator–prey interactions. In many cases, general distributions of forage fish species are known; however, these may not represent surface‐level prey availability to predators. Likewise, we lack an understanding of the oceanographic drivers of spatial patterns of prey aggregation and availability or forage fish community patterns. Specifically, we applied Bayesian joint species distribution models to bottom trawl survey data to assess species‐ and community‐level forage fish distribution patterns across the US Northeast Continental Shelf (NES) ecosystem. Aerial digital surveys gathered data on surface FFAs at two project sites within the NES, which we used in a spatially explicit hierarchical Bayesian model to estimate the abundance and size of surface FFAs. We used these models to examine the oceanographic drivers of forage fish distributions and aggregations. Our results suggest that, in the NES, regions of high community species richness are spatially consistent with regions of high surface FFA abundance. Bathymetric depth drove both patterns, while subsurface features, such as mixed layer depth, primarily influenced aggregation behavior and surface features, such as sea surface temperature, sub‐mesoscale eddies, and fronts influenced forage fish diversity. In combination, these models help quantify the availability of forage fishes to marine predators and represent a novel application of spatial models to aerial digital survey data.

54 ENVIRONMENTAL SCIENCES↗

Rare species do not disproportionately contribute to phylogenetic diversity in a subalpine plant community

Abstract Premise Within plant communities, few species are abundant, and most are locally rare. Worldwide, 36% of plant species are exceedingly rare and often face high extinction risk. However, the community phylogenetic impact of the loss of rare plants is largely unknown in many systems. We address this gap by investigating how rare species contribute to phylogenetic diversity, considering multiple metrics of rarity and multiple elevations in a subalpine plant community. Methods We collected abundance data at three sites near the Rocky Mountain Biological Laboratory (Colorado, USA). We calculated each species' range size from public occurrence data. We calculated phylogenetic signal for abundance and range size, compared community phylogenetic metrics weighted by range size and abundance to unweighted metrics, and quantified the change in phylogenetic diversity when removing single species and groups of species ranked by rarity. Results We found phylogenetic signal for abundance, but not range size. There was no difference between rarity‐weighted and ‐unweighted phylogenetic diversity metrics. Finally, phylogenetic diversity did not decline more when we removed single rare species or groups of rare species than when we removed single common species and groups of common species. Conclusions We found that rare species, whether at low abundance or with a small range, do not disproportionately contribute to phylogenetic diversity in our subalpine plant community. These results were consistent across elevations. Instead, rare species might provide phylogenetic redundancy with common species. Deeper understanding of functional differentiation is needed to understand contributions of rare species to this system.

Plant Sciences↗

Spatial effects on hybrid electric vehicle adoption

This paper examines spatial effects on hybrid-electric vehicle (HEV) adoption. This is in contrast to most existing analyses, which concentrate on analyzing socioeconomic factors and demographics. This paper uses a general spatial model to estimate the strength of ‘neighbor effects’ on HEV adoption—namely that each consumer’s HEV-adoption decision can be influenced by the HEV-adoption decisions of geographic neighbors. We use detailed census tract-level demographic data from the 2010 United States Census and the 2012 American Community Survey and vehicle registration data collected by the Ohio Bureau of Motor Vehicles. We find that HEV adoption exhibits significant spatial effects. We further conduct a time-series analysis and show that historical HEV adoption has a spatial effect on future adoption. Lastly, these results suggest that HEVs may appear in more dense clusters than models that do not consider spatial effects predict.

99 GENERAL AND MISCELLANEOUS↗

In-flight positional and energy use data set of a DJI Matrice 100 quadcopter for small package delivery

Abstract We autonomously directed a small quadcopter package delivery Uncrewed Aerial Vehicle (UAV) or “drone” to take off, fly a specified route, and land for a total of 209 flights while varying a set of operational parameters. The vehicle was equipped with onboard sensors, including GPS, IMU, voltage and current sensors, and an ultrasonic anemometer, to collect high-resolution data on the inertial states, wind speed, and power consumption. Operational parameters, such as commanded ground speed, payload, and cruise altitude, were varied for each flight. This large data set has a total flight time of 10 hours and 45 minutes and was collected from April to October of 2019 covering a total distance of approximately 65 kilometers. The data collected were validated by comparing flights with similar operational parameters. We believe these data will be of great interest to the research and industrial communities, who can use the data to improve UAV designs, safety, and energy efficiency, as well as advance the physical understanding of in-flight operations for package delivery drones.

42 ENGINEERING↗

Dynamic Non-Hierarchical File Systems for Exascale Storage

This constitutes the final report for “Dynamic Non-Hierarchical File Systems for Exascale Storage”. The ultimate goal of this project was to improve data management in scientific computing and high-end computing (HEC) applications, and to achieve this goal we proposed: to develop the first, HEC-targeted, file system featuring rich metadata and provenance collection, extreme scalability, and future storage hardware integration as core design goals, and to evaluate and develop a flexible non-hierarchical file system interface suitable for providing more powerful and intuitive data management interfaces to HEC and scientific computing users. Data management is swiftly becoming a serious problem in the scientific community – while copious amounts of data are good for obtaining results, finding the right data is often daunting and sometimes impossible. Scientists participating in a Department of Energy workshop noted that most of their time was spent “...finding, processing, organizing, and moving data and it’s going to get much worse”. Scientists should not be forced to become data mining experts in order to retrieve the data they want, nor should they be expected to remember the naming convention they used several years ago for a set of experiments they now wish to revisit. Ideally, locating the data you need would be as easy as browsing the web. Unfortunately, existing data management approaches are usually based on hierarchical naming, a 40 year-old technology designed to manage thousands of files, not exabytes of data. Today’s systems do not take advantage of the rich array of metadata that current high-end computing (HEC) file systems can gather, including content-based metadata and provenance1 information. As a result, current metadata search approaches are typically ad hoc and often work by providing a parallel management system to the “main” file system, as is done in Linux (the locate utility), personal computers, and enterprise search appliances. These search applications are often optimized for a single file system, making it difficult to move files and their metadata between file systems. Users have tried to solve this problem in several ways, including the use of separate databases to index file properties, the encoding of file properties into file names, and separately gathering and managing provenance data, but none of these approaches has worked well, either due to limited usefulness or scalability, or both. Our research addressed several key issues: High-performance, real-time metadata harvesting: extracting important attributes from files dynamically and immediately updating indexes used to improve search; Transparent, automatic, and secure provenance capture: recording the data inputs and processing steps used in the production of each file in the system; Scalable indexing: indexes that are optimized for integration with the file system; Dynamic file system structure: our approach provides dynamic directories similar to those in semantic file systems, but these are the native organization rather than a feature grafted onto a conventional system. In addition to these goals, our research effort will include evaluating the impact of new storage technologies on the file system design and performance. In particular, the indexing and metadata harvesting functions can potentially benefit from the performance improvements promised by new storage class memories.

42 ENGINEERING↗

Mitigate: An Adaptive Network Data Anonymization Tool Using Condensation-Based Differential Privacy

Modern network devices collect a large amount of data that can be analyzed to identify bottlenecks, anomalies, cyber-attacks, etc. Therefore, there is often a need to analyze such collections of network data quite often by an external expert or by the research community. However, these collections of data contain sensitive, proprietary information. In order for the network data to be shared, it must first be anonymized. The overall objective of this project is to develop an innovative privacy management tool to anonymize network data and achieve sufficient privacy, acceptable data utility, and efficient data analysis at the same time. No existing anonymization methods can achieve all of these at the same time. The core of this technology is a differential private clustering algorithm that provides strong privacy protection, preserves data properties important for subsequent analysis, and allows the party receiving the anonymized data to conduct analysis directly on anonymized data without the need of decryption or any extra processing. The research carried out was to design, implement and verify a solution to this problem by completing the following tasks: 1) developing the core technology; 2) developing a context based method that automatically recommends fields that must be anonymized; 3) conducted experiments showing superior results using our approach compared to existing tools, and 4) developed an intuitive but basic user interface. The research that was conducted generated novel algorithmic techniques that utilize state-of-the-art methods such as condensation, differential privacy preservation, clustering, automated tuning based on contextual awareness, and recommendation techniques to specify columns to users for anonymization leading to optimal privacy that allows research analysis on the dataset. Experiments were conducted to evaluate the efficacy of these novel algorithmic techniques by performing analysis on original non-anonymized datasets, then conducting analysis on the same yet anonymized datasets and comparing the results of the analyses. Overall, the anonymized analysis results were within 1% of the original results, verifying that the generated technology not only guarantees a high level of privacy but also enables research analysis as if it were conducted on the original dataset. Potential applications of this technology include anonymization of any type of structured network datasets that contain sensitive identifiers, such as IP addresses, that can be used in multiple applications. For example, to create an AI or machine learning model for cyber security, e.g., to detect attacks, or for performance analysis, e.g., identify bottlenecks or predict performance. In addition, a market analysis that was conducted for potential applications of this technology identified a broader range of applications of our anonymization technology beyond the network sector that includes healthcare, banking, insurance, securities, finance (FISB), data brokering, cloud services, ad sales, and government.

97 MATHEMATICS AND COMPUTING↗

Herschel and the Molecular Universe

Over the next decade, space-based missions will open up the universe to high spatial and spectral resolution studies at infrared and submillimeter wavelengths. This will allow us to study, in much greater detail, the composition and the origin and evolution of molecules in space. Moreover, molecular transitions in these spectral ranges provide a sensitive probe of the dynamics and the physical and chemical conditions in a wide range of objects at scales ranging from budding planetary systems to galactic and extragalactic sizes. Hence, these missions provide us with the tools to study key astrophysical and astrochemical processes involved in the formation and evolution of planets, stars, and galaxies. These new missions can be expected to lead to the detection of many thousands of new spectral features. Identification, analysis and interpretation of these features in terms of the physical and chemical characteristics of the astronomical sources will require detailed astronomical modeling tools supported by laboratory measurements and theoretical studies of chemical reactions and collisional excitation rates on species of astrophysical relevance. These data will have to be made easily accessible to the scientific community through web-based data archives. In this paper, we will review the Herschel mission and its expected impact on our understanding of the molecular universe.

Tielens, A. G. G. M.↗

Laser Remote Sensing From ISS: CATS Cloud and Aerosol Level 2 Data Products (Heritage Edition)

The Cloud-Aerosol Transport System (CATS) instrument was developed at NASA's Goddard Space Flight Center (GSFC) and deployed to the International Space Station (ISS) on 10 January 2015. CATS is mounted on the Japanese Experiment Module's Exposed Facility (JEM_EF) and will provide near-continuous, altitude-resolved measurements of clouds and aerosols in the Earth's atmosphere. The CATS ISS orbit path provides a unique opportunity to capture the full diurnal cycle of cloud and aerosol development and transport, allowing for studies that are not possible with the lidar aboard the CALIPSO platform, which flies in the sun-synchronous A-Train orbit." " One of the primary science objectives of CATS is to continue the CALIPSO aerosol and cloud profile data record to provide continuity of lidar climate observations during the transition from CALIPSO to EarthCARE. To accomplish this, the CATS project at NASA's Goddard Space Flight Center (GSFC) and the CALIPSO project at NASA's Langley Research Center (LaRC) are closely collaborating to develop and deliver a full suite of CALIPSO-like level 2 data products that will be produced using the newly acquired CATS level 1B data whenever CATS is operating in science modes 1. The CALIPSO mission is now well into its ninth year of on-orbit operations, and has developed a robust set of mature and well-validated science algorithms to retrieve the spatial and optical properties of clouds and aerosols from multi-wavelength lidar backscatter signals. By leveraging both new and existing NASA technical resources, this joint effort by the CATS and CALIPSO teams will deliver validated lidar data sets to the user community at the earliest possible opportunity. The science community will have access to two sets of CATS Level 2 data products. The "Operational" data products will be produced by the GSFC CATS team utilizing the new instrument capabilities (e.g., multiple FOVs and 1064 nm depolarization), while the "Heritage" data products created using the existing CALIPSO algorithms and the CATS 532 nm channels and the total 1064 nm channel. " Below is the development of the CATS "Heritage" level 2 software and data along with some initial results with operational data."

Rodier, Sharon↗

Instantiating a Global Network Measurement Framework

perfSONAR is a web services-based infrastructure for collecting and publishing network performance monitoring. A primary goal of perfSONAR is making it easier to solve end-to-end performance problems on paths crossing several networks. It contains a set of services delivering performance measurements in a federated environment. These services act as an intermediate layer, between the performance measurement tools and the diagnostic or visualization applications. This layer is aimed at making and exchanging performance measurements across multiple networks and multiple user communities, using well-defined protocols. This paper summarizes the key perfSONAR components, and describes how they are deployed by the US-LHC community to monitor the networks distributing LHC data from CERN. All monitoring data described herein is publicly available, and we hope the availability of this data via a standard schema will inspire others to contribute to the effort by building network data analysis applications that use perfSONAR.

42 ENGINEERING↗

The SNS/HFIR Web Portal System for SANS

In a busy world, continuing with the status-quo, to do things the way we are already familiar, often seems to be the most efficient way to conduct our work. We look for the value-add to decide if investing in a new method is worth the effort. How shall we evaluate if we have reached this tipping point for change? For contemporary researchers, understanding the properties of the data is a good starting point. The new generation of neutron scattering instruments being built are higher resolution and produce one or more orders of magnitude larger data than the previous generation of instruments. For instance, we have grown out of being able to perform some important tasks with our laptops – the data are too big and the computations would simply take too long. These large datasets can be problematic as facility users now begin to grapple with many of the same issues faced by more established computing communities. These issues include data access, management, and movement, data format standards, distributed computing, and collaboration among others. The Neutron Science Portal has been architected, designed, and implemented to provide users with an easy-to-use interface for managing and processing data, while also keeping an eye on meeting modern cybersecurity requirements imposed on institutions. The cost of entry for users has been lowered by utilizing a web interface providing access to backend portal resources. Users can browse or search for data which they are allowed to see, data reduction applications can be run without having to load the software, sample activation calculations can be performed for SNS and HFIR beamlines, McStas simulations can be run on TeraGrid and ORNL computers, and advanced analysis applications such as those being produced by the DANSE project can be run. Behind the scenes is a “live cataloging” system which automatically catalogs and archives experiment data via the data management system, and provides proposal team members access to their experiment data. The complexity of data movement and utilizing distributed computing resources has been taken care on behalf of users. Collaboration is facilitated by providing users a read/writeable common area, shared across all experiment team members. To date, these shared areas are the fastest growing data spaces. The portal currently has over 370 registered users, almost 7TB of experiment and user data, approximately 1,000,000 files cataloged, and had almost 10,000 unique visits last year. Future directions for enhancing portal robustness include examining how to mirror data and portal services, better facilitation of collaborations via virtual organizations, enhancing disconnected service via “thick client” applications, and better inter-facility connectivity to support cross-cutting research. The portal has established itself in the SNS/HFIR user community, and the development team strives to continue to improve the quality of features and services provided in order to better serve the community.

data↗

Extracting data from the muck: deriving biological insight from complex microbial communities and non-model organisms with next generation sequencing

It is becoming increasingly clear that microbes within microbial communities, for which cultured isolates have not yet been obtained, have an immense, untapped reservoir of enzymes that could help address grand challenges in human health, energy, and sustainability. Despite the obstacles associated with culturing these microbes, recent advances in next-generation sequencing (NGS) have made it possible to explore complex microbial communities in their native context for the first time. Key to extracting meaning from rapidly growing NGS datasets are bioinformatics tools that assemble the sequence data, annotate homologous sequences and interrogate it to reveal regulatory patterns. Complementing this are advances in proteomics that can link NGS data to biological function. Finally, this combination of next generation sequencing, proteomics and bioinformatic analysis forms a powerful tool to study non-model microbes, which will transform what we know about these dynamic systems.

59 BASIC BIOLOGICAL SCIENCES↗

GC31G-1182: Opennex, a Private-Public Partnership in Support of the National Climate Assessment

The NASA Earth Exchange (NEX) is a collaborative computing platform that has been developed with the objective of bringing scientists together with the software tools, massive global datasets, and supercomputing resources necessary to accelerate research in Earth systems science and global change. NEX is funded as an enabling tool for sustaining the national climate assessment. Over the past five years, researchers have used the NEX platform and produced a number of data sets highly relevant to the National Climate Assessment. These include high-resolution climate projections using different downscaling techniques and trends in historical climate from satellite data. To enable a broader community in exploiting the above datasets, the NEX team partnered with public cloud providers to create the OpenNEX platform. OpenNEX provides ready access to NEX data holdings on a number of public cloud platforms along with pertinent analysis tools and workflows in the form of Machine Images and Docker Containers, lectures and tutorials by experts. We will showcase some of the applications of OpenNEX data and tools by the community on Amazon Web Services, Google Cloud and the NEX Sandbox.

datasets↗

Metabolic capability and in situ activity of microorganisms in an oil reservoir

Background: Microorganisms have long been associated with oxic and anoxic degradation of hydrocarbons in oil reservoirs and oil production facilities. While we can readily determine the abundance of microorganisms in the reservoir and study their activity in the laboratory, it has been challenging to resolve what microbes are actively participating in crude oil degradation in situ and to gain insight into what metabolic pathways they deploy. Results: Here, we describe the metabolic potential and in situ activity of microbial communities obtained from the Jiangsu Oil Reservoir (China) by an integrated metagenomics and metatranscriptomics approach. Almost complete genome sequences obtained by differential binning highlight the distinct capability of different community members to degrade hydrocarbons under oxic or anoxic condition. Transcriptomic data delineate active members of the community and give insights that Acinetobacter species completely oxidize alkanes into carbon dioxide with the involvement of oxygen, and Archaeoglobus species mainly ferment alkanes to generate acetate which could be consumed by Methanosaeta species. Furthermore, nutritional requirements based on amino acid and vitamin auxotrophies suggest a complex network of interactions and dependencies among active community members that go beyond classical syntrophic exchanges; this network defines community composition and microbial ecology in oil reservoirs undergoing secondary recovery. Conclusion: Our data expand current knowledge of the metabolic potential and role in hydrocarbon metabolism of individual members of thermophilic microbial communities from an oil reservoir. The study also reveals potential metabolic exchanges based on vitamin and amino acid auxotrophies indicating the presence of complex network of interactions between microbial taxa within the community.

59 BASIC BIOLOGICAL SCIENCES↗

IGS Data Flow

The IGS analysis centers and user community in general need to be assured that the data centers archive a consistent set of files. Changes to the archives can occur because of the re-publishing of data, the transmission of historic data, and the resulting re-distribution (or lack thereof) of these data from data center to data center. To ensure the quality of the archives, a defined data flow and method of archive population needs to be established. This poster will diagram and review the current IGS data flow, discuss problems that have occurred, and provide recommendations for improvement.

Noll, Carey↗

The Scientific Data Management Center: Available Technologies and Highlights

Managing scientific data has been identified by the scientific community as one of the most important emerging needs because of the sheer volume and increasing complexity of data being collected. Effectively generating, managing, and analyzing this information requires a comprehensive, end-to-end approach to data management that encompasses all of the stages from the initial data acquisition to the final analysis of the data. Based on community input, we have identified three significant requirements. First, more efficient access to storage systems is needed. In particular, parallel file system and I/O system improvements are needed to write and read large volumes of data without slowing a simulation. Second, scientists require technologies to facilitate better understanding of their data, in particular the ability to effectively perform complex data analysis and searches over extremely large data sets. Furthermore, exploratory analysis requires techniques for efficiently selecting subsets of the data. Third, generating the data, collecting and storing the results, keeping track of data provenance, data post-processing, and analysis of results is a tedious, fragmented process. Tools for automation of this process in a robust, tractable, and recoverable fashion are required to enhance scientific exploration.

99 GENERAL AND MISCELLANEOUS↗

Machine Learning and Social Media to Mine and Disseminate Big Scientific Data

One of the challenges in supplying the communities with wider access to scientific databases is the need for knowledge of database languages like Structured Query Language (SQL). Although the SQL language has been published in many forms, not everybody is able to write SQL queries. Another challenge is that it might not be practical to make the public aware of the structure of databases. There is a need for novice users to query relational databases using their natural language. To solve this problem, many natural language interfaces to structured databases have been developed. The goal is to provide a more intuitive method for generating database queries and delivering responses. Through social media, which makes it possible to interact with a wide section of the population, and with the help of natural language processing, researchers at the Atmospheric Radiation Measurement (ARM) Data Center at Oak Ridge National Laboratory (ORNL) have developed a concept to enable easy search and retrieval of data from several environmental data centers for the scientific community through social media.Using a machine learning framework that maps natural language text to thousands of datasets, instruments, variables, and data streams, the prototype system would allow users to request data through Twitter and receive a link (via tweet) to applicable data results on the project's search catalog tailored to their key words. This automated identification of relevant data from various petascale archives at ORNL could increase convenience, access, and use of the project's data by the broader community. In this paper we discuss how some data-intensive projects at ORNL are using innovative ways to help in data discovery.

Devarakonda, Ranjeet↗

Study of a tracking and data acquisition system for the 1990's. Volume 1: User community characteristics

Projected 1990's experiments; navigation requirements and potentials; communications requirements associated with space experiments; alternative forecast options; and operational impacts on experiments are covered. A baseline of plans for the TDAS User Community, including a set of generic experiments developed to supplement existing planning for the 1990's time frame is generated. It includes extensive summaries of collected data, and a bibliography. The data are representative of inputs obtained from NASA planning sources through September 1981.

Mccreary, T.↗