Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “community data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,279 records · Page 71

A Graphical Model for Fusing Diverse Microbiome Data

This paper develops a Bayesian graphical model for fusing disparate types of count data. The motivating application is the study of bacterial communities from diverse high-dimensional features, in this case, transcripts, collected from different treatments. In such datasets, there are no explicit correspondences between the communities and each corresponds to different factors, making data fusion challenging. We introduce a flexible multinomial-Gaussian generative model for jointly modeling such count data. This latent variable model jointly characterizes the observed data through a common multivariate Gaussian latent space that parameterizes the set of multinomial probabilities of the transcriptome counts. The covariance matrix of the latent variables induces a covariance matrix of co-dependencies between all the transcripts, effectively fusing multiple data sources. We present a computationally scalable variational Expectation-Maximization (EM) algorithm for inferring the latent variables and the parameters of the model. Here, the inferred latent variables provide a common dimensionality reduction for visualizing the data and the inferred parameters provide a predictive posterior distribution. In addition to simulation studies that demonstrate the variational EM procedure, we apply our model to a bacterial microbiome dataset.

59 BASIC BIOLOGICAL SCIENCES↗

BAAD: a Biomass And Allometry Database for woody plants

Quantifying the amount of mass or energy invested in plant tissues is of fundamental interest across a range of disciplines, including ecology, forestry, ecosystem science, and climate change science (Niklas, 1994; Chave et al. 2005; Falster et al. 2011). The allocation of net primary production into different plant components is an important process affecting the lifetime of carbon in ecosystems, and resource use and productivity by plants (Cannell & Dewar, 1994; Litton et al. 2007; Poorter et al. 2012). While many studies in have destructively harvested woody plants in the name of science, most of these data have only been made available in the form of summary tables or figures included in publications. Until now, the raw data has resided piecemeal on the hard drives of individual scientists spread around the world. Several studies have gathered together the fitted (allometric) equations for separate datasets (Ter-Mikaelian & Korzukhin, 1997; Jenkins et al. 2003; Zianis et al. 2005; Henry et al. 2013), but none have previously attempted to organize and share the raw individual plant data underpinning these equations on a large scale. Gathered together, such data would represent an important resource for the community, meeting a widely recognised need for rich, open data resources to solve ecological problems (Costello et al. 2013; Fady et al. 2014; Harfoot & Roberts, 2014; Costello et al. 2013). We (D.S. Falster and R.A. Duursma, with the help of D.R. Barneche, R.G. FitzJohn and A. Vårhammar) set out to create such a resource, by asking authors directly whether they would be willing to make their raw data files freely available. The response was overwhelming: nearly everyone we contacted was interested to contribute their raw data. Moreover, we were invited to incorporate another compilation led by M. Ishihara and focussing on Japanese literature. As a result, we present BAAD: a Biomass And Allometry Database for woody plants, comprising data collected in 174 different published and unpublished studies.

Falster, Daniel↗

The disCO2ver Platform: Curating Data and Tools for Geologic Carbon Sequestration and Deep Subsurface Research Systems

The U.S. DOE National Energy Technology Laboratory has invested 12+ years of development into the data repository and digital laboratory, the Energy Data eXchange (EDX, edx.netl.doe.gov). Supporting a variety of research areas across the DOE Office of Fossil Energy and Carbon Management, the platform has successfully curated and preserved thousands of data products from DOE research. The Carbon Storage Program has successfully supported data curation, upload, and publishing of data products on EDX for many years, demonstrating a success story of how resources like EDX can effectively help with long term preservation and publishing of DOE data products. EDX continues to shift towards cloud-supported infrastructure, taking a hybrid approach combining on-premises compute and storage integrated with cloud-hosted services. The integration of cloud compute and hybrid architecture enables the development of EDX-hosted platforms that tailor the data and tools hosted on them to a specific community, enables implementation of machine learning tools for data discovery and filtering, and enables the hosting of virtual (online user interface) tools. Geologic carbon sequestration (GCS) research continues to scale up in response to the current administration goals to reduce greenhouse gas emissions and transition the energy economy. Over the last year, EDX’s disCO2ver platform has been developed in response to the need for access to data products and tools to support the scaling up of GCS research. disCO2ver provides access to data resources and tools, produced by DOE and outside authoritative external resources. The platform also provides a user-access control component for the virtualization and cloud hosting of tools. Tools that need to be virtualized, to eliminate the need for users to download the tool and use local compute resources, is essential to supporting big-data analysis and machine learning that is becoming common place in carbon storage modeling, risk analysis, and data publishing practices. This talk will review the EDX’s disCO2ver platform and the current work ongoing to curate data and tools to support GCS and deep subsurface systems research.

Morkner, Paige↗

Engineering data management: Experience and projections

Experiences in developing a large engineering data management system are described. Problems which were encountered are presented and projected to future systems. Business applications involving similar types of data bases are described. A data base management system architecture proposed by the business community is described and its applicability to engineering data management is discussed. It is concluded that the most difficult problems faced in engineering and business data management can best be solved by cooperative efforts.

Jefferson, D. K.↗

The Aviation Performance Measuring System (APMS): An Integrated Suite of Tools for Measuring Performance and Safety

This is a report of work in progress. In it, I summarize the status of the research and development of the Aviation Performance Measuring System (APMS) for managing, processing, and analyzing digital flight-recorded data, The objectives of the NASA-FAA APMS research project are to establish a sound scientific and technological basis for flight-data analysis, to define an open and flexible architecture for flight-data analysis systems, and to articulate guidelines for a standardized database structure on which to continue to build future flight-data-analysis extensions. APMS offers to the air transport community an open, voluntary standard for flight-data-analysis software; a standard that will help to ensure suitable functionality and data interchangeability among competing software programs. APMS will develop and document the methodologies, algorithms, and procedures for data management and analyses to enable users to easily interpret the implications regarding safety and efficiency of operations. APMS does not entail the implementation of a nationwide flight-data-collection system. It is intended to provide technical tools to ease the large-scale implementation of flight-data analyses at both the air-carrier and the national-airspace levels in support of their Flight Operations and Quality Assurance (FOQA) Programs and Advanced Qualifications Programs (AQP). APMS cannot meet its objectives unless it develops tools that go substantially beyond the capabilities of the current commercially available software and supporting analytic methods that are mainly designed to count special events. These existing capabilities, while of proven value, were created primarily with the needs-of aircrews in mind. APMS tools must serve the needs of the government and air carriers, as well as aircrews, to fully support the FOQA and AQP programs. They must be able to derive knowledge not only through the analysis of single flights (special-event detection), but also through statistical evaluation of the performance of large groups of flights. This paper describes the integrated suite of tools that will assist analysts in evaluating the operational performance and safety of the national air transport system, the air carrier, and the aircrew.

Statler, Irving C.↗

Standardizng Data

To enable the rational design of nanomaterials for improved efficacy and safety, it is critical to understand and exploit the physicochemical properties that drive biological behavior (Morris, 2010). Data mining and computer simulation are essential for deriving information about nanomaterial behavior; however, the datasets needed to support such studies are sparse and stored across a variety of repositories and resources. Schrurs and Lison (2012) have expressed the need for more coherence and structure in the conduct of nanotechnology research. Additionally, the lack of common reporting standards and non-uniformity of information reported have proven to be significant barriers to such data sharing and re-use. The Nanotechnology Working Group (Nano WG), of the US National Institutes of Health National Cancer Informatics Program, has been focused on addressing these barriers. The Nano WG - which includes representatives from over 20 organizations including government agencies, academia, industry, standards organizations, and alliances -has developed ISA-TAB-Nano (Thomas et al, 2013), a general framework for representing and integrating diverse types of data related to the description and characterization of nanomaterials. Recognizing that nanoparticle characterization studies have many of the same challenges as ‘omics-based assays, the Nano WG joined the ISA Commons (Sansone et al., 2012) to leverage lessons learned in ‘omics data sharing. The ISA Commons community brings together 50 collaborators at over 30 scientific organizations around the globe, including regulatory and industrial participants in an increasingly diverse set of life science domains. At the core of the ISA Commons is the ISA metadata tracking framework which forms the basis for the ISA-TAB-Nano extension. The extension of the ISA framework to nanotechnology domain illustrates the power of a synergistic approach that seeks the interoperability of data across multiple research disciplines. To increase adoption, especially in the commercial arena from vendors and manufactures, the ISA-Tab-Nano data-sharing specification has also been submitted for consideration as a standard to the American Society for Testing and Materials (ASTM). Delivering a community-driven specification is only the first phase of the process. To be useful and used, ISA-TAB-Nano must be implemented by tools and databases to assist researchers in reporting their data accordingly, shielding them from unnecessary complexity. Our next step is to extend the open source ISA Software Suite to provide user-oriented tools for the collection, curation, and storage of data compliant with the ISA-TAB-Nano specification. Future work will also focus on the application of the ISA-TAB-Nano format to support emerging standards on minimal information about nanomaterials in biological research (Ostraat et al, 2012; MinChar). ISA-TAB-Nano development is a community-driven effort and we welcome new contributions, collaborations and domain expertise. We invite researchers, software developers, vendors, and other stakeholders to work with us to implement the ISA-Tab-Nano format in their existing systems and research. Likewise, we welcome engagement of regulators, funding agencies, editors, and other policy makers to discuss how this standard can be used to facilitate the sharing and reuse of nanotechnology data across a wide range of disciplines. More information about the ISA-TAB-Nano project can be found online at https://wiki.nci.nih.gov/display/ICR/ISA-TAB-Nano.

informatics↗

MIBiG 4.0: advancing biosynthetic gene cluster curation through global collaboration

Specialized or secondary metabolites are small molecules of biological origin, often showing potent biological activities with applications in agriculture, engineering and medicine. Usually, the biosynthesis of these natural products is governed by sets of co-regulated and physically clustered genes known as biosynthetic gene clusters (BGCs). To share information about BGCs in a standardized and machine-readable way, the Minimum Information about a Biosynthetic Gene cluster (MIBiG) data standard and repository was initiated in 2015. Since its conception, MIBiG has been regularly updated to expand data coverage and remain up to date with innovations in natural product research. Here, we describe MIBiG version 4.0, an extensive update to the data repository and the underlying data standard. In a massive community annotation effort, 267 contributors performed 8304 edits, creating 557 new entries and modifying 590 existing entries, resulting in a new total of 3059 curated entries in MIBiG. Particular attention was paid to ensuring high data quality, with automated data validation using a newly developed custom submission portal prototype, paired with a novel peer-reviewing model. MIBiG 4.0 also takes steps towards a rolling release model and a broader involvement of the scientific community. MIBiG 4.0 is accessible online at https://mibig.secondarymetabolites.org/.

59 BASIC BIOLOGICAL SCIENCES↗

The use of LANDSAT-4 MSS digital data in temporal data sets and the evaluation of scene-to-scene registration accuracy

The MSS sensor on LANDSAT 4 is, in certain performance aspects, different from those on LANDSATS 1 through 3. These differences created some concern in the NASA research community as to whether individual data sets can be registered accurately enough to produce acceptable data sets for multitemporal data analysis. The use of LANDSAT 4 MSS digital data in temporal data sets is examined and a method is presented for estimating temporal registration accuracy based on the use of an X-Y digitizer and grey tone electrostatic plots. Results indicate that the RMS temporal registration errors are not significantly different from the temporal data sets generated using LANDSAT 4 and LANDSAT 2 data (33.35 meters) and the temporal data set constructed from two LANDSAT 2 data sets (33.61 meters). A derivation of the model used to evaluate the temporal registration is included.

Anderson, J. E.↗

The use of Landsat-4 MSS digital data in temporal data sets and the evaluation of scene-to-scene registration accuracy

The MSS sensor on Landsat 4 is, in certain performance aspects, diferent from those of Landsats 1 through 3. These differences created some concern in the NASA research community as to whether individual data sets can be registered accurately enough to produce acceptable data sets for multitemporal data analysis. The use of Landsat 4 MSS digital data in temporal data sets is examined and a method is presented for estimating temporal registration accuracy based on the use of an X-Y digitizer and grey tone electrostatic plots. Results indicate that the RMS temporal registration errors are not significantly different from the temporal data sets generated using Landsat 4 and Landsat 2 data (33.35 meters) and the temporal data set constructed from two Landsat 2 data sets (33.61 meters). A derivation of the model used to evaluate the temporal registration is included.

Anderson, J. E.↗

Integration among databases and data sets to support productive nanotechnology: Challenges and recommendations

This work is one of a series of articles by the Nanomaterial Data Curation Initiative. Other articles in this series discuss data curation workflows, data completeness and quality, curator responsibilities, and metadata. Many groups within the broad nanotechnology field are already developing data repositories and tools driven by their individual organizational goals. Integrating these data across disciplines, and with other non-nanotechnology resources, can support multiple objectives by reusing the same information, and can serve as the impetus for novel scientific discoveries through deeper data analyses. Based on the results of a community-based survey of organizations that maintain nanomaterial repositories, this article discusses current data integration practices in nanoinformatics and mature fields such as genomics, as well as nanotechnology-specific challenges impacting data integration. Recommendations for achieving integration of existing operational nanotechnology resources, as based on results from a community-wide survey, are presented herein. Nanotechnology-specific data integration challenges, if effectively resolved, can foster the application and validation of nanotechnology within and across disciplines.

77 NANOSCIENCE AND NANOTECHNOLOGY↗

Histological Findings in Wild Rodents of the Great Basin

In the western United States, significant environmental change is expected through the combined effects of climate change, tree mortality, drought, and invasive species. Wild animals can be used as indicators of threats to populations and even entire communities by looking for histopathological changes in their tissues. This method may identify threats to wild populations quickly and more accurately than waiting to observe population declines; however, baseline data are needed for comparisons. In this work, rodents are surveyed at 5 sites in the Great Basin to record histopathological changes. Additionally, one site is next to a copper mine that was in operation for nearly 100 years. This site is compared to the other more pristine sites. Liver, lung, heart, and kidney tissues of 143 rodents from 10 species were processed and examined using standard histological methods. Thirty percent of rodents had histopathological changes. The most common histopathological changes were extramedullary hematopoiesis (11.9%), hyperplastic BALT (6.3%), and pyelitis (4.9%). Two pathogens were found: the nematode Capillaria hepatica (0.7%) and the fungus Emmonsia crescens (2.8%). The most common rodent captured, Peromyscus maniculatus (n = 116), was used to determine whether sex and mass predict histopathological changes. Body mass, not sex, was the best predictor, suggesting that heavier, older individuals should be selectively sampled if the goal is to assess potential threats to rodent populations. Data such as these can be compared to future data to assess populations and communities for effects of environmental change.

59 BASIC BIOLOGICAL SCIENCES↗

Thermal control surfaces experiment (SOO69) flight systems performance

The thermal control surfaces experiment (TCSE) was the most complex hardware system aboard the Long Duration Exposure Facility (LDEF). The TCSE system consists of a scanning spectroreflectometer that measured test samples mounted on a rotatable carousel assembly. A microprocessor based data system controlled all aspects of TCSE system operation. Power was provided by four primary batteries. Flight measurement and housekeeping data were stored on a tape recorder for postflight analysis. The TCSE is a microcosm of complex electro-optical payloads being developed by NASA, DoD, and the aerospace community. The TCSE provides valuable data on the performance of these systems in space. The TCSE flight system and its excellent performance on the LDEF mission are described. A few operational anomalies were encountered and are discussed. Initial post-flight tests show that the TCSE system remains functional although some degradation in the optical measurements were observed. The results of these tests are also presented.

Wilkes, Donald R.↗

Evaluation of Stratospheric Transport in New 3D Models Using the Global Modeling Initiative Grading Criteria

The Global Modeling Initiative (GMI) Team developed objective criteria for model evaluation in order to identify the best representation of the stratosphere. This work created a method to quantitatively and objectively discriminate between different models. In the original GMI study, 3 different meteorological data sets were used to run an offline chemistry and transport model (CTM). Observationally-based grading criteria were derived and applied to these simulations and various aspects of stratospheric transport were evaluated; grades were assigned. Here we report on the application of the GMI evaluation criteria to CTM simulations integrated with a new assimilated wind data set and a new general circulation model (GCM) wind data set. The Finite Volume Community Climate Model (FV-CCM) is a new GCM developed at Goddard which uses the NCAR CCM physics and the Lin and Rood advection scheme. The FV-Data Assimilation System (FV-DAS) is a new data assimilation system which uses the FV-CCM as its core model. One year CTM simulations of 2.5 degrees longitude by 2 degrees latitude resolution were run for each wind data set. We present the evaluation of temperature and annual transport cycles in the lower and middle stratosphere in the two new CTM simulations. We include an evaluation of high latitude transport which was not part of the original GMI criteria. Grades for the new simulations will be compared with those assigned during the original GMT evaluations and areas of improvement will be identified.

Strahan, Susan E.↗

The First Twenty Years (1994 2014) of Ozone Soundings from Rapa Nui (27 deg S, 109 deg W, 51 m a.s.l.)

Ozone (O3) soundings have been performed on Easter Island or Rapa Nui (27 8S, 109 8W, 51 m a.s.l.) since 1994 as part of the Global Atmospheric Watch Programme of the World Meteorological Organization. In this work, we analyze 260 soundings compiled over the period 19942014, and make the data available for the international community. We characterize O3 profiles over this remote area of the Pacific by means of statistical analyses that consider, on the one hand, a traditional climatology that describes the data in terms of seasonal cycles based on monthly averages and, on the other hand, a process-oriented analysis based on self-organizing maps. Our analyses show the influence of both tropical and subtropical/mid-latitude air masses at Rapa Nui. The former occurs in summer and fall when convective conditions prevail, and the latter in late winter and spring when subsiding conditions are recurrent. The occurrence of stratospheric intrusions in late winter and spring in connection with deep troughs and the presence of the subtropical jet stream is also apparent in the data set. The tropospheric ozone column is in good agreement with the corresponding data derived from satellites but with a systematic overestimate of summer and fall values. There is evidence of an upward trend in ozone near the surface, which suggests the impact of local pollution. We look forward to an enhancement of the Rapa Nui observing site, given its location that offers a privileged position to observe climate change over the sparsely sampled and vast South Pacific Ocean.

tropical and subtropical/mid-latitude air masses↗

Analysis Ready Data in Analytics Optimized Data Stores for Analysis of Big Earth Data in the Cloud

Cloud computing offers the possibility of making the analysis of Big Data approachable for a wider community due to affordable access to computing power, an ecosystem of usable tools for parallel processing, and migration of many large datasets to archives in the cloud, allowing data-proximal computing. Generally, data analysis acceleration in the cloud comes from running multiple nodes in a split-combine-apply strategy. Data systems such as the Earth Observing System Data and Information System are in a position to "pre-split" the data by storing them in a data store that is optimized for data parallel computing, i.e., an Analytics-Optimized Data Store (AODS). A variety of approaches to AODS are possible, from highly scalable databases to scalable filesystems to data formats optimized for cloud access (e.g., zarr and cloud-optimized datasets), with the optimal choice dependent on both the types of analysis and the geospatial structure of the data. A key question is how much preprocessing of the data to do, both before splitting and as the first part of the apply step. Again, the geospatial structure of the data and the analysis type influence the decision, with the added complexity of the user type. Trans-disciplinary users who are not well-versed in the nuances of quality-filtering and georeferencing of remote sensing orbit/swath/scene data tend to ask for more highly processed data, relying on the data provider to make sensible decisions on preprocessing parameters. (This accounts for the popularity of "Level 3" gridded data, despite the lower spatial resolution it provides.) In this case, data can be preprocessed before the split, resulting in higher performance in the rest of the "apply" step, which can be transformative for use cases such as interactive data exploration at scale. Discipline researchers who are experienced with remote sensing data often prefer more flexibility in customizing the preprocessing data into Analysis Ready Data, resulting in more need for on-the-fly preprocessing.

Lynnes, Christopher↗

Big Data Challenges at CCMC

Like other research centers, the Community Coordinated Modeling Center (CCMC, https://ccmc.gsfc.nasa.gov) at NASA Goddard Space Flight Center (GSFC) is also experiencing the big data challenges. CCMC hosts over 80 space weather models for Runs On Request (ROR), Continuous Runs and Instant Runs simulation services for the research community. In addition, CCMC has started to support simulation output onboarding in response to the Open Science initiative. Overall, we have accumulated over petabytes of simulation output data and are rapidly growing. In this presentation, we will discuss our data and storage challenges. We will present our attempts to address our challenges and any associated lessons learned. CCMC uses Apache Airflow to ensure data transfer is consistent. We will give a brief overview on how we leverage Apache Airflow to enhance our environment.

space weather↗

Importance and Incorporation of User Feedback in Data Stewardship

Since August 1994, The National Aeronautics and Space Administration's (NASA's) Earth Observation System Data and Information System (EOSDIS) has been serving a global community of over 3 million users with Earth science data in a variety of disciplines. During the entire life of EOSDIS, various mechanisms for user feedback have been extremely important and valuable to its evolution and proven performance. Some inputs from user groups have resulted in fundamental changes in the architecture, design and operations of EOSDIS, while others have provided ideas for incremental changes. The purpose of this paper is to share this experience and the benefits that have resulted from the user feedback.In early to mid-1990s, the EOSDIS Advisory Panel (a.k.a. Data Panel) provided significant inputs for the architecture and design of EOSDIS resulting in NASA's establishment of a set of Distributed Active Archive Centers (DAACs) and development of a "working prototype with operating elements" called Version 0 EOSDIS, which went into operation in August 1994. The Data Panel also participated in many of the requirement and design reviews and influenced the design of EOSDIS through their comments.In 1995, the U.S. National Research Council's Committee on Global Change Research conducted a review of the U.S. Global Change Research Program and NASA's Mission to Planet Earth/EOS, including the plans for EOSDIS. One of this committee's recommendations was that the "Responsibility for product generation and publication and for user services should be transferred to a federation of partners selected through a competitive process open to all". In response, NASA initiated an experiment with a "self-governing" federation called the Working Prototype ESIP (WP-ESIP) Federation. This federation, with support from NASA, NOAA and USGS, has now grown into the Earth Science Information Partners (ESIP) with over 140 member organizations.The EOSDIS DAACs' User Working Groups (UWGs) represent broad user communities served by the respective DAACs. As regular users of the DAACs and experts in their scientific disciplines, the UWG members provide valuable inputs for planning and prioritizing the services as well as addition of new datasets for the benefit of the community.

Research Integrity↗

PARAGON: A Systematic, Integrated Approach to Aerosol Observation and Modeling

Aerosols are generated and transformed by myriad processes operating across many spatial and temporal scales. Evaluation of climate models and their sensitivity to changes, such as in greenhouse gas abundances, requires quantifying natural and anthropogenic aerosol forcings and accounting for other critical factors, such as cloud feedbacks. High accuracy is required to provide sufficient sensitivity to perturbations, separate anthropogenic from natural influences, and develop confidence in inputs used to support policy decisions. Although many relevant data sources exist, the aerosol research community does not currently have the means to combine these diverse inputs into an integrated data set for maximum scientific benefit. Bridging observational gaps, adapting to evolving measurements, and establishing rigorous protocols for evaluating models are necessary, while simultaneously maintaining consistent, well understood accuracies. The Progressive Aerosol Retrieval and Assimilation Global Observing Network (PARAGON) concept represents a systematic, integrated approach to global aerosol Characterization, bringing together modern measurement and modeling techniques, geospatial statistics methodologies, and high-performance information technologies to provide the machinery necessary for achieving a comprehensive understanding of how aerosol physical, chemical, and radiative processes impact the Earth system. We outline a framework for integrating and interpreting observations and models and establishing an accurate, consistent and cohesive long-term data record.

PARAGON↗