Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data diversity”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

A Graphical Model for Fusing Diverse Microbiome Data

This paper develops a Bayesian graphical model for fusing disparate types of count data. The motivating application is the study of bacterial communities from diverse high-dimensional features, in this case, transcripts, collected from different treatments. In such datasets, there are no explicit correspondences between the communities and each corresponds to different factors, making data fusion challenging. We introduce a flexible multinomial-Gaussian generative model for jointly modeling such count data. This latent variable model jointly characterizes the observed data through a common multivariate Gaussian latent space that parameterizes the set of multinomial probabilities of the transcriptome counts. The covariance matrix of the latent variables induces a covariance matrix of co-dependencies between all the transcripts, effectively fusing multiple data sources. We present a computationally scalable variational Expectation-Maximization (EM) algorithm for inferring the latent variables and the parameters of the model. Here, the inferred latent variables provide a common dimensionality reduction for visualizing the data and the inferred parameters provide a predictive posterior distribution. In addition to simulation studies that demonstrate the variational EM procedure, we apply our model to a bacterial microbiome dataset.

59 BASIC BIOLOGICAL SCIENCES↗

Scenario driven data modelling: a method for integrating diverse sources of data and data streams

Background: Biology is rapidly becoming a data intensive, data-driven science. It is essential that data is represented and connected in ways that best represent its full conceptual content and allows both automated integration and data driven decision-making. Recent advancements in distributed multi-relational directed graphs, implemented in the form of the Semantic Web make it possible to deal with complicated heterogeneous data in new and interesting ways. Results: This paper presents a new approach, scenario driven data modelling (SDDM), that integrates multirelational directed graphs with data streams. SDDM can be applied to virtually any data integration challenge with widely divergent types of data and data streams. In this work, we explored integrating genetics data with reports from traditional media. SDDM was applied to the New Delhi metallo-beta-lactamase gene (NDM-1), an emerging global health threat. The SDDM process constructed a scenario, created a RDF multi-relational directed graph that linked diverse types of data to the Semantic Web, implemented RDF conversion tools (RDFizers) to bring content into the Sematic Web, identified data streams and analytical routines to analyse those streams, and identified user requirements and graph traversals to meet end-user requirements. Conclusions: We provided an example where SDDM was applied to a complex data integration challenge. The process created a model of the emerging NDM-1 health threat, identified and filled gaps in that model, and constructed reliable software that monitored data streams based on the scenario derived multi-relational directed graph. The SDDM process significantly reduced the software requirements phase by letting the scenario and resulting multi-relational directed graph define what is possible and then set the scope of the user requirements. Approaches like SDDM will be critical to the future of data intensive, data-driven science because they automate the process of converting massive data streams into usable knowledge.

59 BASIC BIOLOGICAL SCIENCES↗

NASA Open Science Data Repository: Open Science for Life in Space

Space biology and health data are critical for the success of deep space missions and sustainable human presence off-world. At the core of effectively managing biomedical risks is the commitment to open science principles, which ensure that data are findable, accessible, interoperable, reusable, reproducible and maximally open. The 2021 integration of the Ames Life Sciences Data Archive with GeneLab to establish the NASA Open Science Data Repository significantly enhanced access to a wide range of life sciences, biomedical-clinical, and mission telemetry data alongside existing ‘omics data from GeneLab. This paper describes the new database, its architecture, and new data streams supporting diverse data types and enhancing data submission, retrieval, and analysis. Features include the Biological Data Management Environment for improved data submission, a new user interface, controlled data access, an enhanced API, and comprehensive public visualization tools for environmental telemetry, radiation dosimetry data, and ‘omics analyses. By fostering global collaboration through its Analysis Working Groups and training programs, the Open Science Data Repository promotes widespread engagement in space biology, ensuring transparency and inclusivity in research. It supports the global scientific community in advancing our understanding of spaceflight's impact on biological systems, ensuring humans will thrive in future deep space missions.

OSDR↗

A Balanced Model for Exploration of the Terrestrial Planets: Lessons from the Lunar Experience

The Moon is the only extraterrestrial rocky body for which we have a combination of surface-selected samples, high-resolution orbital photography (Lunar Orbiter), manned and robotic surface exploration (Surveyor, Apollo, Luna), and global compositional, mineralogical, and geophysical data (Galileo, Clementine, Lunar Prospector). Beginning in 1998, CAPTEM organized a series of workshops and conference sessions aimed at integrating these diverse data sets. The insights gained by bringing together scientists from the remote-sensing and sample-analysis communities have been singularly rewarding. Not least of these has been the recognition by both groups that having both kinds of data maximizes the scientific return and permits reconciling information from diverse scales and perspectives. The 20-20 hindsight of the Lunar experience thus provides important lessons; learning from mistakes as well as successes, we can derive a sensible scientific program for Mars exploration. In this abstract, we describe examples of key information from (a) in-situ geologic investigation, (b) laboratory analysis of returned samples whose geologic context and location are known, and (c) global remote sensing of mineralogy, composition, and geophysical parameters. We then show the value of integrating these diverse data sets.

Jolliff, B. L.↗

Statistical relationship between metabolic decomposition and chemical uptake predicts bioconcentration factor data for diverse chemical exposures

Background: A challenge of in vitro to in vivo extrapolation (IVIVE) is to predict the physical state of organisms exposed to chemicals in the environment from in vitro exposure assay data. Although toxicokinetic modeling approaches promise to bridge in vitro screening data with i Danio rerio ) based upon particle swarm optimizations (PSO) of the chemical uptake and degradation rates that predict bioconcentration factors (BCF) for a broad range of chemicals. PSO reveals a relationship between chemical uptake and decomposition parameter values that predicts chemical-specific BCF values with moderate statistical agreement to a limited yet diverse chemical dataset, and all without a need to retrain the model to new data. Conclusions: The presented model requires only the octanol-water partitioning ratio to predict BCFs to a fidelity consistent with existing QSAR models. This success begs re-evaluation of the modeling assumptions; specifically, it suggests that chemical uptake into arterial blood may be limited by transport across gill membranes (diffusion) rather than by counter-current flow between gill lamellae (convection). Therefore, more detailed molecular modeling of aquatic respiration may further improve predictive accuracy of the rTK approach.

59 BASIC BIOLOGICAL SCIENCES↗

A digital twin platform for building performance monitoring and optimization: Performance simulation and case studies

Advancements in sensor technology, data analytics, affordable compute, and communication infrastructure have paved the way for Digital Twin technology in optimizing building operations and controls. This study presents the development of an open and interoperable web-based Digital Twin platform for integrating diverse data streams and facilitating effective user interactions. The platform utilizes modern technologies for the web framework and time-series data management, ensuring scalability and responsiveness. The backend supports seamless integration of diverse data sources and emulators, incorporating data from building sensors and meters, external weather Application Programming Interfaces, and advanced EnergyPlus simulation models of the building and its energy systems including the Distributed Energy Resources that are formulated in Functional Mockup Units. A simulation case study was conducted with FlexLab, a test facility on Lawrence Berkeley National Laboratory campus. The case study includes normal operations, Distributed Energy Resource integration, and power outage scenarios, to illustrate the Digital Twin’s ability to provide critical insights into energy performance and thermal resilience. The results demonstrated the platform’s potential as a decision-support tool for optimizing building energy performance and enhancing resilience against extreme weather events. Future work will focus on deploying the Digital Twin platform to a real building for field validation, extending its capabilities to cover more scenarios such as bidirectional Electric Vehicle interactions, and enhancing user engagement.

EnergyPlus↗

Determination of the parton distribution functions of the proton using diverse ATLAS data from pp collisions at $$\sqrt{s} = 7$$, 8 and 13 TeV

This paper presents an analysis at next-to-next-to-leading order in the theory of quantum chromodynamics for the determination of a new set of proton parton distribution functions using diverse measurements in pp collisions at $\sqrt{s}$ = 7, 8 and 13 TeV, performed by the ATLAS experiment at the Large Hadron Collider, together with deep inelastic scattering data from ep collisions at the HERA collider. The ATLAS data sets considered are differential cross-section measurements of inclusive W ± and Z/γ* boson production, W ± and Z boson production in association with jets, $t\bar{t}$ production, inclusive jet production and direct photon production. In the analysis, particular attention is paid to the correlation of systematic uncertainties within and between the various ATLAS data sets and to the impact of model, theoretical and parameterisation uncertainties. The resulting set of parton distribution functions is called ATLASpdf21.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Data from: Diversity and population structure of northern switchgrass as revealed through exome capture sequencing

Switchgrass (Panicum virgatum L.) is a polyploid, perennial grass species that is native to North America, and is being developed as a future biofuels feedstock crop. Switchgrass is present primarily in two ecotypes: a northern upland ecotype composed of tetraploid and octoploid accessions, and a southern lowland ecotype composed of primarily tetraploid accessions. We employed high-coverage exome capture sequencing (~2.4 Tb) to genotype 537 individuals from 45 upland and 21 lowland populations. From these data, we identified ~27 million single nucleotide polymorphisms (SNPs), of which 1,590,653 high confidence SNPs were used in downstream analyses of diversity within and between the populations. From the 66 populations, we identified five primary population groups within the upland and lowland ecotypes, a result that was further supported through genetic distance analysis. We identified conserved, ecotype restricted non-synonymous SNPs that are predicted to impact protein function in genes that encode CONSTANS (CO) and EARLY HEADING DATE 1 (EHD1), key genes involved in flowering which may contribute to the phenotypic differences between the two ecotypes. We also identified, relative to the near-reference Kanlow population, 17,228 up-copy number variants (CNVs), 112,630 down-CNVs, and 14,430 presence/absence variants (PAV) impacting a total of 9,979 genes, including two upland-specific CNV-clusters. In total, 45,719 genes were impacted by a SNP, CNV, or a PAV across the panel providing a firm foundation to identify functional variation associated with phenotypic traits of interest for biofuel feedstock production.

09 BIOMASS FUELS↗

Distinct summer and winter bacterial communities in the active layer of Svalbard permafrost revealed by DNA- and RNA-based analyses

The active layer of soil overlaying permafrost in the Arctic is subjected to dramatic annual changes in temperature and soil chemistry, which likely affect bacterial activity and community structure. We studied seasonal variations in the bacterial community of active layer soil from Svalbard (78°N) by co-extracting DNA and RNA from 12 soil cores collected monthly over a year. PCR amplicons of 16S rRNA genes (DNA) and reverse transcribed transcripts (cDNA) were quantified and sequenced to test for the effect of low winter temperature and seasonal variation in concentration of easily degradable organic matter on the bacterial communities. The copy number of 16S rRNA genes and transcripts revealed no distinct seasonal changes indicating potential bacterial activity during winter despite soil temperatures well below -10°C. Multivariate statistical analysis of the bacterial diversity data (DNA and cDNA libraries) revealed a season-based clustering of the samples, and, e.g., the relative abundance of potentially active Cyanobacteria peaked in June and Alphaproteobacteria increased over the summer and then declined from October to November. The structure of the bulk (DNA-based) community was significantly correlated with pH and dissolved organic carbon, while the potentially active (RNA-based) community structure was not significantly correlated with any of the measured soil parameters. A large fraction of the 16S rRNA transcripts was assigned to nitrogen-fixing bacteria (up to 24% in June) and phototrophic organisms (up to 48% in June) illustrating the potential importance of nitrogen fixation in otherwise nitrogen poor Arctic ecosystems and of phototrophic bacterial activity on the soil surface.

Alphaproteobacteria↗

Finding the forest in the trees. The challenge of combining diverse environmental data

Development of analytical and functional guidelines to help researchers and technicians engaged in interdisciplinary research to better plan and implement their supporting data management activities is addressed. An emphasis is on the projects that involve both geophysical and ecological issues. Six case studies were used to identify and to understand problems associated with collecting, integrating, and analyzing environmental data from local to global spatial scales and over a range of temporal scales. These case studies were also used to elaborate the common barriers to interfacing data of disparate sources and types. A number of lessons derived from the case studies are summarized and analyzed.

Source record↗

The Data Synergy Effects of Time-Series Deep Learning Models in Hydrology

When fitting statistical models to variables in geoscientific disciplines such as hydrology, it is a customary practice to stratify a large domain into multiple regions (or regimes) and study each region separately. Traditional wisdom suggests that models built for each region separately will have higher performance because of homogeneity within each region. However, each stratified model has access to fewer and less diverse data points. Here, through two hydrologic examples (soil moisture and streamflow), we show that conventional wisdom may no longer hold in the era of big data and deep learning (DL). We systematically examined an effect we call data synergy, where the results of the DL models improved when data were pooled together from characteristically different regions. The performance of the DL models benefited from modest diversity in the training data compared to a homogeneous training set, even with similar data quantity. Moreover, allowing heterogeneous training data makes eligible much larger training datasets, which is an inherent advantage of DL. A large, diverse data set is advantageous in terms of representing extreme events and future scenarios, which has strong implications for climate change impact assessment. The results here suggest the research community should place greater emphasis on data sharing.

54 ENVIRONMENTAL SCIENCES↗

Millimeter wavelength propagation studies

Diversity data obtained using the ATS-5 satellite and available BTL data were compared with optimum diversity gain predictions. This comparison indicates that terminal spacings exceeding 8 km result in values of diversity gain within 1.5 dB of the optimum. The thunderstorm cell modeling technique for predicting attenuation and diversity gain statistics was extended to include ellipsoidal cell models. A three rain gage method for the measurement of cell size, ellipticity, and orientation was developed.

Hodge, D. B.↗

The Field Guide to NASA’s Life Sciences Data Repositories

For over 30 years, NASA has invested in life sciences research both in space and on the ground. Data accessibility is an important tool for researchers, and NASA has committed to preserving this vital resource for ongoing use. The Life Sciences Data Archive’s multi-center collaboration between NASA’s Johnson Space Center, Ames Research Center, and Kennedy Space Center is geared toward preserving unique and high-value data from a wide variety of disciplines, data collection methods, and species within NASA’s Life Sciences Portal (NLSP). The data generated by the Human Research Program (HRP) require a systematic approach to data preservation that accounts for diverse data sources, formats, physical storage requirements, and security and privacy protections. This poster presentation will provide a guide to the repositories where the various types of human, non-human animal, plant, and microbial data NASA generates are archived and tips for navigating these data collections. Topics will include where different types of data, metadata, and biospecimens are archived or preserved, how the federated repositories work together as a data preservation ecosystem, and how researchers can access each repository’s collections.

Robert S Beaton↗

A Field Guide to NASA’s Life Sciences Data Repositories

For over 30 years, NASA has invested in life sciences research both in space and on the ground. Data accessibility is an important tool for researchers, and NASA has committed to preserving this vital resource for ongoing use. The Life Sciences Data Archive’s multi-center collaboration between NASA’s Johnson Space Center, Ames Research Center, and Kennedy Space Center is geared toward preserving unique and high-value data from a wide variety of disciplines, data collection methods, and species within NASA’s Life Sciences Portal (NLSP). The data generated by the Human Research Program (HRP) require a systematic approach to data preservation that accounts for diverse data sources, formats, physical storage requirements, and security and privacy protections. This poster presentation will provide a guide to the repositories where the various types of human, non-human animal, plant, and microbial data NASA generates are archived and tips for navigating these data collections. Topics will include where different types of data, metadata, and biospecimens are archived or preserved, how the federated repositories work together as a data preservation ecosystem, and how researchers can access each repository’s collections.

LSDA↗

Systems aspects of COBE science data compression

A general approach to compression of diverse data from large scientific projects has been developed and this paper addresses the appropriate system and scientific constraints together with the algorithm development and test strategy. This framework has been implemented for the COsmic Background Explorer spacecraft (COBE) by retrofitting the existing VAS-based data management system with high-performance compression software permitting random access to the data. Algorithms which incorporate scientific knowledge and consume relatively few system resources are preferred over ad hoc methods. COBE exceeded its planned storage by a large and growing factor and the retrieval of data significantly affects the processing, delaying the availability of data for scientific usage and software test. Embedded compression software is planned to make the project tractable by reducing the data storage volume to an acceptable level during normal processing.

Freedman, I.↗

Working Toward A National Coordinated Soil Moisture Monitoring Network: Vision, Progress, and Future Directions

Soil moisture is a critical land surface variable, impacting the water, energy, and carbon cycles. While in situ soil moisture monitoring networks are still developing, there is no cohesive strategy or framework to coordinate, integrate, or disseminate these diverse data sources in a synergistic way that can improve our ability to understand climate variability at the national, state, and local levels. Thus, a national strategy is needed to guide network deployment, sustainable network operation, data integration and dissemination, and user-focused product development. The National Coordinated Soil Moisture Monitoring Network (NCSMMN) is a federally led, multi-institution effort that aims to address these needs by capitalizing on existing wide-ranging soil moisture monitoring activities, increasing the utility of observational data, and supporting their strategic application to the full range of decision-making needs. The goals of the NCSMMN are to 1) establish a national “network of networks” that effectively demonstrates data integration and operational coordination of diverse in situ networks; 2) build a community of practice around soil moisture measurement, interpretation, and application—a “network of people” that links data providers, researchers, and the public; and 3) support research and development (R&D) on techniques to merge in situ soil moisture data with remotely sensed and modeled hydrologic data to create user-friendly soil moisture maps and associated tools. The overarching mission of the NCSMMN is to provide coordinated high-quality, nationwide soil moisture information for the public good by supporting applications like drought and flood monitoring, water resource management, agricultural and forestry planning, and fire danger ratings.

C. Bruce Baker↗

Toward equitable environmental exposure modeling through convergence of data, open, and citizen sciences: an example of air pollution exposure modeling amidst increasing wildfire smoke

Exposure modeling is critical in environmental epidemiology and human health but may face challenges (e.g., skewed data, unequal error, context-insensitive validation, and computational demands). Modeling decisions reflect the intended use of the models and the values that modelers prioritize. We aimed to provide a conceptual framework and machine learning (ML) modeling protocols that address these issues. With 500m-gridded hourly PM 2.5 and O 3 levels in Illinois before, during, and after the 2023 Canadian wildfire season as a motivating example, we conducted modeling experiments to evaluate modeling methods, guided by three domains we propose based on theories of science: 1) Data Diversity, leveraging open and citizen science data to enhance inclusivity, parsimony, and representativeness; 2) Equitable Accuracy, ensuring fairly distributed uncertainties across subpopulations; and 3) Sustainable Modeling, balancing accuracy with reducing computational demands to promote accessibility for under-resourced researchers. Here, we found that ML with publicly available data can achieve high accuracy. Depending on methods, performance may vary substantially, even with identical input data. Large but skewed data may reduce performance. Misuse of cross-validation protocols can underestimate prediction error; although we observed R 2 s of ∼98 %, the modeled estimates varied significantly, indicating the need for careful model validation. By using new modeling protocols including representativeness-considered training and validation data and a new loss function, we achieved high agreement between estimates and ground-based measurements (e.g., R 2 = ∼90 % for PM 2.5 ; ∼80 % for O 3 ), equally distributed errors across sociodemographic strata and urban–rural divides, and reduction in computation time—from several weeks or months to a few days.

Exposure assessment↗