Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data diversity”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16
All sourcesNASA NTRSDOE OSTI
DOE OSTI2014

Approaches to advancescientific understanding of macrosystems ecology

Macrosystem ecological studies inherently investigate processes that interact across multiple spatial and temporal scales, requiring intensive sampling and massive amounts of data from diverse sources to incorporate complex cross-scale and hierarchical interactions. Inherent challenges associated with these characteristics include high computational demands, data standardization and assimilation, identification of important processes and scales without prior knowledge, and the need for large, cross-disciplinary research teams that conduct long-term studies. Therefore, macrosystem ecology studies must utilize a unique set of approaches that are capable of encompassing these methodological characteristics and associated challenges. Several case studies demonstrate innovative methods used in current macrosystem ecology studies.

data management↗
NASA NTRS2000

A Study of Cloud Radiative Forcing and Feedback

The main objective of the grant proposal was to participate in the CERES (Cloud and Earth's Radiant Energy System) Satellite experiment and perform interdisciplinary investigation of NASA's Earth Observing System (EOS). During the grant period, massive amounts of scientific data from diverse platforms have been accessed, processed and archived for continuing use; several software packages have been developed for integration of different data streams for performing scientific evaluation; extensive validation studies planned have been completed culminating in the development of important algorithms that are being used presently in the operational production of data from the CERES. Contributions to the inter-disciplinary science investigations have been significantly more than originally envisioned. The results of these studies have appeared in several refereed journals and conference proceedings. They are listed at the end of this report.

Ramanathan, Veerabhadran↗
NASA NTRS1971

Handbook of human engineering design data for reduced gravity conditions

A Handbook is presented for the use of engineers, designers, and human factors specialists during the developmental and detailed design phases of manned spacecraft programs. Detailed and diverse quantified data on man's capabilities and tolerances for survival and productive effort in the extraterrestrial environment are provided. Quantified data and information on the space environment as well as the characteristics of the vehicular or residential environment required to support man in outer space are also given.

Marton, T.↗
DOE OSTI2024

Integrating Multi-Source Data for Bi-Level Traffic Simulator Calibration: A Literature Review and Highway Case Study

Traffic simulation serves as a powerful tool for pre-evaluating policies and technologies. In this context, simulation-based Dynamic traffic assignment (DTA) models are capable of capturing traffic dynamics. They are well-known as critical tools in controlling and predicting traffic situations. The reliability of simulation results heavily depends on the calibration process. Most studies in the literature formulate and calibrate simulators based on a single source of collected data or multiple data sets with the same spatiotemporal characteristics. However, in practice, traffic data is collected by various tools with usually different spatial and temporal resolutions. This study introduces a novel approach to taking into account diverse input data from a variety of sources. An iterative bi-level solution is proposed. to equally treat traffic flow and speed data. The upper level solves flow calibration with the exact solution method, and the lower level calibrates the speed with the simultaneous perturbation stochastic approximation (SPSA) algorithm. Subsequently, the effectiveness of the proposed model is investigated using data from a six-mile section of Nashville's I-24 highway in Tennessee. The results demonstrate that our proposed model creates an effective feedback loop between the optimizer and the simulator for calibrating flow and speed to reduce the error between simulated and real data.

42 ENGINEERING↗
DOE OSTI2022

Delimiting the cryptic diversity and host preferences of Sycophila parasitoid wasps associated with oak galls using phylogenomic data

Abstract Cryptic species diversity is a major challenge regarding the species‐rich community of parasitoids attacking oak gall wasps due to a high degree of sexual dimorphism, morphological plasticity, small size and poorly known biology. As such, we know very little about the number of species present, nor the evolutionary forces responsible for generating this diversity. One hypothesis is that trait diversity in the gall wasps, including the morphology of the galls they induce, has evolved in response to selection imposed by the parasitoid community, with reciprocal selection driving diversification of the parasitoids. Using a rare, continental‐scale data set of Sycophila parasitoid wasps reared from 44 species of cynipid galls from 18 species of oak across the USA, we combined mitochondrial DNA barcodes, ultraconserved elements (UCEs), morphological and natural history data to delimit putative species. Using these results, we generate the first large‐scale assessment of ecological specialization and host association in this species‐rich group, with implications for evolutionary ecology and biocontrol. We find most Sycophila target specific subsets of available cynipid host galls with similar morphologies, and generally attack larger galls. Our results suggest that parasitoid wasps such as Sycophila have adaptations allowing them to exploit particular host trait combinations, while hosts with contrasting traits are resistant to attack. These findings support the tritrophic niche concept for the structuring of plant–herbivore–parasitoid communities.

Zhang, Yuanmeng M.↗
NASA NTRSDate not supplied

RadLab: A Comprehensive Database and Analysis Toolkit for Space Radiation Measurements Relevant to Space Radiation Biology

RadLab, a new addition to the NASA Open Science Data Repository (OSDR), is a public platform for space radiation data relevant to human space exploration. RadLab consists of a database, a submission portal, and user-friendly visualization and data analysis tools, including a graphical user interface (GUI) and an application programming interface (API). Investigators from ISS partners including Germany, Italy, Canada, Hungary, the Czech Republic, Russia, Japan have committed to providing data from their instruments. RadLab will also include data from other spacecraft in LEO: the Space Shuttle, the Mir space station, biosatellites; and beyond LEO: the lunar and the Martian surface, the heliocentric orbit at 1 AU, Mars orbit, and Earth-Mars space. Once fully operational, RadLab will provide open, centralized access to space radiation physics data relevant to human space exploration; a platform for submission of data by agencies and research institutions responsible for radiation detectors deployed in space; analysis tools to facilitate detector and dataset intercomparison to better understand space habitat radiation environments; capabilities for space biology investigators to determine the radiation environment to which samples were exposed. A RadLab Working Group (RLWG) has been formed, modeled on the GeneLab Analysis Working Groups and comprised of data contributors and users. RLWG tasks include identifying data sources, normalizing data from diverse detectors, expanding the analysis toolkit and, perhaps most importantly, sharing ideas for research exploiting capabilities of RadLab. We will provide an overview of RadLab data and capabilities and discuss examples of its potential as a resource for open science.

radiation↗
NASA NTRS1988

Alpha, beta, or gamma: where does all the diversity go?

Global taxonomic richness is affected by variation in three components: within-community, or alpha, diversity, between-community, or beta, diversity; and between-region, or gamma, diversity. A data set consisting of 505 faunal lists distributed among 40 stratigraphic intervals and six environmental zones was used to investigate how variation of alpha and beta diversity influenced global diversity through the Paleozoic, and especially during the Ordovician radiations. As first shown by Bambach (1977), alpha diversity increased by 50 to 70 percent in offshore marine environments during the Ordovician and then remained essentially constant of the remainder of the Paleozoic. The increase is insufficient, however, to account for the 300 percent rise observed in global generic diversity. It is shown that beta diversity among level, soft-bottom communities also increased significantly during the early Paleozoic. This change is related to enhanced habitat selection, and presumably increased overall specialization, among diversifying taxa during the Ordovician radiations. Combined with alpha diversity, the measured change in beta diversity still accounts for only about half of the increase in global diversity. Other sources of increase are probably not related to variation in gamma diversity but rather to appearance and/or expansion of organic reefs, hardground communities, bryozoan thickets, and crinoid gardens during the Ordovician.

NASA Discipline Exobiology↗
DOE OSTI2026

Accelerating Structure–Property Relationship Discovery with Multimodal Machine Learning and Self-Driving Microscopy

Microscopy combined with local spectroscopy is widely used to correlate nanoscale structure with functional properties in materials, but conventional measurements rely heavily on human-selected sampling locations and predefined targets, limiting data set diversity and the potential for discovery. Here, we present a framework that integrates autonomous microscopy with dual-novelty deep kernel learning (DN-DKL) for adaptive data acquisition and a dual variational autoencoder (VAE) for representation learning. DN-DKL actively guides the microscopy toward structurally and spectroscopically novel regions, enabling efficient collection of large spectral data sets. Dual-VAE embeds local structures and spectroscopic responses into a shared latent manifold that serves as a structure–property relationship map. We applied this framework for the investigation of halide perovskite films by using conductive atomic force microscopy. The results reveal distinct hysteresis behaviors that are linked to specific nanoscale structural motifs, including grain boundary junction points that show hysteresis under different bias conditions and asymmetric grain boundaries that suppress the charge transport. This framework establishes a general strategy that leverages the complementary strengths of self-driving microscopy, machine learning, and human expertise to accelerate scientific discovery in functional materials.

atomic force microscopy↗
DOE OSTI2019

A Scalable Online Monitoring System Based on Elasticsearch for Distributed Data Acquisition in Cms

The part of the CMS Data Acquisition (DAQ) system responsible for data readout and event building is a complex network of interdependent distributed applications. To ensure successful data taking, these programs have to be constantly monitored in order to facilitate the timeliness of necessary corrections in case of any deviation from specified behaviour. A large number of diverse monitoring data samples are periodically collected from multiple sources across the network. Monitoring data are kept in memory for online operations and optionally stored on disk for post-mortem analysis. We present a generic, reusable solution based on an open source NoSQL database, Elasticsearch, which is fully compatible and non-intrusive with respect to the existing system. The motivation is to benefit from an off the-shelf software to facilitate the development, maintenance and support efforts. Elasticsearch provides failover and data redundancy capabilities as well as a programming language independent JSON-over-HTTP interface. The possibility of horizontal scaling matches the requirements of a DAQ monitoring system. The data load from all sources is balanced by redistribution over an Elasticsearch cluster that can be hosted on a computer cloud. In order to achieve the necessary robustness and to validate the scalability of the approach the above monitoring solution currently runs in parallel with an existing in-house developed DAQ monitoring system.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2019

A Parallel Graph Environment for Real-World Data Analytics Workflows

Economic competitiveness and national security depend increasingly on the insightful analysis of large data sets. The diversity of real-world data sources and analytic workflows impose challenging hardware and software requirements for parallel graph platforms. The irregular nature of graph methods is not supported well by the deep memory hierarchies of conventional distributed systems, requiring new processor and runtime system designs to tolerate memory and synchronization latencies. Moreover, the efficiency of relational table operations and matrix computations are not attainable when data is stored in common graph data structures. In this paper, we present HAGGLE, a high-performance, scalable data analytics platform. The platform’s hybrid data model supports a variety of distributed, thread-safe data structures, parallel programming constructs, and persistent and streaming data. An abstract runtime layer enables us to map the stack to conventional, distributed computer systems with accelerators. The runtime uses multithreading, active messages, and data aggregation to hide memory and synchronization latencies on large-scale systems.

Graph Analytics↗
NASA NTRS1984

Data system considerations for remote sensing

The availability of data obtained with the aid of Landsat and other remote sensing satellites provides potentially the possibility to study problems on a global scale. Difficulties arise, however, in connection with the diversity of data formats, archival conditions, and the need for data registration. Systems are being planned to test the ability to reduce some of these difficulties. Details regarding the given situation are examined, taking into account global problems which are being considered. These problems are related to the global carbon dioxide cycle, and the biogeochemical cycle. Attention is given to pilot data systems, considerations for spatial data, data format considerations, data quality considerations, aspects of data base design, and system aids.

Billingsley, F. C.↗
DOE OSTI2020

Artificial Intelligence a D and D Enabler - 20552

The paper addresses the development of a specific search engine dedicated to Decommissioning and Dismantling (D and D) projects. The solution combines advanced model based system engineering methodologies and a data centric approach. It is based on an appropriate use of the last Natural Language processing techniques, the most innovative artificial intelligence algorithms and open source framework to handle large volume and diversity of data met in the case of a nuclear infrastructure we have to dismantle. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2025

SWARM: Reimagining scientific workflow management systems in a distributed world

Modern scientific workflows process massive amounts of data from diverse instruments and sensors, leveraging geographically distributed, heterogeneous compute and storage resources—from leadership-class systems to edge devices—connected by high-performance networks. The diversity of resources introduces challenges in harnessing their full potential, with resilience issues arising across applications, system software, networks, storage, and hardware. Today, workflow management systems (WMS) coordinate the execution of computation and data management tasks across target resources. However, WMS’s centralized nature makes them vulnerable to faults and scalability issues that may result in failures of entire computational campaigns. In conclusion, this paper introduces a novel agentic framework for workflow management, fully distributing and decentralizing the WMS functions and modeling them as swarm intelligence agents infused with advanced artificial intelligence solutions and traditional distributed computing algorithms that can make coordinated decisions in the presence of failures of the underlying cyberinfrastructure.

Swarm intelligence↗
DOE OSTI2025

A cost and community perspective on the barriers to microbiome data reuse

Microbiome research is becoming a mature field with a wealth of data amassed from diverse ecosystems, yet the ability to fully leverage multi-omics data for reuse remains challenging. To provide a view into researchers’ behavior and attitudes towards data reuse, we surveyed over 700 microbiome researchers to evaluate data sharing and reuse challenges. We found that many researchers are impeded by difficulties with metadata records, challenges with processing and bioinformatics, and problems with data repository submissions. We also explored the cost constraints of data reuse at each step of the data reuse process to better understand “pain points” and to provide a more quantitative perspective from sixteen active researchers. The bioinformatics and data processing step was estimated to be the most time consuming, which aligns with some of the most frequently reported challenges from the community survey. From these two approaches, we present evidence-based recommendations for how to address data sharing and reuse challenges with concrete actions for future work.

59 BASIC BIOLOGICAL SCIENCES↗
NASA NTRS1994

Experimenter's Laboratory for Visualized Interactive Science

ELVIS (Experimenter's Laboratory for Visualized Interactive Science) is an interactive visualization environment that enables scientists, students, and educators to visualize and analyze large, complex, and diverse sets of scientific data. It accomplishes this by presenting the data sets as 2-D, 3-D, color, stereo, and graphic images with movable and multiple light sources combined with displays of solid-surface, contours, wire-frame, and transparency. By simultaneously rendering diverse data sets acquired from multiple sources, formats, and resolutions and by interacting with the data through an intuitive, direct-manipulation interface, ELVIS provides an interactive and responsive environment for exploratory data analysis.

Hansen, Elaine R.↗
DOE OSTI2023

Fusion of Multiple Models for Improving Gross Primary Production Estimation With Eddy Covariance Data Based on Machine Learning

Abstract Terrestrial gross primary production (GPP) represents the magnitude of CO 2 uptake through vegetation photosynthesis, and is a key variable for carbon cycles between the biosphere and atmosphere. Light use efficiency (LUE) models have been widely used to estimate GPP for its physiological mechanisms and availability of data acquisition and implementation, yet each individual GPP model has exhibited large uncertainties due to input errors and model structure, and further studies of systematic validation, comparison, and fusion of those models with eddy covariance (EC) site data across diverse ecosystem types are still needed in order to further improve GPP estimation. We here compared and fused five GPP models (VPM, EC‐LUE, GOL‐PEM, CHJ, and C‐Fix) across eight ecosystems based on FLUXNET2015 data set using the ensemble methods of Bayesian Model Averaging (BMA), Support Vector Machine (SVM), and Random Forest (RF) separately. Our results showed that for individual models, EC‐LUE gave a better performance to capture interannual variability of GPP than other models, followed by VPM and GLO‐PEM, while CHJ and C‐Fix were more limited in their estimation performance. We found RF and SVM were superior to BMA on merging individual models at various plant functional types (PFTs) and at the scale of individual sites. On the basis of individual models, the fusion methods of BMA, SVM, and RF were examined by a five‐fold cross validation for each ecosystem type, and each method successfully improved the average accuracy of estimation by 8%, 18%, and 19%, respectively.

Environmental Sciences & Ecology↗
NASA NTRS1992

System of Experts for Intelligent Data Management (SEIDAM)

It is proposed to conduct research and development on a system of expert systems for intelligent data management (SEIDAM). CCRS has much expertise in developing systems for integrating geographic information with space and aircraft remote sensing data and in managing large archives of remotely sensed data. SEIDAM will be composed of expert systems grouped in three levels. At the lowest level, the expert systems will manage and integrate data from diverse sources, taking account of symbolic representation differences and varying accuracies. Existing software can be controlled by these expert systems, without rewriting existing software into an Artificial Intelligence (AI) language. At the second level, SEIDAM will take the interpreted data (symbolic and numerical) and combine these with data models. At the top level, SEIDAM will respond to user goals for predictive outcomes given existing data. The SEIDAM Project will address the research areas of expert systems, data management, storage and retrieval, and user access and interfaces.

Goodenough, David G.↗
NASA NTRS1993

System of experts for intelligent data management (SEIDAM)

A proposal to conduct research and development on a system of expert systems for intelligent data management (SEIDAM) is being developed. CCRS has much expertise in developing systems for integrating geographic information with space and aircraft remote sensing data and in managing large archives of remotely sensed data. SEIDAM will be composed of expert systems grouped in three levels. At the lowest level, the expert systems will manage and integrate data from diverse sources, taking account of symbolic representation differences and varying accuracies. Existing software can be controlled by these expert systems, without rewriting existing software into an Artificial Intelligence (AI) language. At the second level, SEIDAM will take the interpreted data (symbolic and numerical) and combine these with data models. at the top level, SEIDAM will respond to user goals for predictive outcomes given existing data. The SEIDAM Project will address the research areas of expert systems, data management, storage and retrieval, and user access and interfaces.

Goodenough, David G.↗