Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data diversity”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15

DMTN-065: Data Management for LSST Special Programs

Special Programs are additional survey areas and/or observing strategies that are driven by specific science goals which build on, or are beyond, the core science pillars of the Wide Fast Deep Main Survey. In order to meet the requirements and enable science related to Special Programs, this document provides recommendations for Rubin Data Management regarding processing and serving data products for Special Programs. Hardware and processing boundaries on the potential diversity of data from Special Programs are discussed along with scenarios in which user-generated processing and data products might be needed to meet Special Programs' science goals.

79 ASTRONOMY AND ASTROPHYSICS↗

A Quality Screening Service for Remote Sensing Data

NASA provides a wide variety of Earth-observing satellite data products to a diverse community. These data are annotated with quality information in a variety of ways, with the result that many users struggle to understand how to properly account for quality when dealing with satellite data. To address this issue, a Data Quality Screening Service (DQSS) is being implemented for a number of datasets. The DQSS will enable users to obtain data files in which low-quality pixels have been filtered out, based either on quality criteria recommended by the science team or on the user s particular quality criteria. The objective is to increase proper utilization of this critical quality data in science data analysis of satellite data products.

Lynnes, Christopher↗

An empirical relationship for path diversity gain

Existing 15.3 and 16 GHz path diversity gain data for earth-space propagation paths are used to generate an empirical relationship for diversity gain as a function of terminal separation distance and single terminal fade depth. The agreement between the resulting closed form expression and the data is within 0.75 dB in all cases.

Hodge, D. B.↗

Artificial Intelligence Medical Support for Long-Duration Space Missions

We envision an artificial intelligence (AI) based system that will provide support and recommendations to the crew medical officer (CMO) and ground flight surgeon during long-duration space missions. Such a system would be pretrained on the knowledgebase of clinical knowledge on Earth, minimizing the amount of Earth data that needs to be transferred into space. Then during deployment, the system would be constantly refined through active learning from diverse streams of data from sensors in the spacecraft, data collected daily from individual astronauts, and human-in-the-loop feedback from the crew. The model could be interrogated for predictions and recommendations on personalized crew health based on the overall status of the spacecraft, medicinal stores, and status of other crew members. Adaptation techniques would be used to incorporate spaceflight data that have very different distributions from the training data due to the extreme environment. Edge computing and the most advanced neuromorphic processing would enable computation in scenarios with low power and bandwidth, while dimensionality reduction would be employed to ensure that the input data streams from spaceflight are as small as possible. In order to realize this long-term vision, several hardware and software aspects need to be developed and assembled. First, models pretrained on Earth biomedical data would need to be evaluated for predictive accuracy, and the best one selected. That model would need to be adapted to learn from diverse, sparse, and inconsistently measured data streams, as well as human-in-the-loop feedback. A data integration, standardization, and dimensionality reduction methodology would need to be developed to handle all data types and feed them into the model. Once the software and data infrastructure is developed, it would need to be integrated with small footprint compute processors and tested in high-radiation, high-vibration, unregulated temperature situations. As a short-term goal, we recommend to focus on the development of the data and model software structure. Several large language models (LLM) already exist that have been trained on Earth biomedical and clinical knowledgebases, including BioMedLLM, Med-PaLM, SPOKE LLM, and Foresight. These models need to be evaluated for accuracy and the best one chosen for a proof-of-concept structure, while maintaining awareness of the accelerating AI field and incorporating any newly improved model architectures as needed. Then, we recommend to develop a database of synthetic data types to mimic the diverse data streams that are expected in a long-duration space mission. This should include environmental and microbial data from the spacecraft, non-invasive data from wearables and point-of-care devices employed by astronauts, and more invasive molecular and physiological monitoring of clinical and biomarker data from astronauts. The data standardization methodology should be developed, and these data streams used to refine the clinical LLM. Several scenarios should be developed that could plausibly come up in a long-duration space mission, and changes or aberrations introduced to the data at specific times to mimic these scenarios. Then, question and answer tasks should be designed to interrogate the model for predictions and recommendations, with acceptable answers already identified.

Artificial Intelligence↗

Riverine dissolved organic matter transformations increase with watershed area, water residence time, and Damköhler numbers in nested watersheds

Abstract Quantifying the relative influence of factors and processes controlling riverine ecosystem function is essential to predicting future conditions under global change. Dissolved organic matter (DOM) is a fundamental component of riverine ecosystems that fuels microbial food webs, influences nutrient and light availability, and represents a significant carbon flux globally. The heterogeneous nature of DOM molecular composition and its propensity for interaction (i.e., functional diversity) can characterize riverine ecosystem function across spatiotemporal scales. To investigate fundamental drivers of DOM diversity, we collected seasonal water samples from 42 nested locations within five watersheds spanning multiple watershed sizes (~ 5 to 30,000 km 2 ) across the United States. Patterns in DOM molecular richness, aromaticity, relative abundance of N-containing formulas, and putative biochemical transformations derived from high-resolution mass spectrometry were assessed across gradients of explanatory variables associated with watershed characteristics (e.g., watershed area, water residence time, land cover). We found that putative biochemical transformations were more strongly related to explanatory variables across watersheds than common bulk DOM parameters and that watershed area, surface water residence time and derived Damköhler numbers representing DOM reactivity timescales were strong predictors of DOM diversity. The data also indicate that catchment-specific land cover factors can significantly influence DOM diversity in diverging directions. Overall, the results highlight the importance of considering water residence time and land cover when interpreting longitudinal patterns in DOM chemistry and the continued challenge of identifying generalizable drivers that are transferable across watershed and regional scales for application in Earth system models. This work also introduces a Findable Accessible Interoperable Reusable (FAIR) dataset (> 300 samples) to the community for future syntheses.

54 ENVIRONMENTAL SCIENCES↗

A Variational Assimilation Method for Satellite and Conventional Data: Model 2 (version 1)

The Model II variational data assimilation model is the second of the four variational models designed to blend diverse meteorological data into a dynamically constrained data set. Model II differs from Model I in that it includes the thermodynamic equation as the fifth dynamical constraint. Thus, Model II includes all five of the primative equations that govern atmospheric flow for a dry atmosphere.

Achtemeier, Gary L.↗

eqtools: Modular, extensible, open-source, cross-machine Python tools for working with magnetic equilibria

As plasma physics research for fusion energy transitions to an increasing emphasis on cross-machine collaboration and numerical simulation, it becomes increasingly important that portable tools be developed to enable data from diverse sources to be analyzed in a consistent manner. This paper presents eqtools, a modular, extensible, open-source toolkit implemented in the Python programming language for handling magnetic equilibria and associated data from tokamaks. eqtools provides a single interface for working with magnetic equilibrium data, both for handling derived quantities and mapping between coordinate systems, extensible to function with data from different experiments, data formats, and magnetic reconstruction codes, replacing the diverse, non-portable solutions currently in use. Moreover, while the open-source Python programming language offers a number of advantages as a scripting language for research purposes, the lack of basic tokamak-specific functionality has impeded the adoption of the language for regular use. Implementing equilibrium-mapping tools in Python removes a substantial barrier to new development in and porting legacy code into Python. In this paper, we introduce the design of the eqtools package and detail the workflow for usage and expansion to additional devices. Additionally, the implementation of a novel three-dimensional spline solution (in two spatial dimensions and in time) is also detailed. Finally, verification and benchmarking for accuracy and speed against existing tools are detailed. Wider deployment of these tools will enable efficient sharing of data and software between institutions and machines as well as self-consistent analysis of the shared data.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

SPATIO-TEMPORAL DATA MODEL FOR INTEGRATING EVOLVING NATION-LEVEL DATASETS

Ability to easily combine the data from diverse sources in a single analytical workflow is one of the greatest promises of the Big Data technologies. However, such integration is often challenging as datasets originate from different vendors, governments, and research communities that results in multiple incompatibilities including data representations, formats, and semantics. Semantics differences are hardest to handle: different communities often use different attribute definitions and associate the records with different sets of evolving geographic entities. Analysis of global socioeconomic variables across multiple datasets over prolonged time is often complicated by the difference in how boundaries and histories of countries or other geographic entities are represented. Here we propose an event-based data model for depicting and tracking histories of evolving geographic units (countries, provinces, etc.) and their representations in disparate data. The model addresses the semantic challenge of preserving identity of geographic entities over time by defining criteria for the entity existence, a set of events that may affect its existence, and rules for mapping between different representations (datasets). Proposed model is used for maintaining an evolving compound database of global socioeconomic and environmental data harvested from multiple sources. Practical implementation of our model is demonstrated using PostgreSQL object-relational database with the use of temporal, geospatial, and NoSQL database extensions.

Sorokine, Alexandre↗

The Right Amount of Glue: Technologies and Standards Relevant to a Future Solar-Terrestrial Data Environment

In order to meet the challenge of developing a new system science, we will need to employ technology that enables researchers to access data from fields with which they are at least initially unfamiliar as well as from sources they use more regularly. At the same time, the quantity of data to be obtained by missions such as the Solar Dynamics Observatory demands ease and simplicity of data access. These competing demands must in turn fit within severely constrained funding for data analysis in such projects. Based on experience in only a single discipline but with a diversity of data types and sources, we will give examples of technology that have made a significant difference in the way people do science. Similarly, we will show how adoption of a well-documented data format has made it easier for one community to search, reduce, and analyze data. We will also describe a community-supported data reduction and analysis software tree with useful features. We will attempt to generalize the lessons learned in these instances to features the broader, solar-terrestrial community might find compelling, while avoiding overdesign of a common data environment.

Gurman, J. B.↗

Bio-Optical Measurement and Modeling of the California Current and Polar Oceans

The principal goals of our research are to validate standard or experimental products through detailed bio-optical and biogeochemical measurements, and to combine ocean optical observations with advanced radiative transfer modeling to contribute to satellite vicarious radiometric calibration and advanced algorithm development. To achieve our goals requires continued efforts to execute complex field programs globally, as well as development of advanced ocean optical measurement protocols. We completed a comprehensive set of ocean optical observations in the California Current, Southern Ocean, Indian Ocean requiring a large commitment to instrument calibration, measurement protocols, data processing and data merger. We augmented separately funded projects of our own, as well as others, to acquire ill situ data sets we have collected on various global cruises supported by separate grants or contracts. In collaboration with major oceanographic ship-based observation programs funded by various agencies (CalCOFI, US JGOFS, NOAA AMLR, INDOEX and Japan/East Sea) our SIMBIOS effort has resulted in data from diverse bio-optical provinces. For these global deployments we generate a high-quality, methodologically consistent, data set encompassing a wide-range of oceanic conditions. Global data collected in recent years have been integrated with our on-going CalCOFI database and have been used to evaluate SeaWiFS algorithms and to carry out validation studies. The combined database we have assembled now comprises more than 700 stations and includes observations for the clearest oligotrophic waters, highly eutrophic blooms, red-tides and coastal case 2 conditions. The data has been used to validate water-leaving radiance estimated with SeaWiFS as well as bio-optical algorithms for chlorophyll pigments. The comprehensive data is utilized for development of experimental algorithms (e.g. high-low latitude pigment transition, phytoplankton absorption, and cDOM). During this period we completed 9 peer-reviewed publications in high quality journals, and presented aspects of our work at more than 10 scientific conferences.

Mitchell, B. Greg↗

Bio-Optical Measurement and Modeling of the California Current and Polar Oceans

This Sensor Intercomparison and Merger for Biological and Interdisciplinary Oceanic Studies (SIMBIOS) project contract supports in situ ocean optical observations in the California Current, Southern Ocean, Indian Ocean as well as merger of other in situ data sets we have collected on various global cruises supported by separate grants or contracts. The principal goals of our research are to validate standard or experimental products through detailed bio-optical and biogeochemical measurements, and to combine ocean optical observations with advanced radiative transfer modeling to contribute to satellite vicarious radiometric calibration and advanced algorithm development. In collaboration with major oceanographic ship-based observation programs funded by various agencies (CalCOFI, US JGOFS, NOAA AMLR, INDOEX and Japan/East Sea) our SIMBIOS effort has resulted in data from diverse bio-optical provinces. For these global deployments we generate a high-quality, methodologically consistent, data set encompassing a wide-range of oceanic conditions. Global data collected in recent years have been integrated with our on-going CalCOFI database and have been used to evaluate Sea-Viewing Wide Field-of-view Sensor (SeaWiFS) algorithms and to carry out validation studies. The combined database we have assembled now comprises more than 700 stations and includes observations for the clearest oligotrophic waters, highly eutrophic blooms, red-tides and coastal case two conditions. The data has been used to validate water-leaving radiance estimated with SeaWiFS as well as bio optical algorithms for chlorophyll pigments. The comprehensive data is utilized for development of experimental algorithms (e.g., high-low latitude pigment transition, phytoplankton absorption, and cDOM).

Mitchell, B. Greg↗

Taming Big Data Variety in the Earth Observing System Data and Information System

Although the volume of the remote sensing data managed by the Earth Observing System Data and Information System is formidable, an oft-overlooked challenge is the variety of data. The diversity in satellite instruments, science disciplines and user communities drives cost as much or more as the data volume. Several strategies are used to tame this variety: data allocation to distinct centers of expertise; a common metadata repository for discovery, data format standards and conventions; and services that further abstract the variations in data.

Information Systems↗

A Critical Review of Heat Pipe Experiments in Nuclear Energy Applications

This critical review provides heat pipe (HP) experimental data sets that contain pertinent information regarding nuclear technology that may be beneficial to researchers. Heat pipes have been shown to have a tremendously positive impact on nuclear technologies and will continue to become a more prevalent technology as more nuclear reactor concepts embrace this robust technology. Most previous reviews may focus on only a specific HP design or application, and some are backdated. Herein, this critical review extends previous efforts; integrates and summarizes previously reported HP experimental efforts; and provides updates with recently reported results in the literature for HPs in all nuclear-related applications, including space power (thermal radiators, core cooling, and electricity production), microreactors (emergency core cooling, hybrid control rods, and reactor core cooling), and HP involvement in other nuclear-related technologies (spent fuel pool cooling). The two main objectives of this critical review are (1) to facilitate the development of HP codes by outlining some of the existing experimental data sets to validate their codes and directing developers to these efforts and (2) to provide comprehensive information regarding the vast applicability of HPs used in the nuclear industry, including the theory of operation and limitations to supplement researchers in the development of new ideas for potential applications in nuclear-related technologies. The review clearly shows extensive and diverse experimental data sets for HPs developed under diverse testing conditions depending on the available nuclear application for validation purposes. Thus, this critical review is oriented to providing attention to the existing efforts rather than determining gaps in HP research.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Past and Future Operations Concepts of NASA's Earth Science Data and Information System

NASA committed to support the collection and distribution of Earth science data to study global change in the 1990's. A series of Earth science remote sensing satellites, the Earth Observing System (EOS), was to be the centerpiece. The concept for the science data system, the EOS Data and Information System (EOSDIS), created new challenges in the data processing of multiple satellite instrument observations for climate research and in the distribution of global-coverage remote sensor products to a large and growing science research community. EOSDIS was conceived to facilitate easy access to EOS science data for a wide heterogeneous national and international community of users. EOSDIS was to provide a spectrum of services designed for research scientists working on NASA focus areas but open to the general public and international science community. EOSDIS would give researchers tools and assistance in searching, selecting and acquiring data, allowing them to focus on Earth science climate research rather than complex product generation. Goals were to promote exchange of data and research results and expedite development of new geophysical algorithms. The system architecture had to accommodate a diversity of data types, data acquisition and product generation operations, data access requirements and different centers of science discipline expertise. Steps were taken early to make EOSDIS flexible by distributing responsibility for basic services. Many of the system operations concept decisions made in the 90s continued to this day. Once implemented, concepts such as the EOSDIS data model played a critical role developing effective data services, now a hallmark of EOSDIS. In other cases, EOSDIS architecture has evolved to enable more efficient operations, taking advantage of new technology and thereby shifting more resources on data services and less on operating and maintaining infrastructure. In looking to the future, EOSDIS may be able to take advantage of commercial compute environments for infrastructure and further enable large scale climate research. In this presentation, we will discuss key EOSDIS operations concepts from the 1990's, how they were implemented and evolved in the architecture, and look at concepts and architectural challenges for EOSDIS operations utilizing commercial cloud services.

Moses, John F.↗

Toward Comprehensive Uncertainty Predictions for Remote Imaging Spectroscopy

Remote imaging spectroscopy’s role in Earth science will grow in the coming decade as a series of globe-spanning spectroscopy missions launch from NASA, ESA, and other agencies. The nature of remote imaging spectroscopy will change, advancing from short regional studies to address global multi-year questions. The diversity of data will also grow with exposure to a wider range of biomes and atmospheric conditions. To execute these new investigations we must reconcile diverse observing conditions to derive consistent global maps. To this end, rig- orous uncertainty quantification and propagation enables an optimal synthesis of data accounting for observing conditions and data quality. Understanding data uncertainties is also important for principled hypothesis testing, information content assessment, and informed decision making by end users. We survey prior efforts in uncer- tainty quantification for imaging spectroscopy, and describe methods for validating the accuracy of uncertainty predictions. We conclude with a discussion of remaining challenges and promising avenues for future research.

Susiluoto, Jouni↗

Quantifying and Valuing Fundamental Characteristics and Benefits of Floating PV Systems

This project undertook the first systematic and comprehensive collection of Floating Photovoltaic (FPV) related techno-ecological data across diverse geographic regions of the United States. It examined FPV performance, assessed potential environmental risks and benefits, and provided data to support the development of research protocols for better understanding the impacts of FPV. As part of this process, we conducted a detailed study of four existing FPV sites and three land-based PV (LPV) sites in Florida and California.

14 SOLAR ENERGY↗

DSN Wide Area Network Architecture, Capacity and Performance

This paper discusses the architecture of the wide area network that connects key communications facilities within the National Aeronautic and Space Administration (NASA) Deep Space Network (DSN). Several considerations are given to the design of this wide area network to ensure a timely, reliable, and secure data delivery between the mission users and their spacecraft. The network star configuration simplifies data delivery to users and minimizes operational cost. The dual-path connections maximize the system reliability, with geographical diversity in data routing to avoid single point of failure. Data encryption enhances the protection of mission users’ data. The system bandwidth is determined by balancing the needs to minimize the operating bandwidth cost and to have sufficient bandwidth to be able to deliver data to all users within the required. The DSN uses a class base weighted fair queuing (CBWFQ) method in its data delivery. This scheme guarantees a minimum bandwidth to each class of users and allows users to also access any unused bandwidth by other groups. The paper will also show performance of system reliability and bandwidth margin.

Liao, Jason↗

Announcing the Biomedical Data Translator: Initial Public Release

ABSTRACT The growing availability of biomedical data offers vast potential to improve human health, but the complexity and lack of integration of these datasets often limit their utility. To address this, the Biomedical Data Translator Consortium has developed an open‐source knowledge graph–based system—Translator—designed to integrate, harmonize, and make inferences over diverse biomedical data sources. We announce here Translator's initial public release and provide an overview of its architecture, standards, user interface, and core features. Translator employs a scalable, federated, knowledge graph framework for the integration of clinical, genomic, pharmacological, and other biomedical knowledge sources, enabling query retrieval, inference, and hypothesis generation. Translator's user interface is designed to support the exploration of knowledge relationships and the generation of insights, without requiring deep technical expertise and gradually revealing more detailed evidence, provenance, and confidence information, as needed by a given user. To demonstrate Translator's application and impact, we highlight features of the user interface in the context of three real‐world use cases: suggesting potential therapeutics for patients with rare disease; explaining the mechanism of action of a pipeline drug; and screening and validating drug candidates in a model organism. We discuss strengths and limitations of reasoning within a largely federated system and the need for rich concept modeling and deep provenance tracking. Finally, we outline future directions for enhancing Translator's functionality and expanding its data sources. Translator represents a significant step forward in making complex biomedical knowledge more accessible and actionable, aiming to accelerate translational research and improve patient care.

Research & Experimental Medicine↗