Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data Management Platform”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 307 records · Page 17
All sourcesNASA NTRSDOE OSTI
NASA NTRS2019

Design and Construction of a NASA Airborne and Field Investigation Inventory

NASA conducts airborne and field investigations that produce a wealth of valuable research data. Unfortunately, this data is often scattered across individual scientist hard drives or NASA Distributed Active Archive Centers and it can be difficult to locate and retrieve. Although satellite data has been successfully consolidated by tools such as EarthData Search, airborne and field investigation data present unique challenges stemming from the variability of temporal, spatial, platform, and instrument metadata. To address these difficulties with data retrieval and metadata variability, the Interagency Implementation and Concepts Team established an Airborne Data Management Group to improve airborne data search, understanding, access, and use. Surveys have been conducted of end users in order to build query lists that will drive the augmentation and standardization of existing metadata. Detailed metadata was then laboriously compiled from present and historic airborne and field investigations to build a database that will enable intelligent data search and retrieval. The inventory structure and function will be described and demonstrated. The purpose of this presentation is to bring awareness to this effort, to highlight and describe the issues and complications in development, and to increase user interest prior to public release in 2020.

Davis, Carson↗
DOE OSTI2022

EXRAY

SAND2022-2270 O EXRAY is a data analysis software for x-ray spectrometers based on the IDL software platform from L3Harris. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Rochau, Gregory↗
NASA NTRS1998

Advanced Data Format (ADF) Software Library and Users Guide

The "CFD General Notation System" (CGNS) consists of a collection of conventions, and conforming software, for the storage and retrieval of Computational Fluid Dynamics (CFD) data. It facilitates the exchange of data between sites and applications, and helps stabilize the archiving of aerodynamic data. This effort was initiated in order to streamline the procedures in exchanging data and software between NASA and its customers, but the goal is to develop CGNS into a National Standard for the exchange of aerodynamic data. The CGNS development team is comprised of members from Boeing Commercial. Airplane Group, NASA-Ames, NASA-Langley, NASA-Lewis, McDonnell-Douglas Corporation (now Boeing-St. Louis), Air Force-Wright Lab., and ICEM-CFD Engineering. The elements of CGNS address all activities associated with the storage of data on external media and its movement to and from application programs. These elements include: 1) The Advanced Data Format (ADF) Database manager, consisting of both a file format specification and its 1/0 software, which handles the actual reading and writing of data from and to external storage media; 2) The Standard Interface Data Structures (SIDS), which specify the intellectual content of CFD data and the conventions governing naming and terminology; 3) The SIDS-to-ADF File Mapping conventions, which specify the exact location where the CFD data defined by the SIDS is to be stored within the ADF file(s); and 4) The CGNS Mid-level Library, which provides CFD-knowledgeable routines suitable for direct installation into application codes. The ADF is a generic database manager with minimal intrinsic capability. It was written for the purpose of storing large numerical datasets in an efficient, platform independent manner. To be effective, it must be used in conjunction with external agreements on how the data will be organized within the ADF database such defined by the SIDS. There are currently 34 user callable functions that comprise the ADF Core library and are described in the Users Guide. The library is written in C, but each function has a FORTRAN counterpart.

Smith, Matthew↗
NASA NTRS2008

Automated Data Assimilation and Flight Planning for Multi-Platform Observation Missions

This is a progress report on an effort in which our goal is to demonstrate the effectiveness of automated data mining and planning for the daily management of Earth Science missions. Currently, data mining and machine learning technologies are being used by scientists at research labs for validating Earth science models. However, few if any of these advanced techniques are currently being integrated into daily mission operations. Consequently, there are significant gaps in the knowledge that can be derived from the models and data that are used each day for guiding mission activities. The result can be sub-optimal observation plans, lack of useful data, and wasteful use of resources. Recent advances in data mining, machine learning, and planning make it feasible to migrate these technologies into the daily mission planning cycle. We describe the design of a closed loop system for data acquisition, processing, and flight planning that integrates the results of machine learning into the flight planning process.

Oza, Nikunj↗
NASA NTRS1975

Space data relay systems

Significant progress has been achieved in simplifying platform concepts through random access techniques. This is particularly important in applications such as balloons where weight is critical. In applications, where weight restriction may not be a problem, the concept lends itself to uncomplicated designs and low cost. Nevertheless, ordered systems offer inherent advantages in managing data flow which justifies their use. With continuing improvements in technology, particularly low power receivers, ordered systems should become quite competitive with random systems for many applications.

Cote, C. E.↗
DOE OSTI2024

Centralized Interactive Phenomics Resource: an integrated online phenomics knowledgebase for health data users

Development of clinical phenotypes from electronic health records (EHRs) can be resource intensive. Several phenotype libraries have been created to facilitate reuse of definitions. However, these platforms vary in target audience and utility. Here, we describe the development of the Centralized Interactive Phenomics Resource (CIPHER) knowledgebase, a comprehensive public-facing phenotype library, which aims to facilitate clinical and health services research. The platform was designed to collect and catalog EHR-based computable phenotype algorithms from any healthcare system, scale metadata management, facilitate phenotype discovery, and allow for integration of tools and user workflows. Phenomics experts were engaged in the development and testing of the site. The knowledgebase stores phenotype metadata using the CIPHER standard, and definitions are accessible through complex searching. Phenotypes are contributed to the knowledgebase via webform, allowing metadata validation. Data visualization tools linking to the knowledgebase enhance user interaction with content and accelerate phenotype development. The CIPHER knowledgebase was developed in the largest healthcare system in the United States and piloted with external partners. The design of the CIPHER website supports a variety of front-end tools and features to facilitate phenotype development and reuse. Health data users are encouraged to contribute their algorithms to the knowledgebase for wider dissemination to the research community, and to use the platform as a springboard for phenotyping. CIPHER is a public resource for all health data users available at https://phenomics.va.ornl.gov/ which facilitates phenotype reuse, development, and dissemination of phenotyping knowledge.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2018

Partnership For Edge Physics Simulation

In this effort, we will extend our prior work as part of CPES (i.e., DART and DataSpaces) to support in-situ tight coupling between application codes that exploits data locality and core-level parallelism to maximize on-chip data exchange and reuse. This will be accomplished by mapping coupled simulations so that the data exchanges are more localized within the nodes. Coupled simulation workflows can more effectively utilize the resources available on emerging HEC platforms if they can be mapped and executed to exploit data locality as well as the communication patterns between application components. Scheduling and running such workflows requires an extended framework that should provide a unified hybrid abstraction to enable coordination and data sharing across computation tasks that run on the heterogeneous multi-core-based systems, and develop a data-locality based dynamic tasks scheduling approach to increase on-chip or intra-node data exchanges and in-situ execution. This effort will extend our prior work as part of CPES (i.e., DART and DataSpaces), which provided a simple virtual shared-space abstraction hosted at the staging nodes, to support application coordination, data sharing and active data processing services. Moreover, it will transparently manage the low-level operations associated with the inter-application data exchange, such as data redistributions, and will enable running coupled simulation workflow on multi-cores computing platforms.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
NASA NTRS2007

SERVIR: From Space to Village. A Regional Monitoring and Visualization System For Environmental Management Using Satellite Applications For Sustainable Development

NASA is committed to providing technological support and expertise to regional and national organizations for earth science monitoring and analysis. This commitment is exemplified by NASA's long-term relationship with Central America. The focus of these efforts has primarily been to measure the impact of human development on the environment and to provide data for the management of human settlement and expansion in the region. Now, NASA is planning to extend and expand this capability to other regions of the world including Africa and the Caribbean. NASA began using satellite imagery over twenty-five years ago to locate important Maya archeological sites in Mesoamerica and to quantify the affect of deforestation on those sites. Continuing that mission, NASA has partnered with the U.S. Agency for International Development (USAID), the World Bank, the Water Center for the Humid Tropics of Latin America and the Caribbean (CATHALAC) and the Central American Commission for Environment and Development (CCAD) to develop SERVIR (Sistema Regional de Visualizacion y Monitoreo), for the Mesoamerican Biological Corridor. SERVIR has become one of the most important aspects of NASA's geospatial efforts in Central America by establishing a common access portal for information that affects the lives, livelihood and future of everyone in the region. SERVIR, most commonly referred to as a regional visualization and monitoring system, is a scientific and technological platform that integrates satellite and other geospatial data sets to generate tools for improved decision-making capabilities. It has a collection of data and models that are easily accessible to earth science managers, first responders, NGO's (Non-Government Organizations) and a host of others. SERVIR is currently used to monitor and forecast ecological changes as well as provide information for decision support during severe events such as forest fires, red tides,and tropical storms. Additionally, SERVIR addresses the nine societal benefit areas of the Global Earth Observation System (GEOSS): disasters, ecosystems, biodiversity, weather, water, climate, health, agriculture and energy.

Sever, Tom↗
DOE OSTI2022

LANL Activities on Mechanistic Approach to Analyzing and Improving Unconventional Hydrocarbon Production

Hydrocarbon production from shale reservoirs is inherently inefficient and challenging since these are low permeability plays. In addition, there is a limited understanding of the fundamentals and the controlling mechanisms, further complicating how to optimize these plays. Herein, we summarize our experimental and computational efforts fully and partially supported by the fundamental shale portfolio to reveal unconventional shale fundamentals and devise development strategies to enhance extraction efficiency with a minimal environmental footprint. Integrating these fundamentals with machine learning, we outline a pathway to improve the predictive power of our models, which enhances the forecast quality of production, thereby improving the economics of operations in unconventional reservoirs. For instance, we have developed science informed workflows and platforms for optimizing pressure-drawdown at a site, which allow operators to make reservoir-management decisions that optimize recovery in consideration of future production. Recently, our work relies on the hybridization of physics-based prediction and machine learning, whereby accurate synthetic data (combined with available site data) can enable the application of machine learning methods for rapid forecasting and optimization. Consequently, the workflow and platform are readily extendable to operations at other sites, plays, and basins.

04 OIL SHALES AND TAR SANDS↗
DOE OSTI2021

TCR Data Management Plan

The Oak Ridge National Laboratory (ORNL) Transformation Challenge Reactor (TCR) program is developing additive manufacturing and artificial intelligence (AI) to deliver enabling technologies for advanced reactors. Through the application of these advanced technologies, the program targets delivering solutions to the high costs and lengthy deployment timelines that threaten the future of nuclear energy—the country’s largest source of carbon-free energy. This document describes the plan for integrating and managing TCR data from multiple sources throughout ORNL and external sources, including novel data sources associated with advanced manufacturing, characterization systems, and the TCR Digital Platform that incorporates various levels of AI and data analytics.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
NASA NTRS2018

JSC OCFO Cloud Integrated Budget Analytical Toolbox

The JSC OCFO analyst's job function relies heavily on analytics to provide every directorate customer with quality service in managing their respective budgets. This technology, configured on the Salesforce cloud platform, enhances the JSC OCFO customer user interface, provides state of the art data analytics and statistics, reduces IT costs, increases productivity, eliminates duplicate entry and errors, and utilizes machine learning and artificial intelligence to process day to day transactional tasks automatically without analyst manipulation. The unique configuration of the COTS technology allows for highly advanced analysis and reporting of government budget data. This provides the ability for complex budgets to be fully understood in detail by non-budget organizations and eliminates time consuming analysis on the OCFO analyst's behalf.

Robertson, Arden↗
NASA NTRS2019

Assembly and Integrated Systems Testing for the Flow Boiling and Condensation Experiment (FBCE)

The Flow Boiling and Condensation Experiment (FBCE) is a flight experiment that is designed to operate in the Fluids Integrated Rack (FIR) on the International Space Station (ISS). The objective of the FBCE is to develop an integrated two-phase flow experiment that will serve as a primary platform for obtaining flow boiling and condensation heat transfer data in microgravity. This data will enable the design and analysis of two-phase thermal management systems for future NASA missions that require increased efficiency beyond the current single-phase systems. The FBCE consists of seven modules, each of which must link together mechanically, electrically, and fluidically upon final integration. Five of the modules provide the fluidic and electronic components required to bring the test fluid to the inlet conditions required by the test module, where the primary science is conducted. These inlet conditions encompass fluid quality ranging from a superheated vapor to a subcooled liquid at a variety of flow rates and pressures. The FBCE is currently manufacturing two test modules, each of which has its own separate test campaign with the five support modules. Each of the modules presents a unique challenge in its assembly and checkout, particularly related to ensuring the final hardware configuration can meet the fluid and thermal requirements levied upon them. Following assembly, a series of flight verification tests will be performed, including thermal testing, EMI testing, and final integration in a FIR Ground Integration Unit. This presentation discusses the status of the FBCE as it continues through final verification testing, including current test results and lessons learned throughout the assembly and integration phase of the project. In addition, future options for additional flight test sections will be explored that will benefit the broader NASA thermal and fluids community.

deFiebre, Jesse↗
NASA NTRSDate not supplied

ICARTT File Format Enhancements: Supporting FAIRness and Data Discovery of Suborbital Campaign Data

Suborbital campaigns aim to accomplish a wide variety of goals and can include a variety of platforms, instruments, and parameters measured. In 2004, the ICARTT (International Consortium for Atmospheric Research on Transport and Transformation) standards were developed to fulfill data management needs for the ICARTT campaign. The ICARTT file format is text-based and composed of a header with important data description information and the data section. Built on the NASA Ames and GTE data formats, the ICARTT format was created to facilitate data exchange and promote collaborations among the science teams for achieving the ICARTT campaign goals. Due to its success and adaptation for use in many other field campaigns, the ICARTT file format became a NASA standard in 2010 and was amended in January 2017. These changes provided many enhancements, including the requirement for variable standard names. Primarily designed for airborne field studies, ICARTT has been further utilized for ground-based studies. NASA has made a commitment to build an inclusive open science community over the next decade. Open-source science strives to make publicly funded scientific research transparent, inclusive, accessible, and reproducible. The ICARTT format can host metadata that is critical for proper use of the data, particularly for in-situ measurements, and can enhance data discovery and accessibility. However, the required fields are often free text, meaning that the information is human readable, but not machine interpretable. Furthermore, the amount and type of information provided can vary significantly between principal investigators and campaigns. To support FAIR principles and interoperability, enhancements to the ICARTT standards are recommended. Possible recommendations include potential use of controlled and consistent vocabulary for variable standard name and certain common metadata elements; standardizing timestamps for easier data comparisons and analysis; and providing guidance on variable measurement units and how they are reported. Enhancing ICARTT metadata can further streamline the process to make suborbital data more readily available to the data user and improve variable-level metadata. Providing more variable-level metadata can enhance data searching and discovery, supporting NASA’s Open-Source Science Initiative (OSSI).

Megan Buzanowicz↗
DOE OSTI2025

mzPeak: Designing a Scalable, Interoperable, and Future-Ready Mass Spectrometry Data Format

Advances in mass spectrometry (MS) instrumentation, such as higher resolution, faster scan speeds, and improved sensitivity, have significantly increased the volume and complexity of data. The growing adoption of imaging and ion mobility further amplifies these challenges across MS-based omics fields, including proteomics, metabolomics, and lipidomics. While these technologies unlock new possibilities, they also present significant challenges in data management, storage, and accessibility. Existing open formats, such as the XML-based community standards mzML and imzML, struggle to meet the demands of modern MS workflows due to their large file sizes, slow data access, and limited metadata support. Vendor-specific formats, while optimized for proprietary instruments, lack interoperability, comprehensive metadata support and long-term archival reliability. This white paper lays the groundwork for mzPeak, a next-generation community data format designed to address these challenges and support high-throughput, multi-dimensional MS workflows. By adopting a hybrid model that combines efficient binary storage for numerical data and both human and machine-readable metadata storage, mzPeak will reduce file sizes, accelerate data access, and offer a scalable, adaptable solution for evolving MS technologies. For researchers, mzPeak will enable enhanced interoperability across platforms, seamless support for complex workflows including ion mobility and MS imaging, and faster data access compared to existing community formats such as mzML. Its design will ensure data is managed in compliance with regulatory standards, essential for applications such as precision medicine and chemical safety, where long-term data integrity and accessibility are critical. For vendors, mzPeak provides a streamlined, open alternative to proprietary formats, reducing the burden of regulatory compliance while aligning with the industry's push for transparency and standardization. By offering a high-performance, interoperable solution, mzPeak positions vendors to meet customer demands for sustainable data management tools which will be able to handle emerging and future data types and workflows. mzPeak aspires to become the cornerstone of MS data management, empowering researchers, vendors, and developers to innovate and collaborate more effectively.

data formats↗
DOE OSTI2024

Equitable Energy Metrics for Integration into Building Performance Standard Tracking Platforms: Preprint

Building Performance Standards (BPS) are being adopted globally and in the United States of America, where 14 different states and jurisdictions have a policy in place and many others are under development (Department of Energy (DOE) 2023). Accurate and equitable data sources are essential to make informed decisions about focusing investment on upgrading buildings to meet jurisdictional goals. There have been multiple new tools developed related to Energy Equity and Environmental Justice (EEEJ) and the resulting datasets need to be integrated into large building port-folios for quick access and better scalability. Integrating EEEJ data in a user-friendly format can help decision makers more quickly assess impacts and analyze the multitude of potentially significant metrics for which there is not yet consensus. In the U.S. and Canada, many BPS ordinances rely primarily on ENERGY STAR Portfolio Manager (ESPM) to capture building characteristics and energy and water consumption data. These datasets can then be imported into city-specific building tracking tools like the Standard Energy Efficiency Data Platform (SEED). Crucially, BPS decision makers require an efficient means of identifying buildings in priority communities to effectively allocate resources and funding. This process must integrate seamlessly with existing jurisdictional toolsets for optimal utility. This paper will demonstrate, for the case of Washington D.C.'s (the District) data, a workflow that provides actionable data for building upgrade investment prioritization in disadvantaged communities.

BPS↗
NASA NTRS2006

Sensor Management for Applied Research Technologies (SMART)-On Demand Modeling (ODM) Project

NASA requires timely on-demand data and analysis capabilities to enable practical benefits of Earth science observations. However, a significant challenge exists in accessing and integrating data from multiple sensors or platforms to address Earth science problems because of the large data volumes, varying sensor scan characteristics, unique orbital coverage, and the steep learning curve associated with each sensor and data type. The development of sensor web capabilities to autonomously process these data streams (whether real-time or archived) provides an opportunity to overcome these obstacles and facilitate the integration and synthesis of Earth science data and weather model output. A three year project, entitled Sensor Management for Applied Research Technologies (SMART) - On Demand Modeling (ODM), will develop and demonstrate the readiness of Open Geospatial Consortium (OGC) Sensor Web Enablement (SWE) capabilities that integrate both Earth observations and forecast model output into new data acquisition and assimilation strategies. The advancement of SWE-enabled systems (i.e., use of SensorML, sensor planning services - SPS, sensor observation services - SOS, sensor alert services - SAS and common observation model protocols) will have practical and efficient uses in the Earth science community for enhanced data set generation, real-time data assimilation with operational applications, and for autonomous sensor tasking for unique data collection.

Goodman, M.↗
DOE OSTI2017

A Data Driven Pre-cooling Framework for Energy Cost Optimization in Commercial Buildings

Commercial buildings consume significant amount of energy. Facility managers are increasingly grappling with the problem of reducing their buildings’ peak power, overall energy consumption and energy bills. In this paper, we first develop an optimization framework – based on a gray box model for zone thermal dynamics – to determine a pre-cooling strategy that simultaneously shifts the peak power to low energy tariff regimes, and reduces both the peak power and overall energy consumption by exploiting the flexibility in a building’s thermal comfort range. We then evaluate the efficacy of the pre-cooling optimization framework by applying it to building management system data, spanning several days, obtained from a large commercial building located in a tropical region of the world. The results from simulations show that optimal pre-cooling reduces peak power by over 50%, energy consumption by up to 30% and energy bills by up to 37%. Next, to enable ease of use of our framework, we also propose a shortest path based heuristic algorithmfor solving the optimization problemand show that it has comparable erformance with the optimal solution. Finally, we describe an application of the proposed optimization framework for developing countries to reduce the dependency on expensive fossil fuels, which are often used as a source for energy backup.We conclude by highlighting our real world deployment of the optimal pre-cooling framework via a software service on the cloud platform of a major provider. Our pre-cooling methodology, based on the gray box optimization framework, incurs no capital expense and relies on data readily available from a building management system, thus enabling facility managers to take informed decisions for improving the energy and cost footprints of their buildings

Vishwanath, Arun↗