Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data sharing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 721 records · Page 40

EDOS Data Capture for ALOS

In 2008, NASA's Earth Sciences Missions Operations (ESMO) at Goddard Space Flight Center (GSFC) directed the Earth Observing System Data Operations System (EDOS) project to provide a prototype system to assess the feasibility of high rate data capture for the Japan Aerospace Exploration Agency's (JAXA) Advanced Land Observing Satellite (ALOS) spacecraft via NASA's Tracking and Data Relay Satellite System (TDRSS). The key objective of this collaborative effort between NASA and JAXA was to share science data collected over North and South America previously unavailable due to limitations in ALOS downlink capacity. EDOS provided a single system proof-of-concept in 4 months at White Sands TDRS Ground Terminal The system captured 6 ALOS events error-free at 277 Mbps and delivered the data to the Alaska Satellite Facility (ASF) within 3 hours (May/June '08). This paper describes the successful rapid prototyping approach which led to a successful demonstration and agreement between NASA and JAXA for operational support. The design of the operational system will be discussed with emphasis on concurrent high-rate data capture, Level-O processing, real-time display and high-rate delivery with stringent latency requirements. A similar solution was successfully deployed at Svalbard, Norway to support the Suomi NPP launch (October 2011) and capture all X-band data and provide a 30-day backup archive.

McLemore, Bruce↗

Residential Mobility and Lung Cancer Risk: Data-Driven Exploration Using Internet Sources

Frequent relocation has been linked to health decline, particularly with respect to emotional and psychological wellbeing. In this paper we investigate whether there is an association between frequent relocation and lung cancer risk. For the initial investigation we leverage two online data sources to collect cancer and control subjects using web crawling and tailored text mining. The two data sources share different strengths and weaknesses in terms of the amount of detail, population representation, and sample size. One data source includes online obituaries. The second data source includes augmented LinkedIn profiles. For each data source, the subjects spatiotemporal history is reconstructed from the available information provided in the obituaries and from the education and work experience provided in the LinkedIn profiles. The study shows that lung cancer subjects have higher mobility frequency than the control group. This trend is consistent for both data sources.

Yoon, Hong-Jun↗

Putting Data to Work: Using Building Energy Performance Data to Expand the Market for Energy Efficiency in Buildings

An increasing number of state and local jurisdictions are implementing building performance reporting laws, which generate large quantities of useful data on the characteristics and resource consumption of the building stock. Yet, to realize the potential of these policies, the data must not only be disclosed, but put to work to drive energy savings. Under a three-year pilot, Washington DC (DC), New York City (NYC) and their partners are pioneering the use of data from building performance reporting in energy efficiency programs. To minimize the administrative burden of managing, combining, and sharing these data sets, the cities are utilizing the U.S. Department of Energy’s (DOE) open-source Standard Energy Efficiency Data (SEED) Platform. The Putting Data to Work project team is working with efficiency program administrators to develop and implement new and innovative ways in which the data collected through benchmarking, energy audits, and related policies can be used to improve energy policies and planning, unlock data directly for market use, scale-up the market for energy efficiency services, drive competition, better target utility incentive programs, and inform measurement and verification. This paper details achievements and key findings in DC and NYC to date, including the importance of high compliance, data quality, and data cleansing in using the information collected; methods that the cities are using to apply data to drive maximum energy efficiency; and the importance of inter- and intra-agency collaboration in program success. We also outline the path forward and detail expected outcomes and scalability of project activities.

Beddingfield, Erin↗

Accelerating Multigrid-based Hierarchical Scientific Data Refactoring on GPUs

Rapid growth in scientific data and a widening gap between computational speed and I/O bandwidth make it increasingly infeasible to store and share all data produced by scientific simulations. Instead, we need methods for reducing data volumes: ideally, methods that can scale data volumes adaptively so as to enable negotiation of performance and fidelity tradeoffs in different situations. Multigrid-based hierarchical data representations hold promise as a solution to this problem, allowing for flexible conversion between different fidelities so that, for example, data can be created at high fidelity and then transferred or stored at lower fidelity via logically simple and mathematically sound operations. However, the effective use of such representations has been hindered until now by the relatively high costs of creating, accessing, reducing, and otherwise operating on such representations. We describe here highly optimized data refactoring kernels for GPU accelerators that enable efficient creation and manipulation of data in multigrid-based hierarchical forms. We demonstrate that our optimized design can achieve up to 250 TB/s aggregated data refactoring throughput—83% of theoretical peak—on 1024 nodes of the Summit supercomputer. We showcase our optimized design by applying it to a large-scale scientific visualization workflow and the MGARD lossy compression software.

Chen, Jieyang↗

Ocean Surface Vector Wind: Research Challenges and Operational Opportunities

The atmosphere and ocean are joined together over seventy percent of Earth, with ocean surface vector wind (OSVW) stress one of the linkages. Satellite OSVW measurements provide estimates of wind divergence at the bottom of the atmosphere and wind stress curl at the top of the ocean; both variables are critical for weather and climate applications. As is common with satellite measurements, a multitude of OSVW data products exist for each currently operating satellite instrument. In 2012 the Joint Technical Commission on Oceanography and Marine Meteorology (JCOMM) launched an initiative to coordinate production of OSVW data products to maximize the impact and benefit of existing and future OSVW measurements in atmospheric and oceanic applications. This paper describes meteorological and oceanographic requirements for OSVW data products; provides an inventory of unique data products to illustrate that the challenge is not the production of individual data products, but the generation of harmonized datasets for analysis and synthesis of the ensemble of data products; and outlines a vision for JCOMM, in partnership with other international groups, to assemble an international network to share ideas, data, tools, strategies, and deliverables to improve utilization of satellite OSVW data products for research and operational applications.

Joint Technical Commission on Oceanography and Mar↗

SU-E-T-544: A Radiation Oncology-Specific Multi-Institutional Federated Database: Initial Implementation

Purpose: To implement a common database structure and user-friendly web-browser based data collection tools across several medical institutions to better support evidence-based clinical decision making and comparative effectiveness research through shared outcomes data. Methods: A consortium of four academic medical centers agreed to implement a federated database, known as Oncospace. Initial implementation has addressed issues of differences between institutions in workflow and types and breadth of structured information captured. This requires coordination of data collection from departmental oncology information systems (OIS), treatment planning systems, and hospital electronic medical records in order to include as much as possible the multi-disciplinary clinical data associated with a patients care. Results: The original database schema was well-designed and required only minor changes to meet institution-specific data requirements. Mobile browser interfaces for data entry and review for both the OIS and the Oncospace database were tailored for the workflow of individual institutions. Federation of database queries--the ultimate goal of the project--was tested using artificial patient data. The tests serve as proof-of-principle that the system as a whole--from data collection and entry to providing responses to research queries of the federated database--was viable. The resolution of inter-institutional use of patient data for research is still not completed. Conclusions: The migration from unstructured data mainly in the form of notes and documents to searchable, structured data is difficult. Making the transition requires cooperation of many groups within the department and can be greatly facilitated by using the structured data to improve clinical processes and workflow. The original database schema design is critical to providing enough flexibility for multi-institutional use to improve each institution s ability to study outcomes, determine best practices, and support research. The project has demonstrated the feasibility of deploying a federated database environment for research purposes to multiple institutions.

60 APPLIED LIFE SCIENCES↗

Quantifying agricultural productive use of energy load in Sub-Saharan Africa and its impact on microgrid configurations and costs

The use of advanced energy technologies for agricultural purposes—such as irrigation, refrigeration, crop processing, and egg incubation—has the potential to increase crop yield, reduce vulnerability to changing precipitation patterns, increase shelf life, strengthen income and employment opportunities in rural areas, and reduce emissions by displacing fossil fuel-based technologies. These productive uses of energy (PUE) in remote areas could potentially be powered by microgrids that additionally serve otherwise unelectrified communities, most of which are located in rural Sub-Saharan Africa. Here, in this paper, we use high-resolution geospatial data to estimate the end-use electricity demand for a range of agricultural PUE across Sub-Saharan Africa, and we share these data in an open-access mapping tool. Next, we use REopt®, a techno-economic optimization model of energy systems, to determine the cost and system sizing implications of incorporating agricultural PUE into microgrid designs in Kenya and Zambia. We estimate the upper bound of agricultural PUE demand for irrigation, milling, shelling, refrigeration, and egg incubation across Sub-Saharan to be 16.8 TWh/yr. We find that incorporating local agricultural PUE into microgrid system designs increases the required system sizing while having minimal impact on the levelized cost of energy of these systems. Our analysis is the first to demonstrate the PUE potential in the agricultural sector at a 10x10-kilometer resolution across Sub-Saharan Africa and to show, at scale, how site-specific PUE can impact the cost and sizing of microgrids that are otherwise deployed to serve local household and community load.

24 POWER TRANSMISSION AND DISTRIBUTION↗

A National Infrastructure for Artificial Intelligence on the Grid (NI4AI) (Final Scientific/Technical Report)

Electric utilities have traditionally taken a very pragmatic yet myopic approach with grid sensors and the resulting collected data. Sensors are purchased and deployed to solve a specific, known problem that has risen to sufficient awareness as to justify the effort of deploying sensors and the needed capital investment. This sensor data flows into proprietary software packages with limited functionality intended only to address the initial problem. This approach aligns with the financial incentives of the utility to deploy capital into fixed hardware assets for which the corporations earn a rate of return. This mentality stands in stark contrast to the big data revolution that started nearly 25 years ago with the rise of Google. In this worldview, data is a fundamental business asset; successful organizations collect, store, explore, merge, and exploit as much data as possible to not only solve problems well understood today but also to tackle new problems that will inevitably rise tomorrow. The ARPA-E Open Innovation 2018 project entitled A National Infrastructure for Artificial Intelligence on the Grid or NI4AI for short was designed to demonstrate this alternative paradigm for using data. To do this, the project was composed of three key thrust areas. The first major component deployed a variety of high-frequency grid sensors and captured terabytes of both wide-scale and localized grid measurements, generating high-value datasets for grid research and algorithm development. The second aspect made available PingThings’ PredictiveGridTM, a horizontally scalable, cloud-based data management and AI platform built for time series data to explore and exploit the collected data. Finally, the project fostered a diverse and open research community composed of experts from numerous fields through focused educational content, code sharing, and data science competitions. Shifting away from “single use” sensors and closed data silos within electric utilities is a major benefit to the public at large. This legacy approach to data is incredibly (1) capital intensive (new sensors must be deployed for each new problem and problems tend to arise continuously) and (2) painfully slow (new problems must be identified first and then new sensors must be deployed to collect data to begin to address the issue). The transition to a carbon neutral grid requires a massive transformation of the existing grid infrastructure and will continue to challenge the legacy grid in unforeseen ways. The only way to make the energy transition cost effective is for utilities to abandon this dated data paradigm and adopt more contemporary approaches. NI4AI has shown that it is technically possible and economically feasible to ingest, explore, and exploit grid data collected from even very high frequency sensing, such as continuous point on wave sensors collecting measurements 10,000 times a second. In fact, the PredictiveGrid platform used is commercially available and deployed at several utilities in the United States. Project accomplishments were numerous and included (1) making available a state of the art time series platform to the community, (2) collecting over 520 streams of time series data from grid sensors totaling over 1 trillion grid measurements, and (3) developing and nurturing a community within the industry focused on the use of data to create value for utilities and, ultimately, end consumers.

97 MATHEMATICS AND COMPUTING↗

Hydrological Perspectives on Integrated, Coordinated, Open, Networked (ICON) Science

Hydrologic sciences depend on data monitoring, analyses, and simulations of hydrologic processes to ensure safe, sufficient, and equal water distribution. These hydrologic data come from but are not limited to primary (lab, plot, and field experiments) and secondary sources (remote sensing, UAVs, hydrologic models) that typically follow FAIR Principles (Findable, Accessible, Interoperable, and Reusable: (go-fair.org)). Easy availability of FAIR data has become possible because the hydrology-oriented organizations have pushed the community to increase coordination of the protocols for generating data and sharing model platforms. In addition, networking at all levels has emerged with an invigorated effort to activate community science efforts that complement conventional data collection methods. However, it has become difficult to decipher various complex hydrologic processes with increasing data. Machine learning, a branch of artificial intelligence, provide more accurate and faster alternatives to better understand different hydrological processes. The Integrated, Coordinated, Open, Networked (ICON) framework provides a pathway for water users to include and respect diversity, equity, and inclusivity. In addition, ICONs support the integration of peoples with historically marginalized identities into this professional discipline of water sciences. This article comprises three independent commentaries about the state of ICON principles in hydrology and discusses the opportunities and challenges of adopting them.

(ICON) principles to address↗

NASA contributions to the global habitability program

As a result of developments occurring over the last two decades, the data acquisition, storage, analysis, and transmission facilities are now available for a concerted long-term interdisciplinary and international study of the global environmental system. Such a study is the essence of the 'Global Habitability' concept introduced in 1982. The aims of Global Habitability research are considered, taking into account an understanding of the vital global processes of the earth's energy balance, the global hydrological cycle, and the biogeochemical cycling of carbon, nitrogen, phosphorus, and sulfur. Details of NASA planning for Global Habitability are discussed along with international data exchange arrangements. Attention is given to the possible contributions of satellite data and associated techniques to Global Habitability, examples of specific research conducted by NASA in support of the Global Habitability and the international sharing of data and results for Global Habitability.

Mcconnell, D. G.↗

Open-Source Science-Driven Development of the Science Data System (SDS) for Earth System Observatory (ESO) Atmospheric Missions

The NASA Earth System Observatory (ESO) atmospheric missions will provide space-based and suborbital observations of collocated cloud, dynamic, precipitation and aerosol processing leading to improved weather, air quality, and climate predictions. The Science Data System (SDS) will deploy the adaptive processing system (APS) developed within the Cloud to manage the research and operational processing of ESO atmospheric mission orbital and suborbital sensors and curate these data for near real-time and collection reprocessing and transfer them to a NASA Distributed Active Archive Center (DAAC) for long-term storage and distribution. Further, the SDS will follow guidelines provided by NASA Earth Science Data Systems (ESDS) program including standard conventions for data file formats, naming, and metadata to improve data interoperability, interpretability, usability, discovery, provenance, and spatiotemporal representativeness. The SDS follows NASA’s commitment to Open-Source Science (OSS) including the sharing of data, software, and knowledge in an open and timely manner. Each of the SDS system components will be developed with open-source concepts including components of APS itself as well as ESO atmospheric mission algorithms. This presentation describes the framework of the SDS and its integral part in facilitating OSS within the ESO atmospheric missions.

David M. Giles↗

Towards more transparent and reproducible omics studies through a common metadata checklist and data publications

Biological processes are fundamentally driven by complex interactions between biomolecules. Integrated high-throughput omics studies enable multifaceted views of cells, organisms, or their communities. With the advent of new post-genomics technologies omics studies are becoming increasingly prevalent yet the full impact of these studies can only be realized through data harmonization, sharing, meta-analysis, and integrated research,. These three essential steps require consistent generation, capture, and distribution of the metadata. To ensure transparency, facilitate data harmonization, and maximize reproducibility and usability of life sciences studies, we propose a simple common omics metadata checklist. The proposed checklist is built on the rich ontologies and standards already in use by the life sciences community. The checklist will serve as a common denominator to guide experimental design, capture important parameters, and be used as a standard format for stand-alone data publications. This omics metadata checklist and data publications will create efficient linkages between omics data and knowledge-based life sciences innovation and importantly, allow for appropriate attribution to data generators and infrastructure science builders in the post-genomics era. We ask that the life sciences community test the proposed omics metadata checklist and data publications and provide feedback for their use and improvement.

Kolker, Eugene↗

Data Transfer Study HPSS Archiving

The movement of the large amounts of data produced by codes run in a High Performance Computing (HPC) environment can be a bottleneck for project workflows. To balance filesystem capacity and performance requirements, HPC centers enforce data management policies to purge old files to make room for new computation and analysis results. Users at Oak Ridge Leadership Computing Facility (OLCF) and many other HPC user facilities must archive data to avoid data loss during purges, therefore the time associated with data movement for archiving is something that all users must consider. This study observed the difference in transfer speed from the originating location on the Lustre filesystem to the more permanent High Performance Storage System (HPSS). The tests were done with a number of different transfer methods for files that spanned a variety of sizes and compositions that reflect OLCF user data. This data will be used to help users of Titan and other Cray supercomputers plan their workflow and data transfers so that they are most efficient for their project. We will also discuss best practice for maintaining data at shared user facilities.

Big Data↗

AAM NC ATI TechTalk - Aerograph Architecture v1

Aerograph is NASA’s data management system for Advanced Air Mobility. Its mission is to support AAM research by providing a reliable and secure system that collects, stores, protects, and shares AAM data. Its vision is to provide a system that AAM research scientists, aerospace engineers, data scientists, and analysts trust for obtaining NC data and performing key analyses. The types of data Aerograph manages involves data related to flight test events, including: Aircraft Performance and Characterization (e.g., position reports) Airspace (e.g., operation intent, waypoints, and constraints) Environment (e.g., surface and wind weather) Infrastructure (e.g., surveillance coverage) Derivative Analytical Artifacts (e.g., glide path performance chart, 3D position chart, Integrated Data Product)

Aerograph↗

Fusion Energy Science Joint Facilities and Theory Research Target 2011: Final Report for the Period October 1, 2010 through September 30, 2011

Briefly stated, the goal of this combined experiment/theory milestone was to improve our knowledge of the physics processes that control the H-mode pedestal by applying models of these mechanisms to experimental data. A concerted and coordinated effort of experimental, theory and modeling activities has examined several physics mechanisms of interest, and has met the goals of the milestone. A few noteworthy results will be noted here. The activity has applied peeling-ballooning theory to all three machines, and increased confidence that the theory predicts the ultimate limits to pedestal height in an ELMing plasma. The activity has expanded the range of conditions for testing of the EPED model, and increased confidence in the ability of the model to compute the pedestal pressure height in medium aspect ratio tokamaks. Kinetic neoclassical models have been used to verify that an important analytic model for the pedestal bootstrap current has good accuracy in many regimes of interest but needs correction at high collisionality. A benchmarking effort between electromagnetic gyrokinetic codes has provided increased understanding of how to use these codes in the pedestal, and has laid the groundwork for using these codes to study linear stability of gyrokinetic modes in and on top of the pedestal. Comparisons of data and models have led to successful simulations of a quasi-coherent mode in C-Mod and to the tentative identification of a high frequency mode in DIII-D. A kinetic neoclassical model qualitatively agrees with some features of pedestal density profiles. A paleoclassical transport model quantitatively predicts some features of the electron temperature profiles in NSTX and DIII-D. The milestone activity also laid the groundwork for future advancements in understanding and predicting the pedestal. All three machines obtained a wealth of pedestal data under a wide variety of operating conditions. Some of these data have been analyzed already, and the analysis and comparison with models will provide important results over the next year or two. Many codes were improved in significant ways in order to model data under the challenging conditions of the pedestal. In addition, new and strengthened collaborations were established between experiment, modeling and theory, and these efforts include providing mechanisms for sharing experimental data. All of these efforts will continue to provide major benefits to future pedestal studies. Much of the experimental and modeling work performed to support this milestone is reported in detail in the research contributions to this report. Here, a summary of results from the various contributions, as they pertain to several proposed pedestal physics processes, is discussed here. Emphasis is placed on mechanisms for which there are results from one or more machines or one or more models. Work from preceding quarterly reports is used for some of this summary. At the end of this summary, a brief summary of implications for ITER and implications for future work will be presented.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Myna

The additive manufacturing (AM) community has been developing digital factory tools over the past decade to better leverage the multi-modal process data coming out of the advanced manufacturing process. As a result, numerous databases of additive manufacturing process data exist in the literature and in the archival storage of disparate research groups. While some efforts have been made to create a standard ontology for storing and sharing AM data, in practice a variety of data structures are used to store AM build data, even within a single institution. This causes many problems for maintainability and extensibility when attempting to integrate computational modeling tools with experimental data to either validate models or to provide further insight into results and trends. Myna is a Python-based framework that aims to decrease the effort needed to connect individual computational models to the variety of AM process data that exist in different research groups and institutions. This type of software is sometimes referred to as "middleware" or “glueware,” in that it connects disparate databases and applications into a single computational ecosystem. Instead of maintaining unique interfaces between each application and each database, developers can create a single interface from each application to Myna and thereby gain access to the implemented database connections. Similarly, developing a database connection in Myna provides access to the developed simulation applications. This framework greatly simplifies the maintainability of model applications that rely on experimental data. Using external simulation tools, users will also be able to run pre-configured workflows using the built-in workflow manager. Several examples of input files are provided with Myna for different workflows, including melt pool geometry predictions and detailed melt pool and solidification microstructure predictions.

Knapp, GerryL. [Oak Ridge National Laboratory (ORN↗

Open-Source Science-led Development of the Atmosphere Observing System (AOS) Mission Science Data System (SDS)

The Earth System Observatory (ESO) Atmosphere Observing System (AOS) mission will provide space-based and suborbital observations of collocated cloud, dynamic, precipitation and aerosol processing leading to improved weather, air quality, and climate predictions. The AOS Science Data System (SDS) will be a system of systems developed within the Cloud to manage the research and operational processing of AOS mission orbital and suborbital sensors and curate these data for reprocessing (e.g., in near real-time or by collection) and transfer them to a NASA Distributed Active Archive Center (DAAC) for long-term storage. Further, AOS SDS will follow guidelines provided by NASA Earth Science Data Systems (ESDS) program including standard conventions for data file formats, naming, and metadata to improve data interoperability, interpretability, usability, discovery, provenance, and spatiotemporal representativeness. The AOS mission follows NASA’s lead in making a commitment to Open-Source Science (OSS) including the sharing of data, software, and knowledge in an open and timely manner. Each of the AOS SDS system components will be developed with open-source concepts including components of SDS itself as well as AOS mission algorithms. Further, the AOS SDS assumes the role to lead and facilitate OSS activities for the AOS mission. This presentation describes the framework of the AOS SDS and its integral part in facilitating OSS within the AOS mission.

David Giles↗

Open-Source Science-led Development of the AOS Mission Science Data System (SDS)

The Earth System Observatory (ESO) Atmosphere Observing System (AOS) mission will provide space-based and suborbital observations of collocated cloud, dynamic, precipitation and aerosol processing leading to improved weather, air quality, and climate predictions. The AOS Science Data System (SDS) will be a system of systems developed within the Cloud to manage the research and operational processing of AOS mission orbital and suborbital sensors and curate these data for reprocessing (e.g., in near real-time or by collection) and transfer them to a NASA Distributed Active Archive Center (DAAC) for long-term storage. Further, AOS SDS will follow guidelines provided by NASA Earth Science Data Systems (ESDS) program including standard conventions for data file formats, naming, and metadata to improve data interoperability, interpretability, usability, discovery, provenance, and spatiotemporal representativeness. The AOS mission follows NASA’s lead in making a commitment to Open-Source Science (OSS) including the sharing of data, software, and knowledge in an open and timely manner. Each of the AOS SDS system components will be developed with open-source concepts including components of SDS itself as well as AOS mission algorithms. Further, the AOS SDS assumes the role to lead and facilitate OSS activities for the AOS mission. This presentation describes the framework of the AOS SDS and its integral part in facilitating OSS within the AOS mission.

David M. Giles↗