Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “resource data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,531 records · Page 85

SPASE: Current Uses, Tools, and Plans

The Space Physics Archive Search and Extract (SPASE) project is an international collaboration among Heliophysics (solar and space physics) groups concerned with data acquisition and archiving. Within this community there are a variety of old and new data centers, resident archives, "virtual observatories", etc. acquiring, holding, and distributing data. The main product of the SPASE group is an XML-based SPASE Data Model now in operational use to enable searches for and ultimate acquisition of data of interest to a researcher. The SPASE Data Model defines the content of resource descriptions (metadata). The intent is to describe all SCientifically usable Heliophysics data sets using the Data Model. Another product of the SPASE group, in collaboration with NASA's Virtual Observatories, is a set of tools and services which work with SPASE meta data. This includes Registry Services which can retrieve and render metadata using resource identifiers and facilitate the downloading of the data referenced by the meta data. The SPASE Data Model has also been used as a vocabulary in specialized data models. One example is the Heliophysics Event List Manager (HELM) model. The SPASE Data Model is also being expanded to provide the means for more detailed description of data sets with the aim of enabling more automated ingestion and use of the data through detailed format descriptions. The evolution is based on a number of lessons learned and feedback from our community. Some of the lessons learned are unique to Heliophysics, and some are common to the various data diSCiplines. We will discuss the present state of SPASE usage, the role the SPASE Data Model can play in speCialized data models and how we foresee the development direction in the future.

Thieman, J. R.↗

A Knowledge Graph Approach for the Secondary Use of Cancer Registry Data

Population-based central cancer registries collect valuable structured and unstructured data primarily for cancer surveillance and research, enhancing insights into clinical features associated with cancer occurrence, cancer treatment, and cancer outcomes to guide interventions which reduce the cancer burden. Cancer registries primarily collect data on (1) cancer type (case or tumor); (2) patient demographics such as age, gender, and residential address at time of diagnosis; (3) planned first course of treatment; and (4) date of last contact, vital status, and cause of death. Cancer registry data is dynamic, structured data, which is extracted from many unstructured sources such as electronic healthcare records, and consolidated for reporting and other purposes. While available advanced analytic tools such as SEER*Stat have the ability to build SAS queries, we, however, explore an innovative knowledge graph approach to organizing cancer registry data for advanced analytics and visualization, which has unique advantages over approaches of existing tools. This innovative knowledge graph approach semantically enriches the data and easily enables linkage with third-party data, which can better explain variation in outcomes. We have developed a prototype knowledge graph based on data from the Louisiana Tumor Registry and other publicly available datasets including Behavioral Risk Factor Surveillance System, Clinical Trials, DBpedia, GeoNames, Rural-Urban Continuum Codes, and Semantic MEDLINE. The resource description framework (RDF) data model was selected to represent our knowledge graph, which contains more than 25 billion triples and is ~4TB in storage size. To exhibit the benefits of the knowledge graph approach, we used scenario specific queries, which find the relationships between cancer treatment sequences and outcomes. To illustrate its ease of use in iterative analysis, the knowledge graph was linked to external datasets for performing complex queries across multiple datasets. In addition, we used knowledge graphs to identify data discrepancies and to handle schema changes. Finally, we visualized the knowledge graph to discover data patterns. Our results demonstrate this graph-based solution enables cancer researchers to execute complex queries and more easily perform iterative analyses to improve understanding of cancer registry data. In the future, we would like to use high-performance computing (HPC) resources for faster-generating hypotheses with clinical potential from our knowledge graph.

Hasan, S M Shamimul↗

Play fairway analysis of geothermal resources across the state of Hawaii: 2. Resource probability mapping

We develop a new geostatistical method to combine evidence provided by diverse geological data sets and produce maps of geothermal resource probability. The application is to the State of Hawaii, and the data sets include the locations and ages of mapped volcanic centers, gravity and magnetotelluric measurements, groundwater temperature and geochemistry, ground surface deformation, seismicity, water table elevation, and groundwater recharge. Using the basic principles of Bayesian statistics, these data and expert knowledge about the effects and importance of the data are used to compute the probabilities of the primary resource qualities of elevated subsurface heat, reservoir permeability, and reservoir fluid content. The product of these marginal probabilities estimates the joint probability of all three qualities and hence the probability of a successful geothermal prospect at each map point. An analogous set of algorithms is used to quantify the confidence in the probability at each point. Not surprisingly, we find that successful geothermal prospects are most probable on the active volcanoes of Hawaii Island, including the area of Hawaii’s single geothermal energy plant. Probability decreases primarily with shield volcano age, being relatively moderate in select locations on Maui and Lanai, relatively low on Oahu, and minimal on Kauai. Future exploration efforts should consider these results as well as the practical, societal, and economic conditions that influence development viability. Here, the difficulties of interisland power transmission mean that even areas with moderate to low probabilities are worth investigating on islands with population centers.

15 GEOTHERMAL ENERGY↗

Scenario driven data modelling: a method for integrating diverse sources of data and data streams

Background: Biology is rapidly becoming a data intensive, data-driven science. It is essential that data is represented and connected in ways that best represent its full conceptual content and allows both automated integration and data driven decision-making. Recent advancements in distributed multi-relational directed graphs, implemented in the form of the Semantic Web make it possible to deal with complicated heterogeneous data in new and interesting ways. Results: This paper presents a new approach, scenario driven data modelling (SDDM), that integrates multirelational directed graphs with data streams. SDDM can be applied to virtually any data integration challenge with widely divergent types of data and data streams. In this work, we explored integrating genetics data with reports from traditional media. SDDM was applied to the New Delhi metallo-beta-lactamase gene (NDM-1), an emerging global health threat. The SDDM process constructed a scenario, created a RDF multi-relational directed graph that linked diverse types of data to the Semantic Web, implemented RDF conversion tools (RDFizers) to bring content into the Sematic Web, identified data streams and analytical routines to analyse those streams, and identified user requirements and graph traversals to meet end-user requirements. Conclusions: We provided an example where SDDM was applied to a complex data integration challenge. The process created a model of the emerging NDM-1 health threat, identified and filled gaps in that model, and constructed reliable software that monitored data streams based on the scenario derived multi-relational directed graph. The SDDM process significantly reduced the software requirements phase by letting the scenario and resulting multi-relational directed graph define what is possible and then set the scope of the user requirements. Approaches like SDDM will be critical to the future of data intensive, data-driven science because they automate the process of converting massive data streams into usable knowledge.

59 BASIC BIOLOGICAL SCIENCES↗

An Adaptable Seismic Data Format

We present ASDF, the Adaptable Seismic Data Format, a modern and practical data format for all branches of seismology and beyond. The growing volume of freely available data coupled with ever expanding computational power opens avenues to tackle larger and more complex problems. Current bottlenecks include inefficient resource usage and insufficient data organization. Properly scaling a problem requires the resolution of both these challenges, and existing data formats are no longer up to the task. ASDF stores any number of synthetic, processed or unaltered waveforms in a single file. A key improvement compared to existing formats is the inclusion of comprehensive meta information, such as event or station information, in the same file. Additionally, it is also usable for any non-waveform data, for example, cross-correlations, adjoint sources or receiver functions. Last but not least, full provenance information can be stored alongside each item of data, thereby enhancing reproducibility and accountability. Any data set in our proposed format is self-describing and can be readily exchanged with others, facilitating collaboration. The utilization of the HDF5 container format grants efficient and parallel I/O operations, integrated compression algorithms and check sums to guard against data corruption. To not reinvent the wheel and to build upon past developments, we use existing standards like QuakeML, StationXML, W3C PROV and HDF5 wherever feasible. Usability and tool support are crucial for any new format to gain acceptance. We developed mature C/Fortran and Python based APIs coupling ASDF to the widely used SPECFEM3D_GLOBE and ObsPy toolkits.

58 GEOSCIENCES↗

Exascale Deep Learning to Accelerate Cancer Research

Deep learning, through the use of neural networks, has demonstrated remarkable ability to automate many routine tasks when presented with sufficient data for training. The neural network architecture (e.g. number of layers, types of layers, connections between layers, etc.) plays a critical role in determining what, if anything, the neural network is able to learn from the training data. The trend for neural network architectures, especially those trained on ImageNet, has been to grow ever deeper and more complex. The result has been ever increasing accuracy on benchmark datasets with the cost of increased computational demands. In this paper we demonstrate that neural network architectures can be automatically generated, tailored for a specific application, with dual objectives: accuracy of prediction and speed of prediction. Using MENNDL- an HPC-enabled software stack for neural architecture search-we generate a neural network with comparable accuracy to state-of-the-art networks on a cancer pathology dataset that is also 16× faster at inference. The speedup in inference is necessary because of the volume and velocity of cancer pathology data; specifically, the previous state-of-the-art networks are too slow for individual researchers without access to HPC systems to keep pace with the rate of data generation. Our new model enables researchers with modest computational resources to analyze newly generated data faster than it is collected.

Patton, Robert↗

CMS Workflow Execution using Intelligent Job Scheduling and Data Access Strategies

Complex scientific workflows can process large amounts of data using thousands of tasks. The turnaround times of these workflows are often affected by various latencies such as the resource discovery, scheduling and data access latencies for the individual workflow processes or actors. Minimizing these latencies will improve the overall execution time of a workflow and thus lead to a more efficient and robust processing environment. In this paper, we propose a pilot job based infrastructure that has intelligent data reuse and job execution strategies to minimize the scheduling, queuing, execution and data access latencies. The results have shown that significant improvements in the overall turnaround time of a workflow can be achieved with this approach. The proposed approach has been evaluated, first using the CMS Tier0 data processing workflow, and then simulating the workflows to evaluate its effectiveness in a controlled environment.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

The Meteorological Experiment on the Mars Surveyor '98 Polar Lander

When it lands on Mars on December 3, 1999, the Mars Surveyor '98 Mars Polar Lander (MPL) will provide the first opportunity to make in-situ measurements of the near-surface weather climate, and volatile inventory in the Martian south polar region. To make the most of this opportunity, the MPL's Mars Volatiles and Climate Surveyor (MVACS) payload includes the most comprehensive complement of meteorological instruments ever sent to Mars. Like the Viking and the Mars Pathfinder Lander, the MVACS Meteorological (Met) package includes sensors for measuring atmospheric pressures, temperatures, and wind velocities. This payload also includes a 2-channel tunable diode laser spectrometer for in-situ measurements of the atmospheric water vapor abundance near the ground, and improved instruments for measuring the relative abundances of oxygen isotopes (in water vapor and CO2) and a surface temperature probe for measuring the surface and sub-surface temperatures. This presentation will provide a brief overview of the environmental conditions anticipated at the surface in the Martian regions. We will then provide an over-view of the MVACS Met instrument and describe the MET sensors in detail, including their principle of operation, range, resolution, accuracy, sampling strategy, heritage, accommodation on the Lander, and their control and data handling system. Finally, we will describe the operational sequences, resource requirements, and the anticipated data volumes for each of the Met instruments.

Crisp, D.↗

Hera - The HEASARC's New Data Analysis Service

Hera is the new computer service provided by the HEASARC at the NASA Goddard Space Flight Center that enables qualified student and professional astronomical researchers to immediately begin analyzing scientific data from high-energy astrophysics missions. All the necessary resources needed to do the data analysis are freely provided by Hera, including: * the latest version of the hundreds of scientific analysis programs in the HEASARC's HEASOFT package, as well as most of the programs in the Chandra CIAO package and the XMM-Newton SAS package. * high speed access to the terabytes of data in the HEASARC's high energy astrophysics Browse data archive. * a cluster of fast Linw workstations to run the software * ample local disk space to temporarily store the data and results. Some of the many features and different modes of using Hera are illustrated in this poster presentation.

Pence, William↗

Nested Microgrids for Increased Grid Resiliency

The article presents a control and communication architecture for interconnecting multiple microgrids by leveraging IEC 61850 data models with distributed energy resources (DER) extensions, IEC Common Information Model (CIM) and Open Field Message Bus (OpenFMB) frameworks. An example use case for planned islanding in the nested microgrid scenario is also provided.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Need help planning for the future of electric vehicles?

This resource provides a sampling of key U.S. Department of Energy (DOE) and national lab resources available to states and local jurisdictions to help them plan for the future of electric vehicles. In particular, these data, information, and modeling resources can help jurisdictions with community planning and developing charging infrastructure.

department of energy, DOE, electric vehicles, Volk↗

Site Remediation Technology InfoBase: A Guide to Federal Programs, Information Resources, and Publications on Contaminated Site Cleanup Technologies. First Edition

Table of Contents: Federal Cleanup Programs; Federal Site Remediation Technology Development Assistance Programs; Federal Site Remediation Technology Development Electronic Data Bases; Federal Electronic Resources for Site Remediation Technology Information; Other Electronic Resources for Site Remediation Technology Information; Other Electronic Resources for Site Remediation Technology Information; Selected Bibliography: Federal Publication on Alternative and Innovative Site Remediation; and Appendix: Technology Program Contacts.

INFORMATION RESOURCES↗

Automated thematic mapping and change detection of ERTS-1 images

A system that inventories and updates resources must be capable of recognizing resources and their changes rapidly, using imagery acquired by a resources satellite such as ERTS-1. The conversion of ERTS images to thematic maps showing the distribution of resources is the first step in the data reduction process. To accomplish this task, the resources must be recognized from spatial and multispectral signatures. In addition, resource boundaries must be accurately established, and the data from different acquisition dates must be registered. This paper describes a system that combines multispectral and spatial pattern recognition techniques to produce thematic maps. This system has been applied to ERTS-1 MSS images, and the results obtained are discussed.

Gramenopoulos, N.↗

Solar Resource & Meteorological Assessment Project (SOLRMAP): Rotating Shadowband Radiometer (RSR); Milford, Utah (Data)

The U.S. Department of Energy's National Renewable Energy Laboratory collaborates with the solar industry to establish high quality solar and meteorological measurements. This Solar Resource and Meteorological Assessment Project (SOLRMAP) provides high quality measurements to support deployment of power projects in the United States. The no-funds-exchanged collaboration brings NREL solar resource assessment expertise together with industry needs for measurements. The end result is high quality data sets to support the financing, design, and monitoring of large scale solar power projects for industry in addition to research-quality data for NREL model development. NREL provides consultation for instrumentation and station deployment, along with instrument calibrations, data acquisition, quality assessment, data distribution, and summary reports. Industry participants provide equipment, infrastructure, and station maintenance.

14 SOLAR ENERGY↗

Strategies for community-sourced biocuration in bioinformatics: a case study on MIBiG 4.0

Biocuration is essential to transform molecular sequence data into standardized, machine-readable resources. Such curated datasets enable comparative analysis, predictive modeling, and data integration across bioinformatics platforms. While professional biocuration is resource-intensive and usually limited to institutional settings, community-driven approaches can mobilize large-scale annotation of specialized datasets and are more resilient to disruptions in scientific funding. Here, we present a model for community-powered curation applied to the Minimum Information about a Biosynthetic Gene Cluster (MIBiG) repository. Through a framework of workflows for metadata capture, annotation validation, and contributor coordination, the MIBiG 4.0 initiative recruited 267 scientists across 178 institutions from 33 countries, volunteering an estimated 4000 h of work. These efforts expanded the MIBiG repository by 22% and enhanced its usability in downstream molecular data analyses in comparative genomic analyses, natural product discovery, and machine learning applications. We provide strategies and actionable lessons for adopting this model, supporting the sustainability of curated bioinformatics resources central to nucleic acid research and related fields.

biocuration↗

A Versatile Simulated Data Transport Layer for in Situ Workflows Performance Evaluation

In situ processing does not only allow scientific applications to face the explosion in data volume and velocity but also to address the time constraints of many simulation-analysis workflows by providing scientists with early insights about their applications at runtime. Multiple frameworks implement the concept of a data transport layer (DTL) to enable such in situ workflows. These tools are very versatile, directly or indirectly access the data generated on the same node, another node of the same compute cluster, or a completely distinct node, and allow data publishers and subscribers to run on the same computing resources or not. This versatility puts on researchers the onus of taking key decisions related to resource allocation and how to transport data to ensure the most efficient execution of their in situ workflows. However, domain scientists and workflow practitioners lack the appropriate tools to assess the respective performance of particular design and deployment options. In this paper we introduce a versatile simulated DTL designed to provide researchers with insights on the respective performance of different execution scenarios of in situ workflows. This open-source, standalone library builds on the SimGrid toolkit and can be linked to any SimGrid-based simulator. It facilitates the evaluation of the performance behavior, at scale, of different data transport configurations and the study of the effects of resource allocation strategies. We demonstrate the scalability, versatility, and accuracy of this simulated DTL by reproducing the execution of two synthetic benchmarks and of a real-world in situ workflow composed of an MPI application and a parallel data analysis. Results of simulations run on a single core show that the proposed library can simulate the interactions of tens of thousands of simulated processes deployed on two interconnected commodity clusters in a few seconds, and the execution by a thousand simulated processes of an in situ workflow in less than three minutes.

Suter, Fred [ORNL] (ORCID:0000000319021955)↗

The role of remotely sensed and relayed data in the Delaware River Basin

A discussion is presented of the planned integration of the existing Delaware River Basin water quality monitoring and data processing systems with a data relay experiment proposed for the Earth Resources Technology Satellite (ERTS)-A, which will be launched in 1972. The experiment is designed to use ERTS-A as a data relay link for a maximum of 20 hydrologic stations in the basin, including streamgaging, reservoir level, ground water level,and water quality monitoring stations. This experiment has the potential for reducing the timelag between data collection and dissemination to less than 12 hours. At present there is a significant timelag between the time when the data are recorded at a monitoring site and the water resources agencies receive the data. The timelag exists because most of these instruments operate in remote locations without telementry, and the data records are removed manually, generally at a weekly frequency. For most water quality monitoring, the data do not reach water resources agencies for a period of 2 weeks to 2 months.

Paulson, R. W.↗