Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Scientific Data Management”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,027 records · Page 57

Implementing the GEOSS Water Strategy: From Observations to Decisions

In 2014, The GEOSS Water Strategy – From Observations to Decisions was published and steps were taken to implement the Strategy’s recommendations. The Strategy highlighted priority areas where the application of Earth observations to water research and water management decisions would have significant scientific and societal benefits. This article reviews the implementation of the Strategy’s recommendations over the past eight years. After a review of the Strategy’s assessment of the needs for water observations and their applications, it then reviews actions taken in response to the Strategy’s recommendations in its four major themes: improved data acquisition for Essential Water Variables, research and product development, interoperability, and capacity development. It highlights significant achievements in the implementation of the Strategy including some motivated by factors beyond this Strategy, reviews actions taken by participating agencies and programs for each of the main themes and summarizes the remaining challenges in achieving the Strategy’s full implementation. The article not only is an update for the Water Community regarding the GEOSS Water Strategy, but it is also an example of how other communities could develop and promulgate a set of strategic recommendations, monitor progress, and carry out assessments of their effectiveness.

Earth observations↗

Using GTO-Velo to Facilitate Communication and Sharing of Simulation Results in Support of the Geothermal Technologies Office Code Comparison Study

The Geothermal Technologies Office Code Comparison Study (GTO-CCS) aims to support the DOE Geothermal Technologies Office in organizing and executing a model comparison activity. This project is directed at testing, diagnosing differences, and demonstrating modeling capabilities of a worldwide collection of numerical simulators for evaluating geothermal technologies. Teams of researchers are collaborating in this code comparison effort, and it is important to be able to share results in a forum where technical discussions can easily take place without requiring teams to travel to a common location. Pacific Northwest National Laboratory has developed an open-source, flexible framework called Velo that provides a knowledge management infrastructure and tools to support modeling and simulation for a variety of types of projects in a number of scientific domains. GTO-Velo is a customized version of the Velo Framework that is being used as the collaborative tool in support of the GTO-CCS project. Velo is designed around a novel integration of a collaborative Web-based environment and a scalable enterprise Content Management System (CMS). The underlying framework provides a flexible and unstructured data storage system that allows for easy upload of files that can be in any format. Data files are organized in hierarchical folders and each folder and each file has a corresponding wiki page for metadata. The user interacts with Velo through a web browser based wiki technology, providing the benefit of familiarity and ease of use. High-level folders have been defined in GTO-Velo for the benchmark problem descriptions, descriptions of simulator/code capabilities, a project notebook, and folders for participating teams. Each team has a subfolder with write access limited only to the team members, where they can upload their simulation results. The GTO-CCS participants are charged with defining the benchmark problems for the study, and as each GTO-CCS Benchmark problem is defined, the problem creator can provide a description using a template on the metadata page corresponding to the benchmark problem folder. Project documents, references and videos of the weekly online meetings are shared via GTO-Velo. A results comparison tool allows users to plot their uploaded simulation results on the fly, along with those of other teams, to facilitate weekly discussions of the benchmark problem results being generated by the teams. GTO-Velo is an invaluable tool providing the project coordinators and team members with a framework for collaboration among geographically dispersed organizations.

Collaborative Tools↗

OPEN-Augmented Reality GUI for Bioenergy Crop Phenotyping and Precision Agriculture (Donald Danforth Plant Science Center Final Scientific Technical Report)

The project led by the Donald Danforth Plant Science Center, in collaboration with Arizona State University, George Washington University, and Saint Louis University, has made significant strides in advancing the phenotypic analysis of bioenergy crops through the development of an innovative AI processing pipeline. This initiative was primarily funded by ARPA-E, with additional cost-sharing provided by the participating institutions. The project successfully utilized a variety of sensors—3D scanners, thermal, RGB, and hyperspectral—to refine algorithms for data-driven trait signature identification and improve the classification and visualization of plant traits. The developed AI processing pipeline is capable of handling the complex, multidimensional data characteristic of dynamic agricultural environments. 1) Contributions to understanding: The research has advanced the field of plant phenomics by showcasing the synergistic use of various sensor data to enhance the precision of trait analysis in bioenergy crops. Through the integration of 3D scanners, thermal, RGB, and hyperspectral sensors, the project has developed robust data-driven trait signature algorithms and visualization techniques. These innovations have facilitated detailed monitoring and management of plant traits, providing vital insights into plant growth dynamics and stress responses. Further, the project has broadened our understanding of how machine learning can be effectively applied in multi-sensor environments to refine trait analysis. By leveraging diverse datasets, the research has not only improved the accuracy of phenotypic assessments but also established a versatile methodological framework that can be extended beyond agriculture to other fields requiring detailed phenotypic analysis. 2) Technical effectiveness and economic feasibility: The AI processing pipeline developed in this project demonstrated significant technical effectiveness, achieving high throughput analysis of extensive phenotypic data and meeting targeted accuracies. This system exemplified the capability of advanced machine learning technologies to efficiently manage and analyze large, complex datasets. Economically, the implementation of the project-developed pipelines may offer substantial cost savings across multiple sectors. It enhances data analysis processes and significantly reduces the need for manual data interpretation, thereby decreasing both the time and resources required. 3) Public benefit: The project has significantly broadened the scope of agricultural methodologies to enhance phenotypic analysis, with potential applications in various sectors beyond agriculture. Additionally, the initiative fostered an enriching educational and collaborative environment, significantly enhancing the technical skills of participants. It also made substantial contributions to the scientific community by providing open-access data sets and tools, encouraging ongoing research and development across various disciplines. Overall, the project not only met its scientific goals but also showcased the extensive utility of integrating advanced machine learning and sensor data analysis technologies. These advancements have proven instrumental in driving forward both theoretical research and practical applications, setting a strong foundation for future explorations and innovations in data-driven science.

60 APPLIED LIFE SCIENCES↗

Science Capsule - Capturing the Data Life Cycle

The data generated from scientific workflows often become unusable due to the lack or incompleteness of information required for processing and analyzing the data. Reproducibility of scientific data and workflows facilitates efficient processing and analyses. A key to enabling reproducibility is to capture the end-to-end workflow life cycle, and any contextual metadata and provenance.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

Interactions among bioenergy feedstock choices, landscape dynamics, and land use

Landscape implications of bioenergy feedstock choices are significant and depend on land-use practices and their environmental impacts. Although land-use changes and carbon emissions associated with bioenergy feedstock production are dynamic and complicated, lignocellulosic feedstocks may offer opportunities that enhance sustainability when compared to other transportation fuel alternatives. For bioenergy sustainability, major drivers and concerns revolve around energy security, food production, land productivity, soil carbon and erosion, greenhouse gas emissions, biodiversity, air quality, and water quantity and quality. The many implications of bioenergy feedstock choices require several indicators at multiple scales to provide a more complete accounting of effects. Ultimately, the long-term sustainability of bioenergy feedstock resources (as well as food supplies) throughout the world depends on land-use practices and landscape dynamics. Land-management decisions often invoke trade-offs among potential environmental effects and social and economic factors as well as future opportunities for resource use. The hypothesis being addressed in this paper is that sustainability of bioenergy feedstock production can be achieved via appropriately designed crop residue and perennial lignocellulosic systems. We find that decision makers need scientific advancements and adequate data that both provide quantitative and qualitative measures of the effects of bioenergy feedstock choices at different spatial and temporal scales and allow fair comparisons among available options for renewable liquid fuels.

54 ENVIRONMENTAL SCIENCES↗

ENZYME ACTIVITY PROBE AND GEOCHEMICAL ASSESSMENT FOR POTENTIAL AEROBIC COMETABOLISM OF TRICHLOROETHENE IN GROUNDWATER OF THE NORTHWEST PLUME, PADUCAH GASEOUS DIFFUSION PLANT, KENTUCKY

The overarching objective of the Paducah Gaseous Diffusion Plant (PGDP) enzyme activity probe (EAP) effort is to determine if aerobic cometabolism is contributing to the attenuation of trichloroethene (TCE) and other chlorinated solvents in the contaminated groundwater beneath PGDP. The site-specific objective for the EAP assessment is to identify if key metabolic pathways are present and expressed in the microbial community--namely the pathways that are responsible for degradation of methane and aromatic (e.g. toluene, benzene, phenol) substrates. The enzymes produced to degrade methane and aromatic compounds also break down TCE through a process known as cometabolism. EAPs directly measure if methane and/or aromatic enzyme production pathways are operating and, for the aromatic pathways, provide an estimate of the number of active organisms in the sampled groundwater. This study in the groundwater plumes at PGDP is a major part of a larger scientific effort being conducted by Interstate Technology and Regulatory Council (ITRC), U.S. Department of Energy (DOE) Office of Environmental Management (EM), Savannah River National Laboratory (SRNL), and North Wind Inc. in which EAPs are being applied to contaminated groundwater from diverse hydrogeologic and plume settings throughout the U.S. to help standardize their application as well as their interpretation. While EAP data provide key information to support the site specific objective for PGDP, several additional lines of evidence are being evaluated to increase confidence in the determination of the occurrence of biodegradation and the rate and sustainability of aerobic cometabolism. These complementary efforts include: (1) Examination of plume flowpaths and comparison of TCE behavior to 'conservative' tracers in the plume (e.g., {sup 99}Tc); (2) Evaluation of geochemical conditions throughout the plume; and (3) Evaluation of stable isotopes in the contaminants and their daughter products throughout the plume. If the multiple lines of evidence support the occurrence of cometabolism and the potential for the process to contribute to temporal and spatial attenuation of TCE in PGDP groundwater, then a follow-up enzyme probe microcosm study to better estimate biological degradation rate(s) is warranted.

03 NATURAL GAS↗

NASA/ESA CV-990 Spacelab Simulation (ASSESS 2)

Cost effective techniques for addressing management and operational activities on Spacelab were identified and analyzed during a ten day NASA-ESA cooperative mission with payload and flight responsibilities handled by the organization assigned for early Spacelabs. Topics discussed include: (1) management concepts and interface relationships; (2) experiment selection; (3) hardware development; (4) payload integration and checkout; (5) selection and training of mission specialists and payload specialists; (6) mission control center/payload operations control center interactions with ground and flight problems; (7) real time interaction during flight between principal investigators and the mission specialist/payload specialist flight crew; and (8) retrieval of scientific data and its analysis.

Source record↗

Earth resources: A continuing bibliography, issue 46

This bibliography lists 467 reports, articles and other documents introdcued into the NASA scientific and technical information system between April 1 and June 30, 1985. Emphasis is placed on the use of remote sensing and geophysical instrumentation in spacecraft and aircraft to survey and inventory natural resources and urban areas. Subject matter is grouped according to agriculture and forestry, environmental cultural resources geodesy and cartography, geology and mineral resources, hydrology and water management, data processing and distribution systems, instrumentation and sensors, and economical analysis.

Source record↗

The Telecommunications and Data Acquisition Report

Archival reports on developments in programs managed by the Jet Propulsion Laboratory's (JPL's) Office of Telecommunications and Data Acquisition (TDA) are published in the TDA Progress Report. In the search for extraterrestrial intelligence (SETI), the TDA Progress Report reports on implementation and operations for searching the microwave spectrum. In solar system radar, it reports on the uses of the Goldstone Solar System Radar for scientific exploration of the planets, their rings and satellites, asteroids, and comets. In radio astronomy, the areas of support include spectroscopy, very long baseline interferometry, and astrometry. These three programs are performed for NASA's Office of Space Science and Applications (OSSA), with the Office of Space Operations funding DSN operational support.

Posner, Edward C.↗

Implementing Strategic Planning Capabilities Within the Mars Relay Operations Service

Since the Mars Exploration Rovers (MER), Spirit and Opportunity, began their travels across the Martian surface in January of 2004, orbiting spacecraft such as the Mars 2001 Odyssey orbiter have relayed the majority of their collected scientific and operational data to and from Earth. From the beginning of those missions, it was evident that using orbiters to relay data to and from the surface of Mars was a vastly more efficient communications strategy in terms of power consumption and bandwidth compared to direct-to-Earth means. However, the coordination between the various spacecraft, which are largely managed independently and on differing commanding timelines, has always proven to be a challenge. Until recently, the ground operators of all these spacecraft have coordinated the movement of data through this network using a collection of ad hoc human interfaces and various, independent software tools. The Mars Relay Operations Service (MaROS) has been developed to manage the evolving needs of the Mars relay network, and specifically to standardize and integrate the relay planning and coordination data into a centralized infrastructure. This paper explores the journey of developing the MaROS system, from inception to delivery and acceptance by the Mars mission users.

tactical planning↗

Cassini Information Management System in Distributed Operations Collaboration and Cassini Science Planning

Launched on October 15, 1997, the Cassini-Huygens spacecraft began its ambitious journey to the Saturnian system with a complex suite of 12 scientific instruments, and another 6 instruments aboard the European Space Agencies Huygens Probe. Over the next 6 1/2 years, Cassini would continue its relatively simplistic cruise phase operations, flying past Venus, Earth, and Jupiter. However, following Saturn Orbit Insertion (SOI), Cassini would become involved in a complex series of tasks that required detailed resource management, distributed operations collaboration, and a data base for capturing science objectives. Collectively, these needs were met through a web-based software tool designed to help with the Cassini uplink process and ultimately used to generate more robust sequences for spacecraft operations. In 2001, in conjunction with the Southwest Research Institute (SwRI) and later Venustar Software and Engineering Inc., the Cassini Information Management System (CIMS) was released which enabled the Cassini spacecraft and science planning teams to perform complex information management and team collaboration between scientists and engineers in 17 countries. Originally tailored to help manage the science planning uplink process, CIMS has been actively evolving since its inception to meet the changing and growing needs of the Cassini uplink team and effectively reduce mission risk through a series of resource management validation algorithms. These algorithms have been implemented in the web-based software tool to identify potential sequence conflicts early in the science planning process. CIMS mitigates these sequence conflicts through identification of timing incongruities, pointing inconsistencies, flight rule violations, data volume issues, and by assisting in Deep Space Network (DSN) coverage analysis. In preparation for extended mission operations, CIMS has also evolved further to assist in the planning and coordination of the dual playback redundancy of highvalue data from targets such as Titan and Enceladus. This paper will outline the critical role that CIMS has played for Cassini in the distributed ops paradigm throughout operations. This paper will also examine the evolution that CIMS has undergone in the face of new science discoveries and fluctuating operational needs. And finally, this paper will conclude with theoretical adaptation of CIMS for other projects and the potential savings in cost and risk reduction that could potentially be tapped into by future missions.

Equils, Douglas J.↗

NASA Open Science Data Repository: Open Science for Life in Space

Space biology and health data are critical for the success of deep space missions and sustainable human presence off-world. At the core of effectively managing biomedical risks is the commitment to open science principles, which ensure that data are findable, accessible, interoperable, reusable, reproducible and maximally open. The 2021 integration of the Ames Life Sciences Data Archive with GeneLab to establish the NASA Open Science Data Repository significantly enhanced access to a wide range of life sciences, biomedical-clinical, and mission telemetry data alongside existing ‘omics data from GeneLab. This paper describes the new database, its architecture, and new data streams supporting diverse data types and enhancing data submission, retrieval, and analysis. Features include the Biological Data Management Environment for improved data submission, a new user interface, controlled data access, an enhanced API, and comprehensive public visualization tools for environmental telemetry, radiation dosimetry data, and ‘omics analyses. By fostering global collaboration through its Analysis Working Groups and training programs, the Open Science Data Repository promotes widespread engagement in space biology, ensuring transparency and inclusivity in research. It supports the global scientific community in advancing our understanding of spaceflight's impact on biological systems, ensuring humans will thrive in future deep space missions.

OSDR↗

Reducing the Impacts of Hydroelectric Dams on Juvenile Anadromous Fishes: Bioengineering Evaluations Using Acoustic Imaging in the Columbia River, USA

Dams impact the survival of juvenile anadromous fishes by obstructing migration corridors, lowering water quality, delaying migrations, and entraining fish in turbine discharge. To reduce these impacts, structural and operational modifications to dams— such as voluntary spill discharge, turbine intake guidance screens, and surface flow outlets—are instituted. Over the last six years, we have used acoustic imaging technology to evaluate the effects of these modifications on fish behavior, passage rates, entrainment zones, and fish/flow relationships at hydroelectric projects on the Columbia River. The imaging technique has evolved from studies documenting simple movement patterns to automated tracking of images to merging and analysis with concurrent hydraulic data. This chapter chronicles this evolution and shows how the information gleaned from the scientific evaluations has been applied to improve passage conditions for juvenile salmonids. We present data from Bonneville and The Dalles dams that document fish behavior and entrainment zones at sluiceway outlets (14 to 142 m3/s), fish passage rates through a gap at a turbine intake screen, and the relationship between fish swimming effort and hydraulic conditions. Dam operators and fisheries managers have applied these data to support decisions on operational and structural changes to the dams for the benefit of anadromous fish populations in the Columbia River basin.

13 HYDRO ENERGY↗

Cloud Bursting with GlideinWMS: Means to satisfy ever increasing computing needs for Scientific Workflows

Scientific communities have been in the forefront of adopting new technologies and methodologies in the computing. Scientific computing has influenced how science is done today, achieving breakthroughs that were impossible to achieve several decades ago. For the past decade several such communities in the Open Science Grid (OSG) and the European Grid Infrastructure (EGI) have been using GlideinWMS to run complex application workflows to effectively share computational resources over the grid. GlideinWMS is a pilot-based workload management system (WMS) that creates on demand, a dynamically sized overlay HTCondor batch system on grid resources. At present, the computational resources shared over the grid are just adequate to sustain the computing needs. We envision that the complexity of the science driven by 'Big Data' will further push the need for computational resources. To fulfill their increasing demands and/or to run specialized workflows, some of the big communities like CMS are investigating the use of cloud computing as Infrastructure-As-A-Service (IAAS) with GlideinWMS as a potential alternative to fill the void. Similarly, communities with no previous access to computing resources can use GlideinWMS to setup up a batch system on the cloud infrastructure. To enable this, the architecture of GlideinWMS has been extended to enable support for interfacing GlideinWMS with different Scientific and commercial cloud providers like HLT, FutureGrid, FermiCloud and Amazon EC2. In this paper, we describe a solution for cloud bursting with GlideinWMS. The paper describes the approach, architectural changes and lessons learned while enabling support for cloud infrastructures in GlideinWMS.

Mhashilkar, Parag↗

Software-defined network for end-to-end networked science at the exascale

Domain science applications and workflow processes are currently forced to view the network as an opaque infrastructure into which they inject data and hope that it emerges at the destination with an acceptable Quality of Experience. There is little ability for applications to interact with the network to exchange information, negotiate performance parameters, discover expected performance metrics, or receive status/troubleshooting information in real time. The work presented here is motivated by a vision for a new smart network and smart application ecosystem that will provide a more deterministic and interactive environment for domain science workflows. The Software-Defined Network for End-to-end Networked Science at Exascale (SENSE) system includes a model-based architecture, implementation, and deployment which enables automated end- to-end network service instantiation across administrative domains. An intent based interface allows applications to express their high-level service requirements, an intelligent orchestrator and resource control systems allow for custom tailoring of scalability and real-time responsiveness based on individual application and infrastructure operator requirements. This allows the science applications to manage the network as a first-class schedulable resource as is the current practice for instruments, compute, and storage systems. Deployment and experiments on production networks and testbeds have validated SENSE functions and performance. Emulation based testing verified the scalability needed to support research and education infrastructures. Key contributions of this work include an architecture definition, reference implementation, and deployment. This provides the basis for further innovation of smart network services to accelerate scientific discovery in the era of big data, cloud computing, machine learning and artificial intelligence.

47 OTHER INSTRUMENTATION↗

Puget Sound Operational Forecast System - A Real-time Predictive Tool for Marine Resource Management and Emergency Responses

To support marine ecological resource management and emergency response and to enhance scientific understanding of physical and biogeochemical processes in Puget Sound, a real-time Puget Sound Operational Forecast System (PS-OFS) was developed by the Coastal Ocean Dynamics & Ecosystem Modeling group (CODEM) of Pacific Northwest National Laboratory (PNNL). PS-OFS employs the state-of-the-art three-dimensional coastal ocean model and closely follows the standards and procedures established by National Oceanic and Atmospheric Administration (NOAA) National Ocean Service (NOS). PS-OFS consists of four key components supporting the Puget Sound Circulation and Transport Model (PS-CTM): data acquisition, model execution and product archive, model skill assessment, and model results dissemination. This paper provides an overview of PS-OFS and its ability to provide vital real-time oceanographic information to the Puget Sound community. PS-OFS supports pacific northwest region’s growing need for a predictive tool to assist water quality management, fish stock recovery efforts, maritime emergency response, nearshore land-use planning, and the challenge of climate change and sea level rise impacts. The structure of PS-OFS and examples of the system inputs and outputs, forecast results are presented in details.

54 ENVIRONMENTAL SCIENCES↗

Software-Defined Network for End-to-end Networked Science at the Exascale

Domain science applications and workflow processes are currently forced to view the network as an opaque infrastructure into which they inject data and hope that it emerges at the destination with an acceptable Quality of Experience. There is little ability for applications to interact with the network to exchange information, negotiate performance parameters, discover expected performance metrics, or receive status/troubleshooting information in real time. The work we presen here is motivated by a vision for a new smart network and smart application ecosystem that will provide a more deterministic and interactive environment for domain science workflows. The Software-Defined Network for End-to-end Networked Science at Exascale (SENSE) system includes a model-based architecture, implementation, and deployment which enables automated end-to-end network service instantiation across administrative domains. An intent based interface allows applications to express their high-level service requirements, an intelligent orchestrator and resource control systems allow for custom tailoring of scalability and real-time responsiveness based on individual application and infrastructure operator requirements. This allows the science applications to manage the network as a first-class schedulable resource as is the current practice for instruments, compute, and storage systems. Deployment and experiments on production networks and testbeds have validated SENSE functions and performance. Emulation based testing verified the scalability needed to support research and education infrastructures. Key contributions of this work include an architecture definition, reference implementation, and deployment. This provides the basis for further innovation of smart network services to accelerate scientific discovery in the era of big data, cloud computing, machine learning and artificial intelligence.

97 MATHEMATICS AND COMPUTING↗

Nuclear Energy Infrastructure Database Description and User’s Manual

In 2014, the Deputy Assistant Secretary for Science and Technology Innovation initiated the Nuclear Energy (NE)–Infrastructure Management Project by tasking the Nuclear Science User Facilities, formerly the Advanced Test Reactor National Scientific User Facility, to create a searchable and interactive database of all pertinent NE-supported and -related infrastructure. This database, known as the Nuclear Energy Infrastructure Database (NEID), is used for analyses to establish needs, redundancies, efficiencies, distributions, etc., to best understand the utility of NE’s infrastructure and inform the content of infrastructure calls. The Nuclear Science User Facilities developed the database by utilizing data and policy direction from a variety of reports from the U.S. Department of Energy, the National Research Council, the International Atomic Energy Agency, and various other federal and civilian resources. The NEID currently contains data on 802 research and development instruments housed in 377 facilities at 84 institutions in the United States and abroad. The effort to maintain and expand the database is ongoing. Detailed information on many facilities must be gathered from associated institutions and added to complete the database. The data must be validated and kept current to capture facility and instrumentation status as well as to cover new acquisitions and retirements. This document provides a short tutorial on the navigation of the NEID web portal at NSUF-Infrastructure.INL.gov.

42 ENGINEERING↗