SEARCH · Engineering Papers

Results for “resource data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,171 records · Page 65

All sources NASA NTRS DOE OSTI

NASA NTRS1975

Cropland acreage estimates from temporal, multispectral ERTS-1 data

Temporal, multispectral Earth Resources Technology Satellite (ERTS-1) images as pertinent to cropland acreage estimates are illustrated and discussed. A cropland classifier is described that evaluates approximately registered, temporal, and multispectral digital ERTS-1 data acquired over a 14 section test site in central Iowa during 1973. Satellite-derived acreage estimates are compared with estimates derived from low-level images. Discrepancies between these estimates are discussed. Satellite coverage critically timed with a crop development calendar is noted to improve classifier effectiveness.

Carlson, R. E.↗

DOE OSTI2019

pnnl/metagenomic_analysis

Metagenomic analysis is a computationally intensive task, this problem is compounded when many hundreds of samples need to be analyzed. We needed a program that would process the metagenomic sequencing data, manage computing resources, and combine the results into a unified output. We developed a script that prepares raw metagenomic sequencing data for analysis, configures analysis parameters, launches analysis jobs, keeps track of analysis progress, and combines analysis output. The analysis itself itself is done by the functionality provided by mothur (https://www.mothur.org/).

Avila, Andrew↗

DOE OSTI2013

Gap Assessment (FY 13 Update)

To help guide its future data collection efforts, The DOE GTO funded a data gap analysis in FY2012 to identify high potential hydrothermal areas where critical data are needed. This analysis was updated in FY2013 and the resulting datasets are represented by this metadata. The original process was published in FY 2012 and is available here: https://pangea.stanford.edu/ERE/db/GeoConf/papers/SGW/2013/Esposito.pdf Though there are many types of data that can be used for hydrothermal exploration, five types of exploration data were targeted for this analysis. These data types were selected for their regional reconnaissance potential, and include many of the primary exploration techniques currently used by the geothermal industry. The data types include: 1. well data 2. geologic maps 3. fault maps 4. geochemistry data 5. geophysical data To determine data coverage, metadata for exploration data (including data type, data status, and coverage information) were collected and catalogued from nodes on the National Geothermal Data System (NGDS). It is the intention of this analysis that the data be updated from this source in a semi-automated fashion as new datasets are added to the NGDS nodes. In addition to this upload, an online tool was developed to allow all geothermal data providers to access this assessment and to directly add metadata themselves and view the results of the analysis via maps of data coverage in Geothermal Prospector (http://maps.nrel.gov/gt_prospector). A grid of the contiguous U.S. was created with 88,000 10-km by 10-km grid cells, and each cell was populated with the status of data availability corresponding to the five data types. Using these five data coverage maps and the USGS Resource Potential Map, sites were identified for future data collection efforts. These sites signify both that the USGS has indicated high favorability of occurrence of geothermal resources and that data gaps exist. The uploaded data are contained in two data files for each data category. The first file contains the grid and is in the SHP file format (shape file.) Each populated grid cell represents a 10k area within which data is known to exist. The second file is a CSV (comma separated value) file that contains all of the individual layers that intersected with the grid. This CSV can be joined with the map to retrieve a list of datasets that are available at any given site. The attributes in the CSV include: 1. grid_id : The id of the grid cell that the data intersects with 2. title: This represents the name of the WFS service that intersected with this grid cell 3. abstract: This represents the description of the WFS service that intersected with this grid cell 4. gap_type: This represents the category of data availability that these data fall within. As the current processing is pulling data from NGDS, this category universally represents data that are available in the NGDS and are ready for acquisition for analytic purposes. 5. proprietary_type: Whether the data are considered proprietary 6. service_type: The type of service 7. base_url: The service URL

15 GEOTHERMAL ENERGY↗

DOE OSTI2016

Optimization of tomographic reconstruction workflows on geographically distributed resources

New technological advancements in synchrotron light sources enable data acquisitions at unprecedented levels. This emergent trend affects not only the size of the generated data but also the need for larger computational resources. Although beamline scientists and users have access to local computational resources, these are typically limited and can result in extended execution times. Applications that are based on iterative processing as in tomographic reconstruction methods require high-performance compute clusters for timely analysis of data. Here, time-sensitive analysis and processing of Advanced Photon Source data on geographically distributed resources are focused on. Two main challenges are considered: (i) modeling of the performance of tomographic reconstruction workflows and (ii) transparent execution of these workflows on distributed resources. For the former, three main stages are considered: (i) data transfer between storage and computational resources, (i) wait/queue time of reconstruction jobs at compute resources, and (iii) computation of reconstruction tasks. These performance models allow evaluation and estimation of the execution time of any given iterative tomographic reconstruction workflow that runs on geographically distributed resources. For the latter challenge, a workflow management system is built, which can automate the execution of workflows and minimize the user interaction with the underlying infrastructure. The system utilizes Globus to perform secure and efficient data transfer operations. The proposed models and the workflow management system are evaluated by using three high-performance computing and two storage resources, all of which are geographically distributed. Workflows were created with different computational requirements using two compute-intensive tomographic reconstruction algorithms. Experimental evaluation shows that the proposed models and system can be used for selecting the optimum resources, which in turn can provide up to 3.13× speedup (on experimented resources). Furthermore, the error rates of the models range between 2.1 and 23.3% (considering workflow execution times), where the accuracy of the model estimations increases with higher computational demands in reconstruction tasks.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

NASA NTRS1985

Evaluation of Thematic Mapper data for mapping forest, agricultural and soil resources

Color composite TM film products which include TM5, TM4, and a visible band (TM1, TM2, or TM3) are superior to composites which exclude TM4 for discriminating most forest and agricultural cover types and estimating area proportions for inventory and sampling purposes. Clustering a subset of TM data results in a spectral class map which groups diverse forest cover types into spectrally and ecologically similar areas suitable for use as a stratification base in traditional forest inventory practices. Analysis of simulated Thematic Mapper data indicate that the location and number of TM spectral bands are suitable for detecting differences in major soil properties and characterizing soil spectral curve form and magnitude.

Degloria, S.↗

DOE OSTI2022

Can machine learning accelerate process understanding and decision‐relevant predictions of river water quality?

Abstract The global decline of water quality in rivers and streams has resulted in a pressing need to design new watershed management strategies. Water quality can be affected by multiple stressors including population growth, land use change, global warming, and extreme events, with repercussions on human and ecosystem health. A scientific understanding of factors affecting riverine water quality and predictions at local to regional scales, and at sub‐daily to decadal timescales are needed for optimal management of watersheds and river basins. Here, we discuss how machine learning (ML) can enable development of more accurate, computationally tractable, and scalable models for analysis and predictions of river water quality. We review relevant state‐of‐the art applications of ML for water quality models and discuss opportunities to improve the use of ML with emerging computational and mathematical methods for model selection, hyperparameter optimization, incorporating process knowledge into ML models, improving explainablity, uncertainty quantification, and model‐data integration. We then present considerations for using ML to address water quality problems given their scale and complexity, available data and computational resources, and stakeholder needs. When combined with decades of process understanding, interdisciplinary advances in knowledge‐guided ML, information theory, data integration, and analytics can help address fundamental science questions and enable decision‐relevant predictions of riverine water quality.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2017

Exploring the Use of Activity Patterns for Smart Monitoring of Nuclear Facilities

The world is at an inflection point where our ability to collect data now far outpaces our ability to make use of it. LANL has a number of efforts to help us pull more meaningful insights out of our data and target resources to where they will be most impactful. We are exploring an approach to recognizing activity patterns across disparate data streams for a more holistic view of nuclear facility monitoring.

97 MATHEMATICS AND COMPUTING↗

NASA NTRS1983

Analysis of the quality of image data acquired by the LANDSAT-4 thematic mapper and multispectral scanners

Image products and numeric data were extracted from both TM and MSS data in an effort to evaluate the quality of these data for interpreting major agricultural resources and conditions in California's Central Valley. The utility of TM data appears excellent for meeting most of the inventory objectives of the agricultural resource specialist. These data should be extremely valuable for crop type and area proportion estimation, for updating agricultural land use survey maps at 1:24,000-scale and smaller, for field boundary definition, and for determining the size and location of individual farmsteads.

Colwell, R. N.↗

NASA NTRSDate not supplied

Resources at GES DISC for Agriculture Studies

● Introduction to GES DISC (Distributed Active Archive Center- DAAC) ○ Data Holding for Agriculture study ● Resources for Agricultural studies at GES DISC ○ Data Access ○ Data Services and Tools ○ Learning resources : ■ Studying seasonality ■ Studying extreme events: Floods, Flash Floods, Heat Waves, Drought ■ Data Recipe (How-To) ● Demo and hands-on

Zhong Liu↗

NASA NTRS2011

An Integrated Hydrological and Water Management Study of the Entire Nile River System - Lake Victoria to Nile Delta

The Nile basin River system spans 3 million km(exp 2) distributed over ten nations. The eight upstream riparian nations, Ethiopia, Eretria, Uganda, Rwanda, Burundi, Congo, Tanzania and Kenya are the source of approximately 86% of the water inputs to the Nile, while the two downstream riparian countries Sudan and Egypt, presently rely on the river's flow for most of the their needs. Both climate and agriculture contribute to the complicated nature of Nile River management: precipitation in the headwaters regions of Ethiopia and Lake Victoria is variable on a seasonal and inter-annual basis, while demand for irrigation water in the arid downstream region is consistently high. The Nile is, perhaps, one of the most difficult trans-boundary water issue in the world, and this study would be the first initiative to combine NASA satellite observations with the hydrologic models study the overall water balance in a to comprehensive manner. The cornerstone application of NASA's Earth Science Research Results under this project are the NASA Land Data Assimilation System (LDAS) and the USDA Atmosphere-land Exchange Inverse (ALEXI) model. These two complementary research results are methodologically independent methods for using NASA observations to support water resource analysis in data poor regions. Where an LDAS uses multiple sources of satellite data to inform prognostic simulations of hydrological process, ALEXI diagnoses evapotranspiration and water stress on the basis of thermal infrared satellite imagery. Specifically, this work integrates NASA Land Data Assimilation systems into the water management decision support systems that member countries of the Nile Basin Initiative (NBI) and Regional Center for Mapping of Resources for Development (RCMRD, located in Nairobi, Kenya) use in water resource analysis, agricultural planning, and acute drought response to support sustainable development of Nile Basin water resources. The project is motivated by the recognition that accurate, frequent, and spatially distributed estimates of the water balance are necessary for effective water management. This creates a challenge for watersheds that are large, include data poor regions, and/or span multiple nations. All of these descriptors apply to the Nile River basin, yet successful management of the Nile is critical for development and political stability in the region. For this reason, improved hydrological data to support cooperative water management in the Nile basin is a priority for USAID, the US State Department, the World Bank and other international organizations. In this project, the U.S. based research team is working with partners at RCMRD, Nile Basin Initiative (NBI), and their member national-level agencies to develop satellite-based land cover maps, satellite-derived evapotranspiration estimates (using the ALEXI algorithm), and NASA's Land Data Assimilation System (LDAS) customized to match identified information needs. The cornerstone applied sciences product of the project is the development of a customized "Nile LDAS" that will produce optimal estimates of hydrological states and fluxes, as vetted against the in situ observations of NBI and RCMRD member organizations and independent satellite-derived hydrological estimates. Nile LDAS will be applied to improve the reliability of emerging Decision Support Systems in applications that include drought monitoring, reservoir management, and irrigation planning. The end-users such as RCMRD, NBI, Ethiopian and Kenya Meteorological and Famine Early Warning System Network (FEWSNet) will be the eventual benefactors of this work. There will be a capacity building process involving the above end-user organizations and transfer the models and the results for these organizations to execute for future use. The team has already initiated this study and the early results of first years' work are shown. The plan is to complete this work by late 2013.

Habib, Shahid↗

DOE OSTI2020

ML Track Fitting in Nuclear Physics

Charged particle tracking represents the largest consumer of CPU resources in high data volume Nuclear Physics (NP) experiments. An effort is underway to develop machine learning (ML) networks that will reduce the resources required for charged particle tracking. Tracking in NP experiments represent some unique challenges compared to high energy physics (HEP). In particular, track finding typically represents only a small fraction of the overall tracking problem in NP. This presentation will outline the differences and similarities between NP and HEP charged particle tracking and areas where ML learning may provide a benefit. The status of the specific effort taking place at Jefferson Lab will also be shown.

Britton, Thomas↗

DOE OSTI2022

"Way more than a donut and a PowerPoint": Women agricultural landowner learning circles and conservation outreach

Women’s conservation learning circles were designed to address the barriers facing women agricultural landowners, and have been shown to benefit these landowners in multiple ways. But how the resource professionals involved in the learning circle outreach method view the method is as of yet unknown. We use interview data from 35 resource professionals, including those from the Natural Resources Conservation Service and Soil and Water Conservation District to gain insight on their views of the learning circle outreach method. Our findings reveal some of the ways these resource professionals believe these meetings were successful, what they liked most, and what they believe could be improved. Overall, we identify how this outreach method has broad implications for resource professionals in helping work with groups where the traditional modes of conveying information (e.g., lecture formats and male-dominated meetings) are not well suited.

54 ENVIRONMENTAL SCIENCES↗

NASA NTRS1972

Satellite observations of temporal terrestrial features

The application of satellite data to earth resources and environmental studies and the effects of resolution of the photographs and imagery are discussed. The nature of the data acquired by manned space flight and unmanned satellites is described. Specific applications of remotely sensed data for oceanography, hydrology, geography, and geology are examined.

Rabchevsky, G. A.↗

NASA NTRS1992

Utilization of Space Station Freedom for technology research

Space Station Freedom presents a unique opportunity for technology developers to conduct research in the space environment. Research can be conducted in the pressurized volume of the Space Station's laboratories or attached to the Space Station truss in the vacuum of space. Technology developers, represented by the Office of Aeronautics and Space Technology (OAST), will have 12 percent of the available Space Station resources (volume, power, data, crew, etc.) to use for their research. Most technologies can benefit from research on Space Station Freedom and all these technologies are represented in the OAST proposed traffic model. This traffic model consists of experiments that have been proposed by technology developers but not necessarily selected for flight. Experiments to be flown in space will be selected through an Announcement of Opportunity (A.O.) process. The A.O. is expected to be released in August, 1992. Experiments will generally fall into one of the 3 following categories: (1) Individual technology experiments; (2) Instrumented Space Station; and (3) Guest investigator program. The individual technology experiments are those that do not instrument the Space Station nor directly relate to the development of technologies for evolution of Space Station or development of advanced space platforms. The Instrumented Space Station category is similar to the Orbiter Experiments Program and allows the technology developer to instrument subsystems on the Station or develop instrumentation packages that measure products or processes of the Space Station for the advancement of space platform technologies. The guest investigator program allows the user to request data from Space Station or other experiments for independent research. When developing an experiment, a developer should consider all the resources and infrastructure that Space Station Freedom can provide and take advantage of these to the maximum extent possible. Things like environment, accommodations, carriers, and integration should all be taken into account. In developing experiments at Langley Research Center, an iterative approach is proving useful. This approach uses Space Station utilization and subsystem experts to advise and critique experiment designs to take advantage of everything the Space Station has to offer. Also, solid object modeling and animation computer tools are used to fully visualize the experiment and its processes. This process is very useful for attached payloads and allows problems to be detected early in the experiment design phase.

Avery, Don E.↗

DOE OSTI2016

High Energy Physics Exascale Requirements Review. An Office of Science review sponsored jointly by Advanced Scientific Computing Research and High Energy Physics, June 10-12, 2015, Bethesda, Maryland

The U.S. Department of Energy (DOE) Office of Science (SC) Offices of High Energy Physics (HEP) and Advanced Scientific Computing Research (ASCR) convened a programmatic Exascale Requirements Review on June 10–12, 2015, in Bethesda, Maryland. This report summarizes the findings, results, and recommendations derived from that meeting. The high-level findings and observations are as follows. Larger, more capable computing and data facilities are needed to support HEP science goals in all three frontiers: Energy, Intensity, and Cosmic. The expected scale of the demand at the 2025 timescale is at least two orders of magnitude — and in some cases greater — than that available currently. The growth rate of data produced by simulations is overwhelming the current ability of both facilities and researchers to store and analyze it. Additional resources and new techniques for data analysis are urgently needed. Data rates and volumes from experimental facilities are also straining the current HEP infrastructure in its ability to store and analyze large and complex data volumes. Appropriately configured leadership-class facilities can play a transformational role in enabling scientific discovery from these datasets. A close integration of high-performance computing (HPC) simulation and data analysis will greatly aid in interpreting the results of HEP experiments. Such an integration will minimize data movement and facilitate interdependent workflows. Long-range planning between HEP and ASCR will be required to meet HEP’s research needs. To best use ASCR HPC resources, the experimental HEP program needs (1) an established, long-term plan for access to ASCR computational and data resources, (2) the ability to map workflows to HPC resources, (3) the ability for ASCR facilities to accommodate workflows run by collaborations potentially comprising thousands of individual members, (4) to transition codes to the next-generation HPC platforms that will be available at ASCR facilities, (5) to build up and train a workforce capable of developing and using simulations and analysis to support HEP scientific research on next-generation systems.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2017

ASCR/HEP Exascale Requirements Review Report

This draft report summarizes and details the findings, results, and recommendations derived from the ASCR/HEP Exascale Requirements Review meeting held in June, 2015. The main conclusions are as follows. 1) Larger, more capable computing and data facilities are needed to support HEP science goals in all three frontiers: Energy, Intensity, and Cosmic. The expected scale of the demand at the 2025 timescale is at least two orders of magnitude -- and in some cases greater -- than that available currently. 2) The growth rate of data produced by simulations is overwhelming the current ability, of both facilities and researchers, to store and analyze it. Additional resources and new techniques for data analysis are urgently needed. 3) Data rates and volumes from HEP experimental facilities are also straining the ability to store and analyze large and complex data volumes. Appropriately configured leadership-class facilities can play a transformational role in enabling scientific discovery from these datasets. 4) A close integration of HPC simulation and data analysis will aid greatly in interpreting results from HEP experiments. Such an integration will minimize data movement and facilitate interdependent workflows. 5) Long-range planning between HEP and ASCR will be required to meet HEP's research needs. To best use ASCR HPC resources the experimental HEP program needs a) an established long-term plan for access to ASCR computational and data resources, b) an ability to map workflows onto HPC resources, c) the ability for ASCR facilities to accommodate workflows run by collaborations that can have thousands of individual members, d) to transition codes to the next-generation HPC platforms that will be available at ASCR facilities, e) to build up and train a workforce capable of developing and using simulations and analysis to support HEP scientific research on next-generation systems.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2016

ASCR/HEP Exascale Requirements Review Report

Habib, Salman↗

DOE OSTI2011

End-to-End Network QoS via Scheduling of Flexible Resource Reservation Requests

Modern data-intensive applications move vast amounts of data between multiple locations around the world. To enable predictable and reliable data transfer, next generation networks allow such applications to reserve network resources for exclusive use. In this paper, we solve an important problem (called SMR3) to accommodate multiple and concurrent network reservation requests between a pair of end-sites. Given the varying availability of bandwidth within the network, our goal is to accommodate as many reservation requests as possible while minimizing the total time needed to complete the data transfers. We first prove that SMR3 is an NP-hard problem. Then we solve it by developing a polynomial-time heuristic, called RRA. The RRA algorithm hinges on an efficient mechanism to accommodate large number of requests by minimizing the bandwidth wastage. Finally, via numerical results, we show that RRA constructs schedules that accommodate significantly larger number of requests compared to other, seemingly efficient, heuristics.

97 MATHEMATICS AND COMPUTING↗