Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “community data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,225 records · Page 68

The QCECOR Value-Added Product: Quality-Controlled Eddy Correlation Flux Measurements

Eddy correlation flux (ECOR) measurement system stations are used by the U.S. Department of Energy Atmospheric Radiation Measurement (ARM) user facility to provide surface turbulence flux measurements. In recent years, ARM has significantly enhanced its ECOR systems and made them available at all its primary research observatories and mobile facilities. However, the original ECOR data were not corrected through common eddy correlation corrections and still contain suspicious data due to instrument and measurement uncertainties. Such uncertainties in the ECOR surface turbulence fluxes hampered their uses by the user community. To improve the ECOR data, we develop a value-added product (VAP) —the Quality-Controlled Eddy Correlation Flux (QCECOR) — by applying the following necessary corrections and quality control (QC) procedures: Eddy correlation corrections. Determination of the quality-controlled energy fluxes from the corrected ECOR fluxes. Stringent QC checks. Flagging possible incorrect fluxes due to hydrometeor impacts using the collocated surface energy balance system (SEBS) wetness measurements. The QCECOR VAP currently contains two variables: surface latent heat flux (LH) and sensible heat flux (SH), together with their QC flags. When SEBS are collocated with ECOR, the wetness measurements from SEBS are used to flag the LH that may be incorrect due to hydrometeors such as precipitation, dew, or frost. An indeterminate flag is given to those that fail the wetness test. The QCECOR data are currently available at the Southern Great Plains (SGP) atmospheric observatory for the ARM extended facilities of E1, E3, E5, E6, E10, E14, E16, E21, E24, E31, E33, E37, E38, E39, and E41 updated to 2018. The data are also available at the following AMF sites: PYE (Point Reyes, 2005), NIM (Niamey, Niger, 2006), FKB (Black Forest, Germany, 2007), HFE (Shouxian, China, 2008), GRW (Azores, 2009 to 2010), and MAO (Manacapuru, Brazil, 2014-2015). The algorithm is now in the process of moving to production mode. After that, QCECOR will run automatically for all available ARM sites.

47 OTHER INSTRUMENTATION↗

Probabilistic Modeling of Microbial Metabolic Networks for Integrating Partial Quantitative Knowledge Within the Nitrogen Cycle

Understanding the interactions between microbial communities and their environment sufficiently to predict diversity on the basis of physicochemical parameters is a fundamental pursuit of microbial ecology that still eludes us. However, modeling microbial communities is problematic, because (i) communities are complex, (ii) most descriptions are qualitative, and (iii) quantitative understanding of the way communities interact with their surroundings remains incomplete. One approach to overcoming such complications is the integration of partial qualitative and quantitative descriptions into more complex networks. Here we outline the development of a probabilistic framework, based on Event Transition Graph (ETG) theory, to predict microbial community structure across observed chemical data. Using reverse engineering, we derive probabilities from the ETG that accurately represent observations from experiments and predict putative constraints on communities within dynamic environments. These predictions can feedback into the future development of field experiments by emphasizing the most important functional reactions, and associated microbial strains, required to characterize microbial ecosystems.

59 BASIC BIOLOGICAL SCIENCES↗

Accelerating Clean Energy @ Scale

NREL helps translate community energy ambitions into actions. Rooted in inclusive community engagement, Accelerating Clean Energy @ Scale (ACES) brings together NREL’s experience, expertise, and capabilities to illuminate pathways for clean, affordable, equitable, secure, and resilient energy systems. Through customized, holistic modeling and analysis, we uncover insights and collaboratively develop strategies that address communities’ unique energy- system goals and diverse stakeholder priorities. NREL provides support in evaluating and implementing community-selected options, as well as assistance for workforce development.

accelerating clean energy scale analysis↗

Milwaukee Urban Development: Assessing the Drivers of Urban Flood Vulnerability in Milwaukee using the Integrated Valuation of Ecosystem Services and Tradeoffs Urban Flood Risk Mitigation Model (InVEST)

Milwaukee County has experienced an increase in flooding due to climate change and urbanization. The frequency and severity of flooding vary spatially due to differences in land cover, surface permeability, and infrastructure. Marginalized communities tend to experience disproportionately high flooding and damage due to infrastructural inequalities and limited access to resources. To quantify these differences, we used the Natural Capital Project’s Integrated Valuation of Ecosystem Services and Tradeoffs (InVEST) Urban Flood Risk Mitigation Model to calculate and create maps of runoff retention, nominal flood depth, and economic damage to buildings in Milwaukee. Our model inputs included land cover, surface permeability, and rainfall. To inform our precipitation inputs, we used NASA’s Integrated Multi-satellite Retrievals for Global Precipitation Measurement (GPM IMERG) and National Weather Service (NWS) data. We assessed the relationship between flood risk and social and environmental spatial data including redlining, racial demographics, greenspace, and community resilience. The data demonstrate that flood risk is higher in historically redlined neighborhoods, majority Hispanic and Black census block groups, areas that lack parks and trees, and areas of low community resilience as measured by the Census Bureau’s Community Resilience Estimates (CRE). These findings will support our partners, Groundwork Milwaukee and Groundwork USA, in their efforts to promote the equitable distribution of resources and support environmental health in urban spaces. The end products of this project provide our partners with tools to assess urban flooding vulnerability, guide future intervention projects, quantify the effects of environmental injustice, and improve stakeholder access to data.

Madeleine Tango↗

Milwaukee Urban Development: Assessing the Drivers of Urban Flooding Vulnerability in Milwaukee Using NASA Earth Observations

Milwaukee County has experienced an increase in flooding due to climate change and urbanization. The frequency and severity of flooding vary spatially due to differences in land cover, surface permeability, and infrastructure. Marginalized communities tend to experience disproportionately high flooding and damage due to infrastructural inequalities and limited access to resources. To quantify these differences, we used the Natural Capital Project’s Integrated Valuation of Ecosystem Services and Tradeoffs (InVEST) Urban Flood Risk Mitigation Model to calculate and create maps of runoff retention, nominal flood depth, and economic damage to buildings in Milwaukee. Our model inputs included land cover, surface permeability, and rainfall. To inform our precipitation inputs, we used NASA’s Integrated Multi-satellite Retrievals for Global Precipitation Measurement (GPM IMERG) and National Weather Service (NWS) data. We assessed the relationship between flood risk and social and environmental spatial data including redlining, racial demographics, greenspace, and community resilience. The data demonstrate that flood risk is higher in historically redlined neighborhoods, majority Hispanic and Black census block groups, areas that lack parks and trees, and areas of low community resilience as measured by the Census Bureau’s Community Resilience Estimates (CRE). These findings will support our partners, Groundwork Milwaukee and Groundwork USA, in their efforts to promote the equitable distribution of resources and support environmental health in urban spaces. The end products of this project provide our partners with tools to assess urban flooding vulnerability, guide future intervention projects, quantify the effects of environmental injustice, and improve stakeholder access to data.

Madeleine Tango↗

DOE FAIR Surrogate Benchmarks Supporting AI and Simulation Research (SBI Surrogate Benchmark Initiative) (Final Report)

Computational Science is being revolutionized by integrating AI and simulation and, in particular, by deep learning surrogate models that can replace all or part of traditional large‐scale HPC computations. Such surrogates can achieve remarkable performance improvements, as much as several orders of magnitude, and save both compute time and energy. The Surrogate Benchmark Initiative (SBI) project creates a community repository and FAIR (Findable, Accessible, Interoperable, and Reusable) data ecosystem for HPC application surrogate benchmarks. The SBI team comes from Argonne National Laboratory (ANL), Indiana University (IU), Rutgers University, the University of Tennessee, Knoxville (UTK), and the University of Virginia(UVA). SBI repositories include data, code, and all relevant collateral artifacts, that the science and engineering community needs to use and reuse these data sets and surrogates. SBI repositories generate active research from both participants in SBI and the broader AI and domain science communities. This project develops surrogates that use several different neural nets to learn and quickly infer the results of simulations and data systems and capture them as surrogate benchmarks with a rich set of metadata, covering. Data; Model; Metrics specification; Machine specification; Science, Speed, Power Results, We research FAIR metadata for these benchmarks. We develop application surrogate examples as benchmarks across many fields (ANL, UTK, IU, UVA). We also study non Surrogate benchmarks that have many common features and similar issues regarding FAIRness. We work with MLCommons (UVA, UTK), which is a major machine learning benchmarking activity where we get metadata ontologies, software, and benchmarks, benchmarks have datasets, models, and metadata, and they need a technical framework developed by UTK and Rutgers and deployed by UVA. We study features of Surrogates, including performance, training set size, and uncertainty quantification (Rutgers, UVA and IU).

97 MATHEMATICS AND COMPUTING↗

Assessing ecological risks to the fish community from residual coal fly ash in Watts Bar Reservoir, Tennessee

For this research, extensive site-specific biological and environmental data were collected to support an evaluation of risks to the fish community in Watts Bar Reservoir from residual ash from the December 2008 Tennessee Valley Authority (TVA) Kingston ash release. This paper describes the approach used and results of the risk assessment for the fish community, which consists of multiple measurement endpoints (measures of exposure and effects) for fish. The lines of evidence included 1) comparing postspill annual fish community assessments with nearby prespill data and data from other TVA reservoirs, 2) evaluating possible effects of exposures of fish eggs and larval fish to ash in controlled laboratory toxicity tests, 3) evaluating reproductive competence of field-exposed fish, 4) assessing individual fish health through physical examination, histopathology, and blood chemistry, 5) comparing fish tissue concentrations with literature-based critical body residues, and 6) comparing concentrations of ash-related contaminants in surface waters with US Environmental Protection Agency's (USEPA) Ambient Water Quality Standards for Fish and Aquatic Life. These measurement endpoints were treated as independent lines of evidence that were integrated into an overall weight-of-evidence estimate of risk to the fish community. Collectively, the data and analysis presented here indicate that ash and ash-related constituents pose negligible risks to the fish communities in Watts Bar Reservoir. This conclusion contradicts the predictions by some researchers immediately following the ash release of devastating effects on the aquatic ecology of Watts Bar Reservoir. The information presented in this article reaffirms the wisdom of carefully evaluating the evidence before predicting probable ecological effects of a major event such as the TVA Kingston ash release. Lastly, this study demonstrates that a thorough and detailed investigation using multiple measurement endpoints is needed to properly evaluate ecological effects.

54 ENVIRONMENTAL SCIENCES↗

Open Source Application of Fusing Aerosol Products from GEO and LEO Satellites

Retrieving aerosol optical depths (AODs) from sun-synchronous polar orbiting (aka low earth orbit, LEO) satellites, such as MODISs, and VIIRSs, OMI, TROPOMI, etc, has become well-established as a tool for extracting information on particulate matter (PM) and related processes in the atmosphere. However, with recently launched geostationary satellites (GEO), such as GOES-16/17/18, and Himawari-8/9, and Meteosat Third Generation (MTG) they provide a much higher temporal resolution (order of 10 minutes), typically an image once or more per hour during daylight compared to LEO once per day. By combining these observations, we may be able to characterize the diurnal cycle of global AOD at the local, regional and global scale. While the science community is still exploring the new data from GEO observations, we have been thinking about how to properly combine/merge/fuse those data considering differences in their spatial and temporal resolutions. However, this poses a “Big Data” challenge. The big data challenge is not just about data storage, but also about data discoverability, and accessibility, and even more, about data migration/mirroring in the cloud-computing environment. This paper is merely showing some of the efforts and approaches we have attempted in fusing six satellites’ Level 2 aerosol data (three are from GEO (GOES-16/17 and Himawari-8), and the other three are from LEO (TERRA/MODIS, AQUA/MODIS, SNPP-VIIRS) from Dark Target (DT) aerosol retrieval algorithm. Having the on-demand capability of fusing remote sensing products onto the desired temporal and spatial domain enables researchers and application practitioners to better manipulate and work with satellite and sensor data. It is our hopeWe hope that by making such an open-source package, and the accompanying functionality, the scientific community will be granted easier access to aerosol data processing resources. The MEaSUREs Program (Making Earth System Data Records for Use in Research Environments) expands our understanding of the Earth's current system through atmospheric and surface measurements. In an effort to aid the scientific research component and improve open source methods, this project developed Python code for fusing six satellite Level 2 aerosol data (three are from geostationary satellites (GEO), and the other three are from low earth orbital satellites (LEO)) from Dark Target Aerosol Retrieval Algorithm.

Jennifer Wei↗

Navigating Exascale Operational Data Analytics: From Inundation to Insight

In this paper, we address the challenges in achieving sustainable data-driven efficiency by providing a detailed exploration of the end-to-end operational data analytics (ODA) framework that evolved through two generations of supercomputer systems at the Oak Ridge Leadership Computing Facility (OLCF). This framework addresses large data streams ingested from heavily instrumented HPC environment that accumulates multi-terabytes per day. We outline the multifaceted data life cycle across HPC procurement, operations, and research & development, identifying key obstacles and design decisions that shape effective strategies in building and supporting data pipelines end-to-end. By sharing key insights and lessons learned from our experience, we offer recommendations for the HPC community on enabling sustainable operational data analytics and beyond. Our contributions aim to bridge the gap between potential and real benefits of operational data, guiding future efforts towards integrated and sustainable operational intelligence in high-performance computing environments.

Shin, Woong↗

OpenMP-style parallelism in data-centered multicore computing with R

R is a domain specific language widely used for data analysis by the statistics community as well as by researchers in finance, biology, social sciences, and many other disciplines. As R programs are linked to input data, the exponential growth of available data makes high-performance computing with R imperative. To ease the process of writing parallel programs in R, code transformation from a sequential program to a parallel version would bring much convenience to R users. In this paper, we present our work in semiautomatic parallelization of R codes with user-added OpenMPstyle pragmas. While such pragmas are used at the frontend, we take advantage of multiple parallel backends with different R packages. We provide flexibility for importing parallelism with plug-in components, impose built-in MapReduce for data processing, and also maintain code reusability. We illustrate the advantage of the on-the-fly mechanisms which can lead to significant applications in data-centered parallel computing.

Jiang, Lei↗

The NGEE Arctic Data Archive -- Portal for Archiving and Distributing Data and Documentation

The Next-Generation Ecosystem Experiments (NGEE Arctic) project is committed to implementing a rigorous and high-quality data management program. The goal is to implement innovative and cost-effective guidelines and tools for collecting, archiving, and sharing data within the project, the larger scientific community, and the public. The NGEE Arctic web site is the framework for implementing these data management and data sharing tools. The open sharing of NGEE Arctic data among project researchers, the broader scientific community, and the public is critical to meeting the scientific goals and objectives of the NGEE Arctic project and critical to advancing the mission of the Department of Energy (DOE), Office of Science, Biological and Environmental (BER) Terrestrial Ecosystem Science (TES) program.

Boden, Thomas A.↗

A universal language for finding mass spectrometry data patterns

Despite being information rich, the vast majority of untargeted mass spectrometry data are underutilized; most analytes are not used for downstream interpretation or reanalysis after publication. The inability to dive into these rich raw mass spectrometry datasets is due to the limited flexibility and scalability of existing software tools. Here, in this study, we introduce a new language, the Mass Spectrometry Query Language (MassQL), and an accompanying software ecosystem that addresses these issues by enabling the community to directly query mass spectrometry data with an expressive set of user-defined mass spectrometry patterns. Illustrated by real-world examples, MassQL provides a data-driven definition of chemical diversity by enabling the reanalysis of all public untargeted metabolomics data, empowering scientists across many disciplines to make new discoveries. MassQL has been widely implemented in multiple open-source and commercial mass spectrometry analysis tools, which enhances the ability, interoperability and reproducibility of mining of mass spectrometry data for the research community.

Damiani, Tito [Czech Academy of Sciences (CAS), Pr↗

Taming the Wild West: Assessing Impacts-Relevant Climate Data Products (Abbreviated Report)

Impacts-relevant Earth system data refers to observational and ESM data that are downscaled, debiased, validated, and provisioned for use by decision-makers. Impacts-relevant Earth system data is essential for mitigation and adaptation planning across a variety of regions and sectors. A vast number of these data products have emerged in recent years, which has led to confusion among stakeholders and scientists as to the best product to use. With no standard evaluation protocol available for these products, the decision on which product to use was sometimes made because it was pragmatic rather than the best product to use. This project sought to develop foundational capabilities around impacts-relevant data products that would support more informed selection and application of these products. This work has been immensely successful, driving several academic publications and supported the development of a community of practice around impacts-relevant data products. Over the project’s three years we have addressed six tasks: First, the development of standard evaluation metrics for impacts-relevant climate data; second, the development of a novel suite of atmospheric river metrics; third, the development of novel metrics for precipitation feature analysis; fourth, the development of novel metrics for assessing co-variances between temperature and precipitation; fifth, the development of a dashboard for interactive examination of impacts-relevant climate data; and sixth, the establishment of a community of practice around impacts-relevant climate data that will continue beyond the conclusion of this project.

54 ENVIRONMENTAL SCIENCES↗

Remote sensing of wetlands

Results are given for three separate investigations of remote sensing over wetlands, including the delineations of roseau cane and mangrove from both Landsat and aircraft MSS data, and the delineation of wetland communities for potential waste assimilation in a coastal river floodplain from Landsat MSS data only. Attention is also given to data processing and analysis techniques of varying levels of sophistication, which must increase with surface cover diversity. All computer processing in these studies was performed on a minicomputer configured with the adequate memory, image display capability, and associated peripherals, using state-of-the-art digital MSS data analysis software.

Butera, M. K.↗

CI Controls for Energy and Environment

Computational intelligence (CI) is a rapidly evolving field that utilizes life imitating metaphors for guiding model building including, but not limited to neural networks, fuzzy logic, genetic algorithms, artificial life, and hybrid CI paradigms. Although the boundaries between artificial intelligence (AI) and CI are not distinct, their research communities are separate and distinct. CI researchers tend to focus on processing numerical data from sensors, while the AI community generally relies on symbolic computing to capture human knowledge. In both areas, there is a great deal of interest and activity in hybrid systems that can offset the limitations of individual methods, extend their capabilities, and create new capabilities. Examples of the benefits that can accrue from hybrid systems are contained.

Biondo, Samuel J.↗

UAS Related Activities at NASA's Dryden Flight Research Center

NASA's Dryden Flight Research Center is completing its refurbishment and initial flights of one the pre-production Global Hawk aircraft it received from the U.S. Air Force. NASA Dryden has an agreement with the Global Hawk s manufacturer, Northrop Grumman, to partner in the refurbishment and flight operations of the vehicles. The National Oceanic and Atmospheric Administration (NOAA) has also partnered on the project and is assisting NASA with project management and pilot responsibilities for the aircraft. NASA and NOAA will be using the Global Hawks to conduct earth science research. The earth science community is increasing utilizing UAS of all sizes and capabilities to collect important data on a variety of issues including important global climate change issues. To pursue the data collection needs of the science community there is a growing demand for international collaboration with respect to operating UAS in global airspace. Operations of NASA s Ikhana aircraft continued this past year. The Ikhana is a modified Predator B UAS. A UAS dedicated to research at NASA Dryden is the X-48B blended wing body research aircraft. Flight tests with the 500- pound, remotely piloted test vehicle are now in a block 4 phase involving parameter identification and maneuvers to research the limits of the engine in stall situations. NASA s participation in the blended wing body research effort is focused on fundamental, advanced flight dynamics and structural design concepts within the Subsonic Fixed Wing project, part of the Fundamental Aeronautics program managed through NASA s Aeronautics Research Mission Directorate. Potential benefits of the aircraft include increased volume for carrying capacity, efficient aerodynamics for reduced fuel burn and possibly significant reductions in noise due to propulsion integration options. NASA Dryden continues to support the UAS industry by facilitating access to three specially designated test areas on Edwards Air Force Base for the development of small UAS.

Bauer, Jeffrey E.↗

Toward a Common Earth Data Publication Framework

Data publication is an essential activity for all data archives. Each of NASA's twelve Distributed Active Archive Centers (DAACs) have established publication workflows which account for the heterogeneous suite of missions, instruments, data providers, and datasets managed within the Earth Observation System Data and Information System (EOSDIS) program. Some aspects of data publication vary across DAACs: workflows range from manual to automatic, terms used to describe publication elements differ, and systems used to publish and manage data vary. Despite these differences, the DAAC data publication processes are generally the same: obtain the data and related information from data providers, describe the data with metadata and documentation, and release the data for access by the user community. In order to improve consistency and reduce the time required to publish data, we have developed a cross-DAAC initiative called the Common Earthdata Publication Framework (Earthdata Pub). Earthdata Pub seeks to: standardize communications and interactions with data providers; identify and standardize common workflows and steps in the data publication process; and design/implement a front-end system with features that include a common web interface, email & status tracking, and common application programming interfaces (APIs) to communicate with various DAAC-specific software components (services and applications) on the back-end. We will present the latest updates on this effort's progress and future plans.

data publication↗

MERRA-2 Data and Analytic Services at NASA GES DISC for Climate Extremes Study

NASA's climate reanalysis datasets from the Modern Era Retrospective-analysis for Research and Applications, Version 2 (MERRA-2) contains numerous long-term atmosphere, land, and ocean data products from 1980-present. MERRA-2 datasets, such as precipitation, soil moisture, and temperature, have been used widely to study extreme events. The native archived MERRA-2 data files are day-file (hourly time interval) and month-file, containing up to 125 parameters in one file. Due to the large number of data files and volumes, it is challenging for users, especially the applications research community, to handle the original hourly data files for long time periods to analyze extreme events. In this presentation, we review MERRA-2 data for studies of extreme conditions, and demonstrate analytic services at the NASA Goddard Earth Sciences Data and Information Services Center (GES DISC). One of the current operational services, 'subsetter', allows users to download only specific data of interest, i.e. data selected by parameter, region, and time period. New services are under development that will provide more 'on-the-fly' statistical calculations when downloading data; improve efficiency when accessing long time-series data. We will provide additional "How-to" resources that include step-by-step instructions on data access and usage. We have tested restructuring of day-files in an optimized data cube, which has significantly improved system performance for accessing long time-series. Overall performance is associated with cube size and structure, data compression method, and how the data are accessed. The optimized data cube structure will enable better online analytic services for statistical analysis and extreme events mining. To demonstrate the service, we use an extreme drought associated with the anomalous 2016 monsoon over southern Asia. This prototype time-series service may be augmented in the cloud infrastructure in the future.

data access↗