Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Geospatial analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8
All sourcesNASA NTRSDOE OSTI
NASA NTRS2019

NASA GES DISC Giovanni: Current and Future

Giovanni (Geospatial Interactive Online Visualization and Analysis Infrastructure), developed by the NASA Goddard Earth Sciences Data and Information Services Center (GES DISC), has established a reputation among NASA users for easy access, analysis, and visualization of NASA Earth science data. Currently, Giovanni supports over 1900 variables in eight disciplinary areas. Like any other enterprise application, Giovanni faces big data challenges, such as servicing increasingly large data volumes and more complex data types, while at the same time addressing the demands of a more diverse user community, e.g., placing requests for long-term time series from multiple spatially and temporally dense data records. I will present how Giovanni has been evolving from an on-premises, monolithic software application towards a cloud-enabled implementation to address these challenges.

Analytics↗
NASA NTRS2019

New Era, New Opportunity, Is GES DISC Ready for Big Data Challenge?

The new era of Big Data has opened doors for many new opportunities, as well as new challenges, for both Earth science research/application and data communities. As one of the twelve NASA data centers - Goddard Earth Sciences Data and Information Services Center (GES DISC), one of our great challenges has been how to help research/application community efficiently (quickly and properly) accessing, visualizing and analyzing the massive and diverse data in natural hazard research, management, or even prediction. GES DISC has archived over 2000 TB data on premises and distributed over 23,000 TB of data since 2010. Our data has been widely used in every phase of natural hazard management and research, i.e. long term risk assessment and reduction, forecasting and predicting, monitoring and detection, early warning, damage assessment and response. The big data challenge is not just about data storage, but also about data discoverability and accessibility, and even more, about data migration/mirroring in the cloud. This paper is going to demonstrate GES DISC’s efforts and approaches of evolving our overall Web services and powerful Giovanni (Geospatial Interactive Online Visualization ANd aNalysis Infrastructure) tool into further improving data discoverability and accessibility. Prototype works will also be presented.

Li, A.↗
NASA NTRS2019

Cloud Giovanni: Reining in Costs and Improving Performance with Analytical Data Stores Using Scalable Serverless Architecture

Giovanni is the Geospatial Interactive Online Visualization ANd aNalysis Infrastructure developed at NASA GES DISC which provides a simple and intuitive way to visualize, analyze, and access vast amounts of Earth science data. It receives large number of user requests each day for a variety of analysis and visualization services, which leads to the big data challenge of serving gradually increasing large data volumes with diverse statistical algorithms. We hereby propose a multi-dimensional accumulation method which provides fast and cost-efficient cloud analysis for diverse services including both area averaging and time averaging. This method involves the weighted volume integration over multiple variable dimensions (time and space), and is implemented in AWS using Athena providing serverless and highly scalable data analysis. Compared to the standard method, this approach dramatically reduced the computational time by order of magnitude with a minimal AWS cost incurred. For example, for a benchmark of 10-year area averaging over the 1x1 degree daily variable, the computational time was reduced from minutes to seconds, and the Athena cost is only $5 for 100,000 requests.

Zhang, Hailiang↗
NASA NTRSDate not supplied

"Giovanni at 20: Consistency and Persistency in Making Earth Remote Sensing Data Available (and Useful) to the Earth Science Community"

Since its creation in the year 2000, the NASA Geospatial Interactive Online Visualization ANd aNalysis Infrastructure (Giovanni) has been an exemplar of how to provide remotely-sensed satellite data and related Earth science datasets to a broad and globally diverse researcher community. One of the hallmarks of Giovanni system usage is that it is common to see practitioners of many branches of science – particularly those in fields not traditionally associated with remote-sensing data, such as animal behavior and paleooceanography – both accessing and employing datasets which the system provides. This usage pattern is attested to by the diversity of published science citing Giovanni. Giovanni has evolved through several versions, each of which increased analytical and visualization options while also enhancing ease-of-use. Information resources supporting Giovanni from the Goddard Earth Sciences Data and Information Services Center (GES DISC), which hosts the system, start with basic mapping and plotting functions and extend to “How-to” recipes demonstrating interusability with other data analysis systems and software. Giovanni is now being developed for use in a cloud environment, potentially expanding datasets the system can be applied to, and also improving performance for data having high spatial and temporal resolution. This presentation covers the system’s historical success with interesting examples of Giovanni-citing research, and will apply its current capabilities to a multi-dataset examination of derecho events associated with mesoscale convective phenomena in the summer of 2020, indicating how Giovanni is prepared for ongoing support of Earth science in a changing world.

Giovanni Derecho visualization↗
NASA NTRSDate not supplied

Examining 18 Years of Journal Publications to Characterize Usage Modes of Giovanni, a Versatile Earth Science Data Web Service

Introduction to Giovanni (Geospatial Interactive Online Visualization ANd aNalysis Infrastructure) Giovanni … is a Web-based visualization and analysis system that provides 22 different visualization and analysis options, operating on thousands of Earth science data variables generated by satellite instrument observations and from related model datasets Giovanni … was originally conceived as a data exploration tool, but its ease-of-use, analytical capabilities (spatial and temporal subsetting, multi-period averaging, data mapping and time-series, and more) have led to its use as a multi-discipline research tool Giovanni … provided unprecedented access to NASA Earth science data for many different disciplines, AND is still providing a simple way to find, analyze, visualize, and utilize such data for a wide spectrum of research topics

James Acker↗
NASA NTRSDate not supplied

Hydrological Data at the NASA GES DISC: Current Capabilities and New Opportunities

The NASA Goddard Earth Sciences Data and Information Services Center (GES DISC) is one of twelve NASA Earth science data centers that document, process, archive and distribute data from Earth observation missions and projects. GES DISC maintains an archive of several hydrology datasets, including the Land Data Assimilation Systems (LDAS) and the Gravity Recovery and Climate Experiment (GRACE) Data Assimilation for Drought Monitoring (GRACE-DA-DM) data products. These datasets include model output of heat fluxes, rain, snow, soil temperature, soil moisture, and runoff; and observational forcing data, including surface pressure, temperature, precipitation, downward shortwave and longwave radiation, humidity, and wind. The temporal resolution of the hydrology data at GES DISC ranges from hourly to monthly, and spatial resolutions range from 0.1° to 1.0°. The GES DISC provides services which enable users to aggregate, temporally and spatially subset, regrid, and visualize archived data including the GES DISC Subsetter, Hydrology Data Rods, and the Geospatial Interactive Online Visualization and Analysis Infrastructure (GIOVANNI). The Hydrology Data Rods service optimally reorganizes large hydrological data sets as extended time series, providing more efficient access for the hydrological community. The time series data (aka “data rods”) were integrated into hydrology community tools, such as the Data Rods Explorer on HydroShare. Furthermore, the GES DISC is in the process of migrating its data and services to the cloud. Hydrological data available at the GES DISC are now available in the Amazon Web Services (AWS) cloud (us-west-2 region) providing users Direct S3 data access and the capability for cloud computing operations. In this presentation, the hydrology data products and services currently available at the GES DISC will be summarized. Also discussed are the migration to the cloud, user support through this transition, and the status of migrating the data rods service to the cloud.

Ashley Heath↗
NASA NTRSDate not supplied

NASA Giovanni: Analyze, Compare, and Visualize 2000+ Earth Satellite and Model Variables Without Downloading Data and Software

Over vast oceans and remote continents, observations are often scarce and discontinuous. Satellite and model data play a critical role in research and applications. However, finding and accessing satellite and model data can be a daunting task for many, especially those outside the community. The NASA Goddard Earth Sciences (GES) Data and Information Services Center (DISC), one of 12 NASA Science Mission Directorate Data Centers, provides Earth science data, information, and services to everyone such as researchers, application users, educators, and students. GES DISC archives and supports datasets applicable to several NASA Earth Science Focus Areas including Atmospheric Composition, Water & Energy Cycles, Carbon Cycle & Ecosystem, and Climate Variability. To facilitate data discovery, evaluation, and exploration, GES DISC has developed the Geospatial Interactive Online Visualization ANd aNalysis Infrastructure (Giovanni), an online tool to analyze and visualize NASA remote sensing and model data without downloading data and software. As of this writing, over 2000 Earth satellite and model variables are available in Giovanni, including several wellknown NASA satellite missions (e.g., TRMM, GPM) and projects (e.g., MERRA-2, GPCP). Giovanni provides twenty-two plots that can be used to analyze, compare, and explore Earth data across different disciplines. Results can be shared with colleagues and downloaded for further analysis. Over the years, Giovanni has helped publish over 3000 referral papers. In this presentation, we will showcase key variables and plot types in Giovanni with examples. In particular, we will present several popular precipitation products from GPM and CPCP for evaluation and comparison.

data analysis↗
NASA NTRSDate not supplied

Data Integrity Challenges in NASA Giovanni

The Geospatial Interactive Online Visualization ANd aNalysis Infrastructure (Giovanni) is an online tool developed by the NASA Goddard Earth Sciences (GES) Data and Information Services Center (DISC), one of 12 NASA Science Mission Directorate Data Centers (DAACs) to analyze and visualize NASA remote sensing and model data without downloading data and software. As of this writing, over 2000 Earth satellite and model variables are available in Giovanni, including several well-known NASA satellite missions (e.g., TRMM, GPM) and projects (e.g., MERRA-2, GPCP). There are twenty-two plots provided by Giovanni that can be used to analyze, compare, and explore Earth data across disciplines. Results can be shared with colleagues and downloaded for further analysis. Giovanni has helped publish over 3000 referral papers over the years. As open science policies roll in, data integrity has become a major challenge for Giovanni and other tools. For integrity, both data and workflows must be transparent. FAIR-compliant data, including input, intermediate, and result products, as well as their associated statistics, metadata, and information, are needed. The NASA Data Product Development Guide for Data Producers provides a key resource on how to develop FAIR-compliant data products. Data quality information is also needed from data producers and analysis services like Giovanni. The workflow part is quite challenging and requires workflow management improvements, such as recording workflows and making them available to users. In this presentation, we will discuss the data integrity challenges in Giovanni.

data analysis, visualization↗
NASA NTRSDate not supplied

Data Democratization: Challenges and Opportunities

Democratizing Earth data is one of the challenges many organizations around the world face in order to maximize the use of their Earth data for research, applications, education, and societal benefits. For example, at the NASA Goddard Earth Sciences (GES) Data and Information Services Center (DISC), over 1600 global and regional datasets in several NASA Earth science focus areas, including atmospheric composition, water and energy cycles, and climate variability, are archived and distributed to the public. Giovanni, the Geospatial Interactive Online Visualization and Analysis Infrastructure, was developed by GES DISC to facilitate data access and exploration, especially for novice users of Earth science. With Giovanni, users can analyze and visualize over 2000 Earth science variables (e.g., precipitation, aerosol, surface wind) without downloading data, software, the expert understanding of data formats and structures, and coding skills, lowering the barrier to data analysis/comparison by preprocessing and accessing to the data. Results of data analysis and visualization can be accessed in several popular formats (e.g., NetCDF, CSV). As a result of Giovanni's efforts, more than 3000 referral papers have been published in various fields. In spite of this, Giovanni is still difficult to use for some users. For instance, if one searches for "precipitation," it will return over 150 related variables. The question is, which one to use? Furthermore, variables from different data providers (e.g., satellites and models) are named differently with different units, further confusing users, especially those outside the communities. Data democratization is complex and multifaceted. Challenges include service and data discovery, user experiences, visualization, data quality, trustworthiness, and more. In this presentation, we will examine Giovanni as an example of challenges and opportunities in developing data democratization services.

data democratization↗
DOE OSTI2025

Data from: 'Abiotic influences on continuous conifer forest structure across a subalpine watershed'

This package archives the core data used for analysis and inference in 'Abiotic influences on continuous conifer forest structure across a subalpine watershed' (Worsham et al., 2025). All data were collected in the East River, Washington Gulch, Slate River, and Coal Creek watersheds of Colorado. In the paper, we quantified the relative influence of climate, topographic, edaphic, and geologic factors on conifer stand structure and composition, and their functional relationships, at the watershed scale. We used waveform LiDAR data to derive spatially continuous stand structure metrics. We fused these with a species-level classification map to estimate tree species abundance. We applied generalized additive and generalized boosted models to evaluate the covariability of structural and compositional metrics with abiotic variables. The package contains the essential products required for reproducing our analysis and the tables and figures reported in the publication. The products comprise four classes: (1) geospatial data, (2) tabular data used for inferential analysis, (3) tabular data describing analytical results and performance statistics, and (4) a data user guide. (1) includes discretized waveform LiDAR data, locations and attributes of individual tree crowns, sampling locations and domain boundaries, a canopy height model, and raster files of estimated forest structural and compositional metrics at 100 m grid scale. (2) includes all response and explanatory variable values applied in inferential models. Response variables include conifer forest stand density, basal area, 95th percentile height, quadratic mean diameter, and others. Explanatory variables include climatic water deficit, actual evapotranspiration, elevation, heat load, soil available water content, and others. (3) includes results of training and testing several individual tree detection (ITD) algorithms, as well as inferential modeling results. (4) is a PDF user guide for this data package, including detailed descriptions and data dictionaries for all files. The data package root contains 17 assets: 8 compressed tape archive (.tar.gz) files, 5 comma-separated values (.csv) files, 3 Geographic Tagged Image File Format (GeoTIFF) (.tif) files, and 1 Portable Document Format (.pdf) file. The compressed .tar.gz archives contain ESRI shapefiles (.shp) .tif, compressed LASer (.laz), and .csv files. The archives must first be decompressed using the widely distributed command-line software utility TAR. All other files, including constituent files within the .tar.gz archives, can be opened in the open-source R statistical computing environment. Alternatively, .csv files may also be read in any simple text editor software or Microsoft Excel. Geospatial files including .shp and .tif files can also be opened in GIS software, such as QGIS (open-source) or ESRI ArcGIS (proprietary). The .pdf Data User Guide can be read with Adobe Acrobat Reader or other compatible readers.

2018 NEON and 2025 CHESS Campaigns↗
NASA NTRS1999

Introduction to this Special Issue on Geostatistics and Scaling of Remote Sensing

The germination of this special PE&RS issue began at the Royal Geographical Society (with the Institute of British Geographers)(RCS-IBC) annual meeting in January, 1997 held at the University of Exeter in Exeter, England. The cold and snow of an England winter were greatly tempered by the friendly and cordial discussions that ensued at the meeting on possible ways to foster both dialog and research across "the Big Pond" between geographers in the US and the UK on the use of geostatistics and geospatial techniques for remote sensing of land surface processes. It was decided that one way to stimulate and enhance cooperation on the application of geostatistics and geospatial methods in remote sensing was to hold parallel sessions on these topics at appropriate meeting venues in 1998 in both the US and the UK Selected papers given at these sessions would be published as a special issue of PE&RS on the US side, and as a special issue of Computers and Geosciences (C&G) on the UK side, to highlight the commonality in research on geostatistics and geospatial methods in remote sensing and spatial data analysis on both sides of the Atlantic Ocean. As a consequence, a session on "Ceostatistics and Geospatial Techniques for Remote Sensing of Land Surface Processes" was held at the Association of American Geographers (AAG) annual meeting in Boston, Massachusetts in March, 1998, sponsored by the AAG's Remote Sensing Specialty Group (RSSG). A similar session was held at the RGS-IBG annual meeting in Guildford, Surrey, England in January 1998, organized by the Modeling and Advanced Techniques Special Interest Group (MAT SIG) of the Remote Sensing Society (RSS). The six papers that in part, comprise this issue of PE&RS, are the US complement to such a dual journal publication effort. Both of us are co-editors of each of the journal special issues, with the lead editor of each journal being from their respective side of the Atlantic where the journals are published. The special issue of C&G that constitutes the other half of this co-edited journal series will be published in early 1999, with 3 papers by US authors being published along with 6 papers authored by individuals from the UK and other places in Europe.

Quattrochi, Dale A.↗
DOE OSTI2025

Evaluating opportunity for distributed wind energy in rural and agricultural areas

Wind energy is among the most mature renewable energy technologies, accounting for 11% of the current US electricity generation in 2024, with the lowest average levelized cost. While it is known that substantial opportunity exists for further development, a key question has been where wind energy is best suited compared to other technologies. This study leverages an immense dataset of parcel-resolved technoeconomic potential for the contiguous United States, focusing on distributed wind (DW) energy—a configuration where one or more turbines, typically 30–60 m in height are used to satisfy nearby energy needs. The analysis is conducted at multiple spatial scales and considers land use, crop land, census, and incentive program data to determine the most opportune areas for market development. The results show that rural, agricultural and residential areas are most suited to DW. Connection type (in front of, or behind the meter) and regulations determine the best application, while siting constraints, economics, demand and the wind resource determines the optimal size of turbine.

17 WIND ENERGY↗
DOE OSTI2022

Verification and Validation of START: A Spent Nuclear Fuel Routing and Decision Support Tool

The Stakeholder Tool for Assessing Radioactive Transportation (START) is a web-based geospatial decision-support tool being developed by the US Department of Energy’s Office of Integrated Waste Management (IWM) to support federal interim storage for spent nuclear fuel (SNF) and associated transportation. START provides many functions for the IWM program including: serving as a communications tool for conveying geospatial data and information, an options analysis tool for exploring potential transport modes and routes for transporting SNF from nuclear power plants to future federal interim storage facilities, an emergency response planning tool for Tribes and States to identify training needs along potential SNF transport corridors, an environmental analysis tool for estimating potential radiation dose exposure from incident-free and incident-case SNF transport conditions, and a systems analysis support tool providing route-related inputs for system throughput analysis. As part of the START development process, a verification and validation (V&V) effort is being undertaken. In the initial V&V phase, several outputs of the START tool were checked such as the total distance, population and population densities within the buffer zone, and incident free dose. The V&V process is fluid as it will be utilized after each version change to ensure that the core functionalities of the tool are maintained and the results are consistent with the previous versions. Efforts have also been put into developing scripts to aid in the process of automating certain sections of the V&V work. As some of the V&V efforts use Environmental Systems Research Institute’s (ESRI) tools upon which the START framework is built, the START data were compared against outputs from tools like Quantum Geographic Information System (QGIS) for buffer zone populations and route lengths to ensure independence of the V&V process. Good agreement was observed between the START results and the independent V&V studies with the majority of the differences falling between 1% and 5% for populations within the buffer zone and route distance. This presentation describes the development and design of the START tool, V&V methods employed for various metrics of interest and their respective results, and future plans.

START, transportation, GIS, V&V↗
DOE OSTI2021

Accelerating Clean Energy @Scale: Place-Based Solutions

Customized, holistic energy modeling and analysis is conducted across a wide range of geospatial scales -- from global to local. We will describe the value and importance of local, place-based solutions, particularly, how scientific insights, decision support, and technical assistance based on integrated, customized modeling and analysis, and in-depth stakeholder engagement can assist communities in translating their ambitions into implementable action plans.

clean energy↗
DOE OSTI2022

Closed Loop Pumped Storage Hydropower Resource Assessment of the United States

The data includes a geospatial and spreadsheet representation of a resource analysis for closed loop pumped storage systems across the Continental United States, Alaska, Hawaii, and Puerto Rico. The data includes energy storage potential, water volume, distance from source to storage, hydraulic head, dollars per kilowatt of storage, and transmission spurline cost for each pumped storage hydropower (PHS) reservoir. Each reservoir represented in this dataset is represented on potential 10 hour storage duration PSH system comprised of two reservoirs. Units of measure are laid out in the dataset. Pumped storage hydropower (PSH) represents the bulk of the United States' current energy storage capacity: 23 gigawatts (GW) of the 24 GW national total (Denholm et al. 2021). This capacity was largely built between 1960 and 1990. PSH is a mature and proven method of energy storage with competitive round-trip efficiency and long life spans. These qualities make PSH a very attractive potential solution to energy storage needs, particularly for longer-duration storage (8 hours or more); such storage will be crucial to bridge gaps in electricity production as variable wind and solar production continue to comprise an ever-larger portion of the United States' energy portfolio. This study seeks to better understand the technical potential for PSH development in the United States by developing a national-scale resource assessment for closed-loop PSH. For more information, please refer to the Closed Loop Pumped Storage Hydropower Resource Assessment for the United States linked in the resources.

Array↗
DOE OSTI2023

Enabling residential heating decarbonization through hydronic low-temperature thermal distribution using forced-air assistive devices

Space heating represents approximately one-tenth of the United States’ energy use and has a breadth of potential for emission reduction. An element of space heating, hydronic heat distribution methods, use water supply temperatures up to 82.2 °C (180 °F). However, this operating temperature can be incompatible with high-efficiency heat generation systems, which typically provide heating temperatures of up to 60 °C (140 °F). In this work, a low-cost retrofit solution is developed using experimentally validated computational tools by incorporating an airflow distributor that preferentially directs the airflow from a fan to enhance heat transfer over the finned-tube heat exchanger found in conventional baseboards. The same heat output of traditional baseboard heat distribution systems operating at higher water supply temperatures (71.1 – 82.2 °C) can also be achieved at lower temperatures (≤60 °C). Specifically, results indicate that the technology can produce more than a 46.7% improvement in the heat transfer output at temperatures as low as 60 °C (140 °F), effectively matching the same output range achieved by 71.1 – 82.2 °C (160–180 °F) water supply temperatures. An important benefit of this solution is that it utilizes the existing infrastructure as opposed to requiring the replacement of the entire distribution system. Additionally, this technology enables existing building infrastructure to be coupled with newer, high-efficiency heating systems such as condensing boilers, solar-thermal systems, and geothermal/air-to-water heat pumps that may produce lower water supply temperatures (60 °C). A geospatially resolved techno-economic and environmental analysis is completed and presented to further understand the equivalent carbon footprint of enabling higher efficiency heat generation systems with the improved efficiency heat distribution system disclosed. Using 2021 grid-average emission factors, an emission reduction of up to a 67.5% decrease (2658 kgCO 2 /yr) for a single-family home, depending on state and climate region, could be realized by replacing a traditional natural gas-fired boiler with an air-to-water heat pump coupled to the same high-temperature heat distribution system along with the low-cost retrofit solution. A complete CO 2 emission reduction of 6688 kgCO 2 /yr, depending on state and climate region, could be realized if all electricity is further renewably sourced. Thus, this study provides a possible pathway towards enabling the reduction of operational emissions in space heating.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2023

Impact of system parameters and geospatial variables on the reliability of residential systems with PV and energy storage

A reliable power supply is the foundation of modern society, enabling technologies used to function within a society. Residential systems are places where the end users directly consume power, enabling technologies to sustain life. With the emergence of behind-the-meter resources, the end-users have some control over power supply reliability. The intermittency and variability of these resources impact residential system reliability. In this work, we study the reliability performance of a grid-supplemented residential system with behind-the-meter Distributed Energy Resources(DER) subject to various system parameters and geospatial variables. We propose a multistate reliability model for the behind-the-meter microinverter-based Photo Voltaic (PV) system and integrated inverter-based energy storage (ES) system. A sequential Monte Carlo method is then presented to evaluate the reliability indices for the residential system with behind-the-meter DERs as the main supply and the grid as the backup. The sequential Monte Carlo method is used to analyze the reliability performance of the residential model at the top 100 populous counties of the United States, where actual load and solar irradiance data at the counties is used. In the analysis, the sensitivity of indices to system parameters such as DER size and the sensitivity of the indices to climate zone and gross horizontal irradiation (GHI), which affects the load conditions and the PV output of the residential system, is performed. The analysis results show that the system parameters and the geospatial variables significantly impact the residential system’s reliability. The insights from this analysis will be of immense value to the distribution system planners to provide zone-specific guidelines for DER system sizing and toward the evolution of utility business models. Finally, the methodology developed can be used to extend the analysis to other locations.

14 SOLAR ENERGY↗
DOE OSTI2022

Optimizing Error-Bounded Lossy Compression for Scientific Data With Diverse Constraints

Vast volumes of data are produced by today's scientific simulations and advanced instruments. These data cannot be stored and transferred efficiently because of limited I/O bandwidth, network speed, and storage capacity. Error-bounded lossy compression can be an effective method for addressing these issues: not only can it significantly reduce data size, but it can also control the data distortion based on user-defined error bounds. In practice, many scientific applications have specific requirements or constraints for lossy compression, in order to guarantee that the reconstructed data are valid for post hoc analysis. For example, some datasets contain irrelevant data that should be isolated in particular and users often have intuition regarding value ranges, geospatial regions, and other data subsets that are crucial for subsequent analysis. Existing state-of-the-art error-bounded lossy compressors, however, do not consider these constraints during compression, resulting in inferior compression ratios with respect to user's post hoc analysis, due to the fact that the data itself provides little or no value for post hoc analysis. In this work we address this issue by proposing an optimized framework that can preserve diverse constraints during the error-bounded lossy compression, e.g., cleaning the irrelevant data, efficiently preserving different precision for multiple value intervals, and allowing users to set diverse precision over both regular and irregular regions. We perform our evaluation on a supercomputer with up to 2,100 cores. Experiments with six real-world applications show that our proposed diverse constraints based error-bounded lossy compressor can obtain a higher visual quality or data fidelity on reconstructed data with the same or even higher compression ratios compared with the traditional state-of-the-art compressor SZ. Furthermore, our experiments also demonstrate very good scalability in compression performance compared with the I/O throughput of the parallel file system.

97 MATHEMATICS AND COMPUTING↗