Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “cost and performance data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

DOE Deep Energy Retrofit Cost Survey

A survey was conducted by the Lawrence Berkeley National Laboratory on deep energy retrofit (DER) market drivers, opportunities, and challenges. The survey was part a research study sponsored by the U.S. Department of Energy to gather information on the costs of DER from home performance contractors and stakeholders. Cost data was gathered from DER projects that use a comprehensive, whole-home approach to drastically reduce energy use and improve performance. DER projects often aim at reducing energy use by 50% or more. In addition, these projects can improve home comfort and potentially benefiting occupant health. Yet, market adoption of DER has been limited. Major limiting factors include complex projects, high costs, perceived risks, extensive disruption, and unfamiliar work scopes to some contractors. In order to better understand what motivates and deters DER projects in today’s market, a survey was conducted to gather this information, and to learn about promising approaches and technologies from the industry perspective. Past surveys on homeowners and home energy performance professionals have studied the motivations and barriers of energy efficiency retrofits. Two surveys of home energy performance professionals were conducted in recent years. The Resources for the Future (RFF) Home Energy Audit and Retrofit Survey was conducted in 2011 by recruiting energy auditors and retrofit installers through members of Efficiency First and Building Performance Institute (BPI) accredited contractors. The survey asked about the business and services that respondents provide, how often homeowners follow their recommendations to retrofit their homes, and the respondents’ opinion on barriers faced by the industry. The survey found that not enough homeowners know about energy audits, but more importantly, it is the high cost of retrofits compared to low energy prices that is responsible for few energy audits and retrofits being completed. The RESNET Deep Retrofit Industry Stakeholder Survey was conducted shortly after launching of the EnergySmart Home Performance Team program. The EnergySmart Team program involves a formal agreement among allied contractors who are engaged in high performance retrofits. Using this allied team approach, teams can pool their expertise and provide each other with customer referrals. The survey asked EnergySmart Team members and outside stakeholders on questions about market and technical barriers in performing home energy retrofits. Survey respondents identified lack of consumer awareness and lack of affordable financing for consumers as the leading market barriers to home energy retrofits. In their written comments, many survey respondents also echoed that the high costs of retrofit compared to low energy prices is a market barrier. Respondents found “certain housing characteristics that prevent effective retrofit” and “energy analysis software inaccuracy or limitations” are the two leading technical barriers. Their choices for technical barriers were reflective of the energy rater/auditor role played by the majority (78%) of the survey respondents. In comparison to past surveys, this work aimed to gather inputs from a broader segment of the home performance industry to identify the opportunities and barriers faced by DERs from all perspectives. The survey asks for project costs to help breakdown the high costs of DERs. This survey is also motivated by a need to better understand the role of DERs in reducing energy use by the residential sectors and meeting climate goals. The survey is designed towards obtaining more substantive inputs from survey respondents by encouraging written comments, rather than setting the goal to reach a large number of respondents. We took this approach because DER is currently still a niche market, so it is more valuable to gather in-depth inputs from individuals who are performing this work rather than getting to the masses.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2025

2024 Buildings Technology Baseline: Dataset Documentation

The Buildings Technology Baseline is a curated and regularly updated dataset of current and projected performance, retail, and installed price data for all major building energy technologies needed to enable cost/benefit analyses. Building technology analyses require an up-to-date understanding of installation costs and cost-effectiveness of key building energy efficiency technologies. The dataset was assembled by Guidehouse during fiscal year 2024. Data was gathered from the 2024 National Residential Efficiency Measures Database (NREMDB), the 2023 Energy Information Administration Updated Buildings Sector Appliance and Equipment Costs and Efficiencies ("EIA Building Data Report"), DOE Lighting Market Model, the 2023 RSMeans database, and the 2020 Grid-Interactive Efficient Building Technology Cost, Performance, and Lifetime Characteristics ("GEB Data Report"), Lawrence Berkeley National Laboratory, various literature, as well as new data from online retailers, stakeholder interviews, and contractor databases in 2023 and 2024. The dataset has been reviewed by subject matter experts at NREL and DOE. The 2024 dataset release is intended to be a starting point for interested users to provide feedback. This database is not intended to provide specific cost estimates for a specific project. The cost estimates do not include any rebates or tax incentives that may be available for the measures. Rather, it is meant to help determine which measures may be more cost-effective. The National Renewable Energy Laboratory (NREL) makes every effort to ensure accuracy of the data; however, NREL does not assume any legal liability or responsibility for the accuracy or completeness of the information.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2025

Development and Preliminary Analysis of a U.S. Geothermal Heat Pump Installation Database

This paper seeks to addresses the significant gap in the literature regarding the installation and adoption of geothermal heat pump (GHP) systems in the United States. While the "2021 U.S. Geothermal Power Production and District Heating Market Report" published by the National Renewable Energy Laboratory (NREL) focused on direct-use geothermal district heating systems, it did not include an analysis of GHP installations (Robins et al. 2021). To bridge this gap, NREL has compiled a novel database currently containing 70,470 records of GHP installations, primarily sourced from state well permits and small-scale studies. Our methodology emphasizes the collection, cleaning, and standardization of data, addressing challenges such as inconsistent reporting formats and privacy concerns. Despite limitations in data on capacity, costs, and performance, our preliminary geospatial analysis reveals insights into the distribution of GHP systems across urban and rural areas and climate zones. The paper highlights the importance of publicly accessible data for advancing GHP technology adoption with a discussion of existing data sources and their limitations, advocating for improved collaboration between NREL and industry stakeholders.

data collection↗
DOE OSTI2023

Cost and Performance Baseline for Fossil Energy Plants, Volume 5: Natural Gas Electricity Generating Units for Flexible Operation

To address the data needs of energy system designers and to serve as a baseline for research and development, NETL has carried out a study to characterize the flexibility attributes - both performance and cost - of nine common commercial natural gas-fueled electricity generating units. The intermittent output of low-carbon, renewable power generation sources such as wind and solar create challenges to grid stability and reliability. Fossil-fueled power generation technologies are currently used to provide reliable, on-demand power during periods of reduced renewable output. Dispatchable generators must be able to accommodate increasing renewable generation as the nation pursues the Administration’s target of a decarbonized energy sector by 2035. As energy system experts seek to identify least-cost approaches to decarbonization, accurate cost and performance data characterizing dispatchable fossil generators that operate flexibly, at capacity factors that have been declining over time, and are needed to inform models for capacity expansion. Furthermore, these technologies continue to be a significant source of carbon dioxide emissions, providing the impetus for research and development, including the advancement and potential incorporation of carbon capture technologies. This study characterizes the cost and performance of select state-of-the-art natural gas-fueled power generation technologies: reciprocating internal combustion engines (RICE), simple cycle combustion turbines, and natural gas combined cycles (NGCC). An emphasis is placed on flexibility characteristics, such as part-load heat rate, ramp rates, start up times, and start up costs.

03 NATURAL GAS↗
DOE OSTI2022

Hydropower Capital and O&M Costs: An Exploration of the FERC Form 1 Data

This report explores the potential for using responses from the Federal Energy Regulatory Commission’s (FERC’s) “Electric Utility Annual Report,” also known as FERC Form 1, as a cost database for conventional and pumped storage hydropower (PSH). The report outlines the process used to compile an easy-to-access database from the original FERC Form 1 data and discusses the historical cost/performance data. The steps for developing the database include downloading the annual FoxPro files from the FERC website (FERC, 2020), reading them into an Excel format, and reconciling naming issues across years, repeated entries, and shared assets, among others. The cleaned and compiled Form 1 database is available on Oak Ridge National Laboratory’s (ORNL’s) HydroSource website. For this report, the compiled Form 1 database was linked to two other hydropower databases, the National Inventory of Dams and the ORNL Existing Hydropower Assets, that provide additional information on the characteristics and other features of plants in the Form 1 data. Explorations of the plant characteristics, performance, capital costs, and operation and maintenance (O&M) cost data in the combined database were presented separately for conventional hydropower and PSH projects. Form 1 has several advantages as a hydropower cost database. First, the cost data is reported directly by plant owners. Second, Form 1 provides cost breakdowns of capital and operating costs for large conventional and PSH plants enabling more detailed tracking of hydropower costs compared with typical total cost estimates. Third, although the Form 1 data is not reported by all operational hydropower plants in the United States, the available data represents a wide range of plant characteristics and a sizable proportion of the hydropower fleet (61% of PSH plants and 22% of conventional hydropower plants by capacity). The lower proportion of the conventional hydropower fleet is because Form 1 reporting requirements apply only to private utilities that meet given size thresholds, leaving out federally owned facilities and many smaller hydropower plants. Overall, the Form 1 cost database represents a unique, publicly available database on hydropower asset capital and O&M costs. This report leads to a compiled database for the reporting years 1994 to 2020 that helps resolve issues with accessibility and use of the FERC Form 1 data by hydropower plant owners, project developers, technology developers, and regulators.

13 HYDRO ENERGY↗
DOE OSTI2023

Interconnection Cost Analysis in ISO-New England

Electric transmission system operators (ISOs, RTOs, or utilities) require new large generators seeking to connect to the grid to undergo a series of impact studies before they can be built. This process establishes what new transmission equipment or upgrades may be needed before a project can connect to the system and assigns the costs of that equipment. Berkeley Lab has collected interconnection cost data for 194 projects in New England from interconnection studies performed between 2010 and 2021. Project-level cost summary data are available for download on this page. We find: -Interconnection costs have grown over time, especially for projects that withdraw. -Interconnection costs are highest for onshore wind, followed by solar and storage. Natural gas and offshore wind projects tend to cost less to interconnect, in comparison. -Economies of scale exist for solar and possibly storage projects, but not for other resource types. -Wind and solar projects requesting capacity network resource interconnection service have higher interconnection costs, despite being evaluated using the same interconnection standard in the analyzed studies. -Low and high interconnection costs can be found throughout the ISO-NE footprint. -Costs are split fairly evenly between investments at the point of interconnection and within the broader network for active and withdrawn projects, while complete projects incur most costs at the point of interconnection.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

Use of Rig Parameter Data in Bit Constraint Models for Improved Drilling Performance at The Geysers

Surface parameter measurements are routinely used during deep well construction to monitor and guide drilling conditions for improved performance and reduced costs. However, these measurements are of reduced value without a standard to aid in evaluation and decision making. A method is demonstrated whereby drill bit constraint models are used to interpret drilling response parameters. Drill rig parameter data for well GDC-36 at the Geysers Geothermal Field Power were acquired by Geysers Power Company and drilling contractor Kenai Drilling using Pason US DataHub and evaluated. Drilling parameters are evaluated using laboratory-validated rock reduction models for predicting the phenomenological response of drag bits (Detournay and Defourny, 1992) along with other model constraints in computational algorithms. The method is used to evaluate overall bit performance, monitor bit integrity, and detect the presence of drillstring vibrations and other conditions contributing to bit failure; comparisons are made to observations of bit wear and damage. The method will be applied in real-time to improve decision-making on subsequent wells and has applicability to development of advanced analytics on future geothermal wells using real-time electronic drilling recorder (EDR) data for improved performance and reduced drilling costs.

15 GEOTHERMAL ENERGY↗
DOE OSTI2025

Physics-informed machine learning for building performance simulation-A review of a nascent field

Building performance simulation (BPS) is critical for understanding building dynamics and behavior, analyzing the performance of the built environment, optimizing energy efficiency, improving demand flexibility, and enhancing building resilience. However, conducting BPS is not trivial. Traditional BPS relies on accurate building energy models, which are primarily physics-based and heavily dependent on detailed building information, expert knowledge, and case-by-case model calibrations, significantly limiting their scalability. With the development of sensing technology and the increased availability of data, there is growing attention and interest in data-driven BPS. However, purely data-driven models often suffer from limited generalization ability and a lack of physical consistency, resulting in poor performance in real-world applications. To address these limitations, recent studies have begun integrating physics priors into data-driven models, a methodology known as physics-informed machine learning (PIML). PIML is an emerging field where its definitions, methodologies, evaluation criteria, application scenarios, and future directions remain open. To bridge those gaps, this study systematically reviews the state-of-the-art PIML for BPS, offering a comprehensive definition of PIML and comparing it to traditional BPS approaches regarding data requirements, modeling effort, performance, and computational cost. We also summarize the commonly used methodologies, validation approaches, application domains, available data sources, open-source packages, and testbeds. In addition, this study provides a general guideline for selecting appropriate PIML models based on BPS applications. Finally, this study identifies key challenges and outlines future research directions, providing a solid foundation and valuable insights to advance R&D of PIML in BPS.

Jiang, Zixin↗
DOE OSTI2025

Software For Advanced Large-scale Analysis Of Magnetic Confinement For Numerical Design, Engineering & Research (salamander)

As magnetic confinement fusion energy gains traction internationally to enable abundant energy production, designing components for fusion systems is a pressing challenge. During the planned lifetime of a fusion device, components evolve in extreme environments and must withstand large, repeated thermal loads and bombardment by 14 MeV neutrons, plasma ions, and neutral particles (deuterium, tritium, and helium), corrosive conditions, etc. All these physical processes take place simultaneously, interact in intricate ways, and impose important constraints that can affect performance. Experimental data is rare and costly to obtain, making design particularly challenging. Predictive computational frameworks must be an integral part of an accelerated and cost-effective design process by modeling fusion system performance in simulated environments. To better understand component degradation and operational impacts on their performance, the Software for Advanced Large-scale Analysis of MAgnetic confinement for Numerical Design, Engineering & Research (SALAMANDER) is designed as an open-source, fully integrated, multiphysics, multiscale, NQA-1 compliant framework facilitating 3D, high-fidelity fusion system modeling. To that end, SALAMANDER is a MOOSE-based framework, and therefore leverages MOOSE upstream libraries such as PETSc and libMesh to deliver sophisticated finite element, finite volume, and nonlinear solver technology for fusion energy simulations. SALAMANDER couples MOOSE physics module capabilities—such as thermal hydraulics, heat conduction, Navier-Stokes, and thermomechanics—with tritium transport via TMAP8, neutronics via Cardinal, and nascent particle-in-cell capabilities. Direct simulation Monte Carlo methods will be used to address neutral transport near the walls. By coupling all these physics in an integrated application, SALAMANDER will enable high-fidelity modeling of irradiation levels and plasma exposure conditions of plasma facing components and their impact on heat and tritium distributions, as well as the resulting mechanical constraints experienced by the plasma facing components and performance of blanket systems. Furthermore, SALAMANDER will be particularly suited for engineering studies thanks to the stochastic tool module readily available in MOOSE, allowing for extended uncertainty quantification and risk analysis studies. It is also able to use computer-aided design (CAD) meshes to model complex geometries, which is indispensable for fusion systems. SALAMANDER therefore supports design, safety, engineering, and research projects for magnetic confinement fusion systems

Simon, Pierre-Clement [Idaho National Laboratory (↗
DOE OSTI2023

OPTOM: Optimization of Parabolic Trough - Operations & Maintenance

The US Department of Energy’s SunShot goals look to reduce the cost of Concentrating Solar Power (CSP) technology to 5¢/kWh for baseload plants. This is about a 50% reduction from current costs. To achieve this cost target, a significant reduction in operation and maintenance (O&M) costs of 40 to 50% is likely needed. Advances are needed in the O&M practices of CSP plants if the technology is to achieve the SunShot cost goals. Digitization of plant performance and O&M data has become a new best practice in the world of renewable energy asset management. Owners and operators of large photovoltaic and wind power plants are working to digitize performance and O&M data at their existing assets, to improve their management of the facilities, to increase performance, reduce O&M costs, and lower the overall life cycle cost of ownership. CSP power plants are behind the curve of other technologies on the digitization of plant information to aid in the plant asset management. This project directly addresses the objective of digitizing the O&M data of the solar field, focusing on three areas: 1) creating a framework for sharing data and information, 2) creating a system for monitoring and managing the maintenance of the solar field collectors, and 3) developing analytic tools to identify issues in the solar field. According to the NREL CSP Best Practices Study, the current practice at many CSP plants is to rely on paper lists, spreadsheets, and email for monitoring and managing problems and maintenance in the solar field. The key element to digitize solar field O&M is the creation of a centralized data archive that all users and systems can interface with. This project developed a centralized relational database framework that allows users and applications to access and share data. Conventional power plants utilize Computerized Maintenance Management Systems (CMMSs) to track the corrective, preventive (scheduled), and predictive maintenance of equipment and subsystems in the power plant. CSP plants use these systems in the power block, but while these systems specialize at tracking maintenance on up to thousands of pieces of equipment, they are not well suited for tracking the tens or hundreds of thousands of components in large commercial CSP or photovoltaic solar fields. In this project we developed a new software application referred to as FieldStatus (TM). This is a specialized database program that is used to track the status of each collector and its components. This application is designed to complement the existing CMMS to enable improved tracking and management of maintenance activities in the solar field. One of the major maintenance tasks for solar fields is maintaining the cleanliness of the mirrors. Although seemingly a relatively straight forward task, it has often proven challenging to maintain high levels of cleanliness in an efficient and cost-effective manner. This project developed new tools and metrics for monitoring and optimizing solar field cleaning resources and overall solar field cleanliness.

14 SOLAR ENERGY↗
DOE OSTI2020

A Visual Analytics Framework for Reviewing Streaming Performance Data

Understanding and tuning the performance of extreme-scale parallel computing systems demands a streaming approach due to the computational cost of applying offline algorithms to vast amounts of performance log data. Analyzing large streaming data is challenging because the rate of receiving data and limited time to comprehend data make it difficult for the analysts to sufficiently examine the data without missing important changes or patterns. To support streaming data analysis, we introduce a visual analytic framework comprising of three modules: data management, analysis, and interactive visualization. The data management module collects various computing and communication performance metrics from the monitored system using streaming data processing techniques and feeds the data to the other two modules. The analysis module automatically identifies important changes and patterns at the required latency. In particular, we introduce a set of online and progressive analysis methods for not only controlling the computational costs but also helping analysts better follow the critical aspects of the analysis results. Finally, the interactive visualization module provides the analysts with a coherent view of the changes and patterns in the continuously captured performance data. Through a multi-faceted case study on performance analysis of parallel discrete-event simulation, we demonstrate the effectiveness of our framework for identifying bottlenecks and locating outliers.

Human-centered computing↗
DOE OSTI2025

DeepLynx Ecosystem 2025

Poor data integration and governance continue to plague complex engineering projects, resulting in missed cost, schedule, and performance targets. Departments operate in isolated systems with manual data exchange, creating fragmented information that compounds errors and leads to significant delays and cost overruns. The DeepLynx ecosystem addresses these challenges through an open-source, modular data management platform that transforms fragmented project data into an integrated digital thread. Built on a federated microservice architecture, the ecosystem comprises seven specialized tools centered around DeepLynx Nexus, a unified data catalog with hierarchical organization and graph-based navigation capabilities. The ecosystem includes: DeepLynx Stream for real-time timeseries data ingestion from industrial sources; DeepLynx Ingest for governed data uploads with formal review workflows; DeepLynx Lattice for ontology-based entity and relationship extraction; DeepLynx Run for workflow orchestration and secure AI/ML compute; DeepLynx Visualize for 3D digital twin visualization; and DeepLynx Insight for AI-assisted document analysis with traceable, grounded responses. Deployable in cloud, on-premise, or hybrid environments using containerized Docker applications and Helm charts, the DeepLynx ecosystem provides flexible infrastructure that adapts to organizational requirements. By consolidating project data into a unified data lake with role-based access controls and OAuth2 authentication, DeepLynx enables digital thread and digital twin capabilities that improve decision-making, reduce risk, and support complex engineering workflows throughout the project lifecycle.

42 - ENGINEERING↗
DOE OSTI2022

Cross Inference of Throughput Profiles Using Micro Kernel Network Method

Dedicated network connections are being increasingly deployed in cloud, centralized and edge computing and data infrastructures, whose throughput profiles are critical indicators of the underlying data transfer performance. Due to the cost and disruptions to physical infrastructures, network emulators, such as Mininet, are often used to generate measurements needed to estimate throughput profiles, typically expressed as a function of the connection round trip time. The profiles estimated using measurements from such emulated networks are usually inaccurate for high bandwidth and high latency connections, since they do not accurately reflect the critical network transport dynamics mainly due to computing and memory constraints of the host. We present a machine learning (ML) method to estimate the throughput profiles using emulation measurements to closely match the testbed and production network profiles. In particular, we propose a micro Kernel Network (mKN) that provides baseline throughput measurements on the host running Mininet emulations, which are used to learn a regression map that converts them to the corresponding testbed measurement estimates. Once initially learned, this map is applied to measurements from subsequent network emulations on the same host. We present experimental measurements to illustrate this approach, and derive generalization equations for the proposed mKN-ML method. Using a four-site scenario emulation, we show the effectiveness of this method in providing accurate concave throughput profiles from inaccurate convex or non-smooth ones indicated by Mininet emulation.

Rao, Nageswara↗
DOE OSTI2021

Cooperative Research and Development Agreement between National Energy Technology Laboratory and Electric Power Research Institute (EPRI) [Abstract]

Carbon dioxide (CO 2 ) capture from flue gas generated by fossil fuel-fired power plants has been proposed as an efficient approach to limit CO 2 emissions to the atmosphere. Due to the high cyclic CO 2 sorption capacity, well-tuned adsorption chemistry and non-volatility, solid sorbents are widely studied for CO 2 capture processes such as pressure swing adsorption (PSA) and temperature swing adsorption (TSA). Realistic applications of traditional solid sorbent systems face many challenges since moisture and heat management are problematic and solid-solid heat exchange is inefficient. Recently, a novel solid sorbent system, the sorbent polymer composite (SPC), has been developed to overcome those challenges in an energy-saving CO 2 capture process using TSA membrane contactors. A SPC material is comprised of a powdered solid sorbent embedded into a hydrophobic and porous polymer matrix. It allows gases to permeate through and achieve full contact with the sorbents while rejecting water moisture in the CO 2 capture process. In this collaborative research, NETL will conduct performance testing of a novel SPC material and EPRI will conduct a cost analysis based on that performance data.

20 FOSSIL-FUELED POWER PLANTS↗
DOE OSTI2021

Budget Constrained Machine Learning for Early Prediction of Adverse Outcomes for COVID-19 Patients

Background: Machine learning (ML) based risk stratification models of Electronic Health records (EHR) data may help to optimize treatment of COVID-19 patients, but are often limited by their lack of clinical interpretability and cost of laboratory tests. We develop a ML based tool for predicting adverse outcomes based on EHR data to optimize clinical utility under a given cost structure. This cohort study was performed using deidentified EHR data from COVID-19 patients from ProMedica Healthcare in northwest Ohio and southeastern Michigan. Methods: We tested performance of various ML approaches for predicting either increasing ventilatory support or mortality and the set of model features under a budget constraint was optimized via exhaustive search across all combinations of features. Results: The optimal sets of features for predicting ventilation under any budget constraint included demographics and comorbidities (DCM), basic metabolic panel (BMP), D-dimer, lactate dehydrogenase (LDH), erythrocyte sedimentation rate (ESR), CRP, brain natriuretic peptide (BNP), and procalcitonin and for mortality included DCM, BMP, complete blood count, D-dimer, LDH, CRP, BNP, procalcitonin and ferritin. Conclusions: This study presents a quick, accurate and cost-effective method to evaluate risk of deterioration for patients with SARS-CoV-2 infection at the time of clinical evaluation.

Cadena Pico, JoseE.↗
DOE OSTI2025

Eureka: Enabling Fine-Grained Access and Range Queries on Compressed Scientific Data via Data-Index Co-Compression

Handling large-scale scientific data in high-performance computing (HPC) environments poses significant challenges, including excessive I/O, high storage costs, and slow query performance. Traditional approaches often require full data decompression and scans, making them impractical for real-time or interactive analysis. To address these limitations, we introduce Eureka, a unified data-index co-compression framework that enables fine-grained access and efficient range queries on compressed scientific datasets. Eureka integrates spatial domain decomposition with block-wise error-bounded lossy compression to support selective decompression. It constructs a hierarchical AVL-tree index during compression to capture block-level value ranges, enabling fast pruning during query execution. To reduce metadata overhead, the index itself is also compressed while ensuring recall-preserving results. Experiments on six diverse HPC simulation datasets show that Eureka achieves up to 25x data compression and over 300x index compression, surpassing state-of-the-art compressors such as SZ3 and ZFP in rate-distortion performance. Additionally, Eureka delivers over 30x speedup for low-selectivity range queries, making it a scalable and efficient solution for modern scientific data analysis.

Yan, Ning↗
DOE OSTI2024

Earth System Reanalysis in Support of Climate Model Improvements

Recent climate model developments, established through increased model resolution, have led to substantial improvements in model simulations of the time-evolving, coupled Earth system and its subcomponents. However, regardless of resolution, climate models will always produce climate features and variability that differ from the real world and will be prone to biases. This is due to many remaining uncertainties, such as in parametric and structural model uncertainty, in the initial conditions prescribed, and in the prescribed (scenario) forcing which varies on decadal to centennial timescales. Further model improvements are expected to arise specifically from improved representation of physical processes realized through model-data fusion. This will create an unprecedented opportunity to better exploit a large array of Earth observations, from in situ measurements to weather radars and satellite observations, as the resolved scales of the models approach those of the observations. For this, climate DA will be the central tool to bring models and observations into consistency, by improving initial conditions, inferring uncertain model parameters and structure, and quantifying uncertainty. Generally, there will be advantages and complementarities of adjoint-based smoother approaches, ensemble-based filter approaches, or new ML-inspired approaches. Yet, the ever-increasing model resolution will present growing challenges arising from computational cost, calling for new ways of performing data assimilation and model optimization. Using the complementarity in a hybrid approach, blending tools and concepts from variational, ensemble and ML methods might be what is required in the future. In this context ML could be important to handle non-linear responses, and to better approximate non-Gaussian distributions.

54 ENVIRONMENTAL SCIENCES↗