Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “ad hoc”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

216 records · Page 12

Spurious Correlations between Galaxies and Multiepoch Image Stacks in the DESI Legacy Surveys

A nonnegligible source of systematic bias in cosmological analyses of galaxy surveys is the on-sky modulation that is caused by foregrounds and variable image characteristics, such as observing conditions. Standard mitigation techniques perform a regression between the observed galaxy density field and sky maps of the potential contaminants. Such maps are ad hoc lossy summaries of the heterogeneous sets of coadded exposures that contribute to the survey. We present a methodology for addressing this limitation, and we extract spurious correlations between the observed distributions of galaxies and arbitrary stacks of single-epoch exposures. We study four types of galaxies (luminous red galaxies, emission-line galaxies, quasars, and Lyman-break galaxies) in the three regions of the DESI Legacy Surveys (North, South, and Dark Energy Survey), resulting in 12 samples with varying levels and types of contamination. We find that the new technique outperforms the traditional ones in all cases, and is able to remove higher levels of contamination. This paves the way for new methods that extract more information from multiepoch galaxy survey data and mitigate large-scale biases more effectively.

79 ASTRONOMY AND ASTROPHYSICS↗

The HTAP_v3 emission mosaic: merging regional and global monthly emissions (2000–2018) to support air quality modelling and policies

This study, performed under the umbrella of the Task Force on Hemispheric Transport of Air Pollution (TF-HTAP), responds to the global and regional atmospheric modelling community's need of a mosaic emission inventory of air pollutants that conforms to specific requirements: global coverage, long time series, spatially distributed emissions with high time resolution, and a high sectoral resolution. The mosaic approach of integrating official regional emission inventories based on locally reported data, with a global inventory based on a globally consistent methodology, allows modellers to perform simulations of high scientific quality while also ensuring that the results remain relevant to policymakers. HTAP_v3, an ad hoc global mosaic of anthropogenic inventories, has been developed by integrating official inventories over specific areas (North America, Europe, Asia including Japan and South Korea) with the independent Emissions Database for Global Atmospheric Research (EDGAR) inventory for the remaining world regions. The results are spatially and temporally distributed emissions of SO 2 , NO $x$ , CO, non-methane volatile organic compounds (NMVOCs), NH 3 , PM 10 , PM 2.5 , black carbon (BC), and organic carbon (OC), with a spatial resolution of 0.1º × 0.1º and time intervals of months and years, covering the period 2000–2018. The emissions are further disaggregated into 16 anthropogenic emitting sectors. This paper describes the methodology applied to develop such an emission mosaic, reports on source allocation, differences among existing inventories, and best practices for the mosaic compilation. One of the key strengths of the HTAP_v3 emission mosaic is its temporal coverage, enabling the analysis of emission trends over the past 2 decades. The development of a global emission mosaic over such long time series represents a unique product for global air quality modelling and for better-informed policymaking, reflecting the community effort expended by the TF-HTAP to disentangle the complexity of transboundary transport of air pollution.

54 ENVIRONMENTAL SCIENCES↗

Systematically tracking the hourly progression of large wildfires using GOES satellite observations

Abstract. In the western United States, prolonged drought, a warming climate, and historical fuel buildup have contributed to larger and more intense wildfires as well as to longer fire seasons. As these costly wildfires become more common, new tools and methods are essential for improving our understanding of the evolution of fires and how extreme weather conditions, including heat waves, windstorms, droughts, and varying levels of active-fire suppression, influence fire spread. Here, we develop the Geostationary Operational Environmental Satellites (GOES)-Observed Fire Event Representation (GOFER) algorithm to derive the hourly fire progression of large wildfires and create a product of hourly fire perimeters, active-fire lines, and fire spread rates. Using GOES-East and GOES-West geostationary satellite detections of active fires, we test the GOFER algorithm on 28 large wildfires in California from 2019 to 2021. The GOFER algorithm includes parameter optimizations for defining the burned-to-unburned boundary and correcting for the parallax effect from elevated terrain. We evaluate GOFER perimeters using 12 h data from the Visible Infrared Imaging Radiometer Suite (VIIRS)-derived Fire Event Data Suite (FEDS) and final fire perimeters from the California's Fire and Resource Assessment Program (FRAP). Although the GOES imagery used to derive GOFER has a coarser resolution (2 km at the Equator), the final fire perimeters from GOFER correspond reasonably well to those obtained from FRAP, with a mean Intersection-over-Union (IoU) of 0.77, in comparison to 0.83 between FEDS and FRAP; the IoU indicates the area of overlap over the area of the union relative to the reference perimeters, in which 0 is no agreement and 1 is perfect agreement. GOFER fills a key temporal gap present in other fire tracking products that rely on low-Earth-orbit imagery, where perimeters are available at intervals of 12 h or longer or at ad hoc intervals from aircraft overflights. This is particularly relevant when a fire spreads rapidly, such as at maximum hourly spread rates of over 5 km h−1. Our GOFER algorithm for deriving the hourly fire progression using GOES can be applied to large wildfires across North and South America and reveals considerable variability in the rates of fire spread on diurnal timescales. The resulting GOFER product has a broad set of potential applications, including the development of predictive models for fire spread and the improvement of atmospheric transport models for surface smoke estimates. The resulting GOFER product has a broad set of potential applications, including the development of predictive models for fire spread and the improvement of atmospheric transport models for surface smoke estimates (https://doi.org/10.5281/zenodo.8327264, Liu et al., 2023).

Geology↗

The HTAP_v3.2 emission mosaic: merging regional and global monthly emissions (2000–2020) to support air quality modelling and policies

This study, performed under the umbrella of the Task Force on Hemispheric Transport of Air Pollution (TF-HTAP), responds to the need of the global and regional atmospheric modelling community of having a mosaic emission inventory of air pollutants that conforms to specific requirements: global coverage, long time series, spatially distributed emissions with high time resolution, and a high sectoral resolution. The mosaic approach of integrating official regional emission inventories based on locally reported data, with a global inventory based on a globally consistent methodology, allows modellers to perform simulations of a high scientific quality while also ensuring that the results remain relevant to policymakers. HTAP_v3.2, an ad-hoc global mosaic of anthropogenic inventories, is an update to the HTAP_v3 global mosaic inventory and has been developed by integrating official inventories over specific areas (North America, Europe, Asia including China, Japan and Korea) with the independent Emissions Database for Global Atmospheric Research (EDGAR) inventory for the remaining world regions. The results are spatially and temporally distributed emissions of SO 2 , NO x , CO, NMVOC, NH 3 , PM 10 , PM 2.5 , Black Carbon (BC), and Organic Carbon (OC), with a spatial resolution of 0.1 × 0.1° and time intervals of months and years covering the period 2000–2020 (https://doi.org/10.5281/zenodo.17086684, Crippa, 2025, https://edgar.jrc.ec.europa.eu/dataset_htap_v32, last access: 27 October 2025). The emissions are further disaggregated to 16 anthropogenic emitting sectors. This paper describes the methodology applied to develop such an emission mosaic, reports on source allocation, differences among existing inventories, and best practices for the mosaic compilation. One of the key strengths of the HTAP_v3.2 emission mosaic is its temporal coverage, enabling the analysis of emission trends over the past two decades. The development of a global emission mosaic over such long time series represents a unique product for global air quality modelling and for better-informed policy making, reflecting the community effort expended by the TF-HTAP to disentangle the complexity of transboundary transport of air pollution.

Guizzardi, Diego [European Commission, Ispra (Ital↗

CondiDiag1.0: a flexible online diagnostic tool for conditional sampling and budget analysis in the E3SM atmosphere model (EAM)

Abstract. Numerical models used in weather and climate prediction take into account a comprehensive set of atmospheric processes (i.e., phenomena) such as the resolved and unresolved fluid dynamics, radiative transfer, cloud and aerosol life cycles, and mass or energy exchanges with the Earth's surface. In order to identify model deficiencies and improve predictive skills, it is important to obtain process-level understanding of the interactions between different processes. Conditional sampling and budget analysis are powerful tools for process-oriented model evaluation, but they often require tedious ad hoc coding and large amounts of instantaneous model output, resulting in inefficient use of human and computing resources. This paper presents an online diagnostic tool that addresses this challenge by monitoring model variables in a generic manner as they evolve within the time integration cycle. The tool is convenient to use. It allows users to select sampling conditions and specify monitored variables at run time. Both the evolving values of the model variables and their increments caused by different atmospheric processes can be monitored and archived. Online calculation of vertical integrals is also supported. Multiple sampling conditions can be monitored in a single simulation in combination with unconditional sampling. The paper explains in detail the design and implementation of the tool in the Energy Exascale Earth System Model (E3SM) version 1. The usage is demonstrated through three examples: a global budget analysis of dust aerosol mass concentration, a composite analysis of sea salt emission and its dependency on surface wind speed, and a conditionally sampled relative humidity budget. The tool is expected to be easily portable to closely related atmospheric models that use the same or similar data structures and time integration methods.

58 GEOSCIENCES↗

A new form of the Saint-Venant equations for variable topography

The solution stability of river models using the one-dimensional (1D) Saint-Venant equations can be easily undermined when source terms in the discrete equations do not satisfy the Lipschitz smoothness condition for partial differential equations. Although instability issues have been previously noted, they are typically treated as model implementation issues rather than as underlying problems associated with the form of the governing equations. This study proposes a new reference slope form of the Saint-Venant equations to ensure smooth slope source terms and eliminate one source of potential numerical oscillations. It is shown that a simple algebraic transformation of channel geometry provides a smooth reference slope while preserving the correct cross-section flow area and the total Piezometric pressure gradient that drives the flow. The reference slope method ensures the slope source term in the governing equations is Lipschitz continuous while maintaining all the underlying complexity of the real-world geometry. The validity of the mathematical concept is demonstrated with the open-source Simulation Program for River Networks (SPRNT) model in a series of artificial test cases and a simulation of a small urban creek. Validation comparisons are made with analytical solutions and the Hydrologic Engineering Center's River Analysis System (HEC-RAS) model. The new method reduces numerical oscillations and instabilities without requiring ad hoc smoothing algorithms.

54 ENVIRONMENTAL SCIENCES↗

Quantifying uncertainty in Pareto estimates of global lake area

This software contains the code for Bayesian uncertainty analysis of global lake area. Computed uncertainties are compared against more conventional estimation using lake size-abundance distributions. Routines are included to explore sensitivity to observational errors and ad-hoc "censoring" strategies.

Stachelek, Jemma↗

Nuclear Security Interface Considerations for Regaining Control of Discovered Nuclear and Radioactive Materials

Recognizing that regaining control of orphan radioactive and nuclear material is challenging, the international community has developed requirements and guidance to support countries in addressing the problem. However, limited guidance is available on the practical nuclear security related issues that arise when nuclear or other radioactive material out of regulatory control (MORC) is encountered and efforts are undertaken to regain control. For example, the IAEA Specific Safety Guide No. SSG-19, “National Strategy for Regaining Control over Orphan Sources and Improving Control over Vulnerable Sources”, provides recommendations on a methodology for establishing a national strategy for regaining control of orphan sources. However, except for Pu239 in radioactive sources, nuclear material is outside the scope of this safety guide, and practical safety and security measures below the level of national strategy are not discussed adequately.This paper discusses the interfaces between the stakeholder groups and the responsibilities of each when encountering common scenarios that deal with MORC transitioning to regulatory control. The stakeholders include but are not limited to individuals who encounter MORC, and providers of formal and informal transport systems, and traditional and ad hoc storage solutions. This paper explores practical legal, financial, and institutional issues that hinder implementation of required safety and security practices. This paper also offers strategies that can be implemented on the individual, organizational, national, and international level to regain control of MORC.

Shannon, Michael↗

Heterogeneous Visualization: A Call for Empirically Driven Technology Advancement and Adoption; Preprint

Our ability to generate data from simulations and experimental platforms is generally outpacing our ability to analyze those data efficiently and effectively. There are a growing number and variety of possible visualization display modalities, from commodity head-mounted displays to large-scale immersive environments, from desktop and touch displays to high-resolution display walls. Many of these visualization technologies and visual environments are rapidly evolving and could revolutionize analysis for certain classes of complex scientific and engineering data. However, the choice of what technology or combination of technologies to use has historically been largely ad hoc and lacks a carefully validated understanding of how to best utilize different visualization technologies to advance the science. To maximize the impact of our data and analyses, it is imperative that we use the most effective visualization environments for the analysis task at hand.

heterogeneous visualization↗

A Knowledge-based Framework for Building Energy Model Performance Verification

Building energy modeling (BEM) has been widely used by researchers, regulators, and engineers to quantify building energy performance. Quality assurance (QA) and quality control (QC) of the model's performance are essential parts of such analysis. Currently, QA/QC is done in a manual and ad-hoc manner, which is tedious, error-prone, and time-consuming when QA/QC a large number of models. To solve these challenges, we propose a a dAta-driveN buIlding perforMance verificATion framEwork (ANIMATE), which conducts automated output-based verification of building operations requirements (especially for time-series output-based verification of control requirements). While this framework was developed for verifying energy model performance, it can be extended for other applications such as BEM software testing and performance verification of real buildings in the field.

Chen, Yan↗

Approach to Quality Assurance for Complex Environmental Modeling - 20407

A strong Quality Assurance (QA) program for complex environmental modeling is essential for regulatory and public acceptance and trust, but it does not have to be onerous. Neptune and Company, Inc. (Neptune) has developed a strong QA program that improves transparency, traceability, reproducibility, and therefore, defensibility and trust. Neptune's QA program has evolved over the past 27 years, transitioning from an ad hoc QA program, to a program that is currently Nuclear Quality Assurance-1 (NQA-1) compliant, and will soon be NQA-1/DOE approved for DOE EM modeling work. In addition, Neptune is a qualified laboratory assessor and qualified auditor for reference materials, a proficiency testing provider, and fully complies with the Environmental Protection Agency (EPA) QA program. Neptune's President and CEO, Kelly Black, was recently named the Chairperson of the International Organization for Standardization (ISO) Technical Committee 69, Application of Statistical Methods. A strong QA program has been developed for Neptune's radiological performance assessment (PA) program. Although pieces of their QA program are currently in development, their current program includes document control using Subversion, issue tracking and work flow tracking using JIRA, and transparency and traceability via a system of 'calc sheets' for documentation of all data analysis and modeling combined with 'check print' documentation of QA checking, and rigorous model testing and configuration control. All work is reviewed by an independent subject matter expert who is not associated with the collection and assembly of information, for an internal peer review. The program is enforced with a handful of Standard Operation Procedures (SOPs), Work Instructions, QA Project Plans (QAPPs), and Quality Management Plans (QMPs) that are updated frequently, with required annual training and acknowledgment. In addition, effective communication of modeling approaches and results to clients and stakeholders are integral to their QA program. Many of their models are built using the GoldSim modeling platform, for which their models are well-known for their level of transparency, documentation, and QA traceability. This level of QA is also applied to their process-level models. Neptune has taken some lessons learned from the extremely rigorous QA program required for the Yucca Mountain Project (YMP), and imposed the YMP requirements of complete traceability, transparency, and reproducibility, but avoided the inflexibility of a QA program that likely contributed to the suspect e-mails in 2005 that resulted in loss of trust in the YMP, and in nuclear waste disposal (and nuclear power) in general. There are far too many examples of loss of public trust due to poor QA that could have been easily avoided with a simple and straight-forward QA program combined with stakeholder engagement. The purpose of this paper is to share features of Neptune's Radiological Performance Assessment program QA program, and some of their QA related lessons learned over the past 27 years of QA for complex environmental modeling. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Spent Nuclear Fuel Storage and Radioactive Waste Disposal in the United States: A Law and Policy Analysis - 20302

While Congress plays political football, spent nuclear fuel continues to sit in de facto interim nuclear waste storage sites throughout the country. This ad hoc approach - if it can even be called an approach - to nuclear waste management is in no one's best interests, because of financial, safety, environmental, and national security concerns with the status quo. Senate leadership had asserted that an up-or-down vote on the Yucca Mountain Project would take place in September or October 2019, but that did not occur. Rather, a conference bill was agreed to, and it provided that, although the nuclear program should receive some funding, funding was not made available for centralized interim storage ('CIS') or the Yucca Mountain Project. The President's FY2021 Budget Request does not contain any proposed funding for the Yucca Mountain Project ('the Project'). This paper will discuss the implications of that process, both for the Project itself and for the U.S. nuclear waste program more generally. In order to provide context for the current situation, this paper will begin by chronicling the history of U.S. nuclear waste management, from the passage of the Nuclear Waste Policy Act of 1982 and to the present day. It will discuss the roles of the U.S. Department of Energy, the Nuclear Regulatory Commission, federal and state political delegations, and the nuclear energy industry. The paper will then identify key themes that can be expected to affect the future of nuclear waste management in the United States. For example, it will consider whether development of additional CIS facilities is a viable short- to medium-term solution. CIS facilities may relieve immediate pressure at decommissioned or soon-to-be-decommissioned nuclear power plants; but with that pressure partially alleviated, support for building a long-term repository may be reduced. It will also discuss opposition by the State of New Mexico and others to the proposed New Mexico CIS project, based not only on siting concerns but also whether it might become a de facto repository, and whether the State of Texas and others may also be opposed, for similar reasons, to the proposed CIS facility in Texas. Additionally, the paper will examine consent-based siting and its implications for Nevada and other states that are potential hosts for spent nuclear fuel storage and disposal facilities. Further, if the Project is not a politically viable solution, the paper will examine whether it is now time for serious consideration of an alternate location for a permanent repository, as well as consideration of other options entirely, such as deep geologic disposal. The paper will conclude by looking ahead to the 2020 elections. It will describe the positions of candidates (particularly Presidential candidates) on spent nuclear fuel storage and disposal options, without advocating for any particular candidate or political party. Perhaps in 2020, we will at least see a start to a solution to the seemingly intractable problem of nuclear waste management in the United States. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Final Report (October 2024): University of Tennessee, Knoxville (UTK) contribution to: FusMatML: Machine Learning Atomistic Modeling for Fusion Materials Collaborative Project led by Dr. Aidan Thompson, Sandia National Laboratory

The rapid growth of the field of Machine Learning Inter-Atomic Potentials (MLIAP) has lead to a profusion of methods, all of which have some similarity to each other, but each also restricted to particular design choices, often arrived at in a rather ad hoc fashion. Beyond anecdotal evidence, and some benchmarking studies on specific problems, little progress has been made in developing design principles for MLIAPs. The goal of this project is to use machine learning, data science, and uncertainty quantification methods to optimize the design choices for MLIAP.

Density functional theory, Helium and Hydrogen↗

Energy Saving Estimation of ASHRAE Guideline 36 Supervisory Setpoint Reset Controls in a Commercial Large Office Building

Designing, commissioning, and retrofitting HVAC control systems for energy efficiency is crucial, but the use of ad-hoc control sequences by designers and contractors, based on scattered information, results in diverse and sub-optimal sequences. ASHRAE Guideline 36 (G36) addresses the challenge by providing standardized, rule-based HVAC control sequences that prioritize energy efficiency. However, there is limited evaluation of their energy performance at the building level, with only a few studies primarily focused on HVAC airside systems in small-to-medium-sized commercial buildings. In this study, the energy performance of ASHRAE Guideline 36 control sequences was assessed using a large office building emulator in Chicago. The emulator features a central plant system with multiple chillers and boilers as well as multiple variable air volume (VAV) systems with terminal reheat. To achieve a high-fidelity representation, we developed a Spawn-of-EnergyPlus-based model for the large office building, maintaining the DOE prototype large office building setup but substituting the HVAC system with its Modelica counterpart. This substitution ensures that the building thermal load, HVAC system's dynamics, and detailed control sequences are all accurately represented. The study involved evaluating and implementing control strategies outlined in ASHRAE Guideline 36-2021 to replace conventional controls. These strategies include the demand-based supply air temperature and duct static pressure setpoint reset and the request logic for demand-based reset of chilled/hot water supply temperature setpoints and pipe static pressure setpoints. Energy performance was evaluated under various load conditions, including cooling, heating, and transitional seasons, both for individual control strategies and in combination. The results indicate that the collective control strategies retrofit yield greater energy savings than the sum of individual strategies, highlighting the synergistic benefits of incorporating both airside and plant-side control retrofits. Additionally, energy savings of up to 41% in the heating season, 18% in the shoulder season, and 20 % in the cooling season were observed compared to baseline control while maintaining the thermal comfort level.

ASHRAE Guideline 36, Commercial buildings, Control↗

A Simple Data-Centric Methodology for Producible Geothermal Well Determinations: Preprint

The Bureau of Land Management (BLM) has traditionally lacked a standardized methodology for determining if a newly drilled geothermal well is "producible," a designation essential for deciding whether a lease should be "held by production." This is a straightforward problem to solve in oil and gas: Demonstrate that a well is economically viable, meaning it produces sufficient oil or gas to exceed direct operating costs and lease-related expenses, such as rentals or minimum royalties. In geothermal, the problem is more complex: Geothermal wells are tightly coupled with the downstream infrastructure - specifically, the power plant, which is often not designed until well after a lease is deemed as "held by production." Although this designation is critical for advancing geothermal power plant development on BLM-managed lands, current geothermal well assessments often rely on ad hoc approaches that can be complex, operator-biased, and heavy in assumptions related to economic viability. To address this, we have developed two complementary methodologies: a minimum power requirement-based approach and a productivity index (PI)-based approach. These methods leverage key flow test data - pressure, temperature, flow rate, and specific enthalpy - to provide reliable and standardized producible well determinations. The minimum power requirement-based approach evaluates wells against specific power output thresholds informed by reservoir experts and the associated temperature requirements. The PI-based approach assesses well productivity using widely accepted reservoir engineering metrics, proposing a threshold of 2.5 kg/s/bar. Both methods are data-driven and grounded in empirical production data from operational geothermal wells, avoiding uncertain economic assumptions while maintaining decision-making accuracy. Wells falling below key performance thresholds (i.e., PI, specific power) are deemed non-producible. These methodologies aim to streamline BLM's decision-making process, reduce nontechnical barriers to geothermal energy adoption, and enable regulatory expansion into states lacking geothermal expertise. Preliminary results indicate clear trends and thresholds in production data that provide actionable insights for evaluating well producibility. Validation using well completion report (WCR) data is ongoing, with promising results demonstrating the potential for these standardized methodologies to impact geothermal development significantly.

15 GEOTHERMAL ENERGY↗

Simulation-based inference for neutrino interaction model parameter tuning

High-energy physics experiments studying neutrinos rely heavily on simulations of their interactions with atomic nuclei. Limitations in the theoretical understanding of these interactions typically necessitate ad hoc tuning of simulation model parameters to data. Traditional tuning methods for neutrino experiments have largely relied on simple algorithms for numerical optimization. While adequate for the modest goals of initial efforts, the complexity of future neutrino tuning campaigns is expected to increase substantially, and new approaches will be needed to make progress. In this paper, we examine the application of simulation-based inference (SBI) to the neutrino interaction model tuning for the first time. Using a previous tuning study performed by the MicroBooNE experiment as a test case, we find that our SBI algorithm can correctly infer the tuned parameter values when confronted with a mock data set generated according to the MicroBooNE procedure. This initial proof-of-principle illustrates a promising new technique for next-generation simulation tuning campaigns for the neutrino experimental community.

Tame-Narvaez, Karla [Fermilab] (ORCID:000000022249↗

Perspectives and Questions: Toward an Expansive Agenda for Particle Physics

Global celebration greeted the 2012 discovery at CERN's Large Hadron Collider of a particle that matches the textbook description of the Higgs boson. That achievement validated a remarkable chain of theoretical reasoning that combined the prescriptive notion of electroweak gauge symmetry with a simple, but \emph{ad hoc}, embodiment of spontaneous symmetry breaking. It was made possible by generational triumphs of accelerator art and experimental technique, and by human resourcefulness and collaboration on a global scale, all sustained by the enlightened support of many governments and institutions. Some imagine that, once the keystone of the standard model of particle physics has been set, our subject is over. Others worry that we may be at an impasse because no comparable wonders have appeared, leaving us without well-defined clues to a more complete paradigm. I am neither so readily satisfied nor so {easily} discouraged: we have so much more to learn! This essay surveys many questions that, taken together, constitute an inspiring array of opportunities to enhance our understanding of the physical world.

Quigg, Chris [Fermilab] (ORCID:0000000227282445)↗

Sim-Situ: A Framework for the Faithful Simulation of in situ Processing

The amount of data generated by numerical simulations in various scientific domains led to a fundamental redesign of how the analysis and visualization of simulation outputs are performed. The throughput and capacity of storage subsystems have not evolved as fast as the computing power in extreme-scale supercomputers, making the classical post-hoc approach highly inefficient. In situ processing has then emerged as a solution in which simulation and data analysis/visualization are intertwined for better performance and greater interactivity.Determining the best allocation, i.e., how many resources to allocate to simulation and analysis respectively, mapping, i.e., where and at which frequency to run the analysis/visualization, and data transfer mode is a complex task whose performance assessment is crucial to the efficient execution of in situ processing. However, such a performance evaluation of different strategies usually relies either on directly running them on the targeted execution environments, which can rapidly become extremely time- and resource-consuming, or on resorting to simplified models of the components of an in situ application, which can lack of realism. In both cases, the validity of the performance evaluation is limited.In this paper, we present Sim-Situ, a simulation-based framework for the faithful performance evaluation of in situ processing strategies. We designed Sim-Situ to reflect the typical features of in situ processing systems. Thanks to its modular design, Sim-situ has the necessary flexibility to easily and faithfully evaluate the behavior and performance of various allocation, mapping, and data transfer strategies. We illustrate the simulation capabilities of Sim-Situ on a Molecular Dynamics use case. We study the impact of different strategies on performance and show how users can leverage Sim-Situ to determine interesting tradeoffs when adding analysis/visualization components to their application.

Honoré, Valentin↗