Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Benchmark testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,081 records · Page 60
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Dynamic Structure of Magnetized High Energy Density Plasmas (Final Report)

This report summarizes results of project DE-SC0022202 ``Dynamic Structure of Magnetized High Energy Density Plasmas,'' which was originally funded for the period 08/01/2021 - 7/31/2022, but was no-cost extended to 7/31/2023. The primary objectives of the work, as stated in the original proposal, were ``develop a theory to describe a novel state of magnetized high energy density plasmas, benchmark the theory using first-principles molecular dynamics simulations, and apply the results to develop a means to interpret x-ray scattering measurements in future experiments.'' These were the goals of the original project proposal, which was for a 3 year project. The project was ultimately funded for 1 year, and so the work completed focused on the goals described for only the first year of the proposed work. This included further developing a kinetic theory for strongly magnetized plasmas, applying it to compute fluid-scale (MHD) transport coefficients, and to test the predictions using molecular dynamics simulations.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2024

VLM4Bio: A Benchmark Dataset to Evaluate Pretrained Vision-Language Models for Trait Discovery from Biological Images

Images are increasingly becoming the currency for documenting biodiversity on the planet, providing novel opportunities for accelerating scientific discoveries in the field of organismal biology, especially with the advent of large vision-language models (VLMs). We ask if pre-trained VLMs can aid scientists in answering a range of biologically relevant questions without any additional fine-tuning. In this paper, we evaluate the effectiveness of 12 state-of-the-art (SOTA) VLMs in the field of organismal biology using a novel dataset, VLM4Bio, consisting of 469K question8 answer pairs involving 30K images from three groups of organisms: fishes, birds, and butterflies, covering five biologically relevant tasks. We also explore the effects of applying prompting techniques and tests for reasoning hallucination on the performance of VLMs, shedding new light on the capabilities of current SOTA VLMs in answering biologically relevant questions using images

Maruf, M [Virginia Tech, Blacksburg]↗
DOE OSTI2021

Balanced k -means clustering on an adiabatic quantum computer

Adiabatic quantum computers are a promising platform for efficiently solving challenging optimization problems. Therefore, many are interested in using these computers to train computationally expensive machine learning models. We present a quantum approach to solving the balanced k-means clustering training problem on the D-Wave 2000Q adiabatic quantum computer. In order to do this, we formulate the training problem as a quadratic unconstrained binary optimization (QUBO) problem. Unlike existing classical algorithms, our QUBO formulation targets the global solution to the balanced k-means model. We test our approach on a number of small problems and observe that despite the theoretical benefits of the QUBO formulation, the clustering solution obtained by a modern quantum computer is usually inferior to the solution obtained by the best classical clustering algorithms. Nevertheless, the solutions provided by the quantum computer do exhibit some promising characteristics. We also perform a scalability study to estimate the run time of our approach on large problems using future quantum hardware. Finally, as a final proof of concept, we used the quantum approach to cluster random subsets of the Iris benchmark data set.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Water vapor oxidation behaviors of nuclear graphite IG-110 for a postulated accident scenario in high temperature gas-cooled reactors

Water leakage in accidental conditions of high temperature gas-cooled reactors is one of the most critical problems that can compromise the integrity of different nuclear components. In this study, oxidation behaviors of nuclear graphite IG-110 in water ingress accidental conditions were investigated. Mass loss and oxidation rates were evaluated after oxidation tests at temperatures up to 1400 °C in an Ar-20 vol% H 2 O mixed atmosphere. The activation energy decreased from 318.6 to 148.9 kJ/mol with temperature, indicating two different oxidation regimes. The cross-sections of the oxidized samples were systematically characterized. The corresponding logarithmic porosity profiles showed a temperature dependency. Pore formation moved toward near-surface regions with increasing temperature and preferential binder oxidation, with filler particle degradation. Furthermore, oxidant concentration profiles and oxidation depths were estimated using a theoretical model and compared with the experimental results. This work provides important benchmark data and safety analysis guidance for the accident scenario in high temperature gas-cooled reactors.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2021

Open Data and Deep Semantic Segmentation for Automated Extraction of Building Footprints

Advances in machine learning and computer vision, combined with increased access to unstructured data (e.g., images and text), have created an opportunity for automated extraction of building characteristics, cost-effectively, and at scale. These characteristics are relevant to a variety of urban and energy applications, yet are time consuming and costly to acquire with today’s manual methods. Several recent research studies have shown that in comparison to more traditional methods that are based on features engineering approach, an end-to-end learning approach based on deep learning algorithms significantly improved the accuracy of automatic building footprint extraction from remote sensing images. However, these studies used limited benchmark datasets that have been carefully curated and labeled. How the accuracy of these deep learning-based approach holds when using less curated training data has not received enough attention. The aim of this work is to leverage the openly available data to automatically generate a larger training dataset with more variability in term of regions and type of cities, which can be used to build more accurate deep learning models. In contrast to most benchmark datasets, the gathered data have not been manually curated. Thus, the training dataset is not perfectly clean in terms of remote sensing images exactly matching the ground truth building’s foot-print. A workflow that includes data pre-processing, deep learning semantic segmentation modeling, and results post-processing is introduced and applied to a dataset that include remote sensing images from 15 cities and five counties from various region of the USA, which include 8,607,677 buildings. The accuracy of the proposed approach was measured on an out of sample testing dataset corresponding to 364,000 buildings from three USA cities. The results favorably compared to those obtained from Microsoft’s recently released US building footprint dataset.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Optimal Power Flow Derived Sparse Linear Solver Benchmarks

Due to the changing nature of the power grid, it is increasingly important to be able to solve a high-fidelity optimal power-flow models on large power networks. This high-fidelity problem, called AC Optimal Power Flow (ACOPF), is a nonlinear, nonconvex optimization problem. One of the few reliable ways of solving such a problem is interior point methods. These methods result in sparse linear systems where the coefficient matrix is symmetric, indefinite and nearly always ill-conditioned. As such, they are particularly challenging for sparse linear solvers and represent a considerable computational bottleneck in solving the ACOPF problem. In this paper, we introduce a repository of linear systems captured from ACOPF problems when solved by the open-source optimizer IPOPT. These matrices are meant to be used as a test suite for sparse linear solver development.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Verification and validation testing and tools: comparison between MCNP code versions and nuclear data libraries [Slides]

This presentation discusses the primary goal of software testing which is to test the code for correctness. It also discusses the results for individual suites and the role of validation and verification also referred to in the presentation as V&V. In summation, the V&V framework enables easy comparison between calculations performed with different code versions and/or nuclear data libraries. This entire framework will be distributed with the upcoming MCNP6.3 release. V&V test suites shown and several that were not (Criticality, LAQGSM, Lockwood) will be distributed in the new framework.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2023

A Novel Spatio-Temporal Regime Tracking Method for Impact Simulations

In this proposal, we present a novel method of tracking the rheological regimes activated during impact cratering events that will allow researchers to gain new insights into cratering mechanics. Rheology describes the stress-strain response of rocks to different conditions. Planetary impact cratering events often occur on too large of a scale to be feasibly captured in controlled experiments. Instead, these dynamic events are primarily studied using multi-physics codes equipped with complex material models that enable calculations of the impact event at scale. However, determining which physical processes are required for the problem of interest is challenging. Because the dominant rheological regimes change with space and time during crater formation, it is difficult to link numerical simulations with observable features of craters at the end of the event. The basis of this work is the implementation of numerical flags that track the activation of each rheological regime throughout impact simulations. We demonstrate this with the ‘Rock Model’ implemented in the CTH shock-physics code. We will use this rheology tracking method to ’zoom in’ on a specific region within an event and track the conditions the rock experiences over time. This work will develop community benchmarks to validate and distribute our implemented rheological models. We will focus on improving the melt models used by the planetary impact modeling community by developing an EOS-aware rheological transition from solid to melt. Through analysis of cell and tracer-particle based tracking data, we will study the effects of different rheologies on modeled outcomes, particularly on the volume and distributions of impacts melts. We will also use this method to link observable features with the rheological mechanisms responsible for them. The deliverables (peer-reviewed papers) from the proposed work are (i) tests of the implemented rheologic processes and demonstrations of the tracking flags; (ii) the first calculations of the spatio-temporal evolution of the dominant rheologies during impact cratering events; and (iii) application to delivery of impactor iron during basin-scale impacts.

58 GEOSCIENCES↗
DOE OSTI2024

Transcriptomics-Based Points of Departure for Daphnia magna Exposed to 18 Per- and Polyfluoroalkyl Substances

Here, per- and polyfluoroalkyl substances (PFAS) represent a large group of contaminants of concern based on their widespread use, environmental persistence, and potential toxicity. Many traditional models for estimating toxicity, bioaccumulation, and other toxicological properties are not well suited for PFAS. Consequently, there is a need to generate hazard information for PFAS in an efficient and cost-effective manner. In the present study, Daphnia magna were exposed to multiple concentrations of 22 different PFAS for 24 h, in 96-well plate format. Following exposure, whole body RNA was extracted and extracts, each representing five exposed individuals, were subjected to RNA sequencing. Following analytical measurements to verify PFAS exposure concentrations, and quality control on processed cDNA libraries for sequencing, concentration-response modeling was applied to the data sets for 18 of the tested compounds, and the concentration at which a concerted molecular response occurred (transcriptomic point of departure; tPOD) was calculated. The tPODs, based on measured concentrations of PFAS, generally ranged from 0.03-0.58 µM (9.9-350 µg/L; interquartile range). In most cases, these concentrations were two orders of magnitude lower than similarly calculated tPODs for human cell lines exposed to PFAS. They were also lower than apical effect concentrations reported for seven PFAS for which some crustacean or invertebrate toxicity data were available, although there were a few exceptions. Despite being lower than most other available hazard benchmarks, Daphnia magna tPODs were, on average, four orders of magnitude greater than the maximum aqueous concentrations of PFAS measured in Great Lakes tributaries. Overall, this high throughput transcriptomics assay with Daphnia magna holds promise as a component of a tiered hazard evaluation strategy employing new approach methodologies.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Chromium evaporation and oxidation characteristics of alumina-forming austenitic stainless steels for balance of plant applications in solid oxide fuel cells

The chromium (Cr) evaporation behavior of several different types of iron (Fe)-based AFA alloys and benchmark Cr 2 O 3 -forming Fe-based 310 and Ni-based 625 alloys was investigated for 500 h exposures at 800 °C to 900 °C in air with 10% H 2 O. The Cr evaporation rates from alumina-forming austenitic (AFA) alloys were ~5 to 35 times lower than that of the Cr 2 O 3 -forming alloys depending on alloy and temperature. The Cr evaporation behavior was correlated with extensive characterization of the chemistry and microstructure of the oxide scales, which also revealed a degree of quartz tube Si contamination during the test. As a result, long-term oxidation kinetics were also assessed at 800 to 1000 °C for up to 10,000 h in air with 10% H 2 O to provide further guidance for SOFC BOP component alloy selection.

08 HYDROGEN↗
DOE OSTI2022

Porting the Kitten Lightweight Kernel Operating System to RISC-V

Hardware design in high-performance computing (HPC) is often highly experimental. Exploring new designs is difficult and time-consuming, requiring lengthy vendor cooperation. RISC-V is an open-source processor ISA that improves the accessibility of chip design, including the ability to do hardware/software co-design using open-source hardware and tools. Co-design allows design decisions to easily flow across the hardware/software boundary and influence future design ideas. However, new hardware designs require corresponding software to drive and test them. Conventional operating systems like Linux are massively complex and modification is time-prohibitive. In this paper, we describe our port of the Kitten lightweight kernel operating system to RISC-V in order to provide an alternative to Linux for conducting co-design research. Kitten's small code base and simple resource management policies are well matched for quickly exploring new hardware ideas that may require radical operating system modifications and restructuring. Our evaluation shows that Kitten on RISC-V is functional and provides similar performance to Linux for single-core benchmarks. This provides a solid foundation for using Kitten in future co-design research involving RISC-V.

Gordon, Nick↗
DOE OSTI2022

Benchmarking Demand Flexibility in Commercial Buildings and Flattening the Duck – Addressing Baseline and Commissioning Challenges

With the transition from our traditional electric grid to a cleaner grid with renewable power generation, there is a need to enable building loads to be flexible. Load shedding and shifting will be essential for flattening the “Duck” for decarbonization. This paper explored the trend in the timing of DR events as a reflection of the grid’s needs using recent four years of event data from 203 retail stores in 11 states. The events are becoming significantly shorter with 2-hour duration being the most popular; shifting to late afternoon and early evening is another trend beyond California. Benchmarking will be essential for accounting DF as a reliable grid resource. This paper addresses a challenging aspect of benchmarking – inaccuracies in counterfactual baseline methods can introduce significant DF metrics variations in addition to weather and building characteristics related factors. The conventional “10/10” with adjustment baseline method has inherent limitation by design for load shifting applications. Therefore, it is imperative to identify alternative methods. This study compared three hourly regression baseline methods with “10/10” methods using two groups of commercial buildings that participated in DR programs: (1) 121 big-box retail stores, and (2) 11 office buildings in CA. The 14-day hourly outdoor temperature regression method was found to produce least error in the tested datasets and is promising for load shifting. The paper also pointed out that commissioning issues can also be a significant barrier for achieving consistent DF performance, which building managers and utilities should be aware of.

Liu, Jingjing↗
DOE OSTI2021

Verification and Validation Tests of Gamma Library of MC2-3 for Coupled Neutron and Gamma Heating Calculation

For the accurate assessment of the heat generation rate in fast reactors, the gamma library of MC2 -3 and the MC2 -3 + GAMSOR procedure employing the coupled neutron and gamma heating calculation has been thoroughly verified against Monte Carlo results and validated using the ZPPR-15D gamma dose measurement data. NJOY outputs are post-processed in a consistent way with the NJOY procedure to avoid any missing data or double counting of data. Prompt heating for 379 out of 391 isotopes in the gamma library was verified against MCNP6.2 to within 1% relative error in total heating for most isotopes. For both a simple one-dimensional slab problem representing a sodium cooled fast reactor and the Experimental Breeder Reactor II (EBR-II) benchmark problem, the root-mean-square values of assembly power error were less than 0.5% for fuel assemblies, ~1% in blankets and ~1 to ~3% in reflectors compared to MCNP6.2 results. The most plausible cause for the 3% error in a reflector assembly is believed to be the error in the multigroup neutron cross sections for the reflector assembly. For validation, gamma doses measured with thermoluminiscent dosimeters (TLDs) in the ZPPR-15D experiment were calculated using GAMSOR. Due to the uncertainty in the TLD measurement with regards to the energy deposition of photons and neutrons, the validation data leads to a 12.7% uncertainty on the experimental measurement. With this uncertainty bound, the calculated doses all fell within one standard deviation of the measured value. Combined with the accurate calculation of reaction rate distributions and neutron spectrum measurements, these results indicate good agreement for the neutron and gamma heating calculations that were performed.

coupled neutron and gamma heating↗
DOE OSTI2025

Temporal Forecasting of Distributed Temperature Sensing in a Thermal Hydraulic System With Machine Learning and Statistical Models

We benchmark performance of long-short term memory (LSTM) network machine learning model and autoregressive integrated moving average (ARIMA) statistical model in temporal forecasting of distributed temperature sensing (DTS). Data in this study consists of fluid temperature transient measured with two co-located Rayleigh scattering fiber optic sensors (FOS) in a forced convection mixing zone of a thermal tee. We treat each gauge of a FOS as an independent temperature sensor. We first study prediction of DTS time series using Vanilla LSTM and ARIMA models trained on prior history of the same FOS that is used for testing. The results yield maximum absolute percentage error (MaxAPE) and root mean squared percentage error (RMSPE) of 1.58% and 0.06% for ARIMA, and 3.14% and 0.44% for LSTM, respectively. Next, we investigate zero-shot forecasting (ZSF) with LSTM and ARIMA trained on history of the co-located FOS only, which is advantageous when limited training data is available. The ZSF MaxAPE and RMSPE values for ARIMA are comparable to those of the Vanilla use case, while the error values for LSTM increase. We show that in ZSF, performance of LSTM network can be improved by training on most correlated gauges between the two FOS, which are identified by calculating the Pearson correlation coefficient. The improved ZSF MaxAPE and RMSPE for LSTM are 4.4% and 0.33%, respectively. Performance of ZSF LSTM can be further enhanced through transfer learning (TL), where LSTM is re-trained on a subset of the FOS that is the target of forecasting. We show that LSTM pre-trained on correlated dataset and re-trained on 30% of testing target dataset achieves MaxAPE and RMSPE values of 2.32% and 0.28%, respectively.

ARIMA↗
DOE OSTI2022

Guidelines for Publicly Archiving Terrestrial Model Data to Enhance Usability, Intercomparison, and Synthesis

Scientific communities are increasingly publishing data to evaluate, accredit, and build on published research. However, guidelines for curating data for publication are sparse for model-related research, limiting the usability of archived simulation data. In particular, there are no established guidelines for archiving data related to terrestrial models that simulate land processes and their coupled interactions with climate. Terrestrial modelers have a unique set of challenges when publishing data due to the diversity of scientific domains, research questions, and the types and scales of simulations. Researchers in the U.S. Department of Energy’s (DOE) projects use a variety of multiscale models to advance robust predictions of terrestrial and subsurface ecosystem processes. Here, we synthesize archiving needs for data associated with different DOE models, and provide guidelines for publishing terrestrial model data components following FAIR (Findable, Accessible, Interoperable, Reusable) principles. The guidelines recommend archiving model inputs and testing data used in final simulation runs along with associated codes, workflow scripts, and metadata in public repositories. Researchers should consider archiving model outputs if they are within the storage limits of the repository. We also provide considerations for how to bundle files into different data publications with citable digital object identifiers. Finally, we identify repository features and tools that would enable storage and reuse of model data. Given the diversity of DOE terrestrial models, these guidelines are transferable to other model types and will enable efficient reuse of simulation data for purposes such as model intercomparisons, initialization, benchmarking, synthesis, and comparisons with field observations.

58 GEOSCIENCES↗
DOE OSTI2022

Case Study: NREL Campus Chilled Water Storage Potential: Benchmark Datasets Development and Applications, Task 4 - Use Case Demonstration

The Benchmark Datasets Development and Applications project is a three-year collaboration between the National Renewable Energy Laboratory (NREL), Oak Ridge National Laboratory, Pacific Northwest National Laboratory, and Lawrence Berkeley National Laboratory. The project seeks to collect and curate high-resolution, well-calibrated time series of building operational and indoor/outdoor environmental data, which are crucial to understanding and optimizing building energy efficiency performance and demand flexibility capabilities as well as benchmarking energy algorithms. Project outcomes include approximately twelve high-fidelity building datasets, enhanced data representation tools, and four case studies to illustrate example applications. The goal of these case studies is to define and execute analyses that demonstrate how one or more datasets collected through this project can address a data gap or challenge historically faced by building stakeholders. This technical paper summarizes the findings of one of these case studies, in which we studied the operational efficiencies of the central cooling system at NREL. We looked at three years of data from the three chillers in the Field Test Laboratory Building (FTLB), from 2019 to 2021, to compare equipment operation and demand throughout the time period. Our analysis indicates that all three chillers are operating at or below the optimal loading conditions for most of the operation time, and thus there was no efficiency drop due to loading of the chillers at full capacity. Our recommendation is that no chiller capacity increase is needed; instead, the central plant could benefit from adopting advanced control logics for optimal sequencing of chillers during part load operations. Analysis of adding chilled water thermal storage to the central plant indicated 34% savings in demand cost and 24.5% savings in total cost (energy consumption and demand charge cost). The payback period is estimated to be 11-22 years with an assumed TES cost of $\$$100-$200 per ton. This case study shows how a selected dataset is used to solve a practical building problem - learning the operational status of its components, analyzing the effectiveness of a proposed new technique, and aiding decision-making for the building operations and maintenance team.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2023

Assessment of Sodium Thermal Stratification Models Utilizing the TSTF Benchmark

As a result of certain transient scenarios, a thermally stratified layer of liquid sodium can develop in the bulk coolant volumes of a sodium-cooled fast reactor (SFR). In addition to the effects a stratification layer has on the temperature of the heat transport system, a stratification layer can also influence the transition to and establishment of natural circulation flow, which plays an important role in passive cooling and the inherent safety of a pool-type SFR. Therefore, the ability to accurately capture thermal stratification phenomena is important when demonstrating the safety basis of a pool-type SFR during transient sequences. The present work assesses various computational models with different fidelities in their ability to predict thermal stratification in the upper plenum of an SFR. Each computational model will be assessed using the data generated at the Thermal Stratification Test Facility (TSTF) located at the University of Wisconsin-Madison. Using measured flow rate and inlet temperature data, the measured temperature distributions of the tests are compared to the predictions of the lumped volume-based models in SAS4A/SASSYS-1, a 1D-based model in SAM, and a 3-D computational fluid dynamics (CFD) model using STAR-CCM+. The relative performance of the various computational methods is assessed with respect to key metrics such as bulk coolant temperature distribution and plenum exit temperature. A total of eight tests are analyzed, covering different combinations of flow rates (3 and 10 GPM) and upper internal structure (UIS) configurations (none, solid, porous, and open) The perfect mixing model of SAS4A/SASSYS-1 provides the highest accuracy when the flow rate is high and there is no UIS in the test vessel, as high flow rate injection promotes thermal mixing of the sodium in the test vessel. For most of the analyzed tests, the stratified volume model of SAS4A/SASSYS-1 is able to predict the delay in the outlet temperature drop and temperature distribution in the test vessel by a small number of layers to represent thermal stratification. However, the stratified volume model can only simulate a maximum of three temperature layers within a volume and when a layer approaches the elevation of the outlet, the predicted outlet temperature can demonstrate rapid, non-physical changes. The 1-D axial mixing model of SAM provides results that agree reasonably well with the measured data in the prediction of the temporal evolution of the outlet temperature with the exception of the case with a high flow rate and no UIS. The SAM 1-D model has a similar level of accuracy to CFD results when it comes to predicting the outlet temperature. CFD shows overall good agreement in predicting the temperature distribution in the test vessel and outlet temperature. As CFD can model the test vessel geometry in detail, it performs well in the cases of complex geometries such as tests that included a UIS and internal flow through the UIS resulting in active mixing of the coolant in the test vessel. Each of the models discussed in the present work has the potential to be useful during the various stages of reactor design, analysis, and licensing. The lumped-volume approach can be applied for fast turnaround safety calculations to obtain overall reactor behavior during transients. The 1-D models provide improved accuracy when stratification is expected for a relatively low increase in the computational cost. The CFD model can be utilized for confirmatory analysis of the 1-D model, when experimental measurements are not available.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2022

DMC-ICE13 : Ambient and high pressure polymorphs of ice from diffusion Monte Carlo and density functional theory

Ice is one of the most important and interesting molecular crystals, exhibiting a rich and evolving phase diagram. Recent discoveries mean that there are now 20 distinct polymorphs; a structural diversity that arises from a delicate interplay of hydrogen bonding and van der Waals dispersion forces. This wealth of structures provides a stern test of electronic structure theories, with Density Functional Theory (DFT) often not able to accurately characterize the relative energies of the various ice polymorphs. Thanks to recent advances that enable the accurate and efficient treatment of molecular crystals with Diffusion Monte Carlo (DMC), we present here the DMC-ICE13 dataset; a dataset of lattice energies of 13 ice polymorphs. This dataset encompasses the full structural complexity found in the ambient and high-pressure molecular ice polymorphs, and when experimental reference energies are available, our DMC results deliver sub-chemical accuracy. Using this dataset, we then perform an extensive benchmark of a broad range of DFT functionals. Of the functionals considered, revPBE-D3 and RSCAN reproduce reference absolute lattice energies with the smallest error, while optB86b-vdW and SCAN+rVV10 have the best performance on the relative lattice energies. Our results suggest that a single functional achieving reliable performance for all phases is still missing, and that care is needed in the selection of the most appropriate functional for the desired application. The insights obtained here may also be relevant to liquid water and other hydrogen-bonded and dispersion-bonded molecular crystals.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗