Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Consensus”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 379 records · Page 21
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Integrated energy-water-land nexus planning to guide national policy: an example from Uruguay

Despite broad consensus on the benefits of a nexus approach to multi-sector planning, actual implementation in government and other decision-making institutions is still rare. This study presents an approach to conducting integrated energy-water-land (EWL) planning, using Uruguay as an example. This stakeholder-driven study focuses on assessing the EWL nexus implications of actual planned policies aimed at strengthening three of Uruguay's key exports (beef, soy, and rice), which account for more than 40% of total national export revenue. Five scenarios are analyzed in the study: a reference scenario, a climate impacts scenario, and three policy scenarios. The three policy scenarios include measures such as increasing the intensity of beef production while simultaneously decreasing emissions, increasing irrigated soybean production, and improving rice yields. This study supplements previous sector-specific planning efforts in Uruguay by conducting the first stakeholder-driven integrated multi-sector assessment of planned policies in Uruguay using a suite of integrated modeling tools. Key insights from the study are: as compared to a reference scenario, improving beef productivity could lead to cropland expansion (+30%) and significant indirect increases in water requirements (+20%); improving rice yields could lead to increases in total emissions (+3%), which may partially offset emissions reductions from other policies; expanding irrigated soy could have the least EWL impacts amongst the policies studied; and climate-driven changes could have significantly less impact on EWL systems as compared to human actions. The generalizable insights derived from this analysis are readily applicable to other countries facing similar multi-sector planning challenges. In particular, the study's results reinforce the fact that policies often have multi-sector consequences, and thus policies can impact one another's efficacy. Thus, policy design and implementation can benefit from coordination across sectors and decision-making institutions.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Impacts of climate change on subannual hydropower generation: a multi-model assessment of the United States federal hydropower plant

Abstract Hydropower is a low-carbon emission renewable energy source that provides competitive and flexible electricity generation and is essential to the evolving power grid in the context of decarbonization. Assessing hydropower availability in a changing climate is technically challenging because there is a lack of consensus in the modeling representation of key dynamics across scales and processes. Focusing on 132 US federal hydropower plants, in this study we evaluate the compounded impact of climate and reservoir-hydropower models’ structural uncertainties on monthly hydropower projections. In particular, instead of relying on one single regression-based hydropower model, we introduce another conceptual reservoir operations-hydropower model in the assessment framework. This multi-model assessment approach allows us to partition uncertainties associated with both climate and hydropower models for better clarity. Results suggest that while at least 70% of the uncertainties at the annual scale and 50% at the seasonal scale can be attributed to the choice of climate models, up to 50% of seasonal variability can be attributed to the choice of hydropower models, particularly in regions over the western US where the reservoir storage is substantial. The analysis identifies regions where multi-model assessments are needed and presents a novel approach to partition uncertainties in hydropower projections. Another outcome includes an updated evaluation of Coupled Model Intercomparison Project Phase 5 (CMIP5)-based federal hydropower projection, at the monthly scale and with a larger ensemble, which can provide a baseline for understanding future assessments based on CMIP6 and beyond.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Monotonicity in the averaging process

In this work, we investigate an averaging process that describes how interacting agents approach consensus through binary interactions. In each elementary step, two agents are selected at random and they reach compromise by adopting their opinion average. We show that the fraction of agents with a monotonically decreasing opinion decays as e - αt , and that the exponent is selected as the extremum from a continuous spectrum of possible values. The opinion distribution of monotonic agents is asymmetric, and it becomes self-similar at large times. Furthermore, the tails of the opinion distribution are algebraic, and they are characterized by two distinct and nontrivial exponents. We also explore statistical properties of agents with an opinion strictly above average.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Advancing extreme pulsed lasers through measurements: summary of the pulsed laser metrology workshop

In this report we present consensus findings produced during the pulsed laser metrology (PLM) workshop (Boulder, CO, USA, August 2025). The workshop was a meeting of 35 scientists from private industry, academia, and U.S. government to compile a list of the metrology needs to support extreme pulsed laser development and implementation. We define ‘extreme pulsed lasers’ loosely as those with peak powers above 1 TW or multi-Joule pulse energies. Such lasers are being increasingly used and investigated for use in high energy particle acceleration, short wavelength radiation generation, laser-based fusion, etc. The rapid growth of these fields and the proliferation of extreme lasers for these applications, coupled with the extreme electric fields they generate and relative scarcity of such lasers, presents unique challenges to accuracy in their measurement. The PLM workshop was a two-day event designed to hear from users, developers, and researchers on the current state of optical metrology associated with these extreme pulsed lasers. The goal was to identify the most important measurement challenges limiting development and implementation of these lasers in practical applications. We report here the conclusions and recommendations of this workshop. The hope is that this document will become the first of many iterations which track the status of measurement needs supporting extreme pulsed lasers.

Lasers↗
DOE OSTI2021

How different power plant types contribute to electric grid reliability, resilience, and vulnerability: a comparative analytical framework

Abstract This work explores the dependability tradeoffs provided by the most common types of central power plants in the United States. Historically, the electricity sector has lacked consensus on how reliability , resilience , and vulnerability differ and how those metrics change depending on the power plant fleet composition. We propose distinct definitions for these metrics and an analytical framework to evaluate power plant fleet dependability. Using data analysis and literature review, we identify fifteen dependability attributes across which we rank eleven power plant types relative to natural gas combined-cycle (NGCC) plants. We use NGCC as the benchmark because it is common to many locations and is of relatively recent vintage. The framework shows that each power plant type has unique dependability benefits and drawbacks. We provide examples of how researchers may use the framework to evaluate grid dependability qualitatively under different scenarios. We find that assuming all attributes that contribute to grid dependability are equally important and additive, electric grid dependability is best supported when power plant fleets include a mixture of power generation technologies. Then, we discuss scenario characteristics that could alter the prioritization and relationships of attributes. We also find that if current capacity installation trends continue to favor low- and zero-carbon power plants, US power grids may benefit from increased resilience and reduced vulnerability at the cost of decreased reliability. We conclude by recommending methods for adapting the framework and quantifying relationships between attributes in individual scenarios.

Ramirez-Meyers, K. (ORCID:0000000291216952)↗
DOE OSTI2020

Coarse-grain cluster analysis of tensors with application to climate biome identification

A tensor provides a concise way to codify the interdependence of complex data. Treating a tensor as a d-way array, each entry records the interaction between the different indices. Clustering provides a way to parse the complexity of the data into more readily understandable information. Clustering methods are heavily dependent on the algorithm of choice, as well as the chosen hyperparameters of the algorithm. However, their sensitivity to data scales is largely unknown. In this work, we apply the discrete wavelet transform to analyze the effects of coarse-graining on clustering tensor data. We are particularly interested in understanding how scale affects clustering of the Earth's climate system. The discrete wavelet transform allows classification of the Earth's climate across a multitude of spatial-temporal scales. The discrete wavelet transform is used to produce an ensemble of classification estimates, as opposed to a single classification. Each element of the ensemble is a clustering at a different spatial-temporal scale. Information theoretic approaches are used to identify important scale lengths in clustering the L15 Climate Datset. We also discover a sub-collection of the ensemble that spans the majority of the variance observed, allowing for efficient consensus clustering techniques that can be used to identify climate biomes.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Infrastructure first principles for the Anthropocene

Abstract There appears to be a growing decoupling between the conditions that infrastructures were designed for and today’s rapidly changing environments. Infrastructures today are largely predicated on the technologies, goals, and governance structures from a century ago. While infrastructures continue to deliver untold value, there is growing evidence that these critical, basic, and lifeline systems appear ill-equipped to confront the volatility, uncertainty, accelerating conditions, and complexity that define them and their changing environments. Innovative and disruptive first principles are needed to guide infrastructures in the Anthropocene. Drawing from emerging infrastructure research and disciplines that appear better able to confront disruption and change, a novel set of first principles are identified: (1) Plan for complex conditions and surprise; (2) Recouple with agility and flexibility; (3) Govern for exploration and instability; (4) Build consensus as control decentralizes; (5) Restructure to engage with porous boundaries; and, (6) Cyberthreat planning is now mission critical. These principles should guide infrastructure planning recognizing the changing nature and increasingly obsolete boundaries that have defined engineered systems in the modern era.

Chester, Mikhail (ORCID:0000000293542102)↗
DOE OSTI2025

Future grid mix impacts on whole-building life cycle assessment

Building construction and operation are a significant contribution to global greenhouse gas emissions, so understanding and mitigating emissions is crucial for reliable and realistic emissions accounting. Whole-building Life Cycle Assessment (WBLCA) is an emissions accounting method that considers lifetime environmental impacts of a building during its construction, operation, and eventual end-of-life. When performing WBLCAs, emission calculations from the building's operation over the entire building lifespan are typically based on today's energy grid mixes. This method does not consider changes or advancements in the clean energy proportion within the grid mix and can over or under-inflate results, skewing the ratio of embodied vs. operational environmental impacts. While a variety of prediction tools estimate what future grid emissions might be, predictions can vary widely. To predict the clean energy ratio within future grid mixes and the potential impact these changes might have on WBLCA, annual data from several existing U.S. grid models was averaged and probabilistic modeling was used to extend the usable projections of shorter forecasts. Results show that clean energy sources will likely continue to increase over time, although the rate of growth varies by model. On average, by 2085, the clean energy penetration of the grid is projected to reach ~81% and renewable energy is projected to reach ~71%, although no widespread consensus is reached. To understand how the future grid mix impacts lifetime building emissions within a WBLCA context, the team analyzed two 2021 IECC-compliant all-electric residential buildings: one built from traditional materials and construction processes and the other built with carbon sequestering materials and modular assembly, with a portion of energy generated on site. The results indicate that a moderate estimate of future electricity grid mixes shows a reduction of yearly operational emissions for traditional residential buildings of 55% between 2025 and 2085, and a corresponding reduction of 48% of total emissions over a 60 year building lifespan. This study offers a nuanced approach to account for the variability of future grid mix models and provides an average trend-line based on a robust collection of scenarios.

Life Cycle Assessment (LCA)↗
DOE OSTI2025

Granger causal inference for climate change attribution

Abstract Climate change detection and attribution (D&A) is concerned with determining the extent to which anthropogenic activities have influenced specific aspects of the global climate system. D&A fits within the broader field of causal inference, the collection of statistical methods that identify cause and effect relationships. There are a wide variety of methods for making attribution statements, each of which require different types of input data and focus on different types of weather and climate events and each of which are conditional to varying extents. Some methods are based on Pearl causality (direct experimental interference) while others leverage Granger (predictive) causality, and the causal framing provides important context for how the resulting attribution conclusion should be interpreted. However, while Granger-causal attribution analyses have become more common, there is no clear statement of their strengths and weaknesses relative to Pearl-causal attribution and no clear consensus on where and when Granger-causal perspectives are appropriate. In this prospective paper, we provide a formal definition for Granger-based approaches to trend and event attribution and a clear comparison with more traditional methods for assessing the human influence on extreme weather and climate events. Broadly speaking, Granger-causal attribution statements can be constructed quickly from observations and do not require computationally-intesive dynamical experiments. These analyses also enable rapid attribution, which is useful in the aftermath of a severe weather event, and provide multiple lines of evidence for anthropogenic climate change when paired with Pearl-causal attribution. Confidence in attribution statements is increased when different methodologies arrive at similar conclusions. Moving forward, we encourage the D&A community to embrace hybrid approaches to climate change attribution that leverage the strengths of both Granger and Pearl causality.

Risser, Mark D. (ORCID:0000000319561783)↗
DOE OSTI2020

Mars Extant Life: What's Next? Conference Report

On November 5–8, 2019, the ‘‘Mars Extant Life: What’s Next?’’ conference was convened in Carlsbad, New Mexico. The conference gathered a community of actively publishing experts in disciplines related to habitability and astrobiology. Primary conclusions are as follows: A significant subset of conference attendees concluded that there is a realistic possibility that Mars hosts indigenous microbial life. A powerful theme that permeated the conference is that the key to the search for martian extant life lies in identifying and exploring refugia (‘‘oases’’), where conditions are either permanently or episodically significantly more hospitable than average. Based on our existing knowledge of Mars, conference participants highlighted four potential martian refugium (not listed in priority order): Caves, Deep Subsurface, Ices, and Salts. The conference group did not attempt to reach a consensus prioritization of these candidate environments, but instead felt that a defensible prioritization would require a future competitive process. Within the context of these candidate environments, we identified a variety of geological search strategies that could narrow the search space. Additionally, we summarized a number of measurement techniques that could be used to detect evidence of extant life (if present). Again, it was not within the scope of the conference to prioritize these measurement techniques—that is best left for the competitive process. We specifically note that the number and sensitivity of detection methods that could be implemented if samples were returned to Earth greatly exceed the methodologies that could be used at Mars. Finally, important lessons to guide extant life search processes can be derived both from experiments carried out in terrestrial laboratories and analog field sites and from theoretical modeling.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Integrating multimodal data through interpretable heterogeneous ensembles

Motivation: Integrating multimodal data represents an effective approach to predicting biomedical characteristics, such as protein functions and disease outcomes. However, existing data integration approaches do not sufficiently address the heterogeneous semantics of multimodal data. In particular, early and intermediate approaches that rely on a uniform integrated representation reinforce the consensus among the modalities but may lose exclusive local information. The alternative late integration approach that can address this challenge has not been systematically studied for biomedical problems. Results: We propose Ensemble Integration (EI) as a novel systematic implementation of the late integration approach. EI infers local predictive models from the individual data modalities using appropriate algorithms and uses heterogeneous ensemble algorithms to integrate these local models into a global predictive model. We also propose a novel interpretation method for EI models. We tested EI on the problems of predicting protein function from multimodal STRING data and mortality due to coronavirus disease 2019 (COVID-19) from multimodal data in electronic health records. We found that EI accomplished its goal of producing significantly more accurate predictions than each individual modality. It also performed better than several established early integration methods for each of these problems. The interpretation of a representative EI model for COVID-19 mortality prediction identified several disease-relevant features, such as laboratory test (blood urea nitrogen and calcium) and vital sign measurements (minimum oxygen saturation) and demographics (age). These results demonstrated the effectiveness of the EI framework for biomedical data integration and predictive modeling.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

Engineering of xylose metabolic pathways in Rhodotorula toruloides for sustainable biomanufacturing

Abstract The oleaginous yeast Rhodotorula toruloides is a promising microbial cell factory for the sustainable production of biofuels and value-added chemicals from renewable carbon sources. Unlike the conventional yeast Saccharomyces cerevisiae, R. toruloides can naturally metabolize xylose, the second most abundant sugar in lignocellulosic hydrolysates. However, its native xylose metabolism is inefficient, characterized by slow xylose uptake and accumulation of D-arabitol. Moreover, despite its phenotype, research on the enzymes involved in xylose metabolism has yet to reach a consensus. Therefore, this review provides a comprehensive analysis of the non-canonical xylose metabolism in R. toruloides, focusing on the properties of key enzymes involved in xylose metabolism. Native xylose reductase and xylitol dehydrogenase exhibit broad substrate promiscuity compared to their counterparts in the xylose-fermenting Scheffersomyces stipitis. Additionally, the absence of xylulokinase expression under xylose-utilizing conditions redirects metabolism toward D-arabitol accumulation. Consequently, D-arabitol dehydrogenases and ribulokinase play essential roles in the xylose metabolism of R. toruloides. These findings highlight the fundamental differences between R. toruloides xylose metabolism and the oxidoreductase pathways observed in other xylose-fermenting yeast, providing insights for metabolic engineering strategies to improve xylose utilization and enhance bioconversion of cellulosic hydrolysates to different bioproducts by R. toruloides.

Biotechnology & Applied Microbiology↗
DOE OSTI2021

Nonadditive gene expression is correlated with nonadditive phenotypic expression in interspecific triploid hybrids of willow ( Salix spp.)

Many studies have highlighted the complex and diverse basis for heterosis in inbred crops. Despite the lack of a consensus model, it is vital that we turn our attention to understanding heterosis in undomesticated, heterozygous, and polyploid species, such as willow (Salix spp.). Shrub willow is a dedicated energy crop bred to be fast-growing and high yielding on marginal land without competing with food crops. A trend in willow breeding is the consistent pattern of heterosis in triploids produced from crosses between diploid and tetraploid species. Here, we test whether differentially expressed genes are associated with heterosis in triploid families derived from diploid Salix purpurea, diploid Salix viminalis, and tetraploid Salix miyabeana parents. Three biological replicates of shoot tips from all family progeny and parents were collected after 12 weeks in the greenhouse and RNA extracted for RNA-Seq analysis. This study provides evidence that nonadditive patterns of gene expression are correlated with nonadditive phenotypic expression in interspecific triploid hybrids of willow. Expression-level dominance was most correlated with heterosis for biomass yield traits and was highly enriched for processes involved in starch and sucrose metabolism. In addition, there was a global dosage effect of parent alleles in triploid hybrids, with expression proportional to copy number variation. Importantly, differentially expressed genes between family parents were most predictive of heterosis for both field and greenhouse collected traits. Altogether, these data will be used to progress models of heterosis to complement the growing genomic resources available for the improvement of heterozygous perennial bioenergy crops.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Seismic anisotropy, dominant slip systems and phase transitions in the lowermost mantle

SUMMARY The presence of seismic anisotropy at the base of the Earth's mantle is well established, but there is no consensus on the deformation mechanisms in lower mantle minerals that could explain it. Strong anisotropy in magnesium post-perovskite (pPv) has been invoked, but different studies disagree on the dominant slip systems at play. Here, we aim to further constrain this by implementing the most recent results from atomistic models and high-pressure deformation experiments, coupled with a realistic composition and a 3-D geodynamic model, to compare the resulting deformation-induced anisotropy with seismic observations of the lowermost mantle. We account for forward and reverse phase transitions from bridgmanite (Pv) to pPv. We find that pPv with either dominant (001) or (010) slip can both explain the seismically observed anisotropy in colder regions where downwellings turn to horizontal flow, but only a model with dominant (001) slip matches seismic observations at the root of hotter large-scale upwellings. Allowing for partial melt does not change these conclusions, while it significantly increases the strength of anisotropy and reduces shear and compressional velocities at the base of upwellings.

58 GEOSCIENCES↗
DOE OSTI2021

Ethical, legal and social implications of human genome studies in radiation research: a workshop report for studies on atomic bomb survivors at the Radiation Effects Research Foundation

The Radiation Effects Research Foundation (RERF) is the primary organization in Japan dedicated to studying the health consequences of the Hiroshima and Nagasaki atomic bombings in World War II. In December 2020, RERF held a virtual international workshop on the ethical, legal and social implications (ELSI) of genome studies. In this workshop, the ELSI considerations of future human genome studies on radiation research including atomic bomb survivors and their families were discussed. Since genome sequencing (GS) is now practical and affordable, RERF now plans GS of parents/child trios to examine genetic effects of atomic bomb radiation. As such studies may engender some novel risks and benefits, ethics review and engagement with families (including consent) need to be considered. These include protection of individual privacy, use of samples from deceased prior participants, return of results to the participants, public sharing of genome data and advance science and social welfare. Specifically with regard to social welfare, the results of such studies may have implications for public and government decision-making regarding social benefits of victims and other important questions. Based on these broad-ranging discussions we have developed the following concepts to guide this work: “trust,” “compromise” and “relationship building,” inclusive of the concerned stakeholders, scientific aims and Japanese society at large. We conclude that in order to realize, establish and maintain these concepts, it is essential to put procedures into place to ensure the successful, consensus-based implementation of the RERF studies.

63 RADIATION, THERMAL, AND OTHER ENVIRON. POLLUTAN↗
DOE OSTI2024

The Dynamic Assimilation Technique measures photosynthetic CO 2 response curves with similar fidelity to steady-state approaches in half the time

The net CO 2 assimilation (A) response to intercellular CO 2 concentration (C i ) is a fundamental measurement in photosynthesis and plant physiology research. The conventional A/C i protocols rely on steady-state measurements and take 15–40 min per measurement, limiting data resolution or biological replication. Additionally, there are several CO 2 protocols employed across the literature, without clear consensus as to the optimal protocol or systematic biases in their estimations. We compared the non-steady-state Dynamic Assimilation Technique (DAT) protocol and the three most used CO 2 protocols in steady-state measurements, and tested whether different CO 2 protocols lead to systematic differences in estimations of the biochemical limitations to photosynthesis. The DAT protocol reduced the measurement time by almost half without compromising estimation accuracy or precision. The monotonic protocol was the fastest steady-state method. Estimations of biochemical limitations to photosynthesis were very consistent across all CO 2 protocols, with slight differences in Rubisco carboxylation limitation. The A/C i curves were not affected by the direction of the change of CO 2 concentration but rather the time spent under triose phosphate utilization (TPU)-limited conditions. Our results suggest that the maximum rate of Rubisco carboxylation (V cmax ), linear electron flow for NADPH supply (J), and TPU measured using different protocols within the literature are comparable, or at least not systematically different based on the measurement protocol used.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

The Completed SDSS-IV extended Baryon Oscillation Spectroscopic Survey: measurement of the BAO and growth rate of structure of the luminous red galaxy sample from the anisotropic power spectrum between redshifts 0.6 and 1.0

ABSTRACT We analyse the clustering of the Sloan Digital Sky Survey IV extended Baryon Oscillation Spectroscopic Survey Data Release 16 luminous red galaxy sample (DR16 eBOSS LRG) in combination with the high redshift tail of the Sloan Digital Sky Survey III Baryon Oscillation Spectroscopic Survey Data Release 12 (DR12 BOSS CMASS). We measure the redshift space distortions (RSD) and also extract the longitudinal and transverse baryonic acoustic oscillation (BAO) scale from the anisotropic power spectrum signal inferred from 377 458 galaxies between redshifts 0.6 and 1.0, with the effective redshift of zeff = 0.698 and effective comoving volume of $2.72\, {\rm Gpc}^3$. After applying reconstruction, we measure the BAO scale and infer DH(zeff)/rdrag = 19.30 ± 0.56 and DM(zeff)/rdrag = 17.86 ± 0.37. When we perform an RSD analysis on the pre-reconstructed catalogue on the monopole, quadrupole, and hexadecapole we find, DH(zeff)/rdrag = 20.18 ± 0.78, DM(zeff)/rdrag = 17.49 ± 0.52 and fσ8(zeff) = 0.454 ± 0.046. We combine both sets of results along with the measurements in configuration space and report the following consensus values: DH(zeff)/rdrag = 19.77 ± 0.47, DM(zeff)/rdrag = 17.65 ± 0.30 and fσ8(zeff) = 0.473 ± 0.044, which are in full agreement with the standard ΛCDM and GR predictions. These results represent the most precise measurements within the redshift range 0.6 ≤ z ≤ 1.0 and are the culmination of more than 8 yr of SDSS observations.

Gil-Marín, Héctor↗
DOE OSTI2020

Evaluation of probabilistic photometric redshift estimation approaches for The Rubin Observatory Legacy Survey of Space and Time (LSST)

Many scientific investigations of photometric galaxy surveys require redshift estimates, whose uncertainty properties are best encapsulated by photometric redshift (photo-z) posterior probability density functions (PDFs). A plethora of photo-z PDF estimation methodologies abound, producing discrepant results with no consensus on a preferred approach. We present the results of a comprehensive experiment comparing twelve photo-z algorithms applied to mock data produced forLarge Synoptic Survey Telescope The Rubin Observatory Legacy Survey of Space and Time (lsst) Dark Energy Science Collaboration (desc). By supplying perfect prior information, in the form of the complete template library and a representative training set as inputs to each code, we demonstrate the impact of the assumptions underlying each technique on the output photo-z PDFs. In the absence of a notion of true, unbiased photo-z PDFs, we evaluate and interpret multiple metrics of the ensemble properties of the derived photo-z PDFs as well as traditional reductions to photo-z point estimates. Additionally, we report systematic biases and overall over/under-breadth of the photo-z PDFs of many popular codes, which may indicate avenues for improvement in the algorithms or implementations. Furthermore, we raise attention to the limitations of established metrics for assessing photo-z PDF accuracy; though we identify the conditional density estimate (CDE) loss as a promising metric of photo-z PDF performance in the case where true redshifts are available but true photo-z PDFs are not, we emphasize the need for science-specific performance metrics.

79 ASTRONOMY AND ASTROPHYSICS↗