Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “population count”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Evaluation of an autonomous acoustic surveying technique for grassland bird communities in Nebraska

Monitoring trends in wildlife communities is integral to making informed land management decisions and applying conservation strategies. Birds inhabit most niches in every environment and because of this they are widely accepted as an indicator species for environmental health. Traditionally, point counts are the common method to survey bird populations, however, passive acoustic monitoring approaches using autonomous recording units have been shown to be cost-effective alternatives to point count surveys. Advancements in automatic acoustic classification technologies, such as BirdNET, can aid in these efforts by quickly processing large volumes of acoustic recordings to identify bird species. While the utility of BirdNET has been demonstrated in several applications, there is little understanding of its effectiveness in surveying declining grassland birds. We conducted a study to evaluate the performance of BirdNET to survey grassland bird communities in Nebraska by comparing this automated approach to point count surveys. We deployed ten autonomous recording units from March through September 2022: five recorders in row-crop fields and five recorders in perennial grassland fields. During this study period, we visited each site three times to conduct point count surveys. We compared focal grassland bird species richness between point count surveys and the autonomous recording units at two different temporal scales and at six different confidence thresholds. Total species richness (focal and non-focal) for both methods was also compared at five different confidence thresholds using species accumulation curves. The results from this study demonstrate the usefulness of BirdNET at estimating long-term grassland bird species richness at default confidence scores, however, obtaining accurate abundance estimates for uncommon bird species may require validation with traditional methods.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Staged progression epidemic models for the transmission of invasive nontyphoidal Salmonella (iNTS) with treatment

We develop and analyze a stage-progression compartmental model to study the emerging invasive nontyphoidal Salmonella (iNTS) epidemic in sub-Saharan Africa. iNTS bloodstream infections are often fatal, and the diverse and non-specific clinical features of iNTS make it difficult to diagnose. We focus our study on identifying approaches that can reduce the incidence of new infections. In sub-Saharan Africa, transmission and mortality are correlated with the ongoing HIV epidemic and severe malnutrition. We use our model to quantify the impact that increasing antiretroviral therapy (ART) for HIV infected adults and reducing malnutrition in children would have on mortality from iNTS in the population. We consider immunocompromised subpopulations in the region with major risk factors for mortality, such as malaria and malnutrition among children and HIV infection and ART coverage in both children and adults. We parameterize the progression rates between infection stages using the branching probabilities and estimated time spent at each stage. We interpret the basic reproduction number R 0 as the total contribution from an infinite infection loop produced by the asymptomatic carriers in the infection chain. The results indicate that the asymptomatic HIV+ adults without ART serve as the driving force of infection for the iNTS epidemic. We conclude that the worst disease outcome is among the pediatric population, which has the highest infection rates and death counts. Our sensitivity analysis indicates that the most effective strategies to reduce iNTS mortality in the studied population are to improve the ART coverage among high-risk HIV+ adults and reduce malnutrition among children.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

LandScan Global 30 Arcsecond Annual Global Gridded Population Datasets from 2000 to 2022

Abstract Oak Ridge National Laboratory (ORNL) annually develops the LandScan Global (LSG) dataset, a 30 arcsecond global gridded population dataset representing global ambient human population distribution. This multivariable dasymetric model disaggregates census counts within administrative boundaries using ancillary data. Each country’s distribution reflects cultural and socioeconomic patterns; manual validations yield a unique global dataset for assessing populations at risk. For over two decades, LSG has been a standard for estimating populations at risk, aiding U.S. federal government, academia and humanitarian organizations. During disasters such as the 2004 Indian Ocean tsunami and the 2010 Haiti earthquake and geopolitical crises such as the Syrian civil war and the 2022 Russian invasion of Ukraine, LSG supported scientific and operational communities in emergency response and recovery. In 2022, LSG datasets from 2000 onward were made publicly available through ORNL’s LandScan Portal. This data descriptor details our methodology and the application of geospatial science and machine learning to geographic and demographic data, highlighting uses in urban resiliency, emergency management, disaster response, and human health and security.

Science & Technology - Other Topics↗
DOE OSTI2022

Forecasting distributed energy resources adoption for power systems

Failing to incorporate accurate distributed energy resource penetration forecasts into long-term resource and transmission planning can lead to cost inefficiencies at best and system failures at worst. We have developed an open-source tool that employs an advanced Bass specification to calibrate and forecast technology adoption. The advanced specification includes geographic clustering, exogenously estimated market size, and dynamic time steps. Training on historical adoption of rooftop photovoltaics at the U.S. county-level and using detailed techno-economic estimates, our model achieves a two-year average mean-absolute-percentage-error of 19% in predicting system counts at the county-level, weighted by population. Model error was negatively correlated with market maturity - the error was 12% for counties in states with at least 28 W-per-capita of installed capacity. The advanced specification significantly reduces unweighted forecasting percent error compared to a conventional Bass specification: from 196% to 25% for capacity and from 226% to 22% for system count.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2021

Uniformly Ordered Binary Decision Algorithm for Benchmark Experiment Correlations in Whisper Validation

When performing a validation exercise for determining the upper subcritical limit of a nuclear criticality safety application, an analyst should select and perform a statistical analysis on a population of benchmark experiments that are neutronically similar to the application. The size of this population should be sufficiently large such that the statistical analysis has a high degree of confidence that the bias plus bias uncertainty (calculational margin) has been accurately quantified. A complication arises because many benchmark experiments share common components, leading to correlations in their measured effective multiplication factors. Correlations between benchmark experiments within the population reduces its predictive power. This motivates the need for methods that consider benchmark experiment correlations and ensure adequate statistical significance of results. The Whisper code is a statistical analysis pack- age that incorporates nuclear data sensitivity coefficients from MCNP to assess benchmark experiment similarity and then performs an extreme-value analysis to estimate the bias plus bias uncertainty. The original methodology in Whisper does not consider the effect of benchmark experiment correlations when making this estimation, and this summary proposes the uniformly ordered binary decision algorithm to address this shortcoming. The original methodology in Whisper computes similarity coefficients ck for an application compared to all benchmark experiments in its library and develops weighting factors for a selected population proportional to the ck values. The methodology can be interpreted as statistically emulating a validation exercise for a particular application where the weighting factors may be viewed as the likelihood that an analyst would include a particular benchmark experiment within the population. The effective sample size of the population is the expected or mean number of benchmark experiments in the population. The uniformly ordered binary decision algorithm identifies clusters of correlated benchmark experiments within the population and then computes adjusted weighting factors based on the magnitude of the correlation coefficients within the cluster to compute a reduced effective sample size accounting for the lower information content because of correlations. Benchmark experiments within the cluster are ordered randomly with equal probability and probabilistic decisions are made as to whether a benchmark. experiment within the cluster should treated as redundant with a previous one; if two redundant benchmark experiments are included, then the conservative worst case bias plus bias uncertainty is used and the pair is counted as a single benchmark experiment in the population. Results are provided for HEU solutions in a research version of the Whisper software using benchmark experiment correlations provided by DICE, the Database for the International Criticality Safety Benchmark Evaluation Project (ICSBEP). These show that there can be a significant increase in the bias plus bias uncertainty because the effective sample size is reduced, and therefore the algorithm, needing to meet sample size requirements, expands the benchmark experiment population by accepting less similar benchmark experiments that would have otherwise not been included.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2022

Counting generations in birth and death processes with competing Erlang and exponential waiting times

Lymphocyte populations, stimulated in vitro or in vivo, grow as cells divide. Stochastic models are appropriate because some cells undergo multiple rounds of division, some die, and others of the same type in the same conditions do not divide at all. If individual cells behave independently, then each cell can be imagined as sampling from a probability density of times to division and death. The exponential density is the most mathematically and computationally convenient choice. It has the advantage of satisfying the memoryless property, consistent with a Markov process, but it overestimates the probability of short division times. With the aim of preserving the advantages of a Markovian framework while improving the representation of experimentally-observed division times, we consider a multi-stage model of cellular division and death. We use Erlang-distributed (or, more generally, phase-type distributed) times to division, and exponentially distributed times to death. We classify cells into generations, using the rule that the daughters of cells in generation n are in generation n + 1. In some circumstances, our representation is equivalent to established models of lymphocyte dynamics. We find the growth rate of the cell population by calculating the proportions of cells by stage and generation. The exponent describing the late-time cell population growth, and the criterion for extinction of the population, differs from what would be expected if N steps with rate λ were equivalent to a single step of rate λ/N. We link with a published experimental dataset, where cell counts were reported after T cells were transferred to lymphopenic mice, using Approximate Bayesian Computation. In the comparison, the death rate is assumed to be proportional to the generation and the Erlang time to division for generation 0 is allowed to differ from that of subsequent generations. The multi-stage representation is preferred to a simple exponential in posterior distributions, and the mean time to first division is estimated to be longer than the mean time to subsequent divisions.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2026

Pb-Apatite Framework as a Generator of Novel Flat-Band CuO-Based Physics

Based upon density functional theory (DFT) calculations, we present the basic electronic structure of CuPb 9 (PO 4 ) 6 O (Cu-doped lead apatite, aka LK-99), in two scenarios: (1) where the structure is constrained to the P3 symmetry and (2) where no symmetry is imposed. At the DFT level, the former is predicted to be metallic while the latter is found to be a charge-transfer insulator. In both cases the filling of these states is nominally d 9 , consistent with the standard Cu 2+ valence state, and Cu with a local magnetic moment of order 0.7 μ B . In the metallic case we find these states to be unusually flat (∼0.2 eV dispersion), giving a very high density of electronic states (DOS) at the Fermi level that we argue can be a host for novel electronic physics. The flatness of the bands is the likely origin of symmetry-lowering gapping possibilities that would remove the spectral weight from E F . Motivated by some initial experimental observations of metallic or semiconducting behavior, we propose that disorder (likely structural) is responsible for closing the gap. Here, we consider a variety of possibilities that could possibly close the charge-transfer gap but limit consideration to kinds of disorder that preserve electron count. Of the possible kinds we considered (spin disorder, O populating vacancy sites, and Cu on less energetically favorable Pb sites), the local Cu moment, and consequently the charge-transfer gap, remains robust. We conclude that disorder responsible for metallic behavior entails some kind of doping where the electron count changes. Further, we claim that the emergence of the flat bands should be due to weak wave function overlap between the orbitals on Cu and O sites, owing to the directional character of the constituent orbitals. Therefore, finding an appropriate host structure for minimizing hybridization between Cu and O while allowing them to still weakly interact should be a promising route for generating flat bands at E F which can lead to interesting electronic phenomena, regardless of whether LK-99 is a superconductor.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Screening Tool for Equitable Adoption and Deployment of Solar (STEADy Solar)

The Screening Tool for Equitable Adoption and DeploYment of Solar (STEADy Solar) is a database and mapping tool designed to promoting clean energy investments for low-income communities across the United States. The tool indicates locations that may be eligible for the Investment Tax Credit bonus adders defined in the 2022 Inflation Reduction Act (IRA) and combines this information with demographics, social vulnerability, solar technical potential, solar economics (modeled net present value), and building counts by use-type. It can be used by states, municipalities, community-based organizations, developers, and researchers to identify sites where solar projects may be economical and where federal incentives may be available to support equitable adoption of solar. Specific values include: Areas eligible for the Energy Communities Tax Credit Bonus Program (including brownfield site counts) Areas eligible for the Low Income Communities Bonus Credit Program (including Tribal Lands, and covered affordable housing project counts) Areas categorized as disadvantaged by Justice40 Commercial and Residential Solar economics characterized by the Net Present Value and Simple Payback Period Total Population, Race, and Ethnicity Median Household Income, Poverty rate, Household Tenure Social Vulnerability Count of buildings, developable rooftop solar capacity (in kWdc) and estimated annual generation potential (in kWh) on four building types: Government General Services, Government Emergency Response, Grade Schools, and Colleges/Universities. The linked report describes the STEADy dataset metadata and presents high level insights from the data. The downloadable and formatted excel dataset makes it easy for users to gain insights for their locations. Supporting .csv and shapefiles provide users with the full data to run their own analyses on equitable solar siting.

14 SOLAR ENERGY↗
DOE OSTI2020

The enigmatic Galactic Center excess: Spurious point sources and signal mismodeling

The Galactic Center GeV excess (GCE) has garnered great interest as a possible signal of either dark matter annihilation or some novel astrophysical phenomenon, such as a new population of gamma-ray emitting pulsars. In a companion paper, we showed that in a 10° radius region of interest (ROI) surrounding the Galactic Center, apparent evidence for GCE point sources (PSs) from non-Poissonian template fitting (NPTF) is actually an artifact of unmodeled north-south asymmetry of the GCE. In this work, we develop a simplified analytic description of how signal mismodeling can drive an apparent preference for a PS population, and demonstrate how the behavior pointed out in the companion paper also appears in simpler simulated datasets that contain no PS signals at all. We explore the generality of this behavior in the real gamma-ray data, and discuss the implications for past and future studies using NPTF techniques. While the drop in PS preference once north-south asymmetry is included is not ubiquitous in larger ROIs, we show that any overly-rigid signal model is expected to yield a spurious PS signal that can appear very convincing: as well as apparent significance comparable to what one would expect from a true PS population, the signal can exhibit stability against a range of variations in the analysis, and a source count function that is very consistent with previous apparent NPTF-based detections of a GCE PS population. This contrasts with previously studied forms of systematic mismodeling which are unlikely to mimic a PS population in the same way. Finally, in the light of this observation, and its explicit realization in the region where the GCE is brightest, we argue that a dominantly smooth origin for the GCE is not in tension with existing NPTF analyses.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2020

Learning to Count Grave Sites for Cemetery Observation Models With Satellite Imagery

Understanding how people occupy open spaces is important for research in support of population modeling, policy, national security, emergency response, and sustainability. For the past decade, there has been an increase in research toward capturing and reporting population dynamics and patterns of life at the building level and in some open public spaces such as cemeteries and parks. This is done through observation models developed from local sociocultural information acquired at various spatiotemporal scales to inform night, day, and episodic population occupancy estimates (people/1000 sq ft). Sociocultural information for cemeteries and parks is scarcely available and often collected manually. The process is not only marred by inconsistencies but is laborious and time consuming. In this study, we leverage convolutional neural networks (CNNs) and satellite imagery to derive grave site counts as proxy variables to support scalable and accurate sociocultural data required in a population observation model. Through a hybrid workflow (weak localization plus regression model), we characterize a large scale automation process to counting of grave sites. We evaluate and demonstrate the efficacy of proposed workflow using out-of-data set large satellite imagery and establish its broader impact on cemetery observation models.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2026

Exact Fock-State Preparation with $n^{1/4}$ Circuit Depth

Efficient, deterministic, and high-fidelity preparation of large Fock states is essential for scaling bosonic quantum technologies and exploring quantum phenomena at large excitation energies. We introduce a deterministic one-parameter (D1p) protocol that maps Fock-state preparation in an infinite-dimensional Hilbert space onto two-dimensional amplitude amplification. Starting from a coherent state with $|α|\simeq\sqrt{n}$, the initial target-state population scales as $n^{-1/2}$, yielding an iteration count and circuit depth of $\mathcal{O}(n^{1/4})$. Phase matching guarantees unit fidelity in the ideal model; remarkably, preparing $|{10^6}\rangle$ requires only 39 iterations. The protocol uses only displacements and number-selective phase operations, requires no numerical optimization, and further extends to state transfer, general superpositions, finite-dimensional systems, and multipartite entangled states. In the large-amplitude regime, its multi-target form prepares $L$-legged cat states with an iteration count determined only by $L$; cats with up to ten legs require only two iterations, independent of the coherent-state amplitude. This framework provides a broadly applicable route to highly excited bosonic states on platforms supporting these elementary controls.

Roy, Tanay [Fermilab] (ORCID:000000019442862X)↗
DOE OSTI2023

A quantum trajectory picture of single photon absorption and energy transport in photosystem II

Here, we use quantum trajectory theory to study the dynamics of the first step in photosynthesis for a single photon interacting with photosystem II (PSII). By considering individual trajectories we are able to look beyond the ensemble average dynamics to compute the PSII system evolution conditioned upon individual photon counting measurements. Measurements of the transmitted photon beam strongly affects the system state, since detection of an outgoing photon confirms that the PSII must be in the electronic ground state, while a null measurement implies it is in an excited electronic state. We show that under ideal conditions, observing the null result transforms a state with a low excited state population to a state with nearly all population contained in the excited states. We study the PSII dynamics conditioned on such photon counting for both a pure excitonic model of PSII and a more realistic model with exciton-phonon coupling to a dissipative phononic environment. In the absence of such coupling, we show that the measured fluorescence rates show oscillations constituting a photon-counting witness of excitonic coherence. Excitonic coupling to the phonon environment has a strong effect on the observed rates of fluorescence, damping the oscillations. Addition of non-radiative decay and incoherent transitions to radical pair states in the reaction center to the phononic model allows extraction of a quantum efficiency of 92.5% from the long-time evolution, consistent with bulk experimental measurements.

Coherent states↗
DOE OSTI2021

Exploring the contamination of the DES-Y1 cluster sample with SPT-SZ selected clusters

ABSTRACT We perform a cross validation of the cluster catalogue selected by the red-sequence Matched-filter Probabilistic Percolation algorithm (redMaPPer) in Dark Energy Survey year 1 (DES-Y1) data by matching it with the Sunyaev–Zel’dovich effect (SZE) selected cluster catalogue from the South Pole Telescope SPT-SZ survey. Of the 1005 redMaPPer selected clusters with measured richness $\hat{\lambda }\gt 40$ in the joint footprint, 207 are confirmed by SPT-SZ. Using the mass information from the SZE signal, we calibrate the richness–mass relation using a Bayesian cluster population model. We find a mass trend λ ∝ MB consistent with a linear relation (B ∼ 1), no significant redshift evolution and an intrinsic scatter in richness of σλ = 0.22 ± 0.06. By considering two error models, we explore the impact of projection effects on the richness–mass modelling, confirming that such effects are not detectable at the current level of systematic uncertainties. At low richness SPT-SZ confirms fewer redMaPPer clusters than expected. We interpret this richness dependent deficit in confirmed systems as due to the increased presence at low richness of low-mass objects not correctly accounted for by our richness-mass scatter model, which we call contaminants. At a richness $\hat{\lambda }=40$, this population makes up ${\gt}12{{\ \rm per\ cent}}$ (97.5 percentile) of the total population. Extrapolating this to a measured richness $\hat{\lambda }=20$ yields ${\gt}22{{\ \rm per\ cent}}$ (97.5 percentile). With these contamination fractions, the predicted redMaPPer number counts in different plausible cosmologies are compatible with the measured abundance. The presence of such a population is also a plausible explanation for the different mass trends (B ∼ 0.75) obtained from mass calibration using purely optically selected clusters. The mean mass from stacked weak lensing (WL) measurements suggests that these low-mass contaminants are galaxy groups with masses ∼3–5 × 1013 M⊙ which are beyond the sensitivity of current SZE and X-ray surveys but a natural target for SPT-3G and eROSITA.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Strong lensing of high-energy neutrinos

Here, we consider the effects of strong gravitational lensing by galaxy-scale deflectors on the observations of high-energy ( E $\gg$ GeV ) neutrinos (HENs). For HENs at cosmological distances, the optical depth for multiple imaging is ~10 –3 , implying that while we do not expect any multiply imaged HENs with present samples, next-generation experiments should be able to detect the first such event. We then present the distribution of expected time delays to aid in the identification of such events, in combination with directional and energy information. In order to assist in the evaluation of HEN production mechanisms, we illustrate how lensing affects the observed number counts for a variety of intrinsic luminosity functions of the source population. Finally, we see that the lensing effects on the cosmic neutrino background flux calculation would be negligible by taking kiloparsec-scale jets as an example.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2023

Swift and extensive Omicron outbreak in China after sudden exit from ‘zero-COVID’ policy

In late 2022, China transitioned from a strict ‘zero-COVID’ policy to rapidly abandoning nearly all interventions and data reporting. This raised great concern about the presumably-rapid but unreported spread of the SARS-CoV-2 Omicron variant in a very large population of very low pre-existing immunity. By modeling a combination of case count and survey data, we show that Omicron spread extremely rapidly, at a rate of 0.42/day (95% credibility interval: [0.35, 0.51]/day), translating to an epidemic doubling time of 1.6 days ([1.6, 2.0] days) after the full exit from zero-COVID on Dec. 7, 2022. Consequently, we estimate that the vast majority of the population (97% [95%, 99%], sensitivity analysis lower limit of 90%) was infected during December, with the nation-wide epidemic peaking on Dec. 23. Overall, our results highlight the extremely high transmissibility of the variant and the importance of proper design of intervention exit strategies to avoid large infection waves.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2022

Analyzing count data with measurement error

In this article, we analyze observed count data such as the number of defects in a steel product where the observed counts are the true counts measured with errors. We account for the measurement error by using a measurement error model based on a latent lognormal (LLN) distribution. We consider making inference about a single population (e.g., from samples of a production lot) and a regression model (e.g., from runs of a designed experiment), where the measurement system properties are known, that is, the parameters of the LLN distribution are known. Then, we consider simultaneous inference for the single population and regression model as well as the measurement system. We demonstrate the proposed methodology with both simulated and real observed counts.

42 ENGINEERING↗
DOE OSTI2021

Excess deaths reveal the true spatial, temporal and demographic impact of COVID-19 on mortality in Ecuador

Accepted Background In early 2020, Ecuador reported one of the highest surges of per capita deaths across the globe. Methods We collected a comprehensive dataset containing individual death records between 2015 and 2020, from the Ecuadorian National Institute of Statistics and Census and the Ecuadorian Ministry of Government. We computed the number of excess deaths across time, geographical locations and demographic groups using Poisson regression methods. Results Between 1 January and 23 September 2020, the number of excess deaths in Ecuador was 36 402 [95% confidence interval (CI): 35 762–36 827] or 208 per 100 000 people, which is 171% of the expected deaths in that period in a typical year. Only 20% of the excess deaths are attributable to confirmed COVID-19 deaths. Strikingly, in provinces that were most affected by COVID-19 such as Guayas and Santa Elena, the all-cause deaths are more than double the expected number of deaths that would have occurred in a normal year. The extent of excess deaths in men is higher than in women, and the number of excess deaths increases with age. Indigenous populations had the highest level of excess deaths among all ethnic groups. Conclusions Overall, the exceptionally high level of excess deaths in Ecuador highlights the enormous burden and heterogeneous impact of COVID-19 on mortality, especially in older age groups and Indigenous populations in Ecuador, which was not fully revealed by COVID-19 death counts. Together with the limited testing in Ecuador, our results suggest that the majority of the excess deaths were likely to be undocumented COVID-19 deaths.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2023

Evaluation of an open forecasting challenge to assess skill of West Nile virus neuroinvasive disease prediction

Abstract Background West Nile virus (WNV) is the leading cause of mosquito-borne illness in the continental USA. WNV occurrence has high spatiotemporal variation, and current approaches to targeted control of the virus are limited, making forecasting a public health priority. However, little research has been done to compare strengths and weaknesses of WNV disease forecasting approaches on the national scale. We used forecasts submitted to the 2020 WNV Forecasting Challenge, an open challenge organized by the Centers for Disease Control and Prevention, to assess the status of WNV neuroinvasive disease (WNND) prediction and identify avenues for improvement. Methods We performed a multi-model comparative assessment of probabilistic forecasts submitted by 15 teams for annual WNND cases in US counties for 2020 and assessed forecast accuracy, calibration, and discriminatory power. In the evaluation, we included forecasts produced by comparison models of varying complexity as benchmarks of forecast performance. We also used regression analysis to identify modeling approaches and contextual factors that were associated with forecast skill. Results Simple models based on historical WNND cases generally scored better than more complex models and combined higher discriminatory power with better calibration of uncertainty. Forecast skill improved across updated forecast submissions submitted during the 2020 season. Among models using additional data, inclusion of climate or human demographic data was associated with higher skill, while inclusion of mosquito or land use data was associated with lower skill. We also identified population size, extreme minimum winter temperature, and interannual variation in WNND cases as county-level characteristics associated with variation in forecast skill. Conclusions Historical WNND cases were strong predictors of future cases with minimal increase in skill achieved by models that included other factors. Although opportunities might exist to specifically improve predictions for areas with large populations and low or high winter temperatures, areas with high case-count variability are intrinsically more difficult to predict. Also, the prediction of outbreaks, which are outliers relative to typical case numbers, remains difficult. Further improvements to prediction could be obtained with improved calibration of forecast uncertainty and access to real-time data streams (e.g. current weather and preliminary human cases). Graphical Abstract

54 ENVIRONMENTAL SCIENCES↗