Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “risk score”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Development and Validation of a Scoring System for Abnormalities in the Gopher Frog (Rana capito)

Headstarting efforts are thought to be critical in supplementing populations of the at-risk Gopher Frog (Rana capito); however, recent efforts have occasionally resulted in juveniles with developmental abnormalities. In response, we developed a scoring system to collect quantitative data on the presence and severity of these developmental abnormalities. Our objective was to describe and validate the abnormality scoring system so that it can be used by all Gopher Frog headstarting facilities. The scoring system covers five primary conditions encompassing commonly observed abnormalities. Two groups of participants with different levels of prior experience working with Gopher Frogs assigned scores to a set of images presented to them for each condition. We used intra-class correlation coefficients (ICC) to test the scoring system for inter- and intra-rater agreement as well as agreement with the benchmark standard (established by the authors). We found high ICC values for inter-rater agreement, intra-rater agreement, and agreement to the benchmark standard indicating either excellent or good reliability for all five conditions and for all raters when grouped together. These findings support the reliability and validity of the proposed developmental abnormality scoring system. Gopher Frog headstarting facilities can implement this scoring system to assist in tracking the frequency and severity of abnormalities observed in future headstarting efforts. We hope that by creating a reliable scoring system for Gopher Frogs, it can provide an overall framework and serve as a valuable resource to evaluate abnormalities across any amphibian species.

abnormality↗
DOE OSTI2022

A Framework to Integrate Human Reliability Data Obtained from Different Sources Based on the Complexity Scores of Proceduralized Tasks

For many decades, PSA (Probabilistic Safety Assessment) or PRA (Probabilistic Risk Assessment) techniques have been used to enhance the operational safety of nuclear power plants (NPPs) based on the consideration of potential hazards that could result in an unexpected consequence. As human error is one of the potential hazards, diverse human reliability analysis (HRA) methods have been proposed to provide a systematic way to estimate the likelihood of human errors (i.e., human error probability, HEP) in specific task contexts. Accordingly, it is evident that the quality of HRA results strongly depends on the credibility of HEP estimations. This implies that, in terms of enhancing this credibility, the collection of raw information (HRA data) that is helpful for understating when and why human errors occur is a crucial issue. In order to address this issue, in this study, the feasibility of a framework to integrate HRA data obtained from different sources is investigated based on the complexity of proceduralized tasks.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2020

Quantitative assessment of distant recurrence risk in early stage breast cancer using a nonlinear combination of pathological, clinical and imaging variables

Abstract Use of genomic assays to determine distant recurrence risk in patients with early stage breast cancer has expanded and is now included in the American Joint Committee on Cancer staging manual. Algorithmic alternatives using standard clinical and pathology information may provide equivalent benefit in settings where genomic tests, such as OncotypeDx, are unavailable. We developed an artificial neural network (ANN) model to nonlinearly estimate risk of distant cancer recurrence. In addition to clinical and pathological variables, we enhanced our model using intraoperatively determined global mammographic breast density (MBD) and local breast density (LBD). LBD was measured with optical spectral imaging capable of sensing regional concentrations of tissue constituents. A cohort of 56 ER+ patients with an OncotypeDx score was evaluated. We demonstrated that combining MBD/LBD measurements with clinical and pathological variables improves distant recurrence risk prediction accuracy, with high correlation ( r = 0.98) to the OncotypeDx recurrence score.

Nichols, Brandon S.↗
DOE OSTI2021

Mixture Model Framework for Traumatic Brain Injury Prognosis Using Heterogeneous Clinical and Outcome Data

Prognoses of Traumatic Brain Injury (TBI) outcomes are neither easily nor accurately determined from clinical indicators. This is due in part to the heterogeneity of damage inflicted to the brain, ultimately resulting in diverse and complex outcomes. Using a data-driven approach on many distinct data elements may be necessary to describe this large set of outcomes and thereby robustly depict the nuanced differences among TBI patients’ recovery. In this work, we develop a method for modeling large heterogeneous data types relevant to TBI. Our approach is geared toward the probabilistic representation of mixed continuous and discrete variables with missing values. The model is trained on a dataset encompassing a variety of data types, including demographics, blood-based biomarkers, and imaging findings. In addition, it includes a set of clinical outcome assessments at 3, 6, and 12 months post-injury. The model is used to stratify patients into distinct groups in an unsupervised learning setting. We use the model to infer outcomes using input data, and show that the collection of input data reduces uncertainty of outcomes over a baseline approach. In addition, we quantify the performance of a likelihood scoring technique that can be used to self-evaluate the extrapolation risk of prognosis on unseen patients.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

EHS Health Assessment & Health Action Plan Report (CY 2020)

Sandia National Laboratories (SNL) Employee Health Services (EHS) program believes that good health is essential to getting the most out of life, which is why we offer a variety of worksite wellness programs that put employees in control of their own health. These programs are based on current research and strategies that are proven to minimize risk and decrease the impact of illness through early detection and treatment. Services includes Health Assessments, the Virgin Pulse (VP) online wellness platform, and Health Action Plans (HAP) which include one-on-one education, organizational health initiatives, a video library, an events calendar, onsite fitness facilities, and group fitness classes. Participation in these programs help employees and their spouses earn funding for their Health Reimbursement Accounts (HRAs). The EHS Health Action Plan (HAP) initiative targets the key health risks identified through the 8-15-80 model by engaging employees to change their own healthcare story. EHS identified the most prevalent of the health risks amongst our population through Health Risk Assessment (HRA) and used that data to build Health Action Plans (HAPs). The 2020 Health Action Plans addressed improving upon inadequate sleep, lack of energy, stress, weight, physical inactivity, cardiometabolic issues (hypertension, high cholesterol, diabetes), low back pain, allergies, asthma, digestive health, tobacco use, and living well to maintaining low risk for those individuals who do not have a chronic condition to manage. These plans connect employees with our onsite registered dietitians, fitness professionals, health coaches, physical therapists, and physicians as appropriate. In addition to addressing the physical aspects of health, the plans also emphasized pre/post-assessments to encourage building behavioral and emotional skills that promote health and facilitate lifestyle changes over a minimum of three months. Just one risk reduction or behavior change can make an impact on the health of the participant’s Division as well as Sandia’s overall risk levels and ultimately its healthcare costs. Sandia employees achieved an Overall Wellness Score of 69 based on the WellSource Health Assessment (the same as last year). A score of 70-100 is considered “Doing Well”, and a score of 40-69 is in the “Caution” category. Overall in CY 2019, Sandia saw a 34% participation rate in Health Action Plan (HAP) programs (up from 33% in CY 2019) with an 89% completion rate (4% lower than CY 2019). Overall, 5,039 (347 more than CY 2019) individuals participated in 8,329 HAPs, which is 1,005 more than the last calendar year (7,324).

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Prioritizing Countries by Concern Regarding Access to Weapons of Mass Destruction Materials

This article presents a global prioritization methodology that evaluates the relative risks of non-state actor acquisition of materials that could be used in chemical, biological, radiological, nuclear and high explosive Weapons of Mass Destruction (WMD) from the country’s relevant infrastructure. Prioritization is based on three domains: 1. Assessing relative scale of materials in each country, 2. The country’s corresponding security posture, and 3. The presence of threat actors. The output is a list of countries prioritized from greatest risk to least. Rather than providing an overall 1 to N ranking, however, the results are placed into tiers based upon their natural groupings within the three domains. The countries in the highest tiers are flagged as potential US national security concern; those scoring in the middle and at the bottom are flagged as posing lower US national security concern. A systematic approach assesses each country by leveraging many disciplines, such as risk and decision analysis, as well as expert judgement. A quantitative value model based on Multi-Attribute Value Theory (MAVT) organizes the objectives scoring criteria into a value tree using lessons learned from previous studies, published literature, and expert judgement. The article presents the prioritization categories and corresponding value model scoring criteria to include measurement type, weight, range, and value preference. Country names and data are notional in order to share the details on the underlying methodology and model without identification of actual security risks. A deliberative process addresses factors external to the model and scrutinizes inputs, methodology, model, and results.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗
DOE OSTI2024

Component Criticality in BESS for Cybersecurity

Battery energy storage systems (BESS), inverters, and associated digital equipment are integral pieces of interdependent energy delivery systems. When considering the supply chain security of such systems, there is often a misplaced focus on the origin of energy generation and storage materials like battery cells, overlooking the more significant cyber risks that stem from digital power electronics control systems. Part of this misplaced focus is due to the relative costs of these components, with more attention given to expensive raw materials rather than the impactful digital elements themselves. The Idaho National Laboratory (INL) is addressing this gap in supply chain security through a systems-of-systems approach that considers the impact various components in digital energy systems can have should misoperation occur. Therefore, INL assigns a cyber criticality score based on quantitative analysis, which enables informed prioritization of mitigations and allows operators to reduce risk in light of the prevalence of a BESS and associated systems foreign supply chain.

25 ENERGY STORAGE↗
DOE OSTI2021

A time-varying vulnerability index for COVID-19 in New Mexico, USA using generalized propensity scores

The coronavirus disease (COVID-19) pandemic has highlighted systemic inequities in the United States and resulted in a larger burden of negative social outcomes for marginalized communities. New Mexico, a state in the southwestern US, has a unique population with a large racial minority population and a high rate of poverty that may make communities more vulnerable to negative social outcomes from COVID-19. To identify which communities may be at the highest relative risk, we created a county-level vulnerability index. After the first COVID-19 case was reported in New Mexico on March 11, 2020, we fit a generalized propensity score model that incorporates sociodemographic factors to predict county-level viral exposure and thus, the generic risk to negative social outcomes such as unemployment or mental health impacts. We used four static sociodemographic covariates important for the state of New Mexico—population, poverty, household size, and minority population—and weekly cumulative case counts to iteratively run our model each week and normalize the exposure score to create a time-varying vulnerability index. We found the relative vulnerability between counties varied in the first eight weeks from the initial COVID-19 case before stabilizing. This framework for creating a location-specific vulnerability index in response to an ongoing disaster may be used as a quick, deployable metric to inform health policy decisions such as allocating state resources to the county level.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Vegetable intake and the risk of bladder cancer in the BLadder Cancer Epidemiology and Nutritional Determinants (BLEND) international study

Although a potential inverse association between vegetable intake and bladder cancer risk has been reported, epidemiological evidence is inconsistent. This research aimed to elucidate the association between vegetable intake and bladder cancer risk by conducting a pooled analysis of data from prospective cohort studies. Vegetable intake in relation to bladder cancer risk was examined by pooling individual-level data from 13 cohort studies, comprising 3203 cases among a total of 555,685 participants. Pooled multivariate hazard ratios (HRs), with corresponding 95% confidence intervals (CIs), were estimated using Cox proportional hazards regression models stratified by cohort for intakes of total vegetable, vegetable subtypes (i.e. non-starchy, starchy, green leafy and cruciferous vegetables) and individual vegetable types. In addition, a diet diversity score was used to assess the association of the varied types of vegetable intake on bladder cancer risk. The association between vegetable intake and bladder cancer risk differed by sex ( P -interaction = 0.011) and smoking status ( P -interaction = 0.038); therefore, analyses were stratified by sex and smoking status. With adjustment of age, sex, smoking, energy intake, ethnicity and other potential dietary factors, we found that higher intake of total and non-starchy vegetables were inversely associated with the risk of bladder cancer among women (comparing the highest with lowest intake tertile: HR = 0.79, 95% CI = 0.64–0.98, P = 0.037 for trend, HR per 1 SD increment = 0.89, 95% CI = 0.81–0.99; HR = 0.78, 95% CI = 0.63–0.97, P = 0.034 for trend, HR per 1 SD increment = 0.88, 95% CI = 0.79–0.98, respectively). However, no evidence of association was observed among men, and the intake of vegetable was not found to be associated with bladder cancer when stratified by smoking status. Moreover, we found no evidence of association for diet diversity with bladder cancer risk. Higher intakes of total and non-starchy vegetable are associated with reduced risk of bladder cancer for women. Further studies are needed to clarify whether these results reflect causal processes and potential underlying mechanisms.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

The Potential for Midtreatment Albumin-Bilirubin (ALBI) Score to Individualize Liver Stereotactic Body Radiation Therapy

Our individualized functional response adaptive approach to liver stereotactic body radiation therapy (SBRT) with assessment of indocyanine green (ICG) retention at baseline and midtreatment to detect subclinical changes in liver function, permitting dose adjustment, has decreased toxicity while preserving efficacy. We hypothesized that assessment of the albumin-bilirubin (ALBI) score at baseline and midtreatment would allow for more practical identification of patients at risk for treatment-related toxicity (TRT).

62 RADIOLOGY AND NUCLEAR MEDICINE↗
DOE OSTI2023

Hydropower Potential at Non-Powered Dams: A Multi-Criteria Decision Analysis Tool based on Grid, Community, Industry, and Environmental Impacts

Non-powered dams (NPDs) are dams that do not include hydraulic turbine (hydropower) equipment. Currently, there are more than 80,000 such dams in the United States, which provide a variety of non-energy benefits, including flood control, water supply, navigation, and recreation. Approximately 500 of these NPDs are identified as having the potential to add hydropower generation (totaling up to a capacity of more than 8200 MW). A large share of investment costs and environmental impacts of dam construction have already been incurred at these NPDs. Hence, adding power to the existing dam structure is hypothesized to be achieved at a lower cost, with less risk, and a shorter timeframe than the development required for new dam construction. The abundance of NPDs, the associated environmental favorability, and cost advantages, combined with the reliability, predictability, and dispatchability of hydropower, make NPDs a strong candidate in the nation’s renewable energy portfolio. To assess the NPD to hydropower conversion potential, in this study, we developed a GIS-based multi-criterial decision analysis tool, which allows users to rank these NPDs based on the grid, community, industry, and environmental impacts (i.e., GCIE impacts). This web-based interactive tool (developed using open-source Python and JavaScript) lets the user choose from a wide range of features to define each of the GCIE impact scores through a user-friendly graphical user interface. These features are related to dam operation, hydropower generation opportunity, power market economy, social vulnerability and risk, proximity to critical infrastructure and energy generating facilities, environmental concerns (air, water, and critical habitat), and exposure to natural hazards. The overall priority score of NPDs is calculated based on user-defined weights for each of the GCIE impact scores. Besides ranking NPDs, the tool can also be used to estimate the energy-storage feasibility (battery, hydrogen, and pump-storage hydropower) at each of the potential sites.

13 HYDRO ENERGY↗
DOE OSTI2020

Development and validation of a next-generation sequencing-based multigene assay to predict the prognosis of estrogen receptor-positive, HER2-negative breast cancer

Purpose: Multigene assays provide useful prognostic information regarding hormone receptor (HR)-positive breast cancer. Next-generation sequencing (NGS)-based platforms have numerous advantages including reproducibility and adaptability in local laboratories. Here we aimed to develop and validate an NGS-based multigene assay to predict the distant recurrence risk. Experimental Design: In total, 179 genes including 30 reference genes highly correlated with the 21-gene recurrence score (RS) algorithm were selected from public databases. Targeted RNA-sequencing was performed using 250 and 93 archived breast cancer samples with a known RS in the training and verification sets, respectively, to develop the algorithm and NGS–Prognostic Score (NGS-PS). The assay was validated in 413 independent samples with long-term follow-up data on distant metastasis. Results: In the verification set, the NGS-PS and 21-gene RS displayed 91.4% concurrence (85/93 samples). In the validation cohort of 413 samples, area under the receiver operating characteristic curve plotted using NGS-PS values classified for distant recurrence was 0.76. The best NGS-PS cut-off value predicting distant metastasis was 20. Furthermore, 269 and 144 patients were classified as low- and high-risk patients in accordance with the cut-off. Five- and 10-year estimates of distant metastasis–free survival (DMFS) for low- versus high-risk groups were 97.0% versus 77.8% and 93.2% versus 64.4%, respectively. The age-related HR for distant recurrence without chemotherapy was 9.73 (95% CI, 3.59–26.40) and 3.19 (95% CI, 1.40–7.29) for patients aged ≤50 and >50 years, respectively. Conclusions: The newly developed and validated NGS-based multigene assay can predict the distant recurrence risk in ER-positive, HER2-negative breast cancer.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2021

Towards a New Supply Chain Cybersecurity Risk Analysis Technique

Supply chain cyber-attacks, such as the SolarWinds Orion attack, are occurring with greater frequency. These attacks compromise a digital device before it is sent to customers, bypassing traditional security controls to remain persistent and undetected in operational environments. While supply chain attacks are prevalent, methods for analyzing the risk of these attacks are currently unavailable. This paper proposes new supply chain cyber-attack difficulty and risk metrics to evaluate the relative risk of an attack throughout the supply chain lifecycle. Difficulty metrics for each stakeholder in a digital device’s supply chain (e.g., hardware manufacturing, firmware development, software development, storage, and distribution entities) are calculated using scores from cybersecurity maturity questionnaires in a Bayesian Network leaky Noisy-MAX model. These difficulty metrics are then used to calculate an overall supply chain cyber-attack risk. Vulnerability and recoverability metrics are also proposed to evaluate the relative stakeholder influence in the attack risk. These proposed relative risk metrics enable continuous supply chain monitoring, provide decision-makers with information necessary for improved supplier selection, and help drive improvements in the cybersecurity posture of the stakeholders in their supply chain.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2021

Detecting Arsenic Contamination Using Satellite Imagery and Machine Learning

Arsenic, a potent carcinogen and neurotoxin, affects over 200 million people globally. Current detection methods are laborious, expensive, and unscalable, being difficult to implement in developing regions and during crises such as COVID-19. This study attempts to determine if a relationship exists between soil’s hyperspectral data and arsenic concentration using NASA’s Hyperion satellite. It is the first arsenic study to use satellite-based hyperspectral data and apply a classification approach. Four regression machine learning models are tested to determine this correlation in soil with bare land cover. Raw data are converted to reflectance, problematic atmospheric influences are removed, characteristic wavelengths are selected, and four noise reduction algorithms are tested. The combination of data augmentation, Genetic Algorithm, Second Derivative Transformation, and Random Forest regression (R 2 =0.840 and normalized root mean squared error (re-scaled to [0,1]) = 0.122) shows strong correlation, performing better than past models despite using noisier satellite data (versus lab-processed samples). Three binary classification machine learning models are then applied to identify high-risk shrub-covered regions in ten U.S. states, achieving strong accuracy (=0.693) and F1-score (=0.728). Overall, these results suggest that such a methodology is practical and can provide a sustainable alternative to arsenic contamination detection.

63 RADIATION, THERMAL, AND OTHER ENVIRON. POLLUTAN↗
DOE OSTI2026

A Unified Analytical Method Greenness Score ( uAMGS ) Quantifies How Microscopic Imaging Is Greener Than Conventional Liquid Chromatography

Green chemistry is a set of principles for assessing, developing, and implementing methods that are safer, more efficient, and less detrimental to the environment. The analytical method greenness score (AMGS) is one of many metrics that attempt to evaluate traditional liquid chromatography (LC) based on the energy consumption of the instrument and the safety, health risks, and environmental impact of the solvents employed. Unfortunately, in practice, the AMGS is primarily focused on traditional separation methods in the pharmaceutical industry and is not amenable to cutting-edge separation science, including miniaturization. To broaden this scope, the unified Analytical Method Greenness Score (uAMGS) is presented here, which clarifies and expands on the underlying mathematics and incorporates both dimensional and uncertainty analysis, enabling its application to a broader range of analytical techniques. The uAMGS is used to compare the greenness of two distinct methods: single-molecule microscopy (SMM) and high-performance liquid chromatography (HPLC), which were used to collect equivalent data. uAMGS determines that SMM is significantly greener than HPLC due primarily to decreased solvent consumption. Overall, the uAMGS should allow chemists ranging from undergraduates to industrial PhDs to assess the greenness of a wide range of separations.

chemical separations↗
DOE OSTI2026

Blueprint: Stakeholder-Specific Vulnerability Categorization Guidance

Vulnerability management is a process of discovering, analyzing, and handling new or reported security vulnerabilities in systems to prevent the systems from being exploited, to reduce risk, and to protect assets. For vulnerability analysis, handling, and response, the prioritization of organizational and analyst resources must precede. The Common Vulnerability Scoring System (CVSS) is a standard prioritization method that is used to rate the severity of security vulnerabilities in systems by assigning numerical severity scores, but it does not provide clear guidelines of how the numerical severity scores might inform decisions. The Stakeholder-Specific Vulnerability Categorization (SSVC) provides a method for prioritizing vulnerabilities based on the needs of the stakeholders involved in the vulnerability management process. Instead of the numerical scoring used in the CVSS, the SSVC focuses on contextual decision-making to determine how quickly and effectively an organization should respond to vulnerabilities. The main functionality of the SSVC accommodates the diversity of the stakeholders in the vulnerability management process, including finders, vendors, coordinators, deployers, and others. So, the SSVC should be designed to be used by any of these stakeholders, and it should be customizable to enable specific stakeholder decision models and risk appetites.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2025

Failure Analysis–Informed Risk Assessment Framework for Geological Carbon Storage Using Numerical Simulation and Machine Learning

Geological carbon storage (GCS) is recognized as a critical technology for achieving large-scale reductions in anthropogenic carbon dioxide (CO 2 ) emissions. Ensuring long-term containment and safety requires robust risk assessment frameworks that account for geological uncertainty and identify potential failure scenarios. Among various indicators, the area of review (AoR) serves as a key metric for evaluating storage performance, regulatory compliance, and monitoring design, as it delineates the spatial extent impacted by pressure buildup and plume migration. However, conventional AoR-based risk assessments typically perturb parameters within narrow uncertainty bounds, potentially overlooking rare but high-impact events arising from extreme geological conditions. In this study, we present a failure analysis–informed risk assessment framework for large-scale GCS projects to improve site prescreening and monitoring design. A suite of 300 numerical simulations was generated using stochastic geological models that vary five key parameters: net-to-gross ratio, anisotropy azimuth, porosity multiplier, permeability multiplier, and vertical-to-horizontal permeability ratio. Among these, 200 realizations represent normal geological uncertainty, while 100 additional cases explore extreme yet plausible conditions for failure-case analysis. The AoR was simulated and computed from pressure and CO 2 saturation fields, where the baseline AoR boundary, representing the extent predicted under typical geological uncertainty, was defined as the union of 200 normal-range simulations, and failure was identified when extreme-range cases exceeded this baseline. Results show that incorporating broader parameter uncertainty produces significantly larger AoR extents, underscoring the potential underestimation of risk under conventional uncertainty ranges. Furthermore, spatial probability maps derived from failure-induced AoR exceedance identify regions requiring enhanced monitoring attention. Various machine learning (ML)–based classifiers were developed to predict failure occurrence from geological parameters, with the random forest model achieving the highest performance (F1-score of 0.986). Consistent findings from correlation coefficient, feature importance, and Sobol sensitivity analyses reveal that low net-to-gross ratios and permeability multipliers are the dominant risk drivers, reflecting reduced reservoir connectivity and limited pressure dissipation. Altogether, these results provide a novel framework for risk-informed site prescreening and monitoring design that explicitly considers rare but high-impact geological scenarios in GCS projects.

25 ENERGY STORAGE↗
DOE OSTI2023

Application of multi-criteria decision analysis techniques and decision support framework for informing select agent designation for agricultural animal pathogens

The United States Department of Agriculture (USDA), Division of Agricultural Select Agents and Toxins (DASAT) established a list of biological agents and toxins (Select Agent List) that potentially threaten agricultural health and safety, the procedures governing the transfer of those agents, and training requirements for entities working with them. Every 2 years the USDA DASAT reviews the Select Agent List, using subject matter experts (SMEs) to perform an assessment and rank the agents. To assist the USDA DASAT biennial review process, we explored the applicability of multi-criteria decision analysis (MCDA) techniques and a Decision Support Framework (DSF) in a logic tree format to identify pathogens for consideration as select agents, applying the approach broadly to include non-select agents to evaluate its robustness and generality. We conducted a literature review of 41 pathogens against 21 criteria for assessing agricultural threat, economic impact, and bioterrorism risk and documented the findings to support this assessment. The most prominent data gaps were those for aerosol stability and animal infectious dose by inhalation and ingestion routes. Technical review of published data and associated scoring recommendations by pathogen-specific SMEs was found to be critical for accuracy, particularly for pathogens with very few known cases, or where proxy data (e.g., from animal models or similar organisms) were used to address data gaps. The MCDA analysis supported the intuitive sense that select agents should rank high on the relative risk scale when considering agricultural health consequences of a bioterrorism attack. However, comparing select agents with non-select agents indicated that there was not a clean break in scores to suggest thresholds for designating select agents, requiring subject matter expertise collectively to establish which analytical results were in good agreement to support the intended purpose in designating select agents. The DSF utilized a logic tree approach to identify pathogens that are of sufficiently low concern that they can be ruled out from consideration as a select agent. In contrast to the MCDA approach, the DSF rules out a pathogen if it fails to meet even one criteria threshold. Both the MCDA and DSF approaches arrived at similar conclusions, suggesting the value of employing the two analytical approaches to add robustness for decision making.

60 APPLIED LIFE SCIENCES↗