Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “PERFORMANCE”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 541 records · Page 30
All sourcesNASA NTRSDOE OSTI
NASA NTRSDate not supplied

Performance Risk Model Validation with Operationally Relevant Tasks

Human Research Program aims to develop methods to support astronauts’ health and productivity during spaceflight. The Crew Health and Performance Probabilistic Risk Assessment (CHP-PRA) team uses powerful computational methods to predict mission risk in both domains: medical and performance. Here, we show how CHP-PRA uses the Performance Risk Model (PRisM) to quantify the performance risk and show an application of the model on operationally relevant tasks. There are various metrics adopted across performance researchers that PRisM can accommodate. For data analysis, interpretation, and integration, we use a method of unifying data from multiple sources by converting each to a single metric. We consult subject matter experts prior to integrating the converted data into PRisM. The method we use is inspired by the Cooper-Harper rating scale [1]. Using this unified metric, we can easily combine data from various tests and lab groups. We explain our conversion method in detail and show how it pertains to the process of testing and validation of PRisM on operational tasks. We conducted an initial validation in collaboration with the Behavioral Health and Performance (BHP) lab. We test PRisM using data on their operationally relevant task ROBoT-r, a track-and-capture task for grappling incoming resupply vehicles [2]. Several other labs at NASA Johnson Space Center worked together to design 7 Functional Task Tests (FTTs) in pursuit of simulating the tasks required after landing on a planetary surface and after return to Earth [3]. Here we use the results from both ROBoT-r and the 7 FTTs and compare their experiment data to PRisM’s computational output to demonstrate how PRisM can support operations by predicting crew performance on future missions.

performance modeling↗
DOE OSTI2023

Assessing parallel path cooling tower performance via artificial neural networks

Real-time monitoring of a research nuclear reactor, a system in which all generated power is dissipated to the environment, can be performed via analysis of the heat rejection from the cooling system. Given an inlet water temperature and flow rate, the reactor power can be well-approximated from the outlet water temperature; however, the instrumentation to measure outlet conditions may not be robust or accurate. If we know how a cooling tower performs from historical data, but cannot measure the outlet temperature, a mathematical representation of the system can be inverted to obtain the outlet water temperature that describes the cooling capacity. Unfortunately, model inversion processes are computationally expensive. To address this, an artificial neural network (ANN) is implemented to assess the performance of a multi-cell cooling tower for a nuclear reactor. This approach leverages the Merkel model to obtain an extensive data set describing performance of the cooling tower cells throughout a wide array of potential operating conditions. The Merkel model is expressed as a function of four parameters: the inlet and outlet water temperatures, inlet air wet bulb temperature, and ratio of liquid-to-gas mass flow rates (L/G), which together provide a non-dimensional number indicative of cooling tower performance, called the Merkel integral. Computing a 4-dimensional data structure that describes finite combinations of the Merkel integral, an inverse model is then generated using an ANN to determine the cell outlet water temperature from the other three model parameters along with the computed Merkel integral. Compared to traditional model inversion methods, the ANN reduces the computational time by approximately 4 orders of magnitude, with effectively no sacrifice to solution accuracy, and could be applied for different cooling towers in the event the performance curve is known. Finally, three use cases of the ANN are then reviewed: (1) determining the cell outlet water temperatures when gas flow at rated conditions (GFRC) is known, (2) performing the prior case without knowledge of the GRFC, and (3) assessing performance differences between the individual tower cells.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2026

Achieving high rate performance in hybrid pristine-recycled cathodes using model-informed electrode designs

Direct recycling lithium-ion battery cathodes, a process that retains the engineered oxide structures from end-of-life materials, presents a cost-effective and energy-efficient alternative to other battery recycling methods. However, while direct-recycled cathodes have demonstrated performance comparable to that of pristine materials at low cycling rates, their high-rate performance remains uncertain. Morphology changes in cathode particles, a main mode of degradation, directly impact rate performance by limiting surface kinetics and solid-phase diffusion. If direct recycling processes do not sufficiently restore pristine-like morphologies, the recycled materials may retain structural defects that hinder high-rate performance. The present work uses a physics-based pseudo-2D model to simulate hybrid electrodes with pristine and artificially “aged/recycled” NMC materials to investigate potential impacts of incorporating performance-limited aged cathode materials into cells. The study highlights how differences in transport and kinetic properties can influence rate capabilities in mixed electrodes — particularly in high-loading cells in high-demand applications. However, model results also reveal a possible mitigation strategy via dual-layer electrode architectures with lower-performing materials positioned near the current collector. Simulations of 4.0 mAh cm −2 cells cycled at 4C using a dual-layer architecture provided approximately 5%–30% more capacity in constant-current protocols compared to homogeneously blended electrode architectures with the same loadings and mixed-material compositions. These findings highlight the importance of strategic electrode design in minimizing potential performance losses and facilitating the integration of recycled materials into high-performance batteries, advancing sustainable and cost-effective battery manufacturing.

25 ENERGY STORAGE↗
DOE OSTI2020

Impact of uranium oxide (UO 2 ) fuel with molybdenum (Mo) inserts on pressurized water reactor performance and safety

This work investigates nuclear reactor performance and safety characteristics of UO 2 with high thermal conductivity Mo insert structures by using multiphysics modeling techniques. Additionally, the purpose of this study is to use scoping analyses to quantify the impact of using Mo inserts from neutronic and heat transfer standpoints. Attention is given to reactor performance parameters, such as cycle length, maximum fuel temperature, temperature gradients in the fuel, and stored energy in the fuel. The finite-element code BISON and the Monte Carlo particle transport code Serpent were used to perform sensitivity analyses on the Mo insert geometry to optimize the insert design and inform larger scale modeling that required the homogenization of the UO 2 and Mo. Although BISON is often used as a fuel performance analysis tool, it is used in this context for heat transfer analysis only. Fuel performance optimization is outside the scope of the current study, but would be important for future work focused on this concept. The results showed that the insert had little impact on neutronic performance and that homogenizing the UO 2 and Mo was acceptable for reactor physics calculations. Reactivity temperature coefficients calculated using homogeneous UO 2 -Mo were shown to be relatively similar to UO 2 , but higher Mo content and 235 U enrichment can reduce the worth of soluble boron and control rods. The effect of insert geometry on heat transfer was much greater, and an approximately 15–20% difference in maximum fuel temperature was predicted between the best and worst performing heat transfer geometries. Furthermore, thermal conductivity calibration based on the finite element analysis results was performed to improve the accuracy of temperature predictions in reactor analysis models that homogenized the UO 2 -Mo fuel. Compared with UO 2 in a pressurized water reactor (PWR), the optimized UO 2 -Mo design increased the margin to fuel melt by 13–32% across the fuel cycle, but it requires the 235U enrichment to exceed 5% to match the cycle length of conventional UO 2 .

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2021

Improved performance of a near-field thermophotovoltaic device by a back gapped reflector

Various spectral control techniques can be applied to improve the performance of a thermophotovoltaic (TPV) device. For example, a back surface reflector (BSR) is a common structure to improve the performance of TPV devices. A conventional metal BSR structure enhances the photogeneration rate by increasing the absorption probability of photons via back surface reflections, affording a second chance for absorption. However, the effects of surface passivation and external luminescence introduced by BSR structures have been previously ignored, which potentially decreases the performance of TPV devices. Recently, a back gapped reflector (BGR) structure was proposed to greatly improve the performance of far-field TPV devices by reducing imperfect reflections at the semiconductor-metal interface. In the present work, the performance improvement on a thin-film, near-field InAs TPV device with a BGR is investigated, comparing its performance to that with a conventional metal BSR. Surface passivation conditions are also investigated to further improve the performance of TPV devices with back reflectors. Further, the output power and efficiency are calculated using an iterative model combining fluctuational electrodynamics and the full drift diffusion model. For the well-passivated condition, when the BSR is replaced by the BGR, the calculated conversion efficiency of the near-field TPV was improved from 16.4% to 21% and the output power was increased by 10%. Finally, the absorption of the back reflectors and external luminescence loss are analyzed to explain the performance improvement.

external luminescence↗
DOE OSTI2023

Several Small or Single Large? Quantifying the Catchment-Wide Performance of On-Site Wastewater Treatment Plants with Inaccurate Sensors

On-site wastewater treatment plants (OSTs) often lack monitoring, resulting in unreliable treatment performance. They thus appear to be a stopgap solution despite their potential contribution to circular water management. Low-maintenance but inaccurate soft sensors are emerging that address this concern. However, how their inaccuracy impacts the catchment-wide treatment performance of a system of many OSTs has not been quantified. Here, we develop a stochastic model to estimate catchment-wide OST performances with a Monte Carlo simulation. In our study, soft sensors with a 70% accuracy improved the treatment performance from 66% of the time functional to 98%. Soft sensors optimized for specificity, indicating the true negative rate, improve the system performance, while sensors optimized for sensitivity, indicating the true positive rate, quantify the treatment performance more accurately. This new insight leads us to suggest programming two soft sensors in practical settings with the same hardware sensor data as input: one soft sensor geared to high specificity for maintenance scheduling and one geared to high sensitivity for performance quantification. Our findings suggest that a maintenance strategy combining inaccurate sensors with appropriate alarm management can vastly improve the mean catchment-wide treatment performance of a system of OSTs.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Synthetic Nuances to Maximize n-Type Organic Electrochemical Transistor and Thermoelectric Performance in Fused Lactam Polymers

A series of fully fused n-type mixed conduction lactam polymers p(g 7 NC n N), systematically increasing the alkyl side chain content, are synthesized via an inexpensive, nontoxic, precious-metal-free aldol polycondensation. Employing these polymers as channel materials in organic electrochemical transistors (OECTs) affords state-of-the-art n-type performance with p(g 7 NC 10 N) recording an OECT electron mobility of 1.20 x 10 -2 cm 2 V -1 s -1 and a μC* figure of merit of 1.83 F cm -1 V -1 s -1. In parallel to high OECT performance, upon solution doping with (4-(1,3-dimethyl-2,3-dihydro-1H-benzoimidazol-2-yl)phenyl)dimethylamine (N-DMBI), the highest thermoelectric performance is observed for p(g 7 NC 4 N), with a maximum electrical conductivity of 7.67 S cm -1 and a power factor of 10.4 μWm -1 K -2 . These results are among the highest reported for n-type polymers. Importantly, while this series of fused polylactam organic mixed ionic-electronic conductors (OMIECs) highlights that synthetic molecular design strategies to bolster OECT performance can be translated to also achieve high organic thermoelectric (OTE) performance, a nuanced synthetic approach must be used to optimize performance. Herein, we outline the performance metrics and provide new insights into the molecular design guidelines for the next generation of high-performance n-type materials for mixed conduction applications, presenting for the first time the results of a single polymer series within both OECT and OTE applications.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

Graphite-Embedded High-Performance Insulated Metal Substrate for Wide-Bandgap Power Modules

Emerging wide-bandgap (WBG) semiconductor devices such as silicon carbide (SiC) metal–oxide semiconductor field-effect transistors (MOSFETs) and gallium nitride high-electron-mobility transistors can handle high power in reduced semiconductor areas better than conventional Si-based devices owing to superior material properties. With increased power loss density in a WBG-based converter and reduced die size in power modules, thermal management of power devices must be optimized for high performance. Here, we present a graphite-embedded insulated metal substrate (thermally-annealed-pyrolytic-graphite-embedded insulated metal substrate—IMSwTPG) designed for WBG power modules. Theoretical thermal performance analysis of graphite-embedded metal cores is presented, with design details for IMSwTPG with embedded graphite to replace a direct-bonded copper (DBC) substrate. The proposed IMSwTPG is compared with an aluminum nitride-based DBC substrate using finite-element thermal analysis for steady-state and transient thermal performance. The solutions’ thermal performances are compared under different coolant temperature and thermal loading conditions, and the proposed substrate's electrical performance is validated with static and dynamic characterization. Using graphite-embedded substrates, junction-to-case thermal resistance of SiC MOSFETs can be reduced up to 17%, and device current density can be increased by 10%, regardless of the thermal management strategy used to cool the substrate. Reduced transient thermal impedance of up to 40% of dies owing to increased heat capacity is validated in transient thermal simulations and experiments. The half-bridge power module's electrical performance is evaluated for on -state resistance, switching performance, and switching loss at three junction temperature conditions. The proposed substrate solution has minimal impact on conduction and switching performance of SiC MOSFETs.

42 ENGINEERING↗
DOE OSTI2025

Insights from Optimizing HPL Performance on Exascale Systems: A Comparative Analysis of Panel Factorization

High performance LINPACK (HPL) remains the primary benchmark for evaluating supercomputing performance. It includes many parts with substantial internal complexity, and its performance is affected by a large number of parameters that interact in ways that are difficult to predict on large-scale heterogeneous supercomputer systems. We present a comprehensive performance analysis of HPL on Frontier, the world’s first exascale supercomputer, which achieved HPL performance of 1.35 exaflops. Through empirical parameter tuning, detailed modeling, and comparative evaluation, we uncover critical performance insights, share lessons learned, and outline best practices for effective parameter tuning on exascale systems. We introduce and evaluate two novel PDFACT strategies: a dedicated-thread (DT) variant and a GPU-based variant (GPUPDFACT) implementation using HIP cooperative groups, demonstrating that GPU-based factorization outperforms conventional CPU-based PDFACT on Frontier’s architecture. Our findings establish key performance factors for HPL on exascale systems and offer valuable guidance for future high-performance computing and benchmarking efforts.

Lu, Hao [ORNL] (ORCID:000000018941870X)↗
DOE OSTI2024

Refining HPCToolkit for application performance analysis at exascale

As part of the US Department of Energy’s Exascale Computing Project (ECP), Rice University has been refining its HPCToolkit performance tools to better support measurement and analysis of applications executing on exascale supercomputers. To efficiently collect performance measurements of GPU-accelerated applications, HPCToolkit employs novel non-blocking data structures to communicate performance measurements between tool threads and application threads. To attribute performance information in detail to source lines, loop nests, and inlined call chains, HPCToolkit performs parallel analysis of large CPU and GPU binaries involved in the execution of an exascale application to rapidly recover mappings between machine instructions and source code. To analyze terabytes of performance measurements gathered during executions at exascale, HPCToolkit employs distributed-memory parallelism, multithreading, sparse data structures, and out-of-core streaming analysis algorithms. To support interactive exploration of profiles up to terabytes in size, HPCToolkit’s hpcviewer graphical user interface uses out-of-core methods to visualize performance data. The result of these efforts is that HPCToolkit now supports collection, analysis, and presentation of profiles and traces of GPU-accelerated applications at exascale. These improvements have enabled HPCToolkit to efficiently measure, analyze and explore terabytes of performance data for executions using as many as 64K MPI ranks and 64K GPU tiles on ORNL’s Frontier supercomputer. HPCToolkit’s support for measurement and analysis of GPU-accelerated applications has been employed to study a collection of open-science applications developed as part of ECP. This paper reports on these experiences, which provided insight into opportunities for tuning applications, strengths and weaknesses of HPCToolkit itself, as well as unexpected behaviors in executions at exascale.

Adhianto, Laksono↗
DOE OSTI2021

Performance Comparison of Circular and Spherical Error Probable Estimators

This report compares the performance of three Circular Error Probable (CEP) estimators: the Grubbs-Patnaik estimator, a new, non-iterative, radial-integration estimator, and a median estimator. It also compares the performance of two Spherical Error Probable (SEP) estimators. The performance of each estimator is assessed in terms of bias, uncertainty, robustness, and computational complexity. Robustness is evaluated with respect to outliers, variations in the underlying statistical distribution characterizing munition impact positions, and impact-position measurement errors. The performance assessments indicate the radial-integration and Grubbs-Patnaik estimators perform nearly identically providing the statistical distribution of impact-position coordinates is jointly normal with zero means. In that case, both estimators outperform the median estimator by about 2% relative to the true CEP in terms of estimator uncertainty. The bias performance of the radial-integration and median estimators is close to zero for jointly normal impacts, however, the Grubbs-Patnaik estimator can be significantly biased for jointly normal impacts with non-zero means. When the statistical distribution characterizing impact positions is known, but not jointly normal, the radial-integration estimator is superior. In this case, the median estimator also outperforms the Grubbs-Patnaik estimator but is not quite as good as the radial-integration estimator. If the statistical distribution characterizing impacts is unknown and not jointly normal, or if distribution parameters are difficult or impractical to estimate, or if test data is corrupted with outliers, then the median estimator dramatically outperforms the other estimators, especially in terms of estimation bias. Unexpectedly, measurement noise did not significantly degrade the performance of any of the estimators, except for cases with signal to noise ratios less than five. Although the Grubbs-Patnaik estimator has remained the gold standard for CEP estimation for over half a century, the performance assessments indicate the new, non-iterative, radial-integration estimator and the median estimator offer significant advantages and, in most practical real-world conditions, are superior estimators. These estimators are also useful for SEP estimation whereas the Grubbs-Patnaik estimator does not extend to three dimensions.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Quantitative Performance Assessment of Proxy Apps and Parents (Report for ECP Proxy App Project Milestone ADCD-504-28)

The ECP Proxy Application Project has an annual milestone to assess the state of ECP proxy applications and their role in the overall ECP ecosystem. Our FY22 March/April milestone (ADCD- 504-28) proposed to: Assess the fidelity of proxy applications compared to their respective parents in terms of kernel and I/O behavior, and predictability. Similarity techniques will be applied for quantitative comparison of proxy/parent kernel behavior. MACSio evaluation will continue and support for OpenPMD backends will be explored. The execution time predictability of proxy apps with respect to their parents will be explored through a carefully designed scaling study and code comparisons. Note that in this FY, we also have quantitative assessment milestones that are due in September and are, therefore, not included in the description above or in this report. Another report on these deliverables will be generated and submitted upon completion of these milestones. To satisfy this milestone, the following specific tasks were completed: Study the ability of MACSio to represent I/O workloads of adaptive mesh codes. Re-define the performance counter groups for contemporary Intel and IBM platforms to better match specific hardware components and to better align across platforms (make cross-platform comparison more accurate). Perform cosine similarity study based on the new performance counter groups on the Intel and IBM P9 platforms. Perform detailed analysis of performance counter data to accurately average and align the data to maintain phases across all executions and develop methods to reduce the set of collected performance counters used in cosine similarity analysis. Apply a quantitative similarity comparison between proxy and parent CPU kernels. Perform scaling studies to understand the accuracy of predictability of the parent performance using its respective proxy application. This report presents highlights of these efforts.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Development of Transformative Preparation Methods to Push up High Q&G Performance of FRIB Spare HWR Cryomodule Cavities

The FRIB accelerator project construction, a top priority of US nuclear science, was completed in January 2022, and is now moving to user operation. The stable and reliable operation of the accelerating cryomodules is essential in achieving/fulfilling DOE and user expectations. So far, FRIB cryomodules meet all FRIB specifications for cavity performance. However, during the lifetime of machine operation, degradation of cryomodule performance is possible, as reported in similar operating facilities (CEBAF, SNS). If cryomodule degradation is observed at FRIB, the under-performing cryomodule will require replacement/maintenance. In effort to manage operational reliability, FRIB plans to construct a 0.53 half-wave cryomodule to serve as an active spare. In a parallel effort, FRIB will also work toward increasing operational Q and gradient of spare cryomodule cavities to gain an overall performance margin to support future operational reliability. The current FRIB cavity designs have a potential to operate at gradients higher than 8 MV/m, but are currently limited by field emission (FE) and/or high field Q slope (HFQS); known issue in buffered chemical polished (BCP) treated cavities. The proposal looks to develop transformative surface preparation treatments to improve the operational gradient of spare cryomodules higher than 10 MV/m while maintaining high Q. Thus, increasing operational margin by 30 - 50%. With the goal to improve operational reliability set, the proposal will investigate multiple objectives as possible paths forward to achieve an overall increase in cavity performance and gain a better understanding of SRF limiting mechanisms. The proposal will study the application of different chemical surface treatments to 0.53 half-wave cavities, with the addition of low temperature bakes (LTB), and measure their effects on accelerating performance. Proposed chemical treatments to be explored in this proposal include conventional EP acid mixtures, as well as innovated EP and BCP acid mixtures designed to simplify processing paths in migrating FE and HFQS. The proposed transformative treatment wet N-doping also has the potential to replicate recent advancements in SRF technology relating to nitrogen doping and high Q operation without the requirement for an ultra-high vacuum annealing furnace; currently being developed at FNAL and JLAB. In parallel, high Q performance relating to flux trapping will be investigated with the installation of a second layer of magnetic shielding in the vertical test Dewar. The research objectives presented in the proposal, and their corresponding effects on cavity performance, will provide essential knowledge and future guidance to the SRF community and provide possible paths for future SRF based projects and applications.

43 PARTICLE ACCELERATORS↗
DOE OSTI2023

Evaluation of BISON metallic fuel performance modeling against experimental measurements within FIPD and IMIS databases

Simulations were conducted using the BISON fuel performance code on an automated process to read initial and operating conditions from two databases—the Fuels Irradiation and Physics Database (FIPD) and Integral Fast Reactor Materials Information System (IMIS) database. These databases contain metallic fuel data from the Experimental Breeder Reactor-II (EBR-II) and the Fast Flux Test Facility (FFTF). The work demonstrates use of an integrated framework to access EBR-II fuel pin data for evaluating fuel performance models contained within BISON to predict fuel performance of next-generation metallic fuel systems. Between IMIS and FIPD, there is enough information to conduct 1,977 unique EBR-II metallic fuel pin histories from 29 different experiments, and 338 pins from FFTF MFF-3 and MFF-5 with varying levels of details between the two databases. Each of these fuel performance histories includes a high-resolution power history, flux history, coolant channel flow rates, and coolant channel temperatures, and new model developments in BISON since the initial demonstration of this integrated framework. Fission gas release (FGR), cumulative damage fraction, fuel axial swelling, FCCI wastage thickness, cladding profilometry, and burnup were all simulated in BISON and compared to post-irradiation examination (PIE) results to evaluate BISON fuel performance modeling. Implementation of new fuel performance models into a generic BISON input file coupled with IMIS and FIPD yielded results with a better representation of physics than the initial evaluation of the integrated framework. Cladding profilometry, FGR, and fuel axial swelling were found to be in good agreement with PIE measurements for most of the pins simulated. The chosen mechanical contact solver was found to significantly impact the axial fuel swelling and cladding strain predictions when used in conjunction with the U-Pu-Zr hot-pressing model since it bound the fuel to prevent further swelling and increased hydrostatic stresses. This work suggests that fuel performance modeling in BISON under steady-state conditions represents the PIE data well and should be reassessed when new PIE data become available in IMIS and FIPD databases and when improved physical models to better capture fuel performance are added to BISON.

Paaren, Kyle M.↗
DOE OSTI2023

Performance of methods for SARS-CoV-2 variant detection and abundance estimation within mixed population samples

The accurate identification of SARS-CoV-2 (SC2) variants and estimation of their abundance in mixed population samples (e.g., air or wastewater) is imperative for successful surveillance of community level trends. Assessing the performance of SC2 variant composition estimators (VCEs) should improve our confidence in public health decision making. Here, we introduce a linear regression based VCE and compare its performance to four other VCEs: two re-purposed DNA sequence read classifiers (Kallisto and Kraken2), a maximum-likelihood based method (Lineage deComposition for Sars-Cov-2 pooled samples (LCS)), and a regression based method (Freyja). We simulated DNA sequence datasets of known variant composition from both Illumina and Oxford Nanopore Technologies (ONT) platforms and assessed the performance of each VCE. We also evaluated VCEs performance using publicly available empirical wastewater samples collected for SC2 surveillance efforts. Bioinformatic analyses were performed with a custom NextFlow workflow (C-WAP, CFSAN Wastewater Analysis Pipeline). Relative root mean squared error (RRMSE) was used as a measure of performance with respect to the known abundance and concordance correlation coefficient (CCC) was used to measure agreement between pairs of estimators. Based on our results from simulated data, Kallisto was the most accurate estimator as it had the lowest RRMSE, followed by Freyja. Kallisto and Freyja had the most similar predictions, reflected by the highest CCC metrics. We also found that accuracy was platform and amplicon panel dependent. For example, the accuracy of Freyja was significantly higher with Illumina data compared to ONT data; performance of Kallisto was best with ARTICv4. However, when analyzing empirical data there was poor agreement among methods and variations in the number of variants detected (e.g., Freyja ARTICv4 had a mean of 2.2 variants while Kallisto ARTICv4 had a mean of 10.1 variants). This work provides an understanding of the differences in performance of a number of VCEs and how accurate they are in capturing the relative abundance of SC2 variants within a mixed sample (e.g., wastewater). Such information should help officials gauge the confidence they can have in such data for informing public health decisions.

60 APPLIED LIFE SCIENCES↗
NASA NTRS1973

Development of a standardized battery of performance tests for the assessment of noise stress effects

A set of 36 relatively independent categories of human performance were identified. These categories encompass human performance in the cognitive, perceptual, and psychomotor areas, and include diagnostic measures and sensitive performance metrics. Then a prototype standardized test battery was constructed, and research was conducted to obtain information on the sensitivity of the tests to stress, the sensitivity of selected categories of performance degradation, the time course of stress effects on each of the selected tests, and the learning curves associated with each test. A research project utilizing a three factor partially repeated analysis of covariance design was conducted in which 60 male subjects were exposed to variations in noise level and quality during performance testing. Effects of randomly intermittent noise on performance of the reaction time tests were observed, but most of the other performance tests showed consistent stability. The results of 14 analyses of covariance of the data taken from the performance of the 60 subjects on the prototype standardized test battery provided information which will enable the final development and test of a standardized test battery and the associated development of differential sensitivity metrics and diagnostic classificatory system.

Theologus, G. C.↗
NASA NTRS1984

Performance Measures for Aircraft Landings as a Function of Aircraft Dynamics

A theory of performance measurement for operator controlled systems is presented. The theory permits synthesis of a system performance measure which scores performance on successive data samples based on the impact of the sampled performance on the overall summary of performance. The development of measures for aircraft carrier landings for the glide path and angle of attack control channels is documented. While developing the performance measures, the measures used previously were evaluated and were found to lack the necessary discrimination capability. The previously used measure, the RMS of deviations from the glide path, can, for instance, provide identical scores for both satisfactory and unsatisfactory flight paths. Two types of performance measures developed for aircraft landings are described. Also, an argument is given for the need to test performance measures prior to their use. A suggested test of the measures is offered.

Connelly, E. M.↗
NASA NTRS1989

Reliability and performance evaluation of systems containing embedded rule-based expert systems

A method for evaluating the reliability of real-time systems containing embedded rule-based expert systems is proposed and investigated. It is a three stage technique that addresses the impact of knowledge-base uncertainties on the performance of expert systems. In the first stage, a Markov reliability model of the system is developed which identifies the key performance parameters of the expert system. In the second stage, the evaluation method is used to determine the values of the expert system's key performance parameters. The performance parameters can be evaluated directly by using a probabilistic model of uncertainties in the knowledge-base or by using sensitivity analyses. In the third and final state, the performance parameters of the expert system are combined with performance parameters for other system components and subsystems to evaluate the reliability and performance of the complete system. The evaluation method is demonstrated in the context of a simple expert system used to supervise the performances of an FDI algorithm associated with an aircraft longitudinal flight-control system.

Beaton, Robert M.↗