Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Tool”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13

Comparative Analysis of TCR and TCR-pMHC Complex Structure Prediction Tools

The rapid development of computational approaches for predicting the structures of T cell receptors (TCRs) and TCR-peptide-major histocompatibility (TCR-pMHC) complexes, accelerated by AI breakthroughs such as AlphaFold, has made it feasible to calculate these structures with increasing accuracy. Although these tools show great potential, their relative accuracy and limitations remain unclear due to the lack of standardized benchmarks. Here, we systematically evaluate seven tools for predicting isolated TCR structures together with six tools for predicting TCR-pMHC complex structures. The methods include homology-based approaches, general prediction tools using AlphaFold, TCR-specific tools derived from AlphaFold2, and the newly developed tFold-TCR model. The evaluation uses a post-training data set comprising 40 αβ TCRs and 27 TCR-pMHC complexes (21 Class I and 6 Class II). Model accuracy is assessed at global, local, and interface levels using a variety of metrics. We find that each tool offers distinct advantages in various aspects of its predictions. AlphaFold2, AlphaFold3, and tFold-TCR excel in overall accuracy of TCR structure prediction, and TCRmodel2 and AlphaFold2 perform well in overall accuracy of TCR-pMHC structure prediction. However, TCR-specific tools derived from AlphaFold2 show lower accuracy in the framework region than both homology-based methods and general-purpose tools such as AlphaFold, and challenges remain for all in modeling CDR3 loops, docking orientations, TCR-peptide interfaces, and Class II MHC-peptide interfaces. Furthermore, these findings will guide researchers in selecting appropriate tools, emphasize the importance of using multiple evaluation metrics to assess model performance, and offer suggestions for improving TCR and TCR-pMHC structure prediction tools.

Chemical structure↗

AN APPROACH TO BRINGING AUTOMATED FAULT DETECTION AND DIAGNOSIS (AFDD) TOOLS FOR HVAC&R INTO THE MAINSTREAM

Heating, ventilation and air-conditioning (HVAC) systems can consume over 5 quads of energy annually, representing 30% of energy consumption in the U.S. in commercial buildings. Additionally, commercial refrigeration (R) systems add about 2 quads to commercial buildings energy consumption. Most HVAC systems have one or more faults (low/high refrigerant charge, valve leakage, condenser/evaporator fouling, filter/dryer restriction, economizer faults, controls faults) that result in increased energy consumption. Automated fault detection and diagnosis (AFDD) tools have been developed to address this national issue and many tools are commercially available. AFDD tools have the potential to save considerable energy for existing commercial RTUs, chillers and refrigeration systems. These devices can be used for both retro commissioning, and, when faults are addressed, continuous commissioning as well. However, there appears to be multiple market barriers for this technology. A key market barrier for this technology is the lack of awareness of AFDD products among potential customers. Most HVAC contractors are not familiar with the latest AFDD technologies and HVAC technicians lack skills regarding these technologies. Quantifying potential benefits to building owners is difficult since there are several FDD tools with varying capabilities. For instance, there are several FDD products ranging from handling just economizer faults to those that also handle full-blown refrigerant-side and air-side faults. Methods/algorithms used in FDD vary significantly. Even though there are efforts to develop standards, currently there are no standards/methods to define functions, capabilities, accuracy, and reliability of FDD tools. Moreover, most of the commercial AFDD tools have not been verified in the field independently. This paper presents a comprehensive approach to bringing HVAC AFDD tools into the mainstream. The approach involves demonstrating ten commercially available tools at ten different sites, independent testing and evaluation of the FDD tools, communication with various stakeholders, identifying market barriers, and assisting utility companies in developing incentive programs. This paper presents selection of AFDD tools, ite identification, and field testing and evaluation method.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Power Plant Model Validation Tool

The PPMV is used to validate generator model using disturbance recordings. The PPMV tool contains a collection of power plant models and model validation studies, as well as disturbance recordings from a number of historic grid events. The user can import data from a new disturbance into the database, which converts PMU and SCADA data into GE PSLF format, and then run the tool to validate (or invalidate) the model for a specific power plant against its actual performance. The PNNL PPMV tool enables the automation of the process of power plant model validation using disturbance recordings. The tool uses PMU and SCADA measurements as input information. The tool automatically adjusts all required EPCL scripts and interacts with GE PSLF in the batch mode. The main tool features includes: The tool interacts with GE PSLF; The tool uses GE PSLF Play-In Function for generator model validation; Database of projects (model validation studies); Database of the historic events; Database of the power plant; The tool has advanced visualization capabilities; and the tool automatically generates reports.

Source record↗

Smoothing tool design and performance during subaperture glass polishing

During subaperture tool grinding and polishing, overlaps of the tool influence function can result in undesirable mid-spatial frequency (MSF) errors in the form of surface ripples, which are often corrected using a smoothing polishing step. Here, in this study, flat multi-layer smoothing polishing tools are designed and tested to simultaneously (1) reduce or remove MSF errors, (2) minimize surface figure degradation, and (3) maximize the material removal rate. A time-dependent convergence model in which spatial material removal varies with a workpiece-tool height mismatch, combined with a finite element mechanical analysis to determine the interface contact pressure distribution, was developed to evaluate various smoothing tool designs as a function of tool material properties, thicknesses, pad textures, and displacements. An improvement in smoothing tool performance is achieved when the gap pressure constant, $\overline{h}$ (which describes the inverse rate at which the pressure drops with a workpiece-tool height mismatch), is minimized for smaller spatial scale length surface features (namely, MSF errors) and maximized for large spatial scale length features (i.e., surface figure). Five specific smoothing tool designs were experimentally evaluated. A two-layer smoothing tool using a thin, grooved IC1000 polyurethane pad (with a high elastic modulus, E pad =360 MPa ), thicker blue foam (with an intermediate modulus, E foam =5.3 MPa ) underlayer, and an optimized displacement (d t =1 mm ) provided the best overall performance (namely, high MSF error convergence, minimal surface figure degradation, and high material removal rate).

47 OTHER INSTRUMENTATION↗

Random adaptive tool path for zonal optics fabrication

Deterministic optics fabrication using sub-aperture tools has been vital for manufacturing precision optical surfaces. The fabrication process requires the tool influence function and the tool path to calculate the dwell time that guides the tool to bring surface quality within tight design tolerances. Widely used spiral and raster paths may leave excess waviness from the tool path, and the unavoidable constant removal layer is added to obtain positive dwell time. This waviness can be removed by either using smaller tools sequentially or randomizing the tool path. However, the existing tool-path solutions can hardly adapt to different surface aperture shapes and localized surface errors. Process efficiency and accuracy are also not well considered in tool-path planning. We propose an innovative zonal Random Adaptive Path (RAP) to solve these problems in this study. Firstly, RAP can be flexibly adapted to different surface aperture shapes by introducing part boundary. Secondly, an average threshold strategy is used in the RAP planning to improve efficiency, enabling the surface errors to be selectively corrected. Finally, the threshold is performed in several passes within one processing cycle, each with its RAP, until the desired residual is achieved. The performance of the proposed RAP is studied by comparing it with the conventional tool paths. The results demonstrated that RAP takes the least processing time and achieves the best surface quality, which verifies the effectiveness of RAP in deterministic optics fabrication.

36 MATERIALS SCIENCE↗

The Efficacy of Ultraviolet Radiation for Sterilizing Tools Used for Surgically Implanting Transmitters into Fish

Telemetry is frequently used to examine the behavior of fish, and the transmitters used are normally surgically implanted into the coelom of fish. Implantation requires the use of surgical tools such as scalpels, forceps, needle holders, and sutures. When several fish are implanted consecutively for large telemetry studies, it is common for surgical tools to be sterilized or, at minimum, disinfected between each use so that pathogens that may be present are not spread among fish. However, autoclaving tools can take a long period of time, and chemical sterilants or disinfectants can be harmful to both humans and fish and have varied effectiveness. Ultraviolet (UV) radiation is commonly used to disinfect water in aquaculture facilities. However, this technology has not been widely used to sterilize tools for surgical implantation of transmitters in fish. To determine its efficacy for this application, Pacific Northwest National Laboratory researchers used UV radiation to disinfect surgical tools (i.e., forceps, needle holder, stab scalpel, and suture) that were exposed to one of four aquatic organisms that typically lead to negative health issues for salmonids. These organisms included Aeromonas salmonicida, Flavobacterium psychrophilum, Renibacterium salmoninarum, and Saprolegnia parasitica. Surgical tools were exposed to the bacteria by dipping them into a confluent suspension of three varying concentrations (i.e., low, medium, high). After exposure to the bacterial culture, tools were placed into a mobile Millipore UV sterilization apparatus. The tools were then exposed for three different time periods—2, 5, or 15 min. S. parasitica, a water mold, was tested using an agar plate method and forceps-pinch method. UV light exposures of 5 and 15 min were effective at killing all four organisms. UV light was also effective at killing Geobacillus stearothermophilus, the organism used as a biological indicator to verify effectiveness of steam sterilizers. These techniques appear to provide a quick alternative disinfection technique for some surgical tools that is less harmful to both humans and fish while not producing chemical waste. However, we do not recommend using these methods with tools that have overlapping parts or other structures that cannot be directly exposed to UV light such as needle holders.

Walker, Ricardo W.↗

Electronic Safety Resource Tools -- Supporting Hydrogen and Fuel Cell Commercialization

The Pacific Northwest National Laboratory (PNNL) Hydrogen Safety Program conducted a planning session in Los Angeles, CA on April 1, 2014 to consider what electronic safety tools would benefit the next phase of hydrogen and fuel cell commercialization. A diverse, 20-person team led by an experienced facilitator considered the question as it applied to the eight most relevant user groups. The results and subsequent evaluation activities revealed several possible resource tools that could greatly benefit users. The tool identified as having the greatest potential for impact is a hydrogen safety portal, which can be the central location for integrating and disseminating safety information (including most of the tools identified in this report). Such a tool can provide credible and reliable information from a trustworthy source. Other impactful tools identified include a codes and standards wizard to guide users through a series of questions relating to application and specific features of the requirements; a scenario-based virtual reality training for first responders; peer networking tools to bring users from focused groups together to discuss and collaborate on hydrogen safety issues; and a focused tool for training inspectors. Table ES.1 provides results of the planning session, including proposed new tools and changes to existing tools.

08 HYDROGEN↗

Tool for Inspecting Alignment of Twinaxial Connectors

A proposed tool would be used to inspect alignments of mating twinaxial-connector assemblies on interconnecting wiring harnesses. More specifically, the tool would be used to inspect the alignment of each contact pin of each connector on one assembly with the corresponding socket in the corresponding connector on the other assembly. It is necessary to inspect the alignment because if mating of the assemblies is attempted when any pin/socket pair is misaligned beyond tolerance, the connection will not be completed and the dielectric material in the socket will be damaged (see Figure 1). Although the basic principle of the tool is applicable to almost any type of mating connector assemblies, the specific geometry of the tool must match the pin-and-socket geometry of the specific mating assemblies to be inspected. In the original application for which the tool was conceived, each of the mating assemblies contains eight twinaxial connectors; the pin diameter is 0.014 in. (.0.35 mm), and the maximum allowable pin/socket misalignment is 0.007 in. (.0.18 mm). Incomplete connections can result in loss of flight data within the functional path to the space shuttle crew cockpit displays. The tool (see Figure 2) would consist mainly of a transparent disk with alignment clocking tabs that can be fitted onto either connector assembly. Sets of circles or equivalent reference markings are affixed to the face of the tool, located at the desired positions of the mating contact pairs. An inspector would simply fit the tool onto a connector assembly, engaging the clocking tabs until the tool fits tightly. The inspector would then align one set of circles positioning a line of sight perpendicular to one contact within the connector assembly. Mis alignments would be evidenced by the tip of a pin contact straying past the inner edge of the circle. Socket contact misalignments would be evidenced by a crescent-shaped portion of the white dielectric appearing within the circle. The tool could include a variable magnifier plus an illuminator that could be configured so as not to cast shadows.

Smith, Christopher R.↗

Diamond Smoothing Tools

Diamond smoothing tools have been proposed for use in conjunction with diamond cutting tools that are used in many finish-machining operations. Diamond machining (including finishing) is often used, for example, in fabrication of precise metal mirrors. A diamond smoothing tool according to the proposal would have a smooth spherical surface. For a given finish machining operation, the smoothing tool would be mounted next to the cutting tool. The smoothing tool would slide on the machined surface left behind by the cutting tool, plastically deforming the surface material and thereby reducing the roughness of the surface, closing microcracks and otherwise generally reducing or eliminating microscopic surface and subsurface defects, and increasing the microhardness of the surface layer. It has been estimated that if smoothing tools of this type were used in conjunction with cutting tools on sufficiently precise lathes, it would be possible to reduce the roughness of machined surfaces to as little as 3 nm. A tool according to the proposal would consist of a smoothing insert in a metal holder. The smoothing insert would be made from a diamond/metal functionally graded composite rod preform, which, in turn, would be made by sintering together a bulk single-crystal or polycrystalline diamond, a diamond powder, and a metallic alloy at high pressure. To form the spherical smoothing tip, the diamond end of the preform would be subjected to flat grinding, conical grinding, spherical grinding using diamond wheels, and finally spherical polishing and/or buffing using diamond powders. If the diamond were a single crystal, then it would be crystallographically oriented, relative to the machining motion, to minimize its wear and maximize its hardness. Spherically polished diamonds could also be useful for purposes other than smoothing in finish machining: They would likely also be suitable for use as heat-resistant, wear-resistant, unlubricated sliding-fit bearing inserts.

Voronov, Oleg↗

Rover Wheel-Actuated Tool Interface

A report describes an interface for utilizing some of the mobility features of a mobile robot for general-purpose manipulation of tools and other objects. The robot in question, now undergoing conceptual development for use on the Moon, is the All-Terrain Hex-Limbed Extra-Terrestrial Explorer (ATHLETE) rover, which is designed to roll over gentle terrain or walk over rough or steep terrain. Each leg of the robot is a six-degree-of-freedom general purpose manipulator tipped by a wheel with a motor drive. The tool interface includes a square cross-section peg, equivalent to a conventional socket-wrench drive, that rotates with the wheel. The tool interface also includes a clamp that holds a tool on the peg, and a pair of fold-out cameras that provides close-up stereoscopic images of the tool and its vicinity. The field of view of the imagers is actuated by the clamp mechanism and is specific to each tool. The motor drive can power any of a variety of tools, including rotating tools for helical fasteners, drills, and such clamping tools as pliers. With the addition of a flexible coupling, it could also power another tool or remote manipulator at a short distance. The socket drive can provide very high torque and power because it is driven by the wheel motor.

Matthews, Janet↗

Ultrasonically Actuated Tools for Abrading Rock Surfaces

An ultrasonic rock-abrasion tool (URAT) was developed using the same principle of ultrasonic/sonic actuation as that of the tools described in two prior NASA Tech Briefs articles: Ultrasonic/ Sonic Drill/Corers With Integrated Sensors (NPO-20856), Vol. 25, No. 1 (January 2001), page 38 and Ultrasonic/ Sonic Mechanisms for Drilling and Coring (NPO-30291), Vol. 27, No. 9 (September 2003), page 65. Hence, like those tools, the URAT offers the same advantages of low power demand, mechanical simplicity, compactness, and ability to function with very small axial loading (very small contact force between tool and rock). Like a tool described in the second of the cited previous articles, a URAT includes (1) a drive mechanism that comprises a piezoelectric ultrasonic actuator, an amplification horn, and a mass that is free to move axially over a limited range and (2) an abrasion tool bit. A URAT tool bit is a disk that has been machined or otherwise formed to have a large number of teeth and an overall shape chosen to impart the desired shape (which could be flat or curved) to the rock surface to be abraded. In operation, the disk and thus the teeth are vibrated in contact with the rock surface. The concentrated stresses at the tips of the impinging teeth repeatedly induce microfractures and thereby abrade the rock. The motion of the tool induces an ultrasonic transport effect that displaces the cuttings from the abraded area. The figure shows a prototype URAT. A piezoelectric-stack/horn actuator is housed in a cylindrical container. The movement of the actuator and bit with respect to the housing is aided by use of mechanical sliders. A set of springs accommodates the motion of the actuator and bit into or out of the housing through an axial range between 5 and 7 mm. The springs impose an approximately constant force of contact between the tool bit and the rock to be abraded. A dust shield surrounds the bit, serving as a barrier to reduce the migration of rock debris to sensitive instrumentation or mechanisms in the vicinity. A bushing at the tool-bit end of the housing reduces the flow of dust into the actuator and retains the bit when no axial load is applied.

Dolgin, Benjamin↗

Modeling and Simulation Tools for Heavy Lift Airships

For conventional fixed wing and rotary wing aircraft a variety of modeling and simulation tools have been developed to provide designers the means to thoroughly investigate proposed designs and operational concepts. However, lighter-than-air (LTA) airships, hybrid air vehicles, and aerostats have some important aspects that are different from heavier-than-air (HTA) vehicles. In order to account for these differences, modifications are required to the standard design tools to fully characterize the LTA vehicle design and performance parameters.. To address these LTA design and operational factors, LTA development organizations have created unique proprietary modeling tools, often at their own expense. An expansion of this limited LTA tool set could be accomplished by leveraging existing modeling and simulation capabilities available in the National laboratories and public research centers. Development of an expanded set of publicly available LTA modeling and simulation tools for LTA developers would mitigate the reliance on proprietary LTA design tools in use today. A set of well researched, open source, high fidelity LTA design modeling and simulation tools would advance LTA vehicle development and also provide the analytical basis for accurate LTA operational cost assessments. This paper will present the modeling and analysis tool capabilities required for LTA vehicle design, analysis of operations, and full life-cycle support. A survey of the tools currently available will be assessed to identify the gaps between their capabilities and the LTA industry's needs. Options for development of new modeling and analysis capabilities to supplement contemporary tools will also be presented.

airship design and analysis↗

Data are from Mars, Tools are from Venus

Although during the data production phase, the data producers will usually ensure the products to be easily used by the specific power users the products serve. However, most data products are also posted for general public to use. It is not straightforward for data producers to anticipate what tools that these general end-data users are likely to use. In this talk, we will try to help fill in the gap by going over various tools related to Earth Science and how they work with the existing NASA HDF (Hierarchical Data Format) data products and the reasons why some products cannot be visualized or analyzed by existing tools. One goal is for to give insights for data producers on how to make their data product more interoperable. On the other hand, we also provide some hints for end users on how to make tools work with existing HDF data products. (tool category list: check the comments) HDF-EOS tools: HDFView HDF-EOS Plugin, HEG, h4tonccf, hdf-eos2 dumper, NCL, MATLAB, IDL, etc.net; CDF-Java tools: Panoply, IDV, toosUI, NcML, etc.net; CDF-C tools: ArcGIS Desktop, GrADS, NCL, NCO, etc.; GDAL tools: ArcGIS Desktop, QGIS, Google Earth, etc.; CSV tools: ArcGIS Online, MS Excel, Tableau, etc.

hdf↗

Evaluation of Crew-Centric Onboard Mission Operations Planning and Execution Tool: Year 2

Currently, mission planning for the International Space Station (ISS) is largely affected by ground operators in mission control. The task of creating a week-long mission plan for ISS crew takes dozens of people multiple days to complete, and is often created far in advance of its execution. As such, re-planning or adapting to changing real-time constraints or emergent issues is similarly taxing. As we design for future mission operations concepts to other planets or areas with limited connectivity to Earth, more of these ground-based tasks will need to be handled autonomously by the crew onboard.There is a need for a highly usable (including low training time) tool that enables efficient self-scheduling and execution within a single package. The ISS Program has identified Playbook as a potential option. It already has high crew acceptance as a plan viewer from previous analogs and can now support a crew self-scheduling assessment on ISS or on another mission. The goals of this work, a collaboration between the Human Research Program and the ISS Program, are to inform the design of systems for more autonomous crew operations and provide a platform for research on crew autonomy for future deep space missions. Our second year of the research effort have included new insights on the crew self-scheduling sessions performed by the crew through use on the HERA (Human Exploration Research Analog) and NEEMO (NASA Extreme Environment Mission Operations) analogs. Use on the NEEMO analog involved two self-scheduling strategies where the crew planned and executed two days of EVAs (Extra-Vehicular Activities). On HERA year two represented the first HERA campaign where we were able to perform research tasks. This involved selected flexible activities that the crew could schedule, mock timelines where the crew completed more complex planning exercises, usability evaluation of the crew self-scheduling features, and more insights into the limit of plan complexity that the crew could effectively self-schedule. In parallel we have added in new features and functionality in the Playbook tool based off of our insights from crew self-scheduling in the NASA analogs. In particular this year we have added in the ability for the crew to add, edit, and remove their own activities in the Playbook tool, expanding the type of planning and re-planning possible in the tool and opening up the ability for more free form plan creation. The ability to group and manipulate groups of activities from the plan task list was also added, allowing crew members to add predefined sets of activities onto their mission timeline. In addition we also added a way for crew members to roll back changes in their plan, in order to allow an undo like capability. These features expand and complement the initial self-scheduling features added in year one with the goal of making crew autonomous planning more efficient. As part of this work we have also finished developing the first version of our Playbook Data Analysis Tool, a research tool built to interpret and analyze the unobtrusively collected data obtained during the NASA analog missions through Playbook. This data which includes user click interaction as well as plan change information, through the Playbook Data Analysis Tool, allows us to playback this information as if a video camera was mounted over the crewmember's tablet. While the primary purpose of this tool is to allow usability analysis of crew self-scheduling sessions used on the NASA analog, since the data collected is structured, the tool can automatically derive metrics that would be traditionally tedious to achieve without manual analysis of video playback. We will demonstrate and discuss the ability for future derived metrics to be added to the tool. In addition to the current data and results gathered in year two we will also discuss the preparation and goals of our International Space Station (ISS) onboard technology demonstration with Playbook. This technology demonstration will be preformed as part of the CAST payload starting in late 2016.

onboard planning↗

Impact of ATD-2 Tools on Human Factors Metrics at Charlotte Douglas International Airport

New decision support tools were introduced at Charlotte Douglas International Airport (CLT) as part of NASA’s Air Traffic Demonstration 2 (ATD-2) project. ATD-2 is based on concepts which enable integrated arrival, departures, and surface (IADS) operations in a metroplex environment. Metrics on environmental benefits from ATD-2’s surface metering at CLT have shown impressive reductions in fuel consumption and CO2 emissions. Questions have remained on 1) the human factors impact of these new ATD-2 tools and surface metering and 2) the users’ perceptions of how these tools affect operations. To address these questions, post-bank surveys were designed for the four types of users of the new tools at CLT: Ramp Controllers, Ramp Managers, Tower Traffic Management Coordinators (TMCs) and Terminal Radar Approach Control (TRACON) TMCs. These surveys were administered during five-day blocks at three different times. Three types of banks were compared: No ATD-2 tool use, ATD-2 tool use, and ATD-2 use plus surface metering. Results indicate that higher workload or decreased situation awareness was not significantly associated with ATD-2 tool use more than no ATD-2 tool use--in fact for many users the opposite was true. Also, acceptability and operational efficiency measures indicate that the users did not perceive that banks with ATD-2 tools were significantly less acceptable or less efficient than banks without ATD-2 tools.

Airspace Technology Demonstration 2↗

Impact of ATD-2 Tools on Human Factor Metrics at Charlotte Douglas International Airport

New decision support tools were introduced at Charlotte Douglas International Airport (CLT) as part of NASA’s Air Traffic Demonstration 2 (ATD-2) project. ATD-2 is based on concepts which enable integrated arrival, departures, and surface (IADS) operations in a metroplex environment. Metrics on environmental benefits from ATD-2’s surface metering at CLT have shown impressive reductions in fuel consumption and CO2 emissions. Questions have remained on 1) the human factors impact of these new ATD-2 tools and surface metering and 2) the users’ perceptions of how these tools affect operations. To address these questions, post-bank surveys were designed for the four types of users of the new tools at CLT: Ramp Controllers, Ramp Managers, Tower Traffic Management Coordinators (TMCs) and Terminal Radar Approach Control (TRACON) TMCs. These surveys were administered during five-day blocks at three different times. Three types of banks were compared: No ATD-2 tool use, ATD-2 tool use, and ATD-2 use plus surface metering. Results indicate that higher workload or decreased situation awareness was not significantly associated with ATD-2 tool use more than no ATD-2 tool use--in fact for many users the opposite was true. Also, acceptability and operational efficiency measures indicate that the users did not perceive that banks with ATD-2 tools were significantly less acceptable or less efficient than banks without ATD-2 tools.

Bonny K Parke↗

Objective Structured Clinical Evaluation (OSCE) of an Artificial Intelligence (AI) Clinical Decision Support System (CDSS) Tool

BACKGROUND Objective Structured Clinical Evaluations (OSCEs) have long been established as a robust methodology for summative assessment of clinical skills and decision-making during medical education. The recent integration of Artificial Intelligence (AI) into clinical decision-making processes has prompted the need for novel evaluation frameworks to assess the efficacy and reliability of AI clinical decision support system (CDSS) tools. This abstract outlines the process of quantitatively evaluating a novel CDSS (“Doc in a Box” Google 2024) trained on curated medical spaceflight data in the psychomotor domain as it interfaces with a human volunteer acting as the crew medical officer (CMO). PURPOSE The AI CDSS under review was developed as part of the Lunar Command and Control Interoperability (LuCCI) project, which is intended to address a gap in how Lunar Surface Systems (LSS) would interoperate across multiple programs, commercial partners, and international partners. The project objective is to define, prototype, integrate, and evaluate an interoperable lunar command, control, data, and software reference architecture to enable autonomy and informatics capability through common standards across LSS. A multi-modal AI-based CDSS compatible with Federated LSS will assist clinicians in diagnosing and managing complex medical conditions by providing evidence-based recommendations through predictive analytics. Given the critical role of decision-support as NASA continues to evolve its Earth-independent medical operations (EIMO), it is imperative to ensure that such AI tools perform reliably and align with clinical standards during progressive lunar and Martian exploration class missions. METHODS The OSCE framework, traditionally used for evaluating human clinicians, was adapted to assess the AI tool's decision-making capabilities in simulated clinical scenarios. In this adapted OSCE, the AI CDSS was tested across a series of structured clinical scenarios designed to mimic real-life spaceflight patient cases. These scenarios included a range of conditions and complexities, allowing for comprehensive assessment of the tool's performance. Key evaluation metrics included accuracy of diagnosis, timeliness of decision-making, and appropriate recommendations for therapies. The OSCE was scored by human physician evaluators who assessed the AI's recommendations in comparison with expert clinicians' medical decision making to ensure alignment with best practices and the standard of care. RESULTS Preliminary results indicate that the AI CDSS demonstrated high accuracy in diagnostic recommendations and decision support across various scenarios. However, certain limitations were noted, such as occasional discrepancies in handling complex or nuanced cases that required a more contextual understanding. Additionally, the tool scored higher on the diagnostic portion of the rubric, with lower scores in the therapeutic recommendations. These findings highlight the importance of continuous refinement and validation of AI tools through rigorous evaluation frameworks like the OSCE. The adaptation of OSCEs for AI tools presents several advantages, including a structured and reproducible approach to evaluation, the ability to test AI systems in diverse clinical scenarios, and the opportunity to benchmark AI performance against established clinical standards to permit charting of future progress as aerospace medicine evolves as a discipline. Remaining challenges include ensuring that these evaluations capture the full spectrum of clinical decision-making scenarios that will be confronted by CMOs during missions and adequately reflecting real-world variability of the austere spaceflight environment. CONCLUSION Employing OSCEs to evaluate AI clinical decision support tools offers a promising approach to validating their clinical utility and efficacy. This methodology not only provides insights into the tool's performance but also fosters ongoing improvement and alignment with standard of care practices. Future research should focus on refining these evaluation processes and addressing limitations to enhance the integration of AI tools in clinical spaceflight settings. REFERENCES Scott S, Hearns V, Barker MA. Testing Clinical Skills: A Look at the OSCE and USMLE Clinical Skills Exams. S D Med. 2019 Oct;72(10):451-453. Majumder MAA, Kumar A, Krishnamurthy K, Ojeh N, Adams OP, Sa B. An evaluative study of objective structured clinical examination (OSCE): students and examiners perspectives. Adv Med Educ Pract. 2019 Jun 5;10:387-397. Karam VY, Park YS, Tekian A, Youssef N. Evaluating the validity evidence of an OSCE: results from a new medical school. BMC Med Educ. 2018 Dec 20;18(1):313.

Ariana M Nelson↗

Omics Tools

The Omics Tools package provides several small trivial tools for work in genomics. This single portable package, the “omics.jar” file, is a toolbox that works in any Java-based environment, including PCs, Macs, and supercomputers. The number of tools is expected to grow. One tool (called cmsearch.hadoop or cmsearch.local), calls the external cmsearch program to predict non-coding RNA in a genome. The cmsearch program is part of the third-party Infernal package. Omics Tools does not contain Infernal. Infernal may be installed separately. The cmsearch.hadoop subtool requires Apache Hadoop and runs on a supercomputer, though cmsearch.local does not and runs on a server. Omics Tools does not contain Hadoop. Hadoop mat be installed separartely The other tools (cmgbk, cmgff, fastats, pal, randgrp, randgrpr, randsub) do not interface with third-party tools. Omics Tools is written in Java and Scala programming languages. Invoking the “help” command shows currently available tools, as shown below: schaumbe@gpint06:~/proj/omics$ java -jar omics.jar help Known commands are: cmgbk : compare cmsearch and GenBank Infernal hits cmgff : compare hits among two GFF (version 3) files cmsearch.hadoop : find Infernal hits in a genome, on your supercomputer cmsearch.local : find Infernal hits in a genome, on your workstation fastats : FASTA stats, e.g. # bases, GC content pal : stem-loop motif detection by palindromic sequence search (code stub) randgrp : random subsample without replacement, of groups randgrpr : random subsample with replacement, of groups (fast) randsub : random subsample without replacement, of file lines For more help regarding a particular command, use: java -jar omics.jar command help Usage: java -jar omics.jar command args

Schaumberg, Andrew↗