Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “SCORE”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10
All sourcesNASA NTRSDOE OSTI
NASA NTRS1999

The Autonomic Symptom Profile: a new instrument to assess autonomic symptoms

OBJECTIVE: To develop a new specific instrument called the Autonomic Symptom Profile to measure autonomic symptoms and test its validity. BACKGROUND: Measuring symptoms is important in the evaluation of quality of life outcomes. There is no validated, self-completed questionnaire on the symptoms of patients with autonomic disorders. METHODS: The questionnaire is 169 items concerning different aspects of autonomic symptoms. The Composite Autonomic Symptom Scale (COMPASS) with item-weighting was established; higher scores indicate more or worse symptoms. Autonomic function tests were performed to generate the Composite Autonomic Scoring Scale (CASS) and to quantify autonomic deficits. We compared the results of the COMPASS with the CASS derived from the Autonomic Reflex Screen to evaluate validity. RESULTS: The instrument was tested in 41 healthy controls (mean age 46.6 years), 33 patients with nonautonomic peripheral neuropathies (mean age 59.5 years), and 39 patients with autonomic failure (mean age 61.1 years). COMPASS scores correlated well with the CASS, demonstrating an acceptable level of content and criterion validity. The mean (+/-SD) overall COMPASS score was 9.8 (+/-9) in controls, 25.9 (+/-17.9) in the patients with nonautonomic peripheral neuropathies, and 52.3 (+/-24.2) in the autonomic failure group. Scores of symptoms of orthostatic intolerance and secretomotor dysfunction best predicted the CASS on multiple stepwise regression analysis. CONCLUSIONS: We describe a questionnaire that measures autonomic symptoms and present evidence for its validity. The instrument shows promise in assessing autonomic symptoms in clinical trials and epidemiologic studies.

NASA Discipline Cardiopulmonary↗
NASA NTRS2005

Proposed Project Selection Method for Human Support Research and Technology Development (HSR&TD)

The purpose of HSR&TD is to deliver human support technologies to the Exploration Systems Mission Directorate (ESMD) that will be selected for future missions. This requires identifying promising candidate technologies and advancing them in technology readiness until they are acceptable. HSR&TD must select an may of technology development projects, guide them, and either terminate or continue them, so as to maximize the resulting number of usable advanced human support technologies. This paper proposes an effective project scoring methodology to support managing the HSR&TD project portfolio. Researchers strongly disagree as to what are the best technology project selection methods, or even if there are any proven ones. Technology development is risky and outstanding achievements are rare and unpredictable. There is no simple formula for success. Organizations that are satisfied with their project selection approach typically use a mix of financial, strategic, and scoring methods in an open, established, explicit, formal process. This approach helps to build consensus and develop management insight. It encourages better project proposals by clarifying the desired project attributes. We propose a project scoring technique based on a method previously used in a federal laboratory and supported by recent research. Projects are ranked by their perceived relevance, risk, and return - a new 3 R's. Relevance is the degree to which the project objective supports the HSR&TD goal of developing usable advanced human support technologies. Risk is the estimated probability that the project will achieve its specific objective. Return is the reduction in mission life cycle cost obtained if the project is successful. If the project objective technology performs a new function with no current cost, its return is the estimated cash value of performing the new function. The proposed project selection scoring method includes definitions of the criteria, a project evaluation questionnaire, and a scoring formula.

Jones, Harry↗
NASA NTRS2005

High Frequency QRS ECG Accurately Detects Cardiomyopathy

High frequency (HF, 150-250 Hz) analysis over the entire QRS interval of the ECG is more sensitive than conventional ECG for detecting myocardial ischemia. However, the accuracy of HF QRS ECG for detecting cardiomyopathy is unknown. We obtained simultaneous resting conventional and HF QRS 12-lead ECGs in 66 patients with cardiomyopathy (EF = 23.2 plus or minus 6.l%, mean plus or minus SD) and in 66 age- and gender-matched healthy controls using PC-based ECG software recently developed at NASA. The single most accurate ECG parameter for detecting cardiomyopathy was an HF QRS morphological score that takes into consideration the total number and severity of reduced amplitude zones (RAZs) present plus the clustering of RAZs together in contiguous leads. This RAZ score had an area under the receiver operator curve (ROC) of 0.91, and was 88% sensitive, 82% specific and 85% accurate for identifying cardiomyopathy at optimum score cut-off of 140 points. Although conventional ECG parameters such as the QRS and QTc intervals were also significantly longer in patients than controls (P less than 0.001, BBBs excluded), these conventional parameters were less accurate (area under the ROC = 0.77 and 0.77, respectively) than HF QRS morphological parameters for identifying underlying cardiomyopathy. The total amplitude of the HF QRS complexes, as measured by summed root mean square voltages (RMSVs), also differed between patients and controls (33.8 plus or minus 11.5 vs. 41.5 plus or minus 13.6 mV, respectively, P less than 0.003), but this parameter was even less accurate in distinguishing the two groups (area under ROC = 0.67) than the HF QRS morphologic and conventional ECG parameters. Diagnostic accuracy was optimal (86%) when the RAZ score from the HF QRS ECG and the QTc interval from the conventional ECG were used simultaneously with cut-offs of greater than or equal to 40 points and greater than or equal to 445 ms, respectively. In conclusion 12-lead HF QRS ECG employing RAZ scoring is a simple, accurate and inexpensive screening technique for cardiomyopathy. Although HF QRS ECG is highly sensitive for cardiomyopathy, its specificity may be compromised in patients with cardiac pathologies other than cardiomyopathy, such as uncomplicated coronary artery disease or multiple coronary disease risk factors. Further studies are required to determine whether HF QRS might be useful for monitoring cardiomyopathy severity or the efficacy of therapy in a longitudinal fashion.

Schlegel, Todd T.↗
NASA NTRS2006

A Countermeasure for Space Motion Sickness

Overall, the results obtained in both the U.S. and the Russian space programs indicate that most space crews will experience some symptoms of motion sickness (MS) causing significant impact on the operational objectives that must be accomplished to assure mission success. At this time the primary countermeasure for MS requires the administration of Promethazine. Promethazine is not a benign drug, and is most frequently administered just prior to the sleep cycle to prevent its side effects from further compromising mission objectives. Clearly other countermeasures for SMS must be developed. Currently the primary focus is on two different technologies: (1) developing new and different pharmacological compounds with less significant side effects, (2) preflight training. The primary problem with all of these methods for controlling MS is time. New drugs that may be beneficial are years from testing and development, and preflight training requires a significant investment of crew time during an already intensive pre-launch schedule. Granted, motion sickness symptoms can be minimized with either of the two methods detailed above, however, it may be possible to develop a countermeasure that does not require either extensive adaptation time or exposure to motion sickness. Approximately 25 years ago Professor Geoffrey Melvill Jones presented his work on adaptation of the vestibuloocular reflex (VOR) using optically reversed vision (left-right prisms) during head rotations in the horizontal plane. It was of no surprise that most subjects experienced motion sickness while wearing the optically reversing prisms. However, a serendipitous finding emerged during this research showing that the same subjects did not experience motion sickness symptoms when wearing the reversing prisms under stroboscopic illumination. The mechanism, by which this side-effect was believed to have occurred, is not clearly understood. However, the fact that no motion sickness was ever noted, suggests the possibility of producing functionally useful adaptation during space flight without the penalty of disabling motion sickness by controlling the rate of the adaptive process by means of an appropriate stroboscopically presented environment. After several recent meetings with Professor Melvill Jones, we were encouraged to repeat the motion sickness portions of his and Mandl's 1981 stroboscopic experiment. In conducting this experiment we used a randomized cross-over design where subjects were randomly assigned to either a stroboscopic flash or no strobe for their first exposure in the experimental design. Twenty subjects (19 subjects completed the study) read a short passage from Treasure Island mounted on the wall approximately 1 m from their eyes while wearing left-right reversing prisms. The strobe on time of 3 microseconds and flash frequency of 4 Hz was set to equal that used in the original study. Motion sickness was scored using a modified Miller and Graybiel scale that we constructed to include symptoms that may be elicited under conditions where reversing prisms are worn. On this scale a score of 5 represented Malaise IIa (mild motion sickness) and a score of 8 or above is approaching frank sickness. Symptoms were tracked and recorded every 5 min during the task. Testing was limited to 30 min unless the subject had reached the MIIa score, at which time the test was terminated. Performance under stroboscopic illumination was significantly better than when the subjects read under normal room illumination while wearing the left-right reversing prisms. Based on these results we developed a goggle system using LCD material that can be strobed. To evaluate the effectiveness of stroboscopic goggles we tested an additional 9 subjects in addition to retesting 10 used in the stroboscopic pilot study described above. These 19 subjects wore a pair of strobing LCD goggles that could be cycled at 4 Hz. These subjects wore the goggles while also wearing left-right reversg prisms. Results while wearing the goggles showed that none of the 19 subjects scored at the MIIa level on the motion sickness rating scale. When the goggles did not flash (no strobe), 11 of the 19 developed symptoms above the MIIa criteria. As a countermeasure the goggles seem to be effective, even with an on time of 10 msec (time the goggles are clear). We have also collected anecdotal data, from our personnel in the Neuroscience Laboratory at the Johnson Space Center, suggesting that the goggles may effective in preventing carsickness.

Reschke, M. F.↗
NASA NTRS2012

Preliminary Crater Retention Ages for an Expanded Inventory of Large Lunar Basins

Based on LOLA topography and a new crustal thickness model, the number of candidate lunar basins greater than 300 km in diameter is at least a factor 2 larger than the traditional number based on photogeology alone, and may be as high as 95. Preliminary N(50) crater retention ages for this population of candidate basins shows two distinct peaks. Frey [1] suggested, based on Clementine-era topography (ULCN2005) and a crustal thickness model based on Lunar Prospector data [2], that there could be as many as 98 lunar basins greater than 300 km diameter. Many of the weaker cases have not stood up to recent testing [3,4,5] using LOLA data and a newer crustal thickness model based on Kaguya gravity data and LOLA topography data [6]. As described in companion abstracts [4,5], we have deleted from the earlier inventory 1 more named feature (Sikorsky- Rittenhouse; LOLA data show that its diameter is actually less than 300 km), 11 Quasi-Circular Depressions (QCDs) identified in the ULCN topography, and 11 Circular Thin Areas (CTAs) found in the earlier crustal thickness model [2]. We did this by repeating the scoring exercise originally done in [1] but with the new data [4,5]. Topographic Expression (TE) and Crustal Thickness Expression (CTE) scores were determined for each candidate on a scale of 0 to 5 (5 being a strong, circular signature, 0 for those with no discernible circular topographic or crustal thickness signature). These scores are added together to produce a Summary Score which has a range of 0 to 10. We eliminated all candidates with a Summary Score less than 3, as well as other cases where, for example, the TE went to zero because what looked like a single large circular QCD in the lower resolution ULCN data was in fact a cluster of smaller deep impacts readily apparent in the newer higher resolution LOLA data. This process reduced the original inventory from 98 to 75 candidates.

Frey, H. V.↗
NASA NTRS2018

Trusted Communication: Utilizing Speech Communication to Enhance Human-Machine Teaming Success

An area of increasing interest for the next generation of aircraft is autonomy and the integration of increasingly autonomous systems into the national airspace. Such an integration requires humans to work closely with autonomous systems, forming teams. Our hypothesis is that a team composed of both humans and autonomous systems will operate better than either entity alone. We have existing procedures for certifying pilots to operate in the national airspace and are currently working on methods for validating the function of autonomous systems, however we have no method in place for assessing the interaction of these two disparate systems. Communication is one avenue. This paper will examine the use of language as a metric for ascertaining human-machine teaming effectiveness. A proof-of-concept of the application of two communication-based analysis techniques, Linguistic Inquiry and Word Count (LIWC) and Latent Semantic Analysis (LSA), for the prediction of success in human/chatbot teaming was conducted. By running these analyses over data from the 2014 and 2015 Loebner Prize competitions of human/chatbot teaming, numerical scores were obtained that can be associated with scores provided by human judges during the competition. Correlating their LIWC and LSA data with the scores provided by the judges, and using linear regression over this correlation, formulae were obtained that predict the score of human/chatbot interaction. These formulae were tested over the 2013 Loebner Prize transcripts, determining that, though there was strong correlation between predicted and actual scores, the predictive success of this method was not strong. However, with specialized topic spaces and lexica, as well as larger data sets, the predictive power of these metrics will improve. Given the importance of providing metrics for human-machine system team success and given the promise shown by the communication-basedLIWCand LSAmethods, continuing research in this area is necessary. After examining the potential for using communication and spoken language as a metric for the success of human/autonomous system teaming, this paper then examines aspects inherent to communication systems that may contribute to unreliability and reduced trust. Modern natural language processing tools rely on deep learning algorithms to create language rules that produce accurate results, but these rules are uninterpretable. The resulting blackbox system lacks transparency necessary for full validation and complete trust. Additionally, speech-based interfaces pose other difficulties to developing coordinated teamwork between humans and autonomous systems. Human communication is infrequently limited to speech only, instead usually relying on a combination of verbal, gestural, and general body language communication. Reducing an analysis of team effectiveness to a study of spoken language alone is problematic as it leaves these other equally important forms of communication out. This paper will examine these problems and the general deficiencies in speech-based metrics for human-machine teaming.

E L Meszaros↗
NASA NTRS2019

The Cognition and Fine Motor Skills Test Batteries: Normative Data and Interdependencies

Space mission success and safety relies upon astronaut functional state. Since spaceflight stressors affect cognitive processing and fine motor skills, NASA requires that measures of performance of these things remain within clinically accepted values (NASA STD 3001). NASA is in the process of developing two test batteries for the assessment of crew cognitive and fine motor skills before, during and after spaceflight. Toward that goal, the current project collected normative scores in 91 “astronaut-like” military and civilian pilots. The Cognition Test Battery (CTB) contains ten sub-tests that measure a range of cognitive abilities. For five of the ten CTB sub-tests, we propose scores to improve the battery’s sensitivity. Among the ten sub-tests, response times were more highly correlated than accuracy scores. Principle component analysis of the correlations revealed that the first response time factor could explain over 40% of the total variance and appeared to represent the tendency of observers to try to respond more quickly. The first accuracy factor (explaining only 20%) gave a high weight to the higher level cognitive sub-tests and a negative weight to tasks associated with motor and lower level cognitive processing. The Fine Motor Skills (FMS) test battery contains four sub-tests (Tracking, Pointing, Tracing, Rotating) performed on an Apple iPad tablet computer. Principle component analysis on the sub-test response time correlations revealed that the first two factors accounted for ~80% of the variance in performance. The first component captured overall speed on all four of the sub-tests. The second factor separated the sub-tasks into two groups (Drag-Point vs Trace-Rotate). Previous work found the first group response times correlated with that of a standard peg board task, while those of the other group did not. Correlations were computed between the first FMS factor and the response time and accuracy scores from each CTB sub-task. Performing fine motor behaviors rapidly was significantly correlated with the ability to perform many of the CTB sub-tests rapidly. This ability cannot be simple motor speed since scores on the Psychomotor Vigilance Test (PVT) subtask did not correlate with the ability to perform the other tasks rapidly. Speed on fine motor skills correlated significantly with accuracy on the short-term-memory sub-test. We hypothesize that eye movements, which can be regarded as a fine motor skill, may explain this relationship.

cognition↗
NASA NTRSDate not supplied

The Application of Remote Sensing using NASA Earth Observations paired with Sociodemographic Indicators to Identify Communities Most Susceptible to Urban Heat Exposure in Austin, Texas

In recent years, Austin, Texas has experienced an increase in population and urban development. Additionally, the City’s climate—already characterized by periods of extreme heat and drought—continues to change. As temperatures and demand for utilities and cooling resources rise, the number of heat-related deaths and illnesses in socially vulnerable populations (e.g., older, lower-income populations) is expected to increase. The City of Austin, The University of Texas at Austin (UT Austin), and The University of Texas Health Science Center at Houston (UT Health) partnered with NASA DEVELOP to examine the distribution of urban heat throughout the City. This project used land surface temperature, greenness, plant water content, and urban surface material analysis parameters derived from NASA Earth observations from Landsat 8 Operational Land Imager (OLI), Landsat 8 Thermal Infrared Sensor (TIRS), and Aqua and Terra Moderate Resolution Imaging Spectroradiometer (MODIS). The project team produced three different indices to create a spatial analysis for the study area including a social vulnerability index (SoVI), heat exposure index (HEI), and an overall heat priority index (HPI) score. This overall score was determined with a weighted analysis of heat-related environmental variables from NASA Earth observations and socioeconomic data from the 2019 American Community Survey. Based on the HPI score, the project team identified 121 census block groups out of 605 total that are designated as being most at risk of adverse impacts from extreme heat events. To test the sensitivity of the HPI, the team used a Monte Carlo analysis using different approaches for geographic scale, variable inclusion, census uncertainty, and index aggregation. Based on the sensitivity analysis, the resulting HPI score showed the metric was consistent with the baseline HPI. This provided increased confidence the score can be used as a tool to make informed infrastructure improvement plans in targeted areas (e.g., siting of cooling centers) and ensure equitable sustainable development.

Ryan Hammock↗
NASA NTRS2024

Cognitive Performance in ISS Astronauts on 6-Month Low Earth Orbit Missions

Introduction: Current and future astronauts will endure prolonged exposure to spaceflight hazards and environmental stressors that could compromise cognitive functioning, yet cognitive performance in current missions to the International Space Station remains critically under-characterized. We systematically assessed cognitive performance across 10 cognitive domains in astronauts on 6-month missions to the ISS. Methods: Twenty-five professional astronauts were administered the Cognition Battery as part of National Aeronautics and Space Administration (NASA) Human Research Program Standard Measures Cross-Cutting Project. Cognitive performance data were collected at five mission phases: pre-flight, early flight, late flight, early post-flight, and late post-flight. We calculated speed and accuracy scores, corrected for practice effects, and derived z-scores to represent deviations in cognitive performance across mission phases from the sample’s mean baseline (i.e., pre-flight) performance. Linear mixed models with random subject intercepts and pairwise comparisons examined the relationships between mission phase and cognitive performance. Results: Cognitive performance was generally stable over time with some differences observed across mission phases for specific subtests. There was slowed performance observed in early flight on tasks of processing speed, visual working memory, and sustained attention. We observed a decrease in risk-taking propensity during late flight and post-flight mission phases. Beyond examining group differences, we inspected scores that represented a significant shift from the sample’s mean baseline score, revealing that 11.8% of all flight and post-flight scores were at or below 1.5 standard deviations below the sample’s baseline mean. Finally, exploratory analyses yielded no clear pattern of associations between cognitive performance and either sleep or ratings of alertness. Conclusions: There was no evidence for a systematic decline in cognitive performance for astronauts on a 6-month missions to the ISS. Some differences were observed for specific subtests at specific mission phases, suggesting that processing speed, visual working memory, sustained attention, and risk-taking propensity may be the cognitive domains most susceptible to change in Low Earth Orbit for high performing, professional astronauts. We provide descriptive statistics of pre-flight cognitive performance from 25 astronauts, the largest published preliminary normative database of its kind to date, to help identify significant performance decrements in future samples.

Data curation↗
DOE OSTI2024

A Mobility Energy Productivity Evaluation of On-Demand Transit: A Case Study in Arlington, Texas

On-demand transit (ODT) systems are increasing in number and size. In order to evaluate and quantify outcomes, we use the Mobility Energy Productivity (MEP) metric, a holistic tool to analyze, quantify, and compare the mobility and accessibility of various transportation modes in a specific area. In this paper, we apply the MEP tool to the ODT system in Arlington, Texas, and compare the results among four existing transportation modes (drive, transportation network company, transit, and bike) and five additional ODT scenarios. We focus our analysis on the opportunities that an ODT system presents such as serving disadvantages communities. While the results in Arlington show the typical U.S. pattern of driving receiving the highest MEP score, the ODT system best serves those in disadvantaged communities, helping with an equity design goal. ODT improved the average MEP score across the service area by 100% when considering only non-private vehicle modes (bike, transit, and ODT). For the ODT scenarios, decreasing the wait time 50% compared to the baseline scenario led to a nearly 160% increase in MEP score, while increasing the ODT travel speed by 21% led to an 80% improvement in MEP score. The decreased wait time scenario had the highest MEP score out of the six ODT scenarios. This paper demonstrates how ODT can enhance mobility, particularly for disadvantaged communities. The results of a MEP analysis can be used by researchers and transit agencies to compare transportation modes and improve the effectiveness of transportation systems in subareas across a service area.

accessibility↗
DOE OSTI2024

Diffusion-Model-Assisted Supervised Learning of Generative Models for Density Estimation

Here, we present a supervised learning framework of training generative models for density estimation. Generative models, including generative adversarial networks (GANs), normalizing flows, and variational auto-encoders (VAEs), are usually considered as unsupervised learning models, because labeled data are usually unavailable for training. Despite the success of the generative models, there are several issues with the unsupervised training, e.g., requirement of reversible architectures, vanishing gradients, and training instability. To enable supervised learning in generative models, we utilize the score-based diffusion model to generate labeled data. Unlike existing diffusion models that train neural networks to learn the score function, we develop a training-free score estimation method. This approach uses mini-batch-based Monte Carlo estimators to directly approximate the score function at any spatial-temporal location in solving an ordinary differential equation (ODE), corresponding to the reverse-time stochastic differential equation (SDE). This approach can offer both high accuracy and substantial time savings in neural network training. Once the labeled data are generated, we can train a simple, fully connected neural network to learn the generative model in the supervised manner. Compared with existing normalizing flow models, our method does not require the use of reversible neural networks and avoids the computation of the Jacobian matrix. Compared with existing diffusion models, our method does not need to solve the reverse-time SDE to generate new samples. As a result, the sampling efficiency is significantly improved. We demonstrate the performance of our method by applying it to a set of 2D datasets as well as real data from the University of California Irvine (UCI) repository.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Peanut allergy burden survey: Factors associated with health‐related quality of life in adolescents

Abstract Background Patients with peanut allergy (PA) experience significant burden of illness, which impacts health‐related quality of life (HRQoL), particularly in adolescence. There is a paucity of research evaluating drivers of HRQoL scores. Methods A prospective, online survey of adolescents with self‐reported, provider‐diagnosed PA completed from November 2018 to January 2019 was used to explore drivers of the real‐world impact of PA on HRQoL using the Pediatric Quality of Life Inventory 4.0 (PedsQL) and other measures. Univariate and multivariate analyses were used to identify potential factors associated with PedsQL scores and to understand the level of association. Results A total of 102 adolescents were included. The final model included 10 variables: race, reported strict peanut avoidance, satisfaction with prophylaxis, moderate‐to‐severe reaction within the past 12 months, touching peanut as cause of most severe reaction, fear of reaction, age, gender, comorbidities, and daily life limitations. In total, three items were shown to be strong predictors of the PedsQL total score including cause of severe reaction was touching peanut (yes), level of agreement with avoiding peanut (completely agree), and satisfaction with prophylaxis (not very much/not at all). Conclusions There is substantial heterogeneity in the impact of the burden of PA on PedsQL scores across patients. This indicates the importance of shared and individualized decision making for PA management to optimize outcomes and improve HRQoL.

McCann, William A.↗
DOE OSTI2025

AAPM Truth‐based CT (TrueCT) reconstruction grand challenge

Background: This Special Report summarizes the 2022, AAPM grand challenge on Truth-based CT image reconstruction. Purpose: To provide an objective framework for evaluating CT reconstruction methods using virtual imaging resources consisting of a library of simulated CT projection images of a population of human models with various diseases. Methods: Two hundred unique anthropomorphic, computational models were created with varied diseases consisting of 67 emphysema, 67 lung lesions, and 66 liver lesions. The organs were modeled based on clinical CT images of real patients. The emphysematous regions were modeled using segmentations from patient CT cases in the COPDGene Phase I dataset. For the lung and liver lesion cases, 1–6 malignant lesions were created and inserted into the human models, with lesion diameters ranging from 5.6 to 21.9 mm for lung lesions and 3.9 to 14.9 mm for liver lesions. The contrast defined between the liver lesions and liver parenchyma was 82 ± 12 HU, ranging from 50 to 110 HU. Similarly, the contrast between the lung lesions and the lung parenchyma was defined as 781 ± 11 HU, ranging from 725 to 805 HU. For the emphysematous regions, the defined HU values were −950 ± 17 HU ranging from −918 to −979 HU. The developed human models were imaged with a validated CT simulator. The resulting CT sinograms were shared with the participants. The participants reconstructed CT images from the sinograms and sent back their reconstructed images. Further, the reconstructed images were then scored by comparing the results against the corresponding ground truth values. The scores included both task-generic (root mean square error [RMSE] and structural similarity matrix [SSIM]), and task-specific (detectability index [d’] and lesion volume accuracy) metrics. For the cases with multiple lesions, the measured metric was averaged across all the lesions. To combine the metrics with each other, each metric was normalized to a range of 0 to 1 per disease type, with “0” and “1” being the worst and best measured values across all cases of the disease type for all received reconstructions. Results: The True-CT challenge attracted 52 participants, out of which 5 successfully completed the challenge and submitted the requested 200 reconstructions. Across all participants and disease types, SSIM absolute values ranged from 0.22 to 0.90, RMSE from 77.6 to 490.5 HU, d’ from 0.1 to 64.6, and volume accuracy ranged from 1.2 to 753.1 mm3. The overall scores demonstrated that participant “A” had the best performance in all categories, except for the metrics of d’ for lung lesions and RMSE for liver lesions. Participant “A” had an average normalized score of 0.41 ± 0.22, 0.48 ± 0.32, and 0.42 ± 0.33 for the emphysema, lung lesion, and liver lesion cases, respectively. Conclusions: The True-CT challenge successfully enabled objective assessment of CT reconstructions with the unique advantage of access to a diverse population of diseased human models with known ground truth. This study highlights the significant potential of virtual imaging trials in objective assessment of medical imaging technologies.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2021

The soil health assessment protocol and evaluation applied to soil organic carbon

The concept of soil health has evolved over the past several decades, recognizing that dynamic soil property response to management and land use is highly dependent on site-specific factors that must be considered when interpreting soil health measurements. Initially, the Soil Management Assessment Framework (SMAF) and Comprehensive Assessment of Soil Health (CASH) were developed and used globally for scoring soil health indicators. However, both SMAF and CASH frameworks were developed using a relatively small dataset and their interpretation curves were not validated at the nationwide scale. Expanding upon these concepts, we propose the Soil Health Assessment Protocol and Evaluation (SHAPE) tool. The SHAPE was developed using 14,680 soil organic C (SOC) observations from across the United States, and accounts for edaphic and climate factors at the continental scale. Data were compiled from the literature, the Cornell Soil Health Laboratory, and the Kellogg Soil Survey Laboratory. In this approach, scoring curves are Bayesian model-based estimates of the conditional cumulative distribution function (CDF) for defined soil peer groups reflecting five soil texture and five soil suborder classes adjusted for mean annual temperature and precipitation. Specifically, SHAPE produces scores between 0 and 1 (0–100%) for measured SOC values that reflect the quantile or position within the conditional CDF along with measures of uncertainty. Herein, we focus on development of the SHAPE scoring curve for SOC with our case studies. SHAPE is a flexible, quantitative tool that provides a regionally relevant interpretation of this key soil health indicator.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Do Remote Camera Arrangements and Image Capture Settings Improve Individual Identification of Golden Eagles?

Individual identification of animals from camera traps has become an important task in wildlife research, but camera deployment methods often do not facilitate this important undertaking. Identification of individual golden eagles (Aquila chrysaetos) is possible using uniquely marked rectrices, but no studies have explored methods to maximize the rate of individual identification from camera images. Furthermore, our objectives were to assess whether different camera heights (1 m vs. 3 m), image capture settings (one image after a 1-min delay vs. burst of 5 images after a 30 sec delay), and arrangements relative to bait (dorsally vs. ventrally aimed) affected views of rectrices on golden eagles and our ability to identify individuals. We conducted our study from 15 December 2016 to 3 March 2017 on the Savannah River Site, South Carolina. First, we developed a scoring system based on views of rectrices and used a linear mixed-effects model to compare image scores among different camera arrangements and image settings. Next, after identifying individual eagles, we used generalized linear mixed-effects models to compare total individual eagle detections, total days an individual was detected, and probability of obtaining an unknown individual identification among camera arrangements and settings. Overall, we scored a total of 27,499 images, with 8,083 providing views of marked rectrices that allowed identification of 18 individual eagles. Average image scores and proportion of images suitable for individual identification were higher from elevated (3 m) camera arrangements than standard arrangements (1 m) across sites. Regardless of camera height, faster frequency of image capture provided more images that could be used to identify individuals and the most trap days per individual. Researchers and managers should consider deploying elevated cameras traps with faster frequency of image capture to improve data quality and potential for analysis of golden eagle populations and trends across the species’ range.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2022

Integration of polyurethane meniscus scaffold during ACL revision is not reliable at 5 years despite favourable clinical outcome

Abstract Purpose The aim of this study was to evaluate the clinical outcome at 5‐year follow‐up of a one‐step procedure combining anterior cruciate ligament (ACL) reconstruction and partial meniscus replacement using a polyurethane scaffold for the treatment of symptomatic patients with previously failed ACL reconstruction and partial medial meniscectomy. Moreover, the implanted scaffolds have been evaluated by MRI protocol in terms of morphology, volume, and signal intensity. Methods Twenty patients with symptomatic knee laxity after failed ACL reconstruction and partial medial meniscectomy underwent ACL revision combined with polyurethane‐based meniscal scaffold implant. Clinical assessment at 2‐ and 5‐year follow‐ups included VAS, Tegner Activity Score, International Knee Documentation Committee (IKDC), Western Ontario and McMaster Universities Osteoarthritis Index (WOMAC), and the Lysholm Score. MRI evaluation of the scaffold was performed according to the Genovese scale with quantification of the scaffold’s volume at 1‐ and 5‐year follow‐ups. Results All scores revealed clinical improvement as compared with the preoperative values at the 2‐ and 5‐year follow‐ups. However, a slight, but significant reduction of scores was observed between 2 and 5 years. Concerning the MRI assessment, a significant reduction of the scaffold’s volume was observed between 1 and 5 years. Genovese Morphology classification at 5 years included two complete resorptions (Type 3) and all the remaining patients had irregular morphology (Type 2). With regard to the Genovese Signal at the 5‐year follow‐up, three were classified as markedly hyperintense (Type 1), 15 as slightly hyperintense (Type 2), and two as isointense (Type 1). Conclusion Simultaneous ACL reconstruction and partial meniscus replacement using a polyurethane scaffold provides favourable clinical outcomes in the treatment of symptomatic patients with previously failed ACL reconstruction and partial medial meniscectomy at 5 years. However, MRI evaluation suggests that integration of the scaffold is not consistent. Level of evidence Level IV.

Pereira, Hélder↗
DOE OSTI2022

Capsule network-based semantic segmentation model for thermal anomaly identification on building envelopes

Thermography technology is widely used to inspect thermal anomalies in building façade systems. Computer vision-based techniques provide opportunities to autonomously detect such heat anomalies to significantly improve the efficiency of decision-making for building envelope retrofitting and maintenance. Here, in this work, we propose a novel Capsule Network-based deep learning model – CapsLab – that detects and identifies thermal anomalies by semantic segmentation. CapsLab is built based on our proposed prediction-tuning capsule (PT-Capsule) layer. Different from a traditional capsule layer, which consists of part-whole transformation and capsule-routing process, the proposed layer is composed of a prediction and tuning process, which helps decreasing the number of model parameters significantly. While the applicability of traditional Capsule Networks (CapsNets) has been limited to simpler tasks and smaller datasets due to their scalability issue, we can leverage the lightweight of the proposed PT-Capsule layer, and apply it to the semantic segmentation task. In this work, we also employ our previously presented performance metric, referred to as the Anomaly Identification Metric (AIM) (Kakillioglua et al. 2021), to evaluate the segmentation outputs. Traditional performance metrics do not accurately reflect the true performance of the segmentation models in thermal anomaly identification due to the high subjectivity in the annotation process and higher overlap ratio sensitivity of the standard metrics. AIM, on the other hand, is robust to these drawbacks. Experimental results show, both qualitatively and quantitatively, that our proposed segmentation method can effectively segment the thermal anomalies. Specifically, our model provides 9.38% and 13.53% improvements over the baseline model – DeepLabV3+ – based on traditional mIoU score and the AIM score, respectively, while requiring less model parameters and less computation at the same time. In addition, the scores that the AIM metric generates better align with the scores provided by building performance experts.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2023

AI-accelerated protein-ligand docking for SARS-CoV-2 is 100-fold faster with no significant change in detection

Protein-ligand docking is a computational method for identifying drug leads. The method is capable of narrowing a vast library of compounds down to a tractable size for downstream simulation or experimental testing and is widely used in drug discovery. While there has been progress in accelerating scoring of compounds with artificial intelligence, few works have bridged these successes back to the virtual screening community in terms of utility and forward-looking development. We demonstrate the power of high-speed ML models by scoring 1 billion molecules in under a day (50 k predictions per GPU seconds). We showcase a workflow for docking utilizing surrogate AI-based models as a pre-filter to a standard docking workflow. Our workflow is ten times faster at screening a library of compounds than the standard technique, with an error rate less than 0.01% of detecting the underlying best scoring 0.1% of compounds. Our analysis of the speedup explains that another order of magnitude speedup must come from model accuracy rather than computing speed. In order to drive another order of magnitude of acceleration, we share a benchmark dataset consisting of 200 million 3D complex structures and 2D structure scores across a consistent set of 13 million “in-stock” molecules over 15 receptors, or binding sites, across the SARS-CoV-2 proteome. We believe this is strong evidence for the community to begin focusing on improving the accuracy of surrogate models to improve the ability to screen massive compound libraries 100 × or even 1000 × faster than current techniques and reduce missing top hits. The technique outlined aims to be a fast drop-in replacement for docking for screening billion-scale molecular libraries.

59 BASIC BIOLOGICAL SCIENCES↗