Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “SCORE”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Prediction of protein assemblies, the next frontier: The CASP14-CAPRI experiment

Here we present the results for CAPRI Round 50, the fourth joint CASP-CAPRI protein assembly prediction challenge. The Round comprised a total of twelve targets, including six dimers, three trimers, and three higher-order oligomers. Four of these were easy targets, for which good structural templates were available either for the full assembly, or for the main interfaces (of the higher-order oligomers). Eight were difficult targets for which only distantly related templates were found for the individual subunits. Twenty-five CAPRI groups including eight automatic servers submitted ~1250 models per target. Twenty groups including six servers participated in the CAPRI scoring challenge submitted ~190 models per target. The accuracy of the predicted models was evaluated using the classical CAPRI criteria. The prediction performance was measured by a weighted scoring scheme that takes into account the number of models of acceptable quality or higher submitted by each group as part of their five top-ranking models. Compared to the previous CASP-CAPRI challenge, top performing groups submitted such models for a larger fraction (70–75%) of the targets in this Round, but fewer of these models were of high accuracy. Scorer groups achieved stronger performance with more groups submitting correct models for 70–80% of the targets or achieving high accuracy predictions. Servers performed less well in general, except for the MDOCKPP and LZERD servers, who performed on par with human groups. In addition to these results, major advances in methodology are discussed, providing an informative overview of where the prediction of protein assemblies currently stands.

protein complexes↗
DOE OSTI2022

De novo design and Rosetta-based assessment of high-affinity antibody variable regions (Fv) against the SARS-CoV -2 spike receptor binding domain ( RBD )

The continued emergence of new SARS-CoV-2 variants has accentuated the growing need for fast and reliable methods for the design of potentially neutralizing antibodies (Abs) to counter immune evasion by the virus. Here, we report on the de novo computational design of high-affinity Ab variable regions (Fv) through the recombination of VDJ genes targeting the most solvent-exposed hACE2-binding residues of the SARS-CoV-2 spike receptor binding domain (RBD) protein using the software tool OptMAVEn-2.0. Subsequently, we carried out computational affinity maturation of the designed variable regions through amino acid substitutions for improved binding with the target epitope. Immunogenicity of designs was restricted by preferring designs that match sequences from a 9-mer library of “human Abs” based on a human string content score. We generated 106 different antibody designs and reported in detail on the top five that trade-off the greatest computational binding affinity for the RBD with human string content scores. We further describe computational evaluation of the top five designs produced by OptMAVEn-2.0 using a Rosetta-based approach. We used Rosetta SnugDock for local docking of the designs to evaluate their potential to bind the spike RBD and performed “forward folding” with DeepAb to assess their potential to fold into the designed structures. Ultimately, our results identified one designed Ab variable region, P1.D1, as a particularly promising candidate for experimental testing. This effort puts forth a computational workflow for the de novo design and evaluation of Abs that can quickly be adapted to target spike epitopes of emerging SARS-CoV-2 variants or other antigenic targets.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Fourier transform ion cyclotron resonance mass spectrometry (FT-ICR-MS) peak intensity normalization for complex mixture analyses

Fourier transform ion cyclotron resonance mass spectrometry (FT-ICR-MS) is a preferred technique for analyzing complex organic mixtures. Currently, there is no consensus normalization approach, nor an objective method for selecting one, for quantitative analyses of FT-ICR-MS data. We investigate a method to evaluate and score the amount of bias various normalization approaches introduce into the data. We evaluate the ability of the Statistical Procedure for the Analysis of Normalization Strategies (SPANS) to guide selection of appropriate normalization approaches for two different FT-ICR-MS datasets. Further, we test the robustness of SPANS results to changes in SPANS parameter values and assess the impact of using various normalization approaches on downstream statistical analyses. The normalization approach identified by SPANS differed for the two datasets. Normalization methods impacted the statistical significance of peaks differently, underscoring the importance of carefully evaluating potential methods. More consistent SPANS scores resulted when at least 120 significant peaks are used, where larger sets of peaks were obtained by increasing the p-value threshold. Interestingly, we show that Total Sum Scaling and highest peak normalization, used in previous studies, underperformed relative to SPANS-recommended normalization approaches. While there is no single, best normalization method for all datasets, SPANS provides a mechanism to identify an appropriate normalization method for analyzing FT-ICR-MS data quantitatively. As a result, the number of peaks used in the background distributions of SPANS contributes more significantly to the reproducibility of results than the p-value thresholds used to obtain those peaks.

47 OTHER INSTRUMENTATION↗
DOE OSTI2021

Privacy-Preserving Knowledge Transfer with Bootstrap Aggregation of Teacher Ensembles

There is a need to transfer knowledge among institutions and organizations to save effort in annotation and labeling or in enhancing task performance. However, knowledge transfer is difficult because of restrictions that are in place to ensure data security and privacy. Institutions are not allowed to exchange data or perform any activity that may expose personal information. With the leverage of a differential privacy algorithm in a high-performance computing environment, we propose a new training protocol, Bootstrap Aggregation of Teacher Ensembles (BATE), which is applicable to various types of machine learning models. The BATE algorithm is based on and provides enhancements to the PATE algorithm, maintaining competitive task performance scores on complex datasets with underrepresented class labels.We conducted a proof-of-the-concept study of the information extraction from cancer pathology report data from four cancer registries and performed comparisons between four scenarios: no collaboration, no privacy-preserving collaboration, the PATE algorithm, and the proposed BATE algorithm. The results showed that the BATE algorithm maintained competitive macro-averaged F1 scores, demonstrating that the suggested algorithm is an effective yet privacy-preserving method for machine learning and deep learning solutions.

Yoon, Hong-Jun↗
DOE OSTI2022

Challenges for unsupervised anomaly detection in particle physics

Anomaly detection relies on designing a score to determine whether a particular event is uncharacteristic of a given background distribution. One way to define a score is to use autoencoders, which rely on the ability to reconstruct certain types of data (background) but not others (signals). In this paper, we study some challenges associated with variational autoencoders, such as the dependence on hyperparameters and the metric used, in the context of anomalous signal (top and W) jets in a QCD background. We find that the hyperparameter choices strongly affect the network performance and that the optimal parameters for one signal are non-optimal for another. In exploring the networks, we uncover a connection between the latent space of a variational autoencoder trained using mean-squared-error and the optimal transport distances within the dataset. We then show that optimal transport distances to representative events in the background dataset can be used directly for anomaly detection, with performance comparable to the autoencoders. Whether using autoencoders or optimal transport distances for anomaly detection, we find that the choices that best represent the background are not necessarily best for signal identification. These challenges with unsupervised anomaly detection bolster the case for additional exploration of semi-supervised or alternative approaches.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2023

A new method for predicting hurricane rapid intensification based on co-occurring environmental parameters

Abstract Tropical cyclones (TCs) that undergo Rapid Intensification (RI) can pose serious socioeconomic threats and can potentially result in major damaging impacts along coastal areas. Considering the complexity of various physical mechanisms that play a role in RI and its relatively low probability of occurrence, predicting RI remains a major operational challenge. In this study, we propose a simple deterministic binary classification model based on the co-occurrence of environmental parameters (MCE) to predict an RI event. More specifically, the model determines the possibility of RI based on a simple count of the number of environmental predictors deemed favorable and unfavorable. We compare our model results to logistic regression (LR) and decision tree (DT) models, well-trained using the same set of environmental predictors. Results reveal that at an RI threshold of 30 kt, the MCE exhibits a critical success index score of 0.233 which is 14% higher than DT and LR model performances. When tested at multiple RI thresholds, the MCE displays relatively higher skill scores across multiple metrics. By simultaneously evaluating the favorability of predictors, the MCE is able to comparatively reduce the number of false alarms predicted when certain predictors are unfavorable toward RI. Interpreting these model results to gain a physical understanding of how co-occurring environmental parameters can affect RI, we highlight future directions for using models based on the MCE approach to understand and predict TC RI as well as other meteorological extremes.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Stable parallel training of Wasserstein conditional generative adversarial neural networks

In this work, we propose a stable, parallel approach to train Wasserstein conditional generative adversarial neural networks (W-CGANs) under the constraint of a fixed computational budget. Differently from previous distributed GANs training techniques, our approach avoids inter-process communications, reduces the risk of mode collapse and enhances scalability by using multiple generators, each one of them concurrently trained on a single data label. The use of the Wasserstein metric also reduces the risk of cycling by stabilizing the training of each generator. We illustrate the approach on the CIFAR10, CIFAR100, and ImageNet1k datasets, three standard benchmark image datasets, maintaining the original resolution of the images for each dataset. Performance is assessed in terms of scalability and final accuracy within a limited fixed computational time and computational resources. To measure accuracy, we use the inception score, the Fréchet inception distance, and image quality. An improvement in inception score and Fréchet inception distance is shown in comparison to previous results obtained by performing the parallel approach on deep convolutional conditional generative adversarial neural networks as well as an improvement of image quality of the new images created by the GANs approach. Weak scaling is attained on both datasets using up to 2000 NVIDIA V100 GPUs on the OLCF supercomputer Summit.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

ThermoPore: Predicting part porosity based on thermal images using deep learning

Part qualification is often a critical and labor-intensive process in additive manufacturing, particularly in the detection of defects such as porosity, which stands to benefit significantly from advancements in machine learning. We present a deep learning approach for quantifying and localizing ex-situ porosity within Laser Powder Bed Fusion fabricated samples utilizing in-situ thermal image monitoring data. Our goal is to build the real time porosity map of parts based on thermal images acquired during the build. The quantification task builds upon the established Convolutional Neural Network model architecture to predict pore count and the localization task leverages the spatial and temporal attention mechanisms of the novel Video Vision Transformer model to indicate areas of expected porosity. Our model for porosity quantification achieved a R 2 score of 0.57 and our model for porosity localization produced an average Intersection over Union (IoU) score of 0.32 and a maximum of 1.0. This work is setting the foundations of part porosity “Digital Twins” based on additive manufacturing monitoring data and can be applied downstream to reduce time-intensive post-inspection and testing activities during part qualification and certification. In addition, we seek to accelerate the acquisition of crucial insights normally only available through ex-situ part evaluation by means of machine learning analysis of in-situ process monitoring data.

Deep learning↗
DOE OSTI2020

Machine learning and ligand binding predictions: A review of data, methods, and obstacles

We report that computational predictions of ligand binding is a difficult problem, with more accurate methods being extremely computationally expensive. The use of machine learning for drug binding predictions could possibly leverage the use of biomedical big data in exchange for time-intensive simulations. This paper reviews current trends in the use of machine learning for drug binding predictions, data sources to develop machine learning algorithms, and potential problems that may lead to overfitting and ungeneralizable models. A few popular datasets that can be used to develop virtual high-throughput screening models are characterized using spatial statistics to quantify potential biases. We can see from evaluating some common benchmarks that good performance correlates with models with high-predicted bias scores and models with low bias scores do not have much predictive power. A better understanding of the limits of available data sources and how to fix them will lead to more generalizable models that will lead to novel drug discovery.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

Disturbance and diversity: Lichen species richness decreases with increasing anthropogenic disturbance

Anthropogenic disturbance is rapidly increasing through habitat degradation, development, and deforestation. Gaps remain in understanding the effects of this disturbance on diverse and ecologically important organisms such as lichens. In North America, studies have focused on epiphytic macrolichens and catastrophic disturbance, largely ignoring microlichens and less severe disturbances. The Intermediate Disturbance Hypothesis predicts these moderate disturbances will lead to higher species richness. Here we examine the effects of anthropogenic disturbance in the form of land management on overall lichen richness, including microlichens, and on the species richness of eight lichen functional groups. The study draws on a comprehensive data set of 872 species, in 208 one-hectare plots throughout the Southern Appalachian Mountains, a global biodiversity hotspot in eastern North America. A habitat quality index based on an established forestry metric was used as a proxy for anthropogenic disturbance and was quantified using a 10-part score including categories such as percent native tree canopy cover and degree of fragmentation. Linear models were used to compare habitat quality scores to overall species richness and to species richness of functional groups. Rather than following the Intermediate Disturbance Hypothesis, all groups uniformly follow a negative linear relationship: as disturbance increases, species richness decreases. This pattern held even for widely variable functional groups such as morphotype. Effective conservation of lichen richness should prioritize the maintenance of existing older, less-disturbed stands within large, contiguously forested areas.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

Information theory optimization of signals from small-angle scattering measurements

Small-angle X-ray scattering (SAXS) of particles in solution informs on the conformational states and assemblies of biological macromolecules (bioSAXS) outside of cryo- and solid-state conditions. In bioSAXS, the SAXS measurement under dilute conditions is resolution limited, and through an inverse Fourier transform, the measured SAXS intensities directly relate to the physical space occupied by the particles via the P (r)-distribution. Yet, this inverse transform of SAXS data has been historically cast as an ill-posed, ill-conditioned problem requiring an indirect approach. Here, we show that through the applications of matrix and information theories, the inverse transform of SAXS intensity data is a well-conditioned problem. The so-called ill-conditioning of the inverse problem is directly related to the Shannon number. By exploiting the oversampling enabled by modern detectors, a direct inverse Fourier transform of the SAXS data is possible, provided the recovered information does not exceed the Shannon number. The Shannon limit corresponds to the maximum number of significant singular values that can be recovered in a SAXS experiment, suggesting this relationship is a fundamental property of band-limited inverse integral transform problems. This correspondence reduces the complexity of the inverse problem to the Shannon limit and maximum dimension. We propose a hybrid scoring function using an information theory framework that assesses both the quality of the model-data fit as well as the quality of the recovered P (r)-distribution. The hybrid score utilizes the Akaike information criteria and Durbin-Watson statistic that considers parameter-model complexity, i.e., degrees of freedom, and the randomness of the model-data residuals. The described tests and findings extend the boundaries for bioSAXS by completing the information theory formalism initiated by Peter B. Moore to enable a quantitative measure of resolution in SAXS, robustly determine maximum dimension, and more precisely define the best parameter model appropriately representing the observed scattering data.

Rambo, Robert P. [Science and Technology Facilitie↗
DOE OSTI2021

Physics-Informed Machine Learning Models for Predicting the Progress of Reactive-Mixing

This paper presents a physics-informed machine learning (ML) framework to construct reduced-order models (ROMs) for reactive-transport quantities of interest (QoIs) based on high-fidelity numerical simu-lations. QoIs include species decay, product yield, and degree of mixing. The ROMs for QoIs are applied to quantify and understand how the chemical species evolve over time. First, high-resolution datasets for constructing ROMs are generated by solving anisotropic reaction-di?usion equations using a non-negative finite element formulation for di?erent input parameters. The reactive-mixing model input parameters are: time-scale associated with flipping of velocity, spatial-scale controlling small/large vortex structures of velocity, perturbation parameter of the vortex-based velocity, anisotropic dispersion strength/contrast, and molecular diffusion. Second, random forests, F-test, and mutual information criterion are used to evaluate the importance of model inputs/features with respect to QoIs. We observed that anisotropic dispersion strength/contrast is the most important feature and time-scale associated with flipping of velocity is the least important feature. Third, Support Vector Machines (SVM) and Support Vector Regression (SVR) are used to construct ROMs based on the model inputs. The constructed SVR-ROMs are then used to predict scaling of QoIs. We also present estimates and inequalities on the QoIs, which inform that the species decay, mix, and produce in an exponential fashion. These inequalities also inform that a radial basis function is the most suitable kernel for the SVM/SVR models for QoIs. It is observed that R2-score for SVR-ROMs on unseen data is greater than 0.9, implying that the SVR-ROMs are able to predict the reaction-diffusion system state reasonably well. Finally, in terms of the computational cost, the proposed SVM-ROMs are O(107) times faster than running a high-fidelity finite element simulation for evaluating QoIs. This makes the proposed ML-based ROMs attractive for reactive-transport sensing and real-time monitoring applications as they are significantly faster yet reasonably accurate.

Mudunuru, Maruti K.↗
DOE OSTI2020

Computer-aided classification of suspicious pigmented lesions using wide-field images

Early identification of melanoma is conducted through whole-body visual examinations to detect suspicious pigmented lesions, a situation that fluctuates in accuracy depending on the experience and time of the examiner. Computer-aided diagnosis tools for skin lesions are typically trained using pre-selected single-lesion images, taken under controlled conditions, which limits their use in wide-field scenes. Here, we propose a computer-aided classifier system with such input conditions to aid in the rapid identification of suspicious pigmented lesions at the primary care level. 133 patients with a multitude of skin lesions were recruited for this study. All lesions were examined by a board-certified dermatologist and classified into “suspicious” and “non-suspicious”. A new clinical database was acquired and created by taking Wide-Field images of all major body parts with a consumer-grade camera under natural illumination condition and with a consistent source of image variability. 3–8 images were acquired per patient on different sites of the body, and a total of 1759 pigmented lesions were extracted. A machine learning classifier was optimized and build into a computer aided classification system to binary classify each lesion using a suspiciousness score. In a testing set, our computer-aided classification system achieved a sensitivity of 100% for suspicious pigmented lesions that were later confirmed by dermoscopy examination (“SPL_A”) and 83.2% for suspicious pigmented lesions that were not confirmed after examination (“SPL_B”). Sensitivity for non-suspicious lesions was 72.1%, and accuracy was 75.9%. With these results we defined a suspiciousness score that is aligned with common macro-screening (naked eye) practices. This work demonstrates that wide-field photography combined with computer-aided classification systems can distinguish suspicious from non-suspicious pigmented lesions, and might be effective to assess the severity of a suspicious pigmented lesions. We believe this approach could be useful to support skin screenings at a population-level.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2024

Dataset of mechanically induced thermal runaway measurement and severity level on Li-ion batteries

The deployment of Li-ion batteries covers a wide range of energy storage applications, from mobile phones, e-bikes, electric vehicles (EV) and stationary energy storage systems. However, safety issue such as thermal runaway is always one of the most important concerns to prevent Li-ion batteries from further market penetration. A standardized single-side indentation test protocol was developed to mechanically induce an internal short-circuit. The cell voltage, compressive load, indenter stroke, and temperature at the indentation point are measured in time series. The test data of each cell, along with cell parameters such as dimensions, mass, chemistry, state of charge (SOC), capacity, are integrated together to calculate a thermal runaway severity score from 0 to100. Complete data collection process including the original measured record, test method, severity score calculation scheme is presented in this article. The thermal runaway severity analysis and the more than 100 tested Li-ion battery records provide a good data source for further comparison and ranking of thermal runaway risks.

25 ENERGY STORAGE↗
DOE OSTI2021

Prenatal exposure to mixtures of persistent endocrine disrupting chemicals and postnatal body size in British girls

Endocrine disrupting chemical (EDC) exposure is ubiquitous. EDC exposure during critical windows of development may interfere with the body's endocrine system, affecting growth. Previous human studies have examined one EDC at a time in relation to infant growth. By studying mixtures, the human experience can be better approximated. We investigated the association of prenatal exposure to persistent EDCs (per- and polyfluoroalkyl substances (PFAS), polychlorinated biphenyls (PCBs), and organochlorine pesticides (OCPs)) as mixtures with postnatal body size among female offspring. We used a sub-sample of the Avon Longitudinal Study of Parents and Children (N = 425), based in the United Kingdom. We quantified 52 EDCs in maternal serum collected during pregnancy. We used Bayesian kernel machine regression with a random intercept to examine the association of prenatal concentrations of EDC mixtures with longitudinal postnatal body size measures for each EDC class separately (PFAS, PCBs, and OCPs) and for all three classes combined. Weight and height measures at 0, 2, 9, and 19 months were obtained by health professionals as part of routine child health surveillance. The mixture representing all three classes combined (31 chemicals) (n = 301) was inversely associated with postnatal body size. Holding all EDCs in the 31-chemical mixture at the 75th percentile compared to the 50th percentile was associated with 0.15 lower weight-for-age z-score (95% credible interval –0.26, –0.03). Weak inverse associations were also seen for height-for-age and body mass index-for-age scores. Furthermore, these results suggest that prenatal exposure to mixtures of persistent EDCs may affect postnatal body size.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

A multi-criteria land suitability assessment of field allocation decisions for switchgrass

With the goal of evaluating biomass resource availability in certain regions in the United States, the Department of Energy, Department of Agriculture, Environmental Protection Agency, national laboratories, and Forest Service research laboratories, together with academic and industry collaborators, performed a resource analysis study, 2016 Billion-Ton Report: Advancing Domestic Resources for a Thriving Bioeconomy, Volume 1: Economic Availability of Feedstocks, using POLYSYS model to estimate biomass potential. The study provided county- and state-level biomass potential projections, with biomass feedstock production estimates and suitability assessment of lands acreage likely to transition to energy crops. For this analysis, we estimate biomass supply by year 2028, more specifically, lands acreage transition to switchgrass in the Midwest of the United States, across 50 counties in 3 states (Nebraska, Kansas, and Colorado). We propose a multi-criteria site suitability framework, to determine the potential acreage and production for switchgrass, at the field level. Site selection criteria span agronomic and ecosystem services such as previous land cover, crop rotation, soil water holding capacity, crop productivity, field efficiency, topography, soil organic matter, soil leaching propensity, distance to surface water bodies, and soil erosivity. Efficient agricultural field selection for dedicated energy crops field allocation is critical to evaluate biomass resource availability, and it is our position that estimation at the field level would provide a more accurate and useful estimation to support an emerging bioeconomy. Using field suitability scores and county-level assessments, we model land allocation decision for energy crop in the future, estimating the spatial distribution of dynamics of energy crop adoption with priority to fields scoring the highest. Additionally, compared with POLYSYS results from the report mentioned above, our method shows good performance overall, with about 2% and 1.2% of difference in switchgrass acreage allocation and crop production, respectively.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Micromovements and discomfort associated with flight mission with helmet operation tasks with different levels of cognitive workload

When performing stationary tasks under elevated cognitive workload, individuals must perform continual muscle contractions to maintain stability of the body, resulting in fatigue of the postural muscles. When the muscles perform these contractions in a prolonged manner, the body potentially responds through small changes in body movements—micromovements that may lead to discomfort. The study purpose was to evaluate impact of cognitive load on micromovements. The micromovements were measured during three different cognitive workloads; low, medium, and high. The NASA-TLX score was used to evaluate the perceived mental workload and discomfort was assessed by visual analog scale. In total, 60 subjects (30 males and 30 females) were recruited and performed cognitive tasks that simulated flight operations such as changing the radio frequency based on air traffic control messages, balancing the fuel levels in simulated fuel tanks, and aiming a reticle in a designated moving target using the cyclic control. Cognitive load was defined by the frequency of events. Micromovements were defined by changes in the center of pressure (COP) of the seat pan and COP standard deviation. It was found that the high cognitive workloads had the highest NASA-TLX scores including mental demands, temporal demands, and effort. The neck area had the highest overall levels of discomfort followed by upper back. The highest standard deviation for COP shift and number of micromovements occurred for medium cognitive workloads. In conclusion, while there were some interesting trends, few trends reached a statistical significance due to high variability among subjects for the outcome variables.

60 APPLIED LIFE SCIENCES↗