Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Model selection”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 487 records · Page 27

Virtual sensor supervised learning for cyber-attack neutralization

An industrial asset may have monitoring nodes that generate current monitoring node values. A dynamic, resilient estimator may split a temporal monitoring node space into normal and one or more abnormal subspaces associated with different kinds of attack vectors. According to some embodiments, a neutralization model is constructed and trained for each attack vector using supervised learning and the associated abnormal subspace. In other embodiments, a single model is created using out-of-range values for abnormal monitoring nodes. Responsive to an indication of a particular abnormal monitoring node or nodes, the system may automatically invoke the appropriate neutralization model to determine estimated values of the particular abnormal monitoring node or nodes (e.g., by selecting the correct model or using out-of-range values). The series of current monitoring node values from the abnormal monitoring node or nodes may then be replaced with the estimated values.

97 MATHEMATICS AND COMPUTING↗

Enhancing reactant selectivity for Ni/Mg reforming catalysts using silicalite-1 shells: A modeling study

The ability of a zeolite shell to enhance the selective conversion of hydrocarbons through diffusional limitations was investigated using a multi-scale model of a fixed-bed reactor. The impact of shell thickness and molecule/pore size on the catalytic performance of silicalite-1 zeolite encapsulated nickel catalyst pellets for steam reforming of C1-C7 hydrocarbons is reported. A reaction–diffusion model using kinetic expressions established in literature was employed. The model was verified through comparison with reported experimental results for steam reforming data over a temperature range of 748 – 1113 K and pressure of 1 – 10 bar. Comparisons are also made against experimental data for steam reforming in the presence of a zeolite shell. Evaluation of the Weisz-Prater criterion for both the core and encapsulated catalyst confirmed mass transfer limitation induced by the utilization of a zeolite shell. The model was used to suggest an optimal thickness that balances diffusional limitations imposed by the zeolite layer on methane versus that of the heavier hydrocarbons. The optimum thickness varied as a function of hydrocarbon size and shape which determined the diffusion rates. For toluene and heptane, a 50 nm thick shell was sufficient to wholly prevent reaction. Hydrocarbons like propane and butane required a shell 7.5 and 5 μm thick. Increasing the gas-hourly-space-velocity from 10,000 to 60,000 h –1 caused a decrease in the optimum shell thickness. Furthermore, this approach can be modified for application to other mixed hydrocarbon systems to predict optimal catalyst design.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Creation of Polymer Datasets with Targeted Backbones for Screening of High-Performance Membranes for Gas Separation

A simple approach was developed to computationally construct a polymer dataset by combining simplified molecular-input line-entry system (SMILES) strings of a targeted polymer backbone and a variety of molecular fragments. This method was used to create 14 polymer datasets by combining seven polymer backbones and molecules from two large molecular datasets (MOSES and QM9). Polymer backbones that were studied include four polydimethylsiloxane (PDMS) based backbones, poly(ethylene oxide) (PEO), poly(allyl glycidyl ether) (PAGE), and polyphosphazene (PPZ). The generated polymer datasets can be used for various cheminformatics tasks, including high-throughput screening for gas permeability and selectivity. This study utilized machine learning (ML) models to screen the polymers for CO2/CH4 and CO2/N2 gas separation using membranes. Several polymers of interest were identified. Here the results highlight that employing an ML model fitted to polymer selectivities leads to higher accuracy in predicting polymer selectivity compared to using the ratio of predicted permeabilities.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Coupled Neutronic and Thermal Hydraulic Analysis of a Natural Circulation Based Small Modular Reactor (SMR) Using VERA-CS

As part of the work supported by a US Department of Energy (DOE) Office of Nuclear Energy Gateway for Accelerated Innovation in Nuclear FY 2020 Voucher, Holtec International subsidiary SMR LLC (hereinafter referred to as Holtec) and Oak Ridge National Laboratory entered into a cooperative research and development agreement (CRADA) to develop coupled multiphysics core models of the Holtec developed small modular reactor (SMR), SMR-160. The scope of the 1 year project was to use the DOE–developed tool set, VERA, to analyze several aspects of a representative SMR-160 core design. The goals of the project were to perform the code-to-code benchmarking and to provide Holtec with a confirmatory calculations to compare against the results with the codes used in the SMR-160 design, identify and resolve areas of discrepancy between the two models to give Holtec a basis for selecting certain tool and model options, and develop a workflow so that the VERA model could be adapted easily to any future changes in the design of the SMR-160 core. The work proceeded in four phases: 1. Developing the initial VERA model based on Holtec-provided core design information; 2. Comparing VERA results with Holtec-provided calculations for the first five cycles; 3. Developing a VERA transient model based on the prior model; and 4. Training Holtec personnel on VERA and hand-off the developed models. This report summarizes at a high level the completed tasks. Details of the tasks and results are reserved for the full report, which will not be publicly released for 5 years per the terms of the CRADA. The report is titled “Coupled Neutronic and Thermal Hydraulic Analysis of a Natural Circulation Based Small Modular Reactor (SMR) using VERA-CS” and has the ORNL technical report number ORNL/TM 2021/2303 (NFE-20-08305)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

ThermoPI—an Online Tool to Calculate Heat Transfer Through Foam Insulation

Thermal insulation materials with ultra-low effective thermal conductivity are crucial for a multitude of applications. Over the years, a significant amount of experimental work has been dedicated to creating new insulation materials with low thermal conductivity. Similarly, substantial efforts have been made to enhance the theoretical understanding of thermal transport mechanisms in thermal insulation materials and to push the boundaries of lower thermal conductivity. However, ample room remains for enhancing the thermal resistivity of closed-cell foam insulations. To aid in the development of ultra-low effective thermal conductivity foam insulations, Oak Ridge National Laboratory has introduced a unique online tool, ThermoPI. This tool calculates not only the effective thermal conductivity but also the thermal conductivity components for porous materials, including gases, solids, and radiative, based on the materials’ structural information (e.g., porosity, pore size, gas species, pressure, solid species, pore geometry, and temperature).This tool collected and improved the existing theoretical models for thermal insulation materials’ gas, solid, and radiative thermal conductivity. These improved models have been validated with experimental data. Effective medium theory and sound velocity softening effects are considered for solid thermal conductivity. The built-in solid materials include polystyrene, polyurethane, polyethylene, and silica. Users are allowed to input new solid materials that are not built inside the tool. For gas thermal conductivity, the subcontinuum Knudsen effect is considered. In addition to several built-in gases, users can input new gases. For solid and radiative thermal conductivity calculations, several models are available to select, and the tool can determine the best model to choose based on the materials that users input. Users are also allowed to change selections manually. In addition, the tool can also calculate the effect of interfacial resistance on the overall thermal conductivity of layered materials. This work will elaborate on the tool and discuss how it can guide the development of new insulation products.

Shrestha, Som [ORNL] (ORCID:0000000183993797)↗

A Joint Search for Muon Neutrino Disappearance with the Short-Baseline Neutrino Program Using the SPINE Deep Learning-Based Reconstruction Package

We present the status of a joint search for muon neutrino disappearance in the Booster Neutrino Beam at Fermilab using the Short-Baseline Neutrino (SBN) Program's two-detector configuration, SBND and ICARUS. Charged-current interactions consistent with muon neutrinos and containing only a muon and at least one proton in the final state are reconstructed and selected using the SPINE deep learning-based particle reconstruction package. To exploit proton multiplicity information and enhance sensitivity to modeling effects, the selected sample is partitioned into exclusive channels with exactly one reconstructed proton and with more than one reconstructed proton. Comprehensive systematic uncertainties from the neutrino flux, interaction, and detector response are incorporated into the analysis, and the coverage of these systematic uncertainty models is validated using data from both detectors, including checks of near-far consistency in key kinematic and topology-sensitive observables. This analysis is intended for inclusion in SBN's first oscillation result.

Mueller, Justin [Fermilab]↗

Three-State Majority-vote Model on Scale-Free Networks and the Unitary Relation for Critical Exponents

Abstract We investigate the three-state majority-vote model for opinion dynamics on scale-free and regular networks. In this model, an individual selects an opinion equal to the opinion of the majority of its neighbors with probability 1 − q , and different to it with probability q . The parameter q is called the noise parameter of the model. We build a network of interactions where z neighbors are selected by each added site in the system, a preferential attachment network with degree distribution k − λ , where λ = 3 for a large number of nodes N . In this work, z is called the growth parameter. Using finite-size scaling analysis, we obtain that the critical exponents $$\beta /\bar{\nu }$$ β / ν ¯ and $$\gamma /\bar{\nu }$$ γ / ν ¯ associated with the magnetization and the susceptibility, respectively. Using Monte Carlo simulations, we calculate the critical noise parameter q c as a function of z for the scale-free networks and obtain the phase diagram of the model. We find that the critical exponents add up to unity when using a special volumetric scaling, regardless of the dimension of the network of interactions. We verify this result by obtaining the critical noise and the critical exponents for the two and three-state majority-vote model on cubic lattice networks.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Estimating the strength of selection for new SARS-CoV-2 variants

Abstract Controlling the SARS-CoV-2 pandemic becomes increasingly challenging as the virus adapts to human hosts through the continual emergence of more transmissible variants. Simply observing that a variant is increasing in frequency is relatively straightforward, but more sophisticated methodology is needed to determine whether a new variant is a global threat and the magnitude of its selective advantage. We present two models for quantifying the strength of selection for new and emerging variants of SARS-CoV-2 relative to the background of contemporaneous variants. These methods range from a detailed model of dynamics within one country to a broad analysis across all countries, and they include alternative explanations such as migration and drift. We find evidence for strong selection favoring the D614G spike mutation and B.1.1.7 (Alpha), weaker selection favoring B.1.351 (Beta), and no advantage of R.1 after it spreads beyond Japan. Cutting back data to earlier time horizons reveals that uncertainty is large very soon after emergence, but that estimates of selection stabilize after several weeks. Our results also show substantial heterogeneity among countries, demonstrating the need for a truly global perspective on the molecular epidemiology of SARS-CoV-2.

60 APPLIED LIFE SCIENCES↗

DISTEMA: distance map-based estimation of single protein model accuracy with attentive 2D convolutional neural network

Abstract Background Estimation of the accuracy (quality) of protein structural models is important for both prediction and use of protein structural models. Deep learning methods have been used to integrate protein structure features to predict the quality of protein models. Inter-residue distances are key information for predicting protein’s tertiary structures and therefore have good potentials to predict the quality of protein structural models. However, few methods have been developed to fully take advantage of predicted inter-residue distance maps to estimate the accuracy of a single protein structural model. Result We developed an attentive 2D convolutional neural network (CNN) with channel-wise attention to take only a raw difference map between the inter-residue distance map calculated from a single protein model and the distance map predicted from the protein sequence as input to predict the quality of the model. The network comprises multiple convolutional layers, batch normalization layers, dense layers, and Squeeze-and-Excitation blocks with attention to automatically extract features relevant to protein model quality from the raw input without using any expert-curated features. We evaluated DISTEMA’s capability of selecting the best models for CASP13 targets in terms of ranking loss of GDT-TS score. The ranking loss of DISTEMA is 0.079, lower than several state-of-the-art single-model quality assessment methods. Conclusion This work demonstrates that using raw inter-residue distance information with deep learning can predict the quality of protein structural models reasonably well. DISTEMA is freely at https://github.com/jianlin-cheng/DISTEMA

59 BASIC BIOLOGICAL SCIENCES↗

Quantifying shifts in natural selection on codon usage between protein regions: a population genetics approach

Codon usage bias (CUB), the non-uniform usage of synonymous codons, occurs across all domains of life. Adaptive CUB is hypothesized to result from various selective pressures, including selection for efficient ribosome elongation, accurate translation, mRNA secondary structure, and/or protein folding. Given the critical link between protein folding and protein function, numerous studies have analyzed the relationship between codon usage and protein structure. The results from these studies have often been contradictory, likely reflecting the differing methods used for measuring codon usage and the failure to appropriately control for confounding factors, such as differences in amino acid usage between protein structures and changes in the frequency of different structures with gene expression. Here we take an explicit population genetics approach to quantify codon-specific shifts in natural selection related to protein structure in S. cerevisiae and E. coli. Unlike other metrics of codon usage, our approach explicitly separates the effects of natural selection, scaled by gene expression, and mutation bias while naturally accounting for a region’s amino acid usage. Bayesian model comparisons suggest selection on codon usage varies only slightly between helix, sheet, and coil secondary structures and, similarly, between structured and intrinsically-disordered regions. Similarly, in contrast to previous findings, we find selection on codon usage only varies slightly at the termini of helices in E. coli. Using simulated data, we show this previous work indicating “non-optimal” codons are enriched at the beginning of helices in S. cerevisiae was due to failure to control for various confounding factors (e.g. amino acid biases, gene expression, etc.), and rather than selection to modulate cotranslational folding. Our results reveal a weak relationship between codon usage and protein structure, indicating that differences in selection on codon usage between structures are slight. In addition to the magnitude of differences in selection between protein structures being slight, the observed shifts appear to be idiosyncratic and largely codon-specific rather than systematic reversals in the nature of selection. Overall, our work demonstrates the statistical power and benefits of studying selective shifts on codon usage or other genomic features from an explicitly evolutionary approach. Limitations of this approach and future potential research avenues are discussed.

59 BASIC BIOLOGICAL SCIENCES↗

Selectivity mechanisms of ion intercalation in Prussian blue analogs

Prussian blue analogs (PBAs) are a family of materials with facile, reversible, and selective ion transport capability for various ions via electrochemical intercalation, owing to their vacancy structure. The large tunable compositional space of PBAs allows for manipulation of intercalation behavior and selectivity by controlling structural vacancy level through choice of transition metal centers and modifications to the synthesis process. However, a lack of understanding of the mechanisms of ion selectivity hinders the material’s design process. Here, for this work, we investigated the origins of ion selectivity using a model PBA, copper hexacyanoferrate, and focused on eight technologically and biologically prominent ions, for which we determined a sequence of selectivity: Rb + > K + > Na + > Ba 2+ > Sr 2+ ≈ Ca 2+ > Mg 2+ > Li + . We provide electrochemical, structural, and redox evidence of strong correlation between the ion identity, the dominant charge-compensating redox, and preferred occupancy site. Specifically, using synchrotron anomalous X-ray diffraction (AXRD), we reveal that monovalent ions exhibit significant association with the corner sites of the unit cell and iron redox, whereas divalent ions display affinity toward the center site with higher ratios of copper redox. Informed by selectivity results, we applied CuHCFe to Li purification and achieved 99.9% purity. Our findings demonstrate an approach to elucidating ion intercalation behavior in order to distinguish and manipulate material properties to optimize separation performance.

Prussian blue analog↗

Spatially Patterned Architectures to Modulate CO 2 Reduction Cascade Catalysis Kinetics

Electrochemical CO 2 reduction using renewable sources of electrical energy holds promise for converting CO 2 into fuels and chemicals. The complex interactions among chemical/electrochemical reactions and mass transport make it difficult to analyze the effect of an individual process on electrode performance based only on experimental methods. Here, we developed a generalized steady-state simulation to describe an electrode surface in which sequential cascade catalysts are patterned in a periodic trench design. If appropriately constructed, this trench geometry is hypothesized to be able to yield a higher net current density for a CO 2 reduction (CO 2 R) cascade reaction. We have used realistic experimental reaction kinetics to investigate the role of trench geometry in mass transport, local microenvironments, and selectivity for a model CO 2 R cascade reaction. The model considers local concentration gradients of bicarbonate species at quasi-equilibrium and catalytic surface reactions based on concentration-dependent Butler–Volmer kinetics. Our results suggest that varying the spatial distribution of active sites plays a significant role in facilitating effective mass transport between active sites, modulating selectivity for the cascade reaction, and enhancing the yield of desirable cascade products. Moreover, we observe that this trench geometry significantly alters the cascade reaction rate by affecting the local pH, which can cause inadvertent depletion of available aqueous CO 2 to limit the CO 2 R cascade kinetics and modest suppression of the hydrogen evolution reaction (HER). The results highlight the trade-offs between mass transport, pH, and reaction kinetics that become apparent only when considering the coupled physics of all processes at the electrode surface. Here, this model can thus serve as a primary tool to build more selective and efficient patterned architectures for the CO 2 R cascade catalysis.

CO2 reduction↗

Optimal vocabulary selection approaches for privacy-preserving deep NLP model training for information extraction and cancer epidemiology

With the use of artificial intelligence and machine learning techniques for biomedical informatics, security and privacy concerns over the data and subject identities have also become an important issue and essential research topic. Without intentional safeguards, machine learning models may find patterns and features to improve task performance that are associated with private personal information. The privacy vulnerability of deep learning models for information extraction from medical textural contents needs to be quantified since the models are exposed to private health information and personally identifiable information. The objective of the study is to quantify the privacy vulnerability of the deep learning models for natural language processing and explore a proper way of securing patients’ information to mitigate confidentiality breaches. The target model is the multitask convolutional neural network for information extraction from cancer pathology reports, where the data for training the model are from multiple state population-based cancer registries. This study proposes the following schemes to collect vocabularies from the cancer pathology reports; (a) words appearing in multiple registries, and (b) words that have higher mutual information. We performed membership inference attacks on the models in high-performance computing environments. The comparison outcomes suggest that the proposed vocabulary selection methods resulted in lower privacy vulnerability while maintaining the same level of clinical task performance.

59 BASIC BIOLOGICAL SCIENCES↗

CMIP6-based Multi-model Hydroclimate Projection over the Conterminous US, Version 1.1

This dataset presents a suite of high-resolution downscaled hydro-climate projections over the conterminous United States (CONUS) based on multiple selected Global Climate Models (GCMs) from the Coupled Models Intercomparison Project phase 6 (CMIP6). The CMIP6 GCMs are downscaled using either statistical (DBCCA) or dynamical (RegCM) downscaling approaches based on two meteorological reference datasets (Daymet and Livneh). Subsequently, the downscaled precipitation, temperature, and wind speed are employed to drive two calibrated hydrologic models (VIC and PRMS), enabling the simulation of projected future hydrologic responses across the CONUS. Each ensemble member covers the 1980-2019 baseline and 2020-2059 near-future periods under the high-end (SSP585) emission scenario. Moreover, utilizing only DBCCA and Daymet, the projections are further extended to the 2060-2099 far-future period and across three additional emission scenarios (SSP370, SSP245, and SSP126). This dataset is formulated to support the SECURE Water Act Section 9505 Assessment for the US Department of Energy (DOE) Water Power Technologies Office (WPTO). For further details on this dataset, please refer to Kao et al. (2022) and Rastogi et al. (2022).

13 HYDRO ENERGY↗

Nuclear and chloroplast genome engineering of a productive non-model alga Desmodesmus armatus: Insights into unusual and selective acquisition mechanisms for foreign DNA

Despite the tremendous potential of algae to contribute to a future bioeconomy, there are practical and theoretical limitations to how well naturally sourced species and strains can perform in an outdoor setting. The application of biotechnology to modulate and engineer algae metabolism or to increase performance, resilience, or produce novel compounds, offers opportunities to overcome some of the major commercialization barriers. There are numerous approaches reported in the literature having variable success on genetic engineering of algae with non-model algae often presenting unique challenges to genetic engineering. We report here on successful nuclear and chloroplast genomic integration of selection marker resistance in the non-model alga Desmodesmus armatus. Nuclear transformation was accomplished using both electroporation and Agrobacterium-mediated approaches. However, in all surviving transformants, DNA integration was accompanied by excision and/or rearrangement of the gene of interest and fluorescence reporter coding sequences. Similarly, chloroplast transformation was successfully accomplished using a biolistic DNA delivery method. For these transformants, we also observed off-target mutations in the chloroplast genome, not previously observed in other, more routinely used, algae species. Finally, we present insights into potential mechanisms for these observed truncations, rearrangements, and mutations in D. armatus.

59 BASIC BIOLOGICAL SCIENCES↗

Machine learning–assisted prediction of heat fluxes through thermally anisotropic building envelopes

Thermally anisotropic building envelope (TABE) is a novel active building envelope that can save energy use to maintain thermal comfort in buildings by redirecting heat and coolness from building envelopes to thermal loops. Finite element models (FEMs) can be used to compute the heat fluxes through TABEs, but the high computational cost of finite element simulations has prevented parametric studies and design optimizations. This paper proposes a domain knowledge–informed, finite element–based machine learning framework to reduce the computation cost for the energy management of buildings installed with TABE that uses a ground thermal loop. First, the training heat flux data set was generated by FEM simulations with different thermal loop schedules. Then, both shallow learning models (i.e., multivariate linear regression and eXtreme Gradient Boost, or XGBoost) and a deep learning model (i.e., deep neural network, or DNN) were trained to predict the heat fluxes. Domain knowledge was used for data preprocessing and feature selection. Finally, the suitability of the selected machine learning model was tested under different thermal loop schedules. Herein, the case study results showed that: (1) XGBoost can be as accurate as DNN (coefficient of determination equal to 0.81) with much less training time; (2) the annual energy cost savings for different thermal loop schedules obtained by the XGBoost-predicted and FEM-calculated heat fluxes are consistent, having a difference of only 4%; and (3) XGBoost can reduce the computation time for the annual energy analysis of the case study building with a given thermal loop schedule from around 12 h by using FEM to less than 1 min.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Machine learning for ultrasonic nondestructive examination of welding defects: A systematic review

Recent years have seen a substantial increase in the application of machine learning (ML) for automated analysis of nondestructive examination (NDE) data. One of the applications of interest is the use of ML for the analysis of data from in-service inspection of welds in nuclear power and other industries. These types of inspections are performed in accordance with criteria described in the ASME Boiler and Pressure Vessel Code and require the use of reliable NDE techniques. The rapid growth in ML methods and the diversity of possible approaches indicate a need to assess the current capabilities of ML and automated data analysis for NDE and identify any gaps or shortcomings in current ML technologies as applied to the automated analysis of NDE data. In particular, there is a need to determine the impact of ML on the NDE reliability. This paper discusses the findings from a literature survey on the current state of ML for the automated analysis of data from ultrasonic NDE of weld flaws. It discusses an overview of ultrasonic NDE as used for weld inspections in nuclear power and other industries. Herein, data sets and ML models used in the literature are summarized, along with a generally applicable workflow for ML. Findings on the capabilities, limitations and potential gaps in feature selection, data selection, and ML model optimization are discussed. The paper identified several needs for quantifying and validating the performance of ML methods for ultrasonic NDE, including the need for common data sets.

36 MATERIALS SCIENCE↗