Engineering PapersSearch

SEARCH · Engineering Papers

Results for “Applied Mathematics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

Chemical reaction enhanced graph learning for molecule representation

Abstract Motivation Molecular representation learning (MRL) models molecules with low-dimensional vectors to support biological and chemical applications. Current methods primarily rely on intrinsic molecular information to learn molecular representations, but they often overlook effectively integrating domain knowledge into MRL. Results In this article, we develop a reaction-enhanced graph learning (RXGL) framework for MRL, utilizing chemical reactions as domain knowledge. RXGL introduces dual graph learning modules to model molecule representation. One module employs graph convolutions on molecular graphs to capture molecule structures. The other module constructs a reaction-aware graph from chemical reactions and designs a novel graph attention network on this graph to integrate reaction-level relations into molecular modeling. To refine molecule representations, we design a reaction-based relation learning task, which considers the relations between the reactant and product sides in reactions. In addition, we introduce a cross-view contrastive task to strengthen the cooperative associations between molecular and reaction-aware graph learning. Experiment results show that our RXGL achieves strong performance in various downstream tasks, including product prediction, reaction classification, and molecular property prediction. Availability and implementation The code is publicly available at https://github.com/coder-ACAC/RLM.

Biochemistry & Molecular Biology

CryoTEN: efficiently enhancing cryo-EM density maps using transformers

Abstract Motivation Cryogenic electron microscopy (cryo-EM) is a core experimental technique used to determine the structure of macromolecules such as proteins. However, the effectiveness of cryo-EM is often hindered by the noise and missing density values in cryo-EM density maps caused by experimental conditions such as low contrast and conformational heterogeneity. Although various global and local map-sharpening techniques are widely employed to improve cryo-EM density maps, it is still challenging to efficiently improve their quality for building better protein structures from them. Results In this study, we introduce CryoTEN—a 3D UNETR++ style transformer to improve cryo-EM maps effectively. CryoTEN is trained using a diverse set of 1295 cryo-EM maps as inputs and their corresponding simulated maps generated from known protein structures as targets. An independent test set containing 150 maps is used to evaluate CryoTEN, and the results demonstrate that it can robustly enhance the quality of cryo-EM density maps. In addition, automatic de novo protein structure modeling shows that protein structures built from the density maps processed by CryoTEN have substantially better quality than those built from the original maps. Compared to the existing state-of-the-art deep learning methods for enhancing cryo-EM density maps, CryoTEN ranks second in improving the quality of density maps, while running >10 times faster and requiring much less GPU memory than them. Availability and implementation The source code and data are freely available at https://github.com/jianlin-cheng/cryoten.

Biochemistry & Molecular Biology

miss-SNF: a multimodal patient similarity network integration approach to handle completely missing data sources

Abstract Motivation Precision medicine leverages patient-specific multimodal data to improve prevention, diagnosis, prognosis, and treatment of diseases. Advancing precision medicine requires the non-trivial integration of complex, heterogeneous, and potentially high-dimensional data sources, such as multi-omics and clinical data. In the literature, several approaches have been proposed to manage missing data, but are usually limited to the recovery of subsets of features for a subset of patients. A largely overlooked problem is the integration of multiple sources of data when one or more of them are completely missing for a subset of patients, a relatively common condition in clinical practice. Results We propose miss-Similarity Network Fusion (miss-SNF), a novel general-purpose data integration approach designed to manage completely missing data in the context of patient similarity networks. miss-SNF integrates incomplete unimodal patient similarity networks by leveraging a non-linear message-passing strategy borrowed from the SNF algorithm. miss-SNF is able to recover missing patient similarities and is “task agnostic”, in the sense that can integrate partial data for both unsupervised and supervised prediction tasks. Experimental analyses on nine cancer datasets from The Cancer Genome Atlas (TCGA) demonstrate that miss-SNF achieves state-of-the-art results in recovering similarities and in identifying patients subgroups enriched in clinically relevant variables and having differential survival. Moreover, amputation experiments show that miss-SNF supervised prediction of cancer clinical outcomes and Alzheimer’s disease diagnosis with completely missing data achieves results comparable to those obtained when all the data are available. Availability and implementation miss-SNF code, implemented in R, is available at https://github.com/AnacletoLAB/missSNF.

Biochemistry & Molecular Biology

NGPINT V3: a containerized orchestration Python software for discovery of next-generation protein–protein interactions

Abstract Summary Batch yeast two-hybrid (Y2H) assays, leveraged with next-generation sequencing, have afforded successful innovations for the analysis of protein–protein interactions. NGPINT is a Conda-based software designed to process the millions of raw sequencing reads resulting from Y2H–next-generation interaction screens. Over time, increasing compatibility and dependency issues have prevented clean NGPINT installation and operation. A system-wide update was essential to continue effective use with its companion software, Y2H-SCORES. We present NGPINT V3, a containerized implementation built with both Singularity and Docker, allowing accessibility across virtually any operating system and computing environment. Availability and implementation This update includes streamlined dependencies and container images hosted on Sylabs (https://cloud.sylabs.io/library/schuyler/ngpint/ngpint) and Dockerhub (https://hub.docker.com/r/schuylerds/ngpint), facilitating easier adoption and integration into high-throughput and cloud-computing workflows. Full instructions and software can be also found in the GitHub repository https://github.com/Wiselab2/NGPINT_V3 and Zenodo https://doi.org/10.5281/zenodo.15256036.

Biochemistry & Molecular Biology

CSGL: chemical synthesis graph learning for molecule representation

Abstract Motivation Molecule representation learning (MRL) translates molecules into a real vector space, serving as input to downstream tasks in biology, chemistry, and computer science. This article introduces a chemical synthesis graph learning (CSGL) framework, which enhances MRL by considering both the atomic structures of molecules and their roles in chemical reactions through a hierarchical graph representation. Specifically, molecules are first modeled based on their molecular graphs, which capture atomic-level structural information. They are then further refined using a chemical synthesis graph, where nodes represent reactant and product molecule sets, and edges encode chemical transformations between reactants and products (e.g. changes in molecular structures). CSGL optimizes molecular embeddings of reactant and product nodes in a fashion that ensures the embeddings conform to a chemical balance constraint. Results Experimental results show that our method CSGL achieves strong performance on a variety of tasks, including product prediction, reaction classification, and molecular property prediction. Availability and implementation https://github.com/li-2023/CSGL.

Biochemistry & Molecular Biology

CovTransformer: A transformer model for SARS-CoV-2 lineage frequency forecasting

With hundreds of SARS-CoV-2 lineages circulating in the global population, there is an ongoing need for predicting and forecasting lineage frequencies and thus identifying rapidly expanding lineages. Accurate prediction would allow for more focused experimental efforts to understand pathogenicity of future dominating lineages and characterize the extent of their immune escape. Here, we first show that the inherent noise and biases in lineage frequency data make a commonly-used regression-based approach unreliable. To address this weakness, we constructed a machine learning model for SARS-CoV-2 lineage frequency forecasting, called CovTransformer, based on the transformer architecture. We designed our model to navigate challenges such as a limited amount of data with high levels of noise and bias. We first trained and tested the model using data from the UK and the USA, and then tested the generalization ability of the model to many other countries and US states. Remarkably, the trained model makes accurate predictions two months into the future with high levels of accuracy both globally (in 31 countries with high levels of sequencing effort) and at the US-state level. Our model performed substantially better than a widely used forecasting tool, the multinomial regression model implemented in Nextstrain, demonstrating its utility in SARS-CoV-2 monitoring. Assuming a newly emerged lineage is identified and assigned, our test using retrospective data shows that our model is able to identify the dominating lineages 7 weeks in advance on average before they became dominant. Overall, our work demonstrates that transformer models represent a promising approach for SARS-CoV-2 forecasting and pandemic monitoring.

60 APPLIED LIFE SCIENCES

An improved dataset for predicting mammal infecting viruses from genetic sequence information

There have been several attempts to develop machine learning (ML) models to identify human infecting viruses from their genomic sequences, with varying degrees of success. Direct comparison between models is problematic, because these models are typically trained and evaluated on different datasets with alternative data splitting schemes, features, and model performance metrics. In this paper we present a standardized dataset of mammal infecting and non-infecting viral pathogens, refined from the previous work of Mollentze et al. to include the latest literature evidence, roughly doubling the number of curated host-virus records available to the community, and new host target labels, primate and mammal. The new host labels were included for several reasons, including previous reports that classification performance is better at broader taxonomic ranks and the idea that there may be more data for primate infection that might serve as a suitable proxy for zoonotic potential and avoidance of false positives for human infection due to absence of evidence. On this dataset, we report the performance of eight machine learning models for predicting mammal-infecting viruses from their genomic sequences. We find that randomly assigning cases in our improved dataset to training/testing sets, when compared to the original assignments into training/testing in Mollentze et al., increases the overall average ROC AUC of prediction of human infection from 0.663 ± 0.070 to 0.784 ± 0.013, consistent with the reduction in phylogenetic distance between train and test sets (relative entropy change from 3.00 to 0.08). The broadest host category of mammal infection can be predicted most reliably at 0.850 ± 0.020. We share our improved dataset and code to enable standardized comparisons of machine learning methods to predict human host infections. Overall, we have presented preliminary evidence that classification of virus host infection is more tractable at higher taxonomic ranks, that unsurprisingly reducing the phylogenetic distance between training and test sets can improve predictive performance, that peptide kmer features appear to be harmful to out of sample model performance, and we are left with the question of whether models for virus host prediction can reasonably be expected to perform well in out of sample scenarios given the likelihood that viruses do not share a common ancestor. Consistent with this concern, when the data is resampled such that there is no overlap between viral families in training and test sets (relative entropy > 24), models perform no better than random chance at prediction of human infection regardless of whether kmers are included (ROC AUC 0.50 ± 0.08) or not (ROC AUC 0.50 ± 0.04).

59 BASIC BIOLOGICAL SCIENCES

Develop High-Throughput Workflows for Whole-Genome Sequencing and Insertion Site Screening

The engineering of microbes for biomanufacturing (e.g. of fuels, chemicals, materials) applications has advanced to a stage where researchers screen genetic libraries with millions of variations each for those with enhanced productivity. This screening, however, can be slow and expensive, as screening individual variants in a high-throughput yet cost-effective manner is challenging. In this project, we aimed to reduce by 3-fold costs associated with the sequencing aspects of the screening process (to determine which genetic variant is responsible for an observed change in productivity), while being able to process over 1,000 samples per batch.

60 APPLIED LIFE SCIENCES

TGCM: (T)rait, (G)ene, and (C)rop Growth (M)odel Directed Targeted Gene Characterization in Sorghum (Final Technical Report)

Understanding which genes control important crop traits could help scientists develop better bioenergy and food crops more efficiently. However, plant genomes contain tens of thousands of genes, and testing each one individually is expensive and time-consuming. This project developed computational tools to predict which genes are most likely to matter, allowing researchers to focus their efforts where they will have the greatest impact. This project developed and validated integrated approaches combining machine learning, quantitative genetics, and crop growth modeling to improve the efficiency of functional gene characterization in sorghum (Sorghum bicolor), a critical bioenergy and food security crop. The research addressed a fundamental challenge in plant biology: the majority of genes in plant genomes lack experimentally validated functions, making it difficult to prioritize which genes to study using resource-intensive reverse genetics approaches.

60 APPLIED LIFE SCIENCES

Transforming the bootstrap: using Transformers to compute scattering amplitudes in planar N = 4 Super Yang-Mills theory

Abstract We pursue the use of deep learning methods to improve state-of-the-art computations in theoretical high-energy physics. Planar N = 4 Super Yang-Mills theory is a close cousin to the theory that describes Higgs boson production at the Large Hadron Collider; its scattering amplitudes are large mathematical expressions containing integer coefficients. In this paper, we apply Transformers to predict these coefficients. The problem can be formulated in a language-like representation amenable to standard cross-entropy training objectives. We design two related experiments and show that the model achieves high accuracy (> 98%) on both tasks. Our work shows that Transformers can be applied successfully to problems in theoretical physics that require exact solutions.

Cai, Tianji (ORCID:0000000232359486)

Application of physics-informed neural networks (PINNs) solution to coupled thermal and hydraulic processes in silty sands

Abstract The accurate modeling of water and heat transport in soils is crucial for both geo-environmental and geothermal engineering. Traditional modeling methods are problematic because they require well-defined boundaries and initial conditions. Recently, physics-informed neural networks (PINNs), which incorporate partial differential equations (PDEs) to solve forward and inverse problems, have attracted increasing attention in machine learning research. In this study, we applied PINNs to tackle hydraulic and thermal transport coupling forward problems in silty sands. A fully connected deep neural network was utilized for training. This neural network model leverages automatic differentiation to apply the governing equations as constraints, based on the mathematical approximations established by the neural network itself. We conducted forward problems and compared the solutions derived from PINNs with those from Finite Element Method (FEM) simulations. The forward problem results demonstrate the PINNs model’s capability in predicting hydraulic transport, heat transport, and thermal–hydraulic coupling in silty sands under various boundary conditions. The PINNs exhibited great performance in simulating the thermal–hydraulic coupling problem. The accuracy of the PINNs solutions shows its potential for simulation in geotechnical engineering.

Feng, Yuan

Prediction of cccDNA dynamics in hepatitis B patients by a combination of serum surrogate markers

Quantification of intrahepatic covalently closed circular DNA (cccDNA) is a key for evaluating an elimination of hepatitis B virus (HBV) in infected patients. However, quantifying cccDNA requires invasive methods such as a liver biopsy, which makes it impractical to access the dynamics of cccDNA in patients. Although HBV RNA and HBV core-related antigens (HBcrAg) have been proposed as surrogate markers for evaluating cccDNA activity, they do not necessarily estimate the amount of cccDNA. Here, we employed a recently developed multiscale mathematical model describing intra- and intercellular viral propagation and applied it in HBV-infected patients under treatment. We developed a model that can predict intracellular HBV dynamics by use of extracellular viral markers, including HBsAg, HBV DNA, and HBcrAg in peripheral blood. Importantly, the model prediction of the amount of cccDNA in patients over time was confirmed to be well correlated with the data for quantified cccDNA by paired liver biopsy. Thus, our method combining classic and emerging surrogate markers enables us to predict the decay dynamics of cccDNA in patients undergoing treatment.

60 APPLIED LIFE SCIENCES

Towards modeling phage therapy

Patients infected with life-threatening multi-drug resistant (MDR) bacteria have been treated with cocktails of bacteriophages. This is a complicated form of personalized medicine as the phages given to a patient have to be selected beforehand on the basis of their lytic capacity of the infecting bacteria. Because bacteria rapidly become resistant, the evolution of resistance to a diverse cocktail of phages is a complicated dynamical process, during which competing bacterial strains replace one another by accumulating several resistance mechanisms, each of which may involve a fitness cost. As a consequence, it is typically not known why a particular phage therapy succeeded or failed, and how one can optimize the composition of the cocktails to maximize the rate of success. To improve upon this, we extend an existing in vivo -calibrated mouse model into a novel mathematical model for the human situation, and include multiple phages infecting multiple bacterial strains, differing in their resistance to each of the phages. We adjust several parameter estimates of the bacterial model to the human situation, and use the model to describe a successful case of phage therapy involving several cocktails, each containing several phages. In the model, treatment success crucially depended on pretreatment resistance levels, and on the diversity and the timing of the cocktails. Once an appropriate cocktail is found, it is less important to further optimize the infection rates of the phages. Resistant bacterial strains expand rapidly when sensitive strains decline, and the higher the infectivity of the phages, the faster resistant strains expand. Because resistance evolves rapidly, it is best to provide a diverse set of phages right from the start of therapy, i.e., to hit hard and early, and create a high genetic barrier to bacterial resistance.

59 BASIC BIOLOGICAL SCIENCES

Chasing Gamma-Ray Signals from Binary Neutron Star Coalescences with the Cherenkov Telescope Array: Prospects and Observing Strategies

The detection of gravitational waves (GWs) from a binary neutron star (BNS) merger by Advanced LIGO and Advanced Virgo (GW170817), together with its electromagnetic counterpart, the short gamma-ray burst GRB 170817A, heralded the birth of multimessenger astronomy. The detection of TeV emission from GRBs motivates follow-up observations with the Cherenkov Telescope Array Observatory (CTAO), which is ideal for detecting such signals due to its unprecedented sensitivity, rapid response, and wide-field survey capabilities. The aim of this work is to evaluate GeV–TeV GW follow-up strategies for CTAO using a multistep simulation pipeline and to estimate the expected rate of joint GW–GRB detections during observing run O5. Using a simulated sample of BNS systems with corresponding GW detections, gamma-ray emission is simulated through phenomenological prescriptions based on the observed population of short GRBs, including off-axis jet scenarios. CTAO observations are simulated to account for instrument response, sky tiling strategies, integration times, and varying observing conditions. Strategies with variable and constant integration times are investigated. We find that, via an optimized follow-up strategy, about 5% of simulated GW-associated short GRBs produce GeV–TeV radiation detectable by CTAO. Detectability is strongly influenced by the jet opening angle and viewing angle, suggesting that even rough estimates of the viewing angle in GW alerts could enhance targeting. This framework motivates future follow-ups of GW-detectable events, including neutron star–black hole mergers, and further supports the development of advanced strategies incorporating galaxy distributions and synergies with future detectors such as the Einstein Telescope.

Abe, S. [University of Tokyo] (ORCID:0000000172503

Stable vacua with realistic phenomenology and cosmology in heterotic M-theory satisfying Swampland conjectures

We recently described a protocol for computing the potential energy in heterotic M-theory for the dilaton, complex structure and Kähler moduli. This included the leading order non-perturbative contributions to the complex structure, gaugino condensation and worldsheet instantons assuming a hidden sector that contains an anomalous U(1) structure group embedded in E8. In this paper, we elucidate, in detail, the mathematical and computational methods required to utilize this protocol. These methods are then applied to a realistic heterotic M-theory model, the B – L MSSM, whose observable sector is consistent with all particle physics requirements. Within this context, it is shown that the dilaton and universal moduli can be completely stabilized at values compatible with every phenomenological and mathematical constraint — as well as with ΛCDM cosmology. We also show that the heterotic M-theory vacua are consistent with all well-supported Swampland conjectures based on considerations of string theory and quantum gravity, and we discuss the implications of dark energy theorems for compactified theories.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS

Autonomous Operations for Advanced Reactors Utilizing Supervisory Control

Automation is a critical tenet of reactor plant operations as reliance on nuclear energy increases. Nuclear power plants require a large workforce which does not scale with output; that is, the cost per megawatt increases as reactor output becomes smaller. The economic viability of advanced reactors, particularly small modular reactors (SMRs) and microreactors, requires a significantly reduced onsite workforce. The logical solution is establishing a systematic process of elimination of reliance on human operators, and to the extent possible, replacing these actions with automated functions. In this paper, we propose a method for such transformation to establish a robust technical basis to enable transition to autonomy. Our method is based on finite state automata (FSA)—also known as finite state machines (FSMs). Relying on this method allows us to exploit the rich set of mathematical proofs available in the field of regular languages. FSA are one of the mathematical tools to model discrete event systems (DES). These properties are applied to produce an automated startup controller for the Massachusetts Institute of Technology Research Reactor (MITR). The startup procedure is captured in terms of discrete changes from one state to another while an independent supervisory control system directs the sequence of states and alerts a human in the event of an abnormal operation. First, the design and behavior of the MITR rod control system were modeled in Simulink. Then, the startup procedure was applied to the rod control system and the DES performed a startup by procedurally withdrawing rods to the subcritical position. The simulation also stops rod motion in response to an uncontrollable event and restarts rod motion once the event has been cleared.

46 - INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AN

A Combined Computational and Mathematical Analysis of Interconnect Fatigue Potential in Photovoltaic Modules

A finite element model of a 60-cell monocrystalline silicon glass-polymer photovoltaic module was simulated with ±1.0 kPa and ±2.4 kPa loads applied to the glass to calculate the deformation under load. Cell-to-cell displacements were used to approximate interconnect strain and stress. A mathematical fatigue cycle life relation was fitted to data for the interconnect material (copper), to generate a life prediction at each interconnect location based on the local stress means, reversal extents, and amplitudes. Interconnect stress was found to be significantly asymmetric about zero despite symmetric positive and negative module loads due to laminate thickness offsets about the neutral plane and the effects of module framing. Cycle life results indicated that interconnect fatigue failure was unlikely to occur over a 30-year lifetime of conservative wind and snow load cycles since the typical cell design feature of leaving some unconstrained length between the cell edge and first solder pad increases the effective gauge length and decreases the stress levels below the material endurance limit. Follow-up analyses found that 3.6 mm and 6.4 mm were the minimum unconstrained lengths required to survive the assumed lifetime of wind and snow cycles, respectively, confirming that typical industrial module constructions with 8–15 mm unconstrained lengths should survive conservatively. Notably, large magnitude, low-cycle snow loading was consistently the limiting factor requiring a longer unconstrained interconnect length. Finally, insights and workflows from this study inform module interconnection design limits for survival against mechanical fatigue in deployment environments.

14 SOLAR ENERGY