Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Mathematical Computing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 703 records · Page 39

Acceleration of Graph Neural Network-Based Prediction Models in Chemistry via Co-Design Optimization on Intelligence Processing Units

Atomic structure prediction and associated property calculations are the bedrock of chemical physics. Since high-fidelity ab initio modeling techniques for computing the structure and properties can be prohibitively expensive, this motivates the development of machine-learning (ML) models that make these predictions more efficiently. Training graph neural networks over large atomistic databases introduces unique computational challenges such as the need to process millions of small graphs with variable size and support communication patterns that are distinct from learning over large graphs such as social networks. We demonstrate a novel hardware-software co-design approach to scale up the training of atomistic graph neural networks (GNN) for structure and property prediction. First, to eliminate redundant computation and memory associated with alternative padding techniques and to improve throughput via minimizing communication, we formulate the effective coalescing of the batches of variable-size atomistic graphs as the bin packing problem and introduce a hardware-agnostic algorithm to pack these batches. In addition, we propose hardware-specific optimizations including a planner and vectorization for the gather-scatter operations targeted for Graphcore’s Intelligence Processing Unit (IPU), as well as model-specific optimizations such as merged communication collectives and optimized softplus. Putting these all together, we demonstrate the effectiveness of the proposed co-design approach by providing an implementation of a well-established atomistic GNN on the Graphcore IPUs. We evaluate the training performance on multiple atomistic graph databases with varying degrees of graph counts, sizes and sparsity. Here, we demonstrate that such a co-design approach can reduce the training time of atomistic GNNs and can improve the performance by up to 1.5× compared to the baseline implementation of the model on the IPUs. Additionally, we compare our IPU implementation with a Nvidia GPU-based implementation and show that our atomistic GNN implementation on the IPUs can run 1.8× faster on average compared to the execution time on the GPUs.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Assessment of Extinction‐, Satellite‐, and Model‐Based Vertical Cloud Condensation Nuclei (CCN) Retrieval Methods Using Airborne CCN Measurements Over the Southern Great Plains

Abstract Accurate estimates of the vertical profile of cloud condensation nuclei (CCN) concentration are crucial to better quantify aerosol‐cloud interactions. We assessed the correlation between the vertical CCN concentrations obtained from extinction‐, satellite‐, and model‐based retrieval methods and airborne CCN concentrations collected at 0.24% supersaturation within the 3, 9, 27, and 81 km regions centered over the U.S. Department of Energy's Atmospheric Radiation Measurement User Facility Southern Great Plains (SGP) site during the spring and summer of 2016. The extinction profiles at a wavelength 355 nm were provided by the ground‐based Raman lidar. Our analysis showed moderate correlation between dry‐corrected extinction and airborne CCN data. We found the retrieved number concentration of CCN (RNCCN) method showed regression best‐fit slopes close to unity and consistent prediction errors for the majority of the data. The Lenhardt et al. (2023, https://doi.org/10.5194/amt‐16‐2037‐2023 ) method showed similar conclusions but only during spring, whereas the Mamouri and Ansmann (2016, https://doi.org/10.5194/acp‐16‐5905‐2016 ) method showed poor correlation. The Shinozuka et al. (2015, https://doi.org/10.5194/acp‐15‐7585‐2015 ) satellite‐based method exhibited reasonable agreement during summer but poor correlation during periods where both high (∼1,400 #/cm 3 ) and low (∼50 #/cm 3 ) airborne CCN concentrations were observed. The Copernicus Atmosphere Monitoring Service reanalysis modeled 3‐D CCN data set showed a moderate to weak positive correlation but performed poorly at high airborne CCN concentrations. Our analysis suggests the extinction‐based RNCCN method performed better than other methods across most observation periods under the diverse meteorological conditions observed at the SGP site.

54 ENVIRONMENTAL SCIENCES↗

Controlling the pandemic during the SARS-CoV-2 vaccination rollout

There is a consensus that mass vaccination against SARS-CoV-2 will ultimately end the COVID-19 pandemic. However, it is not clear when and which control measures can be relaxed during the rollout of vaccination programmes. We investigate relaxation scenarios using an age-structured transmission model that has been fitted to age-specific seroprevalence data, hospital admissions, and projected vaccination coverage for Portugal. Our analyses suggest that the pressing need to restart socioeconomic activities could lead to new pandemic waves, and that substantial control efforts prove necessary throughout 2021. Using knowledge on control measures introduced in 2020, we anticipate that relaxing measures completely or to the extent as in autumn 2020 could launch a wave starting in April 2021. Additional waves could be prevented altogether if measures are relaxed as in summer 2020 or in a step-wise manner throughout 2021. We discuss at which point the control of COVID-19 would be achieved for each scenario.

60 APPLIED LIFE SCIENCES↗

Correspondence between neuroevolution and gradient descent

Abstract We show analytically that training a neural network by conditioned stochastic mutation or neuroevolution of its weights is equivalent, in the limit of small mutations, to gradient descent on the loss function in the presence of Gaussian white noise. Averaged over independent realizations of the learning process, neuroevolution is equivalent to gradient descent on the loss function. We use numerical simulation to show that this correspondence can be observed for finite mutations, for shallow and deep neural networks. Our results provide a connection between two families of neural-network training methods that are usually considered to be fundamentally different.

97 MATHEMATICS AND COMPUTING↗

A quantum eigenvalue solver based on tensor networks

Electronic ground states are of central importance in chemical simulations, but have remained beyond the reach of efficient classical algorithms except in cases of weak electron correlation or one-dimensional spatial geometry. We introduce a hybrid quantum-classical eigenvalue solver that constructs a wavefunction ansatz from a linear combination of matrix product states in rotated orbital bases, enabling the characterization of strongly correlated ground states with arbitrary spatial geometry. The energy is converged via a gradient-free generalized sweep algorithm based on quantum subspace diagonalization, with a potentially exponential speedup in the off-diagonal matrix element contractions upon translation into compact quantum circuits of linear depth in the number of qubits. Chemical accuracy is attained in numerical experiments for both a stretched water molecule and an octahedral arrangement of hydrogen atoms, achieving substantially better correlation energies compared to a unitary coupled-cluster benchmark, with orders of magnitude reductions in quantum resource estimates and a surprisingly high tolerance to shot noise. This proof-of-concept study suggests a promising new avenue for scaling up simulations of strongly correlated chemical systems on near-term quantum hardware.

chemistry↗

Utilizing genome-scale models to optimize nutrient supply for sustained algal growth and lipid productivity

Nutrient availability is critical for growth of algae and other microbes used for generating valuable biochemical products. Determining the optimal levels of nutrient supplies to cultures can eliminate feeding of excess nutrients, lowering production costs and reducing nutrient pollution into the environment. With the advent of omics and bioinformatics methods, it is now possible to construct genome-scale models that accurately describe the metabolism of microorganisms. In this study, a genome-scale model of the green alga Chlorella vulgaris (iCZ946) was applied to predict feeding of multiple nutrients, including nitrate and glucose, under both autotrophic and heterotrophic conditions. The objective function was changed from optimizing growth to instead minimizing nitrate and glucose uptake rates, enabling predictions of feed rates for these nutrients. The metabolic model control (MMC) algorithm was validated for autotrophic growth, saving 18% nitrate while sustaining algal growth. Additionally, we obtained similar growth profiles by simultaneously controlling glucose and nitrate supplies under heterotrophic conditions for both high and low levels of glucose and nitrate. Finally, the nitrate supply was controlled in order to retain protein and chlorophyll synthesis, albeit at a lower rate, under nitrogen-limiting conditions. This model-driven cultivation strategy doubled the total volumetric yield of biomass, increased fatty acid methyl ester (FAME) yield by 61%, and enhanced lutein yield nearly 3 fold compared to nitrogen starvation. This study introduces a control methodology that integrates omics data and genome-scale models in order to optimize nutrient supplies based on the metabolic state of algal cells in different nutrient environments. This approach could transform bioprocessing control into a systems biology-based paradigm suitable for a wide range of species in order to limit nutrient inputs, reduce processing costs, and optimize biomanufacturing for the next generation of desirable biotechnology products.

59 BASIC BIOLOGICAL SCIENCES↗

Dynamic resource allocation drives growth under nitrogen starvation in eukaryotes

Cells can sense changes in their extracellular environment and subsequently adapt their biomass composition. Nutrient abundance defines the capability of the cell to produce biomass components. Under nutrient-limited conditions, resource allocation dramatically shifts to carbon-rich molecules. Here, we used dynamic biomass composition data to predict changes in growth and reaction flux distributions using the available genome-scale metabolic models of five eukaryotic organisms (three heterotrophs and two phototrophs). We identified temporal profiles of metabolic fluxes that indicate long-term trends in pathway and organelle function in response to nitrogen depletion. Surprisingly, our calculations of model sensitivity and biosynthetic cost showed that free energy of biomass metabolites is the main driver of biosynthetic cost and not molecular weight, thus explaining the high costs of arginine and histidine. We demonstrated how metabolic models can accurately predict the complexity of interwoven mechanisms in response to stress over the course of growth.

59 BASIC BIOLOGICAL SCIENCES↗

High-throughput platform for yeast morphological profiling predicts the targets of bioactive compounds

Abstract Morphological profiling is an omics-based approach for predicting intracellular targets of chemical compounds in which the dose-dependent morphological changes induced by the compound are systematically compared to the morphological changes in gene-deleted cells. In this study, we developed a reliable high-throughput (HT) platform for yeast morphological profiling using drug-hypersensitive strains to minimize compound use, HT microscopy to speed up data generation and analysis, and a generalized linear model to predict targets with high reliability. We first conducted a proof-of-concept study using six compounds with known targets: bortezomib, hydroxyurea, methyl methanesulfonate, benomyl, tunicamycin, and echinocandin B. Then we applied our platform to predict the mechanism of action of a novel diferulate-derived compound, poacidiene. Morphological profiling of poacidiene implied that it affects the DNA damage response, which genetic analysis confirmed. Furthermore, we found that poacidiene inhibits the growth of phytopathogenic fungi, implying applications as an effective antifungal agent. Thus, our platform is a new whole-cell target prediction tool for drug discovery.

59 BASIC BIOLOGICAL SCIENCES↗

Model of metabolism and gene expression predicts proteome allocation in Pseudomonas putida

Abstract The genome-scale model of metabolism and gene expression (ME-model) forPseudomonas putidaKT2440,iPpu1676-ME, provides a comprehensive representation of biosynthetic costs and proteome allocation. Compared to a metabolic-only model,iPpu1676-ME significantly expands on gene expression, macromolecular assembly, and cofactor utilization, enabling accurate growth predictions without additional constraints. Multi-omics analysis using RNA sequencing and ribosomal profiling data revealed translational prioritization inP. putida, with core pathways, such as nicotinamide biosynthesis and queuosine metabolism, exhibiting higher translational efficiency, while secondary pathways displayed lower priority. Notably, the ME-model significantly outperformed the M-model in alignment with multi-omics data, thereby validating its predictive capacity. Thus,iPpu1676-ME offers valuable insights intoP. putida’s proteome allocation and presents a powerful tool for understanding resource allocation in this industrially relevant microorganism.

Mathematical & Computational Biology↗

Identifying COVID-19 cases and extracting patient reported symptoms from Reddit using natural language processing

We used social media data from “covid19positive” subreddit, from 03/2020 to 03/2022 to identify COVID-19 cases and extract their reported symptoms automatically using natural language processing (NLP). We trained a Bidirectional Encoder Representations from Transformers classification model with chunking to identify COVID-19 cases; also, we developed a novel QuadArm model, which incorporates Question-answering, dual-corpus expansion, Adaptive rotation clustering, and mapping, to extract symptoms. Our classification model achieved a 91.2% accuracy for the early period (03/2020-05/2020) and was applied to the Delta (07/2021–09/2021) and Omicron (12/2021–03/2022) periods for case identification. We identified 310, 8794, and 12,094 COVID-positive authors in the three periods, respectively. The top five common symptoms extracted in the early period were coughing (57%), fever (55%), loss of sense of smell (41%), headache (40%), and sore throat (40%). During the Delta period, these symptoms remained as the top five symptoms with percent authors reporting symptoms reduced to half or fewer than the early period. During the Omicron period, loss of sense of smell was reported less while sore throat was reported more. Our study demonstrated that NLP can be used to identify COVID-19 cases accurately and extracted symptoms efficiently.

60 APPLIED LIFE SCIENCES↗

Light-powered end-to-end neutron detection and imaging with an edge-deployed optical AI chip

Neutron detection is widely used in many applications including nuclear physics, nuclear energy, nuclear technologies and nuclear safeguards. Developing an end-to-end neutron detection and imaging workflow paves way towards fully automated processes for many applications. We implemented an automated workflow for neutron detection experiments which use a solid state image sensor to capture neutron hits as a digital image. We deploy the workflow to an edge-based optical neural network (ONN) to increase the radiation-hardness and lifetime of neutron detection instruments. We present a two-stage neural network framework for detection of neutrons at sub-pixel resolution. The first stage uses a region proposal network to efficiently detect and extract neutron hits from the input camera image. The second stage feeds the extracted hits into a fully connected neural network to predict the sub-pixel hit position. The performance of the two-stage framework is evaluated using the edge-based ONN. The results show that we can achieve above 96% neutron detection accuracy as well as sub-pixel and sub-micron position resolution, while enjoying the advantages of the ONN hardware including radiation-hardness, low energy consumption and high computing speed for integrated edge camera and hardware deployment, when compared with electronic counterparts.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Approximate models for the study of exponential changed quantities: Application on the plasma waves growth rate or damping

Many physical phenomena that concern the research these days are basically complicated because of being multi-parametric. Thus, their study and understanding meets with big if not unsolved obstacles. Such complicated and multi-parametric is the plasmatic state as well, where the plasma and the physical quantities that appear along with it have chaotic behavior. Many of those physical quantities change exponentially and at most times they are stabilized by presenting wavy behavior. Mostly in the transitive state rather than the steady state, the exponentially changing quantities (Growth, Damping etc) depend on each other in most cases. Thus, it is difficult to distinguish the cause from the result. The present paper attempts to help this difficult study and understanding by proposing mathematical exponential models that could relate with the study and understanding of the plasmatic wavy instability behavior. Such instabilities are already detected, understood and presented in previous publications of our laboratory. In other words, our new contribution is the study of the already known plasmatic quantities by using mathematical models (modeling and simulation). These methods are both useful and applicable in the chaotic theory. In addition, our ambition is to also conduct a list of models useful for the study of chaotic problems, such as those that appear into the plasma, starting with this paper's examples.

36 MATERIALS SCIENCE↗