SEARCH · Engineering Papers
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Symbolic regression is the task of finding tractable mathematical expressions that best fit an input dataset. Deep symbolic regression (DSR) searches the space of tractable mathematical expressions by using a recurrent neural network that generates mathematical expressions. The network is trained using reinforcement learning.
The ability to embed molecules in a numeric space is essential in order to build mathematical and machine-learning models describing molecular properties or other processes affected by molecules. MACAW is a cheminformatic tool that allows embedding small molecules into a multidimensional numeric space. In the embedding, each molecule is assigned a numeric vector that captures information of the molecule in relation to other molecules, and that vector can be used as input to mathematical models. Molecules that are more similar to each other are embedded closer in this numeric space, whereas molecules that are more different are embedded further away. One advantage of the MACAW embedding technology compared to established alterantives is that it is fast and does not require extensive computational resources or expertise. In particular, MACAW embeddings can be used as input to mathematical models without the need for variable cleaning or feature selection, saving time and simplifying their use. On the other hand, MACAW also contains methods to generate new molecules and to recommend new molecules satisfying a desired molecular property. The generation of new molecules can be biased based on an input set of molecules, effectively generating molecular diversity around it. In its turn, MACAW's molecular recommendation tool is a novel method for evolving molecules in silico towards a desired molecular specification. In this method, the biased molecular generator tool is applied iteratively in combination with a molecular selection step. As a result, in each iteration the molecules selected by the software are increasingly closer to the desired specification. Both the molecular generation and the molecular recommendation tools are very fast, efficient, and intuitive to use.
C3PU sets up a model predictive control formulation for the optimal charging control of battery packs and can be deployed for real-time operation on an embedded microprocessor. C3PU uses electrochemical and thermal models of battery packs to predict the charging trajectories of the battery pack over a time horizon under different operating conditions. It then selects the optimal charging trajectory such that a pre-defined objective is minimized, which in the present state of the code is to minimize the charging duration of the battery pack. The optimal charging trajectory is obtained by solving an underlying mathematical problem. However, C3PU is flexible to incorporate other charging objectives. The underlying battery models can be swapped as well, as long as they follow certain mathematical properties. Mathematically, optimal control problems (in this case, optimally controlling the charging current of the battery pack) are computationally expensive. C3PU implements advanced numerical techniques, namely pseudo-spectral optimization, to reduce the computational burden of the underlying problem to solve. This allows for the problem to be solved in real-time in an embedded system. Once the optimal charging trajectory is computed over a time horizon, C3PU can package such data and send it out via appropriate communication protocols.
Abstract This paper presents a novel application of convolutional neural network (CNN) models for filtering the intraseasonal variability of the tropical atmosphere. In this deep learning filter, two convolutional layers are applied sequentially in a supervised machine learning framework to extract the intraseasonal signal from the total daily anomalies. The CNN-based filter can be tailored for each field similarly to fast Fourier transform filtering methods. When applied to two different fields (zonal wind stress and outgoing longwave radiation), the index of agreement between the filtered signal obtained using the CNN-based filter and a conventional weight-based filter is between 95% and 99%. The advantage of the CNN-based filter over the conventional filters is its applicability to time series with the length comparable to the period of the signal being extracted. Significance Statement This study proposes a new method for discovering hidden connections in data representative of tropical atmosphere variability. The method makes use of an artificial intelligence (AI) algorithm that combines a mathematical operation known as convolution with a mathematical model built to reflect the behavior of the human brain known as artificial neural network. Our results show that the filtered data produced by the AI-based method are consistent with the results obtained using conventional mathematical algorithms. The advantage of the AI-based method is that it can be applied to cases for which the conventional methods have limitations, such as forecast (hindcast) data or real-time monitoring of tropical variability in the 20–100-day range.
This research is motivated by the challenges faced during biomass processing in bioenergy plants. It has been observed that variations in biomass characteristics, such as moisture, ash, and carbohydrate contents cause variations in feeding of the system which led to underutilization of equipment and the reactor. The objective of this research is to ensure a continuous flow of biomass to the reactor in plants that use the biochemical conversion process to generate liquid fuels. The overall goal is to lower the cost of producing biofuels, which could lead to improving US’s energy independency and growing US’s rural economy. The research team developed analytical models, such as discrete element method (DEM) models and mathematical models. The DEM models are unit-level models that explicitly capture biomass characteristics and quantify the impacts of biomass characteristics on bulk material properties and the performance of specific equipment. The mathematical models are system-level models that capture the impacts of system infeed rate, equipment processing rate, storage location and capacity, and biomass characteristics on system throughput. The functional relations predicting the bulk material properties from DEM models are incorporated to the mathematical models. The models developed were validated and evaluated using data collected at Idaho National Laboratory’s biomass processing facility. Via these models, we identified process control strategies that ensure a continuous flow of biomass to the reactor, while meeting the requirements of biochemical conversion process. Our analysis indicates that sequencing of biomass bales based on moisture level, and carbohydrate contents could have a positive impact on reducing processing time and inventory level and increasing throughput rate. Short bale sequences that repeat frequently, seem to have the greatest impact on improving system’s performance. Based on our experiments, the total annual system operating costs reduced by 20-30%, and the maximum inventory level reduced by 3 to 4 times. The operating costs include the annual equipment amortization cost and processing cost. The implementation of the models developed requires the use of standardized bale format, Radio Frequency Identification technology, sensing and real time monitoring of material attributes, automated material handling equipment, and automated process control. The scope of the model proposed can be extended to include the whole supply chain. The supply chain models help identify how many bales of different biomass feedstock to purchase given biomass availability in the region, biomass price and quality, and the biomass processing capabilities of the biorefinery. Thus, the outcomes of supply chain models can be used to inform the design of long-term contracts among farmers and the biorefinery.
Cancer exhibits substantial heterogeneity, manifesting as distinct morphological and molecular variations across tumors, which frequently undermines the efficacy of conventional oncological treatments. Developments in multiomics and sequencing technologies have paved the way for unraveling this heterogeneity. Nevertheless, the complexity of the data gathered from these methods cannot be fully interpreted through multimodal data analysis alone. Mathematical modeling plays a crucial role in delineating the underlying mechanisms to explain sources of heterogeneity using patient-specific data. Intra-tumoral diversity necessitates the development of precision oncology therapies utilizing multiphysics, multiscale mathematical models for cancer. This review discusses recent advancements in computational methodologies for precision oncology, highlighting the potential of cancer digital twins to enhance patient-specific decision-making in clinical settings. We review computational efforts in building patient-informed cellular and tissue-level models for cancer and propose a computational framework that utilizes agent-based modeling as an effective conduit to integrate cancer systems models that encode signaling at the cellular scale with digital twin models that predict tissue-level response in a tumor microenvironment customized to patient information. Furthermore, we discuss machine learning approaches to building surrogates for these complex mathematical models. These surrogates can potentially be used to conduct sensitivity analysis, verification, validation, and uncertainty quantification, which is especially important for tumor studies due to their dynamic nature.
Adaptive and self-optimizing intelligent systems such as digital twins are increasingly important in science and engineering. Digital twins utilize mathematical models to provide added precision to decision-making. However, physics-informed models are challenging to build, calibrate, and validate with existing data science methods. Model-based design of experiments (MBDoE) is a popular framework for optimizing data collection to maximize parameter precision in mathematical models and digital twins. In this work, we apply MBDoE, facilitated by the open-source package Pyomo.DoE, to train and validate mathematical models for batch crystallization. We quantitatively examined the estimability of the model parameters for experiments with different cooling rates. This analysis provides a quantitative explanation for the heuristic of using multiple experiments at different cooling rates.
As data structures and mathematical objects used for complex systems modeling, hypergraphs sit nicely poised between on the one hand the world of network models, and on the other that of higher-order mathematical abstractions from algebra, lattice theory, and topology. They are able to represent complex systems interactions more faithfully than graphs and networks, while also being some of the simplest classes of systems representing topological structures as collections of multidimensional objects connected in a particular pattern. In this paper we discuss the role of (undirected) hypergraphs in the science of complex networks, and provide a mathematical overview of the core concepts needed for hypernetwork modeling, including duality and the relationship to bicolored graphs, quantitative adjacency and incidence, the nature of walks in hypergraphs, and available topological relationships and properties. We close with a brief discussion of two example applications: biomedical databases for disease analysis, and domain-name system (DNS) analysis of cyber data.
Network intrusion detection systems (NIDS) are commonly used to detect malware communications, including command-and-control (C2) traffic from botnets. NIDS performance assessments have been studied for decades, but mathematical modeling has rarely been used to explore NIDS performance. This paper details a mathematical model that describes a NIDS performing packet inspection and its detection of malware's C2 traffic. Here, the paper further describes an emulation testbed and a set of cyber experiments that used the testbed to validate the model. These experiments included a commonly used NIDS (Snort) and traffic with contents from a pervasive malware (Emotet). Results are presented for two scenarios: a nominal scenario and a “stressed” scenario in which the NIDS cannot process all incoming packets. Model and experiment results match well, with model estimates mostly falling within 95 % confidence intervals on the experiment means. Model results were produced 70-3000 times faster than the experimental results. Consequently, the model's predictive capability could potentially be used to support decisions about NIDS configuration and effectiveness that require high confidence results, quantification of uncertainty, and exploration of large parameter spaces. Furthermore, the experiments provide an example for how emulation testbeds can be used to validate cyber models that include stochastic variability.
Compartmental ordinary differential equation (ODE) models are used extensively in mathematical biology. When transit between compartments occurs at a constant rate, the well-known linear chain trick can be used to show that the ODE model is equivalent to an Erlang distributed delay differential equation (DDE). Here, we demonstrate that compartmental models with nonlinear transit rates and possibly delayed arguments are also equivalent to a scalar distributed DDE. To illustrate the utility of these equivalences, we calculate the equilibria of the scalar DDE, and compute the characteristic function---without calculating a determinant. Further, we derive the equivalent scalar DDE for two examples of models in mathematical biology and use the DDE formulation to identify physiological processes that were otherwise hidden by the compartmental structure of the ODE model.
Mathematical modelling has successfully been used to provide quantitative descriptions of many viral infections, but for the Ebola virus, which requires biosafety level 4 facilities for experimentation, modelling can play a crucial role. Ebola virus modelling efforts have primarily focused on in vivo virus kinetics, e.g., in animal models, to aid the development of antivirals and vaccines. But, thus far, these studies have not yielded a detailed specification of the infection cycle, which could provide a foundational description of the virus kinetics and thus a deeper understanding of their clinical manifestation. Here, we obtain a diverse experimental data set of the Ebola virus infection in vitro, and then make use of Bayesian inference methods to fully identify parameters in a mathematical model of the infection. Our results provide insights into the distribution of time an infected cell spends in the eclipse phase (the period between infection and the start of virus production), as well as the rate at which infectious virions lose infectivity. We suggest how these results can be used in future models to describe co-infection with defective interfering particles, which are an emerging alternative therapeutic.
Mathematical models are a core component in the foundation of cancer theory and have been developed as clinical tools in precision medicine. Modeling studies for clinical applications often assume an individual’s characteristics can be represented as parameters in a model and are used to explain, predict, and optimize treatment outcomes. However, this approach relies on the identifiability of the underlying mathematical models. In this study, we build on the framework of an observing-system simulation experiment to study the identifiability of several models of cancer growth, focusing on the prognostic parameters of each model. Our results demonstrate that the frequency of data collection, the types of data, such as cancer proxy, and the accuracy of measurements all play crucial roles in determining the identifiability of the model. We also found that highly accurate data can allow for reasonably accurate estimates of some parameters, which may be the key to achieving model identifiability in practice. As more complex models required more data for identification, our results support the idea of using models with a clear mechanism that tracks disease progression in clinical settings. For such a model, the subset of model parameters associated with disease progression naturally minimizes the required data for model identifiability.
Cyber-physical systems (CPS) are engineered systems that rely on the smooth integration of computational algorithms and physical elements. This integration presents new challenges for verifying that systems will behave as expected. The goal of this presentation is to present current challenges and potential solutions for the formal verification of cyber-physical systems. For cyber systems, formal methods refer to systematically rigorous mathematical techniques employed in the specification, development, analysis, and verification of both software and hardware systems. Recent advancements in computer science have yielded sophisticated tools specifically designed to address challenges associated with formal methods in complex systems. These tools leverage various foundational concepts such as logic, formal languages, program semantics, type systems, type theory, and automata theory. A notable achievement in the application of formal methods is the seL4 microkernel, claimed to be the first general-purpose operating-system kernel to be verified. Its proof implies the absence of bugs and guarantees that the kernel meets specifications. For physical systems, dynamic and control theory has a history of using rigorous analytic techniques to prove functional correctness. Lyapunov, optimal, classical, modern, and robust control theories all provide rigorous mathematical methods both to analyze system performance and to design controller that can be guaranteed to meet certain objectives. Recent computational techniques like level set theory and reachability analysis provide assertions that a system's state will avoid unsafe regions. Even though success has been independently achieved for cyber systems and physical systems, the integration of such systems creates new challenges. In particular, there is an obvious discrepancy between finite-state machines and infinite-state systems, resulting in different approaches for modeling and analyzing these system. While it is possible to simulate hybrid systems, this provides only a demonstration of a performance and not proof. For hybrid systems, current formal methods and system analysis approaches typically require a workarounds to work on hybrid systems like CPS. This paper will outline the state of the art and limits of current practice for formally verifying CPS and will identify possible research directions that require attention.
We illustrate a technique to calculate the gradient of scalar functions that are defined on any arbitrary matrix subspace. It generalizes our earlier work titled “What is the gradient of a scalar function of a symmetric matrix ?”(Indian Journal of Pure and Applied Mathematics (2022), https://doi.org/10.1007/s13226-022-00313-x), in which we considered the special case of the subspace of symmetric matrices. Extant methods to calculate the gradient in such cases have an inherent flaw which leads to spurious results that populate several publications, as well as respected textbooks and handbooks on matrix calculus. Here, we examine these sources and results in a rigorous and concrete mathematical setting of a finite-dimensional inner-product space and discover the inherent flaw and also a remedy. We demonstrate two ways to calculate the derivative/gradient and second derivative for scalar functions of matrices defined over an arbitrary matrix subspace; the first method is by considering any (differentiable) extension to the space of square matrices and projection of its gradient onto the given subspace. The second method utilizes an ordered basis and computes each component of the gradient through evaluation of the directional derivative. All the ideas presented are illustrated by non-trivial examples, namely, considering the subspace of 3 x 3 circulant and Toeplitz matrices and presenting the results of gradient-descent with both the spurious and correct gradients. Moreover, our bibliography makes it clear that a rigorous approach to matrix calculus is not common in practice, and our presentation of matrix calculus in the language of inner-product spaces will be significant and meaningful for applied mathematicians, engineers and researchers working in inter-disciplinary fields to avoid the conceptual pitfalls that exist.
Abstract The u -plane integral is the contribution of the Coulomb branch to correlation functions of $${\mathcal {N}}=2$$ N = 2 gauge theory on a compact four-manifold. We consider the u -plane integral for correlators of point and surface observables of topologically twisted theories with gauge group $$\mathrm{SU}(2)$$ SU ( 2 ) , for an arbitrary four-manifold with $$(b_1,b_2^+)=(0,1)$$ ( b 1 , b 2 + ) = ( 0 , 1 ) . The u -plane contribution equals the full correlator in the absence of Seiberg–Witten contributions at strong coupling, and coincides with the mathematically defined Donaldson invariants in such cases. We demonstrate that the u -plane correlators are efficiently determined using mock modular forms for point observables, and Appell–Lerch sums for surface observables. We use these results to discuss the asymptotic behavior of correlators as function of the number of observables. Our findings suggest that the vev of exponentiated point and surface observables is an entire function of the fugacities.
The phase field method is playing an increasingly important role in understanding and predicting morphological evolution in materials and biological systems. Here, in this study, we develop a new analytical approach based on the bifurcation analysis to explore the mathematical solution structure of phase field models. Revealing such solution structures not only is of great mathematical interest but also may provide guidance to experimentally or computationally uncover new morphological evolution phenomena in materials undergoing electronic and structural phase transitions. To elucidate the idea, we apply this analytical approach to three representative phase field equations: the Allen-Cahn equation, the Cahn-Hilliard equation, and the Allen-Cahn-Ohta-Kawasaki system. The solution structures of these three phase field equations are also verified numerically by the homotopy continuation method.
Here, we present PyOECP, a Python-based flexible open-source software for estimating and modeling the complex permittivity obtained from the open-ended coaxial probe (OECP) technique. The transformation of the measured reflection coefficient to complex permittivity is performed based on three different methods. The software library contains the dielectric spectra of common reference liquids, which can be used to transform the reflection coefficient into the dielectric spectra. Several Python routines that are commonly employed (e.g., SciPy and NumPy) in the field of science and engineering are required only so that the users can alter the software structure depending on their needs. The modeling algorithm exploits the Markov Chain Monte Carlo method for the data regression. The discrete relaxation models can be built by a proper combination of well-known relaxation models. In addition to these models, electrode polarization, a typical measurement artifact for interpreting dielectric spectra, can be incorporated into the modeling algorithm. A continuous relaxation model, which solves the Fredholm integral equation of the first kind (a mathematically ill-posed problem), is also included. This open-source software enables users to freely adjust the physical parameters to obtain physical insight into their materials under test and will be consistently updated for more accurate measurement and interpretation of dielectric spectra in an automated manner. This work describes the theoretical and mathematical background of the software, lays out the workflow, and validates the software functionality based on both synthetic and empirical data included in the software.
An analytical model using Green’s functions for partial external heating of a pipe is developed, which results in an exact mathematical solution for the radial and axial temperature distribution in the pipe wall. Partial heating consists of a constant heat flux function imposed over a small section of the exterior of a pipe and for a limited time duration. The solution comprises steady-state and transient parts, and an algebraic identity is used to decrease the number of summation terms in the slowly-converging steady- state part. Intrinsic verification principles are used to verify the solution. As an example application, this transient solution is applied toward the development of a simple, noninvasive method for in-field measurement of the flow rate in pipes. Furthermore, to simulate this application, a pulse of energy is imposed to the wall of the pipe, and the developed mathematical solution is used to find the flow rate of the fluid inside the pipe. An optimal experiment is designed to find the best measurement location and time.