Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “recurrence”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 451 records · Page 25

Predicting Adverse Events and their Precursors in Aviation Using Multi-Class Multiple-Instance Learning

In recent years, there has been a rapid growth in the application of machine learning techniques that leverage aviation data collected from commercial airline operations to improve safety. Anomaly detection and predictive maintenance have been the main targets for machine learning applications. However, this paper focuses on the identification of precursors, which is a relatively newer application. Precursors are events correlated with adverse events that happen prior to the adverse event itself. Therefore, precursor mining provides many benefits including understanding the reasons behind a safety incident and the ability to identify signatures, which can be tracked throughout a flight to alert the operators of an potential upcoming adverse event. This work proposes using the multiple-instance learning (MIL) framework, a weakly supervised learning task, combined with a carefully designed Multi-Head Convolutional Neural Networks-Recurrent Neural Networks (MHCNN-RNN) architecture to predict different type of adverse events for any given flights and identify their precursors with little to no post-processing.Results obtained show that the MHCNN-RNN is able to accurately forecast high speed and high path angle events during the approach, and that it is also capable of determining the aircraft’s parameters that are correlated to these events. These parameters can be considered precursors to the events.

multiple instance learning↗

DroughtCast: A Machine Learning Forecast of the United States Drought Monitor

Drought is one of the most ecologically and economically devastating natural phenomena affecting the United States, causing the U.S. economy billions of dollars in damage, and driving widespread degradation of ecosystem health. Many drought indices are implemented to monitor the current extent and status of drought so stakeholders such as farmers and local governments can appropriately respond. Methods toforecast drought conditions weeks to months in advance are less common but would provide a more effective early warning system to enhance drought response, mitigation, and adaptation planning. To resolve this issue, we introduce DroughtCast, a machine learning framework for forecasting the United States Drought Monitor (USDM). DroughtCast operates on the knowledge that recent anomalies in hydrology and meteorology drive future changes in drought conditions. We use simulated meteorology and satellite observed soil moisture as inputs into a recurrent neural network to accurately forecast the USDM between 1 and 12 weeks into the future. Our analysis shows that precipitation, soil moisture, and temperature are the most important input variables when forecasting future drought conditions. Additionally, a case study of the 2017 Northern Plains Flash Drought shows that DroughtCast was able to forecast a very extreme drought event up to 12 weeks before its onset. Given the favorable forecasting skill of the model, DroughtCast may provide a promising tool for land managers and local governments in preparing for and mitigating the effects of drought.

Machine Learning↗

Amino Acid Encoding for Deep Learning Applications

Background: The number of applications of deep learning algorithms in bioinformatics is increasing as they usually achieve superior performance over classical approaches, especially, when bigger training datasets are available. In deep learning applications, discrete data, e.g. words or n-grams in language, or amino acids or nucleotides in bioinformatics, are generally represented as a continuous vector through an embedding matrix. Recently, learning this embedding matrix directly from the data as part of the continuous iteration of the model to optimize the target prediction – a process called ‘end-to-end learning’ – has led to state-of-the-art results in many fields. Although usage of embeddings is well described in the bioinformatics literature, the potential of end-to-end learning for single amino acids, as compared to more classical manually-curated encoding strategies, has not been systematically addressed. To this end, we compared classical encoding matrices, namely one-hot, VHSE8 and BLOSUM62, to end-to-end learning of amino acid embeddings for two different prediction tasks using three widely used architectures, namely recurrent neural networks (RNN), convolutional neural networks (CNN), and the hybrid CNN-RNN. Results: By using different deep learning architectures, we show that end-to-end learning is on par with classical encodings for embeddings of the same dimension even when limited training data is available, and might allow for a reduction in the embedding dimension without performance loss, which is critical when deploying the models to devices with limited computational capacities. We found that the embedding dimension is a major factor in controlling the model performance. Surprisingly, we observed that deep learning models are capable of learning from random vectors of appropriate dimension. Conclusion: Our study shows that end-to-end learning is a flexible and powerful method for amino acid encoding. Further, due to the flexibility of deep learning systems, amino acid encoding schemes should be benchmarked against random vectors of the same dimension to disentangle the information content provided by the encoding scheme from the distinguishability effect provided by the scheme.

Deep-learning↗

Tumor Microenvironment Targeting Nano–Bio Emulsion for Synergistic Combinational X-Ray PDT with Oncolytic Bacteria Therapy

Various cancer therapies have been developed, but tumor recurrence with incomplete tumor killing and remaining tumor cells/tissues is frequent in monotherapies. Herein, a nano–bio therapeutic emulsion formulated with multifunctional nanoscintillators and anaerobic Clostridium novyi-NT spores for synergistic image-guided combinational cancer therapy is reported. MRI visible nanoscintillators (NSs) are synthesized with a NaGdF 4 :Tb,Ce@NaGdF 4 core/shell structure for an image-guided X-ray photodynamic therapy (PDT) of the normoxic peripheral tumor. An anaerobic oncolytic bacterium (C. novyi-NT) therapy is combined to treat the hypoxic central tumor tissues. Photosensitizer-coated NSs (PS-NSs) and C. novyi-NT spores are emulsified with clinically available ethiodized oil (Lipiodol) to be the nano–bio therapeutic emulsion and injected into the tumor with computed tomography image guidance. The distribution of nano–bio therapeutic emulsion, including PS-NSs and anaerobic C. novyi-NT spores in the tumor site, is confirmed by both X-ray and T1-weighted magnetic resonance imaging. Following the image-guided X-ray PDT and anaerobic C. novyi- NT combination treatment, apoptotic cell death in cancer tissues, including both peripheral and central tumor regions, is significantly higher than in the control groups. Finally, this combination therapy approach using a nano–bio therapeutic emulsion is expected to overcome the limitations of conventional cancer therapy, resulting in increased cancer-therapeutic efficacy.

60 APPLIED LIFE SCIENCES↗

Machine‐learning‐based construction of barrier functions and models for safe model predictive control

Abstract In this paper, we propose a control Lyapunov‐barrier function‐based model predictive control method utilizing a feed‐forward neural network specified control barrier function (CBF) and a recurrent neural network (RNN) predictive model to stabilize nonlinear processes with input constraints, and to guarantee that safety requirements are met for all times. The nonlinear system is first modeled using RNN techniques, and a CBF is characterized by constructing a feed‐forward neural network (FNN) model with unique structures and properties. The FNN model for the CBF is trained based on data samples collected from safe and unsafe operating regions, and the resulting FNN model is verified to demonstrate that the safety properties of the CBF are satisfied. Given sufficiently small bounded modeling errors for both the FNN and the RNN models, the proposed control system is able to guarantee closed‐loop stability while preventing the closed‐loop states from entering unsafe regions in state‐space under sample‐and‐hold control action implementation. We provide the theoretical analysis for bounded unsafe sets in state‐space, and demonstrate the effectiveness of the proposed control strategy using a nonlinear chemical process example with a bounded unsafe region.

Chen, Scarlett↗

Deep generative models for vehicle speed trajectories

Generating realistic vehicle speed trajectories is a crucial component in evaluating vehicle fuel economy and in predictive control of self-driving cars. Traditional generative models rely on Markov chain methods and can produce accurate synthetic trajectories but are subject to the curse of dimensionality. They do not allow to include conditional input variables into the generation process. In this paper, we show how extensions to deep generative models allow accurate and scalable generation. Proposed architectures involve recurrent and feed-forward layers and are trained using adversarial techniques. Our models are shown to perform well on generating vehicle trajectories using a model trained on GPS data from Chicago metropolitan area.

33 ADVANCED PROPULSION SYSTEMS↗

Development of a prediction model for radiotherapy response among patients with head and neck squamous cell carcinoma based on the tumor immune microenvironment and hypoxia signature

Abstract Introduction The immune system and hypoxia are major factors influencing radiosensitivity in patients with different cancer types. This study aimed at developing a model to predict radiotherapy response in patients with head and neck squamous cell carcinoma (HNSCC) based on the tumor immune microenvironment and hypoxia signature. Materials and Methods We first evaluated the hypoxia status and tumor immune microenvironment in the Cancer Genome Atlas (TCGA) cohort by using transcriptomic data. Differentially expressed genes (DEGs) were identified between the “high immunity and low hypoxia” and “low immunity and high hypoxia” groups and those DEGs significantly associated with disease‐specific survival in the univariate Cox regression analysis were selected as the prognostic DEGs. We selected the immune hypoxia–related genes (IHRGs) by intersecting prognostic DEGs with immune and hypoxia gene sets. We used the IHRGs to train a multivariate Cox regression model in the TCGA cohort, based on which we calculated the IHRG prognostic index (IHRGPI) for each patient and validated its efficacy in predicting radiotherapy response in the Gene Expression Omnibus cohorts. Furthermore, we explored potential mechanisms and effective combinational treatment strategies for different IHRGPI groups. Results Five IHRGs were used to construct the IHRGPI, which was used to dichotomize the cohorts. The patients with lower IHRGPI showed a better radiotherapy response across different cohorts and endpoints, including overall survival, progression‐free survival, and recurrence‐free survival ( p < 0.05). Patients with higher IHRGPI showed greater hypoxia and lesser immune cell infiltration. A lower IHRGPI indicated a better immunotherapy response, while a higher IHRGPI indicated a better chemotherapy response. Conclusions IHRGPI is promising for predicting radiotherapy response and guiding combinational treatment strategies in patients with HNSCC.

Zhu, Guang‐Li↗

Reliable machine prognostic health management in the presence of missing data

Prognostics and health management enables the prediction of future degradation and remaining useful life (RUL) for in-service systems based on historical and contemporary data, showing promise for many practical applications. One major challenge for prognostics is the common occurrence of missing values in time-series data, often caused by disruptions in sensor communication or hardware/software failures. Another major concern is that the sufficient prior knowledge of critical component degradation with a clear failure threshold is often not readily available in practice. These issues can significantly hinder the application of advanced signal and data analysis methods and consequently degrade the health management performance. In this article, we propose a novel data-driven framework that is capable of providing accurate and reliable predictions of degradation and RUL. In this approach, one-hot health state indicators are appended to the historical time series so that the model learns end-of-life automatically. A modified gate recurrent unit based variational autoencoder is employed in generative adversarial networks to model the temporal irregularity of the incomplete time series. Furthermore, experiments on multivariate time-series datasets collected from real-world aeroengines verify that significant performance improvement can be achieved using the proposed model for robust long-term prognostics.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

Implementation of AI/DEEP learning disruption predictor into a plasma control system

Abstract This paper reports on advances in the state‐of‐the‐art deep learning disruption prediction models based on the Fusion Recurrent Neural Network (FRNN) originally introduced in a 2019 NATURE publication [ https://doi.org/10.1038/s41586‐019‐1116‐4 ]. In particular, the predictor now features not only the “disruption score,” as an indicator of the probability of an imminent disruption, but also a “sensitivity score” in real time to indicate the underlying reasons for the imminent disruption. This adds valuable physics interpretability for the deep learning model and can provide helpful guidance for control actuators now implemented into a modern plasma control system (PCS). The advance is a significant step forward in moving from modern deep learning disruption prediction to real‐time control and brings novel AI‐enabled capabilities relevant for application to the future burning plasma ITER system. Our analyses use large amounts of data from JET and DIII‐D vetted in the earlier NATURE publication. In addition to “when” a shot is predicted to disrupt, this paper addresses reasons “why” by carrying out sensitivity studies. FRNN is accordingly extended to use more channels of information, including measured DIII‐D signals such as (i) the “n1rms” signal that is correlated with the n = 1 modes with finite frequency, including neoclassical tearing mode and sawtooth dynamics; (ii) the bolometer data indicative of plasma impurity control; and (iii) “q‐min”—the minimum value of the safety factor relevant to the key physics of kink modes. The additional channels and interpretability features expand the ability of the deep learning FRNN software to provide information about disruption subcategories as well as more precise and direct guidance for the actuators in a PCS.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Modeling interval trendlines: Symbolic singular spectrum analysis for interval time series

Abstract In this article we propose an extension of singular spectrum analysis for interval‐valued time series. The proposed methods can be used to decompose and forecast the dynamics governing a set‐valued stochastic process. The resulting components on which the interval time series is decomposed can be understood as interval trendlines, cycles, or noise. Forecasting can be conducted through a linear recurrent method, and we devised generalizations of the decomposition method for the multivariate setting. The performance of the proposed methods is showcased in a simulation study. We apply the proposed methods so to track the dynamics governing the Argentina Stock Market (MERVAL) in real time, in a case study over a period of turbulence that led to discussions of the government of Argentina with the International Monetary Fund.

de Carvalho, Miguel↗

Incorporating the Role(s) of Human Actors in Complex System Design for Safety and Security

Traditional systems engineering demonstrates the importance of customer needs in scoping and defining design requirements; yet, in practice, other human stakeholders are often absent from early lifecycle phases. Human factors are often omitted in practice when evaluating and down-selecting design options due to constraints such as time, money, access to user populations, or difficulty in proving system robustness through the inclusion of human behaviors. Advances in systems engineering increasingly include non-technical influences into the design, deployment, operations, and maintenance of interacting components to achieve common performance objectives. Furthermore, such advances highlight the need to better account for the various roles of human actors to achieve desired performance outcomes in complex systems. Many of these efforts seek to infuse lessons and concepts from human factors (enhanced decision-making through Crew Resource Management), systems safety (Rasmussen's “drift toward danger”) and organization science (Giddens' recurrent human acts leading to emergent behaviors) into systems engineering to better understand how socio-technical interactions impact emergent system performance. Safety and security are examples of complex system performance outcomes that are directly impacted by varying roles of human actors. Using security performance of high consequence facilities as a representative use case, this article will outline the System Context Lenses to understand how to include various roles of human actors into systems engineering design. Several exemplar applications of this organizing lenses will be summarized and used to highlight more generalized insights for the broader systems engineering community.

42 ENGINEERING↗

Registration of the sorghum carbon–partitioning nested association mapping (CP–NAM) population

The sorghum [ Sorghum bicolor (L.) Moench] carbon-partitioning nested association mapping (CP_NAM) (Reg. no. MP-4, NSL 542189 MAP) population was developed at Clemson University, SC, using 11 diverse, male founder accessions, each crossed with a recurrent female parent ‘Grassl’. The male parents represent all five major botanical races and the four major agronomic types: cellulosic (5), sweet (3), grain (2) and forage (1). A set of 11 recombinant inbred line (RIL) families CP_NAM01 to CP_NAM011 were maintained, which consisted of 2,484 (F 6 ) individuals. Each RIL family contained a minimum of 193 individuals (CP_NAM01) and a maximum of 287 individuals (CP_NAM06). For the development of this population, the founder lines were judiciously selected from the sorghum Bioenergy Association Panel based on carbon-partitioning phenotypes that make this population an ideal genetic resource for dissecting a wide range of agronomic and compositional traits for basic and applied research. The founder accessions of the CP_NAM were phenotypically characterized for various traits, including agronomic, biomass and related components, and additional compositional components. Each of the 11 F 6 RIL families of the CP_NAM were genotyped using genotyping-by-sequencing analysis, and 144,087 single nucleotide polymorphisms were generated for each individual. Genotypic information along with phenotypic data were used for the characterization of this population and to explore the range of phenotypes that permits the understanding of carbon-partitioning dynamics. This population is a unique resource for researchers to study a wide range of contrasting carbon-partitioning characteristics in sorghum to understand the genetic architecture underlying whole-plant carbon partitioning and allocation.

59 BASIC BIOLOGICAL SCIENCES↗

Convergent behavior of extended stalk regions from staphylococcal surface proteins with widely divergent sequence patterns

Staphylococcus epidermidis and Staphylococcus aureus are highly problematic bacteria in hospital settings. A major challenge is their ability to form biofilms on abiotic or biotic surfaces. Biofilms are well-organized, multicellular bacterial aggregates that resist antibiotic treatment and often lead to recurrent infections. Bacterial cell wall-anchored (CWA) proteins are important players in biofilm formation and infection. Many have putative stalk-like regions or regions of low complexity near the cell wall-anchoring motif. Recent work demonstrated the strong propensity of the stalk region of S. epidermidis accumulation-associated protein (Aap) to remain highly extended under solution conditions that typically induce compaction. This behavior is consistent with the expected function of a stalk-like region that is covalently attached to the cell wall peptidoglycan and projects the adhesive domains of Aap away from the cell surface. In this study, we evaluate whether the ability to resist compaction is a common theme among stalk regions from various staphylococcal CWA proteins. Circular dichroism spectroscopy was used to examine secondary structure changes as a function of temperature and cosolvents along with sedimentation velocity analytical ultracentrifugation, size-exclusion chromatography, and SAXS to characterize structural characteristics in solution. All stalk regions tested are intrinsically disordered, lacking secondary structure beyond random coil and polyproline type II helix, and they all sample highly extended conformations. Remarkably, the Ser-Asp dipeptide repeat region of SdrC exhibited nearly identical behavior in solution when compared to the Aap Pro/Gly-rich region, despite highly divergent sequence patterns, indicating conservation of function by various distinct staphylococcal CWA protein stalk regions.

59 BASIC BIOLOGICAL SCIENCES↗

The S-matrix of 2D type 0B string theory. Part I. Perturbation theory revisited

We study the perturbative S-matrix of closed strings in the two-dimensional type 0B string theory from the worldsheet perspective, by directly integrating correlation functions of N = 1 Liouville theory. The latter is computed numerically using recurrence relations for super-Virasoro conformal blocks. We show that the tree level 3- and 4-point amplitudes are in agreement with the proposed dual matrix quantum mechanics. The non-perturbative aspects of the duality will be analyzed in a companion paper.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Quantile regression-enriched event modeling framework for dropout analysis in high-temperature superconductor manufacturing

High-temperature superconductor (HTS) tapes have shown promising characteristics of high critical current, which are prerequisites for applications in high-field magnets. Due to the unstable growth conditions in the HTS manufacturing process, however, the frequent occurrences of dropouts in the critical current impede the consistent performance of HTS tapes. To manufacture HTS tapes with large scale, high yield, and uniform performance, it is essential to develop novel data analysis approaches for modeling the dropouts and identifying the related important process parameters. Conventional methods for modeling recurrent events, such as the point process, require the extraction of events from quality measurements. As the critical current is a continuous process, it may not comprehensively represent the drop patterns by transforming the time-series measurements into a set of events. Here, to solve this issue, we develop a novel quantile regression-enriched event modeling (QREM) framework that integrates the non-homogeneous Poisson process for modeling the occurrence of dropouts and the quantile regression for capturing the drop patterns. By incorporating the feature selection and regularization, the proposed framework identifies a set of significant process parameters that can potentially cause the dropouts of HTS tapes. The proposed method is tested on real HTS tapes produced using an advanced manufacturing process, successfully identifying important parameters that influence dropout events including the substrate temperature and voltage. The results demonstrate that the proposed QREM method outperforms the standard point process in predicting the occurrence of dropouts.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

A cluster of results on amplituhedron tiles

Abstract The amplituhedron is a mathematical object which was introduced to provide a geometric origin of scattering amplitudes in $$\mathcal {N}=4$$ N = 4 super Yang–Mills theory. It generalizes cyclic polytopes and the positive Grassmannian and has a very rich combinatorics with connections to cluster algebras. In this article, we provide a series of results about tiles and tilings of the $$m=4$$ m = 4 amplituhedron. Firstly, we provide a full characterization of facets of BCFW tiles in terms of cluster variables for $$\text{ Gr}_{4,n}$$ Gr 4 , n . Secondly, we exhibit a tiling of the $$m=4$$ m = 4 amplituhedron which involves a tile which does not come from the BCFW recurrence—the spurion tile, which also satisfies all cluster properties. Finally, strengthening the connection with cluster algebras, we show that each standard BCFW tile is the positive part of a cluster variety, which allows us to compute the canonical form of each such tile explicitly in terms of cluster variables for $$\text{ Gr}_{4,n}$$ Gr 4 , n . This paper is a companion to our previous paper “Cluster algebras and tilings for the $$m=4$$ m = 4 amplituhedron.”

Physics↗

Real-time biomass feedstock particle quality detection using image analysis and machine vision

Abstract A common and costly challenge in the nascent biorefinery industry is the consistent handling and conveyance of biomass feedstock materials, which can vary widely in their chemical, physical, and mechanical properties. Solutions to cope with varying feedstock qualities will be required, including advanced process controls to adjust equipment and reject feedstocks that do not meet a quality standard. In this work, we present and evaluate methods to autonomously assess corn stover feedstock quality in real time and provide data to process controls with low-cost camera hardware. We explore the use of neural networks to classify feedstocks based on actual processing behavior and pixel matrix feature parameterization to further assess particle attributes that may explain the variable processing behavior. We used the pretrained ResNet neural network coupled with a gated recurrent unit (GRU) time-series classifier trained on our image data, resulting in binary classification of feedstock anomalies with favorable performance. The textural aspects of the image data were statistically analyzed to determine if the textural features were predictive of operational disruptions. The significant textural features were angular second moment, prominence, mean height of surface profile, mean resultant vector, shade, skewness, variation of the polar facet orientation, and direction of azimuthal facets. Expansion of these models is recommended across a wider variety of labeled feedstock images of different qualities and species to develop a more robust tool that may be deployed using low-cost cameras within biorefineries.

09 BIOMASS FUELS↗

Robust deep learning framework for constitutive relations modeling

Modeling the full-range deformation behaviors of materials under complex loading and materials conditions is a significant challenge for constitutive relations (CRs) modeling. Here, we propose a general encoder-decoder deep learning framework that can model high-dimensional stress-strain data and complex loading histories with robustness and universal capability. The framework employs an encoder to project high-dimensional input information (e.g., loading history, loading conditions, and materials information) to a lower-dimensional hidden space and a decoder to map the hidden representation to the stress of interest. We evaluated various encoder architectures, including gated recurrent unit (GRU), GRU with attention, temporal convolutional network (TCN), and the Transformer encoder, on two complex stress-strain datasets that were designed to include a wide range of complex loading histories and loading conditions. All architectures achieved excellent test results with an root-mean-square error (RMSE) below 1 MPa. Additionally, we analyzed the capability of the different architectures to make predictions on out-of-domain applications, with an uncertainty estimation based on deep ensembles. The proposed approach provides a robust alternative to empirical/semi-empirical models for CRs modeling, offering the potential for more accurate and efficient materials design and optimization.

36 MATERIALS SCIENCE↗