Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “recurrence”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 361 records · Page 20
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Use of Event-Time Embeddings via RNN to Discern Novel Event Sequences in EHRs

In highly configurable health information technology (HIT) systems, such as VistA of the Veterans Health Administration, the variations in how the system is used among different healthcare facilities and how the data are recorded can be significant. Despite the successful standardization of care efforts, some of these variations can be indicative of HIT hazards and demand further investigation. In this work, we implemented a recurrent neural network (RNN) architecture to learn clinical provider order sequences and their temporal dynamics while predicting the orders' terminal state. We demonstrate model performance and provide a use case for the model discerning novel event sequences. This model is proposed to find novel event sequences in an operational environment.

Ozmen, Ozgur↗
DOE OSTI2023

AI-Based EMT Dynamic Model of PV Systems

Several electromagnetic transient (EMT) dynamic modeling methods are available to model systems like photovoltaic (PV) plants, wind power plants, variable-speed drives, among others. The methods include: (a) physics-based models and (b) data-driven models. The physics-based dynamic models may include high-fidelity switched system model and average-value model that both require the control algorithms included in the models. However, manufacturers typically prefer to provide black-box models to avoid disclosing proprietary. One of the solutions to prevent disclosing control algorithms is the use of data-driven dynamic EMT models of PV systems. In this paper, data-driven dynamic EMT model based on artificial intelligence (AI) algorithms are presented. The AI algorithms evaluated include convolutional neural networks, recurrent neural networks, and nonlinear auto-regressive exogenous model. Automation in generating data and training these models is also discussed in this paper. The results generated by the best AI algorithms have been observed to be greater than 95 % accurate.

Debnath, Suman↗
DOE OSTI2024

ICED: An Integrated CGRA Framework Enabling DFVS-Aware Acceleration

oarse-grained reconfigurable arrays (CGRAs) are a promising solution to enable energy-efficient acceleration of applications from different domains. By leveraging reconfiguration at the functional level, they can adapt to significantly different computational patterns. Existing CGRA mapping approaches extract instruction-level parallelism, exploit loop-pipelining opportunities, guarantee the data dependency, and target high throughput of a given loop. However, the recurrence data-dependency in the DFG and the mismatch between required and available computing/communication resources complicate the mapping, and might lead to significant unbalances in the utilization of the CGRA's tiles. This results in wasted power for tiles with low utilization. Applying dynamic voltage and frequency scaling (DVFS) can potentially solve this challenge and improve energy efficiency by adjusting voltage and frequency of different tiles independently. CGRAs have also been successful in accelerating data-dependent streaming applications. However, in these applications, the execution time of each kernel in the pipeline might dynamically vary depending on the characteristics of the input. This also leads to under-utilization of resources for the dynamically changing kernels that do not limit the application throughput. DVFS can also improve energy efficiency for these applications by dynamically changing the voltage and frequency levels of tiles that host non performance-constraining kernels. This paper proposes ICEDTEA -- an integrated DVFS-aware framework to map applications on CGRAs that support power islands. ICEDTEA proposes a CGRA architecture supporting DVFS islands at varying granularity (from a single tile to a group of tiles) and the related DVFS-aware compilation and mapping toolchain. ICEDTEA is the first work that introduces DVFS support for spatio-temporal CGRAs at power-island levels. The experimental evaluation shows that ICEDTEA improves average utilization by 2.3$\times$ and energy-efficiency by 1.32$\times$ over a conventional CGRA. With streaming applications, ICEDTEA improves energy efficiency by 1.12$\times$ over a state-of-the-art CGRA that introduces partial dynamic reconfiguration to adapt to variations in kernels' throughput.

Tan, Cheng↗
DOE OSTI2023

Spatio-Temporal Deep Graph Network for Event Detection, Localization, and Classification in Cyber-Physical Electric Distribution System

This work proposes a deep graph learning framework to identify, locate, and classify power, cyber, and cyber power events at the distribution system level. The proposed algorithm jointly exploits spatial, temporal, and node-level cyber and physical data features. The developed graph neural network, together with a deep autoencoder, utilizes physical measurements from distribution level phasor measurement units and cyber data from communication network logs. The spatial structure of the synchrophasor measurements and network is incorporated through a weighted adjacency matrix. The temporal structure is incorporated by defining a spatial operation in the gated recurrent unit. This spatio-temporal learning element resides inside a power event detection, localization, and classification module that provides the degree of confidence for an event label. To accurately pinpoint the location of an event to the nearest bus equipped with a measurement unit, a combination of squared error and proximity score is utilized. Also included is a cyber event detection module that employs heteroskedasticity to analyze the significance of various cyber features during different types of attacks. Finally, a dual-bit cyber-power decision table determines the nature of the event. The proposed method is validated on two distribution systems modeled in OPAL-RT/Hypersim with limited phasor measurement units for different possible physical and cyber events. Further analyses include comparison with other state-of-the-art methods and validation in the presence of measurement noise. As a result, our method outperforms existing approaches and achieves an average detection accuracy of 97.97%, F1-score of 96.88%, precision of 96.53%, and recall of 98.57%.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2022

Traffic Signal Control With Adaptive Online-Learning Scheme Using Multiple-Model Neural Networks

This article proposes a new traffic signal control algorithm to deal with unknown-traffic-system uncertainties and reduce delays in vehicle travel time. Unknown-traffic-system dynamics are approximated using a recurrent neural network (NN). To accurately identify the traffic system model, an online-learning scheme is developed to switch among a set of candidate NNs (i.e., multiple-model NNs) based on their estimation errors. Then, a bank of optimal signal-timing controllers is designed based on the online identification of the traffic system. Simulation studies have been carried out for the obtained control strategies using multiple-model NNs, and the desired results have been obtained. Moreover, compared with the widely used actuated traffic signal control schemes, it is shown that the proposed method can reduce vehicle travel delays and improve traffic system robustness.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2020

The loss or absence of minimal residual disease of <0·1% at any time after two cycles of consolidation chemotherapy in CBFB–MYH11 ‐positive acute myeloid leukaemia indicates poor prognosis

Summary No consensus has been reached on the relationship between CBFB‐MYH11 copies and prognosis. Of 1525 acute myeloid leukemia (AML) patients, 58 with CBFB‐MYH11‐positive AML (16/58 patients with c‐kit mutation) were retrospectively analyzed with a median follow‐up duration of 29.8 (range: 4.8–74.4) months. Of these, 25/58 (43.1%) patients underwent allogeneic hematopoietic stem cell transplantation (allo‐HSCT), 10 of whom had the c‐kit mutation. Of the 33 patients who did not undergo allo‐HSCT, recurrence in patients with CBFB‐MYH11/ABL level >0.1% at any time after two consolidation cycles was significantly higher than in patients with CBFB‐MYH11/ABL level <0.1% (61.9% vs. 0%, P = 0.001); further, the 3‐year relapse‐free survival (RFS; 31.4% vs. 100%, P = 0.004) and event‐free survival (EFS; 33.1% vs. 100%, P = 0.004) were significantly decreased in patients with CBFB‐MYH11/ABL level >0.1% at any time after two consolidation cycles. The 3‐year RFS and EFS rates were lower in patients who did not receive allo‐HSCT than in those who did (31.4% vs 84.6%, P = 0.000; 31.4% vs. 80.8%, P = 0.001). CBFB‐MYH11‐positive AML patients with CBFB‐MYH11/ABL level >0.1% at any time after two cycles of consolidation had poor prognoses, and allo‐HSCT could improve their survival.

Duan, Wenbing↗
DOE OSTI2020

Using Machine Learning Tools to Predict Compressor Stall

Clean energy has become an increasingly important consideration in today’s power systems. As the push for clean energy continues, many coal-fired power plants are being decommissioned in favor of renewable power sources such as wind and solar. However, the intermittent nature of renewables means that dynamic load following traditional power systems is crucial to grid stability. With high flexibility and fast response at a wide range of operating conditions, gas turbine systems are poised to become the main load following component in the power grid. Yet, rapid changes in load can lead to fluid flow instabilities in gas turbine power systems. These instabilities often lead to compressor surge and stall, which are some of the most critical problems facing the safe and efficient operation of compressors in turbomachinery today. Although the topic of compressor surge and stall has been extensively researched, no methods for early prediction have been proven effective. This study explores the utilization of machine learning tools to predict compressor stall. The long short-term memory (LSTM) model, a form of recurrent neural network (RNN), was trained using real compressor stall datasets from a 100 kW recuperated gas turbine power system designed for hybrid configuration. Two variations of the LSTM model, classification and regression, were tested to determine optimal performance. The regression scheme was determined to be the most accurate approach, and a tool for predicting compressor stall was developed using this configuration. Overall, results show that the tool is capable of predicting stalls 5–20 ms before they occur. With a high-speed controller capable of 5 ms time-steps, mitigating action could be taken to prevent compressor stall before it occurs.

42 ENGINEERING↗
DOE OSTI2022

Neural Network-Based Electric Vehicle Range Prediction for Smart Charging Optimization

Range prediction is a standard feature in most modern road vehicles, allowing drivers to make informed decisions about when to refuel. Most vehicles make range predictions through data- or model-driven means, monitoring the average fuel consumption rate or using a tuned vehicle model to predict fuel consumption. The uncertainty of future driving conditions makes the range prediction problem challenging, particularly for less pervasive battery electric vehicles (BEV). Most contemporary machine learning-based methods attempt to forecast the battery SOC discharge profile to predict vehicle range. In this work, we propose a novel approach using two recurrent neural networks (RNNs) to predict the remaining range of BEVs and the minimum charge required to safely complete a trip. Each RNN has two outputs that can be used for statistical analysis to account for uncertainties; the first loss function leads to mean and variance estimation (MVE), while the second results in bounded interval estimation (BIE). These outputs of the proposed RNNs are then used to predict the probability of a vehicle completing a given trip without charging, or if charging is needed, the remaining range and minimum charging required to finish the trip with high probability. Training data was generated using a low-order physics model to estimate vehicle energy consumption from historical drive cycle data collected from medium-duty last-mile delivery vehicles. Here, the proposed method demonstrated high accuracy in the presence of day-to-day route variability, with the root-mean-square error (RMSE) below 6% for both RNN models.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2022

A New Evaluation Metric for Demand Response-Driven Real-Time Price Prediction Towards Sustainable Manufacturing

Abstract The increasing industry energy demand highlights the urgency of demand response management, while the emerging smart manufacturing technologies pave the way for the implementation of real-time price (RTP)-based demand response management towards sustainable manufacturing. The demand response management requires scheduling of manufacturing systems based on RTP predictions, and thus the prediction quality can directly alter the effectiveness of demand response. However, since the general price prediction algorithms and prediction evaluation metrics are not specifically designed for RTP in demand response problems, a good RTP prediction obtained and evaluated by these algorithms and metrics may not be suitable for demand response scheduling. Therefore, in this study, the relationships between the effectiveness of demand response for manufacturing systems and evaluation results from six commonly used metrics are investigated. Meanwhile, a new metric called k-peak distance (KPD), considering the characteristics of the demand response problem, is proposed and compared with the other six metrics. Furthermore, an encoder-decoder long short-term memory recurrent neural network with KPD is proposed to provide better RTP prediction for manufacturing demand response problems. The case studies indicate that the proposed KPD metric shows a 1.8–3.6 times higher correlation with the demand response effectiveness compared to the other metrics. In addition, the production schedule based on the RTP prediction obtained from the proposed algorithm can improve the effectiveness of demand response by 23.4% on average.

Engineering↗
DOE OSTI2025

Conformational ensembles reveal the origins of serine protease catalysis

Enzymes exist in ensembles of states that encode the energetics underlying their catalysis. Conformational ensembles built from 1231 structures of 17 serine proteases revealed atomic-level changes across their reaction states. By comparing the enzymatic and solution reaction, we identified molecular features that provide catalysis and quantified their energetic contributions to catalysis. Serine proteases precisely position their reactants in destabilized conformers, creating a downhill energetic gradient that selectively favors the motions required for reaction while limiting off-pathway conformational states. The same catalytic features have repeatedly evolved in proteases and additional enzymes across multiple distinct structural folds. In conclusion, our ensemble-function analyses revealed previously unknown catalytic features, provided quantitative models based on simple physical and chemical principles, and identified motifs recurrent in nature that may inspire enzyme design.

Du, Siyuan [Stanford Univ., CA (United States)] (O↗
DOE OSTI2022

Genome-Resolved Metagenomic Insights into Massive Seasonal Ammonia-Oxidizing Archaea Blooms in San Francisco Bay

Ammonia-oxidizing archaea (AOA) are key for the transformation of ammonia to oxidized forms of nitrogen in aquatic environments around the globe, including nutrient-rich coastal and estuarine waters such as San Francisco Bay (SFB). Using metagenomics and 16S rRNA gene amplicon libraries, we found that AOA are more abundant than ammonia-oxidizing bacteria (AOB) and nitrite-oxidizing bacteria (NOB), except in the freshwater stations in SFB. In South SFB, we observed recurrent AOA blooms of “Candidatus Nitrosomarinus catalina” SPOT01-like organisms, which account for over 20% of 16S rRNA gene amplicons in both surface and bottom waters and co-occur with weeks of high nitrite concentrations (>10 μM) in the oxic water column. We observed pronounced nitrite peaks occurring in the autumn for 7 of the last 9 years (2012 to 2020), suggesting that seasonal AOA blooms are common in South SFB. We recovered two high-quality AOA metagenome-assembled genomes (MAGs), including a Nitrosomarinus-like genome from the South SFB bloom and another Nitrosopumilus genome originating from Suisun Bay in North SFB. Both MAGs cluster with genomes from other estuarine/coastal sites. Analysis of Nitrosomarinus-like genomes show that they are streamlined, with low GC content and high coding density, and harbor urease genes. Our findings support the unique niche of Nitrosomarinus-like organisms which dominate coastal/estuarine waters and provide insights into recurring AOA blooms in SFB.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

Bacterial response to the 2021 Orange County, California, oil spill was episodic but subtle relative to natural fluctuations

ABSTRACT An oil spill began in October 2021 off the coast of Orange County, California, releasing 24,696 gallons of crude oil into coastal environments. Although oil spills, such as this one, are recurrent accidents along the California coast, no prior studies have been performed to examine the severity of the local bacterial response. A coastal 10-year time series of short-read metagenomes located within the impacted area allowed us to quantify the magnitude and duration of the disturbance relative to natural fluctuations. We found that the largest change in bacterial beta-diversity occurred at the end of October. The change in taxonomic beta-diversity corresponded with an increase in the sulfur-oxidizing clade Candidatus Thioglobus, an increase in the total relative abundance of potential hydrocarbon-degrading bacteria, and an anomalous decline in the picocyanobacteria Synechococcus . Similarly, changes in function were related to anomalous declines in photosynthetic pathways and anomalous increases in sulfur metabolism pathways as well as aromatic degradation pathways. There was a lagged response in taxonomy and function to peaks in total PAHs. One week after peaks in total PAH concentrations, the largest shifts in taxonomy were observed, and 1 week after the taxonomy shifts were observed, unique functional changes were seen. This response pattern was observed twice during our sampling period, corresponding with the combined effect of resuspended PAHs and increased nutrient concentrations due to physical transport events. Thus, the impact of the spill on bacterial communities was temporally extended and demonstrates the need for continued monitoring for longer than 3 months after initial oil exposure. IMPORTANCE Oil spills are common occurrences in waterways, releasing contaminants into the aquatic environment that persist for long periods of time. Bacterial communities are rapid responders to environmental disturbances, such as oil spills. Within bacterial communities, some members will be susceptible to the disturbance caused by crude oil components and will decline in abundance, whereas others will be opportunistic and will be able to use crude oil components for their metabolism. In many cases, when an oil spill occurs, it is difficult to assess the oil spill’s impact because no samples were collected prior to the accident. Here, we examined the bacterial response to the 2021 Orange County oil spill using a 10-year time series that lies within the impacted area. The results presented here are significant because (i) susceptible and opportunistic taxa to oil spills within the coastal California environment are identified and (ii) the magnitude and duration of the in situ bacterial response is quantified for the first time.

Brock, Melissa L. (ORCID:0000000340329241)↗
DOE OSTI2023

ATLAS flavour-tagging algorithms for the LHC Run 2 $pp$ collision dataset

The flavour-tagging algorithms developed by the ATLAS Collaboration and used to analyse its dataset of $\sqrt{s}$ = 13 TeV $pp$ collisions from Run 2 of the Large Hadron Collider are presented. These new tagging algorithms are based on recurrent and deep neural networks, and their performance is evaluated in simulated collision events. These developments yield considerable improvements over previous jet-flavour identification strategies. At the 77% $b$-jet identification efficiency operating point, light-jet (charm-jet) rejection factors of 170 (5) are achieved in a sample of simulated Standard Model $t\bar{t}$ events; similarly, at a $c$-jet identification efficiency of 30%, a light-jet ($b$-jet) rejection factor of 70 (9) is obtained.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2025

TorchBraid: High-Performance Layer-Parallel Training of Deep Neural Networks with MPI and GPU Acceleration

TorchBraid is a high-performance implementation of layer-parallel training for deep neural networks (DNNs) supporting MPI-based parallelism and GPU acceleration. Layer-parallel training has been developed to overcome the serialization inherent in forward and backward propagation of DNNs that limits utilization of computational resources in the strong scaling limit. To achieve this, TorchBraid integrates the PyTorch neural network framework with the state-of-the-art XBraid time-parallel library. Furthermore, this article presents the use and performance of TorchBraid, in addition to solutions for overcoming the algorithmic challenges inherent in combining automatic differentiation with layer-parallel. Results are presented with and without GPU acceleration for the Tiny ImageNet and MNIST image classification data sets, as well as recurrent neural networks. Overall, TorchBraid enables fast training of DNNs, both in a strong and weak scaling context. In addition to the TorchBraid software, several new advances in applying layer-parallel algorithms are detailed. Integration of layer-parallel with data-parallel algorithms is presented for the first time, showing the computational advantages of the combination. Standard deep learning techniques, like batch-normalization, are developed for layer-parallel training. Finally, a new approach combining layer-parallel with spatial coarsening in order to accelerate training for 3D image classification shows roughly a 10× speedup over serial execution.

Layer-parallel↗
DOE OSTI2024

AIRES-NODE

This software package performs time series forecasting for engineering systems using neural controlled differential equations. Neural controlled differential equations are continuous time analogues to recurrent neural networks. AIRES-NODE is particularly well suited for dynamic systems which are subject to external forcing terms and time-dependent boundary conditions. AIRES-NODE provides an encoder-decoder architecture which allows for variable-length forecasts to be made and is not limited to a fixed time step size when forecasting. Additionally, by utilizing a novel combination of a variational autoencoder and neural controlled differential equations, the AIRES-NODE package is capable of producing probabilistic future forecasts.

Gurecky, William [Oak Ridge National Laboratory (O↗
DOE OSTI2024

NuclPred v1

This tool takes a genome assembly as input and predicts per-site nucleosome occupancy as output. Trained on physical maps of nucleosome binding preferences across the fungal kingdom, NuclPred can be applied broadly across fungi (and other eukaryotes). This breadth, combined with its accuracy, means it could have both basic and applied biological implications, for example in understanding eukaryotic gene regulation and genetic engineering. Almost universally across eukaryotes, nucleosomes - each wrapping ~150 base pairs of DNA - serve to package DNA inside the nucleus, with major consequences on DNA access, gene activity and DNA integration. NuclPred was generated using a supervised deep learning approach combining convolutional and recurrent neural networks to take DNA features (nucleotides, GC content and structural information) as input, then use that information to predict the physical attractiveness DNA sequences might have for forming nucleosomes. With this information at hand, researchers can design more efficient CRISPR constructs, explore the interplay between DNA signatures and other regulators impact nucleosome locations, predict expression patterns, etc. This tool will be published as part of a manuscript currently under revision at iScience (draft attached).

Mondo, Stephen↗
DOE OSTI2022

BCL10 Mutations Define Distinct Dependencies Guiding Precision Therapy for DLBCL

Activated B cell–like diffuse large B-cell lymphomas (ABC-DLBCL) have unfavorable outcomes and chronic activation of CARD11–BCL10–MALT1 (CBM) signal amplification complexes that form due to polymerization of BCL10 subunits, which is affected by recurrent somatic mutations in ABC-DLBCLs. Herein, we show that BCL10 mutants fall into at least two functionally distinct classes: missense mutations of the BCL10 CARD domain and truncation of its C-terminal tail. Truncating mutations abrogated a motif through which MALT1 inhibits BCL10 polymerization, trapping MALT1 in its activated filament-bound state. CARD missense mutations enhanced BCL10 filament formation, forming glutamine network structures that stabilize BCL10 filaments. Mutant forms of BCL10 were less dependent on upstream CARD11 activation and thus manifested resistance to BTK inhibitors, whereas BCL10 truncating but not CARD mutants were hypersensitive to MALT1 inhibitors. Therefore, BCL10 mutations are potential biomarkers for BTK inhibitor resistance in ABC-DLBCL, and further precision can be achieved by selecting therapy based on specific biochemical effects of distinct mutation classes.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2024

Long-term Multimodal Recording Reveals Epigenetic Adaptation Routes in Dormant Breast Cancer Cells

Patients with estrogen receptor–positive breast cancer receive adjuvant endocrine therapies (ET) that delay relapse by targeting clinically undetectable micrometastatic deposits. Yet, up to 50% of patients relapse even decades after surgery through unknown mechanisms likely involving dormancy. To investigate genetic and transcriptional changes underlying tumor awakening, we analyzed late relapse patients and longitudinally profiled a rare cohort treated with long-term neoadjuvant ETs until progression. Next, we developed an in vitro evolutionary study to record the adaptive strategies of individual lineages in unperturbed parallel experiments. Our data demonstrate that ETs induce nongenetic cell state transitions into dormancy in a stochastic subset of cells via epigenetic reprogramming. Single lineages with divergent phenotypes awaken unpredictably in the absence of recurrent genetic alterations. Targeting the dormant epigenome shows promising activity against adapting cancer cells. Overall, this study uncovers the contribution of epigenetic adaptation to the evolution of resistance to ETs.

60 APPLIED LIFE SCIENCES↗