Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Design pattern”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Cancer Incidence Trends in Successive Social Generations in the US

Importance: The incidence of some cancers in the US is increasing in younger age groups, but underlying trends in cancer patterns by birth year remain unclear. Objective: To estimate cancer incidence trends in successive social generations. Design, Setting, and Participants: In this cohort study, incident invasive cancers were ascertained from the Surveillance, Epidemiology, and End Results (SEER) program’s 13-registry database (November 2020 submission, accessed August 14, 2023). Invasive cancers diagnosed at ages 35 to 84 years during 1992 to 2018 within 152 strata were defined by cancer site, sex, and race and ethnicity. Exposure: Invasive cancer. Main Outcome and Measures: Stratum-specific semiparametric age-period-cohort (SAGE) models were fitted and incidence per 100 000 person-years at the reference age of 60 years was calculated for single-year birth cohorts from 1908 through 1983 (fitted cohort patterns [FCPs]). The FCPs and FCP incidence rate ratios (IRRs) were compared by site for Generation X (born between 1965 and 1980) and Baby Boomers (born between 1946 and 1964). Results: A total of 3.8 million individuals with invasive cancer (51.0% male; 8.6% Asian or Pacific Islander, 9.5% Hispanic, 10.4% non-Hispanic Black, and 71.5% non-Hispanic White) were included in the analysis. In Generation X vs Baby Boomers, FCP IRRs among women increased significantly for thyroid (2.76; 95% CI, 2.41-3.15), kidney (1.99; 95% CI, 1.70-2.32), rectal (1.84; 95% CI, 1.52-2.22), corpus uterine (1.75; 95% CI, 1.40-2.18), colon (1.56; 95% CI, 1.27-1.92), and pancreatic (1.39; 95% CI, 1.07-1.80) cancers; non-Hodgkins lymphoma (1.40; 95% CI, 1.08-1.82); and leukemia (1.27; 95% CI, 1.03-1.58). Among men, IRRs increased for thyroid (2.16; 95% CI, 1.87-2.50), kidney (2.14; 95% CI, 1.86-2.46), rectal (1.80; 95% CI, 1.52-2.12), colon (1.60; 95% CI, 1.32-1.94), and prostate (1.25; 95% CI, 1.03-1.52) cancers and leukemia (1.34; 95% CI, 1.08-1.66). Lung (IRR, 0.60; 95% CI, 0.50-0.72) and cervical (IRR, 0.71; 95% CI, 0.57-0.89) cancer incidence decreased among women, and lung (IRR, 0.51; 95% CI, 0.43-0.60), liver (IRR, 0.76; 95% CI, 0.63-0.91), and gallbladder (IRR, 0.85; 95% CI, 0.72-1.00) cancer and non-Hodgkins lymphoma (IRR, 0.75; 95% CI, 0.61-0.93) incidence decreased among men. For all cancers combined, FCPs were higher in Generation X than for Baby Boomers because gaining cancers numerically overtook falling cancers in all groups except Asian or Pacific Islander men. Conclusions and Relevance: In this model-based cohort analysis of incident invasive cancer in the general population, decreases in lung and cervical cancers in Generation X may be offset by gains at other sites. Generation X may be experiencing larger per-capita increases in the incidence of leading cancers than any prior generation born in 1908 through 1964. On current trajectories, cancer incidence could remain high for decades.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2025

Material Fracturing and Failure Simulation Datasets

Fracturing is a fundamental physics phenomena with broad relevance across multiple domains, ranging from infrastructure integrity, aerospace durability, reservoir production, and seismic events. We present a diverse dataset of simulated fracture evolution and material failure generated from two numerical solvers: the phase-field method and the combined finite-discrete element method (FDEM). These solvers differ in formulation, physical fidelity, and computational efficiency. The dataset includes five materials: PBX, anisotropic shale, tungsten, aluminum, and steel. For each, phase-field simulations span 400,000 cases: 200,000 under uniaxial tension and 200,000 under biaxial tension. The computationally expensive FDEM simulations include 90,000 split evenly among PBX, shale, and tungsten under uniaxial loading. All simulations begin with randomized initial fracture patterns. Each entry includes temporal data capturing fracture propagation dynamics. This comprehensive dataset is designed to support the development of foundational or surrogate machine learning approaches for predicting material failure. While no such models are introduced here, the dataset lays a robust foundation for advancing future research and innovation in these areas.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Unraveling complex causal processes that affect sustainability requires more integration between empirical and modeling approaches

Scientists seek to understand the causal processes that generate sustainability problems and determine effective solutions. Yet, causal inquiry in nature–society systems is hampered by conceptual and methodological challenges that arise from nature–society interdependencies and the complex dynamics they create. Here, we demonstrate how sustainability scientists can address these challenges and make more robust causal claims through better integration between empirical analyses and process- or agent-based modeling. To illustrate how these different epistemological traditions can be integrated, we present four studies of air pollution regulation, natural resource management, and the spread of COVID-19. The studies show how integration can improve empirical estimates of causal effects, inform future research designs and data collection, enhance understanding of the complex dynamics that underlie observed temporal patterns, and elucidate causal mechanisms and the contexts in which they operate. These advances in causal understanding can help sustainability scientists develop better theories of phenomena where social and ecological processes are dynamically intertwined and prior causal knowledge and data are limited. The improved causal understanding also enhances governance by helping scientists and practitioners choose among potential interventions, decide when and how the timing of an intervention matters, and anticipate unexpected outcomes. Methodological integration, however, requires skills and efforts of all involved to learn how members of the respective other tradition think and analyze nature–society systems.

42 ENGINEERING↗
DOE OSTI2021

The ATLAS Fast TracKer system

The ATLAS Fast TracKer (FTK) was designed to provide full tracking for the ATLAS high-level trigger by using pattern recognition based on Associative Memory (AM) chips and fitting in high-speed field programmable gate arrays. The tracks found by the FTK are based on inputs from all modules of the pixel and silicon microstrip trackers. The as-built FTK system and components are described, as is the online software used to control them while running in the ATLAS data acquisition system. Also described is the simulation of the FTK hardware and the optimization of the AM pattern banks. An optimization for long-lived particles with large impact parameter values is included. A test of the FTK system with the data playback facility that allowed the FTK to be commissioned during the shutdown between Run 2 and Run 3 of the LHC is reported. The resulting tracks from part of the FTK system covering a limited $\eta$-$\phi$ region of the detector are compared with the output from the FTK simulation. It is shown that FTK performance is in good agreement with the simulation.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2023

Plasmon-enhanced optical nonlinearity in graphene nanomeshes

Using the density-matrix formalism, here we show that graphene nanomeshes (GNMs)—graphene sheets patterned with antidots—have large plasmon-enhanced nonlinear optical response. GNMs can be designed to behave as quasi-one-dimensional plasmonic crystals in which plasmons with large propagation lengths are efficiently excited. The associated third-order Kerr and third-harmonic-generation susceptibility can be as high as 10 –7 and 10 –9 m 2 V –2 , respectively, over the mid-to-near-infrared frequency range. Furthermore, carrier-density tuning in GNMs can flip the propagation direction of plasmonic waves and enables bidirectional switching of optical signals.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2021

A capillary-based microfluidic device enables primary high-throughput room-temperature crystallographic screening

A novel capillary-based microfluidic strategy to accelerate the process of small-molecule-compound screening by room-temperature X-ray crystallography using protein crystals is reported. The ultra-thin microfluidic devices are composed of a UV-curable polymer, patterned by cleanroom photolithography, and have nine capillary channels per chip. The chip was designed for ease of sample manipulation, sample stability and minimal X-ray background. 3D-printed frames and cassettes conforming to SBS standards are used to house the capillary chips, providing additional mechanical stability and compatibility with automated liquid- and sample-handling robotics. These devices enable an innovative in situ crystal-soaking screening workflow, akin to high-throughput compound screening, such that quantitative electron density maps sufficient to determine weak binding events are efficiently obtained. This work paves the way for adopting a room-temperature microfluidics-based sample delivery method at synchrotron sources to facilitate high-throughput protein-crystallography-based screening of compounds at high concentration with the aim of discovering novel binding events in an automated manner.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

Spaced Orthocyclic Winding Pattern for Improved Die Compressed Coils

Winding fill, coil fill, or packing factor, is critical to the performance of many types of electromagnetic devices from electric machines to actuators, transformers, inductors, etc. One technique to increase the packing of conductors in the winding area is to compress round magnet wire conductors in a die, so that they deform and air voids between coil turns are removed. The winding layout of the coil turns on a bobbin before compression has a direct impact on the achievable coil fill and the damage to the coil insulation or conductors after compression. It is thought that winding the turns in an orthocyclic pattern on the bobbin before compression would minimize damage to the turns. This however causes turns to displace during the winding compression process. A new pre-compression winding pattern is proposed, a spaced orthocyclic winding, to minimize turn displacement and damage. A design of experiments study has been carried out to optimize this winding method and to compare it to the traditional orthocyclic winding.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2026

Integrated System Planning: Emerging Software Requirements in the Power Industry

Power system planning software remains fragmented across organizational boundaries, with specialized tools for capacity expansion, production cost modeling, power flow, and dynamic analysis operating on incompatible data models and assumptions. This article argues that the fragmentation is not merely a technical problem but a predictable consequence of Conway's law: software architectures mirror the departmental structures within which they are developed. Regulatory milestones like Federal Energy Regulatory Commission (FERC) Order 888 formalized these divisions, but the roots trace back to the distinct engineering disciplines-mechanical, chemical, and electrical-that staffed generation and transmission planning departments in vertically integrated utilities. As the industry moves toward integrated system planning (ISP) that coordinates generation, transmission, and distribution investment decisions, the software ecosystem must evolve accordingly. We identify five categories of software requirements to enable this transition: coherent data inputs decoupled from individual applications, unified and extensible data schemas, modular component representations that support multiple abstraction levels, lifecycle management of planning datasets, and well-defined application programming interface (API) contracts that separate data exchange from algorithmic control. We examine how these requirements interact with three common workflow patterns-serial gate clearing, sequential multiapplication, and convergence oriented-and discuss the interface design principles each demands. We then outline a vision for platform-based planning architectures where specialized analytical services compose through standardized interfaces and where artificial intelligence (AI)/machine learning (ML) tools augment decision support within a disciplined software infrastructure. The practices proposed here offer a path from today's siloed tool collections toward collaborative planning ecosystems capable of handling the complexity of modern power system transformation.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2022

GSoFa: Scalable Sparse Symbolic LU Factorization on GPUs

Decomposing a matrix $\mathbf {A}$ into a lower matrix $\mathbf {L}$ and an upper matrix $\mathbf {U}$, which is also known as LU decomposition, is an essential operation in numerical linear algebra. For a sparse matrix, LU decomposition often introduces more nonzero entries in the $\mathbf {L}$ and $\mathbf {U}$ factors than in the original matrix. A symbolic factorization step is needed to identify the nonzero structures of $\mathbf {L}$ and $\mathbf {U}$ matrices. Attracted by the enormous potentials of the Graphics Processing Units (GPUs), an array of efforts have surged to deploy various LU factorization steps except for the symbolic factorization, to the best of our knowledge, on GPUs. This article introduces gSoFa, the first GPU-based symbolic factorization design with the following three optimizations to enable scalable LU symbolic factorization for nonsymmetric pattern sparse matrices on GPUs. First, here we introduce a novel fine-grained parallel symbolic factorization algorithm that is well suited for the Single Instruction Multiple Thread (SIMT) architecture of GPUs. Second, we tailor supernode detection into a SIMT friendly process and strive to balance the workload, minimize the communication and saturate the GPU computing resources during supernode detection. Third, we introduce a three-pronged optimization to reduce the excessive space consumption problem faced by multi-source concurrent symbolic factorization. Taken together, gSoFa achieves up to 31× speedup from 1 to 44 Summit nodes (6 to 264 GPUs) and outperforms the state-of-the-art CPU project, on average, by 5×. Notably, gSoFa also achieves up to 47 percent of the peak memory throughput of a V100 GPU in the Summit Supercomputer.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Neural Networks to Find the Optimal Forcing for Offsetting the Anthropogenic Climate Change Effects

Abstract Of great relevance to climate engineering is the systematic relationship between the radiative forcing to the climate system and the response of the system, a relationship often represented by the linear response function (LRF) of the system. However, estimating the LRF often becomes an ill-posed inverse problem due to high-dimensionality and nonunique relationships between the forcing and response. Recent advances in machine learning make it possible to address the ill-posed inverse problem through regularization and sparse system fitting. Here, we develop a convolutional neural network (CNN) for regularized inversion. The CNN is trained using the surface temperature responses from a set of Green’s function perturbation experiments as imagery input data together with data sample densification. The resulting CNN model can infer the forcing pattern responsible for the temperature response from out-of-sample forcing scenarios. This promising proof of concept suggests a possible strategy for estimating the optimal forcing to negate certain undesirable effects of climate change. The limited success of this effort underscores the challenges of solving an inverse problem for a climate system with inherent nonlinearity. Significance Statement Predicting the climate response for a given climate forcing is a direct problem, while inferring the forcing for a given desired climate response is often an inverse, ill-posed, problem, posing a new challenge to the climate community. This study makes the first attempt to infer the radiative forcing for a given target pattern of global surface temperature response using a deep learning approach. The resulting deeply trained convolutional neural network inversion model shows promise in capturing the forcing pattern corresponding to a given surface temperature response, with a significant implication on the design of an optimal solar radiation management strategy for curbing global warming. This study also highlights the technical challenges that future research should prioritize in seeking feasible solutions to the inverse climate problem.

Ren, Huiying↗
DOE OSTI2021

SMC 2021 : Analyzing Resource Utilization and User Behavior on Titan Supercomputer

Resource utilization statistics of submitted jobs on a supercomputer can help us understand how users from various scientific domains use HPC platforms and better design a job scheduler. We explore to generate insight regarding workload distribution and usage pattern domains from job scheduler trace, GPU failure information, and project-specific information collected from Titan supercomputer. Furthermore, we want to know how the scheduler performance varies over time and how the users' scheduling behavior changes following a system failure. These observations have the potential to provide valuable insight, which is helpful to prepare for system failures. These practices will help us develop and apply novel machine learning algorithms in understanding system behavior, requirement, and better scheduling of HPC systems. There are two datasets, RUR and GPU. RUR: This dataset is the job scheduler traces collected from the Titan supercomputerfrom 01/01/2015 to 07/31/2019 (2015.csv - 2019.csv). These were collected usingResource Utilization Report (RUR), a Cray-developed resource-usage data collectionand reporting system. It contains the usage information of its critical resources (CPU,Memory, GPU, and I/O) of each running job on Titan during that period [2]. ProjectAreas: Every job is associated with a project ID. TheProjectAreas.csvdatasetprovides a mapping of the project ID to its domain science. GPU: There have been some hardware-related issues in the GPUs in Titan that caused some GPUs to fail, sometimes irrecoverably during some job runs. This dataset provides information regarding these failures during the execution of the submitted jobs. GPUs on Titan are uniquely identified by a serial number (SN), and they are installed in a location. A GPU can be installed in a location, then removed from that location following a failure, and then re-installed in a different location after fixing the problem. If the failure can't be recovered, the GPU might be removed entirely from Titan. There are two prominent types of failures that resulted in the removal of GPUs from Titan: Double Bit Error (DBE) and Out of the Bus (OTB). The dataset (gc_full.csv) has the following fields: 1. SN : Serial number of a GPU 2. location : The location where it is installed 3. insert : The time when it was inserted into that location 4. remove : The time when it was removed from that location 5. duration : Amount of time the GPU spent in this location 6. out : If the device was taken out entirely w/o a re-installment into a new location. 7. event : If the GPU was taken out entirely, the reason for its removal. To learn more about this dataset, please refer to the git repositoryhttps://github.com/olcf/TitanGPULifeand the related publication [1]. References [1] George Ostrouchov, Don Maxwell, Rizwan A Ashraf, Christian Engelmann, MallikarjunShankar, and James H Rogers. Gpu lifetimes on titan supercomputer: Survival analysisand reliability. InSC20: International Conference for High Performance Computing,Networking, Storage and Analysis, pages 1-14. IEEE, 2020. [2] Feiyi Wang, Sarp Oral, Satyabrata Sen, and Neena Imam. Learning from five-yearresource-utilization data of titan system. In2019 IEEE International Conference onCluster Computing (CLUSTER), pages 1-6. IEEE, 2019.

42 ENGINEERING↗
DOE OSTI2021

SMC 2021 Data Challenge: Analyzing Resource Utilization and User Behavior on Titan Supercomputer

Resource utilization statistics of submitted jobs on a supercomputer can help us understand how users from various scientific domains use HPC platforms and better design a job scheduler. We explore to generate insight regarding workload distribution and usage pattern domains from job scheduler trace, GPU failure information, and project-specific information collected from Titan supercomputer. Furthermore, we want to know how the scheduler performance varies over time and how the users' scheduling behavior changes following a system failure. These observations have the potential to provide valuable insight, which is helpful to prepare for system failures. These practices will help us develop and apply novel machine learning algorithms in understanding system behavior, requirement, and better scheduling of HPC systems. There are two datasets, RUR and GPU: RUR dataset is the job scheduler traces collected from the Titan supercomputer from 01/01/2015 to 07/31/2019 (2015.csv - 2019.csv). These were collected using resource Utilization Report (RUR), a Cray-developed resource-usage data collection and reporting system. It contains the usage information of its critical resources (CPU, Memory, GPU, and I/O) of each running job on Titan during that period (https://ieeexplore.ieee.org/abstract/document/8891001). It includes ProjectAreas as additional information, every job is associated with a project ID. TheProjectAreas.csv dataset provides a mapping of the project ID to its domain science. GPU dataset has information regarding GPU failure on Titan. There have been some hardware-related issues in the GPUs in Titan that caused some GPUs to fail, sometimes irrecoverably during some job runs. This dataset provides information regarding these failures during the execution of the submitted jobs. GPUs on Titan are uniquely identified by a serial number (SN), and they are installed in a location. A GPU can be installed in a location, then removed from that location following a failure, and then re-installed in a different location after fixing the problem. If the failure can't be recovered, the GPU might be removed entirely from Titan. There are two prominent types of failures that resulted in the removal of GPUs from Titan: Double Bit Error (DBE) and Out of the Bus (OTB). The dataset (gc_full.csv) has seven attributes, we provided a short description of these attributes in the ReadMe file. To learn more about this dataset, please refer to the git repository https://github.com/olcf/TitanGPULife and the related publication (https://ieeexplore.ieee.org/abstract/document/9355319).

42 ENGINEERING↗
DOE OSTI2024

Investigating the relationship between microbial network features of giant kelp “seedbank” cultures and subsequent farm performance

Microbial inoculants can increase the yield of cultivated crops and are successful in independent trials; however, efficacy drops in large-scale applications due to insufficient consideration of microbial community dynamics. The structure of microbiomes, in addition to the impact of individual taxa, is an important factor to consider when designing growth-promoting inoculants. Here, we investigate the microbial network and community assembly patterns of Macrocystis pyrifera gametophyte germplasm cultures (collectively referred to as a “seedbank”) used to cultivate an offshore farm in Santa Barbara, California, and identify network features associated with increased biomass of mature sporophytes. We found that [1] several network features, such as clustering coefficient and edge ratios, significantly vary with biomass outcomes; [2] gametophytes that become low- or high-biomass sporophytes have different hub taxa; and [3] microbial community assembly of gametophyte germplasm cultures is niche-driven. Overall, this study describes microbial community dynamics in M . pyrifera germplasm cultures and ultimately supports the development of early life stage inoculants that can be used on seaweed cultivars to increase biomass yield.

Osborne, Melisa G. (ORCID:0000000154980057)↗
DOE OSTI2022

Design and construction of a quantum matter synthesizer

The quantum matter synthesizer (QMS) is a new quantum simulation platform in which individual particles in a lattice can be resolved and re-arranged into arbitrary patterns. The ability to spatially manipulate ultracold atoms and control their tunneling and interactions at the single-particle level allows full control of a many-body quantum system. We present the design and characterization of the QMS, which integrates into a single ultra-stable apparatus a two-dimensional optical lattice, a moving optical tweezer array formed by a digital micromirror device, and site-resolved atomic imaging. We demonstrate excellent mechanical stability between the lattice and tweezer array with relative fluctuations below 10 nm, diffraction-limited imaging at a resolution of 655 nm, and high-speed real-time control of the tweezer array at a 2.52 kHz refresh rate, which will be adopted to realize fast rearrangement of atoms. The QMS also features new technologies and schemes, such as nanotextured anti-reflective windows and all-optical long-distance transport of atoms.

47 OTHER INSTRUMENTATION↗
DOE OSTI2022

Validation of Manufacturing Process Designs for Stamped Microchannel Recuperators

Microchannel recuperators can achieve high-efficiency power cycles and chemical reactions by recovering waste heat from hot turbine exhaust and chemical reaction streams. However, the industrial application of microchannel recuperators are restricted by the high cost of patterning and bonding. The objective of this study was thus to investigate new methods for producing microchannel recuperators for emerging markets. Based on greenfield cost estimates, process designs based on stamping, laser welding and vacuum brazing of 316L stainless steel laminae were found to be more economical than conventional photochemical machining and diffusion bonding. Subsequently, validation experiments were conducted to produce stamped microchannel components using cost model parameters. At a mass flow rate of 0.99 g/s, the test article made with laser welding was found to provide higher effectiveness than the test article produced using vacuum brazing. Preliminary investigations showed that residual stresses during laser welding of the laminae led to significant warpage, collapsing channels and making lamina-to-lamina fit up challenging. In contrast, the test article produced by vacuum brazing of stamped laminae showed no clogging and 4.6% and 10.5% channel height standard deviation for the cold and hot channels, respectively. Channel variation in the vacuum brazing sample was determined to be caused by misregistration of laminae during brazing. In future work, efforts are needed to choose cheaper, more ductile brazing foils as well as design a brazing fixture to improve lamina-to-lamina registration.

42 ENGINEERING↗
DOE OSTI2021

Sculpting the Plasmonic Responses of Nanoparticles by Directed Electron Beam Irradiation

Spatial confinement of matter in functional nanostructures has propelled these systems to the forefront of nanoscience, both as a playground for exotic physics and quantum phenomena and in multiple applications including plasmonics, optoelectronics, and sensing. In parallel, the emergence of monochromated electron energy loss spectroscopy (EELS) has enabled exploration of local nanoplasmonic functionalities within single nanoparticles and the collective response of nanoparticle assemblies, providing deep insight into associated mechanisms. However, modern synthesis processes for plasmonic nanostructures are often limited in the types of accessible geometry, and materials and are limited to spatial precisions on the order of tens of nm, precluding the direct exploration of critical aspects of the structure-property relationships. Here, the atomic-sized probe of the scanning transmission electron microscope is used to perform precise sculpting and design nanoparticle configurations. Using low-loss EELS, dynamic analyses of the evolution of the plasmonic response are provided. It is shown that within self-assembled systems of nanoparticles, individual nanoparticles can be selectively removed, reshaped, or patterned with nanometer-level resolution, effectively modifying the plasmonic response in both space and energy. This process significantly increases the scope for design possibilities and presents opportunities for unique structure development, which are ultimately the key for nanophotonic design.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2020

DEEP CELLULAR RECURRENT NEURAL ARCHITECTURE FOR EFFICIENT MULTIDIMENSIONAL TIME-SERIES DATA PROCESSING

Efficient processing of time series data is a fundamental yet challenging problem in pattern recognition. Though recent developments in machine learning and deep learning have enabled remarkable improvements in processing large scale datasets in many application domains, most are designed and regulated to handle inputs that are static in time. Many real-world data, such as in biomedical, surveillance and security, financial, manufacturing and engineering applications, are rarely static in time, and demand models able to recognize patterns in both space and time. Current machine learning (ML) and deep learning (DL) models adapted for time series processing tend to grow in complexity and size to accommodate the additional dimensionality of time. Specifically, the biologically inspired learning based models known as artificial neural networks that have shown extraordinary success in pattern recognition, tend to grow prohibitively large and cumbersome in the presence of large scale multi-dimensional time series biomedical data such as EEG. Consequently, this work aims to develop representative ML and DL models for robust and efficient large scale time series processing. First, we design a novel ML pipeline with efficient feature engineering to process a large scale multi-channel scalp EEG dataset for automated detection of epileptic seizures. With the use of a sophisticated yet computationally efficient time-frequency analysis technique known as harmonic wavelet packet transform and an efficient self-similarity computation based on fractal dimension, we achieve state-of-the-art performance for automated seizure detection in EEG data. Subsequently, we investigate the development of a novel efficient deep recurrent learning model for large scale time series processing. For this, we first study the functionality and training of a biologically inspired neural network architecture known as cellular simultaneous recurrent neural network (CSRN). We obtain a generalization of this network for multiple topological image processing tasks and investigate the learning efficacy of the complex cellular architecture using several state-of-the?art training methods. Finally, we develop a novel deep cellular recurrent neural network (CDRNN) architecture based on the biologically inspired distributed processing used in CSRN for processing time series data. The proposed DCRNN leverages the cellular recurrent architecture to promote extensive weight sharing and efficient, individualized, synchronous processing of multi-source time series data. Experiments on a large scale multi-channel scalp EEG, and a machine fault detection dataset show that the proposed DCRNN offers state-of-the-art recognition performance while using substantially fewer trainable recurrent units.

Vidyaratne, Lasitha S.↗
DOE OSTI2021

Design of a Robust Memristive Spiking Neuromorphic System with Unsupervised Learning in Hardware

Spiking neural networks (SNN) offer a power efficient, biologically plausible learning paradigm by encoding information into spikes. The discovery of the memristor has accelerated the progress of spiking neuromorphic systems, as the intrinsic plasticity of the device makes it an ideal candidate to mimic a biological synapse. Despite providing a nanoscale form factor, non-volatility, and low-power operation, memristors suffer from device-level non-idealities, which impact system-level performance. To address these issues, this article presents a memristive crossbar-based neuromorphic system using unsupervised learning with twin-memristor synapses, fully digital pulse width modulated spike-timing-dependent plasticity, and homeostasis neurons. Additionally, the implemented single-layer SNN was applied to a pattern-recognition task of classifying handwritten-digits. The performance of the system was analyzed by varying design parameters such as number of training epochs, neurons, and capacitors. Furthermore, the impact of memristor device non-idealities, such as device-switching mismatch, aging, failure, and process variations, were investigated and the resilience of the proposed system was demonstrated.

97 MATHEMATICS AND COMPUTING↗