Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Deep Direct Use”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 361 records · Page 20

EHR-BERT: A BERT-based model for effective anomaly detection in electronic health records

Objective: Physicians and clinicians rely on data contained in electronic health records (EHRs), as recorded by health information technology (HIT), to make informed decisions about their patients. The reliability of HIT systems in this regard is critical to patient safety. Consequently, better tools are needed to monitor the performance of HIT systems for potential hazards that could compromise the collected EHRs, which in turn could affect patient safety. In this paper, we propose a new framework for detecting anomalies in EHRs using sequence of clinical events. This new framework, EHR-Bidirectional Encoder Representations from Transformers (BERT), is motivated by the gaps in the existing deep-learning related methods, including high false negatives, sub-optimal accuracy, higher computational cost, and the risk of information loss. EHR-BERT is an innovative framework rooted in the BERT architecture, meticulously tailored to navigate the hurdles in the contemporary BERT method; thus, enhancing anomaly detection in EHRs for healthcare applications.Methods: The EHR-BERT framework was designed using the Sequential Masked Token Prediction (SMTP) method. This approach treats EHRs as natural language sentences and iteratively masks input tokens during both training and prediction stages. This method facilitates the learning of EHR sequence patterns in both directions for each event and identifies anomalies based on deviations from the normal execution models trained on EHR sequences.Results: Extensive experiments on large EHR datasets across various medical domains demonstrate that EHR-BERT markedly improves upon existing models. It significantly reduces the number of false positives and enhances the detection rate, thus bolstering the reliability of anomaly detection in electronic health records. This improvement is attributed to the model’s ability to minimize information loss and maximize data utilization effectively.Conclusion: EHR-BERT showcases immense potential in decreasing medical errors related to anomalous clinical events, positioning itself as an indispensable asset for enhancing patient safety and the overall standard of healthcare services. The framework effectively overcomes the drawbacks of earlier models, making it a promising solution for healthcare professionals to ensure the reliability and quality of health data.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

FeederGAN: Synthetic Feeder Generation via Deep Graph Adversarial Nets

This paper presents a novel, automated, generative adversarial networks (GAN) based synthetic feeder generation mechanism, abbreviated as FeederGAN. FeederGAN digests real feeder models represented by directed graphs via a deep learning framework powered by GAN and graph convolutional networks (GCN). Information of a distribution feeder circuit is extracted from its model input files so that the device connectivity is mapped onto the adjacency matrix and the device characteristics, such as circuit types (i.e., 3-phase, 2-phase, and 1-phase) and component attributes (e.g., length and current ratings), are mapped onto the attribute matrix. Then, Wasserstein distance is used to optimize the GAN and GCN is used to discriminate the generated graphs from the actual ones. A greedy method based on graph theory is developed to reconstruct the feeder using the generated adjacency and attribute matrices. Furthermore, our results show that the GAN generated feeders resemble the actual feeder in both topology and attributes verified by visual inspection and by empirical statistics obtained from actual distribution feeders.

42 ENGINEERING↗

Tigers at a crossroads: Shedding light on the role of Bangladesh in the illegal trade of this iconic big cat

Abstract Unsustainable wildlife trade is a major threat to many species, but quantifying trade remains challenging, as seizure data provides an incomplete understanding. For this reason, integrating multiple types of information, including interviews with actors involved in trade, is crucial if we are to understand the problem better. Hence, in this study, we digitized Bangladesh Forest Department tiger seizure records to identify trade routes and interviewed 163 individuals involved in trafficking tigers through Bangladesh's air, sea and land ports, including poachers, smugglers, and traders. We identified six ports used to import tigers, 14 ports used for tiger export and three ports showing bi‐directional trade. Elite Bangladeshis were the most important consumer group, and tigers were sourced from populations in NE India, Myanmar and Bangladesh Sundarbans to supply domestic demand. Tiger products were exported to 14 countries, including seven G20 nations, with Bangladeshi expatriates as the consumer group in three countries (United Kingdom, Germany and Qatar). Rising economic development in Bangladesh over the last decade, combined with deep‐rooted cultural ties to tiger consumption, has led to a rise in domestic demand. Additionally, rapid growth in international transport links has increased smuggling and connected local traders with global markets, increasing the complexity of global trade. These findings suggest Bangladesh is poised to play a pivotal role in tiger conservation over the next decade, requiring strong national strategies to reduce trade opportunities, disrupt networks and weaken demand.

Uddin, Nasir↗

Determination of the parton distribution functions of the proton using diverse ATLAS data from pp collisions at $$\sqrt{s} = 7$$, 8 and 13 TeV

This paper presents an analysis at next-to-next-to-leading order in the theory of quantum chromodynamics for the determination of a new set of proton parton distribution functions using diverse measurements in pp collisions at $\sqrt{s}$ = 7, 8 and 13 TeV, performed by the ATLAS experiment at the Large Hadron Collider, together with deep inelastic scattering data from ep collisions at the HERA collider. The ATLAS data sets considered are differential cross-section measurements of inclusive W ± and Z/γ* boson production, W ± and Z boson production in association with jets, $t\bar{t}$ production, inclusive jet production and direct photon production. In the analysis, particular attention is paid to the correlation of systematic uncertainties within and between the various ATLAS data sets and to the impact of model, theoretical and parameterisation uncertainties. The resulting set of parton distribution functions is called ATLASpdf21.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Machine learning-guided design of direct methanol fuel cells with a platinum group metal-free cathode

Direct methanol fuel cells (DMFCs) offer a promising solution for clean electricity generation, particularly in small electronics and remote auxiliary power units. However, optimizing their efficiency and performance is challenging due to the complex interactions between various factors. Here, we present a novel approach that integrates experiments with machine learning to model and predict the performance of these fuel cells using atomically dispersed platinum group metal (PGM)-free catalysts at the cathode. Further, our machine learning models, trained on diverse input parameters, allow for the comprehensive optimization of DMFC performance prior to fabrication and testing. Through extensive experimental validation, we demonstrate that this data-driven approach accurately predicts key performance metrics, such as maximum power output and polarization curves. By combining our models with interpretable game-theory methods, we provide deep insights into the factors governing fuel cell performance, ultimately paving the way for the design of scalable and efficient DMFC technologies.

25 ENERGY STORAGE↗

EBSD of Rough Native CuInGaSe2 Thin-Films

The polycrystalline Cu (In, Ga) Se2, or CIGS, based thin-film materials system has long been studied for use in photovoltaic technologies, where its bandgap tunability, mechanical flexibility, and relatively low production costs are all appealing. Nonetheless, significant defect populations, which serve to reduce efficiency, create performance instabilities, and increase concerns about long-term reliability, have hindered wide-scale adoption. Prior work, including application of a scanning probe based deep level trap spectroscopy (SP-DLTS) defect mapping technique and scanning transmission electron microscope (STEM) based electron energy loss spectroscopy (EELS), has shown that the most detrimental defects, with energy level near mid-gap (thus serving as a carrier recombination center), are most likely caused by CuIn/Ga antisites and tend to cluster at or around certain grain boundaries [1,2]. However, the exact nature of these particular boundaries — their structures, chemistries, or even the relative misorientation of their associated grains — and their relation to this defect clustering and/or its formation is yet unknown. As such, electron backscatter diffraction (EBSD) orientation mapping, directly correlated with defect-sensitive techniques like SP-DLTS and/or STEM-EELS, could prove critical for providing the final missing links toward understanding the mechanisms behind these defects. Indeed, recent studies using correlative electron beam induced current (EBIC) with EBSD have been able to identify boundaries, and their relative misorientations, that possess detrimental electronic properties [3]. However, because EBIC is unable to resolve the defect energy levels, many questions are left unanswered. Furthermore, this study, and others like it, employed focused ion beam (FIB) milling to flatten the natively-rough CIGS [3-5], which may run the risk of changing the nature of any near-surface defect structures.

14 SOLAR ENERGY↗

Quasiparticle Poisoning of Superconducting Qubits from Resonant Absorption of Pair-Breaking Photons

The ideal superconductor provides a pristine environment for the delicate states of a quantum computer: because there is an energy gap to excitations, there are no spurious modes with which the qubits can interact, causing irreversible decay of the quantum state. As a practical matter, however, there exists a high density of excitations out of the superconducting ground state even at ultralow temperature; these are known as quasiparticles. Observed quasiparticle densities are of order 1 μ m - 3 , tens of orders of magnitude greater than the equilibrium density expected from theory. Nonequilibrium quasiparticles extract energy from the qubit mode and can induce dephasing. Here we show that a dominant mechanism for quasiparticle poisoning is direct absorption of high-energy photons at the qubit junction. We use a Josephson junction-based photon source to controllably dose qubit circuits with millimeter-wave radiation, and we use an interferometric quantum gate sequence to reconstruct the charge parity of the qubit. We find that the structure of the qubit itself acts as a resonant antenna for millimeter-wave radiation, providing an efficient path for photons to generate quasiparticles. A deep understanding of this physics will pave the way to realization of next-generation superconducting qubits that are robust against quasiparticle poisoning.

Liu, Chuan-Hong↗

FY2021 ILAW Glass Ion-Exchange Rate Testing

Approximately 54 to 56 million gallons of radioactive mixed waste is currently stored in underground tanks at The United States Department of Energy’s (DOE’s) Hanford site in the State of Washington. The Hanford Tank Waste Treatment and Immobilization Plant (WTP) will provide DOE’s Office of River Protection (ORP) with a means of treating this waste by vitrification for subsequent disposal. The tank waste will be separated into low- and high-activity waste fractions, which will then be vitrified respectively into Immobilized Low Activity Waste (ILAW) and Immobilized High-Level Waste (IHLW) products. The ILAW product will be disposed of in an engineered facility – the Integrated Disposal Facility (IDF) – on the Hanford site, while the IHLW product will be directed to the national deep geological disposal facility for high-level nuclear waste. The ILAW and IHLW products must meet a variety of requirements with respect to protection of the environment before they can be accepted for disposal. To capitalize on the success of the FY19 and FY20 Atkins/VSL test results on six glasses, Washington River Protection Solutions, LLC (WRPS) has contracted with Atkins/VSL to collect IEX data on four more ILAW glasses using PFT, the results of which are the subject of the present report. The work described herein was performed according to a Test Plan that is responsive to the corresponding WRPS scope of work.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Thermal and Well Flow Performance of Closed-Loop Geothermal in the Wattenberg Area

Closed-loop geothermal systems provide an alternative to resource-constrained hydrothermal systems and stimulation-intensive enhanced geothermal systems. In this work, we apply the slender-body theory (SBT) model, to simulate the well flow and heat transfer performance of U-loop well designs in the Wattenberg area of the Denver-Julesburg Basin. Three U-loop well patterns are investigated, including a single-, double-, and multi-lateral design. The subsurface within the area of interest is characterized by deep, hot (> 200 degrees C) igneous/metamorphic basement rock underlying multiple sedimentary formations. The lateral section(s) of the U-loop lie(s) within a target depth of 6 km, where temperatures are estimated to approach 300 degrees C. As a base case, conduction-only heat transfer is investigated through simulations with the SBT model within U-loops with open-hole laterals that exchange heat directly with the hot, dry rock using water as a working fluid. The utilization of supercritical CO2 as a heat transfer fluid is also considered. For each scenario, the system performance in terms of annual heat production and temperature profile over a 20-year project lifetime are assessed. Also, the levelized costs of heat and electricity (LCOH and LCOE) are determined using a top-down techno-economic analysis model. The results show that the performance- and cost-optimized U-loop design is one having an injection-production well spacing of 1,000 meters with ten 50-meter-spaced laterals that traverse a subsurface system with a temperature gradient of 60 degrees C/km. By injecting 20 degrees C-water at a rate of 60 kg/s through this loop, an average heat production of 19 MWth (i.e., 2.2 MWe net plant output) can be achieved, resulting in an LCOE and LCOH of $136/MWhe and $1.53/GJ, respectively, over a 20-year project life.

closed-loop geothermal↗

Laboratory investigation of hydraulic fracturing in granitic rocks using active and passive seismic monitoring

SUMMARY Knowledge of the fracturing processes can be important for the optimization of pressurized fluid injection operations in the deep underground rock mass. Active and passive seismic monitoring techniques have been used in the field for tracking or mapping the propagating hydraulic fracture. Although both these monitoring techniques provide valuable information about the generated fracture network, it is difficult for either technique to comprehensibly identify the different processes associated with hydraulic fracturing. The combined active and passive monitoring has the potential for better characterization of the complex hydraulic fracturing phenomena. In this study, laboratory hydraulic fracturing experiments with combined active and passive seismic monitoring were conducted on true triaxially loaded Barre granite cubes with different fluid injection rates. The seismic inelastic fracturing was detected by 16 passive acoustic emission sensors, where 3678 and 2370 seismic source events were detected for the high and low injection rate experiments, respectively. For active monitoring, strong variations in the attributes of signals were observed which were transmitted through four source–receiver pairs, placed both perpendicular and parallel to the generated hydraulic fracture. Positive velocity changes were observed for active sensor pairs with ray paths passing through the generated hydraulic fracture indicating fluid permeation, whereas isolated dry deformation was characterized by a slight but permanent velocity decrease. Compared to velocity, the energy of the active signals was 1–2 orders of magnitude more sensitive to different hydraulic fracturing processes. However, the sensitivity and signatures of the active signal attributes were found to be dependent on the frequency range and direction of ray path with respect to the location of the generated fracture network. Using the coupled evaluation of the active and passive signals we were able to systematically identify various hydraulic fracturing processes including: (1) aseismic deformation, (2) fracture initiation and fluid permeation, (3) pressure build-up, (4) fracture propagation and (5) pressure release and leak-off. The results of this study showed that combining the respective advantages of active and passive seismic techniques and using both of them to monitor the failure processes can facilitate a more comprehensive understanding and better control of the hydraulic stimulations in subsurface operations.

Geochemistry & Geophysics↗

SAFE-OCC: A novelty detection framework for Convolutional Neural Network sensors and its application in process control

Herein we present a novelty detection framework for Convolutional Neural Network (CNN) sensors that we call Sensor-Activated Feature Extraction One-Class Classification (SAFE-OCC). We show that this framework enables the safe use of computer vision sensors in process control architectures. Emergent control applications use CNN models to map visual data to a state signal that can be interpreted by the controller. Incorporating such sensors introduces a significant system operation vulnerability because CNN sensors can exhibit high prediction errors when exposed to novel (abnormal) visual data. Unfortunately, identifying such novelties in real-time is nontrivial. To address this issue, the SAFE-OCC framework leverages the convolutional blocks of the CNN to create an effective feature space to conduct novelty detection using a desired one-class classification technique. This approach engenders a feature space that directly corresponds to that used by the CNN sensor and avoids the need to derive an independent latent space. We demonstrate the effectiveness of SAFE-OCC via simulated control environments.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Digital Signal Processing Using Deep Neural Networks

Currently there is great interest in the utility of deep neural networks (DNNs) for the physical layer of radio frequency (RF) communications. In this manuscript we describe a custom DNN specially designed to solve problems in the RF domain. Our model leverages the mechanisms of feature extraction and attention through the combination of an autoencoder convolutional network with a transformer network, to accomplish several important communications network and digital signals processing (DSP) tasks. We also present a new open dataset and physical data augmentation model that enables training of DNNs that can perform automatic modulation classification, infer, and correct transmission channel effects, and directly demodulate baseband RF signals.

42 ENGINEERING↗

Triplet Fusion Upconversion for Photocuring 3D-Printed Particle-Reinforced Composite Networks

High energy photons (λ < 400 nm) are frequently used to initiate free radical polymerizations to form polymer networks, but are only effective for transparent objects. This phenomenon poses a major challenge to additive manufacturing of particle-reinforced composite networks since deep light penetration of short-wavelength photons limits the homogeneous modification of physicochemical and mechanical properties. Herein, the unconventional, yet versatile, multiexciton process of triplet–triplet annihilation upconversion (TTA-UC) is employed for curing opaque hydrogel composites created by direct-ink-write (DIW) 3D printing. TTA-UC converts low energy red light (λ max = 660 nm) for deep penetration into higher-energy blue light to initiate free radical polymerizations within opaque objects. Further, as proof-of-principle, hydrogels containing up to 15 wt.% TiO 2 filler particles and doped with TTA-UC chromophores are readily cured with red light, while composites without the chromophores and TiO 2 loadings as little as 1–2 wt.% remain uncured. Importantly, this method has wide potential to modify the chemical and mechanical properties of complex DIW 3D-printed composite polymer networks.

36 MATERIALS SCIENCE↗

Rare Earth Permanent Magnets: Supply Chain Deep Dive Assessment

The report “America’s Strategy to Secure the Supply Chain for a Robust Clean Energy Transition” lays out the challenges and opportunities faced by the United States in the energy supply chain as well as the federal government plans to address these challenges and opportunities. It is accompanied by several issue-specific deep dive assessments, including this one, in response to Executive Order 14017 “America’s Supply Chains,” which directs the Secretary of Energy to submit a report on supply chains for the energy sector industrial base. The Executive Order is helping the federal government to build more secure and diverse U.S. supply chains, including energy supply chains. This report focuses on the supply chain for rare earth permanent magnets, specifically sintered neodymiumiron-boron (NdFeB) magnets, used in clean energy technologies. Sintered NdFeB magnets are the strongest magnets commercially available and provide a host of benefits to wide-ranging applications in consumer and industrial electronics, especially in advanced motor and drive systems. Within the Energy Sector Industrial Base, and clean energy in particular, NdFeB magnets are key intermediate components of permanent magnet synchronous (direct drive) generators in wind turbines (especially for offshore turbines) and electric synchronous traction motors for propulsion systems in battery and hybrid electric vehicles.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Theoretical Prediction of Thermal Expansion Anisotropy for Y 2 Si 2 O 7 Environmental Barrier Coatings Using a Deep Neural Network Potential and Comparison to Experiment

Environmental barrier coatings (EBCs) are an enabling technology for silicon carbide (SiC)-based ceramic matrix composites (CMCs) in extreme environments such as gas turbine engines. However, the development of new coating systems is hindered by the large design space and difficulty in predicting the properties for these materials. Density Functional Theory (DFT) has successfully been used to model and predict some thermodynamic and thermo-mechanical properties of high-temperature ceramics for EBCs, although these calculations are challenging due to their high computational costs. In this work, we use machine learning to train a deep neural network potential (DNP) for Y 2 Si 2 O 7 , which is then applied to calculate the thermodynamic and thermo-mechanical properties at near-DFT accuracy much faster and using less computational resources than DFT. We use this DNP to predict the phonon-based thermodynamic properties of Y 2 Si 2 O 7 with good agreement to DFT and experiments. We also utilize the DNP to calculate the anisotropic, lattice direction-dependent coefficients of thermal expansion (CTEs) for Y 2 Si 2 O 7 . Molecular dynamics trajectories using the DNP correctly demonstrate the accurate prediction of the anisotropy of the CTE in good agreement with the diffraction experiments. In the future, this DNP could be applied to accelerate additional property calculations for Y 2 Si 2 O 7 compared to DFT or experiments.

36 MATERIALS SCIENCE↗

Adaptive Optical Two-Photon Fluorescence Microscopy Probes Cellular Organization of Ocular Lenses In Vivo

The mammalian ocular lens is an avascular multicellular organ that grows continuously throughout life. Traditionally, its cellular organization is investigated using dissected lenses, which eliminates in vivo environmental and structural support. Therefore, in vivo optical imaging methods for studying lenses in their native context in live animals are urgently needed. Here, we demonstrated that two-photon fluorescence microscopy can visualize lens cells in vivo. To maintain subcellular resolution at depth, we used adaptive optics to correct aberrations owing to ocular and lens tissues, which led to substantial signal and resolution improvements. Imaging lens cells up to 980 µm deep, we observed novel cellular organizations including suture-associated voids, enlarged vacuoles, and large cavities, contrary to the conventional view of a highly ordered organization. We tracked these features longitudinally over weeks and observed the incorporation of new cells during growth. Taken together, noninvasive longitudinal in vivo imaging of lens morphology using adaptive optics two-photon fluorescence microscopy will allow us to observe the development or alterations of lens cellular organization in living animals directly.

60 APPLIED LIFE SCIENCES↗

Deep learning for drag force modelling in dilute, poly-dispersed particle-laden flows with irregular-shaped particles

Here, this study applies machine learning-based approaches to develop a drag force model for irregular-shaped particles in incompressible flows. The particle-laden flows are studied through an in-house particle-resolved direct numerical simulation (PR-DNS) at low-intermediate Reynolds numbers (Re). We utilize the PR-DNS to obtain drag force coefficients and flow fields of single particles. A variational auto-encoder model is used to obtain latent vectors to represent the geometrical features of the particles, and artificial neural networks (ANN) are developed to predict drag force coefficients and flow fields of the single particles. This study applies a pairwise interaction extended point-particle (PIEP) model to obtain the coefficients assuming the flow fields of neighboring particles can be linearly superposed. The PIEP method shows significant improvement on prediction for a few neighbored particles. In addition, the results reveal R2 scores of 0.56-0.62 and errors of 9.1-10.0 % for the dilute, polydispersed systems with a volume fraction of 0.5 %.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Deep learning approaches for neural decoding across architectures and recording modalities

Decoding behavior, perception or cognitive state directly from neural signals is critical for brain–computer interface research and an important tool for systems neuroscience. In the last decade, deep learning has become the state-of-the-art method in many machine learning tasks ranging from speech recognition to image segmentation. The success of deep networks in other domains has led to a new wave of applications in neuroscience. In this article, we review deep learning approaches to neural decoding. Here, we describe the architectures used for extracting useful features from neural recording modalities ranging from spikes to functional magnetic resonance imaging. Furthermore, we explore how deep learning has been leveraged to predict common outputs including movement, speech and vision, with a focus on how pretrained deep networks can be incorporated as priors for complex decoding targets like acoustic speech or images. Deep learning has been shown to be a useful tool for improving the accuracy and flexibility of neural decoding across a wide range of tasks, and we point out areas for future scientific development.

59 BASIC BIOLOGICAL SCIENCES↗