Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “dl”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 523 records · Page 29
All sourcesNASA NTRSDOE OSTI
DOE OSTI2017

Towards a Semantically-Enabled Control Strategy for Building Simulations: Integration of Semantic Technologies and Model Predictive Control

State-of-the-art building simulation control methods incorporate physical constraints into their mathematical models, but omit implicit constraints associated with policies of operation and dependency relationships among rules representing those constraints. To overcome these shortcomings, there is a recent trend in enabling the control strategies with inference-based rule checking capabilities. One solution is to exploit semantic web technologies in building simulation control. Such approaches provide the tools for semantic modeling of domains, and the ability to deduce new information based on the models through use of Description Logic (DL). In a step toward enabling this capability, this paper presents a cross-disciplinary data-driven control strategy for building energy management simulation that integrates semantic modeling and formal rule checking mechanisms into a Model Predictive Control (MPC) formulation. The results show that MPC provides superior levels of performance when initial conditions and inputs are derived from inference-based rules.

Delgoshaei, Parastoo↗
DOE OSTI2020

Artificial Intelligence Applications in Renewable Energy

Addressing new methodologies in deep learning (DL), machine learning (ML) and artificial intelligence (AI), the webinar speakers will provide an overview of the literature spanning these three overlapping fields as applied to energy systems research. The audience will learn how developments in these areas have added new capabilities for pattern recognition and predictive modeling that are complementary to more traditional modeling approaches used in energy systems research. The speakers will illustrate several use cases of these new approaches in the energy space, such as physics-guided neural networks to improve ML regressions for solar data and how AI agents can be used to explore power plant operations.

40 EE - Geothermal Technologies Office (EE-4G)↗
DOE OSTI2020

Multiple-objective Reinforcement Learning for Inverse Design and Identification

The aim of inverse chemical design is to develop new molecules with given optimized molecular properties or objectives. Recently, generative deep learning (DL) networks are considered as the state-of-the-art in inverse chemical design and have achieved early success in generating molecular structures with desired properties in the pharmaceutical and material chemistry fields. However, satisfying a large number (> 10 objectives) of molecular objectives is a limitation of current generative models. To improve the model’s ability to handle a large number of molecule design objectives, we developed a Reinforcement Learning (RL) based generative framework to optimize chemical molecule generation. Our use of Curriculum Learning (CL) to fine-tune the pre-trained generative network allowed the model to satisfy up to 21 objectives and increase the generative network’s robustness. The experiments show that the proposed multiple-objective RL-based generative model can correctly identify unknown molecules with an 83% to 100% success rate, compared to the baseline approach of 0%. Additionally, this proposed generative model is not limited to just chemistry research challenges; we anticipate that problems that utilize RL with multiple objectives will benefit from this framework.

reinforcement learning, generative model, inverse ↗
DOE OSTI2019

Stripping off the implementation complexity of physics-based model predictive control for buildings via deep learning

Over the past decade, model predictive control (MPC) has been considered as the most promising solution for intelligent building operation. Despite extensive effort, transfer of this technology into practice is hampered by the need to obtain an accurate controller model with minimum effort, the need of expert knowledge to set it up, and the need of increased computational power and dedicated software to run it. A promising direction that tackles the last two problems was proposed by approximate explicit MPC where the optimal control policies are learned from MPC data via a suitable function approximator, e.g., a deep learning (DL) model. The main advantage of the proposed approach stems from simple evaluation at execution time leading to low computational footprints and easy deployment on embedded HW platforms. We present the energy savings potential of physics-based (also called 'white-box') MPC applied to an office building in Belgium. Moreover, we demonstrate how deep learning approximators can be used to cut the implementation and maintenance costs of MPC deployment without compromising performance. We also critically assess the presented approach by pointing out the major challenges and remaining open-research questions.

Drgona, Jan↗
DOE OSTI2021

Machine Intelligence to Detect, Characterise, and Defend against Influence Operations in the Information Environment

Social media has enabled a new era of manipulation in the information and cognitive domains. Deceptive content—misleading, falsified, and fabricated—is routinely created and spread in the modern social media environment with the intent to create confusion and widen political and social divides, and exploit the societal conflict exacerbated by these divides in the real-world (aka physical domain). Such disinformation campaigns demonstrate a threat to the integrity of economic, political, cultural, public health, and national security institutions around the world. In this work we overview our artificial intelligence (AI) capabilities to detect, describe, and defend against information operations on Twitter as an example social platform to understand the influence of misleading and falsified content diffusion and better enable those charged with defending against such manipulation to enable responsive parties to counter it. We first present novel linguistically-informed deep learning (DL) models for misinformation and disinformation detection, and present an in-depth linguistic analysis of psycho-linguistic markers across broad deception categories. We then demonstrate how our models perform in the multilingual and multimodal setting and categorize falsified and misleading content based on the intent to deceive. We also provide a large-scale analysis to describe user behavior and spread patterns while engaging with deceptive content and report novel findings about the immediate diffusion of deceptive content by characterizing the vulnerable sub-populations and their demographics, and explicitly measuring speed and scale of deception spread to uncover who shares deceptive content, how quickly, how much, and how evenly. In addition, we measure audience reactions to misinformation and disinformation at scale, distinguishing the reactions of users identified as bots versus humans. Finally, we take advantage of deep translation and generation models to create unique solutions for real-time defense against digital deception and discuss how to apply causal inference to prescribe and intervene into strategic communications jointly across information, cognitive, and physical domains.

artificial intelligence, deep learning, neural lan↗
DOE OSTI2021

Multi-User Capacity for Cyclic Prefix Direct Sequence Spread Spectrum with Linear Detection and Precoding

Cyclic Prefix Direct Sequence Spread Spectrum (CP-DSSS) is a promising solution for futuristic 6G ultra-reliable low latency communications (URLLC) and massive machine type communication (mMTC) applications, where the CP-DSSS waveform would operate as a secondary network at the same frequencies as the primary network but at much lower SNR. In this paper, we show per-user capacity for multi-user scenarios, where simple matched filtering (MF) is performed on the uplink (UL) and time-reversal (TR) precoding is used on the downlink (DL). When operating in the low SNR regime, CP-DSSS achieves per-user capacity near the optimum single-user capacity by using a MF detector at the receiver for the UL. TR precoding converges to the optimal capacity as the number of antennas at the hub/gateway increases. Given the near-optimal performance of MF detection and TR precoding for each of the users, CP-DSSS can be implemented with simple device transceiver structures, reducing per-unit cost for massively deployed 6G networks.

5G and Beyond Communications↗
DOE OSTI2022

EERC Final Topical Report – Findings on Subtask 3.2 – Produced Water Management Through Geologic Homogenization, Conditions, and Reuse

The Energy & Environmental Research Center (EERC) was awarded a contract by the North Dakota Industrial Commission (NDIC) Oil and Gas Research Program (NDIC No. G-051-101) to conduct a study on the recycling of water used in oil and gas operations, also known as produced water, from oil- and gas-producing regions of North Dakota as directed by Section 19 of North Dakota House Bill 1014. This final report provides a compilation of results of the study, which include regulatory, scientific, technological, and feasibility methods and considerations associated with North Dakota produced water management. The report provides a synopsis of this project’s previously submitted produced water assessment report entitled “Produced Water Management and Recycling Options in North Dakota” (Energy & Environmental Research Center, 2020), with updated values provided as appropriate. The report provides the results from the investigation of a novel produced water management strategy, referred to as geologic homogenization, conditioning, and reuse (GHCR), which aims to use a subsurface geologic formation as a natural medium for managing produced water recycling and reuse. Water management is a significant technical and economic challenge for sustainable oil and gas production, and water volumes are intrinsically linked to oil production volumes. North Dakota oil production rose to over 1.5 million barrels (MMbbl)/day in 2019, and despite a downturn in oil price in early 2020, North Dakota oil production has recovered to 1.1 MMbbl/day as of August 2021. Bakken petroleum system development between 2008 and 2020 has resulted in a nearly fourfold increase in produced water volumes to 642 MMbbl/yr in 2020 after peaking at 740 MMbbl/yr in 2019 and a fivefold increase in saltwater disposal (SWD) volumes to 565 MMbbl/yr in 2020 after a peak of 682 MMbbl/yr in 2019. Produced water and SWD volumes are forecasted to double by 2030. SWD is the primary method of produced water management used in North Dakota, with approximately 95% of the SWD volume occurring through subsurface injection into sandstones of the Dakota Group (Dakota). Localized pressurization of the Dakota resulting from SWD and projected increases in produced water volumes could impact the economics of North Dakota oil production. As a result, there is an emerging need to pursue alternative produced water management approaches, including recycling and reuse. While produced water recycling is not yet widespread, commercial operators are making strides in overcoming the technical challenges of using high salinity produced water in completion operations (Marathon Oil, 2020). As water management continues to be a key focal point in companies’ environmental, social, and governance (ESG) initiatives, focus on water management, including recycling, will likely continue to increase. Laboratory column testing, field sample collection, geologic modeling and numerical simulation, and techno-economic analysis all indicate that GHCR could feasibly be implemented as a potential water management option. Laboratory column testing and field sample collection indicate that the Inyan Kara sandstone and native formation fluid are capable of homogenizing with the Bakken produced water to a point where the fluid composition appears to stabilize. Extracting that stabilized fluid could be considered homogeneous and capable of providing individual batches of hydraulic fracturing fluid. Numerical simulation results indicate that extraction of fluids from the Inyan Kara in a GHCR implementation scenario is capable of reducing formation pressure, which would help ease localized pressurization of the Inyan Kara and extend the available capacity for nearby existing SWD wells. Economic analysis indicates that there are scenarios where GHCR implementation can be a competitive or even lower-cost option than a conventional water management approach. Site-specific conditions will dictate the economic potential of GHCR, but potentially attractive sites for GHCR implementation will be those that are located above a pressurized zone of the Inyan Kara, need six or more Bakken infill wells, and face high costs for conventional SWD and/or freshwater. Based on the regulatory review, drilling into the Inyan Kara for SWD and to harness as a source water for industrial use have precedent in North Dakota, and a workable regulatory solution for GHCR seems likely. However, restrictions in the state regarding surface storage and transport of produced fluids may limit some activities, which will affect how GHCR could ultimately be implemented. In summary, this study reveals pursuing GHCR can be a viable approach to water management in North Dakota. The GHCR concept addresses some of the challenges that hinder the more traditional approaches to recycling in the industry. Furthermore, an assessment of the current landscape of water management within the state reveals the ongoing trend of increasing volumes of produced water and SWD. Projections reveal that the volumes of produced water that need to be managed are expected to double over the next decade (Energy & Environmental Research Center, 2020). With the continued development of the Bakken and continuing driving factors related to ESG initiatives, implementing a practice such as GHCR is a feasible approach to adding recycling of produced water to industry within the state. This subtask was cofunded through the EERC–U.S. Department of Energy Joint Program on Research and Development for Fossil Energy-Related Resources Cooperative Agreement No. DE-FE0024233. Nonfederal funding was provided by the North Dakota Industrial Commission Oil and Gas Research Program. References Energy & Environmental Research Center, 2020, Produced water management and recycling options in North Dakota: Final Report for North Dakota Legislative Management Energy Development and Transmission Committee and North Dakota Industrial Commission. Marathon Oil, 2020, Sustainability report: https://cdn.sanity.io/files/ghcnw9z2/website/ 91744eb6ef8fbe59505a911c6b8d2e8dd9a537fa.pdf?dl (accessed November 2021).

02 PETROLEUM↗
DOE OSTI2022

Simurgh: A Framework for Cad-Driven Deep Learning Based X-Ray CT Reconstruction

High-resolution X-ray computed tomography (XCT) is an important technique for the inspection of additively manufactured (AM) parts. While XCT is typically used off-line to inspect a subset of manufactured parts, significantly accelerating measurement speed while retaining accuracy would enable use of XCT for in-line inspection to rapidly identify defects in each part as it is manufactured. Here, we propose a deep learning (DL) based approach that uses computer aided design (CAD) models of the AM parts and physics-based information to rapidly produce high-quality reconstructions from sparse XCT measurements without high quality ground truth data. Our approach uses a generative adversarial neural network (GAN) to produced realistic training data from the CAD-based simulations and a deep neural network that is trained using data from the first stage to produce accurate 3D reconstructions. Using experimental XCT data of metal parts, we demonstrate enhanced defect detection capabilities while dramatically reducing the scan time.

Ziabari, Amir↗
DOE OSTI2021

Unleashing the Power of Industrial Big Data through Scalable Manual Labeling

Big Data plays a central role in the remarkable results achieved by Machine Learning (ML) and especially Deep Learning (DL) in the recent years. However, the difficulty in obtaining a reasonable amount of labeled samples limits ML/DL application in various domains, including industrial equipment and system monitoring. In this paper the need for methods that turn manual labeling into a scalable process is highlighted. A real world problem is analyzed for which weak supervision methods, successfully employed in other domains, did not produce acceptable results. An alternative approach based on clustering ensembles is described and tested, achieving good performance.

Paes Leao, Bruno↗
DOE OSTI2023

Scalable Graph Analytics and HPC Operational Enhancement: Parallel Computing and ML/DL Innovations

Parallel computing plays a pivotal role in the efficient processing of large-scale graphs. Complex network analysis stands as a capti- vating research frontier, holding promise across diverse scientific domains such as sociology, biology, online media, and recommenda- tion systems. In this era, Machine Learning (ML) and Deep Learning (DL) have emerged as indispensable tools, underpinning remarkable technological achievements. Within this dynamic landscape, my research revolves around advancing parallel algorithms tailored for large-scale graph operations. To achieve this, I harness the power of cutting-edge technologies including OpenMP, MPI, HIP, and CUDA, on the High-Performance Computing (HPC) platforms to unlock optimal performance. I also apply ML/DL techniques to HPC operational data, to streamline the monitoring and maintenance of supercomputers, alleviating the complexities associated with their upkeep and enhancing user support. My research echoes the syn- ergy between parallel computing, large-scale graph analysis, and ML/DL, improving computational efficiency and user experience.

Sattar, Naw Safrin↗
DOE OSTI2015

Comparison of dose measurements in CT using a novel semiconductor detector and a small ion chamber

The advance of multislice computed tomography (CT) has become inadequate the currently dosimetric protocol used in CT. Instead of dosimetry based on the measurement of CTDI using a pencil ion chamber of 100 m of length, it was proposed the use of a small ion chamber (IC) and the calculating the dose equilibrium (Deq) at the location of the chamber. The objective of this work was to compare the performance of a short IC and a commercial photodiode to measure the accumulated dose at the center of the scan length L, DL(0), and to obtain the equilibrium dose Deq using the two detectors. The result for L=100 mm was compared with the result of a pencil chamber. The results indicate that the commercial photodiode is suitable to measure the accumulated dose at the center of the scan length L as compared with the ion chambers. This methodology allows measurements of the accumulated dose for any desired scan length, allowing measuring the equilibrium dose Deq if the phantom is long enough to allow it. (authors)

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2022

Design of a neutral thermal scattering (NeTS) module for hydrogen in light water

The accurate representation of thermal scattering law (TSL) data is integral to the design and characterization of many modern nuclear systems, particularly those using light water as a moderator/coolant. As a material-dependent distribution over energy-momentum phase space, the TSL may exhibit a variety of unique and relevant conditional (e.g., temperature, pressure) and compositional (e.g., porosity, stoichiometry, radiation damage) dependencies. Currently, there are various approaches to incorporate temperature dependence, which is especially important in coupled neutronic-thermal hydraulic simulations. In each approach, there is an inherent tradeoff between memory consumption and accuracy. Some techniques require tens to hundreds of MBs or more, while others fail to reproduce the underlying data to within 10% error over the considered input domain, despite having a reduced storage burden. This work aims to address both sides of the tradeoff simultaneously by implementing a novel deep learning (DL) approach to TSL representation. The neural thermal scattering (NeTS) concept, which is amenable to an arbitrary number of dependencies, is demonstrated via the inclusion of temperature dependence into a highly compact, highly accurate functional form of the multi- variate TSL (i.e., S(α, β, T)) for hydrogen in light water. Resulting storage requirements are on the order of 100 kB, and median and maximum percent deviations are on the order of 0.1% and 1%, respectively. These measures represent a step improvement over previous techniques. Notably, the developed neural network and feature methodology build on those employed in prior work on beryllium oxide. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2024

Predicting Li-ion Battery Performance for Impurity-doped NMC Cathodes Using Deep Learning

With the electric vehicle (EV) market expansion and the energy sector's shift towards electrification, the demand for battery metals, including lithium (Li), cobalt (Co), and nickel (Ni), is set to surpass supply. A critical knowledge gap exists in the purity standards for battery precursors and the impact of impurities on battery performance. Addressing this, our study employs a Deep Machine Learning (DL) based multi-objective optimization approach to interpret the relationship between metal impurities in domestic battery resources and their effects on battery performance. We analyze experimental data from Li-ion batteries with NMC (Nickel-Manganese-Cobalt oxide) cathodes over 1000 cycles, representing approximately ~6-8 months of operation, to establish a baseline of performance without impurities. Leveraging this data, we develop a Physics-Informed Deep Learning (PIDL) framework to extend our findings to cases that include metal impurities (e.g., Fe, Cu, Al) ranging from (0.001 - 0.01) %, respectively. By incorporating physics-based features, our PIDL model can accurately estimate the performance of NMC cathodes doped with various metal impurities to provide rapid design decisions. This research paves the way for informed decisions in Li-ion battery material design and optimization, ensuring the sustainable growth of the EV market and the broader energy sector.

25 ENERGY STORAGE↗
DOE OSTI2016

Performance of b-jet identification in the ATLAS experiment

The identification of jets containing b hadrons is important for the physics programme of the ATLAS experiment at the Large Hadron Collider. Several algorithms to identify jets containing b hadrons are described, ranging from those based on the reconstruction of an inclusive secondary vertex or the presence of tracks with large impact parameters to combined tagging algorithms making use of multi-variate discriminants. An independent b-tagging algorithm based on the reconstruction of muons inside jets as well as the b-tagging algorithm used in the online trigger are also presented. The b-jet tagging efficiency, the c-jet tagging efficiency and the mistag rate for light flavour jets in data have been measured with a number of complementary methods. The calibration results are presented as scale factors defined as the ratio of the efficiency (or mistag rate) in data to that in simulation. In the case of b jets, where more than one calibration method exists, the results from the various analyses have been combined taking into account the statistical correlation as well as the correlation of the sources of systematic uncertainty.

43 PARTICLE ACCELERATORS↗
DOE OSTI2014

Standalone vertex finding in the ATLAS muon spectrometer

A dedicated reconstruction algorithm to find decay vertices in the ATLAS muon spectrometer is presented. The algorithm searches the region just upstream of or inside the muon spectrometer volume for multi-particle vertices that originate from the decay of particles with long decay paths. The performance of the algorithm is evaluated using both a sample of simulated Higgs boson events, in which the Higgs boson decays to long-lived neutral particles that in turn decay to bb final states, and pp collision data at $ \sqrt{s} $ = 7 TeV collected with the ATLAS detector at the LHC during 2011.

47 OTHER INSTRUMENTATION↗
DOE OSTI2011

dlrhi

ARM Instrument: Doppler Lidar

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2014

Ending Aging in Super Glassy Polymer Membranes

Aging in super glassy polymers such as poly(trimethylsilylpropyne) (PTMSP), poly(4-methyl-2-pentyne) (PMP), and polymers with intrinsic microporosity (PIM-1) reduces gas permeabilities and limits their application as gas-separation membranes. While super glassy polymers are initially very porous, and ultra-permeable, they quickly pack into a denser phase becoming less porous and permeable. This age-old problem has been solved by adding an ultraporous additive that maintains the low density, porous, initial stage of super glassy polymers through absorbing a portion of the polymer chains within its pores thereby holding the chains in their open position. This result is the first time that aging in super glassy polymers is inhibited whilst maintaining enhanced CO2 permeability for one year and improving CO2/N-2 selectivity. This approach could allow super glassy polymers to be revisited for commercial application in gas separations.

Lau, CH↗
DOE OSTI2016

A search for prompt lepton-jets in pp collisions at √s = 8 TeV with the ATLAS detector

We present a search for a new, light boson with a mass of about 1 GeV and decaying promptly to jets of collimated electrons and/or muons (lepton-jets). The analysis is performed with 20.3 fb -1 of data collected by the ATLAS detector at the Large Hadron Collider in proton-proton collisions at a centre-of-mass energy of 8 TeV. Events are required to contain at least two lepton-jets. This study finds no statistically significant deviation from predictions of the Standard Model and places 95% confidence-level upper limits on the contribution of new phenomena beyond the SM, incuding SUSY-portal and Higgs-portal models, on the number of events with lepton-jets.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗