Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “learning efficiency”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,189 records · Page 66

Learning to Optimize Variational Quantum Circuits to Solve Combinatorial Problems

Quantum computing is a computational paradigm with the potential to outperform classical methods for a variety of problems. Proposed recently, the Quantum Approximate Optimization Algorithm (QAOA) is considered as one of the leading candidates for demonstrating quantum advantage in the near term. QAOA is a variational hybrid quantum-classical algorithm for approximately solving combinatorial optimization problems. The quality of the solution obtained by QAOA for a given problem instance depends on the performance of the classical optimizer used to optimize the variational parameters. In this paper, we formulate the problem of finding optimal QAOA parameters as a learning task in which the knowledge gained from solving training instances can be leveraged to find high-quality solutions for unseen test instances. To this end, we develop two machine-learning-based approaches. Our first approach adopts a reinforcement learning (RL) framework to learn a policy network to optimize QAOA circuits. Our second approach adopts a kernel density estimation (KDE) technique to learn a generative model of optimal QAOA parameters. In both approaches, the training procedure is performed on small-sized problem instances that can be simulated on a classical computer; yet the learned RL policy and the generative model can be used to efficiently solve larger problems. Furthermore, extensive simulations using the IBM Qiskit Aer quantum circuit simulator demonstrate that our proposed RL- and KDE-based approaches reduce the optimality gap by factors up to 30.15 when compared with other commonly used off-the-shelf optimizers.

97 MATHEMATICS AND COMPUTING↗

NREL Melds Nature with Nanotech for Solar-Powered Hydrogen Production (Fact Sheet)

NREL researchers are finding ways to mimic photosynthesis by combining enzymes with nanoparticles - particles on the scale of a billionth of a meter - to produce hydrogen directly from water and sunlight. This breakthrough project began in 2008 with scientists and researchers asking how they might learn from nature and develop a synthetic process that is more efficient than plants at converting sunlight to hydrogen. The goal was to find a new way to produce hydrogen that could then be commercialized inexpensively for fuel cells and other uses. Among the various approaches to making hydrogen, the NREL researchers wondered about a hybrid molecular assembly that might pair the best natural molecule with a synthesized nanoparticle. Researchers looked at using hydrogenase enzymes as one part of the equation. These biological catalysts can convert electrons and protons into hydrogen gas, or convert hydrogen into electrons and protons. The choice seemed worthwhile because the hydrogenase enzyme has some intriguing properties: a high substrate selectivity, meaning a very high preference for catalyzing reactions with protons rather than with other atoms and molecules; and fast turnover, which enables it to produce a hydrogen molecule in milliseconds.

08 HYDROGEN↗

LRBOI Tribal Renewable Energy-Final Report

In 2011, a DOE Tribal energy Program first Steps Human Capacity was awarded to the Little River Band of Ottawa Indians (LRBOI). The main purpose of the grant was to increase human capacity of LRBOI, to understand the components of renewable energy and the importance of energy efficiency. This report summarizes the activities, the outcomes, and the lessons learned during this grant.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Summary Report for the Environmental Protection Agency MERL/FRMAC/RAP Mission Alignment Exercise held at the Savannah River Site on June 9-13 2014

From June 9th thru June 13th 2014, members of the Federal Radiological Monitoring and Assessment Center (FRMAC), the Environmental Protection Agency (EPA) and the Department of Energy Radiological Assistance Program (DOE RAP) Region-3 participated in a joint nuclear incident emergency response exercise at the Savannah River Site (SRS) near Aiken, South Carolina. The purpose of this exercise was to strengthen the interoperability relationship between the FRMAC, RAP, and the EPA Mobile Environmental Radiation Laboratory (MERL) stationed in Montgomery, Alabama. The exercise was designed to allowed members of the DOE RAP Region-3 team to collect soil, water, vegetation and air samples from SRS and submit them through an established FRMAC hotline. Once received and processed through the hotline, FRMAC delivered the samples to the EPA MERL for sample preparation and laboratory radiological analysis. Upon completion of laboratory analysis, data was reviewed and submitted back to FRMAC via an electronic data deliverable (EDD). As part of the exercise, an evaluation was conducted to identify gaps and potential improvements in each step of the processes. Additionally, noteworthy practices and potential future areas of interoperability between FRMAC and EPA were acknowledged. The exercise also provided a unique opportunity for FRMAC personnel to observe EPA sample receipt and sample preparation processes and to gain familiarity with the MERL laboratory instrumentation and radiation detection capabilities. The observations and lessons-learned from this exercise will be critical for developing a more efficient, integrated response for future interactions between the FRMAC and EPA assets.

54 ENVIRONMENTAL SCIENCES↗

Center for Advanced Biofuel Systems (CABS) Final Report

One of the great challenges facing current and future generations is how to meet growing energy demands in an environmentally sustainable manner. Renewable energy sources, including wind, geothermal, solar, hydroelectric, and biofuel energy systems, are rapidly being developed as sustainable alternatives to fossil fuels. Biofuels are particularly attractive to the U.S., given its vast agricultural resources. The first generation of biofuel systems was based on fermentation of sugars to produce ethanol, typically from food crops. Subsequent generations of biofuel systems, including those included in the CABS project, will build upon the experiences learned from those early research results and will have improved production efficiencies, reduced environmental impacts and decreased reliance on food crops. Thermodynamic models predict that the next generations of biofuel systems will yield three- to five-fold more recoverable energy products. To address the technological challenges necessary to develop enhanced biofuel systems, greater understanding of the non-equilibrium processes involved in solar energy conversion and the channeling of reduced carbon into biofuel products must be developed. The objective of the proposed Center for Advanced Biofuel Systems (CABS) was to increase the thermodynamic and kinetic efficiency of select plant- and algal-based fuel production systems using rational metabolic engineering approaches grounded in modern systems biology. The overall strategy was to increase the efficiency of solar energy conversion into oils and other specialty biofuel components by channeling metabolic flux toward products using advanced catalysts and sensible design:1) employing novel protein catalysts that increase the thermodynamic and kinetic efficiencies of photosynthesis and oil biosynthesis; 2) engineering metabolic networks to enhance acetyl-CoA production and its channeling towards lipid synthesis; and 3) engineering new metabolic networks for the production of hydrocarbons required to meet commercial fuel standards.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Final Report, DOE Early Career Award: Predictive modeling of complex physical systems: new tools for statistical inference, uncertainty quantification, and experimental design

Predictive simulation of complex physical systems increasingly rests on the interplay of experimental observations with computational models. Key inputs, parameters, or structural aspects of models may be incomplete or unknown, and must be developed from indirect and limited observations. At the same time, quantified uncertainties are needed to qualify computational predictions in the support of design and decision-making. In this context, Bayesian statistics provides a foundation for inference from noisy and limited data, but at prohibitive computional expense. This project intends to make rigorous predictive modeling *feasible* in complex physical systems, via accelerated and scalable tools for uncertainty quantification, Bayesian inference, and experimental design. Specific objectives are as follows: 1. Develop adaptive posterior approximations and dimensionality reduction approaches for Bayesian inference in high-dimensional nonlinear systems. 2. Extend accelerated Bayesian methodologies to large-scale {\em sequential} data assimilation, fully treating nonlinear models and non-Gaussian state and parameter distributions. 3. Devise efficient surrogate-based methods for Bayesian model selection and the learning of model structure. 4. Develop scalable simulation/optimization approaches to nonlinear Bayesian experimental design, for both parameter inference and model selection. 5. Demonstrate these inferential tools on chemical kinetic models in reacting flow, constructing and refining thermochemical and electrochemical models from limited data. Demonstrate Bayesian filtering on canonical stochastic PDEs and in the dynamic estimation of inhomogeneous subsurface properties and flow fields.

97 MATHEMATICS AND COMPUTING↗

Scalable Track Detection in SAR CCD Images

Existing methods to detect vehicle tracks in coherent change detection images, a product of combining two synthetic aperture radar images ta ken at different times of the same scene, rely on simple, fast models to label track pixels. These models, however, are often too simple to capture natural track features such as continuity and parallelism. We present a simple convolutional network architecture consisting of a series of 3-by-3 convolutions to detect tracks. The network is trained end-to-end to learn natural track features entirely from data. The network is computationally efficient and improves the F-score on a standard dataset to 0.988, up fr om 0.907 obtained by the current state-of-the-art method.

47 OTHER INSTRUMENTATION↗

LANL Activities on Mechanistic Approach to Analyzing and Improving Unconventional Hydrocarbon Production

Hydrocarbon production from shale reservoirs is inherently inefficient and challenging since these are low permeability plays. In addition, there is a limited understanding of the fundamentals and the controlling mechanisms, further complicating how to optimize these plays. Herein, we summarize our experimental and computational efforts fully and partially supported by the fundamental shale portfolio to reveal unconventional shale fundamentals and devise development strategies to enhance extraction efficiency with a minimal environmental footprint. Integrating these fundamentals with machine learning, we outline a pathway to improve the predictive power of our models, which enhances the forecast quality of production, thereby improving the economics of operations in unconventional reservoirs. For instance, we have developed science informed workflows and platforms for optimizing pressure-drawdown at a site, which allow operators to make reservoir-management decisions that optimize recovery in consideration of future production. Recently, our work relies on the hybridization of physics-based prediction and machine learning, whereby accurate synthetic data (combined with available site data) can enable the application of machine learning methods for rapid forecasting and optimization. Consequently, the workflow and platform are readily extendable to operations at other sites, plays, and basins.

04 OIL SHALES AND TAR SANDS↗

Physics-guided Machine Learning: from Supervised Deep Networks to Unsupervised Lightweight Models [Slides]

Machine learning yields great potentials in improving imaging performance (i.e., accuracy and efficiency). The incorporation of governing equation will improve generalization and alleviate label scarcity. Employ physical properties can reduce model complexity and significantly save training cost without compromising accuracy. Combining SciML imaging and edge computing would allow broader applications in energy, medicine, and other domains.

97 MATHEMATICS AND COMPUTING↗

A New Era of Discovery: The 2023 Long-Range Plan for Nuclear Science (V.1.2)

Nuclear science is the investigation of how protons and neutrons are formed from elementary particles and how the forces between those particles produce both nuclei and the vast variety of nuclear phenomena that occur in the universe. It has evolved into a broad field that addresses profound scientific questions: Where does the mass of visible matter come from? How do stars ignite, live, and die? How do nuclei illuminate the search for new laws of nature? This science points the way to using nuclei to build new technologies that benefit society. The 2015 Nobel Prize in physics was shared by nuclear physicists Art McDonald and Takaaki Kajita for the discovery of neutrino oscillations, which confirmed that neutrinos have mass. Our progress on big questions like this one since 2015 has been remarkable owing to new experimental tools, theoretical breakthroughs, powerful computational techniques, and the talented people who make these innovations possible. Focusing on these new tools, the Facility for Rare Isotope Beams (FRIB) at Michigan State University is already producing exciting results on decays of never-before-produced isotopes a year after it was completed on time and on budget. The energy upgrade of the Continuous Electron Beam Accelerator Facility (CEBAF) at the Thomas Jefferson National Accelerator Facility (Jefferson Lab) was also completed on schedule and on budget—new data from this facility are revealing the spectrum, structure, and dynamics of protons, neutrons, nuclei, and mesons. On the theory front, we can now calculate the distribution of quarks inside the proton from first principles. The implementation of artificial intelligence (AI) and machine learning (ML) techniques has led to improved data analysis and increased efficiency in running experiments and theoretical calculations. The impact of nuclear science goes beyond expanding the frontiers of knowledge about matter in the universe. We simultaneously develop a STEM work force that advances the security, technology, health, and wealth of our nation. Some connections are obvious. Expert scientists trained to work with radioactive nuclei are in demand in nuclear security arenas and are highly sought after by various government agencies and private industries. Graduate students and postdoctoral fellows (postdocs) obtain extensive computational, modeling, and data science skills that are similarly in high demand. Less obvious but equally important is the connection between these trained scientists and success in other professions, including medicine, energy, and entrepreneurial pursuits. The workforce that enables discovery in nuclear science also makes breakthroughs in technologies with tremendous impact on the nation’s economic advancement.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Identifying and Explaining Anomalous Activity in Surveillance Video with Compression Algorithms

The primary purpose of this document is to outline the progress made on the LDRD titled “Identifying and Explaining Anomalous Activity in Surveillance Video with Compression Algorithms” in FY22 and FY23. In this LDRD, we explored the usage of compression-based analytics to identify anomalous activity in video. We developed a novel algorithm, Spatio-Temporal N-Gram PPM (STNG PPM) that accounts for spatially and temporally aware anomalies in video. We extracted features using motions vectors from video as well as operating on the raw features. STNG PPM is comparable to many deep learning approaches but does not require specialized hardware (GPUs) to run efficiently. We also examine the evaluation metrics and propose novel measures addressing faults in the current evaluation measures.

97 MATHEMATICS AND COMPUTING↗

Deep Learning-based Parameterization of Complex 3D CO2 Saturation Data in Large-scale Geological Carbon Storage

In deep learning (DL), dimension reduction plays a pivotal role in improving training efficiency and minimizing overfitting, especially when working with complex datasets like three-dimensional (3D) saturation data. In the context of geological carbon storage (GCS), 3D saturation data introduces unique challenges due to its sparse nature and sharp transitions at plume boundaries, known as shock fronts. To tackle these challenges, we developed a novel DL framework that combines dimension reduction with advanced 3D reconstruction techniques. Our approach utilizes latent variables derived from 2D average saturation fields to efficiently capture the essential features of high-dimensional data while reducing the number of variables. This enhances both the robustness and accuracy of DL models, making the framework more practical for real-world applications. By offering a tailored solution for modeling complex 3D saturation dynamics, this framework holds significant potential for environmental monitoring, energy storage, and other geological applications.

Wang, Hongsheng [University of Texas at Austin]↗

Gravity Well Commercial Economics Assessment: Potential Revenue and Cost: Cooperative Research and Development (Final Report)

In the Gravity Well Revenue Study, we evaluate the potential revenue from energy storage using historical energy-only electricity prices, forward-looking projections of hourly electricity prices, and actual reported revenue. This analysis examines the impact of storage duration and round-trip efficiency, as well as the location of the storage, on storage revenue within the current and projected U.S. power system. We also investigated the impact of round-trip efficiency on storage revenue. We found that the relationship between storage revenue and round-trip efficiency is nonlinear. The value of improved round-trip efficiency declines as round-trip efficiency increases. In the Gravity Well Future Cost Study, we applied learning curves to predict the future cost trajectory of Gravity Wells (GrWs). Two types of analysis were implemented. The first was a bottom-up analysis that used historical learning rates for cost components, such as motors and gearboxes, and cost categories (e.g., engineering and design, etc.) to determine the learning-by-doing based single-factor learning curve. The single factor learning curve expresses the relationship between the cost of GrW and the number of units deployed (or the cumulative capacity). In the second analysis, we predicted future GrW costs via a top-down approach. This approach accounts for historical cost trends in other renewable energy and storage technologies, which have similarities with GrWs. Using a multifactor learning curve that accounts for both intrinsic (cumulative capacity) and extrinsic (the elasticity in the price of steel) factors, we estimated the future cost of GrWs.

25 ENERGY STORAGE↗

Multi-Scale Modeling and Prototype Development for Electrochemical CO2 Reduction (CRADA Final Report)

In this CRADA project, Lawrence Livermore National Laboratory, Stanford University, SLAC National Laboratory, and TotalEnergies collaboratively executed a multidisciplinary investigation of electrochemical reduction of CO2 to produce sustainable fuels and chemicals. Overall, the project led to an increased understanding of the fundamental processes involved in CO2 electrolysis, from the atomistic scale to the full electrolyzer device scale, ultimately leading to design guidelines for CO2 electrolyzers that will help in their future commercialization. As the model systems, Ag- and Cu-based catalysts were investigated in various forms depending on the electrochemical platform that was utilized to study the activity, selectivity, and durability towards electrochemical CO2 reduction. By employing experimental, theoretical, and computational techniques, the project team experimentally validated multi-physics models, evaluated the experimental levers that lead to increased electrolyzer reaction selectivity and energy efficiency, and used computational optimization to design higher performance electrodes. The learnings of this project were extensively documented in publicly available peer-reviewed journal publications and conference presentations, which serve as a foundation for further work to build from.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Efficient Distributed Sequence Parallelism for Transformer-Based Image Segmentation

We introduce an efficient distributed sequence parallel approach for training transformer-based deep learning image segmentation models. The neural network models are comprised of a combination of a Vision Transformer encoder with a convolutional decoder to provide image segmentation mappings. The utility of the distributed sequence parallel approach is especially useful in cases where the tokenized embedding representation of image data are too large to fit into standard computing hardware memory. To demonstrate the performance and characteristics of our models trained in sequence parallel fashion compared to standard models, we evaluate our approach using a 3D MRI brain tumor segmentation dataset. We show that training with a sequence parallel approach can match standard sequential model training in terms of convergence. Furthermore, we show that our sequence parallel approach has the capability to support training of models that would not be possible on standard computing resources.

Lyngaas, Isaac↗

Influence of Standard Image Processing of 3D X-ray Microscopy on Morphology, Topology and Effective Properties

Estimating porous media properties is a vital component of geosciences and the physics of porous media. Until now, imaging techniques have focused on methodologies to match image-derived flows or geomechanical parameters with experimentally identified values. Less emphasis has been placed on the compromise between image processing techniques and the consequences on topological and morphological characteristics and on computed properties such as permeability. The effects of some of the most popular image processing techniques (filtering and segmentation) available in open source on 3D X-ray Microscopy (micro-XRM) images are qualitatively and quantitatively discussed. We observe the impacts of various filters such as erosion-dilation and compare the efficiency of Otsu’s method of thresholding and the machine-learning-based software Ilastik for segmentation.

58 GEOSCIENCES↗

Modeling the Impact of Baryons on Subhalo Populations with Machine Learning

Here, we identify subhalos in dark matter–only (DMO) zoom-in simulations that are likely to be disrupted due to baryonic effects by using a random forest classifier trained on two hydrodynamic simulations of Milky Way (MW)–mass host halos from the Latte suite of the Feedback in Realistic Environments (FIRE) project. We train our classifier using five properties of each disrupted and surviving subhalo: pericentric distance and scale factor at first pericentric passage after accretion and scale factor, virial mass, and maximum circular velocity at accretion. Our five-property classifier identifies disrupted subhalos in the FIRE simulations with an 85% out-of-bag classification score. We predict surviving subhalo populations in DMO simulations of the FIRE host halos, finding excellent agreement with the hydrodynamic results; in particular, our classifier outperforms DMO zoom-in simulations that include the gravitational potential of the central galactic disk in each hydrodynamic simulation, indicating that it captures both the dynamical effects of a central disk and additional baryonic physics. We also predict surviving subhalo populations for a suite of DMO zoom-in simulations of MW-mass host halos, finding that baryons impact each system consistently and that the predicted amount of subhalo disruption is larger than the host-to-host scatter among the subhalo populations. Although the small size and specific baryonic physics prescription of our training set limits the generality of our results, our work suggests that machine-learning classification algorithms trained on hydrodynamic zoom-in simulations can efficiently predict realistic subhalo populations.

79 ASTRONOMY AND ASTROPHYSICS↗

Assimilating partial observation to enhance feedback control of stochastic dynamical systems

Here, in this paper, we present a novel methodology to tackle feedback optimal control problems in scenarios where the exact state of the controlled process is unknown. It integrates data assimilation techniques and optimal control solvers to manage partial observation of the state process, a common occurrence in practical scenarios. Traditional stochastic optimal control methods assume full state observation, which is often not feasible in real-world fluid dynamics control problems. Our approach underscores the significance of utilizing observational data to inform control policy design. Specifically, we introduce a kernel learning backward stochastic differential equation (SDE) filter to enhance data assimilation efficiency and propose a sample-wise stochastic optimization method within the stochastic maximum principle framework. We demonstrate the efficacy and accuracy of our method in the control of advection-diffusion-reaction flow problem and the Dubins airplane maneuvering problem with model uncertainty.

data driven↗