Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Knowledge constraint”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Predictive Data-driven Platform for Subsurface Energy Production

Subsurface energy activities such as unconventional resource recovery, enhanced geothermal energy systems, and geologic carbon storage require fast and reliable methods to account for complex, multiphysical processes in heterogeneous fractured and porous media. Although reservoir simulation is considered the industry standard for simulating these subsurface systems with injection and/or extraction operations, reservoir simulation requires spatio-temporal “Big Data” into the simulation model, which is typically a major challenge during model development and computational phase. In this work, we developed and applied various deep neural network-based approaches to (1) process multiscale image segmentation, (2) generate ensemble members of drainage networks, flow channels, and porous media using deep convolutional generative adversarial network, (3) construct multiple hybrid neural networks such as convolutional LSTM and convolutional neural network-LSTM to develop fast and accurate reduced order models for shale gas extraction, and (4) physics-informed neural network and deep Q-learning for flow and energy production. We hypothesized that physicsbased machine learning/deep learning can overcome the shortcomings of traditional machine learning methods where data-driven models have faltered beyond the data and physical conditions used for training and validation. We improved and developed novel approaches to demonstrate that physics-based ML can allow us to incorporate physical constraints (e.g., scientific domain knowledge) into ML framework. Outcomes of this project will be readily applicable for many energy and national security problems that are particularly defined by multiscale features and network systems.

58 GEOSCIENCES↗
DOE OSTI2023

EMMA: a new method for computing multiple sequence alignments given a constraint subset alignment

Abstract Background Adding sequences into an existing (possibly user-provided) alignment has multiple applications, including updating a large alignment with new data, adding sequences into a constraint alignment constructed using biological knowledge, or computing alignments in the presence of sequence length heterogeneity. Although this is a natural problem, only a few tools have been developed to use this information with high fidelity. Results We present EMMA (Extending Multiple alignments using MAFFT--add) for the problem of adding a set of unaligned sequences into a multiple sequence alignment (i.e., a constraint alignment). EMMA builds on MAFFT--add, which is also designed to add sequences into a given constraint alignment. EMMA improves on MAFFT--add methods by using a divide-and-conquer framework to scale its most accurate version, MAFFT-linsi--add, to constraint alignments with many sequences. We show that EMMA has an accuracy advantage over other techniques for adding sequences into alignments under many realistic conditions and can scale to large datasets with high accuracy (hundreds of thousands of sequences). EMMA is available at https://github.com/c5shen/EMMA . Conclusions EMMA is a new tool that provides high accuracy and scalability for adding sequences into an existing alignment.

Shen, Chengze↗
DOE OSTI2021

Importance of Engineered and Learned Molecular Representations in Predicting Organic Reactivity, Selectivity, and Chemical Properties

Machine-readable chemical structure representations are foundational in all attempts to harness machine learning for the prediction of reactivities, selectivities, and chemical properties directly from molecular structure. The featurization of discrete chemical structures into a continuous vector space is a critical phase undertaken before model selection, and the development of new ways to quantitatively encode molecules is an active area of research. Here, we highlight the application and suitability of different representations, from expert-guided “engineered” descriptors to automatically “learned” features, in different prediction tasks relevant to organic and organometallic chemistry, where differing amounts of training data are available. These tasks include statistical models of stereo- and enantioselectivity, thermochemistry, and kinetics developed using experimental and quantum chemical data. The use of expert-guided molecular descriptors provides an opportunity to incorporate chemical knowledge, domain expertise, and physical constraints into statistical modeling. In applications to stereoselective organic and organometallic catalysis, where data sets may be relatively small and 3D-geometries and conformations play an important role, mechanistically informed features can be used successfully to obtain predictive statistical models that are also chemically interpretable. We provide an overview of several recent applications of this approach to obtain quantitative models for reactivity and selectivity, where topological descriptors, quantum mechanical calculations of electronic and steric properties, along with conformational ensembles, all feature as essential ingredients of the molecular representations used. Alternatively, more flexible, general-purpose molecular representations such as attributed molecular graphs can be used with machine learning approaches to learn the complex relationship between a structure and prediction target. This approach has the potential to out-perform more traditional representation methods such as “hand-crafted” molecular descriptors, particularly as data set sizes grow. One area where this is particularly relevant is in the use of large sets of quantum mechanical data to train quantitative structure–property relationships. A general approach toward curating useful data sets and training highly accurate graph neural network models is discussed in the context of organic bond dissociation enthalpies, where this strategy outperforms regression using precomputed descriptors. Finally, we describe how graph neural network predictions can be incorporated into mechanistically informed statistical models of chemical reactivity and selectivity. Once trained, this approach avoids the expensive computational overhead associated with quantum mechanical calculations, while maintaining chemical interpretability. We illustrate examples for which fast predictions of bond dissociation enthalpy and of the identities of radicals formed through cleavage of a molecule’s weakest bond are used in simple physical models of site-selectivity and reactivity.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

Path sampling of recurrent neural networks by incorporating known physics

Recurrent neural networks have seen widespread use in modeling dynamical systems in varied domains such as weather prediction, text prediction and several others. Often one wishes to supplement the experimentally observed dynamics with prior knowledge or intuition about the system. While the recurrent nature of these networks allows them to model arbitrarily long memories in the time series used in training, it makes it harder to impose prior knowledge or intuition through generic constraints. In this work, we present a path sampling approach based on principle of Maximum Caliber that allows us to include generic thermodynamic or kinetic constraints into recurrent neural networks. We show the method here for a widely used type of recurrent neural network known as long short-term memory network in the context of supplementing time series collected from different application domains. These include classical Molecular Dynamics of a protein and Monte Carlo simulations of an open quantum system continuously losing photons to the environment and displaying Rabi oscillations. Our method can be easily generalized to other generative artificial intelligence models and to generic time series in different areas of physical and social sciences, where one wishes to supplement limited data with intuition or theory based corrections.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

Optimal Management of Grid-Interactive Efficient Buildings via Safe Reinforcement Learning

Reinforcement learning (RL)-based methods have achieved significant success in managing grid-interactive efficient buildings (GEBs). However, RL does not carry intrinsic guarantees of constraint satisfaction, which may lead to severe safety consequences. Besides, in GEB control applications, most existing safe RL approaches rely only on the regularisation parameters in neural networks or penalty of rewards, which often encounter challenges with parameter tuning and lead to catastrophic constraint violations. To provide enforced safety guarantees in controlling GEBs, this paper designs a physics-inspired safe RL method whose decision-making is enhanced through safe interaction with the environment. Different energy resources in GEBs are optimally managed to minimize energy costs and maximize customer comfort. The proposed approach can achieve strict constraint guarantees based on prior knowledge of a set of developed hard steady-state rules. Simulations on the optimal management of GEBs, including heating, ventilation, and air conditioning (HVAC), solar photovoltaics, and energy storage systems, demonstrate the effectiveness of the proposed approach.

Huo, Xiang↗
DOE OSTI2022

Advocating for view and daylight in buildings: Next steps

With the exponential growth in population and commensurate increased density in urban cities, access to daylight and views to nature is being severely curtailed in buildings. In parallel, increasingly urgent demands to sharply reduce building energy use and associated greenhouse gas emissions are being made to mitigate climate change. There are many challenges and performance tradeoffs associated with the building facade (i.e., daylight and view versus solar and glare control); increased prioritization of health and well-being as a fundamental human requirement could adversely affect building energy-efficiency. Given the current state of knowledge on the effects of daylight and view on health and well-being in buildings, we identify critical needs in research, tools and technologies that if satisfied may enable more effective use of daylight and view in buildings within the constraints of climate change. Lack of knowledge regarding the complex causal mechanisms of window views on human factors is a severely limiting factor in forward progress. Current models and methods to derive bidirectional scattering distribution functions (BSDFs) will need to be modified. Developers of energy-efficient window technologies will need more guidance to shape product development. Advanced window technologies and integrated design can enable attainment of both health and well-being and net zero energy goals, but considerable work will be needed to make such options turnkey and broadly available.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2023

Geophysical Constraints on Decarbonized Systems—Building Spatio-Temporal Uncertainties into Future Electricity Grid Planning

Future electricity grids will be characterized by the high penetration of renewables to support the decarbonization process. Yet, this transition will further expose grids to a broad spectrum of geophysical forces, such as weather and climate, land and space, minerals and materials. Understanding their role is thus important to support the grid decarbonization process. Here, we synthesize the current body of knowledge on the relationship between geophysical constraints and electricity grid planning. Additionally, we show that there have been promising advances in the data, methods, and modelling tools needed to incorporate the effect of geophysical constraints on demand, resource availability, and grid operations. There are, however, multiple research avenues that deserve further attention. More system-specific and finer-scale analyses are necessary to better understand how spatio-temporal variability---and associated uncertainty---in geophysical forces affect grid planning. Moreover, we need a broader focus on the multi-sectoral implications of grid decarbonization efforts, so as to limit the risk of unintended consequences. Importantly, all these efforts are challenged by the computational requirements of existing power system models, which often limit our ability to characterize uncertainty, scale analyses across larger domains, or study the multi-sector implications of grid expansion decisions.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

Refining localtype primordial non-Gaussianity: Sharpened bϕ constraints through bias expansion

Local-type primordial non-Gaussianity (PNG), predicted by many nonminimal models of inflation, creates a scale-dependent contribution to the power spectrum of large-scale structure tracers. Its amplitude is characterized by the product bϕfNLloc, where bϕ is an astrophysical parameter dependent on the properties of the tracer. However, bϕ exhibits significant secondary dependence on halo concentration and other astrophysical properties, which may bias and weaken the constraints on fNLloc. In this work, we demonstrate that incorporating knowledge of the relation between Lagrangian bias parameters and bϕ can significantly enhance PNG constraints. We employ the hybrid effective field theory approach at the field level and a linear regression model to seek a connection between the bias parameters and bϕ for halo and galaxy samples, constructed using the abacussummit simulation suite and mimicking the luminous red galaxies and quasistellar objects of the Dark Energy Spectroscopic Instrument survey. For the fixed-mass halo samples, our full bias model reduces the uncertainty by more than 70%, with most of that improvement coming from b∇, which we find to be an excellent proxy for concentration. For the galaxy samples, our model reduces the uncertainty on bϕ by 80% for all tracers. By adopting Lagrangian-bias informed priors on the parameter bϕ, future analyses can thus constrain fNLloc with less bias and smaller errors.

Hadzhiyska, Boryana↗
DOE OSTI2020

Optimal carbon storage reservoir management through deep reinforcement learning

Model-based optimization plays a central role in energy system design and management. The complexity and high-dimensionality of many process-level models, especially those used for geosystem energy exploration and utilization, often lead to formidable computational costs when the dimension of decision space is also large. This work adopts elements of recently advanced deep learning techniques to solve a sequential decision-making problem in applied geosystem management. Specifically, a deep reinforcement learning framework was formed for optimal multiperiod planning, in which a deep Q-learning network (DQN) agent was trained to maximize rewards by learning from high-dimensional inputs and from exploitation of its past experiences. To expedite computation, deep multitask learning was used to approximate high-dimensional, multistate transition functions. Both DQN and deep multitask learning are pattern based. As a demonstration, the framework was applied to optimal carbon sequestration reservoir planning using two different types of management strategies: monitoring only and brine extraction. Both strategies are designed to mitigate potential risks due to pressure buildup. Results show that the DQN agent can identify the optimal policies to maximize the reward for given risk and cost constraints. Finally, experiments also show that knowledge the agent gained from interacting with one environment is largely preserved when deploying the same agent in other similar environments.

15 GEOTHERMAL ENERGY↗
DOE OSTI2020

Hybrid real- and reciprocal-space full-field imaging with coherent illumination

In this work, we present a novel diffractive imaging method that harnesses a low-resolution real-space image to guide the phase retrieval. A computational algorithm is developed to utilise such prior knowledge as a real-space constraint in the iterative phase retrieval procedure. Numerical simulations and proof-of-concept experiments are carried out, demonstrating our method's capability of reconstructing high-resolution details that are otherwise inaccessible with traditional phasing algorithms. With the present method, we formulate a conceptual design for the coherent imaging experiments at a next-generation x-ray light source.

42 ENGINEERING↗
DOE OSTI2023

Electrochemical Reduction of Flue Gas Carbon Dioxide to Commercially Viable C2-C4 Products (Final Report)

This is the final scientific/technical report for a DOE project focused on the electrochemical conversion of CO 2 in non-aqueous solvents to novel products. Electrochemical reduction of CO 2 provides an attractive route to produce valuable fuels and chemicals that can simultaneously lower greenhouse gas emissions when powered by renewable electricity. While recent technological advances have shown the feasibility of industrial CO 2 electroreduction, many challenges remain to improve this technology and expand the list of economically viable products. The vast majority of electrochemical CO 2 reduction research has been conducted in aqueous media under neutral to alkaline conditions, leading to commonly reported products including carbon monoxide, formic acid, methane, methanol, ethylene, acetic acid, and ethanol. In comparison, non-aqueous media for CO 2 reduction has been underexplored but represents a possible avenue to yield new products and improved operating conditions. The aim of the project was to convert waste CO 2 in the form of flue gas to a multicarbon C2 - C4 chemical product in a reactor designed to achieve economically competitive values of current density and selectivity. The project strived to advance the technology readiness of an electrochemical CO 2 reduction process in alcohol solvents from the proof-of-concept stage to a device capable of meeting performance metrics for commercial viability. In the initial plan, the University of Louisville researchers were to focus on investigating the electrochemical process and improving the faradaic efficiency for novel C2 – C4 species, while also working on a parallel effort to build a practical electrolysis reactor to markedly increase the CO 2 reduction current density. The reactor development effort also aimed to engineer a dual-electrolyte feed strategy with non-aqueous catholyte and aqueous anolyte to promote water oxidation as the coupling anodic half-reaction to enable a sustainable and economical overall process. At the outset, the University of North Dakota was to investigate the feasibility of operating directly from coal-derived flue gas without separate capture and purification. The research team sought to determine impurity effects and test mitigation strategies, as well as engineer the gaseous feed system for high reactor tolerance to lower CO 2 concentration. In the last half year of the project, the focus was planned to shift to integrating the advances in the catalysis, electrochemical conditions, reactor design, and flue gas compatibility into a fully functional device and improve it for maximum current density and faradaic efficiency for C2 – C4 species. Knowledge of the full system components, constraints, and maximum performance was then to be used as the basis for a thorough technoeconomic analysis (TEA) and life cycle analysis (LCA) at the end of the project.

01 COAL, LIGNITE, AND PEAT↗
DOE OSTI2022

Nonnegative canonical tensor decomposition with linear constraints: nnCANDELINC

Abstract There is an emerging interest for tensor factorization applications in big‐data analytics and machine learning. To speed up the factorization of extra‐large datasets, organized in multidimensional arrays (also known as tensors), easy to compute compression‐based tensor representations, such as, Tucker and tensor train formats, are used to approximate the initial large‐tensor. Further, tensor factorization is used to extract latent features that can facilitate discoveries of new mechanisms and signatures hidden in the data, where the explainability of the latent features is of principal importance. Nonnegative tensor factorization extracts latent features that are naturally sparse and parts of the data, which makes them easily interpretable. However, to take into account available domain knowledge and subject matter expertise, often additional constraints need to be imposed, which lead us to canonical decomposition with linear constraints (CANDELINC), a canonical polyadic decomposition with rank deficient factors. In CANDELINC, Tucker compression is used as a preprocessing step, which lead to a larger residual error but to more explainable latent features. Here, we propose a nonnegative CANDELINC (nnCANDELINC) accomplished via a specific nonnegative Tucker decomposition; we refer to as minimal or canonical nonnegative Tucker. We derive several results required to understand the specificity of nnCANDELINC, focusing on the difficulties of preserving the nonnegative rank of a tensor to its Tucker core and comparing the real valued to nonnegative case. Finally, we demonstrate nnCANDELINC performance on synthetic and real‐world examples.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Off-the-shelf deep learning is not enough, and requires parsimony, Bayesianity, and causality

Abstract Deep neural networks (‘deep learning’) have emerged as a technology of choice to tackle problems in speech recognition, computer vision, finance, etc. However, adoption of deep learning in physical domains brings substantial challenges stemming from the correlative nature of deep learning methods compared to the causal, hypothesis driven nature of modern science. We argue that the broad adoption of Bayesian methods incorporating prior knowledge, development of solutions with incorporated physical constraints and parsimonious structural descriptors and generative models, and ultimately adoption of causal models, offers a path forward for fundamental and applied research.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Genomes to ecosystem function: Targeting critical knowledge gaps in methanogenesis and translation to updated global biogeochemical models

Natural freshwater temperate wetland systems currently represent the largest natural source of atmospheric methane, but are relatively understudied using systems biology tools (e.g. meta-omics) compared to other high producing methane systems (e.g. peat, tropical, or reconstructed wetlands). Using field investigations at the NOAA operated sentinel site on Lake Erie, methane producing activities and responses to geochemical conditions will be determined along seasonal and spatial gradients (Objective 1). Here, a combination of high-throughput activity and gas measurements, combined with high-resolution systems biology and analytical methods, will provide in depth knowledge of the microbiological, chemical, and physical constraints on methane production in wetlands. Using laboratory microcosms, the formation of anoxic microsites and their capacity to facilitate methane production in wetland soils will be simulated (Objective 2). This objective will validate the findings from the field investigations, offering a more controlled environment for teasing out the role of different yet interrelated variables. Lastly, these field and laboratory data will be used for multi-scale, process-level evaluation of an ecosystem biogeochemical model that accommodates these newly identified processes and parameterizes representation of these processes along relevant environmental gradients (Objective 3).This research will identify multiple interacting geochemical, ecological, and metabolic constraints that are poorly understood, oversimplified, or missing in global biogeochemical methane models. This proposal targets the role of oxygen limitation on methane processes in soil domains, to improve reactive transport models of microbial carbon cycling across terrestrial-aquatic soils and generate data on nutrient cycling activities in Great Lake wetlands. This information could provide new insights into the microbial controllers of Lake Erie eutrophication.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

Application of FARM to an IES scenario within the FORCE ecosystem

The FARM (Feasible Actuator Range Modifier) software module is a component of the RAVEN-based FORCE framework for analysis of Integrated Energy Systems (IES). FARM supports the HERON software module in the evaluation of the optimal dispatch by evaluating feasible set-points for the different IES unit components. Set-points are required to satisfy limits on both production variables (i.e., the variables to be optimized such as the electrical power, the hydrogen production rate, etc.) and process variables tied to the service life of equipment (e.g., steam flowrate, vessel pressure, turbine firing temperature, etc.). This problem is addressed by adopting a two-stage approach. First, the HERON power dispatcher determines set-points that meet the constraints on the former variables (e.g., power levels and power ramp rate limits). These constraints are called explicit constraints. Then, FARM adjusts these set-points to ensure the respect of the limits on the latter variables given the knowledge of the system physics acquired through machine learning algorithms. These constraints are called implicit constraints. From this standpoint, FARM constitutes a bridge between the HERON power dispatcher that adopts a simplified description of the IES unit (low-resolution physics) and the HYBRID high-fidelity models (high-resolution physics). The original version of the FARM software module (FARM-Alpha) was released by Argonne National Laboratory in January 2021. In the latest version of the code released in July 2022 (FARM-Delta), the Reference Governor (RG) algorithm was upgraded to a Multi-Input Multi-Output version from its original Single-Input Single-Output form. The RG algorithm acts to enforce constraints. With this improvement an IES unit is now treated as a single dynamic system from the standpoint of control. The crosstalk among components in an IES unit is now fully considered thereby ensuring a true optimization is obtained for those units that have multiple set-points. In this report, the capabilities of FARM-Delta operating within the FORCE ecosystem are demonstrated for an IES test case. The specific configuration of IES unit for this case was selected by the IES team with consultation from the Advanced Reactor IES Expert Group. A full TEA analysis that invoked HERON, HYBRID, FARM, and RAVEN was performed and serves to demonstrate how the latest modification to FARM algorithms (i.e., state variable selection, state-space matrices derivation, set-point verification) can shape setpoints that might otherwise compromise the health of equipment through accelerated wear and tear. In this specific test case, it was demonstrated that these algorithms ensure a more efficient utilization of steam resources to be shared by two different subsystems, namely Balance of Plant (BOP) and High-Temperature Steam Electrolysis (HTSE). Finally, some code improvements that can further enhance the user-friendliness are suggested.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Valued peaks: Sustainable water allocation for small hydropower plants in an era of explicit ecological needs

Optimizing hydropower operations to balance economic profitability and support functioning ecosystem services is integral to river management policy. In this article, we propose a dynamic, constrained optimization framework for small hydropower plants (SHPs) to evaluate trade-offs between economic profitability and socio-ecological requirements. Specifically, we examine the balance between short-term losses in hydropower generation and the potential for compensatory benefits in the form of revenue from recreational ecosystem services, irrespective of the direct beneficiary. Our framework integrates a fish habitat model, a hydropower optimization model, and a recreational ecosystem service estimate to evaluate different environmental flow scenarios. The optimization process gives three outflow release scenarios, informed by previous streamflow realisations (dam inflow), and designed environmental flow constraints. The framework is applied and tested for the river Kuusinkijoki in North-eastern Finland, which is a habitat for migratory brown trout and grayling populations. We show that the revenue loss due to the environmental flow constraints arises through a reduction in revenue per generated energy unit and through a reduction in turbine efficiency. Additionally, the simulation results reveal that all the designed environmental flow constraints cannot be met simultaneously. Under the environmental flow scenario with both minimum flow and flow ramping rate constraints, the annual hydropower revenue decreases by 16.5 %. An annual increase of 8 % in recreational fishing visits offsets the revenue loss. In conclusion, the developed framework provides knowledge of the costs and benefits of hydropower environmental flow constraints and guides the prioritizing process of environmental measures.

13 HYDRO ENERGY↗
DOE OSTI2024

FARM User Guidance and Instructions

The FARM (Feasible Actuator Range Modifier) module is a component of the RAVEN-based FORCE framework for the analysis of Integrated Energy Systems (IES). FARM aids HERON in the solution of the power dispatch problem by evaluating feasible set-point signals to be issued to the control systems of the different IES unit components. Set-points need to satisfy limits on both production variables (i.e., the variables to be optimized such as the electrical power, etc.) and process variables tied to the service life of equipment (e.g., steam flowrate, vessel pressure, turbine firing temperature, etc.). To enforce all these limits, a two-stage approach is adopted. First, the power dispatcher algorithm in HERON module estimates set-points that meet the constraints on the production variables, e.g., power levels and power ramp rate limits. These constraints are called explicit constraints. Then, if necessary, FARM adjusts these set-points to ensure the respect of the limits on the process variables of interest, given the knowledge of the system dynamics acquired through machine learning algorithms. These constraints are called implicit constraints. From this standpoint, FARM constitutes a bridge between the HERON power dispatcher that adopts a simplified description of the IES unit (low-resolution physics) and the HYBRID high-fidelity models (high-resolution physics). In this report, the general workflow and the software requirements of FARM module are summarized, and the detailed instructions for installing FARM software, running built-in example cases, deriving Linear Parameter-Varying (LPV) state-space models, and using FARM for user-defined power dispatch problems are provided.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗