Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Games”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Bioaccumulation of Mercury and Radiocesium in Waterfowl Introduced to a Site with Legacy Contamination

Despite the propensity of waterfowl species to readily accumulate anthropogenic contaminants within polluted environments, few studies have examined bioaccumulation rates over time when entering such a contaminated site. We examined mercury (Hg) and radiocesium ( 137 Cs) bioaccumulation over time in two waterfowl species released into a wetland system containing legacy contamination on the US Department of Energy's Savannah River Site in South Carolina. Released birds were collected at select time intervals over an exposure period of 94 days. We quantified total Hg concentrations in blood, muscle, and liver tissues, and 137 Cs activity in whole-body and muscle tissues. The relationship between the contaminant burdens of different body tissue types was examined over time. Likely a result of microhabitat selection, mallards in our study readily accumulated both Hg and 137 Cs at consistent rates over time within our study system, while ring-neck ducks did not. The findings demonstrated that whole blood can be used as a robust, nondestructive sampling alternative to estimate Hg burdens within muscle and liver, and whole-body 137 Cs activity is a good predictor of muscle burdens. Understanding such bioaccumulation information in waterfowl is useful for the assessment of the potential health risk in wildlife, as well as being important for human risk assessment toward the consumption of popular game species. Environ Toxicol Chem 2022;41:2479–2487. © 2022 The Authors. Environmental Toxicology and Chemistry published by Wiley Periodicals LLC on behalf of SETAC.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2024

Shortest path network interdiction with asymmetric uncertainty

Abstract This paper considers an extension of the shortest path network interdiction problem that incorporates robustness to account for parameter uncertainty. The shortest path interdiction problem is a game of two players with conflicting agendas and capabilities: an evader, who traverses the arcs of a network from a source node to a sink node using a path of shortest length, and an interdictor, who maximizes the length of the evader's shortest path by interdicting arcs on the network. It is usually assumed that the parameters defining the network are known exactly by both players. We consider the situation where the evader assumes the nominal parameter values while the interdictor uses robust optimization techniques to account for parameter uncertainty or sensor degradation. We formulate this problem as a nonlinear mixed‐integer semi‐infinite bilevel program and show that it can be converted into a mixed‐integer linear program with a second order cone constraint. We use random geometric networks and transportation networks to perform computational studies and demonstrate the unique decision strategies that our variant produces. Solving the shortest path interdiction problem with asymmetric uncertainty protects the interdictor from investing in a strategy that hinges on key interdictions performing as promised. It also provides an alternate strategy that mitigates the risk of these worst‐case possibilities.

Punla‐Green, She'ifa Z.↗
DOE OSTI2025

Ca X ML: Chemistry‐informed machine learning explains mutual changes between protein conformations and calcium ions in calcium‐binding proteins using structural and topological features

Proteins' flexibility is a feature in communicating changes in cell signaling instigated by binding with secondary messengers, such as calcium ions, associated with the coordination of muscle contraction, neurotransmitter release, and gene expression. When binding with the disordered parts of a protein, calcium ions must balance their charge states with the shape of calcium-binding proteins and their versatile pool of partners depending on the circumstances they transmit. Accurately determining the ionic charges of those ions is essential for understanding their role in such processes. However, it is unclear whether the limited experimental data available can be effectively used to train models to accurately predict the charges of calcium-binding protein variants. Here, we developed a chemistry-informed, machine-learning algorithm that implements a game theoretic approach to explain the output of a machine-learning model without the prerequisite of an excessively large database for high-performance prediction of atomic charges. We used the ab initio electronic structure data representing calcium ions and the structures of the disordered segments of calcium-binding peptides with surrounding water molecules to train several explainable models. Network theory was used to extract the topological features of atomic interactions in the structurally complex data dictated by the coordination chemistry of a calcium ion, a potent indicator of its charge state in protein. Our design created a computational tool of Ca X ML, which provided a framework of explainable machine learning model to annotate ionic charges of calcium ions in calcium-binding proteins in response to the chemical changes in an environment. Our framework will provide new insights into protein design for engineering functionality based on the limited size of scientific data in a genome space.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

Unveiling User Behavior on Summit Login Nodes as a User

We observe and analyze usage of the login nodes of the leadership class Summit supercomputer from the perspective of an ordinary user—not a system administrator—by periodically sampling user activities (job queues, running processes, etc.) for two full years (2020–2021). Our findings unveil key usage patterns that evidence misuse of the system, including gaming the policies, impairing I/O performance, and using login nodes as a sole computing resource. Our analysis highlights observed patterns for the execution of complex computations (workflows), which are key for processing large-scale applications.

Wilkinson, Sean↗
DOE OSTI2023

Stochastic projective splitting

Here, we present a new, stochastic variant of the projective splitting (PS) family of algorithms for inclusion problems involving the sum of any finite number of maximal monotone operators. This new variant uses a stochastic oracle to evaluate one of the operators, which is assumed to be Lipschitz continuous, and (deterministic) resolvents to process the remaining operators. Our proposal is the first version of PS with such stochastic capabilities. We envision the primary application being machine learning (ML) problems, with the method’s stochastic features facilitating “mini-batch” sampling of datasets. Since it uses a monotone operator formulation, the method can handle not only Lipschitz-smooth loss minimization, but also min–max and noncooperative game formulations, with better convergence properties than the gradient descent-ascent methods commonly applied in such settings. The proposed method can handle any number of constraints and nonsmooth regularizers via projection and proximal operators. We prove almost-sure convergence of the iterates to a solution and a convergence rate result for the expected residual, and close with numerical experiments on a distributionally robust sparse logistic regression problem.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Advancing Fusion with Machine Learning Research Needs Workshop Report

Abstract Machine learning and artificial intelligence (ML/AI) methods have been used successfully in recent years to solve problems in many areas, including image recognition, unsupervised and supervised classification, game-playing, system identification and prediction, and autonomous vehicle control. Data-driven machine learning methods have also been applied to fusion energy research for over 2 decades, including significant advances in the areas of disruption prediction, surrogate model generation, and experimental planning. The advent of powerful and dedicated computers specialized for large-scale parallel computation, as well as advances in statistical inference algorithms, have greatly enhanced the capabilities of these computational approaches to extract scientific knowledge and bridge gaps between theoretical models and practical implementations. Large-scale commercial success of various ML/AI applications in recent years, including robotics, industrial processes, online image recognition, financial system prediction, and autonomous vehicles, have further demonstrated the potential for data-driven methods to produce dramatic transformations in many fields. These advances, along with the urgency of need to bridge key gaps in knowledge for design and operation of reactors such as ITER, have driven planned expansion of efforts in ML/AI within the US government and around the world. The Department of Energy (DOE) Office of Science programs in Fusion Energy Sciences (FES) and Advanced Scientific Computing Research (ASCR) have organized several activities to identify best strategies and approaches for applying ML/AI methods to fusion energy research. This paper describes the results of a joint FES/ASCR DOE-sponsored Research Needs Workshop on Advancing Fusion with Machine Learning, held April 30–May 2, 2019, in Gaithersburg, MD (full report available at https://science.osti.gov/-/media/fes/pdf/workshop-reports/FES_ASCR_Machine_Learning_Report.pdf ). The workshop drew on broad representation from both FES and ASCR scientific communities, and identified seven Priority Research Opportunities (PRO’s) with high potential for advancing fusion energy. In addition to the PRO topics themselves, the workshop identified research guidelines to maximize the effectiveness of ML/AI methods in fusion energy science, which include focusing on uncertainty quantification, methods for quantifying regions of validity of models and algorithms, and applying highly integrated teams of ML/AI mathematicians, computer scientists, and fusion energy scientists with domain expertise in the relevant areas.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2025

Global lessons: a comparative analysis of nuclear gamification's impact in American and British students

The global nuclear skills shortage demands urgent educational investment, particularly for students aged 11–18. To help address this, we have introduced RAD Ratings, an interactive card game designed to improve the teaching of nuclear concepts to students, which includes subjects such as half-lives, types of radiation, and radionuclide applications. RAD Ratings has already been successfully piloted in the United Kingdom and in this paper, we present a comparison in selected American schools for the first time. Snapshot survey results show RAD Ratings improve interest in nuclear science and careers, offering insights into gamification’s potential to improve engagement across different geographic locations.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗
DOE OSTI2024

A new database of building-space-specific internal loads and load schedules for performance based code compliance modeling of commercial buildings

Building-level loads and load profiles prescribed by current modeling rules save modelers time and avoid gaming during whole building performance modeling. However, recent studies show that they sometimes insufficiently capture the entire building performance due to the varied loads and load profiles for different space types. As a solution to this issue, this paper develops a database of building-space-specific loads and load profiles used in code compliance modeling. The existing sets of loads and load profiles are reviewed and the challenges behind using them for specific research topics are discussed. Then, the proposed method to develop the building-space-specific loads and load profiles is introduced. After that, the database for these building-space-specific loads and load profiles is presented. In addition, one case is studied to demonstrate the applications of these loads and load profiles. In this case study, three methods are used to develop building energy models: space-specific (using knowledge of the distribution and location of space types and applying the space-specific data in the developed database), building-level (assuming a lack of knowledge of the space types and using the building-level data in the developed database), and calculated-ratio (assuming knowledge of the distribution of space types but not their locations and calculating weighted average values based on the space-specific data in the developed database). Finally, the energy results simulated by using these three methods are compared, which show building-level methods can produce energy results up to 20% different than the space-specific methods. Finally, this paper discusses the application scope and maintenance of this new database.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2021

Urban cells: Extending the energy hub concept to facilitate sector and spatial coupling

The rapid growth of urban areas and concerns over climate change make it vital to improve the energy sustainability of cities. Understanding the complex interactions within different sectors (sectoral) and localities (spatial) of cities plays a crucial role in improving efficiency and sustainability, which is extremely challenging due to the complex urban morphology. State-of-the-art energy concepts do not facilitate a detailed consideration of both sectoral and spatial coupling that energy infrastructure maintains at the urban scale. This has become a significant challenge when designing interconnected urban energy infrastructure. The Urban Cell concept is introduced to address this bottleneck. A novel computational model using a modular approach is introduced to create an interconnected urban infrastructure, including the energy, building, and transportation sectors. Optimal sizing of the distributed energy system (including renewables, energy storage, and dispatchable sources) and optimal urban morphology is determined within a modular unit. A game-theoretic approach is used to model the interactions between urban cells (modular units). The study revealed that the urban cell concept can reduce the net present value of the interconnected energy infrastructure by 37% while increasing the installed renewable energy capacity by 25%. This demonstrates the benefit potential of urban cells and the importance of considering interactions between different sectors and different parts within a city. The Urban Cell concept can be used to present the complex interactions maintained within a city.

Perera, ATD↗
DOE OSTI2020

Portable interactive visualization of large-scale simulations in geotechnical engineering using Unity3D

Development in large-scale geotechnical engineering simulation places tremendous demand for efficient visualization of such simulation data. This study presents a lightweight software tool, i.e. Geotechnical Interactive Visualization (GIV), as a solution to this challenge, which achieves efficient interactive visualization of large-scale simulations data in geotechnical engineering. Visualization data flow and algorithms specifically optimized for common geotechnical engineering applications are implemented in GIV. GIV can visualize geotechnical structure models with time-varying attributes attached to mesh with fixed topology, and also models with time-varying mesh topologies but no attributes attached, the two most common visualization tasks in geotechnical engineering. Furthermore, challenges for large-scale simulation data visualization, including parallel simulation data redundancy, massive data size, dynamic user interaction, and portability are overcome via specifically designed algorithms for simulation data preprocessing and optimized visualization modules using the powerful 3D rendering and interactive game engine Unity3D. Comparison of GIV with several widely used visualization tools for the visualization of large-scale idealized datasets and realistic geotechnical simulations highlights the visualization efficiency, smooth interactivity, and lightweight features of GIV.

42 ENGINEERING↗
DOE OSTI2022

Introduction to the special section on learning and security for multi-agent systems

This report features six articles that provide an overview of the emerging research topics at the intersection learning, security, and multi-agent systems. Recent years have witnessed a surge in the number of works at their intersections, and they have appeared in system and control communities as well as many other communities in artificial intelligence, cyber–physical systems, and economics. The articles in this special section give accessible and comprehensive tutorials and surveys for a broad systems and control audience, covering topics including adversarial machine learning, multi-agent reinforcement learning, cyber resilience, resilient control systems, and game design. It is hopeful that this special section will spawn future interest and cross-disciplinary collaborations in this emerging transdisciplinary research area.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Uncertainty quantification and optimization of precipitating hydrometeor parameters for winter precipitation in a cloud microphysics scheme

The precipitating hydrometeor parameters used in cloud microphysics schemes carry inherent uncertainties. The quantification of these uncertainties, together with parameter optimization, can significantly improve precipitation forecasts. This study investigates the effects of 13 parameters in the Weather Research and Forecasting (WRF) Double-Moment 6-class (WDM6) microphysics scheme, which define the hydrometeor characteristics such as fall velocity–diameter and mass–diameter relationships, as well as the shape parameter of the drop size distribution for precipitating particles such as rain, snow, and graupel on simulated winter precipitation. A comparison between the model's pre-defined parameters and observations from the International Collaborative Experiments for the PyeongChang 2018 Olympic and Paralympic winter games (ICE-POP 2018) field campaign reveals that the fall velocity–diameter relationship for rain, the mass–diameter relationships for snow and graupel, and the shape parameters for all precipitating particles in the WDM6 scheme deviate from the median values observed by the two-dimensional video disdrometer (2DVD). To quantify parameter sensitivities, a perturbed parameter ensemble (PPE) of 256 simulations was conducted within parameter ranges constrained by 2DVD observations for three winter precipitation cases. Bayesian optimization was then applied to identify parameter sets that minimized the root mean square error (RMSE) for each case, achieving reductions of up to 30.2 %. These results demonstrate that ensemble-based uncertainty quantification and parameter optimization can help identify key parameters and provide a pathway to improving precipitation simulation performance. In addition, measurement sites can be strategically selected based on regions that show high sensitivity to variations in hydrometeor characteristic parameters.

Bayesian optimization↗
DOE OSTI2023

Reinforcement learning building control approach harnessing imitation learning

Reinforcement learning (RL) has shown significant success in sequential decision making in fields like autonomous vehicles, robotics, marketing and gaming industries. This success has attracted the attention to the RL control approach for building energy systems which are becoming complicated due to the need to optimize for multiple, potentially conflicting, goals like occupant comfort, energy use and grid interactivity. However, for real world applications, RL has several drawbacks like requiring large training data and time, and unstable control behavior during the early exploration process making it infeasible for an application directly to building control tasks. To address these issues, an imitation learning approach is utilized herein where the RL agents starts with a policy transferred from accepted rule based policies and heuristic policies. This approach is successful in reducing the training time, preventing the unstable early exploration behavior and improving upon an accepted rule-based policy - all of these make RL a more practical control approach for real world applications in the domain of building controls.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2023

Inverse reinforcement learning control for building energy management

Reinforcement learning (RL) based control is widely considered a promising approach in building automation and control as it has demonstrated the potential to deal with complex objectives in adjacent domains like robotics, autonomous vehicles, gaming applications, and advertisement recommendations. When applied to any environment, model-free RL learns to improve its control performance over time without requiring a control model, by receiving and then analyzing feedback from the building environment after each control action. Operational objectives are becoming increasingly complex through the simultaneous consideration of thermal comfort, carbon emissions, grid services, and indoor air quality. In this context, conventional rule-based control approaches are proving sub-optimal, mostly heuristic, and inadequate. The model-free and self learning nature of RL appears promising and attractive as it may address the scalability issues associated with advanced control approaches. However, it suffers from long training times and unstable control behavior during the early stages of its learning process, which makes it unsuitable to be applied directly to buildings. This paper addresses these issues using an inverse reinforcement learning approach (IRL), a technique utilized to learn the objective of a controller agent which is considered an expert in its respective domain. Here, we consider a rule-based control as the expert demonstrator. IRL is different from a direct imitation (i.e., direct mapping of states to actions) of control actions as it tries to find the underlying intent of an expert's policy, providing the controller with a better-generalized policy for unseen states or environments with slightly different dynamics. This approach propels the RL controller's policy to levels similar to or better than that of a rule-based policy before it starts learning by interacting with the building. This makes RL for building energy management applications more practical as it prevents the erratic and exploratory behavior in the initial training period, simultaneously speeding up the learning process when compared to applying an untrained RL agent directly to a building environment.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2024

A hierarchical framework for aggregating grid-interactive buildings with thermal and battery energy storage

The behind-the-meter (BTM) thermal and battery energy storage can help improve energy efficiency, reduce energy costs, and enhance energy resilience, particularly in rural areas and for disadvantaged communities. Aggregating numerous BTM energy storage systems can act as a price influencer with a significant source of load shifting and peak demand reduction. An integrated and scalable control mechanism is required to effectively utilize energy storage systems and flexible building loads to maximize the economic benefits, considering various distribution system constraints. Here, this paper presents an innovative hierarchical coordination framework for energy storage and flexible load in buildings, considering various factors such as electricity prices, thermal comfort, and distribution system modeling and constraints. At the upper level, a distribution system operator optimizes the power flow to minimize its power procurement costs from the electricity wholesale market, while at the lower level, aggregators determine the optimal dispatch of battery and thermal energy storage systems in multiple buildings on behalf of end-users to minimize operating costs according to the power prices. These problems are solved using a game-theoretic approach through negotiations between the distribution system operator and aggregators as a bi-level decision model. Simulation case studies have been performed for a test distribution network with a number of building end-users using energy storage systems to quantify the performance of aggregators. The results demonstrate that the proposed strategy can reduce peak load for a reliable electricity distribution network while saving electricity bills for customers.

25 ENERGY STORAGE↗
DOE OSTI2021

Probing the electrolyte/electrode interface with vibrational sum frequency generation spectroscopy: A review

Over the past decades, Lithium-ion batteries have seen extensive improvements, and as a result are now the primary choice in many applications for their power, energy, and durability. In recent years, battery cost has reduced by orders of magnitude through adoption of new materials and processes. Despite these advances, interfaces in these battery systems are yet to be fully understood. This is seen as a major limitation to further increase cycle life, calendar life, abuse tolerance, and performances. A major obstacle is a lack of comprehensive understanding of the complex dynamic chemical processes occurring at the electrolyte/electrode interface. In this context, vibrational sum frequency generation (vSFG) spectroscopy possesses the unique capability of probing a molecularly thin interfacial layer to obtain molecular-level information through nonlinear optical interaction. Probing the molecular level processes at the interfaces using such a versatile technique would be a game changer in the advancement of current battery research knowledge. This review article summarizes recent vSFG studies on the electrolyte/electrode interface of various electrode materials and nonaqueous electrolytes for LIBs and discusses future research perspectives. Finally, overall, this focused review highlights the advantages and versatility of vSFG that can be used to further advance present-day battery research.

25 ENERGY STORAGE↗
DOE OSTI2024

Machine learning-guided design of direct methanol fuel cells with a platinum group metal-free cathode

Direct methanol fuel cells (DMFCs) offer a promising solution for clean electricity generation, particularly in small electronics and remote auxiliary power units. However, optimizing their efficiency and performance is challenging due to the complex interactions between various factors. Here, we present a novel approach that integrates experiments with machine learning to model and predict the performance of these fuel cells using atomically dispersed platinum group metal (PGM)-free catalysts at the cathode. Further, our machine learning models, trained on diverse input parameters, allow for the comprehensive optimization of DMFC performance prior to fabrication and testing. Through extensive experimental validation, we demonstrate that this data-driven approach accurately predicts key performance metrics, such as maximum power output and polarization curves. By combining our models with interpretable game-theory methods, we provide deep insights into the factors governing fuel cell performance, ultimately paving the way for the design of scalable and efficient DMFC technologies.

25 ENERGY STORAGE↗
DOE OSTI2020

Tailoring conductive networks within hollow carbon nanospheres to host phosphorus for advanced sodium ion batteries

The formidable sustainability challenges in advancing energy storage technologies call for game-changing research in battery designs. The previous pursuing of novel cathode materials with high redox potentials impedes the vast applications due to the simultaneous electrolyte decomposition at high potentials, though they are expected to deliver high specific capacities. Eventually, people start thinking in an opposite way, desirable anode materials with low redox potentials can also own high specific capacities. Among all the promising candidates, phosphorus-based anodes in sodium ion batteries (SIBs) have received considerable attention owing to the low cost and relatively high natural abundance of phosphorus. More importantly, phosphorus can store three sodium atoms and enable a high theoretical capacity of 2596 mAh g -1 , which overwhelms any other SIB anode currently available. However, the poor electronic conductivity and large volume change of phosphorus during cycling severely deteriorate battery performance. The most widely used strategy is to confine phosphorus within well-designed carbon hosts. Here, we thereby introduce a new type of porous hollow carbon with conductive-network interior as phosphorus host, which not only improves the electrical conductivity, but also creates enough interior surface for maximizing phosphorus utilization and shortening the ion's diffusion distance, compared to those conventional hollow carbon hosts. Therefore, the as-prepared red phosphorus-carbon spheres composites (RP/CS) exhibit superior rate performance (similar to 1083 mAh g -1 at 4 A g -1 , similar to 837 mAh g -1 even at 8 A g -1 ) and excellent cycle life (1027 mAh g -1 at 4 A g -1 more than 2000 cycles).

25 ENERGY STORAGE↗