Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “decision model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,063 records · Page 59

Situation awareness and dynamic ensemble forecasting of abnormal behavior in cyber-physical system

A plurality of monitoring nodes may each generate a time-series of current monitoring node values representing current operation of a cyber-physical system. A feature-based forecasting framework may receive the time-series of and generate a set of current feature vectors using feature discovery techniques. The feature behavior for each monitoring node may be characterized in the form of decision boundaries that separate normal and abnormal space based on operating data of the system. A set of ensemble state-space models may be constructed to represent feature evolution in the time-domain, wherein the forecasted outputs from the set of ensemble state-space models comprise anticipated time evolution of features. The framework may then obtain an overall features forecast through dynamic ensemble averaging and compare the overall features forecast to a threshold to generate an estimate associated with at least one feature vector crossing an associated decision boundary.

Abbaszadeh, Masoud↗

Transmission Data-Driven User-Defined Model for Inverter-based and Conventional Power Plants

Recent events in Odessa [1], [2] have shed light on the complexities of integrating large Inverter-Based Resource (IBR) plants with the transmission system, prompting NERC to stress continuous performance monitoring by transmission operators. Challenges such as plant control updates, IBR model revisions, Phase-locked loop loss of synchronism, and protection events have been identified, underscoring the need for enhanced monitoring protocols by regulatory bodies. The recent FERC 901 order underscores the importance of accurate data exchange regarding IBRs for reliability studies. However, limited access to IBR plant-related data hampers effective decision-making for transmission operators (TOP). This paper proposes a method for constructing data-driven User-Defined dynamic Models (UDM) for power plants for validating multiple-event data using field measurements from interconnection bus locations. The problem is formulated as a power plant model identification problem and a multi-task learning approach under partial input observability assumptions is proposed in this work. This approach aims to predict aggregated responses of conventional and IBR power plants during various dynamic physical events which is useful for planning studies under diverse disturbance conditions. Ultimately, this methodology emphasizes the importance of plant visibility to operators in addressing power system challenges, facilitating improved planning and operational studies.

Mahapatra, Kaveri [BATTELLE (PACIFIC NW LAB)]↗

spopt: a python package for solving spatial optimization problems in PySAL

Spatial optimization is a major spatial analytical tool in management and planning, the significance of which cannot be overstated. Spatial optimization models play an important role in designing and managing effective and efficient service systems such as transportation, education, public health, environmental protection, and commercial investment among others. To this end, spopt (spatial optimization) is under active development for the inclusion of newly proposed models and methods for regionalization, facility location, and transportation-oriented solutions (Feng et al., 2021). Spopt is a submodule in the open-source spatial analysis library PySAL (Python Spatial Analysis Library) founded by Dr. Sergio J. Rey and Dr. Luc Anselin in 2005 (Rey et al., 2015, 2021; Rey & Anselin, 2007). The goal of developing spopt is to provide management and decision-making support to all relevant practitioners and to further promote the appropriate and meaningful application of spatial optimization models in practice.

97 MATHEMATICS AND COMPUTING↗

A Comparison of Machine Learning Methods to Forecast Tropospheric Ozone Levels in Delhi

Ground-level ozone is a pollutant that is harmful to urban populations, particularly in developing countries where it is present in significant quantities. It greatly increases the risk of heart and lung diseases and harms agricultural crops. This study hypothesized that, as a secondary pollutant, ground-level ozone is amenable to 24 h forecasting based on measurements of weather conditions and primary pollutants such as nitrogen oxides and volatile organic compounds. We developed software to analyze hourly records of 12 air pollutants and 5 weather variables over the course of one year in Delhi, India. To determine the best predictive model, eight machine learning algorithms were tuned, trained, tested, and compared using cross-validation with hourly data for a full year. The algorithms, ranked by R2 values, were XGBoost (0.61), Random Forest (0.61), K-Nearest Neighbor Regression (0.55), Support Vector Regression (0.48), Decision Trees (0.43), AdaBoost (0.39), and linear regression (0.39). When trained by separate seasons across five years, the predictive capabilities of all models increased, with a maximum R 2 of 0.75 during winter. Bidirectional Long Short-Term Memory was the least accurate model for annual training, but had some of the best predictions for seasonal training. Out of five air quality index categories, the XGBoost model was able to predict the correct category 24 h in advance 90% of the time when trained with full-year data. Separated by season, winter is considerably more predictable (97.3%), followed by post-monsoon (92.8%), monsoon (90.3%), and summer (88.9%). These results show the importance of training machine learning methods with season-specific data sets and comparing a large number of methods for specific applications.

54 ENVIRONMENTAL SCIENCES↗

Using a Large Language Model for Accurate Technical Language Generation in the Predictive Maintenance of Circulating Water Systems in Nuclear Power Plants

Machine learning (ML) methods for predictive maintenance (PdM) are emerging as effective proactive strategies for diagnosing equipment degradation and enabling effective decision-making. However, explainability and trustworthiness of artificial intelligence are two salient challenges that need to be addressed for wider deployment of these technologies in nuclear power plants (NPPs). Large language models (LLMs) offer a unique approach to tackle these challenges by explaining PdM, work orders, diagnosis results, and ML algorithms to users, who may not be familiar with ML and PdM in general. Moreover, by dynamically retrieving relevant information from technical documents and evaluating factuality of LLM generation, the accuracy and relevance of LLM generations can be improved. This work demonstrates using LLMs to explain the causes and consequences of circulating water system failures based on multiyear NPP work orders. This work tests the capability of multimodal LLM approaches in explaining the differences in the circulating water system from both the Salem and Hope Creek NPPs using both text and image resources. This work also demonstrates the use of multimodal LLMs in describing the diagnosis tab of a predictive maintenance software named VIsualization for PrEdictive maintenance Recommendation (VIPER) to users.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗

Accelerating Informed Local Climate Action by Improving Access to DOE Predictive Modeling and Science-Based Tools

The threat of climate change is becoming increasingly urgent, and local governments across the United States are working to develop and implement climate action plans to reduce greenhouse gas emissions and mitigate the impacts of climate change. At the same time, the U.S. Department of Energy's Office of Science, Earth and Environmental Systems Sciences Division (EESSD) has been developing a range of tools and technologies to help predict the potential multi-faceted impacts from climate change given varying environmental and socioeconomic scenarios. However, local governments have been slow to engage with these scientific assets due to a lack of understanding and awareness. The DOE researchers interviewed highlighted three primary types of resources that could benefit local governments and climate practitioners: climate models, modeled datasets, and scientific journal articles. Although many of these resources are open source and available to the public, there were several challenges identified in translating these resources and their research insights directly to decision-makers.

54 ENVIRONMENTAL SCIENCES↗

National Virtual Biotechnology Laboratory: Report on Rapid R&D Solutions to the COVID-19 Crisis

With funding from the CARES Act, the U.S Department of Energy (DOE) established the National Virtual Biotechnology Laboratory (NVBL) in March 2020 to address key challenges associated with the COVID-19 crisis. NVBL brought together the broad scientific and technical expertise and resources of DOE’s 17 national laboratories to help tackle medical supply short ages, discover potential drugs to fight the virus, develop and validate COVID-19 testing methods, model disease spread and impact across the nation, and understand virus transport in buildings and the environment. National laboratory resources leveraged for this effort include a suite of world-leading user facilities broadly available to the research community, such as light and neutron sources, nanoscale science research centers, sequencing and biocharacterization facilities, and high-performance computing facilities. Within months, NVBL teams produced innovations in materials and advanced manufacturing that mitigated shortages in test kits and personal protective equipment (PPE), creating nearly 1,000 new jobs. They used DOE’s high-performance computers and light and neutron sources to identify promising candidates for antibodies and antivirals that universities and drug companies are now evaluating. NVBL researchers also developed new diagnostic targets and sample collection approaches, and supported U.S. Food and Drug Administration (FDA), Centers for Disease Control and Prevention (CDC), and U.S. Department of Defense (DoD) efforts to establish national guidelines used in administering millions of tests. Researchers used artificial intelligence and high-performance computing to produce near-real-time data analysis to forecast disease transmission, stress on public health infrastructure, and economic impact, which supported decision-makers at the local, state, and national levels. NVBL teams also studied how to control indoor virus movement to minimize uptake and protect human health. NVBL’s accomplishments demonstrate not only the powerful resource represented by DOE’s national laboratories working together to meet national needs, but also the effectiveness of the integrated NVBL framework for rapidly responding to emergencies with research and development (R&D) solutions. As the fight against COVID continues, sustained efforts are needed to confront this pandemic as well as future threats. Examples include: 1) Establishing “supply chains on demand” to meet emergency production needs by leveraging the materials and manufacturing expertise of DOE national laboratories and developing advances in electronics, sensing, robotics, and automation capabilities; 2) Improving the speed and robustness of drug discovery by integrating experimental platforms with DOE’s computational and experimental user facilities, which provide unique resources to support the discovery of high-potential therapeutic agents; 3) Protecting public, environmental, and animal health by developing new testing protocols and instrumentation adaptable to diverse sample types (both physiological and environmental) to quickly detect a wide range of pathogens and monitor other biorisks; 4) Supporting near-real-time data needs of decision-makers at the local, regional, state, and national levels by advancing data curation, analysis, and modeling using artificial intelligence and new data science tools for managing and evaluating large diverse datasets; 5) Harnessing DOE’s expertise in environmental modeling to design rooms and air handling for offices, classrooms, restaurants, and other structures to minimize biorisk transmissions. Going forward, NVBL is poised to apply the unique capabilities and expertise of the national laboratory complex to future national and international emergencies, both natural and engineered. Through this framework, the Office of Science will continue to be an integral component of agency wide efforts to prepare for and respond to biorisks and other crises.

42 ENGINEERING↗

Search for supersymmetry using vector boson fusion signatures and missing transverse momentum in pp collisions at $\sqrt{s}$ = 13 TeV with the ATLAS detector

This paper presents a search for supersymmetric particles in models with highly compressed mass spectra, in events consistent with being produced through vector boson fusion. The search uses 140 fb −1 of proton-proton collision data at $\sqrt{s}$ = 13 TeV collected by the ATLAS experiment at the Large Hadron Collider. Events containing at least two jets with a large gap in pseudorapidity, large missing transverse momentum, and no reconstructed leptons are selected. A boosted decision tree is used to separate events consistent with the production of supersymmetric particles from those due to Standard Model backgrounds. The data are found to be consistent with Standard Model predictions. The results are interpreted using simplified models of R-parity-conserving supersymmetry in which the lightest supersymmetric partner is a bino-like neutralino with a mass similar to that of the lightest chargino and second-to-lightest neutralino, both of which are wino-like. Lower limits at 95% confidence level on the masses of next-to-lightest supersymmetric partners in this simplified model are established between 117 and 120 GeV when the lightest supersymmetric partners are within 1 GeV in mass.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Quantifying uncertainty for deep learning based forecasting and flow-reconstruction using neural architecture search ensembles

Classical problems in computational physics such as data-driven forecasting and signal reconstruction from sparse sensors have recently seen an explosion in deep neural network (DNN) based algorithmic approaches. However, most DNN models do not provide uncertainty estimates, which are crucial for establishing the trustworthiness of these techniques in downstream decision making tasks and scenarios. In recent years, ensemble-based methods have achieved significant success for the uncertainty quantification in DNNs on a number of benchmark problems. However, their performance on real-world applications remains under-explored. In this work, we present an automated approach to DNN discovery and demonstrate how this may also be utilized for ensemble-based uncertainty quantification. Specifically, we propose the use of a scalable neural and hyperparameter architecture search for discovering an ensemble of DNN models for complex dynamical systems. We highlight how the proposed method not only discovers high-performing neural network ensembles for our tasks, but also quantifies uncertainty seamlessly. This is achieved by using genetic algorithms and Bayesian optimization for sampling the search space of neural network architectures and hyperparameters. Subsequently, a model selection approach is used to identify candidate models for an ensemble set construction. Afterwards, a variance decomposition approach is used to estimate the uncertainty of the predictions from the ensemble. We demonstrate the feasibility of this framework for two tasks — forecasting from historical data and flow reconstruction from sparse sensors for the sea-surface temperature. In conclusion, we demonstrate superior performance from the ensemble in contrast with individual high-performing models and other benchmarks.

Deep ensembles↗

Model-based interface design for smart field-device integration

Operational complexity is ever-increasing for electric utilities that face challenges including integration of DERs, customer expectation of energy choices, the proliferation of non-utility-owned resources, new business models with energy service providers, and new technology with IT/OT convergence. To maintain and improve the quality of operations, planning, and decision-making in general, utilities need to manage and navigate the complexity. Managing complexity requires a modular, scalable, and flexible solution. Connecting large amounts of DERs and introducing new services requires increased grid control and evolving applications. In this paper, we show an approach utilizing model-based standardized interfaces that simplifies integration and deployment of new algorithms and smart field devices for interoperability across legacy or new systems. A modular design is presented for a reference implementation of widely used DNP3 and IEEE 2030.5 interfaces within an open-source, standards-based data integration platform for integration of smart field devices with independently developed, best-of-breed applications.

Model-driven development, system integration, smar↗

EpiCast: Simulating Epidemics with Extreme Detail

In early 2020, COVID-19 swept the globe. Governments attempted to “flatten the curve” through business shutdowns and stay-at-home orders, but the United States was hit hard. By the end of March, mere months after the virus first emerged in humans 7,000 miles away, the U.S. had recorded 192,300 cases and 5,300 deaths. While this unprecedented disaster sent shockwaves through every level of society and clouded an uncertain future, state and local governments turned to computational and mathematical epidemiology researchers to help formulate intervention strategies to limit the spread of the disease. Traditional forecasting models provided a reasonable understanding of how the near future was likely to look, but local policy makers and public health communities still struggled to understand how potential mitigations ought to be implemented. Decision makers needed a way to measure the impact of their policy choices—they needed better technology. EpiCast answered the call, bringing urgently needed answers to policymakers grappling with how to adjust school and business schedules. EpiCast is modeling software that generates a synthetic, representative population to simulate infectious disease transmission in the United States with extreme detail and granularity. The software models human behavior combined with community-specific information to provide a fine-grained preview of the effect of potential mitigation strategies for decision makers.

60 APPLIED LIFE SCIENCES↗

Zero Trust Cybersecurity: Concepts and Models for Application

Zero Trust is a cybersecurity paradigm centered on the idea that a network breach is inevitable and so no user or asset should be implicitly trusted. Entities on the network are continuously monitored and access-granting decisions are based on dynamic risk assessment using multiple inputs. To limit the damage from an attack, privileges and lateral access are constrained by default. This report provides an overview of current models and constructs employed in building out these concepts into a zero trust architecture.

97 MATHEMATICS AND COMPUTING↗

Next generation Arctic vegetation maps: Aboveground plant biomass and woody dominance mapped at 30 m resolution across the tundra biome

The Arctic is warming faster than anywhere else on Earth, placing tundra ecosystems at the forefront of global climate change. Plant biomass is a fundamental ecosystem attribute that is sensitive to changes in climate, closely tied to ecological function, and crucial for constraining ecosystem carbon dynamics. However, the amount, functional composition, and distribution of plant biomass are only coarsely quantified across the Arctic. Therefore, we developed the first moderate resolution (30 m) maps of live aboveground plant biomass (g m −2 ) and woody plant dominance (%) for the Arctic tundra biome, including the mountainous Oro Arctic. We modeled biomass for the year 2020 using a new synthesis dataset of field biomass harvest measurements, Landsat satellite seasonal synthetic composites, ancillary geospatial data, and machine learning models. Additionally, we quantified pixel-wise uncertainty in biomass predictions using Monte Carlo simulations and validated the models using a robust, spatially blocked and nested cross-validation procedure. Observed plant and woody plant biomass values ranged from 0 to ∼6000 g m −2 (mean ≈ 350 g m −2 ), while predicted values ranged from 0 to ∼4000 g m −2 (mean ≈ 275 g m −2 ), resulting in model validation root-mean-squared-error (RMSE) ≈ 400 g m −2 and R 2 ≈ 0.6. Our maps not only capture large-scale patterns of plant biomass and woody plant dominance across the Arctic that are linked to climatic variation (e.g., thawing degree days), but also illustrate how fine-scale patterns are shaped by local surface hydrology, topography, and past disturbance. By providing data on plant biomass across Arctic tundra ecosystems at the highest resolution to date, our maps can significantly advance research and inform decision-making on topics ranging from Arctic vegetation monitoring and wildlife conservation to carbon accounting and land surface modeling.

Climate change↗

Roles of retailers in the peer-to-peer electricity market: A single retailer perspective

Despite extensive research in the past five years and several successfully completed and on-going pilot projects, regulators are still reluctant to implement peer-to-peer trading at a large-scale in today’s electricity market. The reason could partly be attributed to the perceived disadvantage of current market participants like retailers due to their exclusion from market participation - a fundamental property of decentralized peer-to-peer trading. As a consequence, recently, there has been growing pressure from energy service providers in favor of retailers’ participation in peer-to-peer trading. However, the role of retailers in the peer-to peer market is yet to be established as no existing study has challenged this fundamental circumspection of decentralized trading. In this context, this perspective takes the first step to discuss the feasibility of retailers’ involvement in the peer-to-peer market. In doing so, we identify key characteristics of retail-based and peer-to-peer electricity markets and discuss our viewpoint on how to incorporate a single retailer in a peer-to-peer market without compromising the fundamental decision-making characteristics of both markets. Finally, we give an example of a hypothetical business model to demonstrate how a retailer can be a part of a peer-to-peer market with a promise of collective benefits for the participants.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

A Unified Framework to Reconcile Different Approaches of Modeling Transpiration Response to Water Stress: Plant Hydraulics, Supply Demand Balance, and Empirical Soil Water Stress Function

Plant responses to water stress is a major uncertainty to predicting terrestrial ecosystem sensitivity to drought. Different approaches have been developed to represent plant water stress. Empirical approaches (the empirical soil water stress (or Beta) function and the supply-demand balance scheme) have been widely used for many decades; more mechanistic based approaches, that is, plant hydraulic models (PHMs), were increasingly adopted in the past decade. However, the relationships between them—and their underlying connections to physical processes—are not sufficiently understood. This limited understanding hinders informed decisions on the necessary complexities needed for different applications, with empirical approaches being mechanistically insufficient, and PHMs often being too complex to constrain. Here we introduce a unified framework for modeling transpiration responses to water stress, within which we demonstrate that empirical approaches are special cases of the full PHM, when the plant hydraulic parameters satisfy certain conditions. We further evaluate their response differences and identify the associated physical processes. Finally, we propose a methodology for assessing the necessity of added complexities of the PHM under various climatic conditions and ecosystem types, with case studies in three typical ecosystems: a humid Midwestern cropland, a semi-arid evergreen needleleaf forest, and an arid grassland. Notably, Beta function overestimates transpiration when VPD is high due to its lack of constraints from hydraulic transport and is therefore insufficient in high VPD environments. With the unified framework, we envision researchers can better understand the mechanistic bases of and the relationships between different approaches and make more informed choices.

54 ENVIRONMENTAL SCIENCES↗

Output-weighted sampling for multi-armed bandits with extreme payoffs

We present a new type of acquisition function for online decision-making in multi-armed and contextual bandit problems with extreme payoffs. Specifically, we model the payoff function as a Gaussian process and formulate a novel type of upper confidence bound acquisition function that guides exploration towards the bandits that are deemed most relevant according to the variability of the observed rewards. This is achieved by computing a tractable likelihood ratio that quantifies the importance of the output relative to the inputs and essentially acts as an attention mechanism that promotes exploration of extreme rewards. Our formulation is supported by asymptotic zero-regret guarantees, and its performance is demonstrated across several synthetic benchmarks, as well as two realistic examples involving noisy sensor network data. Finally, we provide a JAX library for efficient bandit optimization using Gaussian processes.

Science & Technology - Other Topics↗

Curriculum-based Reinforcement Learning for Distribution System Critical Load Restoration

This paper focuses on the critical load restoration problem in distribution systems following major outages. To provide fast online response and optimal sequential decision-making support, a reinforcement learning (RL) based approach is proposed to optimize the restoration. Due to the complexities stemming from the large policy search space, renewable uncertainty, and nonlinearity in a complex grid control problem, directly applying RL algorithms to train a satisfactory policy requires extensive tuning to be successful. To address this challenge, this paper leverages the curriculum learning (CL) technique to design a training curriculum involving a simpler steppingstone problem that guides the RL agent to learn to solve the original hard problem in a progressive and more effective manner. We demonstrate that compared with direct learning, CL facilitates controller training to achieve better performance. To study realistic scenarios where renewable forecasts used for decision-making are in general imperfect, the experiments compare the trained RL controllers against two model predictive controllers (MPCs) using renewable forecasts with different error levels and observe how these controllers can hedge against the uncertainty. Results show that RL controllers are less susceptible to forecast errors than the baseline MPCs and can provide a more reliable restoration process.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Reinforcement Learning for Load-balanced Parallel Particle Tracing

We explore an online reinforcement learning (RL) paradigm to dynamically optimize parallel particle tracing performance in distributed-memory systems. Our method combines three novel components: (1) a work donation algorithm, (2) a high-order workload estimation model, and (3) a communication cost model. First, we design an RL-based work donation algorithm. Our algorithm monitors workloads of processes and creates RL agents to donate data blocks and particles from high-workload processes to low-workload processes to minimize program execution time. The agents learn the donation strategy on the fly based on reward and cost functions designed to consider processes' workload changes and data transfer costs of donation actions. Second, we propose a workload estimation model, helping RL agents estimate the workload distribution of processes in future computations. Third, we design a communication cost model that considers both block and particle data exchange costs, helping RL agents make effective decisions with minimized communication costs. We demonstrate that our algorithm adapts to different flow behaviors in large-scale fluid dynamics, ocean, and weather simulation data. Our algorithm improves parallel particle tracing performance in terms of parallel efficiency, load balance, and costs of I/O and communication for evaluations with up to 16,384 processors.

Distributed and parallel particle tracing↗