Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “agent based model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12

Proceedings 3rd NASA/IEEE Workshop on Formal Approaches to Agent-Based Systems (FAABS-III)

These preceedings contain 18 papers and 4 poster presentation, covering topics such as: multi-agent systems, agent-based control, formalism, norms, as well as physical and biological models of agent-based systems. Some applications presented in the proceedings include systems analysis, software engineering, computer networks and robot control.

Hinchey, Michael↗

Scoping Planning Agents With Shared Models

In this paper we provide a formal framework to define the scope of planning agents based on a single declarative model. Having multiple agents sharing a single model provides numerous advantages that lead to reduced development costs and increase reliability of the system. We formally define planning in terms of extensions of an initial partial plan, and a set of flaws that make the plan unacceptable. A Flaw Filter (FF) allows us to identify those flaws relevant to an agent. Flaw filters motivate the Plan Identification Function (PIF), which specifies when an agent is is ready hand control to another agent for further work. PIFs define a set of plan extensions that can be generated from a model and a plan request. FFs and PIFs can be used to define the scope of agents without changing the model. We describe an implementation of PIFsand FFswithin the context of EUROPA, a constraint-based planning architecture, and show how it can be used to easily design many different agents.

Bedrax-Weiss, Tania↗

The Mobile Agents Integrated Field Test: Mars Desert Research Station April 2003

The Mobile Agents model-based, distributed architecture, which integrates diverse components in a system for lunar and planetary surface operations, was extensively tested in a two-week field "technology retreat" at the Mars Society s Desert Research Station (MDRS) during April 2003. More than twenty scientists and engineers from three NASA centers and two universities refined and tested the system through a series of incremental scenarios. Agent software, implemented in runtime Brahms, processed GPS, health data, and voice commands-monitoring, controlling and logging science data throughout simulated EVAs with two geologists. Predefined EVA plans, modified on the fly by voice command, enabled the Mobile Agents system to provide navigation and timing advice. Communications were maintained over five wireless nodes distributed over hills and into canyons for 5 km; data, including photographs and status was transmitted automatically to the desktop at mission control in Houston. This paper describes the system configurations, communication protocols, scenarios, and test results.

Clancey, William J.↗

Analyzing Stochastic Computer Models: A Review with Opportunities

In modern science, computer models are often used to understand complex phenomena and a thriving statistical community has grown around analyzing them. This review aims to bring a spotlight to the growing prevalence of stochastic computer models-providing a catalogue of statistical methods for practitioners, an introductory view for statisticians (whether familiar with deterministic computer models or not), and an emphasis on open questions of relevance to practitioners and statisticians. Gaussian process surrogate models take center stage in this review, and these, along with several extensions needed for stochastic settings, are explained. The basic issues of designing a stochastic computer experiment and calibrating a stochastic computer model are prominent in the discussion. Instructive examples, with data and code, are used to describe the implementation of, and results from, various methods.

agent based model↗

Autonomous Cyber Defense Against Dynamic Multi-strategy Infrastructural DDoS Attacks

Dynamic Infrastructural Distributed Denial of Service (I-DDoS) attacks constantly change attack vectors to congest core backhaul links and disrupt critical network availability while evading end-system defenses. To effectively counter these highly dynamic attacks, defense mechanisms need to exhibit adaptive decision strategies for real-time mitigation. This paper presents a novel Autonomous DDoS Defense framework that employs model-based reinforcement agents. The framework continuously learns attack strategies, predicts attack actions, and dynamically determines the optimal composition of defense tactics such as filtering, limiting, and rerouting for flow diversion. Our contributions include extending the underlying formulation of the Markov Decision Process (MDP) to address simultaneous DDoS attack and defense behavior, and accounting for environmental uncertainties. We also propose a fine-grained action mitigation approach robust to classification inaccuracies in Intrusion Detection Systems (IDS). Additionally, our reinforcement learning model demonstrates resilience against evasion and deceptive attacks. Evaluation experiments using real-world and simulated DDoS traces demonstrate that our autonomous defense framework ensures the delivery of approximately 96 - 98% of benign traffic despite the diverse range of attack strategies.

Dutta, Ashutosh↗

Progress Towards a Predictive Eagle Behavior and Risk Modeling Framework: Overview and Recent Validation Efforts

This presentation summarizes progress to date of the U.S. Department of Energy project, "Development of a computational framework for modeling golden eagles (Aquila chrysaetos) near wind farms," which focuses on stochastic behavioral modeling of soaring raptors across landscape, facility, and turbine spatiotemporal scales. This publicly available, open-source modeling framework includes behavioral models based on three different underlying principles: energy minimization at landscape scale, behavioral heuristics at landscape-facility scale, and data-driven behaviors at the facility-micro-scale. We will briefly overview the key advancements in the behavioral modeling state of the art, which leverages multiple high-resolution telemetry data sources combined with high-fidelity atmospheric flow modeling insights. We then present preliminary results from a validation study in Altamont, California. This new study involves a novel application of the Stochastic Soaring Raptor Simulator (SSRS), in a new geographic locale, to understand facility scale eagle movement patterns over time scales representative of a wind project's lifetime. For this desktop analysis (that does not depend on any high-performance computing resources), SSRS simultaneously considers a variety of wind conditions and eagle approach vectors toward a project site of interest. This work demonstrates the integration of publicly available landscape-scale atmospheric datasets, our recently improved engineering updraft models (see presentation from Thedin et al.), and our energy minimization behavioral models within the SSRS framework. While we only present results from a single behavioral model, the integration of these three modeling components forms the foundation for our more sophisticated behavioral models (see presentations from Brandes et al., Sandhu et al.) that are under active development. Results are presented in the form of presence maps, which may be applied to estimate risk to wildlife, augment ground survey data, inform wind-plant operations, or incorporated into wind-plant designs.

agent-based modeling↗

Adjustably Autonomous Multi-agent Plan Execution with an Internal Spacecraft Free-Flying Robot Prototype

We present an multi-agent model-based autonomy architecture with monitoring, planning, diagnosis, and execution elements. We discuss an internal spacecraft free-flying robot prototype controlled by an implementation of this architecture and a ground test facility used for development. In addition, we discuss a simplified environment control life support system for the spacecraft domain also controlled by an implementation of this architecture. We discuss adjustable autonomy and how it applies to this architecture. We describe an interface that provides the user situation awareness of both autonomous systems and enables the user to dynamically edit the plans prior to and during execution as well as control these agents at various levels of autonomy. This interface also permits the agents to query the user or request the user to perform tasks to help achieve the commanded goals. We conclude by describing a scenario where these two agents and a human interact to cooperatively detect, diagnose and recover from a simulated spacecraft fault.

Dorais, Gregory A.↗

On the applicability of various levels of detail for occupant behavior representation and modeling in building performance simulation

Occupant behavior (OB) is one of the significant sources of uncertainty in building performance simulation. While OB modeling has received increased attention in the past decade, research on the degree of granularity or level of detail (LoD) required for representing occupants is still in the nascent stages. This paper analyzes the modeling and applicability of three LoDs to represent occupants in building performance assessment. A medium-sized prototype office building located in Chicago, Illinois is used as the simulation case study. Ten occupant-centric attributes are adopted to develop the LoDs for OB representation. We first demonstrate the different modeling approaches required for simulating the three fidelity levels. Later, we illustrate the suitability of the developed LoDs in supporting six building performance use cases across different lifecycle stages. Furthermore, this study intends to provide guidance for the building simulation community on appropriate OB representation to support various use cases.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Data analysis and modeling pipelines for controlled networked social science experiments

There is large interest in networked social science experiments for understanding human behavior at-scale. Significant effort is required to perform data analytics on experimental outputs and for computational modeling of custom experiments. Moreover, experiments and modeling are often performed in a cycle, enabling iterative experimental refinement and data modeling to uncover interesting insights and to generate/refute hypotheses about social behaviors. The current practice for social analysts is to develop tailor-made computer programs and analytical scripts for experiments and modeling. This often leads to inefficiencies and duplication of effort. In this work, we propose a pipeline framework to take a significant step towards overcoming these challenges. Our contribution is to describe the design and implementation of a software system to automate many of the steps involved in analyzing social science experimental data, building models to capture the behavior of human subjects, and providing data to test hypotheses. The proposed pipeline framework consists of formal models, formal algorithms, and theoretical models as the basis for the design and implementation. We propose a formal data model, such that if an experiment can be described in terms of this model, then our pipeline software can be used to analyze data efficiently. The merits of the proposed pipeline framework is elaborated by several case studies of networked social science experiments.

97 MATHEMATICS AND COMPUTING↗

Use of a controlled experiment and computational models to measure the impact of sequential peer exposures on decision making

It is widely believed that one’s peers influence product adoption behaviors. This relationship has been linked to the number of signals a decision-maker receives in a social network. But it is unclear if these same principles hold when the “pattern” by which it receives these signals vary and when peer influence is directed towards choices which are not optimal. To investigate that, we manipulate social signal exposure in an online controlled experiment using a game with human participants. Each participant in the game decides among choices with differing utilities. We observe the following: (1) even in the presence of monetary risks and previously acquired knowledge of the choices, decision-makers tend to deviate from the obvious optimal decision when their peers make a similar decision which we call the influence decision, (2) when the quantity of social signals vary over time, the forwarding probability of the influence decision and therefore being responsive to social influence does not necessarily correlate proportionally to the absolute quantity of signals. To better understand how these rules of peer influence could be used in modeling applications of real world diffusion and in networked environments, we use our behavioral findings to simulate spreading dynamics in real world case studies. We specifically try to see how cumulative influence plays out in the presence of user uncertainty and measure its outcome on rumor diffusion, which we model as an example of sub-optimal choice diffusion. Together, our simulation results indicate that sequential peer effects from the influence decision overcomes individual uncertainty to guide faster rumor diffusion over time. However, when the rate of diffusion is slow in the beginning, user uncertainty can have a substantial role compared to peer influence in deciding the adoption trajectory of a piece of questionable information.

97 MATHEMATICS AND COMPUTING↗

Stochastic simulation of occupant-driven energy use in a bottom-up residential building stock model

The residential buildings sector is one of the largest electricity consumers worldwide and contributes disproportionally to peak electricity demand in many regions. Strongly driven by occupant activities, household energy consumption is stochastic and heterogeneous in nature. However, most residential energy models applied by industry use homogeneous, deterministic activity schedules, which work well for predictions of annual energy consumption, but can result in unrealistic hourly or sub-hourly electric load profiles, with exaggerated or muted peaks. The increasing proportion of variable renewable energy generators means that representing the heterogeneity and stochasticity of occupant behavior is now crucial for reliable planning at both bulk-power and distribution-system scales. This work presents a novel and open-source occupancy simulation approach that can simulate a diverse set of individual occupant and household event schedules for all major electricity, fuel, and hot water end uses. To accomplish this, we evaluated three alternative occupant activity simulation approaches before selecting a hybrid combining time-inhomogeneous Markov chains and probability-sampling of event durations and magnitudes. Further, we integrated the stochastic occupancy simulation with an open-source bottom-up physics-simulation building stock model and published a set of 550,000 diverse household end-use activity schedules representing a national housing stock. The simulator was verified against time-use survey data, and simulation results were validated against measured end-use electricity data for accuracy and reliability. While we use data for the United States, our application demonstrates how similar approaches could be applied using the time-use survey data collected in many countries around the world.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Theoretical modeling of hepatitis C acute infection in liver-humanized mice support pre-clinical assessment of candidate viruses for controlled-human-infection studies

Designing and carrying out a controlled human infection (CHI) model for hepatitis C virus (HCV) is critical for vaccine development. However, key considerations for a CHI model protocol include understanding of the earliest viral-host kinetic events during the acute phase and susceptibility of the viral isolate under consideration for use in the CHI model to antiviral treatment before any infections in human volunteers can take place. Humanized mouse models lack adaptive immune responses but provide a unique opportunity to obtain quantitative understanding of early HCV kinetics and develop mathematical models to further understand viral and innate immune response dynamics during acute HCV infection. We show that the models reproduce the measured HCV kinetics in humanized mice, which are consistent with early acute HCV-host dynamics in immunocompetent chimpanzees. Our findings suggest that humanized mice are well-suited to support development of a CHI model. In-silico and in-vivo modeling estimates provide a starting point to characterize candidate viruses for testing in CHI model studies.

Agent-based modeling↗

Integrated GW Farm ABM

This Data Repository includes data used for the integrated groundwater- farm ABM model, raw model output from scenario ensemble, and processed outputs that isolate the groundwater storage depletion outcomes for the 35,000 farm cells. Model Inputs: Farm ABM Inputs: This folder contains the input data used by the integrated groundwater - farm ABM modelling script (Python file) used for the high performance computing (HPC) experiments. The sub-folder "data inputs" contains all of the farm attribute data, while the three files in the folder have the hydrogeological data lookup table (NLDAS Cost Curve Attributes.csv), a lookup table (Theis well function table.csv) for the groundwater cost curve function, and the farm indexes and corresponding NLDAS ids for all of the cells run in this experiment (nldas farms subset final.csv). NLDAS Cost curve hydrogeological data: Hydrogeological data aggregated to 1/8 degree resolution and aligned with the NLDAS grid. Parameters include: water depth below ground surface [meters], subsurface porosity [unitless], aquifer depth from ground surface to aquifer bottom [meters], annual average recharge (USGS: mm, Doll: meters), and three different hydraulic conductivity (K) values (meters/day). The three K values represent the mean value from Gleeson et al. (2018), one standard deviation above the mean from Gleeson et al. (2018), and the de Graaf et al. 2020 modifications to certain lithologies. Additional information about these datasets and their processing are documented in the supplement to Yoon et al. 2025 (in review). Output: Raw outputs: This folder contains a .zip file that has model outputs for the entire scenario ensemble. There is one csv for each farm id, using the format "farm farmid cases.csv". The relationship between the farm id and NLDAS id is defined by the "nldas farms subset final.csv" located in the Farm ABM Inputs folder. Each csv has 625 rows, corresponding to 625 combinations of different scenario parameter values. Each row (scenario) represents the outcome of a 100 year simulation. Columns define scenario settings and summary statistics for each scenario. The first four columns define the scenario settings: "hydro ratio," "econ ratio," "K scenario," and "gamma scenario." The hydro and econ ratios are values passed to the modeling script that influence multipliers for other model parameters, as documented in the supplement to Yoon et al. 2025 (in review). The gamma multiplier is a coefficient multiplier applied to the baseline gamma values (values below 1 represent lower unobserved costs compared to baseline, values above 1 represent higher costs). The K scenario names represent K values of: "low": 0.5 m/d, "int 1": 2.5 m/d, "int 2": 10 m/d, "high": 50 m/d, and "gleeson": mean Gleeson K value. "Perc vol depleted" is the fraction of groundwater depleted at the end of the 100 simulation. Processed Output: Derived depletion outcomes from raw outputs: All of the individual csv files from the Raw outputs were aggregated into a single file that has the scenario settings and fraction depletion "Perc vol depleted" for every farm cell, for every scenario. The other two files define relationships between the farm id, NLDAS id, and local and major aquifer units, used for aquifer-level depletion analysis.

Agent based modeling↗

Impact of climate change on adaptive management decisions in the face of water scarcity

Reoccurring drought through the early 2000s has caused a serious water scarcity issue in the Colorado River Basin. Previous modeling studies have focused on the impact of climate change without considering the adaptive behaviors of farmers and under-utilized Indian water rights. Here, we use a coupled agent-based water resource model (ABM) to investigate how the adaptive decisions of farmers can affect water resource management under both climate change impacts and fully utilized Indian water right conditions. We used five General Circulation Model projections with RCP8.5 scenarios for the study. The results of farm-level decision-making showed different responses in irrigated areas that were changing due to climate change impact. While winter precipitation changes might partially explain the behavior changes, no specific pattern could be concluded based on their location. Also, farmers’ responses about annual water diversion showed more significant inter-year variation compared to irrigated areas. Basin-level metrics showed that climate change impacts will generally worsen water scarcity issues as measured in Navajo Reservoir storage, flow to Lake Powell, and instream flow requirement. But these basin-level water scarcity metrics cannot reflect individual farm-level impacts under climate change, which is why modeling the bottom-up management actions is necessary. When the under-utilized Indian water rights are fully used, it is more likely to trigger the shortage sharing agreement due to the higher tribal water depletion. Evaluation of model uncertainty and a more realistic setup for adaptive actions under drought contingency plans are suggested for future research.

54 ENVIRONMENTAL SCIENCES↗

Behavioral responses of fish to a current-based hydrokinetic turbine under mutliple operational conditions

There is significant international interest in developing current-based marine and hydrokinetic (MHK) technologies to capture the power of tidal energy. However, concerns have been raised regarding the ecological effects of these projects on fish, including the risk of blade collision and behavioral impacts such as the disruption of migratory behavior and food acquisition and displacement from preferred habitats. In this study, we conducted mobile hydroacoustic surveys to track fish as they approached a tidal turbine deployed in Cobscook Bay, Maine. There was a significant decline in fish numbers with decreasing distance to the turbine, beginning approximately 140 m from the turbine. Similar declines were not observed at control transects or when the turbine was not spinning. The decline in fish numbers appeared to be the result of horizontal displacement, not vertical, movements to avoid the turbine. Noise rather than visual cues or flow field disturbance seemed to be a likely explanation for the reduced number of fish near the turbine. This finding, combined with near-field blade collision studies indicating a low probability of encounter, suggests that a single turbine poses a low collision risk to pelagic fish and that a single turbine is likely to result in minimal behavioral responses by fish. However, the risk may be different with additional devices, which will become more relevant as commercial-scale MHK arrays come under consideration. Therefore, the risks associated with commercial-scale operations will ultimately have to be evaluated to fully understand the ecological impacts of MHK devices.

42 ENGINEERING↗

Towards an Agent-Based Blackboard System for Reactor Design Optimization

The field of reactor design is rich with opportunities for applications of computational optimization algorithms; these applications can range from preliminary core design to reactor shuffling patterns. Many of these schemes rely on sets of previously generated solutions (sometimes referred to as “generations”) to inform future decisions. While it is important to build upon prior knowledge, this process requires a full generation of solutions to be formed before future solutions can be examined. Rather than relying on a generational scheme to perform an optimization, we propose using an agent-based approach in conjunction with a blackboard framework for performing reactor design optimizations. Utilizing an agent-based approach allows agents to perform tasks independently, while retaining the ability to build off of previous solutions. We develop an agent-based blackboard system (ABBS) for determining the Pareto front (PF) in sodium fast reactor design optimization problems and compared this with the Non-Dominated Sorting Genetic Algorithm II (NSGA-II). Our goal is to evaluate the viability of the ABBS in producing a PF that is comparable with the NSGA-II algorithm. The design space consists of the fuel height, fuel smear, and plutonium fraction in the core, and we seek to minimize the reactivity swing and plutonium mass, while maximizing the burnup. The diversity, coverage, and spread of the PFs generated by the two methods are examined, and the ABBS is able to converge to the same PF as the NSGA-II algorithm. These results show that the ABBS is able to find optimal designs that are similar to those found by the NSGA-II algorithm. We conclude our study by applying the ABBS to the design of a sodium-cooled fast reactor to dispose of weapons-grade plutonium. The ABBS finds a core design that can burn upwards of 17.5 kg of weapons-grade plutonium per year and degrade an additional 195 kg of weapons-grade plutonium per year into non-weapons-grade material.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Technology progress and clean vehicle policies on fleet turnover and equity: insights from household vehicle fleet micro-simulations with $\text{ATLAS}$

This paper documents the design and application of ATLAS (Automobile and Technology Lifecycle-Based ASsignment), a comprehensive household vehicle transaction and technology adoption micro-simulator in the San Francisco Bay Area. ATLAS evolves the fleet mix of individual households by simulating the vehicle transaction and choice decisions in response to co-evolving demographics, land use, and vehicle technology simulations. While most existing literature has focused on the aggregate clean vehicle uptake, this paper differentiates distributional effects and decomposes the underlying mechanisms across heterogeneous sub-populations of households. Using scenarios and sensitivity simulations that vary vehicle technology and policy assumptions, we find that Zero Emission Vehicles (ZEVs) penetrate into higher income groups at a faster rate than into lower income groups, which is intuitive and aligns with expectations. Interestingly, the relative income disparity in ZEV ownership shrinks over time across all scenarios, with a ZEV mandate coupled with declining battery cost leading to the greatest reduction in disparity of ZEV ownership by 2050. Federal, state, and local financial incentives influence the redistribution of ZEV uptake across income groups and contribute to narrowing income disparity. Vehicle transaction frequency and new versus used market dynamics are found to be important factors contributing to the income disparity.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Optimization-based trip chain emulation for electrified ride-sourcing charging demand analyses

Range anxiety remains one of the key concerns for ride-sourcing drivers to adopt battery electric vehicles (BEVs). To investigate the feasibility of using BEVs for ride-sourcing services, we propose an optimization-based methodology to estimate the daily driving trip patterns of ride-sourcing vehicles based on widely available non-identifiable trip data. Furthermore, we investigate the charging needs of electrified ride-sourcing vehicles using agent-based simulation. The methodologies are illustrated through a case study in the city of Chicago. Through sensitivity analysis on driver working hours and initial charging status, we quantify the range of daily average vehicle miles traveled (VMT) per car and identify the hot spots of current public charging demand and potential unsatisfied charging demand. This study can be used to determine the priorities of future charging infrastructure investment to further mitigate range anxiety and promote the adoption of electrified ride-sourcing services

42 ENGINEERING↗