Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “agent based simulation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Evaluating Energy Efficiency Opportunities from Connected and Automated Vehicle Deployments Coupled with Shared Mobility in California

Connected and Automated Vehicles (CAVs) can be considered to be a disruptive transportation technology, with the potential to significantly improve overall transportation system efficiency; however, CAVs may increase induce vehicle miles traveled (VMT) and bring on greater energy consumption. Further, shared mobility is another disruptive transportation event that is reshaping our travel patterns. The primary goal of this project was to extensively collect data from vehicles and associated infrastructure equipped with CAV technologies from both real-world experiments and simulation studies mainly deployed in California, and develop a comprehensive framework for evaluating energy efficiency opportunities from large-scale (e.g., statewide) introduction of CAVs and a wide deployment of shared mobility systems in a variety of scenarios. To quantify the combined impact of CAV and shared mobility on travel behavior, traffic performance, and energy efficiency, a unique mesoscopic simulation-based model was developed for mobility and energy efficiency evaluation considering these disruptive transportation technologies. As a complement to existing studies on nationwide evaluation of CAVs’ energy impacts, this project was focused on data collection efforts and CAV applications under congested traffic environments that are frequently experienced on a massive scale across the major metropolitan areas in California. Extensive real-world data collection supplemented with simulation studies were conducted to cover a variety of CAV and shared mobility scenarios, particularly on scenarios less-explored in the existing research. Another key component of this project was to consider the interaction between different CAV technologies and shared mobility models, and the compound effect on energy efficiency. A comprehensive modeling suite was developed to quantify the impact of new mobility technologies on travel behavior and traffic performance. The developed modeling framework includes an energy intensity module, mode choice module and activity generation module that are integrated into an agent-based BEAM simulation platform to perform impact analysis based on a variety of scenarios. In addition, the RouteE model has been upgraded to incorporate the impact of CAVs on traffic flow, VMT and energy intensity, using micro-simulation data collected from both freeways and urban arterials. A novel fundamental influencing factor (FIF) mode choice model was developed to link CAV and shared mobility components with travel behaviors, and adapted into the BEAM-centered model framework. A statewide energy inventory was constructed under various CAV technology deployment scenarios by incorporating datasets and models for predicting vehicle market share and vehicle usage, which are tightly associated with the penetration of shared mobility systems. Based applying this modeling suite to a calibrated network in Riverside California, it was found that cooperative automated driving in general will improve mobility, but automated vehicles, even when deployed in a shared autonomous fleet, will likely bring an increase of VMT (up to 36%) due to mode shifts and deadheading. Ride-hailing vehicles typically have better energy efficiency and a higher share of electric vehicles, which helps offset the negative impact from VMT increases when estimating the system-level energy consumption. In general, simulation results show a 6% increase in energy consumption for the scenarios with an increasing shift to ride-hailing modes. The statewide analysis based on the National Household Travel Survey (NHTS) sample data is consistent with the findings from the Riverside network and validate the developed clustering-prediction modeling methodology. The outcomes from this project will help close the knowledge gap on recognizing the potential performance and energy impacts of a broad deployment of CAV and shared mobility technologies across a wide range of roadway infrastructure with varying levels of congestion. Results from this project: 1) will support policymakers in steering CAV development and deployment towards an energy favorable direction; 2) reduce uncertainties in estimating energy saving opportunities from new mobility technologies and services; 3) increase the confidence of CAV technology investors both on the infrastructure side (i.e., transportation agencies) and on the vehicle side (i.e., OEMs); and 4) expedite the deployment of energy-efficient CAV and shared mobility applications.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2024

"Designing, simulating, and performing the 100-AV field test for the CIRCLES consortium: Methodology and Implementation of the Largest mobile traffic control experiment to date"

Previous controlled experiments on single-lane ring roads have shown that a single partially autonomous vehicle (AV) can effectively mitigate traffic waves. This naturally prompts the question of how these findings can be generalized to field operational, high-density traffic conditions. To address this question, the Congestion Impacts Reduction via CAV-in-the-loop Lagrangian Energy Smoothing (CIRCLES) Consortium conducted MegaVanderTest (MVT), a live traffic control experiment involving 100 vehicles near Nashville, TN, USA. This article is a tutorial for developing analytical and simulation-based tools essential for designing and executing a live traffic control experiment like the MVT. It presents an overview of the proposed roadmap and various procedures used in designing, monitoring, and conducting the MVT, which is the largest mobile traffic control experiment at the time. The design process is aimed at evaluating the impact of the CIRCLES AVs on surrounding traffic. The article discusses the agent-based traffic simulation framework created for this evaluation. A novel methodological framework is introduced to calibrate this microsimulation, aiming to accurately capture traffic dynamics and assess the impact of adding 100 vehicles to existing traffic. The calibration model's effectiveness is verified using data from a six-mile section of Nashville's I-24 highway. The results indicate that the proposed model establishes an effective feedback loop between the optimizer and the simulator, thereby calibrating flow and speed with different spatiotemporal characteristics to minimize the error between simulated and real-world data. Finally, We simulate AVs in multiple scenarios to assess their effect on traffic congestion. This evaluation validates the AV routes, thereby contributing to the execution of a safe and successful live traffic control experiment via AVs.

Ameli, Mostafa↗
NASA NTRS2012

Exploring the Use of Computer Simulations in Unraveling Research and Development Governance Problems

Understanding Research and Development (R&D) enterprise relationships and processes at a governance level is not a simple task, but valuable decision-making insight and evaluation capabilities can be gained from their exploration through computer simulations. This paper discusses current Modeling and Simulation (M&S) methods, addressing their applicability to R&D enterprise governance. Specifically, the authors analyze advantages and disadvantages of the four methodologies used most often by M&S practitioners: System Dynamics (SO), Discrete Event Simulation (DES), Agent Based Modeling (ABM), and formal Analytic Methods (AM) for modeling systems at the governance level. Moreover, the paper describes nesting models using a multi-method approach. Guidance is provided to those seeking to employ modeling techniques in an R&D enterprise for the purposes of understanding enterprise governance. Further, an example is modeled and explored for potential insight. The paper concludes with recommendations regarding opportunities for concentration of future work in modeling and simulating R&D governance relationships and processes.

Balaban, Mariusz A.↗
DOE OSTI2026

ToPolyAgent: AI agents for coarse-grained bead-spring topological polymer simulations

We introduce ToPolyAgent, a multi-agent AI framework for performing coarse-grained molecular dynamics (MD) simulations of topological polymers through natural language instructions. By integrating large language models (LLMs) with domain-specific computational tools, ToPolyAgent supports both interactive and autonomous simulation workflows across diverse polymer architectures, including linear, ring, brush, and star polymers, as well as dendrimers. The system consists of four LLM-powered agents: a Config Agent for generating initial polymer–solvent configurations, a Simulation Agent for executing LAMMPS-based MD simulations and conformational analyses, a Report Agent for compiling markdown reports, and a Workflow Agent for streamlined autonomous operations. Interactive mode incorporates user feedback loops for iterative refinements, while autonomous mode enables end-to-end task execution from detailed prompts. We demonstrate ToPolyAgent's versatility through case studies involving diverse polymer architectures under varying solvent conditions, thermostats, and simulation lengths. Furthermore, we highlight its potential as a research assistant by directing it to investigate the effect of interaction parameters on the linear polymer conformation, and the influence of grafting density on the persistence length of the brush polymer. By coupling natural language interfaces with rigorous simulation tools, ToPolyAgent lowers barriers to complex computational workflows and advances AI-driven materials discovery in polymer science. It lays the foundation for autonomous and extensible multi-agent scientific research ecosystems.

Ding, Lijie [Oak Ridge National Laboratory (ORNL),↗
DOE OSTI2021

Dynamic Ride-Matching for Large-Scale Transportation Systems

Efficient dynamic ride-matching (DRM) in large-scale transportation systems is a key driver in transport simulations to yield answers to challenging problems. Although the DRM problem is simple to solve, it quickly becomes a computationally challenging problem in large-scale transportation system simulations. Therefore, this study thoroughly examines the DRM problem dynamics and proposes an optimization-based solution framework to solve the problem efficiently. To benefit from parallel computing and reduce computational times, the problem’s network is divided into clusters utilizing a commonly used unsupervised machine learning algorithm along with a linear programming model. Then, these sub-problems are solved using another linear program to finalize the ride-matching. At the clustering level, the framework allows users adjusting cluster sizes to balance the trade-off between the computational time savings and the solution quality deviation. A case study in the Chicago Metropolitan Area, U.S., illustrates that the framework can reduce the average computational time by 58% at the cost of increasing the average pick up time by 26% compared with a system optimum, that is, non-clustered, approach. Another case study in a relatively small city, Bloomington, Illinois, U.S., shows that the framework provides quite similar results to the system-optimum approach in approximately 62% less computational time.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2025

Siting and sizing of public–private charging stations impacts on household and electric vehicle fleets

To facilitate the provision of electric vehicle charging stations (EVCS) in urban areas, this study investigates the benefits of co-locating fleet-owned chargers with public charging stations to enable construction incentives and cord-sharing cost savings. Shared EVCS can serve charging demand from both user types: private (household) EV owners and those managing fleet vehicles – like shared and fully automated EV (SAEV) fleets. Using POLARIS to simulate all person-travel across the 6-county Austin, Texas region, new EVCS were sited and sized with DC fast-charging (DCFC) plugs to lower operating and construction costs while providing public + private (PP) service across an 81-square-mile core geofence (where 200 SAEVs were active) over 24-hour days. When co-location is permitted, 115 DCFC cords were added to the 23 existing (publicly available) stations to enable SAEVs and household EVs (HHEVs) charging access, within the geofence. Each 250-mile-range SAEV was simulated to travel an average of 330 miles per day, serve over 92 person-trips, and recharge 2.7 times a day (for 2.4 h per session). The new DCFC plugs were primarily added to public EVCS at shopping centers and schools, and in residential settings along freeways. The average plug served 4.8 EVs per day. Most co-located PP EVCS permitted immediate (no-wait) charging, except for 2 stations along freeways that averaged 8 min of wait time to begin charging. In conclusion, the co-location strategy lowered fleet owners’ initial EVCS construction costs by 12 % (thanks to cord-sharing to avoid cord duplication), while reducing SAEV wait times to just 3.1 min (versus 10.7 min if SAEV managers had to build and operate their own EVCS).

EV charging modeling↗
DOE OSTI2020

Demand Driven Cycamore Archetypes

Future nuclear fuel cycle options may present advantages over today’s once-through fuel cycle. Nuclear fuel cycle simulation tools assess the performance of those fuel cycles as well as the dynamics of long-term technology transitions. In many nuclear fuel cycle simulation tools, it has historically been the responsibility of the user to manually define facility deployment schemes and all facility parameters. While this is straightforward in simple fuel cycles, transitions from one fuel cycle to another can be more complex. In particular, deployment schemes for supportive fuel cycle facilities beyond the reactor become complex if the analyst desires to avoid gaps in the nuclear fuel and power supply chain during those transition scenarios. As nuclear fuel cycle analysis approaches questions regarding the feasibility and performance of the deployment schemes and technology choices during technology transition, automation of this historically manual process is necessary. The main objective of this work was to develop and demonstrate Cyclus automation capabilities toward key nuclear fuel cycle transition scenarios. While deploying reactors to meet power demand is trivial, and existed in the earliest versions of CYCLUS, automated, predictive deployment and decommissioning of other facilities is more complex. These include mining, milling, enrichment, fuel fabrication, reprocessing, and others. For example, a balanced closed fuel cycle may require ensuring that there is enough fast reactor fuel for their operation and may drive deployment of a fleet of light water reactors. This concern comprises the main challenge that drove the project effort. The Demand-Driven Cycamore Archetype project (NEUP-FY16-10512) aimed to develop CYCAMORE demand-driven deployment capabilities and thereby automate transition scenario definition. The developed software package, d3ploy, in the form of a CYCLUS Institution agent, deploys Facilities to meet the front-end and back-end demands of the fuel cycle. The University of South Carolina and the University of Illinois applied multiple algorithmic approaches to this challenge. This project developed an in situ demand-driven development schedule calculation through non-optimizing, deterministic-optimizing, and stochastic-optimizing algorithms as CYCLUS archetypes and demonstrated these new archetypes in program-supporting fuel cycle transition scenarios. Both objectives were achieved. This report documents the results and deliverables obtained toward these achievements in detail.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2022

A reinforcement learning approach to long-horizon operations, health, and maintenance supervisory control of advanced energy systems

In this work, we develop a Reinforcement Learning (RL) approach to the supervisory control problem for advanced energy systems, such as novel nuclear reactors and other demand-driven, mission-critical, and component-health-sensitive energy plants. The inclusive problem landscape considered captures the stochastic confluence of plant performance, component health evolution, power demand from the grid, diverse maintenance actions, and operator-defined goals and constraints, all considered over meaningfully long-enough reasoning horizons. Key aspects of the proposed approach are a receding horizon control-inspired technique dictating time- or event-triggered supervisory policy (re-)constructions, as well as additional capability-enabling contributions such as timescale compression, to handle long reasoning horizons and uncertainty in parts of the problem, and practical yet demonstrably-effective handling of hybrid action spaces with continuous and discrete decision variables. The resulting algorithm consists of a simulation-based RL agent constructing stochastic supervisory control policies over nontrivial action spaces and for long horizons, applying the learned policy to the system for a much shorter interval, and perpetually repeating, to construct the next long-horizon policy. That next policy will only be applied, again, for a short interval, yet originally far-in-time events move progressively closer, their associated uncertainty decreases, and new events and aspects enter the reasoning horizon. The proposed methodology bridges fundamental receding horizon concepts with the unequivocally stronger and more scalable reasoning of contemporary RL. Numerical examples using Soft Actor–Critic Deep RL illustrate the operation and efficacy of the proposed technique for a power plant tasked with health-aware load following missions in a dynamic electricity market landscape.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Analyzing the co-evolution of green technology diffusion and consumers’ pro-environmental attitudes: An agent-based model

Massive diffusion of green technologies is significant for building a cleaner world. However, the process of technology diffusion is usually slow and complex. An in-depth understanding of the mechanism regarding green technology diffusion is an essential precondition for effectively stimulating this process. Green technology diffusion heavily involves both social and technological changes. Although existing studies have provided rich knowledge about identifying critical drivers and barriers affecting green technology diffusion, research that considers consumers’ pro-environmental attitudes and green technology diffusion as an evolving system is still sparse. Aiming at exploring the co-evolution of consumers’ pro-environmental attitudes and green technology diffusion, this paper builds an agent-based model that integrates the relative agreement model with technology diffusion theories to conduct a sequence of controlled numerical experiments, which progressively unveil how attitudinal and technological factors impact green technology diffusion. The main findings include that (1) improving consumers’ pro-environmental attitudes is prominently beneficial to green technology diffusion and maturation; (2) technology maturity has very limited impact on consumers’ first-time purchases but significantly affects consumers’ satisfaction, which would further impact consumers’ repeat purchases; (3) consumers that do not support green technologies frequently emerge during the evolution of attitudes (despite the high technology maturity), which corresponds to the emergence of the anti-environmental groups observed in the real world; (4) active interactions between non-adopters enable their attitudes to converge, which results in the polarization of consumers’ attitudes.

ABM↗
NASA NTRS2014

Exploration of the Theoretical Physical Capacity of the John F. Kennedy International Airport Runway System

A design study was completed to explore the theoretical physical capacity (TPC) of the John F. Kennedy International Airport (KJFK) runway system for a northflow configuration assuming impedance-free (to throughput) air traffic control functionality. Individual runways were modeled using an agent-based, airspace simulation tool, the Airspace Concept Evaluation System (ACES), with all runways conducting both departures and arrivals on a first-come first-served (FCFS) scheduling basis. A realistic future flight schedule was expanded to 3.5 times the traffic level of a selected baseline day, September 26, 2006, to provide a steady overdemand state for KJFK runways. Rules constraining departure and arrival operations were defined to reflect physical limits beyond which safe operations could no longer be assumed. Safety buffers to account for all sources of operational variability were not included in the TPC estimate. Visual approaches were assumed for all arrivals to minimize inter-arrival spacing. Parallel runway operations were assumed to be independent based on lateral spacing distances. Resulting time intervals between successive airport operations were primarily constrained by same-runway and then by intersecting-runway spacing requirements. The resulting physical runway capacity approximates a theoretical limit that cannot be exceeded without modifying runway interaction assumptions. Comparison with current KJFK operational limits for a north-flow runway configuration indicates a substantial throughput gap of approximately 48%. This gap may be further analyzed to determine which part may be feasibly bridged through the deployment of advanced systems and procedures, and which part cannot, because it is either impossible or not cost-effective to control. Advanced systems for bridging the throughput gap may be conceptualized and simulated using this same experimental setup to estimate the level of gap closure achieved.

Neitzke, Kurt W.↗
DOE OSTI2022

An agent-based deployment decision-support system for electric vehicle services

METS-R ADDSEVS simulator is a high fidelity, parallel, agent-based evacuation simulator for multi-modal energy-optimal trip scheduling in real-time (METS-R) at transportation hubs. It consists of two modules. The first one is the traffic simulator module; the second one is the high-performance computing (HPC) module. More details can be found at https://umnilab.github.io/METS-R_doc/.

Lei, Zengxiang↗
DOE OSTI2023

Statistical Learning for Nonlinear Model Reduction from Local Simulations of Stochastic and Particle- and Agent-Based Systems

Stochastic physical systems across the sciences that have very high-dimensional state spaces, with a large number of fast degrees of freedom that force direct simulators to proceed by integration steps that are orders of magnitude smaller than events of interests (e.g., particle collisions). Examples range from molecular motion to dynamics of large populations of cells. A grand challenge in the simulation and understanding of such systems is the systematic construction of accurate, interpretable, reduced models, enabling faster simulations, revealing fundamental properties of the dynamics, and predicting phenomena of interest that the original simulator could not reached with sufficient accuracy or within a given computational budget. In this projected we developed novel statistical estimation/machine learning techniques for analyzing and building empirical reduced models for important families of high-dimensional stochastic systems, in particular: - we developed techniques for estimating interaction kernels in interacting particle- and agent-based systems, which are ubiquitous in Physics, Biology and many other sciences, given observed trajectories of the system; - we developed techniques for nonlinear model reduction for high-dimensional stochastic systems that have a small number of unknown, nonlinear slow variables, and a large number of fast modes, that are possibly of large magnitude, given observed short trajectories of the system in the form of bursts of trajectories from different initial conditions; - we developed novel techniques for estimating linear dynamical systems on graphs when both the dynamics and the underlying graph are unknown, and we have a sparse set of space-time observations; - we considered the problem of estimating an unknown nonlinear observation function of a standard process (e.g. Brownian motion), so that we can recognized if an observed dynamics is "just" a nonlinear version of a known dynamics; we also developed benchmarks for learning algorithms aimed at learning and classifying diffusion processes.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

A level-of-details framework for representing occupant behavior in agent-based models

We report agent-based modeling is an advanced computational technique capable of representing complex and dynamic processes of human behavior in building performance simulation. Though the agent-based approach supports diverse applications concerning human behavior modeling within the built environment, there is no consensus on the optimal amount of information or level of granularity needed for occupant information representation. This paper attempts to formalize the level of details (LoD) needed for occupant behavior representation in agent-based environments. A novel framework, grounded on the concept of LoD, is proposed to select the required details in representing occupants in agent-based models. Ten attributes related to occupants' presence, movement, behavioral processes, and repertoire are considered to define the LoD. The framework identifies use case parameters as the guiding principle and allows a hybrid approach for selecting varying degrees of occupant attributes to serve the purpose of simulation. A discussion on the pertinence of different occupant behavior LoDs in relation to the desired objective and simulation context is also presented. The study intends to support the occupant behavior research by advancing agent-based occupant modeling in building performance simulation.

42 ENGINEERING↗
NASA NTRS2012

Using Agent Based Modeling (ABM) to Develop Cultural Interaction Simulations

Today, most cultural training is based on or built around "cultural engagements" or discrete interactions between the individual learner and one or more cultural "others". Often, success in the engagement is the end or the objective. In reality, these interactions usually involve secondary and tertiary effects with potentially wide ranging consequences. The concern is that learning culture within a strict engagement context might lead to "checklist" cultural thinking that will not empower learners to understand the full consequence of their actions. We propose the use of agent based modeling (ABM) to collect, store, and, simulating the effects of social networks, promulgate engagement effects over time, distance, and consequence. The ABM development allows for rapid modification to re-create any number of population types, extending the applicability of the model to any requirement for social modeling.

Drucker, Nick↗
DOE OSTI2021

A system of shared autonomous vehicles for Chicago: Understanding the effects of geofencing the service

With autonomous vehicles (AVs) still in the testing phase, researchers and planners must resort to simulation techniques to explore possible futures regarding shared and automated mobility. An agent-based discrete-event transport simulator, POLARIS, is used in this study to simulate travel in the 20-county Chicago region with a shared AV (SAV) mobility option. Using this framework, the effect of an SAV fleet on system performance when constrained to serve within geofences is studied under four distinct scenarios: service restricted to the city, to the city plus suburban core, to the core plus exurban areas, and to the entire region — along with the choice of dynamic ridesharing (DRS) versus solo travel in an SAV. Results indicate that service areas need a balanced mix of trip generators and attractors, and an SAV fleet’s empty VMT (eVMT) can be noticeably reduced through suitable geofencing and DRS. Geofences can also help lower response times, reduce systemwide VMT across all modes, and ensure uniform access to SAVs. DRS is most useful in lowering VMT and %eVMT that arises from sprawled land development, but with insufficient demand to share rides, savings from the use of geofences is higher. Geofences targeting neighborhoods with high trip density bring about low response times and %eVMT, but fleet sizes in these regions need to be designed for uniformly low response times throughout a large region, as opposed to maximizing vehicle use in a 24-hour day.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2026

Comparing Delay-, Distance-, and Cordon-Based Congestion Pricing Strategies Via Large-Scale Simulation

This study compares the impacts of delay-, distance-, and cordon-based congestion pricing strategies for Austin, Texas, using the POLARIS agent-based activity-based travel demand simulation model. This approach enables agent-level heterogeneity and realistic choice options (including destination, mode, and activity scheduling) for dynamic traffic assignment and congestion feedbacks across a major metro region, which are features lacking in past work. To ensure comparability, distance-based tolls were set to generate the same revenue as delay-based tolling of $3.5 M/day, averaging $1.17/resident/day or $0.42/vehicle-trip. Delay-based pricing delivers 44% lower network delay and 13% lower VHT compared to the no-toll baseline, levels unmatched by other pricing strategies. At the height of the AM peak, drivers pay up to $0.13/mile on average, though most links in the network remain untolled. Distance-based pricing is the most effective at reducing VMT (by 4%), but VHT reductions (of 6%) primarily stem from drivers selecting closer destinations, achieving only one-fourth the delay reduction of delay-based pricing. Across various implementations of delay- and distance-based pricing, the results suggest that spatial variations of tolls are far more important than temporal variations. Cordon tolls produce minimal impacts at the network-wide level, but offer substantial delay reductions inside the cordon. Other major findings include: 1) delay-based pricing increases trip-making during the PM peak period due to backward shifts in discretionary-activity start times by higher-income residents; and 2) tolls’ spatial impacts, including changes in network flows and tolls paid by residents, vary substantially between delay- and distance-based pricing strategies.

Agent-based modeling↗
NASA NTRS2002

Agent Based Modeling of Collaboration and Work Practices Onboard the International Space Station

The International Space Station is one the most complex projects ever, with numerous interdependent constraints affecting productivity and crew safety. This requires planning years before crew expeditions, and the use of sophisticated scheduling tools. Human work practices, however, are difficult to study and represent within traditional planning tools. We present an agent-based model and simulation of the activities and work practices of astronauts onboard the ISS based on an agent-oriented approach. The model represents 'a day in the life' of the ISS crew and is developed in Brahms, an agent-oriented, activity-based language used to model knowledge in situated action and learning in human activities.

Acquisti, Alessandro↗
DOE OSTI2023

Discerning Deception: An Empirically-Driven Agent-Based Model of Expert Evaluation of Scientific Content

Both human subject experiments and computational, modeling and simulations have been used to study detection of deception. This work aims to combine these two methods by integrating empirically-derived information (from human subject experiments) into agent-based models to generate novel insights into the complex problems of detection of disinformation content. Computational experiments are used to simulate across multiple scenarios for evaluation and decision-making regarding the validity of potentially deceptive scientific documents. Factors influencing the human agent behaviors in the model were identified through a human subject experiment that was conducted to evaluate and characterize decision making related to disinformation discernment. Correlation and regression analyses were used to translate insights from the human subjects experiment to inform the parameterization of agent features and scenario development. Three scenarios were evaluated with the agent-based models to help evaluate the replicability of the simulations (validation analysis) and assess the influence of human agent and document features (sensitivity analyses). A replication of the human participant experiment demonstrated that the agent-based simulations compare favorably to empirical findings. The agent-based modeling was then used to conduct sensitivity analysis on the accuracy of deception detection as a function of document proportions and human agent features. Results indicate that precision values are adversely impacted when the proportion of deceptive documents is lower in the overall sample, whereas recall values are more sensitive to changes in human agent features. These findings indicate important nuances in accuracy evaluations that should be further considered (including consideration of potential alternate metrics) in future agent-based models of disinformation. Additional areas for future exploration include extension of simulations to consider other ways to align the agent-based model design with psychological theory and inclusion of agent-agent interactions, especially as it pertains to sharing of scientific information within an organizational context.

99 GENERAL AND MISCELLANEOUS↗