Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “AUTOMATE”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 397 records · Page 22

Design of Distributed Cyber-Physical Systems for Connected and Automated Vehicles with Implementing Methodologies

With the development of communication and control technology, intelligent transportation systems have received increasing attention from both industry and academia. Intelligent transportation systems are supported by the Internet of Things, Cyber-Physical System, Artificial Intelligence, Cloud Computing and many other technologies, which supply fundamental information for connected and automated vehicles. Although plenty of studies have provided different formulations for intelligent transportation systems, many of them depend on Master Control Center. However, a centralized control mode requires a huge amount of data transmission and high level of hardware configuration and may cause communication delay and privacy leak. Some distributed architectures have been proposed to overcome the above problems but systematized technologies to collect and exchange information, process large amounts of data, model the dynamics of vehicles, and safely control the connected and automated vehicles are not explored in detail. In this paper, we proposed a novel distributed cyber-physical system for connected and automated vehicles in which every vehicle is modeled as a double-integrator using edge computing to analyze information collected from its nearest neighbors. The vehicles are supposed to travel along a desired trajectory and to maintain a rigid formation geometry. Related methodologies for the proposed system are illustrated and experiments are conducted showing that the performance of the connected and automated vehicles matches very well with analytic predictions. Some design guidelines and open questions are provided for the future study.

97 MATHEMATICS AND COMPUTING↗

Design and Operation of an Open, Interoperable Automated Demand Response Infrastructure for Commercial Buildings

This paper describes the concept for and lessons from the development and field-testing of an open, interoperable communications infrastructure to support automated demand response (auto-DR). Automating DR allows greater levels of participation, improved reliability, and repeatability of the DR in participating facilities. This paper also presents the technical and architectural issues associated with auto-DR and description of the demand response automation server (DRAS), the client/server architecture-based middle-ware used to automate the interactions between the utilities or any DR serving entity and their customers for DR programs. Use case diagrams are presented to show the role of the DRAS between utility/ISO and the clients at the facilities.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Automated planning of breast radiotherapy using cone beam CT imaging

Purpose: Develop and clinically validate a methodology for using cone beam computed tomography (CBCT) imaging in an automated treatment planning framework for breast IMRT. Methods: A technique for intensity correction of CBCT images was developed and evaluated. The technique is based on histogram matching of CBCT image sets, using information from “similar” planning CT image sets from a database of paired CBCT and CT image sets (n = 38). Automated treatment plans were generated for a testing subset (n = 15) on the planning CT and the corrected CBCT. The plans generated on the corrected CBCT were compared to the CT-based plans in terms of beam parameters, dosimetric indices, and dose distributions. Results: The corrected CBCT images showed considerable similarity to their corresponding planning CTs (average mutual information 1.0±0.1, average sum of absolute differences 185 ± 38). The automated CBCT-based plans were clinically acceptable, as well as equivalent to the CT-based plans with average gantry angle difference of 0.99°±1.1°, target volume overlap index (Dice) of 0.89±0.04 although with slightly higher maximum target doses (4482±90 vs 4560±84, P < 0.05). Gamma index analysis (3%, 3 mm) showed that the CBCT-based plans had the same dose distribution as plans calculated with the same beams on the registered planning CTs (average gamma index 0.12±0.04, gamma <1 in 99.4%±0.3%). Conclusions: The proposed method demonstrates the potential for a clinically feasible and efficient online adaptive breast IMRT planning method based on CBCT imaging, integrating automation.

60 APPLIED LIFE SCIENCES↗

MO-FG-303-04: A Smartphone Application for Automated Mechanical Quality Assurance of Medical Accelerators

Purpose: The mechanical quality assurance (QA) of medical accelerators consists of a time consuming series of procedures. Since most of the procedures are done manually – e.g., checking gantry rotation angle with the naked eye using a level attached to the gantry –, it is considered to be a process with high potential for human errors. To remove the possibilities of human errors and reduce the procedure duration, we developed a smartphone application for automated mechanical QA. Methods: The preparation for the automated process was done by attaching a smartphone to the gantry facing upward. For the assessments of gantry and collimator angle indications, motion sensors (gyroscope, accelerator, and magnetic field sensor) embedded in the smartphone were used. For the assessments of jaw position indicator, cross-hair centering, and optical distance indicator (ODI), an optical-image processing module using a picture taken by the high-resolution camera embedded in the smartphone was implemented. The application was developed with the Android software development kit (SDK) and OpenCV library. Results: The system accuracies in terms of angle detection error and length detection error were < 0.1° and < 1 mm, respectively. The mean absolute error for gantry and collimator rotation angles were 0.03° and 0.041°, respectively. The mean absolute error for the measured light field size was 0.067 cm. Conclusion: The automated system we developed can be used for the mechanical QA of medical accelerators with proven accuracy. For more convenient use of this application, the wireless communication module is under development. This system has a strong potential for the automation of the other QA procedures such as light/radiation field coincidence and couch translation/rotations.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Exploring the physics of cesium lead halide perovskite quantum dots via Bayesian inference of the photoluminescence spectra in automated experiment

The unique optoelectronic properties of metal halide perovskite quantum dots (QDs) make them promising candidates for applications in light-emitting diodes (LEDs), scintillators, and other photonic devices. The automated micropipetting synthesis platform equipped with an optical reader enables the opportunity for high throughput synthesis and photoluminescent (PL) characterization of metal halide perovskite QDs for the first time. Here, we explore the compositional dependence of the PL behavior and stability of the combinatorial library of cesium lead halide (CsPbX 3 ) perovskites QDs via the automated platform. To study the stability of synthesized QDs in the binary and ternary configurations, we study the time-dependent PL properties using previously developed machine learning analysis. Additionally, to systematically explore the PL behavior in the ternary CsPbX 3 QDs system, we introduce the Bayesian inference framework that allows the probabilistic fit of multiple models to the PL data and establishes both optimal model and model parameter robustly. Furthermore, these behaviors can be used as a control parameter for the navigation of the multidimensional compositional spaces in automated synthesis. Furthermore, this analysis shows the nonuniformity of the PL peak behavior in the ternary CsPbX 3 QDs system. Further, the analysis confirms narrow size distribution and good quality of CsPbBr 3 QDs alloyed with low concentrations of iodide and chloride. We note that Bayesian Inference fit parameters can be further used as a control signal for navigation of the chemical spaces in automated synthesis.

36 MATERIALS SCIENCE↗

Automation Technologies Impact on the Work Process of Nuclear Power Plants

The current cost associated with the work process of nuclear power plants necessities modernizing the work process by augmenting it with automation technologies. This work was performed to assess various automation technologies and the means by which they assimilate into the work process in order to make gains in cost savings in modern nuclear power plants. The goal was to identify key informational items that would be useful to members of industry who are undertaking the large effort to reduce costs through automation by identifying technology maturity levels, recent research, and an analysis of cost impacts of the work process. The technologies cost saving was categorized into low, medium, and high cost savings. Through this effort, a substantive literature review and analysis of recent technological and market trends was performed. The key areas of cost impact were identified through communication with users in industry from operations and maintenance organizations. The results were assembled into a list of work process steps and technologies that are ready be implemented or researched for the automating aspects of that step. This effort aims to present to utilities opportunities of cost saving that are achievable in the short term, and gaps for research organizations and vendors to consider for further research and development. The results of this effort generated a list of technologies that fit each of the three cost saving categories. Electronic work packages remain a high cost saving technology, but data mining and integration, smart scheduling, and dynamic risk models are also indicated to yield a high cost savings. Video applications, spatial mapping, and image processing and identification technologies appear to provide solid cost savings in the medium category, and rounding out the low cost saving areas are deployable technologies such as bar codes, communication tools, and electronic tags.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Northwest Open Automated Demand Response Technology Demonstration Project

Lawrence Berkeley National Laboratory (LBNL) and the Demand Response Research Center (DRRC) performed a technology demonstration and evaluation for Bonneville Power Administration (BPA) in Seattle City Light's (SCL) service territory. This report summarizes the process and results of deploying open automated demand response (OpenADR) in Seattle area with winter morning peaking commercial buildings. The field tests were designed to evaluate the feasibility of deploying fully automated demand response (DR) in four to six sites in the winter and the savings from various building systems. The project started in November of 2008 and lasted 6 months. The methodology for the study included site recruitment, control strategy development, automation system deployment and enhancements, and evaluation of sites participation in DR test events. LBNL subcontracted McKinstry and Akuacom for this project. McKinstry assisted with recruitment, site survey collection, strategy development and overall participant and control vendor management. Akuacom established a new server and enhanced its operations to allow for scheduling winter morning day-of and day-ahead events. Each site signed a Memorandum of Agreement with SCL. SCL offered each site $3,000 for agreeing to participate in the study and an additional $1,000 for each event they participated. Each facility and their control vendor worked with LBNL and McKinstry to select and implement control strategies for DR and developed their automation based on the existing Internet connectivity and building control system. Once the DR strategies were programmed, McKinstry commissioned them before actual test events. McKinstry worked with LBNL to identify control points that can be archived at each facility. For each site LBNL collected meter data and trend logs from the energy management and control system. The communication system allowed the sites to receive day-ahead as well as day-of DR test event signals. Measurement of DR was conducted using three different baseline models for estimation peak load reductions. One was three-in-ten baseline, which is based on the site electricity consumption from 7 am to 10 am for the three days with the highest consumption of the previous ten business days. The second model, the LBNL outside air temperature (OAT) regression baseline model, is based on OAT data and site electricity consumption from the previous ten days, adjusted using weather regressions from the fifteen-minute electric load data during each DR test event for each site. A third baseline that simply averages the available load data was used for sites less with less than 10 days of historical meter data. The evaluation also included surveying sites regarding any problems or issues that arose during the DR test events. Question covered occupant comfort, control issues and other potential problems.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Northwest Open Automated Demand Response Technology Demonstration Project

The Lawrence Berkeley National Laboratory (LBNL) Demand Response Research Center (DRRC) demonstrated and evaluated open automated demand response (OpenADR) communication infrastructure to reduce winter morning and summer afternoon peak electricity demand in commercial buildings the Seattle area. LBNL performed this demonstration for the Bonneville Power Administration (BPA) in the Seattle City Light (SCL) service territory at five sites: Seattle Municipal Tower, Seattle University, McKinstry, and two Target stores. This report describes the process and results of the demonstration. OpenADR is an information exchange model that uses a client-server architecture to automate demand-response (DR) programs. These field tests evaluated the feasibility of deploying fully automated DR during both winter and summer peak periods. DR savings were evaluated for several building systems and control strategies. This project studied DR during hot summer afternoons and cold winter mornings, both periods when electricity demand is typically high. This is the DRRC project team's first experience using automation for year-round DR resources and evaluating the flexibility of commercial buildings end-use loads to participate in DR in dual-peaking climates. The lessons learned contribute to understanding end-use loads that are suitable for dispatch at different times of the year. The project was funded by BPA and SCL. BPA is a U.S. Department of Energy agency headquartered in Portland, Oregon and serving the Pacific Northwest. BPA operates an electricity transmission system and markets wholesale electrical power at cost from federal dams, one non-federal nuclear plant, and other non-federal hydroelectric and wind energy generation facilities. Created by the citizens of Seattle in 1902, SCL is the second-largest municipal utility in America. SCL purchases approximately 40% of its electricity and the majority of its transmission from BPA through a preference contract. SCL also provides ancillary services within its own balancing authority. The relationship between BPA and SCL creates a unique opportunity to create DR programs that address both BPA's and SCL's markets simultaneously. Although simultaneously addressing both market could significantly increase the value of DR programs for BPA, SCL, and the end user, establishing program parameters that maximize this value is challenging because of complex contractual arrangements and the absence of a central Independent System Operator or Regional Transmission Organization in the northwest.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Algorithms to Automate LCLS Undulator Tuning

Automation of the LCLS undulator tuning offers many advantages to the project. Automation can make a substantial reduction in the amount of time the tuning takes. Undulator tuning is fairly complex and automation can make the final tuning less dependent on the skill of the operator. Also, algorithms are fixed and can be scrutinized and reviewed, as opposed to an individual doing the tuning by hand. This note presents algorithms implemented in a computer program written for LCLS undulator tuning. The LCLS undulators must meet the following specifications. The maximum trajectory walkoff must be less than 5 {micro}m over 10 m. The first field integral must be below 40 x 10{sup -6} Tm. The second field integral must be below 50 x 10{sup -6} Tm{sup 2}. The phase error between the electron motion and the radiation field must be less than 10 degrees in an undulator. The K parameter must have the value of 3.5000 {+-} 0.0005. The phase matching from the break regions into the undulator must be accurate to better than 10 degrees. A phase change of 113 x 2{pi} must take place over a distance of 3.656 m centered on the undulator. Achieving these requirements is the goal of the tuning process. Most of the tuning is done with Hall probe measurements. The field integrals are checked using long coil measurements. An analysis program written in Matlab takes the Hall probe measurements and computes the trajectories, phase errors, K value, etc. The analysis program and its calculation techniques were described in a previous note. In this note, a second Matlab program containing tuning algorithms is described. The algorithms to determine the required number and placement of the shims are discussed in detail. This note describes the operation of a computer program which was written to automate LCLS undulator tuning. The algorithms used to compute the shim sizes and locations are discussed.

43 PARTICLE ACCELERATORS↗

Automation of Nanoparticle Synthesis Processes in a Plasma Environment Using LabVIEW

This work presents an automated control system for the synthesis of nanomaterials by plasma-enhanced chemical vapor deposition (PECVD), implemented using the LabVIEW software environment. The main objective of the study is to develop an integrated hardware-software platform that enables sequential control of the key stages of the PECVD process, including vacuum chamber preparation, pressure monitoring, working gas supply, plasma ignition, power matching, cyclic nanomaterial growth, and optical monitoring of nanoparticles in the plasma environment. The use of LabVIEW made it possible to integrate actuator control, experimental parameter acquisition, and realtime process visualization within a single automated system. The automated cycle begins with evacuation of the reaction chamber to a predefined base pressure. Transition to the next stage is permitted only after the specified pressure threshold has been reached, ensuring reproducible initial conditions for each experiment. The program then controls the supply of the working gas through mass flow controllers (MFCs). In this work, two gas-flow control modes were considered: analog control using a 0-5 V voltage signal and digital communication via RS-232 interface. It was shown that the analog approach requires accurate scaling of the control voltage, since applying 5 V corresponds to full-scale opening of the controller and results in the maximum gas flow. In contrast, the RS232 interface enables the gas flow rate to be specified directly in sccm, improving the accuracy, flexibility, and convenience of gas-environment control. After pressure stabilization, LabVIEW initiates RF plasma ignition and executes the RF matching algorithm aimed at minimizing reflected power and improving the stability of the plasma process. A separate software module implements the cyclic nanomaterial growth mode, in which the plasma-on time, plasma duration, and total number of synthesis cycles are predefined. This approach makes it possible to control material accumulation on the substrate and to correlate the process parameters with the morphological characteristics of the resulting nanostructures. The final module of the system is designed for optical monitoring of the nanoparticle cloud density in dusty plasma. For this purpose, the change in the intensity of laser radiation passing through the plasma region is recorded using a photodetector and a Keithley 2401 measuring unit connected to LabVIEW via RS-232 interface. The difference between the initial and modified optical signal intensity is used as a diagnostic parameter characterizing the formation and temporal evolution of nanoparticles. The developed system demonstrates that LabVIEW can be effectively applied not only for the automation of individual instruments, but also for the implementation of a complete digital control cycle for PECVD-based nanomaterial synthesis.

PECVD↗

Human versus automation in responding to failures: an expected-value analysis

A simple analytical criterion is provided for deciding whether a human or automation is best for a failure detection task. The method is based on expected-value decision theory in much the same way as is signal detection. It requires specification of the probabilities of misses (false negatives) and false alarms (false positives) for both human and automation being considered, as well as factors independent of the choice--namely, costs and benefits of incorrect and correct decisions as well as the prior probability of failure. The method can also serve as a basis for comparing different modes of automation. Some limiting cases of application are discussed, as are some decision criteria other than expected value. Actual or potential applications include the design and evaluation of any system in which either humans or automation are being considered.

NASA Discipline Space Human Factors↗

Effects of a psychophysiological system for adaptive automation on performance, workload, and the event-related potential P300 component

The present study examined the effects of an electroencephalographic- (EEG-) based system for adaptive automation on tracking performance and workload. In addition, event-related potentials (ERPs) to a secondary task were derived to determine whether they would provide an additional degree of workload specificity. Participants were run in an adaptive automation condition, in which the system switched between manual and automatic task modes based on the value of each individual's own EEG engagement index; a yoked control condition; or another control group, in which task mode switches followed a random pattern. Adaptive automation improved performance and resulted in lower levels of workload. Further, the P300 component of the ERP paralleled the sensitivity to task demands of the performance and subjective measures across conditions. These results indicate that it is possible to improve performance with a psychophysiological adaptive automation system and that ERPs may provide an alternative means for distinguishing among levels of cognitive task demand in such systems. Actual or potential applications of this research include improved methods for assessing operator workload and performance.

Task Performance and Analysis↗

Cassini-Huygens maneuver automation for navigation

Many times during the Cassini-Huygens mission to Saturn, propulsive maneuvers must be spaced so closely together that there isn't enough time or workforce to execute the maneuver-related software manually, one subsystem at a time. Automation is required. Automating the maneuver design process has involved close cooperation between teams. We present the contribution from the Navigation system. In scope, this includes trajectory propagation and search, generation of ephemerides, general tasks such as email notification and file transfer, and presentation materials. The software has been used to help understand maneuver optimization results, Huygens probe delivery statistics, and Saturn ring-plane crossing geometry. The Maneuver Automation Software (MAS), developed for the Cassini-Huygens program enables frequent maneuvers by handling mundane tasks such as creation of deliverable files, file delivery, generation and transmission of email announcements, generation of presentation material and other supporting documentation. By hand, these tasks took up hours, if not days, of work for each maneuver. Automated, these tasks may be completed in under an hour. During the cruise trajectory the spacing of maneuvers was such that development of a maneuver design could span about a month, involving several other processes in addition to that described, above. Often, about the last five days of this process covered the generation of a final design using an updated orbit-determination estimate. To support the tour trajectory, the orbit determination data cut-off of five days before the maneuver needed to be reduced to approximately one day and the whole maneuver development process needed to be reduced to less than a week..

propulsion maneuvers↗

Automation and Process Improvement Enables a Small Team to Operate a Low Thrust Mission in Orbit Around the Asteroid Vesta

NASA's Dawn mission to the asteroid Vesta and dwarf planet Ceres launched September 27, 2007 and arrived at Vesta in July of 2011. This mission uses ion propulsion to achieve the necessary delta-V to reach and maneuver at Vesta and Ceres. This paper will show how the evolution of ground system automation and process improvement allowed a relatively small engineering team to transition from cruise operations to asteroid operations while maintaining robust processes. The cruise to Vesta phase lasted almost 4 years and consisted of activities that were built with software tools, but each tool was open loop and required engineers to review the output to ensure consistency. Additionally, this same time period was characterized by the evolution from manually retrieved and reviewed data products to automatically generated data products and data value checking. Furthermore, the team originally took about three to four weeks to design and build about four weeks of spacecraft activities, with spacecraft contacts only once a week. Operations around the asteroid Vesta increased the tempo dramatically by transitioning from one contact a week to three or four contacts a week, to fourteen contacts a week (every 12 hours). This was accompanied by a similar increase in activity complexity as well as very fast turn around activity design and build cycles. The design process became more automated and the tools became closed loop, allowing the team to build more activities without sacrificing rigor. Additionally, these activities were dependent on the results of flight system performance, so more automation was added to analyze the flight data and provide results in a timely fashion to feed the design cycle. All of this automation and process improvement enabled up the engineers to focus on other aspects of spacecraft operations, including spacecraft health monitoring and anomaly resolution.

ground system automation↗

NextGen Technologies on the FAA's Standard Terminal Automation Replacement System

This paper describes the integration, evaluation, and results from a high-fidelity human-in-the-loop (HITL) simulation of key NASA Air Traffic Management Technology Demonstration - 1 (ATD- 1) technologies implemented in an enhanced version of the FAA's Standard Terminal Automation Replacement System (STARS) platform. These ATD-1 technologies include: (1) a NASA enhanced version of the FAA's Time-Based Flow Management, (2) a NASA ground-based automation technology known as controller-managed spacing (CMS), and (3) a NASA advanced avionics airborne technology known as flight-deck interval management (FIM). These ATD-1 technologies have been extensively tested in large-scale HITL simulations using general-purpose workstations to study air transportation technologies. These general purpose workstations perform multiple functions and are collectively referred to as the Multi-Aircraft Control System (MACS). Researchers at NASA Ames Research Center and Raytheon collaborated to augment the STARS platform by including CMS and FIM advisory tools to validate the feasibility of integrating these automation enhancements into the current FAA automation infrastructure. NASA Ames acquired three STARS terminal controller workstations, and then integrated the ATD-1 technologies. HITL simulations were conducted to evaluate the ATD-1 technologies when using the STARS platform. These results were compared with the results obtained when the ATD-1 technologies were tested in the MACS environment. Results collected from the numerical data show acceptably minor differences, and, together with the subjective controller questionnaires showing a trend towards preferring STARS, validate the ATD-1/STARS integration.

air traffic management↗

Human-Automation Cooperation for Separation Assurance in Future NextGen Environments

A 2012 Human-In-The-Loop air traffic control simulation investigated a gradual paradigm-shift in the allocation of functions between operators and automation. Air traffic controllers staffed five adjacent high-altitude en route sectors, and during the course of a two-week experiment, worked traffic under different function-allocation approaches aligned with four increasingly mature NextGen operational environments. These NextGen time-frames ranged from near current-day operations to nearly fully-automated control, in which the ground systems automation was responsible for detecting conflicts, issuing strategic and tactical resolutions, and alerting the controller to exceptional circumstances. Results indicate that overall performance was best in the most automated NextGen environment. Safe operations were achieved in this environment for twice todays peak airspace capacity, while being rated by the controllers as highly acceptable. However, results show that sector operations were not always safe; separation violations did in fact occur. This paper will describe in detail the simulation conducted, as well discuss important results and their implications.

air traffic control↗

Crew Resource Management for Automated Teammates (CRM-A)

Crew Resource Management (CRM) is the application of human factors knowledge and skills to ensure that teams make effective use of all resources. This includes ensuring that pilots bring in opinions of other teammates and utilize their unique capabilities. CRM was originally developed 40 years ago in response to a number of airline accidents in which the crew was found to be at fault. The goal was to improve teamwork among airline cockpit crews. The notion of "team" was later expanded to include cabin crew and ground resources. CRM has also been adopted by other industries, most notably medicine. Automation research now finds itself faced with similar issues to those faced by aviation 40 years ago: how to create a more robust system by making full use of both the automation and its human operators. With advances in machine intelligence, processing speed and cheap and plentiful memory, automation has advanced to the point that it can and should be treated as a teammate to fully take advantage of its capabilities and contributions to the system. This area of research is known as Human-Autonomy Teaming (HAT). Research on HAT has identified reusable patterns that can be applied in a wide range of applications. These patterns include features such as bi-directional communication and working agreements. This paper will explore the synergies between CRM and HAT. We believe that HAT research has much to learn from CRM and that there are benefits to expanding CRM to cover automation.

Crew Resource Management↗

Automated Scenario Generation for Human-in-the-Loop Simulations

Automated Multi-Aircraft Control System scenario generation for Human-in-the-Loop (HITL) evaluations of air traffic management concepts is described. The objective is to replace the difficult manual process with the automated process for creating an initial (seed) scenario that serves as a starting point for manual adjustments for creating the Human-in-the-Loop scenario. Methods for analyzing and comparing the seed-scenario generated using the automated process and the Human-in-the-Loop-scenario derived from it to meet the experiment objectives are discussed. Results of comparison of input Human-in-the-Loop-scenario with the Multi-Aircraft Control System output are also presented. The main findings are: (1) many of the characteristics of the seed-scenario used for constructing the Human-in-the-Loop-scenario are preserved in the Human-in-the-Loop-scenario, (2) landing rate profile of the traffic generated by the Multi-Aircraft Control System (MACS) using the input scenario compares reasonably well with that intended in the input scenario, and (3) many of the desired characteristics of the Human-in-the-Loop-scenario can be achieved by further automation.

Automated Scenario Generation↗