Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “planning scheduling optimization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 343 records · Page 19

South Atlantic Anomaly Entry and Exit as Measured by the X-Ray Timing Explorer

The Rossi X-ray Timing Explorer (RXTE) carries instruments that must switch off high voltages (HV) when passing through the South Atlantic Anomaly (SAA). The High Energy X-ray Timing Experiment (HEXTE) contains a particle monitor that detects the increased particle flux associated with the SAA and autonomously reduces its voltage. The Proportional Counter Array (PCA) relies on uplinked predictions of SAA entry/exit times based on ephemeris data provided by the Flight Dynamics Facility. A third instrument, the All-Sky Monitor (ASM) also uses a predicted SAA model to reduce voltage when passing through the SAA. Data collected from the HEXTE particle monitor, as well as other instrument readings near the times of SAA entry/exit offer the potential for refining models of the boundaries of the SAA. The SAA has an increased particle flux which causes high rates of detection in the RXTE instruments designed to observe x-rays. The high counting rates could degrade the PCA if HV is not reduced during SAA passages. On the other hand, PCA downtime can be minimized and the science return can be optimized by having the best possible model of the SAA boundary. Thus, the PCA team planned an extensive effort during in-orbit checkout to utilize both the HEXTE particle monitor data and instrument counting rates to refine the model of the SAA boundary. The times of SAA entry and exit are compared with the definitive epemeris to determine the precise location (latitude and longitude) of the SAA boundary. Over time, the SAA and its perimeter were mapped. The RXTE Science Operations Center is continuously working to feed back the results of this effort into the science scheduling process, improving the SAA model as it affects the RXTE instruments, thus obtaining more accurate estimates of the SAA entry/exit times.

Smith, Evan↗

IpexT: Integrated Planning and Execution for Military Satellite Tele-Communications

The next generation of military communications satellites may be designed as a fast packet-switched constellation of spacecraft able to withstand substantial bandwidth capacity fluctuation in the face of dynamic resource utilization and rapid environmental changes including jamming of communication frequencies and unstable weather phenomena. We are in the process of designing an integrated scheduling and execution tool which will aid in the analysis of the design parameters needed for building such a distributed system for nominal and battlefield communications. This paper discusses the design of such a system based on a temporal constraint posting planner/scheduler and a smart executive which can cope with a dynamic environment to make a more optimal utilization of bandwidth than the current circuit switched based approach.

Plaunt, Christian↗

Ikhana: A NASA UAS Supporting Long Duration Earth Science Missions

NASA's Ikhana unmanned aerial vehicle (UAV) is a General Atomics MQ-9 Predator-B modified to support the conduct of Earth science missions for the NASA Science Mission Directorate through partnerships, other government agencies and universities. Ikhana, a Native American word meaning 'intelligence', can carry over 2000 lbs of atmospheric and remote sensing instruments in the payload bay and external pods. The aircraft is capable of mission durations in excess of 24 hours at altitudes above 40,000 ft. Redundant flight control, avionics, power, and network systems increase the system reliability and allow easier access to public airspace. The aircraft is remotely piloted from a mobile ground control station (GCS) using both C-band line-of-sight and Ku-band over-the-horizon satellite datalinks. NASA's GCS has been modified to support on-site science monitoring, or the downlink data can be networked to remote sites. All ground support systems are designed to be deployable to support global Eart science investigations. On-board support capabilities include an instrumentation system and an Airborne Research Test System (ARTS). The ARTS can host research algorithms that will autonomously command and control on-board sensors, perform sensor health monitoring, conduct data analysis, and request changes to the flight plan to maximize data collection. The ARTS also has the ability to host algorithms that will autonomously control the aircraft trajectory based on sensor needs, (e.g. precision trajectory for repeat pass interferometry) or to optimize mission objectives (e.g. search for specific atmospheric conditions). Standard on-board networks will collect science data for recording and for inclusion in the aircraft's high bandwidth downlink. The Ikhana project will complete GCS development, science support systems integration, external pod integration and flight clearance, and operations crew training in early 2007. A large-area remote sensing mission is currently scheduled for the Summer 2007.

Cobleigh, Brent R.↗

Computational Algorithms for Unit Commitment with AC Power Flows (Final Report)

Security-constrained unit commitment (SCUC) is a key component in power system operations. When AC power flow constraints are considered in the SCUC model (AC-SCUC), the problem becomes extremely difficult due to its discrete and non-convex nature, as described in “Grid Optimization Competition Challenge 3 Problem Formulation (GOCC)”. There are four main challenges: (i) Discrete decisions regarding unit online/offline status and start-up/shut-down procedures for every single unit. The number of discrete decision variables increases considerably when a system integrates multiple generators; (ii) Configuration-based combined-cycle formulations, and multi-commodity models that include ramping products, spin/non-spin products, and regulation up/down products. The combined-cycle units introduce additional discrete decision variables and auxiliary service products further complicate the model by connecting multi-commodity products’ continuous and discrete variables; (iii) SCUC models with AC power flow constraints are far more complex due to massive bilinear terms in the large-scale nonlinear power balance equations. The nonlinear power balance equations are further complicated by the discrete step control variables of shunts; (iv) N − 1 contingency analysis. The size of the model increases linearly with the number of contingencies considered, greatly increasing the size of the optimization model. Accordingly, there is an emergent need to develop a robust algorithm capable of deriving a high-quality solution in a short time and passing through contingency tests simultaneously. In this project, we explore innovative techniques to address this challenging problem by integrating advanced polyhedral theory, approximation methods, relaxation strategies, decomposition techniques, and parallel computing. Each technique approaches the problem from a different perspective, leveraging its specific strengths to tackle distinct challenges. Each individual method has demonstrated its effectiveness in the PI’s previous research. Their integration is expected to significantly reduce the computational time required to solve the proposed complex problem. Successful completion of this project has the potential to transform the industry by enhancing optimization solvers capable of handling large-scale day-ahead energy market clearing models within strict time constraints, while incorporating AC power flow constraints. This advancement will lead to reduced overall generation costs and, consequently, increased social welfare.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Spatiotemporal Fractionation Schemes for Irradiating Large Cerebral Arteriovenous Malformations

Purpose: To optimally exploit fractionation effects in the context of radiosurgery treatments of large cerebral arteriovenous malformations (AVMs). In current practice, fractionated treatments divide the dose evenly into several fractions, which generally leads to low obliteration rates. In this work, we investigate the potential benefit of delivering distinct dose distributions in different fractions. Methods and Materials: Five patients with large cerebral AVMs were reviewed and replanned for intensity modulated arc therapy delivered with conventional photon beams. Treatment plans allowing for different dose distributions in all fractions were obtained by performing treatment plan optimization based on the cumulative biologically effective dose delivered at the end of treatment. Results: We show that distinct treatment plans can be designed for different fractions, such that high single-fraction doses are delivered to complementary parts of the AVM. All plans create a similar dose bath in the surrounding normal brain and thereby exploit the fractionation effect. This partial hypofractionation in the AVM along with fractionation in normal brain achieves a net improvement of the therapeutic ratio. We show that a biological dose reduction of approximately 10% in the healthy brain can be achieved compared with reference treatment schedules that deliver the same dose distribution in all fractions. Conclusions: Boosting complementary parts of the target volume in different fractions may provide a therapeutic advantage in fractionated radiosurgery treatments of large cerebral AVMs. The strategy allows for a mean dose reduction in normal brain that may be valuable for a patient population with an otherwise normal life expectancy.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Comprehensive Lifecycle Planning and Management System For Addressing Water Issues Associated With Shale Gas Development In New York, Pennsylvania, And West Virginia

The objective of this project is to develop a modeling system to allow operators and regulators to plan all aspects of water management activities associated with shale gas development in the target project area of New York, Pennsylvania, and West Virginia (target area ), including water supply, transport, storage, use, recycling, and disposal and which can be used for planning, managing, forecasting, permit tracking, and compliance monitoring. The proposed project is a breakthrough approach to represent the entire shale gas water lifecycle in one comprehensive system with the capability to analyze impacts and options for operational efficiency and regulatory tracking and compliance, and to plan for future water use and disposition. It will address all of the major water-related issues of concern associated with shale gas development in the target area, including water withdrawal, transport, storage, use, treatment, recycling, and disposal. It will analyze the costs, water use, and wastes associated with the available options, and incorporate constraints presented by permit requirements, agreements, local and state regulations, equipment and material availability, etc. By using the system to examine the water lifecycle from withdrawals through disposal, users will be able to perform scenario analysis to answer "what if" questions for various situations. The system will include regulatory requirements of the appropriate state and regional agencies and facilitate reporting and permit applications and tracking. These features will allow operators to plan for more cost effective resource production. Regulators will be able to analyze impacts of development over an entire area. Regulators can then make informed decisions about the protections and practices that should be required as development proceeds. This modeling system will have myriad benefits for industry, government, and the public. For industry, it will allow planning all water management operations for a project or an area as one entity to optimize water use and minimize costs subject to regulatory and other constraints. It will facilitate analysis of options and tradeoffs, and will also simplify permitting and reporting to regulatory agencies. The system will help regulators study cumulative impacts of development, conserve water resources, and manage disposal options across a region. It will also allow them to track permits and monitor compliance. The public will benefit from water conservation, improved environmental performance as better system wide decisions are made, and greater supply of natural gas, with attendant lower prices, as costs are reduced and development is assisted through better planning and scheduling. Altogether, better economics and fewer barriers will facilitate recovery of the more than 300 trillion cubic feet of estimated recoverable natural gas resource in the Marcellus Shale in a manner that protects the environment.

03 NATURAL GAS↗

Investigation into Scalable and Detection-Enhanced Satellite Conjunction Assessment

Imaging opportunities (viewable conjunctions) of Resident Space Objects (RSOs) by satellites are not continuously discovered. We propose to continuously produce and report viewable conjunctions among objects in orbit. Viewable conjunctions are events in space and time when a satellite may favorably view a Resident Space Object (RSO). Favorability is defined by a set of constraints, e.g., solar illumination, distance between observer and target, orbital location for viewable event. Computing viewable conjunctions requires calculation of orbital propagation while considering constraints based on the state vectors of position, velocity, with covariance for both satellite and RSO. We propose two parallel lanes of effort: acceleration and research. The objective of acceleration is to avoid missed opportunities and reduce latency for satellite maneuver requests through continuous prediction and reporting of viewable conjunctions. The effort will begin by deploying currently available software on dedicated systems and continue with optimizing the code for high performance computing hardware. The research lane aims to expand RSO inspection and modeling capabilities. Among our current research ideas are spectral characterization of RSO materials and planning multiple observations to recover RSO 3D form. Computing resources at Oak Ridge National Laboratory (ORNL) are available for the acceleration work. Laika, Maxar conjunction prediction dashboard software, and Bluesim, Maxar orbital propagation software, are expected to be the first software in the acceleration lane. Laike and Bluesim are to be provided by the sponsor, and output will be made accessible through its dashboard. Deliverables will follow a gated schedule to the sponsor. ORNL will provide progressively more robust viewable conjunction assessments from both modelled and actual ephemerides.

97 MATHEMATICS AND COMPUTING↗

A VLBI variance-covariance analysis interactive computer program

An interactive computer program (in FORTRAN) for the variance covariance analysis of VLBI experiments is presented for use in experiment planning, simulation studies and optimal design problems. The interactive mode is especially suited to these types of analyses providing ease of operation as well as savings in time and cost. The geodetic parameters include baseline vector parameters and variations in polar motion and Earth rotation. A discussion of the theroy on which the program is based provides an overview of the VLBI process emphasizing the areas of interest to geodesy. Special emphasis is placed on the problem of determining correlations between simultaneous observations from a network of stations. A model suitable for covariance analyses is presented. Suggestions towards developing optimal observation schedules are included.

Bock, Y.↗

A comparison of price-taker and production cost models for determining system value, revenue, and scheduling of concentrating solar power plants

Concentrating solar power (CSP) plants convert solar energy into electricity and can be coupled with low-cost thermal energy storage to provide a dispatchable renewable resource. Maximizing the economic benefits of CSP systems requires deliberate selection of the timing of thermal energy dispatch to coincide with high-price or high-value periods. The performance and value of CSP systems have traditionally been evaluated using two distinct approaches: (1) production cost models (PCMs), which optimize commitment and dispatch schedules for an entire fleet of generators to minimize the cost of satisfying electricity demand; and (2) price-taker (PT) models, which optimize dispatch of the CSP system against historical or forecasted electricity prices to maximize revenue available to the CSP operator. The PCM approach is, in principle, superior because of the ability to capture system-level details such as transmission pathways and associated constraints, and feedback between CSP dispatch schedules and operation of other generators. The computationally simpler PT technique cannot explicitly address these concerns, but the comparative reduction in solution time is attractive for sensitivity analysis and rigorous optimization of CSP plant design and operation. In this work, we directly compare the dispatch profiles, net revenue, and operational value of CSP systems using implementations of each technique to assess how closely the solutions from the PT technique can approach those from the PCM for a specific market scenario. The PT implementation produced characteristically similar dispatch profiles as the PCM for both a large solar-multiple configuration and a small solar-multiple peaking configuration, while requiring only 1% of the computational time of the PCM. In addition, dispatching the CSP plant according to the self-scheduled PT solution - as opposed to the system-optimized PCM solution - only reduced the total CSP operational value by 1-5%, with consistent trends across CSP configurations and locations. This analysis validates the ability of the PT approach to substantially capture the economic benefits of CSP systems when pricing profiles are available, and indicates that the PT approach is suitable for initial design and optimization of CSP technologies.

14 SOLAR ENERGY↗

The Applied Meteorology Unit: Nineteen Years Successfully Transitioning Research into Operations for America's Space Program

The Applied Meteorology Unit (AMU) provides technology transition and technique development to improve operational weather support to the Space Shuttle and the entire American space program. The AMU is funded and managed by NASA and operated by a contractor that provides five meteorologists with a diverse mix of advanced degrees, operational experience, and associated skills including data processing, statistics, and the development of graphical user interfaces. The AMU's primary customers are the U.S. Air Force 45th Weather Squadron at Patrick Air Force Base, the National Weather Service Spaceflight Meteorology Group at NASA Johnson Space Center, and the National Weather Service Melbourne FL Forecast Office. The AMU has transitioned research into operations for nineteen years and worked on a wide range of topics, including new forecasting techniques for lightning probability, synoptic peak winds,.convective winds, and summer severe weather; satellite tools to predict anvil cloud trajectories and evaluate camera line of sight for Space Shuttle launch; optimized radar scan strategies; evaluated and implemented local numerical models; evaluated weather sensors; and many more. The AMU has completed 113 projects with 5 more scheduled to be completed by the end of 2010. During this rich history, the AMU and its customers have learned many lessons on how to effectively transition research into operations. Some of these lessons learned include collocating with the operational customer and periodically visiting geographically separated customers, operator submitted projects, consensus tasking process, use of operator primary advocates for each project, customer AMU liaisons with experience in both operations and research, flexibility in adapting the project plan based on lessons learned during the project, and incorporating training and other transition assistance into the project plans. Operator involvement has been critical to the AMU's remarkable success and many awards from NASA, the National Weather Association, and two citations from the Navy's Center of Excellence for Best Manufacturing Practices. This paper will present the AMU's proven methods and explain how they may be applied by other organizations to effectively transition research into operations.

Madura, John T.↗

Spot and Runway Departure Advisor

The Spot and Runway Departure Advisor (SARDA) is a research prototype of a decision support tool for ATC tower controllers to assist in manging and controlling traffic on the surface of an airport. SARDA employs a scheduler to generate an optimal runway schedule and gate push-back - spot release sequence and schedule that improves efficiency of surface operations. The advisories for ATC tower controllers are displayed on an Electronic Flight Strip (EFS) system. The human-in-the-loop simulation of the SARDA tool was conducted for east operations of Dallas-Ft. Worth International Airport (DFW) to evaluate performance of the SARDA tool and human factors, such as situational awareness and workload. The results indicates noticeable taxi delay reduction and fuel savings by using the SARDA tool. Reduction in controller workload were also observed throughout the scenario runs. The future plan includes modeling and simulation of the ramp operations of the Charlotte International Airport, and develop a decision support tool for the ramp controllers.

decision support tool↗

Risk of Performance Decrements and Adverse Health Outcomes Resulting from Sleep Loss, Circadian Desynchronization, and Work Overload

Sleep loss, circadian desynchronization, and work overload occur to some extent for ground and flight crews, prior to and during spaceflight missions. Ground evidence indicates that such risk factors may lead to performance decrements and adverse health outcomes, which could potentially compromise mission objectives. Efforts are needed to identify the environmental and mission conditions that interfere with sleep and circadian alignment, as well as individual differences in vulnerability and resiliency to sleep loss and circadian desynchronization. Specifically, this report highlights a collection of new evidence to better characterize the risk and reveals new gaps in this risk as follows: Sleep loss is apparent during spaceflight. Astronauts consistently average less sleep during spaceflight relative to on the ground. The causes of this sleep loss remain unknown, however ground-based evidence suggests that the sleep duration of astronauts is likely to lead to performance impairment and short and long-term health consequences. Further research is needed in this area in order to develop screening tools to assess individual astronaut sleep need in order to quantify the magnitude of sleep loss during spaceflight; current and planned efforts in BHP's research portfolio address this need. In addition, it is still unclear whether the conditions of spaceflight environment lead to sleep loss or whether other factors, such as work overload lead to the reduced sleep duration. Future data mining efforts and continued data collection on the ISS will help to further characterize factors contributing to sleep loss. Sleep inertia has not been evaluated during spaceflight. Ground-based studies confirm that it takes two to four hours to achieve optimal performance after waking from a sleep episode. Sleep inertia has been associated with increased accidents and reduced performance in operational environments. Sleep inertia poses considerable risk during spaceflight when emergency situations necessitate that crewmembers wake from sleep and make quick decisions. A recently completed BHP investigation assesses the effects of sleep inertia upon abrupt awakening, with and without hypnotics currently used in spaceflight; results from this investigation will help to inform strategies relative to sleep inertia effects on performance. Circadian desynchrony has been observed during spaceflight. Circadian desynchrony during spaceflight develops due to schedule constraints requiring non-24 operations or 'slam-shifts' and due to insufficient or mis-timed light exposure. In addition, circadian misalignment has been associated with reduced sleep duration and increased medication use. In ground-based studies, circadian desynchrony has been associated with significant performance impairment and increased risk of accidents when operations coincide with the circadian nadir. There is a great deal of information available on how to manage circadian misalignment, however, there are currently no easily collected biomarkers that can be used during spaceflight to determine circadian phase. Current research efforts are addressing this gap. Work overload has been documented during current spaceflight operations. NASA has established work hour guidelines that limit shift duration, however, schedule creep, where duty requirements necessitate working beyond scheduled work hours, has been reported. This observation warrants the documentation of actual work hours in order to improve planning and in order to ensure that astronauts receive adequate down time. In addition to concerns about work overload, ground based evidence suggests that work underload may be a concern during deep space missions, where torpor may develop and physically demanding workload will be exchanged for monitoring of autonomous systems. Given that increased automation is anticipated for exploration vehicles, fatigue effects in the context of such systems needs to be further understood. Performance metrics are needed to evaluate fitness-for-duty during spaceflight. Although ground-based evidence supports the notion that sleep loss, circadian desynchronization and work overload lead to performance impairment, inconsistency in the measures used to evaluate performance during spaceflight make it difficult to evaluate the magnitude of performance impairment during spaceflight. Work is underway to standardize measures of performance evaluation during spaceflight. Once established, such performance indicators need to be correlated with operational performance. Individual differences in sleep need and circadian preference, phase shifting ability and period have been documented in ground-based studies. Individual differences in response to sleep loss and circadian misalignment have also been documented and are presumed to be associated with genetic polymorphisms. No studies have systematically reported individual differences in sleep or circadian-related outcomes during spaceflight. More work is needed in this area in order to identify genetic or phenotypic biomarkers that predict resilience or vulnerability to sleep loss in order to personalize countermeasure strategies and mitigate performance impairment during spaceflight. Two laboratory and field investigations specific to this topic are currently ongoing; additional efforts, including an effort to mine existing biological data from spaceflight relative to sleep and circadian outcomes, are planned. Sex differences in sleep need and circadian period and phase have been reported in ground-based studies. The impact of these sex differences on performance is unclear. Sex differences in sleep need and circadian rhythms have not been systematically studied during spaceflight, presumably due to the small number of women that have flown in space. More research is needed in this area to evaluate whether any of the observed sex differences in physiology lead to altered performance in spaceflight and on the ground.

Flynn-Evans, Erin↗

Optimal Patient Positioning (Prone Versus Supine) for VMAT in Gynecologic Cancer: A Dosimetric Study on the Effect of Different Margins

Purpose/Objective: It is unknown whether the historically found dosimetric advantages of treating gynecologic cancer with the patient in a prone position with use of a small-bowel displacement device (belly-board) remain when volumetric arc therapy (VMAT) is used and whether these advantages depend on the necessary margin between clinical target volume (CTV) and planning target volume (PTV). The aim of this study is to determine the best patient position (prone or supine) in terms of sparing organs at risk (OAR) for various CTV-to-PTV margins and VMAT dose delivery. Methods and Materials: In an institutional review board—approved study, 26 patients with gynecologic cancer scheduled for primary (9) or postoperative (17) radiation therapy were scanned in a prone position on a belly-board and in a supine position on the same day. The primary tumor CTV, nodal CTV, bladder, bowel, and rectum were delineated on both scans. The PTVs were created each with a different margin for the primary tumor and nodal CTV. The VMAT plans were generated with our in-house system for automated treatment planning. For all margin combinations, the supine and prone plans were compared with consideration of all OAR dose-volume parameters but with highest priority given to bowel cavity V{sub 45Gy} (cm{sup 3}). Results: For both groups, the prone position reduced the bowel cavity V{sub 45Gy}, in particular for nodal margins ≥10 mm (ΔV{sub 45Gy} = 23.9 ± 10.6 cm{sup 3}). However, for smaller margins, the advantage was much less pronounced (ΔV{sub 45Gy} = 6.5 ± 3.0 cm{sup 3}) and did not reach statistical significance. The rectum mean dose (D{sub mean}) was significantly lower (ΔD{sub mean} = 2.5 ± 0.3 Gy) in the prone position for both patient groups and for all margins, and the bladder D{sub mean} was significantly lower in the supine position (ΔD{sub mean} = 2.6 ± 0.4 Gy) only for the postoperative group. The advantage of the prone position was not present if it needed a larger margin than the supine position. Conclusion: For patients with gynecologic cancer, the historically found dosimetric advantages for the prone position remain for modern dose delivery techniques if large margins are needed. However, the advantage is lost for small margins and if the prone position needs a larger margin than the supine position.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Optimal mass evacuation planning for electric vehicles before natural disasters

The electric vehicle (EV) market has significantly expanded because EVs have lower operational costs while leaving less environmental footprint than internal combustion engine vehicles. However, EVs also come with drawbacks, including long charging time and short operational ranges. With these drawbacks and limited charging facilities, efficient long-distance EV evacuation management is challenging and has not been properly addressed. Without an efficient evacuation plan, serious congestion could happen at charging facilities, the evacuation process would be excessively long, and thus human lives may be put at risk. This study is motivated to investigate the optimal mass evacuation planning for EVs considering limited charging facilities. A three-stage method is proposed to efficiently approach this problem. A case study of Florida hurricane evacuation is conducted. Here, the method's effectiveness is verified by comparing it with a benchmark. Management insights and policy indications are drawn through sensitivity analysis of key parameters.

33 ADVANCED PROPULSION SYSTEMS↗

Systems engineering studies of on-orbit assembly operation

While the practice of construction has a long history, the underlying theory of construction is relatively young. Very little has been documented as to techniques of logistic support, construction planning, construction scheduling, construction testing, and inspection. The lack of 'systems approaches' to construction processes is certainly one of the most serious roadblocks to the construction of space structures. System engineering research efforts at CSC are aimed at developing concepts and tools which contribute to a systems theory of space construction. The research is also aimed at providing means for trade-offs of design parameters for other research areas in CSC. Systems engineering activity at CSC has divided space construction into the areas of orbital assembly, lunar base construction, interplanetary transport vehicle construction, and Mars base construction. A brief summary of recent results is given. Several models for 'launch-on-time' were developed. Launch-on-time is a critical concept to the assembly of such Earth-orbiting structures as the Space Station Freedom, and to planetary orbiters such as the Mars transfer vehicle. CSC has developed a launch vehicle selection model which uses linear programming to find optimal combinations of launch vehicles of various sizes (Atlas, Titan, Shuttles, HLLV's) to support SEI missions. Recently, the Center developed a cost trade-off model for studying on orbit assembly logistics. With this model it was determined that the most effective size of the HLLV would be in the range of 120 to 200 metric tons to LEO, which is consistent with the choices of General Stafford's Synthesis Group Report. A second-generation Dynamic Construction Activities Model ('DYCAM') process model has been under development, based on our past results in interruptability and our initial DYCAM model. This second-generation model is built on the paradigm of knowledge-based expert systems. It is aimed at providing answers to two questions: (1) what are some necessary or sufficient conditions for judging conceptual designs of spacecraft?, and (2) can a methodology be formulated such that these conditions may be used to provide computer-aided tools for evaluating conceptual designs and planning for space assembly sequences? Early simulation results indicate that the DYCAM model has a clear ability to emulate and simulate human orbital construction processes.

Morgenthaler, George W.↗

A Cooperative Multi-Agent Deep Reinforcement Learning Framework for Real-Time Residential Load Scheduling

Internet-of-Things (IoT) enabled monitoring and control capabilities are enabling increasing numbers of household users with controllable loads to actively participate in smart grid energy management. Realizing an efficient real-time energy management system that takes advantage of these developments requires novel techniques for managing the increased complexity of the control action space in resolving multiple challenges such as the uncertainty in energy prices and renewable energy output along with the need to satisy physical grid constraints such as transformer capacity. Addressing these challenges, we develop a multi-household energy management framework for residential units connected to the same transformer and containing DERs such as PV, ESS and controllable loads. The goal of our framework is to schedule controllable household appliances and ESS such that the cost of procuring electricity from the utility over a horizon is minimized while physical grid constraints are satisfied at each scheduling step. Traditional energy management frameworks either perform global optimization to satisfy grid constraints but suffer from high computational complexity (for example Integer Program, Mixed Integer Programming frameworks and centralized reinforcement learning) or perform decentralized real-time energy management without satisfying global grid constraints (for example multi-agent reinforcement learning with no cooperation). In contrast, we propose a cooperative multiagent reinforcement learning (MARL) framework that i) operates in real-time, and ii) performs explicit collaboration to satisfy global grid constraints. The novelty in our framework is two fold. Firstly, our framework trains multiple independent learners (IL) for each household in parallel using historical data and performs real-time inferencing of control actions using the most recent system state. Secondly, our framework contains a low complexity knapsack based cooperation agent which combines the outputs of ILs to minimize cost while satisfying grid constraints. Simulation results show that our cooperative MARL approach achieves significant cost improvement over centralized reinforcement learning and day-ahead planning baselines. Moreover, our approach strictly satisfies physical constraints with no apriori knowledge of system dynamics while the baseline approaches have occasional violations. We also measure the training and inference time by ranging the number of households from 1 to 25. Results show that our cooperative MARL approach scales best among various approaches.

14 SOLAR ENERGY↗

U.S. Virgin Islands Petroleum Price-Spike Preparation

This NREL technical report details a plan for the U.S. Virgin Islands (USVI) to minimize the economic damage caused by major petroleum price increases. The assumptions for this plan are that the USVI will have very little time and money to implement it and that the population will be highly motivated to follow it because of high fuel prices. The plan's success, therefore, is highly dependent onbehavior change. This plan was derived largely from a review of the actions taken and behavior changes made by companies and commuters throughout the United States in response to the oil price spike of 2008. Many of these solutions were coordinated by or reported through the 88 local representatives of the U.S. Department of Energy's Clean Cities program. The National Renewable Energy Laboratoryprovides technical and communications support for the Clean Cities program and therefore serves as a de facto repository of these solutions. This plan is the first publication that has tapped this repository.

02 PETROLEUM↗

Monte Carlo Tree Search Methods for the Earth-Observing Satellite Scheduling Problem

This work explores on-board planning for the single spacecraft, multiple ground station Earth-observing satellite scheduling problem through artificial neural network function approximation of state–action value estimates generated by Monte Carlo tree search (MCTS). An extensive hyperparameter search is conducted for MCTS on the basis of performance, safety, and downlink opportunity utilization to determine the best hyperparameter combination for data generation. A hyperparameter search is also conducted on neural network architectures. The learned behavior of each network is explored, and each network architecture’s robustness to orbits and epochs outside of the training distributions is investigated. Furthermore, each algorithm is compared with a genetic algorithm, which serves to provide a baseline for optimality. MCTS is shown to compute near-optimal solutions in comparison to the genetic algorithm. The state–action value networks are shown to match or exceed the performance of MCTS in six orders of magnitude less execution time, showing promise for execution on board spacecraft.

Adam P. Herrmann↗