Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “policy optimization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6
All sourcesNASA NTRSDOE OSTI
NASA NTRSDate not supplied

Scheduling for Urban Air Mobility using Safe Learning

This work considers the scheduling problem for Urban Air Mobility (UAM) vehicles travelling between origin-destination pairs with both hard and soft trip deadlines. Each route is described by a discrete probability distribution over trip completion times (or delay) and over interarrival times of requests (or demand) for the route along with a fixed hard or soft deadline. Soft deadlines carry a cost that is incurred when the deadline is missed. An online, safe scheduler is developed that ensures that hard deadlines are never missed and that average cost of missing soft deadlines is minimized. The system is modelled as a Markov Decision Process (MDP) and safe model based learning is used to find the probabilistic distributions over route delays and demand. Monte Carlo Tree Search (MCTS) Earliest Deadline First (EDF) is used to safely explore the learned models in an online fashion and develop a near-optimal non-preemptive scheduling policy. These results are compared with Value Iteration (VI) and MCTS (Random) scheduling solutions.

Urban Air Mobility↗
DOE OSTI2024

The Debate on Vehicle Triad: Examining the Utilization Patterns of Gasoline, Hybrid, and Electric Vehicles in Households

Light-duty vehicles contribute to approximately half of the transport sector's emissions, a sector challenging to decarbonize owing to the autocentric nature of many American cities. The U.S. Department of Transportation's blueprint outlines three key decarbonization strategies: increasing convenience, improving efficiency, and transitioning to zero-emission vehicles. Among these, the adoption of Electric Vehicles (EVs) offers a promising opportunity to reduce emissions from light-duty vehicles, which are predominantly gasoline-powered. Although substantial literature identifies and addresses factors influencing EV adoption, understanding their utilization within households who own vehicles with mixed fuel types is crucial for accurately assessing their environmental benefits. This paper addresses two key questions: (a) Are EVs utilized more, equally, or less than gasoline vehicles (GVs) and (b) What factors influence mileage utilization patterns in households with multiple vehicle fuel types, accounting for substitution and complementary effects? Analysis of 2022 National Household Travel Survey (NHTS) data indicates that EVs are utilized more than GVs within households that own multiple mixed fuel fleets. Findings reveal that households with a higher number of younger individuals and multiple workers use EVs more extensively, and those with older adults and larger households with multiple vehicles tend to use GVs more. Rural households have higher use of hybrid vehicles (HVs). The study identifies a substitution effect between EVs and GVs, while complementary relationship between HVs and EVs, suggesting nuances in vehicle utilization patterns. This nuanced understanding of vehicle utilization patterns informs the development of targeted policies and infrastructure investments to optimize household transportation efficiency.

ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2025

Designing robust energy policy packages under deep uncertainty: A multi-metric decision support framework

The complexity of transitioning to sustainable energy systems requires policy frameworks capable of balancing multiple objectives while addressing deep uncertainty. However, existing approaches often lack systematic methods to identify combinations of policy levers that remain effective across a wide range of uncertain futures. This paper presents a novel decision support framework that guides the selection of robust policy packages based on their performance across multiple objectives under uncertainty. Our method leverages a large ensemble of scenarios and applies scenario discovery techniques to identify influential policy levers. Here, we introduce new indicators to assess the robustness of policies by evaluating their ability to mitigate adverse outcomes across metrics. These indicators support an iterative process to build a robust policy package. Finally, we map the technological and energy pathways associated with the robust policy package by leveraging an energy system optimization model. We illustrate the application of this framework to the Spanish energy system, providing insights into how specific combinations of policy levers shape decarbonization pathways under uncertainty.

Decision-support method↗
DOE OSTI2024

An Iterative Approach for Solving the SCOPF Problem Applying LP, SOCP, and NLP Subproblems

We propose to develop efficient algorithms and software for the SCOPF problem. We will employ an iterative approach that will: a) use linear subproblems and other active set filtering techniques to identify the most important contingencies and drastically reduce the SCOPF model size; b) solve SOCP relaxations of the reduced SCOPF to converge to the neighborhood of the global optimal solution and establish a lower bound on the solution, and; c) use a non-convex, nonlinear interior-point solver, Artelys Knitro, to converge quickly to the optimal solution. To identify the most effective approach, we will experiment with several techniques to identify the tradeoffs between contingency subproblem complexity and fast solvability.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2024

Optimal Control of SOEC-Based Hydrogen Production Systems for Demand Response Using Deep Reinforcement Learning in Smart Grids

Solid oxide electrolysis cell (SOEC) hydrogen production technology can range in size from small, appliance-size equipment to large-scale, central production facilities that can be tied directly to renewable or non-greenhouse-gas-emitting forms of electricity production, making it an ideal resource for demand response (DR). The SOEC hydrogen production system is a complex integrated system that encompasses fluid dynamics, electrical dynamics, and electrochemical and thermal dynamics, all of which involve non-linearity and non-convexity. Proper control of the SOEC hydrogen production system is crucial to enable its participation in the DR program. Here, to overcome the difficulty of designing an explicit control law for such nonlinear systems with nonconvex optimization features in DR applications, deep reinforcement learning (DRL) is explored to achieve the optimal control of the SOEC system for DR participation. Specifically, a twin delayed deterministic policy gradient (TD3) control framework is applied to achieve optimal response performance during DR events by considering power tracking error and hydrogen production efficiency with a suitable reward function. Two case studies with grid connections for tracking different DR commands were investigated. The first case study involved operating conditions reaching the boundaries, while the second involved operating conditions within the boundaries. The results showed that the proposed DRL-based control for SOEC can track the DR signal in a timely manner while maintaining high energy efficiency.

08 HYDROGEN↗
DOE OSTI2024

Transmission Interface Limits for High-Spatial Resolution Capacity Expansion Modeling

Large-scale capacity expansion models typically rely on estimates of the power transfer limits between modeled zones. Accurate estimation of these interface transfer limits (ITLs) requires modeling the underlying transmission network. Here we expand on a maximum flow optimization method that uses linearized power flow to estimate transfer limits. We apply this method to a data set of the U.S. transmission network to estimate ITLs between U.S. counties. By calculating ITLs using different subsets of the network, we evaluate how the size of the network used in the estimation affects the results. The results show diminishing returns to ITL accuracy after six hops, suggesting that a network subset can reasonably be used to approximate ITLs. The county-level estimates produced in this study will support more spatially resolved capacity expansion modeling and will help inform policy making at local and national levels.

capacity planning↗
DOE OSTI2025

Valued peaks: Sustainable water allocation for small hydropower plants in an era of explicit ecological needs

Optimizing hydropower operations to balance economic profitability and support functioning ecosystem services is integral to river management policy. In this article, we propose a dynamic, constrained optimization framework for small hydropower plants (SHPs) to evaluate trade-offs between economic profitability and socio-ecological requirements. Specifically, we examine the balance between short-term losses in hydropower generation and the potential for compensatory benefits in the form of revenue from recreational ecosystem services, irrespective of the direct beneficiary. Our framework integrates a fish habitat model, a hydropower optimization model, and a recreational ecosystem service estimate to evaluate different environmental flow scenarios. The optimization process gives three outflow release scenarios, informed by previous streamflow realisations (dam inflow), and designed environmental flow constraints. The framework is applied and tested for the river Kuusinkijoki in North-eastern Finland, which is a habitat for migratory brown trout and grayling populations. We show that the revenue loss due to the environmental flow constraints arises through a reduction in revenue per generated energy unit and through a reduction in turbine efficiency. Additionally, the simulation results reveal that all the designed environmental flow constraints cannot be met simultaneously. Under the environmental flow scenario with both minimum flow and flow ramping rate constraints, the annual hydropower revenue decreases by 16.5 %. An annual increase of 8 % in recreational fishing visits offsets the revenue loss. In conclusion, the developed framework provides knowledge of the costs and benefits of hydropower environmental flow constraints and guides the prioritizing process of environmental measures.

13 HYDRO ENERGY↗
NASA NTRS2005

Cognitive Functioning in Space Exploration Missions: A Human Requirement

Solving cognitive issues in the exploration missions will require implementing results from both Human Behavior and Performance, and Space Human Factors Engineering. Operational and research cognitive requirements need to reflect a coordinated management approach with appropriate oversight and guidance from NASA headquarters. First, this paper will discuss one proposed management method that would combine the resources of Space Medicine and Space Human Factors Engineering at JSC, other NASA agencies, the National Space Biomedical Research Institute, Wyle Labs, and other academic or industrial partners. The proposed management is based on a Human Centered Design that advocates full acceptance of the human as a system equal to other systems. Like other systems, the human is a system with many subsystems, each of which has strengths and limitations. Second, this paper will suggest ways to inform exploration policy about what is needed for optimal cognitive functioning of the astronaut crew, as well as requirements to ensure necessary assessment and intervention strategies for the human system if human limitations are reached. Assessment strategies will include clinical evaluation and fitness-to-perform evaluations. Clinical intervention tools and procedures will be available to the astronaut and space flight physician. Cognitive performance will be supported through systematic function allocation, task design, training, and scheduling. Human factors requirements and guidelines will lead to well-designed information displays and retrieval systems that reduce crew time and errors. Means of capturing process, design, and operational requirements to ensure crew performance will be discussed. Third, this paper will describe the current plan of action, and future challenges to be resolved before a lunar or Mars expedition. The presentation will include a proposed management plan for research, involvement of various organizations, and a timetable of deliverables.

Fiedler, Edan↗
NASA NTRS2013

It's the Heat AND the Humidity -- Assessment of Extreme Heat Scenarios to Enable the Assessment of Climate Impacts on Public Health

In the United States, extreme heat is the most deadly weather-related hazard. In the face of a warming climate and urbanization, which contributes to local-scale urban heat islands, it is very likely that extreme heat events (EHEs) will become more common and more severe in the U.S. In a NASA-funded project supporting the National Climate Assessment, we are providing historical and future measures of extreme heat to enable assessments of the impacts of heat on public health over the coterminous U.S. We use atmospheric temperature and humidity information from meteorological reanalysis and from Global Climate Models (GCMs) to provide data on past and future heat events. The project s emphasis is on providing assessments of the magnitude, frequency and geographic distribution of extreme heat in the U.S. to facilitate public health studies. In our approach, long-term climate change is captured with GCM output, and the temporal and spatial characteristics of short-term extremes are represented by the reanalysis data. Two future time horizons, 2040 and 2090, are the focus of future assessments; these are compared to the recent past period of 1981-2000. We are characterizing regional-scale temperature and humidity conditions using GCM output for two climate change scenarios (A2 and A1B) defined in the Special Report on Emissions Scenarios (SRES). For each future period, 20 years of multi-model GCM output have been analyzed to develop a heat stress climatology based on statistics of extreme heat indicators. Differences between the two future and past periods have been used to define temperature and humidity changes on a monthly time scale and regional spatial scale. These changes, combined with hourly historical meteorological data at a spatial scale (12 km) much finer than that of GCMs, enable us to create future climate realizations, from which we compute the daily heat stress measures and related spatially-specific climatological fields. These include the mean annual number of days above certain thresholds of maximum and minimum air temperatures, heat indices and a new heat stress variable that gives an integrated measure of heat stress (and relief) over the course of a day. Comparisons are made between projected (2040 and 2090) and past (1990) heat stress statistics. All output is being provided at the 12 km spatial scale and will also be aggregated to the county level, which is a popular scale of analysis for public health researchers. County-level statistics will be made available by our collaborators at the Centers for Disease Control and Prevention (CDC) via the Wide-ranging Online Data for Epidemiologic Research (WONDER) system. CDC WONDER makes the information resources of the CDC available to public health professionals and the general public. This addition of heat stress measures to CDC WONDER will allow decision and policy makers to assess the impact of alternative approaches to optimize the public health response to EHEs. It will also allow public health researchers and policy makers to better include such heat stress measures in the context of national health data available in the CDC WONDER system. The users will be able to spatially and temporally query public health and heat-related data sets and create county-level maps and statistical charts of such data across the coterminous U.S.

Crosson, William L↗
DOE OSTI2025

Neural network approaches for parameterized optimal control

Here, we consider numerical approaches for deterministic, finite-dimensional optimal control problems whose dynamics depend on unknown or uncertain parameters. We seek to amortize the solution over a set of relevant parameters in an offline stage to enable rapid decision-making and be able to react to changes in the parameter in the online stage. To tackle the curse of dimensionality arising when the state and/or parameter are high-dimensional, we represent the policy using neural networks. We compare two training paradigms: First, our model-based approach leverages the dynamics and definition of the objective function to learn the value function of the parameterized optimal control problem and obtain the policy using a feedback form. Second, we use actor-critic reinforcement learning to approximate the policy in a data-driven way. Using an example involving a two-dimensional convection-diffusion equation, which features high-dimensional state and parameter spaces, we investigate the accuracy and efficiency of both training paradigms. While both paradigms lead to a reasonable approximation of the policy, the model-based approach is more accurate and considerably reduces the number of PDE solves.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Optimal Coordination of Electric Vehicles for Grid Services using Deep Reinforcement Learning

Recent research has shown the effectiveness of reinforcement learning (RL) in coordinating electric vehicles (EVs) with vehicle-to-grid capabilities for grid services. However, many of these studies rely on lookup table and deep Q-network techniques, which can be impractical when dealing with continuous states and actions. In addition, existing RL designs inadequately account for battery aging effects, EV user satisfaction, uncertain departure and arrival time, and trip distance, which may compromise effective coordination. This paper aims to bridge these gaps by developing an innovative deep deterministic policy gradient-based RL framework for optimal coordination of EVs. Case studies were carried out using a test system with 100 EVs, and numerical analysis results showed that the proposed RL framework can effectively coordinate EVs to maximize economic benefits and user satisfaction while ensuring the expected battery lifespan.

Das, Avijit↗
DOE OSTI2024

REopt Model Overview and Example Use Cases [Slides]

REopt(R) is a mixed-integer optimization model that minimizes the lifecycle cost of serving energy loads at a site. This work provides and introduction to the model along with its key workflow, techno-economic inputs, key outputs, and key caveats for readers to understand REopt the when, why, how of using this model. This resource also includes helpful links related to REopt model and the data sources it uses during the optimization.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2024

Scalable Control Co-design for Resilient-by-Design Cyber Physical Systems

Critical infrastructure networks, such as power and transportation networks, are often modelled as cyber-physical systems. With ever increasing complexity of these systems, there is a need for newer and more relevant metrics and design tools that will co-optimize the physical system components and control policies to guarantee resilience against cyber and natural threats. To this end, a simulation-based control co-design computational framework that will concurrently determine the system and control parameters of a cyber-physical system to meet pre-specified resilience, operational and economic objectives has been developed. The capabilities of the developed co-design engine are demonstrated by designing the physical components and control parameters of a microgrid system that will meet its resiliency objectives when subjected to various cyber and physical threats.

42 ENGINEERING↗
NASA NTRS1994

A knowledge-based system for controlling automobile traffic

Transportation network capacity variations arising from accidents, roadway maintenance activity, and special events as well as fluctuations in commuters' travel demands complicate traffic management. Artificial intelligence concepts and expert systems can be useful in framing policies for incident detection, congestion anticipation, and optimal traffic management. This paper examines the applicability of intelligent route guidance and control as decision aids for traffic management. Basic requirements for managing traffic are reviewed, concepts for studying traffic flow are introduced, and mathematical models for modeling traffic flow are examined. Measures for quantifying transportation network performance levels are chosen, and surveillance and control strategies are evaluated. It can be concluded that automated decision support holds great promise for aiding the efficient flow of automobile traffic over limited-access roadways, bridges, and tunnels.

Maravas, Alexander↗
NASA NTRS1998

Airport Financing and User Charge Systems in the USA

This paper examines the financing of U.S. public airports in a turbulent era of change, and projects toward the future. It begins by briefly outlining historical patterns that have changed the industry, and airport facilities in particular. It then develops basic principles of public finance as applied to public infrastructure, followed by the applicable principles of management. Following that, the current airport financing system is analyzed and contrasted with a socially optimal financing system. A concluding section suggests policy reforms and their likely benefits. The principles of finance and management discussed here are elementary. However, their implications are radical for U.S. airport policy. There is a great deal of room to improve the allocation of aviation infrastructure resources. The application of these basic principles makes it evident that in many cases, current practice is wasteful, environmentally unsound, overly costly, and inequitable. Future investments in public aviation capital will continue to be wasteful until more efficient pricing systems are instituted. Thus, problem in the U.S. is not one of insufficient investment in airport infrastructure, but investment in the wrong types of infrastructure. In the U.S., the vast majority of publically-owned airports are owned by local governments. Thus, while the federal government bad a great deal of influence in financing airports, ultimately these are local decisions. The same is true with many other public infrastructure issues. Katz and Herman (1997) report that in 1995, U.S. net public capital stock equaled almost $4.6 trillion, 72% of which ($3.9 trillion) was owned by state and local governments, most of it in buildings, highways, Streets, sewer systems, and water supply facilities. Thus, public infrastructure finance is fundamentally a local government issue, with implications for federal and state governments in the design of their aid programs.

Bartle, John R.↗
NASA NTRS2014

Agent Based Modeling of Air Carrier Behavior for Evaluation of Technology Equipage and Adoption

As part of ongoing research, the National Aeronautics and Space Administration (NASA) and LMI developed a research framework to assist policymakers in identifying impacts on the U.S. air transportation system (ATS) of potential policies and technology related to the implementation of the Next Generation Air Transportation System (NextGen). This framework, called the Air Transportation System Evolutionary Simulation (ATS-EVOS), integrates multiple models into a single process flow to best simulate responses by U.S. commercial airlines and other ATS stakeholders to NextGen-related policies, and in turn, how those responses impact the ATS. Development of this framework required NASA and LMI to create an agent-based model of airline and passenger behavior. This Airline Evolutionary Simulation (AIRLINE-EVOS) models airline decisions about tactical airfare and schedule adjustments, and strategic decisions related to fleet assignments, market prices, and equipage. AIRLINE-EVOS models its own heterogeneous population of passenger agents that interact with airlines; this interaction allows the model to simulate the cycle of action-reaction as airlines compete with each other and engage passengers. We validated a baseline configuration of AIRLINE-EVOS against Airline Origin and Destination Survey (DB1B) data and subject matter expert opinion, and we verified the ATS-EVOS framework and agent behavior logic through scenario-based experiments. These experiments demonstrated AIRLINE-EVOS's capabilities in responding to an input price shock in fuel prices, and to equipage challenges in a series of analyses based on potential incentive policies for best equipped best served, optimal-wind routing, and traffic management initiative exemption concepts..

Horio, Brant M.↗
NASA NTRS1979

Flexible space structure model reduction by modal cost analysis

It is noted that reduced models and reduced controllers for flexible space structures are obtained by retaining those modes which make the greatest contribution to quadratic control objectives. Attention is given to the relative importance of damping, frequency and mode shapes in the mode truncation decisions for the following control objectives: attitude control, vibration suppression and figure control. It is also shown that using Modal Cost Analysis (MCA) on the closed loop modes of the optimally controlled system allows the construction of reduced control policies which feedback only those closed loop coordinates which are most critical to the quadratic control performance criterion. In this manner, the modes which need to be controlled are deduced from truncations of the optimal controller.

Skelton, R. E.↗
DOE OSTI2025

Techno-economic assessment of residential PV system tariff policies in Jordan

This study assesses the economic and technical performance of four energy policy scenarios for Jordan's residential photovoltaic (PV) systems: net metering, net billing, zero-export with battery storage, and sell-all-buy-all. With the recent introduction of time-of-use (TOU) tariffs and policies addressing the “duck curve” effect, the research focuses on optimizing PV system sizing across different regulatory frameworks. A detailed techno-economic analysis evaluates these scenarios based on energy production, cost savings, payback periods, and energy self-sufficiency. The findings indicate that net metering and net billing offer the highest cost savings and the shortest payback periods (∼3 years). While the zero-export strategy with battery storage enhances energy self-sufficiency by up to 70%, it requires a higher upfront investment. The sell-all-buy-all scenario supports larger system sizes, achieving a low levelized cost of electricity (0.0696 USD/kWh) and a net present value of 619 USD. Additionally, the study identifies a critical feed-in tariff threshold of 0.055 USD/kWh, at which net billing becomes as financially attractive as net metering. Here, these insights offer valuable recommendations for policymakers to optimize net billing rates and TOU tariffs, promoting the expansion of Jordan's renewable energy sector.

Battery storage↗