Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “policy solutions”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 379 records · Page 21
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

An Edge-Cloud Integrated Solution for Buildings Demand Response Using Reinforcement Learning

Buildings, as major energy consumers, can provide great untapped demand response (DR) resources for grid services. However, their participation remains low in real-life. One major impediment for popularizing DR in buildings is the lack of cost-effective automation systems that can be widely adopted. Existing optimization-based smart building control algorithms suffer from high costs on both building-specific modeling and on-demand computing resources. To tackle these issues, this paper proposes a cost-effective edge-cloud integrated solution using reinforcement learning (RL). Beside RL’s ability to solve sequential optimal decision-making problems, its adaptability to easy-to-obtain building models and the off-line learning feature are likely to reduce the controller’s implementation cost. Using a surrogate building model learned automatically from building operation data, an RL agent learns an optimal control policy on cloud infrastructure, and the policy is then distributed to edge devices for execution. Simulation results demonstrate the control efficacy and the learning efficiency in buildings of different sizes. A preliminary cost analysis on a 4-zone commercial building shows the annual cost for optimal policy training is only 2.25% of the DR incentive received. Results of this study show a possible approach with higher return on investment for buildings to participate in DR programs.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2022

Exploring Decarbonization and Clean Energy Pathways for Disadvantaged Communities in California

California has a state-wide goal of carbon neutrality by 2045. Decarbonization for disadvantaged communities (DACs) poses extra challenges due to financial, informational, language, and other barriers. This paper presents the methodology, results, and analysis of energy efficiency measures (EEMs) to save energy, reduce CO 2 emission, and promote clean energy access at the district scale for two DACs in Fresno, California. The methods are broadly applicable to other neighborhoods across the U.S. 22 EEMs were identified and modelled for all residential buildings in the two DACs both individually and as packages. Results show that for energy and CO 2 reduction purposes, the top performing EEM package can decrease energy use and CO 2 emissions by an average of 60%. For electrification, heat pump water heaters are a viable solution, coupled with air source or mini-split heat pumps. Replacing gasoline vehicles with electric vehicles is another important measure in electrification and reducing GHG emissions.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2025

Sim2Real Autonomous Robotic Exploration [Poster]

Autonomous robots offer promising solutions for exploration in environments that are inaccessible or hazardous to humans. Despite this, physical training of such robots is often constrained by safety risks, high cost or limited accessibility. This project presents an end-to-end simulation to reality pipeline leveraging Nvidia Isaac Sim and Boston Dynamics' Spot to enable autonomous navigation in indoor environments. A reinforcement learning policy is first trained using Nvidia Isaac Lab to establish Spot's locomotion pattern. Virtual LiDAR sensors are then integrated to perform SLAM-based navigation using simulated odometry. Finally, the simulated navigation scheme is transferred to a physical Spot robot to inspect and record images of a real-world room by repeating the learnt trajectory. The proposed framework highlights the potential of scalable training in simulation and reliable deployment in physical environments. Future directions include dynamic trajectory generation in unseen and challenging environments and integration of environmental sensing like temperature, radiation or humidity via sensor and material simulation.

97 - MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Arbitrage and Capacity Firming in Coordination with Day-Ahead Bidding of a Hybrid PV Plant

A hybrid PV plant (HPP) combines a photovoltaic (PV) plant with a battery energy storage system (BESS), which is considered a promising step towards the future of renewable power plants by the U.S. Department of Energy. When the renewable penetration reaches a significant level, a hybrid PV plant can bid in as a controllable thermal plant in the future electricity market. In this study, a bidding and BESS scheduling model is proposed for the HPP. The robust optimization (RO) technique has been utilized to identify the worst-case scenario of uncertainties during the bidding process. To address the overly conservative issue of the single-stage RO, we have decoupled the BESS schedule for arbitrage and PV capacity firming by a two-stage RO formulation. By comparing the output of single-stage RO and two-stage RO, the two-stage RO bids and schedules in a more aggressive manner, which increases the income of HPP. Also, the penalty of under-generation is considered in our model so that the day-ahead bidding decision and arbitrage schedules can be adjusted based on the potential UNDER-GENERATION penalty. Because the proposed model is non-convex and contains multi-stages, the Column-and-Constraint Generation (C&CG) algorithm is applied to the model as the solution. The proposed model has shown better economic performance compared to a state-of-art single-stage bidding method in case studies.

BESS scheduling↗
DOE OSTI2022

Providencia Island White Papers: Potential for Increasing the Physical Resilience of Distributed Energy Resources

Using technologies such as solar photovoltaics (PV) to provide power to a site during a large-scale grid outage can be an effective solution for enhancing resilience, if designed appropriately. This paper discusses storm-hardening strategies including wind-loading standards, secure racking systems, balance of electrical systems and pre-storm preparations.

24 POWER TRANSMISSION AND DISTRIBUTION↗
NASA NTRS1999

Engineered Solutions to Reduce Occupational Noise Exposure at the NASA Glenn Research Center: A Five-Year Progress Summary (1994-1999)

At the NASA John H. Glenn Research Center at Lewis Field (formerly the Lewis Research Center), experimental research in aircraft and space propulsion systems is conducted in more than 100 test cells and laboratories. These facilities are supported by a central process air system that supplies high-volume, high-pressure compressed air and vacuum at various conditions that simulate altitude flight. Nearly 100,000 square feet of metalworking and specialized fabrication shops located on-site produce prototypes, models, and test hardware in support of experimental research operations. These activities, comprising numerous individual noise sources and operational scenarios, result in a varied and complex noise exposure environment, which is the responsibility of the Glenn Research Center Noise Exposure Management Program. Hearing conservation, community noise complaint response and noise control engineering services are included under the umbrella of this Program, which encompasses the Occupational Safety and Health Administration (OSHA) standard on occupational noise exposure, Sec. 29CFR 1910.95, as well as the more stringent NASA Health Standard on Hearing Conservation. Prior to 1994, in the absence of feasible engineering controls, strong emphasis had been placed on personal hearing protection as the primary mechanism for assuring compliance with Sec. 29CFR 1910.95 as well as NASA's more conservative policy, which prohibits unprotected exposure to noise levels above 85 dB(A). Center policy and prudent engineering practice required, however, that these efforts be extended to engineered noise controls in order to bring existing work areas into compliance with Sec. 29CFR 1910.95 and NASA's own policies and to ensure compliance for new installations. Coincident with the establishment in 1995 of a NASA wide multi-year commitment of funding for environmental abatement projects, the Noise Exposure Management Program was established, with its focus on engineering approaches to reducing occupational and community noise exposure. The organization and mission of this Program were documented shortly after its inception, and individual programmatic components have been the subject of subsequent papers. This paper summarizes the status and accomplishments of the engineering aspects of the Program from a five-year retrospective viewpoint and includes a review of retrofit noise control solution strategies, which have not been previously documented.

Cooper, Beth A.↗
DOE OSTI2023

Quick Talk: Resilient Communities, Maryland

Groundswell, Inc., in partnership with the Maryland Energy Administration (MEA), Ayika Solutions, the National Renewable Energy Lab (NREL), and the Baltimore Office of Sustainability, is advancing a vision for resilient, community-centered energy systems in Maryland. This effort aligns with Groundswell's commitment to a clean energy economy that equitably benefits all communities, closing gaps in representation, wages, and access to wealth generation, savings, and local jobs within a diverse energy supply chain. Project Vision and Objectives The project emphasizes "energy resilience," defined as a community’s capacity to anticipate, adapt to, and swiftly recover from power disruptions through inclusive planning and technical solutions. The approach centers on Resilience Hubs—designated community facilities equipped to support residents before, during, and after power-related disruptions. These hubs offer emergency resources, coordinate communications, and deliver essential services while reducing carbon emissions, ultimately enhancing residents' quality of life. Additionally, Resilience Hubs foster social connections, support disaster preparedness, and provide spaces for community programming and everyday use. The goals of Resilient Communities Maryland include: Developing a replicable framework for community energy resilience, applicable beyond Maryland. Defining community-led indicators of social impact and resilience. Establishing equitable decision-making processes in project design and implementation. Informing MEA of practical, community-based resilience strategies to shape future state initiatives. Approach Groundswell and its partners prioritize collaborative engagement with local stakeholders, ensuring that solutions are responsive to each community's unique needs. By integrating feedback from residents, local organizations, and government entities, the team has developed a holistic model for resilience that balances immediate benefits, such as improved emergency response, with long-term gains in social equity and environmental sustainability. Key Outcomes This initiative has produced valuable resources and insights, including: A Community Energy Resilience Framework: Designed to guide other communities in establishing energy resilience strategies tailored to their specific needs. Case Studies: Documenting best practices and lessons learned from pilot projects to serve as models for future resilience efforts. Community-Driven Impact Metrics: Highlighting the positive social impacts that resilience initiatives can bring, such as improved social connectedness and local decision-making power. Recommendations for MEA: Offering evidence-based insights to inform policies and funding opportunities that support resilient energy infrastructure in vulnerable communities. Next Steps Groundswell's final report will detail findings, including the potential for scaling resilience hubs across Maryland and other regions, with a focus on equitable access and community-driven outcomes. This project underscores the importance of aligning energy resilience with social equity, reinforcing community agency, and building systems that withstand and recover from future challenges effectively and sustainably.

14 SOLAR ENERGY↗
DOE OSTI2020

When the lights go out

In the face of more frequent long-duration power outages, utilities are looking to invest in more resilient infrastructure and solutions. This paper explains a new study that shows that residential customers are willing to pay for increased resilience and will spend extra to support their communities and low-income neighbours.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

Optimal Power Management for Large-Scale Battery Energy Storage Systems via Bayesian Inference

Large-scale battery energy storage systems (BESS) have found ever-increasing use across industry and society to accelerate clean energy transition and improve energy supply reliability and resilience. However, their optimal power management poses significant challenges: the underlying high-dimensional nonlinear nonconvex optimization lacks computational tractability in real-world implementation, and the uncertainty of the exogenous power demand makes exact optimization difficult. This paper presents a new solution framework to address these bottlenecks. The solution pivots on introducing power-sharing ratios to specify each cell’s power quota from the output power demand. To find the optimal power-sharing ratios, we formulate a nonlinear model predictive control (NMPC) problem to achieve power-loss-minimizing BESS operation while complying with safety, cell balancing, and power supply-demand constraints. We then propose a parameterized control policy for the power-sharing ratios, which utilizes only three parameters, to reduce the computational demand in solving the NMPC problem. This policy parameterization allows us to translate the NMPC problem into a Bayesian inference problem for the sake of 1) computational tractability, and 2) overcoming the nonconvexity of the optimization problem. We leverage the ensemble Kalman inversion technique to solve the parameter estimation problem. Concurrently, a low-level control loop is developed to seamlessly integrate our proposed approach with the BESS to ensure practical implementation. This low-level controller receives the optimal power-sharing ratios, generates output power references for the cells, and maintains a balance between power supply and demand despite uncertainty in output power. We conduct extensive simulations and experiments on a 20-cell prototype to validate the proposed approach.

Battery energy storage systems (BESSs)↗
DOE OSTI2025

LC-Opt: Benchmarking Reinforcement Learning and Agentic AI for End-to-End Liquid Cooling Optimization in Data Centers

Liquid cooling is critical for thermal management in high-density data centers with the rising AI workloads. However, machine learning-based controllers are essential to unlock greater energy efficiency and reliability, promoting sustainability. We present LC-Opt, a Sustainable Liquid Cooling (LC) benchmark environment, for reinforcement learning (RL) control strategies in energy-efficient liquid cooling of high-performance computing (HPC) systems. Built on the baseline of a high-fidelity digital twin of Oak Ridge National Lab's Frontier Supercomputer cooling system, LC-Opt provides detailed Modelica-based end-to-end models spanning site-level cooling towers to data center cabinets and server blade groups. RL agents optimize critical thermal controls like liquid supply temperature, flow rate, and granular valve actuation at the IT cabinet level, as well as cooling tower (CT) setpoints through a Gymnasium interface, with dynamic changes in workloads. This environment creates a multi-objective real-time optimization challenge balancing local thermal regulation and global energy efficiency, and also supports additional components like a heat recovery unit (HRU). We benchmark centralized and decentralized multi-agent RL approaches, demonstrate policy distillation into decision and regression trees for interpretable control, and explore LLM-based methods that explain control actions in natural language through an agentic mesh architecture designed to foster user trust and simplify system management. LC-Opt democratizes access to detailed, customizable liquid cooling models, enabling the ML community, operators, and vendors to develop sustainable data center liquid cooling control solutions.

Naug, Avisek [Hewlett Packard Enterprise]↗
NASA NTRS1971

Foundations of planetary quarantine.

Discussion of some of the problems in microbiology and engineering involved in the implementation of planetary quarantine. It is shown that the solutions require new knowledge in both disciplines for success at low cost in terms of both monetary outlay and man's further exploration of the planets. A related problem exists in that engineers are not accustomed to the wide variation of biological data and microbiologists must learn to work and think in more exact terms. Those responsible for formulating or influencing national and international policies must walk a tightrope with delicate balance between unnecessarily stringent requirements for planetary quarantine on the one hand and prevention of contamination on the other. The success of planetary quarantine measures can be assured only by rigorous measures, each checked, rechecked, and triple-checked to make sure that no errors have been made and that no factor has been overlooked.

Hall, L. B.↗
NASA NTRSDate not supplied

MULTI-OBJECTIVE REINFORCEMENT LEARNING FOR LOW-THRUST TRANSFER DESIGN BETWEEN LIBRATION POINT ORBITS

Multi-Reward Proximal Policy Optimization (MRPPO) is a multi-objective reinforcement learning algorithm used to construct low-thrust transfers between periodic orbits in multi-body systems. Previous implementations of MRPPO have relied on a predefined reference transfer to successfully train each policy. In this paper, an algorithmic modification labeled the ‘moving reference’, is introduced to autonomously construct these reference trajectories during training. With this modification, MRPPO is used to recover various low-thrust transfers between two periodic orbits in the Earth-Moon circular restricted three-body problem to solve a multi-objective optimization problem. These results are then compared with the solutions recovered via a traditional optimization formulation.

algorithm↗
NASA NTRSDate not supplied

MULTI-OBJECTIVE REINFORCEMENT LEARNING FOR LOW-THRUST TRANSFER DESIGN BETWEEN LIBRATION POINT ORBITS

Multi-Reward Proximal Policy Optimization (MRPPO) is a multi-objective reinforcement learning algorithm used to construct low-thrust transfers between periodic orbits in multi-body systems. Previous implementations of MRPPO have relied on a predefined reference transfer to successfully train each policy. In this paper, an algorithmic modification labeled the ‘moving reference’, is introduced to autonomously construct these reference trajectories during training. With this modification, MRPPO is used to recover various low-thrust transfers between two periodic orbits in the Earth-Moon circular restricted three-body problem to solve a multi-objective optimization problem. These results are then compared with the solutions recovered via a gradient descent optimization scheme to validate the performance of MRPPO with the moving reference modification.

Christopher J. Sullivan↗
NASA NTRSDate not supplied

MULTI-OBJECTIVE REINFORCEMENT LEARNING FOR LOW-THRUST TRANSFER DESIGN BETWEEN LIBRATION POINT ORBITS

Multi-Reward Proximal Policy Optimization (MRPPO) is a multi-objective reinforcement learning algorithm used to construct low-thrust transfers between periodic orbits in multi-body systems. Previous implementations of MRPPO have relied on a predefined reference transfer to successfully train each policy. In this paper, an algorithmic modification labeled the ‘moving reference’, is introduced to autonomously construct these reference trajectories during training. With this modification, MRPPO is used to recover various low-thrust transfers between two periodic orbits in the Earth-Moon circular restricted three-body problem to solve a multi-objective optimization problem. These results are then compared with the solutions recovered via a gradient descent optimization scheme to validate the performance of MRPPO with the moving reference modification

Christopher John Sullivan↗
NASA NTRS2021

Multi-objective Reinforcement Learning for Low-thrust Transfer Design Between Libration Point Orbits

Multi-Reward Proximal Policy Optimization (MRPPO) is a multi-objective rein- forcement learning algorithm used to construct low-thrust transfers between pe- riodic orbits in multi-body systems. Previous implementations of MRPPO have relied on a predefined reference transfer to successfully train each policy. In this paper, an algorithmic modification labeled the ‘moving reference’, is introduced to autonomously construct these reference trajectories during training. With this modification, MRPPO is used to recover various low-thrust transfers between two periodic orbits in the Earth-Moon circular restricted three-body problem to solve a multi-objective optimization problem. These results are then compared with the solutions recovered via a gradient descent optimization scheme to validate the performance of MRPPO with the moving reference modification.

Anderson, Rodney L.↗
NASA NTRS2021

Multi-objective Reinforcement Learning for Low-thrust Transfer Design Between Libration Point Orbits

Multi-Reward Proximal Policy Optimization (MRPPO) is a multi-objective rein- forcement learning algorithm used to construct low-thrust transfers between pe- riodic orbits in multi-body systems. Previous implementations of MRPPO have relied on a predefined reference transfer to successfully train each policy. In this paper, an algorithmic modification labeled the ‘moving reference’, is introduced to autonomously construct these reference trajectories during training. With this modification, MRPPO is used to recover various low-thrust transfers between two periodic orbits in the Earth-Moon circular restricted three-body problem to solve a multi-objective optimization problem. These results are then compared with the solutions recovered via a gradient descent optimization scheme to validate the performance of MRPPO with the moving reference modification.

Anderson, Rodney L↗
DOE OSTI2024

Defining Safe and Efficient Interconnection Policies for Energy Storage and Solar + Storage to Improve Integration and Reduce Costs

Energy storage has a unique and pivotal role to play in the transition to a low-carbon economy because it can help the electric grid accommodate more renewable energy. However, a number of barriers currently impede the process of connecting energy storage systems to the distribution grid. The Toolkit and Guidance for the Interconnection of Energy Storage and Solar-Plus-Storage (the “BATRIES Toolkit”), which is the publication subject to this Final Technical / Scientific Report, provides vetted solutions to eight regulatory and technical barriers to the interconnection of standalone storage and solar-plus-storage systems (referred to as “energy storage”) to the distribution grid. These recommendations are based on over a year of research and analysis by utility and industry experts. The BATRIES Toolkit also includes model language that utilities and utility regulators can use to update state interconnection rules to reduce the costs and time to safely interconnect energy storage and solar-plus-storage systems. The solutions are nationally applicable and can be applied in diverse states and markets across the U.S.

14 SOLAR ENERGY↗