Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “state policy”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,081 records · Page 60
All sourcesNASA NTRSDOE OSTI
NASA NTRS2012

Using Markov Models of Fault Growth Physics and Environmental Stresses to Optimize Control Actions

A generalized Markov chain representation of fault dynamics is presented for the case that available modeling of fault growth physics and future environmental stresses can be represented by two independent stochastic process models. A contrived but representatively challenging example will be presented and analyzed, in which uncertainty in the modeling of fault growth physics is represented by a uniformly distributed dice throwing process, and a discrete random walk is used to represent uncertain modeling of future exogenous loading demands to be placed on the system. A finite horizon dynamic programming algorithm is used to solve for an optimal control policy over a finite time window for the case that stochastic models representing physics of failure and future environmental stresses are known, and the states of both stochastic processes are observable by implemented control routines. The fundamental limitations of optimization performed in the presence of uncertain modeling information are examined by comparing the outcomes obtained from simulations of an optimizing control policy with the outcomes that would be achievable if all modeling uncertainties were removed from the system.

Bole, Brian↗
DOE OSTI2025

Improving the prediction of daily reservoir releases over the CONUS using conditioned LSTM

Reservoirs play a vital role in regulating streamflow timing and variability for hydroelectricity, flood control, water supply, irrigation, and recreation. Despite their importance, many reservoirs lack comprehensive operational guidelines, making their management complex due to conflicting operational objectives. Hence traditional policy-based reservoir models often fail to capture real-world conditions accurately and they depend on perfect streamflow predictions, which are not always available. In contrast, data-driven models like Long Short-Term Memory (LSTM) networks offer a robust alternative. This study introduces an approach that integrates reservoir characteristics—such as main use, climate, and maximum capacity—into the LSTM model to enhance reservoir release predictions. Using data from nearly 200 reservoirs in the contiguous United States (CONUS), our conditioned LSTM model (LSTM_cond) was compared with both the vanila LSTM and a traditional policy-based approach. Furthermore, our results show that while both LSTM_cond and LSTM perfoms better than the policy-based approach, LSTM_cond consistently outperforms LSTM for hydroelectric, water supply, irrigation, and recreation reservoirs. The KGE median values for LSTM_cond for out-sample reservoirs are 0.764, 0.565, 0.821, and 0.779, respectively, for the aforementioned reservoir types, which are consistently higher that the corresponding KGE values of 0.737, 0.413, 0.775, and 0.713 of LSTM, demonstrating its advantages in improving generalizability.

CONUS↗
DOE OSTI2019

Quasi-Stochastic Approximation and Off-Policy Reinforcement Learning: Preprint

The Robbins-Monro stochastic approximation algorithm is a foundation of many algorithmic frameworks for reinforcement learning and often an efficient approach to solving (or approximating the solution to) complex optimal control problems. In many cases, however, practitioners are unable to apply these techniques because of an inherent high variance. This paper aims to provide a general foundation for 'quasi-stochastic approximation,' in which all of the processes under consideration are deterministic, much like quasi-Monte Carlo for variance reduction in simulation. The variance reduction can be substantial, subject to tuning of pertinent parameters in the algorithm. This paper introduces a new coupling argument to establish the optimal rate of convergence provided the gain is sufficiently large. These results are established for linear models and tested also in nonideal settings. A major application of these general results is a new class of reinforcement learning algorithms for deterministic state space models. In this setting, the main contribution is a class of algorithms for approximating the value function for a given policy, using a different policy designed to introduce exploration.

24 POWER TRANSMISSION AND DISTRIBUTION↗
NASA NTRS2018

Are Water Markets Globally Applicable?

Water scarcity is a global concern that necessitates a global perspective, but it is also the product of multiple regional issues that require regional solutions. Water markets constitute a regionally applicable non-structural measure to counter water scarcity that has received the attention of academics and policy-makers, but there is no global view on their applicability. We present the global distribution of potential nations and states where water markets could be instituted in a legal sense, by investigating 296 water laws internationally, with special reference to a minimum set of key rules: legalization of water reallocation, the separation of water rights and landownership, and the modification of the cancellation rule for non-use. We also suggest two additional globally distributed prerequisites and policy implications: the predictability of the available water before irrigation periods and public control of groundwater pumping throughout its jurisdiction.

global water scarcity↗
DOE OSTI2023

The geographies, typologies, and trends of community-based organizations for solar energy in the United States

Community-based organizations (CBOs)1 play an important role in developing solar energy in low- and moderate-income (LMI) communities. This article shares the perspectives of CBO leaders in LMI communities, identifies and addresses solar information gaps, and provides recommendations State Energy Agencies and other government leaders can use to better involve CBOs in solar program initiatives. Using semi-structured interviews and focus groups with CBOs from across the United States (US) we develop typologies of CBO structure and function, and determine the primary motivations, challenges, opportunities, and communication barriers CBOs face. We explore the correlation between key typologies such as tenure, staff capacity, population served, organizational structure, and region with the organizational activities performed by solar-related CBOs. CBOs operate in disparate regional political and economic ecologies. Our findings suggest strategies for states to support their engagement in solar-related endeavors, particularly with respect to the dissemination of the Bipartisan Infrastructure Law, Inflation Reduction Act, and the EPA Greenhouse Gas Reduction Fund: Solar for All. Developing policies that encourage CBOs to enter the solar training and installation domains, alongside targeted grants and capacity-building initiatives can help maximize community benefits. Furthermore, states can additionally contribute to the positive trajectory and collaboration between state agencies and CBOs in advancing solar energy adoption by fostering a supportive environment.

14 SOLAR ENERGY↗
DOE OSTI2025

Leveraging System Dynamics to Predict the Commercialization Success of Emerging Energy Technologies: Lessons from Wind Energy

The United States urgently needs to tackle the climate crisis while enhancing energy security and resiliency. The complexity of the U.S. energy system, with its interconnected elements, makes predicting future states challenging, especially with the introduction of novel energy systems like wind, solar, clean hydrogen, and advanced nuclear technologies. Modern systems engineering methods and tools can provide deeper insights into these dynamics and future behaviors. This research aims to develop a comprehensive model that captures the main elements and behaviors of new energy technologies within the existing energy system. We hypothesized that the market uptake of novel energy systems is influenced by multiple diverse factors, such as technological learning, availability of resources, and economic incentives; examined the history of electricity generation using land-based wind technologies; and developed a system dynamics model to investigate the relationships between capacity growth and influencing factors, both internal and external. The developed model yielded outcomes that confirmed the hypothesized dynamics of wind energy system diffusion through a quantitative comparison of installed capacity and highlighted the significant influence of resource availability, federal incentives (production tax credits), and technological learning on capacity growth and cost reduction. This research aims to support informed decision-making for investments in novel energy systems and aid in developing effective policies for technology deployment.

17 WIND ENERGY↗
DOE OSTI2024

Battery-powered bargains? Assessing electric vehicle resale value in the United States

Abstract The resale market will play a critical role in expanding plug-in electric vehicle (PEV) adoption to middle- and lower-income households. Understanding PEV depreciation trends in comparison to those of conventional gasoline vehicles (CVs) is critical for assessing PEV affordability and informing relevant policy, such as subsidies for used PEVs. We deliver comprehensive, high-resolution estimates of value retention rates at the make-model level in the United States for battery electric vehicles (BEVs), plug-in hybrid electric vehicles (PHEVs), hybrid electric vehicles (HEVs), and CVs using a database of 9 million used cars listed online between 2016 and 2022. While BEVs and PHEVs have depreciated at faster rates than CVs, this trend is changing, with newer model year BEVs and those with larger ranges have significantly higher retention rates than older model years with smaller ranges. Tesla BEVs are a notable exception following the opposite trend, with earlier model years holding their value better than newer model years. Subsidized BEVs in the new market are associated with lower prices for the same model in the resale market, with the $7500 federal subsidy translating to a 3% lower resale price on average. Finally, disruptions from the COVID-19 pandemic have affected affordability across all vehicles, with mean listing prices rising 37% and 39% for CVs and BEVs, respectively, from January 2020 to March 2022 in inflation-adjusted 2019 dollars.

Environmental Sciences & Ecology↗
DOE OSTI2024

Legal and Regulatory Aspects Related to Unmanned Aerial Systems (UAS) for Safeguards Implementation

The International Atomic Energy Agency (IAEA) is exploring the use of innovative technologies such as Unmanned Aerial Systems (UAS) to address safeguards verification challenges such as difficulties in accessing nuclear material in high radiation environments, and remotely located installations, as well as to increase the efficiency of safeguards implementation by automating repetitive and time-consuming tasks. As UAS continue to advance and their use becomes more frequent in high security conscious industries such as nuclear, their advantages in contributing to greater safety and security may weigh in favor of their use. However, as the IAEA begins to use these technologies, the legal, policy, and operational considerations associated with these advanced technologies will also need to be considered to identify any key opportunities, challenges, or areas of concern for the IAEA and its Member States. This paper will explore these areas and identify important considerations for the IAEA and its Member States to consider as the use of UAS is explored further for safeguards applications. It will also provide a series of recommendations for anticipating and addressing legal, regulatory, and policy challenges related to the use of UAS for safeguards implementation.

Siserman-Gray, Ioana-Cristina↗
DOE OSTI2022

Deep reinforcement learning based optimization for a tightly coupled nuclear renewable integrated energy system

New ways to integrate energy systems to maximize efficiency are being sought to meet carbon emissions goals. Nuclear-renewable integrated energy system (NR-IES) concepts are a leading solution that couples a nuclear power plant with renewable energy, hydrogen generation plants, and energy storage systems, such that thermal and electrical power are dispatchable to fulfill grid-flexibility requirements while also producing hydrogen and maximizing revenue. Here, this paper introduces a deep reinforcement learning (DRL)-based framework to address the complex decision-making tasks for NR-IES. The objective is to maximize revenue by generating and selling hydrogen and electricity simultaneously according to their time-varying prices while keeping the energy flow in the subsystems in balance. A Python-based simulator for a NR-IES concept has been developed to integrate with OpenAI Gym and Ray/RLlib to enable an efficient and flexible computational framework for DRL research and development. Three state-of-the-art DRL algorithms have been investigated, including two-delayed deep deterministic policy gradient (TD3), soft-actor critic (SAC), proximal policy optimization (PPO), to illustrate DRL’s superiority for controlling NR-IES by comparing it with a conventional control approach, particle swarm optimization (PSO). In this effort, PPO has shown more-stable performance and also better generalization capability than SAC and TD3. Comparisons with PSO have demonstrated that, on average, PPO can achieve 13.9% more mean episode returns from the training process and 29.4% more mean episode returns from the testing process when different hydrogen-production targets are applied.

08 HYDROGEN↗
DOE OSTI2021

Heavy-Duty Truck Electrification and the Impacts of Depot Charging on Electricity Distribution Systems

Major technological advancements and recent policy support are improving the outlook for heavy-duty truck electrification in the United States. In particular, short-haul operations (=200 miles (=322 km)) are prevalent and early candidates for plug-in electric vehicles (EVs) given their short, predictable routes and return-to-base applications, which allows vehicles to recharge when off shift at their depots. Although previous studies investigated the impacts of added electrical loads on distribution systems, which included light-duty EVs, the implications for heavy-duty EV charging are underexplored. Here we summarize the causes, costs and lead times of distribution system upgrades anticipated for depot charging. We also developed synthetic depot charging load profiles for heavy-duty trucks from real-world operating schedules, and found that charging requirements are met at common light-duty EV charging rates (=100 kW per vehicle). Finally, we applied depot charging load profiles to 36 distribution real-world substations, which showed that most can accommodate high levels of heavy-duty EV charging without upgrades.

47 OTHER INSTRUMENTATION↗
DOE OSTI2026

Stimulated geologic hydrogen: from mechanistic control to engineered rock transformation

Geologic hydrogen (GeoH 2 ) generated from subsurface iron-rich rock–water reaction (i.e., serpentinization) is emerging as a promising candidate for the next primary energy source. Yet, accelerating GeoH 2 production from geological to human timescales via enhanced serpentinization remains a formidable scientific and technical challenge. Here, in this Review, we decipher the mechanistic control and explore strategies for accelerating in situ, engineered iron-rich rock transformation into carbon-free GeoH 2 by orders of magnitude. Serpentinization rate is hindered by low porosity and permeability of source rocks, suboptimal temperatures, unfavorable water chemistry, inefficient Fe 2+ -to-Fe 3+ conversion, thermodynamic constraints, and low reactive surface area. While closed-system experiments provide valuable mechanistic insights, open-system conditions with fluid circulation are more crucial for economically viable GeoH 2 production. We assess stimulation techniques from enhanced hydrocarbon and geothermal recovery as tools to be adopted or adapted for increasing reactive surface areas for stimulated GeoH2 production. We estimate that 7.40 × 10 5 to 1.73 × 10 6 million metric tons (Mt) of hydrogen could be engineered over 20 to 50 years from about 10% iron-rich rocks within 10 km depth of continental crust. Enabling GeoH 2 as a viable energy source requires not only advancing scientific frontiers but also forming a global GeoH 2 research network and innovation ecosystem to address the critical scientific, technical, societal, economic, and policy challenges.

08 HYDROGEN↗
DOE OSTI2020

Constrained Deep Reinforcement Learning for Energy Sustainable Multi-UAV Based Random Access IoT Networks With NOMA

In this paper, we apply the Non-Orthogonal Multiple Access (NOMA) technique to improve the massive channel access of a wireless IoT network where solar-powered Unmanned Aerial Vehicles (UAVs) relay data from IoT devices to remote servers. Specifically, IoT devices contend for accessing the shared wireless channel using an adaptive p-persistent slotted Aloha protocol; and the solar-powered UAVs adopt Successive Interference Cancellation (SIC) to decode multiple received data from IoT devices to improve access efficiency. To enable an energy-sustainable capacity-optimal network, we study the joint problem of dynamic multi-UAV altitude control and multi-cell wireless channel access management of IoT devices as a stochastic control problem with multiple energy constraints. We first formulate this problem as a Constrained Markov Decision Process (CMDP), and propose an online model-free Constrained Deep Reinforcement Learning (CDRL) algorithm based on Lagrangian primal-dual policy optimization to solve the CMDP. Extensive simulations demonstrate that our proposed algorithm learns a cooperative policy in which the altitude of UAVs and channel access probability of IoT devices are dynamically controlled to attain the maximal long-term network capacity while ensuring energy sustainability of UAVs, outperforming baseline schemes. The proposed CDRL agent can be trained on a small network, yet the learned policy can efficiently manage networks with a massive number of IoT devices and varying initial states, which can amortize the cost of training the CDRL agent.

42 ENGINEERING↗
DOE OSTI2025

NEPATEC2.0: NEPA Text Corpus v2.0

The National Environmental Policy Act of 1969, as amended (NEPA), is a major environmental law in the United States, requiring Federal agencies to consider and document potential environmental impacts before deciding on a proposed action. Modernization of NEPA and permitting processes faces significant challenges due to the lack of standardized formats and interoperable systems for organizing and sharing NEPA-related information across agencies. Much of the information gathered during NEPA reviews is written into documents such as categorical exclusions, environmental assessments, and environmental impact statements, then filed in predominately independent agency file stores that may or may not be publicly accessible. The application of metadata and data standards, such as those recommended by the Council on Environmental Quality (CEQ), to NEPA documents offers a shared vocabulary and structure for key entities like projects, processes, and documents that can streamline information exchange and enhance collaboration across systems. In this work, we publicly release NEPATEC2.0, an expanded corpus of NEPA documents with associated metadata. NEPATEC2.0 encompasses approximately 120,000 documents from 60,000 projects prepared by more than 60 different agencies. Modeled to align with CEQ metadata standards, NEPATEC2.0 promotes consistency in environmental reviews and supports the ongoing effort to modernize permitting technologies by facilitating more transparent, efficient, and data-driven decision-making. Importantly, NEPATEC2.0 demonstrates the possibilities and limitations of large language model-based prompting to extract information from NEPA documents at scale.

environmental review↗
DOE OSTI2022

Offshore Wind Market Report: 2022 Edition

The 2022 edition of the Offshore Wind Market Report provides offshore wind policymakers, regulators, developers, researchers, engineers, financiers, supply chain participants, and other stakeholders with up-to-date quantitative information about the offshore wind market, technology, and cost trends in the United States and worldwide.

17 WIND ENERGY↗
DOE OSTI2024

Washington Housing Electrification Analysis [Slides]

This technical assistance is part of the Communities Local Energy Action Program (CLEAP) for the community of Beacon Hill, Seattle, WA. This analysis focuses on opportunities to reduce energy burden, energy consumption, and energy bills for both single family homes and large multifamily buildings. It uses state-level data from the ResStock modelling tool that was filtered to be relevant to Beacon Hill. Hence, this content includes single family detached homes and large multifamily buildings in the income group of 0-80% AMI, and climate zone 4c (mixed temperatures, relatively cooler summers) within Washington State.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2025

NEPATEC v2.0: Standardized Metadata and Text Corpus of National Environmental Policy Act Documents

The National Environmental Policy Act of 1969, as amended (NEPA), is a major environmental law in the United States, requiring Federal agencies to consider and document potential environmental impacts before deciding on a proposed action. Modernization of NEPA and permitting processes faces significant challenges due to the lack of standardized formats and interoperable systems for organizing and sharing NEPA-related information across agencies. Much of the information gathered during NEPA reviews is written into documents such as categorical exclusions, environmental assessments, and environmental impact statements, then filed in predominately independent agency file stores that may or may not be publicly accessible. The application of metadata and data standards, such as those recommended by the Council on Environmental Quality (CEQ), to NEPA documents offers a shared vocabulary and structure for key entities like projects, processes, and documents that can streamline information exchange and enhance collaboration across systems. In this work, we publicly release NEPATEC2.0, an expanded corpus of NEPA documents with associated metadata. NEPATEC2.0 encompasses approximately 120,000 documents from 60,000 projects prepared by more than 60 different agencies. Modeled to align with CEQ metadata standards, NEPATEC2.0 promotes consistency in environmental reviews and supports the ongoing effort to modernize permitting technologies by facilitating more transparent, efficient, and data-driven decision-making. Importantly, NEPATEC2.0 demonstrates the possibilities and limitations of large language model-based prompting to extract information from NEPA documents at scale.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2018

NASA's Space Launch System: Testing for Deep Space Human Exploration

NASA’S Exploration Plans: National Space Policy Directive 1: NASA to “… Beginning with missions beyond low-Earth orbit, the United States will lead the return of humans to the Moon for long-term exploration and utilization, followed by human missions to Mars and other destinations.” - Today: Work in Low Earth Orbit with ISS: Commercial Partners supporting logistics and soon taking humans to ISS (International Space Station) - Next Step: Gateway human-tended station, robotic landers and rovers, eventually people, at the Moon - Ultimately: Continued robotic exploration of Mars to inform future crewed missions.

Blevins, John↗