Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “integrated planning and learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5
All sourcesNASA NTRSDOE OSTI
NASA NTRS2021

Time series comparisons in Deep Space Network

The Deep Space Network (DSN) is NASA’s international array of antennas that support interplanetary spacecraft missions. DSN provides radar and radio astronomy observations that enhance our understanding of the solar system and the larger universe. A track is a block of continuous multi-dimensional time series from the beginning to end of DSN communication with the target spacecraft, containing 129 monitor data items lasting several hours at a frequency of 0.2-1Hz. Monitor data on each track reports on the performance of specific spacecraft operations and the DSN itself. DSN is receiving signals from 32 spacecraft across the solar system. DSN has pressure to reduce costs while maintaining the quality of support for DSN mission users. DSN operators need to simultaneously monitor multiple tracks and identify anomalies in real time. DSN has seen that as the number of missions increases, the data that needs to be processed increases over time. In this project, we look at the last 8 years of data for analysis. Any anomaly in the track indicates a problem with either the spacecraft, DSN equipment, or weather conditions. DSN operators typically write “discrepancy reports” for further analysis. It is recognized that it would be quite helpful to identify 10 similar historical tracks out of the huge database to quickly find/match anomalies. This tool has three functions: (1) identification of the top 10 similar historical tracks, (2) detection of anomalies compared to the reference normal track, and (3) comparison of statistical differences between two given tracks. The requirements for these features were confirmed by survey responses from 21 DSN operators and engineers. The preliminary machine learning model has shown promising performance (AUC=0.92). We plan to increase the number of data sets and perform additional testing to improve performance further before its planned integration into the Track Visualizer to assist DSN field operators and engineers.

Rebbapragada, Umaa↗
DOE OSTI2026

Intern Poster Session 08/13: Autonomous Nuclear Robotics: Applications in nuclear waste inspection and hot cell experiments

The nuclear industry is experiencing renewed interest in autonomous robotics, yet most deployed systems remain teleoperated with limited autonomy. This work presents two contributions toward fully autonomous nuclear robotic systems: autonomous waste inspection at the Hanford Site and an autonomous hot cell laboratory framework. Inspections of Hanford's underground waste storage tanks are performed manually at significant cost and personnel exposure. We developed a reinforcement-learning (RL) training pipeline for a custom-built inspection arm. In parallel, we are designing an autonomous laboratory framework for post-irradiation examination in hot cells at the Specimen Preparation Laboratory (SPL) that integrates computer vision, task and motion planning, hardware execution, and operator-in-the-loop control. These systems demonstrate a path toward safer, more efficient nuclear operations by reducing human exposure while maintaining rigorous human oversight at critical decision points.

11 - NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2024

Integrating an Ensemble Reward System into an Off-Policy Reinforcement Learning Algorithm for the Economic Dispatch of Small Modular Reactor-Based Energy Systems

Nuclear Integrated Energy Systems (NIES) have emerged as a comprehensive solution for navigating the changing energy landscape. They combine nuclear power plants with renewable energy sources, storage systems, and smart grid technologies to optimize energy production, distribution, and consumption across sectors, improving efficiency, reliability, and sustainability while addressing challenges associated with variability. The integration of Small Modular Reactors (SMRs) in NIES offers significant benefits over traditional nuclear facilities, although transferring involves overcoming legal and operational barriers, particularly in economic dispatch. This study proposes a novel off-policy Reinforcement Learning (RL) approach with an ensemble reward system to optimize economic dispatch for nuclear-powered generation companies equipped with an SMR, demonstrating superior accuracy and efficiency when compared to conventional methods and emphasizing RL’s potential to improve NIES profitability and sustainability. Finally, the research attempts to demonstrate the viability of implementing the proposed integrated RL approach in spot energy markets to maximize profits for nuclear-driven generation companies, establishing NIES’ profitability over competitors that rely on fossil fuel-based generation units to meet baseload requirements.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2020

Charged Wellbore Casing Controlled Source Electromagnetics (CWC-CSEM) for Reservoir Imaging and Monitoring (Final report)

This project addresses the needs of the U.S. Department of Energy (DOE) to develop advanced monitoring technologies and protocols to track the fate of subsurface carbon dioxide (CO2) plumes for carbon storage. Specifically, the project seeks to develop and test a unique and novel system of technologies consisting of electromagnetic data acquisition, coupled multiphysics imaging, and reservoir model enhancement to understand the migration and long-term distribution of CO2 in the subsurface. The overarching objective is to develop an integrated approach for long term monitoring of carbon storage. The two main components of the project include the methodology development and the test of the method at a field site. The methodology component consists of 1) developing the field procedure and protocol for collecting time-lapse controlled-source electromagnetic (CSEM) data with source electric current injected into the subsurface through wellbore casings; 2) building of background 3D electrical conductivity utilizing multiple sources of data such as supplemental surface transient EM (TEM) surveys, well-logs, and seismic structural information, for enhancing CSEM signal from reservoir depths; and 3) coupled multiphysics simulations and inversion of CSEM data constrained by production data and by structural information from seismic imaging of the reservoir and overlying formations. The testing component used the field site of Bell Creek Oil Field, which served both as a field laboratory for the method development as well as a test site to evaluate the CSEM signal strengths and the methodology developed in this research project. We have accomplished all the proposed tasks and developed the methodology as planned. These include the procedure for time-lapse CSEM data acquisition, data processing techniques, integration with 3D conductivity model building, fast reservoir simulation for history matching using machine learning, and interpreting CSEM data with coupling to the reservoir modeling. Collectively, the outcome of these tasks form a coherent workflow that can be applied to monitor dedicated carbon storage in saline reservoirs. The testing component evaluated the applicability and limitations of the method, and concluded that the method would be ideal for monitoring dedicated carbon storage sites utilizing saline reservoirs.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Replication Data for: Latent Representation Learning for Structural Characterization of Catalysts

The data underlying this published work have been made publicly available in this repository as part of the IMASC Data Management Plan. This work was supported as part of the Integrated Mesoscale Architectures for Sustainable Catalysis (IMASC), an Energy Frontier Research Center funded by the U.S. Department of Energy, Office of Science, Basic Energy Sciences under Award # DE-SC0012573.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
NASA NTRS2014

Anomalous Thrust Production from an RF Test Device Measured on a Low-Thrust Torsion Pendulum

This paper describes the eight-day August 2013 test campaign designed to investigate and demonstrate viability of using classical magnetoplasmadynamics to obtain a propulsive momentum transfer via the quantum vacuum virtual plasma. This paper will not address the physics of the quantum vacuum plasma thruster, but instead will describe the test integration, test operations, and the results obtained from the test campaign. Approximately 30-50 micro-Newtons of thrust were recorded from an electric propulsion test article consisting primarily of a radio frequency (RF) resonant cavity excited at approximately 935 megahertz. Testing was performed on a low-thrust torsion pendulum that is capable of detecting force at a single-digit micronewton level, within a stainless steel vacuum chamber with the door closed but at ambient atmospheric pressure. Several different test configurations were used, including two different test articles as well as a reversal of the test article orientation. In addition, the test article was replaced by an RF load to verify that the force was not being generated by effects not associated with the test article. The two test articles were designed by Cannae LLC of Doylestown, Pennsylvania. The torsion pendulum was designed, built, and operated by Eagleworks Laboratories at the NASA Johnson Space Center of Houston, Texas. Approximately six days of test integration were required, followed by two days of test operations, during which, technical issues were discovered and resolved. Integration of the two test articles and their supporting equipment was performed in an iterative fashion between the test bench and the vacuum chamber. In other words, the test article was tested on the bench, then moved to the chamber, then moved back as needed to resolve issues. Manual frequency control was required throughout the test. Thrust was observed on both test articles, even though one of the test articles was designed with the expectation that it would not produce thrust. Specifically, one test article contained internal physical modifications that were designed to produce thrust, while the other did not (with the latter being referred to as the "null" test article). Test data gathered includes torsion pendulum displacement measurements which are used to calculate generated force, still imagery in the visible spectrum to document the physical configuration, still imagery in the infrared spectrum to characterize the thermal environment, and video imagery. Post-test data includes static and animated graphics produced during RF resonant cavity characterization using the COMSOL Multiphysics® software application. Excerpts from all of the above are included and discussed in this paper. Lessons learned from test integration and operations include identification of the need to replace manual control of the resonant cavity target frequency with an automated frequency control capability. Future test plans include the development of an automatic frequency control circuit. Test results indicate that the RF resonant cavity thruster design, which is unique as an electric propulsion device, is producing a force that is not attributable to any classical electromagnetic phenomenon and therefore is potentially demonstrating an interaction with the quantum vacuum virtual plasma. Future test plans include independent verification and validation at other test facilities.

Brady, David↗
DOE OSTI2022

Deep reinforcement learning based optimization for a tightly coupled nuclear renewable integrated energy system

New ways to integrate energy systems to maximize efficiency are being sought to meet carbon emissions goals. Nuclear-renewable integrated energy system (NR-IES) concepts are a leading solution that couples a nuclear power plant with renewable energy, hydrogen generation plants, and energy storage systems, such that thermal and electrical power are dispatchable to fulfill grid-flexibility requirements while also producing hydrogen and maximizing revenue. Here, this paper introduces a deep reinforcement learning (DRL)-based framework to address the complex decision-making tasks for NR-IES. The objective is to maximize revenue by generating and selling hydrogen and electricity simultaneously according to their time-varying prices while keeping the energy flow in the subsystems in balance. A Python-based simulator for a NR-IES concept has been developed to integrate with OpenAI Gym and Ray/RLlib to enable an efficient and flexible computational framework for DRL research and development. Three state-of-the-art DRL algorithms have been investigated, including two-delayed deep deterministic policy gradient (TD3), soft-actor critic (SAC), proximal policy optimization (PPO), to illustrate DRL’s superiority for controlling NR-IES by comparing it with a conventional control approach, particle swarm optimization (PSO). In this effort, PPO has shown more-stable performance and also better generalization capability than SAC and TD3. Comparisons with PSO have demonstrated that, on average, PPO can achieve 13.9% more mean episode returns from the training process and 29.4% more mean episode returns from the testing process when different hydrogen-production targets are applied.

08 HYDROGEN↗
DOE OSTI2025

Downscaled Earth System Model Data for Resilient Energy System Planning

The second-generation Sup3rCC dataset provides high-resolution meteorological data generated through the downscaling of multiple earth system models (ESMs) from the Coupled Model Intercomparison Project Phase 6 (CMIP6). This downscaling is performed through application of a generative machine learning approach called Super-Resolution for Renewable Resource Data (sup3r). This dataset builds on the first-generation Sup3rCC data by applying improved bias correction methods and adding downscaled precipitation to the output variables. In this presentation, we explore the output characteristics of the dataset and various validation analyses. We also present and discuss plans for the integration of this data into power system planning models using a decision-making under deep uncertainty (DMDU) methodology.

97 MATHEMATICS AND COMPUTING↗
NASA NTRSDate not supplied

A Model-Based Systems Engineering Journey to Developing a Concept of Operations

Starting in 2017, NASA’s Human Research Program (HRP) Exploration Medical Capability (ExMC) element began a systems engineering transition from traditional, document-centric development to model-centric development when defining its foundation medical systems. These foundation medical systems define a Concept of Operations (ConOps) and identify the generic requirements for a medical system based on assumptions about a generic crew and mission environments and guidance from NASA standards (e.g., Medical “Levels of Care”). By making the transition, ExMC intends to improve communication among stakeholders about foundation medical system requirements and content. In addition, this transition will enable ExMC to lower both development and crew treatment risks for future, mission-specific medical systems. ExMC followed a Model Based Systems Engineering (MBSE) paradigm when developing the foundation medical systems. A model-based approach provides several advantages over a traditional, document-centric approach. First, when Systems Engineers (SE) develop diagrams in a model using a standard modeling language, they produce information dense pictures that facilitate understanding much more efficiently with less room for misinterpretation than text. Second, due to the evolving nature of projects, documentation becomes out of date the minute it is published. This can result in people making decisions based on information that is no longer current, especially if they are referencing a locally-stored copy of a document. A model, on the other hand, is always up to date with the latest approved changes and information. It serves as a single point of truth. Third, a model-centric approach centralizes all important information in one place. Rather than having to flip through separate ConOps documents, design specifications, requirements specifications, and the like to coordinate information, a model captures the content in one, integrated spot. This integration makes tracing information from end-to-end easier with greater reliability. The ExMC Systems Engineering Lifecycle follows a well-defined process. ExMC Systems Engineers perform all major steps of the process, regardless of the development methodology. One of the first steps in the process is developing the ConOps that describes the operation of the system from the point of view of the users. It includes a list of the users and their needs, the goals of the medical system, key assumptions about the system, and definitions of the medical system’s operational environments. For this development effort, ExMC chose to replace the traditional text-based ConOps document with a model. While the decision to change the development workflow was not difficult, implementing the structural and organizational workflows were. It required showing ExMC’s users, most of whom are not Systems Engineers, how the information they require would be presented in the model and to gain their acceptance of this approach. This paper documents key lessons learned during the ConOps transformation by focusing on how the model represents information, the agile workflow used by SEs when developing the model and how it integrates into a project plan, how leadership influenced key users to accept the transformation, and how the users interact with the model information.

Jeffrey Robert Cohen↗
DOE OSTI2023

Nuclear-Renewable-Storage Systems: Enhancing Planning and Operations of Integrated Energy Systems

Nuclear-renewable-storage integrated energy systems (IES) are multi-carrier energy systems that include not only electricity but also other forms of demands. Because individual IES components must observe their thermo-physical limits, including ramp rates, start-up, and shut-down time, we formulate operations of the IES as an optimization model by minimizing the total operations costs subject to physical limits of all constituent components. In addition, we develop a data-driven approach to improve the computational performance of the economic dispatch model by using reinforcement learning, where an agent is rewarded by meeting demands and penalized otherwise when shifting to the next state.

25 ENERGY STORAGE↗
NASA NTRS1993

GEOTAIL Spacecraft historical data report

The purpose of this GEOTAIL Historical Report is to document ground processing operations information gathered on the GEOTAIL mission during processing activities at the Cape Canaveral Air Force Station (CCAFS). It is hoped that this report may aid management analysis, improve integration processing and forecasting of processing trends, and reduce real-time schedule changes. The GEOTAIL payload is the third Delta 2 Expendable Launch Vehicle (ELV) mission to document historical data. Comparisons of planned versus as-run schedule information are displayed. Information will generally fall into the following categories: (1) payload stay times (payload processing facility/hazardous processing facility/launch complex-17A); (2) payload processing times (planned, actual); (3) schedule delays; (4) integrated test times (experiments/launch vehicle); (5) unique customer support requirements; (6) modifications performed at facilities; (7) other appropriate information (Appendices A & B); and (8) lessons learned (reference Appendix C).

Boersig, George R.↗
DOE OSTI2025

Energy storage planning for enhanced resilience of power systems against wildfires and heatwaves

Extreme weather events pose significant risks to power grid stability due to their severe consequences and potential for widespread failures. Energy storage systems hold great potential for enhancing grid resilience against such events by providing reliable power during peak demand periods. However, accurately quantifying the size, location, and investment costs of new energy storage assets is a complex task, as energy storage planning decisions depend on the investment choices of other generation technologies and the integration of new transmission projects. Here, this paper presents a novel capacity expansion planning framework that simultaneously optimizes investments in energy storage, generation, and transmission, determining their optimal size, location, and type, while incorporating extreme weather events into long-term planning. More specifically, our stress-event-informed planning framework integrates the impact of heatwaves and wildfires into the planning process, identifying least-cost investment solutions that comply with policy goals and enhance grid resilience. The proposed framework employs machine-learning-based modeling to project heatwave-induced loads and performance-based risk assessment to evaluate wildfire-driven transmission line derates. Using industry-standard datasets to accurately represent the transmission topology of the Western Interconnection (WI) system, the proposed framework is applied to the WI 40-zone system, with investment decisions reported for the years 2030, 2035, and 2040. Simulation results reveal that with just a 10% increase in investment costs, resilience against extreme events can be significantly improved, with investment decisions heavily favoring energy storage, particularly 4-hour energy storage systems.

25 ENERGY STORAGE↗
NASA NTRS1979

A review of Spacelab mission management approach

The Spacelab development program is a joint undertaking of the NASA and ESA. The paper addresses the initial concept of Spacelab payload mission management, the lessons learned, and modifications made as a result of the actual implementation of Spacelab Mission 1. The discussion covers mission management responsibilities, program control, science management, payload definition and interfaces, integrated payload mission planning, integration requirements, payload specialist training, payload and launch site integration, payload flight/mission operations, and postmission activities. After 3.5 years the outlined overall mission manager approach has proven to be most successful. The approach does allow the mission manager to maintain the lowest overall mission cost.

Craft, H. G., Jr.↗
NASA NTRS2008

Lunar Dust Mitigation Technology Development

NASA s plans for implementing the Vision for Space Exploration include returning to the moon as a stepping stone for further exploration of Mars, and beyond. Dust on the lunar surface has a ubiquitous presence which must be explicitly addressed during upcoming human lunar exploration missions. While the operational challenges attributable to dust during the Apollo missions did not prove critical, the comparatively long duration of impending missions presents a different challenge. Near term plans to revisit the moon places a primary emphasis on characterization and mitigation of lunar dust. Comprised of regolith particles ranging in size from tens of nanometers to microns, lunar dust is a manifestation of the complex interaction of the lunar soil with multiple mechanical, electrical, and gravitational effects. The environmental and anthropogenic factors effecting the perturbation, transport, and deposition of lunar dust must be studied in order to mitigate it s potentially harmful effects on exploration systems. This paper presents the current perspective and implementation of dust knowledge management and integration, and mitigation technology development activities within NASA s Exploration Technology Development Program. This work is presented within the context of the Constellation Program s Integrated Lunar Dust Management Strategy. The Lunar Dust Mitigation Technology Development project has been implemented within the ETDP. Project scope and plans will be presented, along with a a perspective on lessons learned from Apollo and forensics engineering studies of Apollo hardware. This paper further outlines the scientific basis for lunar dust behavior, it s characteristics and potential effects, and surveys several potential strategies for its control and mitigation both for lunar surface operations and within the working volumes of a lunar outpost.

Hyatt, Mark J.↗
NASA NTRS1995

Robust integrated neurocontroller for complex dynamic systems

The goal of this research effort is to develop an integrated control software environment for the purpose of creating an intelligent neurocontrol system. The system will be capable of estimating states, identifying parameters, diagnosing conditions, planning control strategies, and producing intelligent control actions. The distinct features of such control system are adaptability and on-line learning capability. The proposed system will be flexible to allow structure adaptability to account for changes in the dynamic system such as sensory failures and/or component degradations. The developed system should learn system uncertainties and changes, as they occur, while maintaining minimal control level on the dynamic system. The research activities set to achieve the research objective are summarized by the following general items: (1) Development of a system identifier or diagnostic system; (2) Development of a robust neurocontroller system, and; (3) Integration of above systems to create a robust Integration Control system (RIC-system). Two contrary approaches are investigated in this research: classical (traditional) design approach, and the simultaneous design approach. However, in both approaches neural network is the base for the development of different functions of the system. The two resulting designs will be tested and simulation results will be compared for better possible implementation.

Zein-Sabbato, S.↗
NASA NTRS1996

Robust Integrated Neurocontroller for Complex Dynamic Systems

The goal of this research effort is to develop an integrated control software environment for the purpose of creating an intelligent neurocontrol system. The system will be capable of estimating states, identifying parameters, diagnosing conditions, planning control strategies, and producing intelligent control actions. The distinct features of such control system are: adaptability and on-line learning capability. The proposed system will be flexible to allow structure adaptability to account for changes in the dynamic system such as: sensory failures and/or component degradations. The developed system should learn system uncertainties and changes, as they occur, while maintaining minimal control level on the dynamic system. The research activities set to achieve the research objective are summarized by the following general items: (1) Development of a system identifier or diagnostic system, (2) Development of a robust neurocontroller system, and 3. Integration of above systems to create a Robust Integrated Control system (RIC-system). Two contrary approaches are investigated in this research: classical (traditional) design approach, and the simultaneous design approach. However, in both approaches neural network is the base for the development of different functions of the system. The two resulting designs will be tested and simulation results will be compared for better possible implementation.

Zein-Sabatto, S.↗
DOE OSTI2022

Replication Data for: Multitask Machine Learning of Collective Variables for Enhanced Sampling of Rare Events

The data underlying this published work have been made publicly available in this repository as part of the IMASC Data Management Plan. This work was supported as part of the Integrated Mesoscale Architectures for Sustainable Catalysis (IMASC), an Energy Frontier Research Center funded by the U.S. Department of Energy, Office of Science, Basic Energy Sciences under Award # DE-SC0012573.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗