Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “adaptive learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,531 records · Page 85

LESSONS FROM NUCLEAR ENERGY: BUILDING SNOW AND AVALANCHE SIMULATION TOOLS USING A COMMON OPEN-SOURCE FRAMEWORK

The Department of Energy (DOE) is currently investing millions of dollars annually into various modeling and simulation tools for all aspects of nuclear energy. An important part of this effort includes developing applications based on the open-source Multiphysics Object Oriented Simulation Environment (MOOSE; mooseframework.org) from Idaho National Laboratory (INL). Through the DOE and outside collaborators, MOOSE includes a large set of physics modules, including phase field, level set, heat conduction, tensor mechanics, Navier-Stokes, and porous media, among others. The phase-field module, in particular, is well-suited for micro-structure evolution simulations, including solidification, as shown in the figure. It was also used, in conjunction with the heat conduction module, to build a multiscale snow model (Pika) as presented at the 2014 International Snow Science Workshop (Slaughter et al., 2014). The snow science community should learn from the nuclear industry, and harness the enormous effort underway to build simulation tools that are open, modular, and share a common framework. In particular, MOOSE-based multi-physics solvers are inherently parallel, dimension agnostic, adaptive in time and space, fully-coupled, and capable of interacting with other applications. The snow science community must build on existing tools to enable collaboration between researchers and practitioners throughout the world, and advance the state-of-the-art in line with other scientific research efforts.

97 MATHEMATICS AND COMPUTING↗

Grid-Interactive Multi-Zone Building Control Using Reinforcement Learning with Global-Local Policy Search

In this paper, we develop a grid-interactive multi-zone building controller based on a deep reinforcement learning (RL) approach. The controller is designed to facilitate building operation during normal conditions and demand response events, while ensuring occupants comfort and energy efficiency. We leverage a continuous action space RL formulation, and devise a two-stage global-local RL training framework. In the first stage, a global fast policy search is performed using a gradient-free RL algorithm. In the second stage, a local fine-tuning is conducted using a policy gradient method. In contrast to the state-of-the-art model predictive control (MPC) approach, the proposed RL controller does not require complex computation during real-time operation and can adapt to nonlinear building models. We illustrate the controller performance numerically using a five-zone commercial building.

30 DIRECT ENERGY CONVERSION↗

Autonomous organic synthesis for redox flow batteries via flexible batch Bayesian optimization

Traditional trial-and-error methods for materials discovery are inefficient to meet the urgent demands posed by the rapid progression of climate change. This urgency has driven the increasing interest in integrating robotics and machine learning into materials research to accelerate experimental learning. However, idealized decision-making frameworks to achieve maximum sampling efficiency are not always compatible with high-throughput experimental workflows inside a laboratory. For multi-step chemical processes, differences in hardware capacities can complicate the digital framework by introducing constraints on the maximum number of samples in each step of the experiment, hence causing varying batch sizes in variable selection within the same batch. Therefore, designing flexible sampling algorithms is necessary to accommodate the multi-step synthesis with practical constraints unique to each high-throughput workflow. In this work, we designed and employed three strategies on a high-throughput robotic platform to optimize the sulfonation reaction of redox-active molecules used in flow batteries. Our strategies adapt to the multi-step experimental workflow, where their formulation and heating steps are separate, causing varying batch size requirements. By strategically sampling using clustering and mixed-variable batch Bayesian optimization, we were able to iteratively identify optimal conditions that maximize the yields. Our work presents a flexible approach that allows tailoring the machine learning decision-making to suit the practical constraints in individual high-throughput experimental platforms, followed by performing resource-efficient yield optimization using available open-source Python libraries.

Tamura, Clara [Univ. of Washington, Seattle, WA (U↗

Generalized Bayesian MARS: Tools for Stochastic Computer Model Emulation

The multivariate adaptive regression spline (MARS) approach of Friedman and its Bayesian counterpart are effective approaches for the emulation of computer models. The traditional assumption of Gaussian errors limits the usefulness of MARS, and many popular alternatives, when dealing with stochastic computer models. Here, we propose a generalized Bayesian MARS (GBMARS) framework which admits the broad class of generalized hyperbolic distributions as the induced likelihood function. This allows us to develop tools for the emulation of stochastic simulators which are parsimonious, scalable, and interpretable and require minimal tuning, while providing powerful predictive and uncertainty quantification capabilities. GBMARS is capable of robust regression with t distributions, quantile regression with asymmetric Laplace distributions, and a general form of “Normal-Wald” regression in which the shape of the error distribution and the structure of the mean function are learned simultaneously. We demonstrate the effectiveness of GBMARS on various stochastic computer models, and we show that it compares favorably to several popular alternatives.

97 MATHEMATICS AND COMPUTING↗

Space Shuttle Orbiter Venting: Lessons Learned

The orbiter vent system provides dedicated vent areas to permit the gases trapped inside the vehicle to escape during accent. The same vent system also repressurizes the vehicle during entry. The vent system is one of six systems that constitutes the purge, vent and drain subsystem. The orbiter active vent system has been very adaptable to the changing requirements that have occurred during the development of the Space Shuttle orbiter. Good correlation has been obtained between predicted and measured compartment pressures during the orbital flight test (OFT) program. An investigation of the flight data showed that the difference between preflight prediction and the measured values were primarily due to the difference between the baseline external pressures, which was based on subscale wind tunnel test data, and the actual vehicle local external pressures measured during the flight. The current predictions are based on flight derived vent port pressure coefficients since the wind tunnel data does not adequately define the orbiter ascent pressure environment.

H S Lutfi↗

Deep Learning-Based Dynamic Modeling of Three-Phase Voltage Source Inverters

Inverter-based resource (IBR) models are necessary to analyze modern power system stability and create effective control strategies. Modeling IBRs in converter-rich power systems is crucial, yet challenging due to the lack of commercial information on converter topologies and control parameters. This paper proposes novel convolutional neural network (CNN)–based data-driven techniques for modeling IBRs, addressing adaptability and proprietary concerns without requiring internal system physics knowledge. The proposed method is tested using real grid-tied commercial IBR transient data and demonstrates effectiveness and accuracy. Furthermore, the developed modeling approach is integrated and implemented in the open-source power distribution simulation and analysis tool, GridLAB-D, to illustrate the potentiality of dynamic analysis of large-scale power systems with high IBRs.

deep learning, artificial intelligence↗

Integrating Land Cover Modeling and Adaptive Management to Conserve Endangered Species and Reduce Catastrophic Fire Risk

Land cover modeling is used to inform land management, but most often via a two-step process where science informs how management alternatives can influence resources and then decision makers can use this to make decisions. A more efficient process is to directly integrate science and decision making, where science allows us to learn to better accomplish management objectives and is developed to address specific decisions. Co-development of management and science is especially productive when decisions are complicated by multiple objectives and impeded by uncertainty. Multiple objectives can be met by specification of tradeoffs, and relevant uncertainty can be addressed through targeted science (i.e., models and monitoring). We describe how to integrate habitat and fuels monitoring with decision making focused on dual objectives of managing for endangered species and minimizing catastrophic fire risk. Under certain conditions, both objectives might be achieved by a similar management policy, but habitat trajectories suggest tradeoffs. Knowledge about system responses to actions can be informed by applying competing management actions to different land units in the same system state and by ideas about fire behavior. Monitoring and management integration is important to optimize state-specific management decisions and increase knowledge about system responses. We believe this approach has broad utility for and cover modeling programs intended to inform decision making.

adaptive management↗

Reconnecting fragmented sturgeon populations in North American rivers

The majority of large North American rivers are fragmented by dams that interrupt migrations of wide-ranging fishes like sturgeons. Reconnecting habitat is viewed as an important means of protecting sturgeon species in U.S. rivers because these species have lost between 5% and 60% of their historical ranges. Unfortunately, facilities designed to pass other fishes have rarely worked well for sturgeons. The most successful passage facilities were sized appropriately for sturgeons and accommodated bottom-oriented species. For upstream passage, facilities with large entrances, full-depth guidance systems, large lifts, or wide fishways without obstructions or tight turns worked well. However, facilitating upstream migration is only half the battle. Broader recovery for linked sturgeon populations requires safe round-trip passage involving multiple dams. The most successful downstream passage facilities included nature-like fishways, large canal bypasses, and bottom-draw sluice gates. We outline an adaptive approach to implementing passage that begins with temporary programs and structures and monitors success both at the scale of individual fish at individual dams and the scale of metapopulations in a river basin. The challenge will be to learn from past efforts and reconnect North American sturgeon populations in a way that promotes range expansion and facilitates population recovery.

60 APPLIED LIFE SCIENCES↗

Hindsight logging for model training

In modern Machine Learning, model training is an iterative, experimental process that can consume enormous computation resources and developer time. To aid in that process, experienced model developers log and visualize program variables during training runs. Exhaustive logging of all variables is infeasible, so developers are left to choose between slowing down training via extensive conservative logging, or letting training run fast via minimalist optimistic logging that may omit key information. As a compromise, optimistic logging can be accompanied by program checkpoints; this allows developers to add log statements post-hoc, and "replay" desired log statements from checkpoint---a process we refer to as hindsight logging. Unfortunately, hindsight logging raises tricky problems in data management and software engineering. Done poorly, hindsight logging can waste resources and generate technical debt embodied in multiple variants of training code. In this paper, we present methodologies for efficient and effective logging practices for model training, with a focus on techniques for hindsight logging. Our goal is for experienced model developers to learn and adopt these practices. To make this easier, we provide an open-source suite of tools for Fast Low-Overhead Recovery (flor) that embodies our design across three tasks: (i) efficient background logging in Python, (ii) adaptive periodic checkpointing, and (iii) an instrumentation library that codifies hindsight logging for efficient and automatic record-replay of model-training. Model developers can use each flor tool separately as they see fit, or they can use flor in hands-free mode, entrusting it to instrument their code end-to-end for efficient record-replay. Our solutions leverage techniques from physiological transaction logs and recovery in database systems. Evaluations on modern ML benchmarks demonstrate that flor can produce fast checkpointing with small user-specifiable overheads (e.g. 7%), and still provide hindsight log replay times orders of magnitude faster than restarting training from scratch.

Computer Science↗

Flexible AI Models for Grid Resilience

The rapid growth in size and complexity of artificial intelligence (AI) and machine learning (ML) models has led to increased energy demands, posing a threat to the reliability of the existing power grid. This project addresses the challenge of highly intermittent and energy-intensive inference workloads by (1) developing fidelity-adaptive neural networks capable of dynamic response to grid conditions and (2) integrating these networks with power flow simulations to assess their impact on power grid reliability. We will explore both top-down and bottom-up approaches to create hierarchies of submodels that provide a controlled trade-off between power draw and prediction accuracy. The top-down method utilizes NN pruning to reduce a flagship model into progressively smaller, energy-efficient variants. The bottom-up approach employs geometrically principled weight setting strategies to construct depth-efficient models from the ground up. A real-time hardware-in-the-loop (HIL) platform will be developed to simulate a scaled AC power grid, integrating live AI workload power draw and enabling dynamic model switching in response to grid feedback. This work will provide a novel framework for evaluating the impact of flexible AI/ML workloads on grid performance and establish new methodologies for energy-aware computing in data centers. The outcomes will demonstrate that adaptive AI/ML can play a critical role in improving grid stability while advancing NREL's leadership in energy-efficient computing research.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Procedure Parsing: A Method for Parsing Handwritten Documents into Computer-Based Procedures

The nuclear industry is heavily procedure driven, where almost everything has a step-by-step instruction that is expected to be followed in detail. Historically, these procedures were printed on paper copies. Recently, the industry transitioned towards electronic copies (i.e., PDFs on tablets). One major drive for this transition is the introduction of human error and loss of situation awareness when using paper copies. However, electronic copies of documents inherently have the same error traps as their paper cousins. Therefore, there is an increased interest in a way to utilize the information in the step-by-step guidance, but to present it in a dynamic manner that guides the user and adapts to any encountered conditions. Researchers at Idaho National Laboratory propose a flexible, automated method based on document parsing and augmented by natural language processing (NLP) techniques, to address these shortcomings and capitalize on these recent advancements in machine learning. The proposed method provides a cost-effective solution for computer-assisted procedure parsing of hand-written control room procedures, originally authored in Word or PDF formats, into instructions that can be displayed as computer-based procedures (CBP) in a modern graphical user interface. The researchers devised, implemented and demonstrated the Operating Procedure Extender for Novel Systems (OPENS) method in 2020. The key to OPENS is to map the original procedure text into a context-free grammar, tying content to equipment, locations, and other steps, actions, etc. This formal grammar is then used to isolate and define keywords and actions verbs, such as “measure” or “evaluate” and tie them to specific equipment referenced within that step or located in other steps, substeps, actions, subactions and tables throughout the procedure. OPENS generates an abstract syntax tree from the document which it uses to store a copy of this information in the open-standard, machine-readable and human-readable file formats XML and JSON. The XML is useful to preserve the relational aspects of the procedure for referencing tables and branching information so the user can be directed to the next appropriate active step based on the values entered for that step and previous steps. The JSON is useful for storing and exchanging data objects used to track responses to previous steps and state changes in simulated environments. In future iterations, these formats can also be used for storing more detailed information about input during plant operation or simulation. The techniques the researcher developed could further be improved by integration of recent advancements in machine learning. NLP methods could standardize documents, correct for grammatical error, and provide automated semantic validation. The researcher expects that self-supervised techniques applied to collections of natural language instructions could strengthen the model with broader context. All these methods together give us a practical way to automatically extract protocols from documents and user interactions, empowering researchers, procedure writers and nuclear operators while moving the industry forward.

99 GENERAL AND MISCELLANEOUS↗

Image Analysis via Fuzzy-Reasoning Approach: Prototype Applications at NASA

A set of imaging techniques based on Fuzzy Reasoning (FR) approach was built for NASA at Kennedy Space Center (KSC) to perform complex real-time visual-related safety prototype tasks, such as detection and tracking of moving Foreign Objects Debris (FOD) during the NASA Space Shuttle liftoff and visual anomaly detection on slidewires used in the emergency egress system for Space Shuttle at the launch pad. The system has also proved its prospective in enhancing X-ray images used to screen hard-covered items leading to a better visualization. The system capability was used as well during the imaging analysis of the Space Shuttle Columbia accident. These FR-based imaging techniques include novel proprietary adaptive image segmentation, image edge extraction, and image enhancement. Probabilistic Neural Network (PNN) scheme available from NeuroShell(TM) Classifier and optimized via Genetic Algorithm (GA) was also used along with this set of novel imaging techniques to add powerful learning and image classification capabilities. Prototype applications built using these techniques have received NASA Space Awards, including a Board Action Award, and are currently being filed for patents by NASA; they are being offered for commercialization through the Research Triangle Institute (RTI), an internationally recognized corporation in scientific research and technology development. Companies from different fields, including security, medical, text digitalization, and aerospace, are currently in the process of licensing these technologies from NASA.

Dominguez, Jesus A.↗

Auto-Gopher-2 – An Autonomous Wireline Rotary Piezo-Percussive Deep Drilling Mechanism

Drilling deep into the subsurface of planetary bodies in the Solar System for samples acquisition enables critical capabilities for future NASA exploration missions in its quest to understand the origins of the Solar System and potentially the search for life. Such planetary bodies as Mars and Europa are key targets for potential missions that would require reaching great depths. Performing drilling while using minimal mass/volume systems and with low energy consumption are the main requirements that are imposed on such technologies. A wireline deep drill, called Auto-Gopher-2, is currently being developed as a joint effort between JPL and Honeybee Robotics Ltd. The Auto-Gopher II is a wireline rotary piezo-percussive deep drilling mechanism that combines formation breaking by rotating and piezoelectric actuator hammering and cuttings removal by rotating a fluted bit. The hammering mechanism is based on the Ultrasonic/Sonic Drill/Corer (USDC) mechanism that has been developed as an adaptable tool for many drilling and coring applications. The USDC uses an intermediate ball-shape free-mass to transform high frequency vibrations of a piezoelectric transducer horn tip into sonic hammering of the drill bit. The lessons learned from the previous studies are being implemented into the development of the Auto-Gopher-II, an autonomous deep wireline drill with integrated cuttings and sample management and drive electronics. Subsystems of the wireline drill are being developed in parallel at JPL and Honeybee Robotics, Ltd. Issues related to the bit and its ability to retain the cuttings for caching and removal are currently being addressed. This paper presents the development efforts of the piezoelectric actuator, cuttings removal and retention flutes and drive electronics.

Bar-Cohen, Yoseph↗

The Evolution of Planetary Protection Implementation on Mars Landed Missions

NASA has developed requirements dedicated to the prevention of forward and backward contamination during space exploration. Historically, international agreements provided guidelines to prevent contamination of the Moon and other celestial bodies, as well as the Earth (e.g., sample return missions). The UN Outer Space Treaty was established in 1967 and the Committee on Space Research (COSPAR) maintains a planetary protection policy complying with Article IX of this treaty. By avoiding forward contamination, the integrity of scientific exploration is preserved. Planetary Protection mission requirements are levied on missions to control contamination. These requirements are dependent on the science of the mission and on the celestial bodies encountered or targeted along the way. Consequently, categories are assigned to missions, and specific implementation plans are developed to meet the planetary protection requirements. NASA missions have evolved over time with increasingly more demanding scientific objectives and more complex flight systems to achieve those objectives and, thus, planetary protection methods and processes used for implementation have become much more intricate, complicated, and challenging. Here, we will portray the evolution of planetary protection implementation at JPL in several important areas throughout the course of NASA sponsored robotic Mars lander or rover missions, starting from Mars Pathfinder through the beginning of Mars 2020. Highlighted in the discussion will be process changes in planetary protection requirements development and flow down. Development and implementation of new and improved methods used in the reduction of spacecraft bioburden will be discussed as well as approaches and challenges that come along with setting up remote laboratories to perform bioassays. The consequences and forward planning of delays on missions will be highlighted as well as lessons learned on the impact of communication and training in achieving planetary protection requirements. The evolution of methods used for the detection of microbial bioburden on spacecraft hardware will be considered. These methods use standard microbiology as well as the adaptation of advances in biotechnology, molecular biology, and bioinformatics. Technical approaches developed for the prevention of contamination and recontamination of hardware during Assembly, Test, and Launch Operations will be discussed.

Kazarians, Gayane A.↗

Role of Cyber-Physical Testing in Developing Resilient Extraterrestrial Habitats

Extraterrestrial long-term habitat systems (henceforth referred to as habitat systems) require groundbreaking technological advances to overcome the extreme demands introduced by isolation and challenging environments. A habitat system must operate as intended under continuous disruptive conditions. Designing for the demands that challenging environments will place on habitat systems (e.g., wild temperature fluctuations, galactic cosmic rays, destructive dust, meteoroid impacts, vibrations, and solar particle events) represents one of the greatest challenges in this endeavor. This engineering problem necessitates that we design and manage habitat systems to be resilient. System resilience requires a comprehensive approach that accounts for disruptions through the design process and adapts to them in operation. As the habitat system evolves—growing in physical size, complexity, population, and connectivity—and diversifies in operations, it must continue to be safe and resilient. In this endeavor, we should take advantage of lessons learned in developing civil infrastructure responsive to catastrophic natural hazards, autonomous robotics platforms, smart buildings, cyber-physical testing, complex systems, and diagnostics and prognostics for intelligent health management. This study highlights the importance of system resilience and cyber-physical testing to address the grand challenge of developing habitat systems.

Public health and safety↗

Design and Qualification or the Low-Earth Orbit Flight Test of an Inflatable Decelerator(LOFTID) Payload Adapter Separation System (PASS)

On November 10, 2022, NASA and United Launch Alliance (ULA) launched Low-Earth Orbit Flight Test of an Inflatable Decelerator (LOFTID) as a secondary payload on an Atlas V Centaur from Vandenburg Space Force Base (VSFB). After deploying the primary payload, JPSS-2, to a sun-synchronous orbit, the Centaur reoriented LOFTID for reentry, ejecting the Payload Adaptor to expose the stowed LOFTID reentry vehicle (RV). The Hypersonic Inflatable Aerodynamic Decelerator (HIAD) was then deployed and inflated, and the Centaur reoriented the RV to the desired entry attitude, spun the vehicle to roughly three rpm, and separated the reentry vehicle. After nearly half an orbit of free flight, LOFTID reentered the atmosphere at >8 km/sec, demonstrating stable flight from hypersonic entry through subsonic parachute deployment. A mission-unique Payload Adapter Separation System (PASS) enabled the successful LOFTID flight demonstration, allowing the launch vehicle to accommodate a superstack of two independent, similarly sized payloads. This paper discusses the design, development, and qualification of the LOFTID PASS along with lessons learned.

HIAD↗

A Reinforcement Learning Hyper-Heuristic in Multi-Objective Optimization with Application to Structural Damage Identification

Multi-objective optimization allows satisfying multiple decision criteria concurrently, and generally yields multiple solutions. It has the potential to be applied to structural damage identification applications which are oftentimes under-determined. How to achieve high-quality solutions in terms of accuracy, diversity, and completeness is a challenging research subject. The solution techniques and parametric selections are believed to be problem specific. In this research, we formulate a reinforcement learning hyper-heuristic scheme to work coherently with the single-point search algorithm MOSA/R (Multi-Objective Simulated Annealing Algorithm based on Re-seed). The four low-level heuristics proposed can meet various optimization requirements adaptively and autonomously using the domination amount, crowding distance, and hypervolume calculations. The new approach exhibits improved and more robust performance than AMOSA, NSGA-II, and MOEA/D when applied to benchmark test cases. It is then applied to an active damage interrogation scheme for structural damage identification where solution diversity/completeness and accuracy are critically important. Results show that this approach can successfully include the true damage scenario in the solution set identified. The outcome of this research can potentially be extended to a variety of applications.

Pei Cao↗

Enhancing the Payload Development Process for Lunar Gateway and Lunar Surface Science & Exploration: Space Biology Beyond Low-Earth-Orbit Instrumentation and Science Series (BLISS) Science Working Group 2023-2024 Annual Report

Space biology BLEO research is inherently driven by the differences between the LEO and BLEO environments, which can be broadly characterized by the five-hazard “RIDGE” paradigm (Radiation, Isolation, Distance, Gravity, Environment, e.g., similar to Figure 2 in (1)). Thus, the envisioned goals over the next decade will include using the cislunar and lunar surface environments to (A) characterize deep-space environments including biological effects of radiation and other stressors, (B) gain experience from isolation of very small groups in very small enclosures, (C) learn to compensate for distance from Earth via in situ resource utilization (ISRU) and bioregenerative life support, (D) gain assurance that all aspects of deep-space exploration can proceed in altered or artificial gravity environments, (E) develop essential adaptation scenarios for the built (e.g., low pressure) and external (e.g., temperature extremes, dust) environments.

Biology↗