Engineering PapersSearch

SEARCH · Engineering Papers

Results for “Continual Learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

Effect of continuous gamma-ray exposure on performance of learned tasks and effect of subsequent fractionated exposures on blood-forming tissue

Sixteen monkeys trained to perform continuous and discrete-avoidance and fixed-ratio tasks with visual and auditory cues were performance-tested before, during, and after 10-day gamma-ray exposures totaling 0, 500, 750, and 1000 rads. Approximately 14 months after the performance-test exposures, surviving animals were exposed to 100-rad gamma-ray fractions at 56-day intervals to observe injury and recovery patterns of blood-forming tissues. The fixed-ratio, food-reward task performance showed a transient decline in all dose groups within 24 hours of the start of gamma-ray exposure, followed by recovery to normal food-consumption levels within 48 to 72 hours. Avoidance tasks were performed successfully by all groups during the 10-day exposure, but reaction times of the two higher dose-rate groups in which animals received 3 and 4 rads per hour or total doses of 750 and 1000 rads, respectively, were somewhat slower.

Spalding, J. F.

LDCM Ground System. Network Lesson Learned

This slide presentation reviews the Landsat Data Continuity Mission (LDCM) and the lessons learned in implementing the network that was assembled to allow for the acquisition, archiving and distribution of the data from the Landsat mission. The objective of the LDCM is to continue the acquisition, archiving, and distribution of moderate-resolution multispectral imagery affording global, synoptic, and repetitive coverage of the earth's land surface at a scale where natural and human-induced changes can be detected, differentiated, characterized, and monitored over time. It includes a review of the ground network, including a block diagram of the ground network elements (GNE) and a review of the RF design and testing. Also included is a listing of the lessons learned.

Gal-Edd, Jonathan

Reinforcement learning pulses for transmon qubit entangling gates

The utility of a quantum computer is highly dependent on the ability to reliably perform accurate quantum logic operations. For finding optimal control solutions, it is of particular interest to explore model-free approaches, since their quality is not constrained by the limited accuracy of theoretical models for the quantum processor—in contrast to many established gate implementation strategies. In this work, we utilize a continuous control reinforcement learning algorithm to design entangling two-qubit gates for superconducting qubits; specifically, our agent constructs cross-resonance and CNOT gates without any prior information about the physical system. Using a simulated environment of fixed-frequency fixed-coupling transmon qubits, we demonstrate the capability to generate novel pulse sequences that outperform the standard cross-resonance gates in both fidelity and gate duration, while maintaining a comparable susceptibility to stochastic unitary noise. We further showcase an augmentation in training and input information that allows our agent to adapt its pulse design abilities to drifting hardware characteristics, importantly, with little to no additional optimization. Our results exhibit clearly the advantages of unbiased adaptive-feedback learning-based optimization methods for transmon gate design.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC

Unbinned extraction of $γ$ from $B\to DK$ with normalizing flows

We introduce an unbinned method for extracting the CKM angle $γ$ from the decay chain $B^\pm \to (D \to K_S π^+ π^-) K^\pm$ using normalizing flows (NFs). The NFs, trained on $D$ decay data, learn a faithful continuous representation of the amplitude and strong phase variation over the $D\to K_Sπ^+π^-$ Dalitz plot whose fidelity improves with increased data sample sizes. With this input, the $B$ decay data can be used to extract the parameters $r_B$, $δ_B$, and $γ$. We test the method on Monte Carlo generated data, where it successfully recovers the injected value of $γ$ within uncertainties. The present implementation propagates statistical uncertainties from finite training data via an ensemble of independently trained flows, and does not attempt to capture the effects of systematic experimental errors. We explore two versions of the method that differ in how the trigonometric constraint on phase variation is encoded, and comment on the possible extension to Bayesian NFs, which would provide direct uncertainty estimates on the learned densities without requiring ensemble training.

Grossman, Yuval [Cornell U., LEPP]

Projections of future climate for U.S. national assessments: past, present, future

Climate assessments consolidate our understanding of possible future climate conditions as represented by climate projections, which are largely based on the output of global climate models. Over the past 30 years, the scientific insights gained from climate projections have been refined through model structural improvements, emerging constraints on climate feedbacks, and increased computational efficiency. Within the same period, the process of assessing and evaluating information from climate projections has become more defined and targeted to inform users. As the size and audience of climate assessments has expanded, the framing, relevancy, and accessibility of projections has become increasingly important. This paper reviews the use of climate projections in national climate assessments (NCA) while highlighting challenges and opportunities that have emerged over time. Reflections and lessons learned address the continuous process to understand the broadening assessment audience and evolving user needs. Insights for future NCA development include (1) identifying benchmarks and standards for evaluating downscaled datasets, (2) expanding efforts to gather research gaps and user needs to inform how climate projections are presented in the assessment (3) providing practitioner guidance on the use, interpretation, and reporting of climate projections and uncertainty to better inform decision-making.

Assessment

Incentivizing and Supporting Early-Stage Solar Innovation in the United States

In 2018, the U.S. Department of Energy's Solar Energy Technologies Office and the National Renewable Energy Laboratory set out to develop a repeatable, predictable prize model (the American-Made Challenges) and an entrepreneurial innovation network (the American-Made Network) to support participants along their innovation journeys. This began with the launch of the Solar Prize. Five years and six rounds later, the Solar Prize is the longest-standing competition of the American-Made Challenges. It has awarded $\$20.1$ million in cash prizes and $\$5.5$ million in technical support vouchers to 140 teams across all aspects of the solar industry. By sharing the outputs of the prize, we hope that our lessons learned will help continue to build the clean tech entrepreneurship support ecosystem.

14 SOLAR ENERGY

Lessons Learned on Prize Design in the Perovskite Startup Prize

In 2018, the U.S. Department of Energy's Solar Energy Technologies Office and the National Renewable Energy Laboratory set out to develop a repeatable, predictable prize model with the American-Made Challenges. A new model launched by the Solar Energy Technologies Office in March 2021 was the American-Made Perovskite Startup Prize. This new prize aimed to accelerate the growth of the domestic perovskite industry and support the rapid development of solar cells and modules that use perovskite materials. By sharing the outputs of the prize, we hope that our lessons learned will help continue to build the clean tech entrepreneurship support ecosystem and influence how a successful prize design can be achieved.

14 SOLAR ENERGY

Tactical Analysis for Calculating Contextual Risk at Boundaries: Summary of Laboratory Directed Research & Development Effort

The Tactical Analysis for Calculating Contextual Risk at Boundaries (TACCRAB) tool is an innovative digital twin (DT) platform and automated risk algorithm designed to transform operational decision-making in structured screening environments, with an initial focus on Southern Border Land Ports of Entry (POEs). The invention provides integration points for advanced artificial intelligence, predictive modeling, and real-time data analysis to produce a comprehensive risk management tool that enables proactive, data-informed security strategies. The core inventive features of TACCRAB center on its unique risk algorithm, which dynamically calculates contextual risk by synthesizing historical data, near real-time streaming data from the checkpoints themselves, and AI-generated predictions. Unlike traditional risk assessment methods, TACCRAB utilizes a DT to provide comprehensive operational insights, allowing stakeholders to visualize, simulate, and optimize checkpoint configurations with unprecedented speed and contextual awareness. TACCRAB's key innovation lies in its ability to combine multiple complex inputs - including technology detection probabilities, resource availability, screening pathway characteristics, and threat actor behavioral patterns - into a unified risk calculation and update these inputs based on changing operational and environmental conditions. By leveraging a DT that continuously updates and learns from linked data, TACCRAB can suggest adaptive mitigation strategies that minimize risk while maintaining operational efficiency. Particularly novel is the platform's approach to decision support, which goes beyond static risk assessment. The DT provides dynamic metrics such as wait times, resource allocation effectiveness, and potential emerging threat scenarios, enabling users to view sophisticated, relevant what-if simulations and optimize checkpoint operations in near real-time. The system's architecture allows for generalized application across different screening environments, such as secure facilities, ports of entry, and soft targets, making it a versatile tool for security and operational management. The invention distinguishes itself through its comprehensive integration of predictive modeling, AI-driven pattern discovery, and user-friendly interface design. By combining these elements, TACCRAB transforms complex risk data into actionable insights, supporting decision-makers at various organizational levels - from booth agents making split-second screening decisions to checkpoint managers optimizing the day's resource allocation to strategic planners managing long-term investments.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF

Analog VLSI neural network integrated circuits

Two analog very large scale integration (VLSI) vector matrix multiplier integrated circuit chips were designed, fabricated, and partially tested. They can perform both vector-matrix and matrix-matrix multiplication operations at high speeds. The 32 by 32 vector-matrix multiplier chip and the 128 by 64 vector-matrix multiplier chip were designed to perform 300 million and 3 billion multiplications per second, respectively. An additional circuit that has been developed is a continuous-time adaptive learning circuit. The performance achieved thus far for this circuit is an adaptivity of 28 dB at 300 KHz and 11 dB at 15 MHz. This circuit has demonstrated greater than two orders of magnitude higher frequency of operation than any previous adaptive learning circuit.

Kub, F. J.

NASA's Space Launch System: A Flagship for Exploration Beyond Earth's Orbit

The National Aeronautics and Space Administration s (NASA) Space Launch System (SLS) Program, managed at the Marshall Space Flight Center, is making progress toward delivering a new capability for exploration beyond Earth orbit in an austere economic climate. This fact drives the SLS team to find innovative solutions to the challenges of designing, developing, fielding, and operating the largest rocket in history. To arrive at the current SLS plan, government and industry experts carefully analyzed hundreds of architecture options and arrived at the one clear solution to stringent requirements for safety, affordability, and sustainability over the decades that the rocket will be in operation. This paper will explore ways to fit this major development within the funding guidelines by using existing engine assets and hardware now in testing to meet a first launch by 2017. It will explain the SLS Program s long-range plan to keep the budget within bounds, yet evolve the 70 metric ton (t) initial lift capability to 130-t lift capability after the first two flights. To achieve the evolved configuration, advanced technologies must offer appropriate return on investment to be selected through a competitive process. For context, the SLS will be larger than the Saturn V that took 12 men on 6 trips for a total of 11 days on the lunar surface over 4 decades ago. Astronauts train for long-duration voyages on the International Space Station, but have not had transportation to go beyond Earth orbit in modern times, until now. NASA is refining its mission manifest, guided by U.S. Space Policy and the Global Exploration Roadmap. Launching the Orion Multi-Purpose Cargo Vehicle s first autonomous certification flight in 2017, followed by a crewed flight in 2021, the SLS will offer a robust way to transport international crews and the air, water, food, and equipment they need for extended trips to asteroids, Lagrange Points, and Mars. In addition, the SLS will accommodate high-priority science experiments. SLS affordability initiatives include streamlining interfaces, applying risk-based insight into contracted work, centralizing systems engineering and integration, and nurturing a learning culture that continually benchmarks its performance against successful ventures. As this paper will explain, the SLS is making measurable progress toward becoming a global infrastructure asset for robotic and human scouts of all nations by harnessing business and technological innovations to deliver sustainable solutions for space exploration.

May, Todd

NASA's Space Launch System: A Flagship for Exploration Beyond Earth's Orbit

The National Aeronautics and Space Administration's (NASA) Space Launch System (SLS) Program, managed at the Marshall Space Flight Center, is making progress toward delivering a new capability for exploration beyond Earth orbit in an austere economic climate. This fact drives the SLS team to find innovative solutions to the challenges of designing, developing, fielding, and operating the largest rocket in history. To arrive at the current SLS plan, government and industry experts carefully analyzed hundreds of architecture options and arrived at the one clear solution to stringent requirements for safety, affordability, and sustainability over the decades that the rocket will be in operation. This paper will explore ways to fit this major development within the funding guidelines by using existing engine assets and hardware now in testing to meet a first launch by 2017. It will explain the SLS Program s long-range plan to keep the budget within bounds, yet evolve the 70 metric ton (t) initial lift capability to 130-t lift capability after the first two flights. To achieve the evolved configuration, advanced technologies must offer appropriate return on investment to be selected through a competitive process. For context, the SLS will be larger than the Saturn V that took 12 men on 6 trips for a total of 11 days on the lunar surface over 4 decades ago. Astronauts train for long-duration voyages on the International Space Station, but have not had transportation to go beyond Earth orbit in modern times, until now. NASA is refining its mission manifest, guided by U.S. Space Policy and the Global Exploration Roadmap. Launching the Orion Multi-Purpose Crew Vehicle s (MPCV s) first autonomous certification flight in 2017, followed by a crewed flight in 2021, the SLS will offer a robust way to transport international crews and the air, water, food, and equipment they need for extended trips to asteroids, Lagrange Points, and Mars. In addition, the SLS will accommodate high-priority science experiments. SLS affordability initiatives include streamlining interfaces, applying risk-based insight into contracted work, centralizing systems engineering and integration, and nurturing a learning culture that continually benchmarks its performance against successful ventures. As this paper will explain, the SLS is making measurable progress toward becoming a global infrastructure asset for robotic and human scouts of all nations by harnessing business and technological innovations to deliver sustainable solutions for space exploration.

May, Todd A.

Autonomous Spacecraft Attitude Control Using Deep Reinforcement Learning

While machine learning and spacecraft autonomy continue to gain research interest, significant work remains to be done in efficiently applying modern machine learning techniques to problems in space ight. This study presents a framework for deriving a discrete neural spacecraft attitude controller using reinforcement learning, a paradigm of machine learning, without the need for high-performance computing. The developed attitude controller is an approximately time-optimal solution to a highly constrained control problem, able to achieve well above industry-standard pointing accuracies. Control examples are also presented of the agent performing large-angle spacecraft slews in the developed simulation environment and future extensions of this work are discussed.

ATAP

Workshop on Discovery Lessons-Learned

As part of the Discovery Program's continuous improvement effort, a Discovery Program Lessons-Learned workshop was designed to review how well the Discovery Program is moving toward its goal of providing low-cost research opportunities to the planetary science community while ensuring continued U.S. leadership in solar system exploration. The principal focus of the workshop was on the recently completed Announcement of Opportunity (AO) cycle, but the program direction and program management were also open to comment. The objective of the workshop was to identify both the strengths and weaknesses of the process up to this point, with the goal of improving the process for the next AO cycle. The process for initializing the workshop was to solicit comments from the communities involved in the program and to use the feedback as the basis for establishing the workshop agenda. The following four sessions were developed after reviewing and synthesizing both the formal feedback received and informal feedback obtained during discussions with various participants: (1) Science and Return on Investment; (2) Technology vs. Risk; Mission Success and Other Factors; (3) Cost; and (4) AO.AO Process Changes and Program Management.

Saunders, M.

Controlling optical-cavity locking using reinforcement learning

Abstract This study applies an effective methodology based on Reinforcement Learning to a control system. Using the Pound–Drever–Hall locking scheme, we match the wavelength of a controlled laser to the length of a Fabry-Pérot cavity such that the cavity length is an exact integer multiple of the laser wavelength. Typically, long-term drift of the cavity length and laser wavelength exceeds the dynamic range of this control if only the laser’s piezoelectric transducer is actuated, so the same error signal also controls the temperature of the laser crystal. In this work, we instead implement this feedback control grounded on Q-Learning. Our system learns in real-time, eschewing reliance on historical data, and exhibits adaptability to system variations post-training. This adaptive quality ensures continuous updates to the learning agent. This innovative approach maintains lock for eight days on average.

47 OTHER INSTRUMENTATION

Uncertainty based Online Ensemble on Non-Stationary Data for Fusion Science

Machine Learning (ML) is poised to play a pivotal role in the development and operation of next-generation fusion devices. Fusion data shows non-stationary behavior due to drifts in the data. The drifts can arise from both experimental evolution and machine wear-and-tear. ML models assume stationary distribution and fail to maintain performance when encountered with non-stationary data streams.Online learning can be used to continuously adapt the models with new data as it is acquired. However, traditional online learning can suffer from short-term performance degradation, as ground truth are not available before making the prediction. To address this challenge, we propose uncertainty aware ensemble approach for online learning. We use Deep Gaussian Process Approximation (DGPA) technique for calibrated uncertainty estimation and use the uncertainty values to guide a meta-algorithm that produces predictions based on ensemble of learners. Moreover, DGPA also provides uncertainty estimation along with the predictions for decision makers. This paper demonstrates that the proposed method outperforms traditional online learning approach, and a naive ensemble without uncertainty guidance by about 7% and 6%, respectively, on B-coil deflection prediction at DIII-D Fusion Facility.

Rajput, Kishansingh [Thomas Jefferson National Acc

Uncertainty based Online Ensemble on Non-Stationary Data for Fusion Science

Machine Learning (ML) is poised to play a pivotal role in the development and operation of next-generation fusion devices. Fusion data shows non-stationary behavior due to drifts in the data. The drifts can arise from both experimental evolution and machine wear-and-tear. ML models assume stationary distribution and fail to maintain performance when encountered with non-stationary data streams.Online learning can be used to continuously adapt the models with new data as it is acquired. However, traditional online learning can suffer from short-term performance degradation, as ground truth are not available before making the prediction. To address this challenge, we propose uncertainty aware ensemble approach for online learning. We use Deep Gaussian Process Approximation (DGPA) technique for calibrated uncertainty estimation and use the uncertainty values to guide a meta-algorithm that produces predictions based on ensemble of learners. Moreover, DGPA also provides uncertainty estimation along with the predictions for decision makers. This paper demonstrates that the proposed method outperforms traditional online learning approach, and a naive ensemble without uncertainty guidance by about 7% and 6%, respectively, on B-coil deflection prediction at DIII-D Fusion Facility.

Rajput, Kishansingh [Thomas Jefferson National Acc

Towards a Robust Adaptive Digital Twin for Fusion Applications

The development of a digital twin system for fusion applications is essential for enhancing the prediction, analysis, and optimization of complex plasma processes. Machine learning (ML), particularly deep learning has demonstrated strong capabilities in modeling such highly nonlinear and intricate systems. However, two critical challenges limit the deployment of deep learning-based digital twins: Uncertainty Quantification (UQ) and data drift. UQ is vital for ensuring trustworthy predictions, especially in decision-support scenarios. Additionally, data-driven models are often sensitive to changes in the underlying data distribution, such as shot-to-shot variations in fusion experiments, which can lead to performance degradation over time. To address these challenges, we are developing an uncertainty-aware, adaptive digital twin framework. Our approach incorporates deep learning models enhanced with Gaussian Process approximations for predictive uncertainty estimation, coupled with an online learning mechanism that enables continuous model adaptation to new experimental data. This adaptive capability allows the data driven models to respond effectively to evolving plasma behaviors and equipment conditions. Specifically, to mitigate the effects of shot-to-shot drift, our system updates itself incrementally as new data becomes available, improving both robustness and fidelity. Our vision is to evolve this data driven model into a self-sustaining digital twin system that leverages UQ based feedback to continuously refine itself and potentially support real-time decision making. This presentation will cover a brief background on uncertainty quantification for ML, our ongoing effort on development of UQ capabilities for ML, our data science pipeline from data collection to model development and analysis and online learning framework for modeling coil deflection at DIII-D. I will also briefly touch upon opportunities and challenges in development of digital twin framework.

Sammuli, Brian [General Atomics]

The least constraint principle for learning in neurodynamics

An adaptive neural network for auto-associative memories operating in continuous time is considered. A new learning algorithm for the weight matrix defined by explicit locations of desirable equilibrium points is introduced. The approach is based upon the minimum 'strength energy' of the weight matrix for each prescribed performance of the neural network.

Zak, Michail