Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Continual learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 433 records · Page 24

Deep Learning for Fish Identification from Sonar Data: CRADA 481 [Abstract only]

To help solve the challenges of hydropower energy production related to the potential for eel injury and mortality from passage through hydropower turbines, we will develop a deep learning method for identifying migrating eels from imaging sonar. This project continues with a prior project conducted by the Pacific Northwest National Laboratory (PNNL) and the Electric Power Research Institute (EPRI) in FY2018-2019. The proposed method employs Convolution Neural Network (CNN), a powerful deep learning method for image classification, to distinguish between images of eels and non-eel moving objects. We propose to collect more laboratory data and add more existing field data to train a powerful deep learning model. In addition to eels and sticks as classified in previous studies, we will add images containing several non-eel fish species and macrophyte mats to the training data. A multi-class classification model will be developed to distinguish these objects. Object detection algorithm will be explored and developed to locate and identify multiple objects in each sonar frame. Motion analysis will be performed to track the movement of objects in sonar video clips. We will also improve the data conversion algorithm so that it can read in both DIDSON and ARIS (both are imaging sonars developed by Sound Metrics Corp) data files and convert them to images with comparably high resolution, regardless of the varying detection ranges in different environments. The developed algorithms will be packaged as a software with a graphic user interface. The software will be evaluated by external collaborators in the field. The developed framework can be generalized for automatic monitoring of fish passage and migration using other imaging sonars like ARIS and will benefit the design and operation of ecologically friendly hydroelectric projects. The developed wavelet and CNN model configuration parameters can potentially be transferred to lamprey detection in similar riverine environments.

13 HYDRO ENERGY↗

Recent developments in learning control and system identification for robots and structures

This paper reviews recent results in learning control and learning system identification, with particular emphasis on discrete-time formulation, and their relation to adaptive theory. Related continuous-time results are also discussed. Among the topics presented are proportional, derivative, and integral learning controllers, time-domain formulation of discrete learning algorithms. Newly developed techniques are described including the concept of the repetition domain, and the repetition domain formulation of learning control by linear feedback, model reference learning control, indirect learning control with parameter estimation, as well as related basic concepts, recursive and non-recursive methods for learning identification.

Phan, M.↗

The SEMATECH Berkeley microfield exposure tool: learning a the 22-nm node and beyond

Microfield exposure tools (METs) continue to playa dominant role in the development of extreme ultraviolet (EUV) resists. One of these tools is the SEMATECH Berkeley 0.3-NA MET operating as a SEMATECH resist and mask test center. Here we present an update summarizing the latest resist test and characterization results. The relatively small numerical aperture and limited illumination settings expected from 1st generation EUV production tools make resist resolution a critical issue even at the 32-nm node. In this presentation, sub 22 nm half pitch imaging results of EUV resists are reported. We also present contact hole printing at the 30-nm level. Although resist development has progressed relatively well in the areas of resolution and sensitivity, line-edge-roughness (LER) remains a significant concern. Here we present a summary of recent LER performance results and consider the effect of system-level contributors to the LER observed from the SEMA TECH Berkeley microfield tool.

36 MATERIALS SCIENCE↗

Lessons Learned and Technical Standards: A Logical Marriage

A comprehensive database of lessons learned that corresponds with relevant technical standards would be a boon to technical personnel and standards developers. The authors discuss the emergence of one such database within NASA, and show how and why the incorporation of lessons learned into technical standards databases can be an indispensable tool for government and industry. Passed down from parent to child, teacher to pupil, and from senior to junior employees, lessons learned have been the basis for our accomplishments throughout the ages. Government and industry, too, have long recognized the need to systematically document And utilize the knowledge gained from past experiences in order to avoid the repetition of failures and mishaps. The use of lessons learned is a principle component of any organizational culture committed to continuous improvement. They have formed the foundation for discoveries, inventions, improvements, textbooks, and technical standards. Technical standards are a very logical way to communicate these lessons. Using the time-honored tradition of passing on lessons learned while utilizing the newest in information technology, the National Aeronautics and Space Administration (NASA) has launched an intensive effort to link lessons learned with specific technical standards through various Internet databases. This article will discuss the importance of lessons learned to engineers, the difficulty in finding relevant lessons learned while engaged in an engineering project, and the new NASA project that can help alleviate this difficulty. The article will conclude with recommendations for more expanded cross-sectoral uses of lessons learned with reference to technical standards.

Gill, Paul↗

Deep learning symmetries and their Lie groups, algebras, and subalgebras from first principles

Abstract We design a deep-learning algorithm for the discovery and identification of the continuous group of symmetries present in a labeled dataset. We use fully connected neural networks to model the symmetry transformations and the corresponding generators. The constructed loss functions ensure that the applied transformations are symmetries and the corresponding set of generators forms a closed (sub)algebra. Our procedure is validated with several examples illustrating different types of conserved quantities preserved by symmetry. In the process of deriving the full set of symmetries, we analyze the complete subgroup structure of the rotation groups SO (2), SO (3), and SO (4), and of the Lorentz group S O ( 1 , 3 ) . Other examples include squeeze mapping, piecewise discontinuous labels, and SO (10), demonstrating that our method is completely general, with many possible applications in physics and data science. Our study also opens the door for using a machine learning approach in the mathematical study of Lie groups and their properties.

97 MATHEMATICS AND COMPUTING↗

Cohort-based learning for microbiome research community standards

Microbiome data standards are key to enabling data reuse, yet awareness and community adoption continue to be significant barriers to their broad implementation. The National Microbiome Data Collaborative launched an Ambassador Program based around a community learning model to broaden foundational knowledge and technical skills regarding microbiome metadata standards and best practices in data stewardship.

59 BASIC BIOLOGICAL SCIENCES↗

Space Station Freedom Gateway to the Future

The first inhabited outpost on the frontier of space will be a place to live, work, and discover. Experiments conducted on Freedom will advance scientific knowledge about our world, our environment, and ourselves. We will learn how to adapt to the space environment and to build and operate new spacecraft with destinations far beyond Earth, continuing the tradition of exploration that began with a journey to the Moon. What we learn from living and working on Freedom will strengthen our expertise in science and engineering, promote national research and development initiatives and inspire another generation of Americans to push forward and onward. On the eve of the 21st century, Space Station Freedom will be our gateway to the future. This material covers gateways to space, research, discovery, utilization, benefits, and NASA.

Source record↗

International Conference on the Cell and Molecular Biology of Chlamydomonas

The 2010 Conference on the Cell and Molecular Biology of Chlamydomonas was held June 6-10 near Boston, MA, and attracted a record 273 participants, 146 from US labs, 10 from Canada, and the remainder from 18 other countries. The single-celled algal protist Chlamydomonas is a key research organism for many investigators, including those who study photosynthesis, cell motility, adaptation to environmental stresses, the evolution of multicellularity, and the production of biofuels. Chlamydomonas researchers gather every two years at a research conference to exchange methods, develop collaborative efforts, disseminate recent findings, and plan large-scale studies to improve the usefulness of this unique research organism. This conference provides the only opportunity for Chlamydomonas scientists who work on different research problems to meet face to face, and greatly speeds progress in their respective fields. An important function of these Chlamydomonas conferences is to promote and showcase the work of younger scientists, and to attract new investigators into the Chlamydomonas community. DOE award SC0004085 was used to offset the travel and registration costs for 18 young investigators, 9 of whom were women, including one African American. Most of these scientists would not have been able to attend the conference without DOE support. A total of 208 research presentations were made at the meeting, 80 talks (63 presented by students, postdocs, and pre-tenured faculty) and 128 posters. Cell motility and biofuels/metabolism were the best-represented research areas, with a total of 77 presentations. This fact underscores the growing importance of Chlamydomonas as a research and production tool in the rapidly expanding world of biofuels research. A total of 28 talks and posters were presented on the topics of photosynthesis and stress responses, which were among the next best-represented research areas. As at several recent Chlamydomonas meetings, important advances were reported in the area of tool development, advances that conference attendees should be able to employ in their own labs to speed the analysis of gene function. In summary, support from DOE award SC0004085 helped to make the 2010 Conference on the Cell and Molecular Biology of Chlamydomonas an unqualified success. Thanks to that support it was possible to attract a new cohort of young investigators to this biennial conference. These young scientists benefited from the opportunity to present their results to, and to interact with, the international Chlamydomonas research community. The Chlamydomonas community benefited by learning about the advances reported by these scientists, and it will continue to benefit from the contributions these investigators will make as their training and careers progress.

09 BIOMASS FUELS↗

Johnson Space Center's Free Range Bicycle Program.- Fall 2015 Intern Report

NASA's Johnson Space Center is a big place, encompassing 1,620 acres and more than a hundred buildings. Furthermore, there are reportedly 15 thousand employees, all of which have somewhere to be. To facilitate the movement of all these people JSC has historically relied on human power. Pedaling their way towards deep space, bicycles have been the go to method. Currently there are about 200 Free Range Bicycles at JSC. Free Range Bicycles belong to nobody, except NASA, and are available for anybody to use. They are not to be locked or hidden (although frequently are) and the intention is that there will always be a bike to hop on to get where you're going (although it may not be the bike you rode in on). Although not without its own shortcomings, the Free Range Bicycle Program has continued to provide low cost, simple transportation for NASA's JSC. In addition to the approximately 200 Free Range Bicycles, various larger divisions (like engineering) will often buy a few dozen bikes for their team members to use or individuals will bring their own personal bike to either commute or use on site. When these bicycles fall into disrepair or are abandoned (from retirees etc) they become a problem at JSC. They are an eye sore, create a safety hazard and make it harder to find a working bike in a time of need. The Free Range Program hopes to address this first problem by "tagging out" abandoned or out of service bicycles. A bright orange "DO NOT OPERATE" tag is placed on the bike and given a serial number for tracking purposes. See picture to the right. If the bike has an active owner with intentions to repair the bike the bottom of the tag has instructions for how to claim the abandoned bicycle. After being tagged the owner of the bicycle has 30 days to claim the bicycle and either haul it off site or get it repaired (and labeled) in accordance with Johnson's Bicycle Policy. If the abandoned bicycle is not claimed within 30 days it becomes the property of the Government. The bicycle is then (in short) repaired, labeled, documented and converted to a free range bicycle. Bikes beyond repair are cannibalized of useable parts and then scrapped. That was nearly the first thing I did when arriving at work. After getting settled in and coordinating the purchase of 50 new bicycles (elaboration below); I started combing the Center. Bikes are hidden and tucked away in the oddest of places and it was my priority to root all of them out. I tagged 70 bikes on the center, setting a record. I tagged so many bikes I ran out tags and had to make more. Long ago it was discovered that the same harsh elements that wreak havoc on the bikes, destroy the tags before the 30 day timeframe. The tags are labeled with instructions on how to claim the bike and numbered, then these paper labels are laminated with packing tape. It sounds like a simple process but nothing fits right, everything has to be trimmed, put on straight and is generally a pain in the neck. So I made an assembly process and knocked out a few hundred to save having to do it again for a while. I walked the center and tagged bikes at every building hiding in nearly every nook and cranny. Thus, in conclusion, I've done many things here at JSC on my first term and had a blast doing it. I've learned a lot from my multi-faceted roles and continual challenges. In short I've done my best to get folks at JSC on bikes and keep folks at JSC on bikes and tended a flock of free range bicycles. Everything from turning the rusty bolts and oiling chains to coordinating a $20,000 deal on 50 new free range bicycles. I am proud of the bicycle shop I have built and am infinitely grateful to the people who lead, help, guide and support me. I have fixed a great number of bicycles and cleaned the center of unsightly and unsafe piles of bicycles. I am immensely thankful for this opportunity to learn and serve and appreciate the privilege of coming back for a second term. A second term, in which I will continue to develop this awesome program.

Lee-Stockton, Willem↗

CyberGAN: Generating High-fidelity Cybersecurity Data With Generative Adversarial Networks

Machine learning for cyber defense offers the promise of detecting adversarial activity against the ground data systems managing critical space assets. A fundamental challenge facing machine learning research in cybersecurity is the lack of high-fidelity, shareable datasets for robust evaluation and testing of machine learning-based solutions. High-fidelity, real-world datasets are necessary for reliable benchmarking of nominal system behavior and malicious activity. Unfortunately, such realistic datasets of both nominal and adversarial activity are rarely shared publicly by data owners due to security and privacy concerns. Besides, the available adversarial data is sparse, which makes training models on malicious activity much harder. This situation has impeded and continues to impede the research and successful adoption of machine learning methods for cyber defense. Researchers have dealt with this problem by generating data within a low-fidelity lab environment, using classified and thus unshareable datasets, or downloading low-fidelity public datasets made available by others. We propose an innovative solution to the problem by employing machine learning methods to generate high-fidelity data. Specifically, we propose the use of Generative Adversarial Networks (GANs) to generate high-fidelity data for cybersecurity purposes. GANs have found successful image processing and natural language applications, but have not yet been investigated for cyber data generation. Our proposed approach first involves training the `discriminator' network of the GAN with a sample of real-world data consisting of malicious and nominal samples. We then use the `generator' network to generate new high-fidelity data samples consisting of an appropriate mix of malicious and nominal activity. We demonstrate applications of our architecture by generating high-fidelity cybersecurity data containing both malicious and nominal samples. We thoroughly evaluate the fidelity of our generated data using heuristics and evaluate its usefulness for machine learning applications using three different datasets. Overall, our approach results in high-fidelity, shareable datasets.

Zhang, Yuening↗

Prediction of Distributed River Sediment Respiration Rates Using Community-Generated Data and Machine Learning

River sediment microbial respiration is a key indicator of ecosystem functioning and the biogeochemical fluxes across this critical zone link surface and subsurface waters. As such, there is tremendous interest in measuring and mapping these respiration rates. Respiration observations are expensive and labor intensive; there is limited data available to the community. An open science, collaborative initiative is collecting samples for respiration rate analysis and multi-scale metadata; this evolving data set is being used for making machine learning (ML) predictions at unsampled sites to help inform continued community engagement. However, it is a challenge to find an optimum configuration for ML models to work with this feature-rich (i.e., 100+ possible input variables) data set. Here, we present results from a two-tiered approach to managing the analysis of this complex data set: (a) a stacked ensemble of models that automatically optimizes hyperparameters and manages the training of many models and (b) feature permutation importance to detect the most important features in the models. The major elements of this workflow are modular, portable, open, and cloud-based thus making this implementation a potential template for other applications. The models developed here predict that sediment organic matter chemistry is one of the most important features for predicting sediment respiration rate. Other larger-scale, important features fall into the categories of climatic, ecological, geological, and fluvial settings. Leveraging these larger-scale features to generate data-driven estimates of river sediment respiration rates reveals spatially consistent but heterogeneous patterns across the river network of the Columbia River Basin.

54 ENVIRONMENTAL SCIENCES↗

Reinforcement Learning of Structured Stabilizing Control for Linear Systems With Unknown State Matrix

This paper delves into designing feedback control gains for a continuous-time linear quadratic regulator (LQR) problem that is constrained to certain predefined structure with unknown state matrix. We bring forth the ideas from reinforcement learning (RL) in conjunction with sufficient stability and performance guarantees in order to design these structured gains using the trajectory measurements of states and controls. Here we first formulate a model-based framework using dynamic programming (DP) to embed the structural constraint to the LQR gain computation in the continuous-time setting, and then subsequently, formulate a policy iteration RL algorithm that can alleviate the requirement of known state matrix in conjunction with maintaining the feedback gain structure. The design enables a distributed learning control design which is necessary for many large-scale cyber-physical systems. Theoretical guarantees are provided for stability and convergence of the structured reinforcement learning (SRL) algorithm. We validate our theoretical results with numerical simulations on a multi-agent networked linear time-invariant (LTI) dynamic system.

42 ENGINEERING↗

Sensor Characteristics Reference Guide

The Buildings Technologies Office (BTO), within the U.S. Department of Energy (DOE), Office of Energy Efficiency and Renewable Energy (EERE), is initiating a new program in Sensor and Controls. The vision of this program is: • Buildings operating automatically and continuously at peak energy efficiency over their lifetimes and interoperating effectively with the electric power grid. • Buildings that are self-configuring, self-commissioning, self-learning, self-diagnosing, self-healing, and self-transacting to enable continuous peak performance. • Lower overall building operating costs and higher asset valuation. The overarching goal is to capture 30% energy savings by enhanced management of energy consuming assets and systems through development of cost-effective sensors and controls. One step in achieving this vision is the publication of this Sensor Characteristics Reference Guide. The purpose of the guide is to inform building owners and operators of the current status, capabilities, and limitations of sensor technologies. It is hoped that this guide will aid in the design and procurement process and result in successful implementation of building sensor and control systems. DOE will also use this guide to identify research priorities, develop future specifications for potential market adoption, and provide market clarity through unbiased information.

Cree, Johnathan V.↗

Lessons Learned from Safety Events

The Hydrogen Incident Reporting and Lessons Learned website (www.h2incidents.org) was launched in 2006 as a database-driven resource for sharing lessons learned from hydrogen-related safety events to raise safety awareness and encourage knowledge-sharing. The development of this database, its first uses and subsequent enhancements have been described at the Second and Third International Conferences on Hydrogen Safety. [1,2] Since 2009, continuing work has not only highlighted the value of safety lessons learned, but enhanced how the database provides access to another safety knowledge tool, Hydrogen Safety Best Practices (http://h2bestpractices.org). Collaborations with the International Energy Agency (IEA) Hydrogen Implementing Agreement (HIA) Task 19 – Hydrogen Safety and others have enabled the database to capture safety event learnings from around the world. This paper updates recent progress, highlights the new “Lessons Learned Corner” as one means for knowledge-sharing and examines the broader potential for collecting, analyzing and using safety event information.

Hydrogen↗

Learning from Past Missions for Today’s Case Studies

As interest in small spacecraft and its community continue to grow, the extensive selection of subsystem parts and service providers can present as many opportunities as unique challenges for mission design and implementation. These challenges often include inadequate trade studies, missing lessons learned, and unknown solutions to common pitfalls. Trade studies frequently fall short if products and services ultimately do not meet customer expectations, especially if the actual performance of a particular service or technology is not shared with others seeking similar products or services. It is difficult to quantify the viability and robustness of desired products and services, truly understand what solutions exist, and account for unique failures from previous SmallSat missions when experiences are not shared and captured. This noted, one reason for the lack of information as input for trade studies is that it is problematic to capture and disseminate the relevant lessons learned, experienced anomalies, and programmatic issues in both the laboratory and on-orbit setting, as these types of information can be extremely sensitive and are specific to each unique mission. Often, they are not made publicly available. The adoption and use of existing tools and databases, as well as contributions toward and sharing of information available in literature can help distribute useful information for future SmallSat missions to help avoid these common pitfalls. This paper will provide the required framework for current and future SmallSat mission implementation by providing best practices and identifying helpful resources to assist with subsystem parts and services as part of trade study selections.

Bruce Yost↗

Toward Drilling the Perfect Geothermal Well: An International Research Coordination Network for Geothermal Drilling Optimization Supported by Deep Machine Learning and Cloud Based Data Aggregation

The EDGE project, supported by the U.S. Department of Energy Geothermal Technologies Office under award DE-EE0008793, established a data-driven framework for improving the efficiency, cost-effectiveness, and reliability of geothermal well drilling. The project focused on developing scalable data infrastructure, advanced machine learning and probabilistic models, and integrated analytics tools to support continuous drilling optimization. A central objective was to reduce geothermal drilling costs by up to seventy percent while minimizing the risk of well failure through predictive diagnostics and adaptive planning. Over the project period, a comprehensive data repository was designed and deployed, incorporating records from over one hundred geothermal wells across varied geological settings. This repository supported both structured and unstructured data and adhered to FAIR data principles, enabling provenance tracking, quality control, and standardized metadata. The project introduced automated ingestion pipelines and a cloud-hosted platform that facilitated access to raw, processed, and derived datasets. This infrastructure served as the foundation for model development and analysis. Machine learning workflows were developed to predict key drilling metrics including rate of penetration, non-productive time, and total drilling costs. Self-organizing maps and dimensionality reduction methods were used to uncover operational patterns and outliers, while supervised learning algorithms such as random forests and deep neural networks were applied to forecast performance outcomes. The models were validated on heterogeneous datasets from both U.S. and Icelandic fields, demonstrating variable but significant predictive accuracy. The results indicated that finer temporal resolution, inclusion of lithological data, and consistency in operational annotations could substantially improve model performance. The project also implemented process mining techniques to reconstruct state-transition models from drilling event logs. These models enabled the identification of deviations from optimal workflows and provided insights into recurring failure modes. Analysis of non-productive time highlighted the impact of equipment failures, geological challenges, and human factors, offering opportunities for targeted mitigation strategies. The EDGE Dashboard was developed as a web-based expert system integrating data visualization, model outputs, and user-driven queries. It provided an accessible interface for operators to explore historical data, evaluate predicted outcomes, and compare drilling scenarios. Initial feedback from project partners suggested that the dashboard could serve as a foundation for more advanced advisory and optimization tools. Overall, the EDGE project demonstrated the feasibility and value of applying modern data science techniques to geothermal drilling. It delivered a set of interoperable tools and models that can support more efficient, lower-risk well development. The findings point toward a viable path for transitioning from advisory analytics to semi-autonomous drilling systems, contingent on continued collaboration, expanded datasets, and field validation. The project results have immediate relevance for drilling operations, data management practices, and future geothermal R&D efforts aimed at achieving reliable, cost-competitive geothermal energy at scale.

15 GEOTHERMAL ENERGY↗

DuraMAT Technology Scouting Report: Assessing Module Reliability Risks Associated with Projected Technological Changes

Maintaining the reliability of photovoltaic (PV) modules in the face of rapidly changing technology is critical to maximizing solar energy's contribution to global decarbonization. Our presentation describes expected changes in PV technology and their impacts on performance and reliability. We leverage PV market reports, interviews with PV researchers and other industry stakeholders, and peer-reviewed literature to narrow the multitude of possible changes into a manageable set of 11 impactful trends likely to be incorporated in near-term crystalline-silicon module designs. We group the trends into four categories (module architecture, interconnect technologies, bifacial modules, and cell technology) and explore the drivers behind the changes, their interactions, and associated reliability risks and benefits. Our analysis identifies specific areas that would benefit from accelerating the PV reliability learning cycle, to assess emerging module products and designs more accurately. We recommend that researchers continue tracking module technologies and their reliability implications so efforts can be focused on the most impactful trends. As the rapid technological turnover continues, it is also critical to incorporate fundamental knowledge into models that can predict module reliability. Predictive capabilities complete the PV reliability learning cycle-reducing the time required to assess new designs and mitigating the risks associated with large-scale deployment of new products.

bifacial↗

Earthquake catalog-based machine learning identification of laboratory fault states and the effects of magnitude of completeness

Here, machine learning regression can predict macroscopic fault properties such as shear stress, friction, and time to failure using continuous records of fault zone acoustic emissions. Here we show that a similar approach is successful using event catalogs derived from the continuous data. Our methods are applicable to catalogs of arbitrary scale and magnitude of completeness. We investigate how machine learning regression from an event catalog of laboratory earthquakes performs as a function of the catalog magnitude of completeness. We find that strong model performance requires a sufficiently low magnitude of completeness, and below this magnitude of completeness, model performance saturates.

58 GEOSCIENCES↗