Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Online Learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16

Hydrogen Safety Knowledge Tools

With hydrogen gaining acceptance as an energy carrier for fuel cell vehicles and stationary fuel cell applications, a new community of hydrogen users is emerging and continues to grow. With this growth has come the need to spread the word about safe practices for handling, storing, and using hydrogen. Like all energy forms, hydrogen can be used safely through proper procedures and engineering techniques. However, hydrogen involves a degree of risk that must be respected, and the importance of avoiding complacency or haste in the safe conduct and performance of projects involving hydrogen cannot be overstated. To encourage and promote the safe use of hydrogen, Pacific Northwest National Laboratory (PNNL) has developed and continues to enhance two software tools in support of the U.S. Department of Energy's Fuel Cell Technologies Program: the Hydrogen Safety Best Practices online manual (www.H2BestPractices.org) and the Hydrogen Incident Reporting and Lessons Learned database (www.H2Incidents.org).

08 HYDROGEN↗

Primal-Dual Differentiable Programming for Distribution System Critical Load Restoration: Preprint

Swift and reliable critical load restoration (CLR) can help make a distribution system resilient towards extreme events. To optimally achieve that, alongside practical concerns such as limiting online computational burden, some studies leverage model-free reinforcement learning (RL) to train control policies. Despite the advantages provided by RL algorithms, these approaches suffer from two issues: 1) the lack of a proper mechanism for constraint enforcement, and 2) poor sample efficiency. Therefore, in this paper, a primal-dual differentiable programming (PDDP) method is developed for guiding the training leading to a constraint-satisfying policy. Additionally, the model-based nature of the proposed method aims at improving sample efficiency. The experiment on a CLR problem demonstrates that PDDP can effectively train a control policy that both achieves desirable performance and satisfies required constraints.

differentiable programming↗

Scalable Graph Analytics and HPC Operational Enhancement: Parallel Computing and ML/DL Innovations

Parallel computing plays a pivotal role in the efficient processing of large-scale graphs. Complex network analysis stands as a capti- vating research frontier, holding promise across diverse scientific domains such as sociology, biology, online media, and recommenda- tion systems. In this era, Machine Learning (ML) and Deep Learning (DL) have emerged as indispensable tools, underpinning remarkable technological achievements. Within this dynamic landscape, my research revolves around advancing parallel algorithms tailored for large-scale graph operations. To achieve this, I harness the power of cutting-edge technologies including OpenMP, MPI, HIP, and CUDA, on the High-Performance Computing (HPC) platforms to unlock optimal performance. I also apply ML/DL techniques to HPC operational data, to streamline the monitoring and maintenance of supercomputers, alleviating the complexities associated with their upkeep and enhancing user support. My research echoes the syn- ergy between parallel computing, large-scale graph analysis, and ML/DL, improving computational efficiency and user experience.

Sattar, Naw Safrin↗

The Virginia Earth System Science Scholars (VESSS) Experience: Inspiring High School Students in Stem Through Mentorship and Collaborative Skills Development

Since 2016, the Virginia Earth System Science Scholars (VESSS) program offered by the Virginia Space Grant Consortium (VSGC) has provided an interactive science, technology, engineering, and mathematics learning experience for Virginia high school juniors and seniors. The VESSS program was created through a partnership with VSGC, NASA Langley Research Center (LaRC), and Hampton University to engage students in learning about Earth’s climate change and its global impacts. High school students from all areas of Virginia learn about Earth science and climate change in a 16 week online course focused on the Earth’s surface and interior, atmospheric composition, weather, water energy cycles, and climate variability. Students that complete the online course are invited to a no-cost seven-day residential summer academy at NASA LaRC where students are divided into teams based on four of the major spheres of study for Earth: atmosphere, biosphere, hydrosphere, and lithosphere. Each team is guided by a Master Teacher and teams of undergraduate student interns who were also previous VESSS scholars. Students interview for team positions and are given a role reflecting an actual satellite design team position such as project scientist, research scientist, budget analyst, launch and orbit analyst, contamination analyst, and education and public outreach specialist. The students spend a week mentored by NASA and industry scientists and engineers as they learn how to select science goals and objectives, select science instruments, balance a mission budget, determine the mission launch location and orbit, and communicate the importance of the mission to the public. Each team produces a mission proposal, and at the end of the week, each team presents their portion of the mission to a panel of experts, followed by a question and answer period. Through this week students learn teamwork, communication, time management, meeting management, and research skills. Project work is supplemented by team-building activities, NASA facility tours, and lectures by acclaimed guest speakers such as Dr. Christine Darden, a NASA “Hidden Figure.” Students have conveyed through course evaluations and testimonials not only the vast personal learning and growth they achieved, but also the new perspectives they gained on future STEM career fields and opportunities to explore.

Elaine Seasly↗

Online Support Vector Regression with Varying Parameters for Time-Dependent Data

Support vector regression (SVR) is a machine learning technique that continues to receive interest in several domains including manufacturing, engineering, and medicine. In order to extend its application to problems in which datasets arrive constantly and in which batch processing of the datasets is infeasible or expensive, an accurate online support vector regression (AOSVR) technique was proposed. The AOSVR technique efficiently updates a trained SVR function whenever a sample is added to or removed from the training set without retraining the entire training data. However, the AOSVR technique assumes that the new samples and the training samples are of the same characteristics; hence, the same value of SVR parameters is used for training and prediction. This assumption is not applicable to data samples that are inherently noisy and non-stationary such as sensor data. As a result, we propose Accurate On-line Support Vector Regression with Varying Parameters (AOSVR-VP) that uses varying SVR parameters rather than fixed SVR parameters, and hence accounts for the variability that may exist in the samples. To accomplish this objective, we also propose a generalized weight function to automatically update the weights of SVR parameters in on-line monitoring applications. The proposed function allows for lower and upper bounds for SVR parameters. We tested our proposed approach and compared results with the conventional AOSVR approach using two benchmark time series data and sensor data from nuclear power plant. The results show that using varying SVR parameters is more applicable to time dependent data.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Experiments on Supervised Learning Algorithms for Text Categorization

Modern information society is facing the challenge of handling massive volume of online documents, news, intelligence reports, and so on. How to use the information accurately and in a timely manner becomes a major concern in many areas. While the general information may also include images and voice, we focus on the categorization of text data in this paper. We provide a brief overview of the information processing flow for text categorization, and discuss two supervised learning algorithms, viz., support vector machines (SVM) and partial least squares (PLS), which have been successfully applied in other domains, e.g., fault diagnosis [9]. While SVM has been well explored for binary classification and was reported as an efficient algorithm for text categorization, PLS has not yet been applied to text categorization. Our experiments are conducted on three data sets: Reuter's- 21578 dataset about corporate mergers and data acquisitions (ACQ), WebKB and the 20-Newsgroups. Results show that the performance of PLS is comparable to SVM in text categorization. A major drawback of SVM for multi-class categorization is that it requires a voting scheme based on the results of pair-wise classification. PLS does not have this drawback and could be a better candidate for multi-class text categorization.

Namburu, Setu Madhavi↗

MO-E-18C-03: Incorporating Active Learning Into A Traditional Graduate Medical Physics Course

Purpose: To improve the ability of graduate students to learn medical physics concepts through the incorporation of active learning techniques. Methods: A traditional lecture-based radiological physics course was modified such that: (1) traditional (two-hour) lectures were provided online for students to watch prior to class, (2) a student was chosen randomly at the start of each class to give a two minute synopsis of the material and its relevance (two-minute drill), (3) lectures were significantly abbreviated and remaining classroom time used for group problem solving, and (4) videos of the abbreviated lectures were made available online for review. In the transition year, students were surveyed about the perceived effects of these changes on learning. Student performance was evaluated for 3 years prior to and 4 years after modification. Results: The survey tool used a five point scale from 1=Not True to 5=Very True. While nearly all students reviewed written materials prior to class (4.3±0.9), a minority watched the lectures (2.1±1.5). A larger number watched the abbreviated lectures for further clarification (3.6±1.6) and found it helpful in learning the content (4.2±1.0). Most felt that the two-minute drill helped them get more out of the lecture (3.9±0.8) and the problem solving contributed to their understanding of the content (4.1±0.8). However, no significant improvement in exam scores resulted from the modifications (mean scores well within 1 SD during study period). Conclusion: Students felt that active learning techniques improved their ability to learn the material in what is considered the most difficult course in the program. They valued the ability to review the abbreviated class lecture more than the opportunity to watch traditional lectures prior to class. While no significant changes in student performance were observed, aptitude variations across the student cohorts make it difficult to draw conclusions about the effectiveness of active learning.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

Global-Local Policy Search and its Application in Grid-Interactive Building Control

As the buildings sector represents over 70% of the total U.S. electricity consumption, it offers a great amount of untapped demand-side resources to tackle many critical grid-side problems and improve the overall energy system's efficiency. To help make buildings grid-interactive, this paper proposes a global-local policy search method to train a reinforcement learning (RL) based controller which optimizes building operation during both normal hours and demand response (DR) events. Experiments on a simulated five-zone commercial building demonstrate that by adding a local fine-tuning stage to the evolution strategy policy training process, the control costs can be further reduced by 7.55% in unseen testing scenarios. Baseline comparison also indicates that the learned RL controller outperforms a pragmatic linear model predictive controller (MPC), while not requiring intensive online computation.

demand response↗

HTESP (High-throughput electronic structure package): A package for high-throughput ab initio calculations

High-throughput ab initio calculations are the indispensable parts of data-driven discovery of new materials with desirable properties, as reflected in the establishment of several online material databases. The accumulation of extensive theoretical data through computations enables data-driven discovery by constructing machine learning and artificial intelligence models to predict novel compounds and forecast their properties. Efficient usage and extraction of data from these existing online material databases can accelerate the next stage materials discovery that targets different and more advanced properties, such as electron–phonon coupling for phonon-mediated superconductivity. However, extracting data from these databases, generating tailored input files for different ab initio calculations, performing such calculations, and analyzing new results can be demanding tasks. Here, in this work, we introduce a software package named “HTESP” (High-Throughput Electronic Structure Package) written in Python and Bash languages, which automates the entire workflow including data extraction, input file generation, calculation submission, result collection and plotting. Our HTESP will help speed up future computational materials discovery processes.

36 MATERIALS SCIENCE↗

Self-Taught Anomaly Detection With Hybrid Unsupervised/Supervised Machine Learning in Optical Networks

Here this paper proposes a self-taught anomaly detection framework for optical networks. The proposed framework makes use of a hybrid unsupervised and supervised machine learning scheme. First, it employs an unsupervised data clustering module (DCM) to analyze the patterns of monitoring data. The DCM enables a self-learning capability that eliminates the requirement of prior knowledge of abnormal network behaviors and therefore can potentially detect unforeseen anomalies. Second, we introduce a self-taught mechanism that transfers the patterns learned by the DCM to a supervised data regression and classification module (DRCM). The DRCM, whose complexity is mainly related to the scale of the applied supervised learning model, can potentially facilitate more scalable and time-efficient online anomaly detection by avoiding excessively traversing the original dataset. We designed the DCM and DRCM based on the density-based clustering algorithm and the deep neural network structure, respectively. Evaluations with experimental data from two use cases (i.e., single-point detection and end-to-end detection) demonstrate that up to 99% anomaly detection accuracy can be achieved with a false positive rate below 1%.

42 ENGINEERING↗

MO-E-BRC-00: Online Adaptive Radiotherapy - Considerations for Practical Clinical Implementation

Online adaptive radiation therapy has the potential to ensure delivery of optimal treatment to the patient by accounting for anatomical and potentially functional changes that occur from one fraction to the next and over the course of treatment. While on-line adaptive RT (ART) has been a topic of many publications, discussions, and research, it has until very recently remained largely a concept and not a practical implementation. However, recent advances in on-table imaging, use of deformable image registration for contour generation and dose tracking, faster and more efficient plan optimization, as well as fast quality assurance method has enabled the implementation of ART in the clinic in the past couple of years. The introduction of these tools into routine clinical use requires many considerations and progressive knowledge to understand how processes that have historically taken hours/days to complete can now be done in less than 30 minutes. This session will discuss considerations to perform real time contouring, planning and patient specific QA, as well as a practical workflow and the required resources. Learning Objectives: To understand the difficulties, challenges and available technologies for online adaptive RT. To understand how to implement online adaptive therapy in a clinical environment and to understand the workflow and resources required. To understand the limitations and sources of uncertainty in the online adaptive process I have research funding from ViewRay Inc. and Philips Medical Systems.; R. Kashani, I have research funding from ViewRay Inc. and Philips Medical Systems.; X. Li, Research supported by Elekta Inc.

60 APPLIED LIFE SCIENCES↗

MO-E-BRC-01: Online Adaptive MR-Guided RT: Workflow and Clinical Implementation

Online adaptive radiation therapy has the potential to ensure delivery of optimal treatment to the patient by accounting for anatomical and potentially functional changes that occur from one fraction to the next and over the course of treatment. While on-line adaptive RT (ART) has been a topic of many publications, discussions, and research, it has until very recently remained largely a concept and not a practical implementation. However, recent advances in on-table imaging, use of deformable image registration for contour generation and dose tracking, faster and more efficient plan optimization, as well as fast quality assurance method has enabled the implementation of ART in the clinic in the past couple of years. The introduction of these tools into routine clinical use requires many considerations and progressive knowledge to understand how processes that have historically taken hours/days to complete can now be done in less than 30 minutes. This session will discuss considerations to perform real time contouring, planning and patient specific QA, as well as a practical workflow and the required resources. Learning Objectives: To understand the difficulties, challenges and available technologies for online adaptive RT. To understand how to implement online adaptive therapy in a clinical environment and to understand the workflow and resources required. To understand the limitations and sources of uncertainty in the online adaptive process I have research funding from ViewRay Inc. and Philips Medical Systems.; R. Kashani, I have research funding from ViewRay Inc. and Philips Medical Systems.; X. Li, Research supported by Elekta Inc.

60 APPLIED LIFE SCIENCES↗

MO-E-BRC-02: MRI-Guided Online Adaptive Radiotherapy: The UCLA Approach to Quality Management

Online adaptive radiation therapy has the potential to ensure delivery of optimal treatment to the patient by accounting for anatomical and potentially functional changes that occur from one fraction to the next and over the course of treatment. While on-line adaptive RT (ART) has been a topic of many publications, discussions, and research, it has until very recently remained largely a concept and not a practical implementation. However, recent advances in on-table imaging, use of deformable image registration for contour generation and dose tracking, faster and more efficient plan optimization, as well as fast quality assurance method has enabled the implementation of ART in the clinic in the past couple of years. The introduction of these tools into routine clinical use requires many considerations and progressive knowledge to understand how processes that have historically taken hours/days to complete can now be done in less than 30 minutes. This session will discuss considerations to perform real time contouring, planning and patient specific QA, as well as a practical workflow and the required resources. Learning Objectives: To understand the difficulties, challenges and available technologies for online adaptive RT. To understand how to implement online adaptive therapy in a clinical environment and to understand the workflow and resources required. To understand the limitations and sources of uncertainty in the online adaptive process I have research funding from ViewRay Inc. and Philips Medical Systems.; R. Kashani, I have research funding from ViewRay Inc. and Philips Medical Systems.; X. Li, Research supported by Elekta Inc.

60 APPLIED LIFE SCIENCES↗

MO-E-BRC-03: Fast Online Replanning Techniques

Online adaptive radiation therapy has the potential to ensure delivery of optimal treatment to the patient by accounting for anatomical and potentially functional changes that occur from one fraction to the next and over the course of treatment. While on-line adaptive RT (ART) has been a topic of many publications, discussions, and research, it has until very recently remained largely a concept and not a practical implementation. However, recent advances in on-table imaging, use of deformable image registration for contour generation and dose tracking, faster and more efficient plan optimization, as well as fast quality assurance method has enabled the implementation of ART in the clinic in the past couple of years. The introduction of these tools into routine clinical use requires many considerations and progressive knowledge to understand how processes that have historically taken hours/days to complete can now be done in less than 30 minutes. This session will discuss considerations to perform real time contouring, planning and patient specific QA, as well as a practical workflow and the required resources. Learning Objectives: To understand the difficulties, challenges and available technologies for online adaptive RT. To understand how to implement online adaptive therapy in a clinical environment and to understand the workflow and resources required. To understand the limitations and sources of uncertainty in the online adaptive process I have research funding from ViewRay Inc. and Philips Medical Systems.; R. Kashani, I have research funding from ViewRay Inc. and Philips Medical Systems.; X. Li, Research supported by Elekta Inc.

60 APPLIED LIFE SCIENCES↗

Recovery Act: Training Program Development for Commercial Building Equipment Technicians (Final Scientific/Technical Report)

The overall goal of this project has been to develop curricula, certification requirements, and accreditation standards for training on energy efficient practices and technologies for commercial building technicians. These training products will advance industry expertise towards net-zero energy commercial building goals and will result in a substantial reduction in energy use. The ultimate objective is to develop a workforce that can bring existing commercial buildings up to their energy performance potential and ensure that new commercial buildings do not fall below their expected optimal level of performance. Commercial building equipment technicians participating in this training program will learn how to best operate commercial buildings to ensure they reach their expected energy performance level. The training is a combination of classroom, online and on-site lessons. The Texas Engineering Extension Service (TEEX) developed curricula using subject matter and adult learning experts to ensure the training meets certification requirements and accreditation standards for training these technicians. The training targets a specific climate zone to meets the needs, specialized expertise, and perspectives of the commercial building equipment technicians in that zone. The combination of efficient operations and advanced design will improve the internal built environment of a commercial building by increasing comfort and safety, while reducing energy use and environmental impact. Properly trained technicians will ensure equipment operates at design specifications. A second impact is a more highly trained workforce that is better equipped to obtain employment. Organizations that contributed to the development of the training program include TEEX and the Texas Engineering Experiment Station (TEES) (both members of The Texas A&M University System). TEES is also a member of the Building Commissioning Association. This report includes a description of the project accomplishments, including the course development phases, tasks associated with each phase, and detailed list of the course materials developed. A summary of each year's activities is also included.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Transitioning Sixty Years of NASA Spacesuit Knowledge Capture Lessons Learned to Searchable Knowledge Transfer Databases

Sixty years of spacesuit knowledge capture and lessons learned by spacesuit subject matter experts are documented on videos and presentations and archived with the NASA Engineering and Safety Center (NESC) Academy. The NESC Academy is a web-based platform that hosts online courses by technical experts. A process is underway to transition these decades of lessons learned from the U.S. Spacesuit Knowledge Capture Program Library into more quicky searchable databases and to proactively provide this information to those working on spacesuit projects. Hundreds of lessons learned from Project Mercury, Gemini, Apollo, Apollo- Soyuz Test Project, Skylab, Space Shuttle, International Space Station, and Artemis have been captured in a format that can be quickly searched, enabling users to find information directly applicable to their needs. Transitioning this information to a NASA wiki page will further enhance search and retrieval of data immediately useful to users. This paper provides information about how the lessons learned were determined and how to access them.

spacesuit↗

Transitioning Sixty Years of NASA Spacesuit Knowledge Capture Lessons Learned to Searchable Knowledge Transfer Databases

Sixty years of spacesuit knowledge capture and lessons learned by spacesuit subject matter experts are documented on videos and presentations and archived with the NASA Engineering and Safety Center (NESC) Academy. The NESC Academy is a web-based platform that hosts online courses by technical experts. A process is underway to transition these decades of lessons learned from the U.S. Spacesuit Knowledge Capture Program Library into more quicky searchable databases and to proactively provide this information to those working on spacesuit projects. Hundreds of lessons learned from Project Mercury, Gemini, Apollo, Apollo- Soyuz Test Project, Skylab, Space Shuttle, International Space Station, and Artemis have been captured in a format that can be quickly searched, enabling users to find information directly applicable to their needs. Transitioning this information to a NASA wiki page will further enhance search and retrieval of data immediately useful to users. This paper provides information about how the lessons learned were determined and how to access them.

spacesuit↗

Microgrid energy scheduling under uncertain extreme weather: Adaptation from parallelized reinforcement learning agents

Microgrids are useful solutions for integrating renewable energy resources and providing seamless green electricity to minimize carbon footprint. In recent years, extreme weather events happened often worldwide and caused significant economic and societal losses. Such events bring uncertainties to the microgrid energy scheduling problems and increase the challenges of microgrid operation. Traditional optimization approaches suffer from the inaccuracy of the uncertain microgrid model and the unseen events. Existing reinforcement learning (RL) - based approaches are also hampered by the limited generalization and the increasing computational burden when stochastic formulations are required to accommodate the uncertainties. This paper proposes a new parallelized reinforcement learning (PRL) method based on the probabilistic events to handle the microgrid energy uncertainties. Specifically, several local learning agents are employed to interact with pertinent microgrid environments in a distributed manner and report outcomes to the global agent, which will optimize microgrid energy resources online during extreme events. The stochastic microgrid energy optimization problem is reformulated to include all possible scenarios with probabilities. The advantage estimate functions of learning agents are designed with a backward sweep to transfer the outcomes to the value function updating process. Two simulation studies, stochastic optimization and online testing, are performed to compare with several existing RL approaches. Results substantiate that the proposed PRL method can achieve up to 20% optimization performance improvement with 4 and 28 times less computation cost than Q-learning with experience replay and multi-agent Q-learning approaches, respectively.

24 POWER TRANSMISSION AND DISTRIBUTION↗