Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Online Learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14

Leveraging the 2024 Solar Eclipse to Enhance Science Learning through Citizen Science

The solar eclipse on April 8, 2024, provided a rare and compelling opportunity for educators and students to engage in hands-on citizen science. Two NASA Science Activation projects GLOBE Mission Earth (GME) and NASA Earth Science Education Collaborative (NESEC) partnered together to provide a unique professional development experience for educators interested in the eclipse. They invited educators to participate in a specialized 5-week online workshop designed to engage the educators in Global Learning and Observations to Benefit the Environment (GLOBE) citizen science about the eclipse. The workshop was designed to support their certification as GLOBE educators and develop their knowledge, skills, and confidence in conducting a GLOBE investigation. Over 60 educators from across the United States took part in this workshop, which focused on investigating the eclipse by collecting and analyzing atmospheric data. The GLOBE Program promotes environmental and scientific literacy by enabling participants to collect Earth science data and contribute it to a global database accessible for research. The 2024 GLOBE Eclipse workshop trained educators in specific GLOBE protocols—Clouds, Air Temperature, and Surface Temperature—using the GLOBE Eclipse tool integrated into the GLOBE Observer app. This training was supplemented with guidance on engaging students in authentic scientific research and creating research posters to present their findings. The workshop aimed to enhance educators’ skills and confidence in integrating GLOBE protocols into their teaching practices. It addressed several key areas outlined in the National Academies' report on Learning through Citizen Science, including scientific context, nature of participation, and project infrastructure. Educators learned about the atmospheric effects of solar eclipses and were trained to use scientific tools and data analysis methods relevant to their research. They also engaged in live sessions and asynchronous activities, practicing data collection and analysis with real-time feedback. Survey results from the workshop highlighted that participants were primarily motivated by the desire to better use data in their classrooms and improve their proficiency with the GLOBE Observer app. Post-workshop evaluations showed significant increases in educators' confidence regarding their ability to conduct and guide scientific research. Participants reported feeling well-prepared to use the GLOBE Observer app for data collection and were successful in integrating their eclipse observations into classroom activities. Participants also valued the opportunity to contribute to authentic science through GLOBE, which involved observing atmospheric changes such as air temperature fluctuations and cloud cover alterations during the eclipse. The success of the workshop is evident in the increased confidence and skill levels of educators, as well as the publication of research posters on the GLOBE Mission Earth Student Research webpage.This session will discuss how the GLOBE Eclipse workshop series effectively utilized the unique context of the solar eclipse to enhance science education through citizen science. By adhering to the principles outlined in the Learning through Citizen Science framework, the workshop successfully engaged educators and students in meaningful scientific practices, demonstrating the potential of citizen science to enrich science education and foster a deeper understanding of Earth systems.

Jessica Taylor↗

Enabling robust offline active learning for machine learning potentials using simple physics-based priors

Abstract Machine learning surrogate models for quantum mechanical simulations have enabled the field to efficiently and accurately study material and molecular systems. Developed models typically rely on a substantial amount of data to make reliable predictions of the potential energy landscape or careful active learning (AL) and uncertainty estimates. When starting with small datasets, convergence of AL approaches is a major outstanding challenge which has limited most demonstrations to online AL. In this work we demonstrate a Δ-machine learning (ML) approach that enables stable convergence in offline AL strategies by avoiding unphysical configurations with initial datasets as little as a single data point. We demonstrate our framework’s capabilities on a structural relaxation, transition state calculation, and molecular dynamics simulation, with the number of first principle calculations being cut down anywhere from 70%–90%. The approach is incorporated and developed alongside AMP torch , an open-source ML potential package, along with interactive Google Colab notebook examples.

Shuaibi, Muhammed↗

Scoping the polymer genome: A roadmap for rational polymer dielectrics design and beyond

The Materials Genome Initiative (MGI) has heralded a sea change in the philosophy of materials design. In an increasing number of applications, the successful deployment of novel materials has benefited from the use of computational methodologies, data descriptors, and machine learning. Polymers have long suffered from a lack of data on electronic, mechanical, and dielectric properties across large chemical spaces, causing a stagnation in the set of suitable candidates for various applications. Extensive efforts over the last few years have seen the fruitful application of MGI principles toward the accelerated discovery of attractive polymer dielectrics for capacitive energy storage. Here, we review these efforts, highlighting the importance of computational data generation and screening, targeted synthesis and characterization, polymer fingerprinting and machine-learning prediction models, and the creation of an online knowledgebase to guide ongoing and future polymer discovery and design. We lay special emphasis on the fingerprinting of polymers in terms of their genome or constituent atomic and molecular fragments, an idea that pays homage to the pioneers of the human genome project who identified the basic building blocks of the human DNA. As a result, by scoping the polymer genome, we present an essential roadmap for the design of polymer dielectrics, and provide future perspectives and directions for expansions to other polymer subclasses and properties.

36 MATERIALS SCIENCE↗

A general Bayesian algorithm for the autonomous alignment of beamlines

Autonomous methods to align beamlines can decrease the amount of time spent on diagnostics, and also uncover better global optima leading to better beam quality. The alignment of these beamlines is a high-dimensional expensive-to-sample optimization problem involving the simultaneous treatment of many optical elements with correlated and nonlinear dynamics. Bayesian optimization is a strategy of efficient global optimization that has proved successful in similar regimes in a wide variety of beamline alignment applications, though it has typically been implemented for particular beamlines and optimization tasks. In this paper, we present a basic formulation of Bayesian inference and Gaussian process models as they relate to multi-objective Bayesian optimization, as well as the practical challenges presented by beamline alignment. We show that the same general implementation of Bayesian optimization with special consideration for beamline alignment can quickly learn the dynamics of particular beamlines in an online fashion through hyperparameter fitting with no prior information. We present the implementation of a concise software framework for beamline alignment and test it on four different optimization problems for experiments on X-ray beamlines at the National Synchrotron Light Source II and the Advanced Light Source, and an electron beam at the Accelerator Test Facility, along with benchmarking on a simulated digital twin. We discuss new applications of the framework, and the potential for a unified approach to beamline alignment at synchrotron facilities.

47 OTHER INSTRUMENTATION↗

Learning infinite-horizon average-reward restless multi-action bandits via index awareness

We consider the online restless bandits with average-reward and multiple actions, where the state of each arm evolves according to a Markov decision process (MDP), and the reward of pulling an arm depends on both the current state of the corresponding MDP and the action taken. Since finding the optimal control is typically intractable for restless bandits, existing learning algorithms are often computationally expensive or with a regret bound that is exponential in the number of arms and states. In this paper, we advocate \textit{index-aware reinforcement learning} (RL) solutions to design RL algorithms operating on a much smaller dimensional subspace by exploiting the inherent structure in restless bandits. Specifically, we first propose novel index policies to address dimensionality concerns, which are provably optimal. We then leverage the indices to develop two low-complexity index-aware RL algorithms, namely, (i) GM-R2MAB, which has access to a generative model; and (ii) UC-R2MAB, which learns the model using an upper confidence style online exploitation method. We prove that both algorithms achieve a sub-linear regret that is only polynomial in the number of arms and states. A key differentiator between our algorithms and existing ones stems from the fact that our RL algorithms contain a novel exploitation that leverages our proposed provably optimal index policies for decision-makings.

Xiong, Guojun↗

E-Labs - Learning with Authentic Data

the success teachers have had providing an opportunity for students to: • Organize and conduct authentic research. • Experience the environment of scientific collaborations. • Possibly make real contributions to a burgeoning scientific field. We've created projects that are problem-based, student driven and technology dependent. Students reach beyond classroom walls to explore data with other students and experts and share results, publishing original work to a worldwide audience. Students can discover and extend the research of other students, modeling the processes of modern, large-scale research projects. From start to finish e-Labs are student-led, teacher-guided projects. Students need only a Web browser to access computing techniques employed by professional researchers. A Project Map with milestones allows students to set the research plan rather than follow a step-by-step process common in other online projects. Most importantly, e-Labs build the learning experience around the students' own questions and let them use the very tools that scientists use. Students contribute to and access shared data, most derived from professional research databases. They use common analysis tools, store their work and use metadata to discover, replicate and confirm the research of others. This is where real scientific collaboration begins. Using online tools, students correspond with other research groups, post comments and questions, prepare summary reports, and in general participate in the part of scientific research that is often left out of classroom experiments. Teaching tools such as student and teacher logbooks, pre- and post-tests and an assessment rubric aligned with learner outcomes help teachers guide student work. Constraints on interface designs and administrative tools such as registration databases give teachers the "one-stop-shopping" they seek for multiple e-Labs. Teaching and administrative tools also allow us to track usage and assess the impact on student learning.

Bardeen, Marjorie G.↗

High Flying Interns: NASA's Student Airborne Research Program

The NASA Student Airborne Research Program is an annual summer internship for upper-level undergraduate STEM majors. Each summer since 2009, we have competitively selected ~30 undergraduates from colleges and universities across the United States for this unique airborne research experience. In all past summers, students flew onboard a NASA research aircraft where they assisted in the operation of remote sensing and in situ instrumentation to study the Earth, ocean, and atmosphere. Students also participated in field trips where they acquired data to ground-truth and complement the airborne data. After their flights and field trips, students then spent the rest of summer developing individual research projects using the data they collected as well as data from previous year SARP flights, other NASA airborne campaigns, and NASA satellite data. This summer, we adapted the program to be entirely online. Each of the 28 undergraduate students still completed an individual research project using data from previous SARP flights as well as publicly available data from other airborne campaigns, satellites, and/or ground stations. Students were mentored remotely by five university faculty members, five graduate students, and several additional scientists and engineers from NASA. In order to preserve some aspects of the hands-on research experience, we also shipped each student a box of twenty-four Whole Air Sampling canisters identical to what they would have used to collect air samples onboard the NASA aircraft. Instead, each student collected ground samples near their home starting in mid-April through July. The goal of this sampling was to attempt to characterize the impacts of pandemic-related changes in emissions with time across the United States. The results of that ground sampling are being presented in scientific sessions in this meeting. In addition, students also measured PM2.5 and aerosol optical depth from June through August using sensors provided by the Citizen-Enabled Aerosol Measurements for Satellites (CEAMS) at Colorado State University. We will discuss strategies we employed to conduct research online, the unexpected opportunities that arose, and lessons learned.

STEM disciplines↗

E-Learning in Neutron Activation Analysis

Since the middle 1990's electronic technology (E learning) has slowly infiltrated and now dominates education at all levels. E-learning encompasses a wide array of deliveries from simple introductions of animations in a teaching class to Massive Open-On-Line Courses (MOOCs) and Modular Object-Oriented Dynamic Learning Environment (MOODLEs). Even the definition of e-learning can be allusive. E-learning can or cannot have the following aspects: internet availability, supervised exams, a teacher to advise the students by electronic means such as e-mail, telephone, SKYPE, GOOGLE HANGOUT, FACETIME, etc., and multimedia designs. E-learning has transformed education from the Traditional Classroom Course to a) Synchronous Distributed Course in which web-based technologies are used to extend classroom lectures and discussions to students at remote sites in real time; b) Web-Enhanced Course in which online course activity complements class sessions without reducing the number of required class meetings; c). 'Emporium' Course where this model is designed for on-campus use, eliminates all class meetings and replaces them with a learning resource center featuring online materials and on-demand personalized assistance; d) Hybrid Course where online activity is mixed with classroom meetings, replacing at least 20 percent, but not all required face-to-face meetings; and e) Online Course where all course activity is done online and there are no required face-to-face sessions within the course and no requirements for on-campus activity. E-learning takes an extra challenge where the subject matter is highly scientific and engineering oriented encompassing multiple complex mathematical notations and concepts. A straight forward presentation of equations in Power Point is a recipe for an unsuccessful delivery of lectures. But how does one deliver intricate concepts without the use of a traditional blackboard to write on and how does one reach a worldwide diverse community in a fast moving arena of technological changes in education delivery?. The International Atomic Energy Agency (IAEA) and other international organizations as well, have undertaken large efforts to secure nuclear knowledge management in a wide area of nuclear science and engineering including research reactors. (authors)

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

ML-Based Power System Stability Assessment Considering Network Topology Changes: WECC 20,000+ Bus System Case Study

Modern power grids are fast-changing and thus require real-time monitoring and online stability assessment. With the rapid development of machine learning (ML) techniques, using data-driven models to provide fast and accurate estimations of power system stability marginal information, such as frequency nadir for frequency stability and critical clearing time (CCT) for transient stability, have become possible. However, despite the numerous research on ML-based methods for frequency nadir and CCT prediction, there is limited work on the impact of different network topology changes. Furthermore, most previous studies only focused on small or synthetic systems, and there is a lack of research on actual large power system models. In this paper, the above issues are addressed by studying the actual U.S. Western Electricity Coordinating Council (WECC) system model with more than 20,000 buses. Massive simulations are conducted in PowerWorld Simulator to study the impact of various topology change scenarios on both frequency stability and transient stability. System operating information is extracted from the success dispatch cases of various network topologies to generate a comprehensive dataset for ML-based models. Two ML methods, random forest (RF) and multilayer perceptron (MLP) neural network, are trained and tested for both frequency nadir prediction and CCT prediction. Test results have proven the models are capable of online stability assessment for large power networks such as the WECC system with sufficient accuracy.

critical clearing time↗

Remote Sensing Data Visualization, Fusion and Analysis via Giovanni

We describe Giovanni, the NASA Goddard developed online visualization and analysis tool that allows users explore various phenomena without learning remote sensing data formats and downloading voluminous data. Using MODIS aerosol data as an example, we formulate an approach to the data fusion for Giovanni to further enrich online multi-sensor remote sensing data comparison and analysis.

Leptoukh, G.↗

Aerosol Concentration, Size, Hygroscopicity and MEE, Globally: What Do We Need to Know and How Can We Know It?

Organizers of the Symposium Clouds, their Properties, and their Climate Feedbacks - What Have We Learned in the Satellite Era, held at Columbia University, NASAGISS June 6-8, 2017 plan to post the presented talks to an online website. http:www.gewex.orgeventclouds-their-properties-and-their-climate-feedbacks-what-have-we-learned-in-the-satellite-era?instance_id293534

Aerosols↗

Hybrid Imitation Learning for Real-Time Service Restoration in Resilient Distribution Systems

Self-healing capability is a critical factor for a resilient distribution system, which requires intelligent agents to automatically perform service restoration online, including network reconfiguration and reactive power dispatch. Here, the article proposes the imitation learning framework for training such an agent, where the agent will interact with an expert built based on the mixed-integer program to learn its optimal policy, and therefore significantly improve the training efficiency compared with exploration-dominant reinforcement learning (RL) methods. This significantly improved training efficiency makes the training problem under N-k scenarios tractable. A hybrid policy network is proposed to handle tie-line operations and reactive power dispatch simultaneously to further improve the restoration performance. The 33-bus and 119-bus systems with N-k disturbances are employed to conduct the training. The results indicate that the proposed method outperforms traditional RL algorithms such as the deep-Q network.

42 ENGINEERING↗

Interactive Visualizations for Communicating Compliance and Sustainability Statements in Annual Site Environmental Reports - 20419

The annual reports of organizations are a recurring type of public disclosure that communicates what an organization has done and/or plans to do. Worldwide, organizations use annual reports as powerful instruments for communication that is rich in narrative content and visuals. From the perspective of the leadership of an organization, statutory annual reports are communication devices to stakeholders. By analogy, from the perspective of stakeholders, the annual reports are learning devices that presents stakeholders with contents to generate knowledge about an organization. We have chosen the online accessible U.S. Department of Energy (DOE) Annual Site Environmental Reports (ASERs) as a collection of resources for communicating and learning the environmental management strategies on environmental compliance and environmental sustainability. Environmental Compliance 'consists of regulatory compliance and monitoring programs that implement federal, state, and local requirements, agreements, and permits.' Environmental Sustainability 'promotes and integrates initiatives such as energy and natural resource conservation, waste minimization, green remediation, and the use of sustainable products and services.' Interactive visualizations of textual data designed with visual analytics software can allow stakeholders to interact with statements on the environmental management strategies by performing diverse actions that promote learning. These actions include annotating, comparing, filtering, navigating, selecting and sharing relevant statements. We expect that the possibility of these multiple actions in an interactive manner help stakeholders to learn more effectively about the environmental strategies at U.S. DOE sites. The current case study for the project is a collection of 1,894 annotated (value-added) statements (sentence text) from the eight chapters of the 2017 Savanah River Site (SRS) annual site environmental report. The preliminary interactive visualizations are available online. (authors)

54 ENVIRONMENTAL SCIENCES↗

Scheduling For Urban Air Mobility Using Safe Learning

This work considers the scheduling problem for Urban Air Mobility (UAM) vehicles travelling between origin-destination pairs with both hard and soft trip deadlines. Each route is described by a discrete probability distribution over trip completion times (or delay) and over interarrival times of requests (or demand) for the route along with a fixed hard or soft deadline. Soft deadlines carry a cost that is incurred when the deadline is missed. An online, safe scheduler is developed that ensures that hard deadlines are never missed and that average cost of missing soft deadlines is minimized. The system is modelled as a Markov Decision Process (MDP) and safe model based learning is used to find the probabilistic distributions over route delays and demand. Monte Carlo Tree Search (MCTS) Earliest Deadline First (EDF) is used to safely explore the learned models in an online fashion and develop a near-optimal non-preemptive scheduling policy. These results are compared with Value Iteration (VI) and MCTS (Random) scheduling solutions.

Urban Air Mobility↗

Scheduling for Urban Air Mobility using Safe Learning

This work considers the scheduling problem for Urban Air Mobility (UAM) vehicles travelling between origin-destination pairs with both hard and soft trip deadlines. Each route is described by a discrete probability distribution over trip completion times (or delay) and over interarrival times of requests (or demand) for the route along with a fixed hard or soft deadline. Soft deadlines carry a cost that is incurred when the deadline is missed. An online, safe scheduler is developed that ensures that hard deadlines are never missed and that average cost of missing soft deadlines is minimized. The system is modelled as a Markov Decision Process (MDP) and safe model based learning is used to find the probabilistic distributions over route delays and demand. Monte Carlo Tree Search (MCTS) Earliest Deadline First (EDF) is used to safely explore the learned models in an online fashion and develop a near-optimal non-preemptive scheduling policy. These results are compared with Value Iteration (VI) and MCTS (Random) scheduling solutions.

Urban Air Mobility↗

Reinforcement Learning for feedback-enabled cyber resilience

The rapid growth in the number of devices and their connectivity has enlarged the attack surface and made cyber systems more vulnerable. As attackers become increasingly sophisticated and resourceful, mere reliance on traditional cyber protection, such as intrusion detection, firewalls, and encryption, is insufficient to secure the cyber systems. Cyber resilience provides a new security paradigm that complements inadequate protection with resilience mechanisms. A Cyber-Resilient Mechanism (CRM) adapts to the known or zero-day threats and uncertainties in real-time and strategically responds to them to maintain the critical functions of the cyber systems in the event of successful attacks. Feedback architectures play a pivotal role in enabling the online sensing, reasoning, and actuation process of the CRM. Reinforcement Learning (RL) is an important gathering of algorithms that epitomize the feedback architectures for cyber resilience. It allows the CRM to provide dynamic and sequential responses to attacks with limited or without prior knowledge of the environment and the attacker. In this work, we review the literature on RL for cyber resilience and discuss the cyber-resilient defenses against three major types of vulnerabilities, i.e., posture-related, information-related, and human-related vulnerabilities. Here we introduce moving target defense, defensive cyber deception, and assistive human security technologies as three application domains of CRMs to elaborate on their designs. The RL algorithms also have vulnerabilities themselves. We explain the major vulnerabilities of RL and present develop several attack models where the attacker target the information exchanged between the environment and the agent: the rewards, the state observations, and the action commands. We show that the attacker can trick the RL agent into learning a nefarious policy with minimum attacking effort. The paper introduces several defense methods to secure the RL-enabled systems from these attacks. However, there is still a lack of works that focuses on the defensive mechanisms for RL-enabled systems. Last but not least, we discuss the future challenges of RL for cyber security and resilience and emerging applications of RL-based CRMs.

97 MATHEMATICS AND COMPUTING↗

Machine Learning-Based PV Reserve Determination Strategy for Frequency Control on the WECC System

Frequency control from photovoltaic (PV) power plants has great potential to address the frequency response challenge of the power system with high penetrations of renewable generation. Using model-based approaches to determine the optimal PV headroom reserve, however, requires significant online computation and is intractable for an interconnection level system. This paper proposes a machine learning based strategy, that is suitable for real-time operation, to determine the optimal PV reserve for frequency control. The proposed machine learning algorithm is trained and tested on 1,987 offline simulations of a 60% renewable penetration Western Electricity Coordinating Council (WECC) system. Furthermore, the proposed reserve determination strategy is applied on a realistic 1-day operation profile of the WECC system and demonstrates a savings of more than 40% PV headroom compared to a conservative approach. It is evident that the proposed strategy can efficiently and effectively determine the optimal PV frequency control reserve for realistic interconnection systems.

frequency control↗