Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Online Learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 433 records · Page 24

Calibrating IR Cameras for In-Situ Temperature Measurement During the Electron Beam Melting Process using Inconel 718 and Ti-Al6-V4

The Department of Energy s (DOE) Manufacturing Demonstration Facility (MDF) at Oak Ridge National Laboratory (ORNL) provides world-leading capabilities in advanced manufacturing (AM) facilities which leverage previous, on-going government investments in materials science research and characterization. MDF contains systems for fabricating components with complex geometries using AM techniques (i.e. 3D-Printing). Various metal alloy printers, for example, use electron beam melting (EBM) systems for creating these components which are otherwise extremely difficult- if not impossible- to machine. ORNL has partnered with manufacturers on improving the final part quality of components and developing new materials for further advancing these devices. One method being used to study (AM) processes in more depth relies on the advanced imaging capabilities at ORNL. High performance mid-wave infrared (IR) cameras are used for in-situ process monitoring and temperature measurements. However, standard factory calibrations are insufficient due to very low transmissions of the leaded glass window required for X-ray absorption. Two techniques for temperature calibrations will be presented and compared. In-situ measurement of emittance will also be discussed. Ample information can be learned from in-situ IR process monitoring of the EBM process. Ultimately, these imaging systems have the potential for routine use for online quality assurance and feedback control.

Electron-Beam Melting↗

Particle tracks recorded by ProtoDUNE

This 3-D display shows particle tracks recorded by ProtoDUNE. The video shows the full size of the single-phase ProtoDUNE detector (white box) and the direction of the particle beam (yellow arrow). Particles from other sources (such as cosmic rays) can be seen throughout the white box, while the red box highlights the region of interest: in this case, an interaction resulting from the particle beam passing through the detector. Event information, such as the momentum of particles in the beam and time of interaction, are located in the lower left corner. A selection of 3-D events from ProtoDUNE-SP are available in an online gallery developed by Chao Zhang of Brookhaven National Laboratory (https://www.phy.bnl.gov/twister/bee/s...) for curious minds that want to play with the interface. Learn more about ProtoDUNE here: http://news.fnal.gov/2019/01/success-... And learn more about DUNE here: http://www.fnal.gov/dune

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Heliostat Consortium: Update on Resource, Training, and Education Development and Women+ in Concentrating Solar

One of the major barriers to Concentrating Solar Power (CSP) industry growth in the U.S. is the lack of accessibility of expert knowledge, a lack of a stable workforce pipeline, and little public awareness of the technology area. Improved Resource, Training, and Education (RTE) is needed to address these gaps, to draw workers into the field from diverse technology areas and backgrounds, and to reduce the learning curves of newcomers into the industry. As part of the RTE topic under the NREL-led Heliostat Consortium (HelioCon), a public online resource database has been created to support information sharing across the heliostat and CSP community. Here, information will be presented on the existing and planned database resources, including introductory information about CSP and heliostats, a reference library of texts and publications, educational videos, a CSP power tower plant database and case studies, a contact list of component suppliers and developers, and a list of available software/metrology tools. Women+ in Concentrating Solar is a newly created organization to promote the education, professional development, and advancement of underrepresented genders in the Concentrating Solar Power (CSP) community in a way that includes diverse backgrounds, attitudes, and perspectives. The main objectives of the groups are to provide the following opportunities for underrepresented genders: 1) organize events to provide networking opportunities and community building, 2) boost partnerships and scientific collaboration, 3) create resources to facilitate knowledge and experience sharing, 4) provide mentorship programs to support those new to the industry, 5) bring visibility to underrepresented genders and attract more to the field, and 6) promote Diversity, Equity, and Inclusion (DEI) and engage minorities and underrepresented groups. Initial activities being pursued by the group include creating an expert database to support event organizers in recruiting speakers with representation of all gender identities, hosting online networking and webinar events, organizing conference events including seminars and networking/social events, and establishing a mentorship program to connect members in the CSP community across the globe. The group is open to all genders and has grown to over 60 members in its first few months.

concentrating solar↗

Celebrating 30 Years of K-12 Educational Programming at Fermilab

In 1980 Leon Lederman started Saturday Morning Physics with a handful of volunteer physicists, around 300 students and all the physics teachers who tagged along. Today Fermilab offers over 30 programs annually with help from 250 staff volunteers and 50 educators, and serves around 40,000 students and 2,500 teachers. Find out why we bother. Over the years we have learned to take advantage of opportunities and confront challenges to offer effective programs for teachers and students alike. We offer research experiences for secondary school teachers and high school students. We collaborate with educators to design and run programs that meet their needs and interests. Popular school programs include classroom presentations, experience-based field trips, and high school tours. Through our work in QuarkNet and I2U2, we make real particle physics data available to high school students in datadriven activities as well as masterclasses and e-Labs. Our professional development activities include a Teacher Resource Center and workshops where teachers participate in authentic learning experiences as their students would. We offer informal classes for kids and host events where children and adults enjoy the world of science. Our website hosts a wealth of online resources. Funded by the U.S. Department of Energy, the National Science Foundation and Fermilab Friends for Science Education, our programs reach out across Illinois, throughout the United States and even around the world. We will review the program portfolio and share comments from the volunteers and participants.

99 GENERAL AND MISCELLANEOUS↗

Global field reconstruction from sparse sensors with Veronoi tessellation-assisted deep learning

Achieving accurate and robust global situational awareness of a complex time-evolving field from a limited number of sensors has been a longstanding challenge. This reconstruction problem is especially difficult when sensors are sparsely positioned in a seemingly random or unorganized manner, which is often encountered in a range of scientific and engineering problems. Moreover, these sensors can be in motion and can become online or offline over time. The key leverage in addressing this scientific issue is the wealth of data accumulated from the sensors. As a solution to this problem, we propose a data-driven spatial field recovery technique founded on a structured grid-based deep-learning approach for arbitrary positioned sensors of any numbers. It should be noted that the naïve use of machine learning becomes prohibitively expensive for global field reconstruction and is furthermore not adaptable to an arbitrary number of sensors. In the present work, we consider the use of Voronoi tessellation to obtain a structured-grid representation from sensor locations enabling the computationally tractable use of convolutional neural networks. One of the central features of the present method is its compatibility with deep-learning based super-resolution reconstruction techniques for structured sensor data that are established for image processing. The proposed reconstruction technique is demonstrated for unsteady wake flow, geophysical data, and three-dimensional turbulence. The current framework is able to handle an arbitrary number of moving sensors, and thereby overcomes a major limitation with existing reconstruction methods. The presented technique opens a new pathway towards the practical use of neural networks for real-time global field estimation.

Fukami, Kai↗

Demonstration of Machine Learning-Based Model-Independent Stabilization of Source Properties in Synchrotron Light Sources

Synchrotron light sources, arguably among the most powerful tools of modern scientific discovery, are presently undergoing a major transformation to provide orders of magnitude higher brightness and transverse coherence enabling the most demanding experiments. In these experiments, overall source stability will soon be limited by achievable levels of electron beam size stability, presently on the order of several microns, which is still 1–2 orders of magnitude larger than already demonstrated stability of source position and current. Until now source size stabilization has been achieved through corrections based on a combination of static predetermined physics models and lengthy calibration measurements, periodically repeated to counteract drift in the accelerator and instrumentation. In this paper, we now demonstrate for the first time how the application of machine learning allows for a physics- and model-independent stabilization of source size relying only on previously existing instrumentation. Such feed-forward correction based on a neural network that can be continuously online retrained achieves source size stability as low as 0.2 μm (0.4%) rms, which results in overall source stability approaching the subpercent noise floor of the most sensitive experiments.

43 PARTICLE ACCELERATORS↗

Machine Learning (ML) Classifier to Assist Metadata Creation

The Atmospheric Radiation Measurement (ARM) Data Center is responsible for the timely collection, archival, and curation of science data products. These products are freely available through an online data repository. Metadata creation is paramount for scientific users to find and access over seven petabytes of atmospheric science data. The hierarchical metadata structure allows users to search for information at both broad and narrow levels. This project aims to leverage 30 years’ worth of manually created metadata to enable machine predictions of broad-term classifications from narrow-term descriptions. These classification predictions would assist metadata coordinators with their term selections. This paper discusses the cleaning and preprocessing of the training data, the pipeline developed to determine the best model for this task, and the creation of an API metadata classifier for ARM measurement metadata. Our results show that the Linear Support Vector Classification (LinearSVC) algorithm, along with the Term Frequency – Inverse Document Frequency (TF-IDF) vectorizer, is well-suited for our multi-class classification task. Lengthier input training data led to better results, and artificial balancing was unnecessary for this particular use case. This predictive classifier enhances efficiency in metadata creation, as well as supports greater consistency and accuracy in metadata tagging.

Collier, Hannah [ORNL] (ORCID:0000000341284292)↗

Technology Integration 2021 Annual Progress Report

VTO's Technology Integration Program supports a broad technology portfolio that includes alternative fuels, energy efficient mobility systems and technologies, and other efficient advanced technologies that can reduce transportation energy costs for businesses and consumers. The program provides objective, unbiased data and real-world lessons learned to inform future research needs and support local decision making. It also includes projects to disseminate data, information, and insight, as well as online tools and technology assistance to cities and regions working to implement alternative fuels and energy efficient mobility technologies and systems.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Technology Integration (2022 Annual Progress Report)

VTO's Technology Integration Program supports a broad technology portfolio that includes alternative fuels, energy efficient mobility systems and technologies, and other efficient advanced technologies that can reduce transportation energy costs for businesses and consumers. The program provides objective, unbiased data and real-world lessons learned to inform future research needs and support local decision making. It also includes projects to disseminate data, information, and insight, as well as online tools and technology assistance to cities and regions working to implement alternative fuels and energy efficient mobility technologies and systems.

33 ADVANCED PROPULSION SYSTEMS↗

Technology Integration 2023 Annual Progress Report

This document summarizes the progress of VTO Technology Integration projects supported during the fiscal year 2023. VTO's Technology Integration Program supports a broad technology portfolio that includes alternative fuels, energy efficient mobility systems and technologies, and other efficient advanced technologies that can reduce transportation energy costs for businesses and consumers. The program provides objective, unbiased data and real-world lessons learned to inform future research needs and support local decision making. It also includes projects to disseminate data, information, and insight, as well as online tools and technology assistance to cities and regions working to implement alternative fuels and energy efficient mobility technologies and systems.

33 ADVANCED PROPULSION SYSTEMS↗

Design Thinking for the Applied Sciences: Developing a Novel Approach to Encourage the Use of Synthetic Aperture Radar (SAR) and Open Source Tools for Forest Monitoring

Earth observations from Synthetic Aperture Radar, or SAR, have yet to be fully leveraged for forest monitoring applications. While SAR sensors are uniquely able to capture components of forest structure over optical imagery, especially in cloud-heavy regions, there is a shortage of freely-available applied training materials and related case studies. With the wealth of available datasets from Sentinel-1 and other missions, such as ALOS-Palsar open historical archive, and in preparation for upcoming opendata policy SAR missions (e.g. NISAR and BIOMASS), the applied forestry community would benefit from increased access to relevant, understandable SAR training materials. This work documents lessons learned and best practices for creating EO capacity building/training materials gleaned from the SAR Handbook project. Strategies for increasing legibility for both print and online applications, illustration and editing guidelines for original and modified figures, and the development of quick-reference guides will be shared. Additionally, the conception and use of companion “explainer” videos, using cartoon characters and humor to outline relevant SAR concepts will be explored. Preliminary results indicate the SAR Handbook and supplemental project materials are already having an impact in training sessions. Increased uptake of SAR technologies in SERVIR Hub regions, where Hubs are leading follow-on SAR trainings, has also been noted. In addition, a review of download statistics from the SERVIR global website indicates widespread worldwide access. We conclude similar holistic approaches integrating design concepts into future content development would help increase uptake of EO applications by the earth science community.

Kucera, Leah M.↗

Structured Covariance Gaussian Networks for Orion Crew Module Aerodynamic Uncertainty Quantification

In this paper we propose a new approach for nonlinear regression and uncertainty quantification. The method is based on a pair of neural networks which parameterize mean and dense covariance functions of a multivariate Gaussian process, trained together to maximize the log-likelihood of observing the given data. The covariance matrix is made positive definite at every input by construction. We also propose a sampling approach that produces viable surrogate function realizations from the Gaussian process. We call the proposed model a Structured Covariance Gaussian Network (SCGN). We illustrate the use of SCGNs for learning an aerodynamic response surface with built-in uncertainty for the Orion crew module. We find that SCGN provides an efficient and systematic way to learn nonlinear functional relationships and dense covariances. We compare results to a baseline Gaussian process regressor and observe that the SCGN provides comparable uncertainty descriptions with improved scalability to dataset size. The sample functions generated by SCGN are fast to evaluate online and are therefore convenient for use in trajectory simulations. These results suggest that SCGN may be a viable computational method for aerodynamic uncertainty quantification.

machine learning↗

Structured Covariance Gaussian Networks for Orion Crew Module Aerodynamic Uncertainty Quantification

In this paper we propose a new approach for nonlinear regression and uncertainty quantification. The method is based on a pair of neural networks which parameterize mean and dense covariance functions of a multivariate Gaussian process, trained together to maximize the log-likelihood of observing the given data. The covariance matrix is made positive definite at every input by construction. We also propose a sampling approach that produces viable surrogate function realizations from the Gaussian process. We call the proposed model a Structured Covariance Gaussian Network (SCGN). We illustrate the use of SCGNs for learning an aerodynamic response surface with built-in uncertainty for the Orion crew module. We find that SCGN provides an efficient and systematic way to learn nonlinear functional relationships and dense covariances. We compare results to a baseline Gaussian process regressor and observe that the SCGN provides comparable uncertainty descriptions with improved scalability to dataset size. The sample functions generated by SCGN are fast to evaluate online and are therefore convenient for use in trajectory simulations. These results suggest that SCGN may be a viable computational method for aerodynamic uncertainty quantification.

machine learning↗

A Decadal Hybrid GCM Simulation Using Deep‐Learning‐Based Cloud and Convection Parameterization Generalized to a Warm Climate

A critical challenge for machine‐learning (ML) parameterization in global climate models (GCMs) is to achieve stable, accurate simulations under climates not seen during training. Previous studies have demonstrated promising offline performance and year‐long online stability in aquaplanet simulations but have encountered difficulties in real geography and under climate warming. Here we report that a GCM with real geography configuration using neural‐network‐based cloud and convection parameterization, trained exclusively with present‐day climate data, successfully performs a stable, decade‐long simulation of a warm climate with +4 K sea surface temperature (SST). The neural network (NN) is based on Han et al. (2023, https://doi.org/10.1029/2022ms003508 ) with additional inputs. The simulation captures the global precipitation distribution, surface temperatures, vertical atmospheric structures, and extreme precipitation very well, closely matching simulations from both the superparameterized CAM (SPCAM) and the conventional CAM5 in the warm climate without accuracy degradation compared to those in the baseline climate. Moreover, it produces a climate response to +4 K SST in atmospheric thermodynamic states and circulations similar to those from SPCAM and CAM5. Prognostic ablation tests on NN input variables show that the NN without convective memory as input suffers from numerical instability, and the NN without considering radiative variables and land fraction as input, or with reduced training samples produce less accurate results. To our knowledge, this is the first time an ML parameterization successfully achieves online extrapolation to a warm climate without using additional warm‐climate data for training. It demonstrates the potential of ML‐driven parameterizations for credible long‐term climate projections.

Atmosphere model↗

Enhancing Distribution System Resilience: A First-Order Meta-RL Algorithm for Critical Load Restoration

The increasing frequency of extreme events and the integration of distributed energy resources (DERs) into modern grids have elevated the need for resilient and efficient critical load restoration strategies in distribution systems. However, the stochastic nature of renewable DERs, limited energy resource availability and the intricate nonlinearities inherent in complex grid control problem make the problem challenging. Although reinforcement learning (RL) and warm-start RL methods have shown promising results, their performance often falls short in rapidly adapting to new, unseen situations and typically requires exhaustive problem-specific tuning. To address these gaps, we propose a First-Order Meta-based RL (FOM-RL) algorithm within an online framework for adaptive and robust critical load restoration. By harnessing local DERs as the enabling technology, FOM-RL allows the RL agent to swiftly adapt to new unseen scenarios by leveraging previously acquired knowledge of different tasks. Experimental results provide evidence that proposed algorithm learns more efficiently and showcases generalization capabilities across diverse set of operational scenarios. Moreover, a rigorous theoretical analysis yields a tight sublinear regret bound, sensitive to temporal variability, with a task-averaged optimality gap bounded by O(VM+D*/(Tsquare root(M))). These results suggest that optimality improves with task similarity and an increased number of tasks M, reaffirming the efficacy and scalability of the proposed approach in addressing the complexities of critical load restoration in distribution systems.

complexity theory↗

A lightweight network anomaly detection technique

While the network anomaly detection is essential in network operations and management, it becomes further challenging to perform the first line of detection against the exponentially increasing volume of network traffic. In this paper, we develop a technique for the first line of online anomaly detection with two important considerations: (i) availability of traffic attributes during the monitoring time, and (ii) computational scalability for streaming data. The presented learning technique is lightweight and highly scalable with the beauty of approximation based on the grid partitioning of the given dimensional space. With the public traffic traces of KDD Cup 1999 and NSL-KDD, we show that our technique yields 98.5% and 83% of detection accuracy, respectively, only with a couple of readily available traffic attributes that can be obtained without the help of post-processing. Finally, the results are at least comparable with the classical learning methods including decision tree and random forest, with approximately two orders of magnitude faster learning performance.

97 MATHEMATICS AND COMPUTING↗

Nuclear Theory from First Principles to Forefront Experiments (Final Report for DE-SC0018638)

The Lee research group is a part of the Nuclear Lattice Effective Field Theory Collaboration, which has developed and performed ab initio lattice simulations of nuclear structure, scattering, reactions, and many-body systems. The other senior members of the collaboration include Ulf-G. Meißner at Bonn/Julich, Evgeny Epelbaum and Hermann Krebs at Bochum, Timo Lahde and Thomas Luu at Julich, and Gautam Rupak at Mississippi State. Our letter “Ab initio alpha-alpha scattering” was featured in a Nature News and Views article. Another letter “Nuclear binding near a quantum phase transition” was highlighted in a Viewpoint article in the online APS journal Physics as well as a news article in the IOP publication Physics World (September 21, 2016). Our letter “Eigenvector continuation with subspace learning” was also highlighted a Synopsis article in Physics. There are many promising ab initio approaches being used to calculate the properties of few-and many-nucleon systems. This includes the no-core shell model, symmetry-adapted no-core shell model quantum Monte Carlo, auxiliary-field diffusion Monte Carlo, self-consistent Green’s functions, many-body perturbation theory, in-medium similarity renormalization group, and coupled cluster methods. Lattice effective field theory is another ab initio approach which combines the framework of effective field theory with lattice Monte Carlo methods to allow favorable scaling from few- to many-body systems. Perhaps the most important aspect of lattice effective field theory is that its strengths and weaknesses are orthogonal to that of other ab initio methods. For example, lattice effective field theory has little difficulty in probing cluster structures and collectivity, while such features are much more difficult using other methods. Furthermore it can be used to compute superfluid condensate fractions as well as the phase diagram of strongly matter and the density and temperature dependence of clustering. Lattice effective field theory was first used in simulations of infinite nuclear matter and infinite neutron matter with pions and without pions. In addition to the efforts by our collaboration, there have been recent efforts by other groups as well.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

PACE: Pattern Accurate Computationally Efficient Bootstrapping for Timely Discovery of Cyber-Security Concepts

Public disclosure of important security information, such as knowledge of vulnerabilities or exploits, often occurs in blogs, tweets, mailing lists, and other online sources significantly before proper classification into structured databases. In order to facilitate timely discovery of such knowledge, we propose a novel semi-supervised learning algorithm, PACE, for identifying and classifying relevant entities in text sources. The main contribution of this paper is an enhancement of the traditional bootstrapping method for entity extraction by employing a time-memory trade-off that simultaneously circumvents a costly corpus search while strengthening pattern nomination, which should increase accuracy. An implementation in the cyber-security domain is discussed as well as challenges to Natural Language Processing imposed by the security domain.

Bootstrapping↗