Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Intelligent Systems”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,603 records · Page 89

SchedInspector: A Batch Job Scheduling Inspector Using Reinforcement Learning

Improving the performance of job executions is an important goal of HPC batch job schedulers, such as minimizing job waiting time, slowdown, or completion time. Such a goal is often accomplished using carefully designed heuristics based on job features, such as job size and job duration. However, these heuristics overlook important runtime factors (e.g., cluster availability and waiting job patterns), which may vary across time and make a previously sound scheduling decision not hold any longer. In this study, we propose a new approach to incorporate runtime factors into batch job scheduling for better job execution performance. The key idea is to add a scheduling inspector on top of the base job scheduler to scrutinize its scheduling decisions. The inspector will take the runtime factors into consideration and accordingly determine the fitness of the scheduled job. It then either accepts the scheduled job or rejects it and asks the base schedulers to try again later. We realize such an inspector, namely SchedInspector, by leveraging the intelligence of reinforcement learning. Through extensive experiments, we show SchedInspector can intelligently integrate the runtime factors into various batch job scheduling policies, including the state-of-the-art one, to gain better job execution performance, such as smaller average bounded job slowdown (up to 69% better) or average job waiting time (up to 52% better), across various real-world workloads. We also show that although rejecting scheduling decisions may leave the resources idle hence affect the system utilization, SchedInspector is able to achieve the job execution performance improvement with marginal impact on the system utilization (typically less than 1%). We consider one key advantage of SchedInspector is it automatically learns to work with and improve existing job scheduling policies without changing them, which makes it promising to serve as a generic enhancer for various batch job scheduling policies.

Zhang, Di↗

Management and Storage of Scientific Data

Scientific discoveries rely heavily on efficient access, search, and management of massive data sets. Data management technologies have, for decades, provided foundational capabilities for scientific computing. Just as storage, input/output (I/O), and data management have been fundamental to simulation-based science for many years, so too are capable data-management technologies key to the success of today’s scientific workflows utilizing data intensive and machine learning (ML) techniques. The Department of Energy, Office of Science, Advanced Scientific Computing Research (ASCR) program has invested broadly in data-management research focused on high-performance computing (HPC) systems, from parallel file systems that store data to application software that makes these systems more productive. Still, advances in technology combined with growing diversity of supported science strongly motivate continued investment in this area. In January 2022, ASCR convened a workshop to identify priority research directions in the area of data management for high-performance and scientific computing. Attendees were challenged to identify promising approaches that would support the breadth of the DOE mission, including the explosion of artificial intelligence (AI) uses and the growing needs of experimental and observational science. Technological and science drivers were identified and considered as they relate to key aspects of data management such as interfaces, architectural design, and FAIR principles (Findable, Accessible, Interoperable, and Reusable). The thoughts of the workshop participants were distilled into a set of four priority research directions with the potential for high impact on DOE science. These research directions are summarized in the following pages.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

ASCENDS: Advanced data SCiENce toolkit for Non-Data Scientists

Recently, advances in machine learning and artificial intelligence have been playing more and more critical roles in a wide range of areas. For the last several years, industries have shown that how learning from data, identifying patterns and making decisions with minimal human intervention can be extremely useful to their business (e.g., image classification, recommending a product to a customer, finding friends in a social network, predicting customers actions, etc.). These success stories have been motivating scientists who study physics, chemistry, materials, medicine, and many other subjects, to explore a new pathway of utilizing machine learning techniques like regression and classification for their scientific activities. However, most existing machine learning tools, systems, and methodologies have been developed for programming experts but not for scientists (or any users) who have no or little knowledge of programming. ASCENDS is a toolkit that is developed to assist scientists (or any persons) who want to use their data for machine learning tasks, more specifically, correlation analysis, regression, and classification. ASCENDS does not require programming skills. Instead, it provides a set of simple but powerful CLI (Command Line Interface) and GUI (Graphic User Interface) tools for non-data scientists to be able to intuitively perform advanced data analysis and machine learning techniques. ASCENDS has been implemented by wrapping around opensource software including Keras, TensorFlow, and scikit-learn.

97 MATHEMATICS AND COMPUTING↗

Development of Real-Time Quantitative Safety Evaluation Method for Nuclear Power Plants

Human operators involved with large process control systems such as nuclear power plants (NPPs) perform significant roles in the operation of systems. In this reason, deficiencies in human factors such as poor HSI (Human System Interface) design, procedure, and training, are significant contributing factors to NPPs incidents and accidents. In this regard, many kinds of studies including human reliability analysis (HRA), operation support system, automation, have been conducted in order to reduce human errors. Among these fields of studies, automation has its own specialty since it mainly focuses on eliminating the human error-inducing tasks to reduce human error, while other topics are primarily focusing on reducing human error by aiding human operators during operation. It is commonly believed that replacing human operators to the automated system would guarantee greater efficiency, lower workloads, and fewer human errors. However, these beliefs are not always true in large and complex systems such as NPP, since excessive automation can generate new roles for human operators, change human operators' activities in unexpected ways, and inducing 'out-of-the-loop' (OOTL) problem. Especially, although human error probability drastically increases during abnormal situations in NPP due to overload of information, high workload, and short time available for diagnosis, automation is not actively adopted since conventional machine learning techniques are neither capable nor reliable to handle overwhelmingly complex abnormal situations in NPP. Recently, newly developed 'deep learning' techniques have been actively applied to many fields, and some of these studies proved that the artificial intelligences (AI) based on deep learning techniques show better performance than that of human being. In 2015, deep Q-network (DQN) which is one of the deep learning techniques was developed and applied to train AI that automatically plays various Atari 2800 games, and this AI surpassed the human-level playing in many kind of games. Also in 2016, 'AlphaGo', which was developed by 'Google Deepmind' based on deep learning technique to play the game of Go, was defeated Se-dol Lee who is the World Go champion with score of 4:1. In the point of view that the game of Go is considered as one of the challenging area in machine learning field, it is verified that these new machine learning techniques can perform well, even better than the human being in high-complexity tasks. Previously, most of AI applications in nuclear field were focusing on supporting human operators' tasks such as diagnosis and decision making by rapid classification and prediction, based on fixed training data sets. However, it is expected that AI can be applied to solve more complicated problems (i.e. automation during abnormal states in NPP) by adopting advanced machine learning methodologies. In order to apply the automation system in NPP, firstly it is needed to evaluate the status of the plant quantitatively in real-time, since the information about which state is better (i.e. safe) or worse (i.e. unsafe) is essential for training properly working automation AI. Currently, there are several methodologies for NPP safety evaluation such as probabilistic safety assessment (PSA), safety performance indicator (SPI). However, existing methodologies are not feasible for development of automated system since they are not capable for the cases which are not included in the underlying model, not able to consider delicate changes in the NPP, and hard to evaluate in real-time. Therefore, development of new NPP safety evaluation methodology which can cover previously mentioned requirements is needed to conduct the study on NPP automation further. In this study, the concept of early warning score (EWS) in medical field was adopted to develop the methodology which can evaluate the safety level of the NPP quantitatively and in real-time. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Optimal Eco-Driving Control of Connected and Autonomous Vehicles Through Signalized Intersections

This article focuses on the speed planning problem for connected and automated vehicles (CAVs) communicating to traffic lights. The uncertainty of traffic signal timing for signalized intersections on the road is considered. The eco-driving problem is formulated as a data-driven chance-constrained robust optimization problem. Effective red-light duration (ERD) is defined as a random variable, and describes the feasible passing time through the signalized intersections. Usually, the true probability distribution for ERD is unknown. Consequently, a data-driven approach is adopted to formulate chance constraints based on empirical sample data. This incorporates robustness into the eco-driving control problem with respect to uncertain signal timing. Dynamic programming (DP) is employed to solve the optimization problem. The simulation results demonstrate that the proposed method can generate optimal speed reference trajectories with 40% less vehicle fuel consumption, while maintaining the arrival time at a similar level compared to a modified intelligent driver model (IDM). The proposed control approach significantly improves the controller's robustness in the face of uncertain signal timing, without requiring to know the distribution of the random variable a priori.

33 ADVANCED PROPULSION SYSTEMS↗

From Watt-Scale to Megawatt-Scale: Advances in Wave Energy Technologies for Offshore Applications

Potential applications for wave energy cover the spectrum from powering watt-scale maritime sensors to generating electricity at megawatt-scale. These applications include energy generation for: ocean observation, communications, autonomous underwater vehicles recharging, isolated community grids, aquaculture, underwater data centers, seawater desalination, ocean mining, disaster relief and recovery, and utility grids. Much of the focus to date has been on utility-scale systems for grid-connected applications. Furthermore, despite the effort to develop viable technologies and the attractiveness of the resource, wave energy has yet to achieve status as a mainstream renewable resource.

16 TIDAL AND WAVE POWER↗

Artificial Intelligence for Digital Security and Protections

Proper functioning of nuclear power plants relies on a mix of well-regulated human and machine-driven workflows. This regulation supports nuclear safety through a series of processes and many of the tasks that support these processes have a repetitive nature that make artificial intelligence (AI) informed by machine learning (ML) a potential aid in a variety of tasks. AI is being evaluated for activities that include inspections, fuel processing, monitoring, and other activities. The introduction of any new technology presents a potential new attack vector. In the case of AI/ML, there are many attacks that have already been discovered and over time the attacks can be expected to follow the growth pattern observed in cyber security. While future planning is necessary, current efforts need to be established now to predict the threat emergence over the next year 10 years and mitigate potential threats. Based on these observations, AI/ML will need to become trustworthy, which corresponds to techniques and procedures that emphasize AI explainability along with resilience techniques to data, algorithms, models, and systems. This kind of system robustness is the foundation for defenses against AI/ML-specific attacks. Attempting to look forward and take a broad view of capabilities provides input to research roadmaps and the ability to distill vulnerabilities into specific use cases may provide greater assistance in understanding the technology benefits while introducing new risks. The impact of current and future AI in three areas—capabilities, challenges, and recovery strategies—represents an initial attempt at balancing both.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

HERCULES: Strong Patterns towards More Intelligent Predictive Modeling, In: 2014 43rd International Conference on Parallel Processing

Recent work has shown that program analysis techniques to select meaningful code features of programs are important in the task of deciding the best compiler optimizations. Although, there are many successful state-of-the-art program analysis techniques, they often do not provide a simple method to extract the most expressive information about loops, especially when a target program is computationally intensive with complex loops and data dependencies. In this paper, we introduce a static technique to characterize a program using a pattern-driven system named HERCULES. This characterization technique not only helps a user to understand programs by searching pattern-of-interests, but also can be used for a predictive model that effectively selects the proper compiler optimizations. We formulated 35 loop patterns, then evaluated our characterization technique by comparing the predictive models constructed using HERCULES to three other state-of-the-art characterization methods. We show that our models outperform three state-of-the-art program characterization techniques on two multicore systems in selecting the best optimization combination from a given loop transformation space. We achieved up to 67% of the best possible speedup achievable with the optimization search space we evaluated.

Computer Science↗

Machine-Learning Microstructure for Inverse Material Design

Metallurgy and material design have thousands of years’ history and have played a critical role in the civilization process of humankind. The traditional trial-and-error method has been unprecedentedly challenged in the modern era when the number of components and phases in novel alloys keeps increasing, with high-entropy alloys as the representative. New opportunities emerge for alloy design in the artificial intelligence era. Here a successful machine-learning (ML) method is developed to identify the microstructure images with eye-challenging morphology for a number of martensitic and ferritic steels. Assisted by it, a new neural-network method is proposed for the inverse design of alloys with 20 components, which can accelerate the design process based on microstructure. The method is also readily applied to other material systems given sufficient microstructure images. This work lays the foundation for inverse alloy design based on microstructure images with extremely similar features.

36 MATERIALS SCIENCE↗

Anion-derived contact ion pairing as a unifying principle for electrolyte design

Enabling new electrochemical technologies requires systems that can operate under ever-more demanding conditions, and progress in energy storage applications reveals tantalizing opportunities to reimagine electrolyte design for performance at extreme potentials. Here, a common thread among these innovations is the formation of significant populations of contact ion pairs (CIPs) in the electrolyte, regardless of the specific cation chemistry or solvent system. The examples summarized in this review suggest that a set of general electrolyte design rules likely exists, where the purposeful selection of anion chemistry can yield CIP structures with tunable control over reaction thermodynamics, kinetics, and interphase chemistry. Identifying the relevant descriptors for high-performance, anion-derived CIP structures can be achieved utilizing a combined experimental and computational approach, aided by machine learning and artificial intelligence, to more rapidly survey the vast combinatorial space available and to enable a new generation of electrolytes for decarbonized electrochemical processes at scale.

electrochemistry↗

The Steady State Challenge for Soft X-Ray Diagnostics on Wendelstein 7-X Stellarator

The steady state operation of Wendelstein 7-X stellarator presently under construction in Greifswald poses special challenges to the diagnostics development [1, 2]. A critical issue is the heat load on plasma facing components ({approx}500 kW/m{sup 2}) over a long discharge time (up to 30 min), which leads to the necessity of active cooling. As result, the design of the 400 channel soft X-Ray Multi Camera Tomography System (XMCTS) [2, 3] has to cope with dark currents and amplifier drifts due to the heating of active components like photo diodes and in-vessel preamplifiers. In order to allow for a quantitative measurement of dynamic drifts and offsets, a shutter system and blind diodes are considered to compensate these effects. Another important issue is the large amount of data gathered by the XMCT system during long pulse discharges. A fast but less precise online reconstruction is planned, which will give information on the plasma shape and position on a human time scale. The two options under investigation are a Cormack-Inversion method and an approach based on neural networks [4]. Dependent on the available hardware, as much information as possible should be stored for more accurate offline-analysis. An intelligent way of marking interesting data is required. In case that the steady-state storage of all measured data is not feasible, at least this marked data will be stored in high time resolution.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

An Efficient, Scalable IO Framework for Sparse Data: larcv3

Neutrino physics is one of the fundamental areas of research into the origins and properties of the Universe. Many experimental neutrino projects use sophisticated detectors to observe properties of these particles, and have turned to deep learning and artificial intelligence techniques to analyze their data. From this, we have developed \texttt{larcv}, a \texttt{C++} and \texttt{Python} based framework for efficient IO of sparse data with particle physics applications in mind. We describe in this paper the \texttt{larcv} framework and some benchmark IO performance tests. \texttt{larcv} is designed to enable fast and efficient IO of ragged and irregular data, at scale on modern HPC systems, and is compatible with the most popular open source data analysis tools in the Python ecosystem.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Intelligent Manufacturing Support: Specialized LLMs for Composite Material Processing and Equipment Operation

Engineering educational curriculum and standards cover many material and manufacturing options. However, engineers and designers are often unfamiliar with certain composite materials or manufacturing techniques. Large language models (LLMs) could potentially bridge the gap. Their capacity to store and retrieve data from large databases provides them with a breadth of knowledge across disciplines. However, their generalized knowledge base can lack targeted, industry-specific knowledge. To this end, we present two LLM-based applications based on the GPT-4 architecture: (1) The Composites Guide: a system that provides expert knowledge on composites material and connects users with research and industry professionals who can provide additional support and (2) The Equipment Assistant: a system that provides guidance for manufacturing tool operation and material characterization. By combining the knowledge of general AI models with industry-specific knowledge, both applications are intended to provide more meaningful information for engineers. In this paper, we discuss the development of the applications and evaluate it through a benchmark and two informal user studies. The benchmark analysis uses the Rouge and Bertscore metrics to evaluate our models’ performance against GPT-4o. The results show that GPT-4o and the proposed models perform similarly or better on the ROUGE and BERTScore metrics. The two user studies supplement this quantitative evaluation by asking experts to provide qualitative and open-ended feedback about our model’s performance on a set of domain-specific questions. The results of both studies highlight a potential for more detailed and specific responses with the Composites Guide and the Equipment Assistant.

Kapoor, Gunnika [Oak Ridge National Laboratory (OR↗

From smart homes to smart laboratories: connected instruments for materials science

The current focus on artificial intelligence and machine learning in the scientific community has the potential to greatly speed up discovery. In this article, we explore what a “smart facility” would mean for materials science. We propose to capture meta-data at every step of an experiment, including materials synthesis, sample production and characterization, simulation, and the analysis software used to extract information. Although most of this information is captured in various institutional systems and staff logbooks, more insight could be obtained by connecting this information through a system that allows automation. AI-enabled processes built on such a system would have the potential of making experiment planning easier and minimize the time between experiment and publication.

Doucet, Mathieu↗

System-on-chip upgrade of millimeter-wave imaging diagnostics for fusion plasma

Monolithic, millimeter wave “system-on-chip” technology has been employed in chip heterodyne radiometers in a newly developed Electron Cyclotron Emission Imaging (ECEI) system on the DIII-D tokamak for 2D electron temperature and fluctuation diagnostics. The system employs 20 horn-waveguide receiver modules each with customized W-band (75–110 GHz) monolithic microwave integrated circuit chips comprising a W-band low noise amplifier, a balanced mixer, a ×2 local oscillator (LO) frequency doubler, and two intermediate frequency amplifier stages in each module. Compared to previous quasi-optical ECEI arrays with Schottky mixer diodes mounted on planar antennas, the upgraded W-band array exhibits >30 dB additional gain and 20× improvement in noise temperature; an internal eight times multiplier chain is used to provide LO coupling, thereby eliminating the need for quasi-optical coupling. The horn-waveguide shielding housing avoids out-of-band noise interference on each module. The upgraded ECEI system plays an important role for absolute electron temperature and fluctuation measurements for edge and core region transport physics studies. An F-band receiver chip (up to 140 GHz) is under development for additional fusion facilities with a higher toroidal magnetic field. Visualization diagnostics provide multi-scale and multi-dimensional data in plasma profile evolution. Finally, a significant aspect of imaging measurement is focusing on artificial intelligence for science applications.

47 OTHER INSTRUMENTATION↗

Emerging Threats and Technology Investigation: Industrial Internet of Things - Risk and Mitigation for Nuclear Infrastructure

Industries supporting the global nuclear infrastructure striving for cost savings, expansions in efficiency, and convenience are likely to adopt components (e.g., hardware, software) that comprise the Internet of Things (IoT) and Industrial Internet of Things (IIoT). These devices offer potential improvements along with security challenges. Modern conveniences achieved through application of technology have propagated through society in the form of interconnected devices, from doorbells to microwave ovens, commonly referred to as IoT. IoT devices are often Internet-connected devices that are designed to send data back to a cloud-based server, where a smart phone application then presents device status and control options. Home-based IoT applications carry a different set of risks when compared to a business or security environment, where there is also a history of convenience and interconnection. Industrial settings have long relied on specifically designed Supervisory Control and Data Acquisition (SCADA) systems for process control where IIoT devices are intended to inform business decisions and augment traditional processes. A recent National Institute of Standards and Technology (NIST) report provides a distinction between process control and IIoT in that traditional process control is not replaced by IIoT, but rather IIoT devices are intended to enhance industrial processes through additional monitoring of various sensors and application of data analytics models using artificial intelligence (AI) and machine learning (ML) (Fagan, Marron, et al. 2021) (Ross, et al. 2021).

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

Introduction to structure from motion and its applications in remote sensing

This talk discusses my experience at Los Alamos National Laboratories developing the Wide Area Persistent Surveillance (WAPS) system AngelFire and the problems with working with low resolution surface models. This experience provided a motivation to seek solutions to utilize the redundant WAPS imagery to build surface models of the urban environment. Structure from Motion (SfM) is a process that takes multiple view imagery and compute the 3D structure of a scene. We will walk through the basic algorithm and discuss areas for optimization. Military services and intelligence agencies face long-standing challenges with processing, exploiting, and disseminating ISR data. The problem is that too much data is being produced and not enough people to look at it and the problem is not going away. As a result of this data overload, we need to shift the way we think about data and find creative ways to use and present it so it can be easily digested by decision makers. SfM also provides a means for developing a data processing and organization architecture. Applications for various remote sensing applications will be discussed for motivation for why SfM and Multi-View Stereo rendering is an important area that needs to be continued to be developed.

47 OTHER INSTRUMENTATION↗

NREL, Industry Collaboration to Usher in New Wave of Autonomous Vehicle Research

In an important step toward advancing intelligent, efficient, and autonomous electric vehicles, the National Renewable Energy Laboratory (NREL) plans to partner on research and development efforts with EasyMile, a smart mobility solutions company. EasyMile provided a demo of its driverless EZ10 shuttle on the NREL campus in September 2017.

33 ADVANCED PROPULSION SYSTEMS↗