Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “kernel”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,279 records · Page 71

nPINNs: nonlocal Physics-Informed Neural Networks for a parametrized nonlocal universal Laplacian operator. Algorithms and Applications

Physics-informed neural networks (PINNs) are effective in solving inverse problems based on differential and integro-differential equations with sparse, noisy, unstructured, and multifidelity data. PINNs incorporate all available information, including governing equations (reflecting physical laws), initial-boundary conditions, and observations of quantities of interest, into a loss function to be minimized, thus recasting the original problem into an optimization problem. In this paper, we extend PINNs to parameter and function inference for integral equations such as nonlocal Poisson and nonlocal turbulence models, and we refer to them as nonlocal PINNs (nPINNs). The contribution of the paper is three-fold. First, we propose a unified nonlocal Laplace operator, which converges to the classical Laplacian as one of the operator parameters, the nonlocal interaction radius δ goes to zero, and to the fractional Laplacian as δ goes to infinity. This universal operator forms a super-set of classical Laplacian and fractional Laplacian operators and, thus, has the potential to fit a broad spectrum of data sets. We provide theoretical convergence rates with respect to δ and verify them via numerical experiments. Second, we use nPINNs to estimate the two parameters, δ and α, characterizing the kernel of the unified operator. The strong non-convexity of the loss function yielding multiple (good) local minima reveals the occurrence of the operator mimicking phenomenon, that is, different pairs of estimated parameters could produce multiple solutions of comparable accuracy. Third, we propose another nonlocal operator with spatially variable order α(γ), which is more suitable for modeling turbulent Couette flow. Our results show that nPINNs can jointly infer this function as well as δ. More importantly, these parameters exhibit a universal behavior with respect to the Reynolds number, a finding that contributes to our understanding of nonlocal interactions in wall-bounded turbulence.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

CEED-MS34: Improve performance and capabilities of CEED-enabled ECP applications on Summit/Sierra. Exascale Computing Project Milestone Report

The main goal of this milestone was to help CEED-enabled ECP applications, including ExaSMR, MARBL, ExaWind and ExaAM, to improve their performance and capabilities on GPU systems like Summit and Lassen/Sierra. In addition, the CEED team also worked to: add and improve support for additional hardware and programming models in the CEED software components; release the next version of the CEED software stack, CEED-3.0; and demonstrate performance of libParanumal kernels in libCEED, Nek and MFEM. These additional tasks contributed directly to the main CEED-MS34 goal and will also play an important role in CEED’s future milestones.

97 MATHEMATICS AND COMPUTING↗

Monolithic ATF MiniFuel Sample Capsules Ready for HFIR Insertion

Several advanced nuclear fuel concepts are being considered throughout the nuclear industry. Implementation of these concepts could increase accident tolerance or enhance performance beyond the capabilities of the UO₂-based nuclear fuel currently in use. Qualification and deployment of any new fuel requires rigorous irradiation testing to demonstrate performance under representative normal and off-normal operating conditions. The traditional approach for qualifying new fuels requires exhaustive execution of many integral fuel tests. However, due to the long timeframe for executing these integral tests and the limited number of available materials test reactors, this approach is becoming impractical. To accelerate fuel qualification, Oak Ridge National Laboratory developed the MiniFuel irradiation vehicle for use in conducting accelerated separate effects irradiation testing of a wide range of nuclear fuel materials in the High Flux Isotope Reactor (HFIR). The first MiniFuel irradiations performed in the facility tested sol gel–derived uranium nitride kernels and tristructural isotropic (TRISO)-coated particle fuels. This report describes the preparation and assembly of the first set of monolithic MiniFuel irradiations conducted to support accident-tolerant fuel (ATF) development and accelerated fuel qualification. Two irradiation targets containing a variety of UO₂ and U₃Si₂ disk fuel specimens were fabricated and assembled for irradiation to burnups of 8-10 and 28-40 MWd/kg U. The target irradiation temperature is 450-550°C. Irradiation of U₃Si₂ will provide new data regarding the irradiation performance of a candidate ATF to complement current ATF-1 integral experiments being performed in the Advanced Test Reactor. UO₂ samples were included as a reference so that the results from the MiniFuel experiments can be compared with the extensive UO₂ fuel performance database. The monolithic MiniFuel capsules were successfully assembled, welded, and tested per HFIR requirements and are ready for insertion into the reactor. Pictures of the assembly process are included in this report. The experiment is planned for insertion into the HFIR during cycle 487 in April 2020.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Quantitative Performance Assessment of Proxy Apps and Parents (ECP Proxy App Project Milestone ADCD-504-9)

This report presents highlights of these efforts. Section 2 describes work that has been done to compare the performance of proxy applications on AMD MI60 vs. Nvidia V100 GPUs. So far only a small set of ECP proxies are running on AMD GPUs, but we will continue to expand this analysis as additional proxies become available. We find that although the MI60 and V100 have nearly the same measured memory bandwidth, memory bound proxy app kernels perform 20-30% worse on the MI60. Further work is needed to refine these comparisons to determine whether the root cause is due to differences in the hardware, software stack, platform specific optimization, or some combination of the three. Section 3 describes our continuing effort to find methods to accurately assess the similarity of proxies and parents. We have recently seen very encouraging results using a cosine similarity metric. This technique uses the angle between two vectors of hardware performance counters to characterize the similarity (or difference) between two applications or proxies. We show not only that several widely used proxies are highly similar to their parents, but also that they differ from non-related codes. We also show that cosine similarity can be used to identify gaps and redundancies in suites and even to gain insight into the effects of architectural differences between platforms. Our work on assessing the Exascale toolchain is ongoing. Our successes with performance measurement tools are evident from the data provided in this report. However, our assessments across the broader tool chain are still too incomplete to provide a meaningful report at this time. We will continue to assess tools and work with vendors and third party developers as issues are identified.

97 MATHEMATICS AND COMPUTING↗

Program Verification for Extreme-Scale Applications (Final Scientific/Technical Report)

The project seeks to develop tools and techniques to help software developers verify the correctness and accuracy of their code. The target domain is scientific software of the kind widely used and developed in the Department of Energy research community, with a particular focus on "extreme scale" programs - those that are expected to involve possibly millions of parallel threads of execution. The report covers the University of Delaware contribution to the collaborative project. The project had a number of successful outcomes, especially regarding the development and extension of the CIVL software verification framework. CIVL is a verification tool for C or Fortran programs that use MPI, OpenMP, CUDA, and/or Pthreads for parallelization. CIVL went through vast improvements and extensions, and was successfully applied to a number of challenging codes. It found a subtle bug in the Devito PDE framework. It was able to verify the functional correctness of a conjugate gradient solver using a novel probabilistic technique with vanishingly small chance of error. CIVL was used very successfully in verification competitions, and the CIVL solutions to the competition challenges were presented and published. CIVL was also used successfully by other researchers on a computational chemistry kernel.

97 MATHEMATICS AND COMPUTING↗

Bilevel parameter optimization for learning nonlocal image denoising models

We propose a bilevel optimization approach for the estimation of parameters in nonlocal image denoising models. The parameters we consider are both the space-dependent fidelity weight and weights within the kernel of the nonlocal operator. In both cases we investigate the differentiability of the solution operator in function spaces and derive a first order optimality system that characterizes local minima. For the numerical solution of the problems, we propose a second-order trust-region algorithm in combination with a finite element discretization of the nonlocal denoising models and we introduce a computational strategy for the solution of the resulting dense linear systems. Several experiments illustrate the applicability and effectiveness of our approach.

97 MATHEMATICS AND COMPUTING↗

A Unified Theory of Fractional Nonlocal and Weighted Nonlocal Vector Calculus

Nonlocal and fractional-order models capture effects that classical partial differential equations cannot describe; for this reason, they are suitable for a broad class of engineering and scientific applications that feature multiscale or anomalous behavior. This has driven a desire for a vector calculus that includes nonlocal and fractional gradient, divergence and Laplacian type operators, as well as tools such as Green's identities, to model subsurface transport, turbulence, and conservation laws. In the literature, several independent definitions and theories of nonlocal and fractional vector calculus have been put forward. Some have been studied rigorously and in depth, while others have been introduced ad-hoc for specific applications. The goal of this work is to provide foundations for a unified vector calculus by (1) consolidating fractional vector calculus as a special case of nonlocal vector calculus, (2) relating unweighted and weighted Laplacian operators by introducing an equivalence kernel, and (3) proving a form of Green's identity to unify the corresponding variational frameworks for the resulting nonlocal volume-constrained problems. The proposed framework goes beyond the analysis of nonlocal equations by supporting new model discovery, establishing theory and interpretation for a broad class of operators, and providing useful analogues of standard tools from the classical vector calculus.

97 MATHEMATICS AND COMPUTING↗

Improving the performance of medical imaging applications using SYCL

As opposed to the Open Computing Language (OpenCL) programming model, in which host and device codes are generally written in different programming languages, SYCL can combine host and device codes for an application in a type-safe way to improve development productivity and performance portability. Hence, this report shows the experimental results of applying the SYCL programming model to medical imaging applications for a study on performance portability and programming productivity between OpenCL and SYCL. Rodinia is a widely used open-source benchmark suite for heterogeneous computing. We choose two medical imaging applications (Heart Wall and Particle Filter) in the benchmark suite, migrate the OpenCL implementations of the applications to the SYCL implementations, and evaluate their performance and productivity on Intel® microprocessors that contain a central processing unit (CPU) and an integrated graphics processing unit (GPU). The maturing SYCL compilers, which are based on a conformant implementation of the SYCL 1.2.1 Khronos specification, have been actively optimized for Intel® computing platforms. The experimental results are promising in terms of the raw performance and productivity. Although the SYCL implementation of the Heart Wall application does not execute successfully on a CPU, the SYCL implementations of the application can achieve comparable or better performance than the OpenCL implementation on Intel® integrated GPUs. For the Particle Filter application, the performance difference between the SYCL and OpenCL implementations is comparable on the GPUs for most cases, but the SYCL implementations are on average 4X faster than the OpenCL implementations on Intel® Xeon® CPUs. For programming productivity, we arguably use lines of code as a way to measure programming productivity in software. The SYCL programs reduce the lines of code of the OpenCL programs by 52% and 38% for the Heart Wall and Particle Filter, respectively. The results indicate that SYCL is a promising programming model for heterogeneous computing with the maturing compilers. We organize the remainder of the report as follows. Section II introduces the SYCL programming model, compares the major differences between an OpenCL program and a SYCL program, and describes the characteristics of the two applications. Section III describes the SYCL programming model in more details, and shows the SYCL implementation of a kernel function in the Particle Filter application as an example. In Section IV, we evaluate the performance of the applications on the CPUs and GPUs. Section V concludes the report.

59 BASIC BIOLOGICAL SCIENCES↗

FLC Notable Technology Award Oleo-Furan Surfactant

It’s a well-kept secret that laundry detergents are harmful to the environment. The important chemical in laundry detergent, called a surfactant. Surfactants are the workhorses of laundry detergent and soaps, and they're attracted to things like grease on your hands and dirt in your clothes to wash them away. Surfactants are used in everything from shampoo, hand soap, laundry detergent, and cosmetics. Many current surfactants are made from petroleum feedstock. These petroleum-derived building blocks come with a big carbon footprint. As the need for greener feedstock alternatives for synthesizing surfactants became obvious, manufacturers turned to natural oils, such as palm kernel and coconut oil. However, these oils are costly, particularly in areas where they are not domestically produced, and using them for surfactant synthesis competes with the food supply chain. Surfactants deactivate and do not work in hard water. Hard water is common - 85% of the U.S. water supply is considered hard because of the presence of small metal ions. These metal ions cover the surfactants making them useless. To solve this problem, many manufacturers add chemicals called chelators to bind the metal ions and make the water less hard, enhancing the effectiveness of the laundry detergent. However, this solution leads to more problems, including increased cost of detergent production and a large output of environmentally harmful chemicals. There remains a strong need for effective laundry detergents that do not negatively impact the environment and are available to consumers at an affordable cost. The American Cleaning Institute (ACI), a surfactant manufacturer organizing body, is emphasizing commitment to developing bio-renewable alternatives to current surfactants in laundry detergents. That’s why chemists at SIRONIX Renewables partnered with Los Alamos National Laboratory to further develop Oleo-furan surfactants (OFS). OFS are a new class of non-toxic, non-irritating surfactants for laundry detergent. It is the only surfactant that performs effectively in cold and hard water without chelators to bind the metal ions in hard water. OFS can be produced readily from sustainable, bio-derived molecules. They are multi-functional molecules - performing the role of a surfactant and a chelator in one - and are completely bio-degradable. OFS does not rely on petroleum feedstock and is synthesized from non-food, bio-renewable cellulosic feedstock. OFS solves each of the pertinent problems facing detergents and our environment today.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Analysis of Tempered Fractional Operators

Tempered fractional operators are useful in models for subsurface transport and diffusion due to their ability to capture anomalous diffusion: a behavior which the classical partial differential equation models cannot describe. We analyze tempered fractional operators within the nonlocal vector calculus framework in order to assimilate them to the rigorous mathematical structure developed for nonlocal models. First, we show they are special instances of generalized nonlocal operators in correspondence of a proper choice of nonlocal kernels. Then, we work towards showing tempered fractional operators are equivalent to truncated fractional operators. These truncated operators are useful because they are less computationally intensive than the tempered operators.

97 MATHEMATICS AND COMPUTING↗

Analysis of Tempered Fractional Operators

Tempered fractional operators provide an improved predictive capability for modeling anomalous effects that cannot be captured by standard partial differential equations. These effects include subdiffusion and superdiffusion (i.e. the mean square displacement in a diffusion process is proportional to a fractional power of the time), that often occur in, e.g., geoscience and hydrology. We analyze tempered fractional operators within the nonlocal vector calculus framework in order to assimilate them to the rigorous mathematical structure developed for nonlocal models. First, we show they are special instances of generalized nonlocal operators by means of a proper choice of the nonlocal kernel. Then, we present a plan for showing tempered fractional operators are equivalent to truncated fractional operators. These truncated operators are useful because they are less computationally intensive than the tempered operators.

97 MATHEMATICS AND COMPUTING↗

The Kokkos Ecosystem [Brief]

In 2016/2017, the field of High-Performance Computing (HPC) entered a new era driven by fundamental physics challenges to produce ever more energy and cost-efficient processors. Since the convergence on the Message-Passing Interface (MPI) standard in the mid-1990s, application developers enjoyed a seemingly static view of the underlying machine — that of a distributed collection of homogeneous nodes executing in collaboration. However, after almost two decades of dominance, the sole use of MPI to derive parallelism acted as a limiter to improved future performance. While MPI is widely expected to continue to function as the basic mechanism for communication between compute nodes for the immediate future, additional parallelism is required on the computing node itself if high performance and efficiency goals are to be realized. When reviewing the architectures of the top HPC systems today, the change in paradigm is clear: the compute nodes of the leading machines in the world are either powered by many-core chips with a few dozen cores each, or use heterogeneous designs, where traditional CPUs marshal work to massively parallel compute accelerators which has as many as 200,000 processing threads in flight simultaneously. Complicating matters further for application developers, each processor vendor has its own preferred way of writing code for their architecture.The Kokkos EcoSystem was released by Sandia in 2017 to address this new era in HPC system design by providing a vendor independent performance portable programming system for scientific, engineering, and mathematical software applications written in the C++ programming language. Using Kokkos, application developers can be more productive because they will not have to create and maintain separate versions of their software for each architecture, nor will they have to be experts in each architecture's peculiar requirements. Instead, they will have a single method of programming for the diverse set of modern HPC architectures. While Kokkos started in 2011 as a programming model only, it soon became clear that complex applications needed more. It is also critical to have a portable mathematical functions and developers need tools to debug their applications, gain insight into the performance characteristics of their codes and tune algorithm performance parameters through automated processes. The Kokkos EcoSystem addresses those needs through its three main components: the Kokkos Core programming model, the Kokkos Kernels math library, and the Kokkos Tools project.

97 MATHEMATICS AND COMPUTING↗

Genetic Algorithm for Hyperparameter Optimization in Gaussian Process Modeling

A genetic algorithm is developed and applied to optimize hyperparameters of convolutional recursively determined dual neural network-Gaussian process (NNGP) kernels. As a specific application of the combined GPNN-GA algorithm, it is applied to image classification in publicly available data of Hyper Suprime-Cam Subaru Strategic Program. Matthews correlation coefficient is calculated based on results of binary star-galaxy classification and used as a fitting function of the GA module of the algorithm. The simulation results confirm significant improvement of the classification accuracy with optimized hyperparameters.

79 ASTRONOMY AND ASTROPHYSICS↗

Advanced Visualization of Silent Error Propagation in HPC Applications

Last year, we refactored the major components of the SpotSDC visualization platform and added a visualization component for fault tolerance boundary. Also, we designed a new analysis framework to understand an application resiliency with a significantly less amount of samples compared to previous approaches. We evaluated the visualization platform and analysis framework for multiple critical HPC computation kernels and collected evidence for the effectiveness of the method developed.

97 MATHEMATICS AND COMPUTING↗

Multimodal Deep Learning for Flaw Detection in Software Programs

We explore the use of multiple deep learning models for detecting flaws in software programs. Current, standard approaches for flaw detection rely on a single representation of a software program (e.g., source code or a program binary). We illustrate that, by using techniques from multimodal deep learning, we can simultaneously leverage multiple representations of software programs to improve flaw detection over single representation analyses. Specifically, we adapt three deep learning models from the multimodal learning literature for use in flaw detection and demonstrate how these models outperform traditional deep learning models. We present results on detecting software flaws using the Juliet Test Suite and Linux Kernel.

97 MATHEMATICS AND COMPUTING↗

Joint Analysis of Program Data Representations using Machine Learning for Improved Software Assurance and Development Capabilities

We explore the use of multiple deep learning models for detecting flaws in software programs. Current, standard approaches for flaw detection rely on a single representation of a software program (e.g., source code or a program binary). We illustrate that, by using techniques from multimodal deep learning, we can simultaneously leverage multiple representations of software programs to improve flaw detection over single representation analyses. Specifically, we adapt three deep learning models from the multimodal learning literature for use in flaw detection and demonstrate how these models outperform traditional deep learning models. We present results on detecting software flaws using the Juliet Test Suite and Linux Kernel.

97 MATHEMATICS AND COMPUTING↗

A White Paper: Disposition Options for a High-Temperature Gas-Cooled Reactor

The high-temperature gas-cooled reactor (HTGR) is a uranium-fueled, graphite-moderated, gas-cooled nuclear reactor design concept capable of producing very high core outlet temperatures. Both types of HTGR have the tristructural isotropic (TRISO) fuel kernel at the heart of the fuel design. For the prismatic block-type HTGR, the TRISO particles are overcoated with a resinated graphitic matrix and pressed into fuel compacts, which are then heat treated and placed in the fuel channels of the prismatic-block-shaped fuel assemblies. For the pebble-bed-type HTGR, the TRISO particles are dispersed in a graphitic-matrix sphere, which is the basic unit for the reactor core. Despite having very different fuel designs, both types of HTGR are graphite-moderated, gas-cooled, thermal reactors using many of the same materials. As a result, both prismatic-block-type and pebble-bed-type HTGRs have similar radioactive waste streams, all of which require safe and secure storage and eventual disposition. Modern HTGR designs are based on a long and rich operating history of several different graphite-moderated, gas-cooled, thermal reactors. Several of these reactors have been shut down, the fuel has been placed in safe storage, and they have undergone some degree of decommissioning. As such, there is significant experience in the management of the spent nuclear fuel (SNF) and radioactive wastes associated with operating these reactors. This white paper will, (1) identify the definitions and regulations that apply to the safe and secure management, storage, and disposal of radioactive waste; and (2) identify the key radioactive waste streams from HTGRs and their characteristics. Idaho National Laboratory (INL) has significant experience in the management of SNF from HTGR predecessors. This experience should form the basis for the management and disposition efforts of the radioactive waste from any new HTGR-type small modular reactor, or microreactor intended for deployment at the INL site.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Radial Deconsolidation and Leach-Burn-Leach of AGR-3/4 Compact 1-4 and 10-4

The Advanced Gas Reactor (AGR) Fuel Development and Qualification Program third and fourth irradiation experiments (AGR-3/4), originally planned as separate tests, were combined in one test train for irradiation in the Advanced Test Reactor at Idaho National Laboratory (INL). The irradiation test began on December 14, 2011 and ended on April 12, 2014 (Collin 2016). The originally planned AGR-3 and AGR-4 irradiation experiments were both focused on obtaining data on fission product transport to support the improvement of modeling. The AGR-3 experimental plan was focused on gaseous and metallic fission product release from the kernels and diffusion in the coatings during irradiation and postirradiation safety testing. The AGR-4 experimental plan was focused on diffusivities and sorptivities in the compact matrix and reactor graphite (Petti et al. 2005). These two goals were combined in the AGR-3/4 irradiation, which consisted of twelve independently monitored capsules that each contained four AGR-3/4 compacts in a single stack surrounded by an inner ring of matrix or graphite and an outer ring of graphite. There were two capsule types: a standard capsule and a “fuel body”, in which the outer graphite ring included a floor and cap that fully enclosed the fuel (Stempien et al. 2018a). The fuel body design supported post-irradiation safety testing of the intact fuel and ring assembly to provide data on fission product transport and release from matrix and graphite at accident temperatures (Demkowicz 2017).

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗