Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “METRICS”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,225 records · Page 68

PyPVRPM: Photovoltaic Reliability and Performance Model in Python

The ability to perform accurate techno-economic analysis of solar photovoltaic (PV) systems is essential for bankability and investment purposes. Most energy yield models assume an almost flawless operation (i.e., no failures); however, realistically, components fail and get repaired stochastically. This package, PyPVRPM, is a Python translation and improvement of the Language Kit (LK) based PhotoVoltaic Reliability Performance Model (PVRPM), which was first developed at Sandia National Laboratories in Goldsim software (Granata et al., 2011) (Miller et al., 2012). PyPVRPM allows the user to define a PV system at a specific location and incorporate failure, repair, and detection rates and distributions to calculate energy yield and other financial metrics such as the levelized cost of energy and net present value (Klise, Lavrova, et al., 2017). Our package is a simulation tool that uses NREL’s Python interface for System Advisor Model (SAM) (National Renewable Energy Laboratory, 2020b) (National Renewable Energy Laboratory, 2020a) to evaluate the performance of a PV plant throughout its lifetime by considering component reliability metrics. Besides the numerous benefits from migrating to Python (e.g., speed, libraries, batch analyses), it also expands on the failure and repair processes from the LK version by including the ability to vary monitoring strategies. These failures, repairs, and monitoring processes are based on user-defined distributions and values, enabling a more accurate and realistic representation of cost and availability throughout a PV system’s lifetime.

97 MATHEMATICS AND COMPUTING↗

Comparative Assessment of U-Net-Based Deep Learning Models for Segmenting Microfractures and Pore Spaces in Digital Rocks

Segmentation of high-resolution X-ray microcomputed tomography (µCT) images is crucial in digital rock physics (DRP), affecting the characterization and analysis of microscale phenomena in the porous media. The complexity of geological structures and nonideal scanning conditions pose significant challenges to conventional image segmentation approaches. Motivated by the recent increasing popularity of deep learning (DL) techniques in image processing, this work undertakes a comparative study of DL models, specifically U-Net and its variants, for segmenting multiple targets with distinguished features in digital rocks, including discrete fracture networks (DFNs), pore spaces, and solid rock. Particularly, DFNs have a smaller volumetric fraction over others, bringing in a substantial challenge of imbalanced segmentation. The primary focus is to evaluate the architecture and feature enhancement strategies of various DL models, including U-Net, attention U-Net, residual U-Net, U-Net++, and residual U-Net++. The models were designed as 2.5D, utilizing a central 2D image and its two adjacent upper and lower 2D images as input to provide a pseudo-3D context. In addition, because the ground truth of segmentation was unknown for real-world digital rocks, we created a benchmark data set following the inverse operations of segmentation. The data synthesis started from the label images (i.e., solid rock, pore spaces, and DFNs), followed by simulating partial volume blurring, adding random background noise, and introducing ring artifacts to mimic real raw X-ray µCT images. The data set, which included various rock types (i.e., sandstone and artificial data), scanning resolution, and magnitudes of noise and artifacts, was divided into training and testing data sets with a 90% and 10% ratio, respectively. Moreover, in addition to the conventional pixel-wise evaluation metrics, the physics-based metric of the lattice-Boltzmann method (LBM) simulated permeability provided more comprehensive assessments. The results demonstrated that the residual connections, nested architectures, and redesigned skip connections contribute to the model performance and give the residual U-Net++ the highest accuracy. The improvements were mainly on the boundaries and small targets, especially the DFNs, which dominate the interconnectivity and therefore affect the permeability greatly. This study also rigorously evaluated the efficiency and generalization of each model, demonstrating that the sophisticated architectures achieved excellent practicability and maintained robust performance on completely unseen data, ensuring their suitability for diverse and challenging DRP applications.

58 GEOSCIENCES↗

Wyoming CarbonSAFE: Advancing Commercialization of Low-Carbon Energy Technologies in Fossil-Rich Wyoming

Wyoming’s Powder River Basin (PRB) is the most prolific coal producer and exporter in the United States and the State of Wyoming’s largest oil-producing basin. In addition to being a leading energy producer, the PRB is the site of research programs whose aim is to develop and integrate low-carbon technologies into existing fossil fuel energy industries. Much of the PRB’s low-carbon research is focused around Dry Fork Station (DFS), which is the newest coal-fired power station in the western US. Currently, DFS hosts five carbon capture projects, including pilot-scale capture projects that utilize different capture technologies and a full front-end engineering and design (FEED) study, a commercial CO 2 pipeline for nearby CO 2 -enhanced oil recovery industry, and is also co-located with the Wyoming Integrated Test Center, which is a host facility for unconventional carbon utilization research (i.e. flue gas carbon-to-products innovations). DFS is also the host site for the Wyoming CarbonSAFE project. Wyoming CarbonSAFE, funded by the Department of Energy/National Energy Technology Laboratory, is a multi-phased program (currently in Phase II) whose core objective is developing and validating storage sites within a complex capable of storing 50 million metric tonnes of CO 2 over a 30 year project period using carbon capture, utilization and storage (CCUS). This paper will provide an overview of the project to-date, showing that CarbonSAFE goals are achievable with respect to geologic, environmental, regulatory, CO 2 source and economic conditions, and why the State of Wyoming offers one of the more favorable environments to advance the commercialization studies. In 2019, the project team designed and completed a ~10,000 foot stratigraphic test well just south of DFS. From this well, the team collected over 600 feet of core, fluid samples from target injection zones, and a full petrophysical log suite. In addition, legacy 2D seismic lines were acquired and a 3D seismic survey was acquired in the fall of 2020. The objective of these field activities has been to identify and characterize target storage reservoirs and associated caprock. This complex has several reservoirs that could meet commercial injection goals, and over 4000 feet of associated caprock. Simulations of site performance suggest that stacked injection provides the most effective storage strategy, and would necessitate several sites within the greater complex to meet final project injection goals. Other work within this project includes the development of a business-case around proximal fields with CO 2 -enhanced oil recovery potential and existing tax credits, assessment of regulatory conditions, including pore space ownership and Class VI injection well permitting requirements, implementation of a robust public outreach Electronic copy available at: https://ssrn.com/abstract=3821220 GHGT-15 McLaughlin 2 program, and surface site characterization activities that have focused on environmental factors. In the PRB and at DFS, the State of Wyoming and other entities have made carbon management a priority of its future energy industry by providing a regulatory and business framework that is favorable to advancing these technologies. These endeavors will become more realistic with the successful implementation of Wyoming CarbonSAFE, and its ability to secure and validate commercial-scale CCUS at the center of Wyoming’s premier low-carbon research efforts.

McLaughlin, Fred↗

Metaheuristic Optimization Tool

The metaheuristic optimization tool (MOT) is a generic python module for solving a real value, multiobjective, multidimensional optimization problem. Users design their optimization problem by defining search variables, simulations, evaluation metric functions, and constraints. Search variables and constraints are straightforwardly added via python object methods, while simulations and metric functions used for search variable set evaluation must be implemented as a python class. Final optimum result(s) are provided in a tabular text file, as well as search history if needed.

97 MATHEMATICS AND COMPUTING↗

Optimization of Geometric Perturbations on a Rod Moving Through a High Explosive Target

After completing a study to ensure the simulation results were converged, several high resolution 3D Smoothed Particle Hydrodynamic (SPH) simulations of copper rods impacting a high explosive (LX14) target were performed. This was then formulated into an optimization problem: I wanted to find the optimum shape and location of a perturbation on the rod that would maximize its erosion after it left the target. The shape of the perturbation was modeled as a 2D Gaussian bump and parameterized by its location along the rod axis (z 0 ) and amplitude (A). The final mass of the coherent part of the rod as it leaves the target was used as a metric to represent the erosion of the rod, and the optimization was formulated to maximize this metric with respect to the aforementioned design variables. Due to the expensive nature of the high-fidelity 3D SPH simulations, a surrogate model needed to be chosen so that many function calls to the optimizer would be feasible. Thus, a strategic full factorial sampling plan was chosen to build a dataset, which consisted of 24 high-fidelity simulations. Two surrogate models, a third order polynomial regression model and a Gaussian Process Model, were analyzed using a 14%/86% test/train holdout technique. The root mean square and R2 score of the test set was used to determine the best model, and the third order polynomial regression model was chosen as the surrogate model. Finally, the Nelder-Mead Simplex and Basin-hopping optimization algorithms were implemented, and it was found that the two algorithms gave slightly different optimum values. Nelder-Mead gave an optimum point of [z* 0 ;A*] = [9:9;0:4] and Basin-Hopping gave an optimum value of x* = [z* 0 ;A*] = [9:2;0:1].

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

Understanding Material Strength Variabilities and Uncertainties for Component Qualification (2020 LDRD Final Report)

At its core, material specification and materials qualification require an understanding of the uncertainties in relation to a given performance metric. When simulations are used to inform the design and evaluation of these metrics, it is essential to understand the uncertainties in the underlying models and parameters that feed into those simulations. In this work, we have created a statistical framework to address uncertainties in the materials strength modeling used in integrated simulations. The framework is based on the Bayesian methodology, which allows for uncertainties to be updated as new data become available. The results of this work show how model parameters and their uncertainties can be updated as new and different types of strength data are added, as well as methods for determining which future experiment has the greatest potential to reduce the uncertainty. The statistical framework developed in this project will be utilized to assess and propagate the uncertainties in the strength models used in the programmatic simulations and to create a way to formally update those uncertainties as new data become available.

36 MATERIALS SCIENCE↗

Performance Assessments of Demand Flexibility from Grid-Interactive Efficient Buildings: Issues and Considerations

This SEE Action Network report explains basic concepts and fundamental considerations for assessing the actual demand flexibility performance of buildings participating in demand flexibility programs and responding to time-varying retail rates. Demand flexibility is the capability of distributed energy resources (DERs) to adjust a building’s load profile across different timescales. Assessments determine the timing, location, quantity, and quality of grid services provided. The results can be used for financial settlements and to improve performance of demand flexibility, support its consideration in resource potential studies and electricity system planning, and contribute to cost-effectiveness evaluations. While practitioners and regulators regularly find opportunities to improve performance assessments of demand-related services, to a large degree current best practices are sufficient for basic service offerings as demand flexibility is implemented today. However, advances in assessment practices will be required in a future with grid-interactive efficient buildings (GEBs) that provide continuous demand flexibility by integrating multiple DERs and flexibility modes (load shed, load shift, modulate, and generate). Example practices include using new baseline constructs—including whether baselines are even required for certain building flexibility modes or configurations, deploying more advanced metering and analytics, further developing cybersecurity standards, improving communication standards for increased interoperability, and establishing performance metrics and assessment procedures for load modulation as it is more fully defined and implemented. This report provides information on prioritizing and designing performance assessment elements for demand flexibility programs and time-varying retail rates, assessment protocols, and research and development needs. Additional research sponsored by DOE’s Building Technologies Office offers more detailed technical information on assessing performance of demand flexibility, including definition of performance metrics.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Multi-Mechanism Flood Hazard Assessment: Critical Review of Current Practice and Approaches

This report documents the initial findings from the Nuclear Regulatory commission (NRC)-sponsored research project Methods for Estimating Joint Probabilities of Coincident and Correlated Flooding Mechanisms for Nuclear Power Plant Flood Hazard Assessments.1 This research project is a part of NRC’s Probabilistic Flood Hazard Assessment (PFHA) Research Program and will aid the development of guidance on the use of PFHA methods to evaluate infrastructure safety for existing and proposed US nuclear power plants (NPPs). More specifically, this project intends to provide technical background for the development of flood hazard curves for multi-mechanism floods (MMFs). MMFs are flood events caused by more than one flooding mechanism (e.g., flood events due to the simultaneous occurrence of precipitation-induced river flooding and storm surge). Project activities include three main tasks: Task 1—Survey of current concepts and methods in assessing MMF hazards; Task 2—Critical assessment of selected methods and approaches for quantifying probabilistic MMF hazard risk; Task 3—Development of example case studies to illustrate best practices for quantifying probabilistic MMF hazard risk The initial findings from Tasks 1 and 2 are documented in this report. Task 1 comprised a survey of approaches and methods that have been applied to understand and assess flood hazards due to MMFs. Task 2 involved a critical review of the selected approaches and methods. To that end, the scope of this report includes documentation of (1) a reconnaissance-level survey of the current state of concepts and practice for MMF hazard assessment; (2) a generalized MMF assessment framework to address the distinctions among various types of flood-forcing phenomena, flood mechanisms (grouped into three mechanism types), and flood severity metrics; (3) a wide-ranging survey of approaches and methods that have been applied to various flooding phenomena and settings; and (4) a critical assessment of MMF hazard assessment methods. Studies were identified involving MMFs related to coastal flooding mechanisms, fluvial (rivers/streams) flooding mechanisms, and associated combinations of coastal and fluvial flooding mechanisms. Studies were also identified that address MMFs involving coastal and fluvial flooding mechanisms as well as coastal flooding mechanisms along with extreme precipitation (without specific attribution to fluvial or pluvial mechanisms). The studies identified for review in this report included assessments at varying spatial scales (from local to global) with differing geographic regions of focus using both observed and synthetic data. The majority of studies identified and reviewed were site-specific assessments focusing on relatively short return periods. Studies considered a range of flood severity metrics, made differing assumptions regarding the occurrence of extrema, and used multiple statistical techniques; the use of copulas for the development of joint distributions was a particularly popular analysis technique. The literature review highlighted the differences among existing studies relative to terminology used, means of presenting results, framework and techniques employed, and level of sophistication regarding the number and types of variables considered. Despite the significant diversity in existing studies, the review identified several promising techniques that will be considered in future work under this project, including the development of joint distributions for MMFs using copula and Bayesian-motivated approaches.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

Characterization and Analysis of the Energy-Reporting Accuracy of Connected Devices

Emerging energy-efficient building systems increasingly exhibit greater functionality, often requiring multiple operating modes (e.g. white-tunability for lighting products and data traffic for devices with networked, integrated sensors). This increased functionality makes energy consumption estimates more complex. Given that these functions consume energy, the energy performance of such building systems is dependent on what operating modes they use and how much time they spend in each mode. Devices and systems that can report their own energy consumption mitigate this energy-performance uncertainty. This study explores the energy-reporting accuracy of market-available connected electrical outlets. The study considers two residential-market products (five units each, one outlet per unit) and three commercial-market products (two units each, 18 to 24 outlets per unit) with the ability to report power drawn and/or energy consumed by devices connected to their receptacles. The products were purchased through typical market channels. Pacific Northwest National Laboratory (PNNL) conducted testing in December 2018 at its Connected Lighting Test Bed (CLTB), using a custom-developed test setup and method adapted from industry standards. The setup collected energy-consumption data reported by the outlet devices under test (DUTs) at one-minute intervals and compared that data with measurements taken by a reference meter over a range of test conditions. The residential products reported power draw but not interval or cumulative energy consumption. The commercial products reported both power draw and cumulative energy consumption. Relative reporting error (RRE) was calculated for all measurements, and analysis of the results revealed variations across devices and test conditions. The total number of measurements (50 for each residential product, 60 for each commercial product) offers an appreciable comparison of performance at the make/model level. The average RRE of the residential products derived from reported power draw was -0.02% and -1.20%. The average RRE for two of the three the commercial products derived from reported power draw was worse than those of the residential products (-2.40%, -2.72%, -0.36%). The internal integration of power over time, used to calculate cumulative energy consumption, typically occurs at current and voltage sampling rates much higher than once per minute. This suggests that the average commercial-product RRE derived from reported energy consumption should be very consistent and better than performance based on reported power draw. However, the RRE derived from reported energy consumption varied significantly across the three makes of commercial-market products and was uniformly less accurate than performance based on reported power draw. Subsequent analysis identified a number of root causes for this decrease in performance, most of which were related to reporting resolution. The goals of this study are to generate awareness of building systems capable of reporting their own energy consumption, further interest in the value of energy data for a variety of uses, draw attention to how the accuracy of reported metrics can be characterized, and quantify the performance variation found in marketavailable products. The results of this study and subsequent related work may be relevant to stakeholders in industry-specification and standards-development organizations. The methods this study employs could inform test and measurement procedures and performance classifications for connected outlets, lighting products, and other building systems capable of reporting their own energy consumption. The study concludes with stakeholder recommendations, including the following: • Energy-reporting device and system manufacturers developing products that report energy consumption should characterize the accuracy of reported metrics using a reference meter calibrated by an independent laboratory that was accredited by an ILAC MRA signatory (and whose scope of accreditation explicitly covers energy measurement), and should include this information on product data sheets. • Standards and specification development organizations should develop application-specific performance classifications that end users can understand and relate to their energy-data use needs (e.g., 2% accuracy class for utility streetlight energy billing needs, or 10% accuracy class for ESCO performance verification needs). • Current or potential owners, operators, and specifiers of energy-reporting building systems should rigorously analyze the dependency of current and planned energy-data use cases on accuracy, noting in particular the dependence (or lack thereof) on relative vs. absolute accuracy, and on trueness vs. precision (i.e., repeatability), and should communicate use-case needs to industry standards and specification organizations.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Characterization and Analysis of the Energy-Reporting Accuracy of Connected Devices

Emerging energy-efficient building systems increasingly exhibit greater functionality, often requiring multiple operating modes (e.g. white-tunability for lighting products and data traffic for devices with networked, integrated sensors). This increased functionality makes energy consumption estimates more complex. Given that these functions consume energy, the energy performance of such building systems is dependent on what operating modes they use and how much time they spend in each mode. Devices and systems that can report their own energy consumption mitigate this energy-performance uncertainty. This study explores the energy-reporting accuracy of market-available connected electrical outlets. The study considers two residential-market products (five units each, one outlet per unit) and three commercial-market products (two units each, 18 to 24 outlets per unit) with the ability to report power drawn and/or energy consumed by devices connected to their receptacles. The products were purchased through typical market channels. Pacific Northwest National Laboratory (PNNL) conducted testing in December 2018 at its Connected Lighting Test Bed (CLTB), using a custom-developed test setup and method adapted from industry standards. The setup collected energy-consumption data reported by the outlet devices under test (DUTs) at one-minute intervals and compared that data with measurements taken by a reference meter over a range of test conditions. The residential products reported power draw but not interval or cumulative energy consumption. The commercial products reported both power draw and cumulative energy consumption. Relative reporting error (RRE) was calculated for all measurements, and analysis of the results revealed variations across devices and test conditions. The total number of measurements (50 for each residential product, 60 for each commercial product) offers an appreciable comparison of performance at the make/model level. The average RRE of the residential products derived from reported power draw was -0.02% and -1.20%. The average RRE for two of the three the commercial products derived from reported power draw was worse than those of the residential products (-2.40%, -2.72%, -0.36%). The internal integration of power over time, used to calculate cumulative energy consumption, typically occurs at current and voltage sampling rates much higher than once per minute. This suggests that the average commercial-product RRE derived from reported energy consumption should be very consistent and better than performance based on reported power draw. However, the RRE derived from reported energy consumption varied significantly across the three makes of commercial-market products and was uniformly less accurate than performance based on reported power draw. Subsequent analysis identified a number of root causes for this decrease in performance, most of which were related to reporting resolution. The goals of this study are to generate awareness of building systems capable of reporting their own energy consumption, further interest in the value of energy data for a variety of uses, draw attention to how the accuracy of reported metrics can be characterized, and quantify the performance variation found in marketavailable products. The results of this study and subsequent related work may be relevant to stakeholders in industry-specification and standards-development organizations. The methods this study employs could inform test and measurement procedures and performance classifications for connected outlets, lighting products, and other building systems capable of reporting their own energy consumption. The study concludes with stakeholder recommendations, including the following: • Energy-reporting device and system manufacturers developing products that report energy consumption should characterize the accuracy of reported metrics using a reference meter calibrated by an independent laboratory that was accredited by an ILAC MRA signatory (and whose scope of accreditation explicitly covers energy measurement), and should include this information on product data sheets. • Standards and specification development organizations should develop application-specific performance classifications that end users can understand and relate to their energy-data use needs (e.g., 2% accuracy class for utility streetlight energy billing needs, or 10% accuracy class for ESCO performance verification needs). • Current or potential owners, operators, and specifiers of energy-reporting building systems should rigorously analyze the dependency of current and planned energy-data use cases on accuracy, noting in particular the dependence (or lack thereof) on relative vs. absolute accuracy, and on trueness vs. precision (i.e., repeatability), and should communicate use-case needs to industry standards and specification organizations.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Active Betweenness Cardinality: Algorithms and Applications

Centrality rankings such as degree, closeness, betweenness, Katz, PageRank, etc. are commonly used to identify critical nodes in a graph. These methods are based on two assumptions that restrict their wider applicability. First, they assume the exact topology of the network is available. Secondly, they do not take into account the activity over the network and only rely on its topology. However, in many applications, the network is autonomous, vast, and distributed, and it is hard to collect the exact topology. At the same time, the underlying pairwise activity between node pairs is not uniform and node criticality strongly depends on the activity on the underlying network. In this paper, we propose active betweenness cardinality, as a new measure, where the node criticalities are based on not the static structure, but the activity of the network. We show how this metric can be computed efficiently by using only local information for a given node and how we can find the most critical nodes starting from only a few nodes. We also show how this metric can be used to monitor a network and identify failed nodes. We present experimental results to show effectiveness by demonstrating how the failed nodes can be identified by measuring active betweenness cardinality of a few nodes in the system.

97 MATHEMATICS AND COMPUTING↗

Performance Analysis of PIConGPU: Particle-in-Cell on GPUs using NVIDIA’s NSight Systems and NSight Compute

PIConGPU, Particle In Cell on GPUs, is an open source simulations framework for plasma and laser-plasma physics used to develop advanced particle accelerators for radiation therapy of cancer, high energy physics and photon science. While PIConGPU has been optimized for at least 5 years to run well on NVIDIA GPU-based clusters, there has been limited exploration by the development team of potential scalability bottlenecks using recently updated and new tools including NVIDIA’s NVProf tool and the brand-new NVIDIA NSight Suite (Systems and Compute) tools. PIConGPU is a highly optimized application that runs production jobs at scale on a system Oak Ridge Leadership Facility’s (OLCF) Summit supercomputer (using the full machine at 4600 nodes; at 98% of GPU utilization on all ~28000 NVIDIA Volta GPUs). PIConGPU has been selected as one of the the eight applications for OLCF’s coveted Center for Accelerated Application Readiness (CAAR) program aimed at the facility’s Frontier supercomputer (OLCF’s first exascale system to launch in 2021), to partner with our vendors (primary vendors: AMD and Cray/HPE) ensuring that Frontier will be able to perform large-scale science when it opens to users in 2022. To this effect, performance engineers on the PIConGPU team wanted to dive deep into the application to understand at the finest granularity, which portions of the code could be further optimized to exploit the hardware on Summit at it’s maximum potential and also to elucidate which key kernels should be tracked and optimized for the CAAR effort to port this code to Frontier. Any bottlenecks that are observed via performance profiling on Summit are likely to also impact scalability on the Frontier-dev system and the Frontier Early Access (EA) system. Additionally, the engineers wanted to take a closer look at the newest NVIDIA profiling tools which allows us to identify the most useful features on these tools and will provide an opportunity to compare it to new AMD and Cray’s performance analysis tool releases and provide feedback to our vendor partners on what features are most important and mission critical for CAAR efforts. The primary goal of this report is to focus on the evaluation of PIConGPU’s most time-intensive kernels using NVProf and NSight Suite. Three kernels, Current Deposition (also known as Compute Current), Particle Push (Move and Mark), and Shift Particles are known to be some of the most time-consuming kernels in PIConGPU. The Current xi Deposition kernel and Particle Push kernel both set up the particle attributes for running any physics simulation with PIConGPU, so it is crucial to improve the performance of these two kernels. In this report, we measure single GPU metrics for the three kernels, offer high level takeaways from the conducted analysis, and compare the profiling data from NSight Compute to that of NVProf. This analysis was performed using a grid size of 240 x 272 x 224, and 10 time steps with the Mid-November Figure of Merit (FOM) run setup. The Traveling Wave Electron Acceleration (TWEAC) science case used in this run is a representative science case for PIConGPU. This execution can also be used for baseline analysis on AMD MI50/ MI60 systems. As of the time of writing, the PIConGPU application has limited use for features of NSight Systems, so this report will mainly focus on insights garnered from NSight Compute. For this analysis, we run the “full” metric set available in NSight Compute version 2020.1.2 and use NSight Systems version 2020.3.1 to generate the application timeline.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Component and Circuit Performance Measurements for Coherent Radar - A Systems Perspective

A useful performance metric for Intelligence, Surveillance, and Reconnaissance (ISR) radar systems is the Impulse Response (IPR). This is true for a fidelity metric for the signal channel, as well as a stability measure across multiple pulses. The IPR represents performance with respect to both amplitude and phase modulations of the transfer function for components, circuits, subassemblies, and even the looped radar hardware. The proper IPR performance specification limits will depend on radar operating mode. Generally, it will be the intersection of the strictest requirements.

42 ENGINEERING↗

Eject, crash, or survive: Using machine learning to predict orbital instability of exoplanetary systems

Astronomers throughout history, including titans like Kepler and Newton, have tackled planetary dynamics and orbital instability. Despite strides taken in research, understanding the evolution of planetary orbits remains an intricate, computationally expensive, and analytically unsolved problem. I apply machine learning classification methods to numerical simulations of planetary systems in order to predict the long-term fate of the planet - whether the planet remains in a stable orbit or not. My method uses the first 41.1 years (≤ 500 orbits) of data from a planet’s simulation to calculate 17 dynamically-motivated metrics; I trained my classifier on these features to predict a planet’s stability after 107 years. At 84.33%, my classifier was comparable in accuracy to pre-existing literature, despite using significantly less computational power than most other methods. In my research, I found that the standard deviation of eccentricity, mass ratios for neighboring planets, and semi-major axis ratio with the outer planet neighbor to be the most predictive features of instability. I propose reasons for the importance of these features, their role in planetary dynamics, as well as possible explanations for why some planets were misclassified. By understanding the important metrics of instability and reasons for misclassification, we can begin to understand more about system architectures, orbital motion and dynamics, and the formation and evolution of the exoplanetary systems. This is applicable in our own Solar System, and with exoplanet discovery missions such as TESS, this research becomes especially relevant in understanding the new exoplanetary systems we discover.

79 ASTRONOMY AND ASTROPHYSICS↗

Eject, crash, or survive: Using machine learning to predict orbital instability of exoplanetary systems

Astronomers throughout history, including titans like Kepler and Newton, have tackled planetary dynamics and orbital instability. Despite strides taken in research, understanding the evolution of planetary orbits remains an intricate, computationally expensive, and analytically unsolved problem. I apply machine learning classification methods to numerical simulations of planetary systems in order to predict the long-term fate of the planet - whether the planet remains in a stable orbit or not. My method uses the first 41.1 years (≤ 500 orbits) of data from a planet’s simulation to calculate 17 dynamically-motivated metrics; I trained my classifier on these features to predict a planet’s stability after 107 years. At 84.33%, my classifier was comparable in accuracy to pre-existing literature, despite using significantly less computational power than most other methods. In my research, I found that the standard deviation of eccentricity, mass ratios for neighboring planets, and semi-major axis ratio with the outer planet neighbor to be the most predictive features of instability. I propose reasons for the importance of these features, their role in planetary dynamics, as well as possible explanations for why some planets were misclassified. By understanding the important metrics of instability and reasons for misclassification, we can begin to understand more about system architectures, orbital motion and dynamics, and the formation and evolution of the exoplanetary systems. This is applicable in our own Solar System, and with exoplanet discovery missions such as TESS, this research becomes especially relevant in understanding the new exoplanetary systems we discover.

79 ASTRONOMY AND ASTROPHYSICS↗

Data-Driven Understanding of Low-to-Moderate Income Customers’ Adoption and Financial Qualification in Community Solar (Final Technical Report)

When Solstice began working in the community solar industry, it quickly became clear that there was a wide disparity along race and class lines in terms of what kind of household traditional solar offerings benefited. Solstice is an organization that aligns itself to the principles of a Just Transition, or the concept that a transition to a green economy should benefit and prioritize historically marginalized groups of people. Given that low-income communities are disproportionately burdened by our current polluting fossil fuel economy, Solstice set out to investigate the root causes of the exclusion of low to moderate income (LMI) households in the community solar market. As we worked more and more with financiers, developers, and LMI households, we recognized that significant barriers to entry in a developer-owned project were credit threshold requirements. A FICO score of 750 and higher discriminates against LMI households that are not financially stable enough to take on multiple lines of credit (or who may not have been deemed credit worthy enough to access a line of credit) yet who may have been reliable utility customers. As Solstice began looking further into preliminary data and speaking to community-based organizations (CBOs) that serve LMI households, we found our hypothesis to be worth investigating; there was indeed a subset of LMI households with poor FICO scores (or no FICO score at all) that had perfect bill payment history. Though initially Solstice was intent on gathering a body of data to prove or disprove this hypothesis, we were also concerned that all this proof of a financially stable and reliable customer was not being incorporated into FICO, and wondered if such a score would be possible. After preliminary research into the existence of alternative scores, Solstice realized that many mission-driven lending institutions rely on alternative metrics that are formulated for their specific industry. However, we also realized that community solar did not have an alternative credit underwriting mechanism, though there was great need from solar financiers for one. We anticipated that the creation of an EnergyScore would contribute to financiers’ need to qualify more people, as these entities are desperately looking for ways to lower the cost of customer acquisition. FICO turns away nearly 50% of potential customers (according to our own acquisition experience), and much of the community solar industry is realizing that FICO is not the perfect qualifying mechanism. Additionally, with a grounding in energy justice, just transitions, and climate justice, Solstice recognizes the need for a solution that addresses a more urgent need for LMI households to access renewable energy savings and relieve energy burdens. With funding from the Department of Energy, we gathered the data necessary to build the EnergyScore, reached out to mission-driven developers willing to test the metric, and secured several demonstration projects to pilot the EnergyScore. After acquiring customers for these demo projects using the EnergyScore, we will be continuously collecting customer payment behavior data. Though it goes beyond the scope of this project, we plan to disseminate this de-identified data with the wider community solar industry, which includes not only financiers and developers, but other mission-driven nonprofits, solar cooperatives, community-based organizations, environmental justice activists, and academics. While we intend to disprove the notion that LMI households cannot be included in projects without acutely increasing the risk to project finances, we also hope the data can be used to negotiate better pricing of systems and terms of ownership for community groups seeking to build inclusive projects.

14 SOLAR ENERGY↗

Integrated Monitoring Volume: A Summary of Monitoring Studies Conducted in Niagaran Carbonate Pinnacle Reefs During Enhanced Oil Recovery with CO 2

The Midwest Regional Carbon Sequestration Partnership (MRCSP) was founded in 2003 as part of the U.S. Department of Energy’s (DOE’s) Regional Carbon Sequestration Partnership initiative. Since its founding, MRCSP has made significant strides toward making CCUS a viable option for states in the region. The public/private consortium, funded through the DOE Regional Carbon Sequestration Initiative, brings together nearly 40 industry partners and 10 states. Battelle, as the project lead, oversees research, development and operations and coordinates activities among the partners. The incremental, phased approach has built a valuable knowledge base for the industry and paved the way for commercial-scale adoption of CCUS technologies. From 2008 to 2020, MRCSP Phase III focused on the development of large-scale injection projects. This report is part of a series of reports prepared under the Midwestern Regional Carbon Sequestration Partnership (MRCSP) Phase III (Development Phase). These reports summarize and detail the findings of the work conducted under the Phase III project. During the MRCSP Phase III monitoring period, over 1 million metric tons of CO 2 was injected into ten Silurian-age (Niagaran) pinnacle reef reservoirs in Otsego County, Michigan that are operated by Core Energy, LLC. There are over 800 pinnacle reefs in northern Michigan, and collectively, these geologic features have sufficient capacity to store several hundred million metric tons of CO 2 . Moreover, most of the reefs are oil-bearing and went through primary production in the 1970s and 1980s; therefore, by injecting CO 2 into the reefs, there is a real opportunity to realize additional (enhanced) oil recovery (EOR) and to permanently store CO 2 after EOR. A key objective of the MRCSP Phase III project is to evaluate the effectiveness of various technologies for monitoring CO 2 that has been injected into deep geologic formations. Monitoring may be required at CO 2 storage sites for a variety of reasons, including to meet UIC Class II (EOR sites) or Class VI (storage only sites) permit requirements or EPA greenhouse gas reporting rule requirements or to qualify for tax credits under the 45Q tax credit rule. The results of this monitoring study should prove useful to operators considering using carbonate pinnacle reefs of Northern Michigan for CO 2 storage.

01 COAL, LIGNITE, AND PEAT↗

Advanced Light-Duty Spark Ignition Engine Research: Co-Optimization of Fuels and Engines and Partnership to Advance Combustion Engines (FY2020 Annual Progress Report)

This report covers recent progress on research tasks that support both the Co-Optimization of Fuels and Engines (Co-Optima) initiative and the Partnership to Advance Combustion Engines (PACE) consortium. The Co-Optima tasks further the science-base needed by industry stakeholders to co-evolve the next generation of highly efficient direct injection spark ignition (DISI) engines and new gasoline-type fuels. The research emphasis is on fuel effects on multimode spark ignition (SI) engine operation, which uses traditional non-dilute stoichiometric operation for peak load and power but reverts to lean operation at lower loads to provide higher fuel economy. This work focuses on determining desirable fuel specifications in terms of well-established metrics like research octane number (RON) and motor octane number, but it also involves the assessment of new fuel metrics, including fuel sooting propensity and phi-sensitivity. The PACE task supports the development of predictive computational fluid dynamics (CFD) modeling, which promises to unlock new strategies for high-efficiency combustion while minimizing tailpipe emissions. Here, the primary fuel is a regular E10 gasoline (i.e., a regular gasoline blend containing 10% ethanol), and focus is on fuel-spray dynamics and soot emissions. Soot-formation pathways are studied to determine how the pathways change with injection strategies and the thermal state of the engine (i.e., cold-starting vs. fully warmed-up operation). This PACE task also contributed to the development of an optimal E10 gasoline surrogate fuel, as reported in detail elsewhere

33 ADVANCED PROPULSION SYSTEMS↗