Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Lessons learned”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 325 records · Page 18

Approach to Quality Assurance for Complex Environmental Modeling - 20407

A strong Quality Assurance (QA) program for complex environmental modeling is essential for regulatory and public acceptance and trust, but it does not have to be onerous. Neptune and Company, Inc. (Neptune) has developed a strong QA program that improves transparency, traceability, reproducibility, and therefore, defensibility and trust. Neptune's QA program has evolved over the past 27 years, transitioning from an ad hoc QA program, to a program that is currently Nuclear Quality Assurance-1 (NQA-1) compliant, and will soon be NQA-1/DOE approved for DOE EM modeling work. In addition, Neptune is a qualified laboratory assessor and qualified auditor for reference materials, a proficiency testing provider, and fully complies with the Environmental Protection Agency (EPA) QA program. Neptune's President and CEO, Kelly Black, was recently named the Chairperson of the International Organization for Standardization (ISO) Technical Committee 69, Application of Statistical Methods. A strong QA program has been developed for Neptune's radiological performance assessment (PA) program. Although pieces of their QA program are currently in development, their current program includes document control using Subversion, issue tracking and work flow tracking using JIRA, and transparency and traceability via a system of 'calc sheets' for documentation of all data analysis and modeling combined with 'check print' documentation of QA checking, and rigorous model testing and configuration control. All work is reviewed by an independent subject matter expert who is not associated with the collection and assembly of information, for an internal peer review. The program is enforced with a handful of Standard Operation Procedures (SOPs), Work Instructions, QA Project Plans (QAPPs), and Quality Management Plans (QMPs) that are updated frequently, with required annual training and acknowledgment. In addition, effective communication of modeling approaches and results to clients and stakeholders are integral to their QA program. Many of their models are built using the GoldSim modeling platform, for which their models are well-known for their level of transparency, documentation, and QA traceability. This level of QA is also applied to their process-level models. Neptune has taken some lessons learned from the extremely rigorous QA program required for the Yucca Mountain Project (YMP), and imposed the YMP requirements of complete traceability, transparency, and reproducibility, but avoided the inflexibility of a QA program that likely contributed to the suspect e-mails in 2005 that resulted in loss of trust in the YMP, and in nuclear waste disposal (and nuclear power) in general. There are far too many examples of loss of public trust due to poor QA that could have been easily avoided with a simple and straight-forward QA program combined with stakeholder engagement. The purpose of this paper is to share features of Neptune's Radiological Performance Assessment program QA program, and some of their QA related lessons learned over the past 27 years of QA for complex environmental modeling. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Improvements to the Modeling of the TREAT Reactor and Experiments

This paper summarizes the latest improvements and lessons learned from the modeling and simulation of the transient test reactor at Idaho National Laboratory using the MAM- MOTH reactor physics application. MAMMOTH is a MOOSE-based, Finite Element Method application that specializes in the analysis of the spatial dynamics behavior of nuclear reactors. Since early 2018 several transient tests have been conducted at TREAT, thus providing the opportunity to apply and benchmark modern modeling and simulation tools. MAMMOTH was used to provide predictions of the power coupling factor between the core and the experiment for various experiments. Even though the power coupling factor predictions agree very well with the experimental data, within the bounds of the experimental uncertainty, one shortcoming was the underprediction of the total energy deposited in the core and in the experiment. Determination of the sources for this discrepancy are ongoing, but several key problems have been identified and resolved, thus providing valuable insights for future research. This paper discusses several of these lessons learned. First, the heat capacity data for the TREAT fuel has some significant problems due to limitations of the measurement techniques used circa 1960s. The sensitivity of the peak power and the total energy deposition to various representations of the heat capacity is approximately 5%. Second, the effects of the biological shield and thermal column on the modeling of the core are non-negligible, since they affect the mean generation time and the effective reflection of neutrons back into the core, which is suspected to be important during the core heat up. Matching the reactor period resolves the fact that the reduced spatial domain used in the MAMMOTH model underpredicts the mean generation time. The neutron reflection from these regions is marginally improved with the use of an albedo boundary condition. Third, modeling of the control rod movement with a multi-scheme method is introduced and its current limitations are exposed. Fourth, we explore the effects of using a homogenized model with Superhomogenization equivalence and how that differs from fully heterogeneous simulations. Finally, the energy condensation effects for this graphite core are significant. Solutions with 10 and 26 energy groups show the benefits of using a finer coarse group structure.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Lithium-ion battery physics and statistics-based state of health model

A pseudo-2d model using COMSOL Multiphysics® software is developed to simulate performance and performance degradation of Li-ion batteries consisting of layered and olivine cathodes with graphite anode when subjected to peak shaving grid service. Multiple degradation pathways are considered, including solid electrolyte interphase (SEI) formation and breakdown at the anode, cathode dissolution and its synergistic effect on SEI formation at the anode. The model is validated by simulating commercial cylindrical cell performance. A global model is developed to simulate performance across all chemistries, along with individual chemistry models using global model parameters as initial values. There is good agreement between these models for various optimization parameters such as SEI equilibrium potential, cathode dissolution exchange current density, solvent diffusivity in the SEI and SEI ionic conductivity. To circumvent time constraints related to the COMSOL model, a 0d global model is developed which fits data well and provides more clarity on differences in cathode dissolution exchange current density. Again, good agreement for various optimization parameters is obtained among the COMSOL global & individual chemistry models and the 0-d model. The lessons learned from the physics-based model is used to develop a top down statistics-based model using current, voltage and anode volumetric change per mole lithium intercalated, along with their interactions as degradation predictors. This model predicts out of sample degradation for multiple grid services and electric vehicle drive cycle with high accuracy and provides the pathway to develop an efficient battery management system combining machine learning and findings from physics-based computationally intensive algorithms.

Crawford, Aladsair J.↗

High-resolution Hindcasts for U.S. Wave Energy Resource Characterization

The marine and hydrokinetic (MHK) industry is at an early stage of development and has the potential to play a significant role in diversifying the U.S. energy portfolio and reducing the U.S. carbon footprint. Wave energy is the largest among all the U.S. MHK energy resources, which include wave energy, ocean current, tidal-instream, ocean thermal energy conversion, and river-instream. Wave resource characterization is an essential step for regional wave energy assessments, Wave Energy Converter (WEC) project development, site selection and WEC design. The present paper provides an overview of a joint modelling effort by the Pacific Northwest National Laboratory and Sandia National Laboratories on high-resolution wave hindcasts to support the U.S. Department of Energy’s Water Power Technologies Office’s program of wave resource characterization, assessment and classifications in all US coastal regions. Topics covered include the modelling approach, model input requirements, model validation strategies, high performance computing resource requirements, model outputs and data management strategies. Examples of model setup and validation for different regions are provided along with application to development of classification systems, and analysis of regional wave climates. Lessons learned and technical challenges of the long-term, high-resolution regional wave hindcast are discussed.

Yang, Zhaoqing↗

First Ever Polymer Flood Field Pilot To Enhance The Recovery Of Heavy Oils On Alaska’s North Slope - Pushing Ahead One Year Later

In June 2018 the team embarked on an ambitious project to address the slow development pace of Alaska’s 20+ billion barrels heavy oil resource via the first ever polymer flood pilot. Following the successful commencement of the pilot in August 2018, the field demonstration, supporting laboratory experiments and numerical simulation have steadily progressed. A significant amount of valuable data and lessons learned have been collected, and are reported in this paper. The ongoing pilot and the research activities is making headway toward the primary objective of validating the use of polymer flooding for extracting heavy oil in Alaska’s challenging environment. The pilot is conducted in two pre-existing pairs of horizontal injectors and producers in an isolated fault block of the Schrader Bluff heavy oil reservoir at the Milne Point Field. A customized polymer blending and pumping unit injects HPAM polymer at a concentration of 1,750 ppm to achieve a target viscosity of 45 cP. Supporting coreflood laboratory experiments have focused on quantification of polymer retention in the rock, and effect of injection water salinity, polymer, and their combinations on oil recovery. The injection and production response of the pilot flood pattern is utilized to develop a history matched reservoir simulation model for forecasting oil recovery beyond the pilot. Finally, specially designed laboratory experiments address anticipated operating concerns regarding post-polymer breakthrough such as oil-water separation efficiency and polymer induced fouling of heater tubes. Polymer has been injected continuously since startup except for two short equipment modification shutdowns, and more recently a prolonged disruption due to polymer hydration issues at the J-pad field site. Cumulatively, over 600,000 lbs. of polymer has been injected, corresponding to ~7%PV. The two producers show significant decrease in the water cut, gradually increasing oil rate, and no polymer breakthrough. Two main observations from the coreflood are a significant uncertainty in polymer retention values, and positive oil recovery response to low salinity water (2,600 mg/liter TDS). The heterogeneity in the flood pattern presents some challenges in obtaining a robust history matched simulation model. Experimental results on produced fluids treatment indicate the formation of a dense polymer deposit, at certain conditions, on heating tubes that can negatively impact the heat transfer efficiency. The scientific knowledge, including the lessons learned during unanticipated shutdowns, quality control, logistics and field data that is being acquired from this effort has referential value for other planned EOR projects. Finally, by all indications, the polymer field pilot is steadily progressing toward achieving the ultimate goal of unlocking the massive heavy oil resources on Alaska North Slope (ANS).

Dandekar, Abhijit↗

Potential State Regulatory Pathways to Facilitate Low-Carbon Fuels

States and the federal government are increasingly engaged in the challenges around decarbonizing the electric grid. In particular, regulators, consumers, stakeholders, and utilities recognize the need to carefully consider the role natural gas will play in a decarbonized future. A variety of technology and policy options to reduce greenhouse gas emissions associated with natural gas use are available, including energy efficiency programs, demand reduction tools, strategic electrification, and strategies to reduce emissions from natural gas production, transportation, and consumption. Low-carbon fuels – mainly renewable natural gas (RNG) and clean hydrogen – are being considered an important component of decarbonization goals. RNG and hydrogen may be able to meaningfully reduce emissions from processes independent of geologic natural gas, displacing emissions of methane, a powerful greenhouse gas. Although RNG and hydrogen are not cost-competitive today with geologic natural gas and are smaller in scale and potential than other decarbonization options, they can be explored as potential critical tools to decarbonize sectors that are difficult to electrify or shift off of natural gas entirely, such as air travel, industrial processes, maritime transport, long-distance trucking, space heating on cold days, and railroads (Nadel, 2022). The role of this report is to provide informational context for state utility regulators to understand the impacts of and challenges associated with broader integration of low-carbon fuels, followed by examples of state regulatory actions taken to date to facilitate the development of low-carbon fuels. Setting clear guidance to calculate the environmental benefits of low-carbon fuels and continuing federal and state investments in research and development to reduce costs relative to fossil fuels will be important steps to take to signal the desire to grow the market for these fuels. State public utility commissions may play a key role in setting regulatory frameworks for low-carbon fuels and ensuring that ratepayer funds, if utilized, are done so to further the public interest. This report is intended to summarize decisions that states have made to date on low-carbon fuels. In the spirit of understanding the current market and sharing information, this report provides success stories, and lessons learned across states as regulators implement varying strategies to achieve decarbonization objectives while maintaining their focus on affordability, safety, and reliability of the energy system. The report begins with an introduction of the role of natural gas in the U.S. economy (Section I) and background information on natural gas use, decarbonization, and low-carbon fuels (Section II). Next, the report describes the current market by discussing the scale of current production, emissions intensity, resource potential, and costs of low-carbon fuels compared to geologic natural gas (Section III). Following these sections, the report describes four strategies states have employed to facilitate low-carbon fuels: opening exploratory dockets, approving voluntary tariffs for customers, approving interconnection tariffs for producers, and considering portfolio-wide procurement targets (Section IV). This section lists states that have taken actions in each category, citing utility filings, commission decisions, stakeholder comments, and other relevant sources. Finally, the report concludes with suggested questions regulators may wish to consider regarding low-carbon fuels, in the interest of preparing to make decisions in the future (Section V). These questions include: Are there existing regulatory or technical barriers to voluntary purchases of low-carbon fuels? Can customers work with utilities to procure low-carbon fuels; are producers able to interconnect projects without significant barriers to entry? Should the infrastructure and/or commodity costs of low-carbon fuels be socialized among all ratepayers, or borne solely by the large commercial and industrial (C&I) customers currently driving the market? Should regulated natural gas and/or electric utilities own and operate low-carbon fuel production? How should regulators consider the unique decarbonization potential of low-carbon fuels, particularly for hard-to-abate sectors, in decision-making? Is additional direction or clarity from state policymakers needed? What no-regrets approaches can help facilitate both near-term RNG development and long-term development of hydrogen and other zero-carbon fuels? We collectively wish to express our gratitude to the U.S. Department of Energy, Office of Fossil Energy and Carbon Management, for supporting this report and other technical assistance resources for state regulators on natural gas topics. State regulators operate under a variety of policy environments, and states have vastly different types of energy resources, infrastructure, and customers. While there is no optimal regulatory, policy, or technological solution that will be successful in every state, state regulators can benefit by exchanging lessons learned with their peers across the country. We look forward to continued engagement with our fellow commissioners, commission staff, NARUC, the U.S. Department of Energy, and other stakeholders to develop sound regulation in the public interest.

03 NATURAL GAS↗

SOAR/Goodman Spectroscopic Assessment of Candidate Counterparts of the LIGO/Virgo Event GW190814*

On 2019 August 14 at 21:10:39 UTC, the LIGO/Virgo Collaboration (LVC) detected a possible neutron star–black hole merger (NSBH), the first ever identified. An extensive search for an optical counterpart of this event, designated GW190814, was undertaken using the Dark Energy Camera on the 4 m Victor M. Blanco Telescope at the Cerro Tololo Inter-American Observatory. Target of Opportunity interrupts were issued on eight separate nights to observe 11 candidates using the 4.1 m Southern Astrophysical Research (SOAR) telescope’s Goodman High Throughput Spectrograph in order to assess whether any of these transients was likely to be an optical counterpart of the possible NSBH merger. Here, we describe the process of observing with SOAR, the analysis of our spectra, our spectroscopic typing methodology, and our resultant conclusion that none of the candidates corresponded to the gravitational wave merger event but were all instead other transients. Finally, we describe the lessons learned from this effort. Application of these lessons will be critical for a successful community spectroscopic follow-up program for LVC observing run 4 (O4) and beyond.

79 ASTRONOMY AND ASTROPHYSICS↗

CHALLENGES IN THE DEVELOPMENT OF THE ELECTROREFINING PROCESS AT Y-12

In order to ensure future capabilities of the Y-12 site as older buildings retire, a new process was developed, the Metal Purification Process. The purpose of this new process is to provide a simpler and more efficient uranium metal purification that the previous multi-staged, complex chemical processes. The basis for this technology currently exists in the US DOE complex, but it has not been utilized on a large scale for uranium at higher enrichments. The system requires larger-geometry vessels and furnaces in order to meet the through-put requirements. The crux of the process is the electrorefining cell, consisting of several concentric liners and an unfavorable geometry cylindrical crucible. Within the crucible, a molten Li-CL-KCL-UCL3 salt electrolyte is present. ‘Dirty’ metal is placed into a loading basket and loaded into an electrorefining cell. Here, the metal reacts into the molten salt within the cell to form UCL3, while ‘clean’ metal simultaneously plates out from the salt electrolyte in the form of metal dendrites. These dendrites are then collected and removed from the cell. After removal from the cell, the dendrites are taken to a furnace to remove adhered salts. Then, the salt-free dendrites are moved to a separate furnace for consolidation into the final product form. The development of the Criticality Safety Evaluation for this complex system brought with it many NCS Challenges and lessons learned. These challenges include: design decisions for ensuring subcriticalty in the electrorefining cell during abnormal conditions, the interface of the main glovebox system with auxiliary systems such as the purification system and designated storage, implementation of mass tracking, and concerns from production and operation regarding the movement of material within the system.

36 MATERIALS SCIENCE↗

Building and Executing Aggressive Research Plans in a Large National Laboratory Consortium: Insights from the Co-Optimization of Fuels and Engines Initiative

This report describes lessons learned in the establishment, execution and termination of a large, multi-institutional consortium, derived from the Co-Optimization of Fuels and Engines experience. The decision to form a consortium comes with benefits (in advancing challenging multidisciplinary research) and costs (in time and additional management funds). Once the decision is made, key elements to a strong start include establishing a shared vision and goals; engaging an experienced project manager early; instituting feedback and oversight mechanisms to ensure relevance, strong performance, and situational awareness. Once a consortium is up and running, DOE and leadership should strike the right balance between competition and collaboration; foster an environment that builds trust; and adjust the organizational structure as needed to maintain collaboration. Finally, DOE and the labs can plan effectively for a smooth transition as a consortium winds down. This report provides some additional lessons and details on these lessons that we hope future DOE and lab leaders will find useful as they contemplate standing up new consortia.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

MARVEL Instrumentation, Control, and Software Considerations

This paper details the various I&C considerations and design decisions made throughout the MARVEL (Micro-reactor Applications Research Validation and Evaluation) project, including sensor and actuator selection, safety-related functionality, digital control hardware and software, and testing methodologies. Key challenges such as managing radiation, temperature, and space constraints are discussed, along with the trade-offs between using standard equipment and custom solutions. The successful integration of off-the-shelf components, the emphasis on minimizing safety-related instrumentation, and the lessons learned from prototyping and testing are highlighted. The authors aim to provide insights that can benefit future micro-reactor designs and emphasize the importance of real-world testing in advancing reactor technology.

46 - INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AN↗

Assessing the New Home Market Opportunity: Case Study and Cost Modeling for Solar and Storage in 2030

Residential solar and storage markets are growing in the United States. With approximately 1 million new homes constructed every year, this represents a significant opportunity for solar and storage installations. Some homebuilders have begun to build new homes with solar and storage included as a standard offering. It is not clear how solar and storage is incorporated into the new construction process and at what cost. Further, it is unclear what barriers or opportunities exist to scale this model nationwide. To fill this gap in the literature, this research conducts a case study of Mandalay Homes' new solar and storage community in Arizona to gather lessons learned. From this foundation, we further generate a set of pathways to reduce install costs and expand solar and storage market penetration in this sector. To model existing and 2030 solar and storage costs, we use the National Renewable Energy Laboratory's (NREL's) bottom-up cost model. This modeling is further informed by 12 interviews conducted with new home builders, solar contractors, and other subject matter expert organizations. Our case study analysis generated three key considerations for other homebuilders including: 1. Educating local permitting, inspection, and in some cases utility officials on solar and storage products, designs, and code compliant building practices may be required. The need for education may decline as more local governments and utilities review and approve solar and storage projects. 2. Incorporating solar and storage systems into the homebuilding process can add complexity and related coordination challenges. This does not need to result in home construction delays, but can result in costly contractor "dry runs" to construction sites. 3. Deploying solar and storage at the time of new construction has significant economies of scale, which can improve the value proposition of the systems. The case study, extant literature, and interviews were used to model both existing and future solar and storage installation costs at time of new construction. Here, we find three key cost reduction opportunities relating to solar and battery storage hardware, customer acquisition, and overhead. If future contractors can maximize the cost reduction opportunities outlined here, residential new construction costs could decline by 8 - 25% by 2030, depending on the modeled scenario. Though we expect costs to decline through 2030, it is unclear which of these scenarios may ultimately appear. Interviewees further identified a variety of barriers across each cost category that could temper the savings shown here. At the same time, interviewees described several pathways to scale the new construction solar and storage market, beyond installation cost savings. Interviewees confirmed that changes in finance, rate design, resilience policies, deployment mandates, and DER aggregation could all support more market adoption than seen today. These findings suggest that there are significant opportunities to expand new construction markets and this research can serve as a baseline to assess progress in this segment through 2030.

14 SOLAR ENERGY↗

Tribal Revegetation Project Final Project Report: 92-Acre Area, Area 5 Radioactive Waste Management Complex, Nevada National Security Site, Nevada

Nuwu (Southern Paiute), Newe (Western Shoshone), and Nuumu (Owens Valley Paiute) are linguistically related, Numic-speaking peoples who are part of the broader Uto-Aztecan language group. Numic peoples view the land as a holistic, living, sentient being with feelings and purpose. The land is personified with human characteristics and it needs to be experienced to be understood through “learning by doing.” Numic peoples do not support ground disturbing activities within their ancestral lands, including activities tied to the storage of low-level radioactive waste or classified materials on the NNSS, which they view as culturally inappropriate. These deep-rooted ancestral connections are the impetus for reinforcing Numic responsibility for healing disturbed areas by integrating respect and patience with consistent Tribal interaction. Tribal Ecological Knowledge (TEK) is the science of describing Tribal approaches for understanding natural resources. Numic TEK is embedded in traditional teachings learned incrementally over time though experience and it evolves through lessons learned and responses to environmental changes over millennia. Therefore, TEK can broaden and enhance Western scientific knowledge associated with revegetation, especially in highly disturbed areas. The project blended TEK with Western scientific ecological methods to create a vegetative cover within test plots on the 92-Acre Area located at the Radioactive Waste Management Complex (RWMC) located in Area 5 on the Nevada National Security Site (NNSS). The vegetated test plots were systematically created for the Department of Energy (DOE) in tandem with the existing Federal Facilities Agreement and Consent Order (FFACO) with the Nevada Department of Environmental Protection (NDEP). Three previous contractor-lead attempts at revegetation, one targeting full cover revegetation and two targeting test plot revegetation, did not achieve the anticipated results at this location. When presented to the 16 American Indian Tribal nations and affiliated groups with cultural and historical ties to the NNSS, the group appointed a Tribal Revegetation Committee (TRC) that included six expert Tribal knowledge holders to collaborate with an ethnoecologist/cultural anthropologist and two biologists. Project design, planning, seed and outplant selection, spiritual land preparation, and methodology were guided by the TRC and an ethnoecologist/cultural anthropologist from Portland State University (PSU) and biologists from Desert Research Institute (DRI). Using TEK, the TRC recommended a specific seed mixture that contained nine native plant species and three species of outplants. The revegetation effort included preparing and planting thirty 10 m × 10 m (32.8 ft × 32.8 ft) seeded plots, twelve of which also included outplants; and eight 10 m × 100 m (32.8 ft × 328 ft) plots that only received outplants, all atop a waste cell cover. The TRC and the project team creatively adapted TEK with Western scientific methods so that the planned revegetation efforts could occur within the safety and security parameters of the RWMC. Test plots were subjected to one of five soil treatments with varying combinations of straw or mulch applications, soil amendment, and/or outplant planting and one of two watering treatments (watered or unwatered). Planting was divided into two events: one in the fall season and another during the subsequent spring season based on TEK and a corresponding recommendation from the TRC. Monitoring and spiritual management was conducted by the TRC to evaluate plant progress on a monthly basis (in conjunction with the biologist and anthropologist) during each respective growing season for a period of three years after planting. This approach allowed Tribal members the opportunity to conduct traditional blessings and other culturally appropriate activities to restore balance to the land in accordance with Tribal protocols. Following TEK-guided methods, successful plant establishment from seed stock and outplants was observed in many plots. Overall, plots planted in the spring, as recommended by the TRC, showed higher rates of outplant survival and native seedling emergence than those planted in the fall. This finding is significant because it is contrary to the original guidance and previous approaches provided for planting in this region. The TRC believes the frequent co-occurrence of native seedlings near surviving outplants indicates an important symbiotic relationship understood by Tribal communities and overlooked by others. Watered outplants displayed much higher survivability than unwatered plants, even after watering was reduced after the plants were established. Soil amendments and mulch created higher densities of native plants from seed. Many native seedlings showed significant delays in germination, which is considered a normal adaptation to desert climates. Some native plants did not germinate until the third growing year, whereas others germinated during the first growing year, which demonstrates the complexity of the desert environment. Evidence of native insects, reptiles, mammals, and birds, as well as native plants that were not part of the planted species, were noted and considered culturally significant. Despite the presence of non-native plants, native outplants continued to thrive and the incidence of native plant germination from seed increased over time. These successful revegetation results where previous efforts were unsuccessful reinforce the importance of integrating regionally appropriate, TEK-guided methodology with Western science to achieve positive results and the necessity of integrating Tribal involvement in all stages of the revegetation effort. Expanded approaches coupled with Tribal knowledge and tools from Western science addressed a complex problem tied to revegetating atop a low-level radioactive waste cell. The level of Tribal participation serves as a progressive model for building collaborative relationships and addressing ecological challenges on the NNSS.

54 ENVIRONMENTAL SCIENCES↗

The ASHRAE Great Energy Predictor III competition: Overview and results

In late 2019, ASHRAE hosted the Great Energy Predictor III (GEPIII) machine learning competition on the Kaggle platform. This launch marked the third energy prediction competition from ASHRAE and the first since the mid-1990s. In this updated version, the competitors were provided with over 20 million points of training data from 2,380 energy meters collected for 1,448 buildings from 16 sources. This competition’s overall objective was to find the most accurate modeling solutions for the prediction of over 41 million private and public test data points. Furthermore, the competition had 4,370 participants, split across 3,614 teams from 94 countries who submitted 39,403 predictions. In addition to the top five winning workflows, the competitors publicly shared 415 reproducible online machine learning workflow examples (notebooks), including over 40 additional, full solutions. This paper gives a high-level overview of the competition preparation and dataset, competitors and their discussions, machine learning workflows and models generated, winners and their submissions, discussion of lessons learned, and competition outputs and next steps. The most popular and accurate machine learning workflows used large ensembles of mostly gradient boosting tree models, such as LightGBM. Similar to the first predictor competition, preprocessing of the data sets emerged as a key differentiator.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

The CanBikeCO Mini Pilot: Procedure and Preliminary Results

In fall 2020, the Colorado Energy Office, as part of the State of Colorado's "Can Do Colorado" initiative, initiated a project aimed at encouraging energy-efficient transportation during the COVID-19 pandemic. The initial mini-pilot provided e-bikes to 13 low-income households under an individual ownership model. This report assesses the impact of providing this additional mobility option on the travel behavior of participants. It also outlines the lessons learned from deploying a continuous monitoring platform to track the travel behavior. These lessons will influence the evaluation component for the full pilot, which will cover multiple geographic regions, start in summer 2021, and run for 2 years. The continuous data collection was enabled by a customized version of the open-source e-mission platform, called CanBikeCO, configured with a behavioral gamification feature. The Colorado Energy Office used this system to collect a unique data set consisting of 3 months of partially automated travel diaries, combining sensed and surveyed data and linked with demographic information, from 12 participants. The data collection process worked well overall: users generally liked the app, appreciated the game, and did not complain about battery life. The long tracking period introduced behavioral challenges in user engagement, which we plan to address using repeated patterns and automated status checks for the full pilot. The analysis results, based on the subset of trips with user-reported labels (68%), indicate that the e-bike was the dominant commute mode share (31%), in sharp contrast to the census bicycle commute mode share (<1%). E-bike trips primarily replaced single-occupancy vehicle (SOV) trips (28%), followed closely by walking (24%) and regular bike (20%). The non-motorized mode replacement corresponds to lower travel time and increased productivity enabled by the program. The emissions impact analysis of the program, computed using trip-level energy intensity factors, indicates savings of 1,367 lbs. of CO2. Although the results are strongly positive, the narrow demographic profile of study participants, their limited mobility alternatives, and nonuniform labeling indicate caution in broader interpretation. These preliminary results do suggest that such programs, supported by real-time education and support from program managers, can simultaneously meet equity and sustainability goals. The planned full pilot, addressing the data collection challenges and broadening the geographic scope, will provide additional insights into the generality of this approach.

ADVANCED PROPULSION SYSTEMS↗

Solar Energy Innovation Network 2017-2024: Abbreviated Final Technical Report

This material is based upon work supported by the U.S. Department of Energy's (DOE) Office of Energy Efficiency and Renewable Energy (EERE) Solar Energy Technologies Office under the Agreement/Award Number 32954 for Solar Energy Innovation Network (SEIN) Project, 2017-2024. SEIN is a dynamic program that assembles diverse teams of stakeholders to research solutions to real-world challenges associated with solar energy adoption. In conjunction with its partner organizations, NREL implemented the program by providing research, analysis, and technical expertise directly to project teams and groups of teams (cohorts), by facilitating networked learning through cohorts and peer exchange, and by facilitating dissemination and replication of solutions and lessons learned among stakeholders across the U.S. with similar challenges.

14 SOLAR ENERGY↗

Continual Learning for Production-Level Machine Learning in Particle Accelerators

Particle accelerators operate in complex environments where data distribution can change dynamically, leading to data drifts that significantly challenge Machine Learning (ML) models. These non-stationary conditions often cause ML models to deteriorate in performance, making it difficult to maintain reliable predictions in operation. The primary sources of data drifts are changes in accelerator settings and changes in equipment performance which cannot be measured directly. To bridge this gap between ML development and long-term deployment in operational settings, we identify key areas within particle accelerators where continual learning can help mitigate drift-induced performance degradation. We will provide a practical guide on selecting the appropriate method given resource constraints and desired stability plasticity trade offs. As a concrete example, we will present a real-world use case for anomaly detection to predict errant beams at the Spallation Neutron Source accelerator, where continual learning has been employed to demonstrate stable performance on drifting data streams. We will present practical challenges, lessons learned, and the results from the deployed ML model.

Rajput, Kishansingh [Thomas Jefferson National Acc↗

Device-Centric Ransomware Detection using Machine Learning-Based Memory Forensics for Smart Inverters

Ransomware attacks are the fastest-growing form of cyberattacks worldwide. Recently, ransomware attacks have targeted industrial control systems (ICSs), including power grids. Lessons learned from recent incidents in ICSs show that ransomware groups can deliver ransomware into not only the organization’s control servers, but also the operational technology (OT) devices such as smart inverters and smart grid devices. This paper proposes a machine learning (ML)- based memory forensics method enabling the detection of ransomware binaries stored in the memory of a commercial smart inverter. Device firmware binary files are extracted from a Serial Peripheral Interface (SPI) flash memory, and samples of both benign and ransomware binaries are generated by a binary manipulation method and a real-world ransomware encryption, separately. A deep transfer learning (DTL) method is used to retrain a convolutional neural network (CNN)-based ransomware detection algorithm using the generated samples. The experimental result validates that the proposed ML-based memory forensics method can accurately detect ransomware files.

97 MATHEMATICS AND COMPUTING↗