Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “auditing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

bifiPV2020 Bifacial Workshop: A Technology Overview

The virtual bifiPV Workshop was held in July 2020 to provide the solar industry with a forum for sharing and discussing research into bifacial photovoltaic (PV) technology. This report outlines major insights from the workshop to give the reader an overview of the latest developments in bifacial PV technology worldwide, from the lab to the field. Citations are drawn from this workshop unless otherwise noted, with all proceedings available online at bifipvworkshop. com. Presentations for the bifiPV2020 Workshop focused on the following areas: bifacial power plant modeling and simulation, albedo improvements, the development of encapsulants, the durability and reliability of current bifacial technologies, performance comparisons between glass-glass and glass-transparent backsheet configurations, the future of passivated emitter and rear contact (PERC) solar cells, and the growing adoption of n-type solar cells. With 650 GW total PV installed worldwide and 1 TW to come very soon, PERC is now the standard PV cell type produced en masse. However, it is already reaching 23% efficiency, the upper limit for this type of technology. PV modules breaking the 0.5-kW barrier are starting to appear, and the costs of standard PERC technology are already below 0.2 USD/Wp. In 2019, five GW of bifacial PV were installed worldwide. In 2020, the majority of bifacial installations are expected to be located in the United States, China, and Middle East and North Africa (MENA) states. N-type bifacial technologies are becoming increasingly viable and have huge potential to dominate the market in the coming years. With bifacial technology mounted on horizontal single-axis trackers (HSAT), bids below 10 USD/MWh will soon be observed in the MENA region, and later in Chile and the United States. Factory audits and reliability testing can reduce field failures by helping buyers to select producers that follow rigorous quality assurance and quality control processes.

14 SOLAR ENERGY↗
DOE OSTI2020

bifiPV2020 Bifacial Workshop: A Technology Overview

The virtual bifiPV Workshop was held in July 2020 to provide the solar industry with a forum for sharing and discussing research into bifacial photovoltaic (PV) technology. This report outlines major insights from the workshop to give the reader an overview of the latest developments in bifacial PV technology worldwide, from the lab to the field. Citations are drawn from this workshop unless otherwise noted. Presentations for the bifiPV2020 Workshop focused on the following areas: bifacial power plant modeling and simulation, albedo improvements, the development of encapsulants, the durability and reliability of current bifacial technologies, performance comparisons between glass-glass and glass-transparent backsheet configurations, the future of passivated emitter and rear contact (PERC) solar cells, and the growing adoption of n-type solar cells. With 650 GW total PV installed worldwide and 1 TW to come very soon, PERC is now the standard PV cell type produced en masse. However, it is already reaching 23% efficiency, the upper limit for this type of technology. PV modules breaking the 0.5-kW barrier are starting to appear, and the costs of standard PERC technology are already below 0.2 USD/Wp. In 2019, five GW of bifacial PV were installed worldwide. In 2020, the majority of bifacial installations are expected to be located in the United States, China, and Middle East and North Africa (MENA) states. N-type bifacial technologies are becoming increasingly viable and have huge potential to dominate the market in the coming years. With bifacial technology mounted on horizontal single-axis trackers (HSAT), bids below 10 USD/MWh will soon be observed in the MENA region, and later in Chile and the United States. Factory audits and reliability testing can reduce field failures by helping buyers to select producers that follow rigorous quality assurance and quality control processes.

14 SOLAR ENERGY↗
DOE OSTI2020

Flanged Tritium Waste Containers: Background and Current Path to Disposal

The MLLW Flanged Tritium Waste Container (FTWC) Project has been operational since 2007 when, during an audit of the FTWC waste stream, it was determined that four FTWC containers contained lead in amounts greater than LDR treatment standards. From June to August of 2007, four FTWC containers were shipped to TA-54 for disposal as LLW from WETF. The contents of the FTWCs were characterized as high activity LLW and were thought to be in compliance with LANL's Waste Acceptance Criteria (WAC). During the packaging of these FTWC's, 36 intact squib valves (aka actuators), containing detonated squibs were included with the waste stream After being transported to TA-54 Area G, it was determined that the explosive used in some of the squibs was Normal Lead Styphnate (NLS). A recharacterization of the entire contents in the FTWC's was performed with the conclusion that the squib valves exhibited the RCRA toxic characteristic for Lead (D008), thus resulting in the contents of the FTWCs being reclassified as a Mixed LLW.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2022

A System Approach to Deep Heating Savings Through Measurement, Management, and Motivation

Across multi-tenant commercial office and multifamily buildings, centrally metered fuel use represents a substantial fraction of whole-building energy use. Energy audit practitioners understand that improving heating distribution efficiency is typically more of an opportunity than combustion efficiency and that differing thermal comfort preferences between tenants are the bane of operators across these building typologies. There is an unmet market need for retrofit technologies that allow for the delivery of the right amount of heat to the right spaces, at the right time. The Energy Management and Information System (EMIS) package fills this gap through enhanced controls and metering, incorporating low-cost sensors and wireless communication infrastructure to provide a platform for ongoing commissioning and tenant feedback, including heat cost allocation. With support from the US DOE Building Technologies Office, Steven Winter Associates, Inc. (SWA) partnered with Sentient Buildings, E Source, building owners, and utility and policy stakeholders, to demonstrate a market viable EMIS that achieves a reduction in space heating energy use by reducing heating load, improving control, and positively impacting behavior while providing an acceptable financial return. In this study, EMIS packages were implemented in two New York City multifamily rental buildings. Both buildings conducted basic mechanical work (e.g., repairing steam traps) to ensure the heating system was operating well before any tenant feedback was layered in. Heating Energy Use Reports (HEUR) were created to provide tenants with social comparisons and energy savings tips to influence their behavior; these were provided monthly to all tenants in both buildings. Additionally, one building allocated heating costs to a portion of the tenants. Heat cost allocation (HCA) has a long history in the European Union (EU), although it is not common in the US or in steam-heated buildings. SWA leveraged existing EU best practices and stakeholder feedback to develop a Heat Cost Allocation algorithm that was considered equitable and intuitive. Energy use and tenant behavior impacts were tracked throughout the study. The basic mechanical repair work saved between 11-20% of heating energy. Those savings rose to 17-24% with the addition of tenant feedback. While it may not be possible to precisely determine the impact of COVID-19 on research studies like this, there may have been additional savings realized had the study taken place in a period of normal occupancy patterns. These types of central heating systems have been a blind spot for utilities, who have traditionally had little visibility into detailed behind-the-meter gas usage. Heating energy savings stayed consistent during the coldest months, indicating the potential for utilities to utilize EMIS packages for peak gas demand reductions or demand response programs. Tenant comfort was also improved. Post installation, room temperatures more closely matched thermostat set points. Perhaps due to this greater level of control, the vast majority of tenants being billed for heating were accepting of the allocation costs. And tenants receiving heat cost allocations were more likely to reduce their thermostat setpoints than tenants receiving behavioral feedback without financial impacts were. Variation in building specifics makes it difficult to provide precise energy and financial savings estimates. But within the range of expected conditions, the study identified a few key variables that can have the greatest impact on financial returns: the cost of fuel, the ability and willingness to allocate heating costs to tenants, and a well-functioning heating system as a starting point. This study focused on two multifamily buildings, but additional use cases, such as commercial buildings and affordable housing, should be explored to better understand the full market potential. While this type of upgrade has the potential for deep energy reductions and cost savings, future projects should take into account the balance of costs and benefits between owners and tenants, especially in the affordable, regulated, or other low-to-moderate income (LMI) segments of the market. Rent credits, utility allowances, or a shared savings program are possible options to accelerate adoption of this strategy in these market segments.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2021

Reducing Energy Use and Making Energy More Efficient in the Native Village of Kiana (Final Technical Report)

The goal of the Remote Alaska Community Energy Efficiency (RACEE) Competition was to advance the implementation of affordable, resilient, and clean energy-efficient solutions for remote Alaska communities. RACEE assisted Kiana with its unique challenges, mostly the remote nature of their location paired with the harsh temperatures and isolated electrical grid resulting in high energy costs. In addition to the assistance from DOE, the Alaska Energy Authority (AEA) provided direct technical assistance to RACEE recipients throughout their projects. Before Kiana started work, AEA conducted energy audits in public buildings and facilities to identify which energy measures would be most effective for the community’s energy goals.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2021

Assessment of the Impact of the Single Stream Recycling on Paper Contamination in Recovery Facilities and Paper Mills

Contaminated recyclables pose one of the largest roadblocks to an effective implementation of a circular economy system. Current knowledge surrounding the effects of various recycling methods on contamination rates is limited, thus preventing effective quantification of contamination effects. This study aims to fill this knowledge gap by assessing the impact of single stream recycling on paper contamination in MRFs and their end-products based on different composition studies conducted by facilities nationwide. This project expects to provide the foundational knowledge that could catalyze significant cost savings and energy consumption at MRFs and paper mills by understanding the levels of inbound and outbound contamination rates in SSR systems. Statistical analysis conducted in this project utilizes the available nationwide inbound and outbound samples collected as part of material composition and audit studies to identify and measure the significance of various factors on the resultant contamination levels. The research results provide benefits to both the recycling industry and its customers by addressing the causes and impact of contamination in recycled products, particularly with the wide applicability of single stream recycling within the United States.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2022

Industrial Assessment Center for Energy Efficiency, Smart Manufacturing and Cyber Security of Illinois and Northwestern Indiana Small and Medium Sized Manufacturing Companies and Water Facilities (Final Technical Report)

The University of Illinois Chicago (UIC) established and implemented a U.S. Department of Energy (DOE) sponsored Industrial Assessment Center (IAC) from September 1, 2016 through December 31, 2021. The established UIC IAC focused on providing 1) technical assistance to small and medium-sized enterprises (SMEs) and water and wastewater facilities in Illinois and northwestern Indiana and 2) education and training university students developing the future energy workforce. The technical assessments incorporated energy efficiency, increasing productivity via smart manufacturing, energy management systems, enhancing on-site cyber security practices, and the promotion of DOE best practices and tools. The educational training enabled UIC faculty and staff to provide classroom education, exposure to industry research, multiple targeted training sessions, real world experience with industry professionals, and live training to implement professional grade audits and recommendations.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2022

ACES: Infrastructure As Code. Model Optimization and Performance Capability

Infrastructure as Code (IaC) refers to managing infrastructure (networks, physical/virtual machines, storage, and connection topology) in a descriptive model/language, rather than configuring it manually or using interactive configuration tools. Just like source code can be compiled to generate the same binary code, IaC enables generating the same environment every time it is applied. IaC is a key DevOps practice and is generally used in conjunction with continuous integration (CI) and continuous delivery (CD). In CI, all code changes are merged into a mainline branch and validated multiple times a day as developers check in their changes to the source code. In CD on the other hand, code changes are automatically packaged for a new release-to-production on a regular basis. This typically enables teams to deliver software changes much more quickly and often. Developing and managing the ACES platform using (IaC) is vital for the robust deployment and continued sustainment of this foundational computing capability. IaC and DevOps practices will help us solve many of the common challenges often encountered in developing and maintaining compute infrastructure. First, it will make the provisioning, deployment, and maintenance of the compute infrastructure across multiple environments much more efficient. Second, these processes help make the overall system much more stable by continuously testing new changes as they are introduced to the system. Third, it allows us to be much more confident of the security controls in place since they can be tested as part of the CI process and all new changes can be audited and tracked. Finally, IaC enables the ACES Platform to be adaptable to the emerging technologies due to its ability to spin up different test beds to evaluate and incorporate these technologies. This document addresses common infrastructure-management challenges, describes what happens if they are not addressed, and highlights the value of utilizing IaC to tackle them. Finally, we will provide a high-level overview of the IaC and DevOps practices being utilized by the ACES Platform team.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Waste Compliance and Tracking System (WCATS) Version 3 Requirements Document

This document describes the end-user requirements for the Waste Compliance and Tracking System (WCATS) project in accordance with the WCATS Software Quality Management Plan, EPC-WMP-WCATSPLAN-001. The WCATS application shall support the generation, characterization, processing, and shipment of LANL radioactive, hazardous, and industrial waste. Regulatory drivers include RCRA hazardous waste, DOT shipping, NNSA nuclear material control and accountability, DOE nuclear safety, TSDF permit, and transuranic waste certification requirements. The system will utilize a task-based architecture that supports the spectrum of treatment, storage, disposal, administrative, and characterization based unit operations necessary to manage waste from cradle to grave. The application design shall readily accommodate new facilities, processes, workflow, signature requirements, and so forth, via end-user established metadata. WCATS will provide support for representing waste storage and disposal facilities, buildings, rooms, and grid layouts (x, y, z) to support waste and radioactive material inventory management. Nuclear material at risk (MAR), DOE hazard rating (e.g., Category II facility) compliance per DOE-STD-1027, and permit inventory requirements will be configurable for any storage or disposal facility, or waste operation, and the system will automatically evaluate and enforce those requirements. In addition, the application will support the characterization and management of the entire range of hazardous and radioactive wastes (TRU, MTRU, LLW, MLLW, hazardous waste, etc.) that might be colocated or processed at a permitted facility. Some capabilities not found in traditional systems include user-defined tank systems for liquid waste, user-defined work paths (i.e., sequence of operations), and an equipment subsystem for tracking the calibration, maintenance, and inspection of tools used to process waste, such as torque wrenches, scales, pH probes, etc. The application incorporates a desktop and mobile user interface as shown in Figure 1. The mobile interface supports field operations, such as waste item characterization, intra-facility transfers, internal and external audits, and shipment preparation and receipt.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2023

Framework for Incorporating Social Cost of Carbon in Weatherization

This document provides a framework for incorporating [avoided] social cost of carbon (SCC) when calculating cost effectiveness of energy measures under the U.S. Department of Energy Weatherization Assistance Program (WAP). The framework describes the relevant metrics, calculation methodology, and implementation approach that can be adopted by any energy audit software for use under the WAP.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2023

Field Validation of Air-Source Heat Pumps for Cold Climates

Heating energy is the largest end-use for U.S. residential buildings accounting for approximately one-third of residential building energy consumption (EIA 2021). Historically, air-source heat pumps have been limited to temperate climates because of subpar performance at extremely cold outdoor air temperatures. However, recent advances to cold-climate air-source heat pump technology, which typically rely on inverter-driven, variable-speed compressors and variable-speed fans, have significantly improved low-temperature heat pump performance enabling the technology to save energy for many homes in cold climates. The primary objective of this project was to measure in-field performance of centrally ducted, variable-capacity air-source heat pumps in cold climates to validate performance and develop field-based performance maps. The project focused on quantifying heat pump performance at cold temperatures. The sites identified for the study were primarily located in the Northwest United States since homes in the region tend to have all-electric space heating systems and high-efficiency heat pumps have been incentivized in the region for several years. NREL partnered with Ecotope, Inc., a small energy consulting firm located in Seattle, WA, for site recruitment, monitoring equipment installation, data quality management. All the sites included in the study had previously installed a high-efficiency, central heat pump system. One site was in a Denver, CO suburb, which was the only dual fuel heat pump in the study. We used airside and power measurements, collected at 5-second intervals, to quantify heat pump capacity, coefficient of performance (COP), and auxiliary heater energy consumption. We developed algorithms to automatically determine the heat pump operating mode including defrost and auxiliary heating operation. A whole-house thermal and duct audit was completed during the initial site visit to estimate winter heating loads and assess heat pump sizing. Whole-home heating design loads were calculated at ASHRAE 99% design temperatures and compared to manufacturer-reported maximum capacities to assess the heat pump sizing at each site.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2023

Open Source Evaluation Framework for Solar Forecasting

The Solar Forecast Arbiter is an open-source evaluation framework for solar forecasting. The framework enables evaluations of solar irradiance, solar power, and net-load forecasts that are impartial, repeatable and auditable. The Solar Forecast Arbiter addresses stakeholder-informed use cases including evaluation of forecast skill, comparisons to reference data sets, private forecast trials, and evaluation of probabilistic forecast skill. The framework includes a data validation toolkit, reference data sources, data privacy protocols, and benchmark forecast capabilities for intra-hour and day ahead forecast horizons. Reports and metrics communicate the relative merits of the test and benchmark forecasts. The reports are created from standardized templates and include graphics for qualitatively evaluating deterministic and probabilistic forecasts and standard metrics for quantitatively evaluating forecasts. The Solar Forecast Arbiter is designed to support all solar forecasting stakeholders, including Solar Forecasting 2 Topic Area 2 and Topic Area 3 teams.

14 SOLAR ENERGY↗
DOE OSTI2023

Blockchain Empowered Provenance Framework for Sensor Identity Management and Data Flow Security in Fossil-based Power Plants

The overall goals of this project are divided into 3 important phases. First, a peer-to-peer SCADA network is to be established where identity profile of sensors from fossil-power plants will be stored in an immutable manner in order to verify data flow integrity in real time. Second, it is aimed to develop a Blockchain-based provenance platform to audit equipment operations along with data and process integrity violations. In this phase, various operational rules will be incorporated in the ledger on behalf of the operating sensor so its abnormal use can be easily detected. In addition, it is aimed to achieve provenance when the rate of transactions is exceedingly high, thus enabling to design a scalable provenance scheme that can work in real time when number of data collecting points or sensor units increase in fossil-based power plants. Finally, a working testbed will be developed to integrate the Blockchain platform with sensor-based fossil power plant comprising of Remote Terminal Units (RTU) and SCADA devices. Using multiple Raspberry-PIs mimicking the role of RTUs that are interfaced with multiple sensors devices will be deployed to serve as a critical component of fossil power plant and the performance metrics such as throughput, latency, bootstrapping time, etc., will be evaluated on the testbed.

20 FOSSIL-FUELED POWER PLANTS↗
DOE OSTI2024

Time Dilated Bundt Cake Analysis of PV Output [Poster]

We present a novel method for modeling time-dependent statistics in the power signal generated by a photovoltaic (PV) system. Our white-box machine learning method is interpretable and auditable, based on principles of multiperiodic basis functions and convex optimization. Our proposed method of time dilating the daily signal to remove night time values results in a novel representation of PV power signals, evocative of a ‘Bundt cake’. The proposed model describes the marginal distribution of power output as a function of date and time. The resulting probabilistic model of a PV system can be used to perform a variety of tasks, and here, we demonstrate the application of clear sky detection.

14 SOLAR ENERGY↗
DOE OSTI2023

Implementation of an ICS Ransomware Testbed: Scenarios, Variants, and Evaluation Methods

Ransomware attacks on Industrial Control Systems (ICS) have emerged as a formidable threat to the United States’ critical infrastructure, eliciting grave concerns regarding national security. In March 2023, the FBI Internet Crime Complaint Center (IC3) unveiled its 2022 Internet Crime Report, highlighting a concerning 870 complaints related to ransomware impacting U.S. critical infrastructure. Of the country's 16 critical infrastructure sectors, 14 encountered at least one ransomware attack. Notably, while the Healthcare and Public Health sector suffered the most, reporting 210 attacks, sectors pivotal to ICS networks and governmental organizations were also targeted: the Defense Industrial Base reported 1 attack, Water and Wastewater Systems 3, Chemical 19, Energy 15, Government Facilities 115, and Critical Manufacturing 157. For instance, a ransomware attack on a major chemical company could jeopardize not only its production but also pose environmental risks should systems controlling hazardous materials be compromised. In 2022, three ransomware variants predominantly targeted U.S. critical infrastructure: HIVE, with 87 attacks; ALPHV/BlackCat, with 114; and LOCKBIT, with 149. Several cyber-attacks, such as the MOVEit data breach in May 2023 and the Colonial Pipeline ransomware attack in May 2021, have been so impactful that they commanded national attention. The DarkSide hacking group's assault on the Colonial Pipeline, initiated on May 6th, 2021, stands as one of the most substantial and publicly acknowledged cyber-attacks against U.S. critical infrastructure. The group exploited an exposed Virtual Private Network (VPN) password, paving the way for initial intrusion and subsequent data theft. A mere day later, DarkSide unleashed a ransomware attack that compromised vital accounting and billing systems, prompting an immediate shutdown of the pipeline to mitigate further ransomware proliferation across its network. This crisis spurred a robust response from the U.S. president and regulators, culminating in a national emergency declaration related to the pipeline shutdown on May 9th, 2021. This incident mirrors the 2017 NotPetya ransomware attack that significantly impacted the shipping giant Maersk, highlighting an urgent need for fortified cybersecurity across various industries. Future incidents, akin to the Colonial Pipeline attack, could potentially be mitigated—or entirely averted—should government agencies and private entities scrutinize system vulnerabilities, exploring various ransomware types and entry points. Proactive measures, such as conducting experiments on VPN accounts or auditing passwords to pinpoint duplicate usage across diverse systems and software, might illuminate feasible entry points and vulnerability zones within an organization's systems.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2024

Income Verification Strategies for Income-Based Solar Programs

The Inflation Reduction Act has created substantial new programs that support adoption of solar power by low-income households, including the $7 billion Solar For All program and the Low-Income Communities Bonus Credit Program, which increases the investment tax credit for certain types of deployment. In addition, a growing number of states are using solar programs to reduce energy burdens and create energy justice opportunities for low-income households and disadvantaged communities. Verifying the income of participating customers is an important component of these programs. Program managers are seeking strategies to verify a large number of subscribing customers in an accurate, timely, and cost-efficient manner. To help inform program managers, Berkeley Lab investigated how a number of energy and non-energy programs manage income verification. The most common approach is to require proof through tax documents, pay stubs, or other formal income documentation, which can pose an impediment to enrolling eligible customers and create a paperwork burden for administrators. In order to reduce the burden for both the applicant and the program manager, some programs use alternative methods. We identify three common alternative verification methods: -Categorical eligibility: Customers enrolled in other, similar income-verified assistance programs are automatically eligible for enrollment in other income-qualified programs. -Geographic eligibility: Eligibility is based on the customer’s location within a specified area, typically a low-income or disadvantaged community or census tract, and; -“Self-attestation”: The participant claims eligibility with or without further documentation. We describe these options, their pros and cons, give examples of how they are used, and explore how some low-income programs address administrative issues, audits, or other quality control measures. Finally, we explore the risk of mistaken verifications (finding a participant eligible when they are not) in the different strategies. While this memo was initiated by a request relating to income-based community solar programs, the methods are applicable to any program with income eligibility requirements in the energy or non-energy sector. Funding was provided for this research by the Solar Energy Technologies Office of the US Department of Energy, through the National Community Solar Partnership.

14 SOLAR ENERGY↗
DOE OSTI2024

Benchmarking MELCOR's NAC Package to ABCOVE Tests AB5 and AB6

This report presents analyses of the AB5 and AB6 ABCOVE sodium spray fire experiments with the MELCOR code. This code simulates the progression of accident events for analysis and auditing purposes of nuclear facilities during accident conditions. Historically, the ABCOVE experiments have contributed to the validation of aerosol physics and related phenomena. Given advancements in sodium-cooled reactor designs, characterization of the sodium spray combustion may further the review and validation of newly incorporated sodium properties and physics packages, namely, the sodium equations of state (EOS) and the sodium combustion (NAC) package within MELCOR. By analyzing the AB5 and AB6 experiments with and without the NAC package, sodium specificity for spray combustion and aerosol formation as well as speciation of the combustion products are reviewed with the new packages. This effort provides code users with a demonstration of the current code capabilities. This report provides the current best practices for the NAC package as well as a discussion of any issues observed while performing the presented analyses.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2024

Safety in Artificial Intelligence: Challenges and Opportunities for the U.S. National Labs and Beyond

This report discusses the importance of the critical and underexplored topic of artificial intelligence (AI) safety, as highlighted during the “Strategy Alignment on AI Safety” workshop convened at Lawrence Livermore National Laboratory (LLNL) in April 2024. Through a summary of keynote talks, panel discussions, and breakout sessions, world-leading AI safety experts from academic, industry, national labs, and government agencies clearly agree on the need for and importance of large-scale investments for research and capabilities in AI safety. With the field innovating at unprecedented rates, there is increasing urgency to develop novel evaluation methodologies that allow full considerations of risks/threats of AI technologies in different domains. Quantitative metrics and effective methodologies that can evaluate and audit the “safeness” of how a given AI technology is trained, deployed, or regulated are, at best, nascent for certain scenarios or, more commonly, nonexistent. This maturation gap presents the possibility of serious threats to national security, and further inaction may have serious consequences. Additionally, the gap between the public’s and research community’s perceptions of AI risks/rewards is significant. While numerous voices from the AI community have expressed concern that the risks could be so high that future AI systems could inflict extinction-level damage to humanity if deployed incorrectly, the public largely is aware only of risk in low-impact scenarios. This discrepancy highlights the crucial need for researchers to articulate to governmental bodies what, why, and when various AI risks matter as part of motivating funding requests. Thus, the call to action for this community is to pursue AI safety as a “Big Science” project on a scale comparable to the Manhattan Project. High risks and high payoffs are on the table, but safe AI is a fast-moving target, and large-scale investments are needed to guide development of this technology in a responsible way. We highlight the need for a multilayered solution combining the development of new methods and algorithmic approaches to mitigate threats with an active participation of the government(s) in setting high industry standards and regulations based on state-of-the-art technology. The U.S. Department of Energy (DOE) national laboratories have served as leading institutions for scientific innovation in the U.S. for more than 70 years. Drawing on their expertise in the AI community and their history of safeguarding critical and sensitive information, and as we look to the future, national labs are the best choice for evaluating and safeguarding AI technologies.

97 MATHEMATICS AND COMPUTING↗