Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “regulatory decisions”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

320 records · Page 18
All sourcesNASA NTRSDOE OSTI
NASA NTRS1998

Enhancing Global Competitiveness: Benchmarking Airline Operational Performance in Highly Regulated Environments

Enhancing competitiveness in the global airline industry is at the forefront of attention with airlines, government, and the flying public. The seemingly unchecked growth of major airline alliances is heralded as an enhancement to global competition. However, like many mega-conglomerates, mega-airlines will face complications driven by size regardless of the many recitations of enhanced efficiency. Outlined herein is a conceptual model to serve as a decision tool for policy-makers, managers, and consumers of airline services. This model is developed using public data for the United States (U.S.) major airline industry available from the U/S. Department of Transportation, Federal Aviation Administration, the National Aeronautics and Space Administration, the National Transportation Safety Board, and other public and private sector sources. Data points include number of accidents, pilot deviations, operational performance indicators, flight problems, and other factors. Data from these sources provide opportunity to develop a model based on a complex dot product equation of two vectors. A row vector is weighted for importance by a key informant panel of government, industry, and consumer experts, while a column vector is established with the factor value. The resulting equation, known as the national Airline Quality Rating (AQR), where Q is quality, C is weight, and V is the value of the variables, is stated Q=C[i1-19] x V[i1-19]. Looking at historical patterns of AQR results provides the basis for establishment of an industry benchmark for the purpose of enhancing airline operational performance. A 7 year average of overall operational performance provides the resulting benchmark indicator. Applications from this example can be applied to the many competitive environments of the global industry and assist policy-makers faced with rapidly changing regulatory challenges.

Bowen, Brent D.↗
DOE OSTI2026

Validating a Dynamic PWR Safety and Security Model?

Nuclear power plants (NPPs) are assessed for safety and security using separate models that cannot capture how an attacker's decisions and a plant's response unfold together in real time, leaving regulators and operators without a complete picture of true plant vulnerability. Traditional probabilistic risk assessment (PRA) methods treat adversarial events as fixed initiators with predetermined outcomes, and are structurally incapable of representing the time-dependent interplay between physical security events, safety system response, and operator mitigative actions. At Idaho National Laboratory (INL), I contributed to the development and validation of Modeling and Analysis for Safety and Security using the Dynamic EMRALD Framework (MASS-DEF). Where static PRA relies on event-tree logic that cannot evolve mid-scenario, MASS-DEF couples a time-dependent dynamic PRA tool EMRALD (Event Modeling Risk Assessment using Linked Diagrams) with attack simulation software, allowing attacker behavior, plant system states, and operator actions to interact across time. My work focused on validating a general Pressurized Water Reactor (PWR) model. I traced model logic against PWR plant to identified errors in logic and confirm accuracy. I then built and tested attack scenarios against a general PWR model to verify that the model produced expected outcomes across all logical pathways. I also contributed a section to a related technical paper applying the same EMRALD platform to radiation dose modeling. Results show that MASS-DEF can quantitatively demonstrate that many plants exceed their regulatory security thresholds. This demonstrated margin provides a technically defensible basis for reducing the number of guards without compromising regulatory compliance. Physical security costs represent roughly 10% of annual operating budgets, making such reductions directly meaningful to INL's mission of sustaining existing commercial NPPs. This internship strengthened my understanding of nuclear systems, probabilistic modeling, and technical writing, and has solidified my pursuit of a career at a national laboratory.

98 - NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL↗
DOE OSTI2020

Enhancement of risk informed validation framework for external hazard scenario

In recent years, the U.S. Nuclear Regulatory Commission (USNRC) and the International Atomic Energy Agency (IAEA) have developed methodologies to assess the vulnerabilities of nuclear plants against site specific extreme hazards. In many cases, advanced simulation tools are being considered to simulate multi-physics, multi-scale phenomena and to evaluate vulnerability of nuclear facilities. The credibility of advanced simulation tools is assessed based on a formal verification, validation, and uncertainty quantification procedure. One of the key limitations in validation is the lack of relevant experimental data at system-level. This limitation leads to a decrease in the confidence of system-level risk predictions. Therefore, a robust validation framework is needed to formalize the confidence in predictive capability of advanced simulation results. Additionally, this study enhances the existing risk informed validation methodology, originally proposed by Kwag et al. [1] and Bodda et al. [2], by developing additional attributes and a new set of validation indicies for a complete and wider applicability of the framework. In this manuscript, the methodology to identify the critical path that leads to the system-level failure is illustrated. The overall validation is checked for completeness and consistency by comparing the critical path for both the system-level simulation and experimental models. The applicability of the code for an intended application is represented in terms of various maturity levels and helps in the process of decision making.

42 ENGINEERING↗
DOE OSTI2020

A Dose Assessment Model for Radioactive Waste Exposed by Gully Erosion at West Valley - 20513

The Western New York Nuclear Service Center (WNYNSC), located approximately 48 km south of Buffalo, New York, is the site of a former nuclear fuel reprocessing and radioactive waste disposal facility. Spent nuclear fuel was processed there from 1966 to 1972, leaving behind radioactive and chemical wastes in two disposal areas and a waste tank farm. Site operations also resulted in releases of radioactivity to site soils, groundwater, and to surface waters draining the site. The New York State Energy Research and Development Authority (NYSERDA) and the U.S. Department of Energy (DOE) are collaborating in a process of decision making for decommissioning those facilities remaining at the WNYNSC following the completion of Phase 1 decommissioning. Neptune and Company, Inc. (Neptune) was contracted to develop a probabilistic performance assessment (PPA) computer model to assist the agencies in this process. The PPA Model includes a contaminant transport component focusing on the movement of contaminants within and among environmental media including groundwater and surface water transport, contaminant translocation by plants and animals, diffusion, and erosion. The model also includes evaluation of potential exposure and health effects for a Resident Farmer exposure scenario, where the Resident Farmer represents a critical group, described as that group of individuals reasonably expected to receive the greatest exposure to residual radioactivity for any applicable set of circumstances. The West Valley Site is located in the glaciated Allegheny Plateau region of western New York State. The waste reprocessing and disposal areas were constructed on a relatively fat area of plateau dissected by drainages of Buttermilk Creek, including Erdman Brook, Franks Creek, and Quarry Creek. An important aspect of the contaminant transport component of the PPA model is consideration of erosive processes such as slumping of the stream slopes and the advance of gullies from these streams. These erosion processes remove material from the plateau, growing the size of the creek valleys and making them wider and deeper. Of particular interest for the impact of erosion is radioactive waste contained in the Nuclear Regulatory Commission (NRC)-Licensed Disposal Area (NDA), the New York State-Licensed Disposal Area (SDA), and residual radiological inventory in the underground storage tanks at the Waste Tank Farm (WTF). The PPA Model is organized around geographically-defined facilities which were constructed upon the plateau, including the NDA, SDA, and WTF. Ongoing stream erosion processes will potentially transfer radioactive waste and residual inventory from these facilities to the ground surface on adjacent hillslope areas where erosion has breached the facility. Hence, it is important to evaluate the consequences of potential exposures to a Resident Farmer on the hillslopes below a breached facility. Two interrelated aspects of the dose assessment model related to hillslope exposure are discussed: 1) representation of the physical processes related to transport of radionuclides from facilities onto the hillslopes, and from the hillslopes into adjoining creeks where contaminated material migrates downstream with surface water and sediment, and; 2) adaptation of the activities associated with the Resident Farmer scenario to assess potential exposures to contamination in the hillslope areas. This discussion will cover the conceptual basis of the hillslope exposure and transport models, and also implementation in the PPA computer model. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2024

Decarbonizing Hydrogen Production: Assessing A Net-Negative Pathway

Hydrogen is gaining prominence as a key factor in the world's transition to a cleaner energy future. The International Energy Agency (IEA)'s Global Hydrogen Review 2023 reports that the number of low-emission hydrogen production projects is increasing rapidly. The potential for growth in new applications such as heavy industry, transportation, and power generation is significant. The IEA urges more decisive action to spur demand for low-emission hydrogen to achieve climate goals. While hydrogen is produced through various industrial methods, each with its own advantages and disadvantages, low-carbon hydrogen is critical for mitigating climate change and is incentivized by the Clean Hydrogen Production Tax Credit (45V). To this end, we have evaluated a commercial technology that can produce low- or negative-carbon hydrogen via ethanol catalytic oxidative reforming. This study assessed life cycle greenhouse gas emissions (carbon intensity or CI) associated with the hydrogen production technology. A total of 24 scenarios were evaluated, encompassing (a) Gen1 versus Gen2 ethanol inputs, (b) carbon capture and sequestration (CCS) of upstream fermentation CO2, and (c) oxygen sourcing via air separation unit (ASU) versus purchased or on-site production of oxygen as a byproduct of hydrogen electrolysis with a proton exchange membrane (PEM). Key findings include that the base case CI for hydrogen production using Gen2 ethanol from corn stover is lower than Gen1 dry mill corn ethanol. The study also points out that the CI for hydrogen production using PEM-O2 is lower than that using ASU-O2, whether the PEM-O2 is produced on-site or off-site (importing). When sourcing oxygen from on-site PEM-O2, the Gen1 and Gen2 ethanol-derived hydrogen exhibit favorable net-negative CI values for all evaluated scenarios, especially if the upstream ethanol CCS is included. As a reference, the 45V regulatory threshold for generating clean hydrogen tax credits is a CI below 0.45 kg CO2e/kg hydrogen.

BIOMASS FUELS,HYDROGEN↗
DOE OSTI2024

Cost effectiveness of preemptive school closures to mitigate pandemic influenza outbreaks of differing severity in the United States

Background: Nonpharmaceutical interventions (NPIs) may be considered as part of national pandemic preparedness as a first line defense against influenza pandemics. Preemptive school closures (PSCs) are an NPI reserved for severe pandemics and are highly effective in slowing influenza spread but have unintended consequences. Methods: We used results of simulated PSC impacts for a 1957-like pandemic (i.e., an influenza pandemic with a high case fatality rate) to estimate population health impacts and quantify PSC costs at the national level using three geographical scales, four closure durations, and three dismissal decision criteria (i.e., the number of cases detected to trigger closures). At the Chicago regional level, we also used results from simulated 1957-like, 1968-like, and 2009-like pandemics. Our net estimated economic impacts resulted from educational productivity costs plus loss of income associated with providing childcare during closures after netting out productivity gains from averted influenza illness based on the number of cases and deaths for each mitigation strategy. Results: For the 1957-like, national-level model, estimated net PSC costs and averted cases ranged from $\$7.5$ billion (2016 USD) averting 14.5 million cases for two-week, community-level closures to $\$97$ billion averting 47 million cases for 12-week, county-level closures. We found that 2-week school-by-school PSCs had the lowest cost per discounted life-year gained compared to county-wide or school district–wide closures for both the national and Chicago regional-level analyses of all pandemics. The feasibility of spatiotemporally precise triggering is questionable for most locales. Theoretically, this would be an attractive early option to allow more time to assess transmissibility and severity of a novel influenza virus. However, we also found that county-wide PSCs of longer durations (8 to 12 weeks) could avert the most cases (31–47 million) and deaths (105,000–156,000); however, the net cost would be considerably greater ($\$88$-$\$103$ billion net of averted illness costs) for the national-level, 1957-like analysis. Conclusions: We found that the net costs per death averted ($\$180,000$-$\$4.2$ million) for the national-level, 1957-like scenarios were generally less than the range of values recommended for regulatory impact analyses ($\$4.6$ to 15.0 million). This suggests that the economic benefits of national-level PSC strategies could exceed the costs of these interventions during future pandemics with highly transmissible strains with high case fatality rates. In contrast, the PSC outcomes for regional models of the 1968-like and 2009-like pandemics were less likely to be cost effective; more targeted and shorter duration closures would be recommended for these pandemics.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2022

Accelerated Materials Deployment in Advanced Nuclear Power Plants

The purpose of this report is to begin the development of a maximally efficient process for licensing and deploying new materials in Advanced Non-Light-Water Reactors (ANLWRs). Some new materials that are to be used in some new plants are seen as possibly introducing risks, because our understanding of those new materials’ behavior in the conditions generated by some novel plant designs is less complete than our understanding of the behavior of materials with long use histories in existing designs. In these cases, an approved code/standard or a code case to support the use of these materials in the novel design’s safety case may not exist for the regulator to utilize as part of the licensing determination. This circumstance creates the potential for an extremely long licensing process for new designs using new materials. The present strategy is to show how to manage these risks proactively, in such a way as to permit licensing decisions to be made in a timely manner, based on this risk management process. The present report outlines the gaps in the current codes to support deployment and use of novel materials and begins the development of the necessary risk management framework that is focused on the subject materials issues; it is based on risk-informed in-service surveillance practices, carried out in such a way as to compensate for current limitations in our state of knowledge. This development will enable licensing and deployment of the subject materials, conditional on the proactive surveillance process to be established. While this report is occasioned by limitations in our knowledge of certain materials issues that may arise in advanced designs, in-service surveillance is always done in order to compensate for a lack of knowledge: if we knew that components were not already failed and not trending toward failure, we would not perform surveillance, even in current-generation plants (except that prescriptive requirements would force us to do so). What is different about the surveillance program discussed here is that the issues are newer and the relevant experience base is less complete, so the surveillance presently contemplated may need to measure new things and/or measure them more often than has been traditional for surveillance coupons. The present report is devoted to the risk management framework and applies American Society of Mechanical Engineers Boiler and Pressure Vessel Code Section XI, Division [1] to establish the structure of a protocol for carrying out the necessary surveillance. These documents are generic: they do not tell us how often to surveille, or what to surveille, or what to measure, but rather how to determine those things, given certain technical inputs. The Regulatory Development R&D Program [2] is currently developing the companion supporting technical basis for the materials surveillance technology that, when completed and validated, can be used by owner/operator and NRC to implement a materials degradation management program for ANLWRs. This report also outlines salient points of discussion, positive potential outcomes, and potential concerns from industry and the USNRC. These aspects of the report intend to inform future work to develop a proposed technical process for adoption by the industry and endorsement by the USNRC to allow developers to propose a risk informed and conservative approach for the use of materials where operating experience/data and codes and standards may not exist for use of a novel material in an operating reactor environment. Additionally, such a technology could be leveraged to potentially reduce part of the upfront materials data requirements from ongoing long-term materials testing so that early action on license application could be undertaken by NRC, in parallel with the continuation of long-term data collection. This could accelerate the schedule for a first-of-a-kind ANLWR deployment or a nth-of-a-kind new materials insertion for established ANLWR designs.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2023

Addendum 2 to the Closure Report for CAU 577 Area 5 Chromium Containing Waste Disposal Cells, NNSS, Nevada

Corrective Action Unit (CAU) 577, “Area 5 Chromium Containing Waste Disposal Cells,” includes five low-level waste cells at the Nevada National Security Site Area 5 Radioactive Waste Management Site where buried waste received from Nuclear Fuel Services, Inc., was subsequently determined to contain chromium that exceeded the toxicity characteristic leaching procedure regulatory limit, which would require the waste to carry hazardous waste code D007. CAU 577 was created to satisfy the requirements of the Settlement Agreement (SA) executed between the Nevada Division of Environmental Protection (NDEP) and the U.S. Department of Energy, National Nuclear Security Administration Nevada Field Office (NNSA/NFO) on April 25, 2019 (NDEP 2019). The SA required that the chromium-containing waste received from NFS would be addressed following the closure process laid out in the Federal Facility Agreement and Consent Order (FFACO). The FFACO process ensures proper closure of the chromium-containing waste and documentation of that closure through FFACO-type documents. The following three Corrective Action Sites (CASs) were closed, and their closure was documented in the Closure Report for Corrective Action Unit 577: Area 5 Chromium Containing Waste Disposal Cells, Nevada National Security Site, Nevada, DOE/EMNV--0030, dated September 2021 (U.S. Department of Energy [DOE] Environmental Management [EM] Nevada Program 2021a): • CAS 05-21-02, Waste Disposal Cell 12 • CAS 05-21-03, Waste Disposal Cell 15 • CAS 05-21-04, Waste Disposal Cell 17 Closure of the following CAS was previously documented in the Addendum to the Closure Report for Corrective Action Unit 577: Area 5 Chromium Containing Waste Disposal Cells, Nevada National Security Site, Nevada, DOE/EMNV--0030-ADD, dated September 2022 (DOE EM Nevada Program 2022): • CAS 05-21-05, Waste Disposal Cell 20 This second addendum to the Closure Report documents the closure activities that have occurred for CAS 05-21-06, Waste Disposal Cell 21. This is the last CAS in CAU 577. The final waste shipment was placed in the waste disposal cell on November 21, 2022. Following this, closure activities began on November 28, 2022, and were conducted according to the Corrective Action Decision Document/Corrective Action Plan (CADD/CAP) for CAU 577 (DOE EM Nevada Program 2021b). The following closure activities were performed: • Constructing an engineered evapotranspiration cover • Installing two subsidence monuments and vadose zone monitoring equipment • Seeding the cover with a mixture of native plant species • Installing four concrete monuments on the corners of the cover and placing two use restriction (UR) warning signs on each monument These activities fulfill applicable federal and state regulations for closure of CAS 05-21-06 and minimize potential future exposure pathways to buried waste. Completed closure activities are also consistent with closure of the nine historical Resource Conservation and Recovery Act (RCRA) units included in Section 10.2.2 of the RCRA Permit that governs hazardous waste management activities at the Nevada National Security Site (Permit NEV HW0101) (NDEP 2023). UR documentation for this CAS is included in Appendix B of this report. The post-closure plan is presented in detail in the CADD/CAP for CAU 577 (DOE EM Nevada Program 2021b), and the requirements are summarized in Section 5.2 of this document. In accordance with paragraph 5D of the SA, a request to incorporate the requirements for post-closure monitoring of CAU 577 was included with the permit application for RCRA Permit NEV HW0101 that was submitted in January 2022 (NNSA/NFO 2022). The request included the post-closure requirements for the three CASs that had been closed at the time of submittal of the application as well as requirements that would be implemented upon future approval of closure of the remaining two CASs. All CAU 577 post-closure monitoring requirements have been captured in the April 4, 2023, Revision 7 of the RCRA Permit (NDEP 2023). As the RCRA Permit NEV HW0101 has been revised since the submittal of the original CAU 577 Closure Report (DOE EM Nevada Program 2021a) and Addendum 1 (DOE EM Nevada Program 2022), the post-closure requirements in this Addendum 2 report do not align with the previous documents. Specific changes resulting from the issuance of Revision 7 of the RCRA Permit are discussed in Section 5.2 of this report. The requirements in this report are consistent with the current permit (NDEP 2023) and supersede all requirements listed in the CAU 577 Closure Report and Addendum 1. All CAU 577 post-closure requirements should be conducted in accordance with the version of the RCRA Permit that is current at the time of the activities being performed. The DOE EM Nevada Program is requesting a Notice of Completion from NDEP for closure of CAU 577. Although CAU 577 is not a legacy site, the FFACO process is being followed to ensure proper closure of the chromium-containing waste. Therefore, transfer of CAU 577 from Appendix III of the FFACO to Appendix IV, Closed Corrective Action Units, is requested, as all closure activities have been completed.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2022

Performance Monitoring Program: Developing Comparative Metrics for Fitness-for-Duty Programs

To comply with U.S. Nuclear Regulatory Commission (NRC) regulations, licensees and entities authorized under Title 10 of the Code of Federal Regulations (CFR) Part 26 Section 26.3 (§ 26.3) are required to have fitness-for-duty (FFD) programs. Under § 26.3, the expectation of these FFD programs is to provide reasonable assurance that individuals who are granted unescorted access to nuclear power reactor protected areas and Category I fuel cycle facility material control areas are trustworthy, will perform their tasks in a reliable manner, are not under the influence of any substance, legal or illegal, that may impair their ability to perform their duties, and are not mentally or physically impaired from any cause that can adversely affect their ability to safely and competently perform their duties. Pacific Northwest National Laboratory (PNNL) was tasked with developing a performance monitoring program to risk inform NRC inspection and policy regarding quantitative FFD performance data. To meet this need, PNNL developed methodologies that could be implemented within a performance monitoring program. Throughout this report, these methodologies are referred to as comparative metrics. The NRC provided PNNL with 2016–2019 data from annual reporting forms and single positive test forms provided by licensees and other entities. For most of the comparative metrics, the analyses required customized processing, such as creating filtering fields, adding data fields and summaries, and joining datasets. The comparative metrics developed include: random testing rate, random policy violation rate, pre-access policy violation rate, subversion attempt rate, and number of policy violations by labor category. The comparative metrics can be used for parsing and visualizing FFD program data and monitoring FFD performance at the labor category, facility, licensee, and industry levels to risk inform NRC inspection and policy with regard to the FFD data currently collected from licensees and other entities that implement Part 26 requirements. Furthermore, these developed comparative metrics allow a more in-depth look at the FFD programs for the industry to discern trends and patterns that may warrant changes at an industry level and to inform policy decisions. These analyses should be refreshed as new FFD data become available.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2020

CY2019 Annual Closure Monitoring Report for Corrective Action Unit 98, Frenchman Flat, Underground Test Area, Nevada National Security Site, Nevada (January 2019–December 2019), Revision 1

Three types of monitoring are performed for CAU 98: water quality, water level, and institutional control. These are monitored to determine whether the URs remain protective of human health and the environment, and to ensure that the regulatory boundary objectives are being met. Monitoring data will be used in the future, once multiple years of data are available, to evaluate consistency with the groundwater flow and contaminant transport models because the contaminant boundaries calculated with the models are the primary basis of the UR boundaries. Six wells were sampled for water-quality monitoring in 2019. Contaminants of concern were detected only in the two source/plume wells already known to contain contamination as a result of a radionuclide migration experiment. Tritium concentrations in both of these wells, RNM-2S and UE-5n, remain above the Safe Drinking Water Act maximum contaminant level of 20,000 picocuries per liter but declined in 2019 as compared to measurements in 2018. All other contaminants of concern are below the minimum detection level plus analytical error. The water-level monitoring network includes 16 wells. Depth to water measured in 2019 is generally consistent with recent measurements for all wells. Many wells continue to exhibit a long-term downward trend in water level, though changes from 2018 to 2019 are minimal. The sharp 2016 decline in water level in Well ER-5-3-2 remains unexplained, with the lower level persisting through 2019. Rising water-level trends continue to be observed in Well ER-5-3 deep piezometer and former water supply Well WW-5A. Water supply Well WW-5B experienced a rise in water level as a result of an absence of pumping in the first part of the year (due to a mechanical problem), whereas water levels declined in WW-4 and WW-4A in response to greater pumping in 2019. Institutional control monitoring confirmed the URs are recorded in U.S. Department of Energy and U.S. Air Force land management systems, and that no activities within Frenchman Flat basin are occurring that could potentially affect the contaminant boundaries. Survey of groundwater resources in basins surrounding Frenchman Flat similarly identify no current or pending development that would indicate the need to increase monitoring activities or would otherwise cause concern for the closure decision. The URs continue to prevent exposure of the public, workers, and the environment to contaminants of concern by preventing use of potentially contaminated groundwater.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

Optimal CO 2 storage management considering safety constraints in multi-stakeholder multi-site GCS projects: A Markov game perspective

Geological carbon storage (GCS) projects could involve a diverse array of stakeholders or players from public, private, and regulatory sectors, each with different objectives and responsibilities. Given the complexity, scale, and long-term nature of GCS operations, determining whether individual stakeholders can independently optimize their interests — or whether collaborative coalition agreements are needed — remains a central question for effective GCS project planning and management. To access large, high-quality storage resources, future GCS deployment may increasingly occur in geologically connected sites, where shared geological features such as pressure space and reservoir pore capacity can lead to competitive behavior among stakeholders. In this work, we propose a paradigm based on Markov games to quantitatively investigate how different coalition structures affect the goals of stakeholders. We frame this multi-stakeholder multi-site problem as a multi-agent reinforcement learning problem with safety constraints. Our approach enables agents to learn optimal strategies while complying with safety regulations. We present an example where multiple operators are injecting CO 2 into their respective project areas in a geologically connected basin. To address the high computational cost of repeated simulations of high fidelity models, a previously developed surrogate model based on the Embed-to-Control (E2C) framework is employed. Our results demonstrate the effectiveness of the proposed framework in addressing optimal management of CO 2 storage when multiple stakeholders with different objectives and goals are involved.

58 GEOSCIENCES↗
NASA NTRS2017

Evaluating Process Effectiveness to Reduce Risk

It is well documented that government agencies do not have the same incentive as the private sector to focus on process effectiveness and continual improvement of those processes. It is also well documented whenever government agencies fail to deliver efficient, effective, consistent, and fair services to the citizens. In spite of the various "reinventing government" and "effectiveness initiatives" of the past decades, and in spite of the efforts on the part of many agencies to improve, government in general still lags behind industry in creating a culture of effective processes and systems. While the tragic events that unfolded recently in Flint, Michigan, teach us that running government "like a business" does not always take the needs of the citizenry into account, there are many lessons and techniques from the private sector that government agencies can use to improve. The incentive to improve, while mandated by various administrations1, needs to come from within the workforce, in order to effectively take root. The best, most effective incentive is to reduce, control or eliminate risk. Government agencies face some of the same risks as the private sector, while some are unique. While ISO 310002 has been around since 2009, risk has taken on increased visibility within the private sector with the advent of the emphasis on risk-based thinking in ISO 9001:20153. The relationship between risk-based thinking and effective processes is simple and direct. Those processes that are well thought out and standardized (i.e. Plan-Do-Check-Act), will have taken into account the applicable policy, statutory, regulatory, safety, quality and technical parameters, which may not occur to someone performing the process with minimal experience or training; and thus protect the employees, the public and the agency from statutory and regulatory violations; delay in providing services; non-delivery of services; harm to public or employee safety and health; cost overruns; breaches in security; loss of confidence in government; failure of publicly funded projects; damage to the environment; ethics violations, and the list goes on; with local, national and even international consequences. The Plan-Do-Check-Act process, also known as the "process approach" can be used at any time to establish and standardize a process, and it can also be used to check periodically for "process creep" (i.e., informal, unauthorized changes that have occurred over time), any necessary updates and improvements. While ISO 9001 compliance is not mandated for all government agencies, if interpreted correctly, it can be useful in establishing a framework and implementing effective management systems and processes.4 Another method that can be used to evaluate effectiveness is the scorecard definitions in Mallory's Process Management Standard5 as a basis for evaluating work on the process level on effective, and continuously improved and improving processes. With processes on the lower end of the scale, agencies are vulnerable to a great many risks, with employees and managers making up many of the rules as they go, leading to the above listed negative results. Without clear guidance for nominal operations, off-nominal situations can, and do, increase the likelihood of chaos. In an increasingly technical environment, with inter-agency communication and collaboration becoming the norm, agencies need to come to grips with the fact that processes can become rapidly outdated, and that the technical community should take on an increased role in the maturation of the agency's processes. Industry has long known that effective processes are also efficient, and process improvement methods such as Kaizen, Lean, Six Sigma, 5S, and mistake proofing lead to increased productivity, improved quality, and decreased cost. Again, government agencies have different concerns, but inefficiencies and mistakes can have dire and wide reaching consequences for the public that they serve. While no one goes to work planning to cause harm, it is up to agencies to establish upper level systems, which make establishment and compliance with processes possible. Again, Mallory provides us with a Systems Management Standard6, similar to the Process Management Standard, with a scale of 0-5 for systems effectiveness and maturity. Deming determined that "eighty-five percent of the reasons for failure are deficiencies in the systems and process rather than the employee. The role of management is to change the process rather than badgering individual employees to do better." 7 It is not just the working level employees who need effective processes, but the mid-and upper level managers as well. A disciplined management culture sets the tone for the employees, aids both routine and off-nominal decision-making, and incorporates risk -based thinking into the systems and processes as a matter of normal activity. Figure 1, illustrates the relationship between ineffective and effective processes and risk, through the use of the "stoplight" colors that are commonly used to show serious situations (red), situations which may be improving or deteriorating depending on trends (yellow), and situations that are under control and continuously improved (green).

Shepherd, Christena C.↗
DOE OSTI2021

Considerations regarding the Use of Computer Vision Machine Learning in Safety-Related or Risk-Significant Applications in Nuclear Power Plants

With the advancements made to date in the field of artificial intelligence (AI), significant potential exists to utilize AI capabilities for nuclear power plant (NPP) applications. AI can replicate human decision making and it is usually faster and more accurate than humans. For implementations that impact critical NPP applications (e.g., safety-related or non-safety systems that potentially affect overall plant risk), a deeper safety analysis of the AI methods is necessary. AI applied to NPP operations could resemble the use of digital I&C (DI&C) because such applications involve digital computer hardware and custom-designed software that input plant data, execute complex software algorithms, and output the results to a system or licensed human operator to potentially provoke an action. For AI methods to be compliant with current safety requirements for DI&C, AI compatibility must be evaluated, and AI-related gaps may exist that prevent the prompt deployment of AI in NPPs. This effort aims to evaluate how example AI technologies align with the DI&C safety framework, and discusses how they could be analyzed, modeled, tested, and validated in a manner similar to typical DI&C technologies. Because AI is a broad field that encompasses areas such as machine learning (ML), natural language processing, and computer vision, this research focused on a subset of methods categorized as the computer vision ML (CVML) methods. This report explores two CVML use cases, gauge reading and fire watch, considered relevant to the DI&C standards, as they could play a safety-critical role. For the gauge reading use case, a CVML-enabled technology that can read gauges at oblique angles is utilized. For the fire watch use case, a CVML-enabled technology is utilized that migrates fire watch from a manual (human) approach to automated fire detection. These use cases are mainly intended to give context to the CVML system discussion. This effort assumes the worst-case scenario, with the CVML system being used to replace a safety-related or risk-significant system, thus requiring evaluation. Evaluating CVML against most of the relevant safety requirements for DI&C yielded several CVML-specific considerations due to the uniqueness of its characteristics in comparison with typical DI&C systems. For example, CVML models often employ commonly used (open-source) datasets, and it is not always possible to determine the level of overlap among open-source datasets. Therefore, the independence of the developed CVML models when demonstrating diversity is questionable, therefore creating vulnerability to common cause failure (CCF). The design verification process is also impacted since the data overlap could result in overestimation of the software validation and verification (V&V) performance results. Section 2 of this report evaluates a list of the identified CVML-specific characteristics and discusses the resulting considerations and potential solutions in the context of each referenced requirement. A summation is provided in Section 3. This report is not to be used as a guideline. It was developed to identify and consider issues in the implementation of ML technologies used to augment activities that may have a bearing on plant operation. The report draws parallels to the use of DI&C technologies, for which many standards are available to guide their use in nuclear plant operation. It considers the technologies and some of the potential implications of their use in safety-related applications but is not intended to address regulatory or licensing related issues.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2022

NRAP-Open-IAM: NRAP Open Source Integrated Assessment Model

Note: This is the last version (a2.6.1) of NRAP-Open-IAM released during NRAP Phase II in 2022. The latest version of NRAP-Open-IAM is available here: https://edx.netl.doe.gov/dataset/phase-iii-nrap-open-iam NRAP-Open-IAM is an open-source software product that enables quantification of containment effectiveness and leakage risk at storage sites in the context of system uncertainties and variability. NRAP-Open-IAM represents the next-generation in a line of systems-based computational models developed for quantitative geological carbon storage (GCS) risk assessment. The model comprises a set of reduced-order and analytical models of various components of the GCS system, potential leakage pathways, receptors of concern including impact to groundwater resources and the atmosphere, a framework to support stochastic simulation, time stepping, uncertainty quantification, other analytical functionality for scenario and risk-performance evaluation, and a basic graphical user interface to support scenario development, data input simulation definition, and basic post-processing and results display. As the NRAP Open-IAM functionality continues to evolve, we continue to add to its capability to develop quantitative, probabilistic, and time-dependent profiles of the evolution of risk at a GCS site and evaluate the influence of uncertain parameters on uncertainty in predicted risk. It can be used to quantify the dynamics of reservoir saturation plume and pressure-affected area, for evaluation of the area of potential groundwater impact (i.e., Area of Review) and monitoring requirements to support cost and regulatory analysis, and for consideration of different post-injection site care and closure scenarios. This submission contains the current version of NRAP-Open-IAM available for evaluation and testing. To use the NRAP-Open-IAM, download the source code (https://edx.netl.doe.gov/dataset/08f396c8-bc5f-44ad-a028-6e98a6ea6d70/resource/4c24a3da-3b40-4ffe-9892-c807ae9f8760) then open the NRAP-Open-IAM user's guide (https://edx.netl.doe.gov/dataset/08f396c8-bc5f-44ad-a028-6e98a6ea6d70/resource/8b27335a-343c-4836-b8a3-3ad0bdc9e669) to read more about the tool. Installation instructions for Windows, Mac, and Linux can be found in the "installers" folder of the extracted NRAP-Open-IAM folder and describe setup of environment (e.g., Python libraries) needed for proper work of the tool. Test of installation can be done by running "python openiam_setup_tests.py" in the "setup" folder. The installation test also runs a test suite to see if the NRAP-Open-IAM has been installed correctly. To run the test suite separately, run "python iam_test.py" in the "test" folder. User's guide: https://edx.netl.doe.gov/dataset/08f396c8-bc5f-44ad-a028-6e98a6ea6d70/resource/8b27335a-343c-4836-b8a3-3ad0bdc9e669 Developer's guide: https://edx.netl.doe.gov/dataset/08f396c8-bc5f-44ad-a028-6e98a6ea6d70/resource/3bc6ee7d-609d-4eb6-80ba-fa6130ee0313 Reservoir simulation data used in some examples distributed with NRAP-Open-IAM: - Kimberlina: https://edx.netl.doe.gov/dataset/08f396c8-bc5f-44ad-a028-6e98a6ea6d70/resource/eb62cece-61b2-4037-9b6d-32407dde2ab8 - Kimberlina (compartmentalized): https://edx.netl.doe.gov/dataset/08f396c8-bc5f-44ad-a028-6e98a6ea6d70/resource/366f9530-3b32-4b84-affe-ab2df1d9a8b5 - FutureGen 2.0: https://edx.netl.doe.gov/dataset/futuregen-2-0-1008-simulation-reservoir-lookup-table NRAP-Open-IAM GitLab repository: https://gitlab.com/NRAP/OpenIAM Related publications: - Bacon, D., Yonkofski, C., Brown, C., Demirkanli, D. and Whiting, J., 2019. Risk-based post injection site care and monitoring for commercial-scale carbon storage: Reevaluation of the FutureGen 2.0 site using NRAP-Open-IAM and DREAM. International Journal of Greenhouse Gas Control 90: 102784. - Bacon, D. Demirkanli, D., and White, S., 2020. Probabilistic risk-based Area of Review (AoR) determination for a deep-saline carbon storage site. International Journal of Greenhouse Gas Control 102: 103153. - Harp, D., Oldenburg, C., and Pawar, R., 2019. A metric for evaluating conformance robustness during geologic CO2 sequestration operations. International Journal of Greenhouse Gas Control 85: 100-108. - Lackey, G., Vasylkivska, V., Huerta, N., King, S., and Dilmore, R., 2019. Managing well leakage risks at a geologic carbon storage site with many wells, International Journal of Greenhouse Gas Control, 88 :182-194. - Vasylkivska, V., Dilmore, R., Lackey, G., Zhang, Y., King, S., Bacon, D., Chen, B., Mansoor, K., and Harp, D., 2021. NRAP-Open-IAM: A flexible open-source integrated assessment model for geologic carbon storage risk assessment and management, Environmental Modelling & Software, 143: 105114. Presentations: - Chen, B., Harp, D., and Pawar, R., A data assimilation approach (ES-MDA) coupling with NRAP-Open-IAM for quantifying uncertainty reduction in geological CO2 sequestration. AGUFM 2019: T44A-02. - Chen, B., and Harp, D., Improving risk analysis precision for geologic CO2 sequestration by quantifying the uncertainty reduction before and after acquiring monitoring data. 14th Greenhouse Gas Control Technologies Conference, Melbourne, Australia, 2018, pp. 21-26. - Harp, D., National Risk Assessment Partnership Task 2: Containment Assurance. No. LA-UR-19-28654, Los Alamos National Laboratory (LANL), Los Alamos, NM (United States), 2019. - Vasylkivska, V., King, S., Bacon, D., Harp, D., Chen, B., Mansoor, K., Onishi, T., Yang, Y., Zhang, Y., and Keating, E., NRAP-Open-IAM: An open-source integrated assessment model, poster, Mastering the Subsurface Through Technology Innovation, Partnerships and Collaboration: Carbon Storage and Oil and Natural Gas Technologies Review Meeting, Pittsburgh, PA, August 13-16, 2018. - Vasylkivska, V., Lackey, G., King, S., Wentworth, A., Huerta, N., Creason, C., DiGiulio, J., Yang, Y., and Dilmore, R., Long-term risk analysis of a geologic CO2 storage project during the post-injection period, SIAM Conference on Computational Science and Engineering, Spokane, WA, February 25-March 1, 2019. - Vasylkivska, V., Overview of the NRAP-Open-IAM tool for carbon storage (beta release), 2019 Annual NRAP Tool Users Meeting, Pittsburgh, PA, August 27, 2019. - Vasylkivska, V., Bacon, D., Chen, B., Dilmore, R., Harp, D., King, S., Lackey, G., Lindner, E., Liu, G., Mansoor, K. and Zhang, Y., NRAP-Open-IAM: A new, open-source code for integrated assessment of geologic carbon storage containment effectiveness and leakage risk, poster, American Geophysical Union Fall Meeting 2020 (virtual meeting), December 2020. - Vasylkivska, V., NRAP open-source integrated assessment model and relevant application, oral presentation, NRAP workshop "NRAP Tools for Geologic Carbon Storage Risk-Based Decision Making" held in conjunction with Groundwater Protection Council (GWPC) 2021 Annual Forum (virtual meeting), Salt Lake City, UT, September 2021. - Vasylkivska, V., NRAP-Open-IAM: open-source integrated assessment model, digital poster/demonstration, software demonstration session, 2022 Carbon Management Project Review Meeting, August 16, 2022

AoR↗