Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Risk Informed Decision Making”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Optimizing Alabama’s CO 2 Storage in Shelby County (Project OASIS) Milestone 6.0: Evaluation of Class VI Readiness

Introduction. Project OASIS is approximately 30 miles southeast of Birmingham, Alabama, and approximately 5 miles north-northwest of Alabama Power Company's Plant Gaston. Geologically, the Project area is in the Alabama fold and thrust belt province. This work builds on the initiatives of the Southeast Regional Carbon Utilization and Storage Acceleration Partnership (SECARB-USA, DE-FE0031830) that identified nearly 500 million metric tonnes of CO 2 emitted on an annual basis that is not collocated with prospective storage geology (the Coastal Plain of the Southeastern US in this context). This observation suggests costly investments in connective infrastructure (e.g., pipelines) or exploratory well drilling campaigns to identify CO 2 storage opportunities in under explored areas. While not traditionally thought of for saline storage, these studies suggest that storage prospects in the Valley and Ridge Province occur in relatively flat lying structural panels between thrust faults. For the Project OASIS region, available geologic studies related to hydrocarbon exploration suggest that Cambro-Ordovician carbonates and Cambrian clastic units offer multiple potential storage intervals, and that regional confining systems are present, such as the tectonically thickened Floyd-Parkwood Shale. The Project OASIS surface property is owned by a timber and land stewardship company, The Westervelt Company, Inc., who worked with the Project Team to select and prepare adequate sites for geologic assessment. The purpose of drilling the Westover Stratigraphic Test Well #2 was to collect geologic data to model the feasibility of commercial scale CO 2 injection and storage in an under explored region. This initiative benefits the regions emitters as the data generated from this study can inform their own internal decision making. The field program included geological and geophysical evaluations, reservoir engineering analyses, and risk assessments. This report evaluates existing data, as well as a variety of modeling scenarios to evaluate project readiness. Importantly, the impact of this study is not limited to Alabama as there are numerous large emitters throughout Appalachia, in similar geologic settings, contemplating their decarbonization options.

20 FOSSIL-FUELED POWER PLANTS↗
NASA NTRS2013

Tool Use Within NASA Software Quality Assurance

As space mission software systems become larger and more complex, it is increasingly important for the software assurance effort to have the ability to effectively assess both the artifacts produced during software system development and the development process itself. Conceptually, assurance is a straightforward idea - it is the result of activities carried out by an organization independent of the software developers to better inform project management of potential technical and programmatic risks, and thus increase management's confidence in the decisions they ultimately make. In practice, effective assurance for large, complex systems often entails assessing large, complex software artifacts (e.g., requirements specifications, architectural descriptions) as well as substantial amounts of unstructured information (e.g., anomaly reports resulting from testing activities during development). In such an environment, assurance engineers can benefit greatly from appropriate tool support. In order to do so, an assurance organization will need accurate and timely information on the tool support available for various types of assurance activities. In this paper, we investigate the current use of tool support for assurance organizations within NASA, and describe on-going work at JPL for providing assurance organizations with the information about tools they need to use them effectively.

software assurance↗
NASA NTRS2019

Space Program Advocacy Can Distort Project Management and Damage Systems Engineering

Over-optimistic project advocacy often causes exaggerated performance claims and underestimated costs and schedules. This can distort project management and damage systems engineering. NASA projects such as the space shuttle and Hubble are extreme examples. NASA's spectacular success in the Apollo moon landings seems to have produced overconfidence and carelessness, but also to have gained tolerance for unrealistic claims and forgiveness when they were proven wrong. Apollo risk analysis predicted many astronaut fatalities. This was believed but was potentially damaging to the Apollo program, so risk analysis was discontinued. The moon landings beat bad odds because Apollo obsessively reduced risk. Its success seemed to confirm that risk analysis was unreasonably pessimistic and that risk could be overcome by good engineering. This understanding caused risk to be increased during space shuttle engineering and led to an unnecessarily dangerous approach. The shuttle design placed a fragile spacecraft next to the fuel tanks and failed to provide crew escape or launch abort. These design decisions directly caused the Challenger and Columbia tragedies. After Challenger, risk analysis was re-established. The current rocket and capsule design does consider risk and the result strongly resembles Apollo. Apollo advocacy led NASA to abandon risk analysis and this was ultimate cause of the Shuttle tragedies. Excessive advocacy that distorts risk, cost, and schedule could be prevented in an ideal organization that used systems engineering to make rational and fair decisions. However, most real organizations accommodate human and group needs using informal methods often described as "the system." Humans have biases, use innate decision making heuristics, instinctively rely on "gut feel," and establish deviant groups through groupthink. Expecting organizations to become totally rational is impractical, but specific problems such as neglecting risk and underestimating cost and schedule can be directly challenged with some hope of success.

Jones, Harry W.↗
NASA NTRS2004

Development of Risk Assessment Matrix for NASA Engineering and Safety Center

This paper describes a study, which had as its principal goal the development of a sufficiently detailed 5 x 5 Risk Matrix Scorecard. The purpose of this scorecard is to outline the criteria by which technical issues can be qualitatively and initially prioritized. The tool using this score card has been proposed to be one of the information resources the NASA Engineering and Safety Center (NESC) takes into consideration when making decisions with respect to incoming information on safety concerns across the entire NASA agency. The contents of this paper discuss in detail each element of the risk matrix scorecard, definitions for those elements and the rationale behind the development of those definitions. This scorecard development was performed in parallel with the tailoring of the existing Futron Corporation Integrated Risk Management Application (IRMA) software tool. IRMA was tailored to fit NESC needs for evaluating incoming safety concerns and was renamed NESC Assessment Risk Management Application (NAFMA) which is still in developmental phase.

Malone, Roy W., Jr.↗
DOE OSTI2023

Climate Services for Agriculture: Tools for Informing Decisions Relating to Climate Change and Climate Variability in the Wine Industry

Australia’s changing climate is already impacting the agriculture sector and will continue to do so in the future. To help respond to these impacts, the Climate Services for Agriculture (CSA) platform presents readily accessible climate data, including future climate projections, relevant to specific agricultural commodities. This wine industry example aims to demonstrate the functionality and utility of the CSA for national use across a broad range of commodities. Methods and Results. The platform includes commodity-relevant climate indices designed in consultation with experts to ensure that they are as salient to producers as possible; the wine-grape specific indices include measures of growing season temperature, rainfall, extreme heat, and frost. Here, we describe the research behind the wine-grape specific indices and present sample outputs from the CSA platform for a site within a selected winegrowing region. We note the CSA platform has been developed through an extensive and continuing user engagement initiative, ensuring it meets the needs of the agriculture community as they grapple with how to make decisions based on longer term climate projections. Conclusions. Provision of past, seasonal outlook, and future climate information for Australia and for a range of important agricultural commodities can help improve on-farm planning and decision-making to respond to climate risks. The wine industry provides a leading example of how to use these data for decision-making, noting ongoing adjustments will be needed. Significance of the Study. The CSA platform brings together historical climate data, seasonal climate outlooks, and future climate projections to assist agricultural producers to better manage climate variability and climate change. It aims to nationalise this information for all major agricultural commodities in Australia. We use wine production as a demonstration case here.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Development of Dry Cask Risk Tools

The Nuclear Regulatory Commission (NRC) has repeatedly expressed a desire to increase the use of risk in its decision-making. The Probabilistic Risk Assessment (PRA) Policy Statement published in 1995 formalized the Commission’s commitment to risk-informed regulation through the expanded use of PRA. While a great deal of work has been done to incorporate risk insights into the regulatory framework for at-power nuclear reactors. Far less progress has been made to risk inform the dry-casks and nuclear waste transportation areas of the nuclear fuel cycle. INL was tasked with incorporating the information from the two completed dry cask PRAs as well as any additional available information into a tool that helps the NRC use those insights to identify levels of risk at various stages in the nuclear waste cycle. The first task was to address the License Amendment Request (LAR) Process for Dry Cask storage, the second task is for the incorporate transportation into the tool, and the third and final task will be incorporate any additional regulatory applications for dry cask storage. This report covers the first task of the tool and will eventually incorporate the remaining two tasks may be completed in the future and built off the model described here. Task 1 specifically asked to incorporate the risk insights into the process for determining and prioritizing review of license amendment changes related to storage applications by outlining a resource allocation strategy and defining recommendations of for the depth and breadth of the LAR review. It was requested that the tool be similar in design to the SDP notebooks/worksheets and contain quantitative, qualitative, or semi-quantitative approaches to assessing the risk of the change. The final tool that was selected by INL to be developed was a flowchart and associated rationale document that allows the reviewer to quickly assess potential LAR changes and their associated risks as well as the rationale behind the risk categorization. This risk categorization will lead to specific actionable recommendations to expect from a change of that specific category. This allows for a more consistent review process as well as improving the overall efficiency of the review itself.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗
DOE OSTI2021

Plant Water Profiler: A Water Balance and True Cost of Water Calculator for Manufacturing Plants

As the uncertainty of a sustained water supply, regulatory constraints, competition among end users, and public scrutiny increases, a growing number of manufacturing sectors are adapting to current and emerging water-related risks by optimizing productivity and reducing waste. As a step toward increasing water use efficiency and making informed business decisions, corporations must make an effort to understand and track their water demands, losses, and costs associated with each subsystem within their facilities. Manufacturers are often unaware of the “true cost of water” (i.e., the total costs associated with procurement, treatment, and consumption of water, and wastewater disposal), which reduces the visibility of the actual impact of water-saving measures. To help manufacturers account for water procurement and use in manufacturing operations, quantify the true cost of water, and identify potential areas for water and associated energy cost savings, an open access tool—Plant Water Profiler (PWP)—was developed. The tool is based on water mass balance analysis and has been adopted as the core analysis tool for plant water use assessments, Water In-Plant Training (Water INPLT), as part of the US Department of Energy’s Better Plants program. During three pilot INPLTs conducted in 2019 at three manufacturing facilities, the PWP tool allowed users to understand water flows within the facilities and provided additional capabilities to analyze their water use. This paper describes the methodology behind the PWP tool and its implementation through pilot Water INPLT trainings delivered in three manufacturing facilities in the United States. The three case studies demonstrate opportunities to improve water efficiency and reduce associated costs and the challenges encountered in three different manufacturing sectors.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2026

Development and application of an environmental risk register for marine energy device and project developers

The marine energy industry is steadily advancing as more devices are deployed worldwide. However, several challenges and barriers remain, such as lingering uncertainty regarding the potential environmental effects of marine energy devices on marine animals, habitats, and ecosystems. Concerns have led to difficulty navigating permitting and consenting processes and receiving authorization to deploy devices in the marine environment, including extended timelines and costs. Based on existing risk registers, a novel marine energy environmental risk register was created to help the marine energy industry move beyond these barriers. This risk register aims to aid marine energy device and project developers identify and assess potential environmental risks early in device design or project planning, document and track potential environmental interactions, prioritize risks and determine risk responses, and make decisions throughout device or project development. It can also be used as a tool to assist in communicating with regulators and advisors during permitting processes and to inform stakeholder and community engagement efforts. This paper details the methods and process to develop a risk register specific to environmental effects of marine energy and describes two use cases (one for wave energy and another for tidal energy) to highlight example results. Due to the tool's novelty, the paper showcases its application for the marine energy industry and acknowledges limitations and possible future improvements. Overall, the environmental risk register shows promise to support marine energy developers when identifying, tracking, and addressing potential environmental risks and to help successfully navigate permitting and deploy marine energy devices responsibly.

Environmental effects↗
DOE OSTI2022

A Bayesian Approach for In-Situ Stress Prediction and Uncertainty Quantification for Subsurface Engineering

Many subsurface engineering applications require accurate knowledge of the in-situ state of stress for their safe design and operation. Existing methods to meet this need primarily include field measurements for estimating one or more of the principal stresses from a borehole, or optimization methods for constructing a 3D geomechanical model in terms of geophysical measurements. These methods, however, often contain considerable uncertainty in estimating the state of stress. Here, in this paper, we build on a Bayesian approach to quantify uncertainty in stress estimations for subsurface engineering applications. This approach can provide an estimate of the 3D distribution of stress throughout the volume of interest and provide an estimate of the uncertainty arising from the stress measurement, the rheology parameters, and a paucity of measurements. The value of this approach is demonstrated using stress measurements from the In Salah carbon storage site, which was one of the world’s first industrial carbon capture and storage projects. This demonstration shows the application of this Bayesian approach for estimating the initial state of stress for In Salah and quantifying the uncertainty in the estimated stress. Also, an assessment of a maximum injection pressure to prevent geomechanical risks from CO 2 injection pressures is provided in terms of the probability distribution of the minimum principal stress quantified by the approach. With the In Salah case study, this paper demonstrates that using the Bayesian approach can provide additional insights for site explorations and/or project operations to make informed-site decisions for subsurface engineering applications.

58 GEOSCIENCES↗
DOE OSTI2022

Risk-Informed Approach for Regulatory Approval of Microreactor Transport

Pacific Northwest National Laboratory (PNNL) is addressing the challenges associated with safe transport of microreactors including the development and evaluation of regulatory options. PNNL developed a risk-informed regulatory framework for the licensing of the transportation of microreactors in which irradiated nuclear fuel is part microreactor transportation package. The framework lays out a viable regulatory pathway, including decision points for regulatory options and the supporting technical evaluations for those options in phases from near to long term. A microreactor and its contents will likely not be able to meet all the federal regulatory requirements as a Type B or fissile material transportation package under 10 CFR Part 71 (“Packaging and Transportation of Radioactive Material”). However, the regulatory framework developed by PNNL lays out a viable risk-informed licensing options that are safe and feasible. Risk assessment such as probabilistic risk assessment (PRA) can be used to show comparable safety to that provided by a Type B or fissile material package for surface transport. The framework includes guidance on applicable regulations and discusses historical precedence in using risk information for transportation licensing. The framework includes guidance for performing a microreactor transportation PRA, use and development of risk evaluation criteria, and factors such of defense-in-depth and safety margin concepts. Key advantages of using the approach are (1) increasing the likelihood of successfully obtaining regulatory transportation package approval, (2) informing the design on the relative risk significance of microreactor containment and shielding, and (3) informing the need for transportation compensatory measures. This paper focuses on two primary elements of the framework which are development of a transportation PRA for microreactor packages and development of the risk acceptance guidelines to assess the results of the PRA for regulatory decision-making.

microreactor, micro nuclear power plant, MNPP, ris↗
NASA NTRS2008

The Integrated Medical Model: Statistical Forecasting of Risks to Crew Health and Mission Success

The Integrated Medical Model (IMM) helps capture and use organizational knowledge across the space medicine, training, operations, engineering, and research domains. The IMM uses this domain knowledge in the context of a mission and crew profile to forecast crew health and mission success risks. The IMM is most helpful in comparing the risk of two or more mission profiles, not as a tool for predicting absolute risk. The process of building the IMM adheres to Probability Risk Assessment (PRA) techniques described in NASA Procedural Requirement (NPR) 8705.5, and uses current evidence-based information to establish a defensible position for making decisions that help ensure crew health and mission success. The IMM quantitatively describes the following input parameters: 1) medical conditions and likelihood, 2) mission duration, 3) vehicle environment, 4) crew attributes (e.g. age, sex), 5) crew activities (e.g. EVA's, Lunar excursions), 6) diagnosis and treatment protocols (e.g. medical equipment, consumables pharmaceuticals), and 7) Crew Medical Officer (CMO) training effectiveness. It is worth reiterating that the IMM uses the data sets above as inputs. Many other risk management efforts stop at determining only likelihood. The IMM is unique in that it models not only likelihood, but risk mitigations, as well as subsequent clinical outcomes based on those mitigations. Once the mathematical relationships among the above parameters are established, the IMM uses a Monte Carlo simulation technique (a random sampling of the inputs as described by their statistical distribution) to determine the probable outcomes. Because the IMM is a stochastic model (i.e. the input parameters are represented by various statistical distributions depending on the data type), when the mission is simulated 10-50,000 times with a given set of medical capabilities (risk mitigations), a prediction of the most probable outcomes can be generated. For each mission, the IMM tracks which conditions occurred and decrements the pharmaceuticals and supplies required to diagnose and treat these medical conditions. If supplies are depleted, then the medical condition goes untreated, and crew and mission risk increase. The IMM currently models approximately 30 medical conditions. By the end of FY2008, the IMM will be modeling over 100 medical conditions, approximately 60 of which have been recorded to have occurred during short and long space missions.

Fitts, M. A.↗
DOE OSTI2021

Data Driven Analysis for Modernization Program Management

NNSA is responsible for managing national nuclear security missions: ensuring a safe, secure, and reliable nuclear deterrent; supplying nuclear fuel to the Navy; and supporting the nation’s nuclear nonproliferation efforts. However, over half of NNSA’s facilities are more than 40 years old, and roughly one-third date back to the Manhattan Project. To execute its critical nuclear security missions, NNSA is making large investments to modernize its nuclear production capabilities. This ramp up represents NNSA’s largest modernization effort since the Cold War. Given the scale of these efforts, NNSA’s Office of Secondary Stage Production Modernization has implemented data driven techniques to prioritize investments and inform strategic decision making. NNSA, with support from its site managing contractors, has developed and implemented an integrated schedule and risk management system to address the issues and limitations with the traditional approach. The multi-year integrated schedules are key to identifying program linkages and managing large portfolios comprised of many different projects and efforts. In conjunction with the integrated schedule, a new program risk management system has also been developed and implemented, which manages program risks and opportunities, along with specific mitigation strategies to reduce or eliminate the risks per timelines that are tracked in the integrated schedule. This paper is supplemented with a follow-on presentation on effective management of program material and throughput modeling.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
NASA NTRS1976

Space-based solar power conversion and delivery systems study. Volume 1: Executive summary

The technical and economic aspects of satellite solar power systems are presented with a focus on the current configuration 5000 MW system. The technical studies include analyses of the orbital system structures, control and stationkeeping, and the formulation of program plans and costs for input to the economic analyses. The economic analyses centered about the development and use of a risk analysis model for a system cost assessment, identification of critical issues and technologies, and to provide information for programmatic decision making. A preliminary economic examination of some utility interface issues is included. Under the present state-of-knowledge, it is possible to formulate a program plan for the development of a satellite solar power system that can be economically justified. The key area of technological uncertainty is man's ability to fabricate and assemble large structures in space.

Hazelrigg, G. A., Jr.↗
NASA NTRS2006

An Overview of NASA's IM&S Verification and Validation Process Plan and Specification for Space Exploration

NASA's Exploration Systems Mission Directorate (ESMD) is implementing a management approach for modeling and simulation (M&S) that will provide decision-makers information on the model's fidelity, credibility, and quality. This information will allow the decision-maker to understand the risks involved in using a model's results in the decision-making process. This presentation will discuss NASA's approach for verification and validation (V&V) of its models or simulations supporting space exploration. This presentation will describe NASA's V&V process and the associated M&S verification and validation (V&V) activities required to support the decision-making process. The M&S V&V Plan and V&V Report templates for ESMD will also be illustrated.

Gravitz, Robert M.↗
NASA NTRS2006

NASA's M and S Accreditation Process Plan and Specification for Space Exploration

NASA's Exploration Systems Mission Directorate (ESMD) is implementing a management approach for modeling and simulation (M&S) that will provide decision-makers information on the model's fidelity, credibility, and quality. This information will allow the decision-maker to understand the risks involved in using a model's results in the decision-making process. This presentation will discuss NASA's overall approach to achieving formal accreditation of its models or simulations supporting space exploration. The development of a formal Accreditation Plan is a key component in the preliminary activities for modeling and simulation (M&S) assessment. This presentation will describe NASA's process for identifying risks associated with M&S use and the associated M&S assessments that will dictate the level of data certification and M&S verification and validation (V&V) activities required to support the decision-making process. The M&S Accreditation Plan and Report templates for ESMD will also be illustrated.

O'Neil, David↗
NASA NTRS2016

Surface Water and Flood Extent Mapping, Monitoring, and Modeling Products and Services for the SERVIR Regions

SERVIR is a joint NASA - US Agency for International Development (USAID) project to improve environmental decision-making using Earth observations and geospatial technologies. A common need identified among SERVIR regions has been improved information for disaster risk reduction and in specific surface water and flood extent mapping, monitoring and forecasting. Of the 70 SERVIR products (active, complete, and in development), 4 are related to surface water and flood extent mapping, monitoring or forecasting. Visit http://www.servircatalog.net for more product details.

environment↗
NASA NTRS1999

The Human Space Life Sciences Critical Path Roadmap Project: A Strategy for Human Space Flight through Exploration-Class Missions

The product of the critical path roadmap project is an integrated strategy for mitigating the risks associated with human exploration class missions. It is an evolving process that will assure the ability to communicate the integrated critical path roadmap. Unlike previous reports, this one will not sit on a shelf - it has the full support of the JSC Space and Life Sciences Directorate (SA) and is already being used as a decision making tool (e.g., budget and investigation planning for Shuttle and Space Station mission). Utility of this product depends on many efforts, namely: providing the required information (completed risk data sheets, critical question information, technology data). It is essential to communicate the results of the critical path roadmap to the scientific community - this meeting is a good opportunity to do so. The web site envisioned for the critical path roadmap will provide the capability to communicate to a broader community and to track and update the system routinely.

Sawin, Charles F.↗
DOE OSTI2020

Risk-Informed Approach for Event Selection and Component Classification

Develop a report summarizing a structured approach for the incorporation of risk insights when making facility safety assessments and regulatory decisions is proposed to supplement the deterministic approach, with the following expected benefits: Increased confidence that key safety issues have been fully identified and addressed Better understanding of safety margins Facilitates more structured dialogue among international regulators Reduced reliance on “expert judgement” through a rigorous, pre-defined process with more predictable outcomes Proposed outcome is development of a report summarizing the structure and key considerations for applying this approach that: Is inclusive of advanced reactor technologies Provides for flexible implementation recognizing unique and varying sovereign regulatory structures Builds upon existing/current GIF safety approaches (e.g., GIF Basic Safety Approach, Integrated Safety Assessment Methodology)

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗