The Value of Graphical Models for Quantifying Risk
Explore the source record for details and available documents.
SEARCH · Engineering Papers
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Explore the source record for details and available documents.
As Integrated Energy Systems (IES) combine multiple energy and storage technologies to provide potentially more value and less risk via resource diversification, complementary overbuild, increased flexibility, and revenue-stacking, IES value is dependent on electricity market dispatch and grid interactions should play an important role in IES design and operation. This study hybridizes and retrofits wind and combustion turbine plants to study the impacts of replacing gas generation capacity with wind, battery, PEM electrolysis, hydrogen tanks and hydrogen turbines. The optimized design is co-simulated in a production cost model with different bidding strategies in order to compare performance and highlight the importance of grid-interactions. We analyze the revenue and dispatch changes as well as the price and cost implications of wind-battery-hydrogen IESs.
Purpose: To evaluate the utility of 3-dimensional magnetic resonance (3D-MR) proton spectroscopic imaging for treatment planning and its implications for early response assessment in glioblastoma multiforme. Methods and Materials: Eighteen patients with newly diagnosed, histologically confirmed glioblastoma had 3D-MR proton spectroscopic imaging (MRSI) along with T2 and T1 gadolinium-enhanced MR images at simulation and at boost treatment planning after 17 to 20 fractions of radiation therapy. All patients received standard radiation therapy (RT) with concurrent temozolomide followed by adjuvant temozolomide. Imaging for response assessment consisted of MR scans every 2 months. Progression-free survival was defined by the criteria of MacDonald et al. MRSI images obtained at initial simulation were analyzed for choline/N-acetylaspartate ratios (Cho/NAA) on a voxel-by-voxel basis with abnormal activity defined as Cho/NAA ≥2. These images were compared on anatomically matched MRSI data collected after 3 weeks of RT. Changes in Cho/NAA between pretherapy and third-week RT scans were tested using Wilcoxon matched-pairs signed rank tests and correlated with progression-free survival, radiation dose and location of recurrence using Cox proportional hazards regression. Results: After a median follow-up time of 8.6 months, 50% of patients had experienced progression based on imaging. Patients with a decreased or stable mean or median Cho/NAA values had less risk of progression (P<.01). Patients with an increase in mean or median Cho/NAA values at the third-week RT scan had a significantly greater chance of early progression (P<.01). An increased Cho/NAA at the third-week MRSI scan carried a hazard ratio of 2.72 (95% confidence interval, 1.10-6.71; P=.03). Most patients received the prescription dose of RT to the Cho/NAA ≥2 volume, where recurrence most often occurred. Conclusion: Change in mean and median Cho/NAA detected at 3 weeks was a significant predictor of early progression. The potential impact for risk-adaptive therapy based on early spectroscopic findings is suggested.
Traditional portfolio optimization methods in the likes of Markowitz' mean-variance model and semi-variance model utilize static expected return and volatility risk from historical data to generate an optimal portfolio. The optimal portfolio may not truly be optimal in reality due to the fact that maximum and minimum values from the data may largely influence the expected return and volatility risk values. This paper considers distributions of assets' return and volatility risk to determine a more realistic optimized portfolio. For illustration purposes, the sectorial indices data in FTSE Bursa Malaysia is employed. The results show that stochastic optimization provides more stable information ratio.
Forest and grass fires cause economic losses in the billions of dollars in the U.S. alone. In addition, boreal forests constitute a large carbon store; it has been estimated that, were no burning to occur, an additional 7 gigatons of carbon would be sequestered in boreal soils each century. Effective wildfire suppression requires anticipation of locales and times for which wildfire is most probable, preferably with a two to four week forecast, so that limited resources can be efficiently deployed. The United States Forest Service (USFS), and other experts and agencies have developed several measures of fire risk combining physical principles and expert judgment, and have used them in automated procedures for forecasting fire risk. Forecasting accuracies for some fire risk indices in combination with climate and other variables have been estimated for specific locations, with the value of fire risk index variables assessed by their statistical significance in regressions. In other cases, the MAPSS forecasts [23, 241 for example, forecasting accuracy has been estimated only by simulated data. We describe alternative forecasting methods that predict fire probability by locale and time using statistical or machine learning procedures trained on historical data, and we give comparative assessments of their forecasting accuracy for one fire season year, April- October, 2003, for all U.S. Forest Service lands. Aside from providing an accuracy baseline for other forecasting methods, the results illustrate the interdependence between the statistical significance of prediction variables and the forecasting method used.
The measurement of power demand risks in manufacturing power systems will benefit manufacturers and the wider society. If the risks can be characterized using manufacturing parameters, manufacturers can better control risks originating in those parameters, select less power-risky production plans, and reduce utility costs and resource consumption. The measurement of risk can also help manufacturers and power suppliers to protect their power systems from unexpected disturbances. Existing measures of risk, however, do not consider time duration, and thus cannot accurately quantify the risks in manufacturing power systems; the risks of a period of high power demand must be evaluated with the duration of the surge. Therefore, new methods of measuring power demand risks are proposed, adapting measures drawn from the field of finance. With a focus on milling operations, processing power is shown to be a function of processing amount and processing time, and a power demand distribution is directly derived as a joint distribution of and A and T. A bivariate random variable model with copulas is applied to examine the correlation in the joint distribution. Then, based on evaluation of a probability distribution of power demand from and, new risk measures are introduced. Herein illustrative examples are provided to show how the proposed measures can quantify the power demand risks from milling machines, based on manufacturing parameters. Certain manufacturing parameters are found to affect overall power demand risks, including i) raw material type, ii) variability in processing time, and iii) correlation between and. In the examples, these three factors increase power demand risks by up to 108%, 67%, and 1% respectively.
The effects, in terms of bias and precision, of omitting non-confounding predictive covariates from generalized linear models have been well studied, and it is known that such omission results in attenuation bias but increased precision with logistic regression. However, many epidemiologic risk analyses utilize alternative models that are not based on a linear predictor, and the effect of omitting non-confounding predictive covariates from such models has not been characterized. We employed simulation to study the effects on risk estimation of omitting non-confounding predictive covariates from an excess relative risk (ERR) model and a general additive-multiplicative relative-risk mixture model for binary outcome data in a case-control setting. We also compared the results to the effects with ordinary logistic regression. For these commonly employed alternative relative-risk models, the bias was similar to that with logistic regression when the risk was small. More generally, the bias and standard error of the risk-parameter estimates demonstrated patterns that are similar to those with logistic regression, but with greater magnitude depending on the true value of the risk. The magnitude of bias and standard error had little relation to study size or underlying disease prevalence. Prior conclusions regarding omitted covariates in logistic regression models can be qualitatively applied to the ERR and the general additive-multiplicative relative-risk mixture model without substantial change. Quantitatively, however, these alternative models may have slightly greater omitted-covariate bias, depending on the magnitude of the true risk being estimated.
This report provides a detailed description of a set of numerical simulations that represent reservoir behavior over time in response to different operational decision scenarios for detection of potential leakage and reduction or avoidance of leakage impact at a hypothetical geological carbon storage (GCS) site. These simulations serve as the basis for a series of GCS leakage risk forecasts that are to be developed using the National Risk Assessment Partnership’s Open-Source Integrated Assessment Model (NRAP-Open-IAM), and a demonstration of a simple decision support workflow for evaluation of mitigation strategies based on results of those system model forecasts. This risk assessment and decision support study is forthcoming. Four injection scenarios were considered: a constant rate carbon dioxide (CO 2 ) injection case (base case), a case with CO 2 injection rate adjustment, a case with early termination of injection operations, and a case with brine extraction. CO 2 injection operations were controlled to ensure that the pressure transient remains below the defined manageable reservoir fracture pressure, with consideration shown to hypothetical locations within the modeled spatial domain where the overburden was weaker and lower transient pressure increases were allowable. Additionally, a brine extraction alternative was considered as a reservoir management and risk mitigation option to reduce reservoir pressure, steer the plume away from any hypothetical geohazard such as fault as needed, and enhance storage capacity. Such operational actions contribute to risk management overtime. This study explores the potential utility of reservoir management for risk reduction at GCS sites. This study shows that the injection design may modify the time to CO 2 breakthrough at a legacy well; in particular, these results show that brine extraction can add value for mitigating risk both by delaying leakage and reducing pressure build-up. For the scenario considered, both pressure plots and pressure distributions demonstrate that pressure build-up was decreased by 3% with brine extraction. Additionally, extraction of brine afforded enhancement of CO 2 storage capacity by 5% compared to the base case. These findings suggest that brine extraction has substantial potential to steer the risk-related reservoir effects away from known geohazards (e.g., faults and legacy wells) by conducting pressure transient effects and CO 2 plume movement toward the production well. Injection rate adjustment scenarios considered in this study show potential value for managing both reservoir pressure transients and CO 2 plume behavior. Operational actions for reducing injection and/or early termination of injection (as compared to the base case), however, require careful design; tailoring both the extent and timing of injection rate adjustment over the injection and post-injection operational period must be thoroughly planned to balance maximizing storage and minimizing subsurface environmental risk. The study also gives preliminary consideration to the effectiveness that monitoring strategy may play in providing useful information to inform reservoir management decisions for risk reduction. Two types of monitoring were considered: 1) pressure build-up or pressure transient; and 2) potential leakage detection from a CO 2 mass or plume. Four hypothetical legacy wells, two plugged and two abandoned, were placed in the model domain. Monitoring along these wells was measured over time in individual stacked reservoir formations and shale formations to support risk mitigation decisions, especially operational decisions that assisted in risk reduction. These simulations will serve as the basis for a series of GCS leakage risk forecasts that are to be developed using NRAP’s Open-IAM, and demonstration of a simple decision support workflow for comparative assessment of mitigation alternatives based on results of those system model forecasts. This risk assessment and decision support study is forthcoming.
Purpose: There are reports of a high sensitivity of prostate cancer to radiotherapy dose fractionation, and this has prompted several trials of hypofractionation schedules. It remains unclear whether hypofractionation will provide a significant therapeutic benefit in the treatment of prostate cancer, and whether there are different fractionation sensitivities for different stages of disease. In order to address this, multiple primary datasets have been collected for analysis. Methods and Materials: Seven datasets were assembled from institutions worldwide. A total of 5969 patients were treated using external beams with or without androgen deprivation (AD). Standard fractionation (1.8-2.0 Gy per fraction) was used for 40% of the patients, and hypofractionation (2.5-6.7 Gy per fraction) for the remainder. The overall treatment time ranged from 1 to 8 weeks. Low-risk patients comprised 23% of the total, intermediate-risk 44%, and high-risk 33%. Direct analysis of the primary data for tumor control at 5 years was undertaken, using the Phoenix criterion of biochemical relapse-free survival, in order to calculate values in the linear-quadratic equation of k (natural log of the effective target cell number), {alpha} (dose-response slope using very low doses per fraction), and the ratio {alpha}/{beta} that characterizes dose-fractionation sensitivity. Results: There was no significant difference between the {alpha}/{beta} value for the three risk groups, and the value of {alpha}/{beta} for the pooled data was 1.4 (95% CI = 0.9-2.2) Gy. Androgen deprivation improved the bNED outcome index by about 5% for all risk groups, but did not affect the {alpha}/{beta} value. Conclusions: The overall {alpha}/{beta} value was consistently low, unaffected by AD deprivation, and lower than the appropriate values for late normal-tissue morbidity. Hence the fractionation sensitivity differential (tumor/normal tissue) favors the use of hypofractionated radiotherapy schedules for all risk groups, which is also very beneficial logistically in limited-resource settings.
Increased risk of renal stone formation during space flight has been linked primarily to increased calcium excretion from bone demineralization induced by space flight. Other factors contributing to increased risk include increased urinary calcium oxalate supersaturation, while urinary citrate, magnesium and volume are all decreased. The aim of this study was to increase the predictive value of stone risk profiles for crew members during space flight by evaluating the excretion of urinary protein inhibitors of calcium crystallization so that more comprehensive stone risk profiles could relate mineral saturation to the concentrations of inhibitor proteins. Levels of urinary osteopontin (uropontin) are reported in a series of 14 astronauts studied before, during, and after space flights. During space flight, a compensatory increase in uropontin excretion was not observed. However, the uropontin excretion of a majority of astronauts was increased during the period after space flight and was maximal at 2 wk after landing. The downward shift in the molecular size of uropontin observed in samples obtained during space flight was shown to result from storage at ambient temperature during flight, rather than an effect of microgravity on uropontin synthesis.
As global communities transition to clean energy technologies, the threat landscape for energy security is more complex than ever before. While broad adoption of clean energy technologies has progressed across the world, the National Renewable Energy Laboratory (NREL) has been researching how to reduce risks and the value renewable energy technologies bring to improved energy security, today and decades into the future. Continuing adoption of technologies to meet clean energy and climate mitigation goals requires consideration of energy security, making NREL's risk reduction and mitigation research increasingly important.
This paper recommends an approach to inadvertent human intrusion (IHI) at the Area 3 and Area 5 Radioactive Waste Management Sites (RWMSs) on the Nevada National Security Site (NNSS). IHI analysis uses the consequences of an individual inadvertently contacting buried waste to set waste concentration limits for near-surface disposal of low-level radioactive waste (LLW). Regulatory agencies are increasingly applying risk-informed decision-making to LLW waste management (NRC 2006). Risk-informed decision-making combines scientific risk assessment with stakeholder values and perceptions to determine a level of acceptable risk. Risk considers not only the consequences of an event, but also its probability of occurring.
As an intern this summer in the GRC Risk Management Office, I have become familiar with the NASA Continuous Risk Management Process. In this process, risk is considered in terms of the probability that an undesired event will occur and the impact of the event, should it occur (ref., NASA-NPG: 7120.5). Risk management belongs in every part of every project and should be ongoing from start to finish. Another key point is that a risk is not a problem until it has happened. With that in mind, there is a six step cycle for continuous risk management that prevents risks from becoming problems. The steps are: identify, analyze, plan, track, control, and communicate & document. Incorporated in the first step are several methods to identify risks such as brainstorming and using lessons learned. Once a risk is identified, a risk statement is made on a risk information sheet consisting of a single condition and one or more consequences. There can also be a context section where the risk is explained in more detail. Additionally there are three main goals of analyzing a risk, which are evaluate, classify, and prioritize. Here is where a value is given to the attributes of a risk &e., probability, impact, and timeframe) based on a multi-level classification system (e.g., low, medium, high). It is important to keep in mind that the definitions of these levels are probably different for each project. Furthermore the risks can be combined into groups. Then, the risks are prioritized to see what risk is necessary to mitigate first. After the risks are analyzed, a plan is made to mitigate as many risks as feasible. Each risk should be assigned to someone in the project with knowledge in the area of the risk. Then the possible approaches to choose from are: research, accept, watch, or mitigate. Next, all risks, mitigated or not, are tracked either individually or in groups. As the plan is executed, risks are re-evaluated, and the attribute values are adjusted as necessary. Metrics are established and monitored as tools for risk tracking. Also a trigger or threshold should be set on the metric data that indicates when an action is needed. Results of this tracking are usually evaluated and reported in a relevant format at weekly or monthly meetings. Choosing controls is the subsequent step, which involves the effects of the tracking. The three basic controls are: close, continue tracking, and re- plan. Finally communicate & document is the last step, but occurs throughout the process. It is vital that main risks, plans, changes, and progress are known by everyone in the project. A good way to keep everyone updated and inform other projects of common issues is by thoroughly documenting project risks. NASA sees value in risk management and believes that projects have greater probability or success by using the NASA Continuous Risk Management Process.
Purpose: A small-scale implementation of Failure Modes and Effects Analysis (FMEA) for treatment planning system QA by utilizing methodology of AAPM TG-100 report. Methods: FMEA requires numerical values for severity (S), occurrence (O) and detectability (D) of each mode of failure. The product of these three values gives a risk priority number (RPN). We have implemented FMEA for the treatment planning system (TPS) QA for two clinics which use Pinnacle and Eclipse TPS. Quantitative monthly QA data dating back to 4 years for Pinnacle and 1 year for Eclipse have been used to determine values for severity (deviations from predetermined doses at points or volumes), and occurrence of such deviations. The TPS QA protocol includes a phantom containing solid water and lung- and bone-equivalent heterogeneities. Photon and electron plans have been evaluated in both systems. The dose values at multiple distinct points of interest (POI) within the solid water, lung, and bone-equivalent slabs, as well as mean doses to several volumes of interest (VOI), have been re-calculated monthly using the available algorithms. Results: The computed doses vary slightly month-over-month. There have been more significant deviations following software upgrades, especially if the upgrade involved re-modeling of the beams. TG-100 guidance and the data presented here suggest an occurrence (O) of 2 depending on the frequency of re-commissioning the beams, severity (S) of 3, and detectability (D) of 2, giving an RPN of 12. Conclusion: Computerized treatment planning systems could pose a risk due to dosimetric errors and suboptimal treatment plans. The FMEA analysis presented here suggests that TPS QA should immediately follow software upgrades, but does not need to be performed every month.
An important area of current research is whether large-scale penetration of variable renewable generation such as wind and solar power pose economic and operational burdens on the electricity system. In such scenarios, this issue has also raised considerable interest in the potential role and value of electricity storage as a method of mitigating variability in generation associated with the inherently variable nature of these forms of generation. At the same time, a number of studies have pointed to the potential benefits of renewable generation as a hedge against the volatility and potential escalation of fossil fuel prices. Prior research and this work suggest that the lack of correlation of renewable energy costs with fossil fuel prices means that adding large amounts of wind or solar generation may also reduce the volatility of system-wide electricity costs. Such variance reduction in overall system costs may be of significant value to consumers due to risk aversion. In contrast to this observation, other studies have focused on returns in restructured markets and noted that, in deregulated markets, baseload natural gas power generation may be relatively more attractive to investors because-unlike wind generation-peak power prices are often strongly correlated to natural gas prices. The analysis in this report recognizes that the potential value of risk mitigation associated with wind generation and natural gas generation may depend on whether one considers the consumer's perspective or the investor's perspective and whether the market is regulated or deregulated. We analyze the risk and return trade-offs for wind and natural gas generation for deregulated markets based on hourly prices and load over a 10-year period using historical data in the PJM Interconnection (PJM)2 from 1999 to 2008. Similar analysis is then simulated and evaluated for regulated markets under certain assumptions. Estimating the absolute value, as opposed to the relative value, of variance reduction will also depend on assumptions about risk aversion and other consumer preferences, such as loss aversion, and this is discussed.
Purpose: To systematically screen the tumor contrast enhancement of locally advanced cervical cancers to assess the prognostic value of two descriptive parameters derived from dynamic contrast-enhanced magnetic resonance imaging (DCE-MRI). Methods and Materials: This study included a prospectively collected cohort of 81 patients who underwent DCE-MRI with gadopentetate dimeglumine before chemoradiotherapy. The following descriptive DCE-MRI parameters were extracted voxel by voxel and presented as histograms for each time point in the dynamic series: normalized relative signal increase (nRSI) and normalized area under the curve (nAUC). The first to 100th percentiles of the histograms were included in a log-rank survival test, resulting in p value and relative risk maps of all percentile-time intervals for each DCE-MRI parameter. The maps were used to evaluate the robustness of the individual percentile-time pairs and to construct prognostic parameters. Clinical endpoints were locoregional control and progression-free survival. The study was approved by the institutional ethics committee. Results: The p value maps of nRSI and nAUC showed a large continuous region of percentile-time pairs that were significantly associated with locoregional control (p < 0.05). These parameters had prognostic impact independent of tumor stage, volume, and lymph node status on multivariate analysis. Only a small percentile-time interval of nRSI was associated with progression-free survival. Conclusions: The percentile-time screening identified DCE-MRI parameters that predict long-term locoregional control after chemoradiotherapy of cervical cancer.
Conference poster presented at American Association of Petroleum Geologists (AAPG) Carbon Capture, Utilization, and Storage (CCUS) Conference, Houston, Texas, April 25–27, 2023. There is no one-size-fits-all risk management approach for storage projects. Instead, risk management is about having a detailed process in place, adhering to that process throughout the project life cycle, and adapting the process depending on site-specific conditions, applicable regulatory requirements, and any additional requirements imposed by pursuing one or more financial incentive programs. The Plains CO 2 Reduction (PCOR) Partnership Initiative experience has demonstrated the value of managing risk analysis in concert with storage project regulatory permit requirements, which drive the geologic exhibits and site characterization needs for the permit and the risk analysis.
An effective risk assessment system is needed to address the threat posed by an active or passive insider who, acting alone or in collusion, could attempt diversion or theft of nuclear material. The material control and accountability (MC&A) system effectiveness tool (MSET) is a self-assessment or inspection tool utilizing probabilistic risk assessment (PRA) methodology to calculate the system effectiveness of a nuclear facility's material protection, control, and accountability (MPC&A) system. The MSET process is divided into four distinct and separate parts: (1) Completion of the questionnaire that assembles information about the operations of every aspect of the MPC&A system; (2) Conversion of questionnaire data into numeric values associated with risk; (3) Analysis of the numeric data utilizing the MPC&A fault tree and the SAPHIRE computer software; and (4) Self-assessment using the MSET reports to perform the effectiveness evaluation of the facility's MPC&A system. The process should lead to confirmation that mitigating features of the system effectively minimize the threat, or it could lead to the conclusion that system improvements or upgrades are necessary to achieve acceptable protection against the threat. If the need for system improvements or upgrades is indicated when the system is analyzed, MSET provides the capability to evaluate potential or actual system improvements or upgrades. A facility's MC&A system can be evaluated at a point in time. The system can be reevaluated after upgrades are implemented or after other system changes occur. The total system or specific subareas within the system can be evaluated. Areas of potential system improvement can be assessed to determine where the most beneficial and cost-effective improvements should be made. Analyses of risk importance factors show that sustainability is essential for optimal performance and reveals where performance degradation has the greatest impact on total system risk. The risk importance factors show the amount of risk reduction achievable with potential upgrades and the amount of risk reduction achieved after upgrades are completed. Applying the risk assessment tool gives support to budget prioritization by showing where budget support levels must be sustained for MC&A functions most important to risk. Results of the risk assessment are also useful in supporting funding justifications for system improvements that significantly reduce system risk. The functional model, the system risk assessment tool, and the facility evaluation questionnaire are valuable educational tools for MPC&A personnel. These educational tools provide a framework for ongoing dialogue between organizations regarding the design, development, implementation, operation, assessment, and sustainability of MPC&A systems. An organization considering the use of MSET as an analytical tool for evaluating the effectiveness of its MPC&A system will benefit from conducting a complete MSET exercise at an existing nuclear facility.