Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Risk Model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,045 records · Page 58

Physics-informed machine learning for fault-leakage reduced-order modeling

Geologic carbon storage (GCS) is a promising technology for mitigating CO 2 emissions. The overall success of GCS depends on safe operations that are informed by risk assessment and have proper mitigation plans in place. Performing quantitative probabilistic risk assessment for a GCS site using traditional reservoir simulators can be challenging due to the high computational costs. To overcome this challenge, the US Department of Energy’s National Risk Assessment Partnership (NRAP) project has developed an integrated assessment modeling approach that utilizes computationally efficient reduced-order models (ROM) for simulating various parts of a GCS storage site to quantify uncertainty. Here, in this study, we develop a reduced-order model for fault leakage risk assessment. We use a deep learning approach to build the reduced-order model. We perform a sensitivity analysis and find that the deep learning model yields high accuracy with a much smaller computational cost than full-physics simulation. We also evaluate the performance of the model in scenarios where simulations are not possible to run, providing analysis not previously performed in fault-leakage ROM analyses. Based on a sensitivity analysis of the model, we suggest a simplified conceptual model for fault leakage and site monitoring.

58 GEOSCIENCES↗

A Model for Assessing the Liability of Seemingly Correct Software

Current research on software reliability does not lend itself to quantitatively assessing the risk posed by a piece of life-critical software. Black-box software reliability models are too general and make too many assumptions to be applied confidently to assessing the risk of life-critical software. We present a model for assessing the risk caused by a piece of software; this model combines software testing results and Hamlet's probable correctness model. We show how this model can assess software risk for those who insure against a loss that can occur if life-critical software fails.

Voas, Jeffrey M.↗

A non-cooperative meta-modeling game for automated third-party calibrating, validating and falsifying constitutive laws with parallelized adversarial attacks

The evaluation of constitutive models, especially for high-risk and high-regret engineering applications, requires efficient and rigorous third-party calibration, validation and falsification. While there are numerous efforts to develop paradigms and standard procedures to validate models, difficulties may arise due to the sequential, manual, and often biased nature of the commonly adopted calibration and validation processes, thus slowing down data collections, hampering the progress towards discovering new physics, increasing expenses and possibly leading to misinterpretations of the credibility and application ranges of proposed models. This work attempts to introduce concepts from game theory and machine learning techniques to overcome many of these existing difficulties. Here, we introduce an automated meta-modeling game where two competing AI agents systematically generate experimental data to calibrate a given constitutive model and to explore its weakness such that the experiment design and model robustness can be improved through competitions. The two agents automatically search for the Nash equilibrium of the meta-modeling game in an adversarial reinforcement learning framework without human intervention. In particular, a protagonist agent seeks to find the more effective ways to generate data for model calibrations, while an adversary agent tries to find the most devastating test scenarios that expose the weaknesses of the constitutive model calibrated by the protagonist. By capturing all possible design options of the laboratory experiments into a single decision tree, we recast the design of experiments as a game of combinatorial moves that can be resolved through deep reinforcement learning by the two competing players. Our adversarial framework emulates idealized scientific collaborations and competitions among researchers to achieve a better understanding of the application range of the learned material laws and prevent misinterpretations caused by conventional AI-based third-party validation. Numerical examples are given to demonstrate the wide applicability of the proposed meta-modeling game with adversarial attacks on both human-crafted constitutive models and machine learning models.

97 MATHEMATICS AND COMPUTING↗

Collagen Turnover in Relation to Risk Factors and Hemodynamics in Human Intracranial Aneurysms

Determinants for molecular and structural instability, that is, impending growth or rupture, of intracranial aneurysms (IAs) remain uncertain. To elucidate this, we endeavored to estimate the actual turnover rates of the main molecular constituent in human IA (collagen) on the basis of radiocarbon ( 14 C) birth dating in relation to IA hemodynamics. Collagen turnover rates in excised human IA samples were calculated using mathematical modeling of 14 C birth dating data of collagen in relation to risk factors and histological markers for collagen maturity/turnover in selected IA. Hemodynamics were simulated using image-based computational fluid dynamics. Correlation, logistic regression, and receiver operating characteristic analyses were performed. Collagen turnover rates were estimated in 46 IA (43 patients); computational fluid dynamics could be performed in 20 IA (20 patients). The mean collagen turnover rate (γ) constituted 126% (±1% error) per year. For patients with arterial hypertension, γ was greater than 2600% annually, whereas γ was distinctly lower with 32% (±1% error) per year for patients without risk factors, such as smoking and hypertension. There was a distinct association between histological presence of rather immature collagen in human IA and the presence of modifiable risk factors. Spatial-temporal averaged wall shear stress predicted rapid collagen turnover (odds ratio, 1.6 [95% CI, 1.0–2.7]). Receiver operating characteristic analysis demonstrated a good test accuracy (area under the curve, 0.798 [95% CI, 0.598–0.998]) for average wall shear stress with a threshold ≥4.9 Pa for rapid collagen turnover. Our data indicate that turnover rates and stability of collagen in human IA are strongly associated with the presence of modifiable risk factors and aneurysmal hemodynamics. Finally, these findings underline the importance of strict risk factor modification in patients with unruptured IA. Future should include more detailed risk factor data to establish a more causal understanding of hemodynamics and the rupture risk of individual IA.

60 APPLIED LIFE SCIENCES↗

Extension of HCDstruct for Transonic Aeroservoelastic Analysis of Unconventional Aircraft Concepts

A substantial effort has been made to implement an enhanced aerodynamic modeling capability in the Higher-fidelity Conceptual Design and structural optimization tool. This additional capability is needed for a rapid, physics-based method of modeling advanced aircraft concepts at risk of structural failure due to dynamic aeroelastic instabilities. To adequately predict these instabilities, in particular for transonic applications, a generalized aerodynamic matching algorithm was implemented to correct the doublet-lattice model available in Nastran using solution data from a priori computational fluid dynamics anal- ysis. This new capability is demonstrated for two tube-and-wing aircraft configurations, including a Boeing 737-200 for implementation validation and the NASA D8 as a first use case. Results validate the current implementation of the aerodynamic matching utility and demonstrate the importance of using such a method for aircraft configurations featuring fuselage-wing aerodynamic interaction.

Quinlan, Jesse R.↗

Projecting U.S. coastal storm surge risks and impacts with deep learning

Storm surge is one of the deadliest hazards posed by tropical cyclones (TCs), yet assessing its current and future risk is difficult due to the phenomenon’s rarity and physical complexity. Recent advances in artificial intelligence applications to natural hazard modeling suggest a new avenue for addressing this problem. We develop a deep learning storm surge model to efficiently estimate coastal surge risk in the United States from 900 000 synthetic TC events, accounting for projected changes in TC behavior and sea levels. The derived historical 100 year surge (the event with a 1% yearly exceedance probability) agrees well with historical observations and other modeling techniques. When coupled with an inundation model, we find that heightened TC intensities and sea levels by the end of the century result in a 50% increase in population at risk. Key findings include markedly heightened risk in Florida, and critical thresholds identified in Georgia and South Carolina.

RAFT↗

Hanford Waste Treatment Plant LAB Facility Stack Effluent Monitoring: Sampling Probe Location Qualification Evaluation

The Waste Treatment Plant laboratory (LAB) facility stack monitor locations were qualified using scale model stacks to mitigate the risk of identifying that sampling locations do not meet the qualification criteria on the full-scale stack. As required by the American National Standards Institute/Health Physics Society (ANSI/HPS) N13.1-1999 standard, the scale model and its sampling location were geometrically similar to the actual stack and the Reynolds numbers for both the actual and model stacks were >10,000. An additional criterion is that the product of the hydraulic diameter and mean velocity (DV) of the full-scale stack must be between 1/6 DV and 6 DV of the scale model stack tests. Verification tests of the LAB stacks were performed at normal operating conditions. The minimum 1/6 DV value, along with the maximum 6 DV value from the scale model testing determines the range of conditions for which the full-scale stack may be operated and remain in compliance with the stack verification criterion. Based on these DV values, the corresponding stack flow rates for each of the LAB stacks are 625 to 47,237 scfm for LB-C2, 1,704 to 103,131 scfm for LB-S1, and 467 to 18,088 scfm for LB-S2. The remaining criteria for the stack verification to be considered valid involve the flow angle and velocity uniformity results. First, the flow angle at the full-scale stack must be =20°. Second, the velocity uniformity at the full-scale stack must be =20% coefficient of variance (COV). Finally, the velocity uniformity results for the actual and scale model stack tests must agree within 5% COV. These criteria were met through the full-scale stack tests at the LAB facility. Flow angle results were primarily less than 10 degrees, except for the LB-C2 Fan A results, which were an average of 17.6 degrees; all flow angle results were within the =20° criterion. The velocity uniformity results for each test condition averaged between 1.5 and 3.5% COV, which were all within the range of the target %COV values from the scale model tests. Based on these stack verification test results, the three LAB filtered exhaust stack sampling locations meet the qualification criteria provided in the ANSI/HPS N13.1-1999 standard for all fan operating configurations. This includes single-fan as well as dual-fan operations for LB-C2, each of the dual-fan operating conditions for LB-S1, and each single-fan operating condition for LB-S2. Further changes to the system configuration or operating conditions that are outside the bounds described in this report may require additional tests or analyses to determine compliance with the standard.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Hanford Waste Treatment Plant Low Activity Waste Facility Stack Effluent Monitoring - Sampling Probe Location Qualification Evaluation

The Hanford Tank Waste Treatment and Immobilization Plant low activity waste (LAW) facility stack monitor locations were qualified using scale model stacks to mitigate the risk of identifying that sampling locations do not meet the qualification criteria on the full-scale stack. As required by the American National Standards Institute/Health Physics Society (ANSI/HPS) N13.1-1999 standard, the scale model and its sampling location were geometrically similar to the actual stack and the Reynolds numbers for both the actual and model stacks were >10,000. An additional criterion is that the product of the hydraulic diameter and mean velocity (DV) of the full-scale stack must be between 1/6 DV and 6 DV of the scale model stack tests. Verification tests of the LAW stacks were performed at normal operating conditions. The minimum 1/6 DV value, along with the maximum 6 DV value from the scale model testing determines the range of conditions for which the full-scale stack may be operated and remain in compliance with the stack verification criterion. Based on these DV values, the corresponding stack flow rates for each of the LAW stacks are 815–55,758 scfm for LV-S1, 980–112,078 scfm for LV-S2, 264–22,901 scfm for LV-S3, and 981–79,832 scfm for LV-C2. The remaining criteria for the stack verification to be considered valid involve the flow angle and velocity uniformity results. First, the flow angle at the full-scale stack must be =20°. Second, the velocity uniformity at the full-scale stack must be =20% coefficient of variance (COV). Finally, the velocity uniformity results for the actual and scale model stack tests must agree within 5% COV. These criteria were met through the full-scale stack tests at the LAW facility. Flow angle results were primarily less than 10°, except for one LV-S2 Fan A result, which was 13.2°; all flow angle results were within the =20° criterion. The velocity uniformity results for each test condition ranged between 1.5 COV and 9.2% COV, which were all within the range of the target % COV values from the scale model tests. Based on these stack verification test results, the four LAW filtered exhaust stack sampling locations meet the qualification criteria provided in the ANSI/HPS N13.1-1999 standard for all fan operating configurations. This includes single-fan operating conditions for LV-S1 and LV-S2, dual-fan operations for LV-S3 at both the continuous air monitor and record sampler locations, and both the single-fan as well as the dual-fan operations for LV-C2. Further changes to the system configuration or operating conditions that are outside the bounds described in this report may require additional tests or analyses to determine compliance with the standard.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Hanford Waste Treatment Plant Low Activity Waste Facility Stack Effluent Monitoring: Sampling Probe Location Qualification Evaluation (Rev.1)

The Hanford Tank Waste Treatment and Immobilization Plant Low Activity Waste (LAW) facility stack monitor locations were qualified using scale model stacks to mitigate the risk of discovering that sampling locations do not meet the qualification criteria on the full-scale stacks. As required by the American National Standards Institute/Health Physics Society (ANSI/HPS) N13.1-1999 standard, the scale model and its sampling location were geometrically similar to the actual stack and the Reynolds numbers for both the actual and model stacks were >10,000. An additional criterion is that the product of the hydraulic diameter and mean velocity (DV) of the full-scale stack must be between 1/6 DV and 6 DV of the scale model stack tests. Verification tests of the LAW stacks were performed at normal operating conditions. The minimum 1/6 DV value, along with the maximum 6 DV value from the scale model testing, determines the range of stack flow rates for which the full-scale stack may be operated and remain in compliance with the stack verification criterion. For this analysis, the range of qualified flow rates listed is conservatively based on the average DV through 6 DV for LV-S1, LV-S2, and LV-C2, and 1/3 DV to 3 DV for LV-S3. Table S1 lists the operating flow rates along with the conservative lower and upper qualified stack flow rates for each of the LAW facility stacks. For each stack, the operating flow is below the upper qualified stack.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Hanford Waste Treatment Plant LAB Facility Stack Effluent Monitoring: Sampling Probe Location Qualification Evaluation

The Waste Treatment Plant laboratory (LAB) facility stack monitor locations were qualified using scale model stacks to mitigate the risk of identifying that sampling locations do not meet the qualification criteria on the full-scale stack. As required by the American National Standards Institute/Health Physics Society (ANSI/HPS) N13.1-1999 standard, the scale model and its sampling location were geometrically similar to the actual stack, and the Reynolds numbers for both the actual and model stacks were >10,000. An additional criterion is that the product of the hydraulic diameter and mean velocity (DV) of the full-scale stack must be between 1/6 DV and 6 DV of the scale model stack tests. Verification tests of the LAB stacks were performed at normal operating conditions. The minimum 1/6 DV value, along with the maximum 6 DV value from the scale model testing, determines the range of conditions for which the full-scale stack may be operated and remain in compliance with the stack verification criterion. A practical range for the full-scale stack qualification uses the average DV through 6 DV from the scale model tests to compute the corresponding flow rates. Table S1 lists the operating flow rates along with the average and maximum qualified stack flow rates for each of the LAB facility stacks. For each stack, the operating flow is below the maximum qualified stack flow, which means that the scale model test results are acceptable for stack qualification. The remaining criteria for the stack verification to be considered valid involve the flow angle and velocity uniformity results. First, the flow angle at the full-scale stack must be ≤20°. Second, the velocity uniformity at the full-scale stack must be ≤20% coefficient of variance (COV). Finally, the velocity uniformity results for the actual and scale model stack tests must agree within 5% COV. These criteria were met through the full-scale stack tests at the LAB facility. Flow angle results were primarily less than 10°, except for the LB-C2 Fan A results, which were an average of 13.7°; all flow angle results were within the ≤20° criterion. The velocity uniformity results for each test condition averaged between 1.5 and 4.1% COV, which were all within the range of the target percent coefficient of variation values from the scale model tests. Based on these stack verification test results, the three LAB filtered exhaust stack sampling locations meet the qualification criteria provided in the ANSI/HPS N13.1-1999 standard for all fan operating configurations. This includes single-fan as well as dual-fan operations for LB-C2, each of the dual-fan operating conditions for LB-S1, and each single-fan operating condition for LB-S2. Further changes to the system configuration or operating conditions that are outside the bounds described in this report may require additional tests or analyses to determine compliance with the standard.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Proactive Wildfire Management: A Remote Sensing and Multimodal CNN-MLP Architecture for Ignition Risk Forecasting

As the frequency and intensity of wildfires increase, with fire seasons now starting earlier and ending later than they have over the past decades, current monitoring systems, such as lookout towers and satellites, are hindered by cloud cover, low-resolution imagery, and static data gaps that fail to track vegetation moisture levels fast enough to catch rapid pre-ignition changes. This report proposes a Machine Learning-enabled Wildfire Ignition Prediction framework that combines satellite monitoring with dynamic and high-resolution remote sensing from Unmanned Aerial Vehicle (UAV) swarms. The method would use multispectral and thermal data from the Landsat program to create a baseline for vegetation health, calculating a two-band Enhanced Vegetation Index (EVI2) and the moisture content of the vegetation. These inputs will later be fused with microscale UAV weather data, including thermal hotspots found through thick canopies, hyperspectral chemical signatures of pre-visual combustion, and local weather streams. The multispectral satellite, multispectral Light Detection and Ranging (LiDAR), and thermal data would then be processed through a Convolutional Neural Network (CNN), alongside a Multilayer Perceptron (MLP) for the micro-weather telemetry. The outputs of these networks would be fused into a single feature representation and passed through a final prediction network to generate real-time ignition risk scores and hotspot alerts. Model performance would be assessed using standard classification metrics, including a Receiver Operating Characteristic - Area Under the Curve (ROC AUC) and F1 score. This system would allow first responders to identify high-risk zones and intervene before ignition occurs, improving emergency response time compared to current approaches.

machine learning↗

Review and developments of dissemination models for airborne carbon fibers

Dissemination prediction models were reviewed to determine their applicability to a risk assessment for airborne carbon fibers. The review showed that the Gaussian prediction models using partial reflection at the ground agreed very closely with a more elaborate diffusion analysis developed for the study. For distances beyond 10,000 m the Gaussian models predicted a slower fall-off in exposure levels than the diffusion models. This resulting level of conservatism was preferred for the carbon fiber risk assessment. The results also showed that the perfect vertical-mixing models developed herein agreed very closely with the diffusion analysis for all except the most stable atmospheric conditions.

Elber, W.↗

The association between neighborhood obesogenic factors and prostate cancer risk and mortality: the Southern Community Cohort Study

Background: Prostate cancer is one of the leading causes of cancer-related mortality among men in the United States. We examined the role of neighborhood obesogenic attributes on prostate cancer risk and mortality in the Southern Community Cohort Study (SCCS). Methods: From the total of 34,166 SCCS male participants, 28,356 were included in the analysis. We assessed the relationship between neighborhood obesogenic factors [neighborhood socioeconomic status (nSES) and neighborhood obesogenic environment indices including the restaurant environment index, the retail food environment index, parks, recreational facilities, and businesses] and prostate cancer risk and mortality by controlling for individual-level factors using a multivariable Cox proportional hazards model. We further stratified prostate cancer risk analysis by race and body mass index (BMI). Results: Median follow-up time was 133 months [interquartile range (IQR): 103, 152], and the mean age was 51.62 (SD: ± 8.42) years. There were 1,524 (5.37%) prostate cancer diagnoses and 98 (6.43%) prostate cancer deaths during follow-up. Compared to participants residing in the wealthiest quintile, those residing in the poorest quintile had a higher risk of prostate cancer (aHR = 1.32, 95% CI 1.12–1.57, p = 0.001), particularly among non-obese men with a BMI < 30 (aHR = 1.46, 95% CI 1.07–1.98, p = 0.016). The restaurant environment index was associated with a higher prostate cancer risk in overweight (BMI ≥ 25) White men (aHR = 3.37, 95% CI 1.04–10.94, p = 0.043, quintile 1 vs. None). Obese Black individuals without any neighborhood recreational facilities had a 42% higher risk (aHR = 1.42, 95% CI 1.04–1.94, p = 0.026) compared to those with any access. Compared to residents in the wealthiest quintile and most walkable area, those residing within the poorest quintile (aHR = 3.43, 95% CI 1.54–7.64, p = 0.003) or the least walkable area (aHR = 3.45, 95% CI 1.22–9.78, p = 0.020) had a higher risk of prostate cancer death. Conclusion: Living in a lower-nSES area was associated with a higher prostate cancer risk, particularly among Black men. Restaurant and retail food environment indices were also associated with a higher prostate cancer risk, with stronger associations within overweight White individuals. Finally, residing in a low-SES neighborhood or the least walkable areas were associated with a higher risk of prostate cancer mortality.

60 APPLIED LIFE SCIENCES↗

Coupled CFD-PBE Predictions of Renal Stone Size Distributions in the Nephron in Microgravity

In this paper, a deterministic model is developed to assess the risk of critical renal stone formation for astronauts during space travel. A Population Balance Equation (PBE) model is used to compute the size distribution of a population of nucleating, growing and agglomerating renal calculi as they are transported through different sections of the nephron. The PBE model is coupled to a Computational Fluid Dynamics (CFD) model that solves for steady state flow of urine and transport of renal calculi along with the concentrations of ionic species, calcium and oxalate, in the nephron using an Eulerian two-phase mathematical framework. Parametric simulation are performed to study stone size enhancement and steady state volume fraction distributions in the four main sections of the nephron under weightlessness conditions. Contribution of agglomeration to the stone size distribution and effect of wall friction on the stone volume fraction distributions are carefully examined. Case studies using measured astronaut urinary calcium and oxalate concentrations in microgravity as input indicate that under nominal conditions the largest stone sizes developed in Space will be still considerably below the critical range for problematic stone development. However, results also indicate that the highest stone volume fraction occurs next to the tubule and duct walls. This suggests that there is an increased potential for wall adhesion with the possibility of evolution towards critical stone sizes.

Microgravity↗

Coupled CFD-PBE Predictions of Renal Stone Size Distributions in the Nephron in Microgravity

In this paper, a deterministic model is developed to assess the risk of critical renal stone formation for astronauts during space travel. A Population Balance Equation (PBE) model is used to compute the size distribution of a population of nucleating, growing and agglomerating renal calculi as they are transported through different sections of the nephron. The PBE model is coupled to a Computational Fluid Dynamics (CFD) model that solves for steady state flow of urine and transport of renal calculi along with the concentrations of ionic species, calcium and oxalate, in the nephron using an Eulerian two-phase mathematical framework. Parametric simulation are performed to study stone size enhancement and steady state volume fraction distributions in the four main sections of the nephron under weightlessness conditions. Contribution of agglomeration to the stone size distribution and effect of wall friction on the stone volume fraction distributions are carefully examined. Case studies using measured astronaut urinary calcium and oxalate concentrations in microgravity as input indicate that under nominal conditions the largest stone sizes developed in Space will be still considerably below the critical range for problematic stone development. However, results also indicate that the highest stone volume fraction occurs next to the tubule and duct walls. This suggests that there is an increased potential for wall adhesion with the possibility of evolution towards critical stone sizes.

Crystal Growth↗

Practical Techniques for Modeling Gas Turbine Engine Performance

The cost and risk associated with the design and operation of gas turbine engine systems has led to an increasing dependence on mathematical models. In this paper, the fundamentals of engine simulation will be reviewed, an example performance analysis will be performed, and relationships useful for engine control system development will be highlighted. The focus will be on thermodynamic modeling utilizing techniques common in industry, such as: the Brayton cycle, component performance maps, map scaling, and design point criteria generation. In general, these topics will be viewed from the standpoint of an example turbojet engine model; however, demonstrated concepts may be adapted to other gas turbine systems, such as gas generators, marine engines, or high bypass aircraft engines. The purpose of this paper is to provide an example of gas turbine model generation and system performance analysis for educational uses, such as curriculum creation or student reference.

aerothermodynamics↗

Practical Techniques for Modeling Gas Turbine Engine Performance

The cost and risk associated with the design and operation of gas turbine engine systems has led to an increasing dependence on mathematical models. In this paper, the fundamentals of engine simulation will be reviewed, an example performance analysis will be performed, and relationships useful for engine control system development will be highlighted. The focus will be on thermodynamic modeling utilizing techniques common in industry, such as: the Brayton cycle, component performance maps, map scaling, and design point criteria generation. In general, these topics will be viewed from the standpoint of an example turbojet engine model; however, demonstrated concepts may be adapted to other gas turbine systems, such as gas generators, marine engines, or high bypass aircraft engines. The purpose of this paper is to provide an example of gas turbine model generation and system performance analysis for educational uses, such as curriculum creation or student reference.

aerothermodynamics↗

Integrated Medical Model (IMM) Project Verification, Validation, and Credibility (VVandC)

The Integrated Medical Model (IMM) Project supports end user requests by employing the Integrated Medical Evidence Database (iMED) and IMM tools as well as subject matter expertise within the Project. The iMED houses data used by the IMM. The IMM is designed to forecast relative changes for a specified set of crew health and mission success risk metrics by using a probabilistic model based on historical data, cohort data, and subject matter expert opinion. A stochastic approach is taken because deterministic results would not appropriately reflect the uncertainty in the IMM inputs. Once the IMM was conceptualized, a plan was needed to rigorously assess input information, framework and code, and output results of the IMM, and ensure that end user requests and requirements were considered during all stages of model development and implementation, as well as lay the foundation for external review and application. METHODS: In 2008, the Project team developed a comprehensive verification and validation (VV) plan, which specified internal and external review criteria encompassing 1) verification of data and IMM structure to ensure proper implementation of the IMM, 2) several validation techniques to confirm that the simulation capability of the IMM appropriately represents occurrences and consequences of medical conditions during space missions, and 3) credibility processes to develop user confidence in the information derived from the IMM. When the NASA-STD-7009 (7009) [1] was published, the Project team updated their verification, validation, and credibility (VVC) project plan to meet 7009 requirements and include 7009 tools in reporting VVC status of the IMM. Construction of these tools included meeting documentation and evidence requirements sufficient to meet external review success criteria. RESULTS: IMM Project VVC updates are compiled recurrently and include updates to the 7009 Compliance and Credibility matrices. Reporting tools have evolved over the lifetime of the IMM Project to better communicate VVC status. This has included refining original 7009 methodology with augmentation from the HRP NASA-STD-7009 Guidance Document working group and the NASA-HDBK-7009 [2]. End user requests and requirements are being satisfied as evidenced by ISS Program acceptance of IMM risk forecasts, transition to an operational model and simulation tool, and completion of service requests from a broad end user consortium including operations, science and technology planning, and exploration planning. IMM v4.0 is slated for operational release in the FY015 and current VVC assessments illustrate the expected VVC status prior to the completion of customer lead external review efforts. CONCLUSIONS: The VVC approach established by the IMM Project of incorporating Project-specific recommended practices and guidelines for implementing the 7009 requirements is comprehensive and includes the involvement of end users at every stage in IMM evolution. Methods and techniques used to quantify the VVC status of the IMM Project represented a critical communication tool in providing clear and concise suitability assessments to IMM customers. These processes have not only received approval from the local NASA community but have also garnered recognition by other federal agencies seeking to develop similar guidelines in the medical modeling community.

Walton, M.↗