Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “multiple faults”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Fault isolation and fault-tolerant control for nonlinear stochastic distribution control systems with multiplicative faults

Here, in this paper, a fault isolation, diagnosis and fault tolerant control algorithm is proposed for nonlinear multiple multiplicative faults stochastic distribution control systems employing Takagi–Sugeno fuzzy system. To obtain the detailed fault information, a fault detection algorithm is introduced to discover the fault occurrence time. Then a fault isolation observer is built to produce the residual, and the error system is separated to subsystems affected only by disturbance and multiplicative faults. Moreover, a fault estimation scheme is presented to obtain the fault magnitude information. When faults occur, the system output probability density function will deviate from the desired distribution. So the model predictive control fault tolerant control scheme is needed to minimize the impact of faults as much as possible to make sure that the post fault output probability density function track the desired probability density function. The validity of the designed algorithm is demonstrated through a simulation example, where the fault tolerant control algorithm ensures that the system output probability density function still track the given output probability density function despite the complex case of multiple multiplicative faults occurring simultaneously.

42 ENGINEERING↗

3-D Modeling of Induced Seismicity Along Multiple Faults: Magnitude, Rate, and Location in a Poroelasticity System

Understanding of the potential to injection–induced seismicity along faults requires the response of fault zone system to spatiotemporal perturbations in pore pressure and stress. In this study, three–dimensional (3–D) model system consisting of the caprock, reservoir, and basement is intersected by vertical strike–slip faults. We examine the full poroelastic behavior of the formation and perform the mechanical analysis along each fault zone using the Coulomb stress change. The magnitude, rate, and location of potential earthquakes are predicted using the spatial distribution of stresses and pore pressure over time. Rapid diffusion of pore pressure into conductive faults initiates failure, but the majority of induced seismicity occurs at deep fault zones due to poroelastic stabilization near the injection interval. Less permeable faults can be destabilized by either delayed pore pressure diffusion or poroelastic stressing. A two–dimensional (2–D) horizontal model, representing the interface between the reservoir and the basement, limits diffusion of pore pressure and deformation of the formation in the vertical direction that may overestimate or underestimate the potential of earthquakes along the fault. Lastly, our numerical results suggest that the 3–D modeling of faulting system including poroelastic coupling can reduce the uncertainty in the seismic hazard prediction by considering the hydraulic and mechanical interaction between faults and bounding formations.

3‐D modeling↗

Integrating Survival Analysis with Bayesian Statistics to Forecast the Remaining Useful Life of a Centrifugal Pump Conditional to Multiple Fault Types

To improve the viability of nuclear power plants, there is a need to reduce their operational costs. Operational costs account for a significant portion of a plant’s yearly budget, due to their scheduled-based maintenance approach. In order to reduce these costs, proactive methods are required that estimate and forecast the state of a machine in real time to optimize maintenance schedules. In this research, we use Bayesian networks to develop a framework that can forecast the remaining useful life of a centrifugal pump. To do so, we integrate survival analysis with Bayesian statistics to forecast the health of the pump conditional to its current state. We complete our research by successfully using the Bayesian network on a case study. This solution provides an informed probabilistic viewpoint of the pumping system for the purpose of predictive maintenance.

42 ENGINEERING↗

Effects of multiple simultaneous faults on characteristic fault detection features of a heat pump in cooling mode

Faults in air-cooled vapor compression air-conditioning systems are known to reduce performance, including efficiency, capacity, and lifespan. Their effects have been studied, and fault detection and diagnostic (FDD) methods have been developed as tools for field technicians to install or repair systems, or for monitoring to alert operators to the fault’s presence. Most of this work has focused on faults that occur singly. It is likely that in some systems, multiple faults occur simultaneously, but it is uncertain what effects this may have on diagnostics. Here, this paper describes a laboratory study of a split system air source heat pump in which combinations of two, three, and four simultaneous faults occur. The study includes all combinations of: improper evaporator airflow; overcharge or undercharge of refrigerant; liquid line restrictions; and non-condensable gas in the refrigerant, each at multiple fault intensities. Fault features – those characteristics that can be determined from measurements, for use in diagnostics – are analyzed, and the key fault features are presented. A robust existing method for determining refrigerant charge, the virtual refrigerant charge sensor (VRC) is tested using the multiple fault data, in order to understand how its performance is impacted by the combined faults. The VRC performs well, typically able to correctly determine whether a system is undercharged or overcharged, but the magnitude estimates are impacted. The results suggest that simple subcooling-based methods of charging a system are likely to provide unsatisfactory results when other faults are present.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Multiple simultaneous faults’ impacts on air-conditioner behavior and performance of a charge diagnostic method

Although there have been several studies that have focused on the effects of faults on the performance and on the characteristic features that could be used to detect faults, almost none of the research has studied the effects of multiple simultaneous faults. Existing fault detection and diagnosis approaches that have been developed based on single faults may struggle with simultaneous faults. Here, this paper is part of a series that present a methodology and comprehensive measurement data from a battery of laboratory tests on an air-conditioner with combinations of common faults (refrigerant charge, evaporator airflow, non-condensable gas, and liquid line restrictions) imposed, to show how the indicator variables and overall performance are impacted. The system has a microtube condenser and a fixed-orifice (FXO) expansion device, which are found to affect the features’ fault sensitivity. This experiment is the first to test these combined faults in an FXO-equipped system, so comparisons are made to a previously studied thermostatic expansion valve-equipped system. Finally, a promising charge diagnostic technology is assessed, to see how it is impacted by other faults. The faults reduced capacity by up to 42%, and efficiency by up to 39%. The charge diagnostic performed well, even with multiple faults present.

42 ENGINEERING↗

High-Frequency Signature-Based Fault Detection for Future MV Distribution Grids: Preprint

Increased deployment of Distributed Energy Resources (DERs) and microgrids are significantly changing the operation of distribution grid. Increasing penetration of power electronics based DERs also raise several operational problems such as protection coordination issues, voltage raise, recloser synchronization, stability, and frequency control. Legacy systems are designed for unidirectional power flow. Bidirectional power flows, and varying short circuit levels are some of the major challenges in implementing these legacy protection schemes for future power grid with high penetration of power electronics based DERs. Inverter based DER’s can contribute to a maximum of 2 p.u. fault current. Interconnection standards might require even lower fault current contribution. If these protection related challenges are not addressed, it will result in limiting the penetration of DERs in distribution feeders. In this paper, the feasibility of high frequency signature generated by transients is evaluated to identify and locate faults in a distribution system. The paper will discuss the need for an accurate line modeling approach to accurately capture the high frequency signatures. These high frequency signatures are naturally occurring electromagnetic transients for events such as switching events in the network, faults events, etc. This is different than that implemented in transmission systems as the proposed approach utilizes advanced signal processing techniques to retrieve valuable information from the high frequency signatures generated during faults and does not just rely on time delay measurements between reflections of the high frequency signals. In the full paper, information of a modified IEEE distribution feeder test system to accurately model the high frequency signatures will be provided. The distribution lines will be modeled using universal line modeling (ULM) technique in an electromagnetic transients program (EMTP) modeling platform. Different test cases will be simulated and these test cases will include different fault types, multiple fault locations, capacitor bank switching, etc. The feeder system modeled for these simulations will also include power electronics based DERs. Additionally, experimental results demonstrating the high frequency signatures generated due to a transient event in a medium voltage (13.8 kV) distribution line will also be presented in the full paper. Furthermore, the analysis combined with simulation and experimental results in the full paper will help demonstrate the feasibility and efficacy of the proposed protection scheme. The developed protection scheme will not just help solve problems generated by bidirectional current flow, varying short-circuit current capacity, but also help in proliferation of DERs in distribution systems.

41 EE - Solar Energy Technologies Office (EE-4S)↗

Internal configuration of prismatic lithium-ion cells at the onset of mechanically induced short circuit

The response of Li-ion cells to mechanically induced internal electrical shorts is an important safety performance metric design. We assume that the battery internal configuration at the onset of electrical short influences the subsequent response and can be used to gauge the safety risk. We subjected a series of prismatic Li-ion cells to lateral pinching using 0.25", 0.5", 1", 2" and 3" diameter steel balls until the onset of internal short. The external aluminum enclosure froze the internal cell configuration at the onset of short and enabled us to cross-section the cells, and take the cross-section images. The images indicate that an internal electric short is preceded by extensive strain partitioning in the cells, fracturing and tearing of the current collectors, and cracking and slipping of the electrode layers with multiple fault lines across multiple layers. These observations are at odds with a common notion of homogeneous deformation across the layers and strain hardening of electrodes that eventually punch through the separator and short the cell. The faults are akin to tectonic movements of multiple layers that are characteristic of granular materials and bonded aggregates. As a result, the short circuits occur after extensive internal faulting, which implies significant stretching and tearing of separators.

25 ENERGY STORAGE↗

Numerical assessment of fault impact on caprock seals during CO 2 sequestration

Coupled fluid-flow and geomechanical analysis of caprock integrity has gained a lot of attention among scientists and researchers investigating the long-term performance of geologic carbon storage systems. Reactivation of pre-existing fractures within the caprock or re-opening of faults can create permeable pathways which can influence the seal integrity. Stability of the caprock during and after injection of super-critical CO 2 , and the impact of pre-existing fractures in the presence or absence of one or multiple faults have been investigated in this study. The impact of the wellbore orientation and the injection rate are among other key factors in understanding the structural trapping mechanisms within such geological formations. In this study, we numerically investigated the impact of each of these factors. This study revealed the interplay between joints and faults and how different leakage pathways are formed and under which scenario they play a dominant role in terms of CO 2 leakage. Finally, this study also highlights the role of one versus multiple faults in the domain and the importance of the fault hydrological property in forming leakage pathway.

58 GEOSCIENCES↗

Quantifying EGS Reservoir Complexity with an Integrated Geophysical Approach-Improved Resolution Ambient Seismic Noise Interferometry

The primary goal of the project was met, as improved resolution (from kilometers to tens/hundreds of meters and to a depth of at least 3 km) was added to the seismic interferometry-estimated parameters relative to the work reported in AltaRock Energy Inc. (2014) for the Dixie Valley Geothermal Wellfield. A procedure for initial fault identification, using seismic interferometry, was developed. The project team further improved, and applied a new, cost-effective, and non-invasive exploration method, developed and validated since 2010, during two previous experiments, at Dixie Valley and Soda Lake, Nevada. The method, initially designed for hydrothermal exploration, was adapted to EGS exploration conditions, which require deeper crustal information. Regions of elevated energy for both the 2-7 Hz and 5-15 Hz frequency bands are located above intersections of multiple faults. Thus, an unprecedented, innovative seismic field deployment and ambient seismic noise and signal processing were successfully used to estimate crustal structure and to identify fault locations at depths up to 3 km, at a cost per kilometer of survey that in some cases may be as much as ten times less than the cost of a controlled-source survey. Based on valid and useful seismic data collected and analyzed during Phase I, in Phase II the team has further quantified statistically the advantage of using seismic analysis, in combination with other geological and geophysical techniques, for EGS target identification. A power spectral density analysis of the passive-seismic empirical Green’s functions reveals significantly higher power recorded over the exploration area at the power plant, and in the drilling area, near the BB station 10201, especially on the horizontal components. In this study, the most important relationship observed during the prior report, namely the one between velocity and temperature was explored. The areas that show anomalously high predicted temperature in the geostatistics occur where multiple faults intersect. Not surprisingly, such areas span between the Dixie Valley range front fault and the basin-ward Piedmont faults, in the vicinity of numerous wells. These locations also fall in the area of high EGS favorability from the prior 2014 study. The anomalies also coincide with the high power spectral density values. The result of altering all favorability criteria for the new data reached a maximum of 1/8th of a point and were not large enough to change any favorability value reported in the 2014 study. The new data reinforce the results obtained from the previous 2014 study. The current high-resolution ambient seismic noise project provided excellent results in defining faults in the wellfield. As such the identification of known faults by the project demonstrated the utility of this method for identifying faults at an exploration stage in geothermal development. Such fault identification, while extremely useful in exploration investigation, has not added sufficient new data for the generation of significantly different DVGW favorability maps in the current project. We believe the cost savings of our passive-seismic technique for EGS, over common industry active-source survey techniques, may have a minimum of 30%, and a maximum of 90%. There are many significant non-cost benefits of passive seismic surveys. Our passive-source method provides an environmentally-friendly seismic survey with minimal to negligible impacts. The economic benefit is greater EGS project feasibility.

15 GEOTHERMAL ENERGY↗

Aftershocks of the 2012 Off-Coast of Sumatra Earthquake Sequence

Aftershocks of the 2012 Off-Coast of Sumatra Earthquake Sequence exhibit a complex and diffuse spatial distribution. The first-order complexity in aftershock distribution is clear and well beyond the influence of typical earthquake location uncertainty. The sequence included rupture of multiple fault segments, spatially separated. We use surface-wave based relative centroid locations to examine whether, at the small scale, the distribution of the aftershocks was influenced by location errors. Surface-wave based relative location has delineated precise oceanic transform fault earthquake locations in multiple regions. However, the relocated aftershocks off the coast of Sumatra seldom align along simple linear trends that are compatible with the corresponding fault strikes as estimated for the GCMT catalog. The relocation of roughly 60 moderate-earthquake epicentroids suggests that the faulting involved in the 2012 earthquake aftershock sequence included strain release along many short fault segments. Statistical analysis and temporal variations of aftershocks show a typical decay of the aftershocks but a relatively low number of aftershocks, as is common for intraplate oceanic earthquakes. Coulomb stress calculations indicate that most of the moderate-magnitude aftershocks are compatible with stress changes predicted by the large-event slip models. Furthermore the patterns in the aftershocks suggest that the formation of the boundary and eventual localization of deformation between the Indian and Australian plate is a complicated process.

2012 Sumatra Earthquake↗

Improving EV Charger Resiliency for MW Charging Systems

In this paper, the resiliency of a megawatt-scale EV charging station is investigated. Fault detection and tolerance methodologies are presented, based on monitoring the voltage offsets in DABs and switch-level currents in three-phase inverters, with the goal of maintaining operation at rated power during single faults and at reduced power under multiple fault conditions. To validate the effectiveness of the proposed strategy, simulation results at the rated 1 MW power of the charging station are carried out, followed by controller hardware-in-the-loop (CHIL) experiments on a 250 kW section of the station. The results highlight the feasibility of the integrated fault-tolerant methods for resilient, high-power EV charging infrastructure.

Adib, Aswad [ORNL] (ORCID:000000020997056X)↗

A systematic feature extraction and selection framework for data-driven whole-building automated fault detection and diagnostics in commercial buildings

In data-driven automated fault detection and diagnostics (AFDD) modeling for building energy systems, feature engineering is a critical process of extracting information from high-dimensional and noisy sensor measurement and turning it into informative and representative inputs or features for data-driven modeling. However, few studies specifically discuss the feature engineering, especially the interactions between feature extraction and feature selection in whole-building AFDD. We developed a systematic feature extraction and selection framework for whole-building AFDD. In this framework, features are aggressively extracted from raw sensor data using statistical feature extraction techniques with various window sizes and statistics. With many features extracted, a hybrid feature selection algorithm that combines the filter and wrapper method then selects the best feature set. The framework considers diversity in the duration of fault behavior among fault types in whole-building AFDD, thus achieving high model generalization. We implemented our developed framework in a virtual testbed calibrated with measured data from Oak Ridge National Laboratory's Flexible Research Platform designed to mimic the operation of a typical small commercial building. The AFDD model is trained by the simulation data generated from the virtual testbed. The results show that (1) the developed framework improves the generalization of the AFDD model by 10.7% compared with literature-reported feature extraction and selection methods and (2) features with diverse window sizes and statistics are selected, providing insight into physical systems beyond the current understanding of buildings and faults and improving the detection and diagnostics of multiple fault types.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

AGGREGATE: dAta-driven modelinG preservinG contRollable dEr for outaGe mAnagemenT and rEsiliency (Final Report)

The AGGREGATE project team successfully developed and validated various modules for outage management. Brief summaries of each module are provided to showcase their strength for outage management and restoration for a distribution system with a high penetration of connected distribution energy resources (DERs). In recent years, inverter-based DERs have been widely deployed in distribution system. A most of behind-the-meter (BTM) solar power generation is not visible to the utility. The data-driven DER and load estimation modules are using machine learning (ML) and artificial intelligence (AI) to manage this issue, which provides an opportunity for distribution system operators (DSOs) to operate systems and make decisions in real-time for a distribution system with a high penetration of DERs deployed. Also, the estimated DER and true load can be further leveraged in network aggregation and cold-load pick up estimation for reducing the computing complexity and providing for fast restoration. After load demand and DER power generations have been estimated, the information will support topology and state estimation (SE). The topology estimation module demonstrated the viability of mixed integer linear programming (MILP) formulation to estimate the most likely operational radial topology and outage sections using power flow measurements, historical/estimated load and DERs data and smart meter ping measurements. Formulation includes continuous (power flow, load and DERs data) and binary measurements (smart meter ping measurements) in a single formulation. Errors in continuous data and binary data are modeled as normal distribution and Bernoulli distribution, respectively. In the future distribution grid, the power injection from controllable DERs will be essential for efficient and resilient grid operation. However, determining the optimal DER injections and restoration actions is dependent on knowledge of the system states. State estimation (SE), already the cornerstone of transmission energy management systems, will become commonplace in distribution management systems as more measurements become available from deployment of automated metering infrastructure (AMI). Observability analysis is the first step in SE, as it determines the sufficiency of the available measurements for accurately estimating the current system states. A new type of pseudo-measurement called a Correlational Measurement (CM) is introduced in this module, to enhance the observability of the system to enable more accurate SE. CMs encapsulate knowledge of correlation between demand patterns for similar classes of loads as well as injection patterns for same-technology renewable DERs. During grid contingency scenarios, DERs have been traditionally disconnected, without any fault ride-through capabilities. However, with new regulations and better technology, it is feasible for these resources to contribute to the grid’s restoration after an adverse event and hence enhance resilience. The controllability module proposes a two-step restoration scheme for the power system restoration process by leveraging additional degrees of freedom in power electronics interfaced DERs for mitigating voltage problems. In a resilience mode without the utility system, the distribution grid relies on DERs to serve critical load. In such a severe event with multiple faults on the distribution feeders, actuation of various protective devices (PDs) divides the distribution system into electrical islands. The undetected actuated PDs due to fault current contributions from DERs can delay the restoration process, thereby reducing the system resilience. The Advanced Outage Management (AOM) and the Advanced Feeder Restoration (AFR) modules developed in this project provide improved system resilience with multiple DERs. AOM identifies the faulted sections and actuated PDs in a distribution system with DERs by incorporating smart meter data. The most credible outage scenario including fault locations, PD actuations, and fault indicator (FI) failures is identified by a set of binary integer linear programming incorporating hypotheses. The AFR module serves to restore a distribution system with available energy resources taking into consideration the availability of utility sources and DERs. By partitioning the system into islands, critical load will be served with the available generation resources within islands based on the solution of a MILP. When the utility systems become available, the optimal path will be determined by a spanning tree search algorithm that reconnects these islands back to substations and restores the remaining load. The transmission and distribution (T&D) co-simulation module was used to validate the effect of a control action performed on the distribution side assets as it propagates to the transmission side. This ensures that the control action performed results in a feasible operating point on both the transmission and the distribution system. In addition to validation, the team used the T&D co-simulation module to demonstrate how distribution system assets can be used to mitigate issues on the transmission system. Specifically, the team demonstrated that appropriate switching operations on the distribution side can alleviate the line overload condition on the transmission side without causing new operational constraint violations.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Forward and inverse modeling of fault transmissibility in subsurface flows

Characterizing physical properties of faults, such as their transmissibility, is crucial for performing predictive numerical simulation of subsurface flows, such as those encountered in petroleum engineering and remediation of subsurface contamination. Here, this paper provides a complete investigation of the inverse problem for fault transmissibility in subsurface flow models, under appropriate assumptions on fault structure. In particular, the following aspects are considered: 1) fault modeling and well-posedness of the forward problem; 2) finite element (FEM) discretizations of the forward problem and their rigorous a priori convergence analysis; 3) Well-posedness of the Bayesian inverse problem, FEM discretization of the infinite dimensional Bayesian inverse formulation, and its rigorous a priori analysis. Moreover, computation of the maximum a posteriori (MAP) point via fast inexact Newton-conjugate gradient optimization and a Laplace approximation of the Bayesian posterior are also presented. Numerical results illustrate the use of the proposed fault model in forward and inverse problems for subsurface flows in two dimensional domains with multiple faults.

97 MATHEMATICS AND COMPUTING↗

An Innovative Fault Impact Analysis Framework for Enhancing Building Operations

The main goal of this paper is to rank building faults based on their impacts on the building energy penalty and occupant thermal comfort penalty considering multiple faults and fault occurrence rates. A fault impact analysis framework is created by incorporating the fault model library with the whole building energy performance simulation (e.g., EnergyPlus used in this study). The fault occurrence rate is introduced as a 'meta' parameter in the simulation. This framework involves three essential aspects of conducting a fault impact analysis: fault constructing, fault simulation, and fault impact analysis. A parametric sensitivity analysis was used to determine and rank the criticality of the faults considering the fault concurrence frequency, by using the deep-learning based response surface model (i.e., the multi-layer perceptron regression). The proposed fault analysis framework with ranking was tested and demonstrated for the DOE's prototype medium-sized office in four different climate zones (i.e., Atlanta, Chicago, Miami, and San Francisco) with 12,000 EnergyPlus fault simulations. A total of 129 fault modes from 41 groups of fault models were simulated for the medium-sized office case. The results demonstrate the proposed framework is robust and scalable for the fault impact analysis. The top critical fault for the medium-sized office is the fault of HVAC-Left-ON for the packaged rooftop unit, regarding the site energy, source energy, and HVAC energy. Excluding the fault of HVAC-Left-ON, the top critical faults vary significantly among the four climate zones.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Optimal well placement and brine extraction for pressure management during CO 2 sequestration

Large-scale pressure increases resulting from carbon dioxide (CO 2 ) injection in the subsurface can potentially impact caprock integrity, induce reactivation of critically stressed faults, and drive CO 2 or brine through conductive features into shallow groundwater. Pressure management involving the extraction of native fluids from storage formations can be used to reduce such pressure increases. However, dealing with large volumes of extracted brine can be technically challenging and expensive. Selection of optimal well locations and pumping rates are critical for maximizing CO 2 storage and minimizing brine extraction during geologic CO 2 sequestration (GCS). Robust and efficient computerized algorithms combining reservoir models and optimization methods are needed to make proper decisions on well placement and pumping rates. This work presents a constrained differential evolution (CDE) algorithm for solving global optimization problems involving pressure management of GCS projects. Application of the CDE optimization methodology was demonstrated for a hypothetical CO 2 storage scenario in a deep sandstone reservoir in the Southern San Joaquin Basin in California, USA. Industrial-scale storage of CO 2 would generate significant pressure buildup in this formation, which in turn would raise concerns about induced seismicity due to presence of multiple faults surrounding the injection site. Through the CDE optimization algorithm coupled to a vertically-averaged reservoir simulator, we successfully estimated optimal solutions for brine extraction wells in the reservoir that would limit the local pressure along the faults to a prescribed threshold. Multiple realizations of the reservoir permeability field were created to understand the impact of reservoir heterogeneity on optimization results. Our results indicate that the reservoir slope and heterogeneity have significant impact on optimum extraction rates. Reservoir heterogeneity is also a significant factor for extraction well locations, suggesting that in practice decisions about extraction well placement through optimization should be made at later project stages when data from a few years of CO 2 injection have allowed iterative updating and refining of the reservoir forward models. Although the study focused on optimization of brine extraction, the CDE optimization methodology presented in this paper has also potential to solve other complex optimization problems related to GCS, such as increasing storage efficiency by enhancing injectivity and capillary and dissolution trapping.

58 GEOSCIENCES↗

Experience Report for WOPR

One of the purposes of the SQA effort at LLNL is to attempt to determine the 'goodness' of the research codes used for various scientific applications. Typically these are two and three dimensional multi-physics simulation and modeling codes. These legacy research codes are used for applciations such as atmospheric dispersion modeling and analysis and prediction of the performance of engineered systems. These codes are continually subjected to automated regression test suites consisting of verified and validated expected results. Code is managed in repositories. Experience level of developers is high in the knowledge domain, platforms, and languages used. Code size of the multi-physics code used in this study was 578,242 lines excluding comment and blank lines or 5538.7 function points. Languages were 70% C++, 20% C, and 10% Fortran. The code has 130 users and a development team of 14 and an embedded SQE. The code has achieved 100% prime feature test coverage, 73.6% functional test coverage, and 71.5% statement test coverage. The average cyclomatic complexity of the code was 6.25. The codes have evolved over 10 years. Research codes are challenging because there is a desire to balance agility with discipline as well as compliance with DOE standards. Agility is important to allow experimentation with new algorithms and addition of the latest physics features. Discipline is important to increase the quality of the codes. Automation of processes and defect prevention/detection are deployed throughout the software development process. Since resarch codes are a small segment of the software industry, not much information exists in terms of reliability studies on these types of codes. This paper describes attempts to determine the goodness of these research codes. Goodness defined as both correctness of the codes and their fault densities. Correctness is determined by user interviews, peer review; feature based automated testing, and coverage measurement. This paper focuses on the fault density aspect of goodness and reliability of the codes in particular. The approach taken was to use multiple fault density prediction methods and compare results to actual experimentation and other industry studies on fault density. As a result of the predictions and experiments our confidence in the prediction methods was increased and our confidence in the goodness of the code from a fault density perspective was given more context. A large unintended benefit of these experiments was to find defects hidden for years in the codes when using the Monte Carlo reliability testing results to develop heuristic based bug driven tests.

99 GENERAL AND MISCELLANEOUS↗