Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “software estimations”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Lessons learned in deploying software estimation technology and tools

Developing a software product involves estimating various project parameters. This is typically done in the planning stages of the project when there is much uncertainty and very little information. Coming up with accurate estimates of effort, cost, schedule, and reliability is a critical problem faced by all software project managers. The use of estimation models and commercially available tools in conjunction with the best bottom-up estimates of software-development experts enhances the ability of a product development group to derive reasonable estimates of important project parameters. This paper describes the experience of the IBM Software Solutions (SWS) Toronto Laboratory in selecting software estimation models and tools and deploying their use to the laboratory's product development groups. It introduces the SLIM and COSTAR products, the software estimation tools selected for deployment to the product areas, and discusses the rationale for their selection. The paper also describes the mechanisms used for technology injection and tool deployment, and concludes with a discussion of important lessons learned in the technology and tool insertion process.

Panlilio-Yap, Nikki↗

As-built design specification for proportion estimate software subsystem

The Proportion Estimate Processor evaluates four estimation techniques in order to get an improved estimate of the proportion of a scene that is planted in a selected crop. The four techniques to be evaluated were provided by the techniques development section and are: (1) random sampling; (2) proportional allocation, relative count estimate; (3) proportional allocation, Bayesian estimate; and (4) sequential Bayesian allocation. The user is given two options for computation of the estimated mean square error. These are referred to as the cluster calculation option and the segment calculation option. The software for the Proportion Estimate Processor is operational on the IBM 3031 computer.

Obrien, S.↗

Online NASA Software Estimating Tools (ONSET): A Suite of Web-Based Cost Analysis Tools

This paper provides an overview of ONSET theOnline NASA Software Estimating Tools suite of web-basedcosts analysis tools. ONSET is comprised of the AnalogySoftware Cost Tool (ASCoT) [1], and the CubeSat Or MicrosatProbabilistic and Analogies Cost Tool (COMPACT) [2]. TheOnline NASA Space Estimation Tool (ONSET) has beendeveloped to provide a standardized platform for hosting webbasedNASA cost estimation tools on NASA ONCE (OneNASA Cost Engineering). It evolved from the BETA version ofASCoT (The NASA Analogy Software Cost Tool) which wasreleased in 2017 and was presented at the 2017 IEEEAerospace Conference. This first release of ONSET contains anew version of ASCoT as well as the first official release ofCOMPACT (CubeSat Or Microsat Probabilistic + AnalogiesCost Tool). In this paper we will provide an overview ofONSET, all its features and a high-level summary of bothASCoT and COMPACT. The heart of both tools arealgorithms for analogy-based estimation based on system levelinputs.

Johnson, James↗

Practical Methods for Estimating Software Systems Fault Content and Location

Over the past several years, we have developed techniques to discriminate between fault-prone software modules and those that are not, to estimate a software system's residual fault content, to identify those portions of a software system having the highest estimated number of faults, and to estimate the effects of requirements changes on software quality.

fault-prone discriminant function↗

Observation model and parameter partials for the JPL VLBI parameter estimation software MODEST, 19 94

This report is a revision of the document Observation Model and Parameter Partials for the JPL VLBI Parameter Estimation Software 'MODEST'---1991, dated August 1, 1991. It supersedes that document and its four previous versions (1983, 1985, 1986, and 1987). A number of aspects of the very long baseline interferometry (VLBI) model were improved from 1991 to 1994. Treatment of tidal effects is extended to model the effects of ocean tides on universal time and polar motion (UTPM), including a default model for nearly diurnal and semidiurnal ocean tidal UTPM variations, and partial derivatives for all (solid and ocean) tidal UTPM amplitudes. The time-honored 'K(sub 1) correction' for solid earth tides has been extended to include analogous frequency-dependent response of five tidal components. Partials of ocean loading amplitudes are now supplied. The Zhu-Mathews-Oceans-Anisotropy (ZMOA) 1990-2 and Kinoshita-Souchay models of nutation are now two of the modeling choices to replace the increasingly inadequate 1980 International Astronomical Union (IAU) nutation series. A rudimentary model of antenna thermal expansion is provided. Two more troposphere mapping functions have been added to the repertoire. Finally, corrections among VLBI observations via the model of Treuhaft and lanyi improve modeling of the dynamic troposphere. A number of minor misprints in Rev. 4 have been corrected.

Sovers, O. J.↗

Estimating Software Reliability for Space Launch Vehicles in Probabilistic Risk Assessment (PRA)

It is acutely recognized in the Probabilistic Risk assessment (PRA) field that software plays a defining role in overall system reliability for all modern systems across a wide variety of industries. Regardless if the software is embedded firmware for working components or elements, part of a Human-Machine-Interface, or automated command and control logic, the success of the software to fulfill its function under nominal and off-nominal environments will be a dominant contributor to system reliability. It is also recognized that software reliability prediction and estimation is one of the more challenging and questionable aspects of any PRA or system analyses due to the nature of software and its integration with physics based systems. Irrespective of this dichotomy, any incorporation of software reliability methods requires that the contributions are accountable, quantitative, and tractable. This paper provides a brief overview of software reliability methods, establishes some minimum requirements that the methods should incorporate for completeness, and provides a logic structure for applying software reliability. Model resolution will be discussed that supports current testing plans and trade studies. We will provide initial recommendations for use in the NASA PRA and present a future dynamic option for software and PRA. Space Launch Vehicle Software is recognized to be reliable in static conditions, yet relatively vulnerable to a set of failure modes in changing environments/flight phases. Two quantitative methods were chosen to incorporate software reliability into a Space Launch Vehicle PRA accounting for phase adjustments. One method predicts latent software failure using statistical methods, and the second provides estimates of coding errors and software operating system failures based on test and historical data, respectively. Software uncertainty will also be discussed. We determined that recommendations for PRA software reliability should be modeled at the software module level where multiple software components compose a module and combinations of the software architecture can lead to a functional failure.

Novack, Steven↗

Estimating Software Reliability for Space Launch Vehicles in Probabilistic Risk Assessment (PRA)

It is acutely recognized in the Probabilistic Risk Assessment (PRA) field that software plays a defining role in overall system reliability for all modern systems across a wide variety of industries. Regardless of whether the software is embedded firmware for working components or elements, part of a Human-Machine-Interface, or automated command and control logic, the success of the software to fulfill its function under nominal and off-nominal environments will be a dominant contributor to system reliability. It is also recognized that software reliability prediction and estimation is one of the more challenging and questionable aspects of any PRA or system analyses due to the nature of software and its integration with physics based systems. Irrespective of this dichotomy, any incorporation of software reliability methods requires that the contributions are accountable, quantitative, and tractable. This paper provides a brief overview of software reliability methods, establishes some minimum requirements that the methods should incorporate for completeness, and provides a logic structure for applying software reliability. Model resolution will be discussed that supports current testing plans and trade studies. We will provide initial recommendations for use in the National Aeronautics and Space Administration (NASA) PRA and present a future dynamic option for software and PRA. Space Launch Vehicle software is recognized to be reliable in static conditions, yet relatively vulnerable to a set of failure modes in changing environments/flight phases. Two quantitative methods were chosen to incorporate software reliability into a Space Launch Vehicle PRA accounting for phase adjustments. One method predicts latent software failure using statistical methods, and the second provides estimates of coding errors and software operating system failures based on test and historical data. Software uncertainty will also be discussed. It is determined that recommendations for PRA software reliability should be modeled at the software module level where multiple software components compose a module and combinations of the software architecture can lead to a functional failure.

Steven D. Novack↗

Fuzzy/Neural Software Estimates Costs of Rocket-Engine Tests

The Highly Accurate Cost Estimating Model (HACEM) is a software system for estimating the costs of testing rocket engines and components at Stennis Space Center. HACEM is built on a foundation of adaptive-network-based fuzzy inference systems (ANFIS) a hybrid software concept that combines the adaptive capabilities of neural networks with the ease of development and additional benefits of fuzzy-logic-based systems. In ANFIS, fuzzy inference systems are trained by use of neural networks. HACEM includes selectable subsystems that utilize various numbers and types of inputs, various numbers of fuzzy membership functions, and various input-preprocessing techniques. The inputs to HACEM are parameters of specific tests or series of tests. These parameters include test type (component or engine test), number and duration of tests, and thrust level(s) (in the case of engine tests). The ANFIS in HACEM are trained by use of sets of these parameters, along with costs of past tests. Thereafter, the user feeds HACEM a simple input text file that contains the parameters of a planned test or series of tests, the user selects the desired HACEM subsystem, and the subsystem processes the parameters into an estimate of cost(s).

Douglas, Freddie↗

NASA Software Estimating Tool (N-SET)

The goals of this project are to: Develop an early lifecycle software cost estimation tool leveraging existing data and capabilities Collect additional software data from: a) Jet Propulsion Laboratory; b) Goddard Space Flight Center; and c) Marshall Space Flight Center. Analyze, normalize, evaluate, stratify, and validate data. Create a calibrated, validated, and documented tool initially using available data and subsequently using newly collected data.

cost estimating tools↗

TU-AB-202-03: Prediction of PET Transfer Uncertainty by DIR Error Estimating Software, AUTODIRECT

Purpose: Deformable image registration (DIR) is a powerful tool, but DIR errors can adversely affect its clinical applications. To estimate voxel-specific DIR uncertainty, a software tool, called AUTODIRECT (automated DIR evaluation of confidence tool), has been developed and validated. This work tests the ability of this software to predict uncertainty for the transfer of standard uptake values (SUV) from positron-emission tomography (PET) with DIR. Methods: Virtual phantoms are used for this study. Each phantom has a planning computed tomography (CT) image and a diagnostic PET-CT image set. A deformation was digitally applied to the diagnostic CT to create the planning CT image and establish a known deformation between the images. One lung and three rectum patient datasets were employed to create the virtual phantoms. Both of these sites have difficult deformation scenarios associated with them, which can affect DIR accuracy (lung tissue sliding and changes in rectal filling). The virtual phantoms were created to simulate these scenarios by introducing discontinuities in the deformation field at the lung rectum border. The DIR algorithm from Plastimatch software was applied to these phantoms. The SUV mapping errors from the DIR were then compared to that predicted by AUTODIRECT. Results: The SUV error distributions closely followed the AUTODIRECT predicted error distribution for the 4 test cases. The minimum and maximum PET SUVs were produced from AUTODIRECT at 95% confidence interval before applying gradient-based SUV segmentation for each of these volumes. Notably, 93.5% of the target volume warped by the true deformation was included within the AUTODIRECT-predicted maximum SUV volume after the segmentation, while 78.9% of the target volume was within the target volume warped by Plastimatch. Conclusion: The AUTODIRECT framework is able to predict PET transfer uncertainty caused by DIR, which enables an understanding of the associated target volume uncertainty.

60 APPLIED LIFE SCIENCES↗

Evaluation of the accuracy of 3DVH software estimates of dose to virtual ion chamber and film in composite IMRT QA

Purpose: A novel patient-specific intensity modulated radiation therapy (IMRT) QA system, 3DVH software and mapcheck 2, purports to be able to use diode array-measured beam doses and the patient's DICOM RT plan, structure set, and dose files to predict the delivered 3D dose distribution in the patient for comparison to the treatment planning system (TPS) calculated doses. In this study, the composite dose to an ion chamber and film in phantom predicted by the 3DVH and mapcheck 2 system is compared to the actual measured chamber and film doses. If validated in this context, then 3DVH can be used to perform an equivalent dose analysis as that obtained with film dosimetry and ion chamber-based composite IMRT QA. This is important for those losing their ability to perform film dosimetry for true composite IMRT QA and provides a measure of confidence in the accuracy of 3DVH 3D dose calculations which may replace phantom-based IMRT QA. Methods: The dosimetric results from 15 consecutive patient-specific IMRT QA tests performed by composite field irradiation of ion chamber and EDR2 film in a solid water phantom were compared to the predicted doses for those virtual detectors based on the calculated 3D dose by the 3DVH software using mapcheck 2 measured doses of each beam within each plan. For each of the 15 cases, immediately after performing the ion chamber plus film measurements, the mapcheck 2 was used to measure the dose for each beam of the plan. The dose to the volume of the virtual ion chamber and the dose distribution in the plane of the virtual film calculated by the 3DVH software was extracted. The ratio of the measured to 3DVH or eclipse-predicted ion chamber doses was calculated. The same plane in the phantom measured using film and calculated with eclipse was exported from 3DVH and the 2D gamma metric was used to compare the relationship between the film doses and the eclipse or 3DVH predicted planar doses. Also, the 3D gamma value was calculated in the 3DVH software which compares the eclipse dose to the 3DVH predicted dose distribution. For the 2D and 3D gamma metrics, 2% dose and 2 mm distance to agreement (DTA) were used. In addition, a simple dose difference was performed using either a 2% or 3% dose difference tolerance. Results: The mean ratio {+-} standard deviation of the measured vs 3DVH or vs eclipse-predicted dose to the ion chamber was 1.013 {+-} 0.015 and 1.003 {+-} 0.012, respectively. For 3DVH vs eclipse, the mean percentage of pixels failing the 3D gamma metric was 1.2% {+-} 1.4% while the failure rate for the 2D gamma metric was 1.1% {+-} 0.9%. When either 3DVH or eclipse was compared to EDR2 film, the gamma failure rate was 2.3% {+-} 2.0% and 1.6% {+-} 1.7%, respectively. Mean dose difference failures were 9%-27% {+-} 5%-15% for 2 or 3% dose difference tolerances, depending on the combination of systems tested. No statistically significant differences were found for any of the planar dosimetric comparisons. Conclusions: 3DVH + mapcheck 2 predicts the same absolute dose, the percent of pixels failing the gamma metric, and the percent of pixels failing 2% or 3% dose difference tolerance tests as one would have obtained had one made measurements in solid water phantom using an ion chamber and coronal film instead of a diode array. This is also a necessary although not sufficient condition for validation of the accuracy of 3DVH predictions of the 3D dose using beam-by-beam measurements.

61 RADIATION PROTECTION AND DOSIMETRY↗

Misalignment estimation software system

A system of computer software, spacecraft, and ground system activity is described that enables spacecraft startrackers and inertial assemblies to be aligned and calibrated from the ground after the spacecraft has achieved orbit. The system generates in the uplink flow an exercise designed to render misalignments visible, and sends the exercise to the spacecraft where the spacecraft inserts the misalignment into the information in the form of attitude sensor error. The information is downlinked for processing into misalignment estimates to be used for correcting spacecraft model at data base.

Desjardins, R. L.↗