Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “verification and validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,135 records · Page 63
All sourcesNASA NTRSDOE OSTI
NASA NTRS1988

Acoustic emission frequency discrimination

In acoustic emission nondestructive testing, broadband frequency noise is distinguished from narrow banded acoustic emission signals, since the latter are valid events indicative of structural flaws in the material being examined. This is accomplished by separating out those signals which contain frequency components both within and beyond (either above or below) the range of valid acoustic emission events. Application to acoustic emission monitoring during nondestructive bond verification and proof loading of undensified tiles on the Space Shuttle Orbiter is considered.

Sugg, Frank E.↗
NASA NTRS2008

NASA Langley's Formal Methods Research in Support of the Next Generation Air Transportation System

This talk will provide a brief introduction to the formal methods developed at NASA Langley and the National Institute for Aerospace (NIA) for air traffic management applications. NASA Langley's formal methods research supports the Interagency Joint Planning and Development Office (JPDO) effort to define and develop the 2025 Next Generation Air Transportation System (NGATS). The JPDO was created by the passage of the Vision 100 Century of Aviation Reauthorization Act in Dec 2003. The NGATS vision calls for a major transformation of the nation s air transportation system that will enable growth to 3 times the traffic of the current system. The transformation will require an unprecedented level of safety-critical automation used in complex procedural operations based on 4-dimensional (4D) trajectories that enable dynamic reconfiguration of airspace scalable to geographic and temporal demand. The goal of our formal methods research is to provide verification methods that can be used to insure the safety of the NGATS system. Our work has focused on the safety assessment of concepts of operation and fundamental algorithms for conflict detection and resolution (CD&R) and self- spacing in the terminal area. Formal analysis of a concept of operations is a novel area of application of formal methods. Here one must establish that a system concept involving aircraft, pilots, and ground resources is safe. The formal analysis of algorithms is a more traditional endeavor. However, the formal analysis of ATM algorithms involves reasoning about the interaction of algorithmic logic and aircraft trajectories defined over an airspace. These trajectories are described using 2D and 3D vectors and are often constrained by trigonometric relations. Thus, in many cases it has been necessary to unload the full power of an advanced theorem prover. The verification challenge is to establish that the safety-critical algorithms produce valid solutions that are guaranteed to maintain separation under all possible scenarios. Current research has assumed perfect knowledge of the location of other aircraft in the vicinity so absolute guarantees are possible, but increasingly we are relaxing the assumptions to allow incomplete, inaccurate, and/or faulty information from communication sources.

Butler, Ricky W.↗
NASA NTRS2011

Space Suit Joint Torque Testing

In 2009 and early 2010, a test was performed to quantify the torque required to manipulate joints in several existing operational and prototype space suits in an effort to develop joint torque requirements appropriate for a new Constellation Program space suit system. The same test method was levied on the Constellation space suit contractors to verify that their suit design meets the requirements. However, because the original test was set up and conducted by a single test operator there was some question as to whether this method was repeatable enough to be considered a standard verification method for Constellation or other future space suits. In order to validate the method itself, a representative subset of the previous test was repeated, using the same information that would be available to space suit contractors, but set up and conducted by someone not familiar with the previous test. The resultant data was compared using graphical and statistical analysis and a variance in torque values for some of the tested joints was apparent. Potential variables that could have affected the data were identified and re-testing was conducted in an attempt to eliminate these variables. The results of the retest will be used to determine if further testing and modification is necessary before the method can be validated.

Valish, Dana J.↗
NASA NTRSDate not supplied

NASA HECC Geometry and Performance Review Part 1: Validation of a Computational Model for the Vaneless Diffuser Configuration with As-Manufactured Impeller Geometry

An investigation of the NASA High Efficiency Centrifugal Compressor (HECC) vaneless diffuser configuration was performed. This multipart investigation focused on validating the computational model against experimental data. The validated model was then used to explore the effects of observed geometric differences between the as-manufactured and design-intent impellers. Lastly, the validated model was used for comparison against an experimental tip clearance study. Details regarding each of the parts are detailed below: A multipart investigation of the NASA High Efficiency Centrifugal Compressor (HECC) vaneless diffuser configuration was performed. Part I of the investigation focused on describing the HECC vaneless computational model and its validation against the experimental data published in GT2023-103128. To generate the model, a verification of the manufactured impeller was performed and was confirmed to match the impeller CAD. Section data from the impeller CAD, referred to as As-Manufactured, were used in the model. Steady RANS simulations using a multiblock structured mesh were used to conduct a mesh convergence study. The resultant mesh was then used for simulations at both design-speed and off-design speed conditions. The simulations compared well to data in both 1D and 2D terms. Based on the observed results the model was deemed validated and was used in the latter two parts of the multipart investigation.

centrifugal compressor↗
NASA NTRS2006

Crash Certification by Analysis - Are We There Yet?

This paper addresses the issue of crash certification by analysis. This broad topic encompasses many ancillary issues including model validation procedures, uncertainty in test data and analysis models, probabilistic techniques for test-analysis correlation, verification of the mathematical formulation, and establishment of appropriate qualification requirements. This paper will focus on certification requirements for crashworthiness of military helicopters; capabilities of the current analysis codes used for crash modeling and simulation, including some examples of simulations from the literature to illustrate the current approach to model validation; and future directions needed to achieve "crash certification by analysis."

Jackson, Karen E.↗
NASA NTRS2024

NASA HECC Geometry and Performance Review Part 1: Validation of a Computational Model for the Vaneless Diffuser Configuration with As-Manufactured Impeller Geometry

An investigation of the NASA High Efficiency Centrifugal Compressor (HECC) vaneless diffuser configuration was performed. This multipart investigation presents an extensive validation of the computational model against experimental data. The validated model was then used to explore the effects geometric differences between the as-manufactured and design-intent impellers. Lastly, the validated model was used for comparison against an experimental tip clearance study. Part I of the investigation focused on describing the HECC vaneless computational model and its validation against the experimental data published in GT2023-103128. To generate the model, a verification of the manufactured impeller was performed and was confirmed to match the impeller CAD. Section data from the impeller CAD, referred to as the As-Manufactured geometry, were used for development of the computational model. Steady RANS simulations utilizing the Wilcox K-Omega 98 turbulence model and a multiblock structured mesh were used to conduct a mesh convergence study. The resultant mesh was then used for simulations at both design-speed and off-design speed conditions. The simulations compared well to data in both 1D and 2D terms for the major performance metrics of efficiency, total pressure rise, and total temperature rise. Based on the observed results the model was deemed validated and was used in the latter two parts of the multipart investigation.

centrifugal compressor↗
NASA NTRS1986

Additional confirmation of the validity of laboratory simulation of cloud radiances

The results of a laboratory experiment are presented that provide additional verification of the methodology adopted for simulation of the radiances reflected from fields of optically thick clouds using the Cloud Field Optical Simulator (CFOS) at Colorado State University. The comparison of these data with their theoretically derived counterparts indicates that the crucial mechanism of cloud-to-cloud radiance field interaction is accurately simulated in the CFOS experiments and adds confidence to the manner in which the optical depth is scaled.

Davis, J. M.↗
NASA NTRS2000

From Livingstone to SMV: Formal Verification for Autonomous Spacecrafts

To fulfill the needs of its deep space exploration program, NASA is actively supporting research and development in autonomy software. However, the reliable and cost-effective development and validation of autonomy systems poses a tough challenge. Traditional scenario-based testing methods fall short because of the combinatorial explosion of possible situations to be analyzed, and formal verification techniques typically require a tedious, manual modelling by formal method experts. This paper presents the application of formal verification techniques in the development of autonomous controllers based on Livingstone, a model-based health-monitoring system that can detect and diagnose anomalies and suggest possible recovery actions. We present a translator that converts the models used by Livingstone into specifications that can be verified with the SMV model checker. The translation frees the Livingstone developer from the tedious conversion of his design to SMV, and isolates him from the technical details of the SMV program. We describe different aspects of the translation and briefly discuss its application to several NASA domains.

Pecheur, Charles↗
NASA NTRS1979

Inertial Upper Stage (IUS) software analysis

The Inertial Upper Stage (IUS) System, an extension of the Space Transportation System (STS) operating regime to include higher orbits, orbital plane changes, geosynchronous orbits, and interplanetary trajectories is presented. The IUS software design, the IUS software interfaces with other systems, and the cost effectiveness in software verification are described. Tasks of the IUS discussed include: (1) design analysis; (2) validation requirements analysis; (3) interface analysis; and (4) requirements analysis.

Grayson, W. L.↗
NASA NTRS1985

Verification and performance tests of HYCAR program

The HYCAR program simulates the network protocols of HYPERchannel and Fiber Optic Demonstration System (FODS) and other related protocols. Verification tests of the program were conducted using the FODS protocol. The tests validated the operation of the program through deterministic and analytical means. Extensive experimentation with the simulator produced a set of performance characteristics for the FODS protocol under varied loading conditions. These characteristics are consistent with those expected, and are documented with the validation tests.

Bhatia, Veena↗
NASA NTRS2018

Blind Study Validating Parametric Costing Tools PRICE TruePlanning and SEER-H for NASA Science Missions

Two of the primary parametric costing tools used to estimate the development and production cost of future spacecraft hardware are PRICE TruePlanning - Space Missions Catalog by PRICE Systems, and SEER-H by Galorath. These are standard tools used by NASA and industry to estimate the cost of new aerospace hardware. However, no independent verification of the accuracy of these tools is publicly available. Both PRICE Systems and Galorath have completed internal validation studies of their parametric cost estimating tools; however, they only provided the results of the studies and did not detail the exact methods used to perform the validation. In the present study, cost estimators used PRICE TruePlanning and SEER-H to estimate the cost of twelve different past NASA science missions. The estimators were prevented from knowing the actual cost of the missions in an effort to minimize cognitive biases. In the present study, SEER had an average error of 23%, median error of -0.3%, with a standard deviation of 43%. PRICE had an average error of 52%, median error of 50%, and standard deviation of 45%. There were several factors independent of PRICE and SEER which may have affected the accuracy of the results in the present study including: uncertainty in the technical data used for the estimates, the methods used to estimate uncertainty in spacecraft component mass and numbers of prototypes, and the experience of the estimators.

Paul D Friz↗
NASA NTRS2019

Blind Study Validating Parametric Costing Tools PRICE True Planning and SEER-H for NASA Science Missions

Two of the primary parametric costing tools used to estimate the development and production cost of future spacecraft hardware are PRICE True Planning - Space Missions Catalog by PRICE Systems, and SEER-H by Galorath. These are standard tools used by NASA and industry to estimate the cost of new aerospace hardware. However, no independent verification of the accuracy of these tools is publicly available. Both PRICE Systems and Galorath have completed internal validation studies of their parametric cost estimating tools; however, they only provided the results of the studies and did not detail the exact methods used to perform the validation. In the present study, cost estimators used PRICE True Planning and SEER-H to estimate the cost of twelve different past NASA science missions. The estimators were prevented from knowing the actual cost of the missions in an effort to minimize cognitive biases. In the present study, SEER had an average error of 23%, median error of -0.3%, with a standard deviation of 43%. PRICE had an average error of 52%, median error of 50%, and standard deviation of 45%. There were several factors independent of PRICE and SEER which may have affected the accuracy of the results in the present study including: uncertainty in the technical data used for the estimates, the methods used to estimate uncertainty in spacecraft component mass and numbers of prototypes, and the experience of the estimators.

Friz, Paul D.↗
NASA NTRSDate not supplied

Computational Characterization and Model Verification for 3D Microstructure Reconstruction of Additively-Manufactured Materials

The goal of this study is to characterize and validate the texture and grain topology of additively-manufactured anisotropic three-dimensional (3D) polycrystalline microstructures. The special focus is on developing methodologies to compare the grain shapes and orientations of two-dimensional (2D) and 3D microstructure representations using the same metric. To generate statistical data, synthetic microstructures are reconstructed from experimental data using Markov random field (MRF). The statistical similarity between the experimental and synthetic microstructures is verified by comparing their grain topologies. A universal measure to compare 2D and 3D grains is portrayed through the concept of image moments that are invariant to shape transformations. The graphical plots developed based on moment invariants to compare the 2D and 3D grains are used to verify the synthetic model

Materials Characterization↗
NASA NTRS1993

Short arc orbit determination for altimeter calibration and validation on TOPEX/POSEIDON

TOPEX/POSEIDON (T/P) is a joint mission of United States' National Aeronautics and Space Administration (NASA) and French Centre National d'Etudes Spatiales (CNES) design launched August 10, 1992. It carries two radar altimeters which alternately share a common antenna. There are two project designated verification sites, a NASA site off the coast at Pt. Conception, CA and a CNES site near Lampedusa Island in the Mediterranean Sea. Altimeter calibration and validation for T/P is performed over these highly instrumented sites by comparing the spacecraft's altimeter radar range to computed range based on in situ measurements which include the estimated orbit position. This paper presents selected results of orbit determination over each of these sites to support altimeter verification. A short arc orbit determination technique is used to estimate a locally accurate position determination of T/P from less than one revolution of satellite laser ranging (SLR) data. This technique is relatively insensitive to gravitational and non-gravitational force modeling errors and is demonstrated by covariance analysis and by comparison to orbits determined from longer arcs of data and other tracking data types, such as Doppler Orbitography and Radiopositioning Integrated by Satellite (DORIS) and Global Positioning System Demonstration Receiver (GPSDR) data.

Williams, B. G.↗
NASA NTRS1987

A NASA initiative: Software engineering for reliable complex systems

The objective is the development of methods, technology, and skills that will enable NASA to cost-effectively specify, build, and manage reliable software which can evolve and be maintained over an extended period. The need for such software is rooted in the increasing integration of software and computing components into NASA systems. Current NASA Software Engineering expertise was applied toward some of the largest reliable systems including: shuttle launch; ground support; shuttle simulation; minor control; satellite tracking; and scientific data systems. Unfortunately, no theory exists for reliable complex software systems. NASA is seeking to fill this theoretical gap through a number of approaches. One such approach is to conduct research on theoretical foundations for managing complex software systems. It includes: communication models, new and modified paradigms, and life-cycle models. Another approach is research in the theoretical foundations for reliable software development and validation. It focuses upon formal specifications, programming languages, software engineering systems, software reuse, formal verification, and software safety. Further approaches involve benchmarking a NASA software environment, experimentation within the NASA context, evolution of present NASA methodology, and transfer of technology to the space station software support environment.

Holcomb, Lee B.↗
NASA NTRS2004

Minimum-Time and Vibration Avoidance Attitude Maneuver for Spacecraft with Torque and Momentum Limit Constraints in Redundant Reaction Wheel Configuration

This viewgraph presentation presents an algorithm for trajectory control of a spacecraft that minimizes the time to perform slews, including settling, by avoiding reaction wheel torque and momentum limits that would excite flexible structural modes. This algorithm was validated by simulation during the design of the NGST 'Yardstick' (precursor to JWST). Performance verification of a reduced form for single-axis slews was carried out using the MIT Origins Testbed. It is currently baselined for use by TPF-Coronagraph.

Ha, Kong Q.↗
NASA NTRS2010

Space Shuttle Day-of-Launch Trajectory Design and Verification

A top priority of any launch vehicle is to insert as much mass into the desired orbit as possible. This requirement must be traded against vehicle capability in terms of dynamic control, thermal constraints, and structural margins. The vehicle is certified to a specific structural envelope which will yield certain performance characteristics of mass to orbit. Some envelopes cannot be certified generically and must be checked with each mission design. The most sensitive envelopes require an assessment on the day-of-launch. To further minimize vehicle loads while maximizing vehicle performance, a day-of-launch trajectory can be designed. This design is optimized according to that day s wind and atmospheric conditions, which will increase the probability of launch. The day-of-launch trajectory verification is critical to the vehicle's safety. The Day-Of-Launch I-Load Uplink (DOLILU) is the process by which the Space Shuttle Program redesigns the vehicle steering commands to fit that day's environmental conditions and then rigorously verifies the integrated vehicle trajectory's loads, controls, and performance. The Shuttle methodology is very similar to other United States unmanned launch vehicles. By extension, this method would be similar to the methods employed for any future NASA launch vehicles. This presentation will provide an overview of the Shuttle's day-of-launch trajectory optimization and verification as an example of a more generic application of dayof- launch design and validation.

Harrington, Brian E.↗