Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “verification and validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,261 records · Page 70

Structural Sizing of a Composite Transonic Truss-Braced Wing

Accurate finite element modeling (FEM) is a vital part of the modern aircraft design process. As aircraft become increasingly complex, the time-consuming nature of detailed FEM approaches comes at a significant cost to program timeline and budget. In an effort produce modeling efforts that are sufficiently accurate and minimally costly, a proposed FEM approach and optimization scheme for a composite aircraft is explored, including a discussion of the manufacturing constraints of a highly tailored composite panel design. A high-fidelity structural model of a transonic truss-braced wing (TTBW) is generated, and the components are sized by structural optimization to satisfy buckling and strength constraints while subjected to critical maneuver loads. The structural modeling approaches and sizing of a TTBW are discussed, including details for FEM approaches, verification of an approximated FEM approach, a sizing optimization using the optimization software LS-OPT, and a manufacturing trial of integrally stiffened composite panels conducted to explore the validity of highly tailored composites as a design consideration. The results of study discussed herein indicate that the proposed FEM approach is suitable for modeling composite-construction aircraft and for use in sizing optimization. Further efforts regarding integrally stiffened composite panels will indicate the suitability of this method for the integration of highly tailored composite panels into the design and optimization process, given the manufacturability of such panels as shown here.

Finite Element↗

Structural Sizing of a Transonic Truss-Braced Wing

Accurate finite element modeling (FEM) is a vital part of the modern aircraft design process. As aircraft become increasingly complex, the time-consuming nature of detailed FEM approaches comes at a significant cost to program timeline and budget. In an effort produce modeling efforts that are sufficiently accurate and minimally costly, a proposed FEM approach and optimization scheme for a composite aircraft is explored, including a discussion of the manufacturing constraints of a highly tailored composite panel design. A high-fidelity structural model of a transonic truss-braced wing (TTBW) is generated, and the components are sized by structural optimization to satisfy buckling and strength constraints while subjected to critical maneuver loads. The structural modeling approaches and sizing of a TTBW are discussed, including details for FEM approaches, verification of an approximated FEM approach, a sizing optimization using the optimization software LS-OPT, and a manufacturing trial of integrally stiffened composite panels conducted to explore the validity of highly tailored composites as a design consideration. The results of study discussed herein indicate that the proposed FEM approach is suitable for modeling composite-construction aircraft and for use in sizing optimization. Further efforts regarding integrally stiffened composite panels will indicate the suitability of this method for the integration of highly tailored composite panels into the design and optimization process, given the manufacturability of such panels as shown here.

Finite Element↗

A Quasi-Global Approach to Improve Day-Time Satellite Surface Soil Moisture Anomalies through the Land Surface Temperature Input

Passive microwave observations from various spaceborne sensors have been linked to the soil moisture of the Earth's surface layer. A new generation of passive microwave sensors are dedicated to retrieving this variable and make observations in the single theoretically optimal L-band frequency (1-2 GHz). Previous generations of passive microwave sensors made observations in a range of higher frequencies, allowing for simultaneous estimation of additional variables required for solving the radiative transfer equation. One of these additional variables is land surface temperature, which plays a unique role in the radiative transfer equation and has an influence on the final quality of retrieved soil moisture anomalies. This study presents an optimization procedure for soil moisture retrievals through a quasi-global precipitation-based verification technique, the so-called Rvalue metric. Various land surface temperature scenarios were evaluated in which biases were added to an existing linear regression, specifically focusing on improving the skills to capture the temporal variability of soil moisture. We focus on the relative quality of the day-time (01:30 pm) observations from the Advanced Microwave Scanning Radiometer for Earth Observing System (AMSR-E), as these are theoretically most challenging due to the thermal equilibrium theory, and existing studies indicate that larger improvements are possible for these observations compared to their night-time (01:30 am) equivalent. Soil moisture data used in this study were retrieved through the Land Parameter Retrieval Model (LPRM), and in line with theory, both satellite paths show a unique and distinct degradation as a function of vegetation density. Both the ascending (01:30 pm) and descending (01:30 am) paths of the publicly available and widely used AMSR-E LPRM soil moisture products were used for benchmarking purposes. Several scenarios were employed in which the land surface temperature input for the radiative transfer was varied by imposing a bias on an existing regression. These scenarios were evaluated through the Rvalue technique, resulting in optimal bias values on top of this regression. In a next step, these optimal bias values were incorporated in order to re-calibrate the existing linear regression, resulting in a quasi-global uniform LST relation for day-time observations. In a final step, day-time soil moisture retrievals using the re-calibrated land surface temperature relation were again validated through the Rvalue technique. Results indicate an average increasing Rvalue of 16.5%, which indicates a better performance obtained through the re-calibration. This number was confirmed through an independent Triple Collocation verification over the same domain, demonstrating an average root mean square error reduction of 15.3%. Furthermore, a comparison against an extensive in situ database (679 stations) also indicates a generally higher quality for the re-calibrated dataset. Besides the improved day-time dataset, this study furthermore provides insights on the relative quality of soil moisture retrieved from AMSR-E's day- and night-time observations.

soil moisture↗

Rule groupings: A software engineering approach towards verification of expert systems

Currently, most expert system shells do not address software engineering issues for developing or maintaining expert systems. As a result, large expert systems tend to be incomprehensible, difficult to debug or modify and almost impossible to verify or validate. Partitioning rule based systems into rule groups which reflect the underlying subdomains of the problem should enhance the comprehensibility, maintainability, and reliability of expert system software. Attempts were made to semiautomatically structure a CLIPS rule base into groups of related rules that carry the same type of information. Different distance metrics that capture relevant information from the rules for grouping are discussed. Two clustering algorithms that partition the rule base into groups of related rules are given. Two independent evaluation criteria are developed to measure the effectiveness of the grouping strategies. Results of the experiment with three sample rule bases are presented.

Mehrotra, Mala↗

Dynamic verification of very large space structures

A research program in spacecraft structures, structural dynamics, and controls verification using a relatively large, flexible beam as a focus is introduced. This research effort addresses fundamental problems applicable to the verification of large, flexible space structures and combines ground tests, flight behavior prediction, and instrumented orbital tests. The program is expected to produce quantitative results for use in improving the validity of ground tests for verifying flight performance analyses.

Hanks, B. R.↗

Software reliability report

There are many software reliability models which try to predict future performance of software based on data generated by the debugging process. Unfortunately, the models appear to be unable to account for the random nature of the data. If the same code is debugged multiple times and one of the models is used to make predictions, intolerable variance is observed in the resulting reliability predictions. It is believed that data replication can remove this variance in lab type situations and that it is less than scientific to talk about validating a software reliability model without considering replication. It is also believed that data replication may prove to be cost effective in the real world, thus the research centered on verification of the need for replication and on methodologies for generating replicated data in a cost effective manner. The context of the debugging graph was pursued by simulation and experimentation. Simulation was done for the Basic model and the Log-Poisson model. Reasonable values of the parameters were assigned and used to generate simulated data which is then processed by the models in order to determine limitations on their accuracy. These experiments exploit the existing software and program specimens which are in AIR-LAB to measure the performance of reliability models.

Wilson, Larry↗

Modal identification experiment

The Modal Identification Experiment (MIE) is a proposed on-orbit experiment being developed by NASA's Office of Aeronautics and Space Technology wherein a series of vibration measurements would be made on various configurations of Space Station Freedom (SSF) during its on-orbit assembly phase. The experiment is to be conducted in conjunction with station reboost operations and consists of measuring the dynamic responses of the spacecraft produced by station-based attitude control system and reboost thrusters, recording and transmitting the data, and processing the data on the ground to identify the natural frequencies, damping factors, and shapes of significant vibratory modes. The experiment would likely be a part of the Space Station on-orbit verification. Basic research objectives of MIE are to evaluate and improve methods for analytically modeling large space structures, to develop techniques for performing in-space modal testing, and to validate candidate techniques for in-space modal identification. From an engineering point of view, MIE will provide the first opportunity to obtain vibration data for the fully-assembled structure because SSF is too large and too flexible to be tested as a single unit on the ground. Such full-system data is essential for validating the analytical model of SSF which would be used in any engineering efforts associated with structural or control system changes that might be made to the station as missions evolve over time. Extensive analytical simulations of on-orbit tests, as well exploratory laboratory simulations using small-scale models, have been conducted in-house and under contract to develop a measurement plan and evaluate its potential performance. In particular, performance trade and parametric studies conducted as part of these simulations were used to resolve issues related to the number and location of the measurements, the type of excitation, data acquisition and data processing, effects of noise and nonlinearities, selection of target vibration modes, and the appropriate type of data analysis scheme. The purpose of this talk is to provide an executive-summary-type overview of the modal identification experiment which has emerged from the conceptual design studies conducted to-date. Emphasis throughout is on those aspects of the experiment which should be of interest to those attending the subject utilization conference. The presentation begins with some preparatory remarks to provide background and motivation for the experiment, describe the experiment in general terms, and cite the specific technical objectives. This is followed by a summary of the major results of the conceptual design studies conducted to define the baseline experiment. The baseline experiment which has resulted from the studies is then described.

Kvaternik, Raymond G.↗

Designing a Flight Test of a Flight Path Management System for Advanced Air Mobility Research

The National Aeronautics and Space Administration (NASA) has completed a flight test to evaluate the performance of an onboard prototype automation system operating in future high density urban airspace. The test was part of a research investigation of the Urban Air Mobility (UAM) concept, with a focus on a future environment having hundreds of simultaneous operations over a metropolitan area. The complexity of this future UAM airspace may require automation capable of replanning an aircraft’s path in the presence of traffic and other changing constraints. A live-virtual-constructive (LVC) approach was used to conduct the test. Prototype automation technology was integrated into one of the two live aircraft, which were combined with virtual traffic to create a mixed reality environment at the target airspace density. In-flight evaluation enabled verification of the automation’s functions and discovery of any unexpected behaviors resulting from its operation in an actual flight environment. The in-flight evaluation also provided data for validation of air traffic simulations. This paper discusses the design, methodology, and challenges overcome to conduct a successful flight test. Remaining challenges, future work, and recommendations to improve the flight test capability are also discussed.

Advanced Air Mobility↗

Reconfigurable antenna pattern verification

A method of verifying programmable antenna configurations is disclosed. The method comprises selecting a desired antenna configuration from a plurality of antenna configuration patterns, with the selected antenna configuration forming at least one reconfigurable antenna from reconfigurable antenna array elements. The method validates the formation of the selected antenna configuration to determine antenna performance of the at least one reconfigurable antenna.

Drexler, Jerome P.↗

Model Validation of an RSRM Transporter Through Full-scale Operational and Modal Testing

The Reusable Solid Rocket Motor (RSRM) segments, which are part of the current Space Shuttle system and will provide the first stage of the Ares launch vehicle, must be transported from their manufacturing facility in Promontory, Utah, to a railhead in Corinne, Utah. This approximately 25-mile trip on secondary paved roads is accomplished using a special transporter system which lifts and conveys each individual segment. ATK Launch Systems (ATK) has recently obtained a new set of these transporters from Scheuerle, a company in Germany. The transporter is a 96-wheel, dual tractor vehicle that supports the payload via a hydraulic suspension. Since this system is a different design than was previously used, computer modeling with validation via test is required to ensure that the environment to which the segment is exposed is not too severe for this space-critical hardware. Accurate prediction of the loads imparted to the rocket motor is essential in order to prevent damage to the segment. To develop and validate a finite element model capable of such accurate predictions, ATA Engineering, Inc., teamed with ATK to perform a modal survey of the transport system, including a forward RSRM segment. A set of electrodynamic shakers was placed around the transporter at locations capable of exciting the transporter vehicle dynamics. Forces from the shakers with varying phase combinations were applied using sinusoidal sweep excitation. The relative phase of the shaker forcing functions was adjusted to match the shape characteristics of each of several target modes, thereby customizing each sweep run for exciting a particular mode. The resulting frequency response functions (FRF) from this series of sine sweeps allowed identification of all target modes and other higher-order modes, allowing good comparison to the finite element model. Furthermore, the survey-derived modal frequencies were correlated with peak frequencies observed during road-going operating tests. This correlation enabled verification of the most significant modes contributing to real-world loading of the motor segment under transport. After traditional model updating, dynamic simulation of the transportation environment was compared to the measured operating data to provided further validation of the analysis model. KEYWORDS Validation, correlation, modal test, rocket motor, transporter

Brillhart, Ralph↗

Simulator verification techniques study. Integrated simulator self test system concepts

Software and hardware requirements for implementing hardware self tests are presented in support of the development of training and procedures development simulators for the space shuttle program. Self test techniques for simulation hardware and the validation of simulation performance are stipulated. The requirements of an integrated simulator self system are analyzed. Readiness tests, fault isolation tests, and incipient fault detection tests are covered.

Montoya, G.↗

Studies of the net surface radiative flux from satellite radiances during FIFE

Studies of the net surface radiative flux from satellite radiances during First ISLSCP Field Experiment (FIFE) are presented. Topics covered include: radiative transfer model validation; calibration of VISSR and AVHRR solar channels; development and refinement of algorithms to estimate downward solar and terrestrial irradiances at the surface, including photosynthetically available radiation (PAR) and surface albedo; verification of these algorithms using in situ measurements; production of maps of shortwave irradiance, surface albedo, and related products; analysis of the temporal variability of shortwave irradiance over the FIFE site; development of a spectroscopy technique to estimate atmospheric total water vapor amount; and study of optimum linear combinations of visible and near-infrared reflectances for estimating the fraction of PAR absorbed by plants.

Frouin, Robert↗

Kodiak: An Implementation Framework for Branch and Bound Algorithms

Recursive branch and bound algorithms are often used to refine and isolate solutions to several classes of global optimization problems. A rigorous computation framework for the solution of systems of equations and inequalities involving nonlinear real arithmetic over hyper-rectangular variable and parameter domains is presented. It is derived from a generic branch and bound algorithm that has been formally verified, and utilizes self-validating enclosure methods, namely interval arithmetic and, for polynomials and rational functions, Bernstein expansion. Since bounds computed by these enclosure methods are sound, this approach may be used reliably in software verification tools. Advantage is taken of the partial derivatives of the constraint functions involved in the system, firstly to reduce the branching factor by the use of bisection heuristics and secondly to permit the computation of bifurcation sets for systems of ordinary differential equations. The associated software development, Kodiak, is presented, along with examples of three different branch and bound problem types it implements.

Smith, Andrew P.↗

Check-Cases for Verification of 6-Degree-of-Freedom Flight Vehicle Simulations: Appendices - Volume 2

This NASA Engineering and Safety Center (NESC) assessment was established to develop a set of time histories for the flight behavior of increasingly complex example aerospacecraft that could be used to partially validate various simulation frameworks. The assessment was conducted by representatives from several NASA Centers and an open-source simulation project. This document contains details on models, implementation, and results.

Murri, Daniel G.↗

Improvement of the TOPEX and Jason Orbit Time Series: Precision Orbit Determination, Calibration, Validation and Improvement Through the Combined Reduction and Analysis of GPS, SLR, DORIS and Altimeter Data

Orbit error is a major component in the overall error budget of all altimeter satellite missions. Jason-I is no exception and a 1 cm radial orbit accuracy goal has been set, which represents a factor of two improvement over what is currently being achieved for TOPEX/Poseidon (TP). Our current analysis suggests this goal has been met and even improved upon, but the challenge is to be able to continually achieve this high accuracy, verify the performance and characterize and quantify the remaining errors over the lifetime of the mission. The computation, verification and error characterization of such high accuracy orbits requires the reduction and analysis of all available tracking data (GPS, SLR, DORIS and altimeter). Current analysis also indicates the history of TP orbits can be further improved employing new solution strategies developed and tested on Jason-I. Our research focuses on the calibration, validation and improvement of orbit accuracies using all available tracking data including altimetry. We will compute and distribute well centered Jason orbits with an accuracy of better than 1-cm in the radial component. In addition to the orbits themselves, a characterization of the orbit error will be distributed and accumulated as a time series of orbit performance metrics to track anomalies and trends. The long time series of orbit error characterization will enable a better understanding of the remaining orbit errors and its impact on the altimeter data analysis. As part of this research effort we are also significantly improving the current level of TP orbit accuracy, re-computing new high-accuracy TP orbits from the beginning of the TP mission and continuing into the future (as long as TP is healthy). Our funded research effort will result in a complete and consistent time series of improved orbits for both TP and Jason, significantly benefiting the long time series of altimeter data analysis and the TP/Jason dual mission. The resultant high accuracy orbits and the characterization of their error will allow further improvements to the accuracy and overall quality of the altimeter measurement time series making possible further strides in radar altimeter remote sensing.

Luthcke, Scott B.↗

Preliminary Assessment of Suomi-NPP VIIRS On-orbit Radiometric Performance

The Visible-Infrared Imaging Radiometer Suite (VIIRS) is a key instrument on-board the Suomi National Polar-orbiting Partnership (NPP) spacecraft that was launched on October 28th 2011. VIIRS was designed to provide moderate and imaging resolution of most of the globe twice daily. It is a wide-swath (3,040 km) cross-track scanning radiometer with spatial resolutions of 370.and 740 m at nadir for imaging and moderate bands, respectively. It has 22 spectral bands covering the spectrum between 0.412 11m and 12.01 11m, including 14 reflective solar bands (RSB), 7 thermal emissive bands (TEB), and 1 day-night band (ON B). VIIRS observations are used to generate 22 environmental data products (EORs). This paper will briefly describe NPP VIIRS calibration strategies performed by the independent government team, for the initial on-orbit Intensive Calibration and Validation (ICV) activities. In addition, this paper will provide an early assessment of the sensor on-orbit radiometric performance, such as the sensor signal to noise ratios (SNRs), dual gain transition verification, dynamic range and linearity, reflective bands calibration based on the solar diffuser (SO) and solar diffuser stability monitor (SOSM), and emissive bands calibration based on the on-board blackbody calibration (OBC). A comprehensive set of performance metrics generated during the pre-launch testing program will be compared to VIIRS on-orbit early performance, and a plan for future cal/val activities and performance enhancements will be presented.

Oudrari, Hassan↗

Verification of Real-Time WSA-ENLIL+Cone Simulations of CME Arrival-Time at the CCMC from 2010 to 2016

The Wang-Sheeley-Arge (WSA)-ENLIL+Cone model is used extensively in space weather operations world-wide to model coronal mass ejection (CME) propagation. As such, it is important to assess its performance. We present validation results of the WSA-ENLIL+Cone model installed at the Community Coordinated Modeling Center (CCMC) and executed in real-time by the CCMC space weather team. CCMC uses the WSA-ENLIL+Cone model to predict CME arrivals at NASA missions throughout the inner heliosphere. In this work we compare model predicted CME arrival-times to in situ interplanetary coronal mass ejection leading edge measurements at Solar TErrestrial RElations Observatory-Ahead (STEREO-A), Solar TErrestrial RElations Observatory-Behind (STEREO-B), and Earth (Wind and ACE) for simulations completed between March 2010 and December 2016 (over 1,800 CMEs). We report hit, miss, false alarm, and correct rejection statistics for all three locations. For all predicted CME arrivals, the hit rate is 0.5, and the false alarm rate is 0.1. For the 273 events where the CME was predicted to arrive at Earth, STEREO-A, or STEREO-B, and was actually observed (hit event), the mean absolute arrival-time prediction error was 10.4 +/- 0.9 h, with a tendency to early prediction error of -4.0 h. We show the dependence of the arrival-time error on CME input parameters. We also explore the impact of the multi-spacecraft observations used to initialize the model CME inputs by comparing model verification results before and after the STEREO-B communication loss (since September 2014) and STEREO-A sidelobe operations (August 2014- December 2015). There is an increase of 1.7 h in the CME arrival time error during single, or limited two-viewpoint periods, compared to the three-spacecraft viewpoint period. This trend would apply to a future space weather mission at L5 or L4 as another coronagraph viewpoint to reduce CME arrival time errors compared to a single L1 viewpoint.

MHD / modeling / validation / forecasting / corona↗

A space station Structures and Assembly Verification Experiment, SAVE

The Space Station structure has been baselined to be a 5 M (16.4 ft) erectable truss. This structure will provide the overall framework to attach laboratory modules and other systems, subsystems and utilities. The assembly of this structure represents a formidable EVA challenge. To validate this capability the Space Station Structures/Dynamics Technical Integration Panel (TIP) met to develop the necessary data for an integrated STS structures flight experiment. As a result of this meeting, the Langley Research Center initiated a joint Langley/Boeing Aerospace Company study which supported the structures/dynamics TIP in developing the preliminary definition and design of a 5 M erectable space station truss and the resources required for a proposed flight experiment. The purpose of the study was to: (1) devise methods of truss assembly by astronauts; (2) define a specific test matrix for dynamic characterization; (3) identify instrumentation and data system requirements; (4) determine the power, propulsion and control requirements for the truss on-orbit for 3 years; (5) study the packaging of the experiment in the orbiter cargo bay; (6) prepare a preliminary cost estimate and schedule for the experiment; and (7) provide a list of potential follow-on experiments using the structure as a free flyer. The results of this three month study are presented.

Russell, R. A.↗