SEARCH · Engineering Papers
Results for “data validation”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
An algorithm to generate input data from meteorological and space shuttle observations to validate a CH4-CO model
Objective procedures to analyze data from meteorological and space shuttle observations to validate a three dimensional model were investigated. The transport and chemistry of carbon monoxide and methane in the troposphere were studied. Four aspects were examined: (1) detailed evaluation of the variational calculus procedure, with the equation of continuity as a strong constraint, for adjustment of global tropospheric wind fields; (2) reduction of the National Meteorological Center (NMC) data tapes for data input to the OSTA-1/MAPS Experiment; (3) interpolation of the NMC Data for input to the CH4-CO model; and (4) temporal and spatial interpolation procedures of the CO measurements from the OSTA-1/MAPS Experiment to generate usable contours of the data.
Validation of CALIPSO Lidar Observations Using Data From the NASA Langley Airborne High Spectral Resolution Lidar
This poster focuses on preliminary comparisons of data from the Cloud-Aerosol Lidar with Orthogonal Polarization (CALIOP) instrument on the Cloud-Aerosol Lidar and Infrared Pathfinder Satellite Observations (CALIPSO) spacecraft with data acquired by the NASA Langley Airborne High Spectral Resolution Lidar (HSRL). A series of 20 aircraft validation flights was conducted from 14 June through 27 September 2006, under both day and night lighting conditions and a variety of aerosol and cloud conditions. This poster presents comparisons of CALIOP measurements of attenuated backscatter at 532 and 1064 nm and depolarization at 532 nm with near coincident measurements from the Airborne HSRL as a preliminary assessment of CALIOP calibration accuracy. Note that the CALIOP data presented here are the pre-release version. These data have known artifacts in calibration which have been corrected in the December 8 CALIPSO data release which was not available at the time the comparisons were conducted for this poster. The HSRL data are also preliminary. No artifacts are known to exist; however, refinements in calibration and algorithms are likely to be implemented before validation comparisons are made final.
Stratospheric Aerosol and Gas Experiment III on the International Space Station (SAGE III/ISS) Newly Released V5.2 Validation of Ozone and Water Vapor Data
The Stratospheric Aerosol and Gas Experiment III (SAGE III) instrument installed on the International Space Station (ISS) has completed over three and a half years of data collection and production of science data products. The SAGE III/ISS is a solar and lunar occultation instrument that scans the light from the Sun and Moon through the limb of the Earth’s atmosphere to produce vertical profiles of aerosol, ozone, water vapor, and other trace gases. It continues the legacy of previous SAGE instruments dating back to the 1970s to provide data continuity of stratospheric constituents critical for assessing trends in the ozone layer. This presentation shows the validation results of comparing SAGE III/ISS ozone and water vapor vertical profiles from the newly released v5.2 science product with those of in situ and satellite data .
A new approach for determining fully empirical altimeter wind speed model functions
A statistical technique is developed for determining fully empirical model functions relating altimeter backscatter (sigma(sub 0)) measurements to near-surface neutral stability wind speed. By assuming that sigma(sub 0) varies monotonically and uniquely with wind speed, the method requires knowledge only of the separate, rather than joint distribution functions of sigma(sub 0) and wind speed. Analytic simplifications result from using a Weibull distribution to approximate the global ocean wind speed distribution; several different wind data sets are used to demonstrate the validity of the Weibull approximation. The technique has been applied to 1 year of Geosat data. Validation of the new and historical model functions using an independent buoy data set demonstrates that the present model function not only has small overall bias and root mean square (RMS) errors, but yields smaller systematic error trends with wind speed and pseudowave age than previously published models. The present analysis suggests that generally accuracte altimeter model functions can be derived without the use of colocated measurements, nor is additional significant wave height information measured by the altimeter necessary.
Validation Of The Airspace Concept Evaluation System Using Real World Data
This paper discusses the process of performing a validation of the Airspace Concept Evaluation System (ACES) using real world historical flight operational data. ACES inputs are generated from select real world data and processed to create a realistic reproduction of a single day of operations within the National Airspace System (NAS). ACES outputs are then compared to real world operational metrics and delay statistics for the reproduced day. Preliminary results indicate that ACES produces delays and airport operational metrics similar to the real world with minor variations of delay by phase of flight. ACES is a nation-wide fast-time simulation tool developed at NASA Ames Research Center. ACES models and simulates the NAS using interacting agents representing center control, terminal flow management, airports, individual flights, and other NAS elements. These agents pass messages between one another similar to real world communications. This distributed agent based system is designed to emulate the highly unpredictable nature of the NAS, making it a suitable tool to evaluate current and envisioned airspace concepts. To ensure that ACES produces the most realistic results, the system must be validated. There is no way to validate future concepts scenarios using real world historical data, but current day scenario validations increase confidence in the validity of future scenario results. Each operational day has unique weather and traffic demand schedules. The more a simulation utilizes the unique characteristic of a specific day, the more realistic the results should be. ACES is able to simulate the full scale demand traffic necessary to perform a validation using real world data. Through direct comparison with the real world, models may continuee to be improved and unusual trends and biases may be filtered out of the system or used to normalize the results of future concept simulations.
More Data Needed for Failure Rate Estimation, Validation, and Uncertainty Reduction
The currently planned schedule for advanced Environmental Control and Life Support System (ECLSS) development and test activities to support human exploration missions is unlikely to generate sufficient data to enable statistically-supportable, precise Orbital Replacement Unit (ORU) failure rate estimates to meet existing crew safety expectations. Accurate and precise failure rate estimates are critical for missions beyond Low Earth Orbit (LEO) because current risk mitigation approaches –namely regular resupply and rapid abort capabilities –will not be available. Safe operations will depend on mission planners’ ability to accurately forecast spares demand and efficiently provide the necessary resources. However, even after more than a decade of International Space Station (ISS) ECLSS operations, a significant amount of uncertainty remains in failure rate estimates. Uncertain or inaccurate failure rates result in increased risk and spares mass. A Bayesian estimation approach, such as the one currently implemented by the ISS Program, can reduce uncertainty by incorporating engineering judgement into failure rate estimates. However, experience on the ISS and with other complex systems shows that these prior failure rate estimates are often inaccurate. In addition, prior estimates are typically point values; some level of uncertainty must be added to convert these into probability distributions for Bayesian updating, and there are several potential methods for doing so. Due to the low rate of data collection, any inaccuracy in theseprior estimates currently hasa strong influence on the end result. This paper examines the challenges associated with failure rate estimation, validation, and uncertainty reduction in the context of ECLSS development for beyond-LEO missions. A variety of techniques for generating and updating Bayesian priors are discussed and evaluated using both real-world and simulated data. Potential solutions for improving failure rate estimation, including testing additional units, are analyzed and discussed, and a set of recommendations are provided for next-generation system development activities.
More Data Needed for Failure Rate Estimation, Validation, and Uncertainty Reduction
The currently planned schedule for advanced Environmental Control and Life Support System (ECLSS) development and test activities to support human exploration missions is unlikely to generate sufficient data to enable statistically-supportable, precise Orbital Replacement Unit (ORU) failure rate estimates to meet existing crew safety expectations. Accurate and precise failure rate estimates are critical for missions beyond Low Earth Orbit (LEO) because current risk mitigation approaches –namely regular resupply and rapid abort capabilities –will not be available. Safe operations will depend on mission planners’ ability to accurately forecast spares demand and efficiently provide the necessary resources. However, even after more than a decade of International Space Station (ISS) ECLSS operations, a significant amount of uncertainty remains in failure rate estimates. Uncertain or inaccurate failure rates result in increased risk and spares mass. A Bayesian estimation approach, such as the one currently implemented by the ISS Program, can reduce uncertainty by incorporating engineering judgement into failure rate estimates. However, experience on the ISS and with other complex systems shows that these prior failure rate estimates are often inaccurate. In addition, prior estimates are typically point values; some level of uncertainty must be added to convert these into probability distributions for Bayesian updating, and there are several potential methods for doing so. Due to the low rate of data collection, any inaccuracy in theseprior estimates currently hasa strong influence on the end result. This paper examines the challenges associated with failure rate estimation, validation, and uncertainty reduction in the context of ECLSS development for beyond-LEO missions. A variety of techniques for generating and updating Bayesian priors are discussed and evaluated using both real-world and simulated data. Potential solutions for improving failure rate estimation, including testing additional units, are analyzed and discussed, and a set of recommendations are provided for next-generation system development activities.
BIO-Plex Information System Concept
This paper describes a suggested design for an integrated information system for the proposed BIO-Plex (Bioregenerative Planetary Life Support Systems Test Complex) at Johnson Space Center (JSC), including distributed control systems, central control, networks, database servers, personal computers and workstations, applications software, and external communications. The system will have an open commercial computing and networking, architecture. The network will provide automatic real-time transfer of information to database server computers which perform data collection and validation. This information system will support integrated, data sharing applications for everything, from system alarms to management summaries. Most existing complex process control systems have information gaps between the different real time subsystems, between these subsystems and central controller, between the central controller and system level planning and analysis application software, and between the system level applications and management overview reporting. An integrated information system is vitally necessary as the basis for the integration of planning, scheduling, modeling, monitoring, and control, which will allow improved monitoring and control based on timely, accurate and complete data. Data describing the system configuration and the real time processes can be collected, checked and reconciled, analyzed and stored in database servers that can be accessed by all applications. The required technology is available. The only opportunity to design a distributed, nonredundant, integrated system is before it is built. Retrofit is extremely difficult and costly.
Initial Performance Assessment of CALIOP
The Cloud-Aerosol Lidar with Orthogonal Polarization (CALIOP, pronounced the same as "calliope") is a spaceborne two-wavelength polarizatio n lidar that has been acquiring global data since June 2006. CALIOP p rovides high resolution vertical profiles of clouds and aerosols, and has been designed with a very large linear dynamic range to encompas s the full range of signal returns from aerosols and clouds. CALIOP is the primary instrument carried by the Cloud-Aerosol Lidar and Infrar ed Pathfinder Satellite Observations (CALIPSO) satellite, which was l aunched on April, 28 2006. CALIPSO was developed within the framework of a collaboration between NASA and the French space agency, CNES. I nitial data analysis and validation intercomparisons indicate the qua lity of data from CALIOP meets or exceeds expectations. This paper presents a description of the CALIPSO mission, the CALIOP instrument, an d an initial assessment of on-orbit measurement performance.
Ares I-X Range Safety Analyses Overview
Ares I-X was the first test flight of NASA's Constellation Program's Ares I Crew Launch Vehicle designed to provide manned access to low Earth orbit. As a one-time test flight, the Air Force's 45th Space Wing required a series of Range Safety analysis data products to be developed for the specified launch date and mission trajectory prior to granting flight approval on the Eastern Range. The range safety data package is required to ensure that the public, launch area, and launch complex personnel and resources are provided with an acceptable level of safety and that all aspects of prelaunch and launch operations adhere to applicable public laws. The analysis data products, defined in the Air Force Space Command Manual 91-710, Volume 2, consisted of a nominal trajectory, three sigma trajectory envelopes, stage impact footprints, acoustic intensity contours, trajectory turn angles resulting from potential vehicle malfunctions (including flight software failures), characterization of potential debris, and debris impact footprints. These data products were developed under the auspices of the Constellation's Program Launch Constellation Range Safety Panel and its Range Safety Trajectory Working Group with the intent of beginning the framework for the operational vehicle data products and providing programmatic review and oversight. A multi-center NASA team in conjunction with the 45th Space Wing, collaborated within the Trajectory Working Group forum to define the data product development processes, performed the analyses necessary to generate the data products, and performed independent verification and validation of the data products. This paper outlines the Range Safety data requirements and provides an overview of the processes established to develop both the data products and the individual analyses used to develop the data products, and it summarizes the results of the analyses required for the Ares I-X launch.
Ares I-X Range Safety Flight Envelope Analysis
Ares I-X was the first test flight of NASA's Constellation Program's Ares I Crew Launch Vehicle designed to provide manned access to low Earth orbit. As a one-time test flight, the Air Force's 45th Space Wing required a series of Range Safety analysis data products to be developed for the specified launch date and mission trajectory prior to granting flight approval on the Eastern Range. The range safety data package is required to ensure that the public, launch area, and launch complex personnel and resources are provided with an acceptable level of safety and that all aspects of prelaunch and launch operations adhere to applicable public laws. The analysis data products, defined in the Air Force Space Command Manual 91-710, Volume 2, consisted of a nominal trajectory, three sigma trajectory envelopes, stage impact footprints, acoustic intensity contours, trajectory turn angles resulting from potential vehicle malfunctions (including flight software failures), characterization of potential debris, and debris impact footprints. These data products were developed under the auspices of the Constellation's Program Launch Constellation Range Safety Panel and its Range Safety Trajectory Working Group with the intent of beginning the framework for the operational vehicle data products and providing programmatic review and oversight. A multi-center NASA team in conjunction with the 45th Space Wing, collaborated within the Trajectory Working Group forum to define the data product development processes, performed the analyses necessary to generate the data products, and performed independent verification and validation of the data products. This paper outlines the Range Safety data requirements and provides an overview of the processes established to develop both the data products and the individual analyses used to develop the data products, and it summarizes the results of the analyses required for the Ares I-X launch.
Fundamental Aeronautics Program. Subsonic Rotary Wing Project: SRW Aeromechanics Overview/UH-60 Airloads Wind Tunnel Test Summary
Objectives: a) Advance the understanding of phenomena in aerodynamics, dynamics, and active control of rotorcraft. b) Develop and validate first-principles tools. c) Acquire data for tool validation from small and large-scale testing of existing and novel rotorcraft configurations. Recent Accomplishments include: (CFD) - Made significant improvements in structured and unstructured rotorcraft CFD methods (OVERFLOW and FUN3D). (Icing) - a) Continued development of high-fidelity icing analysis tools. b) Completed test of oscillating airfoil in Icing Research Tunnel (IRT). c) Developed plans and began detailed preparations for subscale rotor test in IRT.
Using Reliability to Meet Z540.3's 2 percent Rule
NASA's Kennedy Space Center (KSC) undertook implementation of ANSI/NCSL Z540.3-2006 in October 2008. Early in the implementation, KSC identified that the largest cost driver of Z540.3 implementation is measurement uncertainty analyses for legacy calibration processes. NASA, like other organizations, has a significant inventory of measuring and test equipment (MTE) that have documented calibration procedures without documented measurement uncertainties. This paper provides background information to support the rationale for using high in-tolerance reliability as evidence of compliance to the 2% probability of false acceptance (PFA) quality metric of ANSI/NCSL Z540.3-2006 allowing use of qualifying legacy processes. NASA is adopting this as policy and is recommending NCSL International consider this as a method of compliance to Z540.3. Topics covered include compliance issues, using end-of-period reliability (EOPR) to estimate test point uncertainty, reliability data influences within the PFA model, the validity of EOPR data, and an appendix covering "observed" versus "true" EOPR.
Onboard Processing and Autonomous Operations on the IPEX Cubesat
IPEX is a 1u Cubesat sponsored by NASA Earth Science Technology Office (ESTO), the goals or which are: (1) Flight validate high performance flight computing, (2) Flight validate onboard instrument data processing product generation software, (3) flight validate autonomous operations for instrument processing, (4) enhance NASA outreach and university ties.
A Spatially Coherent Global Soil Moisture Product with Improved Temporal Resolution
Global soil moisture products that are completely independent of any type of ancillary data and solely rely on satellite observations are presented. Additionally, we further develop an existing downscaling technique that enhances the spatial resolution of such products to approximately 11 km. These products are based on internal modules of the Land Parameter Retrieval Model (LPRM), an algorithm that uses the radiative transfer equation to link soil moisture, vegetation optical depth and land surface temperature to observed brightness temperatures. The soil moisture product that is independent of any type of ancillary data uses the internally calculated dielectric constant as a soil moisture proxy. This data product is not influenced by errors associated with coarse-scale global soil property maps or by any other type of forcing (e.g. re-analysis) data and is therefore solely based on satellite microwave observations. The second step builds upon recent developments to increase the spatial resolution of the LPRM retrievals using a smoothing filter downscaling method. With this method we can attain a spatial resolution that can be more useful at the scale of local and regional hydrological studies as well. The steps presented in this paper were applied to observations from the Advanced Microwave Scanning Radiometer-Earth Observing System (AMSR-E). The newly derived data sets were validated using ground-based observations from the International Soil Moisture Network (ISMN). The internally calculated dielectric constant product results in significantly more days with valid retrievals than the original soil moisture data products, in particular over arid regions. The dielectric constant product resulted in similar correlations with in situ data as the original soil moisture data product. Together, these findings demonstrate the usefulness of this new dielectric constant product for the hydrological modeling community and climate studies. A case study on the Australian Fitzroy catchment demonstrated that the downscaled data product has a more detailed spatial description of soil moisture, especially during wet and dry conditions with more pronounced dry and wet regions within the catchment. The increased resolution data products could therefore improve runoff predictions and this study demonstrated the potential added value of a transitioning from a spatial resolution of 56 km toward a higher resolution of 11 km. The hydrological implications of these newly developed data records are not only linked to AMSR-E satellite data, but also to the next generation Soil Moisture Active and Passive (SMAP) mission where a 9 km spatial resolution is the target resolution for satellite soil moisture products. The new data products will not replace the current LPRM products, but will be added to the existing array of data products and will become publicly available through our data portals.
NASA’s Space Launch System: Comprehensive Test Program Leads to Mission Success during Artemis I Flight Test
NASA’s SLS (Space Launch System) rocket had a successful first launch on Nov. 16, 2022, sending an uncrewed Orion spacecraft to the Moon on the agency’s Artemis I mission. Ten 6U CubeSats were also deployed from SLS during the mission. Orbital insertion parameters, including insertion velocity and altitude, were within hundredths and tenths of a percent from predicted values, corroborating data collected from the individual elements that showed similar performance accuracy. While launch remains the main test – and Artemis I was a true test flight – to collect data, confirm and refine computer models, and validate hardware test data, multiple test programs led up to the first flight and enabled the historic launch. Additionally, SLS was designed from the beginning to be a crew-rated launch vehicle, and teams put the astronauts who will fly on it at the forefront of the development process. This paper and presentation will cover the SLS design and development programs that led to the successful Artemis I mission, and which have set the stage to send the first astronauts back to cislunar space since the Apollo 17 crew in 1972.