Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,099 records · Page 61

Incorporating Yearly Derived Winter Wheat Maps Into Winter Wheat Yield Forecasting Model

Wheat is one of the most important cereal crops in the world. Timely and accurate forecast of wheat yield and production at global scale is vital in implementing food security policy. Becker-Reshef et al. (2010) developed a generalized empirical model for forecasting winter wheat production using remote sensing data and official statistics. This model was implemented using static wheat maps. In this paper, we analyze the impact of incorporating yearly wheat masks into the forecasting model. We propose a new approach of producing in season winter wheat maps exploiting satellite data and official statistics on crop area only. Validation on independent data showed that the proposed approach reached 6% to 23% of omission error and 10% to 16% of commission error when mapping winter wheat 2-3 months before harvest. In general, we found a limited impact of using yearly winter wheat masks over a static mask for the study regions.

MODIS↗

The SPACE Computer Code for Analyzing the International Space Station Electrical Power System: Past, Present, and Future

The System Power Analysis for Capability Evaluation (SPACE) computer code was initially developed by NASA in 1988 to assess the Space Station Freedom electric power system and later adapted to support contractor electrical power system capability analyses for the International Space Station (ISS). Over time, the code has supported many efforts such as ISS redesign activities in the early 1990s, assessment of time-phased loads against power system operating limits for future ISS assembly flights (including Certification of Flight Readiness reviews by the ISS program office), and determining the optimum solar array gimbal positions while respecting keep-out zones which minimize both solar array contamination and structural loads. The code has been validated by comparisons with ISS on-orbit data in multiple validation episodes. Recent updates to the code include the incorporation of a Lithium-Ion battery model in addition to the Nickel Hydrogen battery model and modifications to the solar array degradation model to better match on-orbit test results. SPACE has also been extended beyond the ISS to include modeling of the Orion Multi-Purpose Crew Vehicle electrical power system (SPACE-MPCV) and Mars Surface Electrical Power Systems (MSEPS). Portions of SPACE were integrated with a trajectory code to form a Solar Electric Propulsion Simulation (SEPSim), which can be used for analyzing solar electric propulsion missions. In addition, SPACE methods and subroutines have been adapted to a multitude of other projects. This paper summarizes the initial code development and subsequent code utilization in the context of the overall ISS program development and on-orbit operations. Recent updates and results from the code are discussed, including preliminary analyses for the Orion power system.

Electrical Power System↗

HZETRN Radiation Transport Validation Using Balloon-Based Experimental Data

The deterministic radiation transport code HZETRN (High charge (Z) and Energy TRaNsport) was developed by NASA to study the effects of cosmic radiation on astronauts and instrumentation shielded by various materials. This work presents an analysis of computed differential flux from HZETRN compared with measurement data from three balloon-based experiments over a range of atmospheric depths, particle types, and energies. Model uncertainties were quantified using an interval-based validation metric that takes into account measurement uncertainty both in the flux and the energy at which it was measured. Average uncertainty metrics were computed for the entire dataset as well as subsets of the measurements (by experiment, particle type, energy, etc.) to reveal any specific trends of systematic over- or under-prediction by HZETRN. The distribution of individual model uncertainties was also investigated to study the range and dispersion of errors beyond just single scalar and interval metrics. The differential fluxes from HZETRN were generally well-correlated with balloon-based measurements; the median relative model difference across the entire dataset was determined to be 30%. The distribution of model uncertainties, however, revealed that the range of errors was relatively broad, with approximately 30% of the uncertainties exceeding ± 40%. The distribution also indicated that HZETRN systematically under-predicts the measurement dataset as a whole, with approximately 80% of the relative uncertainties having negative values. Instances of systematic bias for subsets of the data were also observed, including a significant underestimation of alpha particles and protons for energies below 2.5 GeV/u. Muons were found to be systematically over-predicted at atmospheric depths deeper than 50 g/cm(sup 2) but under-predicted for shallower depths. Furthermore, a systematic under-prediction of alpha particles and protons was observed below the geomagnetic cutoff, suggesting that improvements to the light ion production cross sections in HZETRN should be investigated.

James E Warner↗

Benchmark Active Controls Technology (BACT) Wing CFD Results

The Benchmark Active Controls Technology (BACT) wing test (see chapter 8E) provides data for the validation of aerodynamic, aeroelastic, and active aeroelastic control simulation codes. These data provide a rich database for development and validation of computational aeroelastic and aeroservoelastic methods. In this vein, high-level viscous CFD analyses of the BACT wing have been performed for a subset of the test conditions available in the dataset. The computations presented in this section investigate the aerodynamic characteristics of the rigid clean wing configuration as well as simulations of the wing with a static and oscillating aileron and spoiler deflection. Two computational aeroelasticity codes extensively used at NASA Langley Research Center are implemented in this simulation. They are the ENS3DAE and CFL3DAE computational aeroelasticity programs. Both of these methods solve the three-dimensional compressible Navier-Stokes equations for both rigid and flexible vehicles, but they use significantly different approaches to the solution 6f the aerodynamic equations of motion. Detailed descriptions of both methods are presented in the following section.

Schuster, David M.↗

Time Domain Tool Validation Using ARES I-X Flight Data

The ARES I-X vehicle was launched from NASA's Kennedy Space Center (KSC) on October 28, 2009 at approximately 11:30 EDT. ARES I-X was the first test flight for NASA s ARES I launch vehicle, and it was the first non-Shuttle launch vehicle designed and flown by NASA since Saturn. The ARES I-X had a 4-segment solid rocket booster (SRB) first stage and a dummy upper stage (US) to emulate the properties of the ARES I US. During ARES I-X pre-flight modeling and analysis, six (6) independent time domain simulation tools were developed and cross validated. Each tool represents an independent implementation of a common set of models and parameters in a different simulation framework and architecture. Post flight data and reconstructed models provide the means to validate a subset of the simulations against actual flight data and to assess the accuracy of pre-flight dispersion analysis. Post flight data consists of telemetered Operational Flight Instrumentation (OFI) data primarily focused on flight computer outputs and sensor measurements as well as Best Estimated Trajectory (BET) data that estimates vehicle state information from all available measurement sources. While pre-flight models were found to provide a reasonable prediction of the vehicle flight, reconstructed models were generated to better represent and simulate the ARES I-X flight. Post flight reconstructed models include: SRB propulsion model, thrust vector bias models, mass properties, base aerodynamics, and Meteorological Estimated Trajectory (wind and atmospheric data). The result of the effort is a set of independently developed, high fidelity, time-domain simulation tools that have been cross validated and validated against flight data. This paper presents the process and results of high fidelity aerospace modeling, simulation, analysis and tool validation in the time domain.

Hough, Steven↗

CFD Modeling Needs and What Makes a Good Supersonic Combustion Validation Experiment

If a CFD code/model developer is asked what experimental data he wants to validate his code or numerical model, his answer will be: "Everything, everywhere, at all times." Since this is not possible, practical, or even reasonable, the developer must understand what can be measured within the limits imposed by the test article, the test location, the test environment and the available diagnostic equipment. At the same time, it is important for the expermentalist/diagnostician to understand what the CFD developer needs (as opposed to wants) in order to conduct a useful CFD validation experiment. If these needs are not known, it is possible to neglect easily measured quantities at locations needed by the developer, rendering the data set useless for validation purposes. It is also important for the experimentalist/diagnostician to understand what the developer is trying to validate so that the experiment can be designed to isolate (as much as possible) the effects of a particular physical phenomena that is associated with the model to be validated. The probability of a successful validation experiment can be greatly increased if the two groups work together, each understanding the needs and limitations of the other.

Gaffney, Richard L., Jr.↗

Lessons Learned from Preparing OSIRIS-REx Spectral Analog Samples for Bennu

NASA's OSIRIS-REx sample return mission launched on September 8th, 2016 to rendezvous with B-type asteroid (101955) Bennu in 2018. Type C and B asteroids have been linked to carbonaceous chondrites because of their similar visible - to - near infrared (VIS-NIR) spectral properties [e.g., 1,2]. The OSIRIS-REx Visible and Infrared Spectrometer (OVIRS) and the Thermal Emission Spectrometer (OTES) will make spectroscopic observations of Bennu during the encounter. Constraining the presence or absence of hydrous minerals (e.g., Ca-carbonate, phyllosilicates) and organic molecules will be key to characterizing Bennu [3] prior to sample site selection. The goal of this study was to develop a suite of analog and meteorite samples and obtain their spectral properties over the wavelength ranges of OVIRS (0.4- 4.3 micrometer) and OTES (5.0-50 micrometer). These spectral data were used to validate the mission science-data processing system. We discuss the reasoning behind the study and share lessons learned.

Schrader, D. L.↗

Creating A Consistent Historical NASA POWER Solar Radiation Dataset to Support Renewable Energy, Building Energy Efficiency and Agro-Climatology Decisions

Prediction of Worldwide Energy Resources (POWER) project provides irradiance dataset to support renewable energy, building energy efficiency and agricultural needs. These datasets are derived from Global Energy and Water Cycle Experiment Surface Radiation Budget (GEWEX SRB) and Clouds and the Earth’s Radiant Energy System (CERES SYN1Deg). A systematic bias has been reported between these two datasets for the years with overlapping observations. For obtaining a consistent climate data record spanning the entire time record of observations, it is crucial to understand and remove the bias in the irradiance dataset. Inconsistency in solar radiation data can lead to inaccurate conclusions about solar energy potential and obscure real trends in solar radiation patterns that would impact energy availability assessments. In this study, we adapt quantile mapping approach to remove the systematic bias and to improve reliability of shortwave and longwave irradiance data. We present a validation of the bias corrected data against ground truth. For each 1° latitude and 1° longitude grid box across the globe, we match the CDFs of the reference dataset (CERES SYN1Deg) to that of the SRB dataset, thereby, adjusting the irradiance values to match the empirical distribution of two different measurements. The performance of quantile mapping is evaluated by using the metrics such as Mean Absolute Deviation (MAD). The results indicate that the quantile mapping significantly improves the accuracy and reliability of solar irradiance dataset especially for the weather conditions associated with high cloud cover and extreme irradiance values. The initial range of MAD for the studied sites for daily data was 4 to 19 Wm-2. After correction these reduced to 3 to 7 Wm-2. The findings from this study have important implications for solar energy system design, agricultural planning, and climate modeling community. Reducing the inconsistency and biases in solar irradiance dataset can enable better planning and operation of solar energy systems, leading to increased efficiency and cost-effectiveness. Additionally, this work also contributes to the statistical post-processing techniques in the renewable energy domain and highlights the potential of historical and near-real-time NASA POWER dataset as a valuable resource for solar energy research and applications.

POWER↗

CLVTOPS Liftoff and Separation Analysis Validation Using Ares I-X Flight Data

CLVTOPS is a multi-body time domain flight dynamics simulation tool developed by NASA s Marshall Space Flight Center (MSFC) for a space launch vehicle and is based on the TREETOPS simulation tool. CLVTOPS is currently used to simulate the flight dynamics and separation/jettison events of the Ares I launch vehicle including liftoff and staging separation. In order for CLVTOPS to become an accredited tool, validation against other independent simulations and real world data is needed. The launch of the Ares I-X vehicle (first Ares I test flight) on October 28, 2009 presented a great opportunity to provide validation evidence for CLVTOPS. In order to simulate the Ares I-X flight, specific models were implemented into CLVTOPS. These models include the flight day environment, reconstructed thrust, reconstructed mass properties, aerodynamics, and the Ares I-X guidance, navigation and control models. The resulting simulation output was compared to Ares I-X flight data. During the liftoff region of flight, trajectory states from the simulation and flight data were compared. The CLVTOPS results were used to make a semi-transparent animation of the vehicle that was overlaid directly on top of the flight video to provide a qualitative measure of the agreement between the simulation and the actual flight. During ascent, the trajectory states of the vehicle were compared with flight data. For the stage separation event, the trajectory states of the two stages were compared to available flight data. Since no quantitative rotational state data for the upper stage was available, the CLVTOPS results were used to make an animation of the two stages to show a side-by-side comparison with flight video. All of the comparisons between CLVTOPS and the flight data show good agreement. This paper documents comparisons between CLVTOPS and Ares I-X flight data which serve as validation evidence for the eventual accreditation of CLVTOPS.

Burger, Ben↗

Experimental studies of characteristic combustion-driven flows for CFD validation

A series of rocket-related studies intended to develop a suitable data base for validation of Computational Fluid Dynamics (CFD) models of characteristic combustion-driven flows was undertaken at the Propulsion Engineering Research Center at Penn State. Included are studies of coaxial and impinging jet injectors as well as chamber wall heat transfer effects. The objective of these studies is to provide fundamental understanding and benchmark quality data for phenomena important to rocket combustion under well-characterized conditions. Diagnostic techniques utilized in these studies emphasize determinations of velocity, temperature, spray and droplet characteristics, and combustion zone distribution. Since laser diagnostic approaches are favored, the development of an optically accessible rocket chamber has been a high priority in the initial phase of the project. During the design phase for this chamber, the advice and input of the CFD modeling community were actively sought through presentations and written surveys. Based on this procedure, a suitable uni-element rocket chamber was fabricated and is presently under preliminary testing. Results of these tests, as well as the survey findings leading to the chamber design, were presented.

Santoro, R. J.↗

TAMDAR Sensor Validation in 2003 AIRS II

This study entails an assessment of TAMDAR in situ temperature, relative humidity and winds sensor data from seven flights of the UND Citation II. These data are undergoing rigorous assessment to determine their viability to significantly augment domestic Meteorological Data Communications Reporting System (MDCRS) and the international Aircraft Meteorological Data Reporting (AMDAR) system observational databases to improve the performance of regional and global numerical weather prediction models. NASA Langley Research Center participated in the Second Alliance Icing Research Study from November 17 to December 17, 2003. TAMDAR data taken during this period is compared with validation data from the UND Citation. The data indicate acceptable performance of the TAMDAR sensor when compared to measurements from the UND Citation research instruments.

Daniels, Taumi S.↗

Vicarious Calibration of GOCI for the SeaDAS Ocean Color Retrieval

A key on-orbit calibration step for satellite remote sensing of ocean color is the vicarious calibration. This establishes the final gains for each spectral band on the sensor that minimize bias in the retrieved ocean color signal. The vicarious calibration is specific to the instrument and the atmospheric correction algorithm. The vicarious calibration gains for the Geostationary Ocean Color Imager (GOCI) are presented here, which were derived to optimize the performance ofNASA's standard atmospheric correction algorithm as implemented in the l2gen code and distributed through the SeaDAS open-source software package. Following NASA's protocols, the near-infrared(NIR) bands were calibrated first, and the visible bands were then calibrated relative to this fixed NIR calibration. The gain for the 745-nm NIR band was derived using a fixed aerosol model, which waschosen based on the Angstrom Coefficients derived from MODIS onAqua (MODISA). For the vicarious gains of the visible bands, twosources for the target water-leaving radiances were tested: matchupsfrom MODISA and climatological data from SeaWiFS. A validation analysis using AERONET-OC data shows an improvement in sensor performance when compared with results using the current vicarious gains and results using no vicarious calibration. Good agreement was found in vicarious gains derived using both concurrent MODISA and climatological SeaWiFS as vicarious calibration data sources. These results support the use of a concurrent sensor for the vicarious calibration when in situ data are not available and demonstrate that using climatology from a well-calibrated sensor like SeaWiFSfor the vicarious calibration is a valid alternative when it is not possible to use a concurrent sensor or in situ data. We recommend using the gains derived from concurrent GOCI matchups with MODISA for GOCI processing in SeaDAS/l2gen.

Concha, Javier↗

Transfer of Satellite Rainfall Uncertainty from Gauged to Ungauged Regions at Regional and Seasonal Timescales

Hydrologists and other users need to know the uncertainty of the satellite rainfall data sets across the range of time/space scales over the whole domain of the data set. Here, uncertainty' refers to the general concept of the deviation' of an estimate from the reference (or ground truth) where the deviation may be defined in multiple ways. This uncertainty information can provide insight to the user on the realistic limits of utility, such as hydrologic predictability, that can be achieved with these satellite rainfall data sets. However, satellite rainfall uncertainty estimation requires ground validation (GV) precipitation data. On the other hand, satellite data will be most useful over regions that lack GV data, for example developing countries. This paper addresses the open issues for developing an appropriate uncertainty transfer scheme that can routinely estimate various uncertainty metrics across the globe by leveraging a combination of spatially-dense GV data and temporally sparse surrogate (or proxy) GV data, such as the Tropical Rainfall Measuring Mission (TRMM) Precipitation Radar and the Global Precipitation Measurement (GPM) mission Dual-Frequency Precipitation Radar. The TRMM Multi-satellite Precipitation Analysis (TMPA) products over the US spanning a record of 6 years are used as a representative example of satellite rainfall. It is shown that there exists a quantifiable spatial structure in the uncertainty of satellite data for spatial interpolation. Probabilistic analysis of sampling offered by the existing constellation of passive microwave sensors indicate that transfer of uncertainty for hydrologic applications may be effective at daily time scales or higher during the GPM era. Finally, a commonly used spatial interpolation technique (kriging), that leverages the spatial correlation of estimation uncertainty, is assessed at climatologic, seasonal, monthly and weekly timescales. It is found that the effectiveness of kriging is sensitive to the type of uncertainty metric, time scale of transfer and the density of GV data within the transfer domain. Transfer accuracy is lowest at weekly timescales with the error doubling from monthly to weekly.However, at very low GV data density (<20% of the domain), the transfer accuracy is too low to show any distinction as a function of the timescale of transfer.

Tang, Ling↗

Development of an Optical Model for the MEDLI2 Radiometer

We present an optical model of the MEDLI2 radiometer, which was flown onboard the Mars 2020 vehicle during atmospheric entry on February 18, 2021. The proposed model takes into account the radiometer geometry and optical phenomena such as reflection, refraction, and absorption to estimate the signal loss inherent in the design of the radiometer. The model serves as a filter, which can be used to convert predicted total radiative heat fluxes on the radiometer window into predicted measured heat fluxes, enabling more accurate comparisons of the radiometer flight data with predicted radiometer measurements. Optical properties of the radiometer’s sapphire window are inferred from spectral transmissivity measurements. A modified Lorentz Oscillator Model is used to represent the dielectric function of the window and is fit to the transmission data. The resulting optical model of the radiometer is validated against experimental data used to measure the dependence of the radiometer output voltage on the incident angle of the light impinging on it. Comparison of predicted radiometer measurements with the MEDLI2 flight data show good agreement between the predicted and measured peak heat fluxes, though offset at different times. A linear increase in the signal loss due to radiometer optics alone is also demonstrated, suggesting that the changing shock angle over the course of the trajectory impacts the signal loss.

MEDLI2↗

NASA EOSDIS 20 Years of Data Usage and User Assessment in Support of Open Science Initiative

NASA EOS Data and Information System (EOSDIS) has been distributing data to world-wide users free with open access. Since the launch of NASA’s Terra satellite in 1999, more than 10,000 distinct EOS data products have been archived and distributed by NASA-funded Earth Science data centers encompassed by the EOSDIS. As of September 30, 2022, more than 90 PB of data archived by EOSDIS have been made available to public users and during FY 2023 over 60 PB have been distributed to public users worldwide. Over these twenty and more years, it has shown significant increase in the distribution of various data products. This has been possible due to free and open access of the data thereby a step towards open science initiative. The purposes of this study are 1) to perform a comprehensive investigation of the archive and distribution patterns of EOSDIS data products for last 20 years, 2) to identify and characterize the global user community for those data, 3) analyze the increased demand for data products, 4) evaluate distribution of higher level products because those are the ones most frequently used in the studies of natural disasters by public users (those data requestors not involved directly in the production or validation of the data products.) and contribute globally to the advance scientific understanding of the Earth-Atmosphere Systems. Funded by the Earth Science Data and Information System (ESDIS) Project, the ESDIS Metrics System (EMS) collects archive, distribution, and user information from EOSDIS data centers. The information (comprising all data products including heritage datasets going back to the 1990s) is stored in a relational database from which it can be analyzed in many ways. We present several metrics analyses that include data distribution patterns for all, as well as the most frequently requested data products; and user characterizations by country, domain, and Earth Science discipline (e.g., Land, Ocean, Cryosphere) of the requested products. Due to the enormous quantity of data handled by EOSDIS data centers and requirements of future data systems to archive increasing amounts of Earth Science data from future and current Earth Science missions effectively, the results of this study can provide insight on how the user communities have accessed the data and provide guidance for open science initiative.

Lalit Wanchoo↗

Advanced Materials for the Lunar Surface: Multiscale Computational Design of Refractory Alloys and Carbides

Emerging operational environments, such as the lunar surface, present novel challenges for NASA and drive the need for advanced materials in applications like fission surface power systems. To address these demands, computational materials science is rapidly evolving to augment or replace costly and hazardous empirical testing. Although materials selection at NASA remains predominantly experimentally driven, advanced simulation methodologies are being steadily integrated into the engineering lifecycle. This work details the application of multiscale simulation techniques—including first-principles calculations, CALPHAD, dislocation dynamics, and molecular dynamics—at NASA's Ames Research Center to evaluate advanced materials for extreme environments. First, we present contributions to the Space Nuclear Propulsion Project. Be-cause propellant channel coatings in nuclear thermal rockets must withstand high-pressure, high-temperature hydro-gen, optimizing these materials is critical. First-principles calculations were employed to establish a rigorous quantitative and qualitative understanding of the behavior of the refractory carbides ZrC, NbC, and their mixtures in high-enthalpy hydrogen environments. This necessitated the generation of high-fidelity thermodynamic models for both stoichiometric and carbon-depleted carbides, both with and without the presence of hydrogen. Furthermore, we highlight efforts under the Refractory Alloy Additive Manufacturing Build Optimization (RAAMBO) project, where existing and novel alloy compositions were assessed for additive manufacturing printability and subsequent performance in applications such as heat pipes and rocket nozzle extensions. This was accomplished through a comprehensive multiscale simulation framework that bridged the gap from the nanometer to the millimeter scale. Across both initiatives, rigorous validation against empirical data was prioritized. By systematically employing a verified and validated computational frame-work, we demonstrate how simulation effectively supports multidisciplinary engineering efforts, builds project-wide confidence, and drives critical materials development.

computational materials↗

An Analysis of Rocket Propulsion Testing Costs

The primary mission at NASA Stennis Space Center (SSC) is rocket propulsion testing. Such testing is generally performed within two arenas: (1) Production testing for certification and acceptance, and (2) Developmental testing for prototype or experimental purposes. The customer base consists of NASA programs, DOD programs, and commercial programs. Resources in place to perform on-site testing include both civil servants and contractor personnel, hardware and software including data acquisition and control, and 6 test stands with a total of 14 test positions/cells. For several business reasons there is the need to augment understanding of the test costs for all the various types of test campaigns. Historical propulsion test data was evaluated and analyzed in many different ways with the intent to find any correlation or statistics that could help produce more reliable and accurate cost estimates and projections. The analytical efforts included timeline trends, statistical curve fitting, average cost per test, cost per test second, test cost timeline, and test cost envelopes. Further, the analytical effort includes examining the test cost from the perspective of thrust level and test article characteristics. Some of the analytical approaches did not produce evidence strong enough for further analysis. Some other analytical approaches yield promising results and are candidates for further development and focused study. Information was organized for into its elements: a Project Profile, Test Cost Timeline, and Cost Envelope. The Project Profile is a snap shot of the project life cycle on a timeline fashion, which includes various statistical analyses. The Test Cost Timeline shows the cumulative average test cost, for each project, at each month where there was test activity. The Test Cost Envelope shows a range of cost for a given number of test(s). The supporting information upon which this study was performed came from diverse sources and thus it was necessary to build several intermediate databases in order to understand, validate, and manipulate data. These intermediate databases (validated historical account of schedule, test activity, and cost) by themselves are of great value and utility. For example, for the Project Profile, we were able to merged schedule, cost, and test activity. This kind of historical account conveys important information about sequence of events, lead time, and opportunities for improvement in future propulsion test projects. The Product Requirement Document (PRD) file is a collection of data extracted from each project PRD (technical characteristics, test requirements, and projection of cost, schedule, and test activity). This information could help expedite the development of future PRD (or equivalent document) on similar projects, and could also, when compared to the actual results, help improve projections around cost and schedule. Also, this file can be sorted by the parameter of interest to perform a visual review of potential common themes or trends. The process of searching, collecting, and validating propulsion test data encountered a lot of difficulties which then led to a set of recommendations for improvement in order to facilitate future data gathering and analysis.

Ramirez-Pagan, Carmen P.↗