Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data base for model validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16

Initial Shuttle external tank flight evaluation

The objective of this paper is to evaluate aerothermal flight measurements made on the Space Shuttle External Tank (ET) during its initial flights. The ETs have been adequately instrumented to measure various quantities during flight including heat transfer, pressure, and structural temperature. The flight data have been compared with mathematical models based on an extensive wind tunnel data base, realistic flowfields, and empirical heat-transfer relationships. An analysis of the results points out the validity of the current aeroheating methodology and existing data base, and identifies problem areas in the methodology as indicated by the flight data.

Praharaj, S. C.↗

Influence of bulk turbulence and entrance boundary layer thickness on the curved duct flow field

The influence of bulk turbulence and boundary layer thickness on the secondary flow development in a square, 90 degree turning duct was investigated. A three-dimensional laser velocimetry system was utilized to measure the mean and fluctuating components of velocity at six cross-planes in the duct. The results from this investigation, with entrance boundary layer thickness of 20 percent, were compared with the thin boundary layer results documented in NASA CR-174811. The axial velocity profiles, cross-flow velocities, and turbulence intensities were compared and evaluated with regard to the influence of bulk turbulence intensity and boundary layer thickness, and the influence was significant. The results of this investigation expand the 90 degree curved duct experimental data base to higher turbulence levels and thicker entrance boundary layers. The experimental results provide a challenging benchmark data base for computational fluid dynamics code development and validation. The variation of inlet bulk turbulence intensity provides additional information to aid in turbulence model evaluation.

Crawford, R. A.↗

Influence of Dust and Black Carbon on the Snow Albedo in the NASA Goddard Earth Observing System Version 5 Land Surface Model

Present-day land surface models rarely account for the influence of both black carbon and dust in the snow on the snow albedo. Snow impurities increase the absorption of incoming shortwave radiation (particularly in the visible bands), whereby they have major consequences for the evolution of snowmelt and life cycles of snowpack. A new parameterization of these snow impurities was included in the catchment-based land surface model used in the National Aeronautics and Space Administration Goddard Earth Observing System version 5. Validation tests against in situ observed data were performed for the winter of 2003.2004 in Sapporo, Japan, for both the new snow albedo parameterization (which explicitly accounts for snow impurities) and the preexisting baseline albedo parameterization (which does not). Validation tests reveal that daily variations of snow depth and snow surface albedo are more realistically simulated with the new parameterization. Reasonable perturbations in the assigned snow impurity concentrations, as inferred from the observational data, produce significant changes in snowpack depth and radiative flux interactions. These findings illustrate the importance of parameterizing the influence of snow impurities on the snow surface albedo for proper simulation of the life cycle of snow cover.

Yasunari, Teppei J.↗

Application of Machine Learning Techniques to Aviation Operations: NASA Case Studies

There is an increasing interest in applying methods based on Machine Learning Techniques(MLT) to problems in aviation operations. The current interest is based on developments in Cloud Computing, the availability of open software and the success of MLT in automation, consumer behavior and finance involving large database. Historically aviation operations have been analyzed using physics-based models and provide information for making operational decisions. This talk describes issues to be addressed in applying either model-driven or data-driven methods. Aviation operations involving many decision makers, multiple objectives, poor or unavailable physics-based models and a rich historical database are prime candidates for analysis using data-driven methods. The issues relating to data, feature selection and validation of the models are illustrated by examining case studies of the application of MLT to problems in air traffic management at NASA. Further research is needed in the application of MLT to critical aviation operations. As always, the best approach depends on the task, the physical understanding of the problem and the quality and quantity of the available data.

Sridhar, Banavar↗

Diagnosis and sensor validation through knowledge of structure and function

The liquid oxygen expert system 'LES' is proposed as the first capable of diagnostic reasoning from sensor data, using model-based knowledge of structure and function to find the expected state of all system objects, including sensors. The approach is generally algorithmic rather than heuristic, and represents uncertainties as sets of possibilities. Functional relationships are inverted to determine hypothetical values for potentially faulty objects, and may include conditional functions not normally considered to have inverses.

Scarl, Ethan A.↗

The Validity Chlorophyll-a Estimation by Sun Induced Fluorescence in Estuarine Waters: An Analysis of Long-term (2003-2011) Water Quality Data from Tampa Bay, Florida (USA)

Satellite observation of phytoplankton concentration or chlorophyll-a is an important characteristic, critically integral to monitoring coastal water quality. However, the optical properties of estuarine and coastal waters are highly variable and complex and pose a great challenge for accurate analysis. Constituents such as suspended solids and dissolved organic matter and the overlapping and uncorrelated absorptions in the blue region of the spectrum renders the blue-green ratio algorithms for estimating chlorophyll-a inaccurate. Measurement of sun-induced chlorophyll fluorescence, on the other hand, which utilizes the near infrared portion of the electromagnetic spectrum, may provide a better estimate of phytoplankton concentrations. While modelling and laboratory studies have illustrated both the utility and limitations of satellite baseline algorithms based on the sun induced chlorophyll fluorescence signal, few have examined the empirical validity of these algorithms using a comprehensive long term in situ data set. In an unprecedented analysis of a long term (2003-2011) in situ monitoring data from Tampa Bay, Florida (USA), we assess the validity of the FLH product from the Moderate Resolution Imaging Spectrometer (MODIS) against chlorophyll ]a and a suite of water quality parameters taken in a variety of conditions throughout a large optically complex estuarine system. A systematic analysis of sampling sites throughout the bay is undertaken to understand how the relationship between FLH and in situ chlorophyll-a responds to varying conditions within the estuary including water depth, distance from shore and structures and eight water quality parameters. From the 39 station for which data was derived, 22 stations showed significant correlations when the FLH product was matched with in situ chlorophyll-alpha data. The correlations (r2) for individual stations within Tampa Bay ranged between 0.67 (n=28, pless than 0.01) and-0.457 (n=12, p=.016), indicating that for some areas within the Bay, FLH can be a good predictor of chlorophyll-alpha concentration and hence a useful tool for the analysis of water quality. Overall, the results show a 106% increase in the validity of chlorophyll -a concentration estimates using FLH over the standard the blue-green OC3M algorithm. This analysis also illustrates that the correlations between FLH and in situ chlorophyll -a measurements increases with increasing water depth and distance of the monitoring sites from both the shore and structures. However, due to confounding factors related to the complexity of the estuarine system, a linear improvement in the FLH to chlorophyll ]a relationship was not clearly noted with increasing depth and distance from shore alone. Correlations of FLH with turbidity, nutrients (total nitrogen and total phosphorous) biological oxygen demand, salinity, sea surface temperature correlated positively with FLH concentrations, while dissolved oxygen and pH showed negative correlations. Principle component analyses are employed to further describe the relationships between the multivariate water quality parameters and the FLH product. The majority of sites with higher and very significant correlations (pless than 0.01) also showed high correlation values for nutrients, turbidity and biological oxygen demand. These sites were on average in greater than seven meters of water and over five kilometers from shore. A thorough understanding of the relationship between the MODIS FLH product and in situ water quality parameters will enhance our understanding of the accuracy MODIS fs global FLH algorithm and assist in optimizing its calibration for use in monitoring the quality of estuarine and coastal waters worldwide.

Moreno-Madrinan, Max Jacobo↗

Validation of Image-Based Neural Network Controllersthrough Adaptive Stress Testing

Neural networks have become state-of-the-art for computer vision problems because of their ability to efficiently model complex functions from large amounts of data. While neural networks can be shown to perform well empirically fora variety of tasks, their performance is difficult to guarantee.Neural network verification tools have been developed that can certify robustness with respect to a given input image; however,for neural network systems used in closed-loop controllers,robustness with respect to individual images does not address multi-step properties of the neural network controller and itsenvironment. Furthermore, neural network systems interacting in the physical world and using natural images are operating in a black-box environment, making formal verification in-tractable. This work combines the adaptive stress testing (AST)framework with neural network verification tools to search for the most likely sequence of image disturbances that cause the neural network controlled system to reach a failure. Anautonomous aircraft taxi application is presented, and results show that the AST method finds failures with more likely image disturbances than baseline methods. Further analysis of AST results revealed an explainable cause of the failure, giving insight into the problematic scenarios that should be addressed.

Adaptive Stress Testing, Marabou, Deep Neural Netw↗

NASA HECC Geometry and Performance Review Part 1: Validation of a Computational Model for the Vaneless Diffuser Configuration with As-Manufactured Impeller Geometry

An investigation of the NASA High Efficiency Centrifugal Compressor (HECC) vaneless diffuser configuration was performed. This multipart investigation presents an extensive validation of the computational model against experimental data. The validated model was then used to explore the effects geometric differences between the as-manufactured and design-intent impellers. Lastly, the validated model was used for comparison against an experimental tip clearance study. Part I of the investigation focused on describing the HECC vaneless computational model and its validation against the experimental data published in GT2023-103128. To generate the model, a verification of the manufactured impeller was performed and was confirmed to match the impeller CAD. Section data from the impeller CAD, referred to as the As-Manufactured geometry, were used for development of the computational model. Steady RANS simulations utilizing the Wilcox K-Omega 98 turbulence model and a multiblock structured mesh were used to conduct a mesh convergence study. The resultant mesh was then used for simulations at both design-speed and off-design speed conditions. The simulations compared well to data in both 1D and 2D terms for the major performance metrics of efficiency, total pressure rise, and total temperature rise. Based on the observed results the model was deemed validated and was used in the latter two parts of the multipart investigation.

centrifugal compressor↗

Independent Verification of Mars-GRAM 2010 with Mars Climate Sounder Data

The Mars Global Reference Atmospheric Model (Mars-GRAM) is an engineering-level atmospheric model widely used for diverse mission and engineering applications. Applications of Mars-GRAM include systems design, performance analysis, and operations planning for aerobraking, entry, descent and landing, and aerocapture. Atmospheric influences on landing site selection and long-term mission conceptualization and development can also be addressed utilizing Mars-GRAM. Mars-GRAM's perturbation modeling capability is commonly used, in a Monte Carlo mode, to perform high-fidelity engineering end-to-end simulations for entry, descent, and landing. Mars-GRAM is an evolving software package resulting in improved accuracy and additional features. Mars-GRAM 2005 has been validated against Radio Science data, and both nadir and limb data from the Thermal Emission Spectrometer (TES). From the surface to 80 km altitude, Mars-GRAM is based on the NASA Ames Mars General Circulation Model (MGCM). Above 80 km, Mars-GRAM is based on the University of Michigan Mars Thermospheric General Circulation Model (MTGCM). The most recent release of Mars-GRAM 2010 includes an update to Fortran 90/95 and the addition of adjustment factors. These adjustment factors are applied to the input data from the MGCM and the MTGCM for the mapping year 0 user-controlled dust case. The adjustment factors are expressed as a function of height (z), latitude and areocentric solar longitude (Ls).

Justh, Hilary L.↗

Advancing Solar Energetic Particle Forecasting

With growing interest from the aviation and satellite industries, and for NASA’s upcoming Artemis lunar missions, the need for improved scientific understanding and accurate forecasting of solar energetic particle events has never been stronger. In this paper we discuss the observational, validation and model transition support required to achieve these goals. Well-calibrated, high-quality energetic electron, proton, and ion measurements are essential. Expansions to the fields of view offered by current X-ray, extreme ultraviolet and coronagraph instruments, to obtain increased coverage of the solar corona and heliosphere, from vantage points off the Sun-Earth line, are desired for model input. New observations of suprathermal particles are needed to characterize seed particle distributions and low latency space-based observations of solar radio emissions are also desired. Together, this observational suite should offer high cadence, low latency, reliable and accurate space weather data streams. Consistent, extensive and quantitative model validation is required to assess scientific advancements and pave the way for models transitioning to real-time forecast operations. Model performance and skill should be compared to observations and to current operational forecasting baselines. Finally, resources are required to support the significant effort of transitioning mature models into forecast operations.

solar energetic particles↗

A Robust Machine Learning Schema for Developing, Maintaining, and Disseminating Machine Learning Models

Recent advances in the development of machine learning (ML) algorithms have enabled the creation of predictive models that can improve decision making, decrease computational cost, and improve efficiency in a variety of fields. As an organization begins to develop and implement such models, the data used in the training, validation, and testing of ML models, the model parameters, and the use cases or limitations of the models must be properly stored to ensure models are both fully traceable and used correctly. In the context of predicting material behavior, advances in computationally intense, physics-based modeling of material behavior at various length scales and the emergence of Integrated Computational Materials Engineering (ICME) have driven the need for developing data-driven surrogate models of the physics-based simulation tools using ML techniques. Surrogate model development allows for accurate material behavior prediction at a fraction of the cost of its physics-based counterpart, allowing for multiscale simulations of real-world applications, further enabling the ability to design fit-for-purpose materials for a reasonable computational investment. However, training such models requires extensive data, and thus, effective data management is necessary to reach the full potential that ML can offer to material design and ICME. This paper proposes a generalized, robust schema that allows organizations to store both real (experimental) and virtual (simulation) data used to train ML models and the defining model parameters and architectures within the Granta MI Platform. The developed schema allows for various types of data inputs and outputs, including single point values, time-series data, and images that can be used in the prediction of material behavior, while following outlined best practices for effective data management. An effective schema for ML data and models can help prevent the recreation of virtual/real training data and surrogate models, help reduce the time to create new models similar to existing ones by offering a starting point in the hyperparameter determination stages, minimize resources devoted to verification and validation (V&V) and certification of models, and ensure that data and surrogate models are not misused due to full traceability of both the data and ML model. It also allows organizations access to models that have already been developed, such that they can be used in the design of new materials, enabling the overall goals of ICME.

Brandon L. Hearley↗

Use of High-Resolution WRF Simulations to Forecast Lightning Threat

Recent observational studies have confirmed the existence of a robust statistical relationship between lightning flash rates and the amount of large precipitating ice hydrometeors aloft in storms. This relationship is exploited, in conjunction with the capabilities of cloud-resolving forecast models such as WRF, to forecast explicitly the threat of lightning from convective storms using selected output fields from the model forecasts. The simulated vertical flux of graupel at -15C and the shape of the simulated reflectivity profile are tested in this study as proxies for charge separation processes and their associated lightning risk. Our lightning forecast method differs from others in that it is entirely based on high-resolution simulation output, without reliance on any climatological data. short [6-8 h) simulations are conducted for a number of case studies for which three-dmmensional lightning validation data from the North Alabama Lightning Mapping Array are available. Experiments indicate that initialization of the WRF model on a 2 km grid using Eta boundary conditions, Doppler radar radial velocity fields, and METAR and ACARS data y&eld satisfactory simulations. __nalyses of the lightning threat fields suggests that both the graupel flux and reflectivity profile approaches, when properly calibrated, can yield reasonable lightning threat forecasts, although an ensemble approach is probably desirable in order to reduce the tendency for misplacement of modeled storms to hurt the accuracy of the forecasts. Our lightning threat forecasts are also compared to other more traditional means of forecasting thunderstorms, such as those based on inspection of the convective available potential energy field.

McCaul, E. W., Jr.↗

Mathematical model of the SH-3G helicopter

A mathematical model of the Sikorsky SH-3G helicopter based on classical nonlinear, quasi-steady rotor theory was developed. The model was validated statically and dynamically by comparison with Navy flight-test data. The model incorporates ad hoc revisions which address the ideal assumptions of classical rotor theory and improve the static trim characteristics to provide a more realistic simulation, while retaining the simplicity of the classical model.

Phillips, J. D.↗

Improved inhalation technology for setting safe exposure levels for workplace chemicals

Threshold Limit Values recommended as allowable air concentrations of a chemical in the workplace are often based upon a no-observable-effect-level (NOEL) determined by experimental inhalation studies using rodents. A 'safe level' for human exposure must then be estimated by the use of generalized safety factors in attempts to extrapolate from experimental rodents to man. The recent development of chemical-specific physiologically-based toxicokinetics makes use of measured physiological, biochemical, and metabolic parameters to construct a validated model that is able to 'scale-up' rodent response data to predict the behavior of the chemical in man. This procedure is made possible by recent advances in personal computer software and the emergence of appropriate biological data, and provides an analytical tool for much more reliable risk evaluation and airborne chemical exposure level setting for humans.

Stuart, Bruce O.↗

Comparison of Organ Dose and Dose Equivalent Using Ray Tracing of Male and Female Voxel Phantoms to Space Flight Phantom Torso Data

Phantom torso experiments have been flown on the space shuttle and International Space Station (ISS) providing validation data for radiation transport models of organ dose and dose equivalents. We describe results for space radiation organ doses using a new human geometry model based on detailed Voxel phantoms models denoted for males and females as MAX (Male Adult voXel) and Fax (Female Adult voXel), respectively. These models represent the human body with much higher fidelity than the CAMERA model currently used at NASA. The MAX and FAX models were implemented for the evaluation of directional body shielding mass for over 1500 target points of major organs. Radiation exposure to solar particle events (SPE), trapped protons, and galactic cosmic rays (GCR) were assessed at each specific site in the human body by coupling space radiation transport models with the detailed body shielding mass of MAX/FAX phantom. The development of multiple-point body-shielding distributions at each organ site made it possible to estimate the mean and variance of space dose equivalents at the specific organ. For the estimate of doses to the blood forming organs (BFOs), active marrow distributions in adult were accounted at bone marrow sites over the human body. We compared the current model results to space shuttle and ISS phantom torso experiments and to calculations using the CAMERA model.

Kim, Myung-Hee Y.↗

Exploring the Limits of High Altitude GPS for Future Lunar Missions

An increasing number of spacecraft are relying on the Global Positioning System (GPS) for navigation at altitudes near or above the GPS constellation itself - the region known as the Space Service Volume (SSV). While the formal definition of the SSV ends at geostationary altitude, the practical limit of high-altitude space usage is not known, and recent missions have demonstrated that signal availability is sufficient for operational navigation at altitudes halfway to the moon. This paper presents simulation results based on a high-fidelity model of the GPS constellation, calibrated and validated through comparisons of simulated GPS signal availability and strength with flight data from recent high-altitude missions including the Geostationary Operational Environmental Satellite 16 (GOES-16) and the Magnetospheric Multiscale (MMS) mission. This improved model is applied to the transfer to a lunar near-rectilinear halo orbit (NRHO) of the class being considered for the international Deep Space Gateway concept. The number of GPS signals visible and their received signal strengths are presented as a function of receiver altitude in order to explore the practical upper limit of high-altitude space usage of GPS.

Deep Spac↗

Exploring the Limits of High Altitude GPS for Future Lunar Missions

An increasing number of spacecraft are relying on the Global Positioning System (GPS) for navigation at altitudes near or above the GPS constellation itself - the region known as the Space Service Volume (SSV). While the formal definition of the SSV ends at geostationary altitude, the practical limit of high-altitude space usage is not known, and recent missions have demonstrated that signal availability is sufficient for operational navigation at altitudes halfway to the moon. This paper presents simulation results based on a high-fidelity model of the GPS constellation, calibrated and validated through comparisons of simulated GPS signal availability and strength with flight data from recent high-altitude missions including the Geostationary Operational Environmental Satellite 16 (GOES-16) and the Magnetospheric Multiscale (MMS) mission. This improved model is applied to the transfer to a lunar near-rectilinear halo orbit (NRHO) of the class being con- sidered for the international Deep Space Gateway concept. The number of GPS signals visible and their received signal strengths are presented as a function of receiver altitude in order to explore the practical upper limit of high-altitude space usage of GPS.

Deep Spac↗

Physics-Based Retrieval of Surface Roughness Parameters for Bare Soils from Combined Active-Passive Microwave Signatures

In the past the effect of soil roughness was often considered secondary within the determination of soil moisture from remote sensing data. Several studies showed that accurate determination of soil roughness leads to an improved estimation of soil moisture. Two default parameters to describe the surface roughness are the standard deviation of the surface height variation 𝑠 and the surface correlation length 𝑙 with its corresponding autocorrelation function. Both parameters (𝑠,𝑙) affect the emissivity measured by radiometers as well as the backscattering observed by radars. In this study, we develop a physics-based approach to retrieve 𝑠 and 𝑙 by combining both microwave signals based on active-passive microwave covariation. To test the approach, containing a forward model and a retrieval algorithm, we used active/passive microwave data measured with the ComRAD truck-based SMAP simulator at L-band. Results and validations with corresponding field measurements on ground show that 𝑠 and 𝑙 can be estimated simultaneously when using this approach. The physics-based retrieval algorithm works robustly for two investigated test fields having an RMS-Error of 0.68 cm and 0.69 cm between the microwave-based and field-measured 𝑠-values, and of 3.13 cm and 3.04 cm for 𝑙-values. The first validation of the results reveals that the influence of the autocorrelation function, needed within the retrieval, is distinct.

correlation length↗