Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data base for model validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 307 records · Page 17
All sourcesNASA NTRSDOE OSTI
NASA NTRS2018

A Case Study Comparing Citizen Science Aurora Data with Global Auroral Boundaries Derived from Satellite Imagery and Empirical Models

Aurorasaurus is a citizen science project that offers a new, global data source consisting of ground-based reports of the aurora. For this case study, aurora data collected during the 17-18 March 2015 geomagnetic storm are examined to identify their conjunctions with Defense Meteorological Satellite Program (DMSP) satellite passes over the high latitude auroral regions. This unique set of aurora data can provide ground-truth validation of existing auroral precipitation models. Particularly, the solar wind driven, Oval Variation, Assessment, Tracking, Intensity, and Online Nowcasting (OVATION) Prime 2013 (OP-13) model and a Kp-dependent model of Zhang-Paxton (Z-P) are utilized for our boundary validation efforts. These two similar models are compared for the first time. Global equatorward auroral boundaries are derived from the OP 13 model and the DMSP Special Sensor Ultraviolet Spectrographic Imager (SSUSI) far ultraviolet (FUV) data using the Z-P model at a fixed flux level of 0.2 erg cm(exp -2)s(exp -1). These boundaries are then compared with citizen science reports as well as with each other. Even though there are some large differences between the global boundaries for a few cases, the average difference is about 1.5 deg in geomagnetic latitude, with OP-13 being equatorward of Z-P model. When these boundaries are compared with each other as a function of local time, no clear overall trend as a function of local time was observed. It is also found that the ground based reports are more consistent with the predictions of the OP-13 model.

Kosar, Burcu C.↗
NASA NTRS2009

Validation of Model Forecasts of the Ambient Solar Wind

Independent and automated validation is a vital step in the progression of models from the research community into operational forecasting use. In this paper we describe a program in development at the CCMC to provide just such a comprehensive validation for models of the ambient solar wind in the inner heliosphere. We have built upon previous efforts published in the community, sharpened their definitions, and completed a baseline study. We also provide first results from this program of the comparative performance of the MHD models available at the CCMC against that of the Wang-Sheeley-Arge (WSA) model. An important goal of this effort is to provide a consistent validation to all available models. Clearly exposing the relative strengths and weaknesses of the different models will enable forecasters to craft more reliable ensemble forecasting strategies. Models of the ambient solar wind are developing rapidly as a result of improvements in data supply, numerical techniques, and computing resources. It is anticipated that in the next five to ten years, the MHD based models will supplant semi-empirical potential based models such as the WSA model, as the best available forecast models. We anticipate that this validation effort will track this evolution and so assist policy makers in gauging the value of past and future investment in modeling support.

Macneice, P. J.↗
NASA NTRSDate not supplied

Predicting Fiber Failure of Plain Weave Fabric with Recursive Multiscale Micromechanics

Recent advances in the development of machine learning (ML) algorithms have enabled the creation of predictive models that can improve decision making, decrease computational cost, and improve efficiency in a variety of fields. As an organization begins to develop and implement such models, the data used in the training, validation, and testing of machine learning models, the model parameters, and the use cases or limitations of the models must be properly stored to ensure models are both fully traceable and used correctly. In the context of predicting material behavior, advances in computationally intense, physics-based, modeling of material behavior at various length scales, and the emergence of Integrated Computational Materials Engineering (ICME) have driven the need for developing data-driven surrogate models of the physics-based simulation tools using machine learning (ML) techniques. Surrogate model development allows for accurate material behavior prediction at a fraction of the cost of its physics-based counterpart, allowing for multiscale simulations of real-world applications, further enabling the ability to design fit-for-purpose materials for a reasonable computational investment. However, training such models requires extensive data, and thus effective data management is necessary to reach the full potential that ML can offer to material design and ICME. This paper proposes a generalized, robust schema that allows organizations to store both real (experimental) and virtual (simulation) data used to train machine learning models and the defining model parameters and architectures. The developed schema allows for various types of data inputs and outputs, including single point values, time-series data, and images that can be used in for various types of machine learning models while following outlined best practices for effective data management. An effective schema for machine learning data and models can help prevent the recreation of virtual/real training data and surrogate models, can help reduce the time to create new models similar to existing ones by offering a starting point in the hyperparameter determination stages, minimize resources devoted to verification and validation (V&V) and certification of models, and ensure that data and surrogate models are not misused due to full traceability of both the data and ML model. It also allows organizations access to models that have already been developed, such that they can be used in the design of new materials, enabling the overall goals of ICME.

Failure↗
NASA NTRS2018

New Neural Network Cloud Mask Algorithm Based on Radiative Transfer Simulations

Cloud detection and screening constitute critically important first steps required to derive many satellite data products. Traditional threshold-based cloud mask algorithms require a complicated design process and fine tuning for each sensor, and they have difficulties over areas partially covered with snow/ice. Exploiting advances in machine learning techniques and radiative transfer modeling of coupled environmental systems, we have developed a new, threshold-free cloud mask algorithm based on a neural network classifier driven by extensive radiative transfer simulations. Statistical validation results obtained by using collocated CALIOP and MODIS data show that its performance is consistent over different ecosystems and significantly better than the MODIS Cloud Mask (MOD35 C6) during the winter seasons over snow-covered areas in the mid-latitudes. Simulations using a reduced number of satellite channels also show satisfactory results, indicating its flexibility to be configured for different sensors. Comparedto threshold-based methods and previous machine-learning approaches, this new cloud mask (i) does not rely on thresholds, (ii) needs fewer satellite channels, (iii) has superior performance during winter seasons in mid-latitude areas, and (iv) can easily be applied to different sensors.

cloud mask algorithms↗
NASA NTRS2003

Studies of MGS TES and MPF MET Data

The work supported by this grant was divided into two broad areas: (1) mesoscale modeling of atmospheric circulations and analyses of Pathfinder, Viking, and other Mars data, and (2) analyses of MGS TES temperature data. The mesoscale modeling began with the development of a suitable Mars mesoscale model based upon the terrestrial MM5 model, which was then applied to the simulation of the meteorological observations at the Pathfinder and Viking Lander 1 sites during northern summer. This extended study served a dual purpose: to validate the new mesoscale model with the best of the available in-situ data, and to use the model to aid in the interpretation of the surface meteorological data.

Barnes, Jeff R.↗
NASA NTRS2008

The Development of Point Doppler Velocimeter Data Acquisition and Processing Software

In order to develop efficient and quiet aircraft and validate Computational Fluid Dynamic predications, aerodynamic researchers require flow parameter measurements to characterize flow fields about wind tunnel models and jet flows. A one-component Point Doppler Velocimeter (pDv), a non-intrusive, laser-based instrument, was constructed using a design/develop/test/validate/deploy approach. A primary component of the instrument is software required for system control/management and data collection/reduction. This software along with evaluation algorithms, advanced pDv from a laboratory curiosity to a production level instrument. Simultaneous pDv and pitot probe velocity measurements obtained at the centerline of a flow exiting a two-inch jet, matched within 0.4%. Flow turbulence spectra obtained with pDv and a hot-wire detected the primary and secondary harmonics with equal dynamic range produced by the fan driving the flow. Novel,hardware and software methods were developed, tested and incorporated into the system to eliminate and/or minimize error sources and improve system reliability.

Cavone, Angelo A.↗
NASA NTRS2008

Intelligent Devices - Sensors and Actuators - A KSC Perspective

The primary objective of this workshop is to identify areas of advancement in sensor measurements and technologies that will help to define standard practices and procedures that will better enable the infusion into flight programs of sensors with improved capabilities but limited or no flight heritage. These standards would be crucial to demonstrating a methodology for validating current models while also creating the possibility of being able to have sufficient data to either update these models (e. g., spatial or temporal resolution, etc.) or develop new models based on the ability to simulate the new measured physical parameters. The workshop is also intended to narrow the gap between sensor measurements (and techniques), data processing techniques and the ability to make use of that data by gathering together experts in the field for a short workshop. This collaboration will unite NASA and other government agencies with contractor capabilities industry-wide to prevent duplication, spawn synergistic growth in sensor technology, help analysts make good engineering decisions and help focus new sensor maturation efforts to better meet future flight program customers' needs. This is the first such workshop designed to specifically address establishing a standardized protocol/methodology for demonstrating the technology readiness of non-flight heritage sensor systems. While other similar workshops are held covering many areas of interest to the sensor development community, no other meeting is specific enough to address this vital but often overlooked topic. By encouraging cross-fertilization of ideas from instrument experts from many different backgrounds, it is hoped that this workshop will initiate innovative new ideas and concepts in sensor development, calibration and validation. It is anticipated this workshop will repeat periodically as needed.

Mata, Carlos T.↗
NASA NTRS2018

Quantifying Boreal Forest Structure and Composition Using UAV Structure from Motion

The vast extent and inaccessibility of boreal forest ecosystems are barriers to routine monitoring of forest structure and composition. In this research, we bridge the scale gap between intensive but sparse plot measurements and extensive remote sensing studies by collecting forest inventory variables at the plot scale using an unmanned aerial vehicle (UAV) and a structure from motion (SfM) approach. At 20 Forest Inventory and Analysis (FIA) subplots in interior Alaska, we acquired overlapping imagery and generated dense, 3D, RGB (red, green, blue) point clouds. We used these data to model forest type at the individual crown scale as well as subplot-scale tree density (TD), basal area (BA), and aboveground biomass (AGB). We achieved 85% cross-validation accuracy for five species at the crown level. Classification accuracy was maximized using three variables representing crown height, form, and color. Consistent with previous UAV-based studies, SfM point cloud data generated robust models of TD (r(sup 2) = 0.91), BA (r(sup 2) = 0.79), and AGB (r(sup 2) = 0.92), using a mix of plot- and crown-scale information. Precise estimation of TD required either segment counts or species information to differentiate black spruce from mixed white spruce plots. The accuracy of species-specific estimates of TD, BA, and AGB at the plot scale was somewhat variable, ranging from accurate estimates of black spruce TD (+/−1%) and aspen BA (−2%) to misallocation of aspen AGB (+118%) and white spruce AGB (−50%). These results convey the potential utility of SfM data for forest type discrimination in FIA plots and the remaining challenges to develop classification approaches for species-specific estimates at the plot scale that are more robust to segmentation error.

aboveground biomass↗
NASA NTRS2006

Software Development Cost Estimation Executive Summary

Identify simple fully validated cost models that provide estimation uncertainty with cost estimate. Based on COCOMO variable set. Use machine learning techniques to determine: a) Minimum number of cost drivers required for NASA domain based cost models; b) Minimum number of data records required and c) Estimation Uncertainty. Build a repository of software cost estimation information. Coordinating tool development and data collection with: a) Tasks funded by PA&E Cost Analysis; b) IV&V Effort Estimation Task and c) NASA SEPG activities.

data mining↗
NASA NTRS1986

Flight evaluation of height response characteristics for the hover bob-up task and comparison with proposed criteria

The CH-47B variable-stability helicopter was used to evaluate a range of height-response configurations while performing a precision hover bob-up task. The purpose of the study was to assess the validity of results obtained in previous ground-based and in-flight simulations in the context of a precision bob-up task and to provide additional flight data for inclusion in revisions to specifications for helicopter handling qualities. Height response characteristics were implemented using explicit model-following techniques, and the resulting CH-47B dynamics were validated using time-domain and frequency-domain data-analysis methods. The tests complemented the previous investigations by providing detailed pilot comments and ratings, and performance and control-utilization data that relate exclusively to the hover bob-up task. The results are compared with those from previous investigations and with new criteria that have been proposed for handling qualities requirements for helicopters.

Hindson, W. S.↗
NASA NTRS1987

Spacelab Life Sciences flight experiments: an integrated approach to the study of cardiovascular deconditioning and orthostatic hypotension

The microgravity environment of spaceflight produces rapid cardiovascular changes which are adaptive and appropriate in that setting, but are associated with significant deconditioning and orthostatic hypotension on return to Earth's gravity. The rapidity with which these space flight induced changes appear and disappear provides an ideal model for studying the underlying pathophysiological mechanisms of deconditioning and orthostatic hypotension, regardless of etiology. Since significant deconditioning is seen after flights of very short duration, muscle atrophy due to inactivity plays, at most, a small role. These changes in circulatory control associated with cephalad fluid shifts, rather than inactivity per se, are probably more important factors. In order to test this hypothesis in a systematic way, a multidisciplinary approach which defines and integrates inputs and responses from a wide variety of circulatory sub-systems is required. The cardiovascular experiments selected for Spacelab Life Sciences flights 1 and 2 provide such an approach. Both human and animal models will be utilized. Pre- and post-flight characterization of the payload crew includes determination of maximal exercise capacity (bicycle ergometry), orthostatic tolerance (lower body negative pressure), alpha and beta adrenergic sensitivity (isoproterenol and phenylephrine infusions), baroreflex sensitivity (ECG-gated, stepwise changes in carotid artery transmural pressure with a pneumatic neck collar), and responses to a 24 h period of 5 deg head-down tilt. Measurements of cardiac output (CO2 and C2H2 rebreathing), cardiac chamber dimensions (phased-array 2-dimensional echocardiography), direct central venous pressure, leg volume (Thornton sock), limb blood flow and venous compliance (occlusion plethysmography), blood and plasma volumes, renal plasma flow and glomerular filtration rates, and various hormonal levels including catecholamines and atrial natriuretic factor will also be obtained. The central venous catheter will be inserted immediately pre-launch and monitored with heart rate and blood pressure in-flight until cardiac output, respiratory gas exchange and quantitative 2D echocardiography measurements can be performed. In-flight hemodynamic measurements will be repeated at rest and during submaximal exercise daily and also during maximal exercise midway through the flight to document the timecourse and extent of cardiovascular changes in the payload crew. Parallel studies are planned for the animals. In addition to measurements of right atrial and aortic pressures and cardiac output, a dorsal micro-circulatory chamber will allow determinations of changes in capillary and venular architecture and function in six of the rats. The techniques and findings from many of the SLS-1 and 2 supporting studies have already yielded significant information about circulatory regulation in patients with both hypo- and hypertension. The flight experiments themselves will provide new data to test the validity of both animal and human models currently used for simulating the fluid shifts of a micro-gravity environment. The development of effective countermeasures, not only for short and long duration space travellers, but also for Earth-bound medical patients can then be physiologically based on experimental data rather than anecdote.

Non-NASA Center↗
NASA NTRS2014

Bringing Back the Social Affordances of the Paper Memo to Aerospace Systems Engineering Work

Model-based systems engineering (MBSE) is a relatively new field that brings together the interdisciplinary study of technological components of a project (systems engineering) with a model-based ontology to express the hierarchical and behavioral relationships between the components (computational modeling). Despite the compelling promises of the benefits of MBSE, such as improved communication and productivity due to an underlying language and data model, we observed hesitation to its adoption at the NASA Jet Propulsion Laboratory. To investigate, we conducted a six-month ethnographic field investigation and needs validation with 19 systems engineers. This paper contributes our observations of a generational shift in one of JPL's core technologies. We report on a cultural misunderstanding between communities of practice that bolsters the existing technology drag. Given the high cost of failure, we springboard our observations into a design hypothesis - an intervention that blends the social affordances of the narrative-based work flow with the rich technological advantages of explicit data references and relationships of the model-based approach. We provide a design rationale, and the results of our evaluation.

design↗
NASA NTRS1999

Measuring Tropospheric Winds from Space Using a Coherent Doppler Lidar Technique

The global measurement of tropospheric wind profiles has been cited by the operational meteorological community as the most important missing element in the present and planned observing system. The most practical and economical method for obtaining this measurement is from low earth orbit, utilizing a Doppler lidar (laser radar) technique. Specifically, this paper will describe the coherent Doppler wind lidar (CDWL) technique, the design and progress of a current space flight project to fly such a system on the Space Shuttle, and plans for future flights of similar instruments. The SPARCLE (SPAce Readiness Coherent Lidar Experiment) is a Shuttle-based instrument whose flight is targeted for March, 2001. The objectives of SPARCLE are three-fold: Confirm that the coherent Doppler lidar technique can measure line-of-sight winds to within 1-2 m/s accuracy; Collect data to permit validation and improvement of instrument performance models to enable better design of future missions; and Collect wind and backscatter data for future mission optimization and for atmospheric studies. These objectives reflect the nature of the experiment and its program sponsor, NASA's New Millennium Program. The experiment is a technology validation mission whose primary purpose is to provide a space flight validation of this particular technology. (It should be noted that the CDWL technique has successfully been implemented from ground-based and aircraft-based platforms for a number of years.) Since the conduct of the SPARCLE mission is tied to future decisions on the choice of technology for free-flying, operational missions, the collection of data is intrinsically tied to the validation and improvement of instrument performance models that predict the sensitivity and accuracy of any particular present or future instrument system. The challenges unique to space flight for an instrument such as SPARCLE and follow-ons include: Obtaining the required lidar sensitivity from the long distance of orbit height to the lower atmosphere; Maintaining optical alignments after launch to orbit, and during operations in "microgravity"; Obtaining pointing knowledge of sufficient accuracy to remove the speed of the spacecraft (and the rotating Earth) from the measurements; Providing sufficient power (not a problem on the Shuttle) and cooling to the instrument. The paper will describe the status and challenges of the SPARCLE project, the value of obtaining wind data from orbit, and will present a roadmap to future instruments for scientific research and operational meteorology.

Miller, Timothy L.↗
NASA NTRS2001

Bio-Optical Measurement and Modeling of the California Current and Polar Oceans

This Sensor Intercomparison and Merger for Biological and Interdisciplinary Oceanic Studies (SIMBIOS) project contract supports in situ ocean optical observations in the California Current, Southern Ocean, Indian Ocean as well as merger of other in situ data sets we have collected on various global cruises supported by separate grants or contracts. The principal goals of our research are to validate standard or experimental products through detailed bio-optical and biogeochemical measurements, and to combine ocean optical observations with advanced radiative transfer modeling to contribute to satellite vicarious radiometric calibration and advanced algorithm development. In collaboration with major oceanographic ship-based observation programs funded by various agencies (CalCOFI, US JGOFS, NOAA AMLR, INDOEX and Japan/East Sea) our SIMBIOS effort has resulted in data from diverse bio-optical provinces. For these global deployments we generate a high-quality, methodologically consistent, data set encompassing a wide-range of oceanic conditions. Global data collected in recent years have been integrated with our on-going CalCOFI database and have been used to evaluate Sea-Viewing Wide Field-of-view Sensor (SeaWiFS) algorithms and to carry out validation studies. The combined database we have assembled now comprises more than 700 stations and includes observations for the clearest oligotrophic waters, highly eutrophic blooms, red-tides and coastal case two conditions. The data has been used to validate water-leaving radiance estimated with SeaWiFS as well as bio optical algorithms for chlorophyll pigments. The comprehensive data is utilized for development of experimental algorithms (e.g., high-low latitude pigment transition, phytoplankton absorption, and cDOM).

Mitchell, B. Greg↗
NASA NTRS2001

Onboard autonomy on the Three Corner Sat Mission

Three Corner Sat (3CS) is a mission of three university nanosatellites scheduled for launch on September 2002. The 3CS misison will utilize significan onboard autonomy to perform onboard science data validation and replanning.

scheduling planning resources model based systems↗
NASA NTRS2017

Educational and Scientific Applications of Climate Model Diagnostic Analyzer

Climate Model Diagnostic Analyzer (CMDA) is a web-based information system designed for the climate modeling and model analysis community to analyze climate data from models and observations. CMDA provides tools to diagnostically analyze climate data for model validation and improvement, and to systematically manage analysis provenance for sharing results with other investigators. CMDA utilizes cloud computing resources, multi-threading computing, machine-learning algorithms, web service technologies, and provenance-supporting technologies to address technical challenges that the Earth science modeling and model analysis community faces in evaluating and diagnosing climate models. As CMDA technology and infrastructure have matured, we have developed the educational and scientific applications of CMDA. Educationally, CMDA supported the summer school of the JPL Center for Climate Sciences in 2014, 2015, and 2016. In the summer school, the students work on group research projects where CMDA provide datasets, analysis tools, and provenance support utility tools. Each student is assigned to a virtual machine with CMDA installed in Amazon Web Services. Scientifically, we have developed several science use cases of CMDA covering various topics, datasets, and analysis types. Each of the science use cases is described in terms of a scientific goal, datasets used, the analysis tools used, scientific results discovered, an analysis result such as output plots and data files, and a link to the corresponding analysis service call with all the input arguments filled.

Bao, Qihao↗
NASA NTRS2022

Effective Uncertainty Quantification for Multi-Angle Polarimetric Aerosol Remote Sensing Over Ocean

Multi-angle polarimetric (MAP) measurements can enable detailed characterization of aerosol microphysical and optical properties and improve atmospheric correction in ocean color remote sensing. Advanced retrieval algorithms have been developed to obtain multiple geophysical parameters in the atmosphere–ocean system. Theoretical pixel-wise retrieval uncertainties based on error propagation have been used to quantify retrieval performance and determine the quality of data products. However, standard error propagation techniques in high-dimensional retrievals may not always represent true retrieval errors well due to issues such as local minima and the nonlinear dependence of the forward model on the retrieved parameters near the solution. In this work, we analyze these theoretical uncertainty estimates and validate them using a flexible Monte Carlo approach. The Fast Multi-Angular Polarimetric Ocean coLor (FastMAPOL) retrieval algorithm, based on efficient neural network forward models, is used to conduct the retrievals and uncertainty quantification on both synthetic HARP2 (Hyper-Angular Rainbow Polarimeter 2) and AirHARP (airborne version of HARP2) datasets. In addition, for practical application of the uncertainty evaluation technique in operational data processing, we use the automatic differentiation method to calculate derivatives analytically based on the neural network models. Both the speed and accuracy associated with uncertainty quantification for MAP retrievals are addressed in this study. Pixel-wise retrieval uncertainties are further evaluated for the real AirHARP field campaign data. The uncertainty quantification methods and results can be used to evaluate the quality of data products, as well as guide MAP algorithm development for current and future satellite systems such as NASA’s Plankton, Aerosol, Cloud, ocean Ecosystem (PACE) mission.

PACE↗
NASA NTRS2006

NASA-Langley Web-Based Operational Real-time Cloud Retrieval Products from Geostationary Satellites

At NASA Langley Research Center (LaRC), radiances from multiple satellites are analyzed in near real-time to produce cloud products over many regions on the globe. These data are valuable for many applications such as diagnosing aircraft icing conditions and model validation and assimilation. This paper presents an overview of the multiple products available, summarizes the content of the online database, and details web-based satellite browsers and tools to access satellite imagery and products.

Palikonda, Rabindra↗