Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Verification of data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 361 records · Page 20

Advancing Aircraft Operations in a Net-Centric Environment with the Incorporation of Increasingly Autonomous Systems and Human Teaming

NextGen has begun the modernization of the nation’s air transportation system, with goals to improve system safety, increase operation efficiency and capacity, provide enhanced predictability, resilience and robustness. With these improvements, NextGen is poised to handle significant increases in air traffic operations, more than twice the number recorded in 2016, by 2025.1 NextGen is evolving toward collaborative decision-making across many agents, including automation, by use of a Net-Centric architecture, which in itself creates a very complex environment in which the navigation and operation of aircraft are to take place. An intricate environment such as this, coupled with the expected upsurge of air traffic operations generates concern respecting the ability of the human-agent to both fly and manage aircraft within. Therefore, it is both necessary and practical to begin the process of increasingly autonomous systems within the cockpit that will act independently to assist the human-agent achieve the overall goal of NextGen. However, the straightforward technological development and implementation of intelligent machines into the cockpit is only part of what is necessary to maintain, at minimum, or improve human-agent functionality, as desired, while operating in NextGen. The full integration of Increasingly Autonomous Systems (IAS) within the cockpit can only be accomplished when the IAS works in concert with the human, formulating trust between the two, thereby establishing a team atmosphere. Imperative to cockpit implementation is ensuring the proper performance of the IAS by the development team and the human-agent with which it will be paired when given a specific piloting, navigation, or observational task. Described in this paper are the steps taken, at NASA Langley Research Center, during the second and third phases of the development of an IAS, the Traffic Data Manager (TDM), its verification and validation by human-agents, and the foundational development of Human Autonomy Teaming (HAT) between the two.

Houston, Vincent E.↗

NASA Advanced Composites Project

The recently-completed NASA Advanced Composites Project (ACP) successfully developed several new technologies aimed at reducing the timeline to design and certify composite aircraft structures. Advancements in the areas of manufacturing simulation, nondestructive inspection and advanced structural design and analysis methodologies were completed in late 2019 under the Advanced Composites Consortium (ACC) public/private partnership as well as NRA-funded university contracts. In the area of Structures, the ACC made significant improvements in rapid design tools for preliminary sizing of structure, along with developing detailed static and fatigue strength prediction methods and methods for modeling high energy impact events in composite structures. These new methodologies and toolsets were validated against a range of representative test data using a comprehensive verification and validation approach which has been published and is now used extensively on other programs. Specific new tool improvements supported by ACC include NASA’s CompDam code and Floating Node Method code. CompDam is now available from NASA as open source code. The team alsoworked on improved impact modeling using LS-Dyna™ and improved delamination modeling using Abaqus™. Rapid design tool improvements are available through Hypersizer. The ACC team released well over 50 publications documenting these method improvements, and the ACP recently received the prestigious NASA Group Achievement Award for their work.Typical Hat Stiffened Panel Test Article Used for Method Validation

ACC↗

Impact of GPM-retrieved surface meteorology condition on simulations of two winter storms during ICE-POP 2018

Led by the KMA as a component of the WMO's World Weather Research Program (WWRP) Research and Development and Forecast Demonstration Projects (RDP/FDP). Taken place during the Winter Olympics (February-March) of 2018. Goals of ICE-POP: To improve understanding on severe weathers (snowfalls, visibility, rapid wind changes and gusts,) over complex terrain; To improve the predictability of nowcasting and very-short range forecasting with a few kilometer horizontal resolution - Development of NWP-based nowcasting, multi-scale data assimilation and time-lagged ensemble for VSRF, and radar reflectivity and visibility data assimilation; To improve verification for high resolution model considering complex terrain.

Xuanli Li↗

Toward Design Assurance of Machine-Learning Airborne Systems

In recent years, Artificial Intelligence (AI) systems, enabled by Machine Learning (ML)technology, have demonstrated impressive progress and provides historic opportunities for the aviation industry. However, several key aspects of ML technology are not compatible with existing design assurance standards and make certification problematic. In this paper, we present a case study of a visual system with a Deep Neural Network (DNN) intended to detect and identify airport runway signs. Different use cases and variants of this system exhibit different levels of criticality ranging from design assurance level (DAL) D to B. We use the case study to illustrate the challenges of certification according to the current standards, such asDO-178C. We present the system design, data generation, training, and verification in detail and describe how the design assurance objectives can be met for a DAL D variant of the system. We also discuss gaps and potential approaches for the higher design assurance levels.

Avionics↗

Machine-Learning for Safety Critical Airborne Applications Part II: Case Study

The exceptional progress in the field of Artificial Intelligence (AI) systems, enabled by Machine Learning (ML) technology in recent years provides historic opportunities for the aviation industry. Current certification standards for avionics were developed prior to the ML renaissance and have several fundamental incompatibilities with the ML technology. WG-114 is working hard to release a new standard as soon as possible but for now there is no recognized means of compliance for ML based systems even of low criticality. In this talk, we present the custom ML workflow that can be used comply with all objectives of the current certification standards for a low-criticality (DAL D and C) ML-based system. To illustrate the practical application of the custom ML workflow we present a case study of a system based on a Deep Neural Network (DNN) intended to detect and identify airport runway signs. We present the system design, data generation, training, and verification in detail and describe how the design assurance objectives can be met for a DAL D and DAL C systems.

Johann Schumann↗

NASA GeneLab RNASeq Consensus Pipeline: A Nextflow Implementation

The NASA GeneLab project (genelab.nasa.gov) seeks to accelerate space biology research through cataloging and democratizing omics data. Since raw omics data is largely inaccessible to non-bioinformaticians, GeneLab works with the scientific community to develop standard processing pipelines to generate and publish processed data. Unlike raw data, processed data has greater immediate value to a wide range of users with varying technical backgrounds and computational capabilities. Standardizing processing workflows is essential to match the pace of raw data generation, ensure reproducibility, and enable standardized processed data for comparison across datasets. Previously, GeneLab developed a standardized pipeline for processing RNAseq data, referred to as the ‘GeneLab RNAseq Consensus Pipeline (RCP)’, in collaboration with GeneLab’s Analysis Working Groups. The work presented here is a Nextflow implementation of GeneLab’s RCP that automates and accelerates data processing of RNASeq datasets hosted on GeneLab. In addition to the core data processing, the workflow also includes staging of GeneLab raw data and a robust verification and validation (V&V) program that runs after each processing step to identify errors in real-time, stop additional downstream computation, and preserve computational resources. The workflow, including the staging and V&V functionality, is open source for others to reuse and modify at https://github.com/nasa/GeneLab_Data_Processing/tree/master/RNAseq.

Jonathan Dejesus Oribello↗

NASA GeneLab RNASeq Consensus Pipeline: A Nextflow Implementation

The NASA GeneLab project (genelab.nasa.gov) seeks to accelerate space biology research through cataloging and democratizing omics data. Since raw omics data is largely inaccessible to non-bioinformaticians, GeneLab works with the scientific community to develop standard processing pipelines to generate and publish processed data. Unlike raw data, processed data has greater immediate value to a wide range of users with varying technical backgrounds and computational capabilities. Standardizing processing workflows is essential to match the pace of raw data generation, ensure reproducibility, and enable standardized processed data for comparison across datasets. Previously, GeneLab developed a standardized pipeline for processing RNAseq data, referred to as the ‘GeneLab RNAseq Consensus Pipeline (RCP)’, in collaboration with GeneLab’s Analysis Working Groups. The work presented here is a Nextflow implementation of GeneLab’s RCP that automates and accelerates data processing of RNASeq datasets hosted on GeneLab. In addition to the core data processing, the workflow also includes staging of GeneLab raw data and a robust verification and validation (V&V) program that runs after each processing step to identify errors in real-time, stop additional downstream computation, and preserve computational resources. The workflow, including the staging and V&V functionality, is open source for others to reuse and modify at https://github.com/nasa/GeneLab_Data_Processing/tree/master/RNAseq.

Jonathan D Oribello↗

X-57 Cockpit Display System Development and Features

The X-57 Maxwell airplane [1,2] cockpit display system includes multiple, pilot-selectable pages in a multifunction display with detailed statuses of critical parameters from each of the cruise motors (CMs), cruise motor controllers (CMCs), and battery control modules (BCMs), as well as air temperature measurements at reference locations in the passive ram-air cooling ducts for the motors, controllers, and auxiliary equipment. The user (pilot or ground-test crew) can select overview pages that are part of the standard instrument panel scan pattern or switch to a series of detail or debug pages as the system is operating using a rotary position switch in the cockpit. This paper presents and describes each of these displays, and gives an overview of the development and verification process. The critical data condensed for cockpit handling from each of the major electric propulsion and traction power systems are discussed.

Adam Curry↗

Material Characterization and Modeling of Room Temperature Vulcanizing Silicone

Room Temperature Vulcanizing silicone (RTV) is a high-temperature adhesive that has successfully been used as a gap-filler between Thermal Protection System (TPS) tiles for heatshields on numerous missions. It is also used to bond instrumentation plugs such as temperature and pressure sensors into the heatshields. While RTV has been traditionally assumed to be a non-porous and non-ablating material, numerous experiments have shown that RTV pyrolyzes and becomes highly porous as it is heated. Heating RTV has also shown swelling, or intumescence, which can pose unique problems that lead to roughness induced boundary-layer transition, surface oxide formation and contamination of heat shield sensors. Therefore, it is crucial to understand and model the intumescence phenomenon of RTV. As data for RTV material properties is limited, the first step in modeling RTV is to collect material properties such as pyrolysis mass-loss, microstructure change, virgin and char porosity, etc. which was performed in our initial study. Additionally, thermomechanical properties such as Young’s modulus and Poisson ratio are required for modeling the intumescence of RTV, which were taken from literature and the coefficient of thermal expansion was collected using in-situ heating and Micro Computed Tomography (µ-CT) in previous studies. Finally, numerous other properties such as pyrolysis gas properties, virgin and char thermal conductivity and specific heat were compiled from previous experiments and literature into a material database that can be used for simulations. In Porous Material Analysis Toolbox based on OpenFOAM (PATO) [4], structural mechanics coupled with material response was used for simulating the intumescence of RTV as it is heated. However, since the permeability of the material is very low, the pyrolysis gas creates an internal pressure build-up as the material is being heated, significantly contributing to the deformation of the material. To correctly characterize this phenomenon, additional physics models were implemented into PATO's stress analysis solver, and results were compared with RTV dilatometry test data as a preliminary verification case. Future work will include experiments of RTV at the Plasmatron X facility and the in-situ heating cell with µ-CT, and improvement of simulation tools to more accurately model RTV intumescence.

TPS↗

Material Properties and Modeling of Room Temperature Vulcanizing Silicone

Room Temperature Vulcanizing silicone (RTV) is a high-temperature adhesive that has successfully been used as a gap-filler between Thermal Protection System (TPS) tiles for heatshields on numerous missions. It is also used to bond instrumentation plugs such as temperature and pressure sensors into the heatshields. While RTV has been traditionally assumed to be a non-porous and non-ablating material, numerous experiments have shown that RTV pyrolyzes and becomes highly porous as it is heated. Heating RTV has also shown swelling, or intumescence, which can pose unique problems that lead to roughness induced boundary-layer transition, surface oxide formation and contamination of heat shield sensors. Therefore, it is crucial to understand and model the intumescence phenomenon of RTV. As data for RTV material properties is limited, the first step in modeling RTV is to collect material properties such as pyrolysis mass-loss, microstructure change, virgin and char porosity, etc. which was performed in our initial study. Additionally, thermomechanical properties such as Young’s modulus and Poisson ratio are required for modeling the intumescence of RTV, which were taken from literature and the coefficient of thermal expansion was collected using in-situ heating and Micro Computed Tomography (µ-CT) in previous studies. Finally, numerous other properties such as pyrolysis gas properties, virgin and char thermal conductivity and specific heat were compiled from previous experiments and literature into a material database that can be used for simulations. In Porous Material Analysis Toolbox based on OpenFOAM (PATO) [4], structural mechanics coupled with material response was used for simulating the intumescence of RTV as it is heated. However, since the permeability of the material is very low, the pyrolysis gas creates an internal pressure build-up as the material is being heated, significantly contributing to the deformation of the material. To correctly characterize this phenomenon, additional physics models were implemented into PATO's stress analysis solver, and results were compared with RTV dilatometry test data as a preliminary verification case. Future work will include experiments of RTV at the Plasmatron X facility and the in-situ heating cell with µ-CT, and improvement of simulation tools to more accurately model RTV intumescence.

PATO↗

Plumes and Blooms: Observations, Analysis and Modeling for SIMBIOS

The goal of the Plumes and Blooms (PnB) project is to develop, validate and apply to imagery state-of-theart ocean color algorithms for quantifying sediment plumes and phytoplankton blooms for the Case I1 environment of the Santa Barbara Channel. We conduct monthly to twice-monthly transect observations across the Santa Barbara Channel to develop an algorithm development and product validation data set. The PnB field program started in the summer of 1996. At each of the 7 PnB stations, a complete verification bio-geo-optical data set is collected. Included are redundant measures of apparent optical properties (remote sensing reflectance and diffuse attenuation spectra), as well as in situ profiles of spectral absorption, beam attenuation and backscattering coefficients. Water samples are analyzed for component in vivo absorption spectra, fluorometric chlorophyll, phytoplankton pigment (by the SDSU CHORS laboratory), and inorganic nutrient concentrations (Table 1). A primary goal is to use the PnB field data set to objectively tune semi-analytical models of ocean color for this site and apply them using available satellite imagery (SeaWiFS and MODIS). In support of this goal, we have also been addressing SeaWiFS ocean color and AVHRR SST imagery (Otero and Siegel, 2003). We also are using the PnB data set to address time/space variability of water masses in the Santa Barbara Channel and its relationship to the 1997/1998 El Niiio. However, the comparison between PnB field observations and satellite estimates of primary products has been disappointing. We find that field estimates of water-leaving radiance, LwN(h), correspond poorly to satellite estimates for both SeaWiFS and MODIS local area coverage imagery. We believe this is due to poor atmospheric correction due to complex mixtures of aerosol types found in these near-coastal regions. Last, we remain active in outreach activities.

Siegel, D. A.↗

Plumes and Blooms: Modeling the Case II Waters of the Santa Barbara Channel

The goal of the Plumes and Blooms (PnB) project is to develop, validate and apply to imagery state-of-the-art ocean color algorithms for quantifying sediment plumes and phytoplankton blooms for the Case II environment of the Santa Barbara Channel. We conduct monthly to twice-monthly transect observations across the Santa Barbara Channel to develop an algorithm development and product validation data set. The PnB field program started in the summer of 1996. At each of the 7 PnB stations, a complete verification bio-geo-optical data set is collected. Included are redundant measures of apparent optical properties (remote sensing reflectance and diffuse attenuation spectra), as well as in situ profiles of spectral absorption, beam attenuation and backscattering coefficients. Water samples are analyzed for component in vivo absorption spectra, fluorometric chlorophyll, phytoplankton pigment (by the SDSU CHORS laboratory), and inorganic nutrient concentrations. A primary goal is to use the PnB field data set to objectively tune semi-analytical models of ocean color for this site and apply them using available satellite imagery (SeaWiFS and MODIS). In support of this goal, we have also been addressing SeaWiFS ocean color and AVHRR SST imagery. We also are using the PnB data set to address time/space variability of water masses in the Santa Barbara Channel and its relationship to the 1997/1998 El Nino. However, the comparison between PnB field observations and satellite estimates of primary products has been disappointing. We find that field estimates of water-leaving radiance, L(sub wN)(lambda), correspond poorly to satellite estimates for both SeaWiFS and MODIS local area coverage imagery. We believe this is due to poor atmospheric correction due to complex mixtures of aerosol types found in these near-coastal regions. Last, we remain active in outreach activities.

Siegel, D. A.↗

Aerodynamics of thrust vectoring by Navier-Stokes solutions

Induced aerodynamics from thrust vectoring are investigated by a computational fluid dynamic method. A thin-layer Reynolds-averaged Navier-Stokes code with multiblock capability is used. Jet properties are specified on the nozzle exit plane to simulate the jet momentum. Results for a rectangular jet in a cross flow are compared with data to verify the code. Further verification of the calculation is made by comparing the numerical results with transonic data for a wing-body combination. Additional calculations were performed to elucidate the following thrust vectoring effects: the thrust vectoring effect on shock and expansion waves, induced effects on nearby surfaces, and the thrust vectoring effect on the leading edge vortex.

Tseng, Jing-Biau↗

Four-Dimensional Oceanic and Atmosperic Data Assimilation with Tropical Rainfall Measuring Mission Data

An oceanic data assimilation system which allows to utilize the forthcoming Tropical Rainfall Measuring Mission (TRMM) data has been developed and applied to the Pacific Ocean to produce the velocity field. The assimilated data will be indispensable to examine the effects of rainfall and its variability on the structure and circulation of the tropical oceans and to assess the impact of global warming due to the increase of carbon dioxide on the ocean circulation system and the marine pollution caused by oil spill and ocean damping of radionuclide. The data will also provide the verification for the oceanic and ocean-atmosphere coupled General Circulation Models (GCM's). The system consists of oceanic GCM, analysis scheme and data. In the system the flow field has been determined to be physically consistent with the observed density field and the sea surface winds derived from the Special Sensor Microwave Imagery (SSM/I) data which drive the ocean current. The time integration has been performed for five years until the flow field near the surface attained the steady state starting from the rest ocean with observed temperature and salinity fields, and the SSM/I surface wind velocity. The resultant flow field showed high producibility of the system. Especially the flow near the ocean surface agreed well with available observed data. The system, for the first time, succeeded to produce the eastward subtropical current which has been discovered in the joint investigation on Kuroshio current (CSK) in the 1960s. To verify the quality of the flow field a trajectory analysis has been carried out and compared with the Algos buoy data. BRIEF DESCRIPTION OF THE DATA ASSIMILATION SYSTEM ## Oceanic GCM and analysis scheme--The basic equations are much the same as used for the GCM's, except for the Newtonian damping terms introduced into the prediction equations for the potential temperature and salinity to maintain these fields as observed. The C grid of 2'lat. by 2'long. in horizontal and the 11 vertical levels are applied to the entire Pacific Ocean. At the east and west ocean boundaries the periodic boundary conditions are applied creating fictitious ocean there. The SMAC Method is used to increase the accuracy of mass conservation. * Data--The JODC temperature and salinity data obtained from 1906 to 1988 are used in the system between Long.100'E. and 60'W. The surface wind data are derived from the SSM/I data by Dr-R. Atlas of NASA/GSFC. The data set contains every 6 hours data from July 1987 to June 1989 on the grid of 2'lat. by 2.5'long. The averaged for the whole period and then interpolated into the 2'lat. by 2'long. grid data are used to force the system. The sea bottom topography data was based on the General Bathymetric Chart of the Ocean (GEBCO) supplied by the Canadian Hydrographic Service under contract with the International Hydrographic Organization and International Oceanographic Commission of UNESCO.

Takano, Kenji↗

Removal of the solar component in AVHRR 3.7 micrometer radiances for the retrieval of cirrus cloud parameters

A numerical scheme has been developed to remove the solar component in the Advanced Very High Resolution Radiometer (AVHRR) 3.7- micrometer channel for the retrieval of cirrus parameters during daytime. This method uses a number of prescribed threshold values for AVHRR channels 1 (0.63 micrometer), 2 (0.8 micrometer), 3 (3.7 micrometer), 4 (10.9 micrometer), and 5 (12 micrometer) to separate clear and cloudy pixels. A look-up table relating channels 1 and 3 solar reflectances is subsequently constructed based on the prescribed mean effective ice crystal sizes and satellite geometric parameters. An adding-doubling radiative transfer program has been used to generate numerical values in the construction of the look-up table. Removal of the channel 3 solar component is accomplished by using the look-up table and the measured channel 1 reflectance. The cloud retrieval scheme described in Ou et al. has been modified in connection with the removal program. The authors have applied the removal-retrieval scheme to the AVHRR global area coverage daytime data, collected during the First ISCCP (International Satellite Cloud Climatology Project) Regional Experiment cirrus intensive field observation (FIRE IFO) at 2100 UTC 28 October 1986 over the Wisconsin area. Distributions of the retrieved cloud heights and optical depths are comparable to those determined from Geostationary Operational Environmental Satellite (GOES) visible and IR channels data reported by Minnis et al. Moreover, verifications of the retrieved cirrus temperature and height against lidar data have been carried out using results reported from three FIRE IFO stations. The retrieved cloud heights are within 0.5 km of the measured lidar values.

Rao, N. X.↗

Advanced orbiting systems test-bedding and protocol verification

The Consultative Committee for Space Data Systems (CCSDS) has begun the development of a set of protocol recommendations for Advanced Orbiting Systems (SOS). The AOS validation program and formal definition of AOS protocols are reviewed, and the configuration control of the AOS formal specifications is summarized. Independent implementations of the AOS protocols by NASA and ESA are discussed, and cross-support/interoperability tests which will allow the space agencies of various countries to share AOS communication facilities are addressed.

Noles, James↗

SeaWiFS calibration and validation plan, volume 3

The Sea-viewing Wide Field-of-view Sensor (SeaWiFS) will be the first ocean-color satellite since the Nimbus-7 Coastal Zone Color Scanner (CZCS), which ceased operation in 1986. Unlike the CZCS, which was designed as a proof-of-concept experiment, SeaWiFS will provide routine global coverage every 2 days and is designed to provide estimates of photosynthetic concentrations of sufficient accuracy for use in quantitative studies of the ocean's primary productivity and biogeochemistry. A review of the CZCS mission is included that describes that data set's limitations and provides justification for a comprehensive SeaWiFS calibration and validation program. To accomplish the SeaWiFS scientific objectives, the sensor's calibration must be constantly monitored, and robust atmospheric corrections and bio-optical algorithms must be developed. The plan incorporates a multi-faceted approach to sensor calibration using a combination of vicarious (based on in situ observations) and onboard calibration techniques. Because of budget constraints and the limited availability of ship resources, the development of the operational algorithms (atmospheric and bio-optical) will rely heavily on collaborations with the Earth Observing System (EOS), the Moderate Resolution Imaging Spectrometer (MODIS) oceans team, and projects sponsored by other agencies, e.g., the U.S. Navy and the National Science Foundation (NSF). Other elements of the plan include the routine quality control of input ancillary data (e.g., surface wind, surface pressure, ozone concentration, etc.) used in the processing and verification of the level-0 (raw) data to level-1 (calibrated radiances), level-2 (derived products), and level-3 (gridded and averaged derived data) products.

Hooker, Stanford B.↗

Modeling and Simulation Credibility Assessment of Finite Element Models for Fall From Heights Injury Scenarios

Finite element (FE) computational models of the whole human body are being used to investigate the injury modalities and mechanisms arising from suited astronauts’ ExtraVehicular Activities (EVAs). These FE whole body models – simplified Elemance and THUMS pedestrian versions – have undergone a series of verification and validation (V&V) assessments for applications in automotive, domestic, and contact sports arenas. However, the FE models’ Modeling and Simulation (M&S) credibility assessments for simulating suited astronaut injuries due to fall from heights in altered gravity environments are limited. The current study evaluates the M&S credibility of simplified Elemance and THUMS pedestrian FE models based on eight credibility factors – data pedigree, input pedigree, code verification, solution verification, conceptual validation, referent validation, results uncertainty, and results robustness – as per NASA-STD-7009A [1]. These credibility factors were assigned ordinal scores ranging between 0 to 4, with a score of 0 in the case of insufficient evidence and 4 when all data for the model is known, used appropriately, and traceable to the Real-World System (RWS) with acceptable accuracy, precision, and uncertainty. The credibility factor sufficiency thresholds were assigned upon guidance from NASA EVA subject matter experts. The factor scores were ascertained through the evaluation of M&S credibility assessment procedures described in the published literature and FE model reports. The M&S credibility scores for the Elemance and THUMS FE models vary between 1 and 3 for data pedigree, input pedigree, and referent validation credibility factors, and between 0 and 1 for code verification, solution verification, conceptual validation, results uncertainty and results robustness. The results show that these FE models are credible for simulating fall from heights injury scenarios in specific kinematic and kinetic ranges that correlate with highway and contact sports-related external conditions. Multiple credibility elevation strategies are prescribed to improve the Elemance and THUMS models’ credibility for use in the EVA fall from height injury scenarios.

R A Perkins↗