Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “evaluation framework”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 955 records · Page 53

New contributions to the problem of capture

Libration-point capture is analyzed in the framework of the restricted three-body problem in order to obtain general results capable of predicting the major features of an arbitrary postcapture orbit, with specific reference to capture as the presumed mode of origin of Jupiter's outer satellites. Some examples of libration-point capture are computed, the time a body remains captured is estimated, and a long-term numerical integration of orbits is carried out which shows that the equation used to estimate capture lifetimes is quite conservative. An extended capture criterion is proposed and used to demonstrate that direct postcapture orbits lie outside retrograde ones. Mass change involving one or both primaries is evaluated as a means of producing permanent capture, it is found that mass-change effects can produce 'pull-down capture', and consideration is given to the orbital evolution of Jupiter's outer satellites. The effect of drag in the solar nebula or in a nebula around proto-Jupiter on the capture process is briefly investigated. It is concluded that a capture origin for the outer satellites is improbable within the last 4.6 billion years but that either mass change or nebula drag could have been effective in producing capture.

Heppenheimer, T. A.↗

Mission Simulation of Space Lidar Measurements for Seasonal and Regional CO2 Variations

Results of mission simulation studies are presented for a laser-based atmospheric [82 sounder. The simulations are based on real-time carbon cycle process modeling and data analysis. The mission concept corresponds to the Active Sensing of [82 over Nights, Days, and Seasons (ASCENDS) recommended by the US National Academy of Sciences Decadal Survey of Earth Science and Applications from Space. One prerequisite for meaningful quantitative sensor evaluation is realistic CO2 process modeling across a wide range of scales, i.e., does the model have representative spatial and temporal gradients? Examples of model comparison with data will be shown. Another requirement is a relatively complete description of the atmospheric and surface state, which we have obtained from meteorological data assimilation and satellite measurements from MODIS and [ALIPS0. We use radiative transfer model calculations, an instrument model with representative errors ' and a simple retrieval approach to complete the cycle from "nature" run to "pseudo-data" CO2, Several mission and instrument configuration options are examined/ and the sensitivity to key design variables is shown. We use the simulation framework to demonstrate that within reasonable technological assumptions for the system performance, relatively high measurement precision can be obtained, but errors depend strongly on environmental conditions as well as instrument specifications. Examples are also shown of how the resulting pseudo - measurements might be used to address key carbon cycle science questions.

Kawa, Stephan↗

Object and Gas Source Detection with Robotic Platforms in Perceptually-Degraded Environments

In exploration-oriented robotic missions for disaster relief in unknown subterranean environments, it is of prime importance for a human supervisor to rapidly gain situational awareness of salient objects within the environment. In this paper we present an automated object detection pipeline that is adaptable to heterogeneous robots with arbitrary sensor configurations. It has been deployed in time-critical scenarios with multiple collaborative robots in a variety of demanding underground environments. For visually observable objects, detections are made in both the visible and thermal spectra using a state-of-the-art machine learning framework for object detection and classification. Our pipeline can be rapidly adapted to a specific task by using a small, structured dataset to fine-tune a pre-trained convolutional neural network (CNN). Relative localization is separated from the CNN for speed of operation. A robust architecture for localization is used with outlier rejection and a hierarchy of fall-back distance measurement methods. Point-source objects such as gas and WiFi hotspots can also be detected, by tracking signal strength over time and presenting an intuitive visualization on a map. Observations of each object types are presented to the operator in ranked confidence order for final evaluation.

Agha-mohammadi, Ali-akbar↗

NASA’s Digital Information Platform to Accelerate the Transformation of the National Airspace System

In order to accelerate the digital transformation of airspace operations, a foundational framework and infrastructure for providing sustainable, data-driven, and cohesive decision-making digital services for both traditional and emergent air vehicles is being developed. The reference implementation of Digital Information Platform builds an ecosystem for the aviation community by providing access to a secure and trusted source of aviation data and services. Several key features and services have been implemented to enable secure data sharing, communication, and service registration on the Platform. The technical approach used to implement these features is presented here. NASA-developed integrated aviation data and machine learning based prediction services to optimize airspace operations are available on the Platform. These services are being evaluated in an operational environment by flight operators and the real-world benefits are being captured. The Platform fosters collaboration among industry and researchers to develop complex aviation services and the aim is to make it publicly accessible for consumption by the aviation community.

Digital Transformation↗

NASA’s Digital Information Platform to Accelerate the Transformation of the National Airspace System

In order to accelerate the digital transformation of airspace operations, a foundational framework and infrastructure for providing sustainable, data-driven, and cohesive decision-making digital services for both traditional and emergent air vehicles is being developed. The reference implementation of Digital Information Platform builds an ecosystem for the aviation community by providing access to a secure and trusted source of aviation data and services. Several key features and services have been implemented to enable secure data sharing, communication, and service registration on the Platform. The technical approach used to implement these features is presented here. NASA-developed integrated aviation data and machine learning based prediction services to optimize airspace operations are available on the Platform. These services are being evaluated in an operational environment by flight operators and the real-world benefits are being captured. The Platform fosters collaboration among industry and researchers to develop complex aviation services and the aim is to make it publicly accessible for consumption by the aviation community.

Digital Transformation↗

First-Principles Modeling Of Electromagnetic Scattering By Discrete and Discretely Heterogeneous Random Media

A discrete random medium is an object in the form of a finite volume of a vacuum or a homogeneous material medium filled with quasi-randomly and quasi-uniformly distributed discrete macroscopic impurities called small particles. Such objects are ubiquitous in natural and artificial environments. They are often characterized by analyzing theoretically the results of laboratory, in situ, or remote-sensing measurements of the scattering of light and other electromagnetic radiation. Electromagnetic scattering and absorption by particles can also affect the energy budget of a discrete random medium and hence various ambient physical and chemical processes. In either case electromagnetic scattering must be modeled in terms of appropriate optical observables, i.e., quadratic or bilinear forms in the field that quantify the reading of a relevant optical instrument or the electromagnetic energy budget. It is generally believed that time-harmonic Maxwell's equations can accurately describe elastic electromagnetic scattering by macroscopic particulate media that change in time much more slowly than the incident electromagnetic field. However, direct solutions of these equations for discrete random media had been impracticable until quite recently. This has led to a widespread use of various phenomenological approaches in situations when their very applicability can be questioned. Recently, however, a new branch of physical optics has emerged wherein electromagnetic scattering by discrete and discretely heterogeneous random media is modeled directly by using analytical or numerically exact computer solutions of the Maxwell equations. Therefore, the main objective of this Report is to formulate the general theoretical framework of electromagnetic scattering by discrete random media rooted in the Maxwell- Lorentz electromagnetics and discuss its immediate analytical and numerical consequences. Starting from the microscopic Maxwell-Lorentz equations, we trace the development of the first principles formalism enabling accurate calculations of monochromatic and quasi-monochromatic scattering by static and randomly varying multiparticle groups. We illustrate how this general framework can be coupled with state-of-the-art computer solvers of the Maxwell equations and applied to direct modeling of electromagnetic scattering by representative random multi-particle groups with arbitrary packing densities. This first-principles modeling yields general physical insights unavailable with phenomenological approaches. We discuss how the first-order-scattering approximation, the radiative transfer theory, and the theory of weak localization of electromagnetic waves can be derived as immediate corollaries of the Maxwell equations for very specific and well-defined kinds of particulate medium. These recent developments confirm the mesoscopic origin of the radiative transfer, weak localization, and effective-medium regimes and help evaluate the numerical accuracy of widely used approximate modeling methodologies.

Michael I Mishchenko↗

Assessment of RANS-based Transition Models based on Experimental Data of the Common Research Model with Natural Laminar Flow

Transition models based on auxiliary transport equations augmenting the Reynolds-averaged Navier-Stokes (RANS) framework often rely upon transition correlations that were derived from a limited number of low-speed experiments and these models often fail to account for all of the relevant transition mechanisms and/or the variation in those mechanisms with respect to changes in the significant flow parameters. Available data from a recent experiment on the Common Research Model with Natural Laminar Flow (CRM-NLF) in the National Transonic Facility at the NASA Langley Research Center are used to assess the current transition modeling capability in NASA's OVERFLOW 2.3b solver for a swept wing configuration with nonzero taper and transonic cruise conditions. Specifically, the OVERFLOW solutions are used to evaluate the accuracy and robustness of the transport-equation-based transition models. Results highlight that the Spalart-Allmaras-based amplification factor transport (AFT-2017b) equation model and Menter’s shear-stress transport equation (SST2003)-based Langtry-Menter transition models (either with or without the modeling of crossflow transition) significantly underpredict the reported extent of laminar flow region over the entire span of the wing, irrespective of which instability mechanism(s) is expected to dominate the onset of the transition process. We show that the transition correlations underlying these models fail to account for the stabilizing effect of compressibility on the Tollmien-Schlichting transition, which is likely to be a major contributor to the underprediction of the laminar flow region on the CRM-NLF. The SST-2003-based Langtry-Menter model also appears to inaccurately predict the chordwise pressure variation along the majority of the wing span at all the flow conditions studied herein, due to how the turbulence intensity levels were enforced in the computations and how that was interfering with the functioning of the underlying turbulence model within the boundary layer. The AFT and Langtry-Menter models appear to be sensitive to the level of the freestream turbulence intensity, but the degree of sensitivity varies across the models.

CFD modeling↗

Assessing Utility of Different Orbits for a Lunar PNT Constellation

"As the Artemis program establishes a long-term presence on the lunar surface, lunar surface users will need an accurate source of Position, Navigation, and Timing (PNT). Under the LunaNet framework, NASA has proposed the Lunar Navigation System (LNS), a constellation of satellites in lunar orbit which will broadcast LunaNet’s Augmented Forward Signal (AFS) [1] to the lunar surface. LNS will have the objective of providing user position accuracies of 10 m and timing accuracies of 10 microseconds on the lunar surface and up to 200 km above the surface. Several classes of orbits are possibilities for the LNS constellation, including circular orbits, eccentric orbits, and various families of 3-body orbits. Each of these orbit classes have both advantages and disadvantages in their utility as PNT constellations. In this study we examine a wide variety of potential LNS constellations and evaluate their performance against several metrics, including: a. Dilution of Precision (DOP) performance over the lunar service volume and the South Pole region, during both the constellation buildup and after the constellation is completed. b. Number of satellites required to achieve required DOP performance. c. Relative dynamics of LNS satellites with respect to surface users. d. Signal in space error (SISE) performance, assuming orbit determination that includes the Global Positioning System (GPS), crosslinks, and monitor sites on the surface of the moon. e. Constellation insertion, station keeping, and disposal costs. f. Specific Concept of Operations (CONOPS) and engineering challenges associated with establishing and operating the constellations. (E.g., frequent station keeping, variable signal strength, divergent CONOPS for different planes of the constellation.) The system’s performance is considered both independently and in combination with other proposed systems, such as NASA’s Lunar Communication Relay and Navigation System (LCRNS) and ESA’s Moonlight constellation. The study concludes that a 3-plane Walker constellation at 6 lunar radii (slightly higher than GPS’s 4.2 earth radii from a geometry perspective, but significantly closer in an absolute sense) is a good candidate for the LNS constellation, providing the user with good SISE and DOP performance, while not requiring excessive station keeping or complex CONOPS. However, other viable concepts exist and could be chosen if early South Pole coverage is a driving factor in the system design."

navigation↗

Interrelationships Between Receiver/Relative Operating Characteristics Display, Binomial, Logit, and Bayes' Rule Probability of Detection Methodologies

Unknown risks are introduced into failure critical systems when probability of detection (POD) capabilities are accepted without a complete understanding of the statistical method applied and the interpretation of the statistical results. The presence of this risk in the nondestructive evaluation (NDE) community is revealed in common statements about POD. These statements are often interpreted in a variety of ways and therefore, the very existence of the statements identifies the need for a more comprehensive understanding of POD methodologies. Statistical methodologies have data requirements to be met, procedures to be followed, and requirements for validation or demonstration of adequacy of the POD estimates. Risks are further enhanced due to the wide range of statistical methodologies used for determining the POD capability. Receiver/Relative Operating Characteristics (ROC) Display, simple binomial, logistic regression, and Bayes' rule POD methodologies are widely used in determining POD capability. This work focuses on Hit-Miss data to reveal the framework of the interrelationships between Receiver/Relative Operating Characteristics Display, simple binomial, logistic regression, and Bayes' Rule methodologies as they are applied to POD. Knowledge of these interrelationships leads to an intuitive and global understanding of the statistical data, procedural and validation requirements for establishing credible POD estimates.

Generazio, Edward R.↗

Safeguard: Progress and Test Results for a Reliable Independent On-Board Safety Net for UAS

As demands increase to use unmanned aircraft systems (UAS) for a broad spectrum of commercial applications, regulatory authorities are examining how to safely integrate them without compromising safety or disrupting traditional airspace operations. For small UAS, several operational rules have been established; e.g., do not operate beyond visual line-of-sight, do not fly within five miles of a commercial airport, do not fly above 400 feet above ground level. Enforcing these rules is challenging for UAS, as evidenced by the number of incident reports received by the Federal Aviation Administration (FAA). This paper reviews the development of an onboard system - Safeguard - designed to monitor and enforce conformance to a set of operational rules defined prior to flight (e.g., geospatial stay-out or stay-in regions, speed limits, and altitude constraints). Unlike typical geofencing or geo-limitation functions, Safeguard operates independently of the off-the-shelf UAS autopilot and is designed in a way that can be realized by a small set of verifiable functions to simplify compliance with existing standards for safety-critical systems (e.g. for spacecraft and manned commercial transportation aircraft systems). A framework is described that decouples the system from any other devices on the UAS as well as introduces complementary positioning source(s) for applications that require integrity and availability beyond what can be provided by the Global Positioning System (GPS). This paper summarizes the progress and test results for Safeguard research and development since presentation of the design concept at the 35th Digital Avionics Systems Conference (DASC '16). Significant accomplishments include completion of software verification and validation in accordance with NASA standards for spacecraft systems (to Class B), development of improved hardware prototypes, development of a simulation platform that allows for hardware-in-the-loop testing and fast-time Monte Carlo evaluations, and flight testing on multiple air vehicles. Integration testing with NASA's UAS Traffic Management (UTM) service-oriented architecture was also demonstrated.

Young, Steven D.↗

A Unified Nonlinear Adaptive Approach for Detection and Isolation of Engine Faults

A challenging problem in aircraft engine health management (EHM) system development is to detect and isolate faults in system components (i.e., compressor, turbine), actuators, and sensors. Existing nonlinear EHM methods often deal with component faults, actuator faults, and sensor faults separately, which may potentially lead to incorrect diagnostic decisions and unnecessary maintenance. Therefore, it would be ideal to address sensor faults, actuator faults, and component faults under one unified framework. This paper presents a systematic and unified nonlinear adaptive framework for detecting and isolating sensor faults, actuator faults, and component faults for aircraft engines. The fault detection and isolation (FDI) architecture consists of a parallel bank of nonlinear adaptive estimators. Adaptive thresholds are appropriately designed such that, in the presence of a particular fault, all components of the residual generated by the adaptive estimator corresponding to the actual fault type remain below their thresholds. If the faults are sufficiently different, then at least one component of the residual generated by each remaining adaptive estimator should exceed its threshold. Therefore, based on the specific response of the residuals, sensor faults, actuator faults, and component faults can be isolated. The effectiveness of the approach was evaluated using the NASA C-MAPSS turbofan engine model, and simulation results are presented.

Tang, Liang↗

Symbolic Constraint Maintenance Grid

Version 3.1 of Symbolic Constraint Maintenance Grid (SCMG) is a software system that provides a general conceptual framework for utilizing pre-existing programming techniques to perform symbolic transformations of data. SCMG also provides a language (and an associated communication method and protocol) for representing constraints on the original non-symbolic data. SCMG provides a facility for exchanging information between numeric and symbolic components without knowing the details of the components themselves. In essence, it integrates symbolic software tools (for diagnosis, prognosis, and planning) with non-artificial-intelligence software. SCMG executes a process of symbolic summarization and monitoring of continuous time series data that are being abstractly represented as symbolic templates of information exchange. This summarization process enables such symbolic- reasoning computing systems as artificial- intelligence planning systems to evaluate the significance and effects of channels of data more efficiently than would otherwise be possible. As a result of the increased efficiency in representation, reasoning software can monitor more channels and is thus able to perform monitoring and control functions more effectively.

James, Mark↗

Overview of NASA's Carbon Monitoring System Flux-Pilot Project

NASA's space-based observations of physical, chemical and biological parameters in the Earth System along with state-of-the-art modeling capabilities provide unique capabilities for analyses of the carbon cycle. The Carbon Monitoring System is developing an exploratory framework for detecting carbon in the environment and its changes, with a view towards contributing to national and international monitoring activities. The Flux-Pilot Project aims to provide a unified view of land-atmosphere and ocean-atmosphere carbon exchange, using observation-constrained models. Central to the project is the application of NASA's satellite observations (especially MODIS), the ACOS retrievals of the JAXA-GOSAT observations, and the "MERRA" meteorological reanalysis produced with GEOS-S. With a primary objective of estimating uncertainty in computed fluxes, two land- and two ocean-systems are run for 2009-2010 and compared with existing flux estimates. An transport model is used to evaluate simulated CO2 concentrations with in-situ and space-based observations, in order to assess the realism of the fluxes and how uncertainties in fluxes propagate into atmospheric concentrations that can be more readily evaluated. Finally, the atmospheric partial CO2 columns observed from space are inverted to give new estimates of surface fluxes, which are evaluated using the bottom-up estimates and independent datasets. The focus of this presentation will be on the science goals and current achievements of the pilot project, with emphasis on how policy-relevant questions help focus the scientific direction. Examples include the issue of what spatio-temporal resolution of fluxes can be detected from polar-orbiting satellites and whether it is possible to use space-based observations to separate contributions to atmospheric concentrations of (say) fossil-fuel and biological activity

Pawson, Steven↗

Experimental verification of the photodiode theory of SIS mixers

The authors describe the characterization and interpretation of the performance of SIS receivers within the framework of the photodiode theory of mixing. The quantum efficiency plays a dominant role in the theory, and a simple method of accurately measuring this parameter is presented. It is demonstrated that the quantum efficiency measurements can be conveniently made on a standard radio astronomy receiver and combined with the usual hot and cold load characterization to improve the understanding of the receiver's performance. The measurements verify that the photodiode theory of mixing accurately describes the receiver noise even at local-oscillator power levels well above the linear response range. The results for receivers operating at 100 and 240 GHz verify the utility of this approach. These methods should also prove useful in evaluating submillimeter receivers.

Woody, David P.↗

Evaluating ESA CCI Soil Moisture in East Africa

To assess growing season conditions where ground based observations are limited or unavailable, food security and agricultural drought monitoring analysts rely on publicly available remotely sensed rainfall and vegetation greenness. There are also remotely sensed soil moisture observations from missions like the European Space Agency (ESA) Soil Moisture and Ocean Salinity (SMOS) and NASAs Soil Moisture Active Passive (SMAP), however these time series are still too short to conduct studies that demonstrate the utility of these data for operational applications, or to provide historical context for extreme wet or dry events. To promote the use of remotely sensed soil moisture in agricultural drought and food security monitoring, we use East Africa as a case study to evaluate the quality of a 30+ year time series of merged active-passive microwave soil moisture from the ESA Climate Change Initiative (CCI-SM). Compared to the Normalized Difference Vegetation index (NDVI) and modeled soil moisture products, we found substantial spatial and temporal gaps in the early part of the CCI-SM record, with adequate data coverage beginning in 1992. From this point forward, growing season CCI-SM anomalies were well correlated (R greater than 0.5) with modeled, seasonal soil moisture, and in some regions, NDVI. We use correlation analysis and qualitative comparisons at seasonal time scales to show that remotely sensed soil moisture can add information to a convergence of evidence framework that traditionally relies on rainfall and NDVI in moderately vegetated regions.

Amy McNally↗

A knowledge based software engineering environment testbed

The Carnegie Group Incorporated and Boeing Computer Services Company are developing a testbed which will provide a framework for integrating conventional software engineering tools with Artifical Intelligence (AI) tools to promote automation and productivity. The emphasis is on the transfer of AI technology to the software development process. Experiments relate to AI issues such as scaling up, inference, and knowledge representation. In its first year, the project has created a model of software development by representing software activities; developed a module representation formalism to specify the behavior and structure of software objects; integrated the model with the formalism to identify shared representation and inheritance mechanisms; demonstrated object programming by writing procedures and applying them to software objects; used data-directed and goal-directed reasoning to, respectively, infer the cause of bugs and evaluate the appropriateness of a configuration; and demonstrated knowledge-based graphics. Future plans include introduction of knowledge-based systems for rapid prototyping or rescheduling; natural language interfaces; blackboard architecture; and distributed processing

Gill, C.↗

New developments in NASA quality assurance

The purpose of this talk is to examine and discuss NASA's basic quality concept, the policy and procedures which define and implement this concept and subsequently explore the NASA-Industry quality relationships which are essential to the success of NASA's quality assurance concept. It is important to emphasize that NASA's Quality Assurance program is predicated on the concept of an individually tailored quality program for each significant NASA procurement - particularly, large space systems. As a result, NASA's Quality Assurance program - to be effective - must be responsive to various technologies, hardware systems, and space missions. In addition, the program must be responsive to changing policies and practices in research, engineering and procurement. Key issues in the NASA-Contractor quality relationships in the framework of an over all NASA-Industry partnership include: (1) the necessity for NASA to effectively discharge its responsibility for providing clear and complete definition of quality requirements at all phases of the procurement cycle; (2) the right of the contractor to expect an explicit definition of NASA quality requirements in each RFP and contract and to request same if it is not provided; (3) the necessity for the contractor to have a dynamic and responsive quality program which is directed towards assuring that the hardware meets all technical requirements and to accomplish this in an effective and efficient manner; and (4) the critical need for investigation and study of the economic aspects of quality and an evaluation of our policies and practices based upon the results of such a study.

Condon, John E.↗

GCAP 2.0: A Global 3-D Chemical-Transport Model Framework for Past, Present, and Future Climate Scenarios

This manuscript describes version 2.0 of the Global Change and Air Pollution (GCAP 2.0) model framework, a one-way offline coupling between version of the NASA Goddard Institute for Space Studies (GISS) general circulation model (GCM) and the GEOS-Chem global 3-D chemical-transport model (CTM). Meteorology for driving GEOS-Chem has been archived from the E2.1 contributions to Phase 6 of the Coupled Model Intercomparison Project (CMIP6) for the preindustrial and recent past. In addition, meteorology is available for the near future and end-of-the century for seven future scenarios ranging from extreme mitigation to extreme warming. Emissions and boundary conditions have been prepared for input to GEOS-Chem that are consistent with the CMIP6 experimental design. The model meteorology, emissions, transport and chemistry are evaluated in the recent past and found to be largely consistent with GEOS-Chem driven by the Modern-Era Retrospective analysis for Research and Applications Version 2 (MERRA-2) product and with observational constraints.

Global Change and Air Pollution (GCAP 2.0) model↗