Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “evaluation framework”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 919 records · Page 51

Improving Climate Projections Using "Intelligent" Ensembles

Recent changes in the climate system have led to growing concern, especially in communities which are highly vulnerable to resource shortages and weather extremes. There is an urgent need for better climate information to develop solutions and strategies for adapting to a changing climate. Climate models provide excellent tools for studying the current state of climate and making future projections. However, these models are subject to biases created by structural uncertainties. Performance metrics-or the systematic determination of model biases-succinctly quantify aspects of climate model behavior. Efforts to standardize climate model experiments and collect simulation data-such as the Coupled Model Intercomparison Project (CMIP)-provide the means to directly compare and assess model performance. Performance metrics have been used to show that some models reproduce present-day climate better than others. Simulation data from multiple models are often used to add value to projections by creating a consensus projection from the model ensemble, in which each model is given an equal weight. It has been shown that the ensemble mean generally outperforms any single model. It is possible to use unequal weights to produce ensemble means, in which models are weighted based on performance (called "intelligent" ensembles). Can performance metrics be used to improve climate projections? Previous work introduced a framework for comparing the utility of model performance metrics, showing that the best metrics are related to the variance of top-of-atmosphere outgoing longwave radiation. These metrics improve present-day climate simulations of Earth's energy budget using the "intelligent" ensemble method. The current project identifies several approaches for testing whether performance metrics can be applied to future simulations to create "intelligent" ensemble-mean climate projections. It is shown that certain performance metrics test key climate processes in the models, and that these metrics can be used to evaluate model quality in both current and future climate states. This information will be used to produce new consensus projections and provide communities with improved climate projections for urgent decision-making.

Baker, Noel C.↗

Development of a One-Domain Volume-Averaged Navier–Stokes Solver

The interaction between a high-enthalpy flow and a thermal protection material is inherently multiscale and multiphysics. In conventional aerothermal analyses, the external flow and material response are generally modeled using separate computational domains coupled through boundary conditions at the material surface. Although this approach has supported many practical applications, it requires assumptions about the location and behavior of the interface and may become difficult to apply when material decomposition, internal reactions, and surface recession substantially alter the porous structure. This report presents the development of a one-domain formulation in which the free-fluid and porous-material regions are represented within a single computational domain. The formulation is based on the volume-averaged Navier–Stokes (VANS) equations, derived from the governing equations for reacting, compressible flow and condensed material. Volume averaging transfers the influence of the unresolved material microstructure to the macroscale equations through effective transport properties, interfacial source terms, and dispersion fluxes. Particular attention is given to regions in which porosity and permeability vary rapidly, including the diffuse transition between a porous material and the surrounding fluid. The resulting equations are implemented in the Porous-material Analysis Toolbox based on OpenFOAM (PATO). The report describes the pressure–velocity coupling strategy used by the solver, examines spatial filtering techniques for deriving effective properties, and evaluates the influence of a smoothly varying interface permeability. Numerical demonstrations include canonical porous-flow configurations, a flow-tube configuration representative of FiberForm® permeability experiments, and the oxidation of a porous carbon material. The purpose of this work is to establish a mathematical and computational foundation for a unified treatment of flow and thermal protection material response. The present formulation is intended to support the progressive inclusion of additional physical processes, including multicomponent transport, finite-rate gas–surface chemistry, pyrolysis, internal oxidation, and material recession. It also provides a framework for connecting pore-scale simulations and microstructural characterization with macroscale aerothermal-response calculations. This report is intended for researchers and engineers working in computational fluid dynamics, porous-media transport, material response, and thermal protection system modeling. It documents both the theoretical development and the initial numerical assessment of the one-domain approach, while identifying the closure of effective and dispersion terms as an important subject for continued investigation.

Ablation↗

Real-Time Payload Control and Monitoring on the World Wide Web

World Wide Web (W3) technologies such as the Hypertext Transfer Protocol (HTTP) and the Java object-oriented programming environment offer a powerful, yet relatively inexpensive, framework for distributed application software development. This paper describes the design of a real-time payload control and monitoring system that was developed with W3 technologies at NASA Ames Research Center. Based on Java Development Toolkit (JDK) 1.1, the system uses an event-driven "publish and subscribe" approach to inter-process communication and graphical user-interface construction. A C Language Integrated Production System (CLIPS) compatible inference engine provides the back-end intelligent data processing capability, while Oracle Relational Database Management System (RDBMS) provides the data management function. Preliminary evaluation shows acceptable performance for some classes of payloads, with Java's portability and multimedia support identified as the most significant benefit.

Sun, Charles↗

Developing Mars-Based Clinical Scenarios for an Earth Independent Medical Operations (EIMO) – Based Decision Support Service

As crewed missions move beyond Low-Earth Orbit, pre-mission planning cannot fully buy down the medical risks of exploration-class missions. Martian missions, where increased hazards exist, (such as long-duration spaceflight, surface-level EVA operations, and communications delays) will require a paradigm shift in the structure of a medical system. An Earth-Independent Medical Operations-based Medical System (EIMO-MS) will need to optimize four critical domains to help provide medical care: utilization of Pre-Mission Planning, augmentation of Acute and Prolonged Medical Decision Making, automated tracking of Resource Management, and assistance in Task Load Balance. The ideal EIMO-MS will be able to accomplish this goal by having an interactive, adaptable interface that will be able to provide real-time medical services. It must respond based on the level of crewmember training, medical situation, and available medical and non-medical resources. To showcase the capabilities and requirements of such a sophisticated automated MS, a series of clinical scenarios of escalating complexity were developed with clinical and systems engineering input. These scenarios describe in clinical detail what a theoretical future medical system, enhanced with multiple information streams (such as a medical database, an AI-based Decision Support System, real-time monitoring, enhanced in-situ laboratory imaging, etc.) can achieve in conjunction with a trained and experienced crew. Scenarios are comprised of: a context section including objectives and applicable spaceflight environment, a highlighted assumptions section, a clinical narrative section, and a systems engineering activity diagram demonstrating the integrated Medical System (MS). The “swim lanes” of the activity diagram act as the logistical core of each scenario and show how the MS will interact with the crew, ground support, and other in-flight systems. The Design Reference Mission that is used for the scenarios is based on existing reference mission profiles [1] with a projected 30-sol stay on the Martian surface. Scenarios span the spectrum from planned evaluations, minor medical care, urgent care, surgical guidance, critical and expectant management, and behavioral health care. Mission complexity will exponentially increase during deep space and Mars exploration-class missions, and medical support for these missions will likewise need to increase in autonomy and adaptability. The integrated system that will support these missions will need to provide assistance in a variety of anticipated and unforeseen scenarios. These medical scenarios, guided by clinician input, are initial steps in crafting the requirements for an EIMO-based medical system. By working in a systems engineering framework, requirements and capabilities can be extracted and mapped while maintaining a clinical core.

Prashant Parmar↗

A conceptual framework for intelligent real-time information processing

By combining artificial intelligence concepts with the human information processing model of Rasmussen, a conceptual framework was developed for real time artificial intelligence systems which provides a foundation for system organization, control and validation. The approach is based on the description of system processing terms of an abstraction hierarchy of states of knowledge. The states of knowledge are organized along one dimension which corresponds to the extent to which the concepts are expressed in terms of the system inouts or in terms of the system response. Thus organized, the useful states form a generally triangular shape with the sensors and effectors forming the lower two vertices and the full evaluated set of courses of action the apex. Within the triangle boundaries are numerous processing paths which shortcut the detailed processing, by connecting incomplete levels of analysis to partially defined responses. Shortcuts at different levels of abstraction include reflexes, sensory motor control, rule based behavior, and satisficing. This approach was used in the design of a real time tactical decision aiding system, and in defining an intelligent aiding system for transport pilots.

Schudy, Robert↗

Role of IAC in large space systems thermal analysis

Computer analysis programs to evaluate critical coupling effects that can significantly influence spacecraft system performance are described. These coupling effects arise from the varied parameters of the spacecraft systems, environments, and forcing functions associated with disciplines such as thermal, structures, and controls. Adverse effects can be expected to significantly impact system design aspects such as structural integrity, controllability, and mission performance. One such needed design analysis capability is a software system that can integrate individual discipline computer codes into a highly user-oriented/interactive-graphics-based analysis capability. The integrated analysis capability (IAC) system can be viewed as: a core framework system which serves as an integrating base whereby users can readily add desired analysis modules and as a self-contained interdisciplinary system analysis capability having a specific set of fully integrated multidisciplinary analysis programs that deal with the coupling of thermal, structures, controls, antenna radiation performance, and instrument optical performance disciplines.

Jones, G. K.↗

Approach for Autonomous Control of Unmanned Aerial Vehicle Using Intelligent Agents for Knowledge Creation

This paper describes the development of a planned approach for Autonomous operation of an Unmanned Aerial Vehicle (UAV). A Hybrid approach will seek to provide Knowledge Generation through the application of Artificial Intelligence (AI) and Intelligent Agents (IA) for UAV control. The applications of several different types of AI techniques for flight are explored during this research effort. The research concentration is directed to the application of different AI methods within the UAV arena. By evaluating AI and biological system approaches. which include Expert Systems, Neural Networks. Intelligent Agents, Fuzzy Logic, and Complex Adaptive Systems, a new insight may be gained into the benefits of AI and CAS techniques applied to achieving true autonomous operation of these systems. Although flight systems were explored, the benefits should apply to many Unmanned Vehicles such as: Rovers. Ocean Explorers, Robots, and autonomous operation systems. A portion of the flight system is broken down into control agents that represent the intelligent agent approach used in AI. After the completion of a successful approach, a framework for applying an intelligent agent is presented. The initial results from simulation of a security agent for communication are presented.

Dufrene, Warren R., Jr.↗

A Dynamic Landslide Hazard Monitoring Framework for the Lower Mekong Region

The Lower Mekong region is one of the most landslide-prone areas of the world. Despite the need for dynamic characterization of landslide hazard zones within the region, it is largely understudied for several reasons. Dynamic and integrated understanding of landslide processes requires landslide inventories across the region, which have not been available previously. Computational limitations also hamper regional landslide hazard assessment, including accessing and processing remotely sensed information. Finally, open-source software and modelling packages are required to address regional landslide hazard analysis. Leveraging an open-source data-driven global Landslide Hazard Assessment for Situational Awareness model framework, this study develops a region-specific dynamic landslide hazard system leveraging satellite-based Earth observation data to assess landslide hazards across the lower Mekong region. A set of landslide inventories were prepared from high-resolution optical imagery using advanced image-processing techniques. Several static and dynamic explanatory variables (i.e., rainfall, soil moisture, slope, relief, distance to roads, distance to faults, distance to rivers) were considered during the model development phase. An extreme gradient boosting decision tree model was trained for the monsoon period of 2015–2019 and the model was evaluated with independent inventory information for the 2020 monsoon period. The model performance demonstrated considerable skill using receiver operating characteristic curve statistics, with Area Under the Curve values exceeding 0.95. The model architecture was designed to use near-real-time data, and it can be implemented in a cloud computing environment (i.e., Google Cloud Platform) for the routine assessment of landslide hazards in the Lower Mekong region. This work was developed in collaboration with scientists at the Asian Disaster Preparedness Center as part of the NASA SERVIR Program’s Mekong hub. The goal of this work is to develop a suite of tools and services on accessible open-source platforms that support and enable stakeholder communities to better assess landslide hazard and exposure at local to regional scales for decision making and planning.

Nishan Kumar Biswas↗

Benchmark Problem for Autonomous Urban Air Mobility

This paper introduces a Community Benchmark Problem (CBP) for Intelligent Contingency Management (ICM) for Urban Air Mobility (UAM) aircraft. The CBP aims to provide a common framework for measuring and comparing the progress of autonomy solutions for UAM aircraft in handling emergency situations. The paper proposes a methodology for defining and quantifying five measures of complexity that capture the challenges and requirements of ICM for UAM: Mission, Environmental, Autonomy, Decision-Making, and Mission Fault. In addition, it proposes a methodology for defining and quantifying mission risk acceptability with the same goals: Contingency Management, Mission Success, Operational, Mission Redefinition, and Environmental. We describe how to use these measures to track progress of the development of ICM capability, as well as to create scenarios and evaluate the performance of different autonomy solutions.

autonomy↗

Community Benchmark Problem for Intelligent Contingency Management

This paper introduces a Community Benchmark Problem (CBP) for Intelligent Contingency Management (ICM) for Urban Air Mobility (UAM) aircraft. The CBP aims to provide a common framework for measuring and comparing the progress of autonomy solutions for UAM aircraft in handling emergency situations. The paper proposes a methodology for defining and quantifying five measures of complexity that capture the challenges and requirements of ICM for UAM: Mission, Environmental, Autonomy, Decision-Making, and Mission Fault. In addition, it proposes a methodology for defining and quantifying mission risk acceptability with the same goals: Contingency Management, Mission Success, Operational, Mission Redefinition, and Environmental. We describe how to use these measures to track progress of the development of ICM capability, as well as to create scenarios and evaluate the performance of different autonomy solutions.

autonomy↗

The manned transportation system study - Defining human pathways into space

The Manned Transportation System (MTS) Study, conducted by a NASA-Industry Team (NIT), has developed substantiating data for subsequent NASA decisions on the “right” set of manned transportation elements needed for human access to space. It also provides the framework for detailed definition of those manned transportation elements. Including the next manned transportation system, to be developed. Process and product are presented to inform the aerospace community and subject our approach and conclusions to peer review, NASA/JSC lead the NIT, with participation from KSC, LaRC, MSFC, and NASA/Headquarters, along with six aerospace contractor (Boeing, General Dynamics, Lockheed Martin Marietta, McDonnell Douglas, and Rockwell). Each major milestone was archived through team consensus. Our mission model was derived from the FY90 Civil Needs Data Base (CNDB) and included flight assignments for Department of Defense (DOD) missions. Identifying and defining architecture evaluation criteria, i.e. attributes, specified the amount and type of data needed for each concept under consideration. Several architectures, each beginning with today’s transportation systems, were defined using representative systems to explore our future options and address specific questions currently being debated. Our solutions are a function of the level of space activity the nation chooses to follow. However, they all emphasize affordability, safety, routineness, and reliability. Finally, key issues associated with our current business practices were challenged and the impact associated with those practices quantified.

NASA Langley Research Center↗

An advanced method for tracking the evolution of fatigue damage in reusable space propulsion systems

NASA-Lewis is actively involved in the general effort to research, develop, test, and evaluate advanced theoretical, analytical, experimental, and probabilistic analysis concepts required for life prediction of liquid rocket engines at the subcomponent, component, and engine system levels. The models developed are oriented toward use in advanced health monitoring systems of space propulsion systems. It is planned to demonstrate the methodology considering a representative set of three components such as a main injector element, a combustion chamber liner, and a turbopump blade. This paper describes the initial development and application of this method to a specific location in the main injector element of the SSME. Further enhancements and various elements of the framework will be completed as the work proceeds in subsequent years.

Rajagopal, K. R.↗

Compatibility of Segments of Thermoelectric Generators

A method of calculating (usually for the purpose of maximizing) the power-conversion efficiency of a segmented thermoelectric generator is based on equations derived from the fundamental equations of thermoelectricity. Because it is directly traceable to first principles, the method provides physical explanations in addition to predictions of phenomena involved in segmentation. In comparison with the finite-element method used heretofore to predict (without being able to explain) the behavior of a segmented thermoelectric generator, this method is much simpler to implement in practice: in particular, the efficiency of a segmented thermoelectric generator can be estimated by evaluating equations using only hand-held calculator with this method. In addition, the method provides for determination of cascading ratios. The concept of cascading is illustrated in the figure and the definition of the cascading ratio is defined in the figure caption. An important aspect of the method is its approach to the issue of compatibility among segments, in combination with introduction of the concept of compatibility within a segment. Prior approaches involved the use of only averaged material properties. Two materials in direct contact could be examined for compatibility with each other, but there was no general framework for analysis of compatibility. The present method establishes such a framework. The mathematical derivation of the method begins with the definition of reduced efficiency of a thermoelectric generator as the ratio between (1) its thermal-to-electric power-conversion efficiency and (2) its Carnot efficiency (the maximum efficiency theoretically attainable, given its hot- and cold-side temperatures). The derivation involves calculation of the reduced efficiency of a model thermoelectric generator for which the hot-side temperature is only infinitesimally greater than the cold-side temperature. The derivation includes consideration of the ratio (u) between the electric current and heat-conduction power and leads to the concept of compatibility factor (s) for a given thermoelectric material, defined as the value of u that maximizes the reduced efficiency of the aforementioned model thermoelectric generator.

Snyder, G. Jeffrey↗

Program Monitoring with LTL in EAGLE

We briefly present a rule-based framework called EAGLE, shown to be capable of defining and implementing finite trace monitoring logics, including future and past time temporal logic, extended regular expressions, real-time and metric temporal logics (MTL), interval logics, forms of quantified temporal logics, and so on. In this paper we focus on a linear temporal logic (LTL) specialization of EAGLE. For an initial formula of size m, we establish upper bounds of O(m(sup 2)2(sup m)log m) and O(m(sup 4)2(sup 2m)log(sup 2) m) for the space and time complexity, respectively, of single step evaluation over an input trace. This bound is close to the lower bound O(2(sup square root m) for future-time LTL presented. EAGLE has been successfully used, in both LTL and metric LTL forms, to test a real-time controller of an experimental NASA planetary rover.

Barringer, Howard↗

High-Power Hall Propulsion Development at NASA Glenn Research Center

The NASA Office of the Chief Technologist Game Changing Division is sponsoring the development and testing of enabling technologies to achieve efficient and reliable human space exploration. High-power solar electric propulsion has been proposed by NASA's Human Exploration Framework Team as an option to achieve these ambitious missions to near Earth objects. NASA Glenn Research Center is leading the development of mission concepts for a solar electric propulsion Technical Demonstration Mission. The mission concepts are highlighted in this paper but are detailed in a companion paper. There are also multiple projects that are developing technologies to support a demonstration mission and are also extensible to NASA's goals of human space exploration. Specifically, the In-Space Propulsion technology development project at the NASA Glenn has a number of tasks related to high-power Hall thrusters including performance evaluation of existing Hall thrusters; performing detailed internal discharge chamber, near-field, and far-field plasma measurements; performing detailed physics-based modeling with the NASA Jet Propulsion Laboratory's Hall2De code; performing thermal and structural modeling; and developing high-power efficient discharge modules for power processing. This paper summarizes the various technology development tasks and progress made to date.

Kamhawi, Hani↗

Classification of Notices to Airmen using Natural Language Processing

This paper establishes the feasibility of using Natural Language Processing (NLP) to classify NOTAMs or Notices to Airmen – a pilot messaging framework to gather real-time situational awareness. Present day air mobility operations heavily rely on NOTAMs. However, pilots often have difficulty interpreting NOTAMs due to the sheer volume of inapplicable messages and unclear abbreviations. Using NLP, the presented study analyzes the accuracy of classifying NOTAMs and, thereby, the efficiency of generating actionable interpretations in real time. To this effect, efficacies of four NLP neural network architectures were analyzed, including three Recurrent Neural Networks (RNNs) with GloVe, Word2Vec, and FastText word embeddings, and one trained Bi-Directional Encoder Representations from Transformers (BERT) model. The four neural networks were trained and evaluated on three open-source datasets of varying text lengths, vocabularies, and grammars, taken from e-commerce product descriptions, social media tweets, and unstructured descriptions for data and analytics services on open data marketplaces such as NASA’s Data and Reasoning Fabric (DRF) platform. This provided cross-analysis of each neural network architecture’s performance per text type. The best performing architecture, BERT, was then fine-tuned on a collection of open-source NOTAM data. Post-training, a real-time NOTAM classification service was implemented to draw inference on new NOTAMs using the trained model, which demonstrated close to 99% accuracy in classification. This modular classification service is envisioned to be integrated with a data and analytics delivery platform, such as the DRF, thus availing real-time contextualization of NOTAMs to air mobility clients, humans, and machines for enhanced decision making.

Aiden C. Szeto↗

Classification of Notices to Airmen using Natural Language Processing

This paper establishes the feasibility of using Natural Language Processing (NLP) to classify NOTAMs or Notices to Airmen – a pilot messaging framework to gather real-time situational awareness. Present day air mobility operations heavily rely on NOTAMs. However, pilots often have difficulty interpreting NOTAMs due to the sheer volume of inapplicable messages and unclear abbreviations. Using NLP, the presented study analyzes the accuracy of classifying NOTAMs and, thereby, the efficiency of generating actionable interpretations in real time. To this effect, efficacies of four NLP neural network architectures were analyzed, including three Recurrent Neural Networks (RNNs) with GloVe, Word2Vec, and FastText word embeddings, and one trained Bi-Directional Encoder Representations from Transformers (BERT) model. The four neural networks were trained and evaluated on three open-source datasets of varying text lengths, vocabularies, and grammars, taken from e-commerce product descriptions, social media tweets, and unstructured descriptions for data and analytics services on open data marketplaces such as NASA’s Data and Reasoning Fabric (DRF) platform. This provided cross-analysis of each neural network architecture’s performance per text type. The best performing architecture, BERT, was then fine-tuned on a collection of open-source NOTAM data. Post-training, a real-time NOTAM classification service was implemented to draw inference on new NOTAMs using the trained model, which demonstrated close to 99% accuracy in classification. This modular classification service is envisioned to be integrated with a data and analytics delivery platform, such as the DRF, thus availing real-time contextualization of NOTAMs to air mobility clients, humans, and machines for enhanced decision making.

Aiden Szeto↗

High-Power Hall Propulsion Development at NASA Glenn Research Center

The NASA Office of the Chief Technologist Game Changing Division is sponsoring the development and testing of enabling technologies to achieve efficient and reliable human space exploration. High-power solar electric propulsion has been proposed by NASA's Human Exploration Framework Team as an option to achieve these ambitious missions to near Earth objects. NASA Glenn Research Center (NASA Glenn) is leading the development of mission concepts for a solar electric propulsion Technical Demonstration Mission. The mission concepts are highlighted in this paper but are detailed in a companion paper. There are also multiple projects that are developing technologies to support a demonstration mission and are also extensible to NASA's goals of human space exploration. Specifically, the In-Space Propulsion technology development project at NASA Glenn has a number of tasks related to high-power Hall thrusters including performance evaluation of existing Hall thrusters; performing detailed internal discharge chamber, near-field, and far-field plasma measurements; performing detailed physics-based modeling with the NASA Jet Propulsion Laboratory's Hall2De code; performing thermal and structural modeling; and developing high-power efficient discharge modules for power processing. This paper summarizes the various technology development tasks and progress made to date

Kamhawi, Hani↗