Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “evaluation framework”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 379 records · Page 21

Simulation Framework for Rapid Entry, Descent, and Landing (EDL) Analysis, Phase 2 Results

The NASA Engineering and Safety Center (NESC) was requested to establish the Simulation Framework for Rapid Entry, Descent, and Landing (EDL) Analysis assessment, which involved development of an enhanced simulation architecture using the Program to Optimize Simulated Trajectories II simulation tool. The assessment was requested to enhance the capability of the Agency to provide rapid evaluation of EDL characteristics in systems analysis studies, preliminary design, mission development and execution, and time-critical assessments. Many of the new simulation framework capabilities were developed to support the Agency EDL-Systems Analysis (SA) team that is conducting studies of the technologies and architectures that are required to enable human and higher mass robotic missions to Mars. The findings, observations, and recommendations from the NESC are provided in this report.

Murri, Daniel G.↗

The Business Change Initiative: A Novel Approach to Improved Cost and Schedule Management

Goddard Space Flight Center's Flight Projects Directorate employed a Business Change Initiative (BCI) to infuse a series of activities coordinated to drive improved cost and schedule performance across Goddard's missions. This sustaining change framework provides a platform to manage and implement cost and schedule control techniques throughout the project portfolio. The BCI concluded in December 2014, deploying over 100 cost and schedule management changes including best practices, tools, methods, training, and knowledge sharing. The new business approach has driven the portfolio to improved programmatic performance. The last eight launched GSFC missions have optimized cost, schedule, and technical performance on a sustained basis to deliver on time and within budget, returning funds in many cases. While not every future mission will boast such strong performance, improved cost and schedule tools, management practices, and ongoing comprehensive evaluations of program planning and control methods to refine and implement best practices will continue to provide a framework for sustained performance. This paper will describe the tools, techniques, and processes developed during the BCI and the utilization of collaborative content management tools to disseminate project planning and control techniques to ensure continuous collaboration and optimization of cost and schedule management in the future.

Schedule↗

Characterizing Student-Driven Research Investigations Contributed to the GLOBE Program Citizen Science Initiative in a Formal Education Context

The Global Learning and Observations to Benefit the Environment (GLOBE) Program offers citizen science opportunities to participants of all ages, with a focus on youth in formal classroom contexts. This study uses student investigation research reports and posters submitted to the 2018 International Virtual Science Symposium (IVSS) and Student Research Symposium (SRS) as testbeds for characterizing student-driven Earth system citizen science investigations. Secondarily, this study aimed to capture GLOBE’s alignment to existing citizen science outcomes frameworks in the literature, which have primarily focused on adults and non-formal settings. Based on a literature review, the evaluation team identified 89 potential characteristics in 27 categories to typify investigations from both formal education and citizen science perspectives. We coded the artifacts from 207 student projects, conducted quantitative analysis of frequencies, and performed a semantic network analysis. By using this networking approach, we conceptually mapped several clusters of co-occurring characteristics, defining a descriptive framework for GLOBE projects. We identified three tiers of citizen science projects, increasing in the sophistication of participants’ demonstrated science practices. The framework includes additional components that reflect student citizen scientists’ thoughtfulness and connection to context as well as their projects’ reflection of their motivation and self efficacy. Through these findings, we have identified areas where student citizen scientists would benefit from further support, and suggest here further research to incorporate the experiences of students into the broader understanding of citizen science outcomes.

network analysis↗

Simulation Framework for Rapid Entry, Descent, and Landing (EDL) Analysis

The NASA Engineering and Safety Center (NESC) was requested to establish the Simulation Framework for Rapid Entry, Descent, and Landing (EDL) Analysis assessment, which involved development of an enhanced simulation architecture using the Program to Optimize Simulated Trajectories II (POST2) simulation tool. The assessment was requested to enhance the capability of the Agency to provide rapid evaluation of EDL characteristics in systems analysis studies, preliminary design, mission development and execution, and time-critical assessments. Many of the new simulation framework capabilities were developed to support the Agency EDL Systems Analysis (EDL-SA) team, that is conducting studies of the technologies and architectures that are required to enable higher mass robotic and human mission to Mars. The findings of the assessment are contained in this report.

Murri, Daniel G.↗

Simulation Framework for Rapid Entry, Descent, and Landing (EDL) Analysis: Appendices - Volume 2

The NASA Engineering and Safety Center (NESC) was requested to establish the Simulation Framework for Rapid Entry, Descent, and Landing (EDL) Analysis assessment, which involved development of an enhanced simulation architecture using the Program to Optimize Simulated Trajectories II (POST2) simulation tool. The assessment was requested to enhance the capability of the Agency to provide rapid evaluation of EDL characteristics in systems analysis studies, preliminary design, mission development and execution, and time-critical assessments. Many of the new simulation framework capabilities were developed to support the Agency EDL Systems Analysis (EDL-SA) team, that is conducting studies of the technologies and architectures that are required to enable higher mass robotic and human mission to Mars. The appendices to the original report are contained in this document.

Murri, Daniel G.↗

Design and evaluation of an onboard computer-based information system for aircraft

Information seeking by human operators of technical systems is considered. Types of information and forms of presentation are discussed and important issues reviewed. This broad discussion provides a framework within which flight management is considered. The design of an onboard computer-based information system for aircraft is discussed. The aiding possibilities of a computer-based system are emphasized. Results of an experimental evaluation of a prototype system are presented. It is concluded that a computer-based information system can substantially lessen the frequency of human errors.

Rouse, S. H.↗

Improved Hypoxia Modeling for Nutrient Control Decisions in the Gulf of Mexico

The Gulf of Mexico Modeling Framework is a suite of coupled models linking the deposition and transport of sediment and nutrients to subsequent bio-geo chemical processes and the resulting effect on concentrations of dissolved oxygen in the coastal waters of Louisiana and Texas. Here, we examine the potential benefits of using multiple NASA remote sensing data products within this Modeling Framework for increasing the accuracy of the models and their utility for nutrient control decisions in the Gulf of Mexico. Our approach is divided into three components: evaluation and improvement of (a) the precipitation input data (b) atmospheric constituent concentrations in EPA's air quality/deposition model and (c) the calculation of algal biomass, organic carbon and suspended solids within the water quality/eutrophication models of the framework.

Habib, Shahid↗

NASAwide electronic publishing system-prototype STI electronic document distribution: Stage-4 evaluation report: Appendices - Part 2

This evaluation report contains an introduction, seven chapters, and five appendices. The Introduction describes the purpose, conceptual framework, functional description, and technical report server of the Scientific and Technical Information (STI) Electronic Document Distribution (EDD) project. Chapter 1 documents the results of the prototype STI EDD in actual operation. Chapter 2 documents each NASA center's post processing publication processes. Chapter 3 documents each center's STI software, hardware. and communications configurations. Chapter 7 documents STI EDD policy, practices, and procedures. The appendices consist of (A) the STI EDD Project Plan, (B) Team members, (C) Phasing Schedules, (D) Accessing On-line Reports, and (E) Creating an HTML File and Setting Up an xTRS. In summary, Stage 4 of the NASAwide Electronic Publishing System is the final phase of its implementation through the prototyping and gradual integration of each NASA center's electronic printing systems, desk top publishing systems, and technical report servers, to be able to provide to NASA's engineers, researchers, scientists, and external users, the widest practicable and appropriate dissemination of information concerning its activities and the result thereof to their work stations.

Tuey, Richard C.↗

3-D Mixed Mode Delamination Fracture Criteria - An Experimentalist's Perspective

Many delamination failure criteria based on fracture toughness have been suggested over the past few decades, but most only covered the region containing mode I and mode II components of loading because that is where toughness data existed. With new analysis tools, more 3D analyses are being conducted that capture a mode III component of loading. This has increased the need for a fracture criterion that incorporates mode III loading. The introduction of a pure mode III fracture toughness test has also produced data on which to base a full 3D fracture criterion. In this paper, a new framework for visualizing 3D fracture criteria is introduced. The common 2D power law fracture criterion was evaluated to produce unexpected predictions with the introduction of mode III and did not perform well in the critical high mode I region. Another 2D criterion that has been shown to model a wide range of materials well was used as the basis for a new 3D criterion. The new criterion is based on assumptions that the relationship between mode I and mode III toughness is similar to the relation between mode I and mode II and that a linear interpolation can be used between mode II and mode III. Until mixed-mode data exists with a mode III component of loading, 3D fracture criteria cannot be properly evaluated, but these assumptions seem reasonable.

Reeder, James R.↗

CFD Model Development of a Cryogenic Storage Tank Self-Pressurization in Normal Gravity and Validation against SHIIVER Experiment

Two-phase flow and heat transfer simulations with interfacial phase change of the Structural Heat Intercept, Insulation, and Vibration Evaluation Rig (SHIIVER) self-pressurization experiment were conducted using storage tank CFD model in the framework of the ANSYS Fluent CFD code. The simulations were performed for the 70% fill level case with MLI on domes and no vapor cooling. All the phase change calculations in these simulations were generated by in-house Schrage-based evaporation-condensation model. The calculations were performed using both the Volume of Fluid (VOF) and Sharp Interface multiphase 2D axisymmetric models. A number of parametric and sensitivity studies were performed to check the various aspects of the CFD model. These studies helped to understand the effects of varying several parameters on the tank pressure and temperature during self-pressurization. Turbulence modeling; turbulence damping at the interface; and using constant vs. temperature dependent fluid properties were shown to have the most profound influence on predicted tank pressures and temperatures. Current study indicates that including phase change at the interface into the computational model is crucial for accurate prediction of the tank self-pressurization process. The effect of accommodation coefficient was also studied. Tank pressure values predicted by the VOF, and Sharp Interface models are within 4% of the experimental ones.

Computational Fluid Dynamics↗

CFD Model Development of a Cryogenic Storage Tank Self-Pressurization in Normal Gravity and Validation against SHIIVER Experiment

Two-Phase flow and heat transfer simulations with interfacial phase change of the Structural Heat Intercept, Insulation, and Vibration Evaluation Rig (SHIIVER) self-pressurization experiment were conducted using storage tank CFD model in the framework of the ANSYS Fluent CFD code. The simulations were performed for the 70% fill level case with MLI on domes and no vapor cooling. All the phase change calculations in these simulations were generated by in-house Schrage-based evaporation-condensation model. The calculations were performed using both the VOF and Sharp Interface multiphase 2Daxisymmetric models. A number of parametric and sensitivity studies were performed to check the various aspects of the CFD model. These studies helped to understand the effects of varying several parameters on the tank pressure and temperature during self-pressurization. These parameters include: the effect of turbulence modeling and turbulence damping at the interface; the effect of constant vs. temperature dependent fluid properties; the effect of accommodation coefficient; the effect of modeling phase change at the interface and the effect of the fill level.

Computational Fluid Dynamics↗

Agency Additive Manufacturing (AM) Certification Support Team (AACT) Risk Reduction – Safe Life Category: Fracture Control Framework for Un-inspectable Fracture Critical AM Parts

The NASA Engineering and Safety Center (NESC) was requested to support the development of a governing philosophy to provide a consistent and systematic approach for fracture control certification of additive manufacturing (AM) hardware that cannot be reliably inspected. The overall goal of the NESC assessment was to make progress toward a framework for general certification of un-inspectable fracture critical AM hardware and toward approaches for evaluating risks associated with these components. This report contains the results of the assessment.

Additive Manufacturing↗

Agent Based Modeling of Air Carrier Behavior for Evaluation of Technology Equipage and Adoption

As part of ongoing research, the National Aeronautics and Space Administration (NASA) and LMI developed a research framework to assist policymakers in identifying impacts on the U.S. air transportation system (ATS) of potential policies and technology related to the implementation of the Next Generation Air Transportation System (NextGen). This framework, called the Air Transportation System Evolutionary Simulation (ATS-EVOS), integrates multiple models into a single process flow to best simulate responses by U.S. commercial airlines and other ATS stakeholders to NextGen-related policies, and in turn, how those responses impact the ATS. Development of this framework required NASA and LMI to create an agent-based model of airline and passenger behavior. This Airline Evolutionary Simulation (AIRLINE-EVOS) models airline decisions about tactical airfare and schedule adjustments, and strategic decisions related to fleet assignments, market prices, and equipage. AIRLINE-EVOS models its own heterogeneous population of passenger agents that interact with airlines; this interaction allows the model to simulate the cycle of action-reaction as airlines compete with each other and engage passengers. We validated a baseline configuration of AIRLINE-EVOS against Airline Origin and Destination Survey (DB1B) data and subject matter expert opinion, and we verified the ATS-EVOS framework and agent behavior logic through scenario-based experiments. These experiments demonstrated AIRLINE-EVOS's capabilities in responding to an input price shock in fuel prices, and to equipage challenges in a series of analyses based on potential incentive policies for best equipped best served, optimal-wind routing, and traffic management initiative exemption concepts..

Horio, Brant M.↗

Combined EDL-Mobility Planning for Planetary Missions

This paper presents an analysis framework for planetary missions that have coupled mobility and EDL (Entry-Descent-Landing) systems. Traditional systems engineering approaches to mobility missions such as MERs (Mars Exploration Rovers) and MSL (Mars Science Laboratory) independently study the EDL system and the mobility system, and does not perform explicit trade-off between them or risk minimization of the overall system. A major challenge is that EDL operation is inherently uncertain and its analysis results such as landing footprint are described using PDF (Probability Density Function). The proposed approach first builds a mobility cost-to-go map that encodes the driving cost of any point on the map to a science target location. The cost could include variety of metrics such as traverse distance, time, wheel rotation on soft soil, and closeness to hazards. It then convolves the mobility cost-to-go map with the landing PDF given by the EDL system, which provides a histogram of driving cost, which can be used to evaluate the overall risk of the mission. By capturing the coupling between EDL and mobility explicitly, this analysis framework enables quantitative tradeoff between EDL and mobility system performance, as well as the characterization of risks in a statistical way. The simulation results are presented with a realistic Mars terrain data

mission analysis↗

Initial Results of an MDO Method Evaluation Study

The NASA Langley MDO method evaluation study seeks to arrive at a set of guidelines for using promising MDO methods by accumulating and analyzing computational data for such methods. The data are collected by conducting a series of re- producible experiments. In the first phase of the study, three MDO methods were implemented in the SIGHT: framework and used to solve a set of ten relatively simple problems. In this paper, we comment on the general considerations for conducting method evaluation studies and report some initial results obtained to date. In particular, although the results are not conclusive because of the small initial test set, other formulations, optimality conditions, and sensitivity of solutions to various perturbations. Optimization algorithms are used to solve a particular MDO formulation. It is then appropriate to speak of local convergence rates and of global convergence properties of an optimization algorithm applied to a specific formulation. An analogous distinction exists in the field of partial differential equations. On the one hand, equations are analyzed in terms of regularity, well-posedness, and the existence and unique- ness of solutions. On the other, one considers numerous algorithms for solving differential equations. The area of MDO methods studies MDO formulations combined with optimization algorithms, although at times the distinction is blurred. It is important to

Alexandrov, Natalia M.↗

Automated Storm Tracking and the Lightning Jump Algorithm Using GOES-R Geostationary Lightning Mapper (GLM) Proxy Data

This study develops a fully automated lightning jump system encompassing objective storm tracking, Geostationary Lightning Mapper proxy data, and the lightning jump algorithm (LJA), which are important elements in the transition of the LJA concept from a research to an operational based algorithm. Storm cluster tracking is based on a product created from the combination of a radar parameter (vertically integrated liquid, VIL), and lightning information (flash rate density). Evaluations showed that the spatial scale of tracked features or storm clusters had a large impact on the lightning jump system performance, where increasing spatial scale size resulted in decreased dynamic range of the system's performance. This framework will also serve as a means to refine the LJA itself to enhance its operational applicability. Parameters within the system are isolated and the system's performance is evaluated with adjustments to parameter sensitivity. The system's performance is evaluated using the probability of detection (POD) and false alarm ratio (FAR) statistics. Of the algorithm parameters tested, sigma-level (metric of lightning jump strength) and flash rate threshold influenced the system's performance the most. Finally, verification methodologies are investigated. It is discovered that minor changes in verification methodology can dramatically impact the evaluation of the lightning jump system.

lightning jump↗

Model Checking Degrees of Belief in a System of Agents

Reasoning about degrees of belief has been investigated in the past by a number of authors and has a number of practical applications in real life. In this paper we present a unified framework to model and verify degrees of belief in a system of agents. In particular, we describe an extension of the temporal-epistemic logic CTLK and we introduce a semantics based on interpreted systems for this extension. In this way, degrees of beliefs do not need to be provided externally, but can be derived automatically from the possible executions of the system, thereby providing a computationally grounded formalism. We leverage the semantics to (a) construct a model checking algorithm, (b) investigate its complexity, (c) provide a Java implementation of the model checking algorithm, and (d) evaluate our approach using the standard benchmark of the dining cryptographers. Finally, we provide a detailed case study: using our framework and our implementation, we assess and verify the situational awareness of the pilot of Air France 447 flying in off-nominal conditions.

MAS Verification↗