Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “evaluation framework”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 505 records · Page 28

Developments and Validations of Fully Coupled CFD and Practical Vortex Transport Method for High-Fidelity Wake Modeling in Fixed and Rotary Wing Applications

A novel Computational Fluid Dynamics (CFD) coupling framework using a conventional Reynolds-Averaged Navier-Stokes (BANS) solver to resolve the near-body flow field and a Particle-based Vorticity Transport Method (PVTM) to predict the evolution of the far field wake is developed, refined, and evaluated for fixed and rotary wing cases. For the rotary wing case, the RANS/PVTM modules are loosely coupled to a Computational Structural Dynamics (CSD) module that provides blade motion and vehicle trim information. The PVTM module is refined by the addition of vortex diffusion, stretching, and reorientation models as well as an efficient memory model. Results from the coupled framework are compared with several experimental data sets (a fixed-wing wind tunnel test and a rotary-wing hover test).

Anusonti-Inthra, Phuriwat↗

Parametric-Based Heat Rejection Trade Study for Lunar and Martian Surface Operations

Establishing and maintaining a sustained presence on the lunar and/or Martian surfaces will require a diverse portfolio of surface elements (e.g., habitation, mobility, power generation, etc.). Many of these systems generate excess heat that must be rejected across a wide range of magnitudes, temperatures, and duty cycles and under variable environmental conditions. To identify the most promising heat rejection approaches for this diverse portfolio, a heat rejection trade study was conducted to evaluate the performance of different technology approaches across a spectrum of surface environments and heat-load requirements. The trade study consisted of three stages: (1) development of a parametric-based modeling framework, (2) creation of a database of heat rejection technologies, surface elements, and environmental conditions for the Moon and Mars, and (3) execution of a quantitative analysis of various heat rejection technologies across different operating conditions and surface elements. The modeling framework is developed in Python and Excel to prioritize small model size and hence low computational cost to enable large parametric sweeps while avoiding the reliance on proprietary software. Individual heat rejection processes are represented as simple Excel models, and a centralized Python script interfaces with the models to coordinate the parametric study. These simple sizing models were developed to take heat load requirements and environmental parameters as inputs and compute mass, power, and volume as outputs. Rather than assess each heat rejection technology separately for each surface element, a unified parametric space was developed to evaluate all technologies across all elements. This parametric space includes factors related to heat load (e.g., magnitude or temperature) and environment (e.g., surface temperature, sky temperature, solar flux). This effort generated a database containing information on over 60 heat rejection technologies and 30 surface elements. For each surface element, the expected heat rejection requirements were documented and analyzed to determine the most common needs shared across all elements. Environmental conditions at various lunar and Martian latitudes were also established for worst-case hot and worst-case cold scenarios. High-fidelity heat rejection models are currently under development. Preliminary trades between heat rejection technologies including radiators, venting technologies, convective coolers, and more have been conducted to identify promising options. This presentation will summarize the preliminary trade results and provide an overview and discussion of the expected heat loads and thermal environments for sustained surface operations on the Moon and Mars.

Heat Rejection↗

A Simulation Framework for Precision Landing and Hazard Avoidance Technology Assessments

To meet NASA’s challenge to return humans to the Moon in 2024 and establish a sustainable presence in 2028 requires advances in autonomous spacecraft navigation. The Safe and Precise Landing Integrated Capabilities Evolution (SPLICE) project, which leverages previous work at NASA to develop multi-mission precision landing and hazard avoidance technologies, is using a multi-faceted approach to achieve the advanced landing requirements. In addition to increasing the technology readiness level of key sensors and developing high performance space computing, SPLICE uses simulations to determine navigation requirements and evaluate sensor performance. The effort evaluates various precision landing concepts of operations, not only for the lunar human and robotic missions, but also for potential missions to other solar system destinations. This paper summarizes the six degree-of-freedom high fidelity simulation framework, trajectory design methodology, and sensor models being considered for a variety of precision lander missions. Initial results of the navigation sensor performance for a human Mars mission are presented. Finally, trade and sensitivity studies are outlined for future work to fully characterize sensor performance assumptions and modifications required to achieve precision landing and hazard avoidance.

Alicia Dwyer Cianciolo↗

Protocol for Atomic Oxygen Testing of Materials in Ground-Based Facilities

A second version of standard guidelines is proposed for improving materials testing in ground-based atomic oxygen environments for the purpose of predicting the durability of the tested materials in low Earth orbit (LEO). Accompanying these guidelines are background information and notes about testing. Both the guidelines and the additional information are intended to aid users who wish to evaluate the potential hazard of atomic oxygen in LEO to a candidate space component without actually flying the component in space, and to provide a framework for more consistent atomic oxygen testing in the future.

Minton, Timothy K.↗

SPARTAN: A High-Fidelity Simulation for Automated Rendezvous and Docking Applications

bd Systems (a subsidiary of SAIC) has developed the Simulation Package for Autonomous Rendezvous Test and ANalysis (SPARTAN), a high-fidelity on-orbit simulation featuring multiple six-degree-of-freedom (6DOF) vehicles. SPARTAN has been developed in a modular fashion in Matlab/Simulink to test next-generation automated rendezvous and docking guidance, navigation,and control algorithms for NASA's new Vision for Space Exploration. SPARTAN includes autonomous state-based mission manager algorithms responsible for sequencing the vehicle through various flight phases based on on-board sensor inputs and closed-loop guidance algorithms, including Lambert transfers, Clohessy-Wiltshire maneuvers, and glideslope approaches The guidance commands are implemented using an integrated translation and attitude control system to provide 6DOF control of each vehicle in the simulation. SPARTAN also includes high-fidelity representations of a variety of absolute and relative navigation sensors that maybe used for NASA missions, including radio frequency, lidar, and video-based rendezvous sensors. Proprietary navigation sensor fusion algorithms have been developed that allow the integration of these sensor measurements through an extended Kalman filter framework to create a single optimal estimate of the relative state of the vehicles. SPARTAN provides capability for Monte Carlo dispersion analysis, allowing for rigorous evaluation of the performance of the complete proposed AR&D system, including software, sensors, and mechanisms. SPARTAN also supports hardware-in-the-loop testing through conversion of the algorithms to C code using Real-Time Workshop in order to be hosted in a mission computer engineering development unit running an embedded real-time operating system. SPARTAN also contains both runtime TCP/IP socket interface and post-processing compatibility with bdStudio, a visualization tool developed by bd Systems, allowing for intuitive evaluation of simulation results. A description of the SPARTAN architecture and capabilities is provided, along with details on the models and algorithms utilized and results from representative missions.

Turbe, Michael A.↗

ePORT, NASA's Computer Database Program for System Safety Risk Management Oversight (Electronic Project Online Risk Tool)

ePORT (electronic Project Online Risk Tool) provides a systematic approach to using an electronic database program to manage a program/project risk management processes. This presentation will briefly cover the standard risk management procedures, then thoroughly cover NASA's Risk Management tool called ePORT. This electronic Project Online Risk Tool (ePORT) is a web-based risk management program that provides a common framework to capture and manage risks, independent of a programs/projects size and budget. It is used to thoroughly cover the risk management paradigm providing standardized evaluation criterion for common management reporting, ePORT improves Product Line, Center and Corporate Management insight, simplifies program/project manager reporting, and maintains an archive of data for historical reference.

Johnson, Paul W.↗

An Integrated 0-1 Hour First-Flash Lightning Nowcasting, Lightning Amount and Lightning Jump Warning Capability

Lightning one of the most dangerous weather-related phenomena, especially as many jobs and activities occur outdoors, presenting risk from a lightning strike. Cloud-to-ground (CG) lightning represents a considerable safety threat to people at airfields, marinas, and outdoor facilities-from airfield personnel, to people attending outdoor stadium events, on beaches and golf courses, to mariners, as well as emergency personnel. Holle et al. (2005) show that 90% of lightning deaths occurred outdoors, while 10% occurred indoors despite the perception of safety when inside buildings. Curran et al. (2000) found that nearly half of fatalities due to weather were related to convective weather in the 1992-1994 timeframe, with lightning causing a large component of the fatalities, in addition to tornadoes and flash flooding. Related to the aviation industry, CG lightning represents a considerable hazard to baggage-handlers, aircraft refuelers, food caterers, and emergency personnel, who all become exposed to the risk of being struck within short time periods while convective storm clouds develop. Airport safety protocols require that ramp operations be modified or discontinued when lightning is in the vicinity (typically 16 km), which becomes very costly and disruptive to flight operations. Therefore, much focus has been paid to nowcasting the first-time initiation and extent of lightning, both of CG and of any lightning (e.g, in-cloud, cloud-to-cloud). For this project three lightning nowcasting methodologies will be combined: (1) a GOESbased 0-1 hour lightning initiation (LI) product (Harris et al. 2010; Iskenderian et al. 2012), (2) a High Resolution Rapid Refresh (HRRR) lightning probability and forecasted lightning flash density product, such that a quantitative amount of lightning (QL) can be assigned to a location of expected LI, and (3) an algorithm that relates Pseudo-GLM data (Stano et al. 2012, 2014) to the so-called "lightning jump" (LJ) methodology (Shultz et al. 2011) to monitor lightning trends and to anticipate/forecast severe weather (hail > or =2.5 cm, winds > or =25 m/s, tornadoes). The result will be a time-continuous algorithm that uses GOES satellite, radar fields, and HRRR model fields to nowcast first-flash LI and QL, and subsequently monitors lightning trends on a perstorm basis within the LJ algorithm for possible severe weather occurrence out to > or =3 hours. The LI-QL-LJ product will also help prepare the operational forecast community for Geostationary Lightning Mapper (GLM) data expected in late 2015, as these data are monitored for ongoing convective storms. The LI-QL-LJ product will first predict where new lightning is highly probable using GOES imagery of developing cumulus clouds, followed by n analysis of NWS (dual-polarization) radar indicators (reflectivity at the -10 C altitude) of lightning occurrence, to increase confidence that LI is immanent. Once lightning is observed, time-continuous lightning mapping array and Pseudo-GLM observations will be analyzed to assess trends and the severe weather threat as identified by trends in lightning (i.e. LJs). Additionally, 5- and 15-min GOES imagery will then be evaluated on a per-storm basis for overshooting and other cloud-top features known to be associated with severe storms. For the processing framework, the GOES-R 0-1 hour convective initiation algorithm's output will be developed within the Warning Decision Support System - Integrated Information (WDSS-II) tracking tool, and merged with radar and lightning (LMA/Psuedo-GLM) datasets for active storms. The initial focus of system development will be over North Alabama for select lightning-active days in summer 2014, yet will be formed in an expandable manner. The lightning alert tool will also be developed in concert with National Weather Service (NWS) forecasters to meet their needs for real-time, accurate first-flash LI and timing, as well as anticipated lightning trends, amounts, continuation and cessation, so to provide key situational awareness and decision support information. The NASA Short-term Prediction Research and Transition (SPoRT) Center will provide important logistical and collaborative support and training, involving interactions with the NWS and broader user community.

Mecikalski, John↗

New Observing Strategy (NOS) for Future Earth Science Missions

One of the new thrusts of the Earth Science Technology Office (ESTO) Advanced Information Systems Technology (AIST) Program is the New Observing Strategy (NOS) thrust. Its goal is to provide a framework for identifying technology advances needed to exploit newly available observational capabilities, particularly to enable the development of the information technologies needed to support planning, evaluating, implementing, and operating dynamic, multi-element sets of observing assets. In this paper, we will introduce relevant NOS terminology and some key concepts before describing the objectives, driving factors and technology goals of this new thrust.

Advanced Information Systems↗

Vegetation Monitoring Optimization with Normalized Difference Vegetation Index and Evapotranspiration Using Remote Sensing Measurements and Land Surface Models Over East Africa

The majority of people in East Africa rely on the agro-pastoral system for their livelihood, which is highly vulnerable to droughts and flooding. Agro-pastoral droughts are endemic to the region and are considered the main natural hazard that contributes to food insecurity. Drought begins with rainfall deficit, gradually leading to soil moisture deficit, higher land surface temperature, and finally impacts to vegetation growth. Therefore, monitoring vegetation conditions is essential in understanding the progression of drought, potential effects on food security, and providing early warning information needed for drought mitigation decisions. Because vegetation processes couple the land and atmosphere, monitoring of vegetation conditions requires consideration of both water provision and demand. While there is consensus in using either the Normalized Difference Vegetation Index (NDVI) or evapotranspiration(ET) for vegetation monitoring, a comprehensive assessment optimizing the use of both has not yet been done. Moreover, the evaluation methods for understanding the relationships between NDVI and ET for vegetation monitoring are also limited. Taking these gaps into account we have developed a framework to optimize vegetation monitoring using both NDVI and ET by identifying where they perform the best by using triple collocation and cross-correlation methods. We estimated the random error structure in Moderate Resolution Imaging Spectroradiometer (MODIS) NDVI; ET from the Operational Simplified Surface Energy Balance (SSEBop) model; and ET from land surface models (LSMs). LSM ET and SSEBop ET have been found to be better indicators for vegetation monitoring during extreme drought events, while NDVI could provide better information on vegetation condition during wetter than normal conditions. The random error structures of these variables suggest that LSM ET is most likely to provide important information for vegetation monitoring over low and high ends of the vegetation fraction areas. Over moderate vegetative areas, any of these variables could provide important vegetation information for drought characterization and food security assessments. While this study provides a framework for optimizing vegetation monitoring for drought and food security assessments over East Africa, the framework can be adopted to optimize vegetation monitoring over any other drought and food insecure region of the world.

triple collocation↗

Performance Metrics for the Assessment of Satellite Data Products: An Ocean Color Case Study

Performance assessment of ocean color satellite data has generally relied on statistical metrics chosen for their common usage and the rationale for selecting certain metrics is infrequently explained. Commonly reported statistics based on mean squared errors, such as the coefficient of determination (r2), root mean square error, and regression slopes, are most appropriate for Gaussian distributions without outliers and, therefore, are often not ideal for ocean color algorithm performance assessment, which is often limited by sample availability. In contrast, metrics based on simple deviations, such as bias and mean absolute error, as well as pair-wise comparisons, often provide more robust and straightforward quantities for evaluating ocean color algorithms with non-Gaussian distributions and outliers. This study uses a SeaWiFS chlorophyll-a validation data set to demonstrate a framework for satellite data product assessment and recommends a multimetric and user-dependent approach that can be applied within science, modeling, and resource management communities.

remote sensing↗

Integrated Precision Landing Performance and Technology Assessments of a Human-Scale Mars Lander Using a Generalized Simulation Framework

Human-scale missions to Mars will likely require multiple landers delivered precisely to designated locations. The current NASA human Mars reference architecture assumes delivery of three 25 t payloads from a 1- or 5-Sol orbit to the surface with a landing precision of 50 m to ensure logistics are located near the habitat. While initial navigation estimates improve with on-orbit ground tracking, errors increase during post-deorbit coast. Likewise, Mars atmospheric variability and forecasting uncertainty means that the entry vehicle guidance, navigation, and control systems must be robust to accommodate landing during any time of day or Mars year, including during dust storms. Precision landing technologies are currently being assessed to determine if onboard navigation sensors are sufficient to enable the landing accuracy required or if additional navigation aids such as surface or orbiting beacons will be needed. This study evaluates the system performance requirements to meet the desired landing accuracy for the reference vehicle design and entry, descent, and landing concept of operations. A detailed six degree-of-freedom integrated performance simulation framework is used to perform the assessment and demonstrate that under current assumptions, onboard navigation sensors are sufficient to support precision landing.

spacecraft navigation↗

Integrated Precision Landing Performance and Technology Assessments of a Human- Scale Mars Lander Using a Generalized Simulation Framework

Human-scale missions to Mars will likely require multiple landers delivered precisely to designated locations. The current NASA human Mars reference architecture assumes delivery of three 25 t payloads from a 1- or 5-Sol orbit to the surface with a landing precision of 50 m to ensure logistics are located near the habitat. While initial navigation estimates improve with on-orbit ground tracking, errors increase during post-deorbit coast. Likewise, Mars atmospheric variability and forecasting uncertainty means that the entry vehicle guidance, navigation, and control systems must be robust to accommodate landing during any time of day or Mars year, including during dust storms. Precision landing technologies are currently being assessed to determine if onboard navigation sensors are sufficient to enable the landing accuracy required or if additional navigation aids such as surface or orbiting beacons will be needed. This study evaluates the system performance requirements to meet the desired landing accuracy for the reference vehicle design and entry, descent, and landing concept of operations. A detailed six degree-of-freedom integrated performance simulation framework is used to perform the assessment and demonstrate that under current assumptions, onboard navigation sensors are sufficient to support precision landing.

Chen, Po-Ting↗

Solid Rocket Motor Combustion Instability Modeling in COMSOL Multiphysics

Combustion instability modeling of Solid Rocket Motors (SRM) remains a topic of active research. Many rockets display violent fluctuations in pressure, velocity, and temperature originating from the complex interactions between the combustion process, acoustics, and steady-state gas dynamics. Recent advances in defining the energy transport of disturbances within steady flow-fields have been applied by combustion stability modelers to improve the analysis framework [1, 2, 3]. Employing this more accurate global energy balance requires a higher fidelity model of the SRM flow-field and acoustic mode shapes. The current industry standard analysis tool utilizes a one dimensional analysis of the time dependent fluid dynamics along with a quasi-three dimensional propellant grain regression model to determine the SRM ballistics. The code then couples with another application that calculates the eigenvalues of the one dimensional homogenous wave equation. The mean flow parameters and acoustic normal modes are coupled to evaluate the stability theory developed and popularized by Culick [4, 5]. The assumption of a linear, non-dissipative wave in a quiescent fluid remains valid while acoustic amplitudes are small and local gas velocities stay below Mach 0.2. The current study employs the COMSOL multiphysics finite element framework to model the steady flow-field parameters and acoustic normal modes of a generic SRM. The study requires one way coupling of the CFD High Mach Number Flow (HMNF) and mathematics module. The HMNF module evaluates the gas flow inside of a SRM using St. Robert's law to model the solid propellant burn rate, no slip boundary conditions, and the hybrid outflow condition. Results from the HMNF model are verified by comparing the pertinent ballistics parameters with the industry standard code outputs (i.e. pressure drop, thrust, ect.). These results are then used by the coefficient form of the mathematics module to determine the complex eigenvalues of the Acoustic Velocity Potential Equation (AVPE). The mathematics model is truncated at the nozzle sonic line, where a zero flux boundary condition is self-satisfying. The remaining boundaries are modeled with a zero flux boundary condition, assuming zero acoustic absorption on all surfaces. The results of the steady-state CFD and AVPE analyses are used to calculate the linear acoustic growth rate as is defined by Flandro and Jacob [2, 3]. In order to verify the process implemented within COMSOL we first employ the Culick theory and compare the results with the industry standard. After the process is verified, the Flandro/Jacob energy balance theory is employed and results displayed.

Fischbach, Sean R.↗

Remote sensing of row crop structure and component temperatures using directional radiometric temperatures and inversion techniques

A physically based sensor response model of a row crop was used as the mathematical framework from which several inversion strategies were tested for extracting row structure information and component temperatures using a series of sensor view angles. The technique was evaluated on ground-based radiometric thermal infrared data of a cotton row crop that covered 48 percent of the ground in the vertical projection. The results showed that the accuracies of the predicted row heights and widths, vegetation temperatures, and soil temperatures of the cotton row crop were on the order of 5 cm, 1 deg, and 2 deg C, respectively. The inversion techniques can be applied to directional sensor data from aircraft platforms and even space platforms if the effects of atmospheric absorption and emission can be corrected. In theory, such inversion techniques can be applied to a wide variety of vegetation types and thus can have significant implications for remote sensing research and applications in disciplines that deal with incomplete vegetation canopies.

Kimes, D. S.↗

Assessment of proposed fighter agility metrics

This paper presents the results of an analysis of proposed metrics to assess fighter aircraft agility. A novel framework for classifying these metrics is developed and applied. A set of transient metrics intended to quantify the axial and pitch agility of fighter aircraft is evaluated with a high fidelity, nonlinear F-18 simulation. Test techniques and data reduction method are proposed, and sensitivities to pilot introduced errors during flight testing is investigated. Results indicate that the power onset and power loss parameters are promising candidates for quantifying axial agility, while maximum pitch up and pitch down rates are for quantifying pitch agility.

Liefer, Randall K.↗

A test manager's perspective of a test concept for a heavy lift vehicle

The developmment of a test concept is a significant part of the advanced planning activities accomplished for the Initial Operational Test and Evaluation (IOT&E) of new systems. A test concept is generally viewed as a description, including rationale, of the test structure, evaluation methodology and management approach required to plan and conduct the IOT&E of a program such as a new heavy lift launch vehicle system. The test concept as presented in this paper is made up of an operations area, a test area, an evaluation area, and a management area. The description presented here is written from the perspective of one test manager, and represents his views of a possible framework of a test concept using examples for a potential IOT&E of a heavy lift launch vehicle.

Pargeon, John I., Jr.↗

Optimization Based Efficiencies in First Order Reliability Analysis

This paper develops a method for updating the gradient vector of the limit state function in reliability analysis using Broyden's rank one updating technique. In problems that use commercial code as a black box, the gradient calculations are usually done using a finite difference approach, which becomes very expensive for large system models. The proposed method replaces the finite difference gradient calculations in a standard first order reliability method (FORM) with Broyden's Quasi-Newton technique. The resulting algorithm of Broyden updates within a FORM framework (BFORM) is used to run several example problems, and the results compared to standard FORM results. It is found that BFORM typically requires fewer functional evaluations that FORM to converge to the same answer.

Peck, Jeffrey A.↗

Onboard Nonlinear Engine Sensor and Component Fault Diagnosis and Isolation Scheme

A method detects and isolates in-flight sensor, actuator, and component faults for advanced propulsion systems. In sharp contrast to many conventional methods, which deal with either sensor fault or component fault, but not both, this method considers sensor fault, actuator fault, and component fault under one systemic and unified framework. The proposed solution consists of two main components: a bank of real-time, nonlinear adaptive fault diagnostic estimators for residual generation, and a residual evaluation module that includes adaptive thresholds and a Transferable Belief Model (TBM)-based residual evaluation scheme. By employing a nonlinear adaptive learning architecture, the developed approach is capable of directly dealing with nonlinear engine models and nonlinear faults without the need of linearization. Software modules have been developed and evaluated with the NASA C-MAPSS engine model. Several typical engine-fault modes, including a subset of sensor/actuator/components faults, were tested with a mild transient operation scenario. The simulation results demonstrated that the algorithm was able to successfully detect and isolate all simulated faults as long as the fault magnitudes were larger than the minimum detectable/isolable sizes, and no misdiagnosis occurred

Tang, Liang↗