Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “evaluation framework”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 829 records · Page 46

Framework for Defining and Assessing Benefits of a Modular Assembly Design Approach for Exploration Systems

A comprehensive modular assembly system model has been proposed that extends the art from modular hardware, to include in-space assembly, servicing and repair and it s critical components of infrastructure, agents and assembly operations. Benefits of modular assembly have been identified and a set of metrics defined that extends the art beyond the traditional measures of performance, with emphasis on criteria that allow life-cycle mission costs to be used as a figure of merit (and include all substantive terms that have an impact on the evaluation). The modular assembly approach was used as a basis for developing a Solar Electric Transfer Vehicle (SETV) concept and three modular assembly scenarios were developed. The modular assembly approach also allows the SETV to be entered into service much earlier than competing conventional configurations and results in a great deal of versatility in accommodating different launch vehicle payload capabilities, allowing for modules to be pre-assembled before launch or assembled on orbit, without changing the space vehicle design.

Dorsey, John T.↗

On stress analysis of a crack-layer

This work considers the problem of elastic interaction of a macrocrack with an array of microcracks in the vicinity of the macrocrack tip. Using the double layer potential techniques, the solution to the problem within the framework of the plane problem of elastostatics has been obtained. Three particular problems of interest to fracture mechanics have been analyzed. It follows from analysis that microcrack array can either amplify or reduce the resulting stress field of the macrocrack-microcrack array system depending on the array's configuration. Using the obtained elastic solution the energy release rate associated with the translational motion of the macrocrack-microcrack array system has been evaluated.

Chudnovsky, A.↗

Advanced controls for stability assessment of solar dynamics space power generation

In support of the power requirements for the Space Station Alpha (SSA), a joint program by the U.S. and Russia for a permanently manned space station to be launched into orbit by 1998, a robust control scheme is needed to assure the stability of the rotating machines that will be integrated into the power subsystem. A framework design and systems studies for modeling and analysis is presented. It employs classical d-q axes machine model with voltage/frequency dependent loads. To guarantee that design requirements and necessary trade studies are done, a functional analysis tool CORE is used for the study. This provides us with different control options for stability assessment. Initial studies and recommendations using advanced simulation tools are also presented. The benefits of the stability/control scheme for evaluating future designs and power management are discussed.

Momoh, James A.↗

Three-Dimensional Navier-Stokes Calculations Using the Modified Space-Time CESE Method

The space-time conservation element solution element (CESE) method is modified to address the robustness issues of high-aspect-ratio, viscous, near-wall meshes. In this new approach, the dependent variable gradients are evaluated using element edges and the corresponding neighboring solution elements while keeping the original flux integration procedure intact. As such, the excellent flux conservation property is retained and the new edge-based gradients evaluation significantly improves the robustness for high-aspect ratio meshes frequently encountered in three-dimensional, Navier-Stokes calculations. The order of accuracy of the proposed method is demonstrated for oblique acoustic wave propagation, shock-wave interaction, and hypersonic flows over a blunt body. The confirmed second-order convergence along with the enhanced robustness in handling hypersonic blunt body flow calculations makes the proposed approach a very competitive CFD framework for 3D Navier-Stokes simulations.

Chang, Chau-lyan↗

Uncertainty Aware Structural Topology Optimization Via a Stochastic Reduced Order Model Approach

This work presents a stochastic reduced order modeling strategy for the quantification and propagation of uncertainties in topology optimization. Uncertainty aware optimization problems can be computationally complex due to the substantial number of model evaluations that are necessary to accurately quantify and propagate uncertainties. This computational complexity is greatly magnified if a high-fidelity, physics-based numerical model is used for the topology optimization calculations. Stochastic reduced order model (SROM) methods are applied here to effectively 1) alleviate the prohibitive computational cost associated with an uncertainty aware topology optimization problem; and 2) quantify and propagate the inherent uncertainties due to design imperfections. A generic SROM framework that transforms the uncertainty aware, stochastic topology optimization problem into a deterministic optimization problem that relies only on independent calls to a deterministic numerical model is presented. This approach facilitates the use of existing optimization and modeling tools to accurately solve the uncertainty aware topology optimization problems in a fraction of the computational demand required by Monte Carlo methods. Finally, an example in structural topology optimization is presented to demonstrate the effectiveness of the proposed uncertainty aware structural topology optimization approach.

Aguilo, Miguel A.↗

Developing a soil inversion model framework for regional permafrost monitoring

Currently, the community lacks capabilities to assess and monitor landscape scale permafrost active layer dynamics over large extents. To address this need, we developed a concept of a remote sensing based Soil Inversion Model for regional Permafrost (SIM-P) monitoring. The current SIM-P framework includes a satellite-based soil process model and a soil dielectric model. We are also working on incorporating a radar scattering model for Arctic tundra into the SIM-P framework. A unified soil parameterization scheme was developed to harmonize key soil thermal, hydraulic and dielectric parameters in the soil process and radar models that can be used in the joint soil-radar inversion framework. The soil parameter retrievals of the SIM-P framework include soil organic content (SOC) and active layer thickness (ALT). Initial tests of SIM-P using in-situ soil permittivity observations showed reasonable accuracy in predicting site-level SOC and soil temperature profiles at an Alaska tundra site and ALT in Arctic Alaska. SIM-P will be further tested using airborne P- and L-band radar data collected during NASA’s Arctic Boreal Vulnerability Experiment (ABoVE) to evaluate the sensitivity of longwave radar to active layer properties.

Miller, Charles E.↗

Homogenized Ground-Based and Profile Ozone Datasets From the TOAR-II/HEGIFTOM Project: Methods and Station Trends

Within the framework of the second phase of the Tropospheric Ozone Assessment Report (TOAR-II), it was recognized that an essential first step for deriving accurate trends from the ground-based networks that monitor ozone in the free troposphere is putting the measurements on the same basis with respect to absolute references and processing methods. The relevant procedures are referred to as “harmonization” or “homogenization”. The TOAR II working group, “HEGIFTOM” (Harmonization and Evaluation of Ground-based Instruments for Free-Tropospheric Ozone Measurements), has carried out harmonization for five types of network (Figure below) instruments (mid-1990s to 2020): ozonesondes, commercial aircraft IAGOS landing/takeoff profiles, Fourier-Transform Infrared spectrometer (FTIR), tropospheric Lidar, and Brewer/Dobson Umkehr. First, we summarize the homogenization effort for each network that provides new quality-assessed ozone profile or segment (partial column) data sets, including uncertainty estimates and quality flags. Second, with the HEGIFTOM datasets forming the basis for a global assessment of tropospheric ozone column trends, results derived with various trend detection algorithms will be presented. The ultimate goal is evaluation of the consistency of the calculated trends among different techniques at selected stations and/or regions.

ozone↗

Implementing an Objectives-Driven, Risk-Informed, and Case-Assured Approach to Safety and Mission Success at NASA

NASA is developing a “Standard for Assurance of Space Flight Safety and Mission Success” that implements an objectives-driven, risk-informed, and case-assured approach to safety and mission success (S&MS) for NASA space flight programs and projects. The standard aligns with the philosophy of risk leadership that has recently been established in NASA policy to assure acceptable levels of flight crew safety and mission success risk. It is consistent with existing NASA risk management requirements and is compatible with NASA program management and systems engineering requirements. The methodology described in the standard is presented in terms of an S&MS assurance framework that is designed to allow substantial flexibility in the specific means by which programs and projects achieve acceptable mission S&MS risk. Such flexibility is necessary to accommodate the increasingly broad range of acquisition strategies employed by NASA, including commercial transportation services, as well as to accommodate the increasingly rapid evolution of space flight-related technologies and practices. A key feature of the S&MS assurance framework is the specification of S&MS success criteria for each life-cycle review (LCR). The S&MS assurance case is structured around these criteria, the satisfaction of which indicates that the program/project is adhering to the S&MS risk posture. This enables the evolving S&MS assurance case to be used as a fundamental program/project submittal at each LCR, where its inherent structure of argument, supported by evidence, directly supports the evaluation of the program/project with respect to the S&MS success criteria, and by extension, the S&MS risk posture. As such, the S&MS assurance case is integral to program/project systems engineering, risk management, and S&MS oversight activities, and provides the principal basis for S&MS risk acceptance by the Decision Authority throughout the program/project life cycle.

Risk Posture↗

Verification and Tuning of an Adaptive Controller for an Unmanned Air Vehicle

This paper focuses on the analysis and tuning of a controller based on the Adaptive Control Technology for Safe Flight (ACTS) architecture. The ACTS architecture consists of a nominal, non-adaptive controller that provides satisfactory performance under nominal flying conditions, and an adaptive controller that provides robustness under off-nominal ones. A framework unifying control verification and gain tuning is used to make the controller s ability to satisfy the closed-loop requirements more robust to uncertainty. In this paper we tune the gains of both controllers using this approach. Some advantages and drawbacks of adaptation are identified by performing a global robustness assessment of both the adaptive controller and its non-adaptive counterpart. The analyses used to determine these characteristics are based on evaluating the degradation in closed-loop performance resulting from uncertainties having increasing levels of severity. The specific adverse conditions considered can be grouped into three categories: aerodynamic uncertainties, structural damage, and actuator failures. These failures include partial and total loss of control effectiveness, locked-in-place control surface deflections, and engine out conditions. The requirements considered are the peak structural loading, the ability of the controller to track pilot commands, the ability of the controller to keep the aircraft s state within the reliable flight envelope, and the handling/riding qualities of the aircraft. The nominal controller resulting from these tuning strategies was successfully validated using the NASA GTM Flight Test Vehicle.

Crespo, Luis G.↗

Interpretable Categorization of Heterogeneous Time Series Data

We analyze data from simulated aircraft encounters to validate and inform the development of a prototype aircraft collision avoidance system. The high-dimensional and heterogeneous time series dataset is analyzed to discover properties of near mid-air collisions (NMACs) and categorize the NMAC encounters. Domain experts use these properties to better organize and understand NMAC occurrences. Existing solutions either are not capable of handling high-dimensional and heterogeneous time series datasets or do not provide explanations that are interpretable by a domain expert. The latter is critical to the acceptance and deployment of safety-critical systems. To address this gap, we propose grammar-based decision trees along with a learning algorithm. Our approach extends decision trees with a grammar framework for classifying heterogeneous time series data. A context-free grammar is used to derive decision expressions that are interpretable, application-specific, and support heterogeneous data types. In addition to classification, we show how grammar-based decision trees can also be used for categorization, which is a combination of clustering and generating interpretable explanations for each cluster. We apply grammar-based decision trees to a simulated aircraft encounter dataset and evaluate the performance of four variants of our learning algorithm. The best algorithm is used to analyze and categorize near mid-air collisions in the aircraft encounter dataset. We describe each discovered category in detail and discuss its relevance to aircraft collision avoidance.

Drones↗

Evaluating Approaches Relating Ecosystem Productivity with Desis Spectral Information

Data from the DLR Earth Sensing Imaging Spectrometer (DESIS), mounted on the International Space Station (ISS), were used to develop and test algorithms for remotely retrieving ecosystem productivity. Twenty DESIS images were used from three widely separated forested study sites representing deciduous and conifer forests. Gross primary production (GPP) values from eddy covariance flux towers at the sites were matched with DESIS spectral reflectances collected on the same days. Multiple algorithms were successful relating spectral reflectance with GPP, including: spectral vegetation indices (SVI) sensitive to chlorophyll content, SVI used in a photosynthetic light-use efficiency model framework, spectral shape characteristics through spectral derivatives and absorption feature analysis, and statistical models leading to multiband hyperspectral indices from partial least squares regression. Successful algorithms were able to achieve R2 better than 0.7 using a diverse set of observations combining data from different sites from multiple years and at multiple times during the year. The demonstrated robustness of the algorithms provides some confidence in using DESIS imagery to map spatial patterns of GPP.

K F Huemmrich↗

Evaluating Approaches Relating Ecosystem Productivity with DESIS Spectral Information

Data from the DLR Earth Sensing Imaging Spectrometer (DESIS), mounted on the International Space Station (ISS), were used to develop and test algorithms for remotely retrieving ecosystem productivity. Twenty DESIS images were used from three widely separated forested study sites representing deciduous and conifer forests. Gross primary production (GPP) values from eddy covariance flux towers at the sites were matched with DESIS spectral reflectances collected on the same days. Multiple algorithms were successful relating spectral reflectance with GPP, including: spectral vegetation indices (SVI) sensitive to chlorophyll content, SVI used in a photosynthetic light-use efficiency model framework, spectral shape characteristics through spectral derivatives and absorption feature analysis, and statistical models leading to multiband hyperspectral indices from partial least squares regression. Successful algorithms were able to achieve R2 better than 0.7 using a diverse set of observations combining data from different sites from multiple years and at multiple times during the year. The demonstrated robustness of the algorithms provides some confidence in using DESIS imagery to map spatial patterns of GPP.

Gross Primary Productivity (GPP)↗

Preconditioning of overcast-to-broken cloud transitions by riming in marine cold air outbreaks

Marine cold air outbreaks (CAOs) commonly form overcast cloud decks that transition into broken cloud fields downwind, dramatically altering the local radiation budget. In this study, we investigate the impact of frozen hydrometeors on these transitions. We focus on a CAO case in the NW Atlantic, the location of the multi-year flight campaign ACTIVATE (Aerosol Cloud meTeorology Interactions oVer the western ATlantic Experiment). We use MERRA-2 (Modern-Era Retrospective analysis for Research and Applications, version 2) reanalysis fields to drive large eddy simulations with mixed-phase two-moment microphysics in a Lagrangian framework. We find that transitions are triggered by substantial rain (rainwater paths >25 g m−2), and only simulations that allow for aerosol depletion result in sustained breakups, as observed. Using a range of diagnostic ice nucleating particle concentrations, Ninp, we find that increasing ice progressively accelerates transitions, thus abbreviating the overcast state. Ice particles affect the cloud-topped boundary layer evolution, primarily through riming-related processes prior to substantial rain, leading to (1) a reduction in cloud liquid water, (2) early consumption of cloud condensation nuclei, and (3) early and light precipitation cooling and moistening below cloud. We refer to these three effects collectively as “preconditioning by riming”. Greater boundary layer aerosol concentrations available as cloud condensation nuclei (CCN) delay the onset of substantial rain. However, cloud breakup and low CCN concentration final stages are found to be inevitable in this case, due, primarily, to liquid water path buildup. An ice-modulated cloud transition speed suggests the possibility of a negative cloud–climate feedback. To address prevailing uncertainties in the model representation of mixed-phase processes, the magnitude of ice formation and riming impacts and, thereby, the strength of an associated negative cloud–climate feedback process, requires further observational evaluation by targeting riming hot spots with in situ imaging probes that allow for both the characterization of ice particles and abundance of supercooled droplets.

Marine cold air outbreaks↗

Task allocation in a distributed computing system

A conceptual framework is examined for task allocation in distributed systems. Application and computing system parameters critical to task allocation decision processes are discussed. Task allocation techniques are addressed which focus on achieving a balance in the load distribution among the system's processors. Equalization of computing load among the processing elements is the goal. Examples of system performance are presented for specific applications. Both static and dynamic allocation of tasks are considered and system performance is evaluated using different task allocation methodologies.

Seward, Walter D.↗

Health management system for rocket engines

The functional framework of a failure detection algorithm for the Space Shuttle Main Engine (SSME) is developed. The basic algorithm is based only on existing SSME measurements. Supplemental measurements, expected to enhance failure detection effectiveness, are identified. To support the algorithm development, a figure of merit is defined to estimate the likelihood of SSME criticality 1 failure modes and the failure modes are ranked in order of likelihood of occurrence. Nine classes of failure detection strategies are evaluated and promising features are extracted as the basis for the failure detection algorithm. The failure detection algorithm provides early warning capabilities for a wide variety of SSME failure modes. Preliminary algorithm evaluation, using data from three SSME failures representing three different failure types, demonstrated indications of imminent catastrophic failure well in advance of redline cutoff in all three cases.

Nemeth, Edward↗

Interrelation Between Safety Factors and Reliability

An evaluation was performed to establish relationships between safety factors and reliability relationships. Results obtained show that the use of the safety factor is not contradictory to the employment of the probabilistic methods. In many cases the safety factors can be directly expressed by the required reliability levels. However, there is a major difference that must be emphasized: whereas the safety factors are allocated in an ad hoc manner, the probabilistic approach offers a unified mathematical framework. The establishment of the interrelation between the concepts opens an avenue to specify safety factors based on reliability. In cases where there are several forms of failure, then the allocation of safety factors should he based on having the same reliability associated with each failure mode. This immediately suggests that by the probabilistic methods the existing over-design or under-design can be eliminated. The report includes three parts: Part 1-Random Actual Stress and Deterministic Yield Stress; Part 2-Deterministic Actual Stress and Random Yield Stress; Part 3-Both Actual Stress and Yield Stress Are Random.

Elishakoff, Isaac↗

Sensitivity of Cirrus Properties to Ice Nuclei Abundance

The relative importance of heterogeneous and homogeneous ice nucleation for cirrus formation remains an active area of debate in the cloud physics community. From a theoretical perspective, a number of modeling studies have investigated the sensitivity of ice number concentration to the nucleation mechanism and the abundance of ice nuclei. However, these studies typically only addressed ice concentration immediately after ice nucleation. Recent modeling work has shown that the high ice concentrations produced by homogeneous freezing may not persist very long, which is consistent with the low frequency of occurrence of high ice concentrations indicated by cirrus measurements. Here, I use idealized simulations to investigate the impact of ice nucleation mechanism and ice nuclei abundance on the full lifecycle of cirrus clouds. The primary modeling framework used includes different modes of ice nucleation, deposition growth/sublimation, aggregation, sedimentation, and radiation. A limited number of cloud-resolving simulations that treat radiation/dynamics interactions will also been presented. I will show that for typical synoptic situations with mesoscale waves present, the time-averaged cirrus ice crystal size distributions and bulk cloud properties are less sensitive to ice nucleation processes than might be expected from the earlier simple ice nucleation calculations. I will evaluate the magnitude of the ice nuclei impact on cirrus for a range of temperatures and mesoscale wave specifications, and I will discuss the implications for cirrus aerosol indirect effects in general.

Nuclei↗

Applications and Performance of a Lightning Risk Assessment using Geostationary Lightning Mapper (GLM) Data

Lightning is a hazard globally, particularly in lesser-developed countries. Cloud-to-ground lightning strikes are a threat to human safety, motivating a desire to monitor location-based lightning risk to mitigate harm. A lightning risk assessment for human safety was created that uses a combination of probabilistic risk calculation and spatial lightning mapping data to produce a risk magnitude. This risk magnitude evolves with time and changing conditions and is compared to tolerability thresholds in order to evaluate safety. The risk assessment using lightning mapping array (LMA) flash extent density (FED) data was found to perform comparatively (with respect to issuing lightning warnings) to a more standard method of monitoring lightning safety where National Lightning Detection Network (NLDN) flashes were monitored within a 5 nautical mile radius of a location of interest. This research investigates the replacement of LMA FED with FED from the Geostationary Lightning Mapper (GLM) within the risk assessment framework. Using GLM FED would allow for risk to be calculated outside of LMA domains and anywhere within the GLM field of view, including areas outside of the United States (US). A few applications of the risk method with GLM FED are shown and discussed for locations both in and outside of the US. Additionally, the performance of the risk method is compared based on the type of lightning input source (LMA vs GLM). The end goal of this work is to provide forecasters and end users with a tool to help monitor lightning risk in decision support scenarios.

Kelley Murphy↗