Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “qualitative evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 739 records · Page 41

Usability Evaluation of Fleet Management Interface for High Density Vertiplex Environments

To meet the rising demand for an Advanced Air Mobility (AAM) (i.e. urban and rural unmanned aircraft systems) ecosystem, the NASA Aeronautics Research Mission Directorate (ARMD) is hosting a series of simulations and flight tests under the High Density Vertiplex sub-project (HDV) to prototype and study the effectiveness AAM capabilities under various operational contexts. HDV aims to develop an integrated automation architecture to support terminal area flight operations. The HDV simulations and flight tests address safety, integration, and operational challenges, while integrated systems and software demonstrate design readiness, robustness, and interoperability. During the initial HDV simulation in 2021, a prototype traffic management tool developed by NASA called the Fleet Management Interface (FMI) was tested. FMI was designed to introduce an advanced level of human-automation interaction to aid both Ground Control Station Operators (GCSOs) and Fleet Managers (FMs) in remotely managing flights under their ownership. In a human-in-the-loop simulation, a usability study was conducted with the FMI to identify optimal approaches for displaying information to human operators using subjective measures of usability, workload, situation awareness, risk, and trust, along with qualitative feedback. This study consisted of task analysis in which GCSO and FM subjects used an Urban Air Mobility (UAM) environment to develop and execute a plan for two different traffic scenarios of remotely controlled vehicles. In each scenario, a remotely controlled vehicle completed a takeoff, active flight, and landing sequence while simulated traffic flew in the background at a rate of 20 operations per hour. In the first scenario, the controlled vehicle flew a nominal route with takeoff and landing at the same vertiport. In the second scenario, the controlled vehicle started on the nominal route, then diverted to an unplanned location mid-flight. Results showed that self- reported performance, usability, trust, and situation awareness ratings of FMI were moderately to strongly high. There were small differences between scenarios, with Scenario 2 being perceived as more unstable, complex, variable, risky, and potentially harmful than Scenario 1. Furthermore, participants described improvements that could be made to create a better user experience. For example, users suggested customizable interfaces to accommodate information display preferences, and the ability to review routes before assigning them. The results from this study will inform future development of the FMI with the end goal of creating a reference automation tool for airspace management procedures in AAM. The FMI could serve to reduce dependency on traditional air navigation services through increased automation in high density vertiplex environments.

Fleet manager↗

A metric framework for evaluating the resilience contribution of hydropower to the grid

This paper will describe a proposed framework for expressing the resilience of hydropower generation and provide initial case studies for three classes of hydropower, run-of-river hydropower, hydropower with reservoirs, and pumped storage hydropower. Hydropower has great flexibility to provide support during and after natural and man-made events that can disrupt critical infrastructure functionality. The concept of the framework provides for consideration of policy and rules, constraints of the water shed and other allocations of water, storage and plant capabilities to produce real and reactive power, and the strength of the delivery network. The paper details a resilience response metric that has inputs of state of storage and plant level constraints on real and reactive power production. Using the definition of resilience, based on maintaining a minimally normal operations, we provide a qualitative assessment of hydropower’s ability to address the various time scales comprising the “R”s of resilience.

13 HYDRO ENERGY↗

Risk Assessment and Management Workflow—An Example of the Southwest Regional Partnership

This paper summarizes the risk assessment and management workflow developed and applied to the Southwest Regional Partnership on Carbon Sequestration (SWP) Phase III Demonstration Project. The risk assessment and management workflow consists of six primary tasks, including management planning, identification, qualitative analysis, quantitative analysis, response planning, and monitoring. Within the workflow, the SWP assembled and iteratively updated a risk registry that identifies risks for all major activities of the project. Risk elements were ranked with respect to the potential impact to the project and the likelihood of occurrence. Both qualitative and quantitative risk analyses were performed. To graphically depict the interactions among risk elements and help building risk scenarios, process influence diagrams were used to represent the interactions. The SWP employed quantitative methods of risk analysis including Response Surface Method (RSM), Polynomial Chaos Expansion (PCE), and the National Risk Assessment Partnership (NRAP) toolset. The SWP also developed risk response planning and performed risk control and monitoring to prevent the risks from affecting the project and ensure the effectiveness of risk management. As part of risk control and monitoring, existing and new risks have been tracked and the response plan was subsequently evaluated. Findings and lessons learned from the SWP’s risk assessment and management efforts will provide valuable information for other commercial geological CO2 storage projects.

Lee, Si-Yong↗

Multi-Dimensional Measurements of Combustion Species in Flame Tube and Sector Gas Turbine Combustors

The higher temperature and pressure cycles of future aviation gas turbine combustors challenge designers to produce combustors that minimize their environmental impact while maintaining high operation efficiency. The development of low emissions combustors includes the reduction of unburned hydrocarbons, smoke, and particulates, as well as the reduction of oxides of nitrogen (NO(x)). In order to better understand and control the mechanisms that produce emissions, tools are needed to aid the development of combustor hardware. Current methods of measuring species within gas turbine combustors use extractive sampling of combustion gases to determine major species concentrations and to infer the bulk flame temperature. These methods cannot be used to measure unstable combustion products and have poor spatial and temporal resolution. The intrusive nature of gas sampling may also disturb the flow structure within a combustor. Planar laser-induced fluorescence (PLIF) is an optical technique for the measurement of combustion species. In addition to its non-intrusive nature, PLIF offers these advantages over gas sampling: high spatial resolution, high temporal resolution, the ability to measure unstable species, and the potential to measure combustion temperature. This thesis considers PLIF for in-situ visualization of combustion species as a tool for the design and evaluation of gas turbine combustor subcomponents. This work constitutes the first application of PLIF to the severe environment found in liquid-fueled, aviation gas turbine combustors. Technical and applied challenges are discussed. PLIF of OH was used to observe the flame structure within the post flame zone of a flame tube combustor, and within the flame zone of a sector combustor, for a variety of fuel injector configurations. OH was selected for measurement because it is a major combustion intermediate, playing a key role in the chemistry of combustion, and because its presence within the flame zone can serve as a qualitative marker of flame temperature. All images were taken in the environment of actual engines during flight, using actual jet fuel. The results of the PLIF study led directly to the modification of a fuel injector.

Hicks, Yolanda Royce↗

Experimental Hypersonic Aerodynamic Characteristics of the Space Shuttle Orbiter for a Range of Damage Scenarios

Aerodynamic tests in support of the Columbia accident investigation were conducted in two hypersonic wind tunnels at the NASA Langley Research Center, the 20-Inch Mach 6 Air Tunnel and the 20-Inch Mach 6 CF4 Tunnel. The primary purpose of these tests was to measure the forces and moments generated by a variety of outer mold line alterations (damage scenarios) using 0.0075-scale models of the Space Shuttle Orbiter (approximately 10 inches in length). Simultaneously acquired global heat transfer mappings were obtained for a majority of the configurations tested. Test parameters include angles of attack from 38 to 42 deg, unit Reynolds numbers from 0.26 to 3.0 x10^6 per foot, and normal shock density ratios of 5 (Mach 6 air) and 12 (Mach 6 CF4). The damage scenarios evaluated included asymmetric boundary layer transition, gouges in the windward surface acreage thermal protection system tiles, wing leading edge damage (partially and fully missing reinforced carbon-carbon (RCC) panels), holes through the wing from the windward surface to the leeside, deformation of the wing windward surface, and main landing gear door and/or gear deployment. The aerodynamic data were compared to the magnitudes and directions observed in flight, and the heating images were evaluated in terms of the location of the generated disturbances and how these disturbance might relate to the response of discrete gages on the Columbia Orbiter vehicle during entry. The measured aerodynamic increments were generally small in magnitude, as were the flight-derived values during most of the entry. Asymmetric boundary layer transition (ABLT) results were consistent with the flight-derived Shuttle ABLT model, but not with the observed flight trends for STS-107. The partially missing leading edge panel results best matched both the early aerodynamic and heating trends observed in flight. A progressive damage scenario is presented that qualitatively matches the flight observations for the full entry.

Brauckman, Gregory J.↗

Criticality Consideration for Geologic Disposal of DOE-Owned Spent Nuclear Fuels - 20255

Decisions must be made relative to packaging spent nuclear fuel (SNF) for storage, transportation, and eventual disposal. This paper evaluates potential criticality-related loading and packaging considerations for Department of Energy (DOE)-owned SNF that could be impacted favorably or unfavorably by disposal uncertainties and proposes approaches to minimize such impacts. Using Al-Based SNF as an example and drawing on analyses performed in support of the Yucca Mountain Repository License Application (LA), this paper explores the role of natural barriers, engineered barriers, and waste form characteristics relative to reducing the potential for postclosure criticality. Several parameters important to postclosure criticality are considered in order to determine which are useful discriminators to support packaging decisions. Using these parameters, a qualitative assessment is performed relative to three options for managing DOE-owned SNFs. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Reducing the Uncertainties in Direct Aerosol Radiative Forcing

Airborne particles, which include desert and soil dust, wildfire smoke, sea salt, volcanic ash, black carbon, natural and anthropogenic sulfate, nitrate, and organic aerosol, affect Earth's climate, in part by reflecting and absorbing sunlight. This paper reviews current status, and evaluates future prospects for reducing the uncertainty aerosols contribute to the energy budget of Earth, which at present represents a leading factor limiting the quality of climate predictions. Information from satellites is critical for this work, because they provide frequent, global coverage of the diverse and variable atmospheric aerosol load. Both aerosol amount and type must be determined. Satellites are very close to measuring aerosol amount at the level-of-accuracy needed, but aerosol type, especially how bright the airborne particles are, cannot be constrained adequately by current techniques. However, satellite instruments can map out aerosol air mass type, which is a qualitative classification rather than a quantitative measurement, and targeted suborbital measurements can provide the required particle property detail. So combining satellite and suborbital measurements, and then using this combination to constrain climate models, will produce a major advance in climate prediction.

Kahn, Ralph A.↗

The Milky Way’s bulge star formation history as constrained from its bimodal chemical abundance distribution

ABSTRACT We conduct a quantitative analysis of the star formation history (SFH) of the Milky Way’s (MW) bulge by exploiting the constraining power of its stellar [Fe/H] and [Mg/Fe] distribution functions. Using Apache Point Observatory Galactic Evolution Experiment survey data, we confirm the previously established bimodal [Mg/Fe]–[Fe/H] distribution within 3 kpc of the inner Galaxy. To fit the chemical bimodal distribution, we use a simple but flexible star formation framework, which assumes two distinct stages of gas accretion and star formation, and systematically evaluate a wide multidimensional parameter space. We find that the data favour a three-phase SFH that consists of an initial starburst, followed by a rapid star formation quenching episode, and a lengthy, quiescent secular evolution phase. The metal-poor, high-α bulge stars ([Fe/H] < 0.0 and [Mg/Fe] > 0.15) are formed rapidly (<2 Gyr) during the early starburst. The density gap between the high- and low-α sequences is due to the quenching process. The metal-rich, low-α population ([Fe/H] > 0.0 and [Mg/Fe] < 0.15) then accumulates gradually through inefficient star formation during the secular phase. This is qualitatively consistent with the early SFH of the inner disc. Given this scenario, a notable fraction of young stars (age <5 Gyr) is expected to persist in the bulge. Combined with extragalactic observations, these results suggest that a rapid star formation quenching process is responsible for bimodal distributions in both the MW’s stellar populations and in the general galaxy population and thus plays a critical role in galaxy evolution.

Lian, Jianhui↗

Development of Risk Assessment Matrix for NASA Engineering and Safety Center

This paper describes a study, which had as its principal goal the development of a sufficiently detailed 5 x 5 Risk Matrix Scorecard. The purpose of this scorecard is to outline the criteria by which technical issues can be qualitatively and initially prioritized. The tool using this score card has been proposed to be one of the information resources the NASA Engineering and Safety Center (NESC) takes into consideration when making decisions with respect to incoming information on safety concerns across the entire NASA agency. The contents of this paper discuss in detail each element of the risk matrix scorecard, definitions for those elements and the rationale behind the development of those definitions. This scorecard development was performed in parallel with the tailoring of the existing Futron Corporation Integrated Risk Management Application (IRMA) software tool. IRMA was tailored to fit NESC needs for evaluating incoming safety concerns and was renamed NESC Assessment Risk Management Application (NAFMA) which is still in developmental phase.

Malone, Roy W., Jr.↗

Evaluation of silicon carbide as a divertor armor material in DIII-D H-mode discharges

Silicon carbide (SiC) represents a promising but largely untested plasma-facing material (PFM) for next-step fusion devices. In this work, an analytic mixed-material erosion model is developed by calculating the physical (via SDTrimSP) and chemical (via empirical scalings) sputtering yield from SiC, Si, and C. The Si content in the near-surface SiC layer is predicted to increase during D plasma bombardment due to more efficient physical and chemical sputtering of C relative to Si. Silicon erosion from SiC thereby occurs primarily from sputtering of the enriched Si layer, rather than directly from the SiC itself. SiC coatings on ATJ graphite, manufactured via chemical vapor deposition, were exposed to repeated H-mode plasma discharges in the DIII-D tokamak to test this model. The qualitative trends from analytic modeling are reproduced by the experimental measurements, obtained via spectroscopic inference using the S/XB method. Quantitatively the model slightly under-predicts measured erosion rates, which is attributed to uncertainties in the ion impact angle distribution, as well as the effect of edge-localized modes. After exposure, minimal changes to the macroscopic or microscopic surface morphology of the SiC coatings were observed. Compositional analysis reveals Si enrichment of about 10%, in line with expectations from the erosion model. Extrapolating to a DEMO-type device, an order-of-magnitude decrease in impurity sourcing, and up to a factor of 2 decrease in impurity radiation, is expected with SiC walls, relative to graphite, if low C plasma impurity content can be achieved. Furthermore, these favorable erosion properties motivate further investigations of SiC as a low-Z, non-metallic PFM.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

System identity and transformation in petroleum jurisdictions: A multi-method approach for the North Slope Borough, Alaska

Capturing the multidimensionality of a bounded social-environmental system (SES) presents a range of challenges to interdisciplinary researchers due to the need to integrate divergent scientific paradigms, scalar data, and social theories. Contemporary Arctic circumpolar SESs studied under conditions of rapid and unprecedented climatic, ecological, economic, and sociopolitical change, defy any singular established methodological approach that aims to schematize and interpret the system for decision-making purposes. As a small interdisciplinary team working within a large Arctic SES modeling effort, we have found that developing systems models to support resilience in the Arctic requires an understanding of system dynamics that is attentive to holistic indicators of change, measured both quantitatively and qualitatively. Using the Alaska North Slope Borough as a case study, we apply three convergent frameworks to capture significant dimensions of the system for improved problem definition in confronting the challenges of Arctic climate change. We describe contemporary “oil and gas” social-ecological system components and dynamics, the historical processes and transformations that fundamentally altered the system, and the scientific projections for the most likely catalysts of future change. This analysis results in a typology for defining subnational Arctic hydrocarbon SESs. We conclude that the future of oil and gas development as a policy pathway in different locations experiencing rapid climate change can be evaluated when difficult-to-quantify variables are included.

Lovecraft, Amy Lauren↗

Investigating Scientific Data Change with User Research Methods

Scientific datasets are continually expanding and changing due to fluctuations with instruments, quality assessment and quality control processes, and modifications to software pipelines. Datasets include minimal information about these changes or their effects requiring scientists manually assess modifications through a number of labor intensive and ad-hoc steps. The Deduce project is investigating data change to develop metrics, methods, and tools that will help scientists systematically identify and make decisions around data changes. Currently, there is a lack of understanding, and common practices, for identifying and evaluating changes in datasets since systematically measuring and managing data change is under explored in scientific work. We are conducting user research to address this need by exploring scientist's conceptualizations, behaviors, needs, and motivations when dealing with changing datasets. Our user research utilizes multiple methods to produce foundational, generative insights and evaluate research products produced by our team. In this paper, we detail our user research process and outline our findings about data change that emerge from our studies. Our work illustrates how scientific software teams can push beyond just usability testing user interfaces or tools to better probe the underlying ideas they are developing solutions to address.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

Symmetry Breaking and the B3LYP Functional

The infrared spectra of six molecules, each of which contains a five-membered ring, and their cations are determined using density functional theory (DFT); both the B3LYP and BP86 functionals are used. The computed results are compared with the experimental spectra. For the neutral molecules, both methods are in good agreement with experiment. Even the Hartree-Fock (HF) approach is qualitatively correct for the neutrals. For the cations, the HF approach fails, as found for other organic ring systems. The B3LYP and BP86 approaches are in good mutual agreement for five of the six cation spectra, and in good agreement with experiment for four of the five cations where the experimental spectra are available. It is only for the fluoranthene cation, where the BP86 and B3LYP functionals yield different results; the BP86 yields the expected C2v symmetry, while the B3LYP approach breaks symmetry. The experimental spectra supports the BP86 spectra over the B3LYP, but the quality of the experimental spectra does not allow a critical evaluation of the accuracy of the BP86 approach for this difficult system.

Bauschlicher, Charles W., Jr.↗

Evaluation and application of a new interferometry technique for compressible flow research

A new method for obtaining large scale interferograms of flow fields in real time was investigated. The method was based on the point diffraction interferometry technique. The method was modified to accommodate the higher laser power required in recording transonic and supersonic flow fields. Basic tests were conducted in unsteady flows and flows about circulation control airfoils at transonic speeds. It was found that vibration was not a significant factor in the application of the system. In the case of the circulation control airfoils, the real-time viewing allowed the identification of the Coanda jet interaction with the external flow and the shedding of large scale vortices. The method proved to be very sensitive to the optical quality of the wind tunnel windows. The results obtained were compared with earlier interferograms obtained using interferometry. These results were in qualitative agreement.

Bachalo, William D.↗

Projecting climate change in South America using variable‐resolution Community Earth System Model: An application to Chile

Abstract We introduce variable‐resolution enabled Community Earth System Model (VR‐CESM) results simulating historical and future climate conditions at 28 km over South America and 14 km over the Andes. Three 30‐year simulations are performed: a historic (1985–2014), a near future (2030–2059), and an end‐century (2070–2099) simulation under the RCP8.5 scenario. Historic results compare favourably to several temperature and precipitation reanalysis products, though local biases are present, particularly during austral summer. Future simulations highlight broad warming patterns (+3–6°C by end‐century) and heterogeneous precipitation responses across South America that qualitatively agree with prior modelling efforts. Our results reveal that the interaction between temperature and precipitation changes produce shifts in several Köppen–Geiger climates. Notable changes include the near‐elimination of the Andean Tundra or Alpine climates, a 15% decrease in Tropical Rainforests and a Tropical Savannah expansion of 20%. To provide a regionally focused analysis of projected climate change and to illustrate the benefits of variable resolution modelling, we analyse changes in the magnitude and trend in seasonal and daily temperature and precipitation in Chile. We also examined several metrics [e.g., snow water equivalent (SWE), temperatures on wet days, and days below 0°C] to evaluate potential impacts of climate change on the Chilean cryosphere between the end‐of‐century and historic periods, finding wide‐ranging indications of cryospheric decline. These changes are interpreted through reductions in the timing (1–2.5 months earlier peak SWE) and magnitude (200–1,000 mm SWE decreases) of water stored as snow in the Andes, a 10–30% decrease in number of cool season wet days with temperatures below 1°C, and 50–200 fewer days (annually) with minimum temperatures below 0°C. Our aim in producing a high‐resolution dataset of climate projections from VR‐CESM is to support analyses of climate change throughout South America but especially in vulnerable montane regions and to provide additional results for comparison with previous, ongoing, and upcoming modelling efforts.

variable-resolution global climate models↗

Schmid factor crack propagation and tracking crystallographic texture markers of microstructural condition in direct energy deposition additive manufacturing of Ti-6Al-4V

Metallic additive manufacturing (AM) provides a customizable and tailorable manufacturing process for new engineering designs and technologies. The greatest challenge currently facing metallic AM is maintaining control of microstructural evolution during solidification and any solid state phase transformations during the build process. Ti-6Al-4V has been extensively surveyed in this regard, with the potential solid state and solidification microstructures explored at length. In this study, we evaluate the applicability of previously determined crystallo- graphic markers of microstructural condition observed in electron beam melting powder bed fusion (PBF-EB) builds of Ti-6Al-4V in a directed energy deposition (DED) build process. The aim of this effort is to elucidate whether or not these specific crystallographic textures are useful tools for indicating microstructural conditions in AM variants beyond PBF-EB. Parent β-Ti grain size was determined to be directly related to α-Ti textures in the DED build process, and the solid state microstructural condition could be inferred from the intensity of specific α-Ti orientations. Qualitative trends on the as-solidified β-Ti grain size were also determined to be related to the presence of a fiber texture, and proposed as a marker for as-solidified grain size in any cubic metal melted by AM. Analysis of the DED Ti-6Al-4V build also demonstrated a near complete fracture of the build volume, suspected to originate from accumulated thermal stresses in the solid state. Crack propagation was found to only appreciably occur in regions of slow cooling with large α +β colonies. Schmid factors for the basal and prismatic α-Ti systems explained the observed crack pathway, including slower bifurcation in colonies with lower Schmid factors of both slip systems. Colony morphologies and localized equiaxed β-Ti solidification were also found to originate from build pauses during production and uneven heating of the build edges during deposition. Tailoring of DED Ti-6Al-4V microstructures with the insight gained here is proposed, along with cautionary insight on preventing unplanned build pauses to maintain an informed and controlled thermal environment for microstructural control.

36 MATERIALS SCIENCE↗

Thematic Mapper Data Quality and Performance Assessment in Renewable Resources/agriculture Remote Sensing

It is believed that the increased spatial resolution will provide solutions to proportion estimation error due to mixed pixels, and the increased spectral resolution will provide for the identification of important agricultural features such as crop stage, and condition. The results of analyses conducted relative to these hypothesis from sample segments extracted from the 4-band Detroit scene and the 7-band Mississippi County, Arkansas engineering test scene are described. Several studies were conducted to evaluate the geometric and radiometric performance of the TM to determine data viability for the more pertinent investigations of TM utility. In most cases this requirement was more than sufficiently satisfied. This allowed the opportunity to take advantage of detailed ground observations for several of the sample segments to assess class separability and detection of other important features with TM. The results presented regarding these TM characteristics show that not only is the increased definition of the within scene variance captured by the increased spatial and spectral resolution, but that the mid-IR bands (5 and 7) are necessary for optimum crop type classification. Both qualitative and quantitative results are presented that describe the improvements gained with the TM both relative to the MSS and on its own merit.

Bizzell, R. M.↗

Preliminary Effect of Synthetic Vision Systems Displays to Reduce Low-Visibility Loss of Control and Controlled Flight Into Terrain Accidents

An experimental investigation was conducted to study the effectiveness of Synthetic Vision Systems (SVS) flight displays as a means of eliminating Low Visibility Loss of Control (LVLOC) and Controlled Flight Into Terrain (CFIT) accidents by low time general aviation (GA) pilots. A series of basic maneuvers were performed by 18 subject pilots during transition from Visual Meteorological Conditions (VMC) to Instrument Meteorological Conditions (IMC), with continued flight into IMC, employing a fixed-based flight simulator. A total of three display concepts were employed for this evaluation. One display concept, referred to as the Attitude Indicator (AI) replicated instrumentation common in today's General Aviation (GA) aircraft. The second display concept, referred to as the Electronic Attitude Indicator (EAI), featured an enlarged attitude indicator that was more representative of a glass display that also included advanced flight symbology, such as a velocity vector. The third concept, referred to as the SVS display, was identical to the EAI except that computer-generated terrain imagery replaced the conventional blue-sky/brown-ground of the EAI. Pilot performance parameters, pilot control inputs and physiological data were recorded for post-test analysis. Situation awareness (SA) and qualitative pilot comments were obtained through questionnaires and free-form interviews administered immediately after the experimental session. Initial pilot performance data were obtained by instructor pilot observations. Physiological data (skin temperature, heart rate, and muscle flexure) were also recorded. Preliminary results indicate that far less errors were committed when using the EAI and SVS displays than when using conventional instruments. The specific data example examined in this report illustrates the benefit from SVS displays to avoid massive loss of SA conditions. All pilots acknowledged the enhanced situation awareness provided by the SVS display concept. Levels of pilot stress appear to be correlated with skin temperature measurements.

Glaab, Louis J.↗