Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Benchmark”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,351 records · Page 75

Design and Benchmarking of a Network-In-the-Loop Simulation for Use in a Hardware-In-the-Loop System

Distributed engine control (DEC) systems alter aircraft engine design constraints because of fundamental differences in the input and output communication between DEC and centralized control architectures. The change in the way communication is implemented may create new optimum engine-aircraft configurations. This paper continues the exploration of digital network communication by demonstrating a Network-In-the-Loop simulation at the NASA Glenn Research Center. This simulation incorporates a real-time network protocol, the Engine Area Distributed Interconnect Network Lite (EADIN Lite), with the Commercial Modular Aero-Propulsion System Simulation 40k (C-MAPSS40k) software. The objective of this study is to assess digital control network impact to the control system. Performance is evaluated relative to a truth model for large transient maneuvers and a typical flight profile for commercial aircraft. Results show that a decrease in network bandwidth from 250 Kbps (sampling all sensors every time step) to 40 Kbps, resulted in very small differences in control system performance.

Networked Systems↗

2016 International Land Model Benchmarking (ILAMB) Workshop Report

As earth system models (ESMs) become increasingly complex, there is a growing need for comprehensive and multi-faceted evaluation of model projections. To advance understanding of terrestrial biogeochemical processes and their interactions with hydrology and climate under conditions of increasing atmospheric carbon dioxide, new analysis methods are required that use observations to constrain model predictions, inform model development, and identify needed measurements and field experiments. Better representations of biogeochemistryclimate feedbacks and ecosystem processes in these models are essential for reducing the acknowledged substantial uncertainties in 21st century climate change projections.

earth system models (ESMs)↗

A Conventional Liner Acoustic/Drag Interaction Benchmark Database

The aerodynamic drag of acoustic liners has become a significant topic in the design of such for aircraft noise applications. In order to evaluate the benefits of concepts designed to reduce liner drag, it is necessary to establish the baseline performance of liners employing the typical design features of conventional configurations. This paper details a set of experiments in the NASA Langley Grazing Flow Impedance Tube to quantify the relative drag of a number of perforate-over-honeycomb liner configurations at flow speeds of M=0.3 and 0.5. These conventional liners are investigated to determine their resistance factors using a static pressure drop approach. Comparison of the resistance factors gives a relative measurement of liner drag. For these same flow conditions, acoustic measurements are performed with tonal excitation from 400 to 3000 Hz at source sound pressure levels of 140 and 150 dB. Educed impedance and attenuation spectra are used to determine the interaction between acoustic performance and drag.

Howerton, Brian M.↗

Benchmark Comparison of Cloud Analytics Methods Applied to Earth Observations

Earth Observation data are a vital resource for studying long term changes, but the large data volumes can be challenging to analyze. Time series analysis in particular is hampered by the typical thin-time-slice file organization. We examine several potential solutions inspired in large part by the data-parallel methods that have arisen with cloud computing. These solutions include various combinations of data re-organization, spatial indexing, distributed storage and pre-computation that we term "Analytics Optimized Data Stores" (AODS). We find that even simple solutions (such as a data cube) produce more than an order of magnitude improvement; the best provide two to three orders of magnitude improvement. The most performant solutions have tradeoffs in terms of generality or storage footprint, but may nonetheless be useful components in data analytics frameworks where performance is critical.

parallel processing (computers)↗

Discovery and Vetting of Exoplanets. I. Benchmarking K2 Vetting Tools

We have adapted the algorithmic tools developed during the Kepler mission to vet the quality of transit-like signals for use on the K2 mission data. Using the four sets of publicly available light curves at MAST, we produced a uniformly vetted catalog of 772 transiting planet candidates from K2 as listed at the NASA Exoplanet Archive in the K2 Table of Candidates. Our analysis marks 676 of these as planet candidates and 96 as false positives. All confirmed planets pass our vetting tests. Sixty of our false positives are new identifications, effectively doubling the overall number of astrophysical signals mimicking planetary transits in K2 data. Most of the targets listed as false positives in our catalog show either prominent secondary eclipses, transit depths suggesting a stellar companion instead of a planet, or significant photocenter shifts during transit. We packaged our tools into the open-source, automated vetting pipeline Discovery and Vetting of Exoplanets (DAVE), designed to streamline follow-up efforts by reducing the time and resources wasted observing targets that are likely false positives. DAVE will also be a valuable tool for analyzing planet candidates from NASA's TESS mission, where several guest-investigator programs will provide independent light-curve sets—and likely many more from the community. We are currently testing DAVE on recently released TESS planet candidates and will present our results in a follow-up paper.

Kostov, Veselin B.↗

Benchmarking CME Arrival Time and Impact: Progress on Metadata, Metrics, and Events

Accurate forecasting of the arrival time and subsequent geomagnetic impacts of coronal mass ejections (CMEs) at Earth is an important objective for space weather forecasting agencies. Recently, the CME Arrival and Impact working team has made significant progress toward defining communit yagreed metrics and validation methods to assess the current state of CME modeling capabilities. This will allow the community to quantify our current capabilities and track progress in models over time. First, it is crucial that the community focuses on the collection of the necessary metadata for transparency and reproducibility of results. Concerning CME arrival and impact we have identified six different metadata types: 3D CME measurement, model description, model input, CME (non)arrival observation, model output data, and metrics and validation methods. Second, the working team has also identified a validation time period, where all events within the following two periods will be considered: 1 January 2011 to 31 December 2012 and January 2015 to 31 December 2015. Those two periods amount to a total of about 100 hit events at Earth and a large amount of misses. Considering a time period will remove any bias in selecting events and the event set will represent a sample set that will not be biased by user selection. Lastly, we have defined the basic metrics and skill scores that the CME Arrival and Impact working team will focus on.

Verbeke, C.↗

Benchmarking Mixed Mode Failure in Progressive Damage and Failure Analysis Methods

The verification and validation of progressive-damage-analysis finite element methods are difficult but critical tasks to undertake during their development. Verification exercises assess whether a predictive analysis tool produces results that are consistent with the fundamental concepts and assumptions of the tool under evaluation. Ideally, closed-form analytical solutions can be derived for which method verification results can be compared. Problems selected for computational tool verification are often simple and isolate individual features of the tool. In the case of progressive damage finite element methods, verifications should be performed to evaluate the ability of the model to predict the initiation of damage and its growth through the finite element mesh under a variety of conditions. Mabson et al. proposed a test case of a unidirectional, fiber-reinforced plate with a center crack subjected to tensile loads to evaluate matrix crack propagation predictions. The problem was modeled using the Abaqus Hashin continuum damage mechanics (CDM) model for fiber-reinforced composites. Different combinations of matrix strengths and element sizes were used in the simulations, and the results were compared to a closed-form solution based on linear elastic fracture mechanics (LEFM). It was determined that the Abaqus CDM model could predict the LEFM solution of Mode I cracks only when the finite element mesh density met specific requirements based on the material properties. This paper presents closed-form LEFM solutions for a center notch mixed mode (CNMM) verification problem. Parametric finite element analyses were developed using progressive damage analysis methods of both the Discrete Damage Mechanics (DDM) and CDM classes. The progressive damage analysis methods applied in the analyses of the CNMM problem include CompDam and the Floating Node Method. Analyses were conducted with various mode mixities and element sizes to verify that the damage models were working as intended and to identify any limits of applicability.

Leone, Frank↗

Benchmarks in Bingo

Explore the source record for details and available documents.

Diana Vera↗

Improved Benchmarking of Cohesive Elements in Abaqus Standard for Predicting Disbond and Delamination in Composite Structures

Traditional approaches for aircraft certification require the assumption of an initial flaw condition, either represented as barely visible impact damage (BVID) or through inclusion of a Teflon insert to serve as surrogate damage. Based on the initial composite damage state, the structure must be shown to demonstrate structural durability and damage tolerance (DaDT) according to the following criteria: a. Damage displays no detrimental growth under cyclic loading. The structure is able to sustain design limit load (DLL). Currently, the only available manner for validating structural performance is through test. Since damage can occur over a wide variety of areas within a structure, this approach has proven to be increasingly expensive and time consuming for composite airframes and acreage structure within the design-test-certification building block. A further complicating factor is the requirement to accurately capture the most critical damage morphologies as a starting condition. To understand the severity of the damage, it is either required to experimentally determine the most critical areas at tremendous expense or rely on legacy data of similar structural testing, which limits design space expansion. A preferred solution is to use advanced analysis to provide improved understanding of load margins for critical locations based on a wide variety of potential starting damage conditions.

Eric M. Roberts↗

Benchmark Data for Evaluation of NASA Impedance Eduction Methods

Results achieved with three acoustic liner configurations are used to evaluate the effects of recent modifications to the NASA Normal Incidence Tube and Grazing Flow Impedance Tube. These include a calibration liner, a wire mesh liner, and a perforate liner. The effects of source type, source level, and mean flow Mach number on the impedances educed with these liners are explored. Existing models are used to predict the impedance for each test condition and are compared with educed impedance spectra to determine their validity. The results suggest that educed impedances are similar for either a stepped sine or swept sine source. The predicted models are acceptable for the perforate liner and are quite good for the calibration and wire mesh liners.

acoustic↗

Benchmark Data for Evaluation of NASA Impedance Eduction Methods

Results achieved with three acoustic liner configurations are used to evaluate the effects of recent modifications to the NASA Normal Incidence Tube and Grazing Flow Impedance Tube. These include a calibration liner, a wire mesh liner, and a perforate liner. The effects of source type, source level, and mean flow Mach number on the impedances educed with these liners are explored. Existing models are used to predict the impedance for each test condition, and are compared with educed impedance spectra to determine their validity. The results suggest that educed impedances are similar for either a stepped sine or swept sine source. The predicted models are acceptable for the perforate liner, and are quite good for the calibration and wire mesh liners.

acoustic↗

L 98-59: A Benchmark System of Small Planets for Future Atmospheric Characterization

The M3V dwarf star L 98-59 hosts three small (R < 1.6 Rꚛ) planets. The host star is bright (K = 7.1) and nearby (10.6 pc), making the system a prime target for follow-up characterization with the Hubble Space Telescope (HST) and the upcoming James Webb Space Telescope (JWST). Herein, we use simulated transmission spectroscopy to evaluate the detectability of spectral features with HST and JWST assuming diverse atmospheric scenarios (e.g., atmospheres dominated by H2, H2O, CO2, or O2). We find that H2O and CH4 present in a low mean molecular weight atmosphere could be detected with HST in one transit for the two outermost planets, while H2O in a clear steam atmosphere could be detected in six transits or fewer with HST for all three planets. We predict that observations using JWST/NIRISS would be capable of detecting a clear steam atmosphere in one transit for each planet and H2O absorption in a hazy steam atmosphere in two transits or less. In a clear, desiccated atmosphere, O2 absorption may be detectable for all three planets with NIRISS. If the L 98-59 planets possess a clear, Venus-like atmosphere, NIRSpec could detect CO2 within 26 transits for each planet, but the presence of H2SO4 clouds would significantly suppress CO2 absorption. The L 98-59 system is an excellent laboratory for comparative planetary studies of transiting multiplanet systems, and observations of the system via HST and JWST would present a unique opportunity to test the accuracy of the models presented in this study.

Daria Pidhorodetska↗