Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Performance evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 901 records · Page 50
All sourcesNASA NTRSDOE OSTI
NASA NTRS2000

Validated Feasibility Study of Integrally Stiffened Metallic Fuselage Panels for Reducing Manufacturing Costs

The continual need to reduce airframe cost and the emergence of high speed machining and other manufacturing technologies has brought about a renewed interest in large-scale integral structures for aircraft applications. Applications have been inhibited, however, because of the need to demonstrate damage tolerance, and by cost and manufacturing risks associated with the size and complexity of the parts. The Integral Airframe Structures (IAS) Program identified a feasible integrally stiffened fuselage concept and evaluated performance and manufacturing cost compared to conventional designs. An integral skin/stiffener concept was produced both by plate hog-out and near-net extrusion. Alloys evaluated included 7050-T7451 plate, 7050-T74511 extrusion, 6013-T6511 extrusion, and 7475-T7351 plate. Mechanical properties, structural details, and joint performance were evaluated as well as repair, static compression, and two-bay crack residual strength panels. Crack turning behavior was characterized through panel tests and improved methods for predicting crack turning were developed. Manufacturing cost was evaluated using COSTRAN. A hybrid design, made from high-speed machined extruded frames that are mechanically fastened to high-speed machined plate skin/stringer panels, was identified as the most cost-effective manufacturing solution. Recurring labor and material costs of the hybrid design are up to 61 percent less than the current technology baseline.

Pettit, R. G.↗
NASA NTRS2006

Probabilistic Structural Evaluation of Uncertainties in Radiator Sandwich Panel Design

The Jupiter Icy Moons Orbiter (JIMO) Space System is part of the NASA's Prometheus Program. As part of the JIMO engineering team at NASA Glenn Research Center, the structural design of the JIMO Heat Rejection Subsystem (HRS) is evaluated. An initial goal of this study was to perform sensitivity analyses to determine the relative importance of the input variables on the structural responses of the radiator panel. The desire was to let the sensitivity analysis information identify the important parameters. The probabilistic analysis methods illustrated here support this objective. The probabilistic structural performance evaluation of a HRS radiator sandwich panel was performed. The radiator panel structural performance was assessed in the presence of uncertainties in the loading, fabrication process variables, and material properties. The stress and displacement contours of the deterministic structural analysis at mean probability was performed and results presented. It is followed by a probabilistic evaluation to determine the effect of the primitive variables on the radiator panel structural performance. Based on uncertainties in material properties, structural geometry and loading, the results of the displacement and stress analysis are used as an input file for the probabilistic analysis of the panel. The sensitivity of the structural responses, such as maximum displacement and maximum tensile and compressive stresses of the facesheet in x and y directions and maximum VonMises stresses of the tube, to the loading and design variables is determined under the boundary condition where all edges of the radiator panel are pinned. Based on this study, design critical material and geometric parameters of the considered sandwich panel are identified.

Kuguoglu, Latife↗
NASA NTRS1973

Environmental testing of REI-Mullite thermal protection system for the space shuttle orbiter

Tests conducted to evaluate performances in the natural environments of salt spray, humidity, rain, vacuum, and cryogenic temperatures have shown the ceramic mullite fiber is completely compatible and that these environments have no adverse effects on subsequent mission performance. Rain erosion testing has indicated a damage threshold that must be accounted for in the final design. Tests conducted to evaluate the performance of ceramic mullite fiber to induced acoustic, re-entry, and structural load environments again have shown complete capability to fulfill mission environments. Although minor cracking of the sidewall coating was seen to occur throughout the induced environment test program, sidewall designs configured to provide increased flexibility have been successfully tested.

Gluck, R.↗
DOE OSTI2024

Establishing performance metrics for quantitative non-targeted analysis: a demonstration using per- and polyfluoroalkyl substances

Abstract Non-targeted analysis (NTA) is an increasingly popular technique for characterizing undefined chemical analytes. Generating quantitative NTA (qNTA) concentration estimates requires the use of training data from calibration “surrogates,” which can yield diminished predictive performance relative to targeted analysis. To evaluate performance differences between targeted and qNTA approaches, we defined new metrics that convey predictive accuracy, uncertainty (using 95% inverse confidence intervals), and reliability (the extent to which confidence intervals contain true values). We calculated and examined these newly defined metrics across five quantitative approaches applied to a mixture of 29 per- and polyfluoroalkyl substances (PFAS). The quantitative approaches spanned a traditional targeted design using chemical-specific calibration curves to a generalizable qNTA design using bootstrap-sampled calibration values from “global” chemical surrogates. As expected, the targeted approaches performed best, with major benefits realized from matched calibration curves and internal standard correction. In comparison to the benchmark targeted approach, the most generalizable qNTA approach (using “global” surrogates) showed a decrease in accuracy by a factor of ~4, an increase in uncertainty by a factor of ~1000, and a decrease in reliability by ~5%, on average. Using “expert-selected” surrogates ( n = 3) instead of “global” surrogates ( n = 25) for qNTA yielded improvements in predictive accuracy (by ~1.5×) and uncertainty (by ~70×) but at the cost of further-reduced reliability (by ~5%). Overall, our results illustrate the utility of qNTA approaches for a subclass of emerging contaminants and present a framework on which to develop new approaches for more complex use cases. Graphical Abstract

Pu, Shirley (ORCID:0000000201223797)↗
DOE OSTI2022

Ames National Laboratory Annual Site Environmental Report for CY2021

The primary purpose of this report is to summarize the performance of Ames National Laboratory’s environmental programs, present highlights of significant environmental activities, and confirm compliance with environmental regulations and requirements for calendar year 2021. This report is a working requirement of Department of Energy Order 231.1B, Environment, Safety and Health Reporting. It includes descriptions of the Laboratory’s site, mission, the status of its compliance with applicable environmental regulations, its planning and activities to maintain compliance, and a comprehensive review of its environmental protection, surveillance and monitoring activities. Ames National Laboratory is located on the campus of Iowa State University (ISU) and occupies 13 buildings owned by the Department of Energy (DOE). See the Laboratory’s Web page for location and Laboratory overview. The Laboratory also leases space in ISU owned buildings. In 2021, the Laboratory accumulated and disposed of hazardous waste under a U.S. Environmental Protection Agency (EPA) issued generator number. All waste was handled according to applicable EPA, State, and local regulations and DOE Orders. The Laboratory operates as a Small Quantity Generator (SQG) of hazardous waste. There were no radiological air emissions or exposures to the general public due to Laboratory activities in 2021 (See U.S. Department of Energy Air Emissions Annual Report in Appendix A.) The Laboratory has an established Environmental Radiological Protection Program (Plan 10200.041) per DOE Order 458.1 requirements. Plans, policies, and procedures are in place to protect the public and the environment against undue risk from radiation associated with DOE radiological activities. As indicated in prior Site Environmental Reports, formal pollution prevention awareness, waste minimization and recycling programs have been in practice since 1990, with improvements implemented most recently in 2017 with Iowa State University’s shift toward single-stream recycling. Included in recycling efforts are items such as batteries, monitors, corrugated cardboard, lamps, miscellaneous electronic office equipment, mixed paper, newsprint, food/beverage containers, and laboratory glassware. Ames National Laboratory also recycles/reuses salvageable metal, used oil, and foamed polystyrene peanuts, and encourages chemical redistribution and sharing among research groups. Ames National Laboratory reported its contractual performance to DOE-Ames Site Office (AMSO) through the Laboratory’s Performance Evaluation Measurement Plan (PEMP), and a performance level of “B+” was achieved in 2021 for Sustain Excellence and Enhance Effectiveness of Integrated Safety, Health, and Environmental Protection As reported in Site Environmental Reports for prior years, the Laboratory’s Environmental Management System (EMS) has been integrated into the Laboratory’s Integrated Safety Management System (ISMS) since 2005. The integration of EMS into Laboratory business practices allows the Laboratory to systematically review, address and respond to environmental impacts. In addition to DOE-identified objectives and targets, the EMS Steering Committee recommends annual environmental goals for the Laboratory. Due to the COVID-19 pandemic and limited onsite work staff, goals of reducing water usage and travel/commuting to promote the reduction of scope 3 greenhouse gases were achieved. All contract deliverables and environmental compliance activities were still met during this time.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
NASA NTRS1972

Liquid rocket performance computer model with distributed energy release

Development of a computer program for analyzing the effects of bipropellant spray combustion processes on liquid rocket performance is described and discussed. The distributed energy release (DER) computer program was designed to become part of the JANNAF liquid rocket performance evaluation methodology and to account for performance losses associated with the propellant combustion processes, e.g., incomplete spray gasification, imperfect mixing between sprays and their reacting vapors, residual mixture ratio striations in the flow, and two-phase flow effects. The DER computer program begins by initializing the combustion field at the injection end of a conventional liquid rocket engine, based on injector and chamber design detail, and on propellant and combustion gas properties. It analyzes bipropellant combustion, proceeding stepwise down the chamber from those initial conditions through the nozzle throat.

Combs, L. P.↗
NASA NTRS1984

An adaptive guidance logic for an aeroasisted orbital transfer vehicle

The Orbital Transfer Vehicle (OTV) is to be employed for the delivery of a paylod to a high earth orbit, such as a geosynchronous orbit. Subsequently, the OTV is to return to a low earth parking orbit. The present investigation is concerned with an aeroassisted OTV (AOTV) which achieves the required reduction in velocity on its return to the parking orbit through aerodynamic braking. An adaptive guidance logic is employed to control and AOTV as it passes through the earth's upper atmosphere. Attention is given to details regarding the adaptive guidance logic, and a performance evaluation. It is found that the performance of the adaptive guidance logic is satisfactory for the considered conditions.

Hill, O.↗
NASA NTRS1995

Environmentally compatible hand wipe cleaning solvents

Several solvents of environmental concern have previously been used for hand wipe cleaning of SRB surfaces, including 1,1,1-trichloroethane, perchloroethylene, toluene, xylene, and MEK. USBI determined the major types of surfaces involved, and qualification requirements of replacement cleaning agents. Nineteen environmentally compatible candidates were tested on 33 material substrates with 26 types of potential surface contaminants, involving over 7,000 individual evaluations. In addition to the cleaning performance evaluation, bonding, compatibility, and corrosion tests were conducted. Results showed that one cleaner was not optimum for all surfaces. In most instances, some of the candidates cleaned better than the 1,1,1-trichloroethane baseline control. Aqueous cleaners generally cleaned better, and were more compatible with nonmetallic materials, such as paints, plastics, and elastomers. Organic base cleaners were better on metal surfaces. Five cleaners have been qualified and are now being implemented in SRB hand wipe cleaning operations.

Clayton, Catherine P.↗
NASA NTRS2005

Protection of Conductive and Non-conductive Advanced Polymer-based Paints from Highly Aggressive Oxidative Environments

Research has been continued to further improve the space durability of conductive and non-conductive polymer-based paints and of conductive thermal control paints for space applications. Efforts have been made to enhance the space durability and stability of functional Characteristics in ground-based space environment imitating conditions, using specially developed surface modification treatment. The results of surface modification of new conductive paints, including the ground-based testing in aggressive oxidative environments, such as atomic oxygen/UV and oxygen plasma, and performance evaluation are presented. Functional properties and performance characteristics, such as thermal optical properties (differential solar absorptance and thermal emittance representing the thermal optical performance of thermal control paints) and surface resistivity characteristics of pristine, surface modified, and tested materials were verified. Extensive surface analysis studies have been performed using complementary surface analyses including SEM/EDS and XPS. Test results revealed that the successfully treated materials exhibit reduced mass loss and no surface morphology change, thus indicating good protection from the severe oxidative environment. It was demonstrated that the developed surface modification treatment could be applied successfully to charge dissipative and conductive paints.

Gudimenko, Y.↗
NASA NTRS2007

Digital Signal Processing Techniques for the GIFTS SM EDU

The Geosynchronous Imaging Fourier Transform Spectrometer (GIFTS) Sensor Module (SM) Engineering Demonstration Unit (EDU) is a high resolution spectral imager designed to measure infrared (IR) radiance using a Fourier transform spectrometer (FTS). The GIFTS instrument employs three Focal Plane Arrays (FPAs), which gather measurements across the long-wave IR (LWIR), short/mid-wave IR (SMWIR), and visible spectral bands. The raw interferogram measurements are radiometrically and spectrally calibrated to produce radiance spectra, which are further processed to obtain atmospheric profiles via retrieval algorithms. This paper describes several digital signal processing (DSP) techniques involved in the development of the calibration model. In the first stage, the measured raw interferograms must undergo a series of processing steps that include filtering, decimation, and detector nonlinearity correction. The digital filtering is achieved by employing a linear-phase even-length FIR complex filter that is designed based on the optimum equiripple criteria. Next, the detector nonlinearity effect is compensated for using a set of pre-determined detector response characteristics. In the next stage, a phase correction algorithm is applied to the decimated interferograms. This is accomplished by first estimating the phase function from the spectral phase response of the windowed interferogram, and then correcting the entire interferogram based on the estimated phase function. In the calibration stage, we first compute the spectral responsivity based on the previous results and the ideal Planck blackbody spectra at the given temperatures, from which, the calibrated ambient blackbody (ABB), hot blackbody (HBB), and scene spectra can be obtained. In the post-calibration stage, we estimate the Noise Equivalent Spectral Radiance (NESR) from the calibrated ABB and HBB spectra. The NESR is generally considered as a measure of the instrument noise performance, and can be estimated as the standard deviation of calibrated radiance spectra from multiple scans. To obtain an estimate of the FPA performance, we developed an efficient method of generating pixel performance assessments. In addition, a random pixel selection scheme is developed based on the pixel performance evaluation. This would allow us to perform the calibration procedures on a random pixel population that is a good statistical representation of the entire FPA. The design and implementation of each individual component will be discussed in details.

Tian, Jialin↗
DOE OSTI2022

Evaluation of Optimal Net Load Management in Microgrids Using Hardware-in-the-Loop Simulation

This paper presents the performance evaluation of a net load management (NLM) engine that balances load and generation in an isolated community to power a critical facility after a grid interruption event (e.g., the loss of a large generation unit). This NLM engine is particularly important for microgrid systems because it provides a high-speed, cost-optimal control solution to coordinate grid-forming inverters and to dispatch grid-following inverters and deferrable loads in microgrid systems to enhance grid resilience and reliability. The NLM algorithm cost-optimally dispatches the grid-following inverters and deferrable loads based on the demanded power and load priorities, and the grid-forming inverters use droop control to form system voltages and share active and reactive power. A controller-hardware-in-the-loop platform is developed to evaluate the control performance of the NLM algorithm with two sequential contingency events of lost generation units. The experimental results indicate that the NLM engine can maintain system stability, achieve the targeted system voltage and frequency, and balance load and generation to serve the critical facility with improved system resilience and reliability.

grid-following inverter↗
DOE OSTI2022

Evaluation of Optimal Net Load Management in Microgrids Using Hardware-in-the-Loop Simulation

This presentation discusses the performance evaluation of a net load management (NLM) engine that balances load and generation in an isolated community to power a critical facility after a grid interruption event (e.g., the loss of a large generation unit). This NLM engine is particularly important for microgrid systems because it provides a high-speed, cost-optimal control solution to coordinate grid-forming inverters and to dispatch grid-following inverters and deferrable loads in microgrid systems to enhance grid resilience and reliability. The NLM algorithm cost-optimally dispatches the grid-following inverters and deferrable loads based on the demanded power and load priorities, and the grid-forming inverters use droop control to form system voltages and share active and reactive power. A controller-hardware-in-the-loop platform is developed to evaluate the control performance of the NLM algorithm with two sequential contingency events of lost generation units. The experimental results indicate that the NLM engine can maintain system stability, achieve the targeted system voltage and frequency, and balance load and generation to serve the critical facility with improved system resilience and reliability.

droop control↗
DOE OSTI2023

Accelerating Random Forest Classification on GPU and FPGA

Random Forests (RFs) are a commonly used machine learning method for classification and regression tasks spanning a variety of application domains, including bioinformatics, business analytics, and software optimization. While prior work has focused primarily on improving performance of the training of RFs, many applications, such as malware identification, cancer prediction, and banking fraud detection, require fast RF classification. In this work, we accelerate RF classification on GPU and FPGA. In order to provide efficient support for large datasets, we propose a hierarchical memory layout suitable to the GPU/FPGA memory hierarchy. We design three RF classification code variants based on that layout, and we investigate GPU- and FPGA-specific considerations for these kernels. Our experimental evaluation, performed on an Nvidia Xp GPU and on a Xilinx Alveo U250 FPGA accelerator card using publicly available datasets on the scale of millions of samples and tens of features, covers various aspects. First, we evaluate the performance benefits of our hierarchical data structure over the standard compressed sparse row (CSR) format. Second, we compare our GPU implementation with cuML, a machine learning library targeting Nvidia GPUs. Third, we explore the performance/accuracy tradeoff resulting from the use of different tree depths in the RF. Finally, we perform a comparative performance analysis of our GPU and FPGA implementations. Our evaluation shows that for high accuracy targets, our GPU implementation yields 5-9x speedup over CSR, and up to a 2x speedup over cuML.

FPGA, Xilinx FPGA, GPU, Random Forest classificati↗
NASA NTRS1994

Evaluating Multi-Input/Multi-Output Digital Control Systems

Controller-performance-evaluation (CPE) methodology for multi-input/multi-output (MIMO) digital control systems developed. Procedures identify potentially destabilizing controllers and confirm satisfactory performance of stabilizing ones. Methodology generic and used in many types of multi-loop digital-controller applications, including digital flight-control systems, digitally controlled spacecraft structures, and actively controlled wind-tunnel models. Also applicable to other complex, highly dynamic digital controllers, such as those in high-performance robot systems.

Pototzky, Anthony S.↗
DOE OSTI2022

Evaluation of Optimal Net Load Management in Microgrids Using Hardware-in-the-Loop Simulation: Preprint

This paper presents the performance evaluation of a net load management (NLM) engine that balances load and generation in an isolated community to power a critical facility after a grid interruption event (e.g., lost a large generation unit). The NLM engine is a central dispatch control system that provides high-speed cost-optimal coordination of a set of net loads (combination of generation and deferrable loads) connected to the same electrical network. The NLM algorithm cost-optimally dispatches the grid-following inverters and deferrable loads based on the demanded power and load priorities, and the grid-forming inverters use droop control to form system voltages and share active and reactive power. A controller-hardware-in-the-loop platform is developed to evaluate the control performance of the NLM algorithm. The experimental results indicate that the NLM engine can achieve the targeted system voltage and frequency and balance load and generation to serve the critical facility.

droop control↗
NASA NTRS2019

High-Performance Computing Optimization for Aladyn – Adaptive Neural Network Molecular Dynamics Mini-Application

This report provides a description and performance evaluation of the optimization techniques for high performance computing (HPC) implementation of the open source Computational Materials mini-application Aladyn (https://github.com/nasa/aladyn). Aladyn is a basic molecular dynamics code written in FORTRAN 2003, which is designed to demonstrate the use of adaptive neural networks (ANNs) in atomistic simulations. The role of ANNs is to efficiently reproduce the very complex energy landscape resulting from the atomic interactions in materials with the accuracy of the more expensive quantum mechanics-based calculations. The ANN is trained on a large set of atomic structures calculated using the density functional theory (DFT) method. While achieving orders of magnitude faster computational performance than DFT, the ANN-based approach was still very computationally demanding compared to the conventional approach of using empirically fitted energy functions. After its initial development, Aladyn was evaluated and optimized by experts at the NASA Advanced Supercomputing (NAS) division to exploit modern supercomputer architectures. The code has been optimized for execution on multicore central processing units (CPUs), including Intel® Skylake microarchitecture, and on graphic accelerators, such as Nvidia® V100 graphic processing units (GPUs), using Open Multi-Processing (OpenMP) and Open Accelerators (OpenACC) programming interfaces. The optimization achieved a speedup of 4.7 times the baseline version on CPU performance and an additional 2.4 times on CPU+GPU performance. Atomistic computer simulations are a fundamental tool in materials research to model material properties form physics-based first principles. Atomic interaction, governed by Quantum Mechanics (QM) require sophisticated and highly computationally demanding mathematical models to calculate [1]. Classical methods use approximate functional forms, empirically fitted through a set of variable parameters to emulate atomic energies as direct functions of atomic coordinates [2]. While empirical potentials are computationally much simpler, allowing simulations of large-scale systems of up to a trillion (1012) atoms [3], they are substantially less accurate compared to quantum calculations and applicable only to very specific atomic configurations or predefined crystallographic phases. A recently suggested approach is to use heuristic machine learning methods [4], such as those based on Adaptive Neural Networks (ANNs) to predict atomic energies, after being trained on a sufficiently large database of QM-calculated structures [5,6]. This approach reduces significantly the computational complexity, allowing for simulations of orders of magnitude larger systems compared to QM-based methods without compromising accuracy. Still, compared to classical methods using empirical energy functions, ANN methods remain two- to three orders of magnitude more computationally demanding. Hence, the computational cost of simulations, together with the need for extensive training of ANNs, still makes the practical implementation of ANN-based methods quite challenging. The purpose of the Aladyn mini-application software [7], available as open source at https://github.com/nasa/aladyn, is to be a testbed for exploring possible optimization strategies to develop highly scalable parallel algorithms for ANN-based atomistic simulations. Aladyn is aimed at utilizing the architecture of the high-end modern highperformance computing (HPC) hardware based on multicore central processing units (CPUs) equipped with graphic processing unit (GPU) accelerators. Specifically, the goal is to optimize the performance on a single HPC compute node, before implementing scaling to multi-node parallelization using message passing interface (MPI). At the same time, the open source code of Aladyn can serve as a training model for students and professors in academia.

Yamakov, Vesselin I.↗
NASA NTRS1975

JANNAF boundary layer integral matrix procedure

Accurate predictions of the thrust loss due to boundary layer effects and of the wall heat flux are very important to the design and performance evaluation of rocket nozzles. A method used in analytical procedures for liquid fuel rocket engine performance prediction and evaluation is presented. A computer program is examined that is a fast and accurate procedure for solving the set of boundary layer equation (momentum, energy, and species) for laminar or turbulent, chemically reacting flows with a wide variety of boundary conditions. Results of comparison of the various turbulent models are presented. A summary of the modifications and additions to the program is examined.

Evans, R. M.↗