Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Performance evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,207 records · Page 67

Implementation of a Hybrid Edge Node-Centroid Node Approach for the Generation of Reduced Thermal Models

Reduced thermal models are often required for delivery to organizations that manage observatory or launch models at the highest levels of assembly. However, the effort to generate reduced models, and verify against their detailed counterparts, is a challenge that has not yet been conclusively solved. Higher level organizations often place a limit on the number of nodes for delivered models with the assumption that smaller models generally result in less computation time. However, the burden of producing and verifying the accuracy of the reduced models is placed primarily on the lower-level organizations, which in turn consumes resources needed to produce these models. Limiting the total number of allowable nodes may also prevent users from taking full advantage of software capabilities that allow for faster generation of models, such as finite elements, which generally require more nodes than older centroid based models. A methodology using Thermal Desktop was described in 2010 which used: (1) finite elements and edge nodes for a conduction matrix, (2) centroid nodes for capacitance and radiative computations, and (3) the super network feature to produce a conduction matrix based only on the centroid nodes. At that time, the methodology was clear, but the implementation would have had to be done manually; however, with the inclusion of the OpenTD API, this methodology can now be implemented programmatically and for the first time, be a viable approach for the generation of reduced models. The approach was implemented and developed at the NASA Goddard Space Flight Center (GSFC) for the Capture, Containment, and Return System (CCRS) payload on the Earth Return Orbiter (ERO) as part of the Mars Sample Return (MSR) mission, resulting in the TCYEE tool. ERO features a spacecraft bus provided by Airbus through the European Space Agency (ESA) with node limitations on the delivered CCRS model provided by GSFC. TCYEE was used to generate the reduced model for this delivery and the predictions compared favorably to the detailed model currently in use for the thermal performance evaluation. Furthermore, TCYEE is being explored for potential use on the Roman Space Telescope (RST) for the generation of reduced models for delivery to the launch provider, which also has node limit requirements on the RST observatory model for use in launch simulation analyses. This paper describes the methodology, its implementation, and compares the performance of reduced models generated by TCYEE to their detailed counterparts.

Thermal desktop↗

On the evaluation of expected performance cost for partially observed closed-loop stochastic systems

New methods are presented for evaluating the expected performance cost of partially observed closed-loop stochastic systems. When the variances of the process statistics are small, a linearized model of the closed-loop stochastic system is defined for which the expected cost can be evaluated by recursion on a set of purely deterministic difference equations. When the variances of the process statistics are large, the linearized model can be used in the control variate method of variance reduction for reducing the number of sample paths required for effective Monte Carlo estimation.

Bayard, D. S.↗

Application of a High-Fidelity Icing Analysis Method to a Model-Scale Rotor in Forward Flight

An icing analysis process involving the loose coupling of OVERFLOW-RCAS for rotor performance prediction and with LEWICE3D for thermal analysis and ice accretion is applied to a model-scale rotor for validation. The process offers high-fidelity rotor analysis for the noniced and iced rotor performance evaluation that accounts for the interaction of nonlinear aerodynamics with blade elastic deformations. Ice accumulation prediction also involves loosely coupled data exchanges between OVERFLOW and LEWICE3D to produce accurate ice shapes. Validation of the process uses data collected in the 1993 icing test involving Sikorsky's Powered Force Model. Non-iced and iced rotor performance predictions are compared to experimental measurements as are predicted ice shapes.

Narducci, Robert↗

A comparison of frequency estimation techniques for high-dynamic trajectories

A comparison is presented for four different estimation techniques applied to the problem of continuously estimating the parameters of a sinusoidal Global Positioning System (GPS) signal, observed in the presence of additive noise, under extremely high-dynamic conditions. Frequency estimates are emphasized, although phase and/or frequency rate are also estimated by some of the algorithms. These parameters are related to the velocity, position, and acceleration of the maneuvering transmitter. Estimated performance at low carrier-to-noise ratios and high dynamics is investigated for the purpose of determining the useful operating range of an approximate Maximum Likelihood (ML) estimator, an Extended Kalman Filter (EKF), a Cross-Product Automatic Frequency Control (CPAFC) loop, and a digital phase-locked loop (PPL). Numerical simulations are used to evaluate performance while tracking a common trajectory exhibiting high dynamics.

Vilnrotter, V. A.↗

Error modeling of precision orientation sensors in a fixed base simulation

Models of noise and dynamic characteristics of gyro and autocollimator for very small signal levels are presented. Measurements were evaluated using spectral techniques for identifying noise from base motion. The experiment was constructed to measure the precession, due to relativistic effects, of an extremely precise earth-orbiting gyroscope. The design goal for nonrelativistic gyro drift is 0.001 arcsec per year. An analogous fixed base simulator was used in developing methods of instrument error modeling and performance evaluation applicable to the relativity experiment sensors and other precision pointing instruments. Analysis of autocollimator spectra uncovered the presence of a platform gimbal resonance. The source of resonance was isolated to gimbal bearing elastic restraint properties most apparent at very small levels of motion. A model of these properties which include both elastic and coulomb friction characteristics is discussed, and a describing function developed.

Klinger, D. L.↗

Human-in-the-loop Sensing and Control for Commercial Building Energy Efficiency and Occupant Comfort

Most of the existing heating, ventilation and air conditioning (HVAC) systems in commercial buildings operate in a conservative manner by assuming maximum occupancy in each room during pre-specified periods of the week, leading to significant energy being wasted as rooms are over-conditioned compared to the actual requirements of the occupants. Though critical, our understanding of occupancy patterns and thermal comfort needs of the occupants in commercial buildings is lacking and it is well known that both of these quantities are stochastic and time-varying, thus requiring sensing solutions to estimate them. This project had the goal of designing, implementing and evaluating a hardware and software solution to ameliorate this challenge. In particular, a depth camera (one whose pixels reveal distance from the camera as opposed to color values) placed on doorways is used to detect entrance and exit events from thermal zones in the building, and thereby estimate their occupancy levels. This information is then fed to a novel control algorithm that can, through interactions with the HVAC system, learn how to provide control inputs that maximize comfort and minimize energy waste. The resulting system represents a significant improvement over existing controllers for commercial HVAC systems and allowed us to improve our understanding of the design of future human-in-the-loop control solutions. For this solution to be feasible, the project had target metrics for its performance and cost. In particular, entrance and exit events for occupants moving about the building would need to be detected with an accuracy higher than 97%; and the resulting control inputs derived from this information would need to lead to approximately 10% energy savings compared to a schedule-based controller. Furthermore, regarding the final hardware design, the project had a target bill of materials (BOM) cost for the sensing solution of less than US$200 per unit while using less than 25W of power on average. All of these target metrics were met or exceeded by our final proposed solution. We performed evaluations by deploying the system in over 20 rooms of different types across 6 commercial buildings in Pittsburgh, PA over the course of three years, and performing targeted controlled experiments to test its performance along the different metrics. The human-in-the-loop control solutions (both hardware and software) developed through this project are expected to lead to significant improvements in the comfort and energy efficiency of HVAC systems used in commercial buildings. The insights we developed through the project pave the way to HVAC systems that can condition interior spaces according to their real-time utilization and the thermal comfort needs of the occupants, thereby reducing energy use. They also open up a new learning-based way of configuring HVAC controllers without having to manually fine-tune them for each building. These innovations can significantly increase the adoption of novel control solutions by the industry and thereby save resources and reduce costs of operation.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

High-performance data management for whole slide image analysis in digital pathology

When dealing with giga-pixel digital pathology in whole-slide imaging, a notable proportion of data records holds relevance during each analysis operation. For instance, when deploying an image analysis algorithm on whole-slide images (WSI), the computational bottleneck often lies in the input-output (I/O) system. This is particularly notable as patch-level processing introduces a considerable I/O load onto the computer system. However, this data management process could be further paralleled, given the typical independence of patch-level image processes across different patches. This paper details our endeavors in tackling this data access challenge by implementing the Adaptable IO System version 2 (ADIOS2). Our focus has been constructing and releasing a digital pathology-centric pipeline using ADIOS2, which facilitates streamlined data management across WSIs. Additionally, we’ve developed strategies aimed at curtailing data retrieval times. The performance evaluation encompasses two key scenarios: (1) a pure CPU-based image analysis scenario (“CPU scenario”), and (2) a GPU-based deep learning framework scenario (“GPU scenario”). Our findings reveal noteworthy outcomes. Under the CPU scenario, ADIOS2 showcases an impressive two-fold speed-up compared to the brute-force approach. In the GPU scenario, its performance stands on par with the cutting-edge GPU I/O acceleration framework, NVIDIA Magnum IO GPU Direct Storage (GDS). From what we know, this appears to be among the initial instances, if any, of utilizing ADIOS2 within the field of digital pathology. The source code has been made publicly available at https://github.com/hrlblab/adios.

Wang, Xiao↗

Operating and environmental characteristics of Sigma Tau hydrogen masers used in the Very Long Baseline Array (VLBA)

Presented here are the results obtained from performance evaluation of a pair of Sigma Tau Standards Corporation Model VLBA-112 active hydrogen maser frequency standards. These masers were manufactured for the National Radio Astronomy Observatory (NRAO) for use on the Very Long Baseline Array (VLBA) project and were furnished to the Jet Propulsion Laboratory (JPL) for the purpose of these tests. Tests on the two masers were performed in the JPL Frequency Standards Laboratory (FSL) and included the characterization of output frequency stability versus environmental factors such as temperature, humidity, magnetic field, and barometric pressure. The performance tests also included the determination of phase noise and Allan variance using both FSL and Sigma Tau masers as references. All tests were conducted under controlled laboratory conditions, with only the desired environmental and operational parameters varied to determine sensitivity to external environment.

Tucker, T. K.↗

Validation and Independent Uncertainty Analysis of the MIX-SOL-THERM-003 ICSBEP Benchmark

The International Criticality Safety Benchmark Evaluation Project (ICSBEP) was started in 1992 by the United States Department of Energy and later in 1995 became an international project with contributions from 22 countries. The project is now organized by the OECD (Organisation for Economic Co-operation and Development) Nuclear Energy Agency (NEA). In its most recent iteration, the ICSBEP handbook contains over five thousand evaluations of critical, near-critical, and subcritical experiments conducted in facilities all around the world. These benchmarks serve as valuable information for criticality safety engineers who can use them to validate calculation techniques and establish minimum subcritical margins for operations with fissionable materials. The benchmarks in the handbook are categorized by their fissile material composition, material form (oxide, solution, or metal), and fission energy spectra. This is especially useful for those looking for benchmarks similar to a system they are working on to compare methods and identify trends. The ICSBEP Handbook Uncertainty Guide is document outlining recommended practices and methods for determining uncertainties in these benchmarks. Quantifying these uncertainties thoroughly is crucial as it allows a higher degree of confidence that data used from them is valid and relevant. The guide stresses the importance of a thorough and well documented uncertainty analysis when evaluating an experiment. All measured values of a system, whether they be dimensions or material compositions, have a certain amount of uncertainty associated with them and can be analyzed one by one to determine their effects on the system. Many evaluated benchmarks in the handbook present this in detail, however some do not, mostly earlier evaluations performed in the 1990’s and early 2000’s. Recently at Los Alamos National Laboratory (LANL), the Nuclear Criticality Safety Division (NCSD) of LANL has been validating MCNP6.2 ® input files of criticality benchmarks for use by Whisper, a criticality safety code developed at LANL. This effort is also part of the OECD NEA Working Party on International Nuclear Data Evaluation Co-operation (WPEC) Subgroup 45, also known as Validation of Nuclear Data Libraries (VaNDaL). The goal of VaNDaL is to compile a set of validated simulation inputs for use in validating nuclear data and simulation codes. As part of these efforts, one of the benchmarks reviewed was the MIX SOL-THERM-003 ICSBEP benchmark. This paper provides an independent uncertainty analysis of this benchmark experiment.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Performance of concatenated codes using 8-bit and 10-bit Reed-Solomon codes

The performance improvement of concatenated coding systems using 10-bit instead of 8-bit Reed-Solomon codes is measured by simulation. Three inner convolutional codes are considered: (7,1/2), (15,1/4), and (15,1/6). It is shown that approximately 0.2 dB can be gained at a bit error rate of 10(-6). The loss due to nonideal interleaving is also evaluated. Performance comparisons at very low bit error rates may be relevant for systems using data compression.

Pollara, F.↗

FTAPE: A fault injection tool to measure fault tolerance

The paper introduces FTAPE (Fault Tolerance And Performance Evaluator), a tool that can be used to compare fault-tolerant computers. The tool combines system-wide fault injection with a controllable workload. A workload generator is used to create high stress conditions for the machine. Faults are injected based on this workload activity in order to ensure a high level of fault propagation. The errors/fault ratio and performance degradation are presented as measures of fault tolerance.

Tsai, Timothy K.↗

FTAPE: A fault injection tool to measure fault tolerance

The paper introduces FTAPE (Fault Tolerance And Performance Evaluator), a tool that can be used to compare fault-tolerant computers. The tool combines system-wide fault injection with a controllable workload. A workload generator is used to create high stress conditions for the machine. Faults are injected based on this workload activity in order to ensure a high level of fault propagation. The errors/fault ratio and performance degradation are presented as measures of fault tolerance.

Tsai, Timothy K.↗

GPU-Based Static Data-Flow Analysis for Fast and Scalable Android App Vetting

Many popular vetting tools for Android applications use static code analysis techniques. In particular, Interprocedural Data-Flow Graph (IDFG) construction is the computation at the core of Android static data-flow analysis and consumes most of the analysis time. Many analysis tools use a worklist algorithm, an iterative fixed-point approach, to construct the IDFG. In this paper, we observe that a straightforward GPU parallelization of the worklist algorithm leads to significant underutilization of the GPU resources. We identify four performance bottlenecks, namely, frequent dynamic memory allocations, high branch divergence, workload imbalance, and irregular memory access patterns. Accordingly, we propose GDroid, a GPU-based worklist algorithm implementation with multiple fine-grained optimizations tailored to common characteristics of Android applications. The optimizations considered are: matrix-based data structure, memory access-based node grouping, and worklist merging. Our experimental evaluation, performed on 1000 Android applications, shows that the proposed optimizations are beneficial to performance, and GDroid can achieve up to 128X speedups against a plain GPU implementation.

Android security↗

Rasterization with Data-Parallel Primitives

Parallel rasterization can suffer from race conditions during fragment generation, which is traditionally addressed by using specialized hardware accessible via vendor graphics APIs. Unfortunately, graphics APIs are increasingly problematic on high-performance computers, either because they are not provided or because of concerns about dependencies with in situ visualization. In response, we present a hardware-agnostic rasterization algorithm that handles race conditions using only data-parallel primitives (DPPs), enabling efficient rendering on HPC systems without graphics API dependencies and aligning with recent efforts to deliver visualization software with DPPs. Our evaluation consists of three phases: (1) evaluating portability across different CPU and GPU architectures, (2) evaluating competitiveness with a community standard, and (3) evaluating performance across varying workloads and available parallelism. The supporting experiments run on both AMD and NVIDIA GPUs, considering data sets as large as 460 million triangles and 160 million pixels. While performance generally falls short of graphics API baselines, it achieves interactive frame rates on most workloads. As a result, we conclude our approach is a viable solution for rasterization on high-performance computers since our approach is portably performant across different architectures without the need for specialized vendor support.

Buckley, Makani [University of Oregon] (ORCID:0009↗

Shuttle Ku-band and S-band communications implementations study

The interfaces between the Ku-band system and the TDRSS, between the S-band system and the TDRSS, GSTDN and SGLS networks, and between the S-band payload communication equipment and the other Orbiter avionic equipment were investigated. The principal activities reported are: (1) performance analysis of the payload narrowband bent-pipe through the Ku-band communication system; (2) performance evaluation of the TDRSS user constraints placed on the S-band and Ku-band communication systems; (3) assessment of the shuttle-unique S-band TDRSS ground station false lock susceptibility; (4) development of procedure to make S-band antenna measurements during orbital flight; (5) development of procedure to make RFI measurements during orbital flight to assess the performance degradation to the TDRSS S-band communication link; and (6) analysis of the payload interface integration problem areas.

Huth, G. K.↗

Orbit Determination Accuracy Analysis of the Magnetospheric Multiscale Mission During Perigee Raise

The Goddard Space Flight Center (GSFC) Flight Dynamics Facility (FDF) will provide orbit determination and prediction support for the Magnetospheric Multiscale (MMS) mission during the missions commissioning period. The spacecraft will launch into a highly elliptical Earth orbit in 2015. Starting approximately four days after launch, a series of five large perigee-raising maneuvers will be executed near apogee on a nearly every-other-orbit cadence. This perigee-raise operations concept requires a high-accuracy estimate of the orbital state within one orbit following the maneuver for performance evaluation and a high-accuracy orbit prediction to correctly plan and execute the next maneuver in the sequence. During early mission design, a linear covariance analysis method was used to study orbit determination and prediction accuracy for this perigee-raising campaign. This paper provides a higher fidelity Monte Carlo analysis using the operational COTS extended Kalman filter implementation that was performed to validate the linear covariance analysis estimates and to better characterize orbit determination performance for actively maneuvering spacecraft in a highly elliptical orbit. The study finds that the COTS extended Kalman filter tool converges on accurate definitive orbit solutions quickly, but prediction accuracy through orbits with very low altitude perigees is degraded by the unpredictability of atmospheric density variation.

Determination↗

Orbit Determination Accuracy Analysis of the Magnetospheric Multiscale Mission During Perigee Raise

The Goddard Space Flight Center (GSFC) Flight Dynamics Facility (FDF) will provide orbit determination and prediction support for the Magnetospheric Multiscale (MMS) mission during the mission's commissioning period. The spacecraft will launch into a highly elliptical Earth orbit in 2015. Starting approximately four days after launch, a series of five large perigee-raising maneuvers will be executed near apogee on a nearly every-other-orbit cadence. This perigee-raise operations concept requires a high-accuracy estimate of the orbital state within one orbit following the maneuver for performance evaluation and a high-accuracy orbit prediction to correctly plan and execute the next maneuver in the sequence. During early mission design, a linear covariance analysis method was used to study orbit determination and prediction accuracy for this perigee-raising campaign. This paper provides a higher fidelity Monte Carlo analysis using the operational COTS extended Kalman filter implementation that was performed to validate the linear covariance analysis estimates and to better characterize orbit determination performance for actively maneuvering spacecraft in a highly elliptical orbit. The study finds that the COTS extended Kalman filter tool converges on accurate definitive orbit solutions quickly, but prediction accuracy through orbits with very low altitude perigees is degraded by the unpredictability of atmospheric density variation.

Multiscale↗

Virtual Test Bed (VTB): NRIC FY24 Program Review

NRIC: Deliver successful demonstration and deployment of advanced nuclear energy EBRII Test Bed (DOME) ZPPR Test Bed (LOTUS) Virtual Test Bed (VTB): Accelerate deployment of advanced reactors by leveraging state-of-the-art ModSim tools to evaluate performance and safety Ok, but what is it? Library of Reference Model: database of advanced multiphysics advanced reactor models that users can download, edit, and re-run Continuous Software QA: linking repository to software development to avoid legacy issues while enabling rapid code development Virtual models of the test bed: developing demonstration-relevant models (e.g., candidates for DOME/LOTUS) to accelerate safety evaluations

22 GENERAL STUDIES OF NUCLEAR REACTORS↗