Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Performance Tools”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Building a Community Infrastructure for Scalable On-Line Performance Analysis Tools around Open|SpeedShop

In this project we created a community tool infrastructure for program development tools targeting Petascale class machines and beyond. This includes tools for performance analysis, debugging, and correctness tools, as well as tuning and optimization frameworks. The developed infrastructure provides a comprehensive and extensible set of individual tool building components. We started with the basic elements necessary across all tools in such an infrastructure followed by a set of generic core modules that allow a comprehensive performance analysis at scale. Further, we developed a methodology and workflow that allows others to add or replace modules, to integrate parts into their own tools, or to customize existing solutions. In order to form the core modules, we built on the existing Open|SpeedShop infrastructure and decomposed it into individual modules that match the necessary tool components. At the same time, we addressed the challenges found in performance tools for petascale systems in each module. When assembled, this instantiation of community tool infrastructure provides an enhanced version of Open|SpeedShop, which, while completely different in its architecture, provides scalable performance analysis for petascale applications through a familiar interface. This project also built upon and enhances capabilities and reusability of project partner components as specified in the original project proposal. The overall project team’s work over the project funding cycle was focused on several areas of research, which are described in the following sections. The reminder of this report also highlights related work as well as preliminary work that supported the project. In addition to the project partners funded by the Office of Science under this grant, the project team included several collaborators who contribute to the overall design of the envisioned tool infrastructure. In particular, the project team worked closely with the other two DOE NNSA laboratories Los Alamos and Sandia leveraging co-funding for Krell by ASC’s Common Computing Environment (CCE) program as laid out in the original proposal. The ASC CCE co-funding, coordinated through LLNL, was for 50% of the total project funding, with the ASC CCE portion of the funding going entirely to Krell, while the ASCR funding itself was split between Krell and the funded partners. This report covers the entire project from both funding sources. Additionally, the team leveraged the expertise of software engineering researchers from Carnegie Mellon University, who specialize in software framework design, in order to achieve a broadly acceptable component framework. The Component Based Tool Framework (CBTF) software has been released to the community. Information related to the project and the released software can be found on the CBTF wiki page at: http://sourceforge.net/p/cbtf/wiki/Home.

97 MATHEMATICS AND COMPUTING↗

Performance Analysis Tool for HPC and Big Data Applications on Scientific Clusters

Big data is prevalent in HPC computing. Many HPC projects rely on complex workflows to analyze terabytes or petabytes of data. These workflows often require running over thousands of CPU cores and performing simultaneous data accesses, data movements, and computation. It is challenging to analyze the performance involving terabytes or petabytes of workflow data or measurement data of the executions, from complex workflows over a large number of nodes and multiple parallel task executions. To help identify performance bottlenecks or debug the performance issues in large-scale scientific applications and scientific clusters, we have developed a performance analysis framework, using state-ofthe- art open-source big data processing tools. Our tool can ingest system logs and application performance measurements to extract key performance features, and apply the most sophisticated statistical tools and data mining methods on the performance data. It utilizes an efficient data processing engine to allow users to interactively analyze a large amount of different types of logs and measurements. To illustrate the functionality of the big data analysis framework, we conduct case studies on the workflows from an astronomy project known as the Palomar Transient Factory (PTF) and the job logs from the genome analysis scientific cluster. Our study processed many terabytes of system logs and application performance measurements collected on the HPC systems at NERSC. The implementation of our tool is generic enough to be used for analyzing the performance of other HPC systems and Big Data workows.

97 MATHEMATICS AND COMPUTING↗

Method and apparatus for characterizing and enhancing the dynamic performance of machine tools

Disclosed are various systems and methods for assessing and improving the capability of a machine tool. The disclosure applies to machine tools having at least one slide configured to move along a motion axis. Various patterns of dynamic excitation commands are employed to drive the one or more slides, typically involving repetitive short distance displacements. A quantification of a measurable merit of machine tool response to the one or more patterns of dynamic excitation commands is typically derived for the machine tool. Examples of measurable merits of machine tool performance include dynamic one axis positional accuracy of the machine tool, dynamic cross-axis stability of the machine tool, and dynamic multi-axis positional accuracy of the machine tool.

47 OTHER INSTRUMENTATION↗

Method and apparatus for characterizing and enhancing the functional performance of machine tools

Disclosed are various systems and methods for assessing and improving the capability of a machine tool. The disclosure applies to machine tools having at least one slide configured to move along a motion axis. Various patterns of dynamic excitation commands are employed to drive the one or more slides, typically involving repetitive short distance displacements. A quantification of a measurable merit of machine tool response to the one or more patterns of dynamic excitation commands is typically derived for the machine tool. Examples of measurable merits of machine tool performance include workpiece surface finish, and the ability to generate chips of the desired length.

42 ENGINEERING↗

Integrated modeling tool for performance engineering of complex computer systems

This report summarizes Advanced System Technologies' accomplishments on the Phase 2 SBIR contract NAS7-995. The technical objectives of the report are: (1) to develop an evaluation version of a graphical, integrated modeling language according to the specification resulting from the Phase 2 research; and (2) to determine the degree to which the language meets its objectives by evaluating ease of use, utility of two sets of performance predictions, and the power of the language constructs. The technical approach followed to meet these objectives was to design, develop, and test an evaluation prototype of a graphical, performance prediction tool. The utility of the prototype was then evaluated by applying it to a variety of test cases found in the literature and in AST case histories. Numerous models were constructed and successfully tested. The major conclusion of this Phase 2 SBIR research and development effort is that complex, real-time computer systems can be specified in a non-procedural manner using combinations of icons, windows, menus, and dialogs. Such a specification technique provides an interface that system designers and architects find natural and easy to use. In addition, PEDESTAL's multiview approach provides system engineers with the capability to perform the trade-offs necessary to produce a design that meets timing performance requirements. Sample system designs analyzed during the development effort showed that models could be constructed in a fraction of the time required by non-visual system design capture tools.

Wright, Gary↗

Building a Community Infrastructure for Scalable On-Line Performance Analysis Tools around Open|Speedshop (Final Technical Report)

Peta-scale computing environments pose significant challenges for both system and application developers and addressing them required more than simply scaling up existing tera-scale solutions. Performance analysis tools play an important role in gaining this understanding, but previous monolithic tools with fixed feature sets have not sufficed. Instead, this project worked on the design, implementation, and evaluation of a general, flexible tool infrastructure supporting the construction of performance tools as “pipelines” of high-quality tool building blocks. These tool building blocks provide common performance tool functionality, and are designed for scalability, lightweight data acquisition and analysis, and interoperability. For this project, we built on Open|SpeedShop, a modular and extensible open source performance analysis tool set.

97 MATHEMATICS AND COMPUTING↗

Evaluation of Revised Computer-Based Procedure System Prototype

The nuclear power industry is very procedure driven, i.e. almost all activities that take place at a nuclear power plant are conducted by following procedures. The paper-based procedures (PBPs) currently used by the industry do a good job at keeping the industry safe. However, these procedures are most often paired with methods and tools put in place to anticipate, prevent, and catch errors related to hands-on work. These tools are commonly called human performance tools. The drawback with the current implementation of these tools is that the task of performing one procedure becomes time and labor intensive. For example, concurrent and independent verification of procedure steps are required at times, which essentially means that at least two people have to be actively involved in the task. Even though the current use of PBPs and human performance tools are keeping the industry safe, there is room for improvement. The industry could potentially increase their efficiency and safety by replacing their existing PBPs with CBPs. If implemented correctly, the CBP system could reduce the time and focus spent on using the human performance tools. Some of the tools can be completely incorporated in the CBP system in a manner that the performer does not think about the fact that these tools are being used. Examples of these tools are procedure use and adherence, placekeeping, and peer checks. Other tools can be partly integrated in a fashion that reduce the time and labor they require, such as concurrent and independent verification. The incorporation of advanced technology, such as CBP systems, may help to manage the effects of aging systems, structures, and components. The introduction of advanced technology may also make the existing LWR fleet more attractive to the future workforce, which will be of importance when the future workforce will chose between existing fleet and the newly built nuclear power plants.

97 MATHEMATICS AND COMPUTING↗

An Evaluation of Advanced Tools for Distributed Wind Turbine Performance Estimation: Preprint

We evaluate various classes of distributed wind turbine performance tools across two sites in the USA. The tools class ranges from the simple mass conservation model to coupled Reynolds Averaged Navier-Stokes (RANS) model, all initiated by the WIND Toolkit dataset. The resource estimation at the site is evaluated against measured data at the mast location. Taking a sample 100 kW wind turbine and constant losses, we evaluate Openwind, Continuum, and WindNinja tools and document Annual Energy Production (AEP) and time series statistics associated with the performance estimation of the wind turbine. Using a methodology that is consistent and unbiased across the three advance options currently available in the industry, we elaborate results at the two sample locations and discuss the probable sources of discrepancy in the AEP estimates. The discussion includes additional values these tools may bring into the energy assessment process to enhance the owners' confidence over the distributed wind power systems.

17 WIND ENERGY↗

An Evaluation of Advanced Tools for Distributed Wind Turbine Performance Estimation

We evaluate various classes of distributed wind turbine performance tools across two sites in the United States. The class of tools ranges from the simple mass conservation model to the coupled Reynolds-averaged Navier-Stokes model, all initiated by the WIND Toolkit data set. The resource estimation at the site is evaluated against measured data at the mast location. Taking a sample 100-kW wind turbine and constant losses, we evaluate Openwind, Continuum, and WindNinja tools and document annual energy production (AEP) and time-series statistics associated with the performance estimation of the wind turbine. Using a methodology that is consistent and unbiased across the three options currently available in the industry, we elaborate results at the two sample locations and discuss the probable sources of discrepancy in the AEP estimates. Two main sources of the discrepancy come from the input WIND Toolkit data and the spatial modeling techniques of the tools to capture atmospheric physics. The discussion includes additional values that these tools may bring into the energy assessment process to enhance the owners' confidence over the distributed wind power systems.

17 WIND ENERGY↗

Usability of Operational Performance Support Tools - Findings from Sea Test II

Sea Test II, aka NASA Extreme Environment Mission Operations 17(NEEMO 17) took place in the Florida Aquarius undersea habitat. This confined underwater environment provides a excellent analog for space habitation providing similarities to space habitation such as hostile environment, difficult logistics, autonomous operations, and remote communications. This study collected subjective feedback on the usability of two performance support tools during the Sea Test II mission, Sept 10‐14, 2013; Google Glass and iPAD. The two main objectives: - Assess the overall functionality and usability of each performance support tool in a mission analog environment. - Assess the advantages and disadvantages of each tool when performing operational procedures and Just‐In‐Time‐Training (JITT).

Byrne, Vicky↗

Tools Assessing Performance

For the distributed wind industry, it can be challenging to accurately predict the performance and annual energy production of projects prior to their installation. The U.S. Department of Energy’s Tools Assessing Performance (TAP) project aims to improve wind resource characterization, thereby reducing the uncertainty of project performance and financing costs, increasing consumer confidence, and lowering the levelized cost of distributed wind energy. A collaborative effort among DOE National Laboratories, TAP will create a computational framework that provides the distributed wind community with access to newly developed wind resource data and modeling capabilities. These capabilities will allow users to perform timely and accurate performance assessments for distributed wind projects at locations across the United States.

wind, distributed, tools, performance↗

Performance Support Tools for Space Medical Operations

The early Constellation space missions are expected to have medical capabilities very similar to those currently on the Space Shuttle and International Space Station (ISS). For Crew Exploration Vehicle (CEV) missions to ISS, medical equipment will be located on ISS, and carried into CEV in the event of an emergency. Flight Surgeons (FS) on the ground in Mission Control will be expected to direct the Crew Medical Officer (CMO) during medical situations. If there is a loss of signal and the crew is unable to communicate with the ground, a CMO would be expected to carry out medical procedures without the aid of a FS. In these situations, performance support tools can be used to reduce errors and time to perform emergency medical tasks. Human factors personnel at Johnson Space Center have recently investigated medical performance support tools for CMOs on-orbit, and FSs on the ground. This area of research involved the feasibility of Just-in-time (JIT) training techniques and concepts for real-time medical procedures. In Phase 1, preliminary feasibility data was gathered for two types of prototype display technologies: a hand-held PDA, and a Head Mounted Display (HMD). The PDA and HMD were compared while performing a simulated medical procedure using ISS flight-like medical equipment. Based on the outcome of Phase 1, including data on user preferences, further testing was completed using the PDA only. Phase 2 explored a wrist-mounted PDA, and compared it to a paper cue card. For each phase, time to complete procedures, errors, and user satisfaction were captured. Information needed by the FS during ISS mission support, especially for an emergency situation (e.g. fire onboard ISS), may be located in many different places around the FS s console. A performance support tool prototype is being developed to address this issue by bringing all of the relevant information together in one place. The tool is designed to include procedures and other information needed by a FS during an emergency, as well as procedures and information to be used after the emergency is resolved. Several walkthroughs of the prototype with FSs have been completed within a mockup of an ISS FS console. Feedback on the current tool design as well as recommendations for existing ISS FS displays were captured.

Byrne, Vicky E.↗

ESMValTool (v1.0) – a community diagnostic and performance metrics tool for routine evaluation of Earth system models in CMIP

A community diagnostics and performance metrics tool for the evaluation of Earth system models (ESMs) has been developed that allows for routine comparison of single or multiple models, either against predecessor versions or against observations. The priority of the effort so far has been to target specific scientific themes focusing on selected essential climate variables (ECVs), a range of known systematic biases common to ESMs, such as coupled tropical climate variability, monsoons, Southern Ocean processes, continental dry biases, and soil hydrology–climate interactions, as well as atmospheric CO 2 budgets, tropospheric and stratospheric ozone, and tropospheric aerosols. The tool is being developed in such a way that additional analyses can easily be added. A set of standard namelists for each scientific topic reproduces specific sets of diagnostics or performance metrics that have demonstrated their importance in ESM evaluation in the peer-reviewed literature. The Earth System Model Evaluation Tool (ESMValTool) is a community effort open to both users and developers encouraging open exchange of diagnostic source code and evaluation results from the Coupled Model Intercomparison Project (CMIP) ensemble. This will facilitate and improve ESM evaluation beyond the state-of-the-art and aims at supporting such activities within CMIP and at individual modelling centres. Ultimately, we envisage running the ESMValTool alongside the Earth System Grid Federation (ESGF) as part of a more routine evaluation of CMIP model simulations while utilizing observations available in standard formats (obs4MIPs) or provided by the user.

58 GEOSCIENCES↗

Performance Support Tools for Space Medical Operations

Early Constellation space missions are expected to have medical capabilities similar to those currently on board the Space Shuttle and International Space Station (ISS). Flight surgeons on the ground in Mission Control will direct the Crew Medical Officer (CMO) during medical situations. If the crew is unable to communicate with the ground, the CMO will carry out medical procedures without the aid of a flight surgeon. In these situations, use of performance support tools can reduce errors and time to perform emergency medical tasks. The research presented here is part of the Human Factors in Training Directed Research Project of the Space Human Factors Engineering Project under the Space Human Factors and Habitability Element of the Human Research Program. This is a joint project consisting of human factors teams from the Johnson Space Center (JSC) and the Ames Research Center (ARC). Work on medical training has been conducted in collaboration with the Medical Training Group at JSC and with Wyle that provides medical training to crew members, biomedical engineers (BMEs), and flight surgeons under the Bioastronautics contract. Human factors personnel at Johnson Space Center have investigated medical performance support tools for CMOs and flight surgeons.

Byrne, Vicky↗

PATHA: Performance Analysis Tool for HPC Applications

Large science projects rely on complex workflows to analyze terabytes or petabytes of data. These jobs are often running over thousands of CPU cores and simultaneously performing data accesses, data movements, and computation. It is difficult to identify bottlenecks or to debug the performance issues in these large workflows. In order to address these challenges, we have developed Performance Analysis Tool for HPC Applications (PATHA) using the state-of-art open source big data processing tools. Our framework can ingest system logs to extract key performance measures, and apply the most sophisticated statistical tools and data mining methods on the performance data. Furthermore, it utilizes an efficient data processing engine to allow users to interactively analyze a large amount of different types of logs and measurements. To illustrate the functionality of PATHA, we conduct a case study on the workflows from an astronomy project known as the Palomar Transient Factory (PTF). This study processed 1.6 TB of system logs collected on the NERSC supercomputer Edison. Using PATHA, we were able to identify performance bottlenecks, which reside in three tasks of PTF workflow with the dependency on the density of celestial objects.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

Tools Assessing Performance (TAP) 2.0

Dmitry Duplyakin will be presenting on the latest research and results in the Tools Assessing Performance (TAP) 2.0 project. This presentation will include updates on the latest data the group has produced, integration of obstacle models in the computational pipeline for distributed wind siting, and the plans for the near-term analysis and validation efforts. The talk will acknowledge the work of collaborators from NREL and three other national labs - ANL, LANL, and PNNL - all contributing to this multi-year project.

distributed wind↗

Application of Performance Analysis Tools on SNL ASC Codes

This milestone 1) exercised a broad set of performance profiling and analysis tools, including tools whose development has been promoted by the ASC program; 2) exercised the tools on two different SNL ASC codes, one Sierra code (Sierra/Aria, a C++ codebase) and one RAMSES code (ITS, a Fortran codebase); and 3) exercised the tools on multiple platforms, including the CTS-1 (e.g., Serrano) and ATS-1 Trinity (e.g., Mutrino) platforms. The milestone generated a plethora of strong and weak scaling, trend and profile data for multiple versions and problem cases for each of the two codes. A wealth of experience was gained with the various tools that included identification of problems, an improved understanding of feature sets, enhanced usage documentation, and insights for future tool-development. Results are provided from a large number and variety of performance analysis runs with the target codes, together with instructions for how to make use of the tools with the codes.

97 MATHEMATICS AND COMPUTING↗