Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “NEW JOBS”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 505 records · Page 28

The WorkQueue project: A task queue for the CMS workload management system

We present the development and first experience of a new component (termed WorkQueue) in the CMS workload management system. This component provides a link between a global request system (Request Manager) and agents (WMAgents) which process requests at compute and storage resources (known as sites). These requests typically consist of creation or processing of a data sample (possibly terabytes in size). Unlike the standard concept of a task queue, the WorkQueue does not contain fully resolved work units (known typically as jobs in HEP). This would require the WorkQueue to run computationally heavy algorithms that are better suited to run in the WMAgents. Instead the request specifies an algorithm that the WorkQueue uses to split the request into reasonable size chunks (known as elements). An advantage of performing lazy evaluation of an element is that expanding datasets can be accommodated by having job details resolved as late as possible. The WorkQueue architecture consists of a global WorkQueue which obtains requests from the request system, expands them and forms an element ordering based on the request priority. Each WMAgent contains a local WorkQueue which buffers work close to the agent, this overcomes temporary unavailability of the global WorkQueue and reduces latency for an agent to begin processing. Elements are pulled from the global WorkQueue to the local WorkQueue and into the WMAgent based on the estimate of the amount of work within the element and the resources available to the agent. WorkQueue is based on CouchDB, a document oriented NoSQL database. The WorkQueue uses the features of CouchDB (map/reduce views and bi-directional replication between distributed instances) to provide a scalable distributed system for managing large queues of work. The project described here represents an improvement over the old approach to workload management in CMS which involved individual operators feeding requests into agents. This new approach allows for a system where individual WMAgents are transient and can be added or removed from the system as needed.

Ryu, S.↗

Job/Task Analysis: Enhancing the Commercial Building Workforce Through the Development of Foundational Materials; Preprint

For many commercial building operation job categories, industry consensus has not been reached on the knowledge, skills, and abilities that practitioners should possess. The goal of this guidance is to help streamline the minimum competencies taught or tested by organizations catering to building operations and maintenance personnel while providing a basis for developing and comparing new andexisting training programs in the commercial building sector. The developed JTAs will help individuals identify opportunities to enhance their professional skills, enable industry to identify an appropriately skilled workforce, and allow training providers to ensure that they are providing the highest quality product possible.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Mobile Thread Task Manager

The Mobile Thread Task Manager (MTTM) is being applied to parallelizing existing flight software to understand the benefits and to develop new techniques and architectural concepts for adapting software to multicore architectures. It allocates and load-balances tasks for a group of threads that migrate across processors to improve cache performance. In order to balance-load across threads, the MTTM augments a basic map-reduce strategy to draw jobs from a global queue. In a multicore processor, memory may be "homed" to the cache of a specific processor and must be accessed from that processor. The MTTB architecture wraps access to data with thread management to move threads to the home processor for that data so that the computation follows the data in an attempt to avoid L2 cache misses. Cache homing is also handled by a memory manager that translates identifiers to processor IDs where the data will be homed (according to rules defined by the user). The user can also specify the number of threads and processors separately, which is important for tuning performance for different patterns of computation and memory access. MTTM efficiently processes tasks in parallel on a multiprocessor computer. It also provides an interface to make it easier to adapt existing software to a multiprocessor environment.

Clement, Bradley J.↗

Oak Ridge Institutional Cluster Autotune Test Drive Report

The Oak Ridge Institutional Cluster (OIC) provides general purpose computational resources for the ORNL staff to run computation heavy jobs that are larger than desktop applications but do not quite require the scale and power of the Oak Ridge Leadership Computing Facility (OLCF). This report details the efforts made and conclusions derived in performing a short test drive of the cluster resources on Phase 5 of the OIC. EnergyPlus was used in the analysis as a candidate user program and the overall software environment was evaluated against anticipated challenges experienced with resources such as the shared memory-Nautilus (JICS) and Titan (OLCF). The OIC performed within reason and was found to be acceptable in the context of running EnergyPlus simulations. The number of cores per node and the availability of scratch space per node allow non-traditional desktop focused applications to leverage parallel ensemble execution. Although only individual runs of EnergyPlus were executed, the software environment on the OIC appeared suitable to run ensemble simulations with some modifications to the Autotune workflow. From a standpoint of general usability, the system supports common Linux libraries, compilers, standard job scheduling software (Torque/Moab), and the OpenMPI library (the only MPI library) for MPI communications. The file system is a Panasas file system which literature indicates to be an efficient file system.

99 GENERAL AND MISCELLANEOUS↗

The Vault

This new edition of The Vault is another example of our staff’s relentless drive to produce high-quality products. This is the third year we developed this annual magazine. Each volume of The Vault is a labor of love. We do it because we see this as part of our job as stewards of the Lab’s history — and because failure in this critical role is not an option.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

Clean Energy Workforce and Employment Gap Analysis in the Hill District of Pittsburgh, PA [Slides]

Through Communities LEAP, a community coalition focused on the Hill District neighborhood of Pittsburgh is working with a technical assistance provider network led by the National Renewable Energy Laboratory (NREL). The coalition includes community organizations, nonprofits, the city government, and the utility. Technical assistance provides analysis and information to support Hill District stakeholders in their goals to create informed residential energy efficiency and renewable energy transition strategies that improve housing conditions and lower energy bills, incorporate energy efficiency and renewable energy strategies into existing, community-driven development efforts; and generate quality local jobs. This presentation provides a summary of potential employment impacts of residential energy efficiency investments in the Hill District, aligned with NREL's housing stock analysis; a scan of existing energy efficiency and clean energy workforce and education stakeholders in and around the Hill District; and gaps and potential opportunities for new or expanded training to align with energy efficiency and clean energy goals.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Shifting institutional culture to develop climate solutions with Open Science

This call to action by Drs. Johnson and Wilkinson is part of a mosaic of voices sharing tangible progress within the climate movement 1,2. This call speaks to us as environmental and Earth scientists motivated by the urgency of climate change and social inequity and who contribute to finding science-driven climate solutions as part of our daily jobs. Unfortunately, we are often unable to efficiently move this critical and urgent work forward because we are impeded by cumbersome daily workflows and restrictive workplace cultures. Our workplaces have not kept pace with the modern realities of data-intensive science: increasing data volumes and storage needs, rapidly evolving technology, new skill requirements, and a growing need for extensive and diverse collaboration. Struggling with old approaches and learning new ones in isolation can fuel burnout and turnover, preventing us from working on science-driven climate solutions effectively.

open science↗

#WomenInSTEM: Stepping Stones From One Career to Another

Meet Cheryl Martin, Acting Director of the Advanced Research Projects Agency for Energy (ARPA-E) and the latest profile in the Energy Department's #WomenInSTEM video series. Cheryl looks at transformational projects to explore the uncharted territories of energy technology to generate options for entirely new paths to create, store and use energy. There are many challenges to overcome in the energy field, and it's important to have a diverse set of voices in STEM careers to meet these demands. Cheryl recommends that young women include all the skills they have - those gained at formal jobs as well as through volunteering or nonprofit organizations - when they take their next career step. These skills form the stepping stones that lead from one career to the next. And with a solid grounding in STEM, the opportunities are endless.

#WOMENINSTEM↗

Multi-Threaded Output in CMS using ROOT

CMS has worked aggressively to make use of multi-core architectures, routinely running 4- to 8-core production jobs in 2017. The primary impediment to efficiently scaling beyond 8 cores has been our ROOT-based output module, which has been necessarily single threaded. In this paper we explore the changes made to the CMS framework and our ROOT output module to overcome the previous scaling limits, using two new ROOT features: the \texttt{TBufferMerger} asynchronous file merger, and Implicit Multi-Threading. We examine the architecture of the new parallel output module, the specific accommodations and modifications that were made to ensure compatibility with the CMS framework scheduler, and the performance characteristics of the new output module.

Riley, Daniel↗

Recovery Act: SeaMicro Volume Server Power Reduction Research Development

Cloud data centers are projected to be the fastest growing segment of the server market through 2015, according to IDC. Increasingly people and businesses rely on the Cloud to deliver digital content quickly and efficiently. Recovery Act funding from the Department of Energy has helped SeaMicro's technologies enhance the total cost of operation, performance and energy efficiency in large data center and Cloud environments. SeaMicro's innovative supercomputer fabric connects thousands of processor cores, memory, storage and input/output traffic. The company's fabric supports multiple processor instruction sets. Current systems featuring SeaMicro technology typically use one quarter the power and take one sixth the space of traditional servers with the same compute performance, yet deliver up to 12 times the bandwidth per core. Mozilla and eHarmony are two customers successfully using SeaMicro's technology. Numerous non-public customers have been successfully using the SeaMicro product in test and production facilities. As a result of the Recovery Act funding from the U.S. Department of Energy, more than 50 direct jobs were created at SeaMicro. To date, they primarily have been high-value, engineering jobs. Hardware, software and manufacturing engineering positions have been created, as well as sales and sales engineering. The positions have allowed SeaMicro to significantly accelerate engineering development and accelerate commercialization. As a result, commercialization and delivery to market are months ahead of initial schedule. Additional jobs were indirectly created through the development of the SeaMicro product. Through many years of research and hard work prior to receipt of public funding, SeaMicro was awarded 2 patents for its work. SeaMicro's product led the way for industry leaders to reconsider the market for low power servers and create new product lines. With valuable support of the U.S. Department of Energy and through SeaMicro's product, the market has been reshaped by the company's unique approach and ground breaking technology.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Comparison of experiment with calculations using curvature-corrected zero and two equation turbulence models for a two-dimensional U-duct

In this paper experimental measurements are compared with Navier-Stokes calculations using seven different turbulence models for the internal flow in a two-dimensional U-duct. The configuration is representative of many internal flows of engineering interst that experience strong curvature. In an effort to improve agreement, this paper tests several versions of the two-equation k-epsilon turbulence model including the standard version, an extended version with a production range time scale, and a version that includes curvature time scales. Each is tested in its high and low Reynolds number formulations. Calculations using these new models and the original mixing length model are compared here with measurements of mean and turbulence velocities, static pressure and skin friction in the U-duct at two Reynolds numbers. The comparisons show that only the low Reynolds number version of the extended k-epsilon model does a reasonable job of predicting the important features of this flow at both Reynolds numbers tested.

Monson, D. J.↗

TPSAS-NF1676L-33992-DND

The CERES Science Team integrates and fuses observations from 6 CERES instruments aboard the Terra, Aqua, S-NPP, and NOAA-20 missions with data from more than 20 other unique data sources. Following the November 2017 launch of CERES Flight Model 6 (FM6) onboard NOAA20, CERES has now amassed over 80 instrument-years of valuable Earth radiation budget data. The rapidly growing volume of CERES data coupled with the introduction of new data products alongside improvements to existing science algorithms fosters the requirement for faster, more flexible, and scalable data production and orchestration. New virtualized, cloud-centric compute hardware hosted by the NASA Langley Research Center’s (LaRC) Atmospheric Sciences Data Center (ASDC) provides an ideal environment for these ever-increasing data production demands for CERES. This poster discusses updates to the implementation of the CERES Data Management Team’s (DMT) CERES AuTomAted job Loading sYSTem (CATALYST), a custom data processing workflow engine for CERES, to use on-demand computing resources to perform automated CERES data production processing in a Linux-based container environment. Linux containers provide CERES the flexibility to build multiple production environments in containers tailored for specific workloads and allow effortless provisioning of resources based on the CERES Science Team’s data production requirements.

Thomas N. Hillyer↗

Extreme Problem Solving: The New Challenges of Deep Space Exploration

On the International Space Station today, the crew has the near real-time support of a large group of system experts on the ground when dealing with problems on-board. For exploration beyond Low Earth Orbit, however, intermittent and delayed communication with ground will force small crews to take the lead in responding to vehicle anomalies. Enabling a flight crew of roughly four astronauts to perform the job that has traditionally been done by a ground crew of over 80 experts will require a fundamental rethinking of human-systems integration. Through observations of anomaly resolution processes, interviews with system experts and astronauts, and analyses of problem-solving models, we have identified the capabilities that are not currently available on-board but will be needed to enable safe exploration further away from Earth. These include increased data access, just-in-time training tools and technologies, and troubleshooting decision support. Important questions remain on how these technologies can be designed and implemented for increased crew autonomy. We present this critical challenge for deep space exploration to the human-computer interaction research community to reflect on the areas identified by our needs analysis and contemplate how they might be manifested as solutions.

autonomy↗

Automatic and Transparent Resource Contention Mitigation for Improving Large-Scale Parallel File System Performance

Proportional to the scale increases in HPC systems, many scientific applications are becoming increasingly data intensive, and parallel I/O has become one of the dominant factors impacting the large-scale HPC application performance. On a typical large-scale HPC system, we have observed that the lack of a global workload coordination coupled with the shared nature of storage systems cause load imbalance and resource contention over the end-to-end I/O paths resulting in severe performance degradation. I/O load imbalance on HPC systems is generally a self-inflicted wound and mostly occurs between the I/O paths and resources consumed by each individual job. In this paper, we introduce TAPP-IO, a dynamic, shared load balancing framework for mitigating resource contention. TAPP-IO extends our previous work and solves two major limitations: First, it transparently intercepts file creation calls during runtime to balance the workload over all available storage targets. The usage of TAPP-IO requires no application source code modifications and is independent from any I/O middleware. The framework can be applied to almost any HPC platform and is suitable for systems that lack a centralized file system resource manager. Second, the framework proposes a new placement strategy to support not only file-per-process I/O, but also single shared file I/O. This opens the door to a new class of scientific applications that can leverage the placement library for improved performance. We demonstrate the effectiveness of our integration on the Titan system at the Oak Ridge National Laboratory. Our experiments with a synthetic benchmark and real-world HPC workload show that, even in a noisy production environment, TAPP-IO can improve large-scale application performance significantly.

Neuwirth, Sarah↗

CORE-CM in The Greater Green River and Wind River Basins: Transforming and Advancing a National Coal Asset (Final Report)

The following document summarizes project results from “CORE-CM in the Greater Green River and Wind River Basins: Transforming and Advancing a National Coal Asset”. This project is part of the U.S. Department of Energy’s (“DOE”) National Energy Technology Laboratory’s (“NETL”) Carbon Ore, Rare Earth Elements, and Critical Minerals (CORE-CM) Initiative. This report concludes that the Greater Green River and Wind River Basins (GGRB-WRB) Area-of-Interest (AOI 9) is the ideal region for continued research and development in progressing the broader CORE-CM goals outlined by the DOE. Based upon the extensive analyses of technical, social, and community criteria, this report illustrates that the GGRB-WRB hosts numerous potential CORE-CM feedstocks (both coal- and non-coal based), diverse opportunities for utilizing existing industrial waste streams, ample infrastructure and industry to support new CORE-CM-focused technologies, and a highly motivated, well educated, and adaptable workforce to further develop the regional and national CORE-CM supply chain. Additionally, some potential solutions for technological gaps suggest that the GGRB-WRB's diverse resources can play a significant role in achieving the national goal of critical materials independence. With full community participation, meaningful involvement of regional Tribal Nations, and building upon the stakeholder engagement demonstrated here, the GGRB-WRB region presents a unique opportunity for advancing the CORE-CM Initiative. This project was designed to bring together coal-based communities and stakeholders from across the GGRB-WRB to advance new industries for CORE-CM resources. The University of Wyoming (UWyo) School of Energy Resources (SER) led a project team of experts from the Colorado Geological Survey (CGS), Colorado School of Mines (CSM), Los Alamos National Lab (LANL), and local community colleges. Input from basinal, regional, and national experts bolstered the coalition in order to advance the mission of DOE’s CORE-CM initiative and develop the domestic CORE-CM supply chain. Phase I of this project was designed to address the goal of developing and catalyzing economic growth, job creation, and technology innovation in the GGRB-WRB of Wyoming and Colorado, by increasing the supply of CORE-CM to manufacturers of non-fuel Carbon Based Products (CBP) and products reliant upon CM. The GGRB-WRB CORE-CM project worked toward providing benefit through several avenues of performance and research. • Develop a coalition team to achieve project objectives • Complete detailed assessments, including State-of-the-Art (SOTA) Data acquisition of potential CORE-CM materials across the AOI, and meaningfully contributes to DOE’s CORE-CM goals nationally. • Strategic planning for regional economic growth, job creation, and associated technology innovation around coal materials, including plans to maximize the development of potential CORE-CM resources and technology by creating regional public-private partnerships. • Define regional economic growth potential around existing strengths, energy infrastructure, business and industry, including planning for the leveraging of highly trained workforces, existing and novel coal technologies, and energy infrastructure in development of CORE-CM supply chains. • Develop a preliminary strategic plan for increasing the supply of CORE-CM materials to manufacturers of non-fuel Carbon Based Products (CBP) and products reliant upon CM, focusing on regional strengths that result in an emerging diversified CORE-CM economy. • Assemble a committed network of stakeholders and communities that learn about, accept, and grow new energy technologies within coal regions. Additionally, the project team significantly contributed to the CORE-CM Initiative’s national goals, through cross-regional scoping, collaborating with CORE-CM projects in other AOIs, and including parallel regional project experts. In addition to active inclusion and meaningful engagement and contribution to DOE-led working groups, the project team focused on engaging with regional communities including Tribal Nations, economic development groups, and regional government organizations. The project’s CORE-CM development and commercialization plan identified diverse CORECM feedstocks, potential routes towards integration with existing industries, methods for supply-chain development that leverage existing infrastructure and businesses considering the regional economy, identified entry barriers for incorporating traditional and new technologies in those supply chains, recognized opportunities for public-private partnerships to develop technology innovation centers, identified diverse workforces, and conducted stakeholder outreach and education to build a community of understanding on CORE-CM potential in the GGRB-WRB region. Detailed task descriptions can be found in each chapter.

01 COAL, LIGNITE, AND PEAT↗

Memory Optimization for Phase-field Simulations

Phase-field simulations are computationally and memory intensive applications. Many of the phase-field simulations being conducted in support of NEAMS were not capable of running on “normal clusters” with 2-4GB of RAM per core, and instead required specialized “big-memory” clusters with 64GB per core. To address this issue, the MOOSE team developed a new Python-based utility called MemoryLogger, and applied it to locate, diagnose, and eradicate memory bottlenecks within the MOOSE framework. MemoryLogger allows for a better understanding of the memory usage of an application being run in parallel across a cluster. Memory usage information is captured for every individual process in a parallel job, and communicated to the head node of the cluster. Console text output from the application itself is automatically matched with this memory usage information to produce a detailed picture of memory usage over time, making it straightforward to identify the subroutines which contribute most to the application’s peak memory usage. The information produced by the MemoryLogger quickly and effectively narrows the search for memory optimizations to the most data-intensive parts of the simulation.

99 GENERAL AND MISCELLANEOUS↗

Evaluating System Parameters on a Dragonfly using Simulation and Visualization

The dragon y topology is becoming a popular choice for build- ing high-radix, low-diameter networks with high-bandwidth links. Even with a powerful network, preliminary experi- ments on Edison at NERSC have shown that for communica- tion heavy applications, job interference and thus presumably job placement remains an important factor. In this paper, we explore the e ects of job placement, job sizes, parallel workloads and network con gurations on network through- put to better understand inter-job interference. We use a simulation tool called Damsel y to model the network be- havior of Edison and study the impact of various system parameters on network throughput. Parallel workloads based on ve representative communication patters are used and the simulation studies on up to 131,072 cores are aided by a new visualization of the dragon y network.

97 MATHEMATICS AND COMPUTING↗

The Science of Computing: Virtual Memory

In the March-April issue, I described how a computer's storage system is organized as a hierarchy consisting of cache, main memory, and secondary memory (e.g., disk). The cache and main memory form a subsystem that functions like main memory but attains speeds approaching cache. What happens if a program and its data are too large for the main memory? This is not a frivolous question. Every generation of computer users has been frustrated by insufficient memory. A new line of computers may have sufficient storage for the computations of its predecessor, but new programs will soon exhaust its capacity. In 1960, a longrange planning committee at MIT dared to dream of a computer with 1 million words of main memory. In 1985, the Cray-2 was delivered with 256 million words. Computational physicists dream of computers with 1 billion words. Computer architects have done an outstanding job of enlarging main memories yet they have never kept up with demand. Only the shortsighted believe they can.

Denning, Peter J.↗