Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Job Task Analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

Accelerating science: The usage of commercial clouds in ATLAS Distributed Computing

The ATLAS experiment at CERN is one of the largest scientific machines built to date and will have ever growing computing needs as the Large Hadron Collider collects an increasingly larger volume of data over the next 20 years. ATLAS is conducting R&D projects on Amazon Web Services and Google Cloud as complementary resources for distributed computing, focusing on some of the key features of commercial clouds: lightweight operation, elasticity and availability of multiple chip architectures. The proof of concept phases have concluded with the cloud-native, vendoragnostic integration with the experiment’s data and workload management frameworks. Google Cloud has been used to evaluate elastic batch computing, ramping up ephemeral clusters of up to O(100k) cores to process tasks requiring quick turnaround. Amazon Web Services has been exploited for the successful physics validation of the Athena simulation software on ARM processors. We have also set up an interactive facility for physics analysis allowing endusers to spin up private, on-demand clusters for parallel computing with up to 4 000 cores, or run GPU enabled notebooks and jobs for machine learning applications. The success of the proof of concept phases has led to the extension of the Google Cloud project, where ATLAS will study the total cost of ownership of a production cloud site during 15 months with 10k cores on average, fully integrated with distributed grid computing resources and continue the R&D projects.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Time-critical database condition data handling in the CMS experiment during the first data taking period

Automatic, synchronous and reliable population of the condition databases is critical for the correct operation of the online selection as well as of the offline reconstruction and analysis of data. In this complex infrastructure, monitoring and fast detection of errors is a very challenging task. In this paper, we describe the CMS experiment system to process and populate the Condition Databases and make condition data promptly available both online for the high-level trigger and offline for reconstruction. The data are automatically collected using centralized jobs or are 'dropped' by the users in dedicated services (offline and online drop-box), which synchronize them and take care of writing them into the online database. Then they are automatically streamed to the offline database, and thus are immediately accessible offline worldwide. The condition data are managed by different users using a wide range of applications.In normal operation the database monitor is used to provide simple timing information and the history of all transactions for all database accounts, and in the case of faults it is used to return simple error messages and more complete debugging information.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Performance Characterization and Provenance of Distributed Task-based Workflows on HPC Platforms

Understanding performance and provenance of task-based workflows poses significant challenges, particularly in distributed configurations where resources are shared by multiple applications. Task-based workflow management systems further complicate performance predictability because of their dynamicity that subtly alters task execution order from run to run. In this paper we propose a layered characterization framework for performance and task provenance for Dask.distributed workflows running on high-performance computing (HPC) platforms. It collects data from jobs, the workflow management system, and the operating system to aid in understanding the performance of these workflows. Our approach encompasses three main contributions: first, an extension of Dask.distributed to capture high-fidelity task provenance using Mochi data services; second, the adaptation of the established HPC I/O characterization tool Darshan to gather high-fidelity I/O data, thereby enhancing the granularity of our analysis; and third, a framework to combine and process the collected data and provide helpful insights into performance characterization and reproducibility, alongside our lessons learned.

Dask↗

Optimization of tomographic reconstruction workflows on geographically distributed resources

New technological advancements in synchrotron light sources enable data acquisitions at unprecedented levels. This emergent trend affects not only the size of the generated data but also the need for larger computational resources. Although beamline scientists and users have access to local computational resources, these are typically limited and can result in extended execution times. Applications that are based on iterative processing as in tomographic reconstruction methods require high-performance compute clusters for timely analysis of data. Here, time-sensitive analysis and processing of Advanced Photon Source data on geographically distributed resources are focused on. Two main challenges are considered: (i) modeling of the performance of tomographic reconstruction workflows and (ii) transparent execution of these workflows on distributed resources. For the former, three main stages are considered: (i) data transfer between storage and computational resources, (i) wait/queue time of reconstruction jobs at compute resources, and (iii) computation of reconstruction tasks. These performance models allow evaluation and estimation of the execution time of any given iterative tomographic reconstruction workflow that runs on geographically distributed resources. For the latter challenge, a workflow management system is built, which can automate the execution of workflows and minimize the user interaction with the underlying infrastructure. The system utilizes Globus to perform secure and efficient data transfer operations. The proposed models and the workflow management system are evaluated by using three high-performance computing and two storage resources, all of which are geographically distributed. Workflows were created with different computational requirements using two compute-intensive tomographic reconstruction algorithms. Experimental evaluation shows that the proposed models and system can be used for selecting the optimum resources, which in turn can provide up to 3.13× speedup (on experimented resources). Furthermore, the error rates of the models range between 2.1 and 23.3% (considering workflow execution times), where the accuracy of the model estimations increases with higher computational demands in reconstruction tasks.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Understanding How Organizations Handle Cybersecurity

If there is anything we can learn from the media, it is the frequency and severity of cyber-attacks is increasing and there are not enough qualified people to combat the risk organizations are facing. Current estimates say there are 3.5 million available cybersecurity related jobs globally and there has been a 350% growth in cybersecurity jobs since 2013 (Group, 2020). The Idaho Cyber Research Project (ICRP) is focused on finding an implementing solution to the problems in the workforce development pipeline. Our team consists of Cohort 2 of the ICRP, we are tasked with solving issues faced by organizations hiring new cyber personnel. To provide solutions to these issues we focused our research on four components of workforce availability and competency: resume and transcript analysis, apprenticeships, cyber incident response plan development, and adversarial mindset training. From this research we have produced the following focus areas and subsequent steps for each component of workforce capability: transcript and knowledge skills abilities (KSA) focused analysis, cybersecurity apprenticeships programs, the value of an adversarial mindset, and a guide to setting up cyber incident response plans for underprepared organizations. These solutions can be further developed and implemented to reduce the gap in workforce demand and talent.

97 MATHEMATICS AND COMPUTING↗

Best Practices for Equitable Solar Workforce Development

The Midwest Renewable Energy Association (MREA) was selected to serve as a lead organization for the U.S. Department of Energy Solar Energy Technology Office’s Equitable Solar Communities of Practice initiative. This project, facilitated through a partnership with ENERGYWERX, aimed to develop strategies to support the expansion of equitable benefits in solar adoption across the U.S. Specifically, the MREA was chosen to lead the solar workforce development community of practice, focusing on scaling the U.S. solar workforce, to meet growing industry demands and ensure that these opportunities are accessible and beneficial to all communities. For the purpose of this initiative, we define the solar workforce in line with the National Solar Jobs Census, which defines a solar worker as someone who spends a majority of their time on solar-related work. This also includes workers who spend a plurality of their time on solar tasks. It’s important to note that manufacturing jobs were not included in this research, as the focus is primarily on solar installation, development, and related roles. To achieve the goals of the Equitable Solar Communities of Practice initiative, the MREA leveraged existing resources and engaged a diverse core team and group of stakeholders including industry professionals, educators, policymakers, and community leaders. The MREA began with a literature review and gap analysis to identify existing best practices and gaps in the solar workforce. This was followed by a community convening to gather insights from a wide range of stakeholders. The findings informed the best practices and pathways to scale the benefits of solar workforce development, focusing on training programs, workforce services, apprenticeship, and justice, inclusion, and sustainability. This report outlines the background, methodology, findings, and conclusions drawn from the landscape and gap analysis, providing valuable insights into workforce needs and training program capacities across the U.S. The outcomes of this research are presented in this report and contain recommendations for optimizing workforce development and training funding to support the equitable growth of the solar industry, ensuring that the transition to solar energy is inclusive and beneficial for all communities.

14 SOLAR ENERGY↗

Producing Madgraph5_aMC@NLO gridpacks and using TensorFlow GPU resources in the CMS HTCondor Global Pool

The CMS experiment has an HTCondor Global Pool, composed of more than 200K CPU cores available for Monte Carlo production and the analysis of da.The submission of user jobs to this pool is handled by either CRAB, the standard workflow management tool used by CMS users to submit analysis jobs requiring event processing of large amounts of data, or by CMS Connect, a service focused on final stage condor-like analysis jobs and applications that already have a workflow job manager in place. The latest scenario canbring cases in which workflows need further adjustments in order to efficiently work in a globally distributed pool of resources. For instance, the generation of matrix elements for high energy physics processes via Madgraph5_aMC@NLO and the usage of tools not (yet) fully supported by the CMS software, such as Ten-sorFlow with GPUsupport, are tasks with particular requirements. A special adaption, either at the pool factory level (advertising GPU resources) or at the execute level (e.g: to handle special parameters that describe certain needs for the remote execute nodes during submission) is needed in order to adequately work in the CMS global pool. This contribution describes the challenges and efforts performed towards adaptingsuch workflows so they can properly profit from the Global Pool via CMS Connect.

Bockelman, Brian Paul↗

Critical parameters in the faculty application process: A data-driven analysis

We report the process of applying for science and engineering faculty positions requires a significant time investment for both the applicant and hiring committees. Applicants face the daunting task of sifting through a seemingly endless amount of information related to crafting their application packages in preparation for a review process that is inherently highly subjective. Furthermore, while scientific supervisors are often the most valuable resource during this stage of career development, many years may have passed since they went through this process themselves, and they may not have experience with recent developments in the application process. Because expectations and job responsibilities of new faculty members are rapidly evolving, certain guidelines are often not clearly specified, and it is therefore becoming difficult for applicants to most effectively prepare their application documents. Without access to adequate information and assistance, early-career researchers in particular can be placed at a significant disadvantage in the hiring process. Several recent articles can help prospective applicants in materials science and engineering land a faculty position,1,2,3 but there is nevertheless a need for clarification on expectations for different aspects of the faculty application materials.

36 MATERIALS SCIENCE↗

SECARB-USA: Preliminary Regional Commercialization Plan (Task 4.4.a)

The SECARB-USA region refers to the states in the southeastern portion of the United States including Alabama, Arkansas, Florida, Georgia, Kentucky, Louisiana, Mississippi, Missouri, North Carolina, eastern Oklahoma, South Carolina, Tennessee, eastern Texas, Virginia, and West Virginia. This region is a hub for economic activity and accordingly emits almost 1 Gtpa of CO 2 which is the motivation for the development of Carbon Capture and Storage (CCS). This preliminary commercialization plan reviews the status of commercialization of CCS within the region, outlines the infrastructure buildout to achieve CO 2 reduction goals by 2050 described by the Los Alamos National Lab in Task 4.1.b (see the Task 4.1.b “Technoeconomic Analysis of Infrastructure Buildout Scenarios” report), and provides an early estimate of the economic activity and employment creation resulting from the increase in CCS activity. Additionally, this report addresses the challenges associated with commercializing CCS within the region at a large scale.

54 ENVIRONMENTAL SCIENCES↗

The Effect of Job Performance Aids on Quality Assurance

Job performance aids (JPAs) have been studied for many decades in a variety of disciplines and for many different types of tasks, yet this is the first known research experiment using JPAs in a quality assurance (QA) context. The objective of this thesis was to assess whether a JPA has an effect on the performance of a QA observer performing the concurrent dual verification technique for a basic assembly task. The JPA used in this study was a simple checklist, and the design borrows heavily from prior research on task analysis and other human factors principles. The assembly task and QA construct of concurrent dual verification are consistent with those of a high consequence manufacturing environment. Results showed that the JPA had only a limited effect on QA performance in the context of this experiment. However, there were three important and unexpected findings that may draw interest from a variety of practitioners. First, a novel testing methodology sensitive enough to measure the effects of a JPA on performance was created. Second, the discovery that there are different probabilities of detection for different types of error in a QA context may be the most far-reaching results. Third, these results highlight the limitations of concurrent dual verification as a control against defects. It is hoped that both the methodology and results of this study are an effective baseline from which to launch future research activities.

99 GENERAL AND MISCELLANEOUS↗

Performance analysis and optimization for scalable deployment of deep learning models for country-scale settlement mapping on Titan supercomputer

Here, we present a scalable object detection workflow for detecting objects, such as settlements, from remotely sensed (RS) imagery. We have successfully deployed this workflow on Titan supercomputer and utilized it for the task of mapping human settlement at a country scale. The performance of various stages in the workflow was analyzed before making it operational. The workflow implemented various strategies to address issues such as suboptimal resource utilization and long-tail effects due to unbalanced image workload, data loss due to runtime failures, and maximum wall-time constraints imposed by Titan's job scheduling policy. A mean shift clustering–based static load balancing strategy was implemented, which partitions the image load such that each partition contained similar-sized images. Furthermore, a checkpoint-restart strategy was added in the workflow as a fault-tolerance mechanism to prevent the data losses due to unforeseen runtime failures. The performance of the above-mentioned strategies was observed in various scenarios, such as node failure, exceeding wall time, and successful completion. Using this workflow, we have examined an RS data set that has a spatial resolution of 0.31 m and is comprised of 685 675 km 2 of area of the Republic of Zambia in under six hours using 5426 nodes of the Titan supercomputer.

97 MATHEMATICS AND COMPUTING↗

Results of the 2013-2015 Association of Residents in Radiation Oncology Survey of Chief Residents in the United States

Purpose: The purpose of this project was to survey radiation oncology chief residents to define their residency experience and readiness for independent practice. Methods and Materials: During the academic years 2013 to 2014 and 2014 to 2015, the Association of Residents in Radiation Oncology (ARRO) conducted an electronic survey of post-graduate year-5 radiation oncology residents in the United States during the final 3 months of training. Descriptive statistics are reported. Results: Sixty-six chief residents completed the survey in 2013 to 2014 (53% response rate), and 69 completed the survey in 2014 to 2015 (64% response rate). Forty to 85% percent of residents reported inadequate exposure to high-dose rate and low-dose rate brachytherapy. Nearly all residents in both years (>90%) reported adequate clinical experience for the following disease sites: breast, central nervous system, gastrointestinal, genitourinary, head and neck, and lung. However, as few as 56% reported adequate experience in lymphoma or pediatric malignancies. More than 90% of residents had participated in retrospective research projects, with 20% conducting resident-led prospective clinical trials and 50% conducting basic science or translational projects. Most chief residents reported working 60 or fewer hours per week in the clinical/hospital setting and performing fewer than 15 hours per week tasks that were considered to have little or no educational value. There was more than 80% compliance with Accreditation Council for Graduate Medical Education (ACGME) work hour limits. Fifty-five percent of graduating residents intended to join an established private practice group, compared to 25% who headed for academia. Residents perceive the job market to be more competitive than previous years. Conclusions: This first update of the ARRO chief resident survey since the 2007 to 2008 academic year documents US radiation oncology residents' experiences and conditions over a 2-year period. This analysis may serve as a valuable tool for those seeking to improve training of the next generation of oncology leaders.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Multifamily Retrofit Project Manager Job/Task Analysis and Report: September 2013

The development of job/task analyses (JTAs) is one of three components of the Guidelines for Home Energy Professionals project and will allow industry to develop training resources, quality assurance protocols, accredited training programs, and professional certifications. The Multifamily Retrofit Project Manager JTA identifies and catalogs all of the tasks performed by multifamily retrofit project managers, as well as the knowledge, skills, and abilities (KSAs) needed to perform the identified tasks.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Multifamily Energy Auditor Job/Task Analysis and Report: September 2013

The development of job/task analyses (JTAs) is one of three components of the Guidelines for Home Energy Professionals project and will allow industry to develop training resources, quality assurance protocols, accredited training programs, and professional certifications. The Multifamily Energy Auditor JTA identifies and catalogs all of the tasks performed by multifamily energy auditors, as well as the knowledge, skills, and abilities (KSAs) needed to perform the identified tasks.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Multifamily Building Operator Job/Task Analysis and Report: September 2013

The development of job/task analyses (JTAs) is one of three components of the Guidelines for Home Energy Professionals project and will allow industry to develop training resources, quality assurance protocols, accredited training programs, and professional certifications. The Multifamily Building Operator JTA identifies and catalogs all of the tasks performed by multifamily building operators, as well as the knowledge, skills, and abilities (KSAs) needed to perform the identified tasks.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Multifamily Quality Control Inspector Job/Task Analysis and Report: September 2013

The development of job/task analyses (JTAs) is one of three components of the Guidelines for Home Energy Professionals project and will allow industry to develop training resources, quality assurance protocols, accredited training programs, and professional certifications. The Multifamily Quality Control Inspector JTA identifies and catalogs all of the tasks performed by multifamily quality control inspectors, as well as the knowledge, skills, and abilities (KSAs) needed to perform the identified tasks.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Opportunities for enhancing MLCommons efforts while leveraging insights from educational MLCommons earthquake benchmarks efforts

MLCommons is an effort to develop and improve the artificial intelligence (AI) ecosystem through benchmarks, public data sets, and research. It consists of members from start-ups, leading companies, academics, and non-profits from around the world. The goal is to make machine learning better for everyone. In order to increase participation by others, educational institutions provide valuable opportunities for engagement. In this article, we identify numerous insights obtained from different viewpoints as part of efforts to utilize high-performance computing (HPC) big data systems in existing education while developing and conducting science benchmarks for earthquake prediction. As this activity was conducted across multiple educational efforts, we project if and how it is possible to make such efforts available on a wider scale. This includes the integration of sophisticated benchmarks into courses and research activities at universities, exposing the students and researchers to topics that are otherwise typically not sufficiently covered in current course curricula as we witnessed from our practical experience across multiple organizations. As such, we have outlined the many lessons we learned throughout these efforts, culminating in the need for benchmark carpentry for scientists using advanced computational resources. The article also presents the analysis of an earthquake prediction code benchmark while focusing on the accuracy of the results and not only on the runtime; notedly, this benchmark was created as a result of our lessons learned. Energy traces were produced throughout these benchmarks, which are vital to analyzing the power expenditure within HPC environments. Additionally, one of the insights is that in the short time of the project with limited student availability, the activity was only possible by utilizing a benchmark runtime pipeline while developing and using software to generate jobs from the permutation of hyperparameters automatically. It integrates a templated job management framework for executing tasks and experiments based on hyperparameters while leveraging hybrid compute resources available at different institutions. The software is part of a collection called cloudmesh with its newly developed components, cloudmesh-ee (experiment executor) and cloudmesh-cc (compute coordinator).

58 GEOSCIENCES↗