Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “job task analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

34 records · Page 2

Elastic Resource Management for Deep Learning Applications in a Container Cluster

The increasing demand for learning from massive datasets is restructuring our economy. Effective learning, however, involves nontrivial computing resources. Most businesses utilize commercial infrastructure providers (e.g., AWS) to host their computing clusters in the cloud, where various jobs compete for available resources. While cloud resource management is a fruitful research field that has made many advances in production, such as Kubernetes and YARN, few efforts have been invested to further optimize the system performance, especially for deep learning (DL) training jobs in a container cluster. This work introduces FlowCon, a system that is able to monitor the individual evaluation functions of DL jobs at runtime, and thus to make placement decisions on resource allocations elastically. Here, we present a detailed design and implementation of FlowCon and conduct intensive experiments over various DL models. The results demonstrate that FlowCon significantly improves DL job completion time and resource utilization efficiency, compared to default systems. According to the results, FlowCon is able to improve the completion time by up to 68.8% and meanwhile, reduce the makespan by 18.0%, in the presence of various DL job workloads.

97 MATHEMATICS AND COMPUTING↗

User Impressions and Gait Analysis of Exoskeleton Device Usage in Generalized Tank Farm Activities

Tank farm workers involved in nuclear cleanup activities perform physically demanding tasks, typically while wearing heavy personal protective equipment (PPE). Exoskeleton devices have the potential to bring considerable benefit to this industry but have not been thoroughly studied in the context of nuclear cleanup. In this paper, we examine the performance of exoskeletons during a series of tasks emulating jobs performed on tank farms while participants wore PPE commonly deployed by tank farm workers. The goal of this study was to evaluate the effects of commercially available lower-body exoskeletons on a user’s gait kinematics and user perceptions. Three participants each tested three lower-body exoskeletons in a 70-min protocol consisting of level treadmill walking, incline treadmill walking, weighted treadmill walking, a weight lifting session, and a hand tool dexterity task. Results were compared to a no exoskeleton baseline condition and evaluated as individual case studies. The three participants showed a wide spectrum of user preferences and adaptations toward the devices. Individual case studies revealed that some users quickly adapted to select devices for certain tasks while others remained hesitant to use the devices. Temporal effects on gait change and perception were also observed for select participants in device usage over the course of the device session. Here, device benefit varied between tasks, but no conclusive aggregate trends were observed across devices for all tasks. Evidence suggests that device benefits observed for specific tasks may have been overshadowed by the wide array of tasks used in the protocol.

Tank farm↗

Accelerating science: The usage of commercial clouds in ATLAS Distributed Computing

The ATLAS experiment at CERN is one of the largest scientific machines built to date and will have ever growing computing needs as the Large Hadron Collider collects an increasingly larger volume of data over the next 20 years. ATLAS is conducting R&D projects on Amazon Web Services and Google Cloud as complementary resources for distributed computing, focusing on some of the key features of commercial clouds: lightweight operation, elasticity and availability of multiple chip architectures. The proof of concept phases have concluded with the cloud-native, vendoragnostic integration with the experiment’s data and workload management frameworks. Google Cloud has been used to evaluate elastic batch computing, ramping up ephemeral clusters of up to O(100k) cores to process tasks requiring quick turnaround. Amazon Web Services has been exploited for the successful physics validation of the Athena simulation software on ARM processors. We have also set up an interactive facility for physics analysis allowing endusers to spin up private, on-demand clusters for parallel computing with up to 4 000 cores, or run GPU enabled notebooks and jobs for machine learning applications. The success of the proof of concept phases has led to the extension of the Google Cloud project, where ATLAS will study the total cost of ownership of a production cloud site during 15 months with 10k cores on average, fully integrated with distributed grid computing resources and continue the R&D projects.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Performance Characterization and Provenance of Distributed Task-based Workflows on HPC Platforms

Understanding performance and provenance of task-based workflows poses significant challenges, particularly in distributed configurations where resources are shared by multiple applications. Task-based workflow management systems further complicate performance predictability because of their dynamicity that subtly alters task execution order from run to run. In this paper we propose a layered characterization framework for performance and task provenance for Dask.distributed workflows running on high-performance computing (HPC) platforms. It collects data from jobs, the workflow management system, and the operating system to aid in understanding the performance of these workflows. Our approach encompasses three main contributions: first, an extension of Dask.distributed to capture high-fidelity task provenance using Mochi data services; second, the adaptation of the established HPC I/O characterization tool Darshan to gather high-fidelity I/O data, thereby enhancing the granularity of our analysis; and third, a framework to combine and process the collected data and provide helpful insights into performance characterization and reproducibility, alongside our lessons learned.

Dask↗

Understanding How Organizations Handle Cybersecurity

If there is anything we can learn from the media, it is the frequency and severity of cyber-attacks is increasing and there are not enough qualified people to combat the risk organizations are facing. Current estimates say there are 3.5 million available cybersecurity related jobs globally and there has been a 350% growth in cybersecurity jobs since 2013 (Group, 2020). The Idaho Cyber Research Project (ICRP) is focused on finding an implementing solution to the problems in the workforce development pipeline. Our team consists of Cohort 2 of the ICRP, we are tasked with solving issues faced by organizations hiring new cyber personnel. To provide solutions to these issues we focused our research on four components of workforce availability and competency: resume and transcript analysis, apprenticeships, cyber incident response plan development, and adversarial mindset training. From this research we have produced the following focus areas and subsequent steps for each component of workforce capability: transcript and knowledge skills abilities (KSA) focused analysis, cybersecurity apprenticeships programs, the value of an adversarial mindset, and a guide to setting up cyber incident response plans for underprepared organizations. These solutions can be further developed and implemented to reduce the gap in workforce demand and talent.

97 MATHEMATICS AND COMPUTING↗

Best Practices for Equitable Solar Workforce Development

The Midwest Renewable Energy Association (MREA) was selected to serve as a lead organization for the U.S. Department of Energy Solar Energy Technology Office’s Equitable Solar Communities of Practice initiative. This project, facilitated through a partnership with ENERGYWERX, aimed to develop strategies to support the expansion of equitable benefits in solar adoption across the U.S. Specifically, the MREA was chosen to lead the solar workforce development community of practice, focusing on scaling the U.S. solar workforce, to meet growing industry demands and ensure that these opportunities are accessible and beneficial to all communities. For the purpose of this initiative, we define the solar workforce in line with the National Solar Jobs Census, which defines a solar worker as someone who spends a majority of their time on solar-related work. This also includes workers who spend a plurality of their time on solar tasks. It’s important to note that manufacturing jobs were not included in this research, as the focus is primarily on solar installation, development, and related roles. To achieve the goals of the Equitable Solar Communities of Practice initiative, the MREA leveraged existing resources and engaged a diverse core team and group of stakeholders including industry professionals, educators, policymakers, and community leaders. The MREA began with a literature review and gap analysis to identify existing best practices and gaps in the solar workforce. This was followed by a community convening to gather insights from a wide range of stakeholders. The findings informed the best practices and pathways to scale the benefits of solar workforce development, focusing on training programs, workforce services, apprenticeship, and justice, inclusion, and sustainability. This report outlines the background, methodology, findings, and conclusions drawn from the landscape and gap analysis, providing valuable insights into workforce needs and training program capacities across the U.S. The outcomes of this research are presented in this report and contain recommendations for optimizing workforce development and training funding to support the equitable growth of the solar industry, ensuring that the transition to solar energy is inclusive and beneficial for all communities.

14 SOLAR ENERGY↗

Critical parameters in the faculty application process: A data-driven analysis

We report the process of applying for science and engineering faculty positions requires a significant time investment for both the applicant and hiring committees. Applicants face the daunting task of sifting through a seemingly endless amount of information related to crafting their application packages in preparation for a review process that is inherently highly subjective. Furthermore, while scientific supervisors are often the most valuable resource during this stage of career development, many years may have passed since they went through this process themselves, and they may not have experience with recent developments in the application process. Because expectations and job responsibilities of new faculty members are rapidly evolving, certain guidelines are often not clearly specified, and it is therefore becoming difficult for applicants to most effectively prepare their application documents. Without access to adequate information and assistance, early-career researchers in particular can be placed at a significant disadvantage in the hiring process. Several recent articles can help prospective applicants in materials science and engineering land a faculty position,1,2,3 but there is nevertheless a need for clarification on expectations for different aspects of the faculty application materials.

36 MATERIALS SCIENCE↗

SECARB-USA: Preliminary Regional Commercialization Plan (Task 4.4.a)

The SECARB-USA region refers to the states in the southeastern portion of the United States including Alabama, Arkansas, Florida, Georgia, Kentucky, Louisiana, Mississippi, Missouri, North Carolina, eastern Oklahoma, South Carolina, Tennessee, eastern Texas, Virginia, and West Virginia. This region is a hub for economic activity and accordingly emits almost 1 Gtpa of CO 2 which is the motivation for the development of Carbon Capture and Storage (CCS). This preliminary commercialization plan reviews the status of commercialization of CCS within the region, outlines the infrastructure buildout to achieve CO 2 reduction goals by 2050 described by the Los Alamos National Lab in Task 4.1.b (see the Task 4.1.b “Technoeconomic Analysis of Infrastructure Buildout Scenarios” report), and provides an early estimate of the economic activity and employment creation resulting from the increase in CCS activity. Additionally, this report addresses the challenges associated with commercializing CCS within the region at a large scale.

54 ENVIRONMENTAL SCIENCES↗

Opportunities for enhancing MLCommons efforts while leveraging insights from educational MLCommons earthquake benchmarks efforts

MLCommons is an effort to develop and improve the artificial intelligence (AI) ecosystem through benchmarks, public data sets, and research. It consists of members from start-ups, leading companies, academics, and non-profits from around the world. The goal is to make machine learning better for everyone. In order to increase participation by others, educational institutions provide valuable opportunities for engagement. In this article, we identify numerous insights obtained from different viewpoints as part of efforts to utilize high-performance computing (HPC) big data systems in existing education while developing and conducting science benchmarks for earthquake prediction. As this activity was conducted across multiple educational efforts, we project if and how it is possible to make such efforts available on a wider scale. This includes the integration of sophisticated benchmarks into courses and research activities at universities, exposing the students and researchers to topics that are otherwise typically not sufficiently covered in current course curricula as we witnessed from our practical experience across multiple organizations. As such, we have outlined the many lessons we learned throughout these efforts, culminating in the need for benchmark carpentry for scientists using advanced computational resources. The article also presents the analysis of an earthquake prediction code benchmark while focusing on the accuracy of the results and not only on the runtime; notedly, this benchmark was created as a result of our lessons learned. Energy traces were produced throughout these benchmarks, which are vital to analyzing the power expenditure within HPC environments. Additionally, one of the insights is that in the short time of the project with limited student availability, the activity was only possible by utilizing a benchmark runtime pipeline while developing and using software to generate jobs from the permutation of hyperparameters automatically. It integrates a templated job management framework for executing tasks and experiments based on hyperparameters while leveraging hybrid compute resources available at different institutions. The software is part of a collection called cloudmesh with its newly developed components, cloudmesh-ee (experiment executor) and cloudmesh-cc (compute coordinator).

58 GEOSCIENCES↗

DGaaS: GPU as a Service on Distributed Computing System

In the rapidly evolving landscape of scientific computing, Graphics Processing Units (GPUs) have become indispensable for their unparalleled ability to handle parallel tasks in complex calculations, simulations, and data analysis. Their utility is further magnified in machine learning and AI applications, where they significantly accelerate model training and predictive analytics. Within this context, the Triton Inference Server emerges as a pivotal open-source tool, specializing in AI inferencing and optimizing GPU utilization across various platforms and frameworks. This paper presents an in-depth study on distributed High Throughput Computing (HTC), specifically focusing on the HTCondor framework and its resource provisioning tools, GlideinWMS and HEPCloud. These systems enable large-scale scientific experiments like CMS and DUNE to efficiently access and utilize vast computational resources. The paper explores the core architectural components of GlideinWMS, including jobs, user pools, and worker nodes, and discusses their integration with GPUs and the Triton server. The primary aim of this research is to develop a solution that optimizes GPU utilization by leveraging Glideins and containers. This approach allows computational jobs, particularly those involving AI models, to use GPUs only when essential, thereby facilitating efficient sharing of limited GPU resources. To validate this architecture, the study conducted three key tests involving custom scripts, container-based servers, and Triton server deployments. However, the study faces challenges, notably in locating the Triton server and ensuring secure remote access. To address these issues, future work will focus on developing a proxy mechanism and enhancing security protocols. In conclusion, this study offers a comprehensive roadmap for effective and efficient GPU utilization in distributed High Throughput Computing. It aims to contribute significantly to the scientific community by solving pressing problems and implementing robust solutions in collaboration with the GlideinWMS and HEPCloud teams. The research sets the stage for a more efficient, scalable, and cost-effective paradigm in scientific computing.

97 MATHEMATICS AND COMPUTING↗

Jobs, jobs, jobs: what’s an analyst to do?

Analysts and economists often face the task of using employment metrics to characterize industries of interest. Some key challenges can be understanding where to find employment metrics, the differences in various employment metrics, and when each metric should be used. This article analyzes a variety of publicly available employment data for the United States and compares these data. A detailed description of the intricacies of each data source is provided, which covers factors such as regionality, industry breakout, periodicity, and the types of jobs included. This article provides several case study examples, using the oil and gas extraction, coal mining, and chemical manufacturing sectors to portray challenges data users may face when developing employment estimates that suit their needs. Data users should be aware of a variety of data sources to understand alternative analysis options when data limitations are present and to determine which data source best meets their needs. Instances may occur in which information from one dataset may be used to help impute missing values.

99 GENERAL AND MISCELLANEOUS↗

Using Natural Gas Liquids to Recover Unconventional Oil and Gas Resources (Final Report)

This document presents final technical findings for the project Using Natural Gas Liquids to Recover Unconventional Oil and Gas Resources (FE0031782). The project is part of the U.S. Department of Energy Oil and Gas Program to develop and advance technologies that can significantly improve the recovery efficiencies of unconventional oil and gas resources. The overall objective of this project is to improve the ultimate recovery from unconventional oil and gas (UOG) resources in the United States by developing a method for using unrefined natural gas liquids (NGLs) as treatment fluids to improve hydrocarbon production. Horizontal extended-lateral drilling coupled with high volume hydraulic fracturing has significantly increased production from UOG resources in the U.S. However, the recovery efficiency is low compared to the estimated oil and gas in place. Recent data indicate that less than 10% of the oil in the liquid-rich UOG reservoirs is produced. Alternative completion methods using NGLs could increase production (Battelle, 2016; Wan et al., 2013; Wan, 2013; Downey et al, 2021); however, field validation tests are needed to develop an approach that is economical, efficient, and compatible in the UOG setting to advance towards commercial deployment. This project aims to develop and field test a method to improve recovery of oil resources in UOG shale plays by using Y-Grade NGLs, or a similar combination of NGLs, as treatment fluids. Refined NGLs have been used as a hydraulic treatment fluid in UOG plays for decades and are shown to be particularly effective because their miscibility with oil allows oil to flow more freely; however, the use of Y-Grade (unrefined) NGLs has not been studied. The use of Y-Grade NGLs would be advantageous over refined NGLs because Y-Grade NGLs do not require infrastructure or investment in refining and are already being produced from many UOG reservoirs. The concept was tested and monitored in the field at a commercial well site owned by project partner Hopco, Ltd. The project team, which consists of multiple oil and gas operators, Linde Gas North America LLC (Linde) and the Ohio Division of Geological Survey (ODGS), has extensive experience with oil and gas production in the Appalachian basin and the ability to work together quickly to solve technical issues and research needs. A key part of the proposed work was the use of existing wells for field testing and monitoring. A total of four wells (three vertical and one horizontal) were available for this project. One of the vertical wells was utilized as the test well for the NGL treatment test. A nearby vertical well was used for microseismic monitoring. The remaining vertical well and the horizontal well provided a baseline for typical UOG production in the oil window of the Utica/Point Pleasant (UPP). Major technical tasks of the project include characterization of the geotechnical properties of the UPP with an emphasis on the field site; design and planning for the NGLs testing; field testing and monitoring; analysis and integration of field data; and economic and resource/reserve assessment. The Shoman monitoring well and Doughty NGL treatment well were successfully plugged back during September-October 2020 in preparation for treatment and monitoring. A nitrogen diagnostic fracture injection test (DFIT) was completed on the Doughty well on July 22, 2021, consisting of 133,000 scf (91 Bbl.) of nitrogen. A nitrogen foam frac was completed in the Utica-Point Pleasant interval on August 17, 2021 with funding from outside sources. A microseismic monitoring array was installed in the Shoman well and monitored microseismic activity during the Doughty well frac job. Y-Grade NGL injection commenced on August 26, 2021. A total of 215 Bbl. was injected but the job was shut down due to a small leak on the suction hose on the pump truck. The Y-Grade treatment resumed on August 27, 2021 and an additional 726 Bbl. of Y-Grade NGL was injected at a well head pressure of 3850 psi. Total volume of injected Y-Grade over the two days of injection was 941 Bbl. The well was shut-in for 17 days following injection to allow the Y-Grade NGLs to soak on the formation. Y-Grade treatment flow back commenced on 9/13/2021 on a weekly basis. Production data, including surface pressures, oil, nitrogen, natural gas, and flow times was measured and recorded. Periodic gas samples were collected and analyzed to determine composition of flowback gas. As of July 2022, the treatment well had produced 726 Bbl of oil and 2,888 mcf gas. In August 2022, tubing and packer in the well were removed and a pump was installed to enhance oil recovery. Currently, the operator is producing the well about 2 days a week for a few hours. The performance of the NGL treatment test was evaluated based on reservoir simulations of the treatment process, processing of well testing data, analysis of micro seismic monitoring data, and production data analysis. This analysis suggested that oil production in the small test would continue through 2025. Upscaling the treatment to a horizontal Utica Point-Pleasant well would allow more oil recovery, but the process would involve more investment, services, and operational support. An economic analysis was conducted for scenarios aimed at upscaling the NGL treatment process for more typical horizontal UPP wells in the Appalachian Basin.

02 PETROLEUM↗

SR19021 Tritium Aging of Regenerated LANA.75 (Final Project Report)

The Savannah River Tritium Enterprise (SRTE) has used the metal hydride LaNi 4.25 Al 0.75 (LANA.75) in the Tritium Facilities for over two decades. LANA.75 beds store significant quantities of tritium but have a limited service life due to the radiolytic decay of tritium to He-3 within the metal matrix. It has been shown that heating tritium-aged LANA.75 under vacuum can reverse tritium aging effects, eliminating the heel of trapped hydrogen, and restoring the reversible capacity. Additional investigation is needed to ensure there are no unexpected changes to the hydride before this restoration technique is employed in full scale beds in the Tritium Facilities. This project was to be comprised of three distinct scopes: obtain tritium aging data on the sample regenerated in 2018, regenerate a tritium-aged sample at 600 °C, and perform thermal stability testing on a non-tritiated sample. Isotherms were collected on the previously regenerated sample after approximately two years of tritium aging. Isotherms were collected at 80, 100, and 120 °C. As expected, there was a decrease in the plateau pressure, an increase in plateau slope, and a portion of the “heel” of tritium trapped in the metal had been reestablished. Unexpectedly, it appeared that the plateau had shortened at the higher tritium to metal ratios as well. This is typically seen in older samples. The second scope, to regenerate a second tritium-aged LANA.75 sample, was not completed. A Task Technical and Quality Assurance Plan was written and approved, a high temperature test cell was fabricated, several pre-job briefs were held, and the hydride sample was passivated with air. Despite these successes, the hydride sample was not recovered from the legacy test cell. The third scope was to perform thermal stability testing on a “cold” LANA.75 sample. A non-tritiated sample of LANA.75 was held at 750 °C under vacuum for 200 hours to simulate exposure to multiple regeneration evolutions. Hydride isotherm performance, chemical composition, crystallinity, particle size, and morphology are compared between the pre- and post-regeneration samples. No significant changes were observed in composition, crystallinity, or particle size. Comparison of before and after isotherms showed that performance improved rather than deteriorated during the evolution. Scanning Electron Microscopy (SEM) analysis showed small growths on the particle surface after exposure to regeneration conditions. Additional testing will be required to determine the cause of these growths.

07 ISOTOPE AND RADIATION SOURCES↗

Design and implementation of I/O performance prediction scheme on HPC systems through large-scale log analysis

Abstract Large-scale high performance computing (HPC) systems typically consist of many thousands of CPUs and storage units used by hundreds to thousands of users simultaneously. Applications from large numbers of users have diverse characteristics, such as varying computation, communication, memory, and I/O intensity. A good understanding of the performance characteristics of each user application is important for job scheduling and resource provisioning. Among these performance characteristics, I/O performance is becoming increasingly important as data sizes rapidly increase and large-scale applications, such as simulation and model training, are widely adopted. However, predicting I/O performance is difficult because I/O systems are shared among all users and involve many layers of software and hardware stack, including the application, network interconnect, operating system, file system, and storage devices. Furthermore, updates to these layers and changes in system management policy can significantly alter the I/O behavior of applications and the entire system. To improve the prediction of the I/O performance on HPC systems, we propose integrating information from several different system logs and developing a regression-based approach to predict the I/O performance. Our proposed scheme can dynamically select the most relevant features from the log entries using various feature selection algorithms and scoring functions, and can automatically select the regression algorithm with the best accuracy for the prediction task. The evaluation results show that our proposed scheme can predict the write performance with up to 90% prediction accuracy and the read performance with up to 99% prediction accuracy using the real logs from the Cori supercomputer system at NERSC.

97 MATHEMATICS AND COMPUTING↗

Williston Basin CORE-CM Initiative Final Report

The University of North Dakota Energy & Environmental Research Center (EERC) is leading the Williston Basin Carbon Ore, Rare Earth, and Critical Minerals (CORE-CM) Initiative to drive the expansion and transformation of coal and coal-based resource usage within the Williston Basin to produce rare-earth elements (REEs), CMs, and nonfuel carbon-based products (CBPs). This project is the first phase in a long-term program and set the stage for future work by assessing resource, market, technology, and infrastructure knowledge; identifying knowledge gaps; developing a series of plans to be carried out in future work; and initiating stakeholder engagement. Composed of several tasks, the project sought to identify, characterize, and assess several necessary aspects vital to make this future work a reality. The project’s fundamental task was to characterize the Williston Basin CORE-CM resources. Over 2500 samples from multiple sources were utilized to begin the assessment. Several locations were identified in western North Dakota where sample analysis identified the total REE (TREE) concentration as being over 500 parts per million (ppm), which is at a concentration level that would be suitable to consider for mining and extraction. Current operating coal mines have sufficient concentrations of TREEs for consideration. However, the current data across the basin are still not adequate to fully characterize REE and CM content nor give reliable estimates of the total resource potential. Waste stream reuse was also considered, and several streams were identified which ranged from potential energy sources to chemicals to material wastes. This includes streams that result from oil and gas production. These streams are not fully characterized, and further data are needed before they can be accurately assessed. Infrastructure within the Williston Basin is suitable for expansion of a new industry to mine, extract, and concentrate REEs and CMs. The development of this industry will not only preserve many existing jobs in the coal-mining industry but produce many new jobs. The supply chain for REEs and CMs is currently controlled outside of the United States in nations such as China, but the potential to develop the supply chain within the basin is considered possible. Processing of the mined materials for REEs and CMs needs further research. The technology and knowhow exist outside of the United States, and within the country much of the knowledge has been lost and must be regained. To develop the supply chain and regain lost processing technology, the creation of technology innovation centers (TICs) is crucial. The Williston Basin contains several similar centers and entrepreneurial assistance for other industries that can be applied in the development of REE and CM innovation centers. Education to develop the new skill sets required is also needed. Outreach is important for the development of the REE and CM industry within the basin. Understanding throughout federal and state governments, state agencies, industry, and resource end users is vital for the industry to form and grow. Through this project these groups have been contacted through bulletins, presentations, webinars, and annual symposiums. The report is a summary of the work conducted and throughout refers to a series of appendixes which contain more thorough and specific information about each section.

01 COAL, LIGNITE, AND PEAT↗