Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “jobs”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15

X-Ray Backscatter Machine Support Frame

This summer at Kennedy Space Center, I spent 10 weeks as an intern working at the Prototype Development Lab. During this time I learned about the design and machining done here at NASA. I became familiar with the process from where a design begins in Pro/Engineer and finishes at the hands of the machinists. As an intern I was given various small jobs to do and then one project of my own. My personal project was a job for the Applied Physics Lab; in their work they use an X-Ray Backscatter machine. Previously it was resting atop a temporary frame that limited the use of the machine. My job was to design a frame for the machine to rest upon that would allow a full range of sample sizes. The frame was required to support the machine and provide a strain relief for the cords attached to the machine as it moved in the x and y directions. Calculations also had to be done to be sure the design would be able to withstand any loads or outside sources of stress. After the calculations proved the design to be ready to withstand the requirements, the parts were ordered or fabricated, as required. This helped me understand the full process of jobs sent to the Prototype Development Lab.

Cannon, Brooke↗

LEGION: Lightweight Expandable Group of Independently Operating Nodes

LEGION is a lightweight C-language software library that enables distributed asynchronous data processing with a loosely coupled set of compute nodes. Loosely coupled means that a node can offer itself in service to a larger task at any time and can withdraw itself from service at any time, provided it is not actively engaged in an assignment. The main program, i.e., the one attempting to solve the larger task, does not need to know up front which nodes will be available, how many nodes will be available, or at what times the nodes will be available, which is normally the case in a "volunteer computing" framework. The LEGION software accomplishes its goals by providing message-based, inter-process communication similar to MPI (message passing interface), but without the tight coupling requirements. The software is lightweight and easy to install as it is written in standard C with no exotic library dependencies. LEGION has been demonstrated in a challenging planetary science application in which a machine learning system is used in closed-loop fashion to efficiently explore the input parameter space of a complex numerical simulation. The machine learning system decides which jobs to run through the simulator; then, through LEGION calls, the system farms those jobs out to a collection of compute nodes, retrieves the job results as they become available, and updates a predictive model of how the simulator maps inputs to outputs. The machine learning system decides which new set of jobs would be most informative to run given the results so far; this basic loop is repeated until sufficient insight into the physical system modeled by the simulator is obtained.

Burl, Michael C.↗

Trick Simulation Environment 07

The Trick Simulation Environment is a generic simulation toolkit used for constructing and running simulations. This release includes a Monte Carlo analysis simulation framework and a data analysis package. It produces all auto documentation in XML. Also, the software is capable of inserting a malfunction at any point during the simulation. Trick 07 adds variable server output options and error messaging and is capable of using and manipulating wide characters for international support. Wide character strings are available as a fundamental type for variables processed by Trick. A Trick Monte Carlo simulation uses a statistically generated, or predetermined, set of inputs to iteratively drive the simulation. Also, there is a framework in place for optimization and solution finding where developers may iteratively modify the inputs per run based on some analysis of the outputs. The data analysis package is capable of reading data from external simulation packages such as MATLAB and Octave, as well as the common comma-separated values (CSV) format used by Excel, without the use of external converters. The file formats for MATLAB and Octave were obtained from their documentation sets, and Trick maintains generic file readers for each format. XML tags store the fields in the Trick header comments. For header files, XML tags for structures and enumerations, and the members within are stored in the auto documentation. For source code files, XML tags for each function and the calling arguments are stored in the auto documentation. When a simulation is built, a top level XML file, which includes all of the header and source code XML auto documentation files, is created in the simulation directory. Trick 07 provides an XML to TeX converter. The converter reads in header and source code XML documentation files and converts the data to TeX labels and tables suitable for inclusion in TeX documents. A malfunction insertion capability allows users to override the value of any simulation variable, or call a malfunction job, at any time during the simulation. Users may specify conditions, use the return value of a malfunction trigger job, or manually activate a malfunction. The malfunction action may consist of executing a block of input file statements in an action block, setting simulation variable values, call a malfunction job, or turn on/off simulation jobs.

Lin, Alexander S.↗

State-Level Employment Projections for Four Clean Energy Technologies in 2025 and 2030

As states and local governments weigh how to spur economic growth, stimulate job creation, and simultaneously adapt to meet climate goals, modern energy codes, and energy demand, this report provides a simple and transparent method to estimate the size of the workforce needed to support modeled deployments for energy efficiency in buildings, stationary battery energy storage (BES), solar photovoltaics (PV), and land-based wind in 2025 and 2030. In addition to a straightforward estimation method, this report includes state-level job estimates for two different deployment scenarios: a business-as-usual scenario and a more accelerated deployment scenario. The scope of the technologies included in this report is limited to four key energy technologies within the power sector that have strong job growth prospects and widespread geographic deployment potential. Although the included technologies are not all-encompassing, they have generated specific interest from state energy offices across the nation.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Orchestration of materials science workflows for heterogeneous resources at large scale

In the era of big data, materials science workflows need to handle large-scale data distribution, storage, and computation. Any of these areas can become a performance bottleneck. We present a framework for analyzing internal material structures (e.g., cracks) to mitigate these bottlenecks. We demonstrate the effectiveness of our framework for a workflow performing synchrotron X-ray computed tomography reconstruction and segmentation of a silica-based structure. Our framework provides a cloud-based, cutting-edge solution to challenges such as growing intermediate and output data and heavy resource demands during image reconstruction and segmentation. Specifically, our framework efficiently manages data storage, scaling up compute resources on the cloud. The multi-layer software structure of our framework includes three layers. A top layer uses Jupyter notebooks and serves as the user interface. A middle layer uses Ansible for resource deployment and managing the execution environment. A low layer is dedicated to resource management and provides resource management and job scheduling on heterogeneous nodes (i.e., GPU and CPU). At the core of this layer, Kubernetes supports resource management, and Dask enables large-scale job scheduling for heterogeneous resources. The broader impact of our work is four-fold: through our framework, we hide the complexity of the cloud’s software stack to the user who otherwise is required to have expertise in cloud technologies; we manage job scheduling efficiently and in a scalable manner; we enable resource elasticity and workflow orchestration at a large scale; and we facilitate moving the study of nonporous structures, which has wide applications in engineering and scientific fields, to the cloud. While we demonstrate the capability of our framework for a specific materials science application, it can be adapted for other applications and domains because of its modular, multi-layer architecture.

97 MATHEMATICS AND COMPUTING↗

Priority-BF: A Task Manager for Priority-Based Scheduling

The increasing demand for computational resources, particularly in High-Performance Computing environments, necessitates to rethink how we handle job scheduling strategies. This work addresses the challenge of managing concurrent jobs with differing priorities on overloaded parallel systems, where strict QoS constraints are often difficult for users to define. Our solution relies on a qualitative description of priorities and pulls from two key approaches: the Easy-BF algorithm and the Conservative Backfilling algorithms. This solution improves the response time for high-priority jobs by 50% without affecting the overall system utilization. We show its applicability in several critical scenarios such as High-Performance Computing (HPC) resource management and in-situ computing.

Gainaru, Ana [ORNL]↗

Distributing User Code with the CernVM FileSystem

The CernVM FileSystem (CVMFS) is widely used in High Throughput Computing to efficiently distributed experiment code. However, the standard CVMFS publishing tools are designed for a small group of people from each experiment to maintain common software, and the tools are not a good fit for publishing software from numerous users in each experiment. As a result, most user code, such as code to do specific physics analyses, is still sent with every job to the place the job is run. That process is relatively inefficient, especially when the user code is large. To overcome these limitations, we have built a CVMFS user code publication system. This publication system enables users to still submit their code with their jobs but the code is distributed and accessed through the standard CVMFS infrastructure. The user code is automatically deleted from CVMFS after a period of no use. Most of the software for the system is available as a single self-contained open source rpm called cvmfs-user-pub and is available for other deployments.

97 MATHEMATICS AND COMPUTING↗

Production Operations Management System (POMS) for Fermilab Experiments

The Production Operations Management System (POMS) software allows production teams and analysis groups across multiple Fermilab experiments to launch, modify and monitor large scale campaigns of related Monte Carlo or data processing jobs, and currently manages the majority of production computing of experiments at Fermilab.POMS provides a web service interface that enables automated job submission on distributed resources according to customers’ requests, as well as subsequent monitoring of those submissions as well as recovery of failed submissions, debugging and record keeping.POMS interfaces with existing HEP data access, processing, movement and monitoring tools at Fermilab, including Jobsub (for job submission), SAM (for data management), and Landscape (for monitoring), and in combination with them handles the creation of intermediate datasets of files for multistage campaigns.POMS visualizes these campaigns with an interactive GUI interface. An important feature of POMS is a one-to-one connection between the GUI campaign visualizer and a text based representation of the complete campaign configuration. An extensible library of template campaign configurations is available. The templates are user modifiable and map cleanly to and from the GUI description of the campaign.This paper will discuss the current usage, history, and some technical details of POMS, as well as planned future extensions, particularly interfacing with Rucio as well as SAM for file movement.

Mengel, Marc↗

Simulating regional workforce impacts of decarbonizing integrated steelmaking

Global efforts to mitigate climate change are increasing pressure on heavy manufacturing industries to decarbonize production. The iron and steel industry is responsible for 7% of CO 2 emissions globally (2% in the United States) and is often a major employer in the regions where iron and steel is produced. Understanding the future prospects for workers in regions with high CO 2 emitting industries—including impacts of phasing out or evolving such industries—will be critical for informing regional economic and clean energy strategies. We simulate the impact of an “in-place” transition that replaces today’s integrated production with direct reduced iron (DRI) used in electric arc furnaces (EAFs), using Southwest Pennsylvania as an application of our generalizable approach. Our results suggest that the integrated steelmaking workforce today has the skills, knowledge, and abilities (SKAs) to fill over 95% of all jobs required by DRI/EAF facilities, but the number of jobs is only 25% of those at integrated plants. We also find that some occupational groups have greater general transferability into the broader job market, while other groups, such as production workers, are ill-equipped today based on current SKAs to transition out of the iron and steel industry. Our methodology further suggests factors that limit transitions: Around 85% of occupations are more limited by missing skills, while 15% are more limited by insufficient wages. These results may help to improve the design of social policy and the targeting of retraining programs, while the simulation approach can be readily adapted for other regions and industries.

decarbonization↗

Fault-Tolerant Deep Learning Cache with Hash Ring for Load Balancing in HPC Systems

Large-scale DL on HPC systems like Frontier and Summit uses distributed node-local caching to address scalability and performance challenges. However, as these systems grow more complex, the risk of node failures increases, and current caching approaches lack fault tolerance, jeopardizing large-scale training jobs. We analyzed six months of SLURM job logs from Frontier and found that over 30% of jobs failed after an average of 75 minutes. To address this, we propose fault-tolerance strategies that recache data lost from failed nodes using a hash ring technique for balanced data recaching in the distributed node-local caching, reducing reliance on the PFS. Our extensive evaluations on Frontier showed that the hash ring-based recaching approach reduced training time by approximately 25% compared to the approach that redirects I/O to the PFS after node failures and demonstrated effective load balancing of training data across nodes.

Lee, Seoyeong↗

Mastering HPC Runtime Prediction: From Observing Patterns to a Methodological Approach

The continual expansion of high-performance computing (HPC) brings with it an increasing need for efficiency. Heavy investment in energy, hardware, and software infrastructure to support peta- and exascale computing requires the optimization of existing systems and, wherever possible, the discernment and adoption of best-practices towards these goals. Such is the case for runtime prediction. When a job is submitted to an HPC system, an estimate of its runtime is provided by the user in the form of "requested wallclock". Error in this user-provided estimate can lead to jobs being prematurely killed by the scheduler, increased wait time on the queue, and decreased system utilization. More than fifteen years of research has been directed at mitigating these effects by using data-driven runtime predictions. Codified here is a set of commonalities and insights emerging from this body of work, which we present as recommendations and best practices. These practices are combined into a methodological approach described and evaluated on an 11-million-job dataset from the National Renewable Energy Laboratory's petascale HPC system, Eagle. This dataset and the accompanying codebase have been released to the public domain for the benefit of the wider HPC research community.

high performance computing↗

Evaluating HPC Scheduling Strategies for Urgent Workloads

Scientific computing centers increasingly face workloads with diverse urgency requirements, driven by applications that demand rapid or even immediate execution. Appropriately configured scheduling policies can significantly improve both user satisfaction and overall cluster utilization. In this work, we present a systematic analysis of scheduler configurations under scenarios where a fraction of jobs have urgent computing needs. We evaluate multiple job scheduling simulators, develop a lightweight job-submission emulation framework, and create tools to analyze and visualize the resulting scheduling data. Our study identifies key trade-offs between responsiveness, fairness, and efficiency, and offers a set of practical scheduling configurations (particularly for Slurm) that can be tailored to HPC environments supporting mixed-urgency workloads.

Maheshwari, Ketan [ORNL] (ORCID:000000033800662X)↗

JADE

JADE provides a simple, flexible interface to submit jobs to an HPC. JADE is an HPC workflow management system that enables researchers to run simulations efficiently. It provides a simple, flexible interface to define jobs, as well as dependencies between jobs, and then dispatch them to an HPC with maximized parallelization. It also provides detailed error reporting and resource utilization statistics to aid in debugging problems.

Thom, Daniel↗

Occupational Experience Effects on Physiological and Perceptual Responses of Common Soldiering Tasks

Abstract Cohen BS, Redmond JE, Haven CC, Foulis SA, Canino MC, Frykman PN, Sharp MA. Occupational Experience Effects on Physiological and Perceptual Responses of Common Soldiering Tasks. J Strength Cond Res 37(4): 894–901, 2023—This study measured the impact of occupational experience (i.e., time spent deployed, in military service, and in job and task performance frequency in training, deployment, and study practice) on the physiological (heart rate [HR] and oxygen consumption [VO 2 ]) and perceptual (rate of perceived exertion [RPE]) responses to performance of critical physically demanding tasks (CPDTs). Five CPDTs (road march, build a fighting position, move under fire, evacuate a casualty, and drag a casualty to safety), common to all soldiers, were performed by 237 active duty soldiers. Linear regression models examined the association between measures of experience and physiological and perceptual performance responses to task demands. The level of significance was adjusted for multiple comparisons and set at ρ ≤ 0.0125 for this study. Significant and notable effect sizes included the impact of time spent deployed on the physiological measures of the road march (PostHR F = 24.84, p < 0.0001, β=-9.65), sandbag fill (PostHR F = 8.26, p = 0.005, β = −2.83), and sandbag carry (MeanHR F = 7.51, p = 0.007, β = −1.12; PostHR F = 7.35, p = 0.007, β = −0.87). For the road march task, there was a nearly 10 bpm decrease in postperformance HR for every year spent deployed. Road march, sandbag fill, and sandbag carry tasks PostHRs were also notably negatively associated with the experience measures of time in their MOS (job and time in military service but not for other physiological and perceptual responses, including VO 2 and RPE. Frequency of task performance in training, deployment, and study practice was not meaningfully associated with experience. The results suggest that increasing task familiarization through on-the-job occupational operational experience may result in greater proficiency and reduced physiological effort.

Sport Sciences↗

Constructing a Testing Application for GWMS

Many of Fermilab’s High Energy Physics experiments require High Throughput Computing to carry out simulations, data reconstruction, and data analysis. Glidein Workflow Management System (GWMS) is a tool that distributes High Throughput Computing. The purpose of GWMS is to provide convenient access to Grid resources and sites. GWMS is coupled to HTCondor. HTCondor is the workload management system that is used for scheduling and job control. Users submit jobs to a local HTCondor queue and GWMS will make sure the job will run on one of the many remote resources.

Neely-Brown, LeRayah↗

Coal-dependent Communities in Transition: Identifying Best Practices to Ensure Equitable Outcomes

The U.S. coal industry is experiencing a sharp increase in the numbers of retired and/or decommissioned coal-fired power plants across the U.S. In the years between 2010-2019, around 102 gigawatts (GW) of coal-fired generating capacity has been announced to be decommissioned, representing more than 546 coal-fired power plant units, and an additional 17 GW is planned to be decommissioned by 2025. This change in the energy production landscape presents an impact on the social, environmental, and economic prospects of coal-dependent communities. This report examined the role of communities in the coal power plant decommissioning process and provided community-identified best practices to ensure an equitable process. The experiences of four coal-dependent communities—Wise County, VA, Muskegon, MI, Anderson County, TN, and Becker, MN—are presented as case studies to understand the impacts of the decommissioning process, and associated best practices, from the communities’ perspective. The report results highlight the need to recognize that the decommissioning decision-making process must be community-based to be equitable. Each community’s input is key to the transition away from coal power because there is no one-size-fits-all development plan. In other words, each community’s trajectory through the decommissioning process—from the retirement decision-making stage to the final site redevelopment phase—is unique because each community has distinct needs and wants from the energy transition. What is best for one community may not be suited for another. Ultimately, the framework for site development and community revitalization post-decommissioning cannot be universal because each community’s profile—from a social, cultural, and economic perspective—is different. Community impacts of power plant decommissioning are not limited to job and revenue losses. Communities are likely to be impacted culturally, socially, environmentally, and have long-term health-based impacts that should be acknowledged and addressed in post-retirement plans. Commonly identified decommissioning best practices include: Early and continued engagement throughout, with a number of mediums for communication and feedback (e.g., in-person sessions, virtual meetings, written comment opportunities); Early planning of post-decommissioning projects to replace lost jobs, revenue, and economic activity; Recognition (and mitigation, if possible) of social impacts on the community due to plant closure; Transparency throughout the process, with trusted information being provided about the decommissioning process and timeline; potential impacts on the workforce, economy, and environment; and the feasibility of alternative site uses; Identification of funding sources, technical experts, and/or strategic partnerships to support decommissioning and the affected communities upfront; and, Acknowledgment of communities as stakeholders who have a role in the conversation and right to determine their futures. Three key areas for assisting coal-dependent communities affected by the energy transition: Technical assistance: assessment of site feasibility for alternative uses or to repower with new technologies; Cross-partnership engagement and collaboration: facilitate knowledge-sharing of “lessons learned” about the decommissioning process between communities and provide guidance for decision-making processes; and, Financial assistance: access to grant and/or loan programs to assist with redevelopment survey, bolster community economic security through job creation, and cover environmental clean-up costs. Technical assistance, cross-partnership engagement, and financial aid can be mobilized to help communities throughout various stages of the decommissioning process, including the retirement decision, the site reclamation phase, and eventual revitalization of the site and surrounding community.

01 COAL, LIGNITE, AND PEAT↗

Strategies and Approaches for Developing Hands-On Training for Cold Climate Heat Pumps

The International Center for Appropriate and Sustainable Technology (ICAST) is in the process of implementing a program funded by the US Department of Energy (DOE) in which they are providing cold climate heat pump (CCHP) curriculum and training to HVAC workers, ranging from entry to experienced levels. They have coordinated with Santa Fe Community College (SFCC) to develop online curricula, and through their involvement with the DOE Better Buildings Workforce Accelerator, they requested technical assistance from the National Renewable Energy Laboratory (NREL) to help them develop programs that incorporate hands-on and on-the-job skills training and job placement services in coordination with local employers. This report offers a step-by step-overview of the process for developing a new workforce development and hands-on training program in a new region, outlining practices to help understand the market, and to effectively recruit, train, and connect people to HVAC jobs installing cold climate heat pumps.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗