Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “task management”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13

Elastic Resource Management for Deep Learning Applications in a Container Cluster

The increasing demand for learning from massive datasets is restructuring our economy. Effective learning, however, involves nontrivial computing resources. Most businesses utilize commercial infrastructure providers (e.g., AWS) to host their computing clusters in the cloud, where various jobs compete for available resources. While cloud resource management is a fruitful research field that has made many advances in production, such as Kubernetes and YARN, few efforts have been invested to further optimize the system performance, especially for deep learning (DL) training jobs in a container cluster. This work introduces FlowCon, a system that is able to monitor the individual evaluation functions of DL jobs at runtime, and thus to make placement decisions on resource allocations elastically. Here, we present a detailed design and implementation of FlowCon and conduct intensive experiments over various DL models. The results demonstrate that FlowCon significantly improves DL job completion time and resource utilization efficiency, compared to default systems. According to the results, FlowCon is able to improve the completion time by up to 68.8% and meanwhile, reduce the makespan by 18.0%, in the presence of various DL job workloads.

97 MATHEMATICS AND COMPUTING↗

Joint Genome Institute Analysis Workflow Service (JAWS) v2.7

The U.S. Department of Energy Joint Genome Institute (JGI) has developed the JGI Analysis Workflow Service (JAWS) as a distributed framework to run computational workflows across diverse high-performance computing (HPC) and cloud environments. JAWS enhances the reusability, scalability, and robustness of scientific workflows by orchestrating data movement, code execution, and results retrieval across multiple DOE facilities. At its core, JAWS integrates the Cromwell workflow engine to run workflows expressed in the Workflow Description Language (WDL), ensuring portability and interoperability. To provide consistent runtime environments, JAWS employs container technologies such as Shifter, Apptainer, and Docker. Workflow tasks are managed via HTCondor on HPC backends, while Globus ensures secure and efficient data transfer between sites. JAWS is deployed as a multi-site workflow manager across national laboratory computing facilities, with dedicated instances supporting community projects such as the National Microbiome Data Collaborative (NMDC) and KBase. This distributed, service-oriented architecture enables users to "write once, run anywhere," providing scalable, production-quality workflow execution.

Kirton, Edward↗

XPRESS: eXascale PRogramming Environment and System Software

The XPRESS Project is one of four major projects of the DOE Office of Science Advanced Scientific Computing Research X-stack Program initiated in September, 2012. The purpose of XPRESS is to devise an innovative system software stack to enable practical and useful exascale computing around the end of the decade with near-term contributions to efficient and scalable operation of trans-Petaflops performance systems in the next two to three years; both for DOE mission-critical applications. To this end, XPRESS directly addresses critical challenges in computing of efficiency, scalability, and programmability through introspective methods of dynamic adaptive resource management and task scheduling.

97 MATHEMATICS AND COMPUTING↗

Review of Cementitious Materials Development and Applications That Have Supported DOE-EM Missions: Waste Treatment, Conditioning, Containment Structures, Tank Closures, Facility Decommissioning, Environmental Restoration, and Structural Assessments

The Department of Energy (DOE) is tasked with managing the legacy defense wastes that resulted from nuclear materials production and nuclear arms development. Nuclear-waste management encompasses generation, processing (treatment and packaging), storage, transport, and disposal. To date, there are over 100 million gallons of liquid radioactive and chemical mixed wastes within the Department of Energy complex as well as solid waste, debris, and environmental restoration media that require disposal. DOE has been able to meet the challenges involved in dispositioning this waste using unique technical approaches and application-specific data required due to the nature of the constituents to be managed (e.g., long-lived radionuclides and highly mobile radionuclides in the near surface environments). Cementitious materials have played a prominent role historically in the successful disposition of these wastes, in the reduction of risk to the public, and in the closure of decommissioned tanks and facilities across the DOE complex.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

AGGREGATE: dAta-driven modelinG preservinG contRollable dEr for outaGe mAnagemenT and rEsiliency (Report for Task 10: Controllability and Observability Analysis (Deliverable D7))

It is common to have less than full observability for distribution systems, as the number of available measurements are not sufficient. Considering increasing penetration of distributed energy resources (DERs), it is imperative to understand and control distribution systems better. Developed for the transmission system, the original numerical observability analysis methods were based on the canonical DC Power Flow (DC-PF) model. However, the DC-PF model is ill-suited for the distribution system in which line resistance to reactance (R/X) ratios can be near unity. In this report, we apply the non-iterative Observability Test (OT) and Observable Island Identification Procedure (OIIP) in to the gain matrix from the distribution system state estimator. Because sensors are few in distribution systems, pseudo-measurements based on historical load profiles and zero-injection virtual measurements are often employed to ensure observability. However, both the observability and the accuracy of the state estimates are uncertain when historical data is limited/unavailable.

42 ENGINEERING↗

ISIS and META projects

ISIS and META are two distributed systems projects at Cornell University. The ISIS project, has developed a new methodology, virtual synchrony, for writing robust distributed software. This approach is directly supported by the ISIS Toolkit, a programming system that is distributed to over 300 academic and industrial sites. Several interesting applications that exploit the strengths of ISIS, including an NFS-compatible replicated file system, are being developed. The META project, is about distributed control in a soft real time environment incorporating feedback. This domain encompasses examples as diverse as monitoring inventory and consumption on a factory floor and performing load-balancing on a distributed computing system. One of the first uses of META is for distributed application management: the tasks of configuring a distributed program, dynamically adapting to failures, and monitoring its performance. Recent progress and current plans are presented. This approach to distributed computing, a philosophy that is believed to significantly distinguish the work from that of others in the field, is explained.

Birman, Kenneth↗

ISIS and META projects

The ISIS project has developed a new methodology, virtual synchony, for writing robust distributed software. High performance multicast, large scale applications, and wide area networks are the focus of interest. Several interesting applications that exploit the strengths of ISIS, including an NFS-compatible replicated file system, are being developed. The META project is distributed control in a soft real-time environment incorporating feedback. This domain encompasses examples as diverse as monitoring inventory and consumption on a factory floor, and performing load-balancing on a distributed computing system. One of the first uses of META is for distributed application management: the tasks of configuring a distributed program, dynamically adapting to failures, and monitoring its performance. Recent progress and current plans are reported.

Birman, Kenneth↗

Next Generation Space Telescope Integrated Science Module Data System

The Data system for the Next Generation Space Telescope (NGST) Integrated Science Module (ISIM) is the primary data interface between the spacecraft, telescope, and science instrument systems. This poster includes block diagrams of the ISIM data system and its components derived during the pre-phase A Yardstick feasibility study. The poster details the hardware and software components used to acquire and process science data for the Yardstick instrument compliment, and depicts the baseline external interfaces to science instruments and other systems. This baseline data system is a fully redundant, high performance computing system. Each redundant computer contains three 150 MHz power PC processors. All processors execute a commercially available real time multi-tasking operating system supporting, preemptive multi-tasking, file management and network interfaces. These six processors in the system are networked together. The spacecraft interface baseline is an extension of the network, which links the six processors. The final selection for Processor busses, processor chips, network interfaces, and high-speed data interfaces will be made during mid 2002.

Schnurr, Richard G.↗

Roll-Out and Turn-Off Display Software for Integrated Display System

This report describes the software products, system architectures and operational procedures developed by Lockheed-Martin in support of the Roll-Out and Turn-Off (ROTO) sub-element of the Low Visibility Landing and Surface Operations (LVLASO) program at the NASA Langley Research Center. The ROTO portion of this program focuses on developing technologies that aid pilots in the task of managing the deceleration of an aircraft to a pre-selected exit taxiway. This report focuses on software that produces a system of redundant deceleration cues for a pilot during the landing roll-out, and presents these cues on a head up display (HUD). The software also produces symbology for aircraft operational phases involving cruise flight, approach, takeoff, and go-around. The algorithms and data sources used to compute the deceleration guidance and generate the displays are discussed. Examples of the display formats and symbology options are presented. Logic diagrams describing the design of the ROTO software module are also given.

Johnson, Edward J., Jr.↗

Fundamental Biological Research on the International Space Station

The fundamental Biology Program of NASA's Life Sciences Division is chartered with enabling and sponsoring research on the International Space Station (ISS) in order to understand the effects of the space flight environment, particularly microgravity, on living systems. To accomplish this goal, NASA Ames Research Center (ARC) has been tasked with managing the development of a number of biological habitats, along with their support systems infrastructure. This integrated suite of habitats and support systems is being designed to support research requirements identified by the scientific community. As such, it will support investigations using cells and tissues, avian eggs, insects, plants, aquatic organisms and rodents. Studies following organisms through complete life cycles and over multiple generations will eventually be possible. As an adjunct to the development of these basic habitats, specific analytical and monitoring technologies are being targeted for maturation to complete the research cycle by transferring existing or emerging analytical techniques, sensors, and processes from the laboratory bench to the ISS research platform.

Souza, K. A.↗

Two New Aircraft Traffic Surveillance Symbology Concepts: Range Filter and Inboard Field-of-View Symbology

The objective of this preliminary experiment was to investigate two head-up surveillance symbology (HUSS) display issues. The first issue was concerned with the benefits of adding a range filter to the current HUSS concept. A range filter limits the amount of traffic symbols displayed head-up by setting a range boundary (e.g., 7-nmi) around the ownship. The second issue was concerned with the need to incorporate HUSS in the inboard field-of-view (IFOV) display of the eXternal Visibility System (XVS) concept. The hypothesis tested was that adding a range filter to the XVS display and HUSS to the IFOV display would enhance the pilot's effectiveness in traffic surveillance tasks. Using a high-resolution graphics flight simulator, each of three pilots flew departure and arrival scenarios under visual meteorological conditions. The pilots' main tasks, while managing flight path, were to detect and assess potential airborne traffic hazards and to maintain overall situation awareness. Upon completing all the runs, each pilot completed a subjective questionnaire. Results showed that having both the HUSS on the IFOV and the range filter on each of the XVS displays enhanced the effectiveness of the XVS surveillance display concept. This configuration had the least head down time and the lowest mental workload. Combining both features gave the best target detection and, the earliest threat recognition performances, and enabled the pilots to create a better strategy for evasive action when it became necessary.

Wong, Douglas T.↗

Cockpit Interruptions and Distractions: Effective Management Requires a Careful Balancing Act

Managing several tasks concurrently is an everyday part of cockpit operations. For the most part, crews handle concurrent task demands efficiently, yet crew preoccupation with one task to the detriment of performing other tasks is one of the more common forms of error in the cockpit. Most pilots are familiar with the December 1972 L1011 crash that occurred when the crew became preoccupied with a landing gear light malfunction and failed to notice that someone had inadvertently bumped off the autopilot. More recently a DC-9 landed gear-up in Houston when the crew, preoccupied with an stabilized approach, failed to recognize that the gear was not down because they had not switched the hydraulic pumps to high. We have recently started a research project to study why crews are vulnerable to these sorts of errors. As part of that project we reviewed NTSB reports of accidents attributed to crew error; we concluded that nearly half of these accidents involved lapses of attention associated with interruptions, distractions, or preoccupation with one task to the exclusion of another task. We have also analyzed 107 ASRS reports involving competing tasks; we present here some of our conclusions from those ASRS reports. These 107 reports involved 21 different types of routine tasks crews neglected at a critical moment while attending to another task. Sixty-nine percent of the neglected tasks involved either failure to monitor the current status or position of the aircraft or failure to monitor the actions of the pilot flying or taxiing. Thirty-four different types of competing activities distracted or preoccupied the pilots. Ninety percent of these competing activities fell into one of four broad categories: communication (e.g., discussion among crew or radio communication), heads-down work (e.g., programming the FMS or reviewing approach plates), responding to abnormals, or searching for VMC traffic. We will discuss examples of each of these four categories and suggest things crews can do to reduce their vulnerability to these and similar situations.

Dismukes, R. K.↗

Globe Teachers Guide and Photographic Data on the Web

The task of managing the GLOBE Online Teacher s Guide during this time period focused on transforming the technology behind the delivery system of this document. The web application transformed from a flat file retrieval system to a dynamic database access approach. The new methodology utilizes Java Server Pages (JSP) on the front-end and an Oracle relational database on the backend. This new approach allows users of the web site, mainly teachers, to access content efficiently by grade level and/or by investigation or educational concept area. Moreover, teachers can gain easier access to data sheets and lab and field guides. The new online guide also included updated content for all GLOBE protocols. The GLOBE web management team was given documentation for maintaining the new application. Instructions for modifying the JSP templates and managing database content were included in this document. It was delivered to the team by the end of October, 2003. The National Geophysical Data Center (NGDC) continued to manage the school study site photos on the GLOBE website. 333 study site photo images were added to the GLOBE database and posted on the web during this same time period for 64 schools. Documentation for processing study site photos was also delivered to the new GLOBE web management team. Lastly, assistance was provided in transferring reference applications such as the Cloud and LandSat quizzes and Earth Systems Online Poster from NGDC servers to GLOBE servers along with documentation for maintaining these applications.

Kowal, Dan↗

Human-Interaction Challenges in UAV-Based Autonomous Surveillance

Autonomous UAVs provide a platform for intelligent surveillance in application domains ranging from security and military operations to scientific information gathering and land management. Surveillance tasks are often long duration, requiring that any approach be adaptive to changes in the environment or user needs. We describe a decision- theoretic model of surveillance, appropriate for use on our autonomous helicopter, that provides a basis for optimizing the value of information returned by the UAV. From this approach arise a range of challenges in making this framework practical for use by human operators lacking specialized knowledge of autonomy and mathematics. This paper describes our platform and approach, then describes human-interaction challenges arising from this approach that we have identified and begun to address.

Freed, Michael↗

Two Aircraft Head-Up Traffic Surveillance Symbology Issues: Range Filter and Inboard Field-of-View Symbology

The purpose of the eXternal Visibility System (XVS) effort for NASA s High-Speed Research Program was to determine and to provide required pilot visual information for a High Speed Civil Transport vehicle concept to allow safe and efficient operation in the absence of forward windows. The objective of this preliminary experiment conducted at NASA Langley Research Center was to investigate two head-up surveillance symbology (HUSS) display issues. The first issue was concerned with the benefits of adding a range filter to the current HUSS concept. A range filter limits the amount of traffic symbols displayed head-up by setting a range boundary (e.g. 7-nmi) around the ownship. The second issue was concerned with the need to incorporate HUSS in the inboard field-of-view (IFOV) display of the XVS concept. The hypothesis tested was that adding a range filter to the XVS display and HUSS to the IFOV display would enhance the pilot s effectiveness of traffic surveillance tasks. Using a high-resolution graphics flight simulator, each of three pilots flew departure and arrival scenarios under visual meteorological conditions. The pilots main tasks, while managing flight path, were to detect and assess potential airborne traffic hazards and to maintain overall situation awareness. Upon completing all the runs, each pilot completed a subjective questionnaire. Results showed that having both the HUSS on the IFOV and the range filter on each of the XVS displays enhanced the effectiveness of the XVS surveillance display concept. This configuration had the least head down time and the lowest mental workload. Combining both features gave the best target detection, the earliest threat recognition, and enabled the pilots to create a better strategy for evasive action when it became necessary.

Wong, Douglas T.↗

Flow of a Gas Turbine Engine Low-Pressure Subsystem Simulated

The NASA Lewis Research Center is managing a task to numerically simulate overnight, on a parallel computing testbed, the aerodynamic flow in the complete low-pressure subsystem (LPS) of a gas turbine engine. The model solves the three-dimensional Navier- Stokes flow equations through all the components within the LPS, as well as the external flow around the engine nacelle. The LPS modeling task is being performed by Allison Engine Company under the Small Engine Technology contract. The large computer simulation was evaluated on networked computer systems using 8, 16, and 32 processors, with the parallel computing efficiency reaching 75 percent when 16 processors were used.

Veres, Joseph P.↗

High-Performance, Radiation-Hardened Electronics for Space Environments

The Radiation Hardened Electronics for Space Environments (RHESE) project endeavors to advance the current state-of-the-art in high-performance, radiation-hardened electronics and processors, ensuring successful performance of space systems required to operate within extreme radiation and temperature environments. Because RHESE is a project within the Exploration Technology Development Program (ETDP), RHESE's primary customers will be the human and robotic missions being developed by NASA's Exploration Systems Mission Directorate (ESMD) in partial fulfillment of the Vision for Space Exploration. Benefits are also anticipated for NASA's science missions to planetary and deep-space destinations. As a technology development effort, RHESE provides a broad-scoped, full spectrum of approaches to environmentally harden space electronics, including new materials, advanced design processes, reconfigurable hardware techniques, and software modeling of the radiation environment. The RHESE sub-project tasks are: SelfReconfigurable Electronics for Extreme Environments, Radiation Effects Predictive Modeling, Radiation Hardened Memory, Single Event Effects (SEE) Immune Reconfigurable Field Programmable Gate Array (FPGA) (SIRF), Radiation Hardening by Software, Radiation Hardened High Performance Processors (HPP), Reconfigurable Computing, Low Temperature Tolerant MEMS by Design, and Silicon-Germanium (SiGe) Integrated Electronics for Extreme Environments. These nine sub-project tasks are managed by technical leads as located across five different NASA field centers, including Ames Research Center, Goddard Space Flight Center, the Jet Propulsion Laboratory, Langley Research Center, and Marshall Space Flight Center. The overall RHESE integrated project management responsibility resides with NASA's Marshall Space Flight Center (MSFC). Initial technology development emphasis within RHESE focuses on the hardening of Field Programmable Gate Arrays (FPGA)s and Field Programmable Analog Arrays (FPAA)s for use in reconfigurable architectures. As these component/chip level technologies mature, the RHESE project emphasis shifts to focus on efforts encompassing total processor hardening techniques and board-level electronic reconfiguration techniques featuring spare and interface modularity. This phased approach to distributing emphasis between technology developments provides hardened FPGA/FPAAs for early mission infusion, then migrates to hardened, board-level, high speed processors with associated memory elements and high density storage for the longer duration missions encountered for Lunar Outpost and Mars Exploration occurring later in the Constellation schedule.

Keys, Andrew S.↗