Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “function as a service”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

CO 2 Storage Site Screening Platform Development and CO 2 Storage Resource Analysis in SECARB Offshore Reservoirs Using SAS Viya

A major goal of the SECARB Offshore Partnership (DE-FE0031557) is to screen deep saline aquifers and hydrocarbon reservoirs in the central Gulf of Mexico for CO 2 sequestration and CO 2 -enhanced oil and gas recovery (EOR/EGR) and estimate the corresponding CO 2 storage resources for select reservoirs. CO 2 storage potential associated with offshore CO 2 -EOR is considerable and likely represents “low hanging fruit” for near-term CO 2 storage given the in-place infrastructure in the region. It is for these reasons that this assessment focuses on oil and gas fields. To this end, three major objectives have been completed and include (1) managing geological data derived from different sources, (2) building a reservoir screening platform for CO 2 storage, and (3) ranking the reservoirs based on the estimated CO 2 storage resources. The SAS ® Viya platform was used for data management and analytics. The Viya platform is a cloud service platform that provides data integration, data management, quick analytics, data visualization, machine learning functions, and application programming interfaces (APIs) for multi-programming languages. Different sources of data containing geologic information, reservoir properties, and EOR/EGR information were collected, cleaned, formatted, and loaded into the SAS ® Viya platform for evaluation. The major geological characteristics of both shelf and deep-water areas of the central Gulf were examined and compared to define the appropriate reservoir screening criteria. Next, a CO 2 storage site screening system was built in the SAS ® Viya platform with the pre-defined criteria. Finally, the CO 2 storage resources of the screened reservoirs were calculated and reported at the BOEM field level to identify fields with the highest estimated CO 2 storage resource. The fields with the largest total estimated CO 2 storage resource are located in the Mississippi Canyon protraction area. Due to proximity to the Mississippi Delta (indicative of less infrastructure) and large estimated CO 2 storage resources, future development activities may wish to focus efforts in the Mississippi Canyon protraction area.

02 PETROLEUM↗
DOE OSTI2022

Multi-modal Energy-optimal Trip Scheduling in Real-time (METS-R) for Transportation Hubs (Final Report)

This report summarizes the work performed under the award number EE0008524. The project develops the Multi-modal Energy-optimal Trip Scheduling in Real-time (METS-R) platform as the next-generation transportation solution based on autonomous electric vehicles (AEV) serving passenger trips from and to urban transportation hubs, to substantially reduce transportation energy consumption. Extensive data collection and analyses were first conducted to understand the demand patterns and energy consumption of hub-based on-road trips. Then, a data-driven framework that consists of an analytical module and a simulation module was proposed. For the analytical module, five planning + operation tools were developed to support the planning and energy-efficient operations of urban AEV services: the charging station planning that robotically allocates charging supplies based on the stationary charging demand distribution; the transit planning and demand adaptive scheduling model that efficiently generates\ candidate transit routes from hubs to other places and dynamically adjusts the transit time table to fit the current demand; the online energy-efficient routing that learns the energy-optimal paths from observations of link-level energy consumption in real-time; the hub-based ridesharing that matches trip requests together with account for the uncertainty of future trip demand and vehicle supply; and finally, the integrated demand prediction and anomaly detection pipeline that leverages the flight/train time table and support other planning/operation tools. To demonstrate the performance of these tools, a scalable high-performance agent-based simulator was built. We divided the urban space into multiple service zones where each zone was considered as an agent for passenger generation and vehicle charging. Two types of AEV agents were coded to model two types of mobility services: AEV taxi and AEV transit. For the AEV taxi, the team implemented the functions of pickup/drop-off passengers, energy-efficient routing, ridesharing, fleet rebalancing, and recharging. For the AEV bus, the team implemented the functions of demand-adaptive route scheduling, passenger boarding, and recharging. A high-performance computing framework was introduced to receive various profiling information (such as link energy updates, vehicle speed) from the simulator instances and communicate the operational commands back to the instances. The numerical experiments show that each of the proposed operational algorithms can reduce energy consumption and improve system efficiency. Furthermore, there exists the need to collectively consider multiple planning + operational strategies as multiple strategies can influence each other in terms of performance impacts. Recommendations for future work related to AEV planning and simulation are discussed.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2023

Development of A Hardware-In-the-Loop (HIL) Testbed for Cyber-Physical Security in Smart Buildings

As smart buildings move towards open communication technologies, providing access to the Building Automation System (BAS) through the building's intranet, or even remotely through the Internet, has become a common practice. However, BAS was historically developed as a closed environment and designed with limited cyber-security considerations. Thus, smart buildings are vulnerable to cyber-attacks with the increased accessibility. This study introduces the development and capability of a Hardware-in-the-Loop (HIT) testbed for testing and evaluating the cyber-physical security of typical BASs in smart buildings. The testbed consists of three subsystems: (1) a real-time HIL emulator simulating the behavior of a virtual building as well as the Heating, Ventilation, and Air Conditioning (HVAC) equipment via a dynamic simulation in Modelica; (2) a set of real HVAC controllers monitoring the virtual building operation and providing local control signals to control HVAC equipment in the HIL emulator; and (3) a BAS server along with a web-based service for users to fully access the schedule, setpoints, trends, alarms, and other control functions of the HVAC controllers remotely through the BACnet network. The server generates rule-based setpoints to local HVAC controllers. Based on these three subsystems, the HIL testbed supports attack/fault-free and attack/fault-injection experiments at various levels of the building system. The resulting test data can be used to inform the building community and support the cyber-physical security technology transfer to the building industry.

Li, Guowen↗
DOE OSTI2022

Stand and environmental conditions drive functional shifts associated with mesophication in eastern US forests

There is a growing body of evidence that mesic tree species are increasing in importance across much of the eastern US. This increase is often observed in tandem with a decrease in the abundance and importance of species considered to be better adapted to disturbance and drier conditions (e.g., Quercus species). Concern over this transition is related to several factors, including the potential that this transition is self-reinforcing (termed “mesophication”), will result in decreased resiliency of forests to a variety of disturbances, and may negatively impact ecosystem functioning, timber value, and wildlife habitat. Evidence for shifts in composition provide broad-scale support for mesophication, but we lack information on the fine-scale factors that drive the associated functional changes. Understanding this variability is particularly important as managers work to develop site-and condition-specific management practices to target stands or portions of the landscape where this transition is occurring or is likely to occur in the future. To address this knowledge gap and identify forests that are most susceptible to mesophication (which we evaluate as a functional shift to less drought or fire tolerant, or more shade tolerant, forests), we used data from the USDA Forest Service Forest Inventory and Analysis program to determine what fine-scale factors impact the rate (change through time) and degree (difference between the overstory and midstory) of change in eastern US forests. We found that mesophication varies along stand and environmental gradients, but this relationship depended on the functional trait examined. For example, shade and drought tolerance suggest mesophication is greatest at sites with more acidic soils, while fire tolerance suggests mesophication increases with soil pH. Mesophication was also generally more pronounced in older stands, stands with more variable diameters, and in wetter sites, but plots categorized as “hydric” were often highly variable. Our results provide evidence that stand-scale conditions impact current and potential future changes in trait conditions and composition across eastern US forests. We provide a starting point for managers looking to prioritize portions of the landscape most at risk and developing treatments to address the compositional and functional changes associated with mesophication.

Woodbridge, Margaret↗
DOE OSTI2026

Best Practices for Resilience Hub Development and Management

The Carbon League and its community partners in East St. Louis, Illinois, have identified five facilities to serve as resilience hubs. These hubs are intended to support the local community through a range of services and resources during blue-sky (everyday), gray-sky (pre-event), and black-sky (emergency) conditions. Transforming these facilities into fully functional resilience hubs requires a broad operational improvement and programmatic planning roadmap. This memo outlines best practices to guide the development of these resilience hubs in East St. Louis, including recommendations for infrastructure services; safety and physical protection; community services; operational protocols; and a phased implementation strategy aligned with realistic funding and capacity constraints. Infrastructure recommendations include strengthening electric power, communications, water, sanitation, and transportation/logistics capabilities, all of which are essential for hubs that may serve as cooling and warming centers, distribution points, and information hubs during emergencies. Safety recommendations focus on accessibility, emergency action planning, indoor air quality, and secure storage of critical equipment. A phased roadmap provides guidance from immediate, low-cost readiness actions to long-term optimization and community integration. Performance metrics and maintenance protocols ensure continuous improvement and operational readiness. This guidance draws on best practices that can be used to support the development of resilient, community-centered hubs capable of enhancing public safety, health, and well-being during everyday operations and emergencies alike.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2020

Crack Growth Rate and Fracture Toughness Tests on Irradiated Ex-Plant Materials

The performance of structural materials is critical for the safe and economic operation of light water reactors. Exposed to neutron irradiation during service, the reactor core internal materials can undergo significant microstructural and microchemical changes, leading to irradiation hardening and embrittlement. To ensure the structural integrity and functionality of nuclear reactor components during long-term operation, material degradation and damage mechanisms must be understood and managed adequately. In this work, irradiated materials harvested from the decommissioned Zorita reactor were studied for their cracking susceptibility and fracture resistance as a function of irradiation dose up to 47 displacement per atom (dpa). The material is a Type 304 stainless steel sectioned from the baffle plates of this pressurized water reactor with 38 years of service. Crack growth rate and fracture toughness J-resistance (J-R) curve tests were performed in low-corrosion-potential environments at ~315°C. All samples behaved similarly under cyclic loading, and no deteriorated corrosion-fatigue behavior was observed in the test environments. Under constant stress intensity factors, most samples did not show elevated crack growth rates, suggesting an adequate stress corrosion cracking resistance in the test environments. However, an unstable cracking behavior was observed in a 47-dpa sample, resulting in significantly higher crack growth rates than expected at high stress intensity factors. Crack instability was also observed in a 0.06-dpa sample but did not lead to a sustained high crack growth rate. The impact of neutron irradiation was more evident in the fracture toughness J-R curve tests. As the dose increased, the J-R curve declined considerably and became very shallow at high doses. A fully intergranular fracture morphology was also observed among the high-dose samples ruptured in an air atmosphere at room temperature. This brittle fracture mode in the absence of high temperature water environment confirmed a high degree of embrittlement of this material resulting from its service exposure to neutron irradiation.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2021

Scientific and stakeholder evidence-based assessment: Ecosystem response to floating solar photovoltaics and implications for sustainability

Floating solar photovoltaic (FPV) installations are increasing globally. However, their interaction with the hosting water body and implications for ecosystem function is poorly understood. Understanding potential impacts is critical as water bodies provide many ecosystem services on which humans rely and are integral for delivering the United Nations Sustainable Development Goals (SDGs). Here, we used scientific evidence from a systematic review and stakeholder expertise, captured through an international survey and a workshop, alongside existing understanding of the role of water bodies in delivering ecosystem services and the SDGs. We found 22 evidence outcomes that indicated potential physical, chemical and biological impacts of FPV on water bodies. Assessment by stakeholders from across sectors indicated that reduced water evaporation is the greatest opportunity, whilst changes to water chemistry, including nitrification and deoxygenation, are the greatest threat. Despite these findings, FPV operators reported no observed water quality or ecosystem impacts. However, only 15% of respondents had performed water quality analysis; visual inspection alone cannot ascertain all water quality impacts. Based on the integration of these findings, we determined that FPV could impact nine ecosystem services. Furthermore, established linkages between ecosystem services and SDGs indicate the potential for impacts on eight SDGs, although whether the impact is positive or negative is likely to depend on FPV design and water body type. Our results further the understanding of the effects of FPVs on host water bodies and may help to ensure the anticipated growth in FPVs minimises threats and maximises opportunities, safeguarding overall sustainability.

14 SOLAR ENERGY↗
DOE OSTI2020

AGGREGATE: dAta-driven modelinG preservinG contRollable dEr for outaGe mAnagemenT and rEsiliency (Report for Task 13: Functional Specification Report(Deliverable D9))

This report provides functional specification for the AGGREGATE project and associated modules/ tools being developed for outage management and restoration with the Distributed Energy Resources (DERs). This report also provide initial validation of the developed modules and performance metrics. The AGGREGATE team at this stage has been collaborating with General Electric (GE) and Seattle City Light (SCL) to move forward from offline validation to online validation using commercial advanced distribution management system (ADMS). Hence, the functional specifications documents, which outline the requirement of various modules, is provided to address the integration of the modules, including 1) real-time model update and aggregation tools module, 2) observability and controllability metric module, 3) fault location solution service restoration module, 4) transmission-distribution co-simulation module, and 5) advanced distribution management system module. integration of different AGGREGATE modules and functional specification provides the foundation for online multi-scenario testing using SCL system model.

42 ENGINEERING↗
DOE OSTI2022

Development of a Configurable DERMS Test System in GridAPPS-D

Distributed Energy Resources and their increased penetration within the power grid are a suitable method to provide essential reliability services. In order to do so, they must operate in aggregate. Aggregation of a wide variety of systems with varying standards and protocols is a complex task, which could benefit from rules and standards to support interoperability. To this end, the Portland State University Power Lab has developed the Energy Grid of Things project, which includes a Distributed Energy Resource Management System to provide aggregation and demonstrate the usage of an Energy Services Interface: a set of rules governing the interface between resource owners and aggregator businesses. This thesis presents a Modeling Environment that provides a simulation and test platform reflecting the complex needs of an aggregator. A grid simulator is required that is able to reflect the effects of thousands of Distributed Energy Resources operating in tandem; furthermore, these effects must be communicated to external actors such as the Grid Operator, which provides grid service requests to the aggregator and requires feedback. The Modeling Environment provides all of this functionality by leveraging the GridAPPS-D platform to develop an interoperable class-based system that provides configurable simulations with modular input and output APIs. The Modeling Environment uses abstractions to allow any feasible type of input to be reflected within the model as a Distributed Energy Resource, and serves as a proof-of-concept for the development of aggregation simulation and testing within GridAPPS-D.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2021

SD-WAN Evaluation Criteria for a Defense Information Systems Network Expeditionary Customer Edge

The Defense Information Systems Agency (DISA) has identified a service provision gap midway between the capacity and capability of a Defense Information Systems Network (DISN) transport Edge Points of Presence (POP) and U.S. Department of Defense (DoD) Enterprise Classified Travel Kit (DECTK). Some deployed force 100-user Tactical Operations Centers are in field locations far removed from the DISN transport core, in challenging environmental conditions with limitations on space, weight, power, and cooling for network equipment. As part of a multi-phase project, Pacific Northwest National Laboratory (PNNL) will gather and analyze requirements, design, develop, prototype, and test a miniaturized and ruggedized DISN Customer Edge POP scaled to support approximately 100 users in a field Tactical Operations Center. An Expeditionary Customer Edge (ECE) will be more suitable for field deployment than a DISN transport Edge POP, using ruggedized hardware and network function virtualization (NFV) to operate in challenging field environmental conditions, plus reduce weight, power, and cooling requirements. A key enabling technology for ECE is Software Defined Wide Area Networking (SD-WAN). This document provides: • A brief overview of SD-WAN use cases and how they apply to ECE • How SD-WAN technology compares to existing networks like DISN that use Optical Transport Networking (OTN) and Multiprotocol Label Switching (MPLS) • SD-WAN functional requirements relevant to ECE • A description of an ECE Virtual Prototype, including simulated wide area network paths and a DISN-representative implementation of MPLS, in Cisco Modeling Labs • Detailed network flow walkthroughs • Evaluation criteria based on ECE-relevant SD-WAN functional requirements Finally, an appendix provides an informal evaluation of Speedify—a commercial retail Virtual Private Network service—against the ECE SD-WAN evaluation criteria.

42 ENGINEERING↗
DOE OSTI2024

Wear of Wave Energy Converters Mooring Lines Belts

Using a belt as a replacement for a rope on a rotary power take-offs (PTOs) system has become more common for wave energy converters, improving cyclic bend over sheave performance with a smaller bending thickness for belts. However, the service life predictions of PTOs are a major concern in design, because belt performance under harsh underwater environments is largely less studied. Here, in this work, the effect of fleet and twist angles on wear life is being investigated both experimentally and numerically. Two three-dimensional equivalent static finite element models are constructed to evaluate the complex stress state of polyurethane-steel belts around steel drums. The first is to capture the response of the experimental investigation performed on the wear life, and the second to predict the wear life of an existing functional PTO. The results show a significant effect for fleet and twist angles on stress concentrations and estimated service life.

16 TIDAL AND WAVE POWER↗
DOE OSTI2020

Enterprise Credentialing Service Statement of Work (SOW)

The scope of this project includes providing professional services in support of the development and deployment of an Enterprise Credentialing Service for the Department of Energy (DOE) National Nuclear Security Administration (NNSA), which will be used for issuing and managing credentials used for authentication, digital signature, and encryption functions by users, applications, and devices in a closed computing environment. The Seller shall provide subject matter expertise for the design and deployment of the technologies and processes that comprise the Enterprise Credentialing Service, which will include a public key infrastructure (PKI) and a credential management system (CMS) that issues and manages PKI-based smartcard credentials. The Enterprise Credentialing Service will support approximately 17,000 users at 15 DOE NNSA sites and laboratories located across the continental United States.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

An Online Approach to Solve the Dynamic Vehicle Routing Problem with Stochastic Trip Requests for Paratransit Services

Many transit agencies operating paratransit and microtransit services have to respond to trip requests that arrive in real-time, which entails solving hard combinatorial and sequential decision-making problems under uncertainty. To avoid decisions that lead to significant inefficiency in the long term, vehicles should be allocated to requests by optimizing a non-myopic utility function or by batching requests together and optimizing a myopic utility function. While the former approach is typically offline, the latter can be performed online. We point out two major issues with such approaches when applied to paratransit services in practice. First, it is difficult to batch paratransit requests together as they are temporally sparse. Second, the environment in which transit agencies operate changes dynamically (e.g., traffic conditions can change over time), causing the estimates that are learned offline to become stale. To address these challenges, we propose a fully online approach to solve the dynamic vehicle routing problem (DVRP) with time windows and stochastic trip requests that is robust to changing environmental dynamics by construction. We focus on scenarios where requests are relatively sparse—our problem is motivated by applications to paratransit services. We formulate DVRP as a Markov decision process and use Monte Carlo tree search to evaluate actions for any given state. Accounting for stochastic requests while optimizing a non-myopic utility function is computationally challenging; indeed, the action space for such a problem is intractably large in practice. To tackle the large action space, we leverage the structure of the problem to design heuristics that can sample promising actions for the tree search. Our experiments using real-world data from our partner agency show that the proposed approach outperforms existing state-of-the-art approaches both in terms of performance and robustness.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2022

Digital Twins for Materials

Digital twins are emerging as powerful tools for supporting innovation as well as optimizing the in-service performance of a broad range of complex physical machines, devices, and components. A digital twin is generally designed to provide accurate in-silico representation of the form (i.e., appearance) and the functional response of a specified (unique) physical twin. This paper offers a new perspective on how the emerging concept of digital twins could be applied to accelerate materials innovation efforts. Specifically, it is argued that the material itself can be considered as a highly complex multiscale physical system whose form (i.e., details of the material structure over a hierarchy of material length) and function (i.e., response to external stimuli typically characterized through suitably defined material properties) can be captured suitably in a digital twin. Accordingly, the digital twin can represent the evolution of structure, process, and performance of the material over time, with regard to both process history and in-service environment. This paper establishes the foundational concepts and frameworks needed to formulate and continuously update both the form and function of the digital twin of a selected material physical twin. The form of the proposed material digital twin can be captured effectively using the broadly applicable framework of n-point spatial correlations, while its function at the different length scales can be captured using homogenization and localization process-structure-property surrogate models calibrated to collections of available experimental and physics-based simulation data.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Internal curing of cement pastes by means of superabsorbent polymers visualized by neutron tomography

Highlights: • The kinetics of water release from SAPs were studied by neutron tomography. • The time window for internal curing was linked to the water release from SAPs. • The water release links to the SAP effectiveness to mitigate autogenous shrinkage. • One SAP type was effective while another prematurely released its stored water. Superabsorbent polymers (SAPs) are used to counteract self-desiccation in order to mitigate autogenous shrinkage, a problem in cementitious systems with a low water-to-cement ratio. The release kinetics during internal curing are of importance as not all SAP types are able to efficiently mitigate autogenous shrinkage. In this study, neutron tomography is used to study and visualize the water release kinetics over time. Per-voxel analysis of the time-attenuation curve was performed using piecewise-constant functions. Two different SAP types were studied, one being able to mitigate autogenous shrinkage and one quickly releasing its stored water after final setting. The tomography results correspond to autogenous shrinkage measurements and nuclear magnetic resonance tests. The visualization provides information on the time of water release by the SAPs after setting and the time window of internal curing. This opens additional insights towards the application of SAPs in the construction sector and provides information on the mechanism of internal curing.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Assessing the life-cycle environmental impacts of the wood pallet sector in the United States

Wood pallets play a critical role in the movement and storage of goods worldwide. They are an important component in the complex global supply chain and used by almost every industry. It is therefore important to assess the environmental implications of the wood pallet supply chain and identify optimization strategies that can be implemented. In this paper, primary 2018 annual production data collected from U.S. pallet manufacturers were used to develop the first industry-average life-cycle inventory (LCI). A new functional unit was proposed to perform a more refined and accurate environmental life-cycle assessment of the wood pallet supply chain. Using the LCI data developed, a cradle-to-grave industry-average life-cycle impact assessment was performed. This novel approach quantifies environmental impacts of a generic multi-use pallet, including repair and remanufacturing. The total global warming impact was 10.4 kg CO 2 e per 45.4 t of pallet loads of product delivered using wood pallets. The manufacturing stage contributed the most, about 35%, followed by the raw material supply stage. About 41% of total primary energy consumption was from renewable sources, with most sourced from biomass. Fossil fuels comprised about 52% of the total (225 MJ per functional unit) primary energy consumption. Total environmental impact was significantly affected by two main parameters: reference service life and load-bearing capacity. Pallet repair was also found to be an important component of the wood pallet supply chain, which has a low environmental footprint compared with the overall impact of a pallet and enables mitigation of overall impact by extending the reference service life. Finally, at end-of-life, common industry practices demonstrated substantial potential environmental benefits that can minimize overall environmental impact.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Handbook on the Material Properties of Yttrium Hydride for High Temperature Moderator Applications

Yttrium hydride is an optimal choice for a high-temperature moderator material in advanced thermal neutron spectrum reactors that require small core volumes. A complete database of the thermomechanical properties of yttrium hydride is not yet available, although it is much needed to understand and predict the moderator performance during service in reactors. This milestone report presents the properties of unirradiated bulk yttrium hydride as a function of hydrogen concentration—including density, crystal structure, specific heat capacity, thermal diffusivity, thermal conductivity, hardness, elastic/shear moduli, Poisson’s ratio, fracture strength, microstructure, and thermal stability. This information provides a baseline measurement for the subsequent neutron irradiation response study of yttrium hydride. The recommended empirical treatment of the data is suggested. In addition, other properties (i.e., hydrogen retention, thermal hydrogen migration, and irradiation response) requiring investigation are discussed. Also included are the Preliminary post-irradiation examination (PIE) data of yttrium hydride irradiated at 600 and 900°C to 0.1 dpa in the High Flux Isotope Reactor (HFIR). The thermophysical properties have insignificant change following this low dpa irradiation for both irradiation temperatures.

36 MATERIALS SCIENCE↗
DOE OSTI2024

A Managed Tokens Service for Securely Keeping and Distributing Grid Tokens

Fermilab is transitioning authentication and authorization for grid operations to using bearer tokens based on the WLCG Common JWT (JSON Web Token) Profile. One of the functionalities that Fermilab experimenters rely on is the ability to automate batch job submission, which in turn depends on the ability to securely refresh and distribute the necessary credentials to experiment job submit points. Thus, with the transition to using tokens for grid operations, we needed to create a service that would obtain, refresh, and distribute tokens for experimenters’ use. This service would avoid the need for experimenters to be experts in obtaining their own tokens and would better protect the most sensitive long-lived credentials. Further, the service needed to be widely scalable, as we are currently keeping credentials active for approximately 15 experiments, each with 1-3 different credentials, and distributing those credentials to 2-20 submit points per experiment, with those numbers steadily increasing. To address these issues, we created and deployed a Managed Tokens service. The service is written in Go, taking advantage of that language’s native concurrency primitives to easily be able to scale operations as we onboard experiments. The service uses as its first credentials a set of kerberos keytabs, stored on the same secure machine that the Managed Tokens service runs on. These kerberos credentials allow the service to use htgettoken via condor_vault_storer to store vault tokens in the HTCondor credential managers (credds) that run on the batch system scheduler machines (HTCondor schedds); as well as downloading a local, shorter-lived copy of the vault token. The kerberos credentials are then also used to distribute copies of the locally-stored vault tokens to experiment submit points. When experimenters schedule jobs to be submitted, these distributed vault tokens are used to access a Hashicorp Vault instance (run separately from the Managed Tokens service), and previously-stored refresh tokens there are used to obtain the bearer token that is submitted with the job. We will discuss here the design of the Managed Tokens service, including elaborating on certain choices we made with regards to concurrent operations, configuration, monitoring, and deployment.

Bhat, Shreyas↗