Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “resources”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,477 records · Page 82

Meta-virus resource (MetaVR): expanding the frontiers of viral diversity with 24 million uncultivated virus genomes

Viruses are ubiquitous in all environments and impact host metabolism, evolution, and ecology, although our knowledge of their biodiversity is still extremely limited. Viral diversity from genomic and metagenomic datasets has led to an explosion of uncultivated virus genomes (UViGs) and the development of specialized databases to catalog this viral diversity, though many lack comprehensive integration. Here, we introduce meta-virus resource (MetaVR), the successor of the IMG/VR database, designed to overcome previous limitations such as large-scale querying and programmatic access. Drawing on the increase of publicly available genomes and metagenomes, MetaVR significantly expands viral diversity, now comprising 24,435,662 UViGs, a 57.6% increase from its predecessor, organized into over 12 million viral operational taxonomic units. Key enhancements include the integration of curated eukaryotic host information, the integration of protein clusters and predicted structures for comparative studies, and an API for programmatic data access. Furthermore, MetaVR features an updated taxonomic framework based on ICTV release 39, assignment to Baltimore classes, and enhanced host assignment through novel computational tools like iPHoP. These advancements position MetaVR as a unique resource for exploring viral diversity, evolution, and host interactions across diverse environments. MetaVR can be freely accessed at https://www.meta-virome.org/.

Fiamenghi, Mateus B↗

The RCSB Protein Data Bank: new resources for research and education

The Research Collaboratory for Structural Bioinformatics Protein Data Bank (RCSB PDB) develops tools and resources that provide a structural view of biology for research and education. The RCSB PDB web site (http://www.rcsb.org) uses the curated 3D macromolecular data contained in the PDB archive to offer unique methods to access, report and visualize data. Recent activities have focused on improving methods for simple and complex searches of PDB data, creating specialized access to chemical component data and providing domain-based structural alignments. New educational resources are offered at the PDB-101 educational view of the main web site such as Author Profiles that display a researcher’s PDB entries in a timeline. To promote different kinds of access to the RCSB PDB, Web Services have been expanded, and an RCSB PDB Mobile application for the iPhone/iPad has been released. These improvements enable new opportunities for analyzing and understanding structure data.

59 BASIC BIOLOGICAL SCIENCES↗

Improvements to PATRIC, the all-bacterial Bioinformatics Database and Analysis Resource Center

Here, the Pathosystems Resource Integration Center (PATRIC) is the bacterial Bioinformatics Resource Center. Recent changes to PATRIC include a redesign of the web interface and some new services that provide users with a platform that takes them from raw reads to an integrated analysis experience. The redesigned interface allows researchers direct access to tools and data, and the emphasis has changed to user-created genome-groups, with detailed summaries and views of the data that researchers have selected. Perhaps the biggest change has been the enhanced capability for researchers to analyze their private data and compare it to the available public data. Researchers can assemble their raw sequence reads and annotate the contigs using RASTtk. PATRIC also provides services for RNA-Seq, variation, model reconstruction and differential expression analysis, all delivered through an updated private workspace. Private data can be compared by `virtual integration' to any of PATRIC's public data. The number of genomes available for comparison in PATRIC has expanded to over 80 000, with a special emphasis on genomes with antimicrobial resistance data. PATRIC uses this data to improve both subsystem annotation and k-mer classification, and tags new genomes as having signatures that indicate susceptibility or resistance to specific antibiotics.

59 BASIC BIOLOGICAL SCIENCES↗

Fundamental limitations on photoisomerization from thermodynamic resource theories

Small, out-of-equilibrium, and quantum systems defy simple thermodynamic expressions. Such systems are exemplified by molecular switches, which exchange heat with a bath. These molecules can photoisomerize, or change conformation, or switch, on absorbing light. The photoisomerization probability depends on kinetic details that couple the molecule’s energetics to its dissipation. Therefore, a simple, general, thermodynamic-style bound on the photoisomerization probability seems out of reach. We derive such a bound using a resource theory. The resource-theory framework is a set of mathematical tools, developed in quantum information theory, used to generalize thermodynamics to small and quantum settings. From this toolkit has been derived a generalization of the second law, the thermomajorization preorder. We use thermomajorization to upper-bound the photoisomerization probability. Then, we compare the bound with an equilibrium prediction and with a Lindbladian model. We identify a realistic parameter regime in which the Lindbladian evolution saturates the thermomajorization bound. We also quantify the energy coherence in the electronic degree of freedom, and we argue that this coherence cannot promote photoisomerization. Overall, this work illustrates how quantum-information-theoretic thermodynamics can elucidate complex quantum processes in nature, experiments, and synthetics.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Parametrized process characterization with reduced resource requirements

Quantum process tomography (QPT) is a powerful tool to characterize quantum operations, but it requires considerable resources, making it impractical for more than two-qubit systems. This study proposes an alternative approach that requires significantly fewer resources for unitary process characterization with a built-in method for state preparation and measurement error mitigation. By measuring the quantum process as rotated through the X and Y axes on the Bloch sphere, we can acquire enough information to reconstruct the quantum process matrix χ and measure its fidelity. We test the algorithm's performance against standard QPT using simulated and physical experiments on several IBM quantum processors and compare the resulting process matrices. We demonstrate with numerical experiments that the method can improve gate fidelity via a noise reduction in the imaginary part of the process matrix, along with a stark decrease in the number of experiments needed to perform the characterization.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Entanglement is not a critical resource for quantum metrology

We investigate high-precision measurements beyond the standard quantum limit, utilizing nonclassical states. Although entanglement was considered a resource for achieving the Heisenberg limit in measurements, we show that any advantage expected from using entanglement is dependent on the measurement in question. We investigate several measurement scenarios and illustrate the role of entanglement as a resource for quantum high-precision measurement. In particular, we demonstrate that there is a regime wherein entanglement not only does not help, but prevents the achievement of the fundamental limit.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Convex Q-Learning in Continuous Time with Application to Dispatch of Distributed Energy Resources

Convex Q-learning is a recent approach to reinforcement learning, motivated by the possibility of a firmer theory for convergence, and the possibility of making use of greater a priori knowledge regarding policy or value function structure. This paper explores algorithm design in the continuous time domain, with a finite-horizon optimal control objective. The main contributions are (i) The new Q-ODE: a model-free characterization of the Hamilton-Jacobi-Bellman equation. (ii) A formulation of Convex Q-learning that avoids approximations appearing in prior work. The Bellman error used in the algorithm is defined by filtered measurements, which is necessary in the presence of measurement noise. (iii) Convex Q-learning with linear function approximation is a convex program. It is shown that the constraint region is bounded, subject to an exploration condition on the training input. (iv) The theory is illustrated in application to resource allocation for distributed energy resources, for which the theory is ideally suited.

Lu, Fan↗

Dynamic Distribution Voltage Stability Control Using Distributed Energy Resources for Improved Resiliency

The main goal of this paper is to present the development and simulation of a new dynamic voltage stability control technique, with a focus on effective control and coordination of all available reactive power generation resources in a microgrid setting. Both power electronics and synchronous generator based distributed energy resources (DERs), and grid-supporting functions, are considered to accommodate a high penetration of diverse DERs and energy storage by using an enhanced microgrid voltage stabilizer. A systematic controller parameter synthesizing method is employed, and the overall dynamic voltage stability of the system is studied and evaluated with a time-domain dynamic simulation during emergency, hazard and disaster events. The results with the new approach show significant improvements and enhancements on the dynamic voltage profile of the distribution system, leading towards a more resilient grid system with high penetration of diverse DERs during emergency, hazard and disaster events.

Hatipoglu, Kenan↗

Joint Resource Modeling and Assessment for Hybrid Distributed Solar and Wind Systems

The inherent variability and uncertainty in distributed energy resources can presents myriad challenges to the planning and operations of power systems. These risks are poised to become larger as the penetration of renewable energy sources rises in the power generation mix. Hybrid solar-wind energy systems are able to mitigate some of these risks by their complementary resource availability. Surface solar and wind fields are coupled and correlated in both space and time. Appropriately estimating the hybrid solar wind energy system requires simulating the spatio-temporal structure of these fields that can be produced for each time horizon. We introduce a novel joint spatio-temporal stochastic differential equation (SPDE) approach that captures the spatio-temporal dynamics of solar and wind fields and their joint dependency over a domain for each time step. In the case study on Colorado, we consider nonstationary three-level hierarchical spatio temporal models for both hourly solar irradiance data and wind speed data in Colorado. Dependence between the solar irradiance data and wind speed data is captured by a shared spatio-temporal random effect. Our approach performs well in terms of the prediction score criterion.

joint modeling↗

High-Performance Transmission and Distribution Co-simulation with 10,000+ Inverter-Based Resources

The inverter-based resource (IBR) has become avery important component in the distribution system. The impacts on system transient stability introduced by high IBR penetration are not fully addressed because of the lack of high-fidelity models. The aggregate IBR model at the transmission level cannot precisely reproduce the dynamics of distributed IBR at the distribution system because of the oversimplification. In this paper, we will develop a high-penetration fully-connected transmission and distribution (T&D) co-simulation platform that supports the simulation of 10,000+ dispersed IBR models. The interfacing and iterative initialization techniques for the co-simulation have been implemented to maintain stable operation and simulation of large-multitude of IBR models. The phasor-domain IBR models with grid-forming (GFM) and grid-following (GFL) control are implemented in the distribution systems simulators. The developed platform is tested on high-performance computing (HPC) resources and can be utilized to explore the hierarchical control strategies of IBRs for the large-scale T&D hybrid system.

Liu, Yuan↗

Elastic distributed training with fast convergence and efficient resource utilization

Distributed learning is now routinely conducted on cloud as well as dedicated clusters. Training with elastic resources brings new challenges and design choices. Prior studies focus on runtime performance and assume a static algorithmic behavior. In this work, by analyzing the impact of of resource scaling on convergence, we introduce schedules for synchronous stochastic gradient descent that proactively adapt the number of learners to reduce training time and improve convergence. Our approach no longer assumes a constant number of processors throughout training. In our experiment, distributed stochastic gradient descent with dynamic schedules and reduction momentum achieves better convergence and significant speedups over prior static ones. Numerous distributed training jobs running on cloud may benefit from our approach.

Cong, Guojing↗

Advanced Synchrophasor-based Application for Potential Distributed Energy Resources Management: Key Technology, Challenge and Vision

With an increasing number of distributed energy resources (DERs) integrating into the power system, the power grid is becoming more complex and uncertain. Owing to most of DERs are through grid-connected converters to integrate into the power system, the intermittent nature and resource-depended characteristic of the DERs are challenging their monitoring and control. Conventional synchronized measurement devices (SMDs) may be difficult to provide qualified data for DERs management for its accuracy and reporting-rate limitation. The monitoring systems developed basing on SMDs may be insufficient for depicting detailed dynamic manifestations of power systems with a high proportion integration of DERs. This paper shares some advanced synchrophasor-based applications developed in FNET/GridEye, which have a broad prospect for assisting system operator on the control and integration of the DERs.

Wang, Weikang↗

Time Utility Functions for Modeling and Evaluating Resource Allocations in a Heterogeneous Computing System

This study considers a heterogeneous computing system and corresponding workload being investigated by the Extreme Scale Systems Center (ESSC) at Oak Ridge National Laboratory (ORNL). The ESSC is part of a collaborative effort between the Department of Energy (DOE) and the Department of Defense (DoD) to deliver research, tools, software, and technologies that can be integrated, deployed, and used in both DOE and DoD environments. The heterogeneous system and workload described here are representative of a prototypical computing environment being studied as part of this collaboration. Each task can exhibit a time-varying importance or utility to the overall enterprise. In this system, an arriving task has an associated priority and precedence. The priority is used to describe the importance of a task, and precedence is used to describe how soon the task must be executed. These two metrics are combined to create a utility function curve that indicates how valuable it is for the system to complete a task at any given moment. This research focuses on using time-utility functions to generate a metric that can be used to compare the performance of different resource schedulers in a heterogeneous computing system. The contributions of this paper are: (a) a mathematical model of a heterogeneous computing system where tasks arrive dynamically and need to be assigned based on their priority, precedence, utility characteristic class, and task execution type, (b) the use of priority and precedence to generate time-utility functions that describe the value a task has at any given time, (c) the derivation of a metric based on the total utility gained from completing tasks to measure the performance of the computing environment, and (d) a comparison of the performance of resource allocation heuristics in this environment.

99 GENERAL AND MISCELLANEOUS↗

iez: Resource Contention Aware Load Balancing for Large-Scale Parallel File Systems

Parallel I/O performance is crucial to sustaining scientific applications on large-scale High-Performance Computing (HPC) systems. However, I/O load imbalance in the underlying distributed and shared storage systems can significantly reduce overall application performance. There are two conflicting challenges to mitigate this load imbalance: (i) optimizing systemwide data placement to maximize the bandwidth advantages of distributed storage servers, i.e., allocating I/O resources efficiently across applications and job runs; and (ii) optimizing client-centric data movement to minimize I/O load request latency between clients and servers, i.e., allocating I/O resources efficiently in service to a single application and job run. Moreover, existing approaches that require application changes limit wide-spread adoption in commercial or proprietary deployments. We propose iez, an “end-to-end control plane” where clients transparently and adaptively write to a set of selected I/O servers to achieve balanced data placement. Our control plane leverages realtime load information for distributed storage server global data placement while our design model leverages trace-based optimization techniques to minimize I/O load request latency between clients and servers. We evaluate our proposed system on an experimental cluster for two common use cases: synthetic I/O benchmark IOR for large sequential writes and a scientific application I/O kernel, HACC-I/O. Results show read and write performance improvements of up to 34% and 32%, respectively, compared to the state of the art.

Wadhwa, Bharti↗

Cloud Services Enable Efficient AI-Guided Simulation Workflows across Heterogeneous Resources

Applications which fuse machine learning and simulation are rarely best served by a single computing resource. Highly parallel simulation codes are best deployed on super- computers, while AI tasks used to decide which simulations to perform may be best suited to specialized accelerators. Here we present a Function-as-a-Service (FaaS) system for executing complex, distributed computational campaigns that achieves performance parity with conventional workflow systems without the complexities of secure network connections between compute providers. One innovation enabling high performance is a subsystem that directly moves task data between sites, separate from the cloud-hosted FaaS system used to distribute task instructions. We also introduce a flexible scheduling system that allows us access factor of 2 trade offs between the amount of resources required to solve a problem at each compute site. We anticipate that this system will upgrade multi-site applications from demonstration projects to routine practice in computational science.

Ward, Logan↗

An intelligent energy router for managing behind-the-meter resources and assets

With increase in distributed energy resources (DERs) and smart loads, each energy resource and load need a separate power conversion system leading to complex coordination and interaction, reduced energy conversion efficiency, coordinating compliance to grid standards (IEEE 1547) from multiple sources, reduced security. Also, multiple vendors with legacy system designs and proprietary communications interfaces result in redundancy and increase in cost of power electronics systems. This paper presents an energy router concept for buildings applications which provides autonomous power flow between sources and loads with a novel agent-based software interface.

Chinthavali, Madhu Sudhan↗

Secure Federated Learning Across Heterogeneous Cloud and High-Performance Computing Resources: A Case Study on Federated Fine-Tuning of LLaMA 2

Federated learning enables multiple data owners to collaboratively train robust machine learning models without transferring large or sensitive local datasets by only sharing the parameters of the locally trained models. Here, in this article, we elaborate on the design of our Advanced Privacy-Preserving Federated Learning (APPFL) framework, which streamlines end-to-end secure and reliable federated learning experiments across cloud computing facilities and high-performance computing resources by leveraging Globus Compute, a distributed function as a service platform, and Amazon Web Services. We further demonstrate the use case of APPFL in fine-tuning an LLaMA 2 7B model using several cloud resources and supercomputers.

97 MATHEMATICS AND COMPUTING↗

Pathways to the Next-Generation Power System With Inverter-Based Resources: Challenges and recommendations

Managing the stability of today's electric power systems is based on decades of experience with the physical properties and control responses of large synchronous generators. Today's electric power systems are rapidly transitioning toward having an increasing proportion of generation from nontraditional sources, such as wind and solar (among others), as well as energy storage devices, such as batteries. In addition to the variable nature of many renewable generation sources (because of the weather-driven nature of their fuel supply), these newer sources vary in size - from residential-scale rooftop systems to utility-scale power plants - and they are interconnected throughout the electric grid, both from within the distribution system and directly to the high-voltage transmission system. Most important for our purposes, many of these new resources are connected to the power system through power electronic inverters. Collectively, we refer to these sources as inverter-based resources.

24 POWER TRANSMISSION AND DISTRIBUTION↗