Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Resource management”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 415 records · Page 23
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Software defined grid energy storage

Today, consumer battery installations are isolated, physical devices. Virtual power plants (VPPs) allow consumer devices to aggregate for grid services, but they are are vertically integrated, vendor controlled systems (e.g., Tesla’s VPP). Consumer batteries are therefore unable to participate in energy markets or other grid services outside what their vendor provides. We describe a software system that provides software control of multiple, networked battery energy storage systems in the electric grid. The system introduces two new ideas that enable flexible and dependable management of energy storage. The first is a virtual battery, which can either partition a battery or aggregate multiple batteries. The second is a reservation-based API which allows asynchronous control of batteries to meet contractual guarantees in a safe and dependable manner. Virtual batteries and a reservation-based API address the unique challenges of achieving high and efficient utilization of energy storage systems, including heterogeneity of battery systems such as varying C-rates, participation in energy markets, utility bill management systems, community resource sharing, and reliability. Using a testbed comprised of sonnen Inc. storage units installed in several homes and a lab, we demonstrate that virtualized batteries can seamlessly replace physical batteries, flexibly manage energy storage resources, isolate multiple clients using a shared battery, and create new energy storage applications.

25 ENERGY STORAGE↗
DOE OSTI2023

Conquering Data Chaos: Research Data Management with Kubernetes

Managing massive volumes of data and effectively making it accessible to researchers poses significant challenges and is a barrier to scientific discovery. In many cases, critical data is locked up in unwieldy file formats or one-off databases and is too large to effectively process on a single machine. This talk explores the role of Kubernetes, an open-source container orchestration platform, in addressing research data management challenges. I will discuss how we are using a set of publicly available open-source and home-grown tools in the National Renewable Energy Lab (NREL) Data, Analysis, and Visualization (DAV) group to help researchers overcome data-related bottlenecks. The talk will begin by providing an overview of the data challenges faced in research data management, including data storage, processing, and analysis. I will highlight Kubernetes' ability to handle large-scale data by leveraging containerization and distributed computing, including distributed storage. Kubernetes allows researchers to encapsulate data processing infrastructure and workflows into portable containers, enabling reproducibility and ease of deployment. Kubernetes can then schedule and manage the resource allocation of these containers to enable efficient utilization of limited computing resources, leading to more efficient data processing and analysis. I will discuss some limitations of traditional, siloed approaches to dealing with data and emphasize the need for solutions which foster collaboration. I will highlight how we are using Kubernetes at NREL to facilitate data sharing and cooperation among research teams. Kubernetes' flexible architecture enables the deployment of shared computing environments, such as Apache Superset, where researchers can seamlessly access and analyze shared datasets. Providing the ability to have one research team easily consume data generated by another, utilizing Kubernetes' as a central data platform, is one of the major wins we've encountered by adopting the platform. Finally, I will showcase real-world use cases from NREL where we have used Kubernetes to solve some persistent data challenges involving large volumes of sensor and monitoring data. I will discuss the challenges we encountered when creating our cluster and making it available as a production-ready resource. I will also discuss the specific suite of tools, including Postgres and Apache Druid for columnar and timeseries data, and Redpanda Kafka for streaming data we have deployed in our infrastructure, and the process that went into the selection of these tools.

collaborative environment↗
DOE OSTI2025

A Scale‐Adaptive Urban Hydrologic Framework: Incorporating Network‐Level Storm Drainage Pipes Representation

Abstract Below‐ground urban stormwater networks (BUSNs) significantly influence urban flood dynamics, yet their representation at the watershed or larger scales remains challenging. We introduce a scalable urban hydrologic framework that centers on a novel network‐level BUSN representation, balancing the needs for physical basis, parameter parsimony, and computational efficiency. Our framework conceptualizes an urban watershed into four interacting zones: hillslopes (natural), storm‐sewersheds (urban), a sub‐network channel (tributaries), and a main channel. We develop an innovative Graph Theory‐based algorithm to derive network‐level BUSN parameters from publicly available datasets, enabling efficient, scalable parameterization. We demonstrate this framework's applicability at nine representative watersheds in the Houston metropolitan region, USA, with urban imperviousness ranging from 0% to 64% and drainage areas ranging from 24 to 302 . Our model achieves satisfying computational efficiency, completing hourly time step simulations for 18 years in less than 5 sec per watershed on a standard PC. Validation against observed daily streamflow confirms that the model can capture small‐to‐large flood peaks and seasonal and annual water balance over these watersheds. Comparisons with the National Water Model show better performance in predicting flood peaks and overall water balance, underscoring the promises of our new framework for urban hydrologic modeling at large scales. Furthermore, analysis reveals nonlinear relationships between BUSNs' designed capacities and flood reduction effects. Our approach bridges the gap between detailed hydraulic and large‐scale hydrologic models, providing a valuable tool for urban flood prediction and management across broader spatial and temporal scales.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Characterization and Recovery of Critical Metals from Municipal Solid Waste Incineration Ashes

The dependence on international supplies and lack of diverse supplies of critical materials (such as rare earth elements, REEs) have prompted the US to explore new sources and develop environmentally friendly technologies for critical metal extraction, processing, and manufacturing. Secondary wastes have been explored for the recovery of REEs. Municipal solid waste (MSW) is a large solid waste stream and may constitute the largest resource for REEs and other critical metals; yet its incineration ashes (MSWI ashes) have received limited attention in terms of critical metal recovery. On the other hand, management of MSWI ashes also presents significant challenges both operationally and financially, such as landfill costs, volume reduction, and contaminant immobilization. To address the challenges associated with the management of and resource recovery from MSWI ashes, this project developed a closed-loop, integrated, scalable, and environmentally friendly waste management and resource recovery system. This system is characterized with maximum recovery of REEs, production of additional salable products, minimal production of secondary waste, and high immobilization of heavy metal contaminants.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Temporal sequence transformer to advance long-term streamflow prediction

Accurate streamflow prediction is crucial for understanding climate change impacts on water resources and for effective management of extreme hydrological events. While Long Short-Term Memory (LSTM) networks have been the dominant data-driven approach for streamflow forecasting, recent advancements in transformer architectures for time series tasks have shown promise in outperforming traditional LSTM models. This study introduces a transformer-based model that integrates historical streamflow data with climatic variables to enhance streamflow prediction accuracy. We evaluated our transformer model against a benchmark LSTM across five diverse basins in the United States. Results demonstrate that the transformer architecture consistently outperforms the LSTM model across all evaluation metrics, highlighting its potential as a more effective tool for hydrological forecasting. This research contributes to the ongoing development of advanced AI techniques for improved water resource management and climate change adaptation strategies.

Singh, Ruhaan [Farragut High School]↗
DOE OSTI2022

Quantum Computing in the Cloud: Analyzing job and machine characteristics

As the popularity of quantum computing continues to grow, quantum machine access over the cloud is critical to both academic and industry researchers across the globe. And as cloud quantum computing demands increase exponentially, the analysis of resource consumption and execution characteristics are key to efficient management of jobs and resources at both the vendor-end as well as the client-end. While the analysis of resource consumption and management are popular in the classical HPC domain, it is severely lacking for more nascent technology like quantum computing. This paper is a first-of-its-kind academic study, analyzing various trends in job execution and resources consumption / utilization on quantum cloud systems. We focus on IBM Furthermore, quantum systems and analyze characteristics over a two year period, encompassing over 6000 jobs which contain over 600,000 quantum circuit executions and correspond to almost 10 billion “shots” or trials over 20+ quantum machines. Specifically, we analyze trends focused on, but not limited to, execution times on quantum machines, queuing/waiting times in the cloud, circuit compilation times, machine utilization, as well as the impact of job and machine characteristics on all of these trends. Furthermore, our analysis identifies several similarities and differences with classical HPC cloud systems. Based on our insights, we make recommendations and contributions to improve the management of resources and jobs on future quantum cloud systems.

42 ENGINEERING↗
DOE OSTI2024

Converged Computing: A Best of Both Worlds of High-Performance Computing and Cloud

Collaboration between Cloud and High Performance Computing (HPC) communities has accelerated in the last half decade. A common goal to run batch workloads combined with a desire for reproducibility, automation, and optimization has led to successful projects that range from container technologies to workload management and security. This span of current and future work defines a novel “Converged Computing” paradigm that aims to combine the best of both worlds, both from a technological and cultural standpoint. Furthermore, in this Special Issue, we review common themes in the space, showcasing current work and encouraging a continued effort toward innovative ideas that will enable the next generations of scientific discovery.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Taming the terminological tempest in invasion science

ABSTRACT Standardised terminology in science is important for clarity of interpretation and communication. In invasion science – a dynamic and rapidly evolving discipline – the proliferation of technical terminology has lacked a standardised framework for its development. The result is a convoluted and inconsistent usage of terminology, with various discrepancies in descriptions of damage and interventions. A standardised framework is therefore needed for a clear, universally applicable, and consistent terminology to promote more effective communication across researchers, stakeholders, and policymakers. Inconsistencies in terminology stem from the exponential increase in scientific publications on the patterns and processes of biological invasions authored by experts from various disciplines and countries since the 1990s, as well as publications by legislators and policymakers focusing on practical applications, regulations, and management of resources. Aligning and standardising terminology across stakeholders remains a challenge in invasion science. Here, we review and evaluate the multiple terms used in invasion science (e.g. ‘non‐native’, ‘alien’, ‘invasive’ or ‘invader’, ‘exotic’, ‘non‐indigenous’, ‘naturalised’, ‘pest’) to propose a more simplified and standardised terminology. The streamlined framework we propose and translate into 28 other languages is based on the terms ( i ) ‘non‐native’, denoting species transported beyond their natural biogeographic range, ( ii ) ‘established non‐native’, i.e. those non‐native species that have established self‐sustaining populations in their new location(s) in the wild, and ( iii ) ‘invasive non‐native’ – populations of established non‐native species that have recently spread or are spreading rapidly in their invaded range actively or passively with or without human mediation. We also highlight the importance of conceptualising ‘spread’ for classifying invasiveness and ‘impact’ for management. Finally, we propose a protocol for classifying populations based on ( i ) dispersal mechanism, ( ii ) species origin, ( iii ) population status, and ( iv ) impact. Collectively and without introducing new terminology, the framework that we present aims to facilitate effective communication and collaboration in invasion science and management of non‐native species.

Soto, Ismael↗
DOE OSTI2021

Psychosocial drivers of land management behaviour: How threats, norms, and context influence deforestation intentions

Understanding how private landholders make deforestation decisions is of paramount importance for conservation. Behavioural frameworks from the social sciences have a lot to offer researchers and practitioners, yet these insights remain underutilised in describing what drives landholders' deforestation intentions under important political, social, and management contexts. Using survey data of private landholders in Queensland, Australia, we compare the ability of two popular behavioural models to predict future deforestation intentions, and propose a more integrated behavioural model of deforestation intentions. We found that the integrated model outperformed other models, revealing the importance of threat perceptions, attitudes, and social norms for predicting landholders' deforestation intentions. Social capital, policy uncertainty, and years of experience are important contextual moderators of these psychological factors. Here, we conclude with recommendations for promoting behaviour change in this deforestation hotspot and highlight how others can adopt similar approaches to illuminate more proximate drivers of environmental behaviours in other contexts.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Hyperspectral imaging for real-time waste materials characterization and recovery using endmember extraction and abundance detection

Hyperspectral imaging, combined with advanced spectral unmixing techniques and artificial intelligence, offers a powerful solution for improving material identification and classification. Here, this study evaluates the effectiveness of the pixel purity index and the sequential maximum angle convex cone algorithms in extracting and validating spectral signatures from pure samples of paper components (cellulose and lignin) and plastic (polypropylene). Principal-component analysis showed that both algorithms captured nearly all relevant variance for the tested materials. Spectral signatures were compared using the spectral angle mapper, revealing high similarity in the short-wave infrared region and greater variability in the visible near-infrared range. The methodology was then applied to a disposable coffee cup to detect and quantify mixed materials, accurately estimating material abundance and object area with less than 1% error. This approach enhances material classification, supporting product verification, quality control, and automated sorting for sustainable waste management and resource recovery.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Linking Stream Chemistry to Subsurface Redox Architecture

As drinking-water scarcity grows worldwide, we need to improve predictions of the quantity and quality of our water resources. An overarching problem for model improvement is that we do not know the geological structure of aquifers in sufficient detail. In this work, we demonstrate that mineral-water reactions imprint structure in the subsurface that impacts the flow and transport of some chemical species. Specifically, pyrite, a ubiquitous mineral, commonly oxidizes and depletes in the upper layers of the weathering profile in most humid watersheds, only remaining at depths of meters. We hypothesize that variations in concentrations (C) of pyrite-derived sulfate released into rivers as a function of discharge (q) reflect the rate-limiting step and depth of pyrite-oxidizing layers. We found that log C - log q behaviors thus differ in small and large watersheds in the Susquehanna River Basin as well as in selected watersheds in the Western United States. Although coal mining changes pyrite oxidation from closed to open system with respect to O 2 , patterns in stream chemistry as a function of discharge are consistent with deep and shallow pyrite oxidation zones in small and large watersheds respectively. Therefore, understanding the subsurface patterns of mineral reactions and how they affect the architecture of aquifers will elucidate patterns of changing river chemistry and our ability to manage water resources in the future under accelerated land use and climate change.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

A review of artificial intelligence applications in manufacturing operations

Abstract Artificial intelligence (AI) and machine learning (ML) can improve manufacturing efficiency, productivity, and sustainability. However, using AI in manufacturing also presents several challenges, including issues with data acquisition and management, human resources, infrastructure, as well as security risks, trust, and implementation challenges. For example, getting the data needed to train AI models can be difficult for rare events or costly for large datasets that need labeling. AI models can also pose security risks when integrated into industrial control systems. In addition, some industry players may be hesitant to use AI due to a lack of trust or understanding of how it works. Despite these challenges, AI has the potential to be extremely helpful in manufacturing, particularly in applications such as predictive maintenance, quality assurance, and process optimization. It is important to consider the specific needs and capabilities of each manufacturing scenario when deciding whether and how to use AI in manufacturing. This review identifies current developments, challenges, and future directions in AI/ML relevant to manufacturing, with the goal of improving understanding of AI/ML technologies available for solving manufacturing problems, providing decision‐support for prioritizing and selecting appropriate AI/ML technologies, and identifying areas where further research can yield transformational returns for the industry. Early experience suggests that AI/ML can have significant cost and efficiency benefits in manufacturing, especially when combined with the ability to capture enormous amounts of data from manufacturing systems.

Plathottam, Siby Jose↗
DOE OSTI2024

IRIS Reimagined: Advancements in Intelligent Runtime System for Task-Based Programming

Task-based programming models are gaining traction in scientific computing. IRIS is a portable runtime system that exploits multiple heterogeneous programming systems and can discover available resources and manage multiple diverse programming systems (e.g., CUDA, Hexagon, HIP, Level Zero, OpenCL, and OpenMP) simultaneously. It accounts for the constraints of task dependencies and provides customizable scheduling policies to map those tasks to heterogeneous devices. In this paper, we present new capabilities added to IRIS to improve its portability for heterogeneous programming, build-friendliness, and performance efficiency. The new additions include vendor-specific kernel support, a runtime system with a foreign function interface to eliminate writing wrapper or boilerplate code for heterogeneous kernels, an easy-to-use and configurable CMake-based build environment, automatic and efficient data transfers and orchestration, and the Hunter and DAGGER toolchains to evaluate IRIS’s task scheduling algorithms.

Miniskar, Narasinga Rao↗
DOE OSTI2022

Design and implementation of dynamic I/O control scheme for large scale distributed file systems

In this paper, we have analyzed the input/output (I/O) activities of Cori, which is a high-performance computing system at the National Energy Research Scientific Computing Center at Lawrence Berkeley National Laboratory. Our analysis results indicate that most users do not adjust storage configurations but rather use the default settings. In addition, owing to the interference from many applications running simultaneously, the performance varies based on the system status. To configure file systems autonomously in complex environments, we developed DCA-IO, a dynamic distributed file system configuration adjustment algorithm that utilizes the system log information to adjust storage configurations automatically. Our scheme aims to improve the application performance and avoid interference from other applications without user intervention. Moreover, DCA-IO uses the existing system logs and does not require code modifications, an additional library, or user intervention. To demonstrate the effectiveness of DCA-IO, we performed experiments using I/O kernels of real applications in both an isolated small-sized Lustre environment and Cori. Our experimental results shows that our scheme can improve the performance of HPC applications by up to 263% with the default Lustre configuration.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

3-D Geologic Controls of Hydrothermal Fluid Flow at Brady geothermal field, Nevada, USA

In many hydrothermal systems, fracture permeability along faults provides pathways for groundwater to transport heat from depth. Faulting generates a range of deformation styles that cross-cut heterogeneous geology, resulting in complex patterns of permeability, porosity, and hydraulic conductivity. Vertical connectivity (a throughgoing network of permeable areas that allows advection of heat from depth to the shallow subsurface) is rare and is confined to relatively small volumes that have highly variable spatial distribution. This local compartmentalization of connectivity represents a significant challenge to understanding hydrothermal circulation and for exploring, developing, and managing hydrothermal resources. Here, we present an evaluation of the geologic characteristics that control this compartmentalization in hydrothermal systems through 3-D analysis of the Brady geothermal field in western Nevada. A published 3-D geologic map of the Brady area is used as a basis to develop structural and geological variables that are hypothesized to control or effect permeability or connectivity. The 3-D distribution of these variables is compared to the distribution of productive and non-productive fluid flow intervals along production wells and non-productive wells via principal component analysis (PCA). This comparison elucidates which geologic and structural variables are most closely associated with productive fluid flow intervals. Results indicate that production intervals at Brady are located: (1) within or near to known and stress-loaded macro-scale faults, and (2) in areas of high fault and fracture density.

58 GEOSCIENCES↗
DOE OSTI2025

Process and environmental safety of thermochemical conversion of biomass

Biomass presents a promising opportunity for converting waste into valuable energy, fuels, and chemicals through various thermochemical processes, including hydrothermal carbonization, hydrothermal liquefaction, pyrolysis, gasification, and combustion. However, these processes operate under extreme conditions, introducing significant safety hazards that necessitate meticulous management to prevent accidents. This review discusses potential hazards, risk mitigation strategies, and safety management practices, emphasizing the importance of integrated safety measures into the design and operation of these processes. It also highlights the critical need for robust safety engineering and environmental management strategies tailored to each thermo-chemical process. As these processes transition from laboratory to industrial scale, there is an imperative to develop a clear and concise pathway for emerging industries to achieve regulatory compliance, achieve safety certification, and enable effective stewardship of potential fugitive emissions. By addressing safety and environmental concerns, stakeholders can optimize economic benefits, rural development, and achieve sustained domestic energy generation benefits offered by biomass conversion technologies. Further research on plant design optimization, operational safety, environmental evaluation standardization, and innovative waste management solutions will support the safe and effective scaling of these technologies, ultimately contributing to sustainable management and resource recovery.

09 - BIOMASS FUELS↗
DOE OSTI2026

Drying of the Himalayan Indus-Ganges-Brahmaputra Rivers: Understanding Causes and Management as a “One Water” Resource

Here, the Himalayan mega-rivers, the Indus, the Ganges (Ganga), and the Brahmaputra (Tsang Po), together known as the IGB, are three of the largest river systems (RS) in the world (Figure 1a). These transboundary rivers have acted as the lifeline of South Asia for the past several thousand years, and their fluvial plains have acted as the cradle of human civilization. At present, these plains sustain some of the densest and largest global populations (about 1 billion people, ∼15% of the global population) by providing water for agriculture, drinking water, industry, navigation, and hydropower.

Mukherjee, Abhijit [Indian Inst. of Technology (II↗