Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “resource modeling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 325 records · Page 18

“Understanding Robustness Lottery”: A Geometric Visual Comparative Analysis of Neural Network Pruning Approaches

Deep learning approaches have provided state-of-the-art performance in many applications by relying on large and overparameterized neural networks. However, such networks are very brittle and are difficult to deploy on resource-limited platforms. Model pruning, i.e., reducing the size of the network, is a widely adopted strategy that can lead to a more robust and compact model. Many heuristics exist for model pruning, but our understanding of the pruning process remains limited due to the black-box nature of a neural network model. Empirical studies show that some heuristics improve performance whereas others can make models more brittle. Here, this work aims to shed light on how different pruning methods alter the network’s internal feature representation and the corresponding impact on model performance. To facilitate a comprehensive comparison and characterization of the high-dimensional model feature space, we introduce a visual geometric analysis of feature representations. We evaluated a set of critical geometric concepts decomposed from the commonly adopted classification loss and used them to design a visualization system to compare and highlight the impact of pruning on model performance and feature representation. The proposed tool provides an environment for an in-depth comparison of pruning methods and a comprehensive understanding of how the model responds to common data corruption. By leveraging the proposed visualization, machine learning researchers can reveal the similarities between pruning methods and redundancy in robustness evaluation benchmarks, obtain geometric insights about the differences between pruned models that achieve superior robustness performance, and identify samples that are robust or fragile to model pruning and common data corruption.

Li, Zhimin [Univ. of Utah, Salt Lake City, UT (Uni↗

wa-hls4ml-paper

Code for plots, models, data generation and other utilities relating to the paper "wa-hls4ml: A Benchmark and Surrogate Models for hls4ml Resource and Latency Estimation" https://arxiv.org/abs/2511.05615 [FERMILAB-PUB-25-0359-CSAID]

Hawks, Ben [Fermi National Accelerator Laboratory ↗

The role of chromatin state in intron retention: A case study in leveraging large scale deep learning models

Complex deep learning models trained on very large datasets have become key enabling tools for current research in natural language processing and computer vision. By providing pre-trained models that can be fine-tuned for specific applications, they enable researchers to create accurate models with minimal effort and computational resources. Large scale genomics deep learning models come in two flavors: the first are large language models of DNA sequences trained in a self-supervised fashion, similar to the corresponding natural language models; the second are supervised learning models that leverage large scale genomics datasets from ENCODE and other sources. We argue that these models are the equivalent of foundation models in natural language processing in their utility, as they encode within them chromatin state in its different aspects, providing useful representations that allow quick deployment of accurate models of gene regulation. We demonstrate this premise by leveraging the recently created Sei model to develop simple, interpretable models of intron retention, and demonstrate their advantage over models based on the DNA language model DNABERT-2. Our work also demonstrates the impact of chromatin state on the regulation of intron retention. Using representations learned by Sei, our model is able to discover the involvement of transcription factors and chromatin marks in regulating intron retention, providing better accuracy than a recently published custom model developed for this purpose.

Biochemistry & Molecular Biology↗

Community-Centric Microgrid Feasibility Analysis Framework to Accelerate Resilience of Island Communities

Marine energy offers a reliable energy solution for island and coastal communities, which often lack traditional local generation, to support their transition to energy independence and reduce reliance on externally imported fuels. Successful deployment of new technologies in these isolated locations requires community acceptance and approval from the outset, as these communities typically lack the financial and technical resources to operate and maintain new systems. This report presents a community-centric microgrid planning framework for remote coastal and island communities. Community engagement is integrated as the first step in the planning process, incorporating community profiles and visions into energy development scenarios. A case study was conducted in St. George, Pribilof Islands, Alaska, which relies entirely on diesel yet has significant wind and wave energy potential. Community engagement revealed a unique history and current economic status, with an interest in adopting advanced energy technologies despite past failures. Various microgrid configurations were optimized, considering different technologies to meet current and future energy needs while balancing cost and energy resilience. Wave energy converters (WECs) were a key component, integrated with other energy sources using the Xendee optimization tool. The Marine Energy Microgrid Toolkit, developed as part of this work, uses commercial power system analysis tools to optimize and analyze microgrid scenarios. The developed framework and toolkit can be applied to island and coastal communities to enhance resilience and support microgrid deployments. Future enhancements will include incorporating new marine resources, developing dynamic models, and automating the integration of Xendee and PowerFactory simulations.

02 PETROLEUM↗

Methods for Assessing Opportunities for Ring Dam Pumped Storage Hydropower

There is growing interest in new pumped storage hydropower (PSH) deployment to provide a range of grid flexibility, reliability, and resiliency services under an evolving and uncertain future power sector. The National Laboratory of the Rockies develops open PSH resource assessment and cost modeling tools to help evaluate PSH deployment opportunities, and this report describes expansions to those tools to consider an additional PSH system configuration - ring-dam reservoirs built on flat topographical features that are constructed from roller-compacted concrete material. This reservoir type is common among current PSH proposals and requires new methods to identify sites with this reservoir geometry throughout the United States and characterize the associated dam cost. Cost characterization for ring dam reservoirs required collecting historical dam cost data for earthen, rockfill, and roller-compacted concrete dams and regressing equations that relate costs between alternative materials. The ring dam site identification algorithm follows a 5-step procedure to identify circular geometry reservoirs. Once ring dam reservoirs are identified, they are then paired with potential dry-gully reservoirs, and the full set of potential paired reservoirs is cost-optimized to produce a least-cost set of potential PSH sites with no overlapping reservoirs. The resulting analysis found 1,663 ring-dam to dry-gully systems in the contiguous United States that are lower cost than any overlapping dry-gully to dry-gully systems, 29 in Alaska, and none in Hawaii or Puerto Rico. These systems constitute 1.5 TW of capacity in the contiguous United States and nearly 29 GW in Alaska, demonstrating that under suitable topography and head, ring-dam systems can provide cost-effective PSH opportunities. The greatest density of these opportunities are found in the intermountain west where there are mesas and flat land at bases of mountain ranges, but continued work could incorporate additional site characteristics or consider more complex reservoir shapes to find additional PSH deployment opportunities.

13 HYDRO ENERGY↗

MuSIKAL: Multiphysics Simulations and Knowledge Discovery through AI/ML Technologies

Under the MuSiKAL project, we developed a framework for a coastal digital twin (DT) platform capable of integrating diverse data resources, configuring multiscale model simulations, performing SciML‐accelerated predictions, with applications primarily driven by storm surge and heavily rainfall events impacting the Gulf Coast of the U.S.

54 ENVIRONMENTAL SCIENCES↗

Tools Assessing Performance

For the distributed wind industry, it can be challenging to accurately predict the performance and annual energy production of projects prior to their installation. The U.S. Department of Energy’s Tools Assessing Performance (TAP) project aims to improve wind resource characterization, thereby reducing the uncertainty of project performance and financing costs, increasing consumer confidence, and lowering the levelized cost of distributed wind energy. A collaborative effort among DOE National Laboratories, TAP will create a computational framework that provides the distributed wind community with access to newly developed wind resource data and modeling capabilities. These capabilities will allow users to perform timely and accurate performance assessments for distributed wind projects at locations across the United States.

wind, distributed, tools, performance↗

Transforming ENERGY through Computational Excellence

Computational methods underpin advancing the science and engineering of energy efficiency, sustainable transportation, renewable power technologies, and developing a knowledge base to optimize energy systems. Researchers with access to enough computing, and the right type, can focus their ingenuity and creativity on addressing the energy challenges. NREL’s advanced computing influence spans several common themes across the Office of Energy Efficiency and Renewable Energy (EERE), including materials discovery, process modeling, fluid dynamics, resource mapping, and analysis of large-scale systems with real-time optimization.

advanced computing↗

A Novel Multi-Agent Deep Reinforcement Learning-enabled Distributed Power Allocation Scheme for mmWave Cellular Networks

We consider the power allocation problem over shared spectrum for millimeter-Wave (mmWave) cellular downlink. Existing approaches usually find sub-optimal solutions by solving a non-convex optimization which leads to scalability issues due to centralized control. Therefore, distributed and adaptive approaches are desirable. Recently, model-free Deep Reinforcement Learning (DRL) has achieved success in such wireless resource management tasks. By modeling the radio environment as a Markov Decision Process (MDP) with the base stations (BSs) being the agents, power allocation can be automated at the agent level with comparable throughput performance to conventional centralized schemes. The multi-agent setting presents new challenges as the radio environment is impacted by the joint actions of the agents and is no longer stationary from any individual agent’s perspective. Existing literature bypasses this non-stationarity violation by ignoring it which may cause performance degradation. To tackle this issue, we propose a distributed continuous power allocation scheme based on a modified version of multi-agent Deep Deterministic Policy Gradient (MADDPG) that is tailored for the distributed multiple-agent setting. The proposed scheme employs a centralized-training distributed-execution framework where Q-functions are trained over subsets of BSs while each BS determines its transmit power based only on its own local observation. It admits constant per-BS communication and computation complexity and is thus scalable to large networks. Numerical evaluation shows that the proposed scheme adapts well to a wide range of interference conditions and can achieve comparable or better performance than several state-of-the-art non-learning approaches.

99 GENERAL AND MISCELLANEOUS↗

Spatially Aware Linear Transformer (SAL-T) for Particle Jet Tagging

Transformers are very effective in capturing both global and local correlations within high-energy particle collisions, but they present deployment challenges in high-data-throughput environments, such as the CERN LHC. The quadratic complexity of transformer models demands substantial resources and increases latency during inference. In order to address these issues, we introduce the Spatially Aware Linear Transformer (SAL-T), a physics-inspired enhancement of the linformer architecture that maintains linear attention. Our method incorporates spatially aware partitioning of particles based on kinematic features, thereby computing attention between regions of physical significance. Additionally, we employ convolutional layers to capture local correlations, informed by insights from jet physics. In addition to outperforming the standard linformer in jet classification tasks, SAL-T also achieves classification results comparable to full-attention transformers, while using considerably fewer resources with lower latency during inference. Experiments on a generic point cloud classification dataset (ModelNet10) further confirm this trend. Our code is available at https://github.com/aaronw5/SAL-T4HEP.

Wang, Aaron [Illinois U., Chicago] (ORCID:00000003↗

A Distributed Trust Model Simulator for Energy Grid of Things Distributed Energy Resource Management System

The evolution of networks into more distributed, self-reliant nodes has mitigated single-point failures that plagued traditional centralized networks. Applied to power grids, distributed systems can increase the integrity and availability of grid services while also offering a power management solution. However, while distributed networks provide scalability, security, and sustainability compared to centralized networks, their distributed nature makes them harder for anomaly detection and prevention. Incorporating a Distributed Trust Model (DTM) System into an Energy Grid of Things Distributed Energy Resource Management System (EGOT DERMS) allows grid participants to be characterized and their communication to be analyzed for possible attacks. A Trust Model simulator is needed to evaluate and improve the DTM System.Trustworthiness is calculated using a Trust Model. While many trust models exist, most only consider 2-3 matrices to evaluate trust. The TM proposed in this thesis uses a Metric Vector of Trust (MVoT) monitoring 17 parameters when assessing trust. Moreover, unlike standard trust models, the proposed trust model establishes a method to test the trust between various actors within the network and probe the trust model itself. Using a Trust Model Simulator, MVoT calaculations, initial values, and parameters are fine-tuned to achieve high-confidence message classifications and minimize false positives. The DTM System and Trust Mode Simulation Suite allow for distributed trust evaluation with a real-time classification of EGOT DERMS actors, providing additional security for distributed systems.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Methodology to Implement a Microgrid in a University Campus

This paper presents the method we followed to design a microgrid at a university campus based on available resources. Due to introduction of renewable resources to produce energy, a methodology that allows design a microgrid in a university campus is very useful. Hence, we present a series of steps that must be carried out to estimate the resource to be used, the installation, area needed, and the capacity of the systems needed are also described. In addition, the models of the distributed resources that constitutes the microgrid are presented and explained. To validate the proposed methodology, simulations were performed using Opal-RT-LAb. As a test scenario we selected the Mayagüez campus of the University of Puerto Rico where we conducted analysis of the available resource and capacity of the systems is needed to satisfy demand of critical loads, considering a predetermined number of days of austerity. Our study results in determination of dimensions, cost and effectiveness of the microgrid. Simulations results also show that the proposed microgrid satisfy demand with the same reliability, or better, than the traditional electrical network. Additionally, the best options for this purpose are photovoltaic, batteries, and combined heat and power, if the technological advances and availability of resources to the date for Puerto Rico are considered.

36 MATERIALS SCIENCE↗

Combining model-based and model-free methods for stochastic control of distributed energy resources

Modern distribution systems are experiencing a fast transformation with the growing penetration of distributed energy resources (DERs). Along with the economic and environmental benefits of DERs, challenges arise to address the uncertainties caused by their inherent volatility. If properly coordinated, however, DERs have the potential to provide the controllability that grid operators need. Here, we propose a hierarchical control framework that combines the model-based and model-free methods for stochastic DER control in distribution systems. The upper-level scheduler considers a chance-constrained optimal power flow problem (model-based) that schedules DER setpoints to minimize the operational cost and maintain the operating reserve. The lower-level distributed DER controllers absorb real-time disturbances and uncertainties using the extremum seeking control (model-free) to achieve grid objectives. The combination of model-based and model-free methods allows us to take the advantages of both methods to effectively manage the uncertainty in distribution systems. The proposed work is demonstrated on the IEEE 13-node feeder.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Duke Energy Carbon-Free Resource Integration Study: Capacity Expansion Findings and Production Cost Modeling Plan [Slides]

This presentation highlights initial results from the NREL's Low-Carbon Integration study for Duke Energy. Specifically the presentation focuses on preliminary findings from the ReEDS capacity expansion model for the Carolinas. In addition, the presentation also introduces initial plans for the production cost modeling stage of the work.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Investigating uncertainties in human adaptation and their impacts on water scarcity in the Colorado river Basin, United States

The Colorado River Basin (CRB) supports the water supply for seven states and forty million people in the Western United States (US) and has been suffering an extensive drought for more than two decades. As climate change continues to reshape water resources distribution in the CRB, its impact can differ in intensity and location, resulting in variations in human adaptation behaviors. The feedback from human systems in response to the environmental changes and the associated uncertainty is critical to water resources management, especially for water-stressed basins. This paper investigates how human adaptation affects water scarcity uncertainty in the CRB and highlights the uncertainties in human behavior modeling. Our focus is on agricultural water consumption, as approximately 80% of the water consumption in the CRB is used in agriculture. We adopted a coupled agent-based and water resources modeling approach for exploring human-water system dynamics, in which an agent is a human behavior model that simulates a farmer’s water consumption decisions. We examined uncertainties at the system, agent, and parameter levels through uncertainty, clustering, and sensitivity analyses. The uncertainty analysis results suggest that the CRB water system may experience 13 to 30 years of water shortage during the 2019–2060 simulation period, depending on the paths of farmers’ adaptation. The clustering analysis identified three decision-making classes: bold, prudent, and forward-looking, and quantified the probabilities of an agent belonging to each class. The sensitivity analysis results indicated agents whose decision-making models require further investigation and the parameters with the higher uncertainty reduction potentials. Here, by conducting numerical experiments with the coupled model, this paper presents quantitative and qualitative information about farmers’ adaptation, water scarcity uncertainties, and future research directions for improving human behavior modeling.

Agent-based modeling↗