SEARCH · Engineering Papers

Results for “Decision Support System”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 415 records · Page 23

All sources NASA NTRS DOE OSTI

DOE OSTI2025

NREL Tools and Partnership Opportunities for Rural Electric Cooperatives in the United States

Rural electric cooperatives provide power to more than 42 million Americans, many of whom reside in rural and persistent poverty counties. As these co-ops invest in modernizing their energy infrastructure, they play a crucial role in ensuring affordable electricity, enhancing system resilience, and supporting economic development in their communities. To aid in this transition, NREL offers a suite of tools and partnership opportunities designed to help co-ops address evolving resource, affordability, and reliability needs. This factsheet covers already published content on select NREL tools and their most relevant applications for co-op decision-making and investment planning. Additionally, it features case studies demonstrating how rural co-ops can collaborate with NREL to advance both energy and economic development goals.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

DOE OSTI2026

Energy Storage and the Law of Averages: How Storage Can Make Electricity More Affordable

The electric grid is planned, built, and operated to satisfy peak demand. But because peak demand only occurs for a few hours per year, customers end up paying full price for grid infrastructure that is only used for a small fraction of the year—an increasingly expensive proposition as peak demand continues to grow and more infrastructure is required to meet it. The emergence of cost-competitive energy storage technologies in recent years, however, offers the potential for a grid that is planned, built, and operated based on average demand. By strategically siting and operating energy storage throughout the electric grid, excess generation in low-demand periods can be captured and stored near customers, which then reduces the amount of electricity that needs to be generated and moved through the transmission and distribution systems during high-demand periods. This paper describes these potential benefits, supported by real-world examples of energy storage projects that have created cost savings, which points to the potential for profound and far-reaching reductions in the cost of electricity if energy storage technologies are deployed at scale throughout the electric grid. These examples will be of use to system planners and operators, utility regulators, decision makers, and stakeholders in those processes as they look for opportunities to reduce the cost of electricity in their respective systems and jurisdictions.

25 ENERGY STORAGE↗

DOE OSTI2025

Probabilistic Deliverability Assessment of Distributed Energy Resources via Scenario-Based AC Optimal Power Flow

As electric grids decarbonize and distributed energy resources (DERs) become increasingly prevalent, interconnection assessments must evolve to reflect operational variability and control flexibility. This paper highlights key modeling limitations observed in practice and reviews approaches for modeling uncertainty. It then introduces a Probabilistic Deliverability Assessment (PDA) framework designed to complement and extend existing procedures. The framework integrates scenario-based AC optimal power flow (AC OPF), corrective dispatch, and optional multi-temporal constraints. Together, these form a structured methodology for quantifying DER utilization, deliverability, and reliability under uncertainty in load, generation, and topology. Outputs include interpretable metrics with confidence intervals that inform siting decisions and evaluate compliance with reliability thresholds across sampled operating conditions. A case study on Puerto Rico’s publicly available bulk power system model demonstrates the framework’s application using minimal input data, consistent with current interconnection practice. Across staged fossil generation retirements, the PDA identifies high-value DER sites and regions requiring additional reactive power support. Results are presented through mean dispatch signals, reliability metrics, and geospatial visualizations, demonstrating how the framework provides transparent, data-driven siting recommendations. The framework’s modular design supports incremental adoption within existing workflows, encouraging broader use of AC OPF in interconnection and planning contexts.

14 SOLAR ENERGY↗

DOE OSTI2024

A Tool to Incorporate Non-Energy Impacts in Energy Efficiency Investment Decision Making for Firms

Energy efficiency is a key demand-side strategy for sustainability, recently identified by the United States Department of Energy as a pillar of industrial decarbonization. The increased focus on decarbonization and the requirement for efficiency to enable electrification, another decarbonization pillar, due to the spark spread between natural gas and electricity prices, make energy efficiency increasingly relevant. Still, industries face challenges in adopting energy efficiency measures. Researchers have long found a gap in adoption of even those measures with a profitable net present value, attributed to lack of strategic value among other barriers (see for rigorous exploration and taxonomy). One solution to facilitate energy efficiency projects is the inclusion of non-energy impacts, as this has been shown to double potential deployment of such projects at system level. Energy efficiency can provide valuable benefits outside of simple operating cost reductions, from decreased pollution to enhanced productivity. The inclusion of these benefits in decision making assessments faces hurdles due to inconsistency of ancillary benefits across projects, difficulties in quantifying impacts and the need for additional measurement to quantify them. The decision-making tools to support this have been designed primarily for the European context. We begin with a stakeholder engagement process to better characterize the U.S. decision making process surrounding adoption of energy efficiency investments. Characterization of non-energy impacts has developed substantially over recent decades. Cagno et al. provided a framework for studying the applicability of these impacts to energy efficiency projects, listing 120 key performance indicators focused mainly on reductions of costs/harms. Other researchers have included impacts on the strategic and revenue side that can be merged into this framework as well. We seek a tractable set of impacts that can be included in a decision-making tool in the US, and as such are well suited to US industry, management and decision making processes. We also seek to understand how to best quantify or characterize these impacts. This work will demonstrate the results of a survey conducted among US manufacturing industry decision makers to assess the decision making landscape of stakeholders as well as the most relevant performance indicators for energy efficiency projects.

ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATION,↗

DOE OSTI2025

Development of a Digital Twin for Hydrogen Dispersion and Safety Assessment in an Electrolyzer Based Hydrogen Production Facility

Digital twin models are virtual representations of physical systems that use real-time data to simulate and optimize performance. This study presents the development and initial implementation of a digital twin (DT) for the electrolyzer-based hydrogen production facility at NREL's Advanced Research on Integrated Energy Systems (ARIES), focused on enhancing safety and optimizing sensor placement through physics-based simulations and metadata integration. The DT incorporates detailed facility-specific information, including component layout, leak locations, and controlled release parameters, to model hydrogen dispersion under varying environmental conditions. Using steady-state computational fluid dynamics (CFD) simulations informed by real meteorological data, such as wind speed, direction, and vertical wind profiles, the DT enables visualization of hydrogen plume behavior and spatial concentration distributions. Comparative analysis between high and low wind speed scenarios illustrates the significant influence of wind dynamics on plume shape and extent, with horizontal momentum dominating dispersion at higher speeds, while buoyancy effects become more prominent under low wind conditions. These simulations generate a rich dataset embedded within the DT, allowing users to assess potential leak outcomes and identify optimal sensor locations based on concentration thresholds. The model supports scenario-based analysis to guide safety strategies and equipment deployment for open-area hydrogen infrastructure. The digital twin thus serves as a dynamic platform for virtual prototyping, providing predictive insight into hydrogen behavior and enhancing risk-informed decision-making. This initial phase establishes a validated foundation for future integration of transient, uncontrolled leak scenarios and real-time sensor feedback, positioning the DT as a critical tool for safety design, operational planning, and adaptive monitoring in hydrogen systems. Overall, the approach demonstrates the value of combining environmental data with digital simulations to inform safer and more efficient deployment of hydrogen technologies.

08 HYDROGEN↗

DOE OSTI2026

Development of a Digital Twin for Hydrogen Dispersion and Safety Assessment in an Electrolyzer-Based Hydrogen Production Facility: Preprint

Digital twin models are virtual representations of physical systems that use real-time data to simulate and optimize performance. This study presents the development and initial implementation of a digital twin (DT) for the electrolyzer-based hydrogen production facility at the National Renewable Energy Laboratory (NREL)'s Advanced Research on Integrated Energy Systems (ARIES), focused on enhancing safety and optimizing sensor placement through physics-based simulations and metadata integration. The DT incorporates detailed facility-specific information, including component layout, leak locations, and controlled release parameters, to model hydrogen dispersion under varying environmental conditions. Using steady-state computational fluid dynamics (CFD) simulations informed by real meteorological data, such as wind speed, direction, and vertical wind profiles, the DT enables visualization of hydrogen plume behavior and spatial concentration distributions. Comparative analysis between high and low wind speed scenarios illustrates the significant influence of wind dynamics on plume shape and extent, with horizontal momentum dominating dispersion at higher speeds, while buoyancy effects become more prominent under low wind conditions. These simulations generate a rich dataset embedded within the DT, allowing users to assess potential leak outcomes and identify optimal sensor locations based on concentration thresholds. The model supports scenario-based analysis to guide safety strategies and equipment deployment for open-area hydrogen infrastructure. The digital twin thus serves as a dynamic platform for virtual prototyping, providing predictive insight into hydrogen behavior and enhancing risk-informed decision-making. This initial phase establishes a validated foundation for future integration of transient, uncontrolled leak scenarios and real-time sensor feedback, positioning the DT as a critical tool for safety design, operational planning, and adaptive monitoring in hydrogen systems. Overall, the approach demonstrates the value of combining environmental data with digital simulations to inform safer and more efficient deployment of hydrogen technologies.

08 HYDROGEN↗

DOE OSTI2025

REopt: Energy Decision Support [Slides]

The REopt presentation, developed for the Energy Technology Innovation Partnership Project, provides an overview of the REopt tool. It covers tool's capabilities, how to use the tool, resources, and applications.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

DOE OSTI2022

Scaling Sustainable Biochar Research & Commercialization for Agriculture & Conservation: A Summary from a Stakeholder Convening

Biochar is a carbon-rich substance with the potential to increase soil carbon sequestration, reduce greenhouse gas (GHG) emissions and improve soil health. When used as part of soil health management systems, biochar can provide multiple synergistic benefits for the agricultural sector and society, while also supporting the production of renewable, climate-neutral biofuels. Establishing a pyrolysis biochar bioenergy industry (PBBI) is necessary to harness the environmental benefits of biochar. To galvanize the necessary coordination to support a PBBI, the Foundation for Food & Agriculture Research (FFAR), the National Center for Appropriate Technology (NCAT), and American Farmland Trust (AFT) co-hosted a virtual convening event on biochar research and commercialization in March 2022. Participants represented a diverse set of stakeholders, including biochar producers, agricultural producers, and members of nonprofit, industry and government agencies. This whitepaper offers a summary of the convening, as well as insights from subsequent stakeholder engagement. Sustainably sourced, fit-for-purpose biochar can be a powerful tool in the soil health management systems and climate-smart toolbox, with decades of research supporting the soil, environment, production, and climate benefits. However, because biochar represents a range of feedstocks, processes and products, there is a critical need to: • Coordinate efforts to characterize and test the application of biochar types across locations with diverse soil and management conditions • Address research and decision-support gaps • Support the growing industry These objectives can be addressed or advanced through a coordinated strategy. To support establishment of this strategy, the convening participants identified key gaps in implementation and research. The experiences of foresters, ranchers, and farmers already using biochar, some of whom participated in the convening, helped inform priorities. Key gaps include: • Practical, applied on-farm research • Supporting management for agricultural productivity • Maximum benefits for conservation • Decision support • Life Cycle Assessment (LCA) • Quantification of climate mitigation potential Existing research gaps include: • Potential synergies among biochar, soil organic matter, and enhanced rock weathering • Development of new storage reservoirs for biochar in industrial products Convening participants further provided next steps for rapidly developing a PBBI to produce sustainable, fit-for-purpose biochars that increase soil health and mitigate climate change. Participants also stressed the need for actionable, coordinated, large-scale research relevant to commercial production in the next five years. To have a chance to reduce greenhouse gas emissions, we need an array of tools that would aid in mitigation; a coordinated strategy to enable biochar to be an effective tool in the climate-smart toolbox must be created; We cannot wait 50 years.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2026

Three-Dimensional Grid Visualization for Planning Activities: A Dubai Case Study

National Laboratory of the Rockies (NLR), in collaboration with the Dubai Electricity and Water Authority (DEWA) and Infra-X, has undertaken the Energy Visualization Analysis Project. The aim of this project is to enhance analytical and 3D visualization capabilities for distribution network planning and renewable energy integration. As modern grid continues to evolve with large-scale solar PV deployment and emerging distributed energy resources (DERs), the ability to effectively analyze, visualize, and communicate complex grid behaviors has become increasingly critical. The project focuses on developing empirical use cases based on real distribution feeder data and engineering workflows, ensuring the outcomes are directly aligned with operational environment. Through time-series power flow simulations and nodal hosting capacity analysis, the study quantifies the impacts of high PV penetration on voltage and thermal limits within representative 11 kV feeders. These analyses identify specific nodes and conditions where DER integration challenges arise. Furthermore, a Battery Energy Storage System (BESS) optimization algorithm was applied to determine the optimal size and placement of storage systems that can mitigate network constraints and enhance hosting capacity. The comparative results between base-case and BESS-augmented scenarios clearly demonstrate improvements in network stability and load management efficiency. In parallel, the NLR team developed an immersive 3D visualization framework, enabling interactive exploration of grid simulations using commodity head-mounted display (HMD) systems. This framework transforms conventional 2D simulation data into spatially intuitive visual environments - allowing engineers to analyze feeder conditions, PV hosting potential, and BESS effects in real time. This report represents the first foundational phase in establishing a visualization-driven analytical ecosystem. It provides a methodological foundation for data integration, visualization architecture, and simulation-based decision support, paving the way for large-scale adoption of immersive visualization across DEWA's Smart Grid Initiative, R&D activities, and future network resilience studies.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2022

European Strategy for Particle Physics -- Accelerator R&D Roadmap

The 2020 update of the European Strategy for Particle Physics emphasised the importance of an intensified and well-coordinated programme of accelerator R&D, supporting the design and delivery of future particle accelerators in a timely, affordable and sustainable way. This report sets out a roadmap for European accelerator R&D for the next five to ten years, covering five topical areas identified in the Strategy update. The R&D objectives include: improvement of the performance and cost-performance of magnet and radio-frequency acceleration systems; investigations of the potential of laser / plasma acceleration and energy-recovery linac techniques; and development of new concepts for muon beams and muon colliders. The goal of the roadmap is to document the collective view of the field on the next steps for the R&D programme, and to provide the evidence base to support subsequent decisions on prioritisation, resourcing and implementation.

43 PARTICLE ACCELERATORS↗

DOE OSTI2023

Modeling Future Demand for EV Charging Infrastructure [Slides]

U.S. climate goals for economy-wide net-zero greenhouse gas emissions by 2050 require rapid decarbonization of the light-duty vehicle fleet and plug-in electric vehicles (EVs) are poised to become the preferred technology for achieving this end. Considerable investments in public and private EV charging infrastructure will be needed to support widespread adoption, however, guidance is lacking on when, where, and what types of chargers will be needed. In this PLMA Load Management Dialogue session, researchers from the National Renewable Energy Laboratory (NREL) discuss findings from a recent quantitative assessment of the charging network requirements to support high penetrations of light-duty EVs by 2030. The study produced multiple detailed network growth trajectories at the national, state, and local levels that serve as a guidepost for future planning. In addition, an overview of NREL's publicly accessible EV infrastructure tools and data sets, designed to support planning and decision-making for EV infrastructure stakeholders, is provided.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

DOE OSTI2022

Extending the Brick schema to represent metadata of occupants

Here, energy-related behaviors of occupants constitute a key factor influencing building performance; accordingly, the measured occupant data can support the objective assessment of the indoor environment and energy performance of buildings, which can inform building design and operational decisions. Existing data schemas focus on metadata of sensors, meters, physical equipment, and IoT devices in buildings; however, they are limited in representing the metadata of occupant data, including occupants' presence in spaces, movement between spaces, interactions with building systems or IoT devices, and preference of indoor environmental needs. To address this gap, an extension to the widely adopted metadata schema, Brick, is proposed to represent the contextual, behavioral, and demographic information of occupants. The proposed extension includes four parts: (1) a new “Occupant” class to represent occupants' demography and energy related behavioral patterns, (2) new subclasses under the Equipment class to represent envelope system and personal thermal comfort devices, (3) new subclasses under the Point class to represent occupant sensing and status, and (4) new auxiliary properties for occupant interactable equipment to represent the level of controllability for each piece of equipment by occupants. The extension is implemented in the Brick schema and has been tested using multiple occupant datasets from the ASHRAE Global Occupant Database. The extension enables Brick schema to capture diverse types of occupant sensing data and their metadata for FAIR data research and applications.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2021

AGGREGATE: dAta-driven modelinG preservinG contRollable dEr for outaGe mAnagemenT and rEsiliency (Final Report)

The AGGREGATE project team successfully developed and validated various modules for outage management. Brief summaries of each module are provided to showcase their strength for outage management and restoration for a distribution system with a high penetration of connected distribution energy resources (DERs). In recent years, inverter-based DERs have been widely deployed in distribution system. A most of behind-the-meter (BTM) solar power generation is not visible to the utility. The data-driven DER and load estimation modules are using machine learning (ML) and artificial intelligence (AI) to manage this issue, which provides an opportunity for distribution system operators (DSOs) to operate systems and make decisions in real-time for a distribution system with a high penetration of DERs deployed. Also, the estimated DER and true load can be further leveraged in network aggregation and cold-load pick up estimation for reducing the computing complexity and providing for fast restoration. After load demand and DER power generations have been estimated, the information will support topology and state estimation (SE). The topology estimation module demonstrated the viability of mixed integer linear programming (MILP) formulation to estimate the most likely operational radial topology and outage sections using power flow measurements, historical/estimated load and DERs data and smart meter ping measurements. Formulation includes continuous (power flow, load and DERs data) and binary measurements (smart meter ping measurements) in a single formulation. Errors in continuous data and binary data are modeled as normal distribution and Bernoulli distribution, respectively. In the future distribution grid, the power injection from controllable DERs will be essential for efficient and resilient grid operation. However, determining the optimal DER injections and restoration actions is dependent on knowledge of the system states. State estimation (SE), already the cornerstone of transmission energy management systems, will become commonplace in distribution management systems as more measurements become available from deployment of automated metering infrastructure (AMI). Observability analysis is the first step in SE, as it determines the sufficiency of the available measurements for accurately estimating the current system states. A new type of pseudo-measurement called a Correlational Measurement (CM) is introduced in this module, to enhance the observability of the system to enable more accurate SE. CMs encapsulate knowledge of correlation between demand patterns for similar classes of loads as well as injection patterns for same-technology renewable DERs. During grid contingency scenarios, DERs have been traditionally disconnected, without any fault ride-through capabilities. However, with new regulations and better technology, it is feasible for these resources to contribute to the grid’s restoration after an adverse event and hence enhance resilience. The controllability module proposes a two-step restoration scheme for the power system restoration process by leveraging additional degrees of freedom in power electronics interfaced DERs for mitigating voltage problems. In a resilience mode without the utility system, the distribution grid relies on DERs to serve critical load. In such a severe event with multiple faults on the distribution feeders, actuation of various protective devices (PDs) divides the distribution system into electrical islands. The undetected actuated PDs due to fault current contributions from DERs can delay the restoration process, thereby reducing the system resilience. The Advanced Outage Management (AOM) and the Advanced Feeder Restoration (AFR) modules developed in this project provide improved system resilience with multiple DERs. AOM identifies the faulted sections and actuated PDs in a distribution system with DERs by incorporating smart meter data. The most credible outage scenario including fault locations, PD actuations, and fault indicator (FI) failures is identified by a set of binary integer linear programming incorporating hypotheses. The AFR module serves to restore a distribution system with available energy resources taking into consideration the availability of utility sources and DERs. By partitioning the system into islands, critical load will be served with the available generation resources within islands based on the solution of a MILP. When the utility systems become available, the optimal path will be determined by a spanning tree search algorithm that reconnects these islands back to substations and restores the remaining load. The transmission and distribution (T&D) co-simulation module was used to validate the effect of a control action performed on the distribution side assets as it propagates to the transmission side. This ensures that the control action performed results in a feasible operating point on both the transmission and the distribution system. In addition to validation, the team used the T&D co-simulation module to demonstrate how distribution system assets can be used to mitigate issues on the transmission system. Specifically, the team demonstrated that appropriate switching operations on the distribution side can alleviate the line overload condition on the transmission side without causing new operational constraint violations.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2021

The Role of Nuclear-Conventional Intermingling on State Decision-making and the Risk of Inadvertent Escalation

The questions answered by this report are: What are the implications of nuclear and conventional intermingling on crisis stability and the potential risk of miscalculation?, and Specifically, how might entanglement influence US and competitor decision making during crisis and conflict? In practice, there are three main forms of nuclear-conventional intermingling. First, intermingling between nuclear and non-nuclear weapon systems can occur via the fielding of dual capable delivery systems like missiles or aircraft. Second, intermingling can happen due to the co-location of nuclear and non-nuclear forces and their support structures—for example, the co-location of strategic bombers and general-purpose aircraft, or the co-location of strategic submarines and general-purpose vessels. Third, intermingling can occur via convolving nuclear and conventional military command and control systems, to include ballistic missile early warning and potentially space surveillance systems as well. All three forms of nuclear-conventional intermingling have significantly increased since the end of the Cold War, driven by both technological and doctrinal changes. However, there are important differences in the rationale behind, and also the risks associated with these three different forms of intermingling. The mere existence of dual capable systems is not new— deploying such systems can increase the effectiveness of forces, and it can also provide more flexibility. The major powers have both employed and threatened with dual capable systems for decades, and they have done so without nuclear escalation. Similarly, the major powers co-located nuclear and conventional systems in the Cold War, and they did so for variety of reasons that had nothing to do with complicating the adversary’s risk calculus. The Soviet Union, for example, decided to co-locate its nuclear and conventional forces for economic and administrative reasons. Although today it might be recognized as a useful deterrent tool, it was not their primary intention. Major powers want to convince rivals that the co-location of forces creates a high bar for targeting and raises the risk of nuclear escalation, but they also want to have the flexibility of this not being true in an actual crisis or conflict.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

DOE OSTI2023

Building the Case for Hybrid Energy Developments: Webinar Recording Day 2

INL, PNNL, and NREL, with support from our academic and industry partners, hosted a 2-day webinar to learn more about the benefits of hybrid energy systems, considerations for designing the right system for communities, and practical tools that can help with the design and development process. In Day 2 of this webinar, the focus was on tools that can be used to help inform design decisions for hybrid systems, including resource analysis, siting, resilience, valuation, and resource optimization. Day 2 also highlighted funding opportunities for hybrid systems.

14 SOLAR ENERGY↗

DOE OSTI2023

Building the Case for Hybrid Energy Developments: Webinar Recording Day 2

14 SOLAR ENERGY↗

DOE OSTI2020

Leveraging Environmental Monitoring Results from Department of Energy Sites for Research on the Food-Energy-Water Nexus

The Annual Site Environmental Report (ASER) from a U.S. Department of Energy (DOE) Site summarizes environmental data; environmental management performance; compliance with applicable DOE, federal, state, and local regulations; and restoration and surveillance monitoring programs. The Savannah River Site (SRS) produces ASERs that include results of monitoring mercury levels in fish samples obtained in the vicinity of SRS. Mercury is a toxic trace metal and the methylated organic form is a neurotoxin that bioaccumulates in the food web, endangering humans and other organisms. In United States, power plants are the largest source of mercury emissions. Research Objective: To determine the patterns of mercury levels in fish samples reported in the SRS environmental monitoring reports. We developed box plot visualizations to make sense of the data as well as identify fish species, dates and location with outlier mercury content. The integration and visual representation of multi-year datasets can support decision making processes on environmental compliance and environmental sustainability conducted at U.S. DOE Sites. We are constructing datasets from textual, image and multivariable data sources in the multi-year ASERs of the U.S. DOE Savannah River Site (SRS https://www.srs.gov/general/pubs/ERsum/index.html). The Fish Surveillance for mercury presents a case study for the intersection of food, energy and water systems. The dataset of 864 records (2008 and 2009) of mercury levels includes water location of fish, fish species, collection date and mercury content of fish sample. The patterns of mercury levels in the fish species as well as locations provide knowledge for further investigations. A research area for future studies is the composition of microbial communities in fish guts of varying levels of mercury.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2025

VA EDH Advanced Software Pipeline Framework Report: Enhancing Automation and Scalability

The VA Environmental Determinants of Health (EDH) Advanced Software Pipeline Framework is designed to enhance the efficiency, scalability, and security of geospatial data processing workflows. This framework integrates modern data orchestration and containerization technologies, including Prefect for workflow automation, Docker for containerization, and PostgreSQL/PostGIS for geospatial data storage and analysis. It ensures standardized, reproducible, and automated data processing, supporting VA objectives related to substance use risk assessment and recovery research. The pipeline addresses key scalability and performance challenges through horizontal and vertical scaling, high-performance computing (HPC) integration, parallel processing, task caching, and dynamic resource allocation. These optimizations improve throughput and reduce latency, allowing the system to efficiently manage large and complex datasets. Additionally, security and compliance measures—such as data encryption (SSL), Role-Based Access Control (RBAC), and adherence to GDPR and HIPAA standards—safeguard sensitive information throughout data transmission and storage. A key implementation of this framework includes the automation of shelter list geolocation workflows, ensuring that up-to-date data is readily available for VA decision-making. Lessons learned from this project include the transition from in-memory processing to incremental storage writes, improving resource management and reliability. Future enhancements aim to expand automation, integrate AI-driven anomaly detection, and incorporate high-performance computing resources. This framework provides a scalable, secure, and adaptable solution for managing geospatial datasets, reinforcing the VA’s ability to support clinical and strategic initiatives through data-driven decision-making.

97 MATHEMATICS AND COMPUTING↗