Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “silos”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

Integrated System Planning: Emerging Software Requirements in the Power Industry

Power system planning software remains fragmented across organizational boundaries, with specialized tools for capacity expansion, production cost modeling, power flow, and dynamic analysis operating on incompatible data models and assumptions. This article argues that the fragmentation is not merely a technical problem but a predictable consequence of Conway's law: software architectures mirror the departmental structures within which they are developed. Regulatory milestones like Federal Energy Regulatory Commission (FERC) Order 888 formalized these divisions, but the roots trace back to the distinct engineering disciplines-mechanical, chemical, and electrical-that staffed generation and transmission planning departments in vertically integrated utilities. As the industry moves toward integrated system planning (ISP) that coordinates generation, transmission, and distribution investment decisions, the software ecosystem must evolve accordingly. We identify five categories of software requirements to enable this transition: coherent data inputs decoupled from individual applications, unified and extensible data schemas, modular component representations that support multiple abstraction levels, lifecycle management of planning datasets, and well-defined application programming interface (API) contracts that separate data exchange from algorithmic control. We examine how these requirements interact with three common workflow patterns-serial gate clearing, sequential multiapplication, and convergence oriented-and discuss the interface design principles each demands. We then outline a vision for platform-based planning architectures where specialized analytical services compose through standardized interfaces and where artificial intelligence (AI)/machine learning (ML) tools augment decision support within a disciplined software infrastructure. The practices proposed here offer a path from today's siloed tool collections toward collaborative planning ecosystems capable of handling the complexity of modern power system transformation.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2026

Plan It Together: Optimizing Across Generation, Transmission, Distribution, and Distributed Energy Resources

Integrated planning holds the promise of unlocking lower total system cost solutions by connecting previously siloed planning processes. This article summarizes the state of bulk and local grid planning today and details multiple new analytical approaches that can enable more holistic planning methods to develop comprehensive solutions to generation, transmission, distribution, and distributed energy resource needs. These include both iterative approaches as well as cooptimization techniques. In addition to the benefits of these methods, the technical and institutional challenges and associated solutions are also discussed.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2024

Enabling DER visibility using a distributed dissemination network

The electrical grid is currently undergoing a series of rapid transformational changes that have resulted in the introduction of new actors and operational schemes that have fragmented the data and control planes. To help address the issue, this paper describes the implementation of a sensor-oriented, distributed data dissemination network that seeks to eliminate data silos. The implementation is based on the DGSS architecture previously described in [1]. The developed product seeks to facilitate the seamless integration of multi-operator, multi-origin, multi-domain sensor data by using a distributed systems approach. The proposed solution decouples the sensor’s data streams from the application-specific infrastructure and migrates them into a software-defined databus that can be configured to suit the end application’s demands. To further validate DGSS capabilities, a DER oriented use case has been developed.

Sensor Dissemination Networks, Enhanced DER visibi↗
DOE OSTI2025

FAIR Ecosystems for Science at Scale

High Performance Computing (HPC) centers provide resources to users who require greater scale to “get science done”. They deploy infrastructure with singular hardware architectures, cutting-edge software environments, and stricter security measures as compared with users’ own resources. As a result, users often create and configure digital artifacts in ways that are specialized for the unique infrastructure at a given HPC center. Each user of that center will face similar challenges as they develop specialized solutions to take full advantages of the center’s resources, potentially resulting in significant duplication of effort. Much duplicated effort could be avoided, however, if users of these centers found it easier to discover others’ solutions and artifacts as well as share their own. The FAIR principles address this problem by presenting guidelines focused around metadata practices to be implemented by vaguely defined “communities”; in practice, these tend to gather by domain (e.g. bioinformatics, geosciences, agriculture). Domain-based communities can unfortunately end up functioning as silos that tend both to inhibit sharing of solutions and best practices as well as to encourage fragile and unsustainable improvised solutions in the absence of best-practice guidance. We propose that these communities pursuing “science at scale” be nurtured both individually and collectively by HPC centers so that users can take advantage of shared challenges across disciplines and potentially across HPC centers. We describe an architecture based on the EOSC-Life FAIR Workflows Collaboratory, specialized for use with and inside HPC centers such as the Oak Ridge Leadership Computing Facility (OLCF), and we speculate on user incentives to encourage adoption. We note that a focus on FAIR workflow components rather than FAIR workflows is more likely to benefit the users of HPC centers.

Wilkinson, Sean [ORNL] (ORCID:0000000214437479)↗
DOE OSTI2025

CAFE AU LAIT: Compute-Aware Federated Augmented Low-Rank AI Training

Federated finetuning is crucial for unlocking the knowledge embedded in pretrained Large Language Models (LLMs) when data are geographically distributed across clients. Unlike finetuning with data from a single institution, federated finetuning allows collaboration across multiple institutions, enabling the utilization of diverse and decentralized datasets while preserving data privacy. Given the high computing costs of LLM training and the emphasis on energy efficiency in Federated Learning (FL), Low-Rank Adaptation (LoRA) has emerged as a widely adopted algorithm due to its significantly reduced number of trainable parameters. However, this assumes that all data silos have the necessary computing resources to compute local updates of LLMs. Nevertheless, in practice, the computing resources across clients are highly heterogeneous: while some may have access to hundreds of GPUs, others might have limited or no GPU access. Recently, federated finetuning using synthetic data has been proposed, allowing clients to participate in a collaborative training run without training LLMs locally. However, our experimental results reveal a performance gap between models trained using synthetic data and those trained using local updates. Motivated by the observed heterogeneity in computing resources and the performance gap, we propose a novel two-stage algorithm that leverages the storage and computing capabilities of a strong server. In the first stage, under the coordination of the strong server, clients with limited computing resources collaborate to generate synthetic data, which is transferred to and stored on the strong server. In the second stage, the strong server uses this synthetic data on behalf of the resource-constrained clients to perform federated LoRA finetuning alongside clients with sufficient computing resources. This approach ensures that all clients can participate in the finetuning process. Experimental results demonstrate that incorporating local updates from even a small fraction of clients improves performance compared to using synthetic data for all clients. Furthermore, we incorporate the Gaussian mechanism in both stages to guarantee client-level differential privacy.

Wang, Jiayi [ORNL]↗
DOE OSTI2026

HPC ODA Commons [SWR-26-003]

HPC ODA Commons is a community-driven platform for standardizing HPC operational data analytics. HPC sites generate enormous volumes of operational data - scheduler logs, accounting records, monitoring streams - but turning that data into actionable insight is needlessly hard. Each site builds bespoke parsers, schemas, and evaluation pipelines. Results can't be compared across institutions. Promising analytics ideas stay siloed because there's no shared language for describing the data, the experiments, or the outcomes. HPC ODA Commons fixes this by establishing community-governed contracts - versioned schemas, canonical artifacts, and benchmark recipes - that make ODA workflows discoverable, reproducible, and comparable. It pairs these standards with a practical, CLI-first toolkit that lets operators and researchers go from raw logs to standardized results without sending data off-cluster.

Menear, Kevin [National Laboratory of the Rockies ↗
DOE OSTI2024

Deploying a Publicly Available and Living National Oil and Gas Well Geodatabase: CO2-Locate: A Dynamic Database & Tool

Emission mitigation and safe geologic carbon storage require an understanding of local wellbore infrastructure, yet well data are siloed across many entities. Addressing this challenge, the National Energy Technology Laboratory published CO2-Locate, an integrated and dynamic national wellbore geodatabase. CO2-Locate offers up to date well data spanning more than 40 federal, state, and tribal entities, as well as spatially summarized insights designed to support commercial, regulatory, and research communities as they strive to curb climate change through a national energy transition.

Pfander, Isabelle↗
DOE OSTI2024

ICBM Transition Tool

The ICBM Transition Tool is an interactive, spreadsheet-based tool for exploring scenarios involving the planned transition of the Intercontinental Ballistic Missile (ICBM) force from the Minute Man III (MMIII) to the Sentinel missile, including the refurbishment of missile silos. The transition includes the fielding of the W87-1 warhead, retirement of the W78 warhead, and impacts to the availability of components for reuse.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗
DOE OSTI2025

Opportunities for Integrating Electric and Gas Planning

Growing demand for electricity in buildings is creating new opportunities and challenges for electric and natural gas planning. To date, electric and gas planning processes have largely been siloed, and only a few jurisdictions have started to examine how these two processes could be linked together. The report explores the current state of electric and gas system planning, and the benefits and challenges of integrating these planning processes. We frame the characteristics of an integrated electric and gas distribution planning process and identify indicators of progress toward the characteristics.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2025

InterGraph-CPS: A Graph-Theoretic Approach to Characterize Cross-Domain Cyber-Physical Interdependencies and Uncertainties in Electric Grid Systems for Improved Decision-Making in Operation and Response

Critical infrastructure systems such as the electric grid are increasingly cyber-physical; yet, despite the cyber-physical characteristics of critical infrastructure systems, the physical process system and communication/control network system are traditionally analyzed in siloes. As these systems become more cyber-physical, it is crucial that models and methods are available to assess the cyber physical system (CPS) interdependencies, characteristics, and event propagation for improved planning, operation, and response. Thus, we proposed an integrated structural and temporal CPS interdependency analysis framework, InterGraph-CPS, that provides insight into the CPS function during normal operation as well as disturbances. This integrated structural and temporal interdependency framework is uniquely designed for assessing CPSs by account for the challenges of analyzing cyber and physical data streams together due to data availability, data type, and time scale differences. By leveraging both structural (e.g., graph analysis) and temporal (e.g., data analytics) techniques, different CPS behaviors and configurations can be accounted for.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2024

Enhancing Biopreparedness through a Model System to Understand the Molecular Mechanisms that Lead to Pathogenesis and Disease Transmission: NW-BRaVE

The science of biopreparedness to counter biological threats hinges on understanding the fundamental principles and molecular mechanisms that lead to pathogenesis and disease transmission. Our vision to address this challenge is to create a powerful and user-friendly platform to elucidate the fundamental principles of how molecular interactions drive pathogen-host relationships and host shifts. We will enable groundbreaking discoveries by integrating a wide range of structural, genomics, proteomics, and other advanced omics measurements, along with evolutionary and artificial intelligence predictions. To make sure the system is applicable to real-world problems, we will develop it in the context of a tractable model system, the small, abundant, and accessible photosynthetic cyanobacteria and their constantly co-adapting viral pathogens, cyanophages. This model will maintain the system’s applicability to real-world problems and techniques, but the overall focus will be on elucidating general principles of detecting, assessing, and surveilling molecular interaction, adaptation, and coevolution that are system agnostic and therefore extensible to other viral-host interactions. Our overall objectives are to (1) identify the molecular complexes that comprise the cyanobacteria redox macromolecular subsystem and how they dynamically change with bacteriophage infection in situ, using cryo-electron tomography; (2) profile regulatory changes during infection using proteomics, multiomics, and experimental validation, and integrate the data with in situ structures; (3) use genomics and metagenomics to determine environmental and population factors across time scales that impact the interactions between marine cyanobacteria and their cyanophage parasites, predicting the evolutionary origins of in situ structural and functional interactions, convergence and coevolution; and (4) develop a data integration and transformation platform that facilitates the integration of in situ, proteomic, and evolutionary measurements of molecular interactions to surveil diverse hosts and parasites in various environmental contexts. These objectives address Focus Area 2 Reveal Molecular Interactions Across Biological Scales for Design of Targeted Interventions. Our powerful and user-friendly platform will enhance connections between the often-siloed fields of structure, molecular phenotype, and evolutionary genomics that are key to biopreparedness, but in need of integration (Figure 1). We will build an integrated navigation tool to facilitate the effective use of globally distributed experimental data for integrated analysis and predictive modeling. The project will develop, implement, and test a platform to assess host-pathogen molecular interactions, adaptation to hosts and host shifts, and coevolution between hosts and pathogens, successfully impacting the research community by revolutionizing abilities to study any host-pathogen interaction, encourage diverse community contributions, and gain fundamental insights into how proteins adapt to new contexts. This ability will be critical for designing early interventions to address future threats. We will build surveillance training capability, aiming for a fair and equitable response to future pandemics and biothreats.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2026

Numerical Modeling & Size Optimization of Thermal Energy Storage for Iron & Steel Production

Iron and steel production are responsible for 90 million MtCO2 per year in the United States. Hydrogen direct reduction of iron (H2DRI) is a promising pathway for a more sustainable iron production than commercially deployed technologies which rely on natural gas. The H2DRI process requires hydrogen at a temperature of up to 950 degrees C fed into a reduction furnace to produce pellets or briquettes that are used in the downstream iron and steelmaking process. In this work, we propose to use an electrical thermal energy storage (ETES) system, that can use renewable electricity to store high-temperature heat and dispatch it upon demand. Such a system can buffer the H2DRI plant from the variability of electricity prices by charging during curtailment and running the plant from storage during times of peak electricity price. We have developed heat transfer models for two different ETES systems that can be used to heat up hydrogen to the required temperatures: a particle-based ETES and a firebrick ETES. These models are used to evaluate the performance of such a system and support the sizing and preliminary cost estimation. The preliminary results using both models show that designing ETES systems for an industrial-scale H2DRI furnace is feasible. The firebrick ETES system has limited operational duration, which might limit the price buffering effect unless significantly oversized. The particle ETES system heat exchanger has industry-feasible dimensions, but its storage capacity would be decided upon the number of particle storage silos.

25 ENERGY STORAGE↗
DOE OSTI2026

New Norms or Old Habits: Evaluating Interlinked Trajectories of Online Shopping and Work Commute Post-Pandemic

The COVID-19 pandemic has significantly shifted travel behaviors, with major changes observed in online shopping and travel to work. Despite considerable research into pandemic-induced changes in travel behavior, it remains uncertain whether these new patterns have persisted or reverted to pre-pandemic norms. This study addresses this uncertainty by evaluating whether shifts in online shopping and work travel during the pandemic have become permanently ingrained in individuals' daily routine. Leveraging data from the 2022 National Household Travel Survey, a bivariate ordered probit model is employed to analyze changes in online shopping and work travel - whether they have increased, decreased, or remained stable compared to pre-pandemic levels across different population segments. The analysis finds that the pandemic did not significantly alter online shopping for home delivery and travel to work for the majority of society. However, a substantial portion of respondents reported increased online shopping for home delivery and reduced travel to work compared to pre-pandemic levels, with online shopping trends appearing more permanent. Segment-wise analysis and model results indicate heterogeneity in behavioral shifts with females engaging more in online shopping, while zero-vehicle households are traveling less to work, compared to pre-pandemic levels. Additionally, increase in online shopping frequency is significantly and negatively correlated with decrease in traveling to work. These findings highlight the need for improved digital infrastructure, flexible work policies, and integrated transportation solutions tailored to evolving demographic and socioeconomic needs in the post-pandemic era. Additionally, the study calls for integrating passenger and freight movement in a single framework rather than treating them in silos.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2026

Integrating Resilience Planning in Distribution System Planning

Electric utilities, regulators, and stakeholders face increasing risks of severe storms, freezes, floods, and heat waves damaging grid infrastructure and causing power outages—and increasing risks of utility equipment igniting wildfires. At the same time, customer electricity rates have risen substantially in recent years, due in part to replacing aging infrastructure and improving resilience to natural hazards and physical threats. To address these challenges, utilities are beginning to move beyond traditional, siloed planning processes to balance resilience with other fundamental grid objectives such as affordability, reliability, safety, and serving new loads. This study presents a framework for states and utilities that want to advance integration of resilience and distribution planning processes to improve planning efficiency, better prioritize cost-effective grid expenditures, and balance planning objectives. The framework includes 7 key integration points between these planning processes: -Strategy process -Data -Threat assessments -Solution identification and prioritization -Optimization opportunities -Consideration of other grid needs -Metrics Lawrence Berkeley National Laboratory reviewed utility distribution system plans and interviewed subject matter experts to identify emerging practices for each of the 7 integration points. This report presents these practices, which can be used as a guide toward more holistic planning and cohesive investment strategies. It also includes 3 case studies to provide practical examples of how utilities apply such integrated planning processes: two pole hardening programs and one microgrid planning effort. The report concludes by identifying opportunities for future research.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2026

Toward Trustworthy Autonomous Science: A Two-Year Community Roadmap

One year ago, the AISLE roadmap argued that autonomous laboratories operated as isolated islands and proposed a grassroots network organized around five critical dimensions. The field has since moved faster than that roadmap anticipated: multi-agent systems have produced experimentally validated hypotheses, self-driving laboratories have grown more interoperable and orchestrated, reasoning-trained and domain foundation models have raised the capability ceiling, and the Genesis Mission has placed autonomous experimentation at the center of U.S. federal science strategy, with industry emerging as a primary actor. Progress has met a sobering counter-current, including a corrected flagship discovery result, benchmarks showing that agents which rival experts on closed-ended questions still complete only a fraction of open-ended research, and fabricated citations surfacing at leading venues. We read this as the defining tension of the field: producing a candidate discovery is no longer the hard part, but verifying it is, and this asymmetry now limits autonomous science more than raw model capability. Accordingly, we update the roadmap around seven dimensions, revisiting the original five and elevating two former cross-cutting concerns, trust, verification, and reproducibility, and safety, security, and governance, to first-class status. We assess the original milestones (M1 through M14) as achieved, partially achieved, reframed, or open, add four new milestones (M15 through M18) for the elevated dimensions, and scope the path forward to a two-year horizon, with the first year concentrating on interfaces, protocol adoption, and the scaffolding of verification, and the second targeting federation, zero-trust coordination, and governance. Throughout, we position the grassroots network as the interoperability fabric that lets national programs, international initiatives, and commercial platforms connect rather than re-silo.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2026

Coordinated Natural Gas and Electric Planning: Case Studies of Current Approaches and Practices

This paper examines how natural gas and electric utilities across eight U.S. states and two Canadian provinces are beginning to coordinate historically separate planning processes in response to growing system interdependencies, policy mandates, aging infrastructure, and changing customer energy choices. Electricity planning has long relied on robust integrated resource planning frameworks that weigh numerous objectives, risks, and costs. Natural gas planning, on the other hand, is typically less transparent and more narrowly focused on safety and system integrity. As economic, reliability, and policy drivers place new and shared demands on both systems, jurisdictions and utilities are experimenting with approaches such as coordinated forecasting, non pipeline alternatives, and combined planning pilots. A few have issued regulatory or statutory directives for greater data sharing and methodological alignment. Case studies from British Columbia, California, Colorado, Illinois, Massachusetts, Minnesota, New York, Québec, Rhode Island, and Washington illustrate a wide range of approaches to rethinking siloed planning. The paper identifies several common themes across the jurisdictions examined. It provides observations on the methods, processes, and organizational steps that may be needed in the future to address the challenges being faced by states and utilities. Lastly, it identifies some initial steps that states and utilities can consider if they would like to pursue more integrated, cost-effective, policy-aligned energy system planning.

03 NATURAL GAS↗
DOE OSTI2026

Knowledge Graph for End-to-End Traceability of an Integrated Human-Earth System Model

Integrated human-Earth system models inform energy-water-land system dynamics and policies, yet their results are difficult to trace through input-data, model structure, scenario configurations, and solved outputs. Because this information is siloed across disconnected artifacts, process-based IAMs have historically lacked a unified, queryable representation. Such lack of traceability prevents researchers from systematically isolating the multi-sector drivers of complex outcomes (such as tracing water-scarcity results back to distant energy-system dynamics) or conducting holistic uncertainty attribution across hundreds of interacting parameters. To address this concern, our work documents the software engineering process of a knowledge graph that unifies these four layers for the Global Change Analysis Model (GCAM-USA_Reference scenario, GCAM v9.1). The graph was built as a relational property graph in DuckDB from the run’s own artifacts: the input-preparation dependency map (gcamdata chunk map), the model’s XML input files, the run configuration, and the results database (BaseX), successfully mapping the model’s declared structure. The resulting graph comprises 204,321 nodes and 1,687,814 edges across 16 node types and 15 edge types, with approximately 16.3 million time-series values stored separately to maintain structural efficiency. To ensure representation fidelity, every edge carries an epistemic-status annotation recording the warrant for the relationship (structural, provenance, dependency, or model-derived), and a machine-readable provenance ledger classifying the origin of every schema element. Evaluation against a fixed five-benchmark suite with locked baselines reports zero structural orphans, zero dangling edge endpoints, and 100% of output-producing technologies traceable to raw input files. Two interactive interfaces present the graph, including a serverless browser application built on DuckDB-Wasm. By establishing the first end-to-end provenance framework for an IAM, this work enables researchers and scientists to systematically audit complex policy scenarios, debug model structures, and trace policy-relevant outputs to their data origins in real time.

Artifical Intelligence↗
DOE OSTI2025

A Dual-Mode Hybrid System Combining Solar Thermal With Pumped Thermal Energy Storage

A hybrid system that delivers renewable electricity generation and electricity storage capabilities is introduced. This dual-mode hybrid system is based on Pumped Thermal Energy Storage (PTES) which uses a heat pump to convert electricity into thermal energy that is trans-ferred to silica particles which are stored in concrete silos. The stored heat is later converted back to electricity in a heat engine. The heat pump and heat engine use a closed Joule-Brayton cycle and fluidized bed heat exchangers. If the PTES system is co-located with an array of concentrating solar mirrors and a particle receiver, then the silica particles may also be heated up by the concentrating solar power (CSP) system. The PTES heat engine may also be used to convert the stored solar heat into electricity, thereby sharing this system between the PTES and CSP systems and reducing costs. However, this requires careful management of the heat engine off-design parameters. A thermodynamic model is used to evaluate the performance of the dual mode PTES-CSP hybrid system. The model accounts for turbomachinery effi-ciency, and approach temperature and pressure loss in heat exchangers, as well as other sources of inefficiency, such as motor-generator losses, and air fan power. The hybrid system also requires the evaluation of the turbomachinery efficiency and pressure ratio at off-design conditions since the CSP system operates over different temperature ratios than the Carnot Battery. Several design variables and design modifications are investigated, such as pressure ratios and maximum temperatures.

14 SOLAR ENERGY↗