Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “DATA BASE MANAGEMENT”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,099 records · Page 61
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

DYFLOW: A flexible framework for orchestrating scientific workflows on supercomputers

Modern scientific workflows are increasing in complexity with growth in computation power, incorporation of non-traditional computation methods, and advances in technologies enabling data streaming to support on-the-fly computation. These workflows have unpredictable runtime behaviors, and a fixed, predetermined resource assignment on supercomputers can be inefficient for overall performance and throughput. Inability to change resource assignments further limits the scientists to avail of science-driven opportunities or respond to failures.We introduce DYFLOW, a flexible framework that orchestrates scientific workflows on supercomputers based on user-designed policies. DYFLOW compartmentalizes orchestration stages into simplified constructs, and end-users can program and reuse them according to their workflow requirements through an easy-to-use interface. These constructs hide the intricacies involved in runtime management from end-users, for instance, procurement of information to understand the workflow state, assessment, and supervision of the runtime changes. DYFLOW is designed to work alongside existing workflow management systems and reuse the available (static) support for workflow management. We have integrated DYFLOW with an existing workflow management tool as a demonstration. With experiments performed on use cases from three types of scientific workflows and two different parallel architectures, we show that DYFLOW achieves the desired orchestration incurring a small cost to carry out the runtime changes.

Singhal, Swati↗
DOE OSTI2025

Towards automated and real-time multi-object detection of anguilliform fishes from sonar data using YOLOv8 deep learning algorithm

Eels (Anguilla spp.), including American eels (Anguilla rostrata), European eels (Anguilla anguilla), and Japanese eels (Anguilla japonica), are species of critical management and regulatory concern due to their vulnerability to various stressors during downstream migrations. Accurate and efficient detection of migrating eels can improve our understanding of fish behaviors and fish-hydraulic structure interactions, thereby facilitating the design, operation, and optimization of more effective downstream passage facilities from both biological and economic perspectives. However, a real-time, automated framework for detecting migrating eels in real-world applications is currently lacking. Leveraging imaging sonar as a reliable technology for fish passage monitoring, field data are acquired using imaging sonar and then converted to single sonar frames/images for subsequent analysis. In this study, a framework based on the You Only Look Once Version 8 (YOLOv8)-based convolutional neural network is proposed for multi-object detection of eels and non-eel fish using the sonar images after image subtraction and additional wavelet denoising. The results from both training and testing phases demonstrate that the framework's ability can successfully detect both eels and non-eel fish in preprocessed sonar images, achieving F1-scores and mAP@0.50 exceeding 0.84. Additionally, the incorporation of wavelet denoising during preprocessing slightly improve detection performance. Furthermore, the transferability of this framework from eel to lamprey detection is demonstrated to be feasible given the similar morphological characteristics of these two species. Overall, the proposed framework achieves accurate and efficient detection of migrating eels, providing reliable and real-time information that can help conserve vulnerable eel and eel-like populations.

Deep learning↗
DOE OSTI2024

Quantum/AI Topology-Aware Latency-Adaptive HPC Workflow Scheduling Optimization

The growing demand for more powerful high-performance computing (HPC) systems has led to a steady rise in energy consumption by supercomputing worldwide. This study is focused on comparing our Application-Topology Mapper (ATMapper) to the popular Simple Linux Utility for Resource Management (SLURM) for the purpose of exploring methods that can further optimize job-scheduling within HPC systems. ATMapper is an Artificial-Intelligence based approach to job-scheduling that is currently being enhanced with quantum annealing (QA) to generate optimal schedules faster. We are applying QA to speedup our ATMapper process to achieve higher computing efficiency, thereby reducing HPC energy consumption. Here, we examine how four job-scheduling approaches perform in processor node assignment when using an example network architecture of 4 interconnected nodes. Using a specialized script, we are assessing the schedule of a computation flow with 11 interdependent tasks. The data movements among nodes were tracked to count for the number of interactions (network hops) between nodes needed to complete the tasks. The total number of hops and the job completion time were then used to quantify the efficiency of the different mapping approaches. In addition to SLURM, we also compare our ATMapper to the QA-enabled LBNL TIGER and the D-Wave Distributed Computing processor assignment approaches. The preliminary results showed that our topology-aware, latency-adaptive ATMapper is significantly more efficient when compared to the other scheduling approaches due to its load-imbalance network allocation. The scheduler displayed a computing efficiency of 53% by performing significantly fewer network hops than its alternatives. By reducing the number of hops, ATMapper was able to perform all 11 tasks by using only 3 nodes out of given 4. This research indicates the potential to use QA/AI for HPC job-scheduling. Later, we will test a SLURM simulator program to draw further comparisons on the effectiveness of ATMapper's scheduling approach. The results of this comparison will serve as a baseline for later improving SLURM's performance using a QA-enhanced ATMapper approach.

Caraveo, Braulio [University of Huston - Clear Lak↗
DOE OSTI2021

Tailoring EVMS Tools for Projects under $50M

The Earned Value Management System (EVMS) Tailoring Guide for Projects Under $\$$50M is designed for U.S. Department of Energy (DOE) cost-reimbursed projects less than $50M where full EVMS is not required per DOE Order 413.3B but is applicable to all projects below a mandated compliant EVMS requirement. The guide provides an inventory of tools and rules typically used as part of a fully compliant EVMS. The ranking employed in this guide identifies key foundational tools, as well as identifying opportunities for tailoring based upon project size or risk. The goal is to provide guidance for companies to establish enterprise level tools that provide meaningful performance data as efficiently as possible.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2025

A Practical Comparison of Data-Driven Prognostics Methods for Energy Systems

This study explores data-driven prognostics for nuclear power plant (NPP) condensers, focusing on tube fouling. We utilized the Asherah nuclear power plant simulator (ANS) to compare four methods: Random Forest (RF), Support Vector Regressor (SVR), Fully Connected Neural Network (FCNN), and Long Short-Term Memory Neural Network (LSTM). By simulating various fouling scenarios in the ANS, we generated data with different degradation rates under transient operations. The models were trained and tested on these data, with performance evaluated visually and numerically including uncertainty assessment. The LSTM model excelled, exhibiting minimal prediction noise and the most accurate remaining useful life estimates across all degradation levels. Its ability to capture long-term dependencies and produce cleaner outputs makes it a strong candidate, although accurate training data across the entire component lifespan are crucial. The RF model emerged as a robust alternative, providing reliable predictions with high confidence. The FCNN and SVR models, while less effective overall, showed potential under specific conditions. FCNN offers a less complex alternative to LSTM and might benefit from larger datasets. SVR excels in precision when the quality of the training data is high. Furthermore, this study highlights the operational benefits of advanced prognostics in the energy sector and emphasizes the need for further research in NPP condenser health management through real-life experiments.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2024

Update on Activities Related to the Library of Graphite Microstructures

This report provides an overview and update of the ongoing efforts to create a comprehensive library of microstructures for nuclear graphite and carbon-based materials under consideration for nuclear applications. The library includes data on microstructural characterization of unirradiated graphite materials, a guide to the techniques used to analyze graphite (which complements the ASME guidelines and ASTM standards), a summary of characterization data for neutron-irradiated or oxidized material, and a compendium of microstructural information for carbon-based materials. These efforts are being conducted at various length scales for the filler and binder phases in graphite to better understand graphite’s local structure and property relationships. This report is a follow-up to the previous milestone report titled Report on initial development of a database of nuclear graphite characteristics based on microstructural characterization, ORNL/TM/-2023/2992, published in July 2023.The effort to develop the library of microstructures supports the US Department of Energy Office of Advanced Reactor Technologies program objectives of aiding the material selection, licensing, management, and core assessments of a graphite core by documenting the unirradiated microstructure of relevant grades or characterizing the microstructure’s evolution under the reactor environment. Additionally, this project aims to provide (1) information and guidelines for the characterizing of graphite and (2) a protocol to assess a nuclear graphite grade.

36 MATERIALS SCIENCE↗
DOE OSTI2025

An open-access simulated earthquake ground-motion database for an M7 Hayward Fault earthquake in the San Francisco Bay Region

Comprehensive understanding of earthquake ground motions, particularly in the near-fault region of large-magnitude events, is limited by gaps in strong-motion data. This challenge is prominent in areas with high seismic hazard but infrequent large earthquakes where data is sparse and difficult to interpret. These data limitations lead to uncertainties in the development of site-specific ground motions, which are crucial for engineering risk assessments. To address these challenges, physics-based regional-scale ground-motion simulations have been developed. With the emergence of exaflop-scale computing ecosystems, it is now possible to simulate regional earthquake processes at unprecedented fidelity and generate the large number of fault rupture realizations necessary to characterize both intra- and inter-event ground-motion variability. This article introduces a new database of simulated earthquake ground motions, created for applications in earthquake engineering, earthquake planning, and emergency response. The inaugural version of the database features simulated ground motions for a magnitude 7 Hayward Fault earthquake in the San Francisco Bay Region (SFBR), using the EarthQuake SIMulation (EQSIM) simulation framework and the Graves–Pitarka kinematic rupture model. The aim is to provide high-fidelity, spatially dense, three-component motions generated on the Department of Energy’s (DOE) newest generation of graphics processing unit (GPU)-accelerated supercomputers. These motions are being made openly available to the engineering, scientific, and disaster planning communities. In addition, this work develops protocols for the efficient dissemination of these large data sets and emphasizes community engagement to build confidence in their application. This article discusses the methodology behind the data, underlying software verification and validation, scalable data management, and a user interface for data access. The goal is to facilitate widespread use and elicit expert feedback to maximize the utility and exploitation of simulated motions. While the initial focus is on the San Francisco Region, simulations for additional regions will be added as the DOE program progresses.

Simulated ground-motion database↗
DOE OSTI2023

Neglecting Model Parametric Uncertainty Can Drastically Underestimate Flood Risks

Abstract Floods drive dynamic and deeply uncertain risks for people and infrastructures. Uncertainty characterization is a crucial step in improving the predictive understanding of multi‐sector dynamics and the design of risk‐management strategies. Current approaches to estimate flood hazards often sample only a relatively small subset of the known unknowns, for example, the uncertainties surrounding the model parameters. This approach neglects the impacts of key uncertainties on hazards and system dynamics. Here we mainstream a recently developed method for Bayesian inference to calibrate a computationally expensive distributed hydrologic model. We compare three different calibration approaches: (a) stepwise line search, (b) precalibration or screening, and (c) the Fast Model Calibrations (FaMoS) approach. FaMoS deploys a particle‐based approach that takes advantage of the massive parallelization afforded by modern high‐performance computing systems. We quantify how neglecting parametric uncertainty and data discrepancy can drastically underestimate extreme flood events and risks. Precalibration improves prediction skill score over a stepwise line search. The Bayesian calibration improves the uncertainty characterization of model parameters and flood risk projections.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Connecting Minds: AI Use Cases to Bridge Power Systems and Large Language Models for Practical Applications

Recent advances in artificial intelligence (AI) and development of large language models (LLMs) present the opportunity to develop a new generation of power systems applications. In contrast with early power system AI applications based on structured numerical data, LLMs offer unique capabilities to perform logical reasoning using text documents, unstructured data, and application programming interface (API) calls to computational software. This paper seeks to bridge the knowledge gap between power systems engineers and LLM developers through a crosscutting explanation of use cases, characteristics, requirements, practical considerations from the perspectives of both LLM capabilities and industry needs. Specific focus is given to applications that can be realistically deployed by electric utilities. After introducing the architecture of LLMs and unique challenges of the power systems domain, this paper proposes twenty representative LLM applications grouped into categories of 1) power system operations, 2) asset management, 3) system planning and analytics, and 4) energy management and protection systems. Five use cases are presented within each category with descriptions of the motivation, objectives, approaches, example inputs / outputs, and benefits of each use case.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2026

A Play-Based Exploration of CO 2 Storage in the Illinois Basin (Final Technical Report)

This report documents the results of "A Play-Based Exploration of CO₂ Storage in the Illinois Basin" (DE-FE0032366), a project funded by the U.S. Department of Energy Office of Fossil Energy and Carbon Management and conducted by the Illinois State Geological Survey (ISGS) at the University of Illinois Urbana-Champaign in partnership with Visage Energy. The project adapted play-based exploration (PBE), a systematic basin-scale evaluation methodology from the petroleum industry, to screen areas of Illinois for commercial geologic carbon storage (GCS) in Cambro-Ordovician strata. The traditional play concept was expanded to encompass three play element groups, subsurface geologic factors, surface features, and societal factors, yielding 24 play elements with defensible suitability criteria applied through a five-tier classification scheme. An integrated geospatial database was assembled from ISGS, MGSC, MRCI, NATCARB, and public data sources, supported by significant data-improvement work including correction of legacy well locations, digitization of more than 1,300 well construction records using the DOE CATALOG team's OGRRE tool, compilation of a statewide 2D seismic database, and production of a refined fault and fold geodatabase.

58 GEOSCIENCES↗
DOE OSTI2025

Predicting Initial Trans-Membrane Pressure for Optimized Operations in UF Unit Using Random Forest

With the growing scarcity of freshwater, innovative process design mechanisms like Ultra-filtration(UF) units are increasingly gaining attention among water treatment utilities to address the rising demand. Ensuring reliable water production necessitates efficient resource utilization, minimizing downtime in UF systems. Recent advancements in machine learning (ML) have enabled the development of accurate data-driven models for Model Predictive Control (MPC), often requiring minimal prior knowledge of underlying physical processes. In this study, we present predictive regression models based on Random Forest (RF) and Auto-Regressive (AR) approaches to forecast the initial Trans-Membrane Pressure (TMP) for each filtration cycle in data generated by Direct Potable Reuse (DPR) systems. The proposed RF-based model demonstrates superior performance compared to baseline methods, including historical mean, Last Observation Carried Forward (LOCF), and naïve AR models, across various forecasting horizons in terms of root mean square (RMSE) metric. Accurate prediction of initial TMP is critical for optimizing CCRO operations, as it enables the development of robust modelling frameworks that enhance process efficiency and reliability. The demonstrated efficacy of the RF-based approach highlights its potential as a tool for real-time decision-making in water treatment systems, paving the way for advanced process optimization and sustainable water resource management.

Mukherjee, Subrata [ORNL] (ORCID:0000000309930338)↗
DOE OSTI2022

Dynamic Material Flow Analysis of Silicon Photovoltaic Modules to Support a Circular Economy Transition

Solar photovoltaics (PV) are the fastest growing renewable energy technologies for clean, cheap, and sustainable electricity generation. To prepare for rapid scale-up, the PV industry needs to project material requirements to build out all aspects of the supply chain appropriately and plan to handle large volumes of module waste. Impacts of deploying different material circularity strategies to reduce waste and conserve primary resources need to be quantified to inform sustainable material management. Here, we introduce the photovoltaic dynamic material flow analysis (PV DMFA) model based on PV electricity generation. The model quantifies material flows and stocks in the cradle-to-cradle life cycles of utility-scale c-Si PV systems in the United States through 2100. We present case studies for solar flat glass and aluminum frame materials under various scenarios to project the impacts of PV performance, reliability, and processing parameters, material circularity strategies, and module design shifts. In the absence of circularity measures, ~100 million MT of flat glass and ~12 million MT of aluminum would be needed for PV installations by 2100 to meet projected growth in domestic utility PV demand to nearly 1000 TWh in 2100. With optimistic but feasible improvements in efficiency, reliability, and circularity, material intensity and waste could be reduced by nearly 50%. Efficient module collection, minimally intrusive recycling, and careful scrap handling and cleaning could improve material circularity in the PV value chain. This model serves as a sustainability data support tool that may aid in the circular economy transition for PV systems.

circular economy↗
DOE OSTI2020

Selective Sampling for Sensor Type Classification in Buildings

A key barrier to applying any smart technology to a building is the requirement of locating and connecting to the necessary resources among the thousands of sensing and control points, i.e., the metadata mapping problem. Existing solutions depend on exhaustive manual annotation of sensor metadata --- a laborious, costly, and hardly scalable process. To reduce the amount of manual effort required, this paper presents a multi-oracle selective sampling framework to leverage noisy labels from information sources with unknown reliability such as existing buildings, which we refer to as weak oracles, for metadata mapping. This framework involves an interactive process, where a small set of sensor instances are progressively selected and labeled for it to learn how to aggregate the noisy labels as well as to predict sensor types. Two key challenges arise in designing the framework, namely, weak oracle reliability estimation and instance selection for querying. To address the first challenge, we develop a clustering-based approach for weak oracle reliability estimation to capitalize on the observation that weak oracles perform differently in different groups of instances. For the second challenge, we propose a disagreement-based query selection strategy to combine the potential effect of a labeled instance on both reducing classifier uncertainty and improving the quality of label aggregation. We evaluate our solution on a large collection of real-world building sensor data from 5 buildings with more than 11,000 sensors of 18 different types. The experiment results validate the effectiveness of our solution, which outperforms a set of state-of-the-art baselines.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗
DOE OSTI2021

Product Consistency Test Results for the LAW Phase 5 Glasses

This report provides the results of the Vapor Hydration Test solutions and the Product Consistency Test leachates from the Low-Activity Waste Phase 5 glasses, a series of simulated nuclear waste glasses fabricated at the Pacific Northwest National Laboratory. The series included quenched and canister-centerline cooled versions of the glasses. These data will be used in the development of enhanced property/composition models for waste glass vitrification at Hanford. Several of the blanks had detectable amounts of sodium and/or silicon. The measured concentrations (mg/L) of boron, sodium, and silicon for the low-activity test reference material glass included with the Product Consistency Tests were much lower than the expected low-activity test reference material test results. A review of the Product Consistency Test data indicated that there was generally little difference between the normalized values based on targeted or measured glass composition. Heat treatment had various impacts on the normalized concentration values. Most of the glasses had NC B , NC Na , and NC Si values that were greater than the Hanford Tank Waste Treatment and Immobilization Plant low-activity waste constraint of 4 g/L. The release rates for boron, sodium, and silicon were highly correlated for the study glasses.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2020

Growth modeling to evaluate alternative cultivation strategies to enhance national microalgal biomass production

In this paper, we present a model-based assessment of alternative cultivation strategies on algal biomass production within the conterminous United States. Our assessment focuses on two basic cultivation strategies: 1) seasonal rotation of three representative freshwater algal strains that are well suited for warm weather, cold weather, and all-season diverse weather conditions, respectively; and 2) variation between three open pond water depths (15cm, 20cm, and 25cm). The enhanced Biomass Assessment Tool (BAT) is applied on a site-specific, hourly basis at 5,832 North American Land Data Assimilation System Phase 2 1/8° meteorological model grid cells over a 30-year period (1980-2009) to evaluate the operational strategies. Recognizing that resource management decisions may also consider scales beyond the individual site, we also conduct a regional assessment of focused on 7 representative climate zones in the conterminous United States. Results demonstrate that the spatial variability of algal productivity is largely affected by the strain-specific growth response to light and temperature that vary significantly by climate zone and latitude. Therefore, with a limited set of alternative cultivation strategies, the BAT identified the best performing combination of cultivation strategies on a site-specific basis that considerably enhances national annual biomass productivity. Specifically, the appropriate choice of seasonal strain rotation is able to significantly dampen climate-driven seasonal and spatial variability.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Cooperative Research and Development Agreement between National Energy Technology Laboratory and Electric Power Research Institute (EPRI) [Abstract]

Carbon dioxide (CO 2 ) capture from flue gas generated by fossil fuel-fired power plants has been proposed as an efficient approach to limit CO 2 emissions to the atmosphere. Due to the high cyclic CO 2 sorption capacity, well-tuned adsorption chemistry and non-volatility, solid sorbents are widely studied for CO 2 capture processes such as pressure swing adsorption (PSA) and temperature swing adsorption (TSA). Realistic applications of traditional solid sorbent systems face many challenges since moisture and heat management are problematic and solid-solid heat exchange is inefficient. Recently, a novel solid sorbent system, the sorbent polymer composite (SPC), has been developed to overcome those challenges in an energy-saving CO 2 capture process using TSA membrane contactors. A SPC material is comprised of a powdered solid sorbent embedded into a hydrophobic and porous polymer matrix. It allows gases to permeate through and achieve full contact with the sorbents while rejecting water moisture in the CO 2 capture process. In this collaborative research, NETL will conduct performance testing of a novel SPC material and EPRI will conduct a cost analysis based on that performance data.

20 FOSSIL-FUELED POWER PLANTS↗
DOE OSTI2025

High-Fidelity Analysis of EV Integration on Real Utility Feeders in Colorado

Residential electric vehicle (EV) charging has the potential to alter long-held assumptions on load characteristics impacting distribution grid planning, operations, and design standards. This study identifies analysis and control methods to increase the affordability of residential EV charging both for Xcel Energy and their customers. The project also provides solutions for more reliable grid interconnection that can support a reliable utility business model prepared for increasing EV charging load in the coming years. For this project, we referenced Level 2 alternating current (AC) onboard charging profiles for various vehicle models and high-fidelity charging data collected at the experimental setup established at the EV Research Infrastructure Laboratory at the National Renewable Energy Laboratory (NREL). Next, we developed EV adoption models for 2030 and 2040 for the Boulder and Aurora regions in Colorado. Moreover, we evaluated different smart charging control algorithms and compared their performance. We developed time-of-use (TOU)-based and grid-aware active EV charging control methods and integrated them within the study region to understand field impacts. Diving deeper, we selected 10 feeders in Boulder and Aurora for high-fidelity grid modeling down to the house level. We executed detailed grid analysis comparing the smart charge management (SCM) algorithms we developed. Finally, we created a novel tool, Electric Vehicle Infrastructure--Distribution System Integration Tool (EVI-DiST), to integrate all the approaches in a single software environment to provide easy integration, fast simulation, and detailed evaluation capability for utility engineers and other stakeholders.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2021

NeuralCubes: Deep Representations for Visual Data Exploration

Visual exploration of large multi-dimensional datasets has seen tremendous progress in recent years, allowing users to express rich data queries that produce informative visual summaries, all in real time. Techniques based on data cubes are some of the most promising approaches. However, these techniques usually require a large memory footprint for large datasets. To tackle this problem, we present NeuralCubes: neural networks that predict results for aggregate queries, similar to data cubes. NeuralCubes learns a function that takes as input a given query, for instance, a geographic region and temporal interval, and outputs the result of the query. The learned function serves as a real-time, low-memory approximator for aggregation queries. Our models are small enough to be sent to the client side (e.g. the web browser for a web-based application) for evaluation, enabling data exploration of large datasets without database/network connection. Here, we demonstrate the effectiveness of NeuralCubes through extensive experiments on a variety of datasets and discuss how NeuralCubes opens up opportunities for new types of visualization and interaction.

97 MATHEMATICS AND COMPUTING↗