Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data engineering”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,351 records · Page 75
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Data Cleaning and Analysis Scripts for Individual Traits in the Dunning-Kruger Effect Study

This code was built to recode and analyze survey data. The recoding script was built in Python while the data analysis script was built in R. The recoding script takes the raw survey data text and converts it to a numeric coding scheme. The data analysis script conducts analyses recommended by the American Psychological Association (APA) for data of this type. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525. SAND2021-3178 O

Sanchez, DanielleNicole↗
DOE OSTI2025

VoroClust

SAND2025-11465O VoroClust, also known as Voronoi Clustering, is a fast, density-based unsupervised clustering algorithm applicable to high-resolution and high-dimensional data. It operates as quickly as distance-based clustering methods while effectively capturing complex regional geometries, matching the performance of current density-based methods. VoroClust employs a data-centered sphere cover to reduce computational demands while preserving data topology. It propagates clusters outward from local density peaks. Although supervised machine learning is powerful for applications like image classification and segmentation, it requires comprehensive, consistent datasets, which many applications lack. Unsupervised clustering algorithms analyze the structure of each dataset rather than relying on similarities with other examples, making them well-suited for practical applications with insufficient or inappropriate data for supervised learning. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Ebeida, Mohamed [Sandia National Lab. (SNL-CA), Li↗
DOE OSTI2024

Designing and prototyping extensions to the Message Passing Interface in MPICH

As HPC system architectures and the applications running on them continue to evolve, the MPI standard itself must evolve. The trend in current and future HPC systems toward powerful nodes with multiple CPU cores and multiple GPU accelerators makes efficient support for hybrid programming critical for applications to achieve high performance. However, the support for hybrid programming in the MPI standard has not kept up with recent trends. The MPICH implementation of MPI provides a platform for implementing and experimenting with new proposals and extensions to fill this gap and to gain valuable experience and feedback before the MPI Forum can consider them for standardization. Here, in this work, we detail six extensions implemented in MPICH to increase MPI interoperability with other runtimes, with a specific focus on heterogeneous architectures. First, the extension to MPI generalized requests lets applications integrate asynchronous tasks into MPI’s progress engine. Second, the iovec extension to datatypes lets applications use MPI datatypes as a general-purpose data layout API beyond just MPI communications. Third, a new MPI object, MPIX_Stream, can be used by applications to identify execution contexts beyond MPI processes, including threads and GPU streams. MPIX stream communicators can be created to make existing MPI functions thread-aware and GPU-aware, thus providing applications with explicit ways to achieve higher performance. Fourth, MPIX Streams are extended to support the enqueue semantics for offloading MPI communications onto a GPU stream context. Fifth, thread communicators allow MPI communicators to be constructed with individual threads, thus providing a new level of interoperability between MPI and on-node runtimes such as OpenMP. Lastly, we present an extension to invoke MPI progress, which lets users spawn progress threads with fine-grained control to adapt the communication performance to their application designs. We describe the design and implementation of these extensions, provide usage examples, and highlight their expected benefits with performance results.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Subsurface Characterization and Machine Learning Predictions at Brady Hot Springs Results

Geothermal power plants typically show decreasing heat and power production rates over time. Mitigation strategies include optimizing the management of existing wells - increasing or decreasing the fluid flow rates across the wells - and drilling new wells at appropriate locations. The latter is expensive, time-consuming, and subject to many engineering constraints, but the former is a viable mechanism for periodic adjustment of the available fluid allocations. Data and supporting literature from a study describing a new approach combining reservoir modeling and machine learning to produce models that enable strategies for the mitigation of decreased heat and power production rates over time for geothermal power plants. The computational approach used enables translation of sets of potential flow rates for the active wells into reservoir-wide estimates of produced energy and discovery of optimal flow allocations among the studied sets. In our computational experiments, we utilize collections of simulations for a specific reservoir (which capture subsurface characterization and realize history matching) along with machine learning models that predict temperature and pressure timeseries for production wells. We evaluate this approach using an "open-source" reservoir we have constructed that captures many of the characteristics of Brady Hot Springs, a commercially operational geothermal field in Nevada, USA. Selected results from a reservoir model of Brady Hot Springs itself are presented to show successful application to an existing system. In both cases, energy predictions prove to be highly accurate: all observed prediction errors do not exceed 3.68% for temperatures and 4.75% for pressures. In a cumulative energy estimation, we observe prediction errors that are less than 4.04%. A typical reservoir simulation for Brady Hot Springs completes in approximately 4 hours, whereas our machine learning models yield accurate 20-year predictions for temperatures, pressures, and produced energy in 0.9 seconds. This paper aims to demonstrate how the models and techniques from our study can be applied to achieve rapid exploration of controlled parameters and optimization of other geothermal reservoirs. Includes a synthetic, yet realistic, model of a geothermal reservoir, referred to as open-source reservoir (OSR). OSR is a 10-well (4 injection wells and 6 production wells) system that resembles Brady Hot Springs (a commercially operational geothermal field in Nevada, USA) at a high level but has a number of sufficiently modified characteristics (which renders any possible similarity between specific characteristics like temperatures and pressures as purely random). We study OSR through CMG simulations with a wide range of flow allocation scenarios. Includes a dataset with 101 simulated scenarios that cover the period of time between 2020 and 2040 and a link to the published paper about this project, where we focus on the Machine Learning work for predicting OSR's energy production based on the simulation data, as well as a link to the GitHub repository where we have published the code we have developed (please refer to the repository's readme file to see instructions on how to run the code). Additional links are included to associated work led by the USGS to identify geologic factors associated with well productivity in geothermal fields. Below are the high-level steps for applying the same modeling + ML process to other geothermal reservoirs: 1. Develop a geologic model of the geothermal field. The location of faults, upflow zones, aquifers, etc. need to be accounted for as accurately as possible 2. The geologic model needs to be converted to a reservoir model that can be used in a reservoir simulator, such as, for instance, CMG STARS, TETRAD, or FALCON 3. Using native state modeling, the initial temperature and pressure distributions are evaluated, and they become the initial conditions for dynamic reservoir simulations 4....

15 GEOTHERMAL ENERGY↗
DOE OSTI2023

Meteorological and hydrological parameters for 17 locations of meteorological stations of the East River Watershed

The Data Package includes a set of csv files of input meteorological parameters for locations of 17 meteorological stations within the East River watershed. These meteorological datasets were downloaded from the (1) PRISM database--monthly precipitation, air temperature (minimum, mean, and maximum), vapor pressure deficit (minimum and maximum), and dewpoint temperature, and (2) NCEP/NCAR Reanalysis database – wind database. The datasets were used for calculations of the Potential Evapotranspiration (ETo), Actual Evapotranspiration (ET), Standard Precipitation Index (SPI) , Standard Evapotranspiration-Precipitation Index (SPEI) for the period from 1966 to 2021. The main research questions addressed are: the evaluation of the long-term temporal trends of climatic parameters, hierarchical clustering, and areal mapping/zonation of the East River watershed. Calculations were conducted in the Rstudio environment. The dataset additionally includes a file-level metadata (flmd.csv) file that lists each file contained in the dataset with associated metadata; and a data dictionary (dd.csv) file that contains column/row headers used throughout the files along with a definition, units, and data type.The input datasets were downloaded from (a) PRISM database (the Northwest Alliance for Computational Science and Engineering at the Oregon State University), and (b) NCEP/NCAR Reanalysis database.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Bayesian Framework for Predicting and Controlling Metabolic Phenotypes in Microbial System

To improve titers, rates and yields for sucrose production in an engineered strain of Synechococcus elongatus PCC7942, we employed Bayesian metabolic control analysis to transcriptomics and external metabolomics data generated for various phases during the circadian clock. Top overexpression candidates included sodium-dependent bicarbonate transporter (H2cO3_Nat_syn), and UTP—glucose-1-phosphate uridylyltransferase (GALUi). Top repression candidates included Glycogen/starch synthetases, ADP-glucose type (GLCS3), Glutamate racemase (GLUR), and ribonucleoside diphosphate reductase (RNDR1).

60 APPLIED LIFE SCIENCES↗
DOE OSTI2021

Wake Steering Wind Farm Control With Preview Wind Direction Information: Preprint

Wake steering is a wind farm control strategy in which upstream turbines operate with a yaw misalignment to deflect their wakes away from downstream turbines, yielding a net power gain for the wind plant. But the inability of wake steering controllers to perfectly track the wind direction leads to suboptimal performance. In this paper, we propose the use of preview wind direction measurements upstream of the turbine to improve controller performance by anticipating wind direction changes. Further, data from an operational wind plant are used to determine realistic preview measurement accuracy. Using the FLORIS engineering wind farm control tool, we compare the performance of standard and preview-enabled baseline and wake steering control for a two-turbine array during below-rated operation. Assuming perfect preview information, preview-based wake steering increases energy production by the equivalent of 9.5% of the baseline wake losses, compared to a wake loss recovery of 5.6% with standard wake steering. However, when realistic measurement accuracy is included, the preview-based controller provides no advantage over standard control, motivating the need for more sophisticated control and wind direction forecasting strategies.

49 EE - Wind and Water Power Program - Wind (EE-4W↗
DOE OSTI2021

Integrated FY21 Elevated Temperature Mechanical Testing Results for Alloy 709 Code Case

This report provides the status of creep, fatigue, and creep-fatigue testing that transpired in Fiscal Year 2021 at Argonne National Laboratory, Idaho National Laboratory and Oak Ridge National Laboratory. This testing is being conducted to develop the data package to qualify Alloy 709 in Section III, Division 5 of the American Society of Mechanical Engineers Boiler and Pressure Vessel Code. This would permit the use of Alloy 709 for elevated-temperature nuclear construction. Preliminary results continue to demonstrate the improved creep and fatigue resistance of Alloy 709 compared to 316H stainless steel.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2023

Utilizing GEOPHIRES-X Beyond Electricity

The GEOPHIRES tool is a techno-economic simulator for evaluating the thermal performance and cost-competitiveness of geothermal plants for electricity, heating, and/or cooling. The tool combines reservoir, wellbore, and surface plant cost and performance models to estimate overall techno-economic metrics such as net present value or levelized cost of electricity, heating, or cooling. We recently upgraded the tool to an object-oriented Python framework, presented in an accompanying paper. As part of the upgrade, we enhanced the capability to simulate the performance of geothermal plants for heating and cooling, which is the topic of this paper. Specifically, we (1) integrated absorption chillers to investigate the performance of utilizing geothermal heat for cooling, (2) integrated a heat pump module to boost the geothermal temperature and thermal output, (3) integrated a district heating module to estimate heating demand for a district based on local weather data, and simulated heat supply with geothermal energy and peaking boilers, and (4) integrated GEOPHIRES as an engine in the dGeo simulator to perform a geospatial analysis of geothermal district heating feasibility across a large region (e.g., a state or the entire United States) utilizing resource and thermal demand maps. This paper presents background information and case studies for several of these heating and cooling end-use options in GEOPHIRES.

absorption chiller↗
DOE OSTI2021

Development and Application of a Data-Driven Methodology for Validation of Risk-Informed Safety Margin Characterization Models

The document is the Final Technical Progress Report for the Nuclear Energy University Program’s Integrated Research Project (IRP) on “Development and Application of a Data-Driven Methodology for Validation of Risk-Informed Safety Margin Characterization Models” that supports the LWR Sustainability Program’s RISMC R&D Pathway. The project goal is to develop and demonstrate a data-driven methodology for validation of advanced computer models used in nuclear power plant safety analysis. Specifically, the advanced computer models are those in the toolkit developed to support risk-informed safety margin characterization (RISMC), an integrated deterministic/probabilistic safety analysis methodology developed in the Department of Energy’s Light Water Reactor Sustainability (LWR-S) program. The report reflects the progress made towards the project’s stated goal by contributions by researchers and graduate students from universities, with support from researchers from national laboratories and industry companies. The project organization, effort coordination and technical implementation are summarized, followed by discussion of main findings, issues, and path forward. Selected chapters provide a more detailed description of tasks, approaches and respective findings and recommendations. Noteworthy are contributions that serve as guidelines for methodology development. It is also noted that this report is complemented by other milestone reports (as stand-alone deliverables) that provide detailed discussion of the technical developments. The project results have been documented in a number (12) dissertations and these, 50+ peer-reviewed publications in technical journals and conference proceedings.

42 ENGINEERING↗
DOE OSTI2022

Unsupervised learning from three-component accelerometer data to monitor the spatiotemporal evolution of meso-scale hydraulic fractures

Enhanced geothermal systems can provide a substantial share of the global energy demand. There exist several hurdles in the engineering implementations of such geothermal systems. One such hurdle is the accurate monitoring of the fracture networks created in subsurface through hydraulic stimulation of these systems. Micro seismicity associated with the stimulation is the primary means to locate the event hypocenters for estimating the stimulated rock volume. Existing methods for location the hypocenters are restricted to only the highest amplitude impulsive signals that are simultaneously detected on several sensors. Consequently, a large portion (usually ~99%) of the measurements are left unused. In this paper, an unsupervised manifold-approximation followed by clustering of 3-component accelerometer data is used to analyze the seismicity recorded on a monitoring well. With this method, a larger portion of the measured signal is used for the monitoring of the hydraulic fracture network. We analyze the EGS Collab experiment 1 microseismic data, recorded at the Sanford Underground Research Facility, South Dakota. Using the data from a single three-component accelerometer, the polarization features viz. Azimuth, incidence, rectilinearity, and planarity are used as inputs for the unsupervised manifold approximation followed by clustering. Our study shows that density-based clusters in the projected 3D space correspond to distinct types of hydraulically fractured zones around the injection point. Finally, we show that the temporal evolution of these clusters can be used to track fracture creation and propagation.

58 GEOSCIENCES↗
DOE OSTI2020

Accuracy of HVAC Load Predictions: Validation of EnergyPlus and DOE-2 using FLEXLAB Measurements

The aim of the project reported here was to better understand the level of accuracy of three building energy simulation (BES) engines (‘engines’) — EnergyPlus™, DOE-2.1e, and DOE-2.2 — by identifying and investigating significant deviations between the performance predicted by these engines and actual performance as measured in the FLEXLAB® test facility at Lawrence Berkeley National Laboratory (LBNL). The specific test conditions included some of those prescribed in ANSI/ASHRAE Standard 140 - Standard Method of Test for the Evaluation of Building Energy Analysis Computer Programs. Detailed measurements of FLEXLAB performance, including indoor temperatures and heat fluxes and air-flow and water flow rates and temperatures in the Heating, Ventilating and Air Conditioning (HVAC) system, together with hourly weather data, were recorded and used in analyzing the simulation results from EnergyPlus v8.8, DOE-2.2 v3.65 and DOE-2.1e v127. These engines are commonly used in the United States for building energy code compliance, federal, state, and utility incentives programs, as well as energy efficient design of new buildings and energy retrofit of existing buildings. Seven conventional overhead mixing ventilation scenarios were tested and each engine was found to have a similar level of agreement with the measurements of space-level heating and sensible cooling loads. These results provide useful information regarding the accuracy of these engines in predicting the cooling and heating load elements of whole building energy performance. This information is intended for practitioners who are concerned about transitioning between simulation tools with different engines and for managers of utility programs leveraging these tools for evaluating and/or projecting measure savings to be incentivized under their programs. The results of the comparisons of simulated and measured performance indicate that the predictions from all three engines are not significantly different. The 24-hour average value of the absolute mean bias indicates the likely magnitude of the error in any particular case. The average mean bias is reduced by cancelation of overprediction in one case by underprediction in another. The daytime absolute mean biases, which may be more important for both energy performance and occupant comfort, are ~6%, presumably because of the greater complexity involved in simulating in the presence of solar radiation. EnergyPlus typically overpredicts the cooling load and/or underpredicts the heating load by ~1.5% and the DOE-2 engines typically underpredict the cooling load by approximately the same amount. The Root Mean Square Error is relatively more sensitive to shorter term variations in the difference between predicted and measured loads; the three engines have similar values, ~10%, suggesting that the uncertainties in their predictions of peak loads may also be similar in magnitude. The implication of these results is that users, both designers and program analysts, can use EnergyPlus, DOE-2.1e, or DOE-2.2 to model conventional commercial buildings equipped with overhead mixing ventilation with a similar level of confidence. Further work is required to better understand the variability in the level of agreement between the engine predictions and FLEXLAB measurements, where a particular engine will agree well with FLEXLAB in some cases and not so well in others and another engine will agree or disagree in different cases. As the sources of this variability are identified and eliminated or reduced significantly, it is recommended that the experimental capabilities and methods developed in the study reported here should be applied to validating heating and cooling load calculations for spaces with different types of furniture and miscellaneous loads. These methods should then be applied to low energy space conditioning systems in EnergyPlus including, in particular, radiant slab and radiant ceiling panel cooling and heating systems and ‘mixed mode’ systems that combine mechanical cooling and natural ventilation systems, focusing on controls, including control of thermal mass. The work reported here addresses the conventional method of heating and cooling occupied spaces; other methods, such as the use of radiant heating and cooling systems have the potential to provide equivalent occupant comfort, or better, with lower energy consumption. These systems are addressed more explicitly in EnergyPlus but there is a need for empirical validation to give users the same level of confidence in modeling these systems that they have, or should have, in modeling conventional systems, based on the results presented here.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2020

Description and Use of SCALE Sampler Parametric Capability for Engineering Analysis and Optimization

The Sampler sequence was introduced into the SCALE nuclear modeling and simulation suite in SCALE 6.2 to perform uncertainty quantification via random sampling of nuclear data, material number densities, and dimensions. Sampler was expanded with the introduction of a parametric capability in SCALE 6.2.2. This paper discusses input for the Sampler parametric sequence and presents two case studies of analyses performed using the sequence. These case studies include preconceptual design of a package for transporting high assay low-enriched uranium (HALEU) oxide and scoping calculations to support subcritical limit development for a future update of the ANSI/ANS-8.1 (ANS-8.1) standard. The parametric capability within Sampler provides many benefits to analysts. For instance, parametric sweeps are frequently used to identify optimum parameter values as part of safety analysis or system design, but such sweeps can require substantial engineering time or may rely on custom-written scripts or scripts such as Write One, Run Many (or WORM) developed outside of any software quality assurance program. With the parametric capabilities in Sampler, however, a large number of inputs can be generated automatically without recourse to scripting by individual analysts. The parametric capability can also be used in lieu of the CSAS5S search sequence to identify optimum parameters more simply with straightforward inputs and outputs. Sampler can also be used to calculate input parameters from engineering specifications. For example, diameters can be converted to radii, or masses can be used to calculate number densities. Overall, the Sampler parametric capability provides a robust feature within SCALE, eliminating the need for user-developed scripting.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2025

Scalable Data Center Capacity for DOE's AI Prototype: A Rapidly Available Gigawatt Data Center for DOE

The multilaboratory Gigawatt Data Center working group was commissioned to identify approaches to rapidly establish federal data centers with scalable capacities up to 1,000 MW. These state-of-the-art facilities will serve as hubs for interdisciplinary collaboration, industry partnerships, and transformative applications of artificial intelligence. The proposed strategic shift includes facilitating multilaboratory collaboration, prioritizing operational efficiency, expanding public–private partnerships, optimizing investments, ensuring long-term contractual flexibility, supporting open science and secure data enclaves, and exploiting high-speed national networks. Owing to their extensive experience and best practices, the US Department of Energy national laboratories are uniquely positioned to lead this initiative. We recommend conducting a feasibility analysis to rapidly identify the optimal sites for this initiative, and the effort will likely involve private industry for design, construction, financing, and operational integration. We also propose establishing multiple geographically diverse sites to ensure energy resilience, high operational reliability, and a diverse user base, thereby effectively addressing the nation’s critical needs.

42 ENGINEERING↗
DOE OSTI2021

GRIP: Constraint-based Explanation of Missing Answers for Graph Queries

Abstract: A useful feature in graph query engines is to clarify “Why certain entities (nodes, attribute values or edges) are missing” in query answers. This task is even more challenging when the relevant data is already missing in the underlying data source. Missing data, on the other hand, can be inferred by enforcing data constraints for graphs. We demonstrate GRIP, a system that exploits data constraints to clarify missing answers for graph queries. (1) Constraint-based ex- planation. Given a desired yet missing entity in the query answer, GRIP ensures to generate finite and minimal sequences of data con- strains (an “explanation”) that should be consecutively enforced to ?? to ensure its occurrence for the same query. (2) Answering “why” and“how” questions. Users can query GRIP with both“Why”(“Why” the element is missing) and “How” questions (“How” to refine the graph to include the missing answer). GRIP engine supports run- time generation of explanations by incrementally maintaining a set of bi-directional search trees. (3) Interactive exploration. GRIP provides a user-friendly GUI to support interactive ad visual exploration of explanations, including both automated generation and step-by-step inspection of graph manipulations.

graphs↗
DOE OSTI2020

Data Requirements for Application of Risk-Based Dynamic Contingency Analysis to Evaluate Hurricane Impact to Electrical Infrastructure in Puerto Rico

This paper presents a risk-based dynamic contingency analysis framework that was used to evaluate the hurricane impact to electrical infrastructure in Puerto Rico. PNNL developed a scalable risk-based framework for identifying high-voltage transmission resilience improvements by classifying and prioritizing high-risk power grid contingencies (system failures) under hurricane impact. The risk-based framework is founded on grid outage definitions with their associated probabilities of occurrence from hurricane events, in combination with an impact assessment derived from detailed dynamic cascading failure analysis. This paper focuses on a discussion around data requirements for transmission resilience planning for hurricane events, derived from the development of the risk-based framework and its application to Puerto Rico. This paper launches an important first step in encouraging the engineering community and power system industry to move towards establishing resilience planning as a routine practice. Since actual results for Puerto Rico contain sensitive information, sample simulation results will be used to illustrate the data requirements and risk-based dynamic cascading framework on the Puerto Rico power grid, as well as demonstrate the potential for such a simulation framework. The paper includes a discussion on the lessons learned, importance and need for improved datasets that are not usually considered in traditional power system planning. The paper will also elaborate on how the scalable simulation framework and datasets might be expanded to larger footprints and leveraged for modelling other types of natural disasters.

DCAT, Puerto Rico, hurricane, Power System Stabili↗
DOE OSTI2022

Effects of Port Angle on Scavenging of an Opposed Piston Two-Stroke Engine

Opposed-piston 2-stroke (OP-2S) engines have the potential to achieve higher thermal efficiency than a typical diesel engine. However, the uniflow scavenging process is difficult to control over a wide range of speeds and loads. Scavenging performance is highly sensitive to pressure dynamics, port timings, and port design. This study proposes an analysis of the effects of port vane angle on the scavenging performance of an opposed-piston 2-stroke engine via simulation. A CFD model of a three-cylinder opposed-piston 2-stroke was developed and validated against experimental data collected by Achates Power Inc. One of the three cylinders was then isolated in a new model and simulated using cycle-averaged and cylinder-averaged initial/ boundary conditions. This isolated cylinder model was used to efficiently sweep port angles from 12 degrees to 29 degrees at different pressure ratios. Results indicate that scavenging performance is correlated with the bulk swirl ratio generated by these port angles. Scavenging performance is also sensitive to the pressure ratio across the engine. It was concluded that, for a given pressure ratio, the smallest port angle produces the best scavenging; however, previous work indicates lower bulk swirl ratio during combustion can have an impact on emissions formation.

33 ADVANCED PROPULSION SYSTEMS↗