SEARCH · Engineering Papers

Results for “data engineering”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 325 records · Page 18

All sources NASA NTRS DOE OSTI

DOE OSTI2024

Tetris-inspired detector with neural network for radiation mapping

Abstract Radiation mapping has attracted widespread research attention and increased public concerns on environmental monitoring. Regarding materials and their configurations, radiation detectors have been developed to identify the position and strength of the radioactive sources. However, due to the complex mechanisms of radiation-matter interaction and data limitation, high-performance and low-cost radiation mapping is still challenging. Here, we present a radiation mapping framework using Tetris-inspired detector pixels. Applying inter-pixel padding for enhancing contrast between pixels and neural networks trained with Monte Carlo (MC) simulation data, a detector with as few as four pixels can achieve high-resolution directional prediction. A moving detector with Maximum a Posteriori (MAP) further achieved radiation position localization. Field testing with a simple detector has verified the capability of the MAP method for source localization. Our framework offers an avenue for high-quality radiation mapping with simple detector configurations and is anticipated to be deployed for real-world radiation detection.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

DOE OSTI2022

Bridging the length scales on mechanical property evaluation (Final Report)

The development of small-scale mechanical testing in combination with microstructural investigation is of great interest to the nuclear materials community for both materials development and monitoring applications. Dramatically reducing the sample sizes to reduce radioactivity and obtaining mechanical properties of irradiated samples is truly intriguing. Moreover, such studies promise a range of benefits including cost reduction, fundamental insight in structure-property relationships, increased statistics on less sample material, and reinvestigation of prior irradiated and tested reactor samples while simultaneously enabling the generation of mechanical test data on ion beam irradiated materials with limited penetration depths. Small scale materials testing on sub-sized samples has been studied for several decades, though it has only been after the development of micro-testing based on Focused Ion Beam (FIB) sample manufacturing in that orders of magnitude smaller samples could really be investigated in a quantitative manner. In recent years, small scale mechanical testing techniques at a number of length scales has been developed for both unirradiated and irradiated (ion and neutron) materials. Technological advances made in this field have enabled ex-situ and in-situ transmission electron microscopy (TEM) and scanning electron microscopy (SEM) examination, thus leading to more accurate measurements as well as additional mechanistic information. A recent review of the benefits of these techniques show that these techniques are at a stage to tackle multi-scale ranges of materials investigations and can be utilized to obtain fundamental science-based understanding of nuclear materials. Considering the tremendous advances made, one can see how small-scale mechanical testing techniques combined with modeling can enable true small scale to bulk scale mechanical property correlations. However, for the engineering community to adapt this approach fully, one needs to demonstrate that a) that these techniques can produce results with high fidelity and reproducibility, b) generate engineering stress-strain data that one can utilize to understand bulk behavior, and c) generate new insight into relevant phenomena fostering the true understanding of radiation damage and microstructure in materials for nuclear applications. It is the objective of this proposal to bridge the length scale between macro- and micro- scale mechanical testing of unirradiated and irradiated materials. This involves the development and demonstration of procedures for multi-scale mechanical testing that enable high fidelity reproducibility of data and the generation bulk property data from small-scale mechanical tests. Through this, the proposal aims to enhance the confidence in the obtained data at the smaller length scales and enhance the insight provided from these techniques for bulk scale applications on both unirradiated and irradiated materials.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

DOE OSTI2022

Expanded analysis of machine learning models for nuclear transient identification using TPOT

Industries around the world are becoming more and more data driven. The nuclear field is no exception with several different applications being proposed. One popular area of research is the use of machine learning in transient detection. This paper seeks to build upon a previous study which made use of the AutoML package TPOT to train traditional machine learning models to classify transient events occurring with a reactor. Synthetic data was once again collected using a GPWR reactor simulator. Data on 12 different events was collected using 15 different initial conditions. Here, a dataset consisting of over 100,000 data points was compiled and used to train 7 different machine learning models using a pre-defined TPOT dictionary with 12 different preprocessing techniques. Three of the trained models were able to produce validation results in the 90s with the expanded dataset. Once the models were trained, it was possible to look into where during the simulation, misclassifications occurred. Using these three models, analysis was done to determine if TPOT could be used to train models that were effective if important features were missing. The results from this were positive with the newly trained models scoring close to the original models. Finally, to conclude this study, the three high performing models were retrained using different random states to see if there was any major variation when different states were used.

42 ENGINEERING↗

DOE OSTI2023

Hydropower Resilience Database for Assessing Microgrid Formation Capability and Enhancing Power Grid Resilience

In the face of increasing frequency of extreme events, enhancing resilience and reliability of energy infrastructure demands innovative solutions. Hydropower, with its inherent generation flexibility and grid-forming capability, offers significant potential for enhancing power grid resilience through the establishment of microgrids. To enable informed decision-making and strategic planning, we present the Hydropower Resilience Database (HRD) that integrates data from various sources such as Oakridge National Laboratory (ORNL) HydroSource, National Inventory of Dams, and US Western Grid database. By integrating relevant information on hydropower plant characteristics, including dams, reservoirs, and connected electrical grid, this resource enables hydropower plant owners, utilities, and community stakeholders to identify and evaluate the feasibility of using hydropower resources in microgrids to support nearby communities and critical infrastructure in various challenging scenarios. Using HRD, a set of metrics are evaluated to quantify the capability of hydropower plants to support essential microgrid functions. An interactive tool is developed using ArcGIS, enabling the visualization and analysis using HRD. Our research contributes to strategic planning efforts for fortifying energy infrastructure, ensuring reliable power supply during disruptions, and advancing the development of robust and resilient energy systems in regions susceptible to grid vulnerabilities.

13 HYDRO ENERGY↗

DOE OSTI2023

Hydropower Resilience Database for Assessing Microgrid Formation Capability and Enhancing Power Grid Resilience

13 HYDRO ENERGY↗

DOE OSTI2025

Pavement condition and climatic data in southeast Texas: A dataset for evaluating flood impacts on pavement performance

Effective pavement maintenance is essential for economic stability, optimal network performance, and roadway safety. Achieving this requires thorough evaluation of pavement conditions, including structural integrity, surface roughness, and distress characteristics. Pavement performance indicators play a critical role in influencing vehicle safety and ride quality. Recent advances have emphasized the use of data-driven modeling to anticipate pavement behavior, with the goal of optimizing resource allocation and refining Maintenance and Rehabilitation (M&R) strategies through accurate condition assessment. A foundational requirement for these modeling efforts is the availability of standardized, high-quality datasets that can support robust and reproducible infrastructure analysis. This data article presents a comprehensive dataset assembled to facilitate pavement performance prediction, with a geographic focus on Southeast Texas, particularly the flood-vulnerable area of Beaumont. The dataset encompasses pavement and traffic attributes, meteorological records, flood simulation outputs, ground deformation measurements, and topographic indices, enabling detailed examination of both load-associated and non-load-associated degradation mechanisms. Data preprocessing was performed using ArcGIS Pro, Microsoft Excel, and Python to ensure consistency and usability in data-driven modeling applications, including machine learning workflows. Key contributions of this dataset include its utility in analyzing the climatic and environmental factors affecting pavement conditions, identifying critical predictive features, and enabling in-depth correlation analysis across diverse variables. By filling existing gaps in input variable selection resources, this dataset supports the development of predictive tools for estimating future maintenance demand and enhancing the resilience of pavement networks in flood-impacted areas. The resource highlights the importance of standardized datasets for advancing pavement management practices and provides a robust foundation for ongoing infrastructure performance modeling.

42 ENGINEERING↗

DOE OSTI2021

Frequency Injection Based HVDC Attack-Defense Control Via Squeeze-Excitation Double CNN

Due to the independent controllability and fast power regulation capability, the High Voltage Direct Current (HVDC) system could be a prospective technology to provide multiple ancillary services to the system besides conventional bulk power transmission. However, with the increase of False Data Injection Attacks (FDIAs) on PMU data, the HVDC system could have the wrong response once the collected data that the HVDC system relied on is attacked, thus threatening the system operating security. How to ensure the security of the PMU-based HVDC ancillary service control become an urgent issue. To mitigate the risk, this paper proposed an HVDC attack-defense control based on the FDIAs detection method. Firstly, the Squeeze-Excitation based Double Convolutional Neural Networks (SE-DCNN) is proposed to realize fast identification of the attacking frequency type based on the time and frequency domain signals. Furthermore, the duration time of FDIAs is detected by the local outlier factor. Then, utilizing the results from SE-DCNN, HVDC ancillary service control framework is reorganized and an HVDC attack defense control is proposed for suppressing the potential influence of various types of FDIAs on the HVDC system ancillary service. Different experiments results demonstrate that the proposed method has the ability to significantly mitigate the frequency deviation and oscillation under the FDIA.

42 ENGINEERING↗

DOE OSTI2025

Block-Structured Operator Inference for Coupled Multiphysics Model Reduction

This work presents a block-structured formulation of Operator Inference as a way to learn structured reduced-order models for multiphysics systems. The approach specifies the governing equation structure for each physics component and the structure of the coupling terms. Once the multiphysics structure is specified, the reduced-order model is learned from snapshot data following the nonintrusive Operator Inference methodology. In addition to preserving physical system structure, which in turn permits preservation of system properties such as stability and second-order structure, the block-structured approach has the advantages of reducing the overall dimensionality of the learning problem and admitting tailored regularization for each physics component. The numerical advantages of the block-structured formulation over a monolithic Operator Inference formulation are demonstrated for aeroelastic analysis, which couples aerodynamic and structural models. For the benchmark test case of the AGARD 445.6 wing, block-structured Operator Inference provides an average 20% online prediction speedup over monolithic Operator Inference across subsonic and supersonic flow conditions in both the stable and fluttering parameter regimes while preserving the accuracy achieved with monolithic Operator Inference.

42 ENGINEERING↗

DOE OSTI2023

Data-Driven Control: Theory and Applications

The ushering in of the big-data era, ably supported by exponential advances in computation, has provided new impetus to data-driven control in several engineering sectors. This topic's rapid and deep expansion has precipitated the need to showcase the highlights of data-driven approaches. There has been a rich history of contributions from the control systems community in data-driven control. At the same time, several new concepts and research directions have also been introduced in recent years. Many of these contributions and concepts have started to transition from theory to practical applications. This paper will overview the historical contributions and highlight recent concepts and research directions.

Soudbakhsh, Damoon↗

DOE OSTI2024

Oscilloscope Data Push Program

This paper details the development of a Python program designed to automate the data acquisition and conversion for an oscilloscope for the purposes of a one-off/temporary data acquisition system for users that readily need data, and do not have the option of obtaining a Data Acquisition (DAQ) solution. Creating DAQ systems for analyzing a system requires expensive electronics and a dedicated team of engineers for support. Traditionally, manual data collection and processing are time consuming and prone to error. By automating these processes, the cost, efficiency and accuracy of data handling are improved upon. This project involves the creation of a program that interacts with the oscilloscope. During this interaction, there are various functions being performed such as the acquisition of waveform data via floating points, generating plots with the acquired wave points, and storing of floating points in a CSV file format for future reference and plotting purposes. While the initial aim of the project included continuous logging to a cloud database, this was deferred due to time constraints. The results portrayed an almost-instant rate of data collection with a buffer time, showcasing the potential for further integration and real-time data processing.

Osei-Tutu, Jason↗

DOE OSTI2022

Evaluation of a scientific data search infrastructure

The ability to search over large scientific datasets has become crucial to next-generation scientific discoveries as data generated from scientific facilities grow dramatically. In previous work, we developed and deployed ScienceSearch, a search infrastructure for scientific data which uses machine learning to automate metadata creation. Our current deployment is deployed atop a container based platform at a HPC center. In this article, we present an evaluation and discuss our experiences with the ScienceSearch infrastructure. Specifically, we present a performance evaluation of ScienceSearch's infrastructure focusing on scalability trends. The obtained results show that ScienceSearch is able to serve up to 130 queries/min with latency under 3 s. We discuss our infrastructure setup and evaluation results to provide our experiences and a perspective on opportunities and challenges of our search infrastructure.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

DOE OSTI2022

Beyond Energy Efficiency: A clustering approach to embed demand flexibility into building energy benchmarking

The intermittency of carbon-free renewables and the demand changes associated with the widespread push for electrifying the transportation and building sectors provides an opportunity for buildings to go beyond energy efficiency and push towards providing demand flexibility to the electricity grid. The duality of energy efficiency and demand flexibility is necessary for success in a sustainable and reliable energy transition. Current building energy benchmarking models are limited in their ability to integrate concepts of demand flexibility and/or utilize granular smart meter data. Thus, current benchmarking methods are focused annual energy usage and fail to incorporate how the time of use of energy consumption impacts emissions in a quickly changing energy grid. Without a more comprehensive view of energy usage and associated real-time emissions, current benchmarking methods are unlikely to realize the full decarbonization potential of buildings. New emerging data streams provide an opportunity to develop a new generation of benchmarking energy models that embed dimensions of energy efficiency, grid interactivity, and demand flexibility into their analysis. In this paper, we propose a four-step method for embedding grid interactivity and demand flexibility into building benchmarking models that utilizes emerging building and time-series electricity data streams. We first engineer features to produce a mix-type dataset that encompasses many attributes of grid-interactive and efficient buildings, and then we apply K-medoids using Gower's Distance to produce peer-group clusters. We apply the method to a case study of 306 primary and secondary schools in southern California, USA. The results show that the method effectively clusters buildings by attributes of demand flexibility and energy efficiency. The clustering results reveal patterns in inefficient building operations and demand inflexibility at the building peer group level. In conclusion, the interpretation of clusters can serve as an integrated energy efficiency and demand flexibility benchmarking model and inform performance-specific policy targeting for buildings that go beyond traditional efficiency measures.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2023

A computational parametric study of ducted fuel injection implementation in a heavy-duty diesel engine

Experiments have shown that ducted fuel injection (DFI) effectively reduces soot emissions from direct-injection diesel engines. Although many computational studies have evaluated DFI’s spray development and soot reduction mechanisms in constant volume chambers, only limited computational work on internal combustion engines exists. The DFI duct assembly changes the engine’s in-cylinder flow, spray, and combustion development. Therefore, current production engine designs might not be optimal for achieving the best engine performance with DFI. Here, this work conducted an extensive numerical study to evaluate how parameter changes affect DFI performance. The parameters include swirl ratio, piston geometry, compression ratio (CR), number of injector orifices, split injection strategy, and exhaust gas recirculation (EGR) in a heavy-duty diesel engine utilizing DFI. The combustion and soot emission data from the Sandia compression ignition optical research engine were used for model validation. Simulations showed that an increased swirl ratio resulted in more intense jet flame-piston interaction, slowing down the combustion heat release during the late combustion stage and leading to lower indicated thermal efficiency (ITE) due to higher exhaust losses. A piston-bowl design with a reentrant inner piston edge yielded the highest thermal efficiency, due to the reduced cylinder head heat transfer loss. Additional injector orifices led to higher efficiency owing to a more advanced combustion phasing. Nevertheless, the maximum pressure rise rate (MPRR) and oxides of nitrogen (NO x ) emissions also increased with the number of injector orifices due to more rapid heat release and higher combustion temperature. Implementation of a split injection strategy combined with a higher EGR rate effectively inhibited the excessive MPRR and NO x formation. In general, the study concluded that DFI is not sensitive to most parameter changes but will benefit from future parameter optimization.

33 ADVANCED PROPULSION SYSTEMS↗

DOE OSTI2022

Moving small files in a networked environment

Globally distributed computing infrastructures, such as clouds and supercomputers, are currently used to manage data that is generated with an unprecedented speed from a variety of resources. Coping with this trend, the volume of data exchanged across distant sites increases substantially. To accelerate data transfer, high-speed networks are provided to connect remote sites. Most existing data movement solutions are optimized for moving large files. However, it is still challenging to transfer a large number of small files across networks. This disadvantage not only lowers data transfer performance, but also decreases overall system utilization. Here, we identify that moving small files is mainly constrained by degraded file system throughput, not just network performance as might be suspected. We have built a data transfer pipeline model to analyze the impact of small network I/O and storage I/O on data movement. Extending one of the widely used open source data movement solutions, GridFTP, we demonstrate several appropriate engineering approaches that mitigate the bottleneck and increase data transfer efficiency. We show optimizations that improve data transfer performance more than 5 times. In comparison to existing solutions, our approaches can save a significant amount of system resources for moving lots of small files.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2022

Mitigating life cycle GHG emissions of roads to be built through 2030: Case study of a Chinese province

We report the expansion of road networks in emerging economies such as China causes significant greenhouse gas (GHG) emissions. This development is conflicting with China's commitment to achieve carbon neutrality. Thus, there is a need to better understand life cycle emissions of road infrastructure and opportunities to mitigate these emissions. Existing impact studies of roads in developing countries do not address recycled materials, improved pavement maintenance, or pavement-vehicle interaction and electric vehicle (EV) adoption. Combining firsthand information from Chinese road construction engineers with publicly available data, this paper estimates a comprehensive account of GHG emissions of the road pavement network to be constructed in the next ten years in the Shandong province in Northern China. Further, we estimate the potential of GHG emission reductions achievable under three scenario sets: maintenance optimization, alternative pavement material replacement, and EV adoption. Results show that the life cycle GHG emissions of highways and Class 1–4 roads to be constructed in the next 10 years amount to 147 Mt CO2-eq. Considering the use phase in our model reveals that it is the dominant stage in terms of emissions, largely due to pavement-vehicle interaction. Vehicle electrification can only moderately mitigate these emissions. Other stages, such as materials production and road maintenance and rehabilitation, contribute substantially to GHG emissions as well, highlighting the importance of optimizing the management of these stages. Surprisingly, longer, not shorter maintenance intervals, yield significant emission reductions. Another counter-intuitive finding is that thicker and more material-intensive pavement surfaces cause lower emissions overall. Taken together, optimal maintenance and rehabilitation schedules, alternative material use, and vehicle electrification provide GHG reduction potentials of 11%, 4%–16% and 2%–6%, respectively.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2023

System modeling for grid-interactive efficient building applications

Despite the abundance of research applications of system modeling in grid-interactive efficient buildings (GEBs), the transfer of those applications to real-world practices is still in its early stages. This is partially due to the lack of a summary on how system modeling should be established for a given application of GEBs. Here, we fill this gap by providing an extensive survey of the literature on system modeling for different GEBs that have been produced in the past decade. This survey involves over 300 relevant journal articles from the building community, the power system community, and the society of control. Specifically, we first identified key requirements of system modeling for GEBs based on various types of applications discussed in those publications. We then summarized the system modeling applications from those publications, in terms of their assumptions, modeling approach, and simulation. After that, we analyzed different assumptions made for various applications, the extent to which those modeling approaches satisfied the key requirements, and how those approaches can be scaled up for large-scale applications, which are quite common in GEBs. In addition, we gave insights on how to use system modeling for different applications in GEBs. At the end, we provided recommended directions for future studies to fully unleash the potentials of system modeling to support GEBs.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2020

A discrete integral transform for rapid spectral synthesis

Accurate synthetic spectra that rely on large Line-By-Line (LBL)-databases are used in a wide range of applications such as high temperature combustion, atmospheric re-entry, planetary surveillance and laboratory plasmas. Conventionally synthetic spectra are calculated by computing a lineshape for every spectral line in the database and adding those together, which may take multiple hours for large databases. In this paper we propose a new approach for spectral synthesis based on an integral transform: the synthetic spectrum is calculated as the integral over the product of a Voigt profile and a newly proposed three-dimensional “lineshape distribution function”, which is a function of spectral position and Gaussian- & Lorentzian width coordinates. A fast discrete version of this transform based on the Fast Fourier Transform (FFT) is proposed, which improves performance compared to the conventional approach by several orders of magnitude while maintaining accuracy. Strategies that minimize the discretization error are discussed. A Python implementation of the method is compared against state-of-the-art spectral code RADIS, and is since adopted as RADIS's default synthesis method. The synthesis of a benchmark CO2 spectrum consisting of 1.8 M spectral lines and 200k spectral points took only 3.1 s using the proposed method (1011 lines × spectral points/s), a factor ~300 improvement over the state-of-the-art, with the relative improvement generally increasing for higher number of lines and/or number of spectral points. Finally, an experimental GPU-implementation of the method was also benchmarked, which demonstrated another 2~3 orders performance increase, achieving up to 5 ∙ 10 14 lines × spectral points/s.

42 ENGINEERING↗

DOE OSTI2022

Accelerating manufacturing for biomass conversion via integrated process and bench digitalization: a perspective

We present a perspective for accelerating biomass manufacturing via digitalization. We summarize the challenges for manufacturing and identify areas where digitalization can help. A profound potential in using lignocellulosic biomass and renewable feedstocks, in general, is to produce new molecules and products with unmatched properties that have no analog in traditional refineries. Discovering such performance-advantaged molecules and the paths and processes to make them rapidly and systematically can transform manufacturing practices. Furthermore, we discuss retrosynthetic approaches, text mining, natural language processing, and modern machine learning methods to enable digitalization. Laboratory and multiscale computation automation via active learning are crucial to complement existing literature and expedite discovery and valuable data collection without a human in the loop. Such data can help process simulation and optimization select the most promising processes and molecules according to economic, environmental, and societal metrics. We propose the close integration between bench and process scale models and data to exploit the low dimensionality of the data and transform the manufacturing for renewable feedstocks.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗