SEARCH · Engineering Papers

Results for “preprocessed”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 883 records · Page 49

All sources NASA NTRS DOE OSTI

NASA NTRSDate not supplied

Exploring Flooded Fraction Prediction through Machine Learning Models Focusing on Medical Infrastructure in the Southeast U.S. Coastal Areas

Rising sea levels due to climate change increasingly threaten medical infrastructure through flooding. This study develops machine learning models to predict flood exposure for 11,508 medical facilities in the southeastern coastal regions of the United States by integrating datasets including meteorological, hydrological, topographic, and geological data, the Natural Risk Index, and historical flood records from NASA, HIFLD, and FEMA. Six regression models, namely Linear Regression, Support Vector Regression, Random Forest, k-Nearest Neighbors, XGBoost, and Artificial Neural Networks, are trained using 16 explanatory variables identified through literature review and correlation analysis. Data preprocessing employs the SMOGN for class imbalance and Winsorization for outliers. Model performance is evaluated using MAE, MSE, and RMSE, with Random Forest and XGBoost models achieving the highest performance (MSE of 2.58e-5 and 3.69e-5, respectively). This multifactorial approach allows the models to capture complex flood-influencing relationships, enhancing adaptability and performance across geographic regions. Future work focuses on expanding across the U.S. and developing a near real-time flood monitoring system.

Jihoon Chung↗

NASA NTRSDate not supplied

Predicting Team Functioning in Long Term Space Missions Using Acoustic and Linguistic Measures

Maintaining optimal team functioning is critical for long-duration space exploration missions, yet traditional monitoring methods, such as self-reports and wearable sensors, often impose operational burdens or suffer from bias. This paper investigates a non-intrusive speech-based artificial intelligence (AI) framework to predict degradations in team functioning using data from the Human Exploration Research Analog (HERA) of the U.S. National Aeronautics and Space Administration (NASA). Using acoustic features, linguistic descriptors, and semantic embeddings, we evaluate static non-linear and temporal machine learning models to predict both objective (task accuracy) and subjective (self-reported efficacy and cohesion) team functioning outcomes. Results indicate that temporal models outperform static approaches, with prediction of objective task accuracy in Team Interaction Battery (TIB) improving from near chance to 71%. Self-reported outcomes, including team efficacy and cohesion, are predicted more reliably than task performance, achieving balanced accuracies of up to 85.56% and 78.12%, respectively, and are found to be most strongly associated with acoustic features. In a second interdependent task, the MMSEV–EVA, accuracies of up to 78% are achieved using temporal models with acoustic features. Furthermore, incorporating just 1–2 days of team-specific historical data systematically improved performance, and acoustic markers from informal pre-task interactions provided modest predictive gains. Finally, while automated preprocessing yielded viable accuracy, humancorrected data provided moderate performance gains, though transcription error rates did not significantly correlate with model performance. These findings highlight the potential of speech as a passive, high-fidelity monitoring tool for autonomous habitats.

Temporal modeling↗

DOE OSTI2020

On Performance Prediction of Big Data Transfer in High-performance Networks

Big data generated by large-scale scientific and industrial applications need to be transferred between different geographical locations for remote storage, processing, and analysis. High-speed dedicated connections provisioned in High-performance Networks (HPNs) are increasingly utilized to carry out such big data transfer. HPN management highly relies on an important capability of performance (mainly throughput) prediction to reserve sufficient bandwidth and meanwhile avoid over-provisioning that may result in unnecessary resource waste. This capability is critical to improving the resource (mainly bandwidth) utilization of dedicated connections and meeting various user requests for data transfer. Conventional methods conduct performance prediction by fitting prior observed transfer history with predefined loss functions, without considering unobservable latent factors such as competing loads on end hosts. Such latent factors also have a significant impact on the application-level data transfer performance, which may result in an inaccurate prediction model. In this paper, we first investigate the impact of latent factors and propose a clustering-based method to eliminate their negative impact on performance prediction. We then develop a robust machine learning-based performance predictor by: i) incorporating the proposed latent factor elimination method into data preprocessing, and ii) adopting a customized domain guided loss function. Extensive experimental results show that our predictor achieves significantly higher prediction accuracy than several other state-of-the-art methods.

Liu, Wuji↗

DOE OSTI2020

Performance Prediction of Big Data Transfer Through Experimental Analysis and Machine Learning

Big data transfer in next-generation scientific applications is now commonly carried out over connections with guaranteed bandwidth provisioned in High-performance Networks (HPNs) through advance bandwidth reservation. To use HPN resources efficiently, provisioning agents need to carefully schedule data transfer requests and allocate appropriate bandwidths. Such reserved bandwidths, if not fully utilized by the requesting user, could be simply wasted or cause extra overhead and complexity in management due to exclusive access. This calls for the capability of performance prediction to reserve bandwidth resources that match actual needs. Towards this goal, we employ machine learning algorithms to predict big data transfer performance based on extensive performance measurements, which are collected over a span of several years from a large number of data transfer tests using different protocols and toolkits between various end sites on several real-life physical or emulated HPN testbeds. We first identify a comprehensive list of attributes involved in a typical big data transfer process, including end host system configurations, network connection properties, and control parameters of data transfer methods. We then conduct an in-depth exploratory analysis of their impacts on application-level throughput, which provides insights into big data transfer performance and motivates the use of machine learning. We also investigate the applicability of machine learning algorithms and derive their general performance bounds for performance prediction of big data transfer in HPNs. Experimental results show that, with appropriate data preprocessing, the proposed machine learning-based approach achieves 95% or higher prediction accuracy in up to 90% of the cases with very noisy real-life performance measurements.

Yun, Daqing↗

DOE OSTI2020

Performance Prediction of Big Data Transfer Through Experimental Analysis and Machine Learning

Big data transfer in next-generation scientific ap- plications is now commonly carried out over connections with guaranteed bandwidth provisioned in High-performance Net- works (HPNs) through advance bandwidth reservation. To use HPN resources efficiently, provisioning agents need to carefully schedule data transfer requests and allocate appropriate band- widths. Such reserved bandwidths, if not fully utilized by the requesting user, could be simply wasted or cause extra overhead and complexity in management due to exclusive access. This calls for the capability of performance prediction to reserve bandwidth resources that match actual needs. Towards this goal, we employ machine learning algorithms to predict big data transfer perfor- mance based on extensive performance measurements, which are collected over a span of several years from a large number of data transfer tests using different protocols and toolkits between various end sites on several real-life physical or emulated HPN testbeds. We first identify a comprehensive list of attributes involved in a typical big data transfer process, including end host system configurations, network connection properties, and control parameters of data transfer methods. We then conduct an in-depth exploratory analysis of their impacts on application- level throughput, which provides insights into big data transfer performance and motivates the use of machine learning. We also investigate the applicability of machine learning algorithms and derive their general performance bounds for performance prediction of big data transfer in HPNs. Experimental results show that, with appropriate data preprocessing, the proposed machine learning-based approach achieves 95% or higher pre- diction accuracy in up to 90% of the cases with very noisy real-life performance measurements.

Yun, Daqing↗

DOE OSTI2020

Optical array for high-quality imaging in harsh environments

Methods and apparatus are disclosed for producing high quality images in uncontrolled or impaired environments. In some examples of the disclosed technology, groups of cameras for high dynamic range (HDR), polarization diversity, and optional other diversity modes are arranged to concurrently image a common scene. For example, in a vehicle checkpoint application, HDR provides discernment of dark objects inside a vehicle, while polarization diversity aids in rejecting glare. Spectral diversity, infrared imaging, and active illumination can be applied for better imaging through a windshield. Preprocessed single-camera images are registered and fused. Faces or other features of interest can be detected in the fused image and identified in a library. Impairments can include weather, insufficient or interfering lighting, shadows, reflections, window glass, occlusions, or moving objects.

42 ENGINEERING↗

DOE OSTI2020

Anatomical Fraction segmentation in the biomass bales

The U.S. Department of Energy Bioenergy Technologies Office (BETO) is committed to the development of sustainable, nationwide, commercial biofuel production to displace petroleum-derived fuels, increase domestic energy production, and encourage the creation of a domestic bioenergy and bioproducts industry. Operating a commercial-scale bioenergy operation requires significant technological advancements for determining biomass feedstock quality during the preprocessing stage. Usage of non-food feedstocks- e.g., corn-stover, pine residue, and forest residue - at the biorefineries reduces strain on the food supply chain. But the non-food feedstock heterogeneity- physical size, shape, and chemical composition-poses a significant challenge during milling, conveyance, feeding, and biofuel conversion processes. 3D X-Ray imaging (CT) is capable of distinguishing material features by detecting density and compositional differences. But the inherent complexity introduced during harvesting and bailing makes the reconstruction and interpretation of baled biomass materials from x-ray data time consuming, laborious, and expensive. Feedstocks are low-density materials that produce small contrast differences in the x-ray images. This paper focuses on using the shape and texture properties, using 3D image processing techniques like 3D skeletonization, directional statistics to characterize and extract volumetric content of the different tissue samples in the biomass bales.

09 BIOMASS FUELS↗

DOE OSTI2020

FLEET: Flexible Efficient Ensemble Training for Heterogeneous Deep Neural Networks

Parallel training of an ensemble of Deep Neural Networks (DNN) on a cluster of nodes is an effective approach to shorten the process of neural network architecture search and hyper-parameter tuning for a given learning task. Prior efforts have shown that data sharing, where the common preprocessing operation is shared across the DNN training pipelines, saves computational resources and improves pipeline efficiency. Data sharing strategy, however, performs poorly for a heterogeneous set of DNNs where each DNN has varying computational needs and thus different training rate and convergence speed. This paper proposes FLEET, a flexible ensemble DNN training framework for efficiently training a heterogeneous set of DNNs. We build FLEET via several technical innovations. We theoretically prove that an optimal resource allocation is NP-hard and propose a greedy algorithm to efficiently allocate resources for training each DNN with data sharing. We integrate data-parallel DNN training into ensemble training to mitigate the differences in training rates and introduce checkpointing into this context to address the issue of different convergence speeds. Experiments show that FLEET significantly improves the training efficiency of DNN ensembles without compromising the quality of the result.

Guan, Hui↗

DOE OSTI2021

Torrefaction of Sorted MSW Pellets for Uniform Biopower Feedstock

The project objective is to use advanced compositional and thermophysical characterization methods from INL to support the evaluation of new production pathways (partnered with MTU) to biopower applications under the guidance of an industrial partner operating the in U.S. power sector (CE). Ultimately, this project aims to create a uniform feedstock from non-recyclable wastes that can be used in bioenergy and biomaterials, which torrefaction and preprocessing strategies are critical to achieving this goal.

09 BIOMASS FUELS↗

DOE OSTI2021

Feedstock Harvesting and Storage: Post-Harvest Management for Quality Preservation

Research on harvesting, collection, and storage has matured, and our understanding of feedstock supply challenges has led us to the point of our current goals. The goals of this project include using storage time to collect impactful data of critical feedstock properties in storage and to characterize the feedstock before delivery. This data will inform delivery scheduling of biomass and relevant compositional information to minimize variations in the material quality, which are critical to the preprocessing and conversion performance.

09 BIOMASS FUELS↗

DOE OSTI2022

A Comparison of Machine Learning Methods for Frequency Nadir Estimation in Power Systems: Preprint

An increasing penetration level of inverter-based renewable energy resources changes the inertia of power systems, posing challenges for maintaining the desired system frequency stability. An accurate frequency nadir estimation is crucial for power system operators to prepare preventive actions against large frequency excursions. In this paper, five machine learning methods - linear regression, gradient boosting, support vector regression, an artificial neural network, and XGBoost - are applied to two different sets of preprocess data for the prediction of the frequency nadir in the Western Electricity Coordinating Council 240-bus system with high renewable penetration levels. The training and testing data sets are collected by extensive generation scheduling simulations on the Multi-timescale Integrated Dynamic and Scheduling (MIDAS) toolbox. Numerical results show that all five machine learning methods can achieve high performance accuracy for power system nadir frequency estimation. Among them, the gradient boosting and the XGBoost are clear winners by providing the best prediction accuracy.

data driven↗

DOE OSTI2022

CANShield: Signal-based Intrusion Detection for Controller Area Networks

Modern vehicles rely on complex cyber-physical systems made up of hundreds of electronic control units (ECUs) connected through controller area network (CAN) buses. However, the CAN bus attack surface is increasing due to advanced features in automobiles, making it prone to injection attacks. The ordinary injection attacks disrupt the typical timing properties of the CAN data stream, and the rule-based intrusion detection systems (IDS) can easily detect them. However, advanced attackers can inject false data to the signal level, maintaining the regular pattern/frequency of the CAN messages. Such attacks can bypass the rule-based IDS or any anomaly-based IDS built on binary payload data. To make the vehicles robust against such intelligent attacks, we propose CANShield, a signal-based intrusion detection framework for the CAN bus that consists of three modules. A data preprocessing module handles the high-dimensional CAN data stream at the signal level and make them suitable for any machine learning model. A data analyzer module consists of multiple deep autoencoder networks, each analyzing the time series data from a different perspective. Finally, an attack detection module uses an ensemble method to make the final decision. Evaluation results on a standard signal-based dataset show the effectiveness of the CANShield in detecting five advanced attacks.

Shahriar, Md Hasan↗

DOE OSTI2023

Improving the Quality of Geothermal Data Through Data Standards and Pipelines Within the Geothermal Data Repository: Preprint

For machine learning outputs to be applicable to real world problems, high quality data are needed to ensure high quality results. With the more recent emphasis on machine learning in geothermal, there is an increasing need for greater focus on the quality of the data available for use in these projects. For example, Geothermal Operational Optimization Using Machine Learning (GOOML) utilized large quantities of geothermal power plant operational data to inform power plant operational configurations to maximize power generation. High quality datasets result from dependable sensors or devices collecting data, high frequency of measurements, sufficient data points, adequate metadata, reliable storage of data, and sufficient data curation. Another component that contributes to high quality data is reusability, which can be enhanced through data standardization. Data Standardization creates consistency in formatting and contents of like datasets, lessening preprocessing requirements and ensuring adequate information provided by a given dataset. The Geothermal Data Repository (GDR) aims to help improve data quality through automated data standardization for high-value datasets through the implementation of data pipelines alongside reliable and accessible long-term storage for datasets. As such, the GDR has decided to shift away from recommending the use of Excel-based content models and towards the implementation of automated data pipelines. This takes the burden of data standardization off the user and project team and will increase the availability of standardized geothermal data available through the GDR. A set of recommendations, or a data standard for each data type will exist with each data pipeline in order to advise data collection for maximum usability for future research. This paper serves to describe the GDR's proposed transition towards data standardization through automated data pipelines, to discuss the need for and value of such a shift, and to call for suggestions from the community regarding the most useful data standards and pipelines.

data↗

DOE OSTI2023

Optical array for high-quality imaging in harsh environments

Baba, Justin S.↗

DOE OSTI2023

Failure Mode and Effects Analysis Summary Report

This report provides an overview of the development of failure modes and effects analysis (FMEA) and its implementation as a systematic criticality and risk assessment tool supporting a quality by design (QbD) approach for FCIC research. This report also provides a high-level overview of the results for the FMEA evaluation of two feedstock preprocessing system configurations: (1) generation of pine residue materials for high-temperature pyrolysis conversion and (2) generation of corn stover materials for low-temperature conversion using deacetylation and disc mechanical refining pretreatment for fermentation to hydrocarbons. For the results presented in this report, our FMEA interviews included two approaches. The first approach was to perform FMEA interviews for the entire system of unit operations giving a wholistic system level view. The second approach consisted of detailed interviews for each individual unit operation within the system allowing for a “deep dive” into the specific failures for the individual components within the configuration. These two approaches provide different resolutions of information. The FMEA results of this report were focused on failures associated with meeting critical quality attributes (CQAs) identified for the target conversion processes for each processed feedstock type. The information gathered through the FMEA interviews include estimations of risk scores for meeting each given CQA specification, identification of the impacts for not meeting a CQA specification, capturing causes associated with material attributes and process parameters for each failure, identification of current detection methods, and speculation of potential mitigation strategies for decreasing a failure’s risk score. The complete results of all FMEA interviews are provided in the Appendices of this report.

conversion↗

DOE OSTI2023

Sensor Anomaly Detection for Nuclear Reactor Systems Utilizing Linear Regression and K-Means Unsupervised Machine Learning

Nuclear reactors and related systems are becoming increasingly complex due to advancing technologies in next-generation power reactors. This increased complexity necessitates enhanced automation and data management capabilities. To successfully realize autonomous systems, methods must be developed to handle vast volumes of data and effectively distinguish anomalous data from noise and expected data. While impressive models utilizing digital twins and similar approaches are under development, here we propose a simplified model for analyzing fundamental methods and techniques. Initially, we created a general dataset by using initial data from PCTRAN in order to represent ideal steady-state conditions. We then inserted anomalies based on prevalent sensor anomaly types (e.g., point anomalies, linear drift, and downward deviations), along with unusual anomalies such as exponential drift and upward deviations. To detect anomalies, we developed a program that employs data partitioning and linear regression to preprocess and filter the anomalous data. A K-Means machine learning (ML) method was then applied to separate and count the data within the anomalous partition. The results from all datasets—apart from exponential growth—demonstrated positive outcomes, with each returning multiple instances of greaterthan-95% accuracy. We conducted further investigations using Idaho National Laboratory’s RAVEN software to perform a sensitivity analysis on the input variables (R 2 Tolerance, Slope Tolerance, and Window Size) and found that the output variables (Accuracy and Time) were most sensitive to the Window Size. Despite the promising results published, further development is required to effectively apply these methods to nuclear systems. Nevertheless, the strengths of this approach are evident and hold promise for future applications in the field.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

DOE OSTI2023

Comparative Techno-Economic Analysis of Available Feedstocks for High-Temperature Conversion: Whole Tree Thinnings and Mature Pine Residues

The techno-economic and life cycle implications of utilizing low-cost feedstocks in a high temperature conversion process are of great interest. Here, we investigate the conversion cost impacts of two underutilized feedstocks from the commercial pine industry: 13-year-old whole trees, representing trees removed for the purpose of precommercial thinning, and 23-year-old pine residues, representing a waste stream produced from the deconstruction of mature trees for other purposes. Experimental fast pyrolysis (FP) yields for each feedstock were adjusted to a catalytic fast pyrolysis (CFP) basis and used to estimate process economics by employing published correlations based on rigorous techno-economic modeling. These correlations were used in tandem with results from supply and preprocessing analyses to evaluate the field-to-fuel economics of each feedstock. A small difference in minimum fuel selling price (MFSP) was found between the conversion costs for the two feedstocks, with 23-year-old residues demonstrating a net benefit of $0.27 per gasoline gallon equivalent (GGE) compared to the 13- year-old whole tree thinnings, driven primarily by feedstock supply costs. This suggests that both whole tree thinnings and pine residues may be viable feedstock options for CFP conversion. Life cycle inventories (LCIs) were also generated for each case, enabling a field-to-fuel quantification of the cost and carbon cycle associated with each feedstock.

catalytic fast pyrolysis↗

DOE OSTI2024

Biomass Attributes and Attribute Modifications Affecting Systems and Methods to Separate and Fractionate. In: Handbook of Biorefinery Research and Technology

Chemical and physical heterogeneity in biomass feedstocks such as agricultural or forestry residues is due to substantial differences in plant tissue types. These differences can contribute significant challenges to handling, preprocessing, and conversion in biorefining processes. An understanding of this chemical and physical heterogeneity can be used to inform fractionation technologies that could facilitate more streamlined processing and potentially be employed to yield multiple co-product streams for a single feedstock. In this chapter, the motivation and scope of biomass fractionation is first outlined. Physical and chemical properties of biomass feedstocks, along with their distribution and diversity within plants is next discussed with respect to how these differences can be exploited in a fractionation process. A summary of some of the key physical principles that allow for fractionation is next covered along with how these physical principles are exploited in equipment designs. Examples from the literature are briefly discussed that highlight how these approaches can be employed to achieve processing objectives. Several case studies on physical fractionation of corn stover and forestry residues are presented that illustrate how integrated fractionation processes could be employed. Finally, prospects and potential economic drivers for adoption of biomass fractionation technologies are discussed.

Biomass chemical properties↗