Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data- limited”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 955 records · Page 53

Preprocessing for Unintended Conducted Emissions Classification with ResNet

Characterization of Unintended Conducted Emissions (UCE) from electronic devices is important when diagnosing electromagnetic interference, performing nonintrusive load monitoring (NILM) of power systems, and monitoring electronic device health, among other applications. Prior work has demonstrated that UCE analysis can serve as a diagnostic tool for energy efficiency investigations and detailed load analysis. While explaining the feature selection of deep networks with certainty is often not fully comprehensive, or in other applications, quite lacking, additional tools/methods for further corroboration and confirmation can help further the understanding of the researcher. This is true especially in the subject application of the study in this paper. Often the focus of such efforts is the selected features themselves, and there is not as much understanding gained about the noise in the collected data. If selected feature and noise characteristics are known, it can be used to further shape the design of the deep network or associated preprocessing. This is additionally difficult when the available data are limited, as in the case which the authors investigated in this study. Here, the authors present a novel work (which is a proposed complementary portion of the overall solution to the deep network classification explainability problem for this application) by applying a systematic progression of preprocessing and a deep neural network (ResNet architecture) to classify UCE data obtained via current transformers. By using a methodical application of preprocessing techniques prior to a deep classifier, hypotheses can be produced concerning what features the deep network deems important relative to what it perceives as noise. For instance, it is hypothesized in this particular study as a result of execution of the proposed method and periodic inspection of the classifier output that the UCE spectral features are relatively close to each other or to the interferers, as systematically reducing the beta parameter of the Kaiser window produced progressively better classification performance, but only to a point, as going below the Beta of eight produced decreased classifier performance, as well as the hypothesis that further spectral feature resolution was not as important to the classifier as rejection of the leakage from a spectrally distant interference. This can be very important in unpredictable low-FNR applications, where knowing the difference between features and noise is difficult. As a side-benefit, much was learned regarding the best preprocessing to use with the selected deep network for the UCE collected from these low power consumer devices obtained via current transformers. Baseline rectangular windowed FFT preprocessing provided a 62% classification increase versus using raw samples. After performing a more optimal preprocessing, more than 90% classification accuracy was achieved across 18 low-power consumer devices for scenarios in which the in-band features-to-noise ratio (FNR) was very poor.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

[Signal Processing Suite Design]

Our role in this project was to participate in the design of the signal processing suite to analyze plasma density measurements on board a small constellation (3 or 4) satellites in Low Earth Orbit. As we are new to space craft experiments, one of the challenges was to simply gain understanding of the quantity of data which would flow from the satellites, and possibly to interact with the design teams in generating optimal sampling patterns. For example, as the fleet of satellites were intended to fly through the same volume of space (displaced slightly in time and space), the bulk plasma structure should be common among the spacecraft. Therefore, an optimal, limited bandwidth data downlink would take advantage of this commonality. Also, motivated by techniques in ionospheric radar, we hoped to investigate the possibility of employing aperiodic sampling in order to gain access to a wider spatial spectrum without suffering aliasing in k-space.

Sahr, John D.↗

Hover Performance of Isolated Proprotors and Propellers - Experimental Data

The use of Computational Fluid Dynamics (CFD) is gaining momentum within the aeronautical community. A relatively small segment of this community is applying CFD technology in the prediction of VSTOL aircraft performance. An even smaller group of engineers are refining and applying fluid dynamics solvers to the problem of predicting hover performance of helicopter rotors and proprotors designed by rotorcraft advocates. This small group of CFD engineers who are attacking the hover performance problem have, today, been using a quite limited experimental data base upon which to demonstrate their progress. This is because their concentration has been on only two successful tiltrotor flying; namely the XV-15 and the MV-22B. No attention appears (as yet) to be directed at the CL-84 or the XC-142A. The purpose of this report is to expand the experimental data base of both proprotors and propellers so that comparisons of test and various theories can be made to several more configurations of these propulsive devices used by VSTOL aircraft.

Hover↗

Uncertainty Quantification for Data-Driven Machine Learning Models in Nuclear Engineering Applications: Where We Are and What Do We Need?

Machine learning (ML) has been leveraged to tackle a diverse range of tasks in almost all branches of nuclear engineering. Many of the successes in ML applications can be attributed to the recent performance breakthroughs in deep learning, the growing availability of computational power, data, and easy-to-use ML libraries. However, these empirical successes have often outpaced our formal understanding of the ML algorithms. An important but under-rated area is uncertainty quantification (UQ) of ML. ML-based models are subject to approximation uncertainty when they are used to make predictions, due to sources including but not limited to, data noise, data coverage, extrapolation, imperfect model architecture and the stochastic training process. The goal of this paper is to clearly explain and illustrate the importance of UQ of ML. We will elucidate the differences in the basic concepts of UQ of physics-based models and data-driven ML models. Various sources of uncertainties in physical modeling and data-driven modeling will be discussed, demonstrated, and compared. We will also present and demonstrate a few techniques to quantify the ML prediction uncertainties, including Monte Carlo dropout, deep ensemble, Bayesian neural networks, Gaussian Processes and conformal prediction. Lastly, we will discuss the need for building a verification, validation and UQ framework to establish ML credibility.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Evaluating Building Energy Code Compliance and Savings Potential through Large-Scale Simulation with Models Inferred by Field Data

Building energy code compliance is the crucial link between the actual energy savings and the efficiency prescribed in energy codes. A research project aiming to identify opportunities to reduce energy consumption in new single-family residential construction by increasing compliance with the building energy code was conducted in several states of the United States. The study was comprised of three phases: (1) a baseline study to document typical practice and identify opportunities for improvement based on empirical data gathered from the field; (2) an education and training phase targeting the opportunities identified; and (3) a post-study to assess whether a reduction in average state-wide energy use could be achieved following the education and training phase. We proposed a novel methodology based on large-scale building energy simulation inferred by limited field data to assess the performance of a large population of homes. This paper presents the methodology, findings, and results of this study. The state-wide average energy consumption decreased at Phase III from Phase I for five of the seven states involved in the analysis. The measure-level savings potential analysis shows an overall reduction. Overall, the training and education phase plays a recognizable role in improving compliance with building energy codes.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Discovering CO Adsorption and Desorption Pathways from Chemical Reaction Neural Network Modeling of Transient Kinetics Spectroscopy

Here, we demonstrate a data-driven approach to interpreting surface reactions by combining time-resolved gas pulsing infrared spectroscopy with chemical reaction neural networks (CRNNs). Using CO adsorption and desorption on Pd(111) at 460–490 K as a model system, we show how transient kinetic data can reveal detailed reaction mechanisms. Starting with a simple one-species model, we systematically evaluate increasingly complex mechanisms involving hollow and bridge site adsorption. Despite the similar goodness of fit to the same experimental absorbance data, our models predict distinct coverage dynamics for different adsorption sites. Through analysis of spectral peak stability and predicted dynamics, we identify a mechanism in which CO primarily adsorbs on bridge sites followed by rapid conversion to hollow sites as being the most physically consistent with experimental observations. This work provides a framework for extracting mechanistic insights from limited experimental data, demonstrating how machine learning can bridge the gap between transient kinetic measurements and a molecular-level understanding of surface reactions.

36 MATERIALS SCIENCE↗

Using Gravitational Lensing to Probe for Candidate Quintessential Galaxies in the Epoch of Reionization

Abstract Understanding the properties of the first generation of galaxies is an ongoing challenge in observational astrophysics. James Webb Space Telescope deep-field observations have led to the identification of large numbers of galaxies within the Epoch of Reionization (EoR); however, it remains observationally challenging to study the detailed properties of the most numerous, faint high- z galaxies without strong gravitational lensing. To this end, we present five m AB ≃ 24 galaxies, all projected behind the cores of massive clusters where high lensing magnifications significantly (≳1.5 mag) boost their observed brightness. These galaxies are each characterized by a drop-off in their spectra between the near-IR and optical wavelengths, suggesting the presence of a Lyman break at z > 6. The bright sources enable precise dropout color constraints. We combine the dropout data with follow-up imaging to constrain continuum slopes redward of their breaks. Using the open-source spectral energy distribution modeling software Prospector , we characterize two of these galaxies as probable high- z ( z ∼ 6.5–7) and three as probable low- z ( z ∼ 2) sources, demonstrating that for very bright ( m AB < 24) dropout candidates even limited photometric data have good power to distinguish between high- z galaxies and red or dusty low- z galaxies. The two candidate high- z dropouts are comparably bright to the brightest galaxies identified at such redshifts in deep fields, but due to lensing magnifications are intrinsically fainter by at least 1.5 mag. If confirmed, these galaxies represent exciting laboratories for performing detailed follow-up studies of galaxy properties within the EoR.

Roberson, Joshua [University of Cincinnati] (ORCID↗

Remote sensing research in geographic education: An alternative view

It is noted that within many geography departments remote sensing is viewed as a mere technique a student should learn in order to carry out true geographic research. This view inhibits both students and faculty from investigation of remotely sensed data as a new source of geographic knowledge that may alter our understanding of the Earth. The tendency is for geographers to accept these new data and analysis techniques from engineers and mathematicians without questioning the accompanying premises. This black-box approach hinders geographic applications of the new remotely sensed data and limits the geographer's contribution to further development of remote sensing observation systems. It is suggested that geographers contribute to the development of remote sensing through pursuit of basic research. This research can be encouraged, particularly among students, by demonstrating the links between geographic theory and remotely sensed observations, encouraging a healthy skepticism concerning the current understanding of these data.

Wilson, H.↗

Tropospheric ozone - Seasonal behavior, trends, and anthropogenic influence

In the present analysis of tropospheric ozone data, attention is given to spatial and temporal variations. Two modes of seasonal behavior are noted for surface ozone at mid-latitudes: a broad summer maximum within a few hundred km of industrial/urban areas in Europe and the U.S., and a minimum in summer or autumn in sparcely populated regions that are remote from industrial activity. These and limited historical data indicate that summertime concentrations of ozone near the surface in the rural areas of Europe and the U.S. may have increased between 20 and 100 percent since the 1940s. It is suggested that the summer maximum in ozone and other observed trends are due to photochemical production associated with anthropogenic emissions of NO(x), hydrocarbons, and CO from fossil fuel combustion.

Logan, J. A.↗

Libpanda: A High Performance Library for Vehicle Data Collection

Cyber-Physical Systems (CPS) generally involve time-critical components due to physical dynamics, therefore necessitating high-performance subsystems. This is also true in data collection scenarios to infer physical phenomena. This paper covers Libpanda as an example of a component that has been designed to address performance issues in CPS implementations. Libpanda is a C++ library that interfaces software with a Comma.ai Panda device. Pandas are used for installation in modern vehicles to read the vehicle CAN bus, providing rich sensor data and limited vehicle control through message injection. The motivation to design lib-panda stems from the lack of performance in Python-based code that runs on inexpensive hardware like a Raspberry Pi. In such situations, Python code would result in utilizing 92% CPU while also dropping around 40% of the CAN packet due to bottlenecks. Without using different tools, inconsistent data collection means a loss of time-based vehicle state interpretation. Libpanda addresses these issues through implementation in a different language and implementation of different design paradigms involving asynchronous calls and multithreading. The Panda also features a GPS module that allows multiple instances to synchronize clocks for large-scale data collection scenarios. Libpanda has been designed with time-synchronization in mind to aid in the measurement of inter-vehicle dynamics. The performance improvements of libpanda have resulted in it becoming an important component in automotive dynamics research that requires a higher technical performance in large-scale experiments.

Bunting, Matthew↗

Estimating Forest Stand Height in Savannakhet, Lao PDR Using InSAR and Backscatter Methods with L-Band SAR Data

Forest stand height (FSH), or average canopy height, serves as an important indicator for forest monitoring. The information provided about above ground biomass for greenhouse gas emissions reporting, and estimating carbon storage is relevant for reporting for Reducing Emissions from Deforestation and Forest Degradation (REDD+). A novel forest height estimation method utilizing a fusion of backscatter and Interferometric Synthetic Aperture Radar (InSAR) data from JAXA’s Advanced Land Observing Satellite Phased Array type L-band Synthetic Aperture Radar (ALOS PALSAR) are applied to a use case in Savannakhet, Lao. Compared with LiDAR, the estimated height from the fusion method had an RMSE of 4.90 m and an R2 of 0.26. These results are comparable to previous studies using SAR estimation techniques. Despite limitations of data quality and quantity, the Savannakhet, Lao use case demonstrates the applicability of these techniques utilizing L-band SAR data for estimating FSH in tropical forests and can be used as a springboard for use of L-band data from the future NASA-ISRO SAR (NISAR) mission.

remote sensing↗

Amino Acid Encoding for Deep Learning Applications

Background: The number of applications of deep learning algorithms in bioinformatics is increasing as they usually achieve superior performance over classical approaches, especially, when bigger training datasets are available. In deep learning applications, discrete data, e.g. words or n-grams in language, or amino acids or nucleotides in bioinformatics, are generally represented as a continuous vector through an embedding matrix. Recently, learning this embedding matrix directly from the data as part of the continuous iteration of the model to optimize the target prediction – a process called ‘end-to-end learning’ – has led to state-ofthe-art results in many fields. Although usage of embeddings is well described in the bioinformatics literature, the potential of end-to-end learning for single amino acids, as compared to more classical manually-curated encoding strategies, has not been systematically addressed. To this end, we compared classical encoding matrices, namely one-hot, VHSE8 and BLOSUM62, to end-to-end learning of amino acid embeddings for two different prediction tasks using three widely used architectures, namely recurrent neural networks (RNN), convolutional neural networks (CNN), and the hybrid CNN-RNN. Results: By using different deep learning architectures, we show that end-to-end learning is on par with classical encodings for embeddings of the same dimension even when limited training data is available, and might allow for a reduction in the embedding dimension without performance loss, which is critical when deploying the models to devices with limited computational capacities. We found that the embedding dimension is a major factor in controlling the model performance. Surprisingly, we observed that deep learning models are capable of learning from random vectors of appropriate dimension. Conclusion: Our study shows that end-to-end learning is a flexible and powerful method for amino acid encoding. Further, due to the flexibility of deep learning systems, amino acid encoding schemes should be benchmarked against random vectors of the same dimension to disentangle the information content provided by the encoding scheme from the distinguishability effect provided by the scheme.

Hesham ElAbd↗

Amino Acid Encoding for Deep Learning Applications

Background: The number of applications of deep learning algorithms in bioinformatics is increasing as they usually achieve superior performance over classical approaches, especially, when bigger training datasets are available. In deep learning applications, discrete data, e.g. words or n-grams in language, or amino acids or nucleotides in bioinformatics, are generally represented as a continuous vector through an embedding matrix. Recently, learning this embedding matrix directly from the data as part of the continuous iteration of the model to optimize the target prediction – a process called ‘end-to-end learning’ – has led to state-of-the-art results in many fields. Although usage of embeddings is well described in the bioinformatics literature, the potential of end-to-end learning for single amino acids, as compared to more classical manually-curated encoding strategies, has not been systematically addressed. To this end, we compared classical encoding matrices, namely one-hot, VHSE8 and BLOSUM62, to end-to-end learning of amino acid embeddings for two different prediction tasks using three widely used architectures, namely recurrent neural networks (RNN), convolutional neural networks (CNN), and the hybrid CNN-RNN. Results: By using different deep learning architectures, we show that end-to-end learning is on par with classical encodings for embeddings of the same dimension even when limited training data is available, and might allow for a reduction in the embedding dimension without performance loss, which is critical when deploying the models to devices with limited computational capacities. We found that the embedding dimension is a major factor in controlling the model performance. Surprisingly, we observed that deep learning models are capable of learning from random vectors of appropriate dimension. Conclusion: Our study shows that end-to-end learning is a flexible and powerful method for amino acid encoding. Further, due to the flexibility of deep learning systems, amino acid encoding schemes should be benchmarked against random vectors of the same dimension to disentangle the information content provided by the encoding scheme from the distinguishability effect provided by the scheme.

Deep-learning↗

An efficient instance segmentation approach for studying fission gas bubbles in irradiated metallic nuclear fuel

Abstract Gaseous fission products from nuclear fission reactions tend to form fission gas bubbles of various shapes and sizes inside nuclear fuel. The behavior of fission gas bubbles dictates nuclear fuel performances, such as fission gas release, grain growth, swelling, and fuel cladding mechanical interaction. Although mechanical understanding of the overall evolution behavior of fission gas bubbles is well known, lacking the quantitative data and high-level correlation between burnup/temperature and microstructure evolution blocks the development of predictive models and reduces the possibility of accelerating the qualification for new fuel forms. Historical characterization of fission gas bubbles in irradiated nuclear fuel relied on a simple threshold method working on low-resolution optical microscopy images. Advanced characterization of fission gas bubbles using scanning electron microscopic images reveals unprecedented details and extensive morphological data, which strains the effectiveness of conventional methods. This paper proposes a hybrid framework, based on digital image processing and deep learning models, to efficiently detect and classify fission gas bubbles from scanning electron microscopic images. The developed bubble annotation tool used a multitask deep learning network that integrates U-Net and ResNet to accomplish instance-level bubble segmentation. With limited annotated data, the model achieves a recall ratio of more than 90%, a leap forward compared to the threshold method. The model has the capability to identify fission gas bubbles with and without lanthanides to better understand the movement of lanthanide fission products and fuel cladding chemical interaction. Lastly, the deep learning model is versatile and applicable to the micro-structure segmentation of similar materials.

36 MATERIALS SCIENCE↗

Multiscale-Informed Modeling of High Temperature Component Response with Uncertainty Quantification

This report summarizes a joint effort between Argonne National Laboratory, Idaho National Laboratory, and Los Alamos National Laboratory to develop and deploy constitutive models targeted at predicting the life of Grade 91 alloy components subjected to high temperature environments typical of those that structural components in advanced nuclear reactors would experience. Two distinct, but complementary constitutive modeling approaches have been taken here. The first employs a phenomenological viscoplastic model for which parameters have been calibrated based on experimental data for a wide range of Grade 91 alloy that has undergone a variety of processing. A Bayesian approach was used to derive distributions of uncertain parameters for this model based on this data set. The second approach is a reduced order model suitable for engineering-scale analysis that is based on the results of a large set of mesoscale simulations. Mesoscale models allow for the microstructure and composition of a particular alloy to be directly taken into account in the computation of the viscoplastic response, but are computationally expensive, which makes it impractical to directly call those models for the material constitutive response in an engineering-scale simulation. The reduced-order representation of the response of the underlying model used here allows for an engineering-scale model to take into account the characteristics of the underlying microstructure, while only incurring a reasonable computational expense. Both of these approaches have different strengths, and are applicable for different parts of the design/analysis process. The phenomenological models can be readily parameterized based on a set of experimental data for a given class of materials and used for scoping calculations. Once a specific material is chosen and adequately characterized, the reduced order models can accurately predict the response of that specific alloy, and because the models are based on predictive models of the underlying microstructure, they can be used to more confidently predict the response under conditions in regions where there is limited experimental data. Both of these models have been integrated in the Grizzly code, which is used here to perform proof-of-concept uncertainty quantification analyses of a simple component under prototypical conditions. The built- in stochastic analysis capabilities in the MOOSE framework that Grizzly is built on are used here to run large sets of simulations for this uncertainty quantification analysis. As would be expected, because the reduced order models are developed for a much more tightly defined alloy, they predict tighter distributions of the time to failure than the phenomenological models, which are calibrated to a broader set of data. Also important is that these simulations demonstrate that a reduced order modeling approach can be successfully deployed to propagate uncertainties from the material scale to practical engineering-scale component simulations.

42 ENGINEERING↗

Magnetization models for the source of the 'Kentucky anomaly' observed by Magsat

Both the aeromagnetic data and magnetic anomaly data obtained by Magsat indicate the presence of a very magnetic source region within the crust beneath Kentucky and Tennessee. A source model was previously developed to fit surface gravity and long-wavelength aeromagnetic data, using limited seismic constraint. For the present study the model was further developed, and it is demonstrated that the source region for the satellite anomaly is considerably more extensive than the Kentucky body sensu stricto. The extended source region is modeled using both prismatic model sources and dipole array sources. Magnetization directions for the source region found by inversion of various combinations of scalar and vector data are found to be close to the main field direction, implying the lack of a strong remanent component. It is shown by simulation that in a case (such as this) where the geometry of the source is known, if a strong remanent component is present its direction is determinable, but by scalar data as readily as vector data. Magnetization magnitude for the extended source region is about 3 A/m if the vertical extent of the source includes the whole of the crust.

Mayhew, M. A.↗

High-count rate effects in event processing for XRISM/ Resolve X-ray microcalorimeter: I. Ground test

The spectroscopic performance of an X-ray microcalorimeter is compromised at high count rates. We utilize the Resolve X-ray microcalorimeter onboard the XRISM satellite to examine the effects observed during high-count rate measurements and propose modeling approaches to mitigate them. We specifically address the following instrumental effects that impact performance: CPU limit, pile-up, and untriggered electrical cross-talk. Experimental data at high count rates were acquired during ground testing using the flight model instrument and a calibration X-ray source. In the experiment, data processing not limited by the performance of the onboard CPU was run in parallel, which cannot be done in orbit. This makes it possible to access the data degradation caused by limited CPU performance. We use these data to develop models that allow for a more accurate estimation of the aforementioned effects. To illustrate the application of these models in observation planning, we present a simulated observation of GX 13+1. Understanding and addressing these issues is crucial to enhancing the reliability and precision of X-ray spectroscopy in situations characterized by elevated count rates.

47 OTHER INSTRUMENTATION↗

Mechanical separations of corn stover anatomical fractions in an integrated feedstock preprocessing system: An experimental and data-driven modeling study

High variabilities of material attributes in lignocellulosic biomass present risks for biofuel and biochemical productions and must be mitigated via preprocessing. Since almost no mechanical device is originally designed for processing biomass, how to operate existing apparatuses with efficient performance has not been investigated extensively. This work presents a study on an integrated screening and air classification to separate cobs and stalks from husks and leaves in corn stover. Prototype machine learning models were developed to assess the feasibility of predicting the process outcome based on the measurable parameters. The models trained upon limited experimental data rendered decent predictive accuracy of yield and purity. The experimental data and modeling results collectively suggest decreasing throughput leads to a higher purity. To the contrary, if throughput increases, a lower purity is likely. A possible trade-off between yield and purity of the separated streams indicates the need for optimal combinations of feedstock size, moisture, and throughput to achieve optimized separations. The results of this study also suggest the need to further improve model predictability by developing more accurate formulations for physics governing the integrated unit operations. To accomplish this, additional experimental data needs to be generated for model training.

09 - BIOMASS FUELS↗