Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data Set”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,117 records · Page 62

Rapid detection of rare events from in situ X-ray diffraction data using machine learning

High-energy X-ray diffraction methods can non-destructively map the 3D microstructure and associated attributes of metallic polycrystalline engineering materials in their bulk form. These methods are often combined with external stimuli such as thermo-mechanical loading to take snapshots of the evolving microstructure and attributes over time. However, the extreme data volumes and the high costs of traditional data acquisition and reduction approaches pose a barrier to quickly extracting actionable insights and improving the temporal resolution of these snapshots. This article presents a fully automated technique capable of rapidly detecting the onset of plasticity in high-energy X-ray microscopy data. The technique is computationally faster by at least 50 times than the traditional approaches and works for data sets that are up to nine times sparser than a full data set. This new technique leverages self-supervised image representation learning and clustering to transform massive data sets into compact, semantic-rich representations of visually salient characteristics ( e.g. peak shapes). These characteristics can rapidly indicate anomalous events, such as changes in diffraction peak shapes. It is anticipated that this technique will provide just-in-time actionable information to drive smarter experiments that effectively deploy multi-modal X-ray diffraction methods spanning many decades of length scales.

Zheng, Weijian↗

Data volume reduction for imaging radar polarimetry

Two data reduction algorithms developed using the scattering and phase matrix approaches are described. In the scattering matrix approach, the scattering matrices of four consecutive along-track pixels are averaged and in the phase matrix approach, the phase matrices of four consecutive along-track pixels are averaged. The basic procedures necessary to generate a synthetic polarization image from original data sets are discussed. The two algorithms are evaluated in terms of data volume reduction and the number of errors introduced in the synthesized images. It is observed that the reduced data set produced by the scattering matrix algorithm is smaller than that generated by the phase matrix algorithm; however, greater errors are introduced into the data set by the scattering matrix algorithm than the phase algorithm. Flowcharts for the scattering and phase matrix approaches and for synthesis of uncompressible data are presented.

Dubois, Pascale C.↗

Model Evaluation and Intercomparison of Marine Warm Low Cloud Fractions With Neural Network Ensembles

Abstract Low cloud fractions (LCFs) and meteorological factors (MFs) over an oceanic region containing multiple cloud regimes are examined for three data sets: one Energy Exascale Earth System Model (E3SM) simulation with the default 72‐layer vertical grid (E3SM72), another one with 8‐times vertical resolution via the Framework for Improvement by Vertical Enhancement (E3SM 8), and one with MFs from ERA5 reanalysis and LCFs from the CERES SSF product (ERA5‐SSF). Neural networks (NNs) are trained to capture the relationship between MFs and LCF and to select the best‐performing MF subsets for predicting LCF. NN ensembles are used to (a) confirm the performance of selected MF subsets, (b) to serve as proxy models for each data set to predict LCFs for MFs from all data sets, and (c) to classify MFs into those in shared and uniquely occupied MF subspaces. Overall, E3SM72 and E3SM 8 have large fractions of MFs in shared MF subspace, but less so near the Californian and Peruvian stratocumulus decks. E3SM 8 and ERA5 have small fractions of MFs in shared MF subspace but greater than E3SM72 and ERA5, especially in the Southeast Pacific. The differences in LCFs between three pairs of data sets are decomposed into those associated with the differences in the LCF‐MF relationship and those involving different MFs. Given the same MFs, LCFs produced by E3SM 8 are greater than those produced by E3SM72 but are still different from those in ERA5‐SSF. In general, the shift in MFs dominates the difference in the LCFs.

54 ENVIRONMENTAL SCIENCES↗

Characteristics of space and ground based total ozone observing systems investigated by intercomparison of Nimbus 4 Backscattered Ultraviolet /BUV/ data with Dobson and M-83 results

The Nimbus 4 Backscattered Ultraviolet (BUV) experiment data has been reprocessed to provide a near global data set covering the seven years from 1970 to 1977. The data set is the result of a three year effort by the Ozone Processing Team which included review and correction of the spacecraft ephemeris, instrument calibration, and processing algorithms. The accuracy of the resulting total ozone determinations compares well with that of ground based data. An important application of the global BUV data set is to use it in determining long term trends in global total ozone. However, in order to identify long term trends in ozone, it is necessary to eliminate first long-term drift in the instrument calibration. A follow on experiment, the Solar Backscattered Ultraviolet/Total Ozone Mapping Spectrometer, (SBUV/TOMS), was flown on Nimbus 7 launched in October 1978. The SBUV provides information about both total ozone and vertical ozone profiles for a 200 km square field of view.

Fleig, A. J.↗

Active Learning for Anomaly Detection in Environmental data

Due to the growing amount of data from in-situ sensors in environmental monitoring, it becomes necessary to automatically detect anomalous data points. Nowadays, this is mainly performed using supervised machine learning models, which need a fully labelled data set for their training process. However, the process of labelling data is typically cumbersome and, as a result, a hindrance to the adoption of machine learning methods for automated anomaly detection. In this work, we propose to address this challenge by means of active learning. This method consists of querying the domain expert for the labels of only a selected subset of the full data set. We show that this reduces the time and costs associated to labelling while delivering the same or similar anomaly detection performances. Finally, we also show that machine learning models providing a nonlinear classification boundary are to be recommended for anomaly detection in complex environmental data sets.

54 ENVIRONMENTAL SCIENCES↗

Arctic Mixed-Phase Cloud Base Ice Precipitation Properties Over the NSA Site

Cloud-climate feedbacks are still the greatest source of uncertainty in current climate projections. Arctic clouds, which are predominantly stratiform and supercooled, often long-lived, and nearly continuously precipitate ice particles, contribute roughly 10% of the uncertainty attributed to the global cloud feedback. This arctic cloud uncertainty is driven by incomplete observational and theoretical knowledge required to estimate and explain the state and active processes occurring in those clouds. A focus on ice precipitation properties at arctic cloud base rather than the surface deconfounds the product of cloud condensate sink processes from the influence of the atmospheric thermodynamic state below cloud base, rendering cloud-base properties a more appealing target for inference and evaluation of model simulations. This data set provides more than 1800 samples of cloud-base ice precipitation properties over Utqiagvik, North Slope of Alaska, all of which were retrieved using the synthesis of ARM radar and lidar measurements. The retrieved ice precipitation variables in this data set include, among others, the ice number concentration, water content, PSD parameters, precipitation rate, mass-weighted fall velocity, vertical air motion, and effective radius, all of which are highly valuable for model evaluation and a general understanding of polar cloud sink processes. Each variable sample includes its mean value and associated uncertainty. Additional variables based on ARM measurements (liquid layer statistics, etc.) are included in this data set. The retrieval algorithm and analysis of this data set are described in Silber (JGR, 2023, https://doi.org/10.1029/2022JD038202).

54 ENVIRONMENTAL SCIENCES↗

Potential origin of the state-dependent high-energy tail in the black hole microquasar Cygnus X-1 as seen with INTEGRAL

Context. 0.1–10 MeV observations of the black hole microquasar Cygnus X-1 have shown the presence of a spectral feature in the form of a power law in addition to the standard black body (0.1–10 keV) and Comptonization (10–200 keV) components observed by INTEGRAL in several black-hole X-ray binaries. This so-called “high-energy tail” was recently shown to be strong in the hard spectral state of Cygnus X-1, and, in this system, has been interpreted as the high-energy part of the emission from a compact jet. Aims. This result was nevertheless obtained from a data set largely dominated by hard state observations. In the soft state, only upper limits on the presence and hence the potential parameters of a high-energy tail could be derived. Using an extended data set, we aim to obtain better constraints on the properties of this spectral component in both states. Methods. We make use of data obtained from about 15 years of observations with the INTEGRAL satellite. The data set is separated into the different states and we analyze stacked state-resolved spectra obtained from the X-ray monitors, the gamma-ray imager, and the gamma-ray spectrometer (SPI) onboard. Results. A high-energy component is detected in both states, confirming its earlier detection in the hard state and its suspected presence in the soft state with INTEGRAL, as seen in a much smaller SPI data set. We first characterize the high-energy tail components in the two states through a model-independent, phenomenological analysis. We then apply physical models based on hybrid Comptonization (eqpair and belm). The spectra are well modeled in all cases, with a similar goodness of the fits. While in the semi-phenomenological approach the high-energy tail has similar indices in both states, the fits with the physical models seem to indicate slightly different properties. Based on this approach, we discuss the potential origins of the high-energy components in both the soft and hard states, and favor an interpretation where the high-energy component is due to a compact jet in the hard state and hybrid Comptonization in either a magnetized or nonmagnetized corona in the soft state.

accretion↗

Machine Learning Approaches to Increasing Value of Spaceflight Omics Databases

The number of spaceflight bioscience mission opportunities is too small to allow all relevant biological and environmental parameters to be experimentally identified. Simulated spaceflight experiments in ground-based facilities (GBFs), such as clinostats, are each suitable only for particular investigations -- a rotating-wall vessel may be 'simulated microgravity' for cell differentiation (hours), but not DNA repair (seconds) -- and introduce confounding stimuli, such as motor vibration and fluid shear effects. This uncertainty over which biological mechanisms respond to a given form of simulated space radiation or gravity, as well as its side effects, limits our ability to baseline spaceflight data and validate mission science. Machine learning techniques autonomously identify relevant and interdependent factors in a data set given the set of desired metrics to be evaluated: to automatically identify related studies, compare data from related studies, or determine linkages between types of data in the same study. System-of-systems (SoS) machine learning models have the ability to deal with both sparse and heterogeneous data, such as that provided by the small and diverse number of space biosciences flight missions; however, they require appropriate user-defined metrics for any given data set. Although machine learning in bioinformatics is rapidly expanding, the need to combine spaceflight/GBF mission parameters with omics data is unique. This work characterizes the basic requirements for implementing the SoS approach through the System Map (SM) technique, a composite of a dynamic Bayesian network and Gaussian mixture model, in real-world repositories such as the GeneLab Data System and Life Sciences Data Archive. The three primary steps are metadata management for experimental description using open-source ontologies, defining similarity and consistency metrics, and generating testing and validation data sets. Such approaches to spaceflight and GBF omics data may soon enable unique insight into which measured phenomena correlate to biological mechanisms that are truly affected by spaceflight conditions; which are most likely to be confounded by other variables; and which are insufficiently characterized, significantly increasing existing and future science return from ISS and spaceflight missions.

Gentry, Diana↗

Compactly‐Supported Nonstationary Kernels for Computing Exact Gaussian Processes on Big Data

The Gaussian process (GP) is a widely used method for analyzing large-scale data sets, including spatio-temporal measurements of nonlinear processes that are now commonplace in the environmental sciences. Traditional implementations of GPs involve stationary kernels (also termed covariance functions) that limit their flexibility, and exact methods for inference that prevent application to data sets with more than about 10,000 points. Modern approaches to address stationarity assumptions generally fail to accommodate large data sets, while all attempts to address scalability focus on approximating the Gaussian likelihood, which can involve subjectivity and lead to inaccuracies. In this work, we explicitly derive an alternative kernel that can discover and encode both sparsity and nonstationarity. We embed the kernel within a fully Bayesian GP model and leverage high-performance computing resources to enable the analysis of massive data sets. We demonstrate the favorable performance of our novel kernel relative to existing exact and approximate GP methods across a variety of synthetic data examples. Furthermore, we conduct space–time prediction based on more than 1 million measurements of daily maximum temperature and verify that our results outperform state-of-the-art methods in the Earth sciences. More broadly, having access to exact GPs that use ultra-scalable, sparsity-discovering, nonstationary kernels allows GP methods to truly compete with a wide variety of machine learning methods.

Gaussian processes↗

Geologic mapping using integrated AIRSAR, AVIRIS, and TIMS data

The multi-sensor aircraft campaign called the 'Geologic Remote Sensing Field Experiment' (GRSFE), conducted during 1989 in the southwestern United States, collected multiple airborne remote sensing data sets and associated field and laboratory measurements. The GRSFE airborne data sets used in this study include the airborne Synthetic Aperture Radar (AIRSAR), the Airborne Visible/Infrared Imaging Spectrometer (AVIRIS), and the Thermal Infrared Multispectral Scanner (TIMS). Each sensor's unique characteristics were used for this study in a combined analysis scheme for geologic mapping. AIRSAR was used to map structures and landforms, AVIRIS was used to map mineralogy, and TIMS was used to map lithology. Visual data integration using IHS transforms and combined numerical analysis using derived geophysical and geologic parameters with 'multispectral' techniques resulted in improved geologic mapping over that possible using each data set individually.

Kruse, Fred A.↗

AJAX CABOTS Data

The Alpha Jet Atmospheric eXperiment (AJAX) airborne science project based out of NASA Ames Research Center performed eight science flights in coordination with the California Baseline Ozone Transport Study (CABOTS) campaign. Many of these flights included a series of vertical profiles (~ 0-5 km) distributed roughly along either a North/South or East/West transect. Some flights also connected the fixed-location measurements at Visalia (TOPAZ ozone lidar) and Bodega Bay (ozonesondes). AJAX measured ozone, carbon dioxide, methane, water vapor, and 3-D winds on each flight, and those in situ measurements are the basis of the data sets collected here. Trace gas data sets including time and aircraft position have been delivered as comma-separated-value text files. Meteorological data (temperature, pressure and 3-dimensional winds) are provided at 1 Hz in ICARTT-compliant text files.

Iraci, Laura T.↗

Accuracy Evaluation of Electron-Probe Microanalysis as Applied to Semiconductors and Silicates

An evaluation of precision and accuracy will be presented for representative semiconductor and silicate compositions. The accuracy of electron-probe analysis depends on high precision measurements and instrumental calibration, as well as correction algorithms and fundamental parameter data sets. A critical assessment of correction algorithms and mass absorption coefficient data sets can be made using the alpha factor technique. Alpha factor analysis can be used to identify systematic errors in data sets and also of microprobe standards used for calibration.

Carpenter, Paul↗

The CHUVA Lightning Mapping Campaign

The primary science objective for the CHUVA lightning mapping campaign is to combine measurements of total lightning activity, lightning channel mapping, and detailed information on the locations of cloud charge regions of thunderstorms with the planned observations of the CHUVA (Cloud processes of tHe main precipitation systems in Brazil: A contribUtion to cloud resolVing modeling and to the GPM (GlobAl Precipitation Measurement) field campaign. The lightning campaign takes place during the CHUVA intensive observation period October-December 2011 in the vicinity of S o Luiz do Paraitinga with Brazilian, US, and European government, university and industry participants. Total lightning measurements that can be provided by ground-based regional 2-D and 3-D total lightning mapping networks coincident with overpasses of the Tropical Rainfall Measuring Mission Lightning Imaging Sensor (LIS) and the SEVIRI (Spinning Enhanced Visible and Infrared Imager) on the Meteosat Second Generation satellite in geostationary earth orbit will be used to generate proxy data sets for the next generation US and European geostationary satellites. Proxy data, which play an important role in the pre-launch mission development and in user readiness preparation, are used to develop and validate algorithms so that they will be ready for operational use quickly following the planned launch of the GOES-R Geostationary Lightning Mapper (GLM) in 2015 and the Meteosat Third Generation Lightning Imager (LI) in 2017. To date there is no well-characterized total lightning data set coincident with the imagers. Therefore, to take the greatest advantage of this opportunity to collect detailed and comprehensive total lightning data sets, test and validate multi-sensor nowcasting applications for the monitoring, tracking, warning, and prediction of severe and high impact weather, and to advance our knowledge of thunderstorm physics, extensive measurements from lightning mapping networks will be collected in conjunction with electric field mills, field change sensors, high speed cameras and other lightning sensors, dual-polarimetric radars, and aircraft in-situ microphysics which will allow for excellent cross-network inter-comparisons, assessments, and physical understanding.

Goodman, Steven J.↗

A statistical evaluation and comparison of VISSR Atmospheric Sounder (VAS) data and corresponding rawinsonde measurements

Three mesoscale sounding data sets from the VISSR Atmospheric Sounder (VAS) produced using different retrieval techniques were evaluated of corresponding ground truth rawinsonde data for 6-7 March 1982. Mean, standard deviations, and RMS differences between the satellite and rawinsonde parameters were calculated over gridded fields in central Texas and Oklahoma. Large differences exist between each satellite data set and the ground truth data. Biases in the satellite temperature and moisture profiles seem extremely dependent upon the three dimensional structure of the atmosphere and range from 1 deg to 3 deg C for temperature and 3 deg to 6 deg C for dewpoint temperature. Atmospheric gradients of basic and derived parameters determined from the VAS data sets produced an adequate representation of the mesoscale environment but their magnitudes were often reduced by 30 to 50%.

Source record↗

Multiscale-Informed Modeling of High Temperature Component Response with Uncertainty Quantification

This report summarizes a joint effort between Argonne National Laboratory, Idaho National Laboratory, and Los Alamos National Laboratory to develop and deploy constitutive models targeted at predicting the life of Grade 91 alloy components subjected to high temperature environments typical of those that structural components in advanced nuclear reactors would experience. Two distinct, but complementary constitutive modeling approaches have been taken here. The first employs a phenomenological viscoplastic model for which parameters have been calibrated based on experimental data for a wide range of Grade 91 alloy that has undergone a variety of processing. A Bayesian approach was used to derive distributions of uncertain parameters for this model based on this data set. The second approach is a reduced order model suitable for engineering-scale analysis that is based on the results of a large set of mesoscale simulations. Mesoscale models allow for the microstructure and composition of a particular alloy to be directly taken into account in the computation of the viscoplastic response, but are computationally expensive, which makes it impractical to directly call those models for the material constitutive response in an engineering-scale simulation. The reduced-order representation of the response of the underlying model used here allows for an engineering-scale model to take into account the characteristics of the underlying microstructure, while only incurring a reasonable computational expense. Both of these approaches have different strengths, and are applicable for different parts of the design/analysis process. The phenomenological models can be readily parameterized based on a set of experimental data for a given class of materials and used for scoping calculations. Once a specific material is chosen and adequately characterized, the reduced order models can accurately predict the response of that specific alloy, and because the models are based on predictive models of the underlying microstructure, they can be used to more confidently predict the response under conditions in regions where there is limited experimental data. Both of these models have been integrated in the Grizzly code, which is used here to perform proof-of-concept uncertainty quantification analyses of a simple component under prototypical conditions. The built- in stochastic analysis capabilities in the MOOSE framework that Grizzly is built on are used here to run large sets of simulations for this uncertainty quantification analysis. As would be expected, because the reduced order models are developed for a much more tightly defined alloy, they predict tighter distributions of the time to failure than the phenomenological models, which are calibrated to a broader set of data. Also important is that these simulations demonstrate that a reduced order modeling approach can be successfully deployed to propagate uncertainties from the material scale to practical engineering-scale component simulations.

42 ENGINEERING↗

Photometric redshift-aided classification using ensemble learning

We present SHEEP, a new machine learning approach to the classic problem of astronomical source classification, which combines the outputs from the XGBoost, LightGBM, and CatBoost learning algorithms to create stronger classifiers. A novel step in our pipeline is that prior to performing the classification, SHEEP first estimates photometric redshifts, which are then placed into the data set as an additional feature for classification model training; this results in significant improvements in the subsequent classification performance. SHEEP contains two distinct classification methodologies: (i) Multi-class and (ii) one versus all with correction by a meta-learner. We demonstrate the performance of SHEEP for the classification of stars, galaxies, and quasars using a data set composed of SDSS and WISE photometry of 3.5 million astronomical sources. The resulting F1 -scores are as follows: 0.992 for galaxies; 0.967 for quasars; and 0.985 for stars. In terms of the F1-scores for the three classes, SHEEP is found to outperform a recent RandomForest-based classification approach using an essentially identical data set. Our methodology also facilitates model and data set explainability via feature importances; it also allows the selection of sources whose uncertain classifications may make them interesting sources for follow-up observations.

79 ASTRONOMY AND ASTROPHYSICS↗

PLANC: Parallel Low-rank Approximation with Nonnegativity Constraints

In this work, we consider the problem of low-rank approximation of massive dense nonnegative tensor data, for example, to discover latent patterns in video and imaging applications. As the size of data sets grows, single workstations are hitting bottlenecks in both computation time and available memory. We propose a distributed-memory parallel computing solution to handle massive data sets, loading the input data across the memories of multiple nodes, and performing efficient and scalable parallel algorithms to compute the low-rank approximation. We present a software package called Parallel Low-rank Approximation with Nonnegativity Constraints, which implements our solution and allows for extension in terms of data (dense or sparse, matrices or tensors of any order), algorithm (e.g., from multiplicative updating techniques to alternating direction method of multipliers), and architecture (we exploit GPUs to accelerate the computation in this work). We describe our parallel distributions and algorithms, which are careful to avoid unnecessary communication and computation, show how to extend the software to include new algorithms and/or constraints, and report efficiency and scalability results for both synthetic and real-world data sets.

97 MATHEMATICS AND COMPUTING↗

NASA and the U.S. climate program - A problem in data management

NASA's contribution to the total data base for the National Climate Plan will be to produce climate data sets from its experimental space observing systems and to maximize the value of these data for climate analysis and prediction. Validated data sets will be provided to NOAA for inclusion into their overall diagnostic data base. NASA data management for the Climate Plan will involve: (1) cataloging and retrieval of large integrated and distributed data sets upon user demand, and (2) the storage equivalent of 100,000 digital data tapes. It will be the largest, most complex data system ever developed by NASA

Quann, J. J.↗