Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data set”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,657 records · Page 92

A Spurious Jump in the Satellite Record: Has Antarctic Sea Ice Expansion Been Overestimated?

Recent estimates indicate that the Antarctic sea ice cover is expanding at a statistically significant rate with a magnitude one-third as large as the rapid rate of sea ice retreat in the Arctic. However, during the mid-2000s, with several fewer years in the observational record, the trend in Antarctic sea ice extent was reported to be considerably smaller and statistically indistinguishable from zero. Here, we show that much of the increase in the reported trend occurred due to the previously undocumented effect of a change in the way the satellite sea ice observations are processed for the widely used Bootstrap algorithm data set, rather than a physical increase in the rate of ice advance. Specifically, we find that a change in the intercalibration across a 1991 sensor transition when the data set was reprocessed in 2007 caused a substantial change in the long-term trend. Although our analysis does not definitively identify whether this change introduced an error or removed one, the resulting difference in the trends suggests that a substantial error exists in either the current data set or the version that was used prior to the mid- 2000s, and numerous studies that have relied on these observations should be reexamined to determine the sensitivity of their results to this change in the data set. Furthermore, a number of recent studies have investigated physical mechanisms for the observed expansion of the Antarctic sea ice cover. The results of this analysis raise the possibility that much of this expansion may be a spurious artifact of an error in the processing of the satellite observations.

Cryosphere↗

Rapid detection of rare events from in situ X-ray diffraction data using machine learning

High-energy X-ray diffraction methods can non-destructively map the 3D microstructure and associated attributes of metallic polycrystalline engineering materials in their bulk form. These methods are often combined with external stimuli such as thermo-mechanical loading to take snapshots of the evolving microstructure and attributes over time. However, the extreme data volumes and the high costs of traditional data acquisition and reduction approaches pose a barrier to quickly extracting actionable insights and improving the temporal resolution of these snapshots. This article presents a fully automated technique capable of rapidly detecting the onset of plasticity in high-energy X-ray microscopy data. The technique is computationally faster by at least 50 times than the traditional approaches and works for data sets that are up to nine times sparser than a full data set. This new technique leverages self-supervised image representation learning and clustering to transform massive data sets into compact, semantic-rich representations of visually salient characteristics ( e.g. peak shapes). These characteristics can rapidly indicate anomalous events, such as changes in diffraction peak shapes. It is anticipated that this technique will provide just-in-time actionable information to drive smarter experiments that effectively deploy multi-modal X-ray diffraction methods spanning many decades of length scales.

Zheng, Weijian↗

The 2.4 μ m Galaxy Luminosity Function as Measured Using WISE . II. Sample Selection

The WISE satellite surveyed the entire sky multiple times in four infrared (IR) wavelengths (3.4, 4.6, 12, and 22 $μ$m). This all-sky IR photometric survey makes it possible to leverage many of the large publicly available spectroscopic redshift surveys to measure galaxy properties in the IR. While characterizing the cross-matching of WISE data to a single survey is a straightforward process, doing it with six different redshift surveys takes a fair amount of space to characterize adequately, because each survey has unique caveats and characteristics that need addressing. This work describes a data set that results from matching five public redshift surveys with the AllWISE data release, along with a reanalysis of the data described in Lake et al. The combined data set has an additional flux limit of 80 $μ$Jy (19.14 AB mag) in WISE's W1 filter, imposed in order to limit it to targets with high completeness and reliable photometry in the AllWISE data set. Consistent analysis of all of the data is only possible if the color bias discussed in Ilbert et al. is addressed (e.g., the techniques explored in Lake et al.). Finally, the sample defined herein is used in a companion paper in this series to measure the luminosity function of galaxies at 2.4 μm rest-frame wavelength, and the selection process of the sample is optimized for this purpose.

79 ASTRONOMY AND ASTROPHYSICS↗

Data volume reduction for imaging radar polarimetry

Two data reduction algorithms developed using the scattering and phase matrix approaches are described. In the scattering matrix approach, the scattering matrices of four consecutive along-track pixels are averaged and in the phase matrix approach, the phase matrices of four consecutive along-track pixels are averaged. The basic procedures necessary to generate a synthetic polarization image from original data sets are discussed. The two algorithms are evaluated in terms of data volume reduction and the number of errors introduced in the synthesized images. It is observed that the reduced data set produced by the scattering matrix algorithm is smaller than that generated by the phase matrix algorithm; however, greater errors are introduced into the data set by the scattering matrix algorithm than the phase algorithm. Flowcharts for the scattering and phase matrix approaches and for synthesis of uncompressible data are presented.

Dubois, Pascale C.↗

modMine: flexible access to modENCODE data

In an effort to comprehensively characterize the functional elements within the genomes of the important model organisms Drosophila melanogaster and Caenorhabditis elegans, the NHGRI model organism Encyclopaedia of DNA Elements (modENCODE) consortium has generated an enormous library of genomic data along with detailed, structured information on all aspects of the experiments. The modMine database (http:// intermine.modencode.org) described here has been built by the modENCODE Data Coordination Center to allow the broader research community to (i) search for and download data sets of interest among the thousands generated by modENCODE; (ii) access the data in an integrated form together with non-modENCODE data sets; and (iii) facilitate fine-grained analysis of the above data. The sophisticated search features are possible because of the collection of extensive experimental metadata by the consortium. Interfaces are provided to allow both biologists and bioinformaticians to exploit these rich modENCODE data sets now available via modMine.

59 BASIC BIOLOGICAL SCIENCES↗

Model Evaluation and Intercomparison of Marine Warm Low Cloud Fractions With Neural Network Ensembles

Abstract Low cloud fractions (LCFs) and meteorological factors (MFs) over an oceanic region containing multiple cloud regimes are examined for three data sets: one Energy Exascale Earth System Model (E3SM) simulation with the default 72‐layer vertical grid (E3SM72), another one with 8‐times vertical resolution via the Framework for Improvement by Vertical Enhancement (E3SM 8), and one with MFs from ERA5 reanalysis and LCFs from the CERES SSF product (ERA5‐SSF). Neural networks (NNs) are trained to capture the relationship between MFs and LCF and to select the best‐performing MF subsets for predicting LCF. NN ensembles are used to (a) confirm the performance of selected MF subsets, (b) to serve as proxy models for each data set to predict LCFs for MFs from all data sets, and (c) to classify MFs into those in shared and uniquely occupied MF subspaces. Overall, E3SM72 and E3SM 8 have large fractions of MFs in shared MF subspace, but less so near the Californian and Peruvian stratocumulus decks. E3SM 8 and ERA5 have small fractions of MFs in shared MF subspace but greater than E3SM72 and ERA5, especially in the Southeast Pacific. The differences in LCFs between three pairs of data sets are decomposed into those associated with the differences in the LCF‐MF relationship and those involving different MFs. Given the same MFs, LCFs produced by E3SM 8 are greater than those produced by E3SM72 but are still different from those in ERA5‐SSF. In general, the shift in MFs dominates the difference in the LCFs.

54 ENVIRONMENTAL SCIENCES↗

Characteristics of space and ground based total ozone observing systems investigated by intercomparison of Nimbus 4 Backscattered Ultraviolet /BUV/ data with Dobson and M-83 results

The Nimbus 4 Backscattered Ultraviolet (BUV) experiment data has been reprocessed to provide a near global data set covering the seven years from 1970 to 1977. The data set is the result of a three year effort by the Ozone Processing Team which included review and correction of the spacecraft ephemeris, instrument calibration, and processing algorithms. The accuracy of the resulting total ozone determinations compares well with that of ground based data. An important application of the global BUV data set is to use it in determining long term trends in global total ozone. However, in order to identify long term trends in ozone, it is necessary to eliminate first long-term drift in the instrument calibration. A follow on experiment, the Solar Backscattered Ultraviolet/Total Ozone Mapping Spectrometer, (SBUV/TOMS), was flown on Nimbus 7 launched in October 1978. The SBUV provides information about both total ozone and vertical ozone profiles for a 200 km square field of view.

Fleig, A. J.↗

Active Learning for Anomaly Detection in Environmental data

Due to the growing amount of data from in-situ sensors in environmental monitoring, it becomes necessary to automatically detect anomalous data points. Nowadays, this is mainly performed using supervised machine learning models, which need a fully labelled data set for their training process. However, the process of labelling data is typically cumbersome and, as a result, a hindrance to the adoption of machine learning methods for automated anomaly detection. In this work, we propose to address this challenge by means of active learning. This method consists of querying the domain expert for the labels of only a selected subset of the full data set. We show that this reduces the time and costs associated to labelling while delivering the same or similar anomaly detection performances. Finally, we also show that machine learning models providing a nonlinear classification boundary are to be recommended for anomaly detection in complex environmental data sets.

54 ENVIRONMENTAL SCIENCES↗

OpenMSI: A High-Performance Web-Based Platform for Mass Spectrometry Imaging

Mass spectrometry imaging (MSI) enables researchers to directly probe endogenous molecules directly within the architecture of the biological matrix. Unfortunately, efficient access, management, and analysis of the data generated by MSI approaches remain major challenges to this rapidly developing field. Despite the availability of numerous dedicated file formats and software packages, it is a widely held viewpoint that the biggest challenge is simply opening, sharing, and analyzing a file without loss of information. Here we present OpenMSI, a software framework and platform that addresses these challenges via an advanced, high-performance, extensible file format and Web API for remote data access (http://openmsi.nersc.gov). The OpenMSI file format supports storage of raw MSI data, metadata, and derived analyses in a single, self-describing format based on HDF5 and is supported by a large range of analysis software (e.g., Matlab and R) and programming languages (e.g., C++, Fortran, and Python). Careful optimization of the storage layout of MSI data sets using chunking, compression, and data replication accelerates common, selective data access operations while minimizing data storage requirements and are critical enablers of rapid data I/O. The OpenMSI file format has shown to provide >2000-fold improvement for image access operations, enabling spectrum and image retrieval in less than 0.3 s across the Internet even for 50 GB MSI data sets. To make remote high-performance compute resources accessible for analysis and to facilitate data sharing and collaboration, we describe an easy-to-use yet powerful Web API, enabling fast and convenient access to MSI data, metadata, and derived analysis results stored remotely to facilitate high-performance data analysis and enable implementation of Web based data sharing, visualization, and analysis.

59 BASIC BIOLOGICAL SCIENCES↗

Arctic Mixed-Phase Cloud Base Ice Precipitation Properties Over the NSA Site

Cloud-climate feedbacks are still the greatest source of uncertainty in current climate projections. Arctic clouds, which are predominantly stratiform and supercooled, often long-lived, and nearly continuously precipitate ice particles, contribute roughly 10% of the uncertainty attributed to the global cloud feedback. This arctic cloud uncertainty is driven by incomplete observational and theoretical knowledge required to estimate and explain the state and active processes occurring in those clouds. A focus on ice precipitation properties at arctic cloud base rather than the surface deconfounds the product of cloud condensate sink processes from the influence of the atmospheric thermodynamic state below cloud base, rendering cloud-base properties a more appealing target for inference and evaluation of model simulations. This data set provides more than 1800 samples of cloud-base ice precipitation properties over Utqiagvik, North Slope of Alaska, all of which were retrieved using the synthesis of ARM radar and lidar measurements. The retrieved ice precipitation variables in this data set include, among others, the ice number concentration, water content, PSD parameters, precipitation rate, mass-weighted fall velocity, vertical air motion, and effective radius, all of which are highly valuable for model evaluation and a general understanding of polar cloud sink processes. Each variable sample includes its mean value and associated uncertainty. Additional variables based on ARM measurements (liquid layer statistics, etc.) are included in this data set. The retrieval algorithm and analysis of this data set are described in Silber (JGR, 2023, https://doi.org/10.1029/2022JD038202).

54 ENVIRONMENTAL SCIENCES↗

Potential origin of the state-dependent high-energy tail in the black hole microquasar Cygnus X-1 as seen with INTEGRAL

Context. 0.1–10 MeV observations of the black hole microquasar Cygnus X-1 have shown the presence of a spectral feature in the form of a power law in addition to the standard black body (0.1–10 keV) and Comptonization (10–200 keV) components observed by INTEGRAL in several black-hole X-ray binaries. This so-called “high-energy tail” was recently shown to be strong in the hard spectral state of Cygnus X-1, and, in this system, has been interpreted as the high-energy part of the emission from a compact jet. Aims. This result was nevertheless obtained from a data set largely dominated by hard state observations. In the soft state, only upper limits on the presence and hence the potential parameters of a high-energy tail could be derived. Using an extended data set, we aim to obtain better constraints on the properties of this spectral component in both states. Methods. We make use of data obtained from about 15 years of observations with the INTEGRAL satellite. The data set is separated into the different states and we analyze stacked state-resolved spectra obtained from the X-ray monitors, the gamma-ray imager, and the gamma-ray spectrometer (SPI) onboard. Results. A high-energy component is detected in both states, confirming its earlier detection in the hard state and its suspected presence in the soft state with INTEGRAL, as seen in a much smaller SPI data set. We first characterize the high-energy tail components in the two states through a model-independent, phenomenological analysis. We then apply physical models based on hybrid Comptonization (eqpair and belm). The spectra are well modeled in all cases, with a similar goodness of the fits. While in the semi-phenomenological approach the high-energy tail has similar indices in both states, the fits with the physical models seem to indicate slightly different properties. Based on this approach, we discuss the potential origins of the high-energy components in both the soft and hard states, and favor an interpretation where the high-energy component is due to a compact jet in the hard state and hybrid Comptonization in either a magnetized or nonmagnetized corona in the soft state.

accretion↗

Fourier-transform spectroscopy and potential construction of the (2){sup 1}Π state in KCs

The paper presents an empirical pointwise potential energy curve (PEC) of the (2){sup 1}Π state of the KCs molecule constructed by applying the Inverted Perturbation Approach routine. The experimental term values in the energy range E(v′, J′) ∈ [15 407; 16 579] cm{sup −1} involved in the fit were based on Fourier-Transform spectroscopy data obtained with 0.01 cm{sup −1} accuracy from the laser-induced (2){sup 1}Π → X{sup 1}Σ{sup +} fluorescence spectra. Buffer gas Ar was used to facilitate the appearance of rotation relaxation lines in the spectra, thus enlarging the (2){sup 1}Π data set and allowing determination of the Λ-splitting constants. The data set included vibrational v′ ∈ [0, 28] and rotational J′ ∈ [7, 274] quantum numbers covering about 67% of the potential well. The present PEC reproduces the overall set of data included in the fit with a standard deviation of 0.5 cm{sup −1}. The obtained value of the Λ-doubling constant q = + 1.8 × 10{sup −6} cm{sup −1} for J′ > 50 and v′ ∈ [0, 6] is in an excellent agreement with q = + 1.84 × 10{sup −6} cm{sup −1} reported in Kim, Lee, and Stolyarov [J. Mol. Spectrosc. 256, 57-67 (2009)].

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Machine Learning Approaches to Increasing Value of Spaceflight Omics Databases

The number of spaceflight bioscience mission opportunities is too small to allow all relevant biological and environmental parameters to be experimentally identified. Simulated spaceflight experiments in ground-based facilities (GBFs), such as clinostats, are each suitable only for particular investigations -- a rotating-wall vessel may be 'simulated microgravity' for cell differentiation (hours), but not DNA repair (seconds) -- and introduce confounding stimuli, such as motor vibration and fluid shear effects. This uncertainty over which biological mechanisms respond to a given form of simulated space radiation or gravity, as well as its side effects, limits our ability to baseline spaceflight data and validate mission science. Machine learning techniques autonomously identify relevant and interdependent factors in a data set given the set of desired metrics to be evaluated: to automatically identify related studies, compare data from related studies, or determine linkages between types of data in the same study. System-of-systems (SoS) machine learning models have the ability to deal with both sparse and heterogeneous data, such as that provided by the small and diverse number of space biosciences flight missions; however, they require appropriate user-defined metrics for any given data set. Although machine learning in bioinformatics is rapidly expanding, the need to combine spaceflight/GBF mission parameters with omics data is unique. This work characterizes the basic requirements for implementing the SoS approach through the System Map (SM) technique, a composite of a dynamic Bayesian network and Gaussian mixture model, in real-world repositories such as the GeneLab Data System and Life Sciences Data Archive. The three primary steps are metadata management for experimental description using open-source ontologies, defining similarity and consistency metrics, and generating testing and validation data sets. Such approaches to spaceflight and GBF omics data may soon enable unique insight into which measured phenomena correlate to biological mechanisms that are truly affected by spaceflight conditions; which are most likely to be confounded by other variables; and which are insufficiently characterized, significantly increasing existing and future science return from ISS and spaceflight missions.

Gentry, Diana↗

Compactly‐Supported Nonstationary Kernels for Computing Exact Gaussian Processes on Big Data

The Gaussian process (GP) is a widely used method for analyzing large-scale data sets, including spatio-temporal measurements of nonlinear processes that are now commonplace in the environmental sciences. Traditional implementations of GPs involve stationary kernels (also termed covariance functions) that limit their flexibility, and exact methods for inference that prevent application to data sets with more than about 10,000 points. Modern approaches to address stationarity assumptions generally fail to accommodate large data sets, while all attempts to address scalability focus on approximating the Gaussian likelihood, which can involve subjectivity and lead to inaccuracies. In this work, we explicitly derive an alternative kernel that can discover and encode both sparsity and nonstationarity. We embed the kernel within a fully Bayesian GP model and leverage high-performance computing resources to enable the analysis of massive data sets. We demonstrate the favorable performance of our novel kernel relative to existing exact and approximate GP methods across a variety of synthetic data examples. Furthermore, we conduct space–time prediction based on more than 1 million measurements of daily maximum temperature and verify that our results outperform state-of-the-art methods in the Earth sciences. More broadly, having access to exact GPs that use ultra-scalable, sparsity-discovering, nonstationary kernels allows GP methods to truly compete with a wide variety of machine learning methods.

Gaussian processes↗

Geologic mapping using integrated AIRSAR, AVIRIS, and TIMS data

The multi-sensor aircraft campaign called the 'Geologic Remote Sensing Field Experiment' (GRSFE), conducted during 1989 in the southwestern United States, collected multiple airborne remote sensing data sets and associated field and laboratory measurements. The GRSFE airborne data sets used in this study include the airborne Synthetic Aperture Radar (AIRSAR), the Airborne Visible/Infrared Imaging Spectrometer (AVIRIS), and the Thermal Infrared Multispectral Scanner (TIMS). Each sensor's unique characteristics were used for this study in a combined analysis scheme for geologic mapping. AIRSAR was used to map structures and landforms, AVIRIS was used to map mineralogy, and TIMS was used to map lithology. Visual data integration using IHS transforms and combined numerical analysis using derived geophysical and geologic parameters with 'multispectral' techniques resulted in improved geologic mapping over that possible using each data set individually.

Kruse, Fred A.↗

AJAX CABOTS Data

The Alpha Jet Atmospheric eXperiment (AJAX) airborne science project based out of NASA Ames Research Center performed eight science flights in coordination with the California Baseline Ozone Transport Study (CABOTS) campaign. Many of these flights included a series of vertical profiles (~ 0-5 km) distributed roughly along either a North/South or East/West transect. Some flights also connected the fixed-location measurements at Visalia (TOPAZ ozone lidar) and Bodega Bay (ozonesondes). AJAX measured ozone, carbon dioxide, methane, water vapor, and 3-D winds on each flight, and those in situ measurements are the basis of the data sets collected here. Trace gas data sets including time and aircraft position have been delivered as comma-separated-value text files. Meteorological data (temperature, pressure and 3-dimensional winds) are provided at 1 Hz in ICARTT-compliant text files.

Iraci, Laura T.↗

Accuracy Evaluation of Electron-Probe Microanalysis as Applied to Semiconductors and Silicates

An evaluation of precision and accuracy will be presented for representative semiconductor and silicate compositions. The accuracy of electron-probe analysis depends on high precision measurements and instrumental calibration, as well as correction algorithms and fundamental parameter data sets. A critical assessment of correction algorithms and mass absorption coefficient data sets can be made using the alpha factor technique. Alpha factor analysis can be used to identify systematic errors in data sets and also of microprobe standards used for calibration.

Carpenter, Paul↗

The CHUVA Lightning Mapping Campaign

The primary science objective for the CHUVA lightning mapping campaign is to combine measurements of total lightning activity, lightning channel mapping, and detailed information on the locations of cloud charge regions of thunderstorms with the planned observations of the CHUVA (Cloud processes of tHe main precipitation systems in Brazil: A contribUtion to cloud resolVing modeling and to the GPM (GlobAl Precipitation Measurement) field campaign. The lightning campaign takes place during the CHUVA intensive observation period October-December 2011 in the vicinity of S o Luiz do Paraitinga with Brazilian, US, and European government, university and industry participants. Total lightning measurements that can be provided by ground-based regional 2-D and 3-D total lightning mapping networks coincident with overpasses of the Tropical Rainfall Measuring Mission Lightning Imaging Sensor (LIS) and the SEVIRI (Spinning Enhanced Visible and Infrared Imager) on the Meteosat Second Generation satellite in geostationary earth orbit will be used to generate proxy data sets for the next generation US and European geostationary satellites. Proxy data, which play an important role in the pre-launch mission development and in user readiness preparation, are used to develop and validate algorithms so that they will be ready for operational use quickly following the planned launch of the GOES-R Geostationary Lightning Mapper (GLM) in 2015 and the Meteosat Third Generation Lightning Imager (LI) in 2017. To date there is no well-characterized total lightning data set coincident with the imagers. Therefore, to take the greatest advantage of this opportunity to collect detailed and comprehensive total lightning data sets, test and validate multi-sensor nowcasting applications for the monitoring, tracking, warning, and prediction of severe and high impact weather, and to advance our knowledge of thunderstorm physics, extensive measurements from lightning mapping networks will be collected in conjunction with electric field mills, field change sensors, high speed cameras and other lightning sensors, dual-polarimetric radars, and aircraft in-situ microphysics which will allow for excellent cross-network inter-comparisons, assessments, and physical understanding.

Goodman, Steven J.↗