Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “evaluation datasets”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 667 records · Page 37

DS-GL: Advancing Graph Learning via Harnessing the Power of Nature within Dynamic Systems

With the rapid digitization of the world, an increasing number of real-world applications are turning to nonEuclidean data, modeled as graphs. Due to their intrinsic high complexity and irregularity, learning from graph data demands tremendous computational power. Recently, CMOS-compatible Ising machines, i.e., dynamic systems composed of CMOS components, have emerged as a new approach that harnesses the inherent power of natural annealing within dynamic systems to efficiently resolve binary optimization problems and have been adopted for traditional graph computation, such as max-cut. However, when performing complex Graph Learning (GL) tasks, Ising machines face significant hurdles: (i) they are inherently binary and thus ill-suited for real-valued problems; (ii) their expensive all-to-all coupling network that guarantees effective natural annealing poses daunting scalability concerns. To address these challenges, this paper proposes a nature-powered graph learning framework dubbed DS-GL, which is the first effort to transform the process of solving graph learning problems into the natural annealing process within a parameterized dynamic system embodied as a CMOS chip. To tackle the two major hurdles, DS-GL first augments the Ising machine architecture to modify the self-reaction term of its Hamiltonian function from linear to quadratic, effectively serving as an energy regulator. This adjustment maintains the system’s original physical interpretation while enabling it to process continuous, real-valued data. Second, to address the scaling issue, DS-GL further upgrades the real-valued dense Ising machine by decomposing it into a mesh-based multi-PE dynamic system that supports efficient distributed spatial-temporal co-annealing across different PEs through sparse interconnects. By exploiting the inherent sparsity and component structures in real-world graphs, DS-GL is able to map complex graph learning tasks onto the scalable dynamic system while maintaining high accuracy. Evaluations with three diverse GL applications across six real-world datasets, including traffic flow and COVID-19 prediction, show that DS-GL can deliver from 102× to 106× speedups and 500× energy reduction over Graph Neural Networks on GPUs, with 5% - 20% accuracy enhancement.

Song, Ruibing↗

waveSZ: A Hardware-Algorithm Co-Design of Efficient Lossy Compression for Scientific Data

Error-bounded lossy compression is critical to the success of extreme-scale scientific research because of ever-increasing volumes of data produced by today's high-performance computing (HPC) applications. Not only can error-controlled lossy compressors significantly reduce the I/O and storage burden but they can retain high data fidelity for post analysis. Existing state-of-the-art lossy compressors, however, generally suffer from relatively low compression and decompression throughput (up to hundreds of megabytes per second on a single CPU core), which considerably restrict the adoption of lossy compression by many HPC applications especially those with a fairly high data production rate. In this paper, we propose a highly efficient lossy compression approach based on field programmable gate arrays (FPGAs) under the state-of-the-art lossy compression model SZ. Our contributions are fourfold. (1) We adopt a wavefront memory layout to alleviate the data dependency during the prediction for higher-dimensional predictors, such as the Lorenzo predictor. (2) We propose a co-design framework named WAVESZ based on the wavefront memory layout and the characteristics of SZ algorithm and carefully implement it by using high-level synthesis. (3) We propose a hardware-algorithm co-optimization method to improve the performance. (4) We evaluate our proposed WAVESZ on three real-world HPC simulation datasets from the Scientific Data Reduction Benchmarks and compare it with other state-of-the-art methods on both CPUs and FPGAs. Experiments show that our WAVESZ can improve SZ's compression throughput by 6.9x similar to 8.7x over the production version running on a state-of-the-art CPU and improve the compression ratio and throughput by 2.1x and 5.8x on average, respectively, respectively, compared with the state-of-the-art FPGA design.

Compression Ratio↗

Monitoring of ground water table depth and soil moisture at the Point Reyes field site

Ground water table (GWT) depth and soil moisture (SM) have been monitored at several locations at the Point Reyes field site (Californian coastal grassland) from 2021 to 2024. Monitoring is still on-going and data may be added to this archive at later time. The SM data have been acquired using Teros 12 Meter soil moisture sensors placed at 10, 30, 60 and 90 cm depth at 5 locations along a small hillslope. These sensors also collect soil temperature and bulk conductance. In addition, some collocated sensors provide pore pressure and Photochemical Reflectance Index (PRI). The GWT depth has been inferred from various type of Onset pressure transducers. The pressure measurements have been corrected for atmospheric pressure variations and sensor position relative to the ground surface to infer GWT depth, as well as with RTK GPS data to infer GWT elevation. The GWT data have been acquired at 5 distinct locations from 2020 to 2024 with the sensors placed at about 4 m depth. In addition, GWT data has been acquired for the 2023-2024 period with sensors located in 1 m deep shallow wells installed near each deeper well. This data is intended to evaluate possibly different dynamic in shallow (perched) and deep aquifer. The datasets are all provided in csv format. Please note that the interpretation of the GWT data needs to be done with consideration of environmental and well characteristics at the site and uncertainty in various variables. For more information on GWT and SM data, please contact the author.

54 ENVIRONMENTAL SCIENCES↗

Technical Report on Waveform Fit Metrics for Global Models

The new WAVEFORMS Initiative in the Ground-based Nuclear Detonation Detection (GNDD) program includes an increased emphasis on the development of Earth models and methods to predict entire seismic and acoustic waveforms more accurately. In general, this increased emphasis is predicated on the need to better characterize seismic events and provide improved model-based discrimination between event types including earthquakes and explosions. More specifically, while current moment tensor inversion methods tend to work well for larger events (M>~4) using tuned 1-D Earth models, the development of state-of-the-art 3-D models and methods is required for the prediction of shorter period waves over large areas for discrimination of smaller events. There is no standard metric for model-based waveform prediction accuracy used in the waveform modeling/inversion community. However, there are several popular waveform misfit definitions; and minimizing the corresponding objective functions is the goal of waveform inversion. Some example misfit definitions employed for adjoint waveform tomography include measures of simple travel time differences (e.g. Tape et al., 2010), cross-correlation travel time differences (e.g. Luo and Schuster, 1991), multi-taper frequency dependent methods (e.g. Lei et al., 2020), time-frequency phase misfit functions (e.g. Fichtner 2010; Rodgers et al., 2022), normalized cross-correlation methods (e.g. Tao et al., 2018), and others. In some cases, these misfit definitions also involve complicated weighting schemes and summations over multiple frequency bands making it difficult to duplicate the misfit measurement with alternative models and datasets. Although each of the misfit definitions mentioned above are useful for developing waveform models, the actual misfit values are not usually meaningful outside of a given project, model, and/or dataset. Therefore, it is difficult to understand and communicate model performance for predicting waveforms and comparing to other models and/or new model iterations with a different dataset. Therefore, there is a need for a generalized method for evaluating overall model performance that is independent from the specific misfit chosen to develop the waveform models that is also intuitive and meaningful. In this report, we describe a new metric we refer to as ‘Percent of Correlated Signal’. The following sections describe and demonstrate the metric with a case study event and a more rigorous test using a random selection of globally distributed events. While the focus here is on global tomography models, the metric is meant to applicable to regional ‘wiggle-for-wiggle’ waveform models/studies as well.

58 GEOSCIENCES↗

DRE: Designing for Resilience through Emulation

Threats to cyber- and cyber-physical systems have continued to increase over the past decade. Now more than ever, it is vital that cyber-physical system stakeholders have the tools to deeply understand their systems and the threats they face. High-fidelity modeling capabilities are powerful tools to support system understanding and decision-making, but they currently lack scientifically rigorous experimentation practices and infrastructures. The purpose of the project Designing for Resilience through Emulation (DRE) was to bring together past research and existing tools into a new pipeline to improve our ability to quantitatively evaluate future cyber scenarios. DRE offers new integrated capabilities for large dataset collection, noise studies, sensitivity analysis, uncertainty quantification, and surrogate modeling using a cyber-physical system emulation environment. These new capabilities significantly improve our ability to establish the credibility of the answers derived from emulation environments, ultimately leading to better critical decision support.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

Vegetation Detection Using Deep Learning and Conventional Methods

Land cover classification with the focus on chlorophyll-rich vegetation detection plays an important role in urban growth monitoring and planning, autonomous navigation, drone mapping, biodiversity conservation, etc. Conventional approaches usually apply the normalized difference vegetation index (NDVI) for vegetation detection. In this paper, we investigate the performance of deep learning and conventional methods for vegetation detection. Two deep learning methods, DeepLabV3+ and our customized convolutional neural network (CNN) were evaluated with respect to their detection performance when training and testing datasets originated from different geographical sites with different image resolutions. A novel object-based vegetation detection approach, which utilizes NDVI, computer vision, and machine learning (ML) techniques, is also proposed. The vegetation detection methods were applied to high-resolution airborne color images which consist of RGB and near-infrared (NIR) bands. RGB color images alone were also used with the two deep learning methods to examine their detection performances without the NIR band. The detection performances of the deep learning methods with respect to the object-based detection approach are discussed and sample images from the datasets are used for demonstrations.

58 GEOSCIENCES↗

Evaluation of four ground-based retrievals of cloud droplet number concentration in marine stratocumulus with aircraft in situ measurements

Abstract. Cloud droplet number concentration (Nd) is crucial for understanding aerosol–cloud interactions (ACI) and associated radiative effects. We present evaluations of four ground-based Nd retrievals based on comprehensive datasets from the Atmospheric Radiation Measurement (ARM) Aerosol and Cloud Experiments in the Eastern North Atlantic (ACE-ENA) field campaign. The Nd retrieval methods use ARM ENA observatory ground-based remote sensing observations from a micropulse lidar, Raman lidar, cloud radar, and the ARM NDROP (Droplet Number Concentration) value-added product (VAP), all of which also retrieve cloud effective radius (re). The retrievals are compared against aircraft measurements from the fast cloud droplet probe (FCDP) and the cloud and aerosol spectrometer (CAS) obtained from low-level marine boundary layer clouds on 12 flight days during summer and winter seasons. Additionally, the in situ measurements are used to validate the assumptions and characterizations used in the retrieval algorithms. Statistical comparisons of the probability distribution function (PDF) of the Nd and cloud re retrievals with aircraft measurements demonstrate that these retrievals align well with in situ measurements for overcast clouds, but they may substantially differ for broken clouds or clouds with low liquid water path (LWP). The retrievals are applied to 4 years of ground-based remote sensing measurements of overcast marine boundary layer clouds at the ARM ENA observatory to find that Nd (re) values exhibit seasonal variations, with higher (lower) values during the summer season and lower (higher) values during the winter season. The ensemble of various retrievals using different measurements and retrieval algorithms such as those in this paper can help to quantify Nd retrieval uncertainties and identify reliable Nd retrieval scenarios. Of the retrieval methods, we recommend using the micropulse lidar-based method. This method has good agreement with in situ measurements, less sensitivity to issues arising from precipitation and low cloud LWP and/or optical depth, and broad applicability by functioning for both daytime and nighttime conditions.

54 ENVIRONMENTAL SCIENCES↗

The Ground Flash Fraction Retrieval Algorithm Employing Differential Evolution: Simulations and Applications

The ability to estimate the fraction of ground flashes in a set of flashes observed by a satellite lightning imager, such as the future GOES-R Geostationary Lightning Mapper (GLM), would likely improve operational and scientific applications (e.g., severe weather warnings, lightning nitrogen oxides studies, and global electric circuit analyses). A Bayesian inversion method, called the Ground Flash Fraction Retrieval Algorithm (GoFFRA), was recently developed for estimating the ground flash fraction. The method uses a constrained mixed exponential distribution model to describe a particular lightning optical measurement called the Maximum Group Area (MGA). To obtain the optimum model parameters (one of which is the desired ground flash fraction), a scalar function must be minimized. This minimization is difficult because of two problems: (1) Label Switching (LS), and (2) Parameter Identity Theft (PIT). The LS problem is well known in the literature on mixed exponential distributions, and the PIT problem was discovered in this study. Each problem occurs when one allows the numerical minimizer to freely roam through the parameter search space; this allows certain solution parameters to interchange roles which leads to fundamental ambiguities, and solution error. A major accomplishment of this study is that we have employed a state-of-the-art genetic-based global optimization algorithm called Differential Evolution (DE) that constrains the parameter search in such a way as to remove both the LS and PIT problems. To test the performance of the GoFFRA when DE is employed, we applied it to analyze simulated MGA datasets that we generated from known mixed exponential distributions. Moreover, we evaluated the GoFFRA/DE method by applying it to analyze actual MGAs derived from low-Earth orbiting lightning imaging sensor data; the actual MGA data were classified as either ground or cloud flash MGAs using National Lightning Detection Network[TM] (NLDN) data. Solution error plots are provided for both the simulations and actual data analyses.

Koshak, William↗

Contribution of Phenological and Physiological Variations on Northern Vegetation Productivity Changes over Last Three Decades

Plant phenology and maximum photosynthetic state determine spatiotemporal variability of gross primary productivity (GPP) of vegetation. Recent warming induced impacts accelerate shifts of phenology and physiological status over Northern vegetated land. Thus, understanding and quantifying these changes are very important. Here, we investigate 1) how vegetation phenology and physiological status (maximum photosynthesis) are evolved over last three decades and 2) how such components (phenology and physiological status) contribute on inter-annual variation of the GPP during the last three decades. We utilized both long-term remotely sensed (GIMMS (Global Inventory Modeling and Mapping Studies), NDVI3g (Normalized Difference Vegetation Index 3rd generation) and MODIS (Moderate Resolution Imaging Spectroradiometer)) to extract larger scale phenology metrics (growing season start, end and duration); and productivity (i.e., growing season integrated vegetation index, GSIVI) to answer these questions. For evaluation purpose, we also introduced field-measured phenology and productivity datasets (e.g., FLUXNET) and possible remotely-sensed and modeled metrics at continental and regional scales. From this investigation, we found that onset of the growing season has advanced by 1.61 days per decade and the growing season end has delayed by 0.67 days per decade over the circumpolar region. This asymmetric extension of growing season results in a longer growing-season trend (2.96 days per decade) and widespread increasing vegetation-productivity trend (2.96 GSIVI per decade) over Northern land. However, the regionally-diverged phenology shift and maximum photosynthetic state contribute differently characterized productivity, inter-annual variability and trend. We quantified that about 50 percent, 13 percent and 6.5 percent of Northern land's inter-annual variability are dominantly controlled by the onset of the growing season, the end of the growing season and the maximum photosynthetic state, respectively. Productivity characterization over the other approximately 30 percent region has been driven by these co-dominant drivers. Our study clearly shows that regionally different contribution of phenological and physiological components on characterizing vegetation production over the last three decades.

productivity↗

Leveraging Google Earth Engine User Interface for Semiautomated Wetland Classification in the Great Lakes Basin at 10 m With Optical and Radar Geospatial Datasets

As one of the world’s largest freshwater ecosystems,the Great Lakes Basin houses hundreds of thousands of acres of wetlands that support a variety of crucial ecological and environmental functions at the local, regional, and global levels.Monitoring these wetlands is critical to conservation and restoration efforts, however current methods that rely on field monitoring are labor-intensive, costly, and often outdated. In this study, we present a graphical user interface constructed in Google Earth Engine called the Wetland Extent Tool (WET),which allows semi-automatic wetland classification according to a user-input area of interest and date range. WET composites datasets and conducts multi source, moderate resolution processing utilizing Landsat 8 OLI, Sentinel-2 MSI, Sentinel-1 C-SAR, and Shuttle Radar Topography Mission (SRTM) datasets to classify wetlands in the entire Great Lakes Basin. We evaluated classification results of wetlands, uplands, and open water from May-September 2019, and tested whether SRTM elevation, slope,or the Dynamic Surface Water Extent produced the most accurate results in each Great Lake Basin in conjunction with optical indices and radar composites. We found that elevation produced the most accurate classification in Lake Erie, Michigan,and Ontario, while slope performed best in Lake Huron and Superior. Lake Erie, Michigan, Ontario, and Huron achieved high overall accuracy and identification of wetlands. WET leverages cloud-computing for multi source processing of moderate resolution remote sensing data, and employs a user interface in Google Earth Engine that wetland managers and conservationists can use to monitor wetland extent in the Great Lakes Basin in near real-time.

Vanessa L Valenti↗

Improving Rain/No-Rain Detection Skill by Merging Precipitation Estimates from Different Sources

Rain/no-rain detection error is a key source of uncertainty in regional and global precipitation products that propagates into offline hydrological and land surface modeling simulations. Such detection error is difficult to evaluate and/or filter without access to high-quality reference precipitation datasets. For cases where such access is not available, this study proposes a novel approach for improved rain/no-rain detection. Based on categorical triple collocation (CTC) and a probabilistic framework, a weighted merging algorithm (CTC-M) is developed to combine noisy, but independent, precipitation products into an optimal binary rain/no-rain time series. Compared with commonly used approaches that directly apply the best parent product for rain/no-rain detection, the superiority of CTC-M is demonstrated analytically and numerically using spatially dense precipitation measurements over Europe. Our analysis also suggests that CTC-M is tolerant to a range of cross-correlated rain/no-rain detection errors and detection biases of the parent products. As a result, CTC-M will benefit global precipitation estimation by improving the representation of precipitation occurrence in gauge-based and multisource merged precipitation products.

Jianzhi Dong↗

Global Freeze/Thaw Product from L-Band Radiometer Data

The NASA Soil Moisture Active Passive (SMAP) mission has been successfully operated for almost three years. The SMAP freeze/thaw algorithm is based on a seasonal threshold approach. It’s important to have a stable and self-consistent freeze and thaw reference that can be applied for multi-year dataset. The three-year long radiometer datasets allow us to reassess the criteria of reference setup and evaluate its stability. In this paper, we first refined the freeze reference requirements and compare three different methods of setting up the thaw reference to minimize the false flags. The original freeze/thaw products is in the polar grid and only cover the region north of 45° N latitude. The limitation is due to lack of enough freezing days in the lower latitude, where the freezing reference cannot be generated. To extend the freeze/thaw product to global region, we combine the single channel algorithm in the lower latitude and southern atmosphere. The global results have been validated through WMO air temperature.

Colliander, Andreas↗

Structured Covariance Gaussian Networks for Orion Crew Module Aerodynamic Uncertainty Quantification

In this paper we propose a new approach for nonlinear regression and uncertainty quantification. The method is based on a pair of neural networks which parameterize mean and dense covariance functions of a multivariate Gaussian process, trained together to maximize the log-likelihood of observing the given data. The covariance matrix is made positive definite at every input by construction. We also propose a sampling approach that produces viable surrogate function realizations from the Gaussian process. We call the proposed model a Structured Covariance Gaussian Network (SCGN). We illustrate the use of SCGNs for learning an aerodynamic response surface with built-in uncertainty for the Orion crew module. We find that SCGN provides an efficient and systematic way to learn nonlinear functional relationships and dense covariances. We compare results to a baseline Gaussian process regressor and observe that the SCGN provides comparable uncertainty descriptions with improved scalability to dataset size. The sample functions generated by SCGN are fast to evaluate online and are therefore convenient for use in trajectory simulations. These results suggest that SCGN may be a viable computational method for aerodynamic uncertainty quantification.

machine learning↗

Structured Covariance Gaussian Networks for Orion Crew Module Aerodynamic Uncertainty Quantification

In this paper we propose a new approach for nonlinear regression and uncertainty quantification. The method is based on a pair of neural networks which parameterize mean and dense covariance functions of a multivariate Gaussian process, trained together to maximize the log-likelihood of observing the given data. The covariance matrix is made positive definite at every input by construction. We also propose a sampling approach that produces viable surrogate function realizations from the Gaussian process. We call the proposed model a Structured Covariance Gaussian Network (SCGN). We illustrate the use of SCGNs for learning an aerodynamic response surface with built-in uncertainty for the Orion crew module. We find that SCGN provides an efficient and systematic way to learn nonlinear functional relationships and dense covariances. We compare results to a baseline Gaussian process regressor and observe that the SCGN provides comparable uncertainty descriptions with improved scalability to dataset size. The sample functions generated by SCGN are fast to evaluate online and are therefore convenient for use in trajectory simulations. These results suggest that SCGN may be a viable computational method for aerodynamic uncertainty quantification.

machine learning↗

Assessment of Long-term Trends in the Collection 4 Total Ozone Record from the Ozone Monitoring Instrument

Long-term changes in total ozone affect the amount of harmful UV radiation reaching Earth’s surface and reflect progress made towards recovery of stratospheric ozone. Satellite total ozone data are also used to estimate long-term trends in tropospheric ozone, a reactive and potent greenhouse gas, by subtracting the stratospheric column timeseries from that of total ozone. For these scientific applications, the long-term stability should be better than 1%. Left unchecked, instrument calibration drift can produce a trend of this magnitude or greater. NASA has produced nearly twenty years of total ozone data from the Ozone Monitoring Instrument (OMI) using the Total Ozone Mapping Spectrometer (TOMS) algorithm. The drift in the OMI instrument as monitored by ice radiance calibration has been relatively slow, but it has reached a level of ~3% over the mission lifetime. This drift was corrected in the recently released Collection 4 OMI calibrated radiances, updating the Collection 3 calibration released in 2006. We have reprocessed the OMI total ozone record using the Collection 4 calibration and updates to the TOMS algorithm. We summarize these changes and evaluate their impact by comparing to the previous Collection 3 OMI dataset, the Suomi NPP Ozone Mapping and Profiler Suite Nadir Mapper (OMPS-NM) and Solar Backscatter UV (SBUV) Merged Ozone Dataset (MOD) total ozone records and other independent satellite total ozone datasets. Climatological radiance residuals from OMI and OMPS-NM are calculated and compared to investigate differences in spectral calibration that can cause drifts in long-term total ozone trends. We also analyze the tropospheric ozone record produced using the Collection 4 OMI total ozone and stratospheric column ozone from MLS. Collection 3 OMI data processed with the TOMS algorithm show a positive drift relative to other satellite and ground-based data of 1-2 DU per decade. Initial results show that this drift is reduced in Collection 4 OMI, due to the updated OMI calibration. In this work we will quantify the improvements in Collection 4 OMI relative to independent data sources at both the ozone and radiance level

Collection 4 OMI Total Ozone↗

Mapping Cloud Microphysical Properties to Triple-Wavelength Airborne Lidar Measurements in Winter Storms: Results from the IMPACTS Field Campaign

Ice production and growth inmixed-phase cloudsgive a complicated picture of the radiative and mass characteristics due to the heterogeneity of particle shapes and sizes. Collocated airborne lidar and microphysics datasets from a recent winter storm field study are used to evaluate the effect of ice and liquid hydrometeors,observed in situ,on the multiple-wavelength backscatter coefficientvalues measured by the NASA Cloud Physics Lidarover the course of three winter deployments in the Midwestand Northeast United States.

Joseph A. Finlon↗

Revisiting Huffman Coding: Toward Extreme Performance on Modern GPU Architectures

Today's high-performance computing (HPC) applications are producing vast volumes of data, which are challenging to store and transfer efficiently during the execution, such that data compression is becoming a critical technique to mitigate the storage burden and data movement cost. Huffman coding is arguably the most efficient Entropy coding algorithm in information theory, such that it could be found as a fundamental step in many modern compression algorithms such as DEFLATE. On the other hand, today's HPC applications are more and more relying on the accelerators such as GPU on supercomputers, while Huffman encoding suffers from low throughput on GPUs, resulting in a significant bottleneck in the entire data processing. In this paper, we propose and implement an efficient Huffman encoding approach based on modern GPU architectures, which addresses two key challenges: (1) how to parallelize the entire Huffman encoding algorithm, including codebook construction, and (2) how to fully utilize the high memory-bandwidth feature of modern GPU architectures. The detailed contribution is fourfold. (1) We develop an efficient parallel codebook construction on GPUs that scales effectively with the number of input symbols. (2) We propose a novel reduction based encoding scheme that can efficiently merge the codewords on GPUs. (3) We optimize the overall GPU performance by leveraging the state-of-the-art CUDA APIs such as Cooperative Groups. (4) We evaluate our Huffman encoder thoroughly using six real-world application datasets on two advanced GPUs and compare with our implemented multithreaded Huffman encoder. Experiments show that our solution can improve the encoding throughput by up to 5.0× and 6.8× on NVIDIA RTX 5000 and V100, respectively, over the state-of-the-art GPU Huffman encoder, and by up to 3.3× over the multithread encoder on two 28-core Xeon Platinum 8280 CPUs.

Tian, Jiannan↗