Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “cloud platform”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9

Secure Collaborative Environment for Seamless Sharing of Scientific Knowledge

In a secure collaborative environment, tera-bytes of data generated from powerful scientific instruments are used to train secure machine learning (ML) models on exascale computing systems, which are then securely shared with internal or external collaborators as cloud-based services. Devising such a secure platform is necessary for seamless scientific knowledge sharing without compromising individual, or institute-level, intellectual property and privacy details. By enabling new computing opportunities with sensitive data, we envision a secure collaborative environment that will play a significant role in accelerating scientific discovery. Several recent technological advancements have made it possible to realize these capabilities. In this paper, we present our efforts at ORNL toward developing a secure computation platform. We present a use case where scientific data generated from complex instruments, like those at the Spallation Neutron Source (SNS), are used to train a differential privacy enabled deep learning (DL) network on Summit, which is then hosted as a secure multi-party computation (MPC) service on ORNL’s Compute and Data Environment for Science (CADES) cloud computing platform for third-party inference. In this feasibility study, we discuss the challenges involved, elaborate on leveraged technologies, analyze relevant performance results and present the future vision of our work to establish secure collaboration capabilities within and outside of ORNL.

Yoginath, Srikanth↗

NASA’s Atmospheric Science Data Center’s Approach to a Cloud-Based Model of Ingest, Archival, and Distribution of TEMPO Data: Methods, Challenges, and Best Practices

The National Aeronautics and Space Administration's (NASA) Atmospheric Science Data Center (ASDC) at NASA Langley Research Center in Hampton, VA provides atmospheric science data products and services to the science community, including enhanced search and subsetting capabilities for numerous datasets. The ASDC is the official Distributed Active Archive Center (DAAC) of record for the upcoming Tropospheric Emissions: Monitoring of Pollution (TEMPO) instrument. TEMPO will be situated on a geostationary satellite positioned at a longitude near the center of the conterminous United States and focused on North America, making hourly swaths of its field of regard from east to west. ASDC’s data products are currently hosted locally and services (e.g., spatial and temporal subsetting) are managed on premises. The ASDC is planning to provide TEMPO data and services in the cloud through the Earthdata Search platform. This presentation will discuss the ASDC’s approach to a cloud-based model of ingest, archival, and distribution of TEMPO data. Methods, challenges, best practices, lessons learned, and future plans will be discussed.

Iman Nasif↗

Application of Direct Simulation Monte Carlo to Satellite Contamination Studies

A novel method is presented to estimate contaminant levels around spacecraft and satellites of arbitrarily complex geometry. The method uses a three-dimensional direct simulation Monte Carlo algorithm to characterize the contaminant cloud surrounding the space platform, and a computer-assisted design preprocessor to define the space-platform geometry. The method is applied to the Upper Atmosphere Research Satellite to estimate the contaminant flux incident on the optics of the halogen occultation experiment (HALOE) telescope. Results are presented in terms of contaminant cloud structure, molecular velocity distribution at HALOE aperture, and code performance.

Rault, Didier F. G.↗

Detection of Outliers in LiDAR Data Acquired by Multiple Platforms over Sorghum and Maize

High-resolution point cloud data acquired with a laser scanner from any platform contain random noise and outliers. Therefore, outlier detection in LiDAR data is often necessary prior to analysis. Applications in agriculture are particularly challenging, as there is typically no prior knowledge of the statistical distribution of points, plant complexity, and local point densities, which are crop-dependent. The goals of this study were first to investigate approaches to minimize the impact of outliers on LiDAR acquired over agricultural row crops, and specifically for sorghum and maize breeding experiments, by an unmanned aerial vehicle (UAV) and a wheel-based ground platform; second, to evaluate the impact of existing outliers in the datasets on leaf area index (LAI) prediction using LiDAR data. Two methods were investigated to detect and remove the outliers from the plant datasets. The first was based on surface fitting to noisy point cloud data via normal and curvature estimation in a local neighborhood. The second utilized the PointCleanNet deep learning framework. Both methods were applied to individual plants and field-based datasets. To evaluate the method, an F-score was calculated for synthetic data in the controlled conditions, and LAI, the variable being predicted, was computed both before and after outlier removal for both scenarios. Results indicate that the deep learning method for outlier detection is more robust than the geometric approach to changes in point densities, level of noise, and shapes. The prediction of LAI was also improved for the wheel-based vehicle data based on the coefficient of determination (R2) and the root mean squared error (RMSE) of the residuals before and after the removal of outliers.

36 MATERIALS SCIENCE↗

Future energy infrastructure, energy platform and energy storage

Today fossil energy dominates energy consumption across the world. There has been an increasing momentum to reduce fossil energy consumption and increase renewable energy utilization to more than 70%. Such high penetrations of distributed renewable resources bring large uncertainty and complexity that cannot be easily handled by the current infrastructure. For the last two decades, telecommunication industry has gone through a similar transition from centralized to distributed systems, and more recently to platform approaches, which become the corner stone of today’s vibrant platform economy. Based on telecommunication history, we believe that a platform-based approach, called the energy platform, is a viable solution for addressing the renewable energy challenges. The energy platform consists of an array of computational algorithms, sensing and control technologies for key industry, energy generators and users to jointly manage and control the complex energy infrastructure. It includes the following key components: (1) the hardware and software to generate, store, control and transmit electricity/data (the energy cloud), (2) the digital platforms and tools for key energy producers, digital, service and communication industry to share the assets, participate in and manage the complex infrastructure, and for customers to participate in energy transactions, (3) the transaction platform for new service and business models. Additionally, the energy platform requires breakthroughs in large scale energy storage and many other areas including efficient power electronics, sensors and controls, new mathematical and computational tools, and deep integration of energy technologies and information sciences to control and stabilize such complex chaotic systems.

25 ENERGY STORAGE↗

Portability for GPU-accelerated molecular docking applications for cloud and HPC: can portable compiler directives provide performance across all platforms?

High-throughput structure-based screening of drug-like molecules has become a common tool in biomedical research. Recently, acceleration with graphics processing units (GPUs) has provided a large performance boost for molecular docking programs. Both cloud and high-performance computing (HPC) resources have been used for large screens with molecular docking programs; while NVIDIA GPUs have dominated cloud and HPC resources, new vendors such as AMD and Intel are now entering the field, creating the problem of software portability across different GPUs. Ideally, software productivity could be maximized with portable programming models that are able to maintain high performance across architectures. While in many cases compiler directives have been used as an easy way to offload parallel regions of a CPU-based program to a GPU accelerator, they may also be an attractive programming model for providing portability across different GPU vendors, in which case the porting process may proceed in the reverse direction: from low-level, architecture-specific code to higher-level directive-based abstractions. MiniMDock is a new mini-application (miniapp) designed to capture the essential computational kernels found in molecular docking calculations, such as are used in phar-maceutical drug discovery efforts, in order to test different solutions for porting across GPU architectures. Here we extend MiniMDock to GPU offloading with OpenMP directives, and compare to performance of kernels using CUDA and HIP on NVIDIA and AMD GPUs, respectively, as well as across different compilers, exploring performance bottlenecks. We document this reverse-porting process, from highly optimized device code to a higher-level version using directives, compare code structure, and describe barriers that were overcome in this effort.

Thavappiragasam, Mathialakan↗

Example MODIS Global Cloud Optical and Microphysical Properties: Comparisons between Terra and Aqua

MODIS observations from the NASA EOS Terra spacecraft (launched in December 1999, 1030 local time equatorial crossing) have provided a unique data set of Earth observations. With the launch of the NASA Aqua spacecraft in May 2002 (1330 local time), two MODIS daytime (sunlit) and nighttime observations are now available in a 24 hour period, allowing for some measure of diurnal variability. We report on an initial analysis of several operational global (Level-3) cloud products from the two platforms. The MODIS atmosphere Level-3 products, which include clear-sky and aerosol products in addition to cloud products, are available as three separate files providing daily, eight-day, and monthly aggregations; each temporal aggregation is spatially aggregated to a 1 degree grid. The files contain approximately 600 statisitical datasets (from simple means and standard deviations to 1 - and 2-dimensional histograms). Operational cloud products include detection (cloud fraction), cloud-top properties, and daytimeonly cloud optical thickness and particle effective radius for both water and ice clouds. We will compare example global Terra and Aqua cloud fraction, optical thickness, and effective radius aggregations.

Hubanks, P. A.↗

Visualization and 3D Mesh Generation for ASSEMBLERS Range of Motion

In an effort to create a base and foundation for ASSEMBLERS with an informed layout, data representing the range of motion of varying heights of Stewart platforms were analyzed. 3D shapes were generated first to be approximately representative of these data in the form of rotationally symmetric shells, making use of 2D alpha shapes to create a border that did not account for asymmetry inherent in the true range of motion. Further work was performed to generate mesh files more fully representative of reach, creating 3D alpha shapes based directly on point clouds generated from uniformly random platform positions. These shapes were initially not representative of the entire range of motion of a platform stack due to the low likelihood of the most extreme positions being added to a given point cloud but were more representative of the asymmetry inherent in the possible positions of a Stewart platform as they no longer relied on a single 2D contour. The same algorithm for generating 3D alpha shapes was then applied to point clouds designed to represent extreme positions, generating larger smooth shells with six clear planes of symmetry. All shells were converted to STLs to aid in further modeling of range of motion for base layouts and in visualizing reachable area for varying stack heights, successfully creating closed shells representative of typical and extreme positions for platform stacks of varying heights.

Jonah DeGuire Vanke↗

Quantum Computing and Visualization Research Challenges and Opportunities

Here, quantum computing (QC) has experienced rapid growth in recent years with the advent of robust programming environments, readily accessible software simulators and cloud-based QC hardware platforms, and growing interest in learning how to design useful methods that leverage this emerging technology for practical applications. From the perspective of the field of visualization, this article examines research challenges and opportunities along the path from initial feasibility to practical use of QC platforms applied to meaningful problems.

Data visualization↗

Development of eye-safe lidar for aerosol measurements

Research is summarized on the development of an eye safe Raman conversion system to carry out lidar measurements of aerosol and clouds from an airborne platform. Radiation is produced at the first Stokes wavelength of 1.54 micron in the eye safe infrared, when methane is used as the Raman-active medium, the pump source being a Nd:YAG laser at 1.064 micron. Results are presented for an experimental study of the dependence of the 1.54 micron first Stokes radiation on the focusing geometry, methane gas pressure, and pump energy. The specific new technique developed for optimizing the first Stokes generation involves retroreflecting the backward-generated first Stokes light back into the Raman cell as a seed Stokes beam which is then amplified in the temporal tail of the pump beam. Almost 20 percent conversion to 1.54 micron is obtained. Complete, assembled hardware for the Raman conversion system was delivered to the Goddard Space Flight Center for a successful GLOBE flight (1989) to measure aerosol backscatter around the Pacific basin.

Singh, Upendra N.↗

Analysis of measurements for solid state laser remote lidar system

The merits of using lidar systems for remote measurements of various atmospheric processes such as wind, turbulence, moisture, and aerosol concentration are widely recognized. Although the lidar technology has progressed considerably over the past two decades, significant research particularly in the area of solid state lidars remains to be conducted in order to fully exploit this technology. The work performed by the UAH (University of Alabama in Huntsville) personnel under this Delivery Order concentrated on analyses of measurements required in support of solid state laser remote sensing lidar systems which are to be designed, deployed, and used to measure atmospheric processes and constituents. UAH personnel has studied and recommended to NASA/MSFC the requirements of the optical systems needed to characterize the detection devices suitable for solid state wavelengths and to evaluate various heterodyne detection schemes. The 2-micron solid state laser technology was investigated and several preliminary laser designs were developed and their performance for remote sensing of atmospheric winds and clouds from a spaceborne platform were specified. In addition to the laser source and the detector, the other critical technologies necessary for global wind measurements by a spaceborne solid state coherent lidar systems were identified to be developed and demonstrated. As part of this work, an analysis was performed to determine the atmospheric wind velocity estimation accuracy using the line-of-sight measurements of a scanning coherent lidar. Under this delivery order, a computer database of materials related to the theory, development, testing, and operation of lidar systems was developed to serve as a source of information for lidar research and development.

Amzajerdian, Farzin↗

Nominal 30-M Cropland Extent Map of Continental Africa by Integrating Pixel-Based and Object-Based Algorithms Using Sentinel-2 and Landsat-8 Data on Google Earth Engine

A satellite-derived cropland extent map at high spatial resolution (30-m or better) is a must for food and water security analysis. Precise and accurate global cropland extent maps, indicating cropland and non-cropland areas, is a starting point to develop high-level products such as crop watering methods (irrigated or rainfed), cropping intensities (e.g., single, double, or continuous cropping), crop types, cropland fallows, as well as assessment of cropland productivity (productivity per unit of land), and crop water productivity (productivity per unit of water). Uncertainties associated with the cropland extent map have cascading effects on all higher-level cropland products. However, precise and accurate cropland extent maps at high spatial resolution over large areas (e.g., continents or the globe) are challenging to produce due to the small-holder dominant agricultural systems like those found in most of Africa and Asia. Cloud-based Geospatial computing platforms and multi-date, multi-sensor satellite image inventories on Google Earth Engine offer opportunities for mapping croplands with precision and accuracy over large areas that satisfy the requirements of broad range of applications. Such maps are expected to provide highly significant improvements compared to existing products, which tend to be coarser in resolution, and often fail to capture fragmented small-holder farms especially in regions with high dynamic change within and across years. To overcome these limitations, in this research we present an approach for cropland extent mapping at high spatial resolution (30-m or better) using the 10-day, 10 to 20-m, Sentinel-2 data in combination with 16-day, 30-m, Landsat-8 data on Google Earth Engine (GEE). First, nominal 30-m resolution satellite imagery composites were created from 36,924 scenes of Sentinel-2 and Landsat-8 images for the entire African continent in 2015-2016. These composites were generated using a median-mosaic of five bands (blue, green, red, near-infrared, NDVI) during each of the two periods (period 1: January-June 2016 and period 2: July-December 2015) plus a 30-m slope layer derived from the Shuttle Radar Topographic Mission (SRTM) elevation dataset. Second, we selected Cropland/Non-cropland training samples (sample size 9791) from various sources in GEE to create pixel-based classifications. As supervised classification algorithm, Random Forest (RF) was used as the primary classifier because of its efficiency, and when over-fitting issues of RF happened due to the noise of input training data, Support Vector Machine (SVM) was applied to compensate for such defects in specific areas. Third, the Recursive Hierarchical Segmentation (RHSeg) algorithm was employed to generate an object-oriented segmentation layer based on spectral and spatial properties from the same input data. This layer was merged with the pixel-based classification to improve segmentation accuracy. Accuracies of the merged 30-m crop extent product were computed using an error matrix approach in which 1754 independent validation samples were used. In addition, a comparison was performed with other available cropland maps as well as with LULC maps to show spatial similarity. Finally, the cropland area results derived from the map were compared with UN FAO statistics. The independent accuracy assessment showed a weighted overall accuracy of 94, with a producers accuracy of 85.9 (or omission error of 14.1), and users accuracy of 68.5 (commission error of 31.5) for the cropland class. The total net cropland area (TNCA) of Africa was estimated as 313 Mha for the nominal year 2015.

Cropland mapping; cropland areas; 30-m; Landsat-8;↗

Consistency of Global Modis Aerosol Optical Depths over Ocean on Terra and Aqua Ceres SSF Datasets

Aerosol retrievals over ocean from the Moderate Resolution Imaging Spectroradiometer (MODIS) onboard Terra and Aqua platforms are available from the Clouds and the Earth's Radiant Energy System (CERES) Single Scanner Footprint (SSF) datasets generated at NASA Langley Research Center (LaRC). Two aerosol products are reported side-by-side. The primary M product is generated by sub-setting and remapping the multi-spectral (0.47-2.1 micrometer) MODIS produced oceanic aerosol (MOD04/MYD04 for Terra/Aqua) onto CERES footprints. M*D04 processing uses cloud screening and aerosol algorithms developed by the MODIS science team. The secondary AVHRR-like A product is generated in only two MODIS bands 1 and 6 (on Aqua, bands 1 and 7). The A processing uses the CERES cloud screening algorithm, and NOAA/NESDIS glint identification, and single-channel aerosol retrieval algorithms. The M and A products have been documented elsewhere and preliminarily compared using 2 weeks of global Terra CERES SSF Edition 1A data in which the M product was based on MOD04 collection 3. In this study, the comparisons between the M and A aerosol optical depths (AOD) in MODIS band 1 (0.64 micrometers), tau(sub 1M) and tau(sub 1A) are re-examined using 9 days of global CERES SSF Terra Edition 2A and Aqua Edition 1B data from 13 - 21 October 2002, and extended to include cross-platform comparisons. The M and A products on the new CERES SSF release are generated using the same aerosol algorithms as before, but with different preprocessing and sampling procedures, lending themselves to a simple sensitivity check to non-aerosol factors. Both tau(sub 1M) and tau(sub 1A) generally compare well across platforms. However, the M product shows some differences, which increase with ambient cloud amount and towards the solar side of the orbit. Three types of comparisons conducted in this study - cross-platform, cross-product, and cross-release confirm the previously made observation that the major area for improvement in the current aerosol processing lies in a more formalized and standardized sampling (and most importantly, cloud screening) whereas optimization of the aerosol algorithm is deemed to be an important yet less critical element.

Ignatov, Alexander↗

Atmospheric microphysical experiments on an orbital platform

The Zero-Gravity Atmospheric Cloud Physics Laboratory is a Shuttle/Spacelab payload which will be capable of performing a large range of microphysics experiments. This facility will complement terrestrial cloud physics research by allowing many experiments to be performed which cannot be accomplished within the confines of a terrestrial laboratory. This paper reviews the general Cloud Physics Laboratory concept and the experiment scope. The experimental constraints are given along with details of the proposed equipment. Examples of appropriate experiments range from three-dimensional simulation of the earth and planetary atmosphere and of ocean circulation to cloud electrification processes and the effects of atmospheric pollution materials on microphysical processes.

Eaton, L. R.↗

Laboratory for Atmospheres Instrument Systems Report

Studies of the atmospheres of our solar system's planets including our own require a comprehensive set of observations, relying on instruments on spacecraft, aircraft, balloons, and on the surface. These instrument systems perform one or both of the following: 1) provide information leading to a basic understanding of the relationship between atmospheric systems and processes, and 2) serve as calibration references for satellite instrument validation. Laboratory personnel define requirements, conceive concepts, and develop instrument systems for spaceflight missions, and for balloon, aircraft, and ground-based observations. Balloon and airborne platforms facilitate regional measurements of precipitation, cloud systems, and ozone from high-altitude vantage points, but still within the atmosphere. Such platforms serve as stepping-stones in the development of space instruments. Satellites provide nearly global coverage of the Earth with spatial resolutions and repetition rates that vary from system to system. The products of atmospheric remote sensing are invaluable for research associated with water vapor, ozone, trace gases, aerosol particles, clouds, precipitation, and the radiative and dynamic processes that affect the climate of the Earth. These parameters also provide the basic information needed to develop models of global atmospheric processes and weather and climate prediction. Laboratory scientists also participate in the design of data processing algorithms, calibration techniques, and the data processing systems.

Platnick, Steven E.↗

13RC and and 3DRT Working Group of IRC: Status and Plans

We summarize recent activities of the International Intercomparison of 3D Radiation Codes (DRC), including development of an open source code, approximation methods for use in cloud dynamical models, and cloud reconstructions from multiple satellite platforms such as MODIS, MISR and ICESat. We also discuss the charter of the newly formed 3DRT Working Group of the International Radiation Commission, which hopes to coordinate and integrate efforts in various 3D application areas, including clouds, sea ice, and vegetation. Finally we describe plans for a special 3D session at the next International Radiation Symposium in Busan Korea, during 23-30 August 2004.

Cahalan, Robert↗

Comparison of CALIPSO-Like, LaRC, and MODIS Retrievals of Ice Cloud Properties over SIRTA in France and Florida during CRYSTAL-FACE

This study compares cirrus particle effective radius retrieved by a CALIPSO-like method with two similar methods using MODIS, MODI Airborne Simulator (MAS), and GOES imagery. The CALIPSO-like method uses lidar measurements coupled with the split-window technique that uses the infrared spectral information contained at the 8.65-micrometer, 11.15-micrometer and 12.05-micrometer bands to infer the microphysical properties of cirrus clouds. The two other methods, sing passive remote sensing at visible and infrared wavelengths, are the operational MODIS cloud products (referred to by its archival product identifier MOD06 for MODIS Terra) and MODIS retrievals performed by the CERES team at LaRC (Langley Research Center) in support of CERES algorithms; the two algorithms will be referred to as MOD06- and LaRC-method, respectively. The three techniques are compared at two different latitudes: (i) the mid-latitude ice clouds study uses 18 days of observations at the Palaiseau ground-based site in France (SIRTA: Site Instrumental de Recherche par Teledetection Atmospherique) including a ground-based 532 nm lidar and the Moderate Resolution Imaging Spectrometer (MODIS) overpasses on the Terra Platform, (ii) the tropical ice clouds study uses 14 different flight legs of observations collected in Florida, during the intensive field experiment CRYSTAL-FACE (Cirrus Regional Study of Tropical Anvils and cirrus Layers-Florida Area Cirrus Experiment), including the airborne Cloud Physics Lidar (CPL) and the MAS. The comparison of the three methods gives consistent results for the particle effective radius and the optical thickness, but discrepancies in cloud detection and altitudes. The study confirms the value of an active remote-sensing method (CALIPSO-like) for the study of sub-visible ice clouds, in both mid-latitudes and tropics. Nevertheless, this method is not reliable in optically very thick tropical ice clouds.

Chiriaco, M.↗

Assimilation of global cloud imagery from multiple satellites

Synoptic images of the global cloud field are created from measurements of IR radiation taken aboard four geostationary and two polar-orbiting platforms simultaneously observing the earth's cloud field. A series of spatial and temporal interpolations, together with data reliability criteria, are used to map synoptic measurements from the geostationary satellites and asynoptic measurements from the polar-orbiting satellites. The synoptic global cloud imagery (GCI) that results has a horizontal resolution of 0.7 deg in longitude by 0.35 deg in latitude and a temporal resolution of 3 h, providing an unprecedented view of the global cloud pattern. Each composite image represents a nearly instantaneous snapshot of the entire earth's cloud field. Collectively, the composite imagery resolve, on a global basis, most of the variability inherent to organized convection, including several harmonics of the diurnal cycle. Because of its homogeneous properties, the GCI lends itself easily to a variety of space-time analyses useful for studying global cloud behavior.

Tanaka, Ken↗