Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Cloud Computing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 415 records · Page 23
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Secure Federated Learning Across Heterogeneous Cloud and High-Performance Computing Resources: A Case Study on Federated Fine-Tuning of LLaMA 2

Federated learning enables multiple data owners to collaboratively train robust machine learning models without transferring large or sensitive local datasets by only sharing the parameters of the locally trained models. Here, in this article, we elaborate on the design of our Advanced Privacy-Preserving Federated Learning (APPFL) framework, which streamlines end-to-end secure and reliable federated learning experiments across cloud computing facilities and high-performance computing resources by leveraging Globus Compute, a distributed function as a service platform, and Amazon Web Services. We further demonstrate the use case of APPFL in fine-tuning an LLaMA 2 7B model using several cloud resources and supercomputers.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS1971

Cloud-free resolution element statistics program

Computer program computes number of cloud-free elements in field-of-view and percentage of total field-of-view occupied by clouds. Human error is eliminated by using visual estimation to compute cloud statistics from aerial photographs.

Liley, B.↗
NASA NTRS2024

Exploring New Frontiers in Space Communications: Enhancing Delay Tolerant Networking through Cloud and Containerization

The High-rate Delay Tolerant Networking (HDTN) project at NASA Glenn Research Center has developed software that enables more flexible, reliable, and efficient space internetworking by using modern computing techniques such as cloud services, microservices, network function virtualization, software defined networking, and a distributed architecture. HDTN is built upon the Bundle Protocol and related convergence layers which have been developed to mitigate the challenges of the space networking environment including long delays, asymmetric data rates, and intermittent connectivity. The HDTN implementation employs asynchronous message processing tasks which allow for non-blocking operations as well as deployment in both centralized and distributed architectures. This paper investigates deploying HDTN in a containerized approach on the NASA Goddard’s Mission Cloud Platform using Amazon Web Services Elastic Compute Cloud (EC2). Commercial cloud computing will lower operating costs, provide flexible resource allocation, and allow for interconnectivity between multiple NASA centers as well as external partners. Containerization using Docker will enable greater portability and scalability for HDTN to be deployed into a variety of environments. We discuss possible NASA missions and use-cases such as the Laser Communications Relay Demonstration (LCRD) where the services provided by HDTN (reliable transport, high-rate message processing, and store-and-forward capabilities) will be enhanced through cloud computing and containerization. In addition, we describe the HDTN architecture and possible microservice-based networking approaches that can be obtained via HDTN’s configuration capabilities. Finally, we detail the EC2 specifications needed to achieve data rates greater than 1 Gbps to support optical communication missions such as LCRD.

Blake LaFuente↗
DOE OSTI2024

Accelerating science: The usage of commercial clouds in ATLAS Distributed Computing

The ATLAS experiment at CERN is one of the largest scientific machines built to date and will have ever growing computing needs as the Large Hadron Collider collects an increasingly larger volume of data over the next 20 years. ATLAS is conducting R&D projects on Amazon Web Services and Google Cloud as complementary resources for distributed computing, focusing on some of the key features of commercial clouds: lightweight operation, elasticity and availability of multiple chip architectures. The proof of concept phases have concluded with the cloud-native, vendoragnostic integration with the experiment’s data and workload management frameworks. Google Cloud has been used to evaluate elastic batch computing, ramping up ephemeral clusters of up to O(100k) cores to process tasks requiring quick turnaround. Amazon Web Services has been exploited for the successful physics validation of the Athena simulation software on ARM processors. We have also set up an interactive facility for physics analysis allowing endusers to spin up private, on-demand clusters for parallel computing with up to 4 000 cores, or run GPU enabled notebooks and jobs for machine learning applications. The success of the proof of concept phases has led to the extension of the Google Cloud project, where ATLAS will study the total cost of ownership of a production cloud site during 15 months with 10k cores on average, fully integrated with distributed grid computing resources and continue the R&D projects.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
NASA NTRS1985

On Wahlin's mechanism of cloud electrification

Computations were performed to explore the consequences of Wahlin's suggestion that a powerful mechanism of thundercloud electrification is provided, in the presence of a substantial updraft, by the preferential capture of negative ions on the water droplets of a cloud. The mechanism seems capable of providing, on time scales of 10-15 min, electric fields of several tens of kV/m.

Dangelo, N.↗
NASA NTRS1972

A sample computation of kinematic properties from cloud motion vectors.

Distributions of relative vorticity and balanced height have been computed from the cloud velocities associated with the cloud structure of an extratropical cyclone over the continental United States during a three-day period in March 1970. Cloud motions are assigned either to a 'mid-level,' or to a 'high level.' Derived vorticity and balanced height are compared with concurrent National Meteorological Center (NMC) analyses and also with similar kinematic quantities obtained from rawins at three constant-pressure levels. The computations of relative vorticity using mid-level cloud motion vectors show encouraging results. Patterns of computed cyclonic vorticity are related to the development, location, and movement of the surface cyclone. The analyses suggest that the 'mid-level' corresponds best to the 700-mb level. The vorticity analysis from the 'high-level' motion vectors presented difficulties.

Viezee, W.↗
DOE OSTI2016

MOLNs: A Cloud Platform for Interactive, Reproducible, and Scalable Spatial Stochastic Computational Experiments in Systems Biology Using PyURDME

Computational experiments using spatial stochastic simulations have led to important new biological insights, but they require specialized tools and a complex software stack, as well as large and scalable compute and data analysis resources due to the large computational cost associated with Monte Carlo computational workflows. The complexity of setting up and managing a large-scale distributed computation environment to support productive and reproducible modeling can be prohibitive for practitioners in systems biology. This results in a barrier to the adoption of spatial stochastic simulation tools, effectively limiting the type of biological questions addressed by quantitative modeling. In this paper, we present PyURDME, a new, user-friendly spatial modeling and simulation package, and MOLNs, a cloud computing appliance for distributed simulation of stochastic reaction-diffusion models. In conclusion, MOLNs is based on IPython and provides an interactive programming platform for development of sharable and reproducible distributed parallel computational experiments.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Computer Vision on Edge Devices for the Short Term Prediction of Cloud Cover

Edge Computing and IoT are important pieces of today's technological landscape. Here, we build a low-cost IoT sensor for sky imaging and program it using AWS GreenGrass, one of the leading IoT platforms. We demonstrate remote reprogramming of this device to load software that predicts sun shading events through the linear advection method, which is a baseline algorithm that can be used to benchmark algorithmic improvements in future work. Some future directions for sky imaging research are enumerated.

14 SOLAR ENERGY↗
NASA NTRS1987

The effect of subpixel clouds on remote sensing

A method for estimating the cloud effect on remote sensing is described, and it is applied to cloudiness in several climatological conditions. The algorithm is based on the Haurwitz (1948) measurements of the cloud layer transmission of solar radiation for an overcast sky and on an empirical interpolation of data for broken cloudiness by Pochop et al. (1968). Radiances for a sunny area observed directly from space and through a cloud, and for a shady area observed from space and through a cloud are computed. Methods for detecting the cloud effect from satellite images are discussed. The relation between cloud reflectance and cloud size is studied. It is observed that the subpixel clouds affect the detected radiance and vegetation index, and the effect depends on the cloud types and the dependence of the cloud transmissivity on cloud fraction. Procedures for decreasing or eliminating cloud effect are examined.

Kaufman, Yoram J.↗
NASA NTRS2004

Microphysical Timescales in Clouds and their Application in Cloud-Resolving Modeling

Computational phenomena (i.e., spurious supersaturation and negative mixing ratio of cloud water) usually exist in cloud-resolving models when the time step for explicit integration is larger than a microphysical timescale in clouds. In this paper, the microphysical timescales in clouds are studied, showing that the timescale of water vapor condensation (or cloud water evaporation) is smaller than 10 s - the order of a typical time step for cloud-resolving models. To avoid spurious computational phenomena in cloud-resolving modeling, it is suggested that moist entropy be used as a prognostic thermodynamic variable, and temperature be diagnosed from that and other prognostic variables. A simple numerical model with moist entropy as a prognostic variable, for example, is presented to show that spurious computational phenomena are removed when moist entropy is used as a prognostic variable.

Zeng, Xi-Ping↗