Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “CLOUD COMPUTING”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 433 records · Page 24
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Towards FAIR Workflows for Federated Experimental Sciences

A de-centralized, peer-to-peer AI metadata framework is demonstrated which can enable end-to-end metadata & lineage tracking for distributed Machine Learning pipelines spanning edge, High Performance Computing, and cloud environments. With a specific example of end-to-end microscopy algorithm and datasets, the proposed method shows how to enable reproducibility, audit trail, provenance of metadata artifacts. The emerging needs of automation in experimental sciences, ML-centric workflows, and FAIR metadata management across federated compute environments is addressed.

machine learning↗
NASA NTRS1975

Cloud motion in relation to the ambient wind field

Trajectories of convective clouds were computed from a mathematical model and compared with trajectories observed by radar. The ambient wind field was determined from the AVE IIP data. The model includes gradient, coriolis, drag, lift, and lateral forces. The results show that rotational effects may account for large differences between the computed and observed trajectories and that convective clouds may move 10 to 20 degrees to the right or left of the average wind vector and at speeds 5 to 10 m/sec faster or slower than the average ambient wind speed.

Fuelberg, H. E.↗
DOE OSTI2016

Cloud object store for checkpoints of high performance computing applications using decoupling middleware

Cloud object storage is enabled for checkpoints of high performance computing applications using a middleware process. A plurality of files, such as checkpoint files, generated by a plurality of processes in a parallel computing system are stored by obtaining said plurality of files from said parallel computing system; converting said plurality of files to objects using a log structured file system middleware process; and providing said objects for storage in a cloud object storage system. The plurality of processes may run, for example, on a plurality of compute nodes. The log structured file system middleware process may be embodied, for example, as a Parallel Log-Structured File System (PLFS). The log structured file system middleware process optionally executes on a burst buffer node.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2017

The medical science DMZ: a network design pattern for data-intensive medical science

Abstract Objective We describe a detailed solution for maintaining high-capacity, data-intensive network flows (eg, 10, 40, 100 Gbps+) in a scientific, medical context while still adhering to security and privacy laws and regulations. Materials and Methods High-end networking, packet-filter firewalls, network intrusion-detection systems. Results We describe a “Medical Science DMZ” concept as an option for secure, high-volume transport of large, sensitive datasets between research institutions over national research networks, and give 3 detailed descriptions of implemented Medical Science DMZs. Discussion The exponentially increasing amounts of “omics” data, high-quality imaging, and other rapidly growing clinical datasets have resulted in the rise of biomedical research “Big Data.” The storage, analysis, and network resources required to process these data and integrate them into patient diagnoses and treatments have grown to scales that strain the capabilities of academic health centers. Some data are not generated locally and cannot be sustained locally, and shared data repositories such as those provided by the National Library of Medicine, the National Cancer Institute, and international partners such as the European Bioinformatics Institute are rapidly growing. The ability to store and compute using these data must therefore be addressed by a combination of local, national, and industry resources that exchange large datasets. Maintaining data-intensive flows that comply with the Health Insurance Portability and Accountability Act (HIPAA) and other regulations presents a new challenge for biomedical research. We describe a strategy that marries performance and security by borrowing from and redefining the concept of a Science DMZ, a framework that is used in physical sciences and engineering research to manage high-capacity data flows. Conclusion By implementing a Medical Science DMZ architecture, biomedical researchers can leverage the scale provided by high-performance computer and cloud storage facilities and national high-speed research networks while preserving privacy and meeting regulatory requirements.

Peisert, Sean↗
DOE OSTI2020

Innovations in Sensors and Controls for Building Energy Management: Research and Development Opportunities Report for Emerging Technologies

Sensors, actuators, and controllers, which collectively serve as the backbone of cyberphysical systems for building energy management, are one of the core technical areas of investment for achieving the U.S. Department of Energy (DOE) Building Technologies Office's (BTO's) goals for energy affordability in the national building stock - both commercial and residential. In fact, an aggregated annual energy savings of 29% is estimated in the commercial sector alone through the implementation of efficiency measures using current state-of-the-art sensors and controls to retune buildings by optimizing programmable settings based on occupant schedules and comfort requirements, as well as detecting and diagnosing equipment operation and installation problems (Fernandez et al. 2017). Monitoring and control of building conditions and operations has advanced significantly, from the invention of the modern thermostat just before the start of the 20th century to the midcentury incorporation of direct digital control into devices, the introduction of open protocols and network communications at the end of the century, and finally the invention of cloud-based computing and additional advancements that have enabled remote operation and a proliferation of connected and intelligent devices in building automation. Despite this potential, however, two main challenges hinder widespread adoption of sensors and controls in building operations that can ensure savings for high-efficiency components and equipment (e.g., heat pumps, windows, and lighting devices), as well as additional savings from more sophisticated control architectures and algorithms. energy savings of 29% is estimated in the commercial sector alone through the implementation of efficiency measures using current state-of-the-art sensors and controls to retune buildings by optimizing programmable settings based on occupant schedules and comfort requirements, as well as detecting and diagnosing equipment operation and installation problems (Fernandez et al. 2017). Monitoring and control of building conditions and operations has advanced significantly, from the invention of the modern thermostat just before the start of the 20th century to the midcentury incorporation of direct digital control into devices, the introduction of open protocols and network communications at the end of the century, and finally the invention of cloud-based computing and additional advancements that have enabled remote operation and a proliferation of connected and intelligent devices in building automation. Despite this potential, however, two main challenges hinder widespread adoption of sensors and controls in building operations that can ensure savings for high-efficiency components and equipment (e.g., heat pumps, windows, and lighting devices), as well as additional savings from more sophisticated control architectures and algorithms.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2017

Security and Cloud Outsourcing Framework for Economic Dispatch

The computational complexity and problem sizes of power grid applications have increased significantly with the advent of renewable resources and smart grid technologies. The current paradigm of solving these issues consist of inhouse high performance computing infrastructures, which have drawbacks of high capital expenditures, maintenance, and limited scalability. Cloud computing is an ideal alternative due to its powerful computational capacity, rapid scalability, and high cost-effectiveness. A major challenge, however, remains in that the highly confidential grid data is susceptible for potential cyberattacks when outsourced to the cloud. In this work, a security and cloud outsourcing framework is developed for the Economic Dispatch (ED) linear programming application. As a result, the security framework transforms the ED linear program into a confidentiality-preserving linear program, that masks both the data and problem structure, thus enabling secure outsourcing to the cloud. Results show that for large grid test cases the performance gain and costs outperforms the in-house infrastructure.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Rahasak—Scalable blockchain architecture for enterprise applications

Blockchain-based decentralized infrastructure has been adapted in various industries to handle the sensitive data in a privacy-preserving manner without trusting third parties. However, integrating state-of-the-art blockchain platforms with the scalable, enterprise-level applications result in several challenges. Current blockchain platforms do not support high transaction throughput, lack high scalability, and cannot provide real-time transaction processing and back-pressure operation handling in high transaction throughput applications(e.g Big data, IoT). In this paper, we propose a novel permissioned blockchain platform “Rahasak” for highly scalable, enterprise applications. Rahasak blockchain adopts the Apache Kafka-based consensus on top of a “Validate-Execute-Group” blockchain architecture to handle realtime transaction execution on the blockchain. The architecture is equipped with a functional programming and actor-based smart contract platform that enables concurrent execution of transactions in the blockchain. Rahasak supports high transaction throughput, high scalability, concurrent transaction execution, data analytics features. Finally, with Rahasak, we make blockchain more scalable, secure, structured and meaningful for further data analytics.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS1975

Satellite-tracked cumulus velocities

Basic problems in the interpretation of satellite-tracked low-cloud velocities are reviewed. The METRACOM system of cloud velocity computation is outlined, and caution is urged in converting cloud velocities into wind velocities. The motion of various cumulus cells over Springfield, Mo., Barbados, and Tampa, Fla., is analyzed. It is shown that multiturret cells do not always move with the wind, that addition and deletion of turrets belonging to a specific cell may cause erratic motion in a tracer cell, and that cumulus turrets between 0.3 and 2 miles in size are the best targets for inferring the mean wind velocity within the subcloud layers. It is concluded that the accuracy of wind velocity estimates will be no better than 2 meters/sec unless the physical and dynamic characteristics of cumulus motion are further investigated.

Fujita, T. T.↗
NASA NTRS1994

Arctic ocean radiative fluxes and cloud forcing estimated from the ISCCP C2 cloud dataset, 1983-1990

Radiative fluxes and cloud forcings for the ocean areas of the Arctic are computed from the monthly cloud product of the International Satellite Cloud Climatology Project (ISCCP) for 1983-90. Spatially averaged short-wave fluxes are compared well with climatological values, while downwelling longwave fluxes are significantly lower. This is probably due to the fact that the ISCCP cloud amounts are underestimates. Top-of-the-atmosphere radiative fluxes are in excellent agreement with measurements from the Earth Radiation Budget Experiment (ERBE). Computed cloud forcings indicate that clouds have a warming effect at the surface and at the top of the atmosphere during winter and a cooling effect during summer. The net radiative effect of clouds is larger at the surface during winter but greater at the top of the atmosphere during summer. Overall the net radiative effect of clouds at the top of the atmosphere is one of cooling. This is in contrast to a previous result from ERBE data showing arctic cloud forcings have a net warming effect. Sensitivities to errors in input parameters are generally greater during winter with cloud amount being the most important paarameter. During summer the surface radiation balance is most sensitive to errors in the measurements of surface reflectance. The results are encouraging, but the estimated error of 20 W/sq m in surface net radiative fluxes is too large, given that estimates of the net radiative warming effect due to a doubling of CO2 are on the order of 4 W/sq m. Because it is difficult to determine the accuracy of results with existing in situ observations, it is recommended that the development of improved algorithms for the retrieval of surface radiative properties be accompanied by the simultaneous assembly of validation datasets.

Schweiger, Axel J.↗
DOE OSTI2022

Game-Theoretic Strategies for Cyber-Physical Infrastructures Under Component Disruptions

In this work, networked infrastructures of recursively defined systems composed of discrete cyber and physical components are considered. The components of basic systems at the finest levels can be disrupted by cyber or physical means, and can be reinforced to survive at certain costs. A problem of ensuring the infrastructure performance is formulated as a game between a provider and an attacker, who probabilistically choose components to reinforce and attack, respectively. The disruptions of this infrastructure are characterized using the aggregate failure correlation function that specifies the conditional failure probability of the infrastructure given the failure of an individual system at that level. The survival probabilities of basic systems satisfy simple product-form, first-order differential equations expressed in terms of the multiplier functions. The utility functions of the provider and attacker are composed of the reward and cost terms, both expressed in terms of the component reinforcement and attack probabilities. The Nash equilibrium of this game is characterized, along with the sensitivity functions of the survival probabilities of basic systems that highlight their dependence individually on the cost-benefit terms, the correlation functions, and the multiplier functions. These results are illustrated using simplified models of a distributed cloud servers infrastructure, a 5G data network infrastructure, a high performance computing federation, and a smart energy grid infrastructure.

42 ENGINEERING↗
DOE OSTI2022

The Concept of a Quantum Edge Simulator: Edge Computing and Sensing in the Quantum Era

Sensors, enabling observations across vast spatial, spectral, and temporal scales, are major data generators for information technology (IT). Processing, storing, and communicating this ever-growing amount of data pose challenges for the current IT infrastructure. Edge computing—an emerging paradigm to overcome the shortcomings of cloud-based computing—could address these challenges. Furthermore, emerging technologies such as quantum computing, quantum sensing, and quantum communications have the potential to fill the performance gaps left by their classical counterparts. Here, we present the concept of an edge quantum computing (EQC) simulator—a platform for designing the next generation of edge computing applications. An EQC simulator is envisioned to integrate elements from both quantum technologies and edge computing to allow studies of quantum edge applications. The presented concept is motivated by the increasing demand for more sensitive and precise sensors that can operate faster at lower power consumption, generating both larger and denser datasets. These demands may be fulfilled with edge quantum sensor networks. Envisioning the EQC era, we present our view on how such a scenario may be amenable to quantification and design. Given the cost and complexity of quantum systems, constructing physical prototypes to explore design and optimization spaces is not sustainable, necessitating EQC infrastructure and component simulators to aid in co-design. We discuss what such a simulator may entail and possible use cases that invoke quantum computing at the edge integrated with new sensor infrastructures.

47 OTHER INSTRUMENTATION↗
DOE OSTI2017

SMASH: Survey of the MAgellanic Stellar History

The Large and Small Magellanic Clouds are unique local laboratories for studying the formation and evolution of small galaxies in exquisite detail. The Survey of the MAgellanic Stellar History (SMASH) is an NOAO community Dark Energy Camera (DECam) survey of the Clouds mapping 480 deg{sup 2} (distributed over ∼2400 square degrees at ∼20% filling factor) to ∼24th mag in ugriz . The primary goals of SMASH are to identify low surface brightness stellar populations associated with the stellar halos and tidal debris of the Clouds, and to derive spatially resolved star formation histories. Here, we present a summary of the survey, its data reduction, and a description of the first public Data Release (DR1). The SMASH DECam data have been reduced with a combination of the NOAO Community Pipeline, the PHOTRED automated point-spread-function photometry pipeline, and custom calibration software. The astrometric precision is ∼15 mas and the accuracy is ∼2 mas with respect to the Gaia reference frame. The photometric precision is ∼0.5%–0.7% in griz and ∼1% in u with a calibration accuracy of ∼1.3% in all bands. The median 5 σ point source depths in ugriz are 23.9, 24.8, 24.5, 24.2, and 23.5 mag. The SMASH data have already been used to discover the Hydra II Milky Way satellite, the SMASH 1 old globular cluster likely associated with the LMC, and extended stellar populations around the LMC out to R ∼ 18.4 kpc. SMASH DR1 contains measurements of ∼100 million objects distributed in 61 fields. A prototype version of the NOAO Data Lab provides data access and exploration tools.

79 ASTRONOMY AND ASTROPHYSICS↗
NASA NTRS1986

Cloud cover estimation using bispectral satellite measurements

An algorithm has been developed for cloud cover estimation using bispectral satellite measurements. Based on the distribution of pixels in albedo-brightness temperature space, a number of threshold values are applied to identify those pixels which are most likely totally cloud filled. Mean cloudy-column albedo in a region much larger than a single pixel is then estimated and cloud cover computed. The algorithm has been applied to the International Satellite Cloud Climatology Project Geostationary Meteorological Satellite B2 data. Locations of tropical convective cells and the passage of fronts in higher latitudes are identified. Since these features represent the states of large-scale atmospheric circulations, it is concluded that the algorithm can yield consistent cloud data sets useful for climate studies.

Chou, M.-D.↗