Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Cloud computing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 523 records · Page 29
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Report for the ASCR Workshop on Visualization for Scientific Discovery, Decision-Making, and Communication

Visualization—the use of visual elements to explore data, form hypotheses, or convey conclusions—is an integral part of the scientific process. Starting from an initial exploration of new data to illustrating outcomes for the general public, visualization is one of the most intuitive and powerful modes of communication. With the explosion of new data sources and types, unprecedented volumes of data, and new technologies, such as virtual reality (VR) and artificial intelligence (AI), visualization has become increasingly essential but also ever more challenging. The Department of Energy’s (DOE) Office of Advanced Scientific Computing Research (ASCR) sponsored a Basic Research Needs workshop in January 2022 to understand the major opportunities and grand challenges in visualization tools and technologies for scientific computing as well as for DOE-relevant applications and goals in general. The workshop identified five priority research directions (PRDs) for visualization to support scientific discovery, decision making, and communication. The first three PRDs describe interconnected research themes addressing the need for new techniques to deal with complex data, uncertainty, and interpretability (PRD 1); the need for scalable and interoperable software stacks (PRD 2); and the challenges and opportunities inherent in new technologies, such as VR, cloud, or exascale computing (PRD 3). The remaining two PRDs describe foundational research themes that recognize the potential of visualizations to provide equitable access to information and to strengthen the scientific discourse (PRD 4); and the need to consider human factors when designing visualizations (PRD 5). Collectively, these PRDs form the pillars for a coherent, long-term research and development strategy in Visualization for Scientific Discovery, Decision-Making, and Communication in the context of the Office of Science’s mission scope.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Joint Genome Institute Analysis Workflow Service (JAWS) v2.7

The U.S. Department of Energy Joint Genome Institute (JGI) has developed the JGI Analysis Workflow Service (JAWS) as a distributed framework to run computational workflows across diverse high-performance computing (HPC) and cloud environments. JAWS enhances the reusability, scalability, and robustness of scientific workflows by orchestrating data movement, code execution, and results retrieval across multiple DOE facilities. At its core, JAWS integrates the Cromwell workflow engine to run workflows expressed in the Workflow Description Language (WDL), ensuring portability and interoperability. To provide consistent runtime environments, JAWS employs container technologies such as Shifter, Apptainer, and Docker. Workflow tasks are managed via HTCondor on HPC backends, while Globus ensures secure and efficient data transfer between sites. JAWS is deployed as a multi-site workflow manager across national laboratory computing facilities, with dedicated instances supporting community projects such as the National Microbiome Data Collaborative (NMDC) and KBase. This distributed, service-oriented architecture enables users to "write once, run anywhere," providing scalable, production-quality workflow execution.

Kirton, Edward↗
NASA NTRS2010

Using Multi-Scale Modeling Systems to Study the Precipitation Processes

In recent years, exponentially increasing computer power has extended Cloud Resolving Model (CRM) integrations from hours to months, the number of computational grid points from less than a thousand to close to ten million. Three-dimensional models are now more prevalent. Much attention is devoted to precipitating cloud systems where the crucial 1-km scales are resolved in horizontal domains as large as 10,000 km in two-dimensions, and 1,000 x 1,000 km2 in three-dimensions. Cloud resolving models now provide statistical information useful for developing more realistic physically based parameterizations for climate models and numerical weather prediction models. It is also expected that NWP and mesoscale model can be run in grid size similar to cloud resolving model through nesting technique. Recently, a multi-scale modeling system with unified physics was developed at NASA Goddard. It consists of (1) a cloud-resolving model (Goddard Cumulus Ensemble model, GCE model), (2) a regional scale model (a NASA unified weather research and forecast, WRF), (3) a coupled CRM and global model (Goddard Multi-scale Modeling Framework, MMF), and (4) a land modeling system. The same microphysical processes, long and short wave radiative transfer and land processes and the explicit cloud-radiation, and cloud-land surface interactive processes are applied in this multi-scale modeling system. This modeling system has been coupled with a multi-satellite simulator to use NASA high-resolution satellite data to identify the strengths and weaknesses of cloud and precipitation processes simulated by the model. In this talk, a review of developments and applications of the multi-scale modeling system will be presented. In particular, the results from using multi-scale modeling system to study the interactions between clouds, precipitation, and aerosols will be presented. Also how to use of the multi-satellite simulator to improve precipitation processes will be discussed.

Tao, Wei-Kuo↗
NASA NTRS2011

Using Multi-Scale Modeling Systems and Satellite Data to Study the Precipitation Processes

In recent years, exponentially increasing computer power has extended Cloud Resolving Model (CRM) integrations from hours to months, the number of computational grid points from less than a thousand to close to ten million. Three-dimensional models are now more prevalent. Much attention is devoted to precipitating cloud systems where the crucial 1-km scales are resolved in horizontal domains as large as 10,000 km in two-dimensions, and 1,000 x 1,000 km2 in three-dimensions. Cloud resolving models now provide statistical information useful for developing more realistic physically based parameterizations for climate models and numerical weather prediction models. It is also expected that NWP and mesoscale model can be run in grid size similar to cloud resolving model through nesting technique. Recently, a multi-scale modeling system with unified physics was developed at NASA Goddard. It consists of (l) a cloud-resolving model (Goddard Cumulus Ensemble model, GCE model), (2) a regional scale model (a NASA unified weather research and forecast, WRF), (3) a coupled CRM and global model (Goddard Multi-scale Modeling Framework, MMF), and (4) a land modeling system. The same microphysical processes, long and short wave radiative transfer and land processes and the explicit cloud-radiation, and cloud-land surface interactive processes are applied in this multi-scale modeling system. This modeling system has been coupled with a multi-satellite simulator to use NASA high-resolution satellite data to identify the strengths and weaknesses of cloud and precipitation processes simulated by the model. In this talk, the recent developments and applications of the multi-scale modeling system will be presented. In particular, the results from using multi-scale modeling system to study the precipitating systems and hurricanes/typhoons will be presented. The high-resolution spatial and temporal visualization will be utilized to show the evolution of precipitation processes. Also how to use of the multi-satellite simulator tqimproy~ precipitation processes will be discussed.

Tao, Wei-Kuo↗
NASA NTRS2011

Microphysics in the Multi-Scale Modeling Systems with Unified Physics

In recent years, exponentially increasing computer power has extended Cloud Resolving Model (CRM) integrations from hours to months, the number of computational grid points from less than a thousand to close to ten million. Three-dimensional models are now more prevalent. Much attention is devoted to precipitating cloud systems where the crucial 1-km scales are resolved in horizontal domains as large as 10,000 km in two-dimensions, and 1,000 x 1,000 km2 in three-dimensions. Cloud resolving models now provide statistical information useful for developing more realistic physically based parameterizations for climate models and numerical weather prediction models. It is also expected that NWP and mesoscale model can be run in grid size similar to cloud resolving model through nesting technique. Recently, a multi-scale modeling system with unified physics was developed at NASA Goddard. It consists of (l) a cloud-resolving model (Goddard Cumulus Ensemble model, GCE model), (2) a regional scale model (a NASA unified weather research and forecast, WRF), (3) a coupled CRM and global model (Goddard Multi-scale Modeling Framework, MMF), and (4) a land modeling system. The same microphysical processes, long and short wave radiative transfer and land processes and the explicit cloud-radiation, and cloud-surface interactive processes are applied in this multi-scale modeling system. This modeling system has been coupled with a multi-satellite simulator to use NASA high-resolution satellite data to identify the strengths and weaknesses of cloud and precipitation processes simulated by the model. In this talk, the microphysics developments of the multi-scale modeling system will be presented. In particular, the results from using multi-scale modeling system to study the heavy precipitation processes will be presented.

Tao, Wei-Kuo↗
NASA NTRSDate not supplied

Radiometric Assessment of the First Three Years of the NOAA-20 VIIRS Reflective Solar Bands Calibration

NASA’s Clouds and the Earth’s Radiant Energy System (CERES) SYN1deg Ed4.1 product utilizes geostationary (GEO) satellite measured radiances and retrieved cloud properties to account for the regional diurnal fluctuations in the Earth’s radiant broadband fluxes for times between the CERES measurements gathered from the Aqua (1:30 PM) and Terra (10:30 AM) sun-synchronous satellites. In CERES Edition 4 products, a global uniformity in the cloud properties and computed surface fluxes across the GEO satellite domains is maintained by scaling the radiance observations from more than twenty GEO visible imagers in the CERES record to a common radiometric reference scale, i.e., Aqua-MODIS. With the new-generation GEO (Himawari-8/9 and GOES-16/17) imagers having multiple reflective solar bands (RSB) that are spectrally similar to those of VIIRS, the CERES Imager and Geostationary Calibration Group (IGCG) is preparing to use NOAA-20 VIIRS as the reference imager for maintaining the radiometric uniformity across the GEO imager constellation. Given the recent Aqua satellite anomaly, this transition may happen sooner than the projected date of Aqua’s de-orbit. This paper presents an independent performance evaluation of the first three years of the NOAA-20 VIIRS RSB calibration in the NASA VIIRS Land Science Investigator-led Processing System (Land SIPS) L1b Collection 2 dataset. The temporal radiometric stability is assessed using multiple invariant Earth targets, including tropical deep convective clouds and the Saharan desert. The invariant target anisotropic reflectance at the top of atmosphere was modeled using five years of stable satellite observations acquired from the previous VIIRS instrument onboard the Suomi National Polar-orbiting Partnership (S-NPP) satellite. The anisotropic corrections are essential for detecting temporal trends with a high statistical confidence. In addition, the radiometric consistency between the RSB of the two VIIRS instruments will be evaluated.

Rajendra Bhatt↗
NASA NTRSDate not supplied

Radiometric Assessment of the First Three Years of the NOAA-20 VIIRS Reflective Solar Bands Calibration

NASA’s Clouds and the Earth’s Radiant Energy System (CERES) SYN1deg Ed4.1 product utilizes geostationary (GEO) satellite measured radiances and retrieved cloud properties to account for the regional diurnal fluctuations in the Earth’s radiant broadband fluxes for times between the CERES measurements gathered from the Aqua (1:30 PM) and Terra (10:30 AM) sun-synchronous satellites. In CERES Edition 4 products, a global uniformity in the cloud properties and computed surface fluxes across the GEO satellite domains is maintained by scaling the radiance observations from more than twenty GEO visible imagers in the CERES record to a common radiometric reference scale, i.e., Aqua-MODIS. With the new-generation GEO (Himawari-8/9 and GOES-16/17) imagers having multiple reflective solar bands (RSB) that are spectrally similar to those of VIIRS, the CERES Imager and Geostationary Calibration Group (IGCG) is preparing to use NOAA-20 VIIRS as the reference imager for maintaining the radiometric uniformity across the GEO imager constellation. Given the recent Aqua satellite anomaly, this transition may happen sooner than the projected date of Aqua’s de-orbit. This paper presents an independent performance evaluation of the first three years of the NOAA-20 VIIRS RSB calibration in the NASA VIIRS Land Science Investigator-led Processing System (Land SIPS) L1b Collection 2 dataset. The temporal radiometric stability is assessed using multiple invariant Earth targets, including tropical deep convective clouds and the Saharan desert. The invariant target anisotropic reflectance at the top of the atmosphere was modeled using five years of stable satellite observations acquired from the previous VIIRS instrument onboard the Suomi National Polar-orbiting Partnership (S-NPP) satellite. The anisotropic corrections are essential for detecting temporal trends with high statistical confidence. In addition, the radiometric consistency between the RSB of the two VIIRS instruments will be evaluated.

Rajendra Bhatt↗
NASA NTRS2002

Use of TRMM Data to Test an Improved Parameterization of Stratiform Precipitation

We successfully implemented our EAUcup parameterization of convection in our most recent geodesic-grid version of the Colorado State University General Circulation Model (CSU GCM). Tendencies due to convection and large-scale cloud microphysics are computed using the same time-step, allowing smoother interactions between convective and large-scale moist processes. Figures illustrate our most recent progress on the simulation of convective and stratiform precipitations for January. Comparisons against TRMM precipitation radar (PR) data would reveal a systematic overestimation of the simulated monthly-mean convective rainfall over well-known areas of deep convection. One major deficiency in the global distribution of stratiform precipitation simulated in the CSU GCM is the lack of stratiform precipitation over land in the tropics. This result strongly disagree with Fowler and Randall who show that convective and stratiform precipitations always coexist and that their ratio to the total precipitation is about 0.5. We believe that stratiform precipitation over land evaporates before reaching the ground because the lower troposphere remains too dry in response to the lack of convective detrainment occurring immediately above the Planetary Boundary Layer (PBL). This issue is further investigated at present. We made significant progress in the development of our parameterization of fractional cloudiness. As an example of our ongoing research effort, a figure shows the global distribution of the cloud ice mixing ratio and corresponding fractional area of ice clouds at 250 hPa. These results were obtained using our latitude-longitude grid version of the CSU GCM. There is a nice correspondence between areas of high (low) values of the cloud ice mixing ratio and the cloud fraction. A nice correspondence between the global distribution of the cloud water mixing ratio and fraction of water clouds in the lower troposphere can also be found. We are pursuing this effort, but in the geodesic version of the GCM. We hope to be able to make comparison of the simulated precipitation against TRMM precipitation data in the near future.

Randall, David A.↗
NASA NTRS1996

Cloud identification using genetic algorithms and massively parallel computation

As a Guest Computational Investigator under the NASA administered component of the High Performance Computing and Communication Program, we implemented a massively parallel genetic algorithm on the MasPar SIMD computer. Experiments were conducted using Earth Science data in the domains of meteorology and oceanography. Results obtained in these domains are competitive with, and in most cases better than, similar problems solved using other methods. In the meteorological domain, we chose to identify clouds using AVHRR spectral data. Four cloud speciations were used although most researchers settle for three. Results were remarkedly consistent across all tests (91% accuracy). Refinements of this method may lead to more timely and complete information for Global Circulation Models (GCMS) that are prevalent in weather forecasting and global environment studies. In the oceanographic domain, we chose to identify ocean currents from a spectrometer having similar characteristics to AVHRR. Here the results were mixed (60% to 80% accuracy). Given that one is willing to run the experiment several times (say 10), then it is acceptable to claim the higher accuracy rating. This problem has never been successfully automated. Therefore, these results are encouraging even though less impressive than the cloud experiment. Successful conclusion of an automated ocean current detection system would impact coastal fishing, naval tactics, and the study of micro-climates. Finally we contributed to the basic knowledge of GA (genetic algorithm) behavior in parallel environments. We developed better knowledge of the use of subpopulations in the context of shared breeding pools and the migration of individuals. Rigorous experiments were conducted based on quantifiable performance criteria. While much of the work confirmed current wisdom, for the first time we were able to submit conclusive evidence. The software developed under this grant was placed in the public domain. An extensive user's manual was written and distributed nationwide to scientists whose work might benefit from its availability. Several papers, including two journal articles, were produced.

Buckles, Bill P.↗
DOE OSTI2020

An open source analysis framework for large-scale building energy modeling

Full integration of building energy modelling into the design and retrofit process has long been a goal of building scientists and practitioners. However, significant barriers still exist. Among them are the lack of available: (1) configurable technology stacks for performing both small- and large-scale analyses, (2) different classes of algorithms compatible with common design workflows, and (3) analysis tools for effectively visualizing large-scale simulation results. This article discusses the OpenStudio® Analysis Framework: a scalable analysis framework for building energy modelling that was developed to overcome the three barriers listed above. The framework is open-source and scalable to facilitate wider adoption and has a clearly defined application programming interface upon which other applications can be built. It runs on high-performance computing systems, within cloud infrastructure, and on laptops, and uses a common workflow to enable different classes of algorithms. Lessons learned from previous development efforts are also discussed.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2022

Benchmarking Information Scrambling

Information scrambling refers to the rapid spreading of initially localized information over an entire system, via the generation of global entanglement. This effect is usually detected by measuring a temporal decay of the out-of-time order correlators. However, in experiments, decays of these correlators suffer from fake positive signals from various sources, e.g., decoherence due to inevitable couplings to the environment, or errors that cause mismatches between the purported forward and backward evolutions. Here, in this Letter, we provide a simple and robust approach to single out the effect of genuine scrambling. This allows us to benchmark the scrambling process by quantifying the degree of the scrambling from the noisy backgrounds. We also demonstrate our protocol with simulations on IBM cloud-based quantum computers.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Development and Validation of Southeast Asia Solar Resource Data [Slides]

Lack of access to high-quality, publicly available, time series solar data to inform decisions that will transform energy sectors in Southeast Asia is a challenge. The solution is to level the playing field by offering free, high-quality, robust solar data to inform private sector investment and policymaking. This is done by (1) leveraging deep NREL expertise in atmospheric science, solar resource assessment, high-performance computing, and cloud-based data dissemination, (2) producing and validating high spatial and temporal resolution solar resource data, (3) making data available on the USAID-funded global Renewable Energy Data Explorer platform, (4) providing capacity building for data and applications, and (5) informing future demand-driven tool development.

14 SOLAR ENERGY↗
DOE OSTI2024

GlideinBenchmark: collecting resource information to optimize provisioning

Choosing the right resource can speedup jobs completion, better utilize the available hardware and visibly reduce costs, especially when renting computers on the cloud. This was demonstrated in earlier studies on HEPCloud. But the benchmarking of the resources proved to be a laborious and time-consuming process. This paper presents GlideinBenchmark, a new Web application leveraging the pilot infrastructure of GlideinWMS to benchmark resources, and shows how to use the data collected and published by GlideinBenchmark to automate the optimal selection of resources. An experiment can select the benchmark or the set of benchmarks that most closely evaluate the performance of its workflows. With GlideinBenchmark and the help of the GldieinWMS Factory it controls the benchmark execution. Finally, a scheduler like HEPCloud’s Decision Engine can use the results to optimize resource provisioning.

Mambelli, Marco↗
DOE OSTI2025

GlideinBenchmark: collecting resource information to optimize provisioning

Choosing the right resource can speed up job completion, better utilize the available hardware, and visibly reduce costs, especially when renting computers in the cloud. This was demonstrated in earlier studies on HEPCloud. However, the benchmarking of the resources proved to be a laborious and time-consuming process. This paper presents GlideinBenchmark, a new Web application leveraging the pilot infrastructure of GlideinWMS to benchmark resources, and it shows how to use the data collected and published by GlideinBenchmark to automate the optimal selection of resources. An experiment can select the benchmark or the set of benchmarks that most closely evaluate the performance of its workflows. GlideinBenchmark, with the help of the GlideinWMS Factory, controls the benchmark execution. Finally, a scheduler like HEPCloud's Decision Engine can use the results to optimize resource provisioning.

Mambelli, Marco [Fermilab] (ORCID:0000000294892681↗
DOE OSTI2026

The remarkable inefficiency of stratocumulus

Marine stratocumulus clouds play a central role in Earth's climate system by reflecting incoming solar radiation and exerting a strong cooling effect. Their organization into open and closed mesoscale cellular morphologies can be thought of as an example of bistable dynamics driven by aerosol–cloud interactions and mesoscale processes. From the perspective of non-equilibrium thermodynamics, these structures are an example of a far-from-equilibrium open system that continuously produces and exports entropy. While entropy production has been studied in idealized deep convective systems, it has not yet been quantified for shallow clouds. Here, we compute and decompose the internal entropy production of open- and closed-cell stratocumulus using an ensemble of large-eddy simulations. We show that the overall entropy production of stratocumulus is low, reflecting the limited vertical extent and corresponding reduced ability to utilize the energy fluxes at the system's boundaries. Moist processes dominate the overall irreversibility, which, combined with their low entropy production, leads to a mechanical efficiency about an order of magnitude smaller than in deep convective systems. Although the dominant irreversible processes differ between open- and closed-cell regimes, the distributions of total entropy production largely overlap across the ensemble, limiting the ability to distinguish the dynamics of individual cases based solely on total entropy production.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

A geospatial risk analysis graphical user interface for identifying hazardous chemical emission sources

Background: Performing back trajectory and forward trajectory using the Hybrid Single-Particle Lagrangian Integrated Trajectory Model (HYSPLIT) is a reliable approach for assessing particle transport after release among mid-field atmospheric models. HYSPLIT has an externally facing online interface that allows non-expert users to run the model trajectories without requiring extensive training or programming. However, the existing HYSPLIT interface is limited if simulations have a large amount of meteorological data and timesteps that are not coincident. The objective of this study is to design and develop a more robust tool to rapidly evaluate hazard transport conditions and to perform risk analysis, while still maintaining an intuitive and user-friendly interface. Methods: HYSPLIT calculates forward and backward trajectories of particles based on wind speed, wind direction, and the corresponding location, timestamp, and Pasquill stability classes of the regions of the atmosphere in terms of the wind speed, the amount of solar radiation, and the fractional cloud cover. The computed particle transport trajectories, combined with the online Proton Transfer Reaction-Mass Spectrometry (PTR-MS) data (https://figshare.com/articles/dataset/ARL_Data_from_PROS_station_at_Hanford_site/19993964), can be used to identify and quantify the sources and affected area of the hazardous chemicals’ emission using the potential source distribution function (PSDF). PSDF is an improved statistical function based on the well-known potential source contribution function (PSCF) in establishing the air pollutant source and receptor relationship. Performing this analysis requires a range of meteorological and pollutant concentration measurements to be statistically meaningful. The existing HYSPLIT graphical user interface (GUI) does not easily permit computations of trajectories of a dataset of meteorological data in high temporal frequency. To improve the performance of HYSPLIT computations from a large dataset and enhance risk analysis of the accidental release of material at risk, a geospatial risk analysis tool (GRAT-GUI) is created to allow large data sets to be processed instantaneously and to provide ease of visualization. Results: The GRAT-GUI is a native desktop-based application and can be run in any Windows 10 system without any internet access requirements, thus providing a secure way to process large meteorological datasets even on a standalone computer. GRAT-GUI has features to import, integrate, and convert meteorological data with various formats for hazardous chemical emission source identification and risk analysis as a self-explanatory user interface. The tool is available at https://figshare.com/articles/software/GRAT/19426742.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS1976

Extension of surface data by use of meteorological satellites

Ways of using meteorological satellite data to extend surface data are summarized. Temperature models are prepared from infrared data from ITOS/NOAA, NIMBUS, SMS/GOES, or future LANDSAT satellites. Using temperatures for surface meteorological stations as anchors, an adjustment is made to temperature values for each pixel in the model. The result is an image with an estimated temperature for each pixel. This provides an economical way of producing detailed temperature information for data-sparse areas, such as are found in underdeveloped countries. Related uses of these satellite data are also given, including the use of computer prepared cloud-free composites to extend climatic zones, and their use in discrimination of reflectivity-thermal regime zones.

Giddings, L. E.↗