Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Cloud Implementation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 865 records · Page 48

Innovation in Radiological Security, Part 2 of 2 – Insights into Developing a Cloud-hosted Security Technology

A Sentry Remote Monitoring System (Sentry-RMS) is a stand-alone security system that provides detection, assessment, and communication of priority alarms as an additional means of thwarting internal and external threats to sites that maintain radiological material. The SEntry-RMS CommUnications and REsponse (Sentry-SECURE) platform is an optional feature of the Sentry-RMS that relays priority alarm information to the identified response stakeholders. Sentry-SECURE is hosted in a cloud environment that abstracts the data owner’s and data consumer’s platforms to allow for greater information sharing. This promotes situational awareness amongst authorized users and enables future innovation among modern response platforms. When securely architecting a cloud solution such as this, the use of design paradigms can be an effective tool to increase the accuracy and reliability of cyber- and information-security-related decisions made throughout the development process. This approach also supports the categorization of design considerations into three levels: industry concepts, project approaches, and data protections for digital processes. Industry concepts consist of the notional underpinnings that guide or motivate a security process, system, or design but often lack any tangible attributes. Project approaches represent decisions made during the design and development process to prioritize a solution, method, or practice above another that may provide a comparable functional output but lacks a desired security benefit. Data protections for digital processes represent the selection, integration, and implementation of specific controls for a given asset. This paper will explore specific examples of how Sentry-SECURE has been designed to account for considerations at each of these three levels, while balancing the operational intent of the platform with the security enhancements necessary to maintain data integrity, availability, and confidentiality.

assessment, RMS, security, physical, cloud, Cyber ↗

Accurate contrast determination for X-ray speckle visibility spectroscopy

X-ray speckle visibility spectroscopy using X-ray free-electron lasers has long been proposed as a probe of fast dynamics in noncrystalline materials. In this paper, numerical modeling is presented to show how the data interpretation of visibility spectroscopy can be impacted by the nonidealities of real-life X-ray detectors. Using simulated detector data, this work provides a detailed analysis of the systematic errors of several contrast extraction algorithms in the context of low-count-rate X-ray speckle visibility spectroscopy and their origins are discussed. Here, it was found that the finite detector charge cloud and pixel size lead to an unavoidable `degeneracy' in photon position determination, and that the contrasts extracted using different algorithms can all be corrected by a simple linear model. The results suggest that experimental calibration of the correction coefficient at the count rate of interest is possible and essential. This allows computationally lightweight algorithms to be implemented for on-the-fly analysis.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

IoT-Based Comfort Control and Fault Diagnostics System for Energy-Efficient Homes

This project studies an Internet of Things (IoT)-based comfort control and fault diagnostics system (referred as iComfort in this report) for energy-efficient homes. The system delivers an occupant-comfort-oriented thermal environment adaptive to fault scenarios and achieves HVAC energy savings in a cost-effective and straightforward way. This smart iComfort home system consists of the following key features. 1) Cost-effectiveness and scalability of the entire hardware and software system: The system includes low-cost temperature, humidity, and airflow sensors, and a Raspberry Pi-based local hub that interfaces with the cloud and IoT-enabled devices. The cost is low, not only for sensors, but also the costs associated with sensor installation, system setup and commissioning, data communication and storage, and data analytics (e.g., the development of automated fault detection and diagnosis (AFDD), as well as adaptive control strategies that are both computationally efficient and practical to implement). 2) Energy performance and user satisfaction: The system delivers user satisfaction and energy savings. This includes a) ease of use, b) optimal occupant thermal comfort, and c) accurate system feedback (e.g., low false alarm of AFDD strategies). 3) Favorable demonstrated prototype performance: The prototype tested at the Pacific Northwest National Laboratory (PNNL) Lab Homes demonstrates the accuracy of fault detections and diagnoses and shows thermal comfort improvement and energy savings through adaptive and optimal HVAC operations.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Impact of LANDSAT MSS sensor differences on change detection analysis

Differences in overall sensor response, due to both factors within the sensor system, and external factors such as atmospheric effects, must be dealt with before change detection techniques using image differencing can be successfully implemented. The approach used to be coregister data to a base, followed by between image scatterogram generation and evaluation, and image differencing. Data from LANDSAT 2 and 3 were registered to LANDSAT 4 data. The area was limited to a small protion of the scene near the City of Santa Cruz because this was the only area cloud and haze free on all the images. Visual examination of each image, as well as the between image scatterograms, provide information on radiometric characteristics of each sensor. The image differencing, after normalizing for radiometric differences, provides a visual depiction of geometric distortions.

Likens, W.↗

Implementation of A New Microwave Scattering Database and A Forward Model for Active Microwave Sensors in CRTM

Radiative transfer models are extensively used for the assimilation of satellite observations into NWP models as well as retrieving geophysical products from satellite measurements. CRTM is a community model developed by NOAA JCSDA and widely used for different purposes requiring RT calculations. CRTM requires bulk scattering lookup tables in order to perform all-sky RT calculations. However, the current CRTM lookup tables for microwave frequencies were generated based on the Mie theory by assuming spherical frozen particles. The scattering lookup tables generated using the DDA technique has shown to largely improve the RT scattering calculations in the MW region. This presentation targets (i) the implementation and validation of a DDA database that was originally developed for the ARTS RT model into CRTM, and (ii) developing the CRTM active sensor module that takes advantage of the backscattering coefficients computed using the DDA method. The DDA database only provides single scattering properties of different habits, while CRTM requires bulk scattering properties. The CRTM cloud coefficients were previously generated based on the effective radius for representing the size of the particles. However, effective radius is neither measurable nor provided by the NWP models, thus need to be estimated from other geophysical variables such as water content. Therefore, in addition to calculating the CRTM bulk scattering properties from the DDA single scattering database, the CRTM was also largely modified to use cloud water content (kg.m-3), instead of effective radius, for performing the interpolation over size/mass of the particles. CRTM already requires water content as input, thus no extra variables are required for performing scattering calculations using the new ARTS DDA database. The CRTM scattering modules search for effective radius in cloud coefficient files and will use the cloud water content if the effective radius dimension is not found in the cloud coefficient files. Figure 1 shows the CRTM simulated brightness temperatures computed using different cloud coefficients versus ATMS observed values over Hurricane Irma on September 7, 2017 at 18:00 UTC. We used all the cloud water content values included in ERA5 with default CRTM/DDA habits for water, rain, snow, ice, hail, and graupel. ERA5 does not provide separate water content values for ice, hail, and graupel, thus the ice water content values were divided between ice, hail, and graupel clouds similar to what was explained in the previous section. In channels with a frequency lower than 90 GHz, emission from water and rain clouds can compensate for cloud scattering so that cloud contaminated Tbs are larger than corresponding clear sky Tbs. The DDA simulations for channels 1-7 largely perform better than the Mie simulations. The DDA simulations show a mix of small negative and positive simulated minus observed values, while the Mie results show large negative biases. The weighting functions for some of the ATMS temperature sounding channels (channels 9-15) peak mostly above the clouds, therefore the measured Tbs become less sensitive to clouds so that the results of both Mie and DDA become very similar. The Mie lookup tables generate excessive scattering for channel 16, but not enough scattering for the water vapor channels. In the specific case of Hurricane Maria, the DDA lookup tables do not generate enough scattering for channel 16, but the DDA results are much more consistent with observations for water vapor channels than for channel 16. It should be noted that the results may vary if we use other habits to represent snow, hail, and graupel in the DDA simulations. Although these results clearly show the advantage of the DDA database over the Mie dataset, different error sources such as error in the observations, displacement of clouds in the ERA5 reanalysis, and also lack of convective clouds or in general errors in the input atmospheric and cloud profiles contribute to the differences between the simulated and observed values. Aside from the improvements in the simulations, a major advantage of the new dataset is a large number of habits that can be used to tune the data assimilation systems to perform well in different weather conditions.

Isaac Moradi↗

The impact of aerosol mixing state on immersion freezing: insights from classical nucleation theory and particle-resolved simulations

Immersion freezing, initiated by ice-nucleating particles (INPs) in supercooled aqueous droplets, plays an important role in the formation of ice crystals within clouds. The efficiency of immersion freezing depends strongly on INP composition and, crucially, on the mixing state – how chemical species are distributed across the particle population. Here, we quantify the impact of aerosol mixing state on immersion freezing using a combined theoretical and particle-resolved modeling approach. We derive analytical expressions for the frozen fraction of internally and externally mixed INP populations based on classical nucleation theory, showing that the frozen fraction is sensitive to whether ice-active species are present in all particles or only in a subset of the population. We introduce a multi-species immersion freezing scheme into the particle-resolved model PartMC, using the water activity-based immersion freezing model (ABIFM) to compute freezing probabilities for mixed-composition particles. To improve computational efficiency, we implement a Binned Tau-Leaping algorithm and demonstrate an order-of-magnitude speedup with minimal accuracy loss. Simulations reproduce the analytical trends in limiting cases and extend the analysis to more general aerosol populations, where mixing state continues to exert a substantial control on frozen fraction. Sensitivity analyses across particle size, species type, and cooling condition reveal that the mixing state effect is most pronounced when small amounts of highly efficient INPs are mixed with less efficient materials. These findings underscore the need to represent aerosol mixing state explicitly in models of heterogeneous ice nucleation to reduce uncertainty in cloud-phase partitioning.

54 ENVIRONMENTAL SCIENCES↗

Recent advances in understanding secondary organic aerosol: Implications for global climate forcing: Advances in Secondary Organic Aerosol

Anthropogenic emissions and land use changes have modified atmospheric aerosol concentrations and size distributions over time. Understanding preindustrial conditions and changes in organic aerosol due to anthropogenic activities is important because these features (1) influence estimates of aerosol radiative forcing and (2) can confound estimates of the historical response of climate to increases in greenhouse gases. Secondary organic aerosol (SOA), formed in the atmosphere by oxidation of organic gases, represents a major fraction of global submicron-sized atmospheric organic aerosol. Over the past decade, significant advances in understanding SOA properties and formation mechanisms have occurred through measurements, yet current climate models typically do not comprehensively include all important processes. Our review summarizes some of the important developments during the past decade in understanding SOA formation. We also highlight the importance of some processes that influence the growth of SOA particles to sizes relevant for clouds and radiative forcing, including formation of extremely low volatility organics in the gas phase, acid-catalyzed multiphase chemistry of isoprene epoxydiols, particle-phase oligomerization, and physical properties such as volatility and viscosity. Several SOA processes highlighted in this review are complex and interdependent and have nonlinear effects on the properties, formation, and evolution of SOA. Current global models neglect this complexity and nonlinearity and thus are less likely to accurately predict the climate forcing of SOA and project future climate sensitivity to greenhouse gases. Efforts are also needed to rank the most influential processes and nonlinear process-related interactions, so that these processes can be accurately represented in atmospheric chemistry-climate models.

54 ENVIRONMENTAL SCIENCES↗

Efficient estimation of the modified Gromov–Hausdorff distance between unweighted graphs

Abstract Gromov–Hausdorff distances measure shape difference between the objects representable as compact metric spaces, e.g. point clouds, manifolds, or graphs. Computing any Gromov–Hausdorff distance is equivalent to solving an NP-hard optimization problem, deeming the notion impractical for applications. In this paper we propose a polynomial algorithm for estimating the so-called modified Gromov–Hausdorff (mGH) distance, a relaxation of the standard Gromov–Hausdorff (GH) distance with similar topological properties. We implement the algorithm for the case of compact metric spaces induced by unweighted graphs as part of Python library , and demonstrate its performance on real-world and synthetic networks. The algorithm finds the mGH distances exactly on most graphs with the scale-free property. We use the computed mGH distances to successfully detect outliers in real-world social and computer networks.

Oles, Vladyslav (ORCID:0000000188727463)↗

Improved Atmospheric Soundings and Error Estimates from Analysis of AIRS/AMSU Data

The AIRS Science Team Version 5.0 retrieval algorithm became operational at the Goddard DAAC in July 2007 generating near real-time products from analysis of AIRS/AMSU sounding data. This algorithm contains many significant theoretical advances over the AIRS Science Team Version 4.0 retrieval algorithm used previously. Three very significant developments of Version 5 are: 1) the development and implementation of an improved Radiative Transfer Algorithm (RTA) which allows for accurate treatment of non-Local Thermodynamic Equilibrium (non-LTE) effects on shortwave sounding channels; 2) the development of methodology to obtain very accurate case by case product error estimates which are in turn used for quality control; and 3) development of an accurate AIRS only cloud clearing and retrieval system. These theoretical improvements taken together enabled a new methodology to be developed which further improves soundings in partially cloudy conditions, without the need for microwave observations in the cloud clearing step as has been done previously. In this methodology, longwave C02 channel observations in the spectral region 700 cm-' to 750 cm-' are used exclusively for cloud clearing purposes, while shortwave C02 channels in the spectral region 2195 cm-' to 2395 cm-' are used for temperature sounding purposes. The new methodology for improved error estimates and their use in quality control is described briefly and results are shown indicative of their accuracy. Results are also shown of forecast impact experiments assimilating AIRS Version 5.0 retrieval products in the Goddard GEOS 5 Data Assimilation System using different quality control thresholds.

Susskind, Joel↗

Current Status of Multi-Angle Implementation of Atmospheric Correction (MAIAC) Algorithm

A new Multi-Angle Implementation of Atmospheric Correction (MAIAC) algorithm has been developed for MODIS. MAIAC uses a time series and an image based rather than pixel-based processing to perform simultaneous retrievals of aerosol properties and surface bidirectional reflectance. It is a generic algorithm which works over all land surface types with the exception of snow. MAIAC has an internal Cloud Mask, a dynamic land-water-snow classification and a surface change mask which allows it to flexibly choose processing path over different surfaces. A distinct feature of MAIAC is a high 1 km resolution of aerosol retrievals including optical thickness and fine mode fraction, which is required in different applications including the air quality analysis. An overview of the algorithm, results of AERONET validation, and examples of comparison with MODIS Collection 5 aerosol product, including Deep Blue algorithm, will be presented for different parts of the world including continental USA, Persian Gulf region and India.

Lyapustin, A.↗

Developing a Radar Signal Simulator for the Community Radiative Transfer Model

Active radar instruments provide vertically resolved clouds and precipitation measurements that cannot be provided by the passive instruments. These active measurements are not conventionally assimilated into the data assimilation systems because of the lack of fast forward radiative transfer models and also difficulties in the error modelling of the measurements. This paper describes the development, evaluation, and sensitivity analysis for a forward radar model implemented in the Community Radiative Transfer Model (CRTM). The scattering properties required by the forward model are provided by the hydrometeor lookup tables that were generated using the discrete dipole approximation. The model is able to calculate both the reflectivity and the attenuated reflectivity for any given radar instrument at any given zenith angles as long as CRTM instrument specific coefficients are available. The evaluation using CloudSat measurements shows a very good agreement between the simulations and measurements as long as the input profiles of hydrometeors are consistent with the measured reflectivity profiles. Major sources contributing to the differences between the measured and simulated reflectivities are input hydrometeor profiles, scattering lookup tables, lack of melting layer in the forward model, CRTM scattering solvers, and attenuation calculations. In addition to the forward model, both Tangent Linear and Adjoint of the model are also implemented and tested within CRTM. These components may be required by some data assimilation systems for the assimilation of radar measurements.

radar↗

Statistical Techniques For Real-time Anomaly Detection Using Spark Over Multi-source VMware Performance Data

Anomaly detection refers to the identi cation of an irregular or unusual pat- tern which deviates from what is standard, normal, or expected. Such deviated patterns typically correspond to samples of interest and are assigned different labels in different domains, such as outliers, anomalies, exceptions, or malware. Detecting anomalies in fast, voluminous streams of data is a formidable chal- lenge. This paper presents a novel, generic, real-time distributed anomaly detection framework for heterogeneous streaming data where anomalies appear as a group. We have developed a distributed statistical approach to build a model and later use it to detect anomaly. As a case study, we investigate group anomaly de- tection for a VMware-based cloud data center, which maintains a large number of virtual machines (VMs). We have built our framework using Apache Spark to get higher throughput and lower data processing time on streaming data. We have developed a window-based statistical anomaly detection technique to detect anomalies that appear sporadically. We then relaxed this constraint with higher accuracy by implementing a cluster-based technique to detect sporadic and continuous anomalies. We conclude that our cluster-based technique out- performs other statistical techniques with higher accuracy and lower processing time.

Apache Spark↗

5G Energy FRAME: The Design and Implementation of Data, Model, and Use Case (Year 2 Report)

This report summarizes the Year 2 work of Pacific Northwest National Laboratory’s (PNNL’s) 5G Fabricated Resource and Asset Management Encompassment for energy infrastructure (Energy FRAME) project funded by the Department of Energy Office of Science’s Advanced Scientific Computing Research (ASCR) Program. In this report, newest 5G equipment testing results are presented, along with two 5G-enabled AI/ML examples for grid applications; in addition, the work flow of grid edge, cloud, and High Performance Computing (HPC) platform is introduced, to support and interface the cross-domain simulation for power system transmission, distribution, and communication networks. Last but not least, the outlook for Year 3 work and the overarching impact of 5G Energy FRAME work to a multitude of stakeholders are provided. Additional 5G performance data now is shared through the publicly available weblink, https://www.pnnl.gov/projects/5g-energy-frame/publications

24 POWER TRANSMISSION AND DISTRIBUTION↗

Atlas: Navigating NASA’s Knowledge Universe with AI-Powered Natural Language Queries

NASA has a vast archive of engineering guidelines, standards, and best practices collected over decades. This encompasses a breadth of topics from rocketry and engineering standards to risk management and space-related health issues. This wealth of information, while invaluable to NASA engineers, staff, and the public, is too extensive for any individual to fully comprehend. To address this challenge, we have developed Atlas, a tool within NASA's Mission Cloud Platform that enables users to query these diverse sources effectively. Atlas allows users to ask natural language questions and receive answers grounded in factual information from source documents. The tool provides responses with direct quotations and links to original documents, ensuring transparency and accuracy. It can address a wide range of queries, from specific technical details like safe distances for rocket launches from lightning to broader topics such as crew health requirements for long-duration space missions, corrosion protection in low Earth orbit, and NASA's agreements with various entities. In developing Atlas, we encountered and overcame several technical challenges. Large Language Models often struggle with consistently providing accurate information, especially for highly specialized topics. We implemented strategies to prevent hallucinations and ensure the reliability of responses, even for complex questions on topics ranging from NASA Mission Classes to intricate rocket science concepts. Additionally, we addressed the challenges of delivering quick responses while maintaining cost-effectiveness. Our presentation will detail the innovative approaches we employed to optimize performance and efficiency, making Atlas a powerful and practical tool for accessing NASA's extensive knowledge base.

Artificial Intelligence↗

Deliver Signal Phase and Timing (SPAT) for Energy Optimization of Vehicle Cohort Via Cloud-Computing and LTE Communications

Predictive Signal Phase and Timing (SPAT) message set is one fundamental building block for vehicle-to-infrastructure (V2I) applications such as Eco-Approach and Departure (EAD) at traffic signal controlled urban intersections. Among the two complementary communication methods namely short-range sidelink (PC5) and long-range cellular radio link (Uu), this paper documents the work with long-range link: the complete data chain includes connecting to the traffic signals via existing backhaul communication network, collecting the raw signal phase state data, predicting the signal state changes and delivering the SPAT data via a geofenced service to requests over HTTP protocols. An Application Programming Interface (API) library is developed to support various cellular data transmission reduction and latency improvement techniques. An emulation-based algorithm is applied to predict the traffic signal state changes to provide adequate prediction horizon (e.g., at minimum 2 minutes) for the cohort energy optimization. In fact, the same connectivity and SPAT delivery methodology has been applied to traffic signalized intersections nationwide in the United States upon public agency approvals for access to their firewalled traffic control network and signal control systems or directly to individual controllers. This methodology proves its effectiveness and potential for rapid growth of such SPAT deliveries at mass production scale without needing infrastructure hardware retrofit or excessive communication means. To support the energy optimization of light and heavy-duty vehicle cohorts of mixed automation and propulsion systems (EV, ICE and hybrid), the connection and SPAT deliveries at two sites were completed, including public roads in Washtenaw County, Michigan and closed track test sites at American Center for Mobility (ACM) in Ypsilanti, Michigan. However, only closed test track results at ACM will be presented in this paper. A neuroevolution based optimizer is developed and implemented to control the speed of a vehicle cohort with different propulsion systems and automation levels. Closed track tests showed significant energy savings of the cohort operation.

99 GENERAL AND MISCELLANEOUS↗

Internet-of-Things Hardware-in-the-Loop Simulation Architecture for Providing Frequency Regulation With Demand Response

Following recent advances in network infrastructure, cloud computing, and embedded systems, fascinating work is underway exploring the utility of demand response in increasing grid stability while permitting high penetration of intermittent renewable distributed generation resources. Although works have demonstrated diverse theoretical advantages of demand response programs, little real-world data are available and utilities generally remain reticent in moving forward with large-scale implementation due to risks inherent to any modification of the power system. Deciding that the next pertinent step in bringing demand response from theory to technology is developing an Internet-of-things hardware-in-the-loop simulation power system integrated device capable of empirically testing the theoretical mechanisms, this work presents an architecture testbed for providing demand response (telemetric monitoring and actuation of loads), which is real node in a power system simulation where virtual node's parameters derive real node data. Finally, we test a demand response algorithm, which provides frequency regulation services.

97 MATHEMATICS AND COMPUTING↗

funcX: Federated Function as a Service for Science

Here, funcX is a distributed function as a service (FaaS) platform that enables flexible, scalable, and high performance remote function execution. Unlike centralized FaaS systems, funcX decouples the cloud-hosted management functionality from the edge-hosted execution functionality. funcX's endpoint software can be deployed, by users or administrators, on arbitrary laptops, clouds, clusters, and supercomputers, in effect turning them into function serving systems. funcX's cloud-hosted service provides a single location for registering, sharing, and managing both functions and endpoints. It allows for transparent, secure, and reliable function execution across the federated ecosystem of endpoints-enabling users to route functions to endpoints based on specific needs. funcX uses containers (e.g., Docker, Singularity, and Shifter) to provide common execution environments across endpoints. funcX implements various container management strategies to execute functions with high performance and efficiency on diverse funcX endpoints. funcX also integrates with an in-memory data store and Globus for managing data that may span endpoints. We motivate the need for funcX, present our prototype design and implementation, and demonstrate, via experiments on two supercomputers, that funcX can scale to more than 130000 concurrent workers. We show that funcX's container warming-aware routing algorithm can reduce the completion time for 3,000 functions by up to 61% compared to a randomized algorithm and the in-memory data store can speed up data transfers by up to 3x compared to a shared file system.

97 MATHEMATICS AND COMPUTING↗

Progress Towards Accelerating the Unified Model on Hybrid Multi-Core Systems

The cloud microphysics scheme, CASIM, and the radiation scheme, SOCRATES, are two computationally intensive parts within the Met Office's Unified Model (UM). This study enables CASIM and SOCRATES to use accelerated multi-core systems for optimal computational performance of the UM. Using profiling to guide our efforts, we refactored the code for optimal threading and kernel arrangement and implemented OpenACC directives manually or through the CLAW source-to-source translator. Initial porting results achieved 10.02x and 9.25x speedup in CASIM and SOCRATES respectively on 1 GPU compared with 1 CPU core. A granular performance analysis of the strategy and bottlenecks are discussed. These improvements will enable UM to run on heterogeneous computers and a path forward for further improvements is provided.

Zhang, Wei↗