SEARCH · Engineering Papers
Results for “fog computing”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
A Privacy-Aware Federated Learning Framework for Distributed Energy Resource Analytics in Constrained Environments
To be resilient against extreme weather events, the rural communities in Puerto Rico are leveraging distributed energy resources (DER). However, computing frameworks sup-porting the grid in critical decision-making are still largely centralized. Sensitive consumer data are transmitted over the Internet or cellular networks to a secondary or tertiary node. It guarantees better situational awareness at the cost of a wider attack surface, jeopardizing user privacy, as more DER come online. Cloud, Edge, and Fog computing all require data aggregation at some level. This paper introduces a privacy-aware federated learning framework that leverages the Fog model by pushing analytics all the way to the DER and load assets. These local models train on individual asset data and transmit only learned parameters (such as weights) over secure communications to a global decision-maker. By abstracting personally identifiable consumer data without impacting decision optimality, this framework better aligns with distributed power generation paradigm.
Approximate Model of Light Transport in Scattering Media for Computational Sensing in Fog and Tissue (Poster).
Abstract not provided.
Optical Characterization of the Sandia Fog Facility for Computational Sensing (Invited Talk).
Abstract not provided.
Energy-efficient cooperative resource allocation and task scheduling for Internet of Things environments
Offloading Internet of Things (IoT) tasks to the cloud for further processing might not always lead to an optimal execution time, particularly in situations such as resource contention, under-provisioning, over-provisioning, and fragmentation. In addition, dynamically optimizing the number of Virtual Machines (VMs) for resource scheduling in order to meet application requirements remains a major research challenge. Further, existing resource scheduling algorithms focus primarily on minimizing operational costs while maximizing resource sharing and utilization. Considering energy utilization as part of the resource allocation and scheduling process as an optimization objective for maintaining load balancing has often been neglected. To address these challenges and more, we propose a cooperative energy-aware resource allocation and scheduling strategy based on a Technique for Order of Preference by Similarity to Ideal Solution (TOPSIS) multi-criteria decision-making method. Here we used the Grid Workloads Archive dataset to evaluate our proposed approach named TOPREAL. Experimental results with respect to the allocation of VM resources when considering processing a large segment of tasks indicate that TOPREAL outperforms existing algorithms in terms of energy savings, with an average improvement of 40.25%, while maintaining an average improvement of 16.21% when it comes to execution time. Results also demonstrate that our method can save an average of 78.06 processing hours and 63,215kJ of energy when compared to existing scheduling algorithms. These results demonstrate the effectiveness of our proposed model and the viability of using multi-criteria decision-making techniques such as TOPSIS to solve the resource allocation and scheduling problem in edge environments.
Cyber-Physical System Implementation for Manufacturing With Analytics in the Cloud Layer
Effective and efficient modern manufacturing operations require the acceptance and incorporation of the fourth industrial revolution, also known as Industry 4.0. Traditional shop floors are evolving their production into smart factories. To continue this trend, a specific architecture for the cyber-physical system is required, as well as a systematic approach to automate the application of algorithms and transform the acquired data into useful information. This work makes use of an approach that distinguishes three layers that are part of the existing Industry 4.0 paradigm: edge, fog, and cloud. Each of the layers performs computational operations, transforming the data produced in the smart factory into useful information. Trained or untrained methods for data analytics can be incorporated into the architecture. A case study is presented in which a real-time statistical control process algorithm based on control charts was implemented. The algorithm automatically detects changes in the material being processed in a computerized numerical control (CNC) machine. The algorithm implemented in the proposed architecture yielded short response times. The performance was effective since it automatically adapted to the machining of aluminum and then detected when the material was switched to steel. The data were backed up in a database that would allow traceability to the line of g-code that performed the machining.
Computational Imaging for Intelligence in Highly Scattering Aerosols (Final Report)
Natural and man-made degraded visual environments pose major threats to national security. The random scattering and absorption of light by tiny particles suspended in the air reduces situational awareness and causes unacceptable down-time for critical systems and operations. To improve the situation, we have developed several approaches to interpret the information contained within scattered light to enhance sensing and imaging in scattering media. These approaches were tested at the Sandia National Laboratory Fog Chamber facility and with tabletop fog chambers. Computationally efficient light transport models were developed and leveraged for computational sensing. The models are based on a weak angular dependence approximation to the Boltzmann or radiative transfer equation that appears to be applicable in both the moderate and highly scattering regimes. After the new model was experimentally validated, statistical approaches for detection, localization, and imaging of objects hidden in fog were developed and demonstrated. A binary hypothesis test and the Neyman-Pearson lemma provided the highest theoretically possible probability of detection for a specified false alarm rate and signal-to-noise ratio. Maximum likelihood estimation allowed estimation of the fog optical properties as well as the position, size, and reflection coefficient of an object in fog. A computational dehazing approach was implemented to reduce the effects of scatter on images, making object features more readily discernible. We have developed, characterized, and deployed a new Tabletop Fog Chamber capable of repeatably generating multiple unique fog-analogues for optical testing in degraded visual environments. We characterized this chamber using both optical and microphysical techniques. In doing so we have explored the ability of droplet nucleation theory to describe the aerosols generated within the chamber, as well as Mie scattering theory to describe the attenuation of light by said aerosols, and correlated the aerosol microphysics to optical properties such as transmission and meteorological optical range (MOR). This chamber has proved highly valuable and has supported multiple efforts inclusive to and exclusive of this LDRD project to test optics in degraded visual environments. Circularly polarized light has been found to maintain its polarization state better than linearly polarized light when propagating through fog. This was demonstrated experimentally in both the visible and short-wave infrared (SWIR) by imaging targets made of different commercially available retroreflective films. It was found that active circularly polarized imaging can increase contrast and range compared to linearly polarized imaging. We have completed an initial investigation of the capability for machine learning methods to reduce the effects of light scattering when imaging through fog. Previously acquired experimental long-wave images were used to train an autoencoder denoising architecture. Overfitting was found to be a problem because of lack of variability in the object type in this data set. The lessons learned were used to collect a well labeled dataset with much more variability using the Tabletop Fog Chamber that will be available for future studies. We have developed several new sensing methods using speckle intensity correlations. First, the ability to image moving objects in fog was shown, establishing that our unique speckle imaging method can be implemented in dynamic scattering media. Second, the speckle decorrelation over time was found to be sensitive to fog composition, implying extensions to fog characterization. Third, the ability to distinguish macroscopically identical objects on a far-subwavelength scale was demonstrated, suggesting numerous applications ranging from nanoscale defect detection to security. Fourth, we have shown the capability to simultaneously image and localize hidden objects, allowing the speckle imaging method to be effective without prior object positional information. Finally, an interferometric effect was presented that illustrates a new approach for analyzing speckle intensity correlations that may lead to more effective ways to localize and image moving objects. All of these results represent significant developments that challenge the limits of the application of speckle imaging and open important application spaces. A theory was developed and simulations were performed to assess the potential transverse resolution benefit of relative motion in structured illumination for radar systems. Results for a simplified radar system model indicate that significant resolution benefits are possible using data from scanning a structured beam over the target, with the use of appropriate signal processing.
A Multi-Objective Approach for Optimizing Edge-Based Resource Allocation Using TOPSIS
Existing approaches for allocating resources on edge environments are inefficient and lack the support of heterogeneous edge devices, which in turn fail to optimize the dependency on cloud infrastructures or datacenters. To this extent, we propose in this paper OpERA, a multi-layered edge-based resource allocation optimization framework that supports heterogeneous and seamless execution of offloadable tasks across edge, fog, and cloud computing layers and architectures. By capturing offloadable task requirements, OpERA is capable of identifying suitable resources within nearby edge or fog layers, thus optimizing the execution process. Throughout the paper, we present results which show the effectiveness of our proposed optimization strategy in terms of reducing costs, minimizing energy consumption, and promoting other residual gains in terms of processing computations, network bandwidth, and task execution time. We also demonstrate that by optimizing resource allocation in computation offloading, it is then possible to increase the likelihood of successful task offloading, particularly for computationally intensive tasks that are becoming integral as part of many IoT applications such robotic surgery, autonomous driving, smart city monitoring device grids, and deep learning tasks. The evaluation of our OpERA optimization algorithm reveals that the TOPSIS MCDM technique effectively identifies optimal compute resources for processing offloadable tasks, with a 96% success rate. Moreover, the results from our experiments with a diverse range of use cases show that our OpERA optimization strategy can effectively reduce energy consumption by up to 88%, and operational costs by 76%, by identifying relevant compute resources.
Nanosystems, Edge Computing, and the Next Generation Computing Systems
It is widely recognized that nanoscience and nanotechnology and their subfields, such as nanophotonics, nanoelectronics, and nanomechanics, have had a tremendous impact on recent advances in sensing, imaging, and communication, with notable developments, including novel transistors and processor architectures. For example, in addition to being supremely fast, optical and photonic components and devices are capable of operating across multiple orders of magnitude length, power, and spectral scales, encompassing the range from macroscopic device sizes and kW energies to atomic domains and single-photon energies. The extreme versatility of the associated electromagnetic phenomena and applications, both classical and quantum, are therefore highly appealing to the rapidly evolving computing and communication realms, where innovations in both hardware and software are necessary to meet the growing speed and memory requirements. Development of all-optical components, photonic chips, interconnects, and processors will bring the speed of light, photon coherence properties, field confinement and enhancement, information-carrying capacity, and the broad spectrum of light into the high-performance computing, the internet of things, and industries related to cloud, fog, and recently edge computing. Conversely, owing to their extraordinary properties, 0D, 1D, and 2D materials are being explored as a physical basis for the next generation of logic components and processors. Carbon nanotubes, for example, have been recently used to create a new processor beyond proof of principle. These developments, in conjunction with neuromorphic and quantum computing, are envisioned to maintain the growth of computing power beyond the projected plateau for silicon technology. We survey the qualitative figures of merit of technologies of current interest for the next generation computing with an emphasis on edge computing.
High sensitivity of simulated fog properties to parameterized aerosol activation in case studies from ParisFog
Aerosols influence fog properties such as visibility and lifetime by affecting fog droplet number concentrations (N d ). Numerical weather prediction (NWP) models often represent aerosol–fog interactions using highly simplified approaches. Incorporating prognostic size-resolved aerosol microphysics from climate models could allow them to simulate N d and aerosol–fog interactions without incurring excessive computational expense. However, microphysics code designed for coarse spatial resolution may struggle with sub-kilometer-scale grid spacings. Here, we test the ability of the UK Met Office Unified Model to simulate aerosol and fog properties during case studies from the ParisFog field campaign in 2011. We examine the sensitivity of fog properties to variations in N d caused by modifications to simulated aerosol activation. Our model, with a 500 m horizontal resolution and interactive aerosol and cloud microphysics, significantly underpredicts N d , although it only slightly underestimates the cloud condensation nuclei concentration. With an updated version of the Abdul-Razzak and Ghan (2000) activation scheme, we produce N d that are more consistent with those predicted by a cloud parcel model under fog-like conditions. We activate droplets only by adiabatic cooling. We incorporate more realistic hygroscopicities for sulfate and organic aerosols and explore the sensitivity of simulated N d to unresolved updrafts. We find that both N d and simulated fog liquid water content are very sensitive to the updated activation scheme but remain less affected by the update to hygroscopicities. Our improvements offer insights into the physical processes regulating N d in stable conditions, potentially laying foundations for improved operational fog forecasts that incorporate interactive aerosol simulations or aerosol climatologies.
On the Susceptibility of Deep Neural Networks to Natural Perturbations
Deep learning systems are increasingly being adopted for safety critical tasks such as autonomous driving. These systems can be exposed to adverse weather conditions such as fog, rain and snow. Vulnerability of deep learning systems to synthetic adversarial attacks has been extensively studied and demonstrated, but the impact of natural weather conditions on these systems has not been studied in detail. In this paper, we study the effects of fog on classification accuracy of the popular Inception deep learning model. We use stereo images from the Cityscapes dataset and computer graphics techniques to mimic realistic naturally occurring fog. We show that the Inception deep learning model is vulnerable to the addition of fog in images.
Incorporating the effects of objects in an approximate model of light transport in scattering media
A computationally efficient radiative transport model is presented that predicts a camera measurement and accounts for the light reflected and blocked by an object in a scattering medium. The model is in good agreement with experimental data acquired at the Sandia National Laboratory Fog Chamber Facility (SNLFC). The model is applicable in computational imaging to detect, localize, and image objects hidden in scattering media. Here, a statistical approach was implemented to study object detection limits in fog.
Utilizing Highly Scattered Light for Intelligence through Aerosols
This communication is the final report for the project Utilizing Highly Scattered Light for Intelligence through Aerosols funded by the Laboratory Directed Research and Development (LDRD) program at Sandia National Laboratories and lasting six months in 2019. Aerosols like fog reduce visibility and cause down-time that for critical systems or operations are unacceptable. Information is lost due to the random scattering and absorption of light by tiny particles. Computational diffuse optical imaging methods show promise for interpreting the light transmitted through fog, enabling sensing and imaging to improve situational awareness at depths 10 times greater than current methods. Developing this capability first requires verification and validation of diffusion models of light propagation in fog. For this reason, analytical models were developed and compared to experimental data captured at the Sandia National Laboratory Fog Chamber facility. A methodology was developed to incorporate the propagation of scattered light through the imaging optics to a pixel array. The diffusion approximation to the radiative transfer equation was found to predict light propagation in fog under the appropriate conditions.
Importance of Body Stance in Fog Droplet Collection by the Namib Desert Beetle
The fog-basking behavior of the Onymacris unguicularis, a beetle species living in the coastal regions of the Namibian desert, has recently caught the attention of the engineering community, as suggesting a viable biomimetic approach to address the problem of harvesting water in arid regions of the globe. Previous research has focused on observation and analysis of the beetle’s elytron properties and how these affect fog-collection rates. The head stance taken by the Onymacris unguicularis when fog basking is well documented. However, how this stance affects droplet collection has not been studied up to now. The present paper addresses this problem from a computational fluid dynamics perspective, where three-dimensional numerical simulations are used to characterize the fog flow properties around a simplified geometry mimicking the beetle’s body. The simulations employ two-way coupling between the gas flow and the dispersed fog phase to account for feedback effects of fog droplets on the carrier fluid (air), and assume that droplets are captured after hitting the elytron surface. The study considers several combinations of free-stream velocity and droplet volume fraction. The analysis reveals that there is a range of head-stance angles, corresponding to an inclination of the beetle between 35 deg and 45 deg with respect to the horizon, that maximizes water collection on the beetle’s back, in qualitative agreement with observations in nature and laboratory experiments. A rationale is proposed to explain this phenomenon, finding that the specific head stance corresponds to the maximum residence time of fluid particles above the beetle’s elytron surface. This, in turn, designates the maximum likelihood for water droplets to be captured in the boundary layer developing over the beetle and subsequently hit the surface where they get captured. The results reveal the importance of the fluid flow pattern around the beetle’s body in addition to the microphysical properties of the elytron when reliable predictions of the water droplet collection efficiency are sought.
From Reproducible Edge–Cloud Experimentation to Real-World Practice: The E2Clab Experience
Reproducibility is already difficult in distributed systems; on the computing continuum, it becomes substantially harder. Applications that span sensing devices, edge and fog resources, and cloud platforms must be evaluated across heterogeneous hardware, variable network conditions, cross-layer orchestration decisions, and long-running workflow lifecycles. We use E2Clab as a case study to examine these challenges and their implications for experimental methodology. We explain why reproducible experimentation is harder on the continuum, then revisit E2Clab as an initial response based on explicit modeling of infrastructure, workflow lifecycle, and artifacts. Lastly, we discuss how its evolution toward more realistic application settings can be understood through the lens of Translational Computer Science. We argue that reproducible continuum experimentation requires methods that are rigorous enough for research while remaining adaptable to real-world practice.
Light transport with weak angular dependence in fog
Random scattering and absorption of light by tiny particles in aerosols, like fog, reduce situational awareness and cause unacceptable down-time for critical systems or operations. Computationally efficient light transport models are desired for computational imaging to improve remote sensing capabilities in degraded optical environments. To this end, we have developed a model based on a weak angular dependence approximation to the Boltzmann or radiative transfer equation that appears to be applicable in both the moderate and highly scattering regimes, thereby covering the applicability domain of both the small angle and diffusion approximations. An analytic solution was derived and validated using experimental data acquired at the Sandia National Laboratory Fog Chamber facility. The evolution of the fog particle density and size distribution were measured and used to determine macroscopic absorption and scattering properties using Mie theory. A three-band (0.532, 1.55, and 9.68 µ m) transmissometer with lock-in amplifiers enabled changes in fog density of over an order of magnitude to be measured due to the increased transmission at higher wavelengths, covering both the moderate and highly scattering regimes. The meteorological optical range parameter is shown to be about 0.6 times the transport mean free path length, suggesting an improved physical interpretation of this parameter.