Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Cloud Implementation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 793 records · Page 44
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

SQL and NoSQL Databases for Cyber Physical Production Systems in Internet of Things for Manufacturing (IoTfM)

Abstract In this paper, the design and performance differences between Relational Database Management Systems (RDBMS) and NoSQL Database Systems are examined, with attention to their applicability for real-world Internet of Things for manufacturing (IoTfM) data. While previous work has extensively compared SQL and NoSQL for both generalized and IoT uses, this work specifically examines the tradeoffs and performance differences for manufacturing applications by using a high-fidelity data set collected from a large US manufacturing firm. Growing an IoT system beyond the pilot stage requires scalable data storage; this work seeks to determine the impact of selected database systems on data write performance at scale. Payload size and message frequency were used as the primary characteristics to maintain model fidelity in simulated clients. As the number of simulated asset clients grow, the data write latency was calculated to determine how both database systems’ performance were affected. To isolate the RDBMS and NoSQL differences, a cloud environment was created using Amazon Web Services (AWS) with two identical data ingestion pipelines: writing data to an RDMBS (1) using AWS Aurora MySQL, and (2) using AWS DynamoDB NoSQL. The findings may provide guidance for further experimentation in large-scale manufacturing IoT implementations.

Gamero, David↗
DOE OSTI2018

Fuel Efficient Speed Optimization for Real-World Highway Cruising

This paper introduces an eco-driving highway cruising algorithm based on optimal control theory that is applied to a conventionally-powered connected and automated vehicle. Thanks to connectivity to the cloud and/or to infrastructure, speed limit and slope along the future route can be known with accuracy. This can in turn be used to compute the control variable trajectory that will minimize energy consumption without significantly impacting travel time. Automated driving is necessary to the implementation of this concept, because the chosen control variables (e.g., torque and gear) impact vehicle speed. An optimal control problem is built up where quadratic models are used for the powertrain. The optimization is solved by applying Pontryagin’s minimum principle, which reduces the problem to the minimization of a cost function with parameters called co-states. The proposed algorithm assumes piecewise constant slopes and speed limits, and it solves the transition vehicle speeds for each junction of such segments. In addition, a method to extract route information from digital maps is presented, which complies with the proposed optimization algorithm. The algorithms are evaluated in simulation, using Autonomie, a simulation tool for vehicle energy consumption modeling. The optimal control trajectory (e.g., torque, gear) is first computed offline. It is then applied in an open-loop fashion in online simulation, using a forward-looking model of the vehicle in Autonomie. Simulation results show over 8% fuel saving for two selected real-world routes.

Simulation and modeling, Optimization, Vehicle net↗
NASA NTRS1985

Interactive information processing for NASA's mesoscale analysis and space sensor program

The Atmospheric Sciences Division (ASD) of the Systems Dynamics Laboratory at NASA's Marshall Space Flight Center (MSFC) is currently involved in interactive information processing for the Mesoscale Analysis and Space Sensor (MASS) program. Specifically, the ASD is engaged in the development and implementation of new space-borne remote sensing technology to observe and measure mesoscale atmospheric processes. These space measurements and conventional observational data are being processed together to gain an improved understanding of the mesoscale structure and the dynamical evolution of the atmosphere relative to cloud development and precipitation processes. To satisfy its vast data processing requirements, the ASD has developed a Researcher Computer System consiting of three primary computer systems which provides over 20 scientists with a wide range of capabilities for processing and displaying a large volumes of remote sensing data. Each of the computers performs a specific function according to its unique capabilities.

Parker, K. G.↗
NASA NTRS2007

Geo-STAR: A Geostationary Microwave Sounder for the Future

The Geostationary Synthetic Thinned Aperture Radiometer (GeoSTAR) is a new Earth remote sensing instrument concept that has been under development at the Jet Propulsion Laboratory. First conceived in 1998 as a NASA New Millennium Program mission and subsequently developed in 2003-2006 as a proof-of-concept prototype under the NASA Instrument Incubator Program, it is intended to fill a serious gap in our Earth remote sensing capabilities - namely the lack of a microwave atmospheric sounder in geostationary orbit. The importance of such observations have been recognized by the National Academy of Sciences National Research Council, which recently released its report on a 'Decadal Survey' of NASA Earth Science activities1. One of the recommended missions for the next decade is a geostationary microwave sounder. GeoSTAR is well positioned to meet the requirements of such a mission, and because of the substantial investment NASA has already made in GeoSTAR technology development, this concept is fast approaching the necessary maturity for implementation in the next decade. NOAA is also keenly interested in GeoSTAR as a potential payload on its next series of geostationary weather satellites, the GOES-R series. GeoSTAR, with its ability to map out the three-dimensional structure of temperature, water vapor, clouds, precipitation and convective parameters on a continual basis, will significantly enhance our ability to observe hurricanes and other severe storms. In addition, with performance matching that of current and next generation of low-earth-orbiting microwave sounders, GeoSTAR will also provide observations important to the study of the hydrologic cycle, atmospheric processes and climate variability and trends. In particular, with GeoSTAR it will be possible to fully resolve the diurnal cycle. We discuss the GeoSTAR concept and basic design, the performance of the prototype, and a number of science applications that will be possible with GeoSTAR. The work reported on here was performed at the Jet Propulsion Laboratory, California Institute of Technology under a contract with the National Aeronautics and Space Administration.

Geostationary Synthetic Thinned Aperture Radiomete↗
DOE OSTI2021

Priority-enabled Load Balancing for Dispersed Computing

Opportunistic managed access to local in-network compute resources can improve the performance of distributed applications and reduce the dependence on shared network resources. Instead of backhauling application data to a centralized cloud data center for processing, networked services may be adaptively and continuously dispersed into shared compute resources that are closer to the source of need. While this approach has several benefits, support for mission-aware access to computation is often an afterthought, and is implemented as a brittle extension over traditional load-balancer solutions.In this work, we investigate the design of two priority-aware resource allocation strategies and two load-balancing dispatching strategies as first class citizens in an open-source dispersed computing middleware. We present a control theoretic analysis of these load-balancing primitives to identify weaknesses and strengths in our design, and recommend future directions. In parallel, we prototype two priority-aware allocation algorithms to validate our priority predictions. In initial experiments our prototype shows substantial gains in processing prioritized load. Finally, we make our source-code and experimental configurations open source.

Paulos, Aaron↗
NASA NTRS1985

Use of observational and model-derived fields and regime model output statistics in mesoscale forecasting

Various empirical and statistical weather-forecasting studies which utilize stratification by weather regime are described. Objective classification was used to determine weather regime in some studies. In other cases the weather pattern was determined on the basis of a parameter representing the physical and dynamical processes relevant to the anticipated mesoscale phenomena, such as low level moisture convergence and convective precipitation, or the Froude number and the occurrence of cold-air damming. For mesoscale phenomena already in existence, new forecasting techniques were developed. The use of cloud models in operational forecasting is discussed. Models to calculate the spatial scales of forcings and resultant response for mesoscale systems are presented. The use of these models to represent the climatologically most prevalent systems, and to perform case-by-case simulations is reviewed. Operational implementation of mesoscale data into weather forecasts, using both actual simulation output and method-output statistics is discussed.

Forbes, G. S.↗
NASA NTRS1991

Dynamics of charged particles in a Paul radio-frequency quadrupole trap

A molecular-dynamics simulation of hundreds of ions confined in a Paul trap has been performed. The simulation includes the trapped particles' micromotion and interparticle Coulomb interactions. A random walk in velocity was implemented to bring the secular motion to a given temperature which was numerically measured. When the coupling Gamma is large the ions from concentric shells which undergo a quadrupole oscillation at the RF frequency, while the ions within a shell form a 2D hexagonal lattice. Ion clouds at 5 mK show no RF heating for q(z) less than about 0.6, whereas rapid heating is seen for qz = 0.8.

Prestage, J. D.↗
NASA NTRS1992

Ice tracking techniques, implementation, performance, and applications

Present techniques of ice tracking make use both of cross-correlation and of edge tracking, the former being more successful in heavy pack ice, the latter being critical for the broken ice of the pack margins. Algorithms must assume some constraints on the spatial variations of displacements to eliminate fliers, but must avoid introducing any errors into the spatial statistics of the measured displacement field. We draw our illustrations from the implementation of an automated tracking system for kinematic analyses of ERS-1 and JERS-1 SAR imagery at the University of Alaska - the Alaska SAR Facility's Geophysical Processor System. Analyses of the ice kinematic data that might have some general interest to analysts of cloud-derived wind fields are the spatial structure of the fields, and the evaluation and variability of average deformation and its invariants: divergence, vorticity and shear. Many problems in sea ice dynamics and mechanics can be addressed with the kinematic data from SAR.

Rothrock, D. A.↗
NASA NTRS2009

NASA GPM GV Science Implementation

Pre-launch algorithm development & post-launch product evaluation: The GPM GV paradigm moves beyond traditional direct validation/comparison activities by incorporating improved algorithm physics & model applications (end-to-end validation) in the validation process. Three approaches: 1) National Network (surface): Operational networks to identify and resolve first order discrepancies (e.g., bias) between satellite and ground-based precipitation estimates. 2) Physical Process (vertical column): Cloud system and microphysical studies geared toward testing and refinement of physically-based retrieval algorithms. 3) Integrated (4-dimensional): Integration of satellite precipitation products into coupled prediction models to evaluate strengths/limitations of satellite precipitation producers.

Petersen, W. A.↗
DOE OSTI2022

Elastic Resource Management for Deep Learning Applications in a Container Cluster

The increasing demand for learning from massive datasets is restructuring our economy. Effective learning, however, involves nontrivial computing resources. Most businesses utilize commercial infrastructure providers (e.g., AWS) to host their computing clusters in the cloud, where various jobs compete for available resources. While cloud resource management is a fruitful research field that has made many advances in production, such as Kubernetes and YARN, few efforts have been invested to further optimize the system performance, especially for deep learning (DL) training jobs in a container cluster. This work introduces FlowCon, a system that is able to monitor the individual evaluation functions of DL jobs at runtime, and thus to make placement decisions on resource allocations elastically. Here, we present a detailed design and implementation of FlowCon and conduct intensive experiments over various DL models. The results demonstrate that FlowCon significantly improves DL job completion time and resource utilization efficiency, compared to default systems. According to the results, FlowCon is able to improve the completion time by up to 68.8% and meanwhile, reduce the makespan by 18.0%, in the presence of various DL job workloads.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Workflows Community Summit 2022: A Roadmap Revolution

Scientific workflows have become integral tools in broad scientific computing use cases. Science discovery is increasingly dependent on workflows to orchestrate large and complex scientific experiments that range from the execution of a cloud-based data preprocessing pipeline to multi-facility instrument-to-edge-to-HPC computational workflows. Given the changing landscape of scientific computing (often referred to as a computing continuum) and the evolving needs of emerging scientific applications, it is paramount that the development of novel scientific workflows and system functionalities seek to increase the efficiency, resilience, and pervasiveness of existing systems and applications. Specifically, the proliferation of machine learning/artificial intelligence (ML/AI) workflows, need for processing large-scale datasets produced by instruments at the edge, intensification of near real-time data processing, support for long-term experiment campaigns, and emergence of quantum computing as an adjunct to HPC, have significantly changed the functional and operational requirements of workflow systems. Workflow systems now need to, for example, support data streams from the edge-to-cloud-to-HPC, enable the management of many small-sized files, allow data reduction while ensuring high accuracy, orchestrate distributed services (workflows, instruments, data movement, provenance, publication, etc.) across computing and user facilities, among others. Further, to accelerate science, it is also necessary that these systems implement specifications/standards and APIs for seamless (horizontal and vertical) integration between systems and applications, as well as enable the publication of workflows and their associated products according to the FAIR principles.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2016

THOR: A NEW AND FLEXIBLE GLOBAL CIRCULATION MODEL TO EXPLORE PLANETARY ATMOSPHERES

We have designed and developed, from scratch, a global circulation model (GCM) named THOR that solves the three-dimensional nonhydrostatic Euler equations. Our general approach lifts the commonly used assumptions of a shallow atmosphere and hydrostatic equilibrium. We solve the “pole problem” (where converging meridians on a sphere lead to increasingly smaller time steps near the poles) by implementing an icosahedral grid. Irregularities in the grid, which lead to grid imprinting, are smoothed using the “spring dynamics” technique. We validate our implementation of spring dynamics by examining calculations of the divergence and gradient of test functions. To prevent the computational time step from being bottlenecked by having to resolve sound waves, we implement a split-explicit method together with a horizontally explicit and vertically implicit integration. We validate our GCM by reproducing the Earth and hot-Jupiter-like benchmark tests. THOR was designed to run on graphics processing units (GPUs), which allows for physics modules (radiative transfer, clouds, chemistry) to be added in the future, and is part of the open-source Exoclimes Simulation Platform (www.exoclime.org).

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2017

The Modern Research Data Portal: A Design Pattern for Networked, Data-Intensive Science

Here we describe best practices for providing convenient, high-speed, secure access to large data via research data portals. We capture these best practices in a new design pattern, the Modern Research Data Portal, that disaggregates the traditional monolithic web-based data portal to achieve orders-of-magnitude increases in data transfer performance, support new deployment architectures that decouple control logic from data storage, and reduce development and operations costs. We introduce the design pattern; explain how it leverages high-performance Science DMZs and cloud-based data management services; review representative examples at research laboratories and universities, including both experimental facilities and supercomputer sites; describe how to leverage Python APIs for authentication, authorization, data transfer, and data sharing; and use coding examples to demonstrate how these APIs can be used to implement a range of research data portal capabilities. Sample code at a companion web site, https://docs.globus.org/mrdp, provides application skeletons that readers can adapt to realize their own research data portals.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗
DOE OSTI2018

The Modern Research Data Portal: a design pattern for networked, data-intensive science

We describe best practices for providing convenient, high-speed, secure access to large data via research data portals. Here, we capture these best practices in a new design pattern, the Modern Research Data Portal, that disaggregates the traditional monolithic web-based data portal to achieve orders-of-magnitude increases in data transfer performance, support new deployment architectures that decouple control logic from data storage, and reduce development and operations costs. We introduce the design pattern; explain how it leverages high-performance data enclaves and cloud-based data management services; review representative examples at research laboratories and universities, including both experimental facilities and supercomputer sites; describe how to leverage Python APIs for authentication, authorization, data transfer, and data sharing; and use coding examples to demonstrate how these APIs can be used to implement a range of research data portal capabilities. Sample code at a companion web site, https://docs.globus.org/mrdp , provides application skeletons that readers can adapt to realize their own research data portals.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS1984

Multisensor satellite data integration for sea surface wind speed and direction determination

Techniques to integrate meteorological data from various satellite sensors to yield a global measure of sea surface wind speed and direction for input to the Navy's operational weather forecast models were investigated. The sensors were launched or will be launched, specifically the GOES visible and infrared imaging sensor, the Nimbus-7 SMMR, and the DMSP SSM/I instrument. An algorithm for the extrapolation to the sea surface of wind directions as derived from successive GOES cloud images was developed. This wind veering algorithm is relatively simple, accounts for the major physical variables, and seems to represent the best solution that can be found with existing data. An algorithm for the interpolation of the scattered observed data to a common geographical grid was implemented. The algorithm is based on a combination of inverse distance weighting and trend surface fitting, and is suited to combing wind data from disparate sources.

Glackin, D. L.↗
NASA NTRS2001

Recent Developments in DAO's Finite-Volume Data Assimilation System

The Physical-space/Finite-volume Data Assimilation System (fvDAS) is the next generation global atmospheric data assimilation system in development at the Data Assimilation Office at NASA's Goddard Space Flight Center. It is based on a new finite-volume general circulation model jointly developed by NASA and NCAR and on the Physical-Space Statistical Analysis System (PSAS) developed at the DAO. The data assimilation method implemented in CODAS incorporates a simplified version of the model bias estimation and correction algorithm, as described by Dee and da Silva (1998). In this talk we will briefly describe the general system formulation, and focus on the impact of 3 data types recently introduced, namely: 1) cloud tracks winds from the Multi-angle Imaging Spectrometer by the US Air Force, and 3) temperature and moisture information derived from GPS refractivity occultation measurements. The impact of these data types on observation-minus-6hr forecast (O-F) statistics, as well as 5-day forecast skills will be discussed. In addition we will assess the impact of cloud assimilation on top of the atmosphere radiation fields estimated from CERES measurements.

daSilva, Arlindo↗
NASA NTRS2022

Cockpit Interface for Locomotion and Manipulation Control of the NASA Valkyrie Humanoid in Virtual Reality (VR)

A virtual reality (VR) interface is presented for controlling NASA’s Valkyrie humanoid robot with flexible locomotion control options and intuitive teleoperation. Locomotion modes include navigating to a specified waypoint, sending desired velocities with a joystick, or manually placing a sequence of footsteps. On the other hand, teleoperation modes include voice commands to toggle relative whole-body tracking or high-level commandeering, and key bindings for common stored poses such as power grasps. The primary novelties of the interface are in the implementation of the cockpit mode and a floating augmented reality (AR) screen fixed with respect to the robot. The former enables embodied teleoperation and increased awareness during navigation in a mixed-reality setting. The latter preserves depth perception without the disparity clutter from a stereo point cloud. The interface is demonstrated on two real humanoids performing common explosive ordnance disposal (EOD) tasks such as door opening, vehicle inspection, and disruptor placement. Notably, the interface enables a single operator to control multiple humanoids. While the interface is motivated by EOD missions, the presented ideas are usable for other robots employing VR-based control.

Virtual-reality↗
DOE OSTI2016

A CIRCULAR-CYLINDRICAL FLUX-ROPE ANALYTICAL MODEL FOR MAGNETIC CLOUDS

We present an analytical model to describe magnetic flux-rope topologies. When these structures are observed embedded in Interplanetary Coronal Mass Ejections (ICMEs) with a depressed proton temperature, they are called Magnetic Clouds (MCs). Our model extends the circular-cylindrical concept of Hidalgo et al. by introducing a general form for the radial dependence of the current density. This generalization provides information on the force distribution inside the flux rope in addition to the usual parameters of MC geometrical information and orientation. The generalized model provides flexibility for implementation in 3D MHD simulations. Here, we evaluate its performance in the reconstruction of MCs in in situ observations. Four Earth-directed ICME events, observed by the Wind spacecraft, are used to validate the technique. The events are selected from the ICME Wind list with the magnetic obstacle boundaries chosen consistently with the magnetic field and plasma in situ observations and with a new parameter (EPP, the Electron Pitch angle distribution Parameter) which quantifies the bidirectionally of the plasma electrons. The goodness of the fit is evaluated with a single correlation parameter to enable comparative analysis of the events. In general, at first glance, the model fits the selected events very well. However, a detailed analysis of events with signatures of significant compression indicates the need to explore geometries other than the circular-cylindrical. An extension of our current modeling framework to account for such non-circular CMEs will be presented in a forthcoming publication.

79 ASTRONOMY AND ASTROPHYSICS↗