Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “cloud database”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9
All sourcesNASA NTRSDOE OSTI
DOE OSTI2018

C-SAPR2 Convective Cell Tracking Database during CACTI

The convective cell tracking database V1 using the ARM CSAPR2 radar data set at the Sierras de Córdoba (COR) AMF site in Argentina consists of individually tracked convective cells during the entire CACTI field campaign from 15 October 2018 to 3 March 2019. The cell tracking database is produced by applying an updated version of the FLEXible object TRaKeR (FLEXTRKR) (Feng et al. 2022) to the Cartesian gridded CSAPR2 PPI data set produced by the Taranis radar processing package (Hardin et al. 2020).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Progress on the National Solar Radiation Data Base (NSRDB): A New DNI Computation

This study introduces a new technique to compute direct normal irradiance (DNI) for improving the National Solar Radiation Data Base (NSRDB). A finite-surface integration algorithm is developed to compute solar radiation in differential solid angles and efficiently infer its contribution to a surface perpendicular to the solar direction. A lookup table of cloud bi-directional transmittance distribution function (BTDF) is developed by use of the discrete ordinates radiative transfer (DISORT) model for possible solar and observing directions and various cloud optical and microphysical properties. In each solar incident direction, DNI is given by the cloud BTDFs from approximately 200 differential solid angles. The simulated DNI is calibrated and evaluated using surface observations at the National Renewable Energy Laboratory's (NREL's) Solar Energy Research Laboratory (SRRL) and the Atmospheric Radiation Measurement (ARM) Southern Great Plains (SGP) facility.

41 EE - Solar Energy Technologies Office (EE-4S)↗
DOE OSTI2017

Framework for Analysis and Visualization of Simulation Data (VizAly)

As supercomputing resources increase, cosmological scientists are able to run more detailed and larger simulations generating massive amounts of data. Analyzing these simulations with an available open-source toolkit is important for collaborative Department of Energy scientific discovery across labs, universities, and other partners. Developed software as a part of this collection include: comparing data with other existing simulations, verifying and validating results with observation databases, new halo finder algorithms, and using analytical tools to get insights into the physics of the cosmological universe. The goal of this software project is to provide a set of open-source libraries, tools, and packages for large-scale cosmology that allows scientists to visualize, analyze, and compare large-scale simulation and observational data sets. Developed software will provide a variety of methods for processing, visualization, and analysis of astronomical observation and cosmological simulation data. These tools are intended for deployment on multiple scientific computing platforms, including but not limited to personal computers, cloud computing, experimental sites (telescopes) and high performance supercomputers.

Wendelberger, Joanne↗
DOE OSTI2019

Striped Data Analysis Framework

Traditionally, High Energy data analysis is based on the model where data are stored in files and analyzed by running multiple analysis processes, each reading one or more of the data files. This process involves repeated data reduction step, which produces smaller files, which is time consuming and leads to data duplication. We propose an alternative approach to data storage and analysis, based on the Big Data technologies. The idea is to store each element of data once and only once in a distributed scalable database and analyze data by reading only "interesting" pieces of data from the database. To make this approach possible, we developed columnar Striped Data Representation Format as the basis of the framework. Traditional columnar approach allows for efficient analysis of complex data structures. While keeping all the benefits of columnar data representation, striped mechanism goes further by enabling efficient parallelization of computations and flexible dist ribution of data analysis. The framework includes scalable and elastic data storage, compute and user analysis backend components. The framework uses off-the shelf web services and data caching technologies as the compute/data co-location mechanism. Flexible architecture allows the framework run in the cloud using container technologies. The framework offers Python/Jupyter as the user analysis backend platform, but can also run in command line or batch mode. In the article, we will present the results of the FNAL-LDRD-2016-032 FNAL LDRD project, the design, implementation, features and performance characteristics of the Striped Data Analysis Framework.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2022

Pose Classification Using Three-Dimensional Atomic Structure-Based Neural Networks Applied to Ion Channel–Ligand Docking

The identification of promising lead compounds showing pharmacological activities toward a biological target is essential in early stage drug discovery. With the recent increase in available small-molecule databases, virtual high-throughput screening using physics-based molecular docking has emerged as an essential tool in assisting fast and cost-efficient lead discovery and optimization. However, the best scored docking poses are often suboptimal, resulting in incorrect screening and chemical property calculation. We address the pose classification problem by leveraging data-driven machine learning approaches to identify correct docking poses from AutoDock Vina and Glide screens. To enable effective classification of docking poses, we present two convolutional neural network approaches: a three-dimensional convolutional neural network (3D-CNN) and an attention-based point cloud network (PCN) trained on the PDBbind refined set. We demonstrate the effectiveness of our proposed classifiers on multiple evaluation data sets including the standard PDBbind CASF-2016 benchmark data set and various compound libraries with structurally different protein targets including an ion channel data set extracted from Protein Data Bank (PDB) and an in-house KCa3.1 inhibitor data set. Our experiments show that excluding false positive docking poses using the proposed classifiers improves virtual high-throughput screening to identify novel molecules against each target protein compared to the initial screen based on the docking scores.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

BASS. XXIX. The Near-infrared View of the Broad-line Region (BLR): The Effects of Obscuration in BLR Characterization

Virial black hole (BH) mass (M BH ) determination directly involves knowing the broad-line region (BLR) clouds' velocity distribution, their distance from the central supermassive BH (R BLR ), and the virial factor (f). Understanding whether biases arise in M BH estimation with increasing obscuration is possible only by studying a large (N > 100) statistical sample of obscuration-unbiased (hard) X-ray-selected active galactic nuclei (AGNs) in the rest-frame near-infrared (0.8–2.5 μm) since it penetrates deeper into the BLR than the optical. We present a detailed analysis of 65 local Burst Alert Telescope (BAT) selected Seyfert galaxies observed with Magellan/FIRE. Adding these to the near-infrared BAT AGN spectroscopic survey database, we study a total of 314 unique near-infrared spectra. While the FWHMs of Hα and near-infrared broad lines (He i, Paβ, Paα) remain unbiased to either BLR extinction or X-ray obscuration, the Hα broad-line luminosity is suppressed when N H ≳ 10 21 cm –2 , systematically underestimating M BH by 0.23–0.46 dex. Near-infrared line luminosities should be preferred to Hα until N H < 10 22 cm –2 , while at higher obscuration a less-biased R BLR proxy should be adopted. We estimate f for Seyfert 1 and 2 using two obscuration-unbiased M BH measurements, i.e., the stellar velocity dispersion and a BH mass prescription based on near-infrared and X-ray, and find that the virial factors do not depend on the redshift or obscuration, but some broad lines show a mild anticorrelation with M BH . Furthermore, our results show the critical impact obscuration can have on BLR characterization and the importance of the near-infrared and X-rays for a less-biased view of the BLR.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Cyber-Physical System Implementation for Manufacturing With Analytics in the Cloud Layer

Effective and efficient modern manufacturing operations require the acceptance and incorporation of the fourth industrial revolution, also known as Industry 4.0. Traditional shop floors are evolving their production into smart factories. To continue this trend, a specific architecture for the cyber-physical system is required, as well as a systematic approach to automate the application of algorithms and transform the acquired data into useful information. This work makes use of an approach that distinguishes three layers that are part of the existing Industry 4.0 paradigm: edge, fog, and cloud. Each of the layers performs computational operations, transforming the data produced in the smart factory into useful information. Trained or untrained methods for data analytics can be incorporated into the architecture. A case study is presented in which a real-time statistical control process algorithm based on control charts was implemented. The algorithm automatically detects changes in the material being processed in a computerized numerical control (CNC) machine. The algorithm implemented in the proposed architecture yielded short response times. The performance was effective since it automatically adapted to the machining of aluminum and then detected when the material was switched to steel. The data were backed up in a database that would allow traceability to the line of g-code that performed the machining.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Towards Lightweight Data Integration Using Multi-Workflow Provenance and Data Observability

Modern large-scale scientific discovery requires multidisciplinary collaboration across diverse computing facilities, including High Performance Computing (HPC) machines and the Edge-to-Cloud continuum. Integrated data analysis plays a crucial role in scientific discovery, especially in the current AI era, by enabling Responsible AI development, FAIR, Reproducibility, and User Steering. However, the heterogeneous nature of science poses challenges such as dealing with multiple supporting tools, cross-facility environments, and efficient HPC execution. Building on data observability, adapter system design, and provenance, we propose MIDA: an approach for lightweight runtime Multi-workflow Integrated Data Analysis. MIDA defines data observability strategies and adaptability methods for various parallel systems and machine learning tools. With observability, it intercepts the dataflows in the background without requiring instrumentation while integrating domain, provenance, and telemetry data at runtime into a unified database ready for user steering queries. We conduct experiments showing end-to-end multi-workflow analysis integrating data from Dask and MLFlow in a real distributed deep learning use case for materials science that runs on multiple environments with up to 276 GPUs in parallel. We show near-zero overhead running up to 100,000 tasks on 1,680 CPU cores on the Summit supercomputer.

Santos Souza, Renan↗
DOE OSTI2015

THE 2014 KIDA NETWORK FOR INTERSTELLAR CHEMISTRY

Chemical models used to study the chemical composition of the gas and the ices in the interstellar medium are based on a network of chemical reactions and associated rate coefficients. These reactions and rate coefficients are partially compiled from data in the literature, when available. We present in this paper kida.uva.2014, a new updated version of the kida.uva public gas-phase network first released in 2012. In addition to a description of the many specific updates, we illustrate changes in the predicted abundances of molecules for cold dense cloud conditions as compared with the results of the previous version of our network, kida.uva.2011.

astrochemistry↗
DOE OSTI2020

Constraining the destruction rate of K 40 in stellar nucleosynthesis through the study of the Ar 40 ( p , n ) K 40 reaction

Background: We present that K 40 plays a significant role in the radiogenic heating of Earth-like exoplanets, which can affect the development of a habitable environment on their surfaces. The initial amount of K 40 in the interior of these planets depends on the composition of the interstellar clouds from which they formed. Within this context, nuclear reactions that regulate the production of K 40 during stellar evolution can play a critical role. Purpose: In this study, we constrain for the first time the astrophysical reaction rate of K 40 ( n , p ) Ar 40 , which is responsible for the destruction of K 40 during stellar nucleosynthesis. We provide to the nuclear physics community high-resolution data on the cross section and angular distribution of the Ar 40 ( p , n ) K 40 reaction. These are important to various applications involving Ar 40 . The associated reaction rate of the Ar 40 ( p , n ) K 40 process addresses a reaction rate gap in the Joint Institute for Nuclear Astrophysics REACLIB database in the region of intermediate-mass isotopes. Methods: We performed differential cross-section measurements on the Ar 40 ( p , n ) K 40 reaction, for six energies in the center-of-mass system between 3.2 and 4.0 MeV and various angles between 0 ° and 135 ° . The experiment took place at the Edwards Accelerator Laboratory at Ohio University using the beam swinger target location and a standard neutron time-of-flight technique. We extracted total and partial cross sections by integrating the double differential cross sections we measured. Results: The total and partial cross sections varied with energy due to the contribution from isobaric analog states and Ericson type fluctuations. The energy-averaged neutron angular distributions were symmetrical relative to 90 ° . Based on the experimental data, local transmission coefficients were extracted and were used to calculate the astrophysical reaction rates of Ar 40 ( p , n ) K 40 and K 40 ( n , p ) Ar 40 reactions. The new rates were found to vary significantly from the theoretical rates in the REACLIB library. We implemented the new rates in network calculations to study nucleosynthesis via the slow neutron capture process, and we found that the produced abundance of K 40 is reduced by up to 10% compared to calculations with the library rates. At the same time, the above result removes a significant portion of the previous theoretical uncertainty on the K 40 yields from stellar evolution calculations. Conclusions: Our results support a destruction rate of K 40 in massive stars via the K 40 ( n , p ) Ar 40 reaction that is larger compared to previous estimates. The rate of K 40 destruction via the K 40 ( n , p ) Ar 40 reaction now has a dramatically reduced uncertainty based on our measurement. Lastly, this result directly affects the predicted stellar yields of K 40 from nucleosynthesis, which is a critical input parameter for the galactic chemical evolution models that are currently employed for the study of significant properties of exoplanets.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2020

Global ocean dimethyl sulfide climatology estimated from observations and an artificial neural network

Marine dimethyl sulfide (DMS) is important to climate due to the ability of DMS to alter Earth's radiation budget. Knowledge of the global-scale distribution, seasonal variability, and sea-to-air flux of DMS is needed in order to improve understanding of atmospheric sulfur, aerosol/cloud dynamics, and albedo. Here we examine the use of an artificial neural network (ANN) to extrapolate available DMS measurements to the global ocean and produce a global climatology with monthly temporal resolution. A global database of 82 996 ship-based DMS measurements in surface waters was used along with a suite of environmental parameters consisting of latitude–longitude coordinates, time of day, time of year, solar radiation, mixed layer depth, sea surface temperature, salinity, nitrate, phosphate, and silicate. Linear regressions of DMS against the environmental parameters show that on a global-scale mixed layer depth and solar radiation are the strongest predictors of DMS. These parameters capture ~9 % and ~7 % of the raw DMS data variance, respectively. Multilinear regression can capture more of the raw data variance (~39 %) but strongly underestimates DMS in high-concentration regions. In contrast, the artificial neural network captures ~66 % of the raw data variance in our database. Like prior climatologies our results show a strong seasonal cycle in surface ocean DMS with the highest concentrations and sea-to-air fluxes in the high-latitude summertime oceans. We estimate a lower global sea-to-air DMS flux (20.12±0.43 Tg S yr –1 ) than the prior estimate based on a map interpolation method when the same gas transfer velocity parameterization is used. Our sensitivity test results show that DMS concentration does not change unidirectionally with each of the environmental parameters, which emphasizes the interactions among these parameters. The ANN model suggests that the flux of DMS from the ocean to the atmosphere will increase with global warming. Given that larger DMS fluxes induce greater cloud albedo, this corresponds to a negative climate feedback.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Statistical Analysis of Trans‐Ionospheric Pulse Pairs and Inferences on Their Characteristics

Trans-ionospheric pulse pairs (TIPPs), first observed in 1993, are signatures of in-cloud lightning discharges observed by satellite-based broadband very high frequency (VHF) receivers. It has been definitively shown that TIPPs are the space-based signatures of compact intracloud discharges (CIDs), and that the associated pair of pulses that comprise a TIPP result from the direct VHF pulse from the discharge, followed by a pulse reflected from the Earth's surface. However, the ratio of the peak amplitudes of these two pulses can vary widely, with the second pulse often having considerably higher peak amplitude than the first. This observation has not been satisfactorily explained. Using data collected from geostationary orbit by the Radio Frequency Sensor (RFS) and matched to locations reported by the Global Lightning Dataset (GLD360), we assemble the largest database to date of 76,348 TIPPs with associated location, altitude, and amplitude ratio of the two pulses in the TIPP. We show that the amplitude ratio of TIPPs is strongly correlated to the altitude of the associated discharges and the geometry of the source location with respect to the Earth's surface and the receiver. These observations strongly suggest that the difference in amplitude of the two pulses is driven by a nondipole radiated beam pattern that is dependent on the polarity of the CID, velocity of the current wavefront, and viewing angle.

58 GEOSCIENCES↗
DOE OSTI2020

Navigation and Meteorological Data from Multiple Sensors on Airborne Platform (NAVMET-AIR) Value-Added Product Report

The Navigation and Meteorological Data from Multiple Sensors on Airborne Platform (NAVMET-AIR) value-added product encompasses the aafnaviwg data set in the ARM Data Center (ADC), known as the IWG file, named for the Inter-Agency Working Group for Airborne Data and Telemetry Systems (IWGADTS). Its purpose is to produce a suite of tools to promote standardization of instrument interface, data format, and data processing. This data set’s contents are navigational and meteorological state variables at 1 Hz. It also contains higher-order data flags created by ARM Aerial Facility (AAF) scientists to aid analysis such as periods when the aircraft is flying level, operating in maneuvers, or flying through cloud. Due to the nature of research flights, the payload of the aircraft consists of many duplicate and overlapping instruments to ensure, in case of instrument failure, there is a backup to record the data. Measurements from multiple instruments are consolidated into a single file. Each variable of this data set is carefully chosen from the onboard instrumentation and quality checked by AAF scientists to create this wholistic and most accurate data set for airborne research. This document is intended to be a hub towards the individual “read me” files produced for each campaign. For reference about what instrument was used for calculations on specific days, the read me files are located in the ARM IOP archive at the addresses listed, or access the IOP (intensive operational period) database at https://www.archive.arm.gov/.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2015

THE NATURE AND FREQUENCY OF OUTFLOWS FROM STARS IN THE CENTRAL ORION NEBULA CLUSTER

Recent Hubble Space Telescope images have allowed the determination with unprecedented accuracy of motions and changes of shocks within the inner Orion Nebula. These originate from collimated outflows from very young stars, some within the ionized portion of the nebula and others within the host molecular cloud. We have doubled the number of Herbig–Haro objects known within the inner Orion Nebula. We find that the best-known Herbig–Haro shocks originate from relatively few stars, with the optically visible X-ray source COUP 666 driving many of them. While some isolated shocks are driven by single collimated outflows, many groups of shocks are the result of a single stellar source having jets oriented in multiple directions at similar times. This explains the feature that shocks aligned in opposite directions in the plane of the sky are usually blueshifted because the redshifted outflows pass into the optically thick photon-dominated region behind the nebula. There are two regions from which optical outflows originate for which there are no candidate sources in the SIMBAD database.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2019

Comparing datasets of volume servers to illuminate their energy use in data centers

As data centers proliferate, their energy intensity deserves close attention. Always-on operations and growing usage for cloud and other backend processes make servers the fundamental driver of data center energy use. Yet servers’ power draw under real-world conditions is poorly understood. This paper explores characteristics of volume servers that affect energy use, quantifying differences in power draw between higher-performing Standard Performance Evaluation Corporation (SPEC) and ENERGY STAR servers and that of a typical server. First, we establish general characteristics of the US installed base, before reporting hardware configurations from a major online retail website. We then compare idle power across three datasets (one unique to this paper) and explain their differences via the hardware characteristics to which power draw is most sensitive. We find idle server power demand to be significantly higher than benchmarks from ENERGY STAR and the industry-released SPEC database, and SPEC server configurations—and likely their power scaling—to be atypical of volume servers. Next, we examine power draw trends among high-performing servers across their load range to consider whether these trends are representative of volume servers, before inputting average idle power load values into a recent national server energy use model. Lastly, results from two surveys of IT professionals illustrate the incidence of more efficient equipment and operational practices in server rooms/closets. Future work should include server power field measurements in data centers of different sizes, accounting for variations in configurations and setting changes post-purchase, as well as investigating the linkage between time and server energy efficiency.

Fuchs, Heidi (ORCID:0000000300105411)↗
DOE OSTI2018

National Solar Radiation Database (NSRDB)

The National Solar Radiation Database (NSRDB) is a serially complete collection of meteorological and solar irradiance data sets for the United States and a growing list of international locations for 1998-2023. The NSRDB is updated annually and provides foundational information to support U.S. Department of Energy programs, research, industry and the general public. The NSRDB provides time-series data at 30-minute resolution of resource averaged over surface cells of 0.038 degrees in both latitude and longitude, or nominally 4 km in size. Additionally time series data at 5 minutes for the US and 10 minutes for North, Central and South America at 2 km resolution are produced from the next generation of GOES satellites and made available from 2019. The solar radiation values represent the resource available to solar energy systems. The data was created using cloud properties which are generated using the AVHRR Pathfinder Atmospheres-Extended (PATMOS-x) algorithms developed by the University of Wisconsin. Fast all-sky radiation model for solar applications (FARMS) in conjunction with the cloud properties, and aerosol optical depth (AOD) and precipitable water vapor (PWV) from ancillary source are used to estimate solar irradiance (GHI, DNI, and DHI). The Global Horizontal Irradiance (GHI) is computed for clear skies using the REST2 model. For cloud scenes identified by the cloud mask, FARMS is used to compute GHI and FARMS DNI is used to compute the Direct Normal Irradiance (DNI). The PATMOS-X model uses radiance images in visible and infrared channels from the Geostationary Operational Environmental Satellite (GOES) series of geostationary weather satellites. Ancillary variables needed to run REST2 and FARMS (e.g., aerosol optical depth, precipitable water vapor, and albedo) are derived from NASA's Modern Era-Retrospective Analysis (MERRA-2) dataset. Temperature and wind speed data are also derived from MERRA-2 and provided for use in NREL's System Advisor Model (SAM) to compute PV generation.

aerosol↗
DOE OSTI2022

The Ice Particle and Aggregate Simulator (IPAS). Part III: Verification and Analysis of Ice–Aggregate and Aggregate–Aggregate Collection for Microphysical Parameterization

Abstract The Ice Particle and Aggregate Simulator (IPAS) is used to theoretically represent the aggregation process of ice crystals. Aggregates have a variety of formations based on initial ice particle size, shape, and falling orientation, all of which influence water phase partitioning. Aggregate dimensional properties and density changes are calculated for monomer–monomer (MON–MON), monomer–aggregate (MON–AGG), and aggregate–aggregate (AGG–AGG) collection to be used by ice-microphysical models for improvement in aggregation parameterizations. Aggregates are chosen from a database of 9 744 000 preformed combinations to be further collected (see Part II). AGG–AGG collection results in more extreme and a smaller range of aggregate aspect ratios than MON–AGG collection. A majority of aggregates are closer to prolate than oblate spheroids, regardless of collection type, except for quasi-horizontally oriented particles that have extreme aspect ratios to begin with. MON–AGG collection frequently results in an increase in density upon collection, whereas MON–MON and AGG–AGG collection almost always result in particle density decreases, with extreme reductions near 99% for MON–MON collection. MON–MON collection results in the greatest decreases in density but then quickly becomes unaffected by the addition of more monomers due to inherent size differences between monomers and aggregates. Finally, a holistic analysis to in situ observations of cloud particle images is presented. IPAS 2D aspect ratios surround a median value of 0.6 and closely follow that of previous studies while varying by no more than ≈12% on average from observed aggregates.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2015

SU-E-T-186: Cloud-Based Quality Assurance Application for Linear Accelerator Commissioning

Purpose: To identify anomalies and safety issues during data collection and modeling for treatment planning systems Methods: A cloud-based quality assurance system (AQUIRE - Automated QUalIty REassurance) has been developed to allow the uploading and analysis of beam data aquired during the treatment planning system commissioning process. In addition to comparing and aggregating measured data, tools have also been developed to extract dose from the treatment planning system for end-to-end testing. A gamma index is perfomed on the data to give a dose difference and distance-to-agreement for validation that a beam model is generating plans consistent with the beam data collection. Results: Over 20 linear accelerators have been commissioning using this platform, and a variety of errors and potential saftey issues have been caught through the validation process. For example, the gamma index of 2% dose, 2mm DTA is quite sufficient to see curves not corrected for effective point of measurement. Also, data imported into the database is analyzed against an aggregate of similar linear accelerators to show data points that are outliers. The resulting curves in the database exhibit a very small standard deviation and imply that a preconfigured beam model based on aggregated linear accelerators will be sufficient in most cases. Conclusion: With the use of this new platform for beam data commissioning, errors in beam data collection and treatment planning system modeling are greatly reduced. With the reduction in errors during acquisition, the resulting beam models are quite similar, suggesting that a common beam model may be possible in the future. Development is ongoing to create routine quality assurance tools to compare back to the beam data acquired during commissioning. I am a medical physicist for Alzyen Medical Physics, and perform commissioning services.

60 APPLIED LIFE SCIENCES↗