Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “ARMS”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 541 records · Page 30
All sourcesNASA NTRSDOE OSTI
DOE OSTI2019

Regional Moisture Budget and Land-Atmosphere Coupling Over the U.S. Southern Great Plains Inferred From the ARM Long-Term Observations

Ten–year warm–season (May–August) observations at the Atmospheric Radiation Measurement (ARM) Southern Great Plains (SGP) site are used to examine the large–scale atmospheric moisture budget and the strength of land–atmosphere coupling. Atmospheric moisture budget components, computed from the ARM variational analysis data, are compared between different wet/dry scenarios and convection regimes. Consistent with previous studies, large–scale moisture flux convergence dominates the SGP regional moisture budget on the daily time scale, but surface evaporation does play a more prominent role on late–afternoon deep convection days. Moreover, the relationship between moisture flux convergence and precipitation increases significantly from dry year to wet years. The land–atmosphere coupling strength is quantified for local convective events within the “Local L–A Coupling Process Chain” (Santanello et al., 2018, https://doi.org/10.1175/BAMS–D–17–0001.1). The impact of land surface on the evolution of planetary boundary layer is highly dependent on the vegetation leaf area index. A significantly larger surface sensible heat flux is found over the SGP forest region in midsummer, which is accompanied by a much higher planetary boundary layer development and a large increase in shallow cumulus cloud fraction. Here the significant relationship between afternoon precipitation and surface turbulent flux only exists in the northeast part of the ARM SGP site, which is mainly covered by grassland/pasture.

58 GEOSCIENCES↗
DOE OSTI2023

Regime-specific Cloud Vertical Overlap Characteristics from Radar and Lidar Observations at the ARM sites

Climate and numerical weather prediction models require assumptions to represent the vertical distribution of subgrid-scale clouds, which have radiative transfer implications. In this study, nearly 25 years of ground-based radar and lidar observations of vertical cloud profiles at the Atmospheric Radiation Measurement Program (ARM) Southern Great Plains (SGP) site are utilized to derive cloud vertical overlap characteristics from the Cloud Type (CLDTYPE) data product. Here, the cloud vertical overlap characteristics are further separated by cloud regime by considering seven cloud types (i.e., low cloud, congestus, deep convection, altocumulus, altostratus, cirrostratus, and cirrus) as well as periods of shallow cumulus. The decorrelation length scale (i.e., exponential transition from maximum to random overlap with layer separation) is found to vary by cloud regime, ranging between 0.04 km for cirrostratus paired with cirrus to 4.58 km for low cloud paired with cirrus at SGP. Cloud vertical overlap characteristics are also considered for other ARM sites including the Tropical Western Pacific (TWP), North Slope of Alaska (NSA), and Eastern North Atlantic (ENA) sites amongst other shorter term ARM deployments globally. The decorrelation length scale ranged globally from 1.03 km in the Arctic Ocean to 3.06 km in Manacapuru, Brazil. Globally, the decorrelation length scale by cloud regime exhibited similarities (e.g., for cirrus paired with cirrus) and differences (e.g., congestus paired with cirrus). The results could help inform development of cloud vertical overlap assumptions within operational numerical weather prediction models and potentially improve prediction of radiative fluxes for weather, climate, and renewable energy forecasting.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2013

GALACTIC ALL-SKY SURVEY HIGH-VELOCITY CLOUDS IN THE REGION OF THE MAGELLANIC LEADING ARM

We present a catalog of high-velocity clouds in the region of the Magellanic Leading Arm. The catalog is based on neutral hydrogen (H I) observations from the Parkes Galactic All-Sky Survey. Excellent spectral resolution allows clouds with narrow-line components to be resolved. The total number of detected clouds is 419. We describe the method of cataloging and present the basic parameters of the clouds. We discuss the general distribution of the high-velocity clouds and classify the clouds based on their morphological type. The presence of a significant number of head-tail clouds and their distribution in the region is discussed in the context of Magellanic System simulations. We suggest that ram-pressure stripping is a more important factor than tidal forces for the morphology and formation of the Magellanic Leading Arm and that different environmental conditions might explain the morphological difference between the Magellanic Leading Arm and Magellanic Stream. We also discuss a newly identified population of clouds that forms the LA IV and a new diffuse bridge-like feature connecting the LA II and III complexes.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2014

Recovering the observed b/c ratio in a dynamic spiral-armed cosmic ray model

We develop a fully three-dimensional numerical code describing the diffusion of cosmic rays (CRs) in the Milky Way. It includes the nuclear spallation chain up to oxygen, and allows the study of various CR properties, such as the CR age, grammage traversed, and the ratio between secondary and primary particles. This code enables us to explore a model in which a large fraction of the CR acceleration takes place in the vicinity of galactic spiral arms that are dynamic. We show that the effect of having dynamic spiral arms is to limit the age of CRs at low energies. This is because at low energies the time since the last spiral arm passage governs the CR age, and not diffusion. Using the model, the observed spectral dependence of the secondary to primary ratio is recovered without requiring any further assumptions such as a galactic wind, re-acceleration or various assumptions on the diffusivity. In particular, we obtain a secondary to primary ratio which increases with energy below about 1 GeV.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2014

Hα and [SII] emission from warm Ionized GAS in the Scutum-Centaurus Arm

We present Wisconsin H-Alpha Mapper [SII] λ6716 and Hα spectroscopic maps of the warm ionized medium (WIM) in the Scutum-Centaurus Arm at Galactic longitudes 310° < l < 345°. Using extinction-corrected Hα intensities (I{sub Hα}{sup c}), we measure an exponential scale height of electron density squared in the arm of H{sub n{sub e{sup 2}}}=0.30 kpc (assuming a distance of 3.5 kpc), intermediate between that observed in the inner Galaxy and in the Perseus Arm. The [S II]/Hα line ratio is enhanced at large |z| and in sightlines with faint I{sub Hα}{sup c}. We find that the [S II]/Hα line ratio has a power-law relationship with I{sub Hα}{sup c} from a value of ≈1.0 at I{sub Hα}{sup c}<0.2 R (Rayleighs) to a value of ≈0.08 at I{sub Hα}{sup c}≳100 R. The line ratio is better correlated with Hα intensity than with height above the plane, indicating that the physical conditions within the WIM vary systematically with electron density. We argue that the variation of the line ratio with height is a consequence of the decrease of electron density with height. Our results reinforce the well-established picture in which the diffuse Hα emission is due primarily to emission from in situ photoionized gas, with scattered light only a minor contributor.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2014

Pitch angle of galactic spiral arms

One of the key parameters that characterizes spiral arms in disk galaxies is a pitch angle that measures the inclination of a spiral arm to the direction of galactic rotation. The pitch angle differs from galaxy to galaxy, which suggests that the rotation law of galactic disks determines it. In order to investigate the relation between the pitch angle of spiral arms and the shear rate of galactic differential rotation, we perform local N-body simulations of pure stellar disks. We find that the pitch angle increases with the epicycle frequency and decreases with the shear rate and obtain the fitting formula. This dependence is explained by the swing amplification mechanism.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2014

Constraining dark matter halo profiles and galaxy formation models using spiral arm morphology. II. Dark and stellar mass concentrations for 13 nearby face-on galaxies

We investigate the use of spiral arm pitch angles as a probe of disk galaxy mass profiles. We confirm our previous result that spiral arm pitch angles (P) are well correlated with the rate of shear (S) in disk galaxy rotation curves. We use this correlation to argue that imaging data alone can provide a powerful probe of galactic mass distributions out to large look-back times. We then use a sample of 13 galaxies, with Spitzer 3.6 μm imaging data and observed Hα rotation curves, to demonstrate how an inferred shear rate coupled with a bulge-disk decomposition model and a Tully-Fisher-derived velocity normalization can be used to place constraints on a galaxy's baryon fraction and dark matter halo profile. Finally, we show that there appears to be a trend (albeit a weak correlation) between spiral arm pitch angle and halo concentration. We discuss implications for the suggested link between supermassive black hole (SMBH) mass and dark halo concentration, using pitch angle as a proxy for SMBH mass.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2015

Testing density wave theory with resolved stellar populations around spiral arms in M81

Stationary density waves rotating at a constant pattern speed Ω{sub P} would produce age gradients across spiral arms. We test whether such age gradients are present in M81 by deriving the recent star formation histories (SFHs) of 20 regions around one of M81's grand-design spiral arms. For each region, we use resolved stellar populations to determine the SFH by modeling the observed color–magnitude diagram constructed from archival Hubble Space Telescope F435W and F606W imaging. Although we should be able to detect systematic time delays in our spatially resolved SFHs, we find no evidence of star formation propagation across the spiral arm. Our data therefore provide no convincing evidence for a stationary density wave with a single pattern speed in M81, and instead favor the scenario of kinematic spiral patterns that are likely driven by tidal interactions with the companion galaxies M82 and NGC 3077.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2014

SPIRAL ARMS IN THE DISK OF HD 142527 FROM CO EMISSION LINES WITH ALMA

In view of both the size of its gap and the previously reported asymmetries and near-infrared spiral arms, the transition disk of the Herbig Fe star HD 142527 constitutes a remarkable case study. This paper focuses on the morphology of the outer disk through ALMA observations of {sup 12}CO J = 2-1, {sup 12}CO J = 3-2, and {sup 13}CO J = 2-1. Both {sup 12}CO J = 2-1 and {sup 12}CO J = 3-2 show spiral features of different sizes. The innermost spiral arm (S1) is a radio counterpart of the first near-infrared spiral observed by Fukagawa, but it is shifted radially outward. However, the most conspicuous CO spiral arm (S2) lies at the outskirts of the disk and has not been detected before. It corresponds to a cold density structure, with both brightness and excitation temperatures of order 13±2 K and conspicuous in the {sup 12}CO J = 2-1 peak-intensity map, but faint in {sup 12}CO J = 3-2. There is also a faint counterarm (S3), at a point-symmetric location of S2 with respect to the star. These three spirals are modeled separately with two different formulae that approximate the loci of density maxima in acoustic waves due to embedded planets. S1 could be fit relatively well with these formulae, compared to S2 and S3. Alternative scenarios such as gravitational instability or external tidal interaction are discussed. The impact of channelization on spectrally and spatially resolved peak intensity maps is also briefly addressed.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2018

Spring Boot based REST API to Improve Data Quality Report Generation for Big Scientific Data: ARM Data Center Example

Web application technologies are growing rapidly with continuous innovation and improvements. This paper focuses on the popular Spring Boot [1] java-based framework for building web and enterprise applications and how it provides the flexibility for service-oriented architecture (SOA). One challenge with any Spring-based applications is its level of complexity with configurations. Spring Boot makes it easy to create and deploy stand-alone, production-grade Spring applications with very little Spring configuration. Example, if we consider Spring Model-View-Controller (MVC) framework [2], we need to configure dispatcher servlet, web jars, a view resolver, and component scan among other things. To solve this, Spring Boot provides several Auto Configuration options to setup the application with any needed dependencies. Another challenge is to identify the framework dependencies and associated library versions required to develop a web application. Spring Boot offers simpler dependency management by using a comprehensive, but flexible, framework and the associated libraries in one single dependency, which provides all the Spring related technology that you need for starter projects as compared to CRUD web applications. This framework provides a range of additional features that are common across many projects such as embedded server, security, metrics, health checks, and externalized configuration. Web applications are generally packaged as war and deployed to a web server, but Spring Boot application can be packaged either as war or jar file, which allows to run the application without the need to install and/or configure on the application server. In this paper, we discuss how Atmospheric Radiation Measurement (ARM) Data Center (ADC) at Oak Ridge National Laboratory, is using Spring Boot to create a SOA based REST [4] service API, that bridges the gap between frontend user interfaces and backend database. Using this REST service API, ARM scientists are now able to submit reports via a user form or a command line interface, which captures the same data quality or other important information about ARM data.

Guntupally, Kavya↗
DOE OSTI2018

Detecting outliers in streaming time series data from ARM distributed sensors

The Atmospheric Radiation Measurement (ARM) Data Center at ORNL collects data from a number of permanent and mobile facilities around the globe. The data is then ingested to create high level scientific products. High frequency streaming measurements from sensors and radar instruments at ARM sites require high degree of accuracy to enable rigorous study of atmospheric processes. Outliers in collected data are common due to instrument failure or extreme weather events. Thus, it is critical to identify and flag them. We employed multiple univariate, multivariate and time series techniques for outlier detection methods and studied their effectiveness. First, we examined Pearson correlation coefficient which is used to measure the pairwise correlations between variables. Singular Spectrum Analysis (SSA) was applied to detect outliers by removing the anticipated annual and seasonal cycles from the signal to accentuate anomalies. K-means was applied for multivariate examination of data from collection of sensors to identify any deviation from expected and known patterns and identify abnormal observation. The Pearson correlation coefficient, SSA and K-means methods were later combined together in a framework to detect outliers through a range of checks. We applied the developed method to data from meteorological sensors at ARM Southern Great Plains site and validated against existing database of known data quality issues.

Lu, Yuping↗
DOE OSTI2022

Automatic Generation of High-Performance Convolution Kernels on ARM CPUs for Deep Learning

In this work, we present FastConv, a template-based code auto-generation open source library that can automatically generate high-performance deep learning convolution kernels of arbitrary matrices/tensors shapes. FastConv is based on the Winograd algorithm, which is reportedly the highest performing algorithm for the time-consuming convolution layers of convolutional neural networks. ARM CPUs cover a wide range designs and specifications, from embedded devices to HPC-grade CPUs. The leads to the dilemma of how to consistently optimize Winograd-based convolution solvers for convolution layers of different shapes. FastConv addresses this problem by using templates to auto-generate multiple shapes of tuned kernels variants suitable for skinny tall matrices. As a performance portable library, FastConv transparently searches for the best combination of kernel shapes, cache tiles, scheduling of loop orders, packing strategies, access patterns, and online/offline computations. Auto-tuning is used to search the parameter configuration space for the best performance for a given target architecture and problem size. The experiments with layer-wise evaluation on the VGG--16 model confirms a 1.25x performance gains is got by tuning the Winograd library. Integrated comparison results shows 1.02x to 1.40x, 1.14x to 2.17x, and 1.22x and 2.48x speedup is achieved over NNPACK, Arm NN, and FeatherCNN on the Kunpeng 920 beside few cases. Furthermore, problem size performance portability experiments with various convolution shapes shows that FastConv achieves 1.2x to 1.7x speedup and 2x to 22x speedup over NNPACK and ARM NN inference engine using Winograd on Kunpeng 920 . CPU performance portability evaluation on the VGG--16 show an average speedup over NNPACK of 1.42x, 1.21x, 1.26x, 1.37x, 2.26x, and 11.02x is observed on Kunpeng 920, Snapdragon 835, 855, 888, Apple M1, and AWS Graviton2, respectively.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2013

Evaluation of interpolation methods for surface-based motion compensated tomographic reconstruction for cardiac angiographic C-arm data

Purpose: For interventional cardiac procedures, anatomical and functional information about the cardiac chambers is of major interest. With the technology of angiographic C-arm systems it is possible to reconstruct intraprocedural three-dimensional (3D) images from 2D rotational angiographic projection data (C-arm CT). However, 3D reconstruction of a dynamic object is a fundamental problem in C-arm CT reconstruction. The 2D projections are acquired over a scan time of several seconds, thus the projection data show different states of the heart. A standard FDK reconstruction algorithm would use all acquired data for a filtered backprojection and result in a motion-blurred image. In this approach, a motion compensated reconstruction algorithm requiring knowledge of the 3D heart motion is used. The motion is estimated from a previously presented 3D dynamic surface model. This dynamic surface model results in a sparse motion vector field (MVF) defined at control points. In order to perform a motion compensated reconstruction, a dense motion vector field is required. The dense MVF is generated by interpolation of the sparse MVF. Therefore, the influence of different motion interpolation methods on the reconstructed image quality is evaluated. Methods: Four different interpolation methods, thin-plate splines (TPS), Shepard's method, a smoothed weighting function, and a simple averaging, were evaluated. The reconstruction quality was measured on phantom data, a porcine model as well as on in vivo clinical data sets. As a quality index, the 2D overlap of the forward projected motion compensated reconstructed ventricle and the segmented 2D ventricle blood pool was quantitatively measured with the Dice similarity coefficient and the mean deviation between extracted ventricle contours. For the phantom data set, the normalized root mean square error (nRMSE) and the universal quality index (UQI) were also evaluated in 3D image space. Results: The quantitative evaluation of all experiments showed that TPS interpolation provided the best results. The quantitative results in the phantom experiments showed comparable nRMSE of Almost-Equal-To 0.047 {+-} 0.004 for the TPS and Shepard's method. Only slightly inferior results for the smoothed weighting function and the linear approach were achieved. The UQI resulted in a value of Almost-Equal-To 99% for all four interpolation methods. On clinical human data sets, the best results were clearly obtained with the TPS interpolation. The mean contour deviation between the TPS reconstruction and the standard FDK reconstruction improved in the three human cases by 1.52, 1.34, and 1.55 mm. The Dice coefficient showed less sensitivity with respect to variations in the ventricle boundary. Conclusions: In this work, the influence of different motion interpolation methods on left ventricle motion compensated tomographic reconstructions was investigated. The best quantitative reconstruction results of a phantom, a porcine, and human clinical data sets were achieved with the TPS approach. In general, the framework of motion estimation using a surface model and motion interpolation to a dense MVF provides the ability for tomographic reconstruction using a motion compensation technique.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2014

Fiducial marker-based correction for involuntary motion in weight-bearing C-arm CT scanning of knees. II. Experiment

Purpose: A C-arm CT system has been shown to be capable of scanning a single cadaver leg under loaded conditions by virtue of its highly flexible acquisition trajectories. In Part I of this study, using the 4D XCAT-based numerical simulation, the authors predicted that the involuntary motion in the lower body of subjects in weight-bearing positions would seriously degrade image quality and the authors suggested three motion compensation methods by which the reconstructions could be corrected to provide diagnostic image quality. Here, the authors demonstrate that a flat-panel angiography system is appropriate for scanning both legs of subjectsin vivo under weight-bearing conditions and further evaluate the three motion-correction algorithms using in vivo data. Methods: The geometry of a C-arm CT system for a horizontal scan trajectory was calibrated using the PDS-2 phantom. The authors acquired images of two healthy volunteers while lying supine on a table, standing, and squatting at several knee flexion angles. In order to identify the involuntary motion of the lower body, nine 1-mm-diameter tantalum fiducial markers were attached around the knee. The static mean marker position in 3D, a reference for motion compensation, was estimated by back-projecting detected markers in multiple projections using calibrated projection matrices and identifying the intersection points in 3D of the back-projected rays. Motion was corrected using three different methods (described in detail previously): (1) 2D projection shifting, (2) 2D deformable projection warping, and (3) 3D rigid body warping. For quantitative image quality analysis, SSIM indices for the three methods were compared using the supine data as a ground truth. Results: A 2D Euclidean distance-based metric of subjects’ motion ranged from 0.85 mm (±0.49 mm) to 3.82 mm (±2.91 mm) (corresponding to 2.76 to 12.41 pixels) resulting in severe motion artifacts in 3D reconstructions. Shifting in 2D, 2D warping, and 3D warping improved the SSIM in the central slice by 20.22%, 16.83%, and 25.77% in the data with the largest motion among the five datasets (SCAN5); improvement in off-center slices was 18.94%, 29.14%, and 36.08%, respectively. Conclusions: The authors showed that C-arm CT control can be implemented for nonstandard horizontal trajectories which enabled us to scan and successfully reconstruct both legs of volunteers in weight-bearing positions. As predicted using theoretical models, the proposed motion correction methods improved image quality by reducing motion artifacts in reconstructions; 3D warping performed better than the 2D methods, especially in off-center slices.

62 RADIOLOGY AND NUCLEAR MEDICINE↗
DOE OSTI2015

Patient-bounded extrapolation using low-dose priors for volume-of-interest imaging in C-arm CT

Purpose: Three-dimensional (3D) volume-of-interest (VOI) imaging with C-arm systems provides anatomical information in a predefined 3D target region at a considerably low x-ray dose. However, VOI imaging involves laterally truncated projections from which conventional reconstruction algorithms generally yield images with severe truncation artifacts. Heuristic based extrapolation methods, e.g., water cylinder extrapolation, typically rely on techniques that complete the truncated data by means of a continuity assumption and thus appear to be ad-hoc. It is our goal to improve the image quality of VOI imaging by exploiting existing patient-specific prior information in the workflow. Methods: A necessary initial step prior to a 3D acquisition is to isocenter the patient with respect to the target to be scanned. To this end, low-dose fluoroscopic x-ray acquisitions are usually applied from anterior–posterior (AP) and medio-lateral (ML) views. Based on this, the patient is isocentered by repositioning the table. In this work, we present a patient-bounded extrapolation method that makes use of these noncollimated fluoroscopic images to improve image quality in 3D VOI reconstruction. The algorithm first extracts the 2D patient contours from the noncollimated AP and ML fluoroscopic images. These 2D contours are then combined to estimate a volumetric model of the patient. Forward-projecting the shape of the model at the eventually acquired C-arm rotation views gives the patient boundary information in the projection domain. In this manner, we are in the position to substantially improve image quality by enforcing the extrapolated line profiles to end at the known patient boundaries, derived from the 3D shape model estimate. Results: The proposed method was evaluated on eight clinical datasets with different degrees of truncation. The proposed algorithm achieved a relative root mean square error (rRMSE) of about 1.0% with respect to the reference reconstruction on nontruncated data, even in the presence of severe truncation, compared to a rRMSE of 8.0% when applying a state-of-the-art heuristic extrapolation technique. Conclusions: The method we proposed in this paper leads to a major improvement in image quality for 3D C-arm based VOI imaging. It involves no additional radiation when using fluoroscopic images that are acquired during the patient isocentering process. The model estimation can be readily integrated into the existing interventional workflow without additional hardware.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2015

SU-C-207-02: A Method to Estimate the Average Planar Dose From a C-Arm CBCT Acquisition

Purpose: The planar average dose in a C-arm Cone Beam CT (CBCT) acquisition had been estimated in the past by averaging the four peripheral dose measurements in a CTDI phantom and then using the standard 2/3rds peripheral and 1/3 central CTDIw method (hereafter referred to as Dw). The accuracy of this assumption has not been investigated and the purpose of this work is to test the presumed relationship. Methods: Dose measurements were made in the central plane of two consecutively placed 16cm CTDI phantoms using a 0.6cc ionization chamber at each of the 4 peripheral dose bores and in the central dose bore for a C-arm CBCT protocol. The same setup was scanned with a circular cut-out of radiosensitive gafchromic film positioned between the two phantoms to capture the planar dose distribution. Calibration curves for color pixel value after scanning were generated from film strips irradiated at different known dose levels. The planar average dose for red and green pixel values was calculated by summing the dose values in the irradiated circular film cut out. Dw was calculated using the ionization chamber measurements and film dose values at the location of each of the dose bores. Results: The planar average dose using both the red and green pixel color calibration curves were within 10% agreement of the planar average dose estimated using the Dw method of film dose values at the bore locations. Additionally, an average of the planar average doses calculated using the red and green calibration curves differed from the ionization chamber Dw estimate by only 5%. Conclusion: The method of calculating the planar average dose at the central plane of a C-arm CBCT non-360 rotation by calculating Dw from peripheral and central dose bore measurements is a reasonable approach to estimating the planar average dose. Research Grant, Siemens AG.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2014

ARM Data Integrator

The Atmospheric Radiation Measurement (ARM) Data Integrator (ADI) streamlines the development of scientific algorithms and analysis of time-series NetCDF data, and improves the content and consistency of the output data products produced by these algorithms. The framework automates the process of retrieving and preparing data for analysis, and allows users to design output data products through a graphical interface. It also provides a modular, flexible software development architecture that scientists can use to generate C, Python, and IDL source code templates that embed the pre and post processing logic allowing the scientist to focus on only their science. The input data, preprocessing, and output data specifications of algorithms are defined through a graphical interface and stored in a database. ADI implements workflow for data integration and supports user access to data through a library of software modules. Data preprocess capabilities supported include automated retrieval of data from input files, merging the retrieved data into appropriately sized chunks, and transformation of the data onto a common coordinate system grid. Through the graphical interface, users can view the details of both their data products and those in the ARM catalog and allows developers to use existing data product to build new data products. Views of the output data products include an overlay of how the design meets ARM archive's data standards providing the user with a visual cue indicating where their output violates an archive standard. The ADI libraries access the information provided through the GUI via a Postgres database. The ADI framework and its supporting components can significantly decrease the time and cost of implementing scientific algorithms while improving the ability of scientists to disseminate their results.

Source record↗
DOE OSTI2016

The ARM Data System and Archive

Every observationally based research program needs a way to collect data from instruments, convert the data from its raw format into a more usable format, apply quality control, process it into higher-order data products, store the data, and make the data available to its scientific community. This data flow is illustrated pictorially in Fig. 11-1. These are the basic requirements of any scientific data system, and ARM’s data system would have to address these requirements and more. This research provides one view of the development of the ARM data system, which includes the ARM Data Archive, and some of the notable decisions that were made along the way.

97 MATHEMATICS AND COMPUTING↗