An Evaluation of Algorithms and Methods for Compressing and Decompressing Atmospheric Transmission Data for Use in At-Sensor Measurements.
Abstract not provided.
SEARCH · Engineering Papers
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Abstract not provided.
Explore the source record for details and available documents.
Explore the source record for details and available documents.
Explore the source record for details and available documents.
A recent theory of transverse centroid oscillations in solenoidally focused beam transport lattices presented in Ref. [1] is applied to statistically analyze properties of the centroid orbit in the Neutralized Drift Compression Experiment (NDCX) at the Lawrence Berkeley National Laboratory. Contributions to the amplitude of the centroid oscillations from mechanical misalignments and initial centroid errors exiting the injector are analyzed. Measured values of the centroid appear consistent with expected alignment tolerances. Correction of these errors is discussed.
As computational models scale to larger computers, the rate at which they produce data has far outstripped the same computers ability to write that data and further the file systems ability to store that data. Almost all of the SciDAC applications, but especially those related to fusion solve very large scale PDEs whose scientific output his impacted by this problem. To gain access to dynamics in an exascale simulation that are not identifiable a priori and to make that dynamical data available to machine learning requires fundamental research in the area of in situ data data analytics. Here data analytics includes compression, visualization, uncertainty quantification, and machine learning. This in situ data analytics will enable on-the-fly spatial and temporal compression of solution dynamics, expose that space-time compressed field to machine learning algorithms that have been specialized to work with dynamically evolving data (existing machine learning algorithms treat data sets as static), greatly improving the opportunity for machine learning to provide feedback to the compression, all within an ongoing simulation, without the need to write data to files. The same concepts are also being applied to uncertainty quantification and multi-fidelity modeling which have similar needs for spatial and temporal compression of the ongoing exascale simulation to perform either without the typical, unacceptable writing of data to files.
Ultrasonic interferometry was used in combination with synchrotron X-radiation to determine the compressional and shear wave velocities and unit-cell volumes of {Epsilon}-FeSi (cubic B20 structure) at room temperature and pressures up to {approx}12 GPa. The data collected during compression are compared with those collected during decompression after heating to release stress within the sample cell. By fitting all of the decompression unit-cell volume and sound velocity data to third-order finite-strain equations, we obtain the adiabatic zero-pressure bulk and shear moduli and their first pressure derivatives: K{sub S0}=169.3 (8) GPa, G{sub 0}=116.3 (4) GPa, K'S0=6.5(3), G'0=3.0(1). The bulk modulus obtained from this study is in good agreement with those of some previous experimental studies, but significantly lower than those obtained by first-principle calculations. This study presents the first direct measurement on the shear properties of this phase.
We report measurements of the compressibility of ramp compressed tantalum to a final stress of 2.3 TPa corresponding to threefold volumetric compression. Using these data, we extended the experimental constraint on the Ta cold compression curve by an order of magnitude in pressure. Furthermore, by combining the resulting data with previous measurements of shock compression and ambient pressure heating, we construct an experimentally bounded and thermodynamically consistent equation of state model for Ta which has 2% uncertainty in pressure at 1 TPa. We therefore propose Ta as an in situ pressure scale for laser-heated static compression experiments which were recently able to reach terapascal pressures and thousands of degrees Kelvin. Our new equation of state of Ta is experimentally constrained at extreme pressures and temperatures relevant to a wide range of planetary interiors and will allow for more accurate comparison between experimental measurements and theory at extreme conditions.
The Hugoniot data for zinc oxide (ZnO) single crystals were measured up to 80 GPa along both the 〈112{sup ¯}0〉 (a-axis) and 〈0001〉 (c-axis) directions using a velocity interferometer system for any reflector and inclined-mirror method combined with a powder gun and two-stage light gas gun. The Hugoniot-elastic limits of ZnO were determined to be 10.5 and 11.5 GPa along the a- and c-axes, respectively. The wurtzite (B4) to rocksalt (B1) phase transition pressures along the a- and c-axes are 12.3 and 14.4 GPa, respectively. Shock velocity (U{sub s}) versus particle velocity (U{sub p}) relation of the final phase is given by the following relationship: U{sub s} (km/s) = 2.76 + 1.51U{sub p} (km/s). Based on the Debye-Grüneisen model and Birch-Murnaghan equation of state (EOS), we discuss the EOS of the B1 phase ZnO. The bulk modulus (K{sub 0}) and its pressure derivative (K{sub 0}′) are estimated to be K{sub 0} = 174 GPa and K{sub 0}′ = 3.9, respectively.
Numerical data used to draw the figures in the manuscript
This study introduces the Weather Research and Forecasting Model with chemistry/Data Assimilation Research Testbed (WRF-Chem/DART) chemical transport forecasting/data assimilation system together with the assimilation of ''compact phase space retrievals'' of satellite-derived atmospheric composition products. WRF-Chem is a state-of-the-art chemical transport model. DART is a flexible software environment for researching ensemble data assimilation with different assimilation and forecast model options. DART's primary assimilation tool is the ensemble adjustment Kalman filter. WRF-Chem/DART is applied to the assimilation of Terra/Measurement of Pollution in the Troposphere (MOPITT) carbon monoxide (CO) trace gas retrieval profiles. Those CO observations are first assimilated as quasi-optimal retrievals (QORs). Our results show that assimilation of the CO retrievals (i) reduced WRF-Chem's CO bias in retrieval and state space, and (ii) improved the CO forecast skill by reducing the Root Mean Square Error (RMSE) and increasing the Coefficient of Determination ($R^2$). Those CO forecast improvements were significant at the 95 % level. Trace gas retrieval data sets contain (i) large amounts of data with limited information content per observation, (ii) error covariance cross-correlations, and (iii) contributions from the retrieval prior profile that should be removed before assimilation. Those characteristics present challenges to the assimilation of retrievals. This paper addresses those challenges by introducing the assimilation of compact phase space retrievals (CPSRs). CPSRs are obtained by preprocessing retrieval data sets with an algorithm that (i) compresses the retrieval data, (ii) diagonalizes the error covariance, and (iii) removes the retrieval prior profile contribution. Most modern ensemble assimilation algorithms can efficiently assimilate CPSRs. Our results show that assimilation of MOPITT CO CPSRs reduced the number of observations (and assimilation computation costs) by ~ 35 %, while providing CO forecast improvements comparable to or better than with the assimilation of MOPITT CO QORs.
We present a standalone and autonomous X-ray detector capable of operation with the speed of up to1.2Mfps. The detector utilizes UFXC32k hybrid pixel detectors for sensing X-rays, Spartan-6 LX45 FPGA placed in commercially available sbRIO 9628 controller for data acquisition and processing including a compression with zero-suppression algorithm. A Linux-RT system working on the 400 MHz Dual-Core CPU is used for FPGA control and data streaming to the higher-level system over 1 Gbps Ethernet connection. 1.2 M frames per second is achieved in so-called burst mode of operation while in zerodead-time mode 70 kfps is possible. Due to efficient data compression in FPGA there’s no need of using high-speed transceivers and Frame-Grabber cards on the data server side and the detector can stream the data infinitely over standard 1 Gbps network connection. Operation modes were tested at Advanced Photon Source Synchrotron at Argonne National Laboratory.
The structural response of a novel, insensitive energetic crystal—dihydroxylammonium 5,5'-bistetrazole-1,1'-diolate (TKX-50)—was examined under high pressure. Using synchrotron single-crystal X-ray diffraction measurements, details of molecular, intermolecular, and crystal changes were determined to ~10 GPa to understand its structural stability. The experimental results showed that TKX-50 exhibits highly anisotropic compression and significantly lower volume compressibility than currently known energetic crystals. These results are found to be in general agreement with our previous predictions from the DFT calculations. Additionally, the experimental data revealed anomalous compression—an expansion of the unit cell along the a axis (negative linear compressibility, NLC) upon compression to ~3 GPa. The structural analyses demonstrated that this unusual effect, the first such observation in an energetic crystal, is a consequence of the highly anisotropic response of 3D motifs, comprised of two parallel anions [(C 2 N 8 O 2 ) 2– ] linked with two cations [(NH 3 OH) + ] through four strong hydrogen bonds. The present results demonstrate that the structural stability of TKX-50 is controlled by the strong and highly anisotropic intermolecular interactions, and these may contribute to its shock insensitivity.
We present simulation results and experimental data for the compression of a compact toroid by a conducting nozzle without a center electrode. In both simulation and experiment, the flow of the plasma is greatly obstructed by even modest magnetic fields. A simple mechanism for this obstruction is suggested by our simulations. In particular, the configuration of the plasmoid's magnetic field plays a significant role in the success of the experiment. We analyze two types of plasma configurations under compression and demonstrate that the results from the simulations matches those from the experiments, and that the mechanism predicts the different behaviors observed in the two cases.
HPC trends favor algorithms and implementations that reduce data motion relative to FLOPS. We investigate the use of lossy compressed data arrays in place of traditional IEEE floating point arrays to store the primary data of calculations. Simulation is fundamentally an exercise in controlled approximation, and error introduced by finite-precision arithmetic (or lossy compression) is just one of several sources of error that need to be managed to ensure sufficient accuracy in a computed result. We describe ZFP, a compressed numerical format designed for in-memory storage of multidimensional arrays, and summarize theoretical results that demonstrate that the error of repeated lossy compression can be bounded and controlled. Furthermore, we establish a relationship between grid resolution and compression-induced errors and show that, contrary to conventional floating point, ZFP reduces finite-difference errors with finer grids. We present example calculations that demonstrate data reduction by 4x or more with negligible impact on solution accuracy. Our results further demonstrate several orders-of-magnitude increase in accuracy using ZFP over IEEE floating point and Posits for the same storage budget.
Abstract Modern lens designs are capable of resolving greater than 10 gigapixels, while advances in camera frame-rate and hyperspectral imaging have made data acquisition rates of Terapixel/second a real possibility. The main bottlenecks preventing such high data-rate systems are power consumption and data storage. In this work, we show that analog photonic encoders could address this challenge, enabling high-speed image compression using orders-of-magnitude lower power than digital electronics. Our approach relies on a silicon-photonics front-end to compress raw image data, foregoing energy-intensive image conditioning and reducing data storage requirements. The compression scheme uses a passive disordered photonic structure to perform kernel-type random projections of the raw image data with minimal power consumption and low latency. A back-end neural network can then reconstruct the original images with structural similarity exceeding 90%. This scheme has the potential to process data streams exceeding Terapixel/second using less than 100 fJ/pixel, providing a path to ultra-high-resolution data and image acquisition systems.
The move toward exascale computing for scientific simulations is placing new demands on compression techniques. It is expected that the I/O system will not be able to support the volume of data that is expected to be written out. To enable quantitative analysis and scientific discovery, we are interested in techniques that compress high-dimensional simulation data and can provide perfect or near-perfect reconstruction. In this paper, we explore the use of compressed sensing (CS) techniques to reduce the size of the data before they are written out. Using large-scale simulation data, we investigate how the sufficient sparsity condition and the contrast in the data affect the quality of reconstruction and the degree of compression. Also, we provide suggestions for the practical implementation of CS techniques and compare them with other sparse recovery methods. Finally, our results show that despite longer times for reconstruction, compressed sensing techniques can provide near perfect reconstruction over a range of data with varying sparsity.