Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data versions”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10
All sourcesNASA NTRSDOE OSTI
NASA NTRS2004

Processing Spacecraft Data Without Confusion

Producing multiple versions of the same data product for the same time frame with the same remotely sensed inputs can be a recipe for disaster. Yet, amidst the commotion of satellite launch and early operations (LEO), such data processing is needed. After LEO, the situation gets worse. Processing newly arriving data ("forward processing") is augmented with reprocessing and algorithm development, comparison, evaluation, and testing -- often happening all at the same time. The problem can be analyzed in three main parts -- maintaining multiple versions of algorithms and data so that end-product users are not overwhelmed,allocating computer resources efficiently, and simplifying production operations so that va st amounts of data can be processed with minimal staff and fewer errors. OMIDAPS provides a framework for execution of algorithms that transform lower level data acquired by OMI on NASA's Aura satellite into higher level science data products. In contrast to traditional science data processing systems, we address all parts of the problem with an innovative approach allowing multiple data processing to run within a single physical system. The data products, imports, exports, and execution planning are all segregated into distinct "ArchiveSets." This paper describes reasons for multiple concurrent productions on a typical satellite data processing project using OMI as an example. It describes the virtual data processing system concept and its advantages over separate physical processing strings. It explores the specific implementation of the virtual systems within OMIDAPS and discusses some of the implications of our approach and describes how virtual processing is used to accomplish the overall mission of OMI data processing.

Tilmes, Curt↗
DOE OSTI2023

Arctic shrub size and leaf traits, northern Alaska, summer 2017 (Version 2.0)

This data package contains leaf and size trait and environmental data collected from 170 plots of rapidly expanding shrub genera (Alnus, Betula, and Salix) and a widespread sedge (Eriophorum vaginatum) along a latitudinal and climate gradient in northern Alaska. The trait data were collected in summer 2017 and include leaf area, specific leaf area, leaf nitrogen concentration, leaf delta 15N, leaf delta 13C, shrub height, aboveground biomass, and the ratio of root biomass to aboveground biomass. These raw data support a submitted manuscript that examines the intraspecific variations of size, leaf and root traits of shrubs across the graminoid-dominated nutrient-poor arctic tundra and reveals the environmental drivers of deciduous shrub traits in tundra ecosystems (Fraterrigo et al., submitted). Data are presented by site (n=5) and patch (shrub or sedge plot) in separate csv files. The location data are provided in the “plot coordinates” file; all other files contain the data in the file title. Detailed methods are in the submitted manuscript. A companion data package contains root trait data collected simultaneously from the same plots (Fraterrigo and Chen, 2020). See the "Related references" section for more information.2023/07/20 Update: The latest version of this dataset publication is version 2.0. The latest version of the data package was updated to correct the leaf size trait.csv file.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1997

An Investigation of Aerosol and Ozone Measurements from the Cryogenic Limb Array Etalon Spectrometer: Validation and Relation to Other Chemical Species

Throughout this study we focused on comparisons of CLAES and in situ measurements of ozone and aerosol extinction. Thus the comparison is between satellite data representative of large spatial regions and in situ data representative of nearly point samples. Both instruments provide vertical profiles, but the region of overlap is limited to between approximately 10 and 100 mb. CLAES Version 7 ozone measurements have been compared to electrochemical cell ozonesonde measurements over McMurdo Station, Antarctica (78 deg S, 167 deg E), Dumont d'Urville, Antarctica (66.7 deg S, 140 deg E), Laramie, Wyoming (41 deg N, 106 deg W), and Bear Island, Norway (74.3 deg N, 19 deg E). Comparisons were made between vertical ozone profiles, and between integrated column ozone over the region of overlap of the measurements. Comparisons using CLAES Version 8 data are underway. CLAES Version 8 aerosol extinction measurements at all wavelengths have also been compared to University of Wyoming aerosol extinctions over McMurdo Station, Antarctica, and over Laramie, Wyoming. Coincidences in all cases were determined by minimizing the distance between the CLAES observations and the surface station, and the time separation between the satellite and in situ measurements.

Deshler, Terry↗
DOE OSTI2022

LAI, EVI, NDVI, and kNDVI in 23 pantropical forests affected by 21 cyclones

Statement of purpose: Cyclones alter the function and composition of tropical forests, making effects of intensifying cyclones on carbon-rich forests a critical topic of study. Here, we quantified cyclone-induced damage and recovery of 21 cyclone disturbances affecting 23 pantropical forest sites between 1988-2017 utilizing leaf area index (LAI), enhanced vegetation index (EVI), normalized difference vegetation index (NDVI), and transformed NDVI (kNDVI) values from Google Earth Engine. Field observations collected in a meta-analysis (Bomfim et al., 2022, in review) were used to ground-truth and test effects of soil resource availability and disturbance factors on damage and recovery. This meta-analysis also served as the basis to begin vegetation index extraction, utilizing unique site and date combinations, from tropical forests effect by cyclone disturbances. We began collecting NDVI (5km resolution) from the NOAA Climate Data Record (CDR) of AVHRR Normalized Difference Vegetation Index (NDVI), Version 5 data product (Vermote, 2019) for all case studies included, 42. Next, we began extracting Landsat data from Landsat 4, 5, and 8, courtesy of the U.S. Geological Survey, in search of higher resolution data. We selected a 3 by 3 Landsat pixel area, leading to a 90m resolution data extraction. The specific imagery used includes Landsat 4 USGS Landsat 4 TM Collection 1 Tier 1 TOA (top of atmosphere) Reflectance, Landsat 5 USGS Landsat 5 TM (thematic mapper) Collection 1 Tier 1 TOA Reflectance, and Landsat 8 USGS Landsat 8 Collection 1 Tier 1 TOA Reflectance. Within Google Earth Engine, we selected the date and location (latitude and longitude), calculated NDVI, kNDVI, and EVI utilizing Landsat bands (see metadata_NGEE-tropics_cyclones), and extracted post- and pre-cyclone values for each case study to calculate cyclone-induced change in the vegetative index. Due to limited spatial resolution of Landsat remote sensing data, MODIS products were investigated next. First, the MOD13Q1.006 Terra Vegetation Indices 16-Day Global 250m product was used to extract 250m EVI and NDVI (Didan, 2015) and then the MCD15A3H.006 MODIS Leaf Area Index/FPAR 4-Day Global 500m product product was used to extract LAI 500m (Myneni et al., 2015). Pre- and post-cyclone values, change in the vegetative index, and standard deviation for all values are included in the main csv (see case_study_data.csv) for all vegetative indices collected, including LAI 500m, EVI 250m, NDVI 250m, NDVI 90m, kNDVI 90m, EVI 90m, and NDVI 5km. Lastly, recovery values were calculated utilizing a standardization method (see metadata_NGEE-tropics_cyclones) and recovery values for MODIS (see MODIS_recovery.csv) and Landsat (Landsat_recovery.csv) data are included.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2006

NASA Tech Briefs, September 2006

Topics covered include: Improving Thermomechanical Properties of SiC/SiC Composites; Aerogel/Particle Composites for Thermoelectric Devices; Patches for Repairing Ceramics and Ceramic- Matrix Composites; Lower-Conductivity Ceramic Materials for Thermal-Barrier Coatings; An Alternative for Emergency Preemption of Traffic Lights; Vehicle Transponder for Preemption of Traffic Lights; Automated Announcements of Approaching Emergency Vehicles; Intersection Monitor for Traffic-Light-Preemption System; Full-Duplex Digital Communication on a Single Laser Beam; Stabilizing Microwave Frequency of a Photonic Oscillator; Microwave Oscillators Based on Nonlinear WGM Resonators; Pointing Reference Scheme for Free-Space Optical Communications Systems; High-Level Performance Modeling of SAR Systems; Spectral Analysis Tool 6.2 for Windows; Multi-Platform Avionics Simulator; Silicon-Based Optical Modulator with Ferroelectric Layer; Multiplexing Transducers Based on Tunnel-Diode Oscillators; Scheduling with Automated Resolution of Conflicts; Symbolic Constraint Maintenance Grid; Discerning Trends in Performance Across Multiple Events; Magnetic Field Solver; Computing for Aiming a Spaceborne Bistatic- Radar Transmitter; 4-Vinyl-1,3-Dioxolane-2-One as an Additive for Li-Ion Cells; Probabilistic Prediction of Lifetimes of Ceramic Parts; STRANAL-PMC Version 2.0; Micromechanics and Piezo Enhancements of HyperSizer; Single-Phase Rare-Earth Oxide/Aluminum Oxide Glasses; Tilt/Tip/Piston Manipulator with Base-Mounted Actuators; Measurement of Model Noise in a Hard-Wall Wind Tunnel; Loci-STREAM Version 0.9; The Synergistic Engineering Environment; Reconfigurable Software for Controlling Formation Flying; More About the Tetrahedral Unstructured Software System; Computing Flows Using Chimera and Unstructured Grids; Avoiding Obstructions in Aiming a High-Gain Antenna; Analyzing Aeroelastic Stability of a Tilt-Rotor Aircraft; Tracking Positions and Attitudes of Mars Rovers; Stochastic Evolutionary Algorithms for Planning Robot Paths; Compressible Flow Toolbox; Rapid Aeroelastic Analysis of Blade Flutter in Turbomachines; General Flow-Solver Code for Turbomachinery Applications; Code for Multiblock CFD and Heat-Transfer Computations; Rotating-Pump Design Code; Covering a Crucible with Metal Containing Channels; Repairing Fractured Bones by Use of Bioabsorbable Composites; Kalman Filter for Calibrating a Telescope Focal Plane; Electronic Absolute Cartesian Autocollimator; Fiber-Optic Gratings for Lidar Measurements of Water Vapor; Simulating Responses of Gravitational-Wave Instrumentation; SOFTC: A Software Correlator for VLBI; Progress in Computational Simulation of Earthquakes; Database of Properties of Meteors; Computing Spacecraft Solar-Cell Damage by Charged Particles; Thermal Model of a Current-Carrying Wire in a Vacuum; Program for Analyzing Flows in a Complex Network; Program Predicts Performance of Optical Parametric Oscillators; Processing TES Level-1B Data; Automated Camera Calibration; Tracking the Martian CO2 Polar Ice Caps in Infrared Images; Processing TES Level-2 Data; SmaggIce Version 1.8; Solving the Swath Segment Selection Problem; The Spatial Standard Observer; Less-Complex Method of Classifying MPSK; Improvement in Recursive Hierarchical Segmentation of Data; Using Heaps in Recursive Hierarchical Segmentation of Data; Tool for Statistical Analysis and Display of Landing Sites; Automated Assignment of Proposals to Reviewers; Array-Pattern-Match Compiler for Opportunistic Data Analysis; Pre-Processor for Compression of Multispectral Image Data; Compressing Image Data While Limiting the Effects of Data Losses; Flight Operations Analysis Tool; Improvement in Visual Target Tracking for a Mobile Robot; Software for Simulating Air Traffic; Automated Vectorization of Decision-Based Algorithms; Grayscale Optical Correlator Workbench; "One-Stop Shopping" for Ocean Remote-Sensing and Model Data; State Analysis Database Tool; Generating CAHV and CAHVOmages with Shadows in ROAMS; Improving UDP/IP Transmission Without Increasing Congestion; FORTRAN Versions of Reformulated HFGMC Codes; Program for Editing Spacecraft Command Sequences; Flight-Tested Prototype of BEAM Software; Mission Scenario Development Workbench; Marsviewer; Tool for Analysis and Reduction of Scientific Data; ASPEN Version 3.0; Secure Display of Space-Exploration Images; Digital Front End for Wide-Band VLBI Science Receiver; Multifunctional Tanks for Spacecraft; Lightweight, Segmented, Mostly Silicon Telescope Mirror; Assistant for Analyzing Tropical-Rain-Mapping Radar Data; and Anion-Intercalating Cathodes for High-Energy- Density Cells.

Source record↗
NASA NTRS2019

A Compilation of Global Bio-Optical in Situ Data for Ocean-Colour Satellite Applications – Version Two

A global compilation of in situ data is useful to evaluate the quality of ocean-colour satellite data records. Here we describe the data compiled for the validation of the ocean-colour products from the ESA Ocean Colour Climate Change Initiative (OC-CCI). The data were acquired from several sources (including, inter alia, MOBY, BOUSSOLE, AERONETOC, SeaBASS, NOMAD, MERMAID, AMT, ICES, HOT, GeP&CO) and span the period from 1997 to 2018. Observations of the following variables were compiled: spectral remote-sensing reflectances, concentrations of chlorophyll-a, spectral inherent optical properties, spectral diffuse attenuation coefficients and total suspended matter. The data were from multi-project archives acquired via open internet services or from individual projects, acquired directly from data providers. Methodologies were implemented for homogenisation, quality control and merging of all data. No changes were made to the original data, other than averaging of observations that were close in time and space, elimination of some points after quality control and conversion to a standard format. The final result is a merged table designed for validation of satellite-derived ocean-colour products and available in text format. Metadata of each in situ measurement (original source, cruise or experiment, principal investigator) were propagated throughout the work and made available in the final table. By making the metadata available, provenance is better documented, and it is also possible to analyse each set of data separately. This paper also describes the changes that were made to the compilation in relation to the previous version (Valente et al., 2016). The compiled data are available at https://doi.org/10.1594/PANGAEA.898188.

Andre Valente↗
DOE OSTI2025

Remote sensing images, DEM, and point clouds associated with “Accuracy evaluation of cost-effective 3D reconstruction approaches for hydrobiogeochemical processes in non-perennial stream riverbeds”

This data package is associated with the publication “Accuracy evaluation of cost-effective 3D reconstruction approaches for hydrobiogeochemical processes in non-perennial stream riverbeds” published in Frontiers in Environmental Science, Environmental Informatics and Remote Sensing (Bao et al., 2026; doi: 10.3389/fenvs.2026.1725258). This data package includes the drone photos for a section of Umtanum Creek in Washington, Unted States. The photos were used to reconstruct the 3-dimensional (3D) digital elevation model (DEM) of the riverbed for the investigated stream section. The reconstruction results from four approaches are provided: (1) unoccupied aerial vehicle (UAV, colloquially known as drone) imagery-based Structure-from-Motion (SfM), (2) a machine learning-based 3D reconstruction model, Visual Geometry Grounded Deep Structure from Motion (VGGSfM), (3) Visual Geometry Grounded Transformer for long sequence of images (VGGT-Long), and (4) handheld smartphone LiDAR scanning. The ground truth measurements by tripod-mounted optical level kit and ground control points GPS locations for evaluating the accuracy of the four reconstruction approaches are also provided in this data package. A preliminary version of this data package was published in October 2025 at the time of manuscript submission. It was updated in March 2026, at the time of manuscript acceptance, to include additional metadata (this readme, data dictionary, and file level metadata). The data did not change. For details on how to navigate data packages generated by this project, see https://data.ess-dive.lbl.gov/portals/PNNLRiverCorridorSFA/About. In addition to a readme, this data package also includes a file-level metadata (FLMD) file that describes each file and a data dictionary (DD) that describes all column/row headers and variable definitions. This dataset is comprised of (1) 8 folders; (2) the detailed flight configuration html files; (3) field metadata; (4) a readme; (5) a data dictionary; and (6) file-level metadata. The folders “2024_10_18_d01” and “2024_10_18_d02” contain the original drone photos for the two drone flights (d01 and d02) on October 18, 2024. The reconstruction results from each of the approaches are in the folders called “ODM_SfM”, “VGGSfM”, “VGGTLong”, and “LiDAR”. The ground truth measurements are in the folder called “optical_level_kit”. Lastly, results comparing the different approaches are in the folder called “comparisons”. All files are .csv, .html, .jpg, .obj, .txt, and .npy. For information on using the .obj and .npy files, see the readme files within the same folder as the files.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

WFIP3 - BARG site - NREL Profiling Lidar (Windcube v2.1) / Derived Data

This dataset contains derived data from the profiling lidar (Windcube v2.1) deployed at WFIP3's BARG. The derived data files herein are based on the lidar's STA files (i.e., the 10-min average data files). Note: this version of the data has been corrected to account for the motion of the barge.

17 WIND ENERGY↗
DOE OSTI2025

Super-Resolution for Renewable Energy Resource Data with Wind from Reanalysis Data and Application to Ukraine

With a potentially increasing share of the electricity grid relying on wind to provide generating capacity and energy, there is an expanding global need for historically accurate, spatiotemporally continuous, high-resolution wind data. Conventional downscaling methods for generating these data based on numerical weather prediction have a high computational burden and require extensive tuning for historical accuracy. In this work, we present a novel deep learning-based spatiotemporal downscaling method using generative adversarial networks (GANs) for generating historically accurate high-resolution wind resource data from the European Centre for Medium-Range Weather Forecasting Reanalysis version 5 data (ERA5). In contrast to previous approaches, which used coarsened high-resolution data as low-resolution training data, we use true low-resolution simulation outputs. We show that by training a GAN model with ERA5 as the low-resolution input and Wind Integration National Dataset Toolkit (WTK) data as the high-resolution target, we achieved results comparable in historical accuracy and spatiotemporal variability to conventional dynamical downscaling. This GAN-based downscaling method additionally reduces computational costs over dynamical downscaling by two orders of magnitude. We applied this approach to downscale 30 km, hourly ERA5 data to 2 km, 5 min wind data for January 2000 through December 2023 at multiple hub heights over Ukraine, Moldova, and part of Romania. With WTK coverage limited to North America from 2007–2013, this is a significant spatiotemporal generalization. The geographic extent centered on Ukraine was motivated by stakeholders and energy-planning needs to rebuild the Ukrainian power grid in a decentralized manner. This 24-year data record is the first member of the super-resolution for renewable energy resource data with wind from the reanalysis data dataset (Sup3rWind).

17 WIND ENERGY↗
DOE OSTI2025

SITCOMTN-149: An Interim Report on the LSSTComCam On-Sky Campaign

From 24 October to 11 December 2024, the NSF-DOE Vera C. Rubin Observatory conducted an on-sky campaign using the engineering LSST Commissioning Camera (LSSTComCam) to test the end-to-end functionality of hardware and software, as well as operational procedures. This interim report provides a preliminary technical overview of our understanding of the integrated system performance based tests and analyses conducted during the LSSTComCam on-sky campaign. The objectives are to synthesize what we have learned about the system in a timely way to inform on-going commissioning efforts, and to inform the Rubin science community on the progress of the LSSTComCam on-sky campaign. The report is organized into sections to describe major activities during the campaign, as well as multiple aspects of the demonstrated system and science performance. All of the results presented here are to be understood as work in progress using engineering data and the initial versions of the data processing pipelines; the report is a living document that will be updated as analyses are refined.

79 ASTRONOMY AND ASTROPHYSICS↗
NASA NTRS2019

Numerical Reanalyses as a Gateway to Arctic Synthesis

Reanalyses are regularly gridded, retrospective depictions of the physical earth system, which are produced through the correction of a short-term forecast to available observations. In the Arctic, reanalyses are particularly well suited to marshal the sparse observing network to provide a plausible, multivariate representation of conditions. Atmospheric reanalyses such as MERRA-2 (NASA Modern-Era Retrospective analysis for Research and Applications, version 2) and ocean reanalyses such as SODA3 (Univ. Maryland Simple Ocean Data Assimilation version 3) are widely used in Arctic research for diagnostic studies of circulation, model evaluation, and as boundary conditions for a variety of process models. Here, we provide examples that illustrate the utility of reanalyses for providing information on the spatial and temporal scales of recent, rapid changes in the Arctic. Recent trends in Arctic surface temperatures, surface melt over Greenland and Arctic glaciers, and evolving freshwater conditions in the Arctic Ocean are examples where reanalyses can provide information that cannot easily be obtained via other means. These examples provide information on the scale, magnitude, and the uncertainty of recent Arctic change and provide a context for future scenarios. We further quantify uncertainties in key reanalyses variables and approaches for addressing these issues.

Arctic↗
NASA NTRS1991

Digital solar system geology

All available synoptic maps of the solid-surface bodies of the Solar System were digitized for presentation in the planned Atlas of the Solar System by Greeley and Batson. Since the last report (Batson et al., 1990), preliminary Uranian satellite maps were replaced with improved versions, Galilean satellite geology was simplified and digitized, structure was added to many maps, and the maps were converted to a standard format, with corresponding standing colors for the mapped units. Following these changes, the maps were re-reviewed by their authors and are now undergoing final editing before preparation for publication. In some cases (for Mercury, Venus, and Mars), more detailed maps were digitized and then simplified for the Atlas. Other detailed maps are planned to be digitized in the coming year for the Moon and the Galilean satellites. For most of the remaining bodies such as the Uranian satellites, the current digitized versions contain virtually all the detail that can be mapped given the available data; those versions will be unchanged for the Atlas. These digital geologic maps are archived at the digital scale of 1/16 degree/ pixel, in sinusoidal format. The availability of geology of the Solar System in a digital database will facilitate comparisons and integration with other data: digitized lunar geologic maps have already been used in a comparison with Galileo SSI observations of the Moon.

Batson, R. M.↗
NASA NTRS2001

A Comparison of HALOE V19 with SAGE II V6.00 Ozone Observations using Trajectory Mapping

We apply trajectory mapping to an eight-year intercomparison of ozone observations from HALOE (V19) and SAGE II (V6.00) for the months March, May, June, September, October, and December from the period December 1991 - October 1999. Our results, which represent the most extensive such intercomparison of these two data sets to date, suggest a root-mean -square difference between the two data sets of greater than 15% below 22 km and of 4 - 12% throughout most of the rest of the stratosphere. In addition, we find a bias with HALOE ozone low relative to SAGE II by 5 - 20% below 22 km between 40degS and 40degN. Biases throughout most of the rest of the stratosphere are nearly nonexistent. Finally, our analysis suggests almost no drift in the bias between the data sets is observed over the period of study. In the course of our study, we also determine that the employment of the Wang-Cunnold criteria is still recommended with the V6.00 SAGE II ozone data. Results with the new versions of the data sets show significant improvement over previous versions, particularly in the elimination of mid-stratospheric biases and the elimination of the previously observed drifts in the biases between the data sets in the lower stratosphere. Since HALOE V19 and V18 ozone are very similar, these changes can likely be attributed to improvements in the SAGE II retrieval.

Morris, Gary A.↗
NASA NTRS2014

Past Changes in the Vertical Distribution of Ozone Part 1: Measurement Techniques, Uncertainties and Availability

Peak stratospheric chlorofluorocarbon (CFC) and other ozone depleting substance (ODS) concentrations were reached in the mid- to late 1990s. Detection and attribution of the expected recovery of the stratospheric ozone layer in an atmosphere with reduced ODSs as well as efforts to understand the evolution of stratospheric ozone in the presence of increasing greenhouse gases are key current research topics. These require a critical examination of the ozone changes with an accurate knowledge of the spatial (geographical and vertical) and temporal ozone response. For such an examination, it is vital that the quality of the measurements used be as high as possible and measurement uncertainties well quantified. In preparation for the 2014 United Nations Environment Programme (UNEP)/World Meteorological Organization (WMO) Scientific Assessment of Ozone Depletion, the SPARC/IO3C/IGACO-O3/NDACC (SI2N) Initiative was designed to study and document changes in the global ozone profile distribution. This requires assessing long-term ozone profile data sets in regards to measurement stability and uncertainty characteristics. The ultimate goal is to establish suitability for estimating long-term ozone trends to contribute to ozone recovery studies. Some of the data sets have been improved as part of this initiative with updated versions now available. This summary presents an overview of stratospheric ozone profile measurement data sets (ground and satellite based) available for ozone recovery studies. Here we document measurement techniques, spatial and temporal coverage, vertical resolution, native units and measurement uncertainties. In addition, the latest data versions are briefly described (including data version updates as well as detailing multiple retrievals when available for a given satellite instrument). Archive location information for each data set is also given.

stratospheric ozone layer measurement↗
DOE OSTI2020

Progress in modelling fast-ion D-alpha spectra and neutral particle analyzer fluxes using FIDASIM

FIDASIM is a code that models signals produced by charge-exchange reactions between neutrals and ions (both fast and thermal) in magnetically confined plasmas. With the ion distribution function as input, the code predicts the efflux to a neutral particle analyzer diagnostic and the photon radiance of Balmer-alpha light to a fast-ion D α diagnostic, in addition to many other related quantities. A new, parallelized version of the Monte Carlo code FIDASIM has been developed in Fortran90 that is substantially faster than the original interactive data language version. Modified algorithms include more accurate treatments of the time dependent collisional-radiative equations that describe neutral energy levels, of the cloud of ‘halo’ neutrals that surround the injected neutral beam, and of finite Larmor radius effects. Enhanced physics capabilities include modelling ‘passive’ signals from cold edge neutrals, the ability to treat general three-dimensional magnetic confinement configurations, and calculations of diagnostic-specific weight functions that enable tomographic reconstructions of the fast-ion distribution function. Neutral beam attenuation, beam emission, and fast-ion birth profiles are also modelled. Finally, the new algorithms have been successfully validated against experimental data and new features have been tested through benchmarks between two independently developed versions of the code.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
NASA NTRS1994

Comparison of recalculated Dobson and TOMS total ozone at Hradec Kralove, Czechoslovakia, 1978-1990

The reevaluated Dobson total ozone data from Hradec Kralove, Czechoslovakia were compared with independent Total Ozone Mapping Spectrophotometer (TOMS) 'version 6' data set. The comparison was performed by means of the parallel daily averages of ground-based and satellite total ozone pairs of the period November 1978 to December 1990. The comparison showed slight differences between both data series. Their average relative difference is 0.48 percent. The similar results have been reached for subsets of direct sun and zenith types of measurements as well. Their relative differences are 0.61 percent and 0.11 percent respectively. These facts indicate not only good mutual relation of both data sources but also reliability and accuracy of the zenith charts of the spectrophotometer No. 74 used at Hradec Kralove. Preliminary assessment of seasonal MU-dependence of the differences between Dobson and TOMS data was made while using total ozones of winter and summer months representing values of MU=2.70-5.20 and MU = 1.12-1.30 respectively. The results did not show systematic underestimation or overestimation of total ozone due to MU-dependence of the instrument at Hradec Kralove in both seasons.

Stanek, Martin↗
NASA NTRS2019

Forming Aggregations using Virtual Sharding: Lessons Learned from Simple Scalable Storage (S3)

Data aggregation is the ability to combine separate datasets to form a single new logical dataset provides users with a powerful abstraction. The advantage of an aggregate dataset is that the users are freed from having to understand, and incorporate into their workflow, knowledge about the (ad hoc) organization of the constituent datasets. However, aggregating large numbers of files can be computationally complex with data server systems performing many repetitive operations. As part of the authors work on subsetting data stored on Amazon Web Service (AWS) Simple Storage Service (S3), we developed technology to read portions of otherwise monolithic data files. This enables the formation of virtual shards for user in subsetting data stored in HDF5 (hierarchical data format, version 5) files. This same tool can be used to form aggregations that combine data stored in many HDF5 files when those files are stored on S3. The nature of the virtual sharding and the algorithm that exploits it for subsetting is such that it can also be used for aggregation with the need for many of the repetitive operations required by the per file aggregation techniques. We will present timing information that demonstrates the flexibility of this approach. However, the lessons learned is that while this is a useful result in and of itself, these very same techniques can be applied in other contexts where data are stored in services and on media other than S3. For example, this same technique can be applied to data stored on spinning disk. Pushing the envelope for S3 forced a reexamination of our data access techniques which lead to unexpected positive benefits.

Gallagher, James↗