Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data conversion”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10

Magnetic Field Experiment Data Analysis System

The Johns Hopkins University Applied Physics Laboratory (JHU/APL) Magnetic Field Experiment Data Analysis System (MFEDAS) has been developed to process and analyze satellite magnetic field experiment data from the TRIAD, MAGSAT, AMPTE/CCE, Viking, Polar BEAR, DMSP, HILAT, UARS, and Freja satellites. The MFEDAS provides extensive data management and analysis capabilities. The system is based on standard data structures and a standard user interface. The MFEDAS has two major elements: (1) a set of satellite unique telemetry processing programs for uniform and rapid conversion of the raw data to a standard format and (2) the program Magplot which has file handling, data analysis, and data display sections. This system is an example of software reuse, allowing new data sets and software extensions to be added in a cost effective and timely manner. Future additions to the system will include the addition of standard format file import routines, modification of the display routines to use a commercial graphics package based on X-Window protocols, and a generic utility for telemetry data access and conversion.

Holland, D. B.↗

An Integrated Architecture for Onboard Spacecraft

As increasingly complex scientific and environmental observation spacecraft are deployed, the burden on the downlink assets, and ground-based systems complexity and cost is becoming a major problem. Already, the limitations of communications bandwidth and processing throughput limit the science data gathering, both in volume and in rate. This poses a dilemma to the scientist experimenter forcing choices between data collection and bandwidth/processing/archiving. Advances in ground based processing and space-to-Earth links have fallen behind the requirements for observation data, at increasing rates, over the last few decades. As NASA achieves its 40th anniversary, the ability to observe and capture phenomena of theoretical and practical interest to life on Earth far outstrips the ability to transfer, process, or store these data. NASA recognizes the need to invest on technological advancements that will enable both the space and ground systems to address the limitations. Spacecraft onboard computing power is a clear one. The capability of creating data products onboard the spacecraft adds a new level of flexibility to address the more demanding observation needs. Current spacecraft computing power is limited and incapable of addressing the needs of the new generation of observation satellites because extensive onboard data processing is required. Traditional spacecraft architectures only collect, package, and transmit to Earth the data acquired by multiple instruments. Conversely, the experience on developing ground data systems shows the need for high performance computing systems to process and create information from the instrumentation data. The expectation is that supercomputing technology is required to enable spacecraft to create information onboard. Moving supercomputing capability onboard spacecraft requires an approach that considers an integrated data architecture. Otherwise, it may simply convert a compute-bound problem into a communications bound problem, as has been shown numerous times in the context of massively parallel architectures. What is left to determine are the technologies that will enable spacecraft high performance computing.

Figueiredo, Marco A.↗

Data vs. information: A system paradigm

The data system designer requires data parameters, and is dependent on the user to convert information needs to these data parameters. This conversion will be done with more or less accuracy, beginning a chain of inaccuracies which propagate through the system, and which, in the end, may prevent the user from converting the data received into the information required. The concept to be pursued is that errors occur in various parts of the system, and, having occurred, propagate to the end. Modeling of the system may allow an estimation of the effects at any point and the final accumulated effect, and may prove a method of allocating an error budget among the system components. The selection of the various technical parameters which a data system must meet must be done in relation to the ability of the user to turn the cold, impersonal data into a live, personal decision or piece of information.

Billingsley, F. C.↗

A digital algorithm for characteristic film curves

The task of establishing a film calibration scheme for magnitude studies of Skylab photographic images of Comet Kohoutek is examined. Since the data are recorded in terms of film density and have to be used in terms of exposure, the conversion from density to exposure is critical. In this film calibration scheme, the hardware deals with the data sources, recording medium, and data conversion to a computer compatible program, whereas the software deals with signal to noise enhancement, stepwedge calibration curve and leads to modeling of the film characteristic curves. A mathematical model of the characteristic curve is obtained using a modified version of Efroymson's (1960) stepwise multiple linear regression algorithm, which gives log exposure as a function of density. The difference in the calibration curves from pre- and postflight exposures is well accounted for in the model as a result of sensitive statistical tests. The characteristic curve modeling program requires about 4K of core and is executed in about 3 min.

Buckner, J.↗

Satellite Level 3 & 4 Data Subsetting at NASA GES DISC

Earth Science data are available in many file formats (NetCDF, HDF, GRB, etc.) and in a wide range of sizes, from kilobytes to gigabytes. These properties have become a challenge to users if they are not familiar with these formats or only want a small region of interest (ROI) from a specific dataset. At NASA Goddard Earth Sciences Data and Information Services Center (GES DISC), we have developed and implemented a multipurpose subset service to ease user access to Earth Science data. Our Level 3 & 4 Regridder is capable of subsetting across multiple parameters (spatially, temporally, by level, and by variable) as well as having additional beneficial features (temporal means, regridding to target grids, and file conversion to other data formats). In this presentation, we will demonstrate how users can use this service to better access only the data they need in the form they require.

subsetting↗

Data acquisition and analysis on a Macintosh

The introduction of inexpensive analog-to-digital boards for the Macintosh opens the way for its use in areas that have previously been filled by either specialized, dedicated or more expensive mainframe based systems. Two such Macintosh-based systems are the Acoustic Laboratory Data Acquisition System (ALDAS) and the Jet Calibration and Hover Test Facility (JCAHT) data acquisition system. ALDAS provides an inexpensive, transportable means to digitize four channels at up to 50,000 samples per second and analyze this data. The ALDAS software package was written for use with rotorcraft acoustics and performs automatic acoustic calibration of channels, data display, and various types of data analysis. The program can use data obtained either from internal analog-to-digital conversion or discrete external data imported in ASCII format. All aspects of ALDAS can be improved as new hardware becomes available and new features are introduced into the code. The JCAHT data acquisition system was built as not only an analysis program but also to act as the online safety monitoring system. This paper will provide an overview of these systems.

Watts, Michael E.↗

A Compilation of Global Bio-Optical in Situ Data for Ocean Colour Satellite Applications – Version Three

A global in situ data set for validation of ocean colour products from the ESA Ocean Colour Climate Change Initiative (OC-CCI) is presented. This version of the compilation, starting in 1997, now extends to 2021, which is important for the validation of the most recent satellite optical sensors such as Sentinel 3B OLCI and NOAA-20 VIIRS. The data set comprises in situ observations of the following variables: spectral remote-sensing reflectance, concentration of chlorophyll-a, spectral inherent optical properties, spectral diffuse attenuation coefficient, and total suspended matter. Data were obtained from multi-project archives acquired via open internet services or from individual projects acquired directly from data providers. Methodologies were implemented for homogenization, quality control, and merging of all data. Minimal changes were made on the original data, other than conversion to a standard format, elimination of some points, after quality control and averaging of observations that were close in time and space. The result is a merged table available in text format. Overall, the size of the data set grew with 148 432 rows, with each row representing a unique station in space and time (cf. 136 250 rows in previous version; Valente et al., 2019). Observations of remote-sensing reflectance increased to 68 641 (cf. 59 781 in previous version; Valente et al., 2019). There was also a near tenfold increase in chlorophyll data since 2016. Metadata of each in situ measurement (original source, cruise or experiment, principal investigator) are included in the final table. By making the metadata available, provenance is better documented and it is also possible to analyse each set of data separately.

ocean color↗

An Update on GPM and TRMM Data Services at NASA GES DISC

The Goddard Earth Sciences (GES) Data and Information Services Center (DISC) is home to data archives of the NASA-JAXA Global Precipitation Measurement (GPM), the Tropical Rainfall Measuring Mission (TRMM), and other NASA missions and projects. To maximize the use of NASA data products in scientific research and applications as well as for societal benefits, we provide data and information services that make datasets easy to find and use through simplification of data access for users at all levels around the world. Over the years, user-friendly data services have been developed at GES DISC, including data subsetting, format conversion, online visualization and analysis (i.e. Giovanni), user support system, etc. We routinely analyze questions, feedback, and use cases from users and algorithm developers around the world as well as best practices and new technology to improve existing services and formulate new data services. Interaction between users and algorithm developers is an important process for identifying issues in products, collecting user requirements, and improving product quality and usability. Staff members regularly communicate with algorithm developers with user questions and concerns through conferences and workshops. We publish peer-reviewed papers and articles in major Earth science journals and book chapters to describe NASA global and regional precipitation datasets and services with examples. News articles about GPM and TRMM datasets associated with significant events are regularly posted in the GES DISC Web portal and social media. We also actively participate in training activities. In this presentation, we present our latest activities about GPM and TRMM data services, data/service metrics, and future plans at GES DISC.

Liu, Z.↗

Thermal structure of the atmosphere of Venus from Pioneer Venus radio occultations

The processing and analysis results from 87 radio occultation experiments performed with the Pioneer Venus Orbiter are detailed. Atmospheric structure data were obtained with S-band (2293 MHz) and X-band (8407 MHz) signals transmitted through the 40 and 85 km levels of the Venus atmosphere. Latitudes of -68 to 88 deg at solar zenith angles of 8-166 deg were explored. The conversion of the data into acceptable form for the barometric equation to use the perfect gas law to obtain the temperature profiles is described. The temperature structures were more dependent on latitude than solar illumination conditions, with the greatest changes occurring in the circumpolar region. The polar tropopause altitude was about 4.8 km above its value at lower altitudes, with a temperature drop of 60 K and a pressure drop of 240 mb.

Kliore, A. J.↗

Global Land Data Assimilation System (GLDAS) Products, Services and Application from NASA Hydrology Data and Information Services Center (HDISC)

The Global Land Data Assimilation System (GLDAS) is generating a series of land surface state (e.g., soil moisture and surface temperature) and flux (e.g., evaporation and sensible heat flux) products simulated by four land surface models (CLM, Mosaic, Noah and VIC). These products are now accessible at the Hydrology Data and Information Services Center (HDISC), a component of the NASA Goddard Earth Sciences Data and Information Services Center (GES DISC). Current data holdings include a set of 1.0 degree resolution data products from the four models, covering 1979 to the present; and a 0.25 degree data product from the Noah model, covering 2000 to the present. The products are in Gridded Binary (GRIB) format and can be accessed through a number of interfaces. Users can search the products through keywords and perform on-the-fly spatial and parameter subsetting and format conversion of selected data. More advanced visualization, access and analysis capabilities will be available in the future. The long term GLDAS data are used to develop climatology of water cycle components and to explore the teleconnections of droughts and pluvial.

Fang, Hongliang↗

Onboard Experiment Data Support Facility (OEDSF): Conceptual design study

The Onboard Experimental Data Support Facility (OEDSF) is an inflight data processor based on a totally new architecture specifically developed to cost-effectively process the data of Shuttle payloads sensors. Processing data onboard fills the following needs: (1) reduction of data bulk by conversion to information (2)quick-look for evaluation, interactive operation, etc. (3) real-time computation of engineering representation of sensed phenomena. For example: Value of backscatter coefficient (sigma) of a scatterometer as a function of latitude and longitude (4) exploitation of the real-time availability of ancillary data, thereby obviating the need for time-tagging, recording, and recorrelation and (5) providing data or information immediately usable by the experimenter or user. The OEDSF is made up of modular and cascadable matrix processors. Each matrix has been sized to process the data of a full typical shuttle payload. Cost analyses indicate that significant savings are realized by processing data with the OEDSF compared with conventional ground facilities.

Source record↗

Pre- and Post-Production Processes Increasingly Dominate Greenhouse Gas Emissions From Agri-Food Systems

We present results from the FAOSTAT emissions shares database, covering emissions from agri-food systems and their shares to total anthropogenic emissions for 196 countries and 40 territories for the period 1990–2019. We find that in 2019, global agri-food system emissions were 16.5 (95 %; CI range: 11–22) billion metric tonnes (GtCO2 eq. yr(exp -1)), corresponding to 31%(range: 19 %–43 %) of total anthropogenic emissions. Of the agri-food system total, global emissions within the farm gate – from crop and livestock production processes including on-farm energy use – were 7.2 GtCO2 eq. yr(exp -1); emissions from land use change, due to deforestation and peatland degradation, were 3.5 GtCO2 eq. yr(exp -1); and emissions from pre- and post-production processes – manufacturing of fertilizers, food processing, packaging, transport, retail, household consumption and food waste disposal – were 5.8 GtCO2 eq. yr(exp -1). Over the study period 1990–2019, agri-food system emissions increased in total by 17 %, largely driven by a doubling of emissions from pre- and post-production processes. Conversely, the FAOSTAT data show that since 1990 land use emissions decreased by 25 %, while emissions within the farm gate increased 9 %. In 2019, in terms of individual greenhouse gases (GHGs), pre- and postproduction processes emitted the most CO2 (3.9 GtCO2 yr(exp -1)), preceding land use change (3.3 GtCO2 yr(exp -1)) and farm gate (1.2 GtCO2 yr(exp -1)) emissions. Conversely, farm gate activities were by far the major emitter of methane (140 MtCH4 yr(exp -1)) and of nitrous oxide (7.8 MtN2Oyr(exp -1)). Pre- and post-production processes were also significant emitters of methane (49 MtCH4 yr(exp -1)), mostly generated from the decay of solid food waste in landfills and open dumps. One key trend over the 30-year period since 1990 highlighted by our analysis is the increasingly important role of food-related emissions generated outside of agricultural land, in pre- and post-production processes along the agri-food system, at global, regional and national scales. In fact, our data show that by 2019, pre- and post-production processes had overtaken farm gate processes to become the largest GHG component of agri-food system emissions in Annex I parties (2.2 GtCO2 eq. yr(exp -1)). They also more than doubled in non-Annex I parties (to 3.5 GtCO2 eq. yr(exp -1)), becoming larger than emissions from land use change. By 2019 food supply chains had become the largest agri-food system component in China (1100 MtCO2 eq. yr(exp -1)), the USA (700 MtCO2 eq. yr(exp -1)) and the EU-27 (600 MtCO2 eq. yr(exp -1)). This has important repercussions for food-relevant national mitigation strategies, considering that until recently these have focused mainly on reductions of non-CO2 gases within the farm gate and on CO2 mitigation from land use change. The information used in this work is available as open data with DOI https://doi.org/10.5281/zenodo.5615082 (Tubiello et al., 2021d). It is also available to users via the FAOSTAT database (https://www.fao.org/faostat/en/#data/EM; FAO, 2021a), with annual updates.

FAOSTAT agri-food systems emissions database↗

Benefits of using Electronic Data Sheets (EDS) with coreFlight Systems (cFS) - A Project Example

Recently there has been interest in the incorporation of core Flight Systems (cFS) with Spacecraft Onboard Interface Services (SOIS) Electronic Data Sheets (EDS) in the spaceflight software community. The Regenerative Fuel Cell project at the Glenn Research Center is using cFS architecture with EDS support for its monitoring and control software. The presentation will outline the benefits to using cFS with EDS support: First, EDS establishes a single source of truth for the definitions of data structures used throughout an entire mission that may otherwise be programmed in different languages and designed with different processor architectures. Not only does this help with inter-application communication via the software bus, but it also greatly simplifies communication between systems. An EDS Application Programming Interface (API) library allows the conversion of EDS data structures to and from native data structures. Second, bindings for other programming languages (e.g. Lua, Python, JSON) have been written to allow the creation and manipulation of EDS data objects within those languages. The RFC project uses Lua scripts to automatically generate binary configuration files at build time to be loaded into our cFS programs. We also use Python bindings in a graphical user interface (GUI) to allow an operator to send commands and view telemetry messages sent from cFS instances. Finally, using Lua scripts we can set up specific simulation scenarios to perform automatic functional testing. During the development of the RFC software, the software team put together a generic python GUI called “cFS-EDS-GroundStation” that provides a basic interface to an instance of cFS with EDS support. The GUI includes a basic telecommand and telemetry system that reads directly from the generated EDS databases. In the telecommand system, dropdown menus are populated with all user commands that are defined in EDS. In the telemetry system, telemetry messages are automatically decoded, written to the screen, and saved to a binary file. Additional Python scripts have been written to convert the binary data files into a comma separated value (CSV) format for further processing. We will demonstrate the basic use of the cFS-EDS-GroundStation software including adding additional commands and telemetry payload values in EDS and see them appear automatically in the cFS-EDS-Groundstation software. About the RFC project: The Regenerative Fuel Cell project is tasked with developing and demonstrating a power system consisting of a fuel cell and electrolyzer to provide power during a lunar day/night cycle. During the night, the fuel cell takes Hydrogen and Oxygen gasses and converts them into electricity, water, and heat. During the day, the electrolyzer takes input power (e.g. from a photovoltaic array) and converts water back into Hydrogen and Oxygen gasses.

Mathew Mccaskey↗

An operations manual for the digital data system

The Digital Data System (DDS) was designed to incorporate the analog-to-digital conversion process into the initial data acquisition stage and to store the data in a digital format. This conversion is done as part of the acquisition process. Consequently, the data are ready to be analyzed as soon as the test is completed. This capability permits the researcher to alter test parameters during the course of the experiment based on the information acquired in a prior portion of the test. The DDS is currently able to simultaneously acquire up to 10 channels of data. The purpose of this document is fourfold: (1) to describe the capabilities of the hardware in sufficient detail to allow the reader to determine whether the DDS is the optimum system for a particular experiment; (2) to present some of the more significant software developed to provide analyses within a short time of the completion of data acquisition; (3) to provide the reader with sample runs of major software routines to demonstrate their convenience and simple usage; and (4) a portion of the document is used to describe software which uses an FFT-box to provide a means of comparison against which the DDS can be checked.

Jones, Michael G.↗

SAGE ground truth plan: Correlative measurements for the Stratospheric Aerosol and Gas Experiment (SAGE) on the AEM-B satellite

The ground truth plan is outlined for correlative measurements to validate the Stratospheric Aerosol and Gas Experiment (SAGE) sensor data. SAGE will fly aboard the Applications Explorer Mission-B satellite scheduled for launch in early 1979 and measure stratospheric vertical profiles of aerosol, ozone, nitrogen dioxide, and molecular extinction between 79 N and 79 S. latitude. The plan gives details of the location and times for the simultaneous satellite/correlative measurements for the nominal launch time, the rationale and choice of the correlative sensors, their characteristics and expected accuracies, and the conversion of their data to extinction profiles. In addition, an overview of the SAGE expected instrument performance and data inversion results are presented. Various atmospheric models representative of stratospheric aerosols and ozone are used in the SAGE and correlative sensor analyses.

Russell, P. B.↗

GammaCore: The Compton Observatory research environment

The Compton Observatory Science Support Center (COSSC) is developing a coherent analysis environment for the analysis of Compton and other gamma-ray astronomy data. This environment, GammaCore, allows the astronomer to access the data analysis systems developed at the Principal Investigator (PI) sites for the four Compton Observatory instruments. In addition users have access to standard astronomical tools such as IRAF, IDL, and XANADU. The user interface of GammaCore is the AGCL (AnswerGarden Command Language), developed at the AXAF Science Center. The parameter interface supported by the AGCL allows GammaCore to access all PI software systems in a uniform fashion. These systems are quite different, having been developed independently on heterogeneous systems without much concern for general portability. The data kibitzer concept, where a window running in a specific PI environment is controlled by the AGCL, has been used extensively. Users can choose to view what is going on in the native environment, to use the window to control PI software directly, or to ignore the PI systems entirely and to work only through the homogeneous AGCL interface. Software developed at the COSSC is also integrated within GammaCore. Extensive facilities for conversions of PI data formats to and from FITS have been developed. Access to the Compton data archive and catalogs will also be completely integrated with the GammaCore. Users can retrieve any publicly available Compton data. This paper examines the issues that have arisen in attempting to meld these widely diverse systems. The advantages and limitations of the parameter interface and the kibitzer are discussed along with issues of data portability, documentation, and the feasibility of multi-instrument analysis. Limited capabilities are now available within GammaCore with significant enhancements planned over the coming year. An implementation including all PI systems will be available within that time. Instructions on how to access GammaCore and how to get more information are given.

Mcglynn, T. A.↗

CFD Extraction Tool for TecPlot From DPLR Solutions

This invention is a TecPlot macro of a computer program in the TecPlot programming language that processes data from DPLR solutions in TecPlot format. DPLR (Data-Parallel Line Relaxation) is a NASA computational fluid dynamics (CFD) code, and TecPlot is a commercial CFD post-processing tool. The Tec- Plot data is in SI units (same as DPLR output). The invention converts the SI units into British units. The macro modifies the TecPlot data with unit conversions, and adds some extra calculations. After unit conversions, the macro cuts a slice, and adds vectors on the current plot for output format. The macro can also process surface solutions. Existing solutions use manual conversion and superposition. The conversion is complicated because it must be applied to a range of inter-related scalars and vectors to describe a 2D or 3D flow field. It processes the CFD solution to create superposition/comparison of scalars and vectors. The existing manual solution is cumbersome, open to errors, slow, and cannot be inserted into an automated process. This invention is quick and easy to use, and can be inserted into an automated data-processing algorithm.

Norman, David↗

Mapping Bone Mineral Density Obtained by Quantitative Computed Tomography to Bone Volume Fraction

Methods for relating or mapping estimates of volumetric Bone Mineral Density (vBMD) obtained by Quantitative Computed Tomography to Bone Volume Fraction (BVF) are outlined mathematically. The methods are based on definitions of bone properties, cited experimental studies and regression relations derived from them for trabecular bone in the proximal femur. Using an experimental range of values in the intertrochanteric region obtained from male and female human subjects, age 18 to 49, the BVF values calculated from four different methods were compared to the experimental average and numerical range. The BVF values computed from the conversion method used data from two sources. One source provided pre bed rest vBMD values in the intertrochanteric region from 24 bed rest subject who participated in a 70 day study. Another source contained preflight vBMD values from 18 astronauts who spent 4 to 6 months on the ISS. To aid the use of a mapping from BMD to BVF, the discussion includes how to formulate them for purpose of computational modeling. An application of the conversions would be used to aid in modeling of time varying changes in vBMD as it relates to changes in BVF via bone remodeling and/or modeling.

Pennline, James A.↗