Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Raw Data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 865 records · Page 48

Charge Transfer Calculations and Database for Astrophysics

A variety of theoretical approaches, having different but overlapping energy ranges of applicability, are applied to investigate charge transfer processes for collisions of atomic ions with atoms and molecules. The methods include quantal molecular-orbital close-coupling, classical trajectory Monte Carlo, and continuum distorted wave methods. Recent collision systems studied include S(+4) + H, S(+4) + He, N(+7) + He, H2O, CO, and CO2, O(+q)(q = 1 - 8) + H, H2, and S(+q)(q = 1 - 16) + H2. The database effort is concentrating on astrophysically important reactions of atomic ions X(+q)(X=H-Zn, q=1-4, and selected higher charges) with H, He, various metal atoms, H2, and other selected molecular targets. Existing data, much of it produced by us, has been compiled and critically evaluated. Data for many reactions missing in the literature are estimated using the multichannel Landau-Zener approximation. Fits to cross sections and rate coefficients using standard functions are provided as well as tabulations of the raw data. The database is available on the World Wide Web at cfadc.phy.ornl.gov/astro/ps/data.

Wang, J. G.↗

POST Explorer: A Design Space Exploration Tool for POST2

Recent improvements for the Program to Optimize Simulated Trajectories II (POST2) have included the development of an application programming interface (API). This API allows POST2 simulation inputs to be directly manipulated from other applications (such as MATLAB or Python), and the outputs from POST2 are streamed directly to the external application that enables visualization, data manipulation, etc. Through this framework, a new tool called POST Explorer is being developed that provides a user the capability to modify the simulation inputs and interrogate the outputs within the same application, with raw data inspection and visualization embedded. This tool can be leveraged for multiple types of analyses, such as parametric sweeps and sensitivity studies, and will be available with a future release of the POST2 software.

Robert Anthony Williams↗

POST Explorer: A Design Space Exploration Tool for POST2

Recent improvements for the Program to Optimize Simulated Trajectories II (POST2) have included the development of an application programming interface (API). This API allows POST2 simulation inputs to be directly manipulated from other applications (such as MATLAB or Python), and the outputs from POST2 are streamed directly to the external application that enables visualization, data manipulation, etc. Through this framework, a new tool called POST Explorer is being developed that provides a user the capability to modify the simulation inputs and interrogate the outputs within the same application, with raw data inspection and visualization embedded. This tool can be leveraged for multiple types of analyses, such as parametric sweeps and sensitivity studies, and will be available with a future release of the POST2 software.

Anthony Williams↗

Arctic shrub size and leaf traits, northern Alaska, summer 2017 (Version 2.0)

This data package contains leaf and size trait and environmental data collected from 170 plots of rapidly expanding shrub genera (Alnus, Betula, and Salix) and a widespread sedge (Eriophorum vaginatum) along a latitudinal and climate gradient in northern Alaska. The trait data were collected in summer 2017 and include leaf area, specific leaf area, leaf nitrogen concentration, leaf delta 15N, leaf delta 13C, shrub height, aboveground biomass, and the ratio of root biomass to aboveground biomass. These raw data support a submitted manuscript that examines the intraspecific variations of size, leaf and root traits of shrubs across the graminoid-dominated nutrient-poor arctic tundra and reveals the environmental drivers of deciduous shrub traits in tundra ecosystems (Fraterrigo et al., submitted). Data are presented by site (n=5) and patch (shrub or sedge plot) in separate csv files. The location data are provided in the “plot coordinates” file; all other files contain the data in the file title. Detailed methods are in the submitted manuscript. A companion data package contains root trait data collected simultaneously from the same plots (Fraterrigo and Chen, 2020). See the "Related references" section for more information.2023/07/20 Update: The latest version of this dataset publication is version 2.0. The latest version of the data package was updated to correct the leaf size trait.csv file.

54 ENVIRONMENTAL SCIENCES↗

COBE Differential Microwave Radiometers - Preliminary systematic error analysis

The techniques available for the identification and subtraction of sources of dynamic uncertainty from data of the Differential Microwave Radiometer (DMR) instrument aboard COBE are discussed. Preliminary limits on the magnitude in the DMR 1 yr maps are presented. Residual uncertainties in the best DMR sky maps, after correcting the raw data for systematic effects, are less than 6 micro-K for the pixel rms variation, less than 3 micro-K for the rms quadruple amplitude of a spherical harmonic expansion, and less than 30 micro-(K-squared) for the correlation function.

Kogut, A.↗

Differentially Private Map Matching (DPMM) v1.0

Human mobility trajectories provide valuable information for developing mobility applications, as they contain diverse and rich information about the users. User mobility data is valuable for various applications such as intelligent transportation systems (ITS), commercial business models, and disease-spread models. However, such spatio-temporal traces may pose a threat to user privacy. GPS trajectories in their raw form are not suitable for transportation studies, as they require matching locations with nearest road links — a process called map-matching. This software implements a differential privacy (DP)-based map-matching algorithm, called DPMM, that generates link-level location trajectories in a privacy-preserving manner to protect users' origin destinations (OD) and travel paths. OD privacy is achieved by injecting Planar Laplace noise to the user OD GPS points. Travel-path privacy is provided with randomized travel path construction using exponential DP mechanism. The injected noise level is selected adaptively, by considering the link density of the location and the functional category of the localized links. For path privacy, our mechanism samples waypoints and selects candidate paths between waypoints. DPMM provides privacy effectively with respect to link density instead of other trajectory samples in the database compared to other privacy mechanisms. Compared to the different baseline models our DP-based privacy model offers closer query responses to the raw data in terms of individual and aggregate trajectory-level statistics with an average at absolute deviation from the baseline for individual statistics on ϵ = 1.0. Beyond individual trajectory statistics, the DPMM outperforms the other benchmark DP-based mechanisms on different aggregate statistics with up to 8x improvement in utility.

Peisert, Sean [Lawrence Berkeley National Laborato↗

Launch commit criteria performance trending analysis, phase 1, revision A. SRM and QA mission services

An assessment of quantitative methods and measures for measuring launch commit criteria (LCC) performance measurement trends is made. A statistical performance trending analysis pilot study was processed and compared to STS-26 mission data. This study used four selected shuttle measurement types (solid rocket booster, external tank, space shuttle main engine, and range safety switch safe and arm device) from the five missions prior to mission 51-L. After obtaining raw data coordinates, each set of measurements was processed to obtain statistical confidence bounds and mean data profiles for each of the selected measurement types. STS-26 measurements were compared to the statistical data base profiles to verify the statistical capability of assessing occurrences of data trend anomalies and abnormal time-varying operational conditions associated with data amplitude and phase shifts.

Source record↗

The CCD/Transit Instrument (CTI) data-analysis system

The automated software system for archiving, analyzing, and interrogating data from the CCD/Transit Instrument (CTI) is described. The CTI collects up to 450 Mbytes of image-data each clear night in the form of a narrow strip of sky observed in two colors. The large data-volumes and the scientific aims of the project make it imperative that the data are analyzed within the 24-hour period following the observations. To this end a fully automatic and self evaluating software system has been developed. The data are collected from the telescope in real-time and then transported to Tucson for analysis. Verification is performed by visual inspection of random subsets of the data and obvious cosmic rays are detected and removed before permanent archival is made to the optical disc. The analysis phase is performed by a pair of linked algorithms, one operating on the absolute pixel-values and the other on the spatial derivative of the data. In this way both isolated and merged images are reliably detected in a single pass. In order to isolate the latter algorithm from the effects of noise spikes a 3x3 Hanning filter is applied to the raw data before the analysis is run. The algorithms reduce the input pixel-data to a database of measured parameters for each image which has been found. A contrast filter is applied in order to assign a detection-probability to each image and then x-y calibration and intensity calibration are performed using known reference stars in the strip. These are added to as necessary by secondary standards boot-strapped from the CTI data itself. The final stages involve merging the new data into the CTI Master-list and History-list and the automatic comparison of each new detection with a set of pre-defined templates in parameter-space to find interesting objects such as supernovae, quasars and variable stars. Each stage of the processing from verification to interesting image selection is performed under a data-logging system which both controls the pipe-lining of data through the system and records key performance monitor parameters which are built into the software. Furthermore, the data from each stage are stored in databases to facilitate evaluation, and all stages offer the facility to enter keyword-indexed free-format text into the data-logging system. In this way a large measure of certification is built into the system to provide the necessary confidence in the end results.

Cawson, M. G. M.↗

Multipoint sensing by intelligent collectives

Many remote sensing applications require that multiple sensors collect data simultaneously at spatially distributed locations and their information combined in order to characterize the phenomena of interest. Several basic classes of such multipoint measurement systems may be identified. For each, centralized methods exist for combining the raw data from the various sensors. However, recent advancements have given rise to small, integrated nodes comprised of one or more miniaturized sensors, processor, wireless communications capability and power supplies. Collections of these may be deployed and self-organized into intelligent sensor networks capable of performing cooperative signal processing locally, thereby providing substantial benefits.

multipoint measurement sensor networks↗

First Observations from the SPICE EUV Spectrometer on Solar Orbiter

Aims. We present first science observations taken during the commissioning activities of the Spectral Imaging of the Coronal Environment (SPICE) instrument on the ESA/NASA Solar Orbiter mission. SPICE is a high-resolution imaging spectrometer operating at extreme ultraviolet (EUV) wavelengths. In this paper we illustrate the possible types of observations to give prospective users a better understanding of the science capabilities of SPICE. Methods. We have reviewed the data obtained by SPICE between April and June 2020 and selected representative results obtained with different slits and a range of exposure times between 5 s and 180 s. Standard instrumental corrections have been applied to the raw data. Results. The paper discusses the first observations of the Sun on different targets and presents an example of the full spectra from the quiet Sun, identifying over 40 spectral lines from neutral hydrogen and ions of carbon, oxygen, nitrogen, neon, sulphur, magnesium, and iron. These lines cover the temperature range between 20,000 K and 1 million K (10MK in flares), providing slices of the Sun’s atmosphere in narrow temperature intervals. We provide a list of count rates for the 23 brightest spectral lines. We show examples of raster images of the quiet Sun in several strong transition region lines, where we have found unusually bright, compact structures in the quiet Sun network, with extreme intensities up to 25 times greater than the average intensity across the image. The lifetimes of these structures can exceed 2.5 hours. We identify them as a transition region signature of coronal bright points and compare their areas and intensity enhancements. We also show the first above-limb measurements with SPICE above the polar limb in C III,O VI, and Ne VIII lines, and far off limb measurements in the equatorial plane in Mg IX, Ne VIII, and O VI lines. We discuss the potential to use abundance diagnostics methods to study the variability of the elemental composition that can be compared with in situ measurements to help confirm the magnetic connection between the spacecraft location and the Sun’s surface, and locate the sources of the solar wind. Conclusions. The SPICE instrument successfully performs measurements of EUV spectra and raster images that will make vital contributions to the scientific success of the Solar Orbiter mission

Sun: UV radiation↗

QA/QC-ed Groundwater Level Time Series in PLM-1 and PLM-6 Monitoring Wells, East River, Colorado (2016-2022)

This data set contains QA/QC-ed (Quality Assurance and Quality Control) water level data for the PLM1 and PLM6 wells. PLM1 and PLM6 are location identifiers used by the Watershed Function SFA project for two groundwater monitoring wells along an elevation gradient located along the lower montane life zone of a hillslope near the Pumphouse location at the East River Watershed, Colorado, USA. These wells are used to monitor subsurface water and carbon inventories and fluxes, and to determine the seasonally dependent flow of groundwater under the PLM hillslope. The downslope flow of groundwater in combination with data on groundwater chemistry (see related references) can be used to estimate rates of solute export from the hillslope to the floodplain and river. QA/QC analysis of measured groundwater levels in monitoring wells PLM-1 and PLM-6 included identification and flagging of duplicated values of timestamps, gap filling of missing timestamps and water levels, removal of abnormal/bad and outliers of measured water levels. The QA/QC analysis also tested the application of different QA/QC methods and the development of regular (5-minute, 1-hour, and 1-day) time series datasets, which can serve as a benchmark for testing other QA/QC techniques, and will be applicable for ecohydrological modeling. The package includes a Readme file, one R code file used to perform QA/QC, a series of 8 data csv files (six QA/QC-ed regular time series datasets of varying intervals (5-min, 1-hr, 1-day) and two files with QA/QC flagging of original data), and three files for the reporting format adoption of this dataset (InstallationMethods, file level metadata (flmd), and data dictionary (dd) files).QA/QC-ed data herein were derived from the original/raw data publication available at Williams et al., 2020 (DOI: 10.15485/1818367). For more information about running R code file (10.15485_1866836_QAQC_PLM1_PLM6.R) to reproduce QA/QC output files, see README (QAQC_PLM_readme.docx). This dataset replaces the previously published raw data time series, and is the final groundwater data product for the PLM wells in the East River. Complete metadata information on the PLM1 and PLM6 wells are available in a related dataset on ESS-DIVE: Varadharajan C, et al (2022). https://doi.org/10.15485/1660962. These data products are part of the Watershed Function Scientific Focus Area collection effort to further scientific understanding of biogeochemical dynamics from genome to watershed scales. 2022/09/09 Update: Converted data files using ESS-DIVE’s Hydrological Monitoring Reporting Format. With the adoption of this reporting format, the addition of three new files (v1_20220909_flmd.csv, V1_20220909_dd.csv, and InstallationMethods.csv) were added. The file-level metadata file (v1_20220909_flmd.csv) contains information specific to the files contained within the dataset. The data dictionary file (v1_20220909_dd.csv) contains definitions of column headers and other terms across the dataset. The installation methods file (InstallationMethods.csv) contains a description of methods associated with installation and deployment at PLM1 and PLM6 wells. Additionally, eight data files were re-formatted to follow the reporting format guidance (er_plm1_waterlevel_2016-2020.csv, er_plm1_waterlevel_1-hour_2016-2020.csv, er_plm1_waterlevel_daily_2016-2020.csv, QA_PLM1_Flagging.csv, er_plm6_waterlevel_2016-2020.csv, er_plm6_waterlevel_1-hour_2016-2020.csv, er_plm6_waterlevel_daily_2016-2020.csv, QA_PLM6_Flagging.csv). The major changes to the data files include the addition of header_rows above the data containing metadata about the particular well, units, and sensor description. 2023/01/18 Update: Dataset updated to include additional QA/QC-ed water level data up until 2022-10-12 for ER-PLM1 and 2022-10-13 for ER-PLM6. Reporting format specific files (v2_20230118_flmd.csv, v2_20230118_dd.csv, v2_20230118_InstallationMethods.csv) were updated to reflect the additional data. R code file (QAQC_PLM1_PLM6.R) was added to replace the previously uploaded HTML files to enable execution of the associated code. R code file (QAQC_PLM1_PLM6.R) and ReadMe file (QAQC_PLM_readme.docx) were revised to clarify where original data was retrieved from and to remove local file paths.

54 ENVIRONMENTAL SCIENCES↗

Analysis of radiation and meteoroid satellite data

The data obtained in earth orbit by the Radiation and Meteoroid Satellite (RMS) were interpreted and reduced to a form which will be usable by future space experimenters. The required tasks are detailed. Computer programs were written which lifted the raw data and associated emphemeris data from the GFE magnetic tapes. The engineering data was then used to evaluate the performance of the spacecraft and the experiments. The radiation data was used to prepare flux, spectral, and dose maps of the South Atlantic magnetic anomaly where possible. The meteoroid data was used to determine a rough estimate of the meteoroid flux and in general evaluate the performance of the thin-film meteoroid sensors. The degree of success of the RMS mission was evaluated in light of the separation anomaly which occurred between RMS and OFO during launch.

Farmer, B. J.↗

Solar irradiance variations. II - Analysis of the extreme ultraviolet measurements onboard the Atmosphere Explorer E satellite

Five of the extreme ultraviolet channels (L-alpha, L-beta, He I, He II, Fe XV) measuring irradiance fluctuations on board the AE-E satellite between 1977 and 1980 have been studied in detail. It is shown that the daily variations correspond very closely to the daily variations in solar radio emission (F10.7), but that the UV data are afflicted with serious and to date unrecognized calibration changes during the period of operation of the instruments. In order to correct for these changes, a statistical analysis is carried out, and a set of corrections to the raw data is suggested. The resulting, now uniform, data are then compared with rocket measurements (L-alpha) and data acquired onboard the AE-C satellite (L-beta). Finally the remaining discrepancies are discussed. After concluding that they are below the overall level of uncertainties, a first-order 10-year run of EUV irradiances derived from F10.7 data is proposed. This estimate includes the ratio of irradiance levels between the maxima of solar cycles 20 and 21 and the intervening minimum.

Oster, L.↗

Analyzing time delays in a flight simulation environment

Transport delay in a multirate flight simulation environment is examined. An equivalent systems model is developed that quantifies the contributions of individual components and their sampled-data interactions. Mathematical algorithms used in the discrete implementation are also considered, because they are important elements of a flight simulation system. The equivalent systems model was used to demonstrate the consistency and accuracy of data obtained in the flight simulation facility at Ames Research Center. It showed that effective time delays in simulation models, including delays in scene presentation to the pilot, are considerably less than might be assumed by casual examination of raw data obtained from component-level experiments.

Mcfarland, R. E.↗

Pandora Operation and Analysis Software

Pandora Operation and Analysis Software controls the Pandora Sun- and sky-pointing optical head and built-in filter wheels (neutral density, UV bandpass, polarization filters, and opaque). The software also controls the attached spectrometer exposure time and thermoelectric cooler to maintain the spectrometer temperature to within 1 C. All functions are available through a GUI so as to be easily accessible by the user. The data are automatically stored on a miniature computer (netbook) for automatic download to a designated server at user defined intervals (once per day, once per week, etc.), or to a USB external device. An additional software component reduces the raw data (spectrometer counts) to preliminary scientific products for quick-view purposes. The Pandora systems are built from off-the-shelf commercial parts and from mechanical parts machined using electronic machine shop drawings. The Pandora spectrometer system is designed to look at the Sun (tracking to within 0.1 ), or to look at the sky at any zenith or azimuth angle, to gather information about the amount of trace gases or aerosols that are present.

Herman, Jay↗

Blockchain based Communication Architectures with Applications to Private Security Networks

Existing communication protocols in high consequence security networks are highly centralized. While this naively makes the controls easier to physically secure, external actors require fewer resources to disrupt the system because there are fewer points in the system can be destroyed or interrupted without the entire system failing. We present a solution to this problem using a proof-of-work-based blockchain implementation built on MultiChain. We construct a test-bed network containing two types of data input: visual imagers and microwave sensor information. These data types are ubiquitous in perimeter intrusion detection security systems and allow a realistic representation of a real-world network architecture. The cameras in this system use an object detection algorithm to nd important targets in the scene. The raw data from the camera and the outputs from the detection algorithm are then placed in a transaction on the distributed ledger. Similarly, microwave data is used to detect relevant events and are placed in a transaction. These transactions are then bundled into blocks and broadcast to the rest of the network using the Bitcoin-based MultiChain protocol. We develop five tests to examine the security metrics of our network. We performed the five security metric test using different sized networks from 7 to 39 nodes to determine how the metrics scale with respect to size. We nd that when compared to a centralized architecture our implementation provides a resiliency increase that is expected from a blockchain-based protocol without slowing the system so much that a human operator would notice. Furthermore, our approach is able to detect tampering in real time. Based on these results, we theorize that security networks in general could use a blockchain-based approach in a meaningful way.

97 MATHEMATICS AND COMPUTING↗

AI-Ready Data Pilot Project Report

The proliferation of artificial intelligence in scientific research has created an urgent need to define "AI-ready data" for researchers and, more importantly, provide resources to help them produce AI-ready data. At Pacific Northwest National Laboratory, we conducted a pilot study with three data scientists evaluating three CSV datasets from different scientific domains, followed by semi-structured interviews capturing assessment practices. Our findings reveal that AI-readiness evaluation is intuition-based, with practitioners asking "How fast can I go from raw data to my machine learning pipeline?" Data scientists consistently prioritized workflow efficiency, human interpretability, and quality stewardship signals. From these insights, we developed a practical evaluation framework comprising data requirements, metadata standards, and validation tests that provides actionable criteria for producing and curating AI-ready datasets, addressing the gap between theoretical understanding and practical implementation.

97 MATHEMATICS AND COMPUTING↗

Using PCDS to study the influence of UV flux variation on the middle atmosphere

The value of the Pilot Climate Data System (PCDS) in examining the influences of short-period solar flux variations on the middle atmosphere was demonstrated. Several Nimbus satellite data sets proposed for the study exist in the PCDS. Planned for retrieval through the PCDS are ozone mixing ratios and cumulative ozone profiles available from the Backscatter Ultraviolet Spectrophotometer on Nimbus-4. Also to be accessed are Nimbus-7 data sets that will provide ozone and nitrogen dioxide mixing ratios, temperature profiles from the Limb Infrared Monitor of the Stratosphere, and ozone mixing ratio profiles from the Solar Backscatter Ultraviolet Spectrophotometer. Bypassing the time-consuming process of reading raw data tapes, the researchers plan to transfer the PCDS processed data to an IBM PC at Iowa State University. The IBM PC will serve as an intermediate vehicle for transferring the data to the NOAA CYBER 840 at Boulder, Colorado, where research will continue on both an eight-layer radiative-photochemical numerical model and on a nonlinear dynamical model. in this research are the FGGE and ERB data sets. These relevant data sets also reside in the PCDS. Problems associated with remote access to the PCDS were discussed in regard to all the PCDS data sets.

Heilman, W.↗