Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Raw Data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 793 records · Page 44
All sourcesNASA NTRSDOE OSTI
NASA NTRS2018

Changes in Exercise Data Management

The suite of exercise hardware aboard the International Space Station (ISS) generates an immense amount of data. The data collected from the treadmill, cycle ergometer, and resistance strength training hardware are basic exercise parameters (time, heart rate, speed, load, etc.). The raw data are post processed in the laboratory and more detailed parameters are calculated from each exercise data file. Updates have recently been made to how this valuable data are stored, adding an additional level of data security, increasing data accessibility, and resulting in overall increased efficiency of medical report delivery. Questions regarding exercise performance or how exercise may influence other variables of crew health frequently arise within the crew health care community. Inquiries over the health of the exercise hardware often need quick analysis and response to ensure the exercise system is operable on a continuous basis. Consolidating all of the exercise system data in a single repository enables a quick response to both the medical and engineering communities. A SQL server database is currently in use, and provides a secure location for all of the exercise data starting at ISS Expedition 1 - current day. The database has been structured to update derived metrics automatically, making analysis and reporting available within minutes of dropping the inflight data it into the database. Commercial tools were evaluated to help aggregate and visualize data from the SQL database. The Tableau software provides manageable interface, which has improved the laboratory's output time of crew reports by 67%. Expansion of the SQL database to be inclusive of additional medical requirement metrics, addition of 'app-like' tools for mobile visualization, and collaborative use (e.g. operational support teams, research groups, and International Partners) of the data system is currently being explored.

Buxton, R. E.↗
NASA NTRSDate not supplied

Generation of Merged Radar-Lidar Data Products during the IMPACTS 2020 Field Campaign

A novel, composite lidar and radar data products was created using lidar and radar data products generated from the NASA ER-2 aircraft during the NASA IMPACTS 2020 field campaign. This product is intended to supplement the raw data sources, tease out additional aspects of the mechanisms underpinning wintertime cyclones, and enhance our understanding of microphysical properties in sensor overlap regions. Initial combined products focused on generating normalized fields of ER-2 based radar and lidar data to provide a more comprehensive visualization of storm structure (precipitation bands, cloud tops, melting levels, etc.) Ongoing work has focused on developing a combined radar-lidar reflectivity product and deriving hydrometeor particle properties (type, orientation, etc.) using ER-2-based depolarization data. To validate these hydrometeor properties, we leverage coincident overpasses of the high-altitude ER-2 aircraft with the suite of cloud particle probes on the in-situ P-3 aircraft during coincident flight overpasses. This work aims to provide vital information to help IMPACTS achieve its mission goal of improving microphysical properties retrievals from airborne and spaceborne platforms for these high-impact winter storm events.

Stephen D Nicholls↗
NASA NTRSDate not supplied

Quantifying radiation quality for space relevant radiation types: Fitting excess risk models to three combined HZE-irradiated mouse datasets

Radiation health risks are predominantly derived from low linear energy transfer (LET) terrestrial exposures; however, space radiation includes exposure to high-LET and high-charge, high-energy (HZE) particles. Accurately quantifying the differences in radiation quality between the space and terrestrial radiation environments is important for assessing and predicting health risks for astronauts. Weil et al. 2009 and 2014 used two different inbred mouse strains to study differences in hepatocellular carcinoma (HCC) tumorigenesis after exposures to low- and high- LET radiation. More recently, Edmundson et al. 2020 provided valuable new tumor data in outbred mice that were exposed to low- and high-LET radiation. The present study aims to rigorously investigate a relative biological effectiveness (RBE) factor by leveraging the HCC tumor data from Weil et al. 2009, Weil et al. 2014, and Edmundson et al. 2020. The three experiments were similarly designed, allowing the raw data to be combined into a pooled dataset to estimate excess relative risk (ERR) and excess absolute risk (EAR) models using Bayesian Poisson regression. These effect estimates from the pooled data provide greater power to calculate a data driven RBE. Extensive sensitivity analyses test the robustness of RBE estimates to various model assumptions. The following questions will be explored through the sensitivity analyses: • Is the shape of the dose response different for low-LET radiation and HZE radiation, indicating that RBE is a function of dose? • Does attained age modify the effect estimates differently for low-LET radiation and HZE radiation, indicating RBE is a function of attained age? • Are the effect estimates and RBE estimates different for inbred mouse strains and outbred mouse strains? • Do assumptions about differences in ERR models and EAR models change the estimated RBE? Additional studies would be needed to validate the findings from these exploratory analyses.

Lori J. Chappell↗
DOE OSTI2023

TopFusion: Using Topological Feature Space for Fusion and Imputation in Multi-Modal Data

We present a novel multi-modal data fusion technique using topological features. The method, TopFusion, leverages the flexibility of topological data analysis tools (namely persistent homology and persistence images) to map multi-modal datasets into a common feature space by forming a new multi-channel persistence image. Each channel in the image is representative of a view of the data from a modality-dependent filtration. We demonstrate that the topological perspective we take allows for more effective data reconstruction, i.e. imputation. In particular, by performing imputation in topological feature space we are able to outperform the same imputation techniques applied to raw data or alternatively derived features. We show that TopFusion representations can be used as input to downstream deep learning-based computer vision models and doing so achieves comparable performance to other fusion methods for classification on two multi-modal datasets.

Myers, Audun D.↗
DOE OSTI2022

EMSL-Computing/PeakDecoder

PeakDecoder is a machine learning (ML)-based metabolite identification algorithm for multidimensional mass spectrometry measurements incorporating liquid chromatography (LC) and ion mobility spectrometry (IM) separations, and collecting extensive fragmentation spectra with data-independent acquisition (DIA) methods: LC-IM-DIA-MS. The algorithm learns to distinguish true co-elution and co-mobility from raw data and calculates metabolite identification error rates.

Bilbao Pena, Aivett↗
DOE OSTI2025

Data for "Which plant traits increase soil carbon sequestration? Empirical evidence from a long-term poplar genetic diversity trial"

This archive contains all data and code used by the following publication: Field, J. L., Sloan, B. P., Craig, M. E., Calloway, P., Ottinger, S. L., Mead, T., Abramoff, R. Z., Venegas, M. P., Chhetri, H. B., Haiby, K., Kalluri, U. C., Muchero, W., Schadt, C. W., & Mayes, M. A. (2025). Which plant traits increase soil carbon sequestration? Empirical evidence from a long-term poplar genetic diversity trial (p. 2025.02.17.638464). bioRxiv. https://doi.org/10.1101/2025.02.17.638464 Our analysis combined several soil and root data sets collected by Oak Ridge National Laboratory (ORNL) researchers/collaborators from the Clatskanie Poplar Common Garden in Clatskanie, OR by from 2009-2024. The raw data data files are located */02-data/01-raw/* which we harmonized using the codes in */01-codes/01-harmonize-clatskanie-data-pub.qmd*. The final processed data set used in the paper is found at */02-data/02-processed/clatskanie-c-fit-data.csv* and its columns are described in the table below.

Sloan, Brandon [ORNL] (ORCID:0000000316304271)↗
NASA NTRS1985

Atmospheric phenomena data processing and display

Several related efforts which deal with the analysis and display of data pertaining to various atmospheric phenomena are reported. Spectrometer data analysis, with refinements to the preexisting programs, is discussed. A discussion of a Monte Carlo simulation of a photon transfer problem is presented. Raw data gathered in the field by a high-flying U2 aircraft is usually pulse code modulated (PCM). Techniques to reduce the data into a computer-amenable format are described. Several utility programs and other work are outlined.

Tatom, F. B.↗
DOE OSTI2021

Data-driven building energy modeling with feature selection and active learning for data predictive control

Three gaps impede the development of cost-effective and accurate data-driven building energy modeling/models (DBEM) for energy forecasting and predictive control strategies. Gap 1: data bias is common in building operation data, but this topic is hardly studied in DBEM; Gap 2: high data dimensionality is common in DBEM, but a systematic and scalable methodology is lacking to solve the problem; Gap 3: the interactions between data bias and high dimensionality have not been systematically studied for DBEM and predictive control in buildings. In this work, to address the three gaps mentioned above, we develop a framework that integrates active learning and feature selection for DBEM used for whole building data predictive control (or DPC, which is a branch of model predictive control). The framework provides a systematic methodology and automatic workflow that starts with raw data from building automation systems to the establishment of data-driven energy models for DPC controllers. The developed strategies and framework are evaluated in a virtual testbed based on EnergyPlus and BCVTB. Improved performance and reduced computational complexity are observed from the DBEM built with the developed framework, as well as the DPC controller based on that DBEM, indicating the effectiveness of the developed framework.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2026

Solovay-Kitaev Algorithm and Randomized Compilation Data Availability

This zipped folder contains simulation notebooks, simulated data, and experimental data from the QSCOUT trapped-ion device that were used in the publication "Solovay-Kitaev Algorithm and Randomized Compilation" (https://doi.org/10.1103/ll6m-dbl7). The raw data is in the form of measurement outcomes of simple tomographic quantum circuits that were executed on the QSCOUT device and simulated using JAQALPAQ. These data are used to create plots within the jupyter notebooks that were included in the publication.

Quantum benchmarking↗
NASA NTRS1990

An Alternative Derivation of the Nimbus 7 Total Solar Irradiance Variations

Nimbus 7 solar irradiance values have been made available to the scientific community through the open literature (e.g., Hickey et al., 1988) and through NASA data centers. A comparison of these measurements to the Solar Maximum Mission/Active Cavity Radiometer Irradiance Monitor (SSM/ACRIM) time series indicated differences which might be caused in part by the method of converting the Nimbus 7 raw data counts to solar irradiance values. In an effort to see if the derivation of the solar irradiance could be improved, the raw counts were extracted from the tapes and analyzed to see how a new algorithm could be constructed. The basic form of the calibration remains the same as in the previous solar irradiance derivations. However, the input values to the equation differ from what was used before. In particular, improved values of the Earth-sun distance are incorporated and new temperature sensitivities were derived. Several problems with the instrument were uncovered which previously had not been noticed. The sun did not appear to cross the center of field of the radiometer but was systematically off by 1.5 to 2.5 degrees. The analog to digital convertor changed its properties in July 1980. The gain of the electronics apparently increased by 0.03 percent in September 1987. Applying these and other changes in the processing, the day to day variations appear much more like the SMM observations. In fact, the Nimbus 7 observations are sufficiently stable that a problem with the SSM observations in the spin mode period of 1981 to 1984 can be detected when the two time series are compared.

Hoyt, Douglas V.↗
DOE OSTI2021

An Open Combinatorial Diffraction Dataset Including Consensus Human and Machine Learning Labels with Quantified Uncertainty for Training New Machine Learning Models

Modern machine learning and autonomous experimentation schemes in materials science rely on accurate analysis of the data ingested by these models. Unfortunately, accurate analysis of the underlying data can be difficult, even for domain experts, complicating the training of the models intended to drive experiments. This is especially true when the goal is to identify the presence of weak signatures in diffraction or spectroscopic datasets. In this work, we examine a set of as-obtained diffraction data that track the phase transition from monoclinic to tetragonal in a Nb-doped VO2 film as a function of temperature and dopant concentration. We then task a set of domain experts and a set of machine learning experts with identifying which phase is present in each diffraction pattern manually and algorithmically, respectively; in both cases, the labels can vary dramatically, especially at the phase boundaries. We use the mode of the labels and the Shannon entropy as a method to capture, preserve and propagate consensus labels and their variance. Further we use the expert labels as a benchmark and demonstrate the use of Shannon entropy weighted scoring to test the performance of machine learning generated labels. Finally, we propose a material data challenge centered around generating improved labeling algorithms. This real-world dataset curated with expert labels can act as test bed for new algorithms. The raw data, annotations and code used in this study are all available online at data.gov and the interested reader is encouraged to replicate and improve the existing models

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

PeakDecoder enables machine learning-based metabolite annotation and accurate profiling in multidimensional mass spectrometry measurements

Multidimensional measurements using state-of-the-art separations and mass spectrometry provide advantages in untargeted metabolomics analyses for studying biological and environmental bio-chemical processes. However, the lack of rapid analytical methods and robust algorithms for these heterogeneous data has limited its application. Here, we develop and evaluate a sensitive and high-throughput analytical and computational workflow to enable accurate metabolite profiling. Our workflow combines liquid chromatography, ion mobility spectrometry and data-independent acquisition mass spectrometry with PeakDecoder, a machine learning-based algorithm that learns to distinguish true co-elution and co-mobility from raw data and calculates metabolite identification error rates. We apply PeakDecoder for metabolite profiling of various engineered strains of Aspergillus pseudoterreus, Aspergillus niger, Pseudomonas putida and Rhodosporidium toruloides. Results, validated manually and against selected reaction monitoring and gas-chromatography platforms, show that 2683 features could be confidently annotated and quantified across 116 microbial sample runs using a library built from 64 standards.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

Real-time data processing for serial crystallography experiments

We report the use of streaming data interfaces to perform fully online data processing for serial crystallography experiments, without storing intermediate data on disk. The system produces Bragg reflection intensity measurements suitable for scaling and merging, with a latency of less than 1 s per frame. Our system uses the CrystFEL software in combination with the ASAP::O data framework. In a series of user experiments at PETRA III, frames from a 16 megapixel Dectris EIGER2 X detector were searched for peaks, indexed and integrated at the maximum full-frame readout speed of 133 frames per second. The computational resources required depend on various factors, most significantly the fraction of non-blank frames ('hits'). The average single-thread processing time per frame was 242 ms for blank frames and 455 ms for hits, meaning that a single 96-core computing node was sufficient to keep up with the data, with ample headroom for unexpected throughput reductions. Further significant improvements are expected, for example by binning pixel intensities together to reduce the pixel count. We discuss the implications of real-time data processing on the `data deluge' problem from recent and future photon-science experiments, in particular on calibration requirements, computing access patterns and the need for the preservation of raw data.

47 OTHER INSTRUMENTATION↗
DOE OSTI2026

GAT (Grid Analysis Toolkit) [SWR-25-41]

Grid Analysis Toolkit (GAT) is a unified Python API and plotting for power system PCM and CEM results (Sienna, PLEXOS, ReEDS™). It's a toolkit for wrangling data for Bulk Grid Dispatch and Transmission Analysis. GAT aims to provide simplified access to PCM and CEM results in a standard format while also allowing raw data access to underlying datasets specific to the model. This software can also be found on PyPI at For plotting, GAT defaults to standard National Lab of the Rockies (NLR) color schemes and standard styles while allowing customization.

Webb, Micah [National Laboratory of the Rockies (N↗
DOE OSTI2021

Open Radiation Monitoring: Histogram Builder Module Design

The Open Radiation Monitoring Project seeks to develop and demonstrate a modular radiation detection architecture designed specifically for use in arms control treaty verification (ACTV) applications that will facilitate rapid development of trusted systems to meet the needs of potential future treaties. A modular architecture can be used to reduce more complex systems to a series of single purpose building blocks, thereby facilitating equipment inspection and in turn building trust in the equipment by all treaty parties. Furthermore, a modular architecture can be used to control data flow within the measurement system, reducing the risk of "hidden switches" and constraining the amount of sensitive information that could potentially be inadvertently leaked. This report details the first revision of a prototype circuit that will convert analog pulses directly into a histogrammed data set for further processing. The circuit was designed with both spectroscopy and multiplicity analysis in mind but can, in principle, be used to reduce any raw data stream into a histogram. The number of output channels is limited, and the histogram bin ranges are user configurable to allow for non-uniform and discontinuous bins, which makes it possible to restrict the information being passed down stream if desired. Pulse processing relies entirely on analog circuitry and non- programmable logic, which enables operation without the need for a central processor or other programmable control unit. The circuit remains untested under the Open Radiation Monitoring project due to the closure of the sponsoring program. However, further development and testing is scheduled to take place in support of a purpose-built trusted verification system development effort known as COGNIZANT, which demonstrates the potential benefit of developing a suite of modular trusted system components.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
NASA NTRS1982

The SEASAT Synthetic Aperture Radar - Engineering performance evaluation

Results are presented for a study conducted in order to characterize the quality and consistency of the SEASAT Synthetic Aperture Radar image data set. The study evaluated a large spectrum of parameters, including the resolution, position location accuracy, and the amplitude calibration of the imagery produced from the raw data by processors at several institutions. It is demonstrated that this data set can be used to obtain resolution up to the theoretical limit of 6 m x 21 m, absolute position location to within 200 m, and relative calibration of the image data to within + or - 2 dB.

Held, D. N.↗
NASA NTRS2021

Comparison of SAR and CYNSS surface water extent metrics over the Yucatan Lake wetland site

Wetlands have a major role in the carbon cycle, outgassing large quantities of carbon dioxide and methane through processes that are directly and strongly influenced by the duration and timing of inundation. Therefore, understanding the seasonal pattern of inundation can be a component for regional to global scale carbon models. Measurement of inundation extent also establishes a benchmark for the current status of wetland areas, useful in assessing the future impacts of climate change. The incorporation of frequent measurements of inundation extent into large-scale hydrological models would permit the evaluation of more detailed seasonal and longer-term floodplain dynamics and their associated management implications.The Cyclone GNSS (CYGNSS) constellation of satellites launched in 2016, and carries receivers capable of receiving data from L-band GNSS reflections. Delay Doppler maps (DDM) are generated on board and telemetered to the ground, along with a small number of raw data takes that can be used for special processing on the ground for evaluation purposes. It has been previously shown that these data can be sensitive to inundation.The NASA ISRO Synthetic Aperture Radar, currently planned for launch in January 2023, has both an L-band and S-band SAR for earth imaging. The L-band SAR, which will image the Earth's land mass twice every 12 days, has a requirement for measuring wetland inundation extent at the 1 ha scale. One of the sites that will be used to validate this requirement is Yucatan Lake, Louisiana. This oxbow lake and surrounding area located adjacent to the Mississippi river experiences periodic and extensive flooding in the surrounding forest areas.In 2019, NASA's UAVSAR fully polarimetric airborne L-band SAR conducted a flight campaign to image a dozen sites in the SE USA at approximately 12-day intervals and both in the morning and evening, to simulate the type of data NISAR will obtain. One site imaged during this campaign was the Yucatan Lake area, spanning water stages from low to high flood conditions.It has been demonstrated previously that GNSS reflectometry such as that measured by CYGNSS may be used to characterize surface inundation. It has also been known for decades that L-band SAR may be used to characterize not only the presence of open water, but also the presence of subcanopy inundation in forested areas. In this paper we will present results comparing data from these two types of instruments.

Lavalle, Marco↗
DOE OSTI2021

Efforts and Innovations to Promote Data Sharing and Data Accessibility in the EGS Collab Experiments

Large-scale scientific research programs such as the EGS Collab experiments and the FORGE program play extremely important roles in advancing geothermal technologies. Such efforts involve a large number of researchers from multiple institutions, last multiple years, and generate large, complex datasets. The value of the research efforts is only realized when the datasets are used by a large community of researchers in the decades to come. A challenge is that due to the complexity of the data, it could require a user to devote a serious effort into understanding the data before the data can be effectively utilized. In the EGS Collab experiments, the team has devoted remarkable efforts and developed many innovative solutions to make the data more accessible to broader team members and future users. This paper documents the experience gained and lessons learned by the EGS Collab team in disseminating the data in the most informative and inspiring forms to maximize the value of this precious dataset. "Accessibility"in the title does not only mean making the raw data available for download. Particularly, we want to emphasize the importance of organizing, annotating, and presenting the data in ways to make it easy to digest by prospective consumers of the data.

circulation↗