Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data harmonization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3
All sourcesNASA NTRSDOE OSTI
NASA NTRS2011

The Solar Spectral Irradiance as a Function of the Mg II Index for Atmosphere and Climate Modelling

In this paper we present a new method to reconstruct the solar spectrum irradiance in the Ly alpha-400 nm region, and its variability, based on the Mg II index and neutron monitor. Measurements of the solar spectral irradiance available in the literature have been made with different instruments at different times and different spectral ranges. However, climate studies require harmonized data sets. This new approach has the advantage of being independent of the absolute calibration and aging of the instruments. First, the Mg II index is derived using solar spectra from Ly alpha (121 nm) to 410 nm measured from 1978 to 2010 by several space missions. The variability of the spectra with respect to a chosen reference spectrum as a function of time and wavelength is scaled to the derived Mg II index. The set of coefficients expressing the spectral variability can be applied to the chosen reference spectrum to reconstruct the solar spectra within a given time frame or Mg II index values. The accuracy of this method is estimated using two approaches: by direct comparison with particular cases where solar spectra are available from independent measurements, and by calculating the standard deviation between the measured spectra and their reconstruction. From direct comparisons with measurements we obtain an accuracy of about 1 to 2 %, which degrades towards Ly alpha. In a further step, we extend our solar spectral irradiance reconstruction back to the Maunder Minimum introducing the relationship between the Mg II index and the neutron monitor data. Consistent measurements of the Mg II index are not available prior to 1978. However, we observe that over the last three solar cycles, the Mg II index shows strong correlation with the modulation potential determined from the neutron monitor data. Assuming that this correlation can be applied to the past, we reconstruct the Mg II index from the modulation potential back to the Maunder Minimum, and obtain the corresponding solar spectral irradiance reconstruction back to that period. As there is no direct measurement of the spectral irradiance for this period we discuss this methodology in light of the other proposed approaches available in the literature. The use of the cosmogenic isotope data provides a major advantage: it provides information about the solar activity over several thousands years. Using technology of today we can calibrate the solar irradiance against the activity and thus reconstruct it for the times when cosmogenic isotope data are available. This calibration can be re-accessed at any time, if necessary.

Thuillier, Gerard↗
NASA NTRSDate not supplied

RadLab: A Comprehensive Database and Graphical and Programming Interfaces for Biologically Relevant Space Radiation Data

RadLab, a new component of the NASA Open Science Data Repository (OSDR), comprises a database of radiation measurements relevant to space biology, and visual and programmatic interfaces for interrogation and retrieval of these data. The attributes of data available through RadLab include spacecraft, types of radiation sensing instruments, locations within the spacecraft (e.g. modules of the ISS), associated celestial bodies, trajectories, and spacecraft coordinates. The application programming interface (API) implements a request syntax for retrieval of timestamped data filtered by various combinations of such attributes; the graphical user interface (GUI) extends this functionality with visualizations, such as spacecraft schematics, time series plots, geospatial visualizations, and provides easy means to iteratively refine search parameters, inspect the data on the fly, and download target subsets of these data. The release of RadLab currently available to the public contains datasets provided by US and international collaborators and focuses on data recorded on the ISS. Investigators from multiple countries, including the US, Canada, Germany, Bulgaria, Hungary, Italy, Japan, Russia and the Czech Republic, have committed to provide data from their instruments in and beyond low Earth orbit; RadLab will also soon expand to include past (e.g. Shuttle and Mir) and future (e.g. Artemis) data. RadLab will provide a comprehensive, dynamic compendium of space radiation data, enabling the scientific community to perform analyses of data from multiple detectors and to determine the radiation environment of research missions and experiments, both via programmatic retrieval of these data and through the graphical analysis toolkit. The RadLab Working Group has been formed to foster collaborations among data contributors and users, to identify data sources, to put in place standards for data harmonization, and to guide the development of the platform, with the goal to establish the use of RadLab in space radiation research and to advance our understanding of the space radiation environment in human habitats.

radiation↗
NASA NTRSDate not supplied

RadLab: A Comprehensive Database and Graphical and Programming Interfaces for Space Radiation Data

RadLab, a component of the NASA Open Science Data Repository (OSDR), is a database of radiation measurements from multiple instruments and spacecraft that provides visual and programmatic interfaces for interrogation and retrieval of these data. The attributes of data available through RadLab include spacecraft, types of radiation sensing instruments, locations within the spacecraft (e.g. ISS modules), associated celestial bodies, trajectories, and spacecraft coordinates; the primary type of data is the absorbed dose rate, as well as flux and dose equivalent rate where available. The application programming interface (API) implements a request syntax for retrieval of timestamped data filtered by various combinations of such attributes; the graphical user interface (GUI) extends this functionality with visualizations (time series plots, comparison plots, geospatial visualizations) which provide easy means to assess data availability, iteratively refine search parameters, interactively inspect the data, and export target data subsets. Datasets are continuously being added to the RadLab database as part of the rolling release process. Investigators from multiple countries, including the US, Canada, Germany, Bulgaria, Hungary, Italy, Japan, Russia and the Czech Republic, have committed to provide data from their instruments in and beyond low Earth orbit. The current release contains datasets provided by US and international collaborators and includes readings from multiple modules of the ISS, the BioSentinel CubeSat, Chang’e 4, the Lunar Reconnaissance Orbiter, the ExoMars Orbiter, and the Curiosity rover. Datasets are associated with respective RadLab knowledgebase articles which include instrument descriptions and provide bibliographical references. RadLab aims to provide a comprehensive, dynamic compendium of space radiation data, enabling the scientific community to perform analyses of data from multiple detectors and to determine the radiation environment of research missions and experiments. Some of its applications include inference of absorbed radiation dose for NASA GeneLab payloads, and training predictive models as part of the 2024 FDL-X challenge. The platform is actively expanding and seeking additional data, with plans to also cover past (e.g. Shuttle, Mir) and future (e.g. Artemis) missions. The RadLab Working Group has been created to aid in this process as well as to foster collaborations among data contributors and users, to develop standards for data harmonization, and to guide the development of the platform, with the goal to establish the use of RadLab in space radiation research and to advance our understanding of the radiation environment in outer space.

Kirill Grigorev↗
NASA NTRSDate not supplied

RadLab: A Comprehensive Database and Graphical and Programming Interfaces for Biologically Relevant Space Radiation Data

RadLab, a new component of the NASA Open Science Data Repository (OSDR), comprises a database of radiation measurements relevant to space biology, and visual and programmatic interfaces for interrogation and retrieval of these data. The attributes of data available through RadLab include spacecraft, types of radiation sensing instruments, locations within the spacecraft (e.g. modules of the ISS), associated celestial bodies, trajectories, and spacecraft coordinates. The application programming interface (API) implements a request syntax for retrieval of timestamped data filtered by various combinations of such attributes; the graphical user interface (GUI) extends this functionality with visualizations, such as spacecraft schematics, time series plots, geospatial visualizations, and provides easy means to iteratively refine search parameters, inspect the data on the fly, and download target subsets. The release of RadLab currently available to the public contains datasets provided by US and international collaborators and focuses on data recorded on the ISS. Investigators from multiple countries, including the US, Canada, Germany, Bulgaria, Hungary, Italy, Japan, Russia and the Czech Republic, have committed to provide data from their instruments in and beyond low Earth orbit; RadLab will also soon expand to include past (e.g. Shuttle and Mir) and future (e.g. Artemis) data. RadLab will provide a comprehensive, dynamic compendium of space radiation data, enabling the scientific community to perform analyses of data from multiple detectors and to determine the radiation environment of research missions and experiments. The RadLab Working Group has been formed to foster collaborations among data contributors and users, to identify data sources, to put in place standards for data harmonization, and to guide the development of the platform, with the goal to establish the use of RadLab in space radiation research and to advance our understanding of the space radiation environment in human habitats.

database↗
NASA NTRSDate not supplied

RadLab: A Comprehensive Database and Graphical and Programming Interfaces for Space Radiation Data

RadLab, a component of the NASA Open Science Data Repository (OSDR), is a database of radiation measurements from multiple instruments and spacecraft that provides visual and programmatic interfaces for interrogation and retrieval of these data. The attributes of data available through RadLab include spacecraft, types of radiation sensing instruments, locations within the spacecraft (e.g. ISS modules), associated celestial bodies, trajectories, and spacecraft coordinates; the primary type of data is the absorbed dose rate, as well as flux and dose equivalent rate where available. The application programming interface (API) implements a request syntax for retrieval of timestamped data filtered by various combinations of such attributes; the graphical user interface (GUI) extends this functionality with visualizations (time series plots, comparison plots, geospatial visualizations) which provide easy means to assess data availability, iteratively refine search parameters, interactively inspect the data, and export target data subsets. Datasets are continuously being added to the RadLab database as part of the rolling release process. Investigators from multiple countries, including the US, Canada, Germany, Bulgaria, Hungary, Italy, Japan, Russia and the Czech Republic, have committed to provide data from their instruments in and beyond low Earth orbit. The current release contains datasets provided by US and international collaborators and includes readings from multiple modules of the ISS, the BioSentinel CubeSat, Chang’e 4, the Lunar Reconnaissance Orbiter, the ExoMars Orbiter, and the Curiosity rover. Datasets are associated with respective RadLab knowledgebase articles which include instrument descriptions and provide bibliographical references. RadLab aims to provide a comprehensive, dynamic compendium of space radiation data, enabling the scientific community to perform analyses of data from multiple detectors and to determine the radiation environment of research missions and experiments. Some of its applications include inference of absorbed radiation dose for NASA GeneLab payloads, and training predictive models as part of the 2024 FDL-X challenge. The platform is actively expanding and seeking additional data, with plans to also cover past (e.g. Shuttle, Mir) and future (e.g. Artemis) missions. The RadLab Working Group has been created to aid in this process as well as to foster collaborations among data contributors and users, to develop standards for data harmonization, and to guide the development of the platform, with the goal to establish the use of RadLab in space radiation research and to advance our understanding of the radiation environment in outer space.

Kirill Grigorev↗
DOE OSTI2022

Harmonizing model organism data in the Alliance of Genome Resources

The Alliance of Genome Resources (the Alliance) is a combined effort of 7 knowledgebase projects: Saccharomyces Genome Database, WormBase, FlyBase, Mouse Genome Database, the Zebrafish Information Network, Rat Genome Database, and the Gene Ontology Resource. The Alliance seeks to provide several benefits: better service to the various communities served by these projects; a harmonized view of data for all biomedical researchers, bioinformaticians, clinicians, and students; and a more sustainable infrastructure. The Alliance has harmonized cross-organism data to provide useful comparative views of gene function, gene expression, and human disease relevance. The basis of the comparative views is shared calls of orthology relationships and the use of common ontologies. The key types of data are alleles and variants, gene function based on gene ontology annotations, phenotypes, association to human disease, gene expression, protein–protein and genetic interactions, and participation in pathways. The information is presented on uniform gene pages that allow facile summarization of information about each gene in each of the 7 organisms covered (budding yeast, roundworm Caenorhabditis elegans, fruit fly, house mouse, zebrafish, brown rat, and human). The harmonized knowledge is freely available on the alliancegenome.org portal, as downloadable files, and by APIs. We expect other existing and emerging knowledge bases to join in the effort to provide the union of useful data and features that each knowledge base currently provides.

59 BASIC BIOLOGICAL SCIENCES↗
NASA NTRS2011

Capturing, Harmonizing and Delivering Data and Quality Provenance

Satellite remote sensing data have proven to be vital for various scientific and applications needs. However, the usability of these data depends not only on the data values but also on the ability of data users to assess and understand the quality of these data for various applications and for comparison or inter-usage of data from different sensors and models. In this paper, we describe some aspects of capturing, harmonizing and delivering this information to users in the framework of distributed web-based data tools.

Leptoukh, Gregory↗
NASA NTRS1993

Data processing and calibration for tunable diode laser harmonic absorption spectrometers

Data processing and calibration methods are described for tunable diode laser absorption spectrometers which produce harmonic absorption spectra as raw data for measuring gas mixing ratios down to parts-per-trillion levels at a variety of pressures. The methods, which take advantage of modern computer speed, memory, and data storage capabilities, are applicable to the detection of weakly absorbing gases in quantitative industrial monitoring, in addition to aircraft and balloon atmospheric measurements for which they were designed. Algorithms for calibration and data analysis, including rejection of erroneous spectra, variation of effective integration time, spectral alignment prior to averaging, and plotting and archiving of results, have been tested on actual stratospheric laser spectra recorded by the Aircraft Laser Infrared Absorption Spectrometer (ALIAS) spectrometer in numerous flights of NASA's ER-2 aircraft.

May, Randy D.↗
NASA NTRS2018

The Harmonized Landsat and Sentinel-2 Surface Reflectance Data Set

The Harmonized Landsat and Sentinel-2 (HLS) project is a NASA initiative aiming to produce a VirtualConstellation (VC) of surface reflectance (SR) data acquired by the Operational Land Imager (OLI) and MultiSpectral Instrument (MSI) aboard Landsat 8 and Sentinel-2 remote sensing satellites, respectively. The HLS products are based on a set of algorithms to obtain seamless products from both sensors (OLI and MSI): atmospheric correction, cloud and cloud-shadow masking, spatial co-registration and common gridding, bidirectional reflectance distribution function normalization and spectral bandpass adjustment. Three products are derivedfrom the HLS processing chain: (i) S10: full resolution MSI SR at 10 m, 20 m and 60 m spatial resolutions; (ii)S30: a 30 m MSI Nadir BRDF (Bidirectional Reflectance Distribution Function)-Adjusted Reflectance (NBAR);(iii) L30: a 30 m OLI NBAR. All three products are processed for every Level-1 input products from Landsat 8/OLI (L1T) and Sentinel-2/MSI (L1C). As of version 1.3, the HLS data set covers 10.35 million km2 and spans from first Landsat 8 data (2013); Sentinel-2 data spans from October 2015. The L30 and S30 show a good consistency with coarse spatial resolution products, in particular MODIS Collection 6 MCD09CMG products (overall deviations do not exceed 11%) that are used as a reference for quality assurance. The spatial co-registration of the HLS is improved compared to original Landsat 8 L1T and Sentinel 2A L1C products, for which misregistration issues between multi-temporal data are known. In particular, the resulting computed circular errors at 90% for the HLS product are 6.2 m and 18.8 m, for S10 and L30 products, respectively. The main known issue of the current data set remains the Sentinel-2 cloud mask with many cloud detection omissions. The cross-comparison with MODIS was used to flag products with most evident non-detected clouds. A time series outlier filtering approach is suggested to detect remaining clouds. Finally, several time series are presented to highlight the high potential of the HLS data set for crop monitoring.

Landsat Sentinel-2↗
DOE OSTI2024

Harmonized wood density data for Central Amazon species in the BIONTE experimental area in Manaus, Brazil

BIONTE (BIOmass and NuTrient Experiment) is a selective logging experiment established at the Experimental Station of Tropical Forestry (EEST, aka “ZF2”) field research station in the mid 1980s in the central Amazon (Higuchi et al. 1997, Amaral et al. 2019). The main data related to BIONTE are available as a separate dataset (Lima et al. 2022). Only species identified within the BIONTE plots were included in this dataset. Wood density, expressed in g cm-3, was collated from multiple sources that were integrated to compose the wood density for BIONTE. The starting point used was wood density data available from Chave et al. (2006), which was then adapted by Marra et al. (2016) and Marra et al. (2018). We also included data collected and synthesized by Ramírez-Méndez (2018) and Gimenez et al.(2021), who combined local estimates of wood density at the site with other sources collected in the Central Amazon. Data are included in .csv files, while BIONTE_WD_headers.txt provides descriptions of data file headers.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2022

An Earth System Digital Twin for Flood Prediction and Analysis

An Earth System Digital Twin (ESDT) is a dynamic, interactive, digital replica of the state and temporal evolution of Earth systems. It integrates multiple models along with observation data, and connecting them with analysis, AI, and visualization tools. Together, these enable users to explore the current state of the Earth system, predict future conditions, and run hypothetical scenarios to understand how the system would evolve under various assumptions. The NASA’s Advanced Information Systems Technology (AIST)’s Integrated Digital Earth Analysis System (IDEAS) project is to establish an extensible architectural solution to develop digital twins of our physical environment for Earth Science. IDEAS delivers a formal system architecture with mechanisms for the outputs of one model to feed into others; for driving models with observation data; and for harmonizing observation data and model outputs for analysis. To validate and demonstrate the IDEAS architecture, this project collaborates with the Space Climate Observatory (SCO)’s FloodDAM project and the Centre National d’Etudes Spatiales (CNES) to focus on floods detection, prediction and their impacts.

Kettig, Peter↗
DOE OSTI2025

IM3 Phase 2 Official Simulations: GCAM-Demeter-SELECT Annualized Land Use and Land Cover, Wood Harvest and Fertilization Data with Dynamic Urbanization Harmonized to CLM Land Definitions at 0.125 Degrees

Annualized land use land cover data, including wood harvest and fertilizer use data from the Global Change Analysis Model (GCAM) downscaled to 0.125 degrees for couping with the Community Land Model (CLM). GCAM here refers to GCAM-USA v5.3.im3 which has an enhanced electricity sector and an updated data system needed to represent regional to local scale dynamics. Data is also harmonized with future urbanization projections from the Spatially-Explicit, Long-term, Empirical City developmenT (SELECT) model. Projections/Data are generated using the demeter land use and land cover downscaling model. Original projections were generated at 0.05 degrees before being aggregared to 0.125 degrees. Projections are available for 8 alternative scenarios. Two versions of final data are included- one with managed forests or harvested forest area per pixel broken out and one with the same aggregated into total forests. Following folders are included: demeter_78_PFT_output:This is the final output of dynamic land use land cover change for 78 PFTs as required by CLM raw_outputs_incl_managed_forest: This is the final output but with managed forests broken out as a different PFT. Essentially a 79th PFT is added. wood_harvest_outputs: Wood harvest output per pixel in gC/m2 fertilization_outputs: Fertilizer use per pixel in gN/m2 Each NetCDF file in each folder represents a projection for a separate year, scenario. Land use outputs are organized as PFT level data saved as subdata. Link to GCAM version used- https://data.msdlive.org/records/yb23g-44274 Link to SELECT documentation -https://www.sciencedirect.com/science/article/pii/S1364815219301707 Link to CLM documentation- - https://www.cesm.ucar.edu/models/clm In case of questions contact- kanishka.narayan@pnnl.gov

GCAM-USA↗
NASA NTRSDate not supplied

On the Advantages of Using Harmonized Landsat Sentinel-2 Data for Monitoring Environmental Change

NASA coordinates the Satellite Needs Working Group, dedicated to identifying, communicating, and addressing Earth observation needs of federal agencies. In 2016, the Harmonized Landsat Sentinel-2 (HLS) dataset was formulated and implemented to fulfill multiple needs. The combination of acquisitions from the Landsat and Sentinel-2 platforms results in a global dataset of surface reflectance with a temporal resolution of two days, while retaining the geometry and 30-meter spatial resolution of Landsat data. This harmonization allows for seamless integration with the 40-year archive of Landsat data. The HLS dataset is now available on the Google Earth Engine, enabling HLS utilization in various algorithms and frameworks essential for monitoring environmental change worldwide. During this presentation, we will demonstrate and discuss the advantages of using HLS data in comparison to using separate streams of Landsat and Sentinel-2 data in existing time series-based frameworks for change monitoring. Specifically, we will explore the application of HLS for continuous monitoring of deforestation using time series-based algorithms traditionally run with Landsat data. Additionally, we will showcase the benefits of HLS data for near real-time monitoring of forest disturbance in tropical regions. These examples underscore the value and utility of the HLS dataset for environmental monitoring and analysis.

Pontus Olofsson↗
NASA NTRS1999

Backus Effect on a Perpendicular Errors in Harmonic Models of Real vs. Synthetic Data

Measurements of geomagnetic scalar intensity on a thin spherical shell alone are not enough to separate internal from external source fields; moreover, such scalar data are not enough for accurate modeling of the vector field from internal sources because of unmodeled fields and small data errors. Spherical harmonic models of the geomagnetic potential fitted to scalar data alone therefore suffer from well-understood Backus effect and perpendicular errors. Curiously, errors in some models of simulated 'data' are very much less than those in models of real data. We analyze select Magsat vector and scalar measurements separately to illustrate Backus effect and perpendicular errors in models of real scalar data. By using a model to synthesize 'data' at the observation points, and by adding various types of 'noise', we illustrate such errors in models of synthetic 'data'. Perpendicular errors prove quite sensitive to the maximum degree in the spherical harmonic expansion of the potential field model fitted to the scalar data. Small errors in models of synthetic 'data' are found to be an artifact of matched truncation levels. For example, consider scalar synthetic 'data' computed from a degree 14 model. A degree 14 model fitted to such synthetic 'data' yields negligible error, but amplifies 4 nT (rmss) added noise into a 60 nT error (rmss); however, a degree 12 model fitted to the noisy 'data' suffers a 492 nT error (rmms through degree 12). Geomagnetic measurements remain unaware of model truncation, so the small errors indicated by some simulations cannot be realized in practice. Errors in models fitted to scalar data alone approach 1000 nT (rmss) and several thousand nT (maximum).

Voorhies, C. V.↗
DOE OSTI2024

Predicting nutrition and environmental factors associated with female reproductive disorders using a knowledge graph and random forests

Female reproductive disorders (FRDs) are common health conditions that may present with significant symptoms. Diet and environment are potential areas for FRD interventions. We utilized a knowledge graph (KG) method to predict factors associated with common FRDs (for example, endometriosis, ovarian cyst, and uterine fibroids). We harmonized survey data from the Personalized Environment and Genes Study (PEGS) on internal and external environmental exposures and health conditions with biomedical ontology content. We merged the harmonized data and ontologies with supplemental nutrient and agricultural chemical data to create a KG. We analyzed the KG by embedding edges and applying a random forest for edge prediction to identify variables potentially associated with FRDs. We also conducted logistic regression analysis for comparison. Across 9765 PEGS respondents, the KG analysis resulted in 8535 significant or suggestive predicted links between FRDs and chemicals, phenotypes, and diseases. Amongst these links, 32 were exact matches when compared with the logistic regression results, including comorbidities, medications, foods, and occupational exposures. Mechanistic underpinnings of predicted links documented in the literature may support some of our findings. Our KG methods are useful for predicting possible associations in large, survey-based datasets with added information on directionality and magnitude of effect from logistic regression. These results should not be construed as causal but can support hypothesis generation. This investigation enabled the generation of hypotheses on a variety of potential links between FRDs and exposures. Future investigations should prospectively evaluate the variables hypothesized to impact FRDs.

60 APPLIED LIFE SCIENCES↗