Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “metadata”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,675 records · Page 93
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Ontology-Enriched Specifications Enabling Findable, Accessible, Interoperable, and Reusable Marine Metagenomic Datasets in Cyberinfrastructure Systems

Marine microbial ecology requires the systematic comparison of biogeochemical and sequence data to analyze environmental influences on the distribution and variability of microbial communities. With ever-increasing quantities of metagenomic data, there is a growing need to make datasets Findable, Accessible, Interoperable, and Reusable (FAIR) across diverse ecosystems. FAIR data is essential to developing analytical frameworks that integrate microbiological, genomic, ecological, oceanographic, and computational methods. Although community standards defining the minimal metadata required to accompany sequence data exist, they haven’t been consistently used across projects, precluding interoperability. Moreover, these data are not machine-actionable or discoverable by cyberinfrastructure systems. By making ‘omic and physicochemical datasets FAIR to machine systems, we can enable sequence data discovery and reuse based on machine-readable descriptions of environments or physicochemical gradients. In this work, we developed a novel technical specification for dataset encapsulation for the FAIR reuse of marine metagenomic and physicochemical datasets within cyberinfrastructure systems. This includes using Frictionless Data Packages enriched with terminology from environmental and life-science ontologies to annotate measured variables, their units, and the measurement devices used. This approach was implemented in Planet Microbe, a cyberinfrastructure platform and marine metagenomic web-portal. Here, we discuss the data properties built into the specification to make global ocean datasets FAIR within the Planet Microbe portal. We additionally discuss the selection of, and contributions to marine-science ontologies used within the specification. Finally, we use the system to discover data by which to answer various biological questions about environments, physicochemical gradients, and microbial communities in meta-analyses. This work represents a future direction in marine metagenomic research by proposing a specification for FAIR dataset encapsulation that, if adopted within cyberinfrastructure systems, would automate the discovery, exchange, and re-use of data needed to answer broader reaching questions than originally intended.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

Simple Scattering: Lipid nanoparticle structural data repository

Lipid nanoparticles (LNPs) are being intensively researched and developed to leverage their ability to safely and effectively deliver therapeutics. To achieve optimal therapeutic delivery, a comprehensive understanding of the relationship between formulation, structure, and efficacy is critical. However, the vast chemical space involved in the production of LNPs and the resulting structural complexity make the structure to function relationship challenging to assess and predict. New components and formulation procedures, which provide new opportunities for the use of LNPs, would be best identified and optimized using high-throughput characterization methods. Recently, a high-throughput workflow, consisting of automated mixing, small-angle X-ray scattering (SAXS), and cellular assays, demonstrated a link between formulation, internal structure, and efficacy for a library of LNPs. As SAXS data can be rapidly collected, the stage is set for the collection of thousands of SAXS profiles from a myriad of LNP formulations. In addition, correlated LNP small-angle neutron scattering (SANS) datasets, where components are systematically deuterated for additional contrast inside, provide complementary structural information. The centralization of SAXS and SANS datasets from LNPs, with appropriate, standardized metadata describing formulation parameters, into a data repository will provide valuable guidance for the formulation of LNPs with desired properties. To this end, we introduce Simple Scattering, an easy-to-use, open data repository for storing and sharing groups of correlated scattering profiles obtained from LNP screening experiments. Here, we discuss the current state of the repository, including limitations and upcoming changes, and our vision towards future usage in developing our collective knowledge base of LNPs.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

A Unified User-Friendly Instrument Control and Data Acquisition System for the ORNL SANS Instrument Suite

In an effort to upgrade and provide a unified and improved instrument control and data acquisition system for the Oak Ridge National Laboratory (ORNL) small-angle neutron scattering (SANS) instrument suite—biological small-angle neutron scattering instrument (Bio-SANS), the extended q-range small-angle neutron scattering diffractometer (EQ-SANS), the general-purpose small-angle neutron scattering diffractometer (GP-SANS)—beamline scientists and developers teamed up and worked closely together to design and develop a new system. We began with an in-depth analysis of user needs and requirements, covering all perspectives of control and data acquisition based on previous usage data and user feedback. Our design and implementation were guided by the principles from the latest user experience and design research and based on effective practices from our previous projects. In this article, we share details of our design process as well as prominent features of the new instrument control and data acquisition system. The new system provides a sophisticated Q-Range Planner to help scientists and users plan and execute instrument configurations easily and efficiently. The system also provides different user operation interfaces, such as wizard-type tool Panel Scan, a Scripting Tool based on Python Language, and Table Scan, all of which are tailored to different user needs. The new system further captures all the metadata to enable post-experiment data reduction and possibly automatic reduction and provides users with enhanced live displays and additional feedback at the run time. We hope our results will serve as a good example for developing a user-friendly instrument control and data acquisition system at large user facilities.

47 OTHER INSTRUMENTATION↗
DOE OSTI2021

Whole-Genome SNP Analysis Identifies Putative Mycobacterium bovis Transmission Clusters in Livestock and Wildlife in Catalonia, Spain

The high-resolution WGS analyses of MTBC strains have provided useful insight for determining sources of infection for animal tuberculosis. In Spain, tuberculosis in livestock is caused by Mycobacterium bovis and Mycobacterium caprae, where wildlife reservoirs play an important role. We analyzed a set of 125 M. bovis isolates obtained from livestock and wildlife from Catalonia to investigate strain diversity and identify possible sources and/or causes of infection. Whole-genome SNP profiles were used for phylogenetic reconstruction and pairwise SNP distance analysis. Additionally, SNPs were investigated to identify virulence and antimicrobial resistance factors to investigate clade-specific associations. Putative transmission clusters (≤12 SNPs) were identified, and associated epidemiological metadata were used to determine possible explanatory factors for transmission. M. bovis distribution was heterogeneous, with 7 major clades and 21 putative transmission clusters. In order of importance, the explanatory factors associated were proximity and neighborhood, residual infection, livestock-wildlife interaction, shared pasture, and movement. Genes related to lipid transport and metabolism showed the highest number of SNPs. All isolates were pyrazinamide resistant, and five were additionally resistant to isoniazid, but no clade-specific associations could be determined. Our findings highlight the importance of high-resolution molecular surveillance to monitor bovine tuberculosis dynamics in a low-prevalence setting.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

Towards Next-Generation Urban Decision Support Systems through AI-Powered Construction of Scientific Ontology Using Large Language Models—A Case in Optimizing Intermodal Freight Transportation

The incorporation of Artificial Intelligence (AI) models into various optimization systems is on the rise. However, addressing complex urban and environmental management challenges often demands deep expertise in domain science and informatics. This expertise is essential for deriving data and simulation-driven insights that support informed decision-making. In this context, we investigate the potential of leveraging the pre-trained Large Language Models (LLMs) to create knowledge representations for supporting operations research. By adopting ChatGPT-4 API as the reasoning core, we outline an applied workflow that encompasses natural language processing, Methontology-based prompt tuning, and Generative Pre-trained Transformer (GPT), to automate the construction of scenario-based ontologies using existing research articles and technical manuals of urban datasets and simulations. From these ontologies, knowledge graphs can be derived using widely adopted formats and protocols, guiding various tasks towards data-informed decision support. The performance of our methodology is evaluated through a comparative analysis that contrasts our AI-generated ontology with the widely recognized pizza ontology, commonly used in tutorials for popular ontology software. We conclude with a real-world case study on optimizing the complex system of multi-modal freight transportation. Our approach advances urban decision support systems by enhancing data and metadata modeling, improving data integration and simulation coupling, and guiding the development of decision support strategies and essential software components.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗
DOE OSTI2025

BLADE: An Automated Framework for Classifying Light Curves from the Center for Near-Earth Object Studies Fireball Database

Fireballs (bolides) are high-energy luminous phenomena produced when meteoroids and small asteroids enter Earth’s atmosphere at hypersonic speeds, often resulting in fragmentation or complete disintegration accompanied by significant energy release. The resulting bolide light curves capture temporal brightness variations as these objects traverse increasingly dense atmospheric layers, providing essential information on meteoroid entry dynamics, fragmentation behavior, and atmospheric energy deposition processes. The Center for Near-Earth Object Studies’ (CNEOS) continuously expanding fireball database offers a globally comprehensive archive of bolide events, including light curves and associated metadata. Events associated with infrasound detections allow direct correlations between acoustic signatures and light curve features, therefore enabling detailed analyses of fragmentation dynamics and energy deposition. Here, we introduce Bolide Light-curve Analysis and Discrimination Explorer (BLADE), a robust and high-fidelity framework specifically designed to analyze bolide light curves for objects detected from space. BLADE incorporates a processing pipeline integrating Savitzky–Golay filtering, prominence-based peak detection, and gradient analysis, enabling systematic identification and classification of fragmentation events and their associated energy release characteristics. Preliminary results demonstrate that BLADE reliably distinguishes distinct bolide behaviors, providing an objective, scalable methodology for characterization and analysis of large bolide light curve data sets. This foundational work establishes a novel pathway for advanced bolide research, with promising applications in planetary defense and global atmospheric monitoring. Future research should adopt an integrative approach combining CNEOS optical data with complementary infrasound measurements, further clarifying relationships between bolide energy deposition and acoustic signatures, thus refining our understanding of meteoroid and asteroid atmospheric entry processes.

Asteroids↗
DOE OSTI2020

On Neural Architectures for Astronomical Time-series Classification with Application to Variable Stars

Despite the utility of neural networks (NNs) for astronomical time-series classification, the proliferation of learning architectures applied to diverse data sets has thus far hampered a direct intercomparison of different approaches. Here we perform the first comprehensive study of variants of NN-based learning and inference for astronomical time series, aiming to provide the community with an overview on relative performance and, hopefully, a set of best-in-class choices for practical implementations. In both supervised and self-supervised contexts, we study the effects of different time-series-compatible layer choices, namely the dilated temporal convolutional neural network (dTCNs), long-short term memory NNs, gated recurrent units and temporal convolutional NNs (tCNNs). Additionally, we also study the efficacy and performance of encoder-decoder (i.e., autoencoder) networks compared to direct classification networks, different pathways to include auxiliary (non-time-series) metadata, and different approaches to incorporate multi-passband data (i.e., multiple time series per source). Performance—applied to a sample of 17,604 variable stars (VSs) from the MAssive Compact Halo Objects (MACHO) survey across 10 imbalanced classes—is measured in training convergence time, classification accuracy, reconstruction error, and generated latent variables. We find that networks with recurrent NNs generally outperform dTCNs and, in many scenarios, yield to similar accuracy as tCNNs. In learning time and memory requirements, convolution-based layers perform better. We conclude by discussing the advantages and limitations of deep architectures for VS classification, with a particular eye toward next-generation surveys such as the Legacy Survey of Space and Time, the Roman Space Telescope, and Zwicky Transient Facility.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

A Catalog of Candidate Double and Lensed Quasars from Gaia and WISE Data

Making use of strong correlations between closely separated multiple or double sources and photometric and astrometric metadata in Gaia Early Data Release 3 (EDR3), we generate a catalog of candidate double- and multiply imaged lensed quasars and active galactic nuclei (AGNs), comprising 3140 systems. It includes two partially overlapping parts: a sample of distant (redshifts mostly greater than 1) sources with perturbed data; and systems that have been resolved into separate components by Gaia at separations less than 2''. For the first part, which is roughly one-third of the published catalog, we synthesized 0.617 million redshifts using multiple machine-learning prediction and classification methods, using independent photometric and astrometric data from Gaia EDR3 and the Wide-field Infrared Survey Explorer, with accurate spectroscopic redshifts from the Sloan Digital Sky Survey (SDSS) as a training set. Using these synthetic redshifts, we estimate a 4.9% rate of interlopers with spectroscopic redshifts below 1 in this part of the catalog. Unresolved candidate double and dual AGNs and quasars are selected as sources with a marginally high BP/RP excess factor (phot_bp_rp_excess_factor), which is sensitive to source extent, limiting our search to high-redshift quasars. For the second part of the catalog, additional filters on measured parallax and near-neighbor statistics are applied to diminish the propagation of the remaining stellar contaminants. The estimated rate of the positives (double or multiple sources) is 98%, and the estimated rate of dual (physically related) quasars is greater than 54%. A few dozen serendipitously found objects of interest are discussed in more detail, including known and new lensed images, planetary nebulae, young IR stars of peculiar morphology, and quasars with catastrophic redshift errors in SDSS.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Siena Galaxy Atlas 2020

Abstract We present the 2020 version of the Siena Galaxy Atlas (SGA-2020), a multiwavelength optical and infrared imaging atlas of 383,620 nearby galaxies. The SGA-2020 uses optical grz imaging over ≈20,000 deg 2 from the Dark Energy Spectroscopic Instrument (DESI) Legacy Imaging Surveys Data Release 9 and infrared imaging in four bands (spanning 3.4–22 μ m) from the 6 year unWISE coadds; it is more than 95% complete for galaxies larger than R (26) ≈ 25″ and r < 18 measured at the 26 mag arcsec −2 isophote in the r band. The atlas delivers precise coordinates, multiwavelength mosaics, azimuthally averaged optical surface-brightness profiles, model images and photometry, and additional ancillary metadata for the full sample. Coupled with existing and forthcoming optical spectroscopy from the DESI, the SGA-2020 will facilitate new detailed studies of the star formation and mass assembly histories of nearby galaxies; enable precise measurements of the local velocity field via the Tully–Fisher and fundamental plane relations; serve as a reference sample of lasting legacy value for time-domain and multimessenger astronomical events; and more.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2018

Mapping Benthic Habitat Conditions and Seafloor Deposits using Sediment Profile Imaging and a Semiautomated Image Processing System

Objectives/Scope: Sediment profile imaging (SPI) technology characterizes in situ physical, geochemical, and biological seafloor features. SPI was required by Mexico’s Agency for Safety, Energy, and Environment in 2017 for environmental baseline surveys (EBS) of oil lease blocks in the southern Gulf of Mexico. Because of its ability to provide information on benthic community health and the distribution of very thin (down to the centimeter scale) layers of deposited materials, SPI technology is highly effective for mapping drill cuttings or drilling muds released around wellheads during exploration or production and documenting their ecological impacts. SPI technology has not been widely used in the oil and gas industry for EBS or other monitoring activities. A primary objective of this work is to improve the transparency and consistency of the SPI data generation and data management process. Methods, Procedures, Process: The SPI camera works like an inverted periscope and obtains an undisturbed 21x15-cm cross-sectional image of the upper sediment column. The camera is internally powered and can be deployed rapidly from a standard winch in depths to 4,000 m. Many stations can be sampled in a single day by “pogo-sticking” across a survey area. Sediment grain size, penetration depth, surface boundary roughness, natural and anthropogenic depositional layers, depth of the oxidized surface sediment layer, maximum biogenic mixing depth, and infaunal successional stage can be directly measured at sea or immediately following the cruise. Final SPI data sets can be provided within a few weeks of the survey. Results, Observations, Conclusions: Details on the features measured in SPI images and the underlying interpretive paradigms are presented. To standardize the SPI data generation process, Integral Consulting Inc. has developed 1) a semiautomated image analysis platform, and 2) a SPI data-specific database architecture that allows both numerical and non-numerical metrics to be incorporated into a standard database structure. An integrated, software-based SPI analysis platform has been developed that imports image files and metadata and provides a graphical user interface. The software automatically stores the data, which can then be reviewed for quality assurance, plotted, statistically analyzed, and mapped or exported to other platforms (e.g., Esri ArcGIS©) for further evaluation. Image processing algorithms have been developed using a combination of open-source and commercially available software packages (e.g., MATLAB® and OpenCV) to automatically quantify key parameters. Novel/Additive Information: SPI technology’s underutilization in the oil and gas industry may be in part due to a lack of standardization in the measurement of basic features in SPI images. A primary objective of this work is to develop a streamlined, standardized, and transparent process for generating and managing SPI data.

02 PETROLEUM↗
DOE OSTI2025

2025 TEM Workshop

The TEM Data Management Workshop will take place on August 26 from 9 a.m. to 12 p.m. MT, and will be held virtually on TEAMS. The primary goal of this workshop is to engage NSUF users and stakeholders in discussions about the data needs for the utilization of AI and ML in the analysis of TEM data. Key topics to be covered include data storage, data sharing, data tagging, metadata inclusion, standardized data formats, data augmentation, and annotated training datasets. Additionally, the workshop will provide valuable insights into resources such as the Nuclear Research Data System (NRDS) for data storage and sharing, as well as open-source codes for data analysis.

Bachhav, Mukesh↗
DOE OSTI2026

UCB-GLOBES: An open-access mass spectral database of identified and unidentified atmospheric organic compounds

Chemical characterization of atmospheric organic aerosols using gas chromatography with 70 eV electron ionization mass spectrometry (GC/EI-MS) has been used for decades in advancing molecular marker detection and identification, though primarily through suspect screening and/or targeted analyses. To advance non-targeted analyses of environmental samples, we have catalogued approximately 27 000 mass spectra (MS) of the trimethylsilyl derivatives of semi-volatile organic aerosol (OA) analytes in the open-access University of California Berkeley Goldstein Library of Organic Biogenic Environmental Spectra (UCB-GLOBES). Analytes were observed in ambient samples from the U.S. and the Central Amazon and/or laboratory simulations of secondary OA (SOA) formation. These samples are representative of OA under urban and biomass burning influences as well as SOA derived from biogenic precursors (e.g., isoprene, monoterpenes, sesquiterpenes) and biomass burning intermediates. MS are documented in UCB-GLOBES without regard to known chemical identity, annotated with extensive metadata such as sample source/experimental conditions, any structural information gained from MS analyses, and predicted chemical properties such as average carbon oxidation state and carbon number. UCB-GLOBES MS are compatible for importing into the NIST MS Search program, and we have also provided a Jupyter Notebook for MS visualization and comparisons. We demonstrate the utility of UCB-GLOBES through MS reanalyses of prior analytes observed in ambient data, finding a 20 % reduction in the number of analytes assigned to OA source categories reliant solely on time series correlation and an overall 11 % increase in new MS-based OA source categorization for the Southeast U.S. For 1513 analytes observed previously in the Central Amazon, we found 375 MS matches using UCB-GLOBES vs. 136 MS matches during prior analyses, representing a 14 % gain in newly confirmed or newly categorized OA species. While OA from laboratory oxidation experiments in UCB-GLOBES are highly diverse chemically, on average only 29 % of UCB-GLOBES MS have a mass spectral match to another MS entry in UCB-GLOBES and/or in databases of known compounds (i.e. NIST MS Database, Adams Essential Oil, MANE Flavor and Fragrance Company). This indicates that roughly 70 % of UCB-GLOBES MS are unique thus far, not observed more than once among the laboratory oxidation samples and ambient data in UCB-GLOBES MS. Further, only 18 % can be positively identified using these databases or known authentic standards. This points to a large gap between these laboratory simulations and ambient OA. Overall, the UCB-GLOBES database can be utilized for improving confidence in OA source categorization and/or identification, novel chemical marker discovery, tracking chemical diversity, de novo structure and properties prediction, and improving MS search and matching algorithms. This can ultimately inform future research priorities for the chemical characterization of atmospheric organic samples.

Mass spectrometry↗
DOE OSTI2022

Reviews and syntheses: The promise of big diverse soil data, moving current practices towards future potential

Abstract. In the age of big data, soil data are more available and richer than ever, but – outside of a few large soil survey resources – they remain largely unusable for informing soil management and understanding Earth system processes beyond the original study. Data science has promised a fully reusable research pipeline where data from past studies are used to contextualize new findings and reanalyzed for new insight. Yet synthesis projects encounter challenges at all steps of the data reuse pipeline, including unavailable data, labor-intensive transcription of datasets, incomplete metadata, and a lack of communication between collaborators. Here, using insights from a diversity of soil, data, and climate scientists, we summarize current practices in soil data synthesis across all stages of database creation: availability, input, harmonization, curation, and publication. We then suggest new soil-focused semantic tools to improve existing data pipelines, such as ontologies, vocabulary lists, and community practices. Our goal is to provide the soil data community with an overview of current practices in soil data and where we need to go to fully leverage big data to solve soil problems in the next century.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Global transpiration data from sap flow measurements: the SAPFLUXNET database

Plant transpiration links physiological responses of vegetation to water supply and demand with hydrological, energy, and carbon budgets at the land–atmosphere interface. However, despite being the main land evaporative flux at the global scale, transpiration and its response to environmental drivers are currently not well constrained by observations. Here we introduce the first global compilation of whole-plant transpiration data from sap flow measurements (SAPFLUXNET, https://sapfluxnet.creaf.cat/, last access: 8 June 2021). We harmonized and quality-controlled individual datasets supplied by contributors worldwide in a semi-automatic data workflow implemented in the R programming language. Datasets include sub-daily time series of sap flow and hydrometeorological drivers for one or more growing seasons, as well as metadata on the stand characteristics, plant attributes, and technical details of the measurements. SAPFLUXNET contains 202 globally distributed datasets with sap flow time series for 2714 plants, mostly trees, of 174 species. SAPFLUXNET has a broad bioclimatic coverage, with woodland/shrubland and temperate forest biomes especially well represented (80 % of the datasets). The measurements cover a wide variety of stand structural characteristics and plant sizes. The datasets encompass the period between 1995 and 2018, with 50 % of the datasets being at least 3 years long. Accompanying radiation and vapour pressure deficit data are available for most of the datasets, while on-site soil water content is available for 56 % of the datasets. Many datasets contain data for species that make up 90 % or more of the total stand basal area, allowing the estimation of stand transpiration in diverse ecological settings. SAPFLUXNET adds to existing plant trait datasets, ecosystem flux networks, and remote sensing products to help increase our understanding of plant water use, plant responses to drought, and ecohydrological processes. SAPFLUXNET version 0.1.5 is freely available from the Zenodo repository (https://doi.org/10.5281/zenodo.3971689; Poyatos et al., 2020a). The “sapfluxnetr” R package – designed to access, visualize, and process SAPFLUXNET data – is available from CRAN.

58 GEOSCIENCES↗
DOE OSTI2021

The fortedata R package: open-science datasets from a manipulative experiment testing forest resilience

The fortedata R package is an open data notebook from the Forest Resilience Threshold Experiment (FoRTE) – a modeling and manipulative field experiment that tests the effects of disturbance severity and disturbance type on carbon cycling dynamics in a temperate forest. Package data consist of measurements of carbon pools and fluxes and ancillary measurements to help analyze and interpret carbon cycling over time. Currently the package includes data and metadata from the first three FoRTE field seasons, serves as a central, updatable resource for the FoRTE project team, and is intended as a resource for external users over the course of the experiment and in perpetuity. Further, it supports all associated FoRTE publications, analyses, and modeling efforts. This increases efficiency, consistency, compatibility, and productivity while minimizing duplicated effort and error propagation that can arise as a function of a large, distributed and collaborative effort. More broadly, fortedata represents an innovative, collaborative way of approaching science that unites and expedites the delivery of complementary datasets to the broader scientific community, increasing transparency and reproducibility of taxpayer-funded science. The fortedata package is available via GitHub: https://github.com/FoRTExperiment/fortedata (last access: 19 February 2021), and detailed documentation on the access, used, and applications of fortedata are available at https://fortexperiment.github.io/fortedata/ (last access: 19 February 2021). The first public release, version 1.0.1 is also archived at https://doi.org/10.5281/zenodo.4399601 (Atkins et al., 2020b). All data products are also available outside of the package as .csv files: https://doi.org/10.6084/m9.figshare.13499148.v1 (Atkins et al., 2020c).

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2013

The AmeriFlux Data Activity and Data System: An Evolving Collection of Data Management Techniques, Tools, Products and Services

The Carbon Dioxide Information Analysis Center (CDIAC) at Oak Ridge National Laboratory (ORNL), USA has provided scientific data management support for the U.S. Department of Energy and international climate change science since 1982. Over this period, climate change science has expanded from research focusing on basic understanding of geochemical cycles, particularly the carbon cycle, to integrated research addressing climate change impacts, vulnerability, adaptation, and mitigation. Interests in climate change data and information worldwide have grown remarkably and, as a result, so have demands and expectations for CDIAC’s data systems. To meet the growing demands, CDIAC’s strategy has been to design flexible data systems using proven technologies blended with new, evolving technologies and standards. CDIAC development teams are multidisciplinary and include computer science and information technology expertise, but also scientific expertise necessary to address data quality and documentation issues and to identify data products and system capabilities needed by climate change scientists. CDIAC has learned there is rarely a single commercial tool or product readily available to satisfy long-term scientific data system requirements (i.e., one size does not fit all and the breadth and diversity of environmental data are often too complex for easy use with commercial products) and typically deploys a variety of tools and data products in an effort to provide credible data freely to users worldwide. Like many scientific data management applications, CDIAC’s data systems are highly customized to satisfy specific scientific usage requirements (e.g., developing data products specific for model use) but are also designed to be flexible and interoperable to take advantage of new software engineering techniques, standards (e.g., metadata standards) and tools and to support future Earth system data efforts (e.g., ocean acidification). CDIAC has provided data management support for numerous long-term measurement projects crucial to climate change science. One current example is the AmeriFlux measurement network. AmeriFlux provides continuous measurements from forests, grasslands, wetlands, and croplands in North, Central, and South America and offers important insight about carbon cycling in terrestrial ecosystems. We share our approaches in satisfying the challenges of delivering AmeriFlux data worldwide to benefit others with similar challenges handling climate change data, further heighten awareness and use of an outstanding ecological data resource, and highlight expanded software engineering applications being used for climate change measurement data.

Boden, Thomas A.↗
DOE OSTI2016

The Niwot Ridge Subalpine Forest US-NR1 AmeriFlux site – Part 1: Data acquisition and site record-keeping

Abstract. The Niwot Ridge Subalpine Forest AmeriFlux site (US-NR1) has been measuring eddy-covariance ecosystem fluxes of carbon dioxide, heat, and water vapor since 1 November 1998. Throughout this 17-year period there have been changes to the instrumentation and improvements to the data acquisition system. Here, in Part 1 of this three-part series of papers, we describe the hardware and software used for data-collection and metadata documentation. We made changes to the data acquisition system that aimed to reduce the system complexity, increase redundancy, and be as independent as possible from any network outages. Changes to facilitate these improvements were (1) switching to a PC/104-based computer running the National Center for Atmospheric Research (NCAR) In-Situ Data Acquisition Software (NIDAS) that saves the high-frequency data locally and over the network, and (2) time-tagging individual 10 Hz serial data samples using network time protocol (NTP) coupled to a GPS-based clock, providing a network-independent, accurate time base. Since making these improvements almost 2 years ago, the successful capture of high-rate data has been better than 99.98 %. We also provide philosophical concepts that shaped our design of the data system and are applicable to many different types of environmental data collection.

54 ENVIRONMENTAL SCIENCES↗