Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “production data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Dataset for Evaluation of Extreme Weather Impacts on Utility-Scale Photovoltaic Plant Performance in the United States

This dataset is a fusion of three data types (operations and maintenance tickets, weather data, and production data) that was used to support machine learning analysis and evaluation of drivers for low performance at photovoltaic (PV) sites during compound, extreme weather events. After being processed with machine learning, the data was used in the "Evaluation of Extreme Weather Impacts on Utility-scale Photovoltaic Plant Performance in the United States" manuscript. Additional details are captured in the associated manuscript.

AI↗
DOE OSTI2020

LDM-151: Data Management Science Pipelines Design

The LSST Science Requirements Document (the LSST SRD) specifies a set of data product guidelines, designed to support science goals envisioned to be enabled by the LSST observing program. Following these guidelines, the details of these data products have been described in the LSST Data Products Definition Document (DPDD), and captured in a formal flow-down from the SRD via the LSST System Requirements (LSR), Observatory System Specifications (OSS), to the Data Management System Requirements (DMSR). The LSST Data Management subsystem's responsibilities include the design, implementation, deployment and execution of software pipelines necessary to generate these data products. This document describes the design of the scientific aspects of those pipelines.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Evaluation of Extreme Weather Impacts on Utility-scale Photovoltaic Plant Performance in the United States

The global energy system is undergoing significant changes, including a shift in energy generating technologies to more renewable energy sources. However, the dependence of renewable energy sources on local environmental conditions could also increase disruptions in service through exposures to compound, extreme weather events. By fusing three diverse datasets (operations and maintenance tickets, weather data, and production data), this analysis presents a novel methodology to identify and evaluate performance impacts arising from extreme weather events across diverse geographical regions. Text analysis of maintenance tickets identified snow, hurricanes, and storms as the leading extreme weather events affecting photovoltaic plants in the United States. Statistical techniques and machine learning were then implemented to identify the magnitude and variability of these extreme weather impacts on site performance. Impacts varied between event and non-event days, with snow events causing the greatest reductions in performance (54.5%), followed by hurricanes (12.6%) and storms (1.1%). Machine learning analysis identified key features in determining if a day is categorized as low performing, such as low irradiance, geographic location, weather features, and site size. The analysis improves our understanding of compound, extreme weather event impacts on photovoltaic systems, which can inform planning activities, especially as the industry continues to expand into new geographic and climatic regions around the world.

14 SOLAR ENERGY↗
DOE OSTI2020

APOGEE Data and Spectral Analysis from SDSS Data Release 16: Seven Years of Observations Including First Results from APOGEE-South

The spectral analysis and data products in Data Release 16 (DR16; 2019 December) from the high-resolution near-infrared Apache Point Observatory Galactic Evolution Experiment (APOGEE)-2/Sloan Digital Sky Survey (SDSS)-IV survey are described. Compared to the previous APOGEE data release (DR14; 2017 July), APOGEE DR16 includes about 200,000 new stellar spectra, of which 100,000 are from a new southern APOGEE instrument mounted on the 2.5 m du Pont telescope at Las Campanas Observatory in Chile. DR16 includes all data taken up to 2018 August, including data released in previous data releases. All of the data have been re-reduced and re-analyzed using the latest pipelines, resulting in a total of 473,307 spectra of 437,445 stars. Changes to the analysis methods for this release include, but are not limited to, the use of MARCS model atmospheres for calculation of the entire main grid of synthetic spectra used in the analysis, a new method for filling “holes” in the grids due to unconverged model atmospheres, and a new scheme for continuum normalization. Abundances of the neutron-capture element Ce are included for the first time. A new scheme for estimating uncertainties of the derived quantities using stars with multiple observations has been applied, and calibrated values of surface gravities for dwarf stars are now supplied. Compared to DR14, the radial velocities derived for this release more closely match those in the Gaia DR2 database, and a clear improvement in the spectral analysis of the coolest giants can be seen. The reduced spectra as well as the result of the analysis can be downloaded using links provided on the SDSS DR16 web page.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2020

NGEE Arctic CO2, CH4 and Energy Eddy-Covariance (EC) Flux Tower Auxiliary Measurements, Utqiagvik (Barrow), Alaska, 2012 - 2019

Measurements began in September 2012 and are generally made throughout the snow-free growing season starting from April (pre-thawing) until November (freeze-up) when the instrumentation is taken down for maintenance and instrument calibration. CO2, CH4 and energy fluxes using the Eddy Covariance (EC) technique (Baldocchi 2003) and meteorological measurements are reported as 30-minute averages. The tower site is registered with AmeriFlux as US-NGB. See http://ameriflux.lbl.gov/sites/siteinfo/US-NGB for more information. Reported data include: (1) additional/extra meteorological and eddy covariance CO2, CH4 and energy flux data, (2) binned spectra for the three wind components, the sonic temperature and gas densities together with the binned cospectra for covariances of w (vertical wind component) and gas densities, (3) binned ogives (cumulative (co)spectra) for the three wind components, the sonic temperature and gas densities, and (4) tower site footprint matrices. Meteorological and eddy covariance CO2, CH4 and energy flux data (AmeriFlux BASE data product) are available from AmeriFlux https://doi.org/10.17190/AMF/1436326. The tower site is adjacent to the NGEE Arctic Tram system with several complementary time-series measurements https://doi.org/10.5440/1558782.This dataset supersedes the previously released dataset "Eddy-Covariance and auxiliary measurements, NGEE-Barrow, 2012-2013" DOI:10.5440/1124200 as this new product includes data for the longer time period processed using consistent methods for the entire record. The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research. The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) near Utqiagvik (Barrow), Alaska and 2) multiple areas in the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska. Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Impacts of benchmarking choices on inferred model skill of the Arctic–Boreal terrestrial carbon cycle

Abstract Land surface models require continuous validation against observations to improve and reduce simulation uncertainty. However, inferred model performance can be heavily influenced by subjective choices made in the selection and application of observational data products. A key area often misrepresented by models is the Arctic–Boreal region, which is a potential tipping point region in Earth’s climate system due to large permafrost carbon stocks that are vulnerable to release with climate warming. We use the International Land Model Benchmarking (ILAMB) framework to evaluate how the model skill of TRENDY-v9 models varies based on the choice of observational-based benchmark and how benchmarks are applied in model evaluation. This analysis uses global datasets integrated into ILAMB and new, regionally-specific observational products from the Arctic–Boreal Vulnerability Experiment. Our results cover the overall time period of 1979–2019 and show that model scores can vary substantially depending on the data product applied, with higher model scores indicating better model performance against observations. The lowest model scores occur when benchmarked against regional, compared to global, datasets. We also evaluate observed and modeled functional relationships between ecosystem respiration and air temperature and between gross primary production and precipitation. Here, we find that the magnitude and shape of the responses are strongly impacted by the choice of observational dataset and the approach used to construct the functional relationship benchmark. These results suggest that model evaluation studies could conclude a false sense of model skill if only using a single benchmark data product or if not applying regional data products when performing a regional model analysis. Collectively, our findings highlight the influence of benchmarking choices on model evaluation and point to the need for benchmarking guidelines when assessing model skill.

Poe, Jeralyn (ORCID:0000000318495278)↗
DOE OSTI2024

A mapped dataset of surface ocean acidification indicators in large marine ecosystems of the United States

Mapped monthly data products of surface ocean acidification indicators from 1998 to 2022 on a 0.25° by 0.25° spatial grid have been developed for eleven U.S. large marine ecosystems (LMEs). The data products were constructed using observations from the Surface Ocean CO 2 Atlas, co-located surface ocean properties, and two types of machine learning algorithms: Gaussian mixture models to organize LMEs into clusters of similar environmental variability and random forest regressions (RFRs) that were trained and applied within each cluster to spatiotemporally interpolate the observational data. The data products, called RFR-LMEs, have been averaged into regional timeseries to summarize the status of ocean acidification in U.S. coastal waters, showing a domain-wide carbon dioxide partial pressure increase of 1.4 ± 0.4 μatm yr -1 and pH decrease of 0.0014 ± 0.0004 yr -1 . RFR-LMEs have been evaluated via comparisons to discrete shipboard data, fixed timeseries, and other mapped surface ocean carbon chemistry data products. Regionally averaged timeseries of RFR-LME indicators are provided online through the NOAA National Marine Ecosystem Status web portal.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Atmospheric Carbon and Transport – America (ACT-America) Data Sets: Description, Management, and Delivery

The ACT-America project is a NASA Earth Venture Suborbital-2 mission designed to study the transport and fluxes of greenhouse gases. The open and freely available ACT-America data sets provide airborne in situ measurements of atmospheric carbon dioxide, methane, trace gases, aerosols, clouds, and meteorological properties, airborne remote sensing measurements of aerosol backscatter, atmospheric boundary layer height and columnar content of atmospheric carbon dioxide, tower-based measurements, and modeled atmospheric mole fractions and regional carbon fluxes of greenhouse gases over the Central and Eastern United States. In this study, we conducted 121 research flights during five campaigns in four seasons during 2016–2019 over three regions of the US (Mid-Atlantic, Midwest and South) using two NASA research aircraft (B-200 and C-130). We performed three flight patterns (fair weather, frontal crossings, and OCO-2 underflights) and collected more than 1,140 h of airborne measurements via level-leg flights in the atmospheric boundary layer, lower, and upper free troposphere and vertical profiles spanning these altitudes. We also merged various airborne in situ measurements onto a common standard sampling interval, which brings coherence to the data, creates geolocated data products, and makes it much easier for the users to perform holistic analysis of the ACT-America data products. Here, we report on detailed information of data sets collected, the workflow for data sets including storage and processing of the quality controlled and quality assured harmonized observations, and their archival and formatting for users. Finally, we provide some important information on the dissemination of data products including metadata and highlights of applications of ACT-America data sets.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

AmeriFlux BASE data pipeline to support network growth and data sharing

Abstract AmeriFlux is a network of research sites that measure carbon, water, and energy fluxes between ecosystems and the atmosphere using the eddy covariance technique to study a variety of Earth science questions. AmeriFlux’s diversity of ecosystems, instruments, and data-processing routines create challenges for data standardization, quality assurance, and sharing across the network. To address these challenges, the AmeriFlux Management Project (AMP) designed and implemented the BASE data-processing pipeline. The pipeline begins with data uploaded by the site teams, followed by the AMP team’s quality assurance and quality control (QA/QC), ingestion of site metadata, and publication of the BASE data product. The semi-automated pipeline enables us to keep pace with the rapid growth of the network. As of 2022, the AmeriFlux BASE data product contains 3,130 site years of data from 444 sites, with standardized units and variable names of more than 60 common variables, representing the largest long-term data repository for flux-met data in the world. The standardized, quality-ensured data product facilitates multisite comparisons, model evaluations, and data syntheses.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2023

Validation of the Cloud_CCI (Cloud Climate Change Initiative) cloud products in the Arctic

The role of clouds in the Arctic radiation budget is not well understood. Ground-based and airborne measurements provide valuable data to test and improve our understanding. However, the ground-based measurements are intrinsically sparse, and the airborne observations are snapshots in time and space. Passive remote sensing measurements from satellite sensors offer high spatial coverage and an evolving time series, having lengths potentially of decades. However, detecting clouds by passive satellite remote sensing sensors is challenging over the Arctic because of the brightness of snow and ice in the ultraviolet and visible spectral regions and because of the small brightness temperature contrast to the surface. Consequently, the quality of the resulting cloud data products needs to be assessed quantitatively. In this study, we validate the cloud data products retrieved from the Advanced Very High Resolution Radiometer (AVHRR) post meridiem (PM) data from the polar-orbiting NOAA-19 satellite and compare them with those derived from the ground-based instruments during the sunlit months. The AVHRR cloud data products by the European Space Agency (ESA) Cloud Climate Change Initiative (Cloud_CCI) project uses the observations in the visible and IR bands to determine cloud properties. The ground-based measurements from four high-latitude sites have been selected for this investigation: Hyytiälä (61.84°N, 24.29°E), North Slope of Alaska (NSA; 71.32°N, 156.61°W), Ny-Ålesund (Ny-Å; 78.92°N, 11.93°E), and Summit (72.59°N, 38.42°W). The liquid water path (LWP) ground-based data are retrieved from microwave radiometers, while the cloud top height (CTH) has been determined from the integrated lidar–radar measurements. The quality of the satellite products, cloud mask and cloud optical depth (COD), has been assessed using data from NSA, whereas LWP and CTH have been investigated over Hyytiälä, NSA, Ny-Å, and Summit.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

NGEE Arctic Integrated Modeling (IM3): Improved snow-vegetation interaction

This data product represents the integration of new code capability for arctic tundra snow-vegetation-terrain interactions into the Energy Exascale Earth System Model (E3SM), through the E3SM Land Model (ELM) component. This code integration is the result of collaborative effort between the NGEE Arctic project and the E3SM project. The NGEE Arctic project developed a total of six Integrated Modeling (IM) modules informed by observations and experiments. New ELM capability represented by this data product (IM3) falls into three categories: 1) Downscaling from gridcell to topographic unit level when working through the existing coupler bypass code. 2) Four new parameters (taper, stocking, bendresist, and vegshape) have been added to ELM to allow for flexible definition of snow-vegetation interactions. 3) Vegshape and bendresist parameters are used to calculate the fraction of leaf area and/or stem area buried by snow for a given snow depth. This data record consists of a single document (pdf format) that describes the theoretical basis for the snow-vegetation-terrain interactions added to ELM, and describes the modifications made to the ELM code. The Methods section of this metadata record includes a link to the public E3SM code repository where the exact code modifications as integrated in E3SM can be accessed. The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research. The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska. Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

Thornton, Peter E [ORNL] (ORCID:0000000247595158)↗
DOE OSTI2021

Enabling modern data discovery for atmospheric measurements

The Atmospheric Radiation Measurement (ARM) user facility is a US Department of Energy Office of Science user facility that is managed and operated through a collaborative effort led by nine US Department of Energy national laboratories. The ARM Data Center, located at Oak Ridge National Laboratory, is responsible for the timely collection, processing, and delivery of data products to the scientific community. The ARM Data Center holds more than 11,000 data products, including metadata collected from field campaigns, instruments, value-added products, and principal investigator–contributed data. These data sets are checked for successful transfer (for most data, this transfer is carried out automatically via the network; however, some of the largest data sets and some of the most remote sites require manual shipping of hard disks) and both the data and metadata are processed to a standard format, which is an ARM-standardized structure, via the Network Common Data Form. The Network Common Data Form is a self-describing binary format with many compatible software tools. Once processed, the data are cataloged, stored in the ARM Data Archive, and made discoverable through association with an array of metadata-characterizing information, such as location and measurement classification. These metadata enable powerful search capabilities through the ARM Data Center Data Discovery interface. This paper discusses the workflow of how the new discovery system has been redesigned from user requirements and how the data are distributed to the scientific community.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

Tethered Balloon System Ozone Profiles during CoURAGE Summer Intensive Operational Period Field Campaign Report

During the summer IOP, the small ARM field campaign CRGTBSO3 collected measurements to gain an improved understanding of differences between the atmospheric composition in and just above the marine layer at the CoURAGE TBS site near the eastern shore of Chesapeake Bay. CRGTBSO3 included guest instrumentation with ozone (O 3 ) profile measurements on the TBS and surface O3 and meteorological measurements at the TBS site. An En-Sci 2Z electrochemical cell (ECC) ozonesonde (Komhyr 1969, 1986, Witte et al. 2018) was included on the TBS. The ozonesonde was connected to an InterMet iMet-4RSB radiosonde, and the overall data collected included vertical profiles of ozone, relative humidity, temperature, pressure, and altitude. The CRGTBSO3 iMet-4 radiosonde data is identical to that of the iMet in the Tethered Balloon System Merged Data Product (TBSMERGED; Gaustad and Dexheimer 2025). The TBSMERGED data product also includes meteorological data from a different sensor, the iMet XQ2. In some cases, the iMet XQ2 relative humidity (RH) data may be more accurate than the iMet-4, such as for some instances when the iMet-4 RH data stays at 100% for an extended period throughout a profile.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

sfccldgrid2longstation

The site data in a station data product format used to produce the gridded cloud grid data product, sfccldgrid2caracena.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Version 4 CALIPSO Imaging Infrared Radiometer ice and liquid water cloud microphysical properties – Part I: The retrieval algorithms

Following the release of the version 4 Cloud-Aerosol Lidar with Orthogonal Polarization (CALIOP) data products from the Cloud-Aerosol Lidar and Infrared Pathfinder Satellite Observations (CALIPSO) mission, a new version (version 4; V4) of the CALIPSO Imaging Infrared Radiometer (IIR) Level 2 data products has been developed. The IIR Level 2 data products include cloud effective emissivities and cloud microphysical properties such as effective diameter and ice or liquid water path estimates. Dedicated retrievals for water clouds were added in V4, taking advantage of the high sensitivity of the IIR retrieval technique to small particle sizes. This paper (Part I) describes the improvements in the V4 algorithms compared to those used in the version 3 (V3) release, while results will be presented in a companion (Part II) paper. The IIR Level 2 algorithm has been modified in the V4 data release to improve the accuracy of the retrievals in clouds of very small (close to 0) and very large (close to 1) effective emissivities. To reduce biases at very small emissivities that were made evident in V3, the radiative transfer model used to compute clear-sky brightness temperatures over oceans has been updated and tuned for the simulations using Modern-Era Retrospective analysis for Research and Applications version 2 (MERRA-2) data to match IIR observations in clear-sky conditions. Furthermore, the clear-sky mask has been refined compared to V3 by taking advantage of additional information now available in the V4 CALIOP 5 km layer products used as an input to the IIR algorithm. After sea surface emissivity adjustments, observed and computed brightness temperatures differ by less than ±0.2 K at night for the three IIR channels centered at 08.65, 10.6, and 12.05 µm, and inter-channel biases are reduced from several tens of Kelvin in V3 to less than 0.1 K in V4. We have also improved retrievals in ice clouds having large emissivity by refining the determination of the radiative temperature needed for emissivity computation. The initial V3 estimate, namely the cloud centroid temperature derived from CALIOP, is corrected using a parameterized function of temperature difference between cloud base and top altitudes, cloud absorption optical depth, and CALIOP multiple scattering correction factor. As shown in Part II, this improvement reduces the low biases at large optical depths that were seen in V3 and increases the number of retrievals. As in V3, the IIR microphysical retrievals use the concept of microphysical indices applied to the pairs of IIR channels at 12.05 and 10.6 µm and at 12.05 and 08.65 µm. The V4 algorithm uses ice look-up tables (LUTs) built using two ice habit models from the recent “TAMUice2016” database, namely the single-hexagonal-column model and the eight-element column aggregate model, from which bulk properties are synthesized using a gamma size distribution. Four sets of effective diameters derived from a second approach are also reported in V4. Here, the LUTs are analytical functions relating microphysical index applied to IIR channels 12.05 and 10.6 µm and effective diameter as derived from in situ measurements at tropical and midlatitudes during the Tropical Composition, Cloud, and Climate Coupling (TC4) and Small Particles in Cirrus Science and Operations Plan (SPARTICUS) field experiments.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Size-resolved Eddy-Covariance Particle Flux Measurement during the TRACER Campaign (Final Report)

The main goal of the TRacking Aerosol Convection interactions ExpeRiment (TRACER) campaign was to study aerosol–cloud interactions during deep convection over the Houston area. This project deployed a suite of instrumentation with the aim to (1) quantify turbulent vertical particle fluxes during at DOE-ARM sites, including TRACER, (2) assess hygroscopic growth factors and hygroscopicity parameters of the material driving modal aerosol growth during new particle formation and growth events, (3) derive turbulent aerosol mass fluxes using co-located Doppler LIDAR measurements, and (4) create quality-controlled PI data products to support future research utilizing data collected during the TRACER campaign. This report summarized the main findings from the deployments at two DOE-ARM sites. Briefly, we found that new particle formation may occur aloft, in a residual layer, near the top of the boundary layer. Small grown particles appear later due to downward mixing with daytime turbulence. The species that are responsible for aerosol modal growth had hygroscopicity parameters varying between 0.05 and 0.34. These values systematically depended on the wind sector, suggesting that the chemical composition of the precursors differed. This work demonstrated that lidar retrievals of the elastic backscatter and Doppler velocity can be used to obtain surface number emissions of particles with a diameter greater than 0.53 µm. During TRACER, emission particle number fluxes peaked near ∼ 100 cm−2 s−1. Multiple quality-controlled PI data products that will support future TRACER related science were generated and made publically available.

54 ENVIRONMENTAL SCIENCES↗