SEARCH · Engineering Papers

Results for “standardized data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 469 records · Page 26

All sources NASA NTRS DOE OSTI

DOE OSTI2024

Combining compositional data sets introduces error in covariance network reconstruction

Microbial communities are diverse biological systems that include taxa from across multiple kingdoms of life. Notably, interactions between bacteria and fungi play a significant role in determining community structure. However, these statistical associations across kingdoms are more difficult to infer than intra-kingdom associations due to the nature of the data involved using standard network inference techniques. We quantify the challenges of cross-kingdom network inference from both theoretical and practical points of view using synthetic and real-world microbiome data. We detail the theoretical issue presented by combining compositional data sets drawn from the same environment, e.g. 16S and ITS sequencing of a single set of samples, and we survey common network inference techniques for their ability to handle this error. We then test these techniques for the accuracy and usefulness of their intra- and interkingdom associations by inferring networks from a set of simulated samples for which a ground-truth set of associations is known. We show that while the two methods mitigate the error of cross-kingdom inference, there is little difference between techniques for key practical applications including identification of strong correlations and identification of possible keystone taxa (i.e. hub nodes in the network). Furthermore, we identify a signature of the error caused by transkingdom network inference and demonstrate that it appears in networks constructed using real-world environmental microbiome data.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2021

Accuracy of Vaisala RS41 and RS92 Upper Tropospheric Humidity Compared to Satellite Hyperspectral Infrared Measurements

Radiosondes are important for calibrating satellite sensors and assessing sounding retrievals. Vaisala RS41 radiosondes have mostly replaced RS92 in the Global Climate Observing System (GCOS) Reference Upper Air Network (GRUAN) and the conventional network. This study assesses RS41 and RS92 upper tropospheric humidity (UTH) accuracy by comparing with Infrared Atmospheric Sounding Interferometer (IASI) upper tropospheric water vapor absorption spectrum measurements. Using single RS41 and RS92 soundings at three GRUAN and DOE Atmospheric Radiation Measurement (ARM) sites and dual RS92/RS41 launches at three additional GRUAN sites, collocated with cloud-free IASI radiances (OBS), we compute Line-by-Line Radiative Transfer Model radiances for radiosonde profiles (CAL). We analyze OBS-CAL differences from 2015 to 2020, for daytime, nighttime, and dusk/dawn separately if data is available, for standard (STD) RS92 and RS41 processing, and RS92 GRUAN Data Processing (GDP; RS41 GDP is in development). We find that daytime RS41 (even without GDP) has ~1% smaller UTH errors than GDP RS92. RS41 may still have a dry bias of 1–1.5% for both daytime and nighttime, and a similar error for nighttime RS92 GDP, while standard RS92 may have a dry bias of 3–4%. These sonde humidity biases are probably upper limits since “cloud-free” scenes could still be cloud contaminated. Radiances computed from European Centre for Medium-Range Weather Forecasts (ECMWF) analyses match better than radiosondes with IASI measurements, perhaps because ECMWF assimilates IASI measurements. Relative differences between RS41 STD and RS92 GDP, or between radiosondes and ECMWF humidity profiles obtained from the radiance analysis, are consistent with their differences obtained directly from the RH measurements.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2020

Removing flat directions in standard model EFT fits: How polarized electron-ion collider data can complement the LHC

We study the potential of future electron-ion collider (EIC) data to probe four-fermion operators in the Standard Model effective field theory (SMEFT). The ability to perform measurements with both polarized electron and proton beams at the EIC provides a powerful tool that can disentangle the effects from different SMEFT operators. We compare the potential constraints from an EIC with those obtained from Drell-Yan data at the Large Hadron Collider. We show that EIC data play an important complementary role since they probe combinations of Wilson coefficients not accessible through available Drell-Yan measurements.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

DOE OSTI2024

Enhancing Electron Microscopy Image Classification Using Data Augmentation

Manual labeling for machine learning tasks such as image classification is tedious and labor-intensive; as a result, scientific datasets suitable for deep learning applications are scarce and limited. While data augmentation techniques have shown promise for extending image datasets, very little work has been done to understand the impact of combining multiple augmentation methods sequentially or the limits of their effectiveness when combined. Our work addresses this gap by examining how standard and combinatorial data augmentation affects the performance of machine learning models when trained on small datasets for label classification tasks. For our analysis, we generate single, double and quadruple-augmented datasets for a microscopy image classification task using six standard augmentation methods, and compare the resultant improvements observed in binary classification accuracy with three standard image classification models (DenseNet169, MobileNetV2, ResNet101V2). Our experiments show a non-monotonic relationship between the number of simultaneous augmentation methods and classification accuracy, indicating that there is a trade-off between the degree of augmentation and the model performance. These findings suggest that the optimal number of augmentation methods will vary by domain and use case. We also find that the order in which augmentation methods are applied to a limited dataset matters when combining augmentation schemes, with our use case showing performance differences up to 2.6% when the augmentation order is reversed for double-augmented datasets. Our work offers insights to the limits of data augmentation when working on image classification tasks with limited datasets.

Welsman, Jordan A↗

DOE OSTI2026

Extensive analysis of reconstruction algorithms for DESI 2024 baryon acoustic oscillations

Reconstruction of the baryon acoustic oscillation (BAO) signal has been a standard procedure in BAO analyses over the past decade and has helped to improve the BAO parameter precision by a factor of ∼2 on average. The Dark Energy Spectroscopic Instrument (DESI) BAO analysis for the first year (DR1) data uses the “standard” reconstruction framework, in which the displacement field is estimated from the observed density field by solving the linearized continuity equation in redshift space, and galaxy and random positions are shifted in order to partially remove non-linearities. There are several approaches to solving for the displacement field in real survey data, including the multigrid (MG), iterative Fast Fourier Transform (iFFT), and iterative Fast Fourier Transform particle (iFFTP) algorithms. In this work, we analyze these algorithms and compare them with various metrics including two-point statistics and the displacement itself using realistic DESI mocks. We focus on three representative DESI samples, the emission line galaxies (ELG), quasars (QSO), and the bright galaxy sample (BGS), which cover the extreme redshifts and number densities, and potential wide-angle effects. We conclude that the MG and iFFT algorithms agree within 0.4% in post-reconstruction power spectrum on BAO scales with the RecSym convention, which does not remove large-scale redshift space distortions (RSDs), in all three tracers. The RecSym convention appears to be less sensitive to displacement errors than the RecIso convention, which attempts to remove large-scale RSDs. However, iFFTP deviates from the first two; thus, we recommend against using iFFTP without further development. In addition, we provide the optimal settings for reconstruction for five years of DESI observation. The analyses presented in this work pave the way for DESI DR1 analysis as well as future BAO analyses.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2023

Microbiome Metadata Management

Tremendous amounts of microbiome omics data have been generated in recent years, which holds great potential for large-scale studies and metaanalyses. The utility of these datasets is unfortunately limited by their lack of searchability and interoperability. Thorough, standardized metadata is essential for unlocking the scientific discovery potential of disparate datasets. Several national and international initiatives exist to gather and standardize microbiome omics data to improve accessibility and reusability. Continuing to improve consistency in metadata will allow advances in automation and reduction in manual mapping between databases.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2020

Tidal Resource Data from Sequim Bay Inlet, WA, August 2020

Data from a Nortek Signature1000 deployed on a lander for 14 days in Aug 2020 in the entrance to Sequim Bay, WA. Raw data were processed using the DOLfYN python package and standardized using the ME Data Pipeline python package, tsdat version 0.2.12. Processed data were partitioned into 24 hour increments and saved in the NETCDF file format.

16 TIDAL AND WAVE POWER↗

DOE OSTI2024

ARM Metadata Entry and Data Upload Manual

The ARM Metadata Entry and Data Upload Tool, Online Metadata Editor (OME), makes it easy to describe ARM, ASR, and externally funded data products in a standardized way and enables these metadata records and uploaded data to be searchable in the ARM Data Discovery tool. The metadata records provide context for the data and facilitates the discovery and (re)use of the data.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2022

Digitalization of an experimental electrochemical reactor via the smart manufacturing innovation platform

The exponential increase in data produced over the last two decades has revolutionized the way we collect, store, process, analyze, model, and interpret information to improve profitability. Manufacturing is no exception. How- ever, Smart Manufacturing, the digital practice, organization, workforce, and infrastructure transformation for collection and deployment of data and models at scale and at all levels of manufacturing, is a complex, costly, and labor-intensive journey that is still seeing slow adoption. The Clean Energy Smart Manufacturing Innovation Institute (CESMII), a national Manufacturing USA public-private partnership sponsored by the Department of Energy, is addressing this scaled use of data and modeling in manufacturing. CESMII has focused on how to col- lect and use operating data for numerous applications that improve productivity, precision, and performance of manufacturing operations from factory floor to supply chain using process simulation, predictive analytics, mon- itoring and control, and real-time optimization. Because contextualized data are key, CESMII has developed the Smart Manufacturing Innovation Platform (SMIP) to lower the barriers to the data that are needed to accelerate data-based model building, improve data visualization, and more quickly gain insights. Reusable, standards-based ways of doing data collection, ingestion, and contextualization are particularly important for scaling access and use of data. The SMIP uses a standards-based definition and construct for reusable information models called an SM Profile. When an SM Profile is used in conjunction with the SMIP, the SMIP ensures the availability of contextualized, operational data for model building. The present work demonstrates Smart Manufacturing and the application of the SMIP for building several data-centered models for the operation and control of an ex- perimental electrochemical reactor that reduces carbon dioxide (CO 2 ) gas to valuable liquid and gas chemicals, such as alcohols, olefins, and syngas. We describe how the SMIP plays a central role in more effective model building and we demonstrate how the electochemical reactor can be controlled and optimized for the desired products. Use of the SMIP involves the transmission of real-time sensor measurements to a cloud resource so that the operating data are available to all model building experts. The data collection and transmission process is fully automated to greatly reduce the need for manual manipulation of the data. Data-driven machine learning models are used for advanced real-time state estimation, real-time optimization, and model-based feedback control for the reactor. The application models are implemented as a system to monitor the data flow and control the electrochemical reactor with a single visualization interface. SM Profiles are used to demonstrate reusability of the information models for the reactor and the instrumentation. The application packages, algorithms, and user interfaces developed are cast as Docker images in a library to facilitate reusability of the application models.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2023

IAEA PT sample results and analysis [Slides]

Data shows that we need to keep the requirement for matching samples and standards as the set of data from matching standards and samples is qualitatively better with fewer questionable or actionable measurements. Both before and after estimated buoyance corrections.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

DOE OSTI2021

Implementation of a self-consistent slab model of bilayer structure in the SasView suite

Slab models are simple and useful structural descriptions which have long been used to describe lyotropic lamellar phases, such as lipid bilayers. Typically, slab models assume a midline symmetry and break a bilayer structure into three pieces, a central solvent-free core and two symmetric outer layers composed of the soluble portion of the amphiphile and associated solvent. This breakdown matches reasonably well to the distribution of neutron scattering length density and therefore is a convenient and common approach for the treatment of small-angle scattering data. Here, an implementation of this model within the SasView software suite is reported. The implementation is intended to provide physical consistency through the area per amphiphile molecule and number of solvent molecules included within the solvent-exposed outer layer. The proper use of this model requires knowledge of (or good estimates for) the amphiphile and solvent molecule volume and atomic composition, ultimately providing a self-consistent data treatment with only two free parameters: the lateral area per amphiphile molecule and the number of solvent molecules included in the outer region per amphiphile molecule. Here, the use of this code is demonstrated in the fitting of standard lipid bilayer data sets, obtaining structural parameters consistent with prior literature and illustrating the typical and ideal cases of fitting for neutron scattering data obtained using single or multiple contrast conditions. While demonstrated here for lipid bilayers, this model is intended for general application to block copolymers, surfactants, and other lyotropic lamellar phase structures for which a slab model is able to reasonably estimate the neutron scattering length density/electron-density profile of inner and outer layers of the lamellae.

36 MATERIALS SCIENCE↗

DOE OSTI2025

Statistical analysis of the performance and long-term stability of unquenched LSC standards ( 3 H, 14 C) used for radiochemical measurements

Multiple sets of toluene-based unquenched standards, procured over the last 3 decades, were analyzed to determine their stability over time. A statistical analysis was performed to provide insight into the variability for tSIE and counting efficiency measurements of 3 H and 14 C isotopes. Our data suggests that standards remain viable even 30 years after the manufacturer’s recommended expiration date. Overall, these standards have shown no statistically significant sign of performance degradation. We have proven through statistical analysis that these standards can provide comparable performance over time well past their manufactured expiration date.

LSC standards↗

DOE OSTI2025

Uncovering multiscale structure-property correlations via active learning in scanning tunneling microscopy

Atomic arrangements and local sub-structures fundamentally influence emergent material functionalities. These structures are conventionally probed using spatially resolved studies and the property correlations are deciphered by a researcher based on sequential explorations, thereby limiting the efficiency and scope. Here we demonstrate a multi-scale Bayesian deep-learning based framework that automatically correlates material structure with its electronic properties using scanning tunneling microscopy (STM) measurements in real-time. Its predictions are used to autonomously direct exploration toward regions of the sample that optimize a given material property. This method is deployed on a low-temperature ultra-high vacuum STM to understand the structure-property relationship in a europium-based semimetal, EuZn 2 As 2 , a promising candidate relevant to magnetism-driven topological phenomena. The framework employs a sparse-sampling approach to efficiently construct the scalar-property space using minimal measurements, about 1–10% of the data required in standard hyperspectral methods. Moreover, we formulate the problem hierarchically across length scales, implementing autonomous workflow to locate mesoscopic and atomic structures that correspond to a target material property. This framework offers the choice to design scalar-property from the spectroscopic data to steer sample exploration. Our findings reveal correlations of the electronic properties unique to surface terminations, local defect density, and point defects.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

DOE OSTI2021

Soil organic carbon is not just for soil scientists: measurement recommendations for diverse practitioners

Soil organic carbon (SOC) regulates terrestrial ecosystem functioning, provides diverse energy sources for soil microorganisms, governs soil structure, and regulates the availability of organically bound nutrients. Investigators in increasingly diverse disciplines recognize how quantifying SOC attributes can provide insight about ecological states and processes. Today, multiple research networks collect and provide SOC data, and robust, new technologies are available for managing, sharing, and analyzing large data sets. Here, we advocate that the scientific community capitalize on these developments to augment SOC data sets via standardized protocols. We describe why such efforts are important and the breadth of disciplines for which it will be helpful, and outline a tiered approach for standardized sampling of SOC and ancillary variables that ranges from simple to more complex. We target scientists ranging from those with little to no background in soil science to those with more soil-related expertise, and offer examples of the ways in which the resulting data can be organized, shared, and discoverable.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2020

PV Fleet Performance Data Initiative (March 2020 Methodology Report)

Data for thousands of systems by multiple sources were transmitted to NREL for evaluation. Initial automated data quality assurance (QA) checks identified hundreds of systems (QA Tier 1) with high-quality meteorological and AC production data and hundreds of QA Tier 2 systems with adequate data quality. A standard RdTools analysis was conducted for these systems, evaluating performance loss on an annualized basis. To date with the systems evaluated so far, we find a median performance loss rate (aka Rd or degradation rates) for the entire fleet of -0.72%/year based on individual inverter data, which is in line with historical degradation rates previously published for modules and systems (-0.5% to -0.9% / yr, Jordan et al. 2016). A fleet-scale distribution based on revenue-grade meter data rather than inverter AC (alternating current) data yields a slightly different result. We are working to understand the difference between this result and the inverter-based result of -0.72%/year.

14 SOLAR ENERGY↗

DOE OSTI2023

Comparing simulated demand flexibility against actual performance in commercial office buildings

Commercial building energy benchmarking has been used as a mechanism to evaluate energy use of a single building over time, relative to other similar buildings, or to simulations of a reference building conforming to various energy standards. Lack of empirical demand flexibility data and consistent flexibility metrics has limited the ability to compare demand flexibility performance with estimated demand flexibility in buildings. In this study, we collected demand response performance data for a total of 831 demand response events from 192 sites as a first step to build such a building demand flexibility dataset, and propose a standard core data schema to consolidate field data from different sources. We also performed parametric simulations of a control strategy called “global temperature adjustment” using commercial office prototype building models. We then compared the simulated demand flexibility performance against the actual data for offices with global temperature adjustment strategy implemented. During demand response events with an average outside air temperature of 34 °C (range 23 °C–42 °C), the measured demand decrease intensity of the demand flexibility metrics were 6.1 watts per square meter (W/m 2 ), 10.0 W/m 2 , 11.1 W/m 2 , 7.1 W/m 2 , and 4.7 W/m 2 for small, small–medium, medium, medium–large, and large office buildings, respectively. Compared to the measured data in medium- and large-size buildings, the simulated demand decrease intensity was 0.7 W/m 2 (17%) lower on average. The discrepancy between simulated and measured peak demand intensities fell within one standard deviation of the mean measured data. Here, the comparison results validate the credibility of simulations in capturing real building data for assessing the technical potential of building demand flexibility.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2024

Spectral and Temperature-Dependent Optical Metrology: Towards More Robust, Effective and Durable Materials for Concentrated Solar Power

The primary objective of this project is to develop reliable and standardized spectroscopic measurement techniques to determine radiative properties, specifically the emittance and reflectance, of materials relevant for the next generation (Gen3) concentrated solar power (CSP) technologies. Experimental measurements will span near- and mid-infrared wavelengths (1–20 µm) with emphasis on quantifying the influences of: (1) operating temperatures of 25–1000 °C, (2) thermal cycling, and (3) environmental exposure of materials during operation (vacuum/air). A secondary goal is to develop open-access and digitized databases to host and share experimental data, together with standardized measurement protocols and operating procedures to determine optical properties of materials. This project will also include reasonable emphasis on developing predictive modeling tools to augment experimental data to extract more fundamental and material-specific radiative properties.

14 SOLAR ENERGY↗

DOE OSTI2025

National Energy Water Treatment & Speciation (NEWTS): A Water & Critical Mineral Database and Dashboard

The scarcity of water resources, the need for beneficial water reuse, and the challenges of wastewater treatment are becoming increasingly pressing in economic, social, and environmental domains. Addressing these concerns requires effective treatment strategies to manage wastewater streams and tackle environmental and economic issues. Furthermore, the recovery of critical minerals from the waste streams associated with energy production holds the promise of offsetting treatment costs and securing local sources of valuable minerals. However, relevant data on these waste streams are dispersed and challenging to locate. The process of ingesting such data into modeling software often involves multiple steps, requiring data restructuring to meet software-input requirements. The non-standardized reporting of water data makes data aggregation and reformatting a time-consuming process. Additionally, essential attributes necessary for modeling water treatment and mineral scale formation are frequently missing. Moreover, data gaps vary depending on the region of interest. Consequently, there is a pressing need for high-quality energy-water composition data that can be easily imported into water chemistry modeling software. To address this need, the National Energy Technology Laboratory has created the National Energy Water Treatment and Speciation (NEWTS) Database and Dashboard—a free online tool catering to community leaders and water researchers. NEWTS facilitates a comprehensive understanding of the composition of energy-related wastewater streams in the United States. The datasets provide detailed concentrations and speciation of major and minor aqueous compounds in energy-related wastewater streams, including power plant leachate, acid mine drainage, brackish water, and oil and gas produced water across the United States. Many of the aqueous species are critical minerals (Li, REEs) in high demand to modernize the world’s energy infrastructure. Many of the datasets also contain volumetric flow-rates needed to model the treatment and reuse scenarios in advanced aqueous chemistry software programs. The NEWTS Database and Dashboard offer public access to hitherto challenging-to-access datasets, presented in a standardized format that is tailored for easy input into aqueous chemistry modeling software. By performing the work needed to transform dispersed, disparate data sources into unified, model-ready datasets, NEWTS serves as an essential resource in advancing water treatment research and sustainable water resource management.

produced water management↗