Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Raw”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 577 records · Page 32
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

An integrated supply chain analysis for cobalt and rare earth elements under global electrification and constrained resources

As global electrification becomes more prominent, demand is projected to increase for electric vehicles (EVs), their components (EV batteries, rare earth traction motors), and their raw materials (cobalt, rare earths). To analyze the supply chain constraints associated with these components and raw materials, a system dynamics model was developed to simulate the interactions between the rare earth and cobalt supply chains. The results showed that under current understanding of raw material resources, production of the projected volume of EVs could be inadequate. To meet the aggressive EV volume sale projections set by the International Energy Agency, EV manufacturers will need to implement a large portion of traction motors without rare earths and utilize non-cobalt batteries as much as possible. On the supply side, a much faster ramp-up than what being modeled would be needed to meet much higher demand than current market forecasts.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2025

Enhancing supply resilience for critical materials: case study of gallium supply in the United States

Accelerating energy technology development will increase demand for critical raw materials, such as gallium, that enable clean energy technologies. Processing of gallium is concentrated in mainland China (98 % of global production in 2023), resulting in high supply risks for importing countries. To investigate pathways for more resilient supply, we develop a material flow analysis and apply it to the United States, showing the impacts of future domestic primary raw material production and end-of-life (EoL) product recycling on reducing import reliance of raw gallium metal. We complement this analysis with a techno-economic assessment of North American gallium production costs under various demand growth scenarios. Our results indicate that sufficient domestic feedstocks exist to meet U.S. demand under most scenarios by 2035, while EoL recycling can supply up to 50 % under a low-demand growth scenario. Domestic primary production shows significant cost advantages over gallium recycling.

Cost analysis↗
DOE OSTI2023

Emergent Constrained Projections of Mean and Extreme Warming in China

Reliable regional temperature projections including heat extremes are essential for climate change adaptation and mitigation. Taking China as an example, simple averages from Coupled Model Intercomparison Project Phase 6 (CMIP6) models project high warming due to sampling many high climate sensitivities in the ensemble. Here, we develop an emergent constraint (EC) framework to obtain constrained mean and daily maximum temperature (TXx) warming over China by using observed global warming and local residual warming. The constrained annual mean and TXx warming over China (2.33°C [1.61–3.05°C] and 2.31°C [1.21–2.99°C]) are 0.65°C [0.04–1.76°C] and 0.63°C [–0.50–2.39°C], respectively, lower than raw projections (2.98°C [1.85–4.22°C] and 2.94°C [2.04–4.39°C]) for 2080–2099 under the intermediate-emission scenario. Approximately half model uncertainty is reduced after constraint. The land area (population) experiencing temperature extremes in our metric is 78% (85%) of the raw projections. Our results imply a lower impact of extreme heat than implied by current raw CMIP6 projections.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Denoising Autoencoder for Reconstructing Sensor Observation Data and Predicting Evapotranspiration: Noisy and Missing Values Repair and Uncertainty Quantification

Abstract Machine learning (ML) methods applied in scientific research often deal with interrelated features in high‐dimensional data. Reducing data noise and redundancy is needed to increase prediction accuracy and efficiency especially when dealing with data from field sensors. We explored an unsupervised learning method, the denoising autoencoder (DAE), to extract the underlying data structure from noisy raw data in the context of predicting hydrologic quantities from multiple field sensors. These sensors have intrinsic instrumental noise and occasional malfunctions that cause missing values. Our DAE neural network reconstructed meteorological sensor data containing noise and missing values to predict evapotranspiration in a mountainous watershed. The DAE reconstructed the sensor variables with a mean coefficient of determination value of 0.77 across 15 dimensions representing individual sensors. It reduced variance and bias uncertainties compared to a classical autoencoder model. The reconstruction quality varied across dimensions depending on their cross‐correlation and alignment with the underlying data structure. Uncertainties arising from the model structure were overall higher than those resulting from data corruption. We attached the DAE structure to a downstream ET‐prediction neural network in three formats and achieved reasonably accurate ET predictions . The use of the DAE notably reduced variance uncertainty in ET prediction. However, excessive variance reduction may be accompanied by an increase in bias due to the intrinsic bias‐variance tradeoff. Our method of evaluating and reducing uncertainties in aggregated data from different sources can be used to improve predictive models, process understanding, and uncertainty quantification for better water resource management. Plain Language Summary We present a machine learning method, namely the denoising autoencoder, which reduces the effects of data noise and missing values typically present in scientific data sets collected through sensor measurements. This method selects the most relevant information from noisy raw data collected by the instruments and fills in missing values. To demonstrate the effectiveness of our method, we applied it to predict evapotranspiration, a hydrologic variable that represents the water moved from the land surface to the atmosphere through a combination of evaporation and plant water use (transpiration). We also used a random sampling technique (the Monte Carlo method) to compare the uncertainty in the predictions when using the raw and noisy data versus the reconstructed data. The denoising process produced more accurate predictions of evapotranspiration with less uncertainty. Improved predictions of evapotranspiration can lead to a better understanding and accounting of water budgets. This ML approach is broadly suitable for a wide variety of applications that involve noisy sensor data with missing values. Key Points We used a denoising autoencoder (DAE) neural network to reduce noise in meteorological and soil sensor observations by on average We used Monte Carlo sampling to estimate the bias and variance of all model outputs, including uncertainty sources from data and the model We attached the DAE component to a downstream neural network to predict ET with the variance reduced by , compared to that without the DAE

denoising autoencoder↗
DOE OSTI2022

Electron energy loss spectroscopy database synthesis and automation of core-loss edge recognition by deep-learning neural networks

Abstract The ionization edges encoded in the electron energy loss spectroscopy (EELS) spectra enable advanced material analysis including composition analyses and elemental quantifications. The development of the parallel EELS instrument and fast, sensitive detectors have greatly improved the acquisition speed of EELS spectra. However, the traditional way of core-loss edge recognition is experience based and human labor dependent, which limits the processing speed. So far, the low signal–noise ratio and the low jump ratio of the core-loss edges on the raw EELS spectra have been challenging for the automation of edge recognition. In this work, a convolutional-bidirectional long short-term memory neural network (CNN-BiLSTM) is proposed to automate the detection and elemental identification of core-loss edges from raw spectra. An EELS spectral database is synthesized by using our forward model to assist in the training and validation of the neural network. To make the synthesized spectra resemble the real spectra, we collected a large library of experimentally acquired EELS core edges. In synthesize the training library, the edges are modeled by fitting the multi-Gaussian model to the real edges from experiments, and the noise and instrumental imperfectness are simulated and added. The well-trained CNN-BiLSTM network is tested against both the simulated spectra and real spectra collected from experiments. The high accuracy of the network, 94.9%, proves that, without complicated preprocessing of the raw spectra, the proposed CNN-BiLSTM network achieves the automation of core-loss edge recognition for EELS spectra with high accuracy.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Machine Learning-Based Extreme Data Reduction for Prompt Supernova Pointing at DUNE

One of the goals of the Deep Underground Neutrino Experiment (DUNE) is to use the massive underground liquid argon time projection chamber (LArTPC) detectors at its far site for multimessenger astronomy (MMA), in the detection of neutrinos from core-collapse supernovae (SNe). Its current baseline trigger strategy detects activity in the detector that is consistent with supernova (SN) neutrinos and saves the raw data for further offline analysis but provides no prompt pointing information crucial for optical follow-ups by other observatories. This approach is based on the assumption that prompt pointing determination using raw data is computationally prohibitive. In this article, we demonstrate a proof-of-concept based on applying extreme data reduction on the buffered SN data in the DUNE data acquisition (DAQ) system’s front-end computers using a machine learning (ML) workflow. This reduces the data by ~5 orders of magnitude, allowing a full track reconstruction to be carried out quickly on a single server. The total time to perform the ML-based data reduction and the full track reconstruction is less than the time to transfer the SN data back to Fermilab or a high-performance computing (HPC) center. This shows that prompt processing of raw SN data is possible and, in fact, trivial once the data have been reduced to reject radiological backgrounds, paving the way to a high-quality SN pointing trigger that is based on fully reconstructed data instead of trigger primitives (TPs).

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2022

DISTEMA: distance map-based estimation of single protein model accuracy with attentive 2D convolutional neural network

Abstract Background Estimation of the accuracy (quality) of protein structural models is important for both prediction and use of protein structural models. Deep learning methods have been used to integrate protein structure features to predict the quality of protein models. Inter-residue distances are key information for predicting protein’s tertiary structures and therefore have good potentials to predict the quality of protein structural models. However, few methods have been developed to fully take advantage of predicted inter-residue distance maps to estimate the accuracy of a single protein structural model. Result We developed an attentive 2D convolutional neural network (CNN) with channel-wise attention to take only a raw difference map between the inter-residue distance map calculated from a single protein model and the distance map predicted from the protein sequence as input to predict the quality of the model. The network comprises multiple convolutional layers, batch normalization layers, dense layers, and Squeeze-and-Excitation blocks with attention to automatically extract features relevant to protein model quality from the raw input without using any expert-curated features. We evaluated DISTEMA’s capability of selecting the best models for CASP13 targets in terms of ranking loss of GDT-TS score. The ranking loss of DISTEMA is 0.079, lower than several state-of-the-art single-model quality assessment methods. Conclusion This work demonstrates that using raw inter-residue distance information with deep learning can predict the quality of protein structural models reasonably well. DISTEMA is freely at https://github.com/jianlin-cheng/DISTEMA

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

Intra-canopy leaf trait variation facilitates high LAI and compensatory growth in a clonal woody encroaching shrub in the tallgrass prairie

This data package contains the data for Tooley et al. (2022) Intra-canopy leaf trait variation facilitates high leaf area index and compensatory growth in a clonal woody encroaching shrub. The purpose of this project was to evaluate the leaf ecophysiological traits of Cornus drummondii C.A. Mey to better understand how C. drummondii maximizes photosynthetic rates across large gradients of light availability in its short, dense canopies. We also evaluate how C. drummondii modifies its allocation of leaf traits in response to grassland disturbance. High LAI canopies and a compensatory growth response to disturbance are two key factors contributing to the success of C. drummondii and other woody species responsible for the encroachment of grasslands.The data package contains ecophysiological measurements, including leaf morphological, physiological, and chemical traits; photosynthetic measurements, leaf carbon and nitrogen stable isotopes, leaf area index, and photosynthetically active radiation. All measurements were taken vertically across canopies of the clonal woody-encroaching shrub Cornus drummondii under browsed, grazed, and control (unbrowsed and ungrazed) conditions.Files:SeasonalMeasurements_Archive.csv - Data for all seasonal measurements used in the study.LeafPhotoSeasonalRaw_Archive.zip - zip file containing raw data from an li-6400 for each sampling period in the study.LAI_Archive.xlsx - Data for LAI Measurements.ACiandLightCurveResults_Archive.xlsx - Contains parameters extracted from A-ci and Light Response curves along with the morphological and chemical traits for each leaf.ACiRaw Archive.xlsx - Raw data from Li-6400 for A-ci response curvesLightCurves_Raw.zip - zip file containing raw data for Li-6400 light response curves. Excel file format: "IslandID"-"Depth"-lc.xlsx (or .csv)DataCollectionMethods.docx - file containing the methods of data collection, processing, and QA/QC for all data files. File also contains a list of excel file headers, abbreviations, and their units.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Data and scripts associated with the manuscript "A Hydrogeophysical Framework to Assess Infiltration During a Simulated Ecosystem-Scale Flooding Experiment”

This package contains the data and scripts used in "A hydrogeophysical framework to assess infiltration during a simulated ecosystem-scale flooding experiment" (Adebayo et al., 2023). The Geophysics folder contains two subfolders containing Ground Penetrating Radar (GPR) and Electrical Resistivity Imaging (ERI) datasets acquired between August 23 and August 26, 2021. The GPR subfolder contains raw data (Tempest_Project.GPZ) and processed results using the Sensors and Software EKKO Project software. The ERI subfolder contains two additional subfolders named Static and Timelapse. The Static subfolder contains background resistivity datasets acquired before infiltration, both raw and inverted results using the ResIpy code. The Timelapse subfolder contains repeated resistivity datasets acquired during infiltration on two profiles, along with raw and inverted results using the ResIpy code. The Flow model folder contains ATS model simulation files. The Geophysics-informed subfolder contains simulation datasets for two profiles generated using information from the geophysics data. The National_database-informed subfolder contains simulation datasets for two profiles generated using information from a national soil database. Each subfolder contains initial simulation results, multiple ensembles, and final simulation files. The Sensitivity_analysis folder contains the observation files exported from the flow model, notebooks used in running the code, and sensitivity analysis results showing the sensitivity of different parameters over a 48-hour period. We used mutual information-based global sensitivity analysis for the sensitivity analysis, following Jiang et al., 2022. This study shows a novel approach that integrates geophysical data with hydrological modeling to understand subsurface flow during coastal flooding.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

CROCUS High-Frequency Measurements of CO₂, H₂O, Wind, and Temperature at University of Illinois Chicago

As of April 9, 2026: this dataset is currently being versioned to include data up to March 31, 2026. Once the versioning process is complete, new data files will be available for access. The dataset metadata will also be updated to reflect the data availability of the new data being versioned. Raw atmospheric measurements collected at the University of Illinois Chicago (UIC) as part of the Community Research on Climate and Urban Science (CROCUS) project. The data includes high-frequency measurements of carbon dioxide (CO₂) concentration, water vapor (H₂O) concentration, wind speed (U, V, W components), temperature, and atmospheric pressure. These raw data are recorded by the LI-7500DS Open Path CO₂/H₂O Analyzer and a sonic anemometer at a 10 Hz acquisition frequency, providing the necessary inputs for calculating fluxes of CO₂, H₂O, heat, and momentum. In addition to gas concentration measurements, the dataset includes diagnostic information from the instruments, including absorptance, sample and reference signals, and diagnostic values. The data were collected to study urban atmospheric conditions and contribute to flux calculations for urban climate research. These measurements form the basis for calculating 30-minute average fluxes of key atmospheric variables using the eddy covariance method. This dataset provides critical raw input data for researchers interested in atmospheric fluxes, urban air quality, and the interaction between the urban environment and atmospheric processes. The data is part of the U.S. Department of Energy’s Biological and Environmental Research (BER) program, under the CROCUS Urban Integrated Field Laboratory (UIFL) project.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Characterization of Soil and Rock Magnetic Properties along Multiple Hillslope Transects at Teller Road Site, Seward Peninsula, Alaska, 2018 and 2023

The magnetometer data was collected in multiple directions across the watershed hillslope at the NGEE Arctic Teller Road site at mile marker 27 (TL_MM27) on the Seward Peninsula, Alaska over multiple years in March 2018 and April 2023. The magnetic data were collected using a Geometrics Inc. G-858 gradiometer and G-857 base station in 2018 and the G-864 gradiometer and G857 base station in 2023. The data was collected (in all instances) by towing the gradiometer behind a snow machine around the watershed with the two sensors in a vertical profile with constant spacing during the continuous survey in that specific year. Magnetic total field measurements were collected by gradiometer and base station, and the data processing was performed in Geometrics MagMap2000 software. The processing steps were limited to removal of data spikes (despiking), reading dropouts, and correction/removal of bad GPS points. All offsets between sensors and GPS are stated within the data files and metadata, alongwith the processed and raw data. The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research. The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska.Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).In this data submission there are two sets of raw magnetic data (.bin and .stn for 2018 and base for 2023; raw rover mag for 2023 is in .csv) inside two .zip files that identify the year the mag data was collected. The data are proprietary format to Geometrics and can be opened and processed with MagMap2000 which can be downloaded for free at Geometrics website. There are also two processed data files *.csv for each year and two metadata files *.csv.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Videos, photos, and AI-derived grain size data associated with “High-throughput AI Video Surveys Enable Reproducible Multiscale Sediment Size Mapping, with Implications for Hydrobiogeochemical Parameterization”

NOTE: The manuscript associated with this data package is currently in review. The data may be revised based on reviewer feedback. Upon manuscript acceptance, this data package will be updated with the final dataset and additional metadata. This data package is associated with the manuscript “High-throughput AI Video Surveys Enable Reproducible Multiscale Sediment Size Mapping, with Implications for Hydrobiogeochemical Parameterization” under review. This data package includes five data types: 1) raw photos and videos from drone survey and walking smartphone surveys; 2) images derived from raw videos; 3) manual labeling of reference scales; 4) metadata for all images and photo resolution derived from artificial intelligence (AI) models or manual labels, 5) grain size data obtained from AI models for all photos, 6) metadata and grain size data after quality control, 7) summaries of sample efficiency for all data, and 8) computational fluid dynamics (CFD) data used to support hydro-biogeochemical (HBGC) parameter estimation. Such data is used to 1) demonstrate significant improvements in accuracy, efficiency, and quality control for grain size data collection with the help of AI models, 2) study the spatial heterogeneity of grain size and observation reproducibility based on tens of thousands of data points generated by the AI models, and 3) evaluate the impacts of grain size heterogeneity on key HBGC parameters across sediment-to-reach and hourly-to-yearly scales. In particular, the data package contains 116 folders and 179696 files. The files include 41 videos in .mov format, 64047 photos in .jpg format, 13541 video-derived photos in .png format, 12747 segmentation mask data in .tif format, 12747 segmentation data in .json format, 24771 .csv files that with metadata and grain size for each individual photo as well as water depth and velocity data from CFD and observation, 51791 .txt files of raw AI predicted labels, and 11 flight record data in .srt format. The summary for all metadata and grain size statistics information is included in “Scales_V3_NG.csv” and “Statistics_V3_NG.csv”. The summary for data that pass data quality control (QC) level 0-2 is included in “QCStatistics_V3_NG.csv”. The QC level 0 represents photos whose photo resolution is positive, excluding photos that miss reference scale. The QC level 1 means reference scale circularity uncertainty is less than 5% for smartphone images while representing photo resolution is larger than 0.44 mm/pixel for drone images. The QC level 2 means excluding photos whose grain number is less than 100, a minimum number of grains recommended by classic literature. The summary for each video’s name, length, frame rates, survey area, grain number, survey efficiency, etc. can be found in “QCSummary_V3_NG.csv”. The summary for site name, GPS coordinates, and number of images at each site can be found in “SitesSummary_V3_*.csv” files. Overall computational efficiency summary is reported in Table 4 of accompanying manuscript. Additionally, the nitrate concentration data used in this work was downloaded from an existing dataset published on ESS-DIVE (Boat-Dragged Sensor Hanford Reach.csv; Conner A. et al., 2020). We thank the United States Forest Service, Washington Department of Fish and Wildlife, Washington Department of Natural Resources, Cowiche Canyon Conservatory, Port of Benton, and the Confederated Tribes and Bands of the Yakama Nation for access to field locations where the data were collected. We also thank the Yakama Nation Tribal Council and Yakama Nation Fisheries for working with us to facilitate data collection and optimization of data usage according to their values and worldview.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

Zero Resistance Ammetry (ZRA) Measurements of Sediment Electrochemical Gradients, Old Woman Creek, Ohio, USA, June–November 2022

This dataset contains raw and processed zero resistance ammetry (ZRA) measurements collected from wetland sediments at Old Woman Creek, a freshwater estuary on Lake Erie, Ohio, USA, between June and November 2022. Measurements were obtained using a vertically deployed electrode array positioned at multiple depths within the sediment profile to capture electrochemical gradients associated with microbial activity and sediment geochemistry. The raw dataset consists of parsed instrument log files containing timestamps, electrode pair identifiers, and measured electrical potential (mV). The processed dataset includes standardized and quality-controlled values with instrument saturation limits removed and timestamps converted to ISO 8601 format. Electrode line identifiers were mapped to physical depths, enabling interpretation of depth-resolved electrochemical gradients. Instrument saturation values (−2048, −2047, 2047, and 2048 mV) were identified as measurement limits and excluded from quantitative analyses. All data parsing, processing, and quality control steps are documented in an accompanying R Markdown script, ensuring full reproducibility from raw instrument logs to final datasets.

EARTH SCIENCE > AGRICULTURE > SOILS > ELECTRICAL C↗
DOE OSTI2026

Water isotope data for the TEMPEST study site, 2023-2026

This dataset contains water isotope (deuterium (dD) and oxygen (d18O)) data from porewater, experimental source water, and aquifer sources from the Terrestrial Ecosystem Manipulation to Probe the Effects of Storm Treatments (TEMPEST) experimental field site in Edgewater, MD. Samples were taken from 2023-2026 and included in file "TEMPEST_Water_Isotope_LANL_2023-2026.csv". Porewater samples were taken from 15cm depth at multiple locations in each experimental plot (i.e., control, freshwater, and saltwater). Water samples were stored in 2 ml amber glass vials with septum caps under refrigeration until analysis. A L2140-i Picarro cavity ringdown spectrometer connected to an A0211 Picarro vaporization module was used to run water samples. Standards (United States Geological Survey (USGS) 47 and 48) were used to check instrument accuracy during each run of samples. Post-processing codes were run to calculate isotopic values from raw data. Reported isotope data is post-processed. Raw data CSV files from the Picarro were processed using a Python script and output as excel files containing data calibrated to Vienna Standard Mean Ocean Water (VSMOW). Standardization is based on USGS47 and USGS48 standards that are measured before and after every 5-10 unknowns. Every measurement is comprised of 10 injections. Processing involved discarding the first 4 injections due to a known memory effect. Raw means of the last 6 injections are taken for each measurement and then corrected from the linear calibration relationship of the USGS standards expected vs measured values to obtain corrected compositions relative to VSMOW. Reported isotope data are corrected mean results.

Aquifer↗
DOE OSTI2026

Field and Model Data Associated with the Manuscript “Drivers of Streamflow Intermittency in Humid Regions: 2. Evaluating Controls on Flow Persistence in an Urbanized Catchment”

This package contains field data, modeling files, and scripts supporting the investigation of the drivers of streamflow intermittency in an urbanized catchment. It includes the field data collected from electrical resistivity tomography (ERT) surveys, distributed temperature sensing (DTS), continuous self-potential (SP) monitoring, groundwater and stilling well. In addition, it contains the data and results of the coupled water- and electrical-flow model developed using the COMSOL Multiphysics and Advanced Terrestrial Simulator (ATS), as well as software files and Jupyter notebooks used to process the data and generate figures in the manuscript submitted for peer review. The data archive is organized in the following directories: 1) Climate Includes hourly precipitation and daily evapotranspiration time series (2024 – 2025) provided as CSV files, alongside a text file detailing dataset units. 2) Coupled_model Field_Application subfolder contains the ATS XML input scripts, data files, output data for the SP site. It also contains the Jupyter notebook (Plot_final_calib.ipynb) to visualize the results of the modeled SP, stream-groundwater exchange and moisture content. The flow model simulation is executed using the ATS XML scripts and the included Python script (generate_data_set.py) to convert ATS output to COMSOL-ready input. COMSOL Multiphysics template (.m can only be used with COMSOL with MATLAB) is executed using the ATS output data to simulate the potential field. 3) Discharge Includes the electrical conductivity (EC) time series (provided as CSV files) from salt slug injections. It also includes the Jupyter notebook (Discharge_process.ipynyb) used to estimate discharge. All discharge measurements collated into rating_curve_processed.csv 4) DTS Contains collated DTS data including raw Stokes and anti-Stokes measurement (provided as .h5 file). It also includes DTS processing.ipynb, a Jupyter notebook for calibrating the DTS data using dts_calibration Python package. cooler_calibration.csv is the DTS calibration CSV used in the calibration sequence. 5) ERT Contains raw resistivity data (provided as CSV files), spatial location of each of the electrodes (provided as CSV files), and files used for the resistivity inversion. 6) Slug_test Includes the slug test data at all the groundwater wells provided as CSV files, as well as the Jupyter notebook (Slug_test.ipynb) for calculating hydraulic conductivity. 7) SP Contains the SP data collected in field at the SP sites (provided as CSV files). 8) Well_data Contains two subfolders: 1) Raw, which provides unprocessed pressure, electrical conductivity and temperature timeseries downloaded from the loggers in all the groundwater and stilling wells, and 2) Processed, which contains sorted, QA/QC timeseries data for each well. The data archive also contains data_process.ipynb, a Jupyter notebook used for field data analysis and generating figures (plotting well, SP, climate, and discharge data, as well as calculating head gradient at sites with nested groundwater wells). Note: Code files (.ipynb, .py, .xml) can be opened in any standard code editor, .exo file can be viewed using Paraview, .h5 files can be opened using HDFView software and h5py Python package, and .resipy file can be opened with the open-source ResIPy software.

ATS↗
DOE OSTI2021

Stem CO2 Efflux measurements from Manaus, Brazil, 2017

This data was collected in order to test the effects of temperatures on the autotrophic respiratory process in the tropics. This data package contains raw real-time stem CO2 efflux files during the night and day from 3 different species near the K34 in Manaus during the day and the night. Raw and derived data files are included in the format of .csv and .xlsx and information about the canopy trees and temperatures recorded can be found in the field event log using microsoft excel. The data was collected from three canopy dominant trees in the central Amazon near the K34 tower. Real-time stem CO2 efflux was determined using a Li7000 gas analyzer configured in differential mode and connected to a dynamic stem chamber secured to the stem at breast height using straps to generate a reasonable seal. Ambient air was continuously pumped into the stem chamber and CO2 concentrations of the air entering and exiting the chamber were continuously monitored. CO2 efflux was calculated based on the CO2 concentration difference between ambient and stem chambers, the flow rate of air through the chamber, and the area of the enclosed stem. Additional auxiliary data, including sap flow and crown temperature were also measured. No data processing or QA/QC was done on the raw data packages.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Ground-based_transient_electromagnetic_data_and_resistivity_models_for_SubTER_BelleCreek_2017-2018

Ground-based transient electromagnetic (TEM) data were acquired in selected locations around Belle Creek, Montana to define the resistivity structure of the near surface. Data were acquired using the ABEM WalkTEM system (Guideline Geo Ab, Sundbyberg, Sweden). TEM data were processed and numerically inverted to derive one-dimensional resistivity structure using SPIA (Aarhus Geosoftware, Aarhus, Denmark). This release includes raw and processed TEM data and resistivity models for each data location using the following structure: Ground-based_transient_electromagnetic_data_and_resistivity_models_for_SubTER_BelleCreek_2017-2018.xml SBC_TEM_2019_SoundingLocationsModels.gdb.zip - file geodatabase with all models and plots attached. This is a mirror of the contents of the model directory. Ground-based_transient_electromagnetic_data_and_resistivity_models_for_SubTER_BelleCreek_2017-2018.zip Data SBC_USF - raw data USF_format_description.pdf - manual describing the USF file format SBC_SoundingID-USF_lookup.csv - table describing the USF file naming convention and channel mapping *.usf files - raw, unprocessed data files SBC_TEM - processed data AarhusInv_manual.pdf - manual describing the TEM file format *.tem files - processed data files Models SBC_Model_Plots - plots of the data and the models for each sounding location TEM_model_data_dictionary.csv - data dictionary describing tabulated models SBC_TEM_models.csv - tabulated models

geophysical surveying↗
DOE OSTI2020

Cognition at the Point of Sensing

Over the last 15 years, compressive sensing techniques have been developed which have the potential to greatly reduce the amount of data collected by systems while preserving the amount of information obtained. A cost of this efficiency is that a computationally-intensive optimization routine must be used to put the sensed data into a form that a person can interpret. At the same time, machine learning techniques have experienced tremendous growth as well. Machines have demonstrated the ability learn how to effectively perform tasks such as detection and classification at speeds much faster than humanly possible. Our goal in this project was to study the feasibility of using compressive sensing systems "at the edge." That is, how can compressive sensing sensors be deployed such that information is created at the remote sensor rather than sending raw data to a central processing location? Studies were performed to analyze whether machine learning could be done on the compressively sensed data in its raw form. If a machine is performing the task, is it possible to do so without putting the data into a human interpretable form? We show that this is possible for some systems, in particular a compressive sensing snapshot imaging spectrometer. Machine learning tasks were demonstrated to be more effective and more robust to noise when the machine learning algorithm worked on data in its raw form. This system is shown to outperform a traditional spectrometer. Techniques for reducing the complexity of the reconstruction routine were also analyzed. Techniques for such as data regularization, deep neural networks, and matrix completion were studied and shown to have benefits over traditional reconstruction techniques. In this project we showed that compressive sensing sensors are indeed feasible at the edge. As always, sensors and algorithms must be carefully tuned to work in the constrained environment. In this project we developed tools and techniques to enable those analyses.

47 OTHER INSTRUMENTATION↗