Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Adaptive sampling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Port Hope Area Initiative - Port Granby Project: Managing Highly Heterogeneous Low-Level Radioactive Waste - 20327

The Port Granby Project is a large remediation project currently approximately 95% complete. Initial waste characterization was provided through a borehole sampling program. As the waste was excavated, it was found to be highly heterogeneous, ranging from essentially 'clean' material to hundreds of Bq/g. This heterogeneity resulted in constantly changing site conditions. Methods to adapt to these conditions are described. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2020

Adaptive Machine Learning for Bragg Coherent Diffraction Imaging (BCDI) of 3D Electron Density Maps with Application to La 2-x Ba x CuO 4 (LBCO) High Temperature Superconductor Studies [PowerPoint]

Understanding mesoscale heterogeneity is important for evaluating fatigue and failure of structural materials and for manufacturing processes. Data-driven tools can facilitate in guiding effort investment (measurements and computations) at various stages of the materials development. Our 3D reconstruction approach is to find a set of coefficients which define a bounding surface of the electron density. Data for training the 3D CNN was generated by sampling coefficients from uniform distributions. Test vs. prediction values are shown for the 28 even-valued coefficients for 1000 test structures, with the best and worst performers highlighted. The adaptive part of this work utilized a model independent extremum seeking (ES). The predictions of the CNN were used as the starting point for the ES algorithm. The convergence of the ES algorithm for 3 different structures is illustrated, and the robustness of the adaptive ML approach was demonstrated on experimentally measured 3D crystal from high energy diffraction microscopy. Reconstruction of a non-uniform density volume with different levels of Poisson noise is also shown. Preliminary attempts at reconstructing measured La 2-x Ba x CuO 4 diffraction patterns have so far failed.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2021

Total metals & anion concentration data; Slate River floodplain, Crested Butte, CO; May 2020-September 2020

This data package includes processed and undiluted measurements for metal and anion concentrations from pore water (groundwater) samples from the Slate River floodplain of Crested Butte, CO, a focus field site for the SLAC Floodplain Hydro-Biogeochemistry SFA. The data was generated as part of the work targeting the overarching research question for the SLAC SFA: How do ubiquitous subsurface interfaces mediate molecular-scale biogeochemical processes and groundwater quality in floodplains and watersheds? Samples were collected between May and September of 2020. These measurements were all recorded at the Arizona Laboratory for Emerging Contaminants (ALEC) at the University of Arizona located in Tucson, AZ. Groundwater samples were extracted from a network of installed rhizon (Rhizosphere Research Products, part no. 19.60.21F, 0.6 micrometer mesh size) and piezometer wells within the river floodplain. All water samples were shaded from sun exposure during extraction from the subsurface and preserved at 4C until measured at ALEC.Analysis by ICP-MS:Measurements for total metals were made on the Agilent 7700x ICP-MS (for total metals) – Agilent Technologies, Santa Clara, CA.The analytical QA/QC protocol was adapted from US EPA Method 200.8 for analysis by ICP-MS. Calibration standards were prepared from multi-element stock solution (Sigma-Aldrich Multielement standard solution for ICP, St. Louis, MO) using matrix matched to sample solutions (either 2% HCl or HNO3 from AriStar Plus,grade acids from VWR Scientific). Calibration curves include at least 7 points with correlation coefficients > 0.995. The QC protocol includes a continuing calibration blank (CCB), a continuing calibration verification (CCV) solution and at least one quality control sample (QCS) to be analyzed just after calibration and again after every 12 samples and at the completion of the run. The QCS solutions are from an independent source, such as NIST SRM 1643e - Trace Elements in Water, or QCS solutions from High Purity Standards (Charleston, SC). Acceptable QC responses must be between 90 and 110% of the certified value. An internal standard (Rh) is added via on-line addition into the sample line using a mixing tee.Analysis by Ion Chromatography (Anions):The protocol follows Method 4110 in Standard Methods for Examination of Water and Wastewater.The instrument used is the Thermo Scientific Dionex ICS-6000 using AS+AG22 column set for anion analysis with isocratic method using sodium carbonate eluent. Detection is by chemical suppression of eluent conductivity. Quality control solutions and mixed analyte standards purchased from Inorganic Ventures, Christiansburg, VA.All files are in csv format.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

High-Resolution Imaging of Cellulose Organization in Cell Walls by Field Emission Scanning Electron Microscopy

Field emission scanning electron microscopy (FESEM) is a powerful tool for analyzing surface structures of biological and nonbiological samples. However, when it is used to study fine structures of nanometer-sized microfibrils of epidermal cell walls, one often encounters tremendous challenges to acquire clear and undistorted images because of two major issues: (1) Preparation of samples suitable for high resolution imaging; due to the delicateness of some plant materials, such as onion epidermal cell walls, many things can happen during sample processing, which subsequently result in damaged samples or introduce artifacts. (2) Difficulties to acquire clear images of samples which are electron-beam sensitive and prone to charging artifacts at magnifications over 100,000×. In this chapter we described detailed procedures for sample preparation and conditions for high-resolution FESEM imaging of onion epidermal cell walls. Lastly, the methods can be readily adapted for other wall materials.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

A parallel evolutionary multiple-try metropolis Markov chain Monte Carlo algorithm for sampling spatial partitions

We develop an Evolutionary Markov Chain Monte Carlo (EMCMC) algorithm for sampling spatial partitions that lie within a large, complex, and constrained spatial state space. Our algorithm combines the advantages of evolutionary algorithms (EAs) as optimization heuristics for state space traversal and the theoretical convergence properties of Markov Chain Monte Carlo algorithms for sampling from unknown distributions. Local optimality information that is identified via a directed search by our optimization heuristic is used to adaptively update a Markov chain in a promising direction within the framework of a Multiple-Try Metropolis Markov Chain model that incorporates a generalized Metropolis-Hastings ratio. We further expand the reach of our EMCMC algorithm by harnessing the computational power afforded by massively parallel computing architecture through the integration of a parallel EA framework that guides Markov chains running in parallel.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

3x3 array module of 8×8×32 mm 3 position-sensitive virtual frisch-grid CdZnTe detectors for imaging and spectroscopy of cosmic gamma-rays

Here, we evaluated the performance of the 3x3 array of 32-mm long position-sensitive virtual Frisch-grid (VFG) CdZnTe (CZT) detectors read out by the IDEAS GDS-100 data acquisition system. The array is a mechanically solid module designed for integration into a large effective area gamma-ray telescope proposed for imaging and spectroscopy of cosmic gamma-rays. The array employs the bar-shaped 8x8x32 mm 3 CZT crystals which recently became available from Redlen Technologies, Inc. and Kromek-eV Group PLC at affordable costs. The waveform sampling IDE3421 application-specific integrated circuit (ASIC), developed by the University of Michigan and IDEAS for CZT pixel detectors, was adapted to capture the signals from the array's VFG detectors. We showed good spectral performance of the Redlen detectors with an energy resolution of <1% FWHM at 662 keV and slightly poorer performance of the Kromek-eV detectors with a resolution of <2% measured at a reduced temperature of 13 °C. By testing the same detectors as single devices using hybrid charge-sensitive preamplifiers, we demonstrated improved energy resolutions at a normal temperature of ~25°C: <1% and 1.3-1.7%, respectively. However, the Kromek-eV detectors did not perform as well as the Redlen ones. We explained this by the space charge formation (polarization) decreasing the electric field and the electron drift times. The polarization was likely caused by the high injections of holes from the anode contacts. The absence of polarization in Redlen detectors suggested that the quality of the contacts might have played a role in this case.

47 OTHER INSTRUMENTATION↗
DOE OSTI2025

Cybersecurity Enhancement in Digital Substations: Hidden Markov Model-Based Smart Cyber Switching and Threat Response

The rising incidence of cyber-attacks on critical infrastructure and power grids poses significant threats to the stability and reliability of electrical substations, with potentially devastating consequences such as extended blackouts. This paper introduces an advanced cybersecurity framework aimed at safeguarding IEC 61850-based substations through the integration of software-defined networking (SDN) and digital twin (DT) technologies. The proposed DT-based framework employs smart cyber switching (SCS) for proactive threat mitigation and concurrent intelligent electronic device (CIED) for swift system restoration, thereby maintaining continuous operational integrity and robust cybersecurity defenses. Central to this framework is the adaptive port controller (APC), which enables dynamic port management to adapt to evolving threats, and an intrusion detection system (IDS) designed to detect and neutralize malicious attacks on IEC 61850-based sampled value (SV) and generic object-oriented substation event (GOOSE) messages within the substation’s communication network. Further, novel predictive intrusion detection and response (PIDR) algorithm is implemented on a digital substation (DS) to predict the best route to be taken by the attacker. The efficacy of these comprehensive cybersecurity frameworks is validated through rigorous simulations and a hardware-in-the-loop (HIL) testbed, showcasing the system’s ability to sustain substation operations amidst cyber-attacks.

Digital substation↗
DOE OSTI2025

Effects of Subhalos on Interpreting Highly Magnified Sources Near Lensing Caustics

Large magnification factors near gravitational lensing caustics of galaxy-cluster lenses allow the study of individual stars or compact stellar associations at cosmological distances. We study how the presence of sub-galactic subhalos, an inevitable consequence of cold dark matter, can alter the property of caustics and hence change the interpretation of highly magnified sources that lie atop them. First, we consider a galaxy-cluster halo populated with subhalos sampled from a realistic subhalo mass function calibrated to N-body simulations. Then, we compare a semianalytical approximation and an adaptive ray-shooting method that we employ to quantify the property of the caustics. As a case study, we investigate Earendel, a z = 6.2 candidate of magnified single- or multiple-star system with a lone lensed image atop the critical curve in the Sunrise Arc. We find that the source size constraint (≲0.3 pc) previously derived from macrolens models should be relaxed by a factor of a few to 10 when subhalos are accounted for, therefore allowing the possibility of a compact star cluster. The subhalos could introduce an astrometric perturbation that is ≲0$^{"}_{.}$5, which does not contradict observation. These conclusions are largely robust to changes in the subhalo population. Subhalos therefore should be seriously accounted for when interpreting the astrophysical nature of similar highly magnified sources uncovered in recent high-z observations.

Caustic curve↗
DOE OSTI2021

Characterisation of motor cortex organisation in patients with different presentations of persistent low back pain

Abstract Persistence of low back pain is thought to be associated with different underlying pain mechanisms, including ongoing nociceptive input and central sensitisation. We hypothesised that primary motor cortex (M1) representations of back muscles (a measure of motor system adaptation) would differ between pain mechanisms, with more consistent observations in individuals presumed to have an ongoing contribution of nociceptive input consistently related to movement/posture. We tested 28 participants with low back pain sub‐grouped by the presumed underlying pain mechanisms: nociceptive pain, nociplastic pain and a mixed group with features consistent with both. Transcranial magnetic stimulation was used to study M1 organisation of back muscles. M1 maps of multifidus (deep and superficial) and longissimus erector spinae were recorded with fine‐wire electromyography and thoracic erector spinae with surface electromyography. The nociplastic pain group had greater variability in M1 map location (centre of gravity) than other groups ( p < .01), which may suggest less consistency, and perhaps relevance, of motor cortex adaptation for that group. The mixed group had greater overlap of M1 representations between deep/superficial muscles than nociceptive pain (deep multifidus/longissimus: p = .001, deep multifidus/thoracic erector spinae: p = .008) and nociplastic pain (deep multifidus/longissimus: p = .02, deep multifidus/thoracic erector spinae: p = .02) groups. This study provides preliminary evidence of differences in M1 organisation in subgroups of low back pain classified by likely underlying pain mechanisms. Despite the sample size, differences in cortical re‐organisation between subgroups were detected. Differences in M1 organisation in subgroups of low back pain supports tailoring of treatment based on pain mechanism and motor adaptation.

Elgueta‐Cancino, Edith↗
DOE OSTI2020

More chemical detection through less sampling: amplifying chemical signals in hyperspectral data cubes through compressive sensing

Compressive sensing (CS) is a method of sampling which permits some classes of signals to be reconstructed with high accuracy even when they were sampled at sub-Nyquist rates. In this paper we explore a phenomenon in which bandwise CS sampling of a hyperspectral data cube followed by reconstruction can actually result in amplification of chemical signals contained in the cube. Perhaps most surprisingly, chemical signal amplification generally seems to increase as the level of sampling decreases. In some examples, the chemical signal is significantly stronger in a data cube reconstructed from 10% CS sampling than it is in the raw, 100% sampled data cube. We explore this phenomenon in two real-world datasets including the Physical Sciences Inc. Fabry-Perot interferometer sensor multispectral dataset and the Johns Hopkins Applied Physics Lab FTIR-based longwave infrared sensor hyperspectral dataset. Each of these datasets contains the release of a chemical simulant, such as glacial acetic acid, triethyl phospate, and sulfur hexafluoride, and in all cases we use the adaptive coherence estimator (ACE) to detect a target signal in the hyperspectral data cube. We end the paper by suggesting some theoretical justifications for why chemical signals would be amplified in CS sampled and reconstructed hyperspectral data cubes and discuss some practical implications.

Hyperspectral imagery, Compressive Sensing, single↗
DOE OSTI2025

Regional-scale soil carbon predictions can be enhanced by transferring global-scale soil–environment relationships

Accurate modelling and mapping soil organic carbon are crucial for supporting soil health restoration and climate change mitigation at both regional and global scales. However, regional soil predictions often suffer from data scarcity and high prediction uncertainty. Utilizing a pre-trained global-to-regional soil carbon predictive model can be a potential solution to address this challenge. Despite its promise, how to construct and apply the global-scale model to enhance regional-scale soil carbon mapping remains largely unexplored. Here, we propose the Global Soil Carbon Pre-trained Model (GSoilCPM), a deep-learning-based domain adaptative model, to enhance regional-scale soil carbon predictions. Based on large amount of environmental covariate data and 106,167 soil samples across the globe, we verify our hypothesis of the effectiveness of this 'global-to-regional' modelling strategy. The pre-trained model can be then transferred and fine-tuned to bridge the regional- and global-scale soil–environment relationships. We applied and validated this modelling strategy in four regional-scale study areas, three in the Northern Hemisphere and one in the Southern Hemisphere, each with distinct environmental background. Compared to traditional modelling approaches as a baseline, four case studies all demonstrated significant improvement in prediction accuracy across diverse environments and varying data availabilities. The average percentage improvement across all regions is 10.93% (absolute values decreased by 1.20 g kg−1 averagely) in MAE and 29.04% (absolute values increased by 0.10 averagely) in CCC. The applicability and future horizons of using GSoilCPM were further discussed. We further reveal that regions with fewer soil samples or lower baseline accuracy benefit more from the pre-trained global model. Our findings highlight the advantages of leveraging the generalized knowledge from global models to enhance specifically localized soil modelling, positioning a potential paradigm shift in digital soil mapping, and far-reaching implications for soil monitoring and land management.

Deep learning↗
DOE OSTI2023

Time-warping invariant quantum recurrent neural networks via quantum-classical adaptive gating

Adaptive gating plays a key role in temporal data processing via classical recurrent neural networks (RNNs), as it facilitates retention of past information necessary to predict the future, providing a mechanism that preserves invariance to time warping transformations. This paper builds on quantum RNNs (QRNNs), a dynamic model with quantum memory, to introduce a novel class of temporal data processing quantum models that preserve invariance to time-warping transformations of the (classical) input-output sequences. The model, referred to as time warping-invariant QRNN (TWI-QRNN), augments a QRNN with a quantum–classical adaptive gating mechanism that chooses whether to apply a parameterized unitary transformation at each time step as a function of the past samples of the input sequence via a classical recurrent model. The TWI-QRNN model class is derived from first principles, and its capacity to successfully implement time-warping transformations is experimentally demonstrated on examples with classical or quantum dynamics.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Differentially Private Map Matching (DPMM) v1.0

Human mobility trajectories provide valuable information for developing mobility applications, as they contain diverse and rich information about the users. User mobility data is valuable for various applications such as intelligent transportation systems (ITS), commercial business models, and disease-spread models. However, such spatio-temporal traces may pose a threat to user privacy. GPS trajectories in their raw form are not suitable for transportation studies, as they require matching locations with nearest road links — a process called map-matching. This software implements a differential privacy (DP)-based map-matching algorithm, called DPMM, that generates link-level location trajectories in a privacy-preserving manner to protect users' origin destinations (OD) and travel paths. OD privacy is achieved by injecting Planar Laplace noise to the user OD GPS points. Travel-path privacy is provided with randomized travel path construction using exponential DP mechanism. The injected noise level is selected adaptively, by considering the link density of the location and the functional category of the localized links. For path privacy, our mechanism samples waypoints and selects candidate paths between waypoints. DPMM provides privacy effectively with respect to link density instead of other trajectory samples in the database compared to other privacy mechanisms. Compared to the different baseline models our DP-based privacy model offers closer query responses to the raw data in terms of individual and aggregate trajectory-level statistics with an average at absolute deviation from the baseline for individual statistics on ϵ = 1.0. Beyond individual trajectory statistics, the DPMM outperforms the other benchmark DP-based mechanisms on different aggregate statistics with up to 8x improvement in utility.

Peisert, Sean [Lawrence Berkeley National Laborato↗
DOE OSTI2024

The ancestral environment of teosinte populations shapes their root microbiome

Summary Background The composition of the root microbiome affects the host’s growth, with variation in the host genome associated with microbiome variation. However, it is not known whether this intra-specific variation of root microbiomes is a consequence of plants performing targeted manipulations of them to adapt to their local environment or varying passively with other traits. To explore the relationship between the genome, environment and microbiome, we sampled seeds from teosinte populations across its native range in Mexico. We then grew teosinte accessions alongside two modern maize lines in a common garden experiment. Metabarcoding was performed using universal bacterial and fungal primers to profile their root microbiomes. Results The root microbiome varied between the two modern maize lines and the teosinte accessions. We further found that variation of the teosinte genome, the ancestral environment (temperature/elevation) and root microbiome were all correlated. Multiple microbial groups significantly varied in relative abundance with temperature/elevation, with an increased abundance of bacteria associated with cold tolerance found in teosinte accessions taken from high elevations. Conclusions Our results suggest that variation in the root microbiome is pre-conditioned by the genome for the local environment (i.e. non-random). Ultimately, these claims would be strengthened by confirming that these differences in the root microbiome impact host phenotype, for example, by confirming that the root microbiomes of high-elevation teosinte populations enhance cold tolerance.

Genetics & Heredity↗
DOE OSTI2026

Extended Accelerated Stress Testing of Lamination-Free Edge-Sealed Photovoltaic Minimodules

Lamination-free minimodules are constructed with silicon solar cells between glass sheets and an edge seal of polyisobutylene and silicone. These samples are stressed using a repeated sequential testing sequence including ultraviolet-containing simulated solar spectrum light exposure at elevated temperature, damp heat, humidity freeze, and thermal cycling adapted from the International Electrotechnical Commission (IEC) TS 63209-2:2022. The minimodule performance throughout the stressing is characterized by flash testing and electroluminescence imaging. Results are compared to conventional laminated minimodules using the same type of solar cells. The lamination-free minimodules experience up to 8% power loss compared to roughly 3% for the laminated versions. However, those losses, dominated by current and fill factor, are caused by glass soiling and busbar ribbon separation on the cells. When glass is replaced and the stressed cells are contacted with probes bypassing the delaminated ribbons, the initial performance is recovered, and overall losses of the lamination-free samples become negligible.

14 SOLAR ENERGY↗
DOE OSTI2024

Variational inference of effective range parameters for 3 He− 4 He scattering

We use two different methods, Monte Carlo sampling and variational inference (VI), to perform a Bayesian calibration of the effective-range parameters in 3 He– 4 He elastic scattering. The parameters are calibrated to data from a recent set of 3 He– 4 He elastic scattering differential cross section measurements. Analysis of these data for E lab ≤ 4.3 MeV yields a unimodal posterior for which both methods obtain the same structure. However, the effective-range expansion amplitude does not account for the 7/2 − state of 7 Be so, even after calibration, the description of data at the upper end of this energy range is poor. The data up to E lab = 2.6 MeV can be well described, but calibration to this lower-energy subset of the data yields a bimodal posterior. After adapting VI to treat such a multi-modal posterior we find good agreement between the VI results and those obtained with parallel-tempered Monte Carlo sampling.

effective field theory↗
DOE OSTI2022

Machine learning with knowledge constraints for process optimization of open-air perovskite solar cell manufacturing

Perovskite photovoltaics (PV) have achieved rapid development in the past decade in terms of power conversion efficiency of small-area lab-scale devices; however, successful commercialization still requires further development of low-cost, scalable, and high-throughput manufacturing techniques. One of the critical challenges of developing a new fabrication technique is the high-dimensional parameter space for optimization, but machine learning (ML) can readily be used to accelerate perovskite PV scaling. Herein, we present an ML-guided framework of sequential learning for manufacturing process optimization. We apply our methodology to the Rapid Spray Plasma Processing (RSPP) technique for perovskite thin films in ambient conditions. With a limited experimental budget of screening 100 process conditions, we demonstrated an efficiency improvement to 18.5% as the best-in-our-lab device fabricated by RSPP, and we also experimentally found 10 unique process conditions to produce the top-performing devices of more than 17% efficiency, which is 5 times higher rate of success than the control experiments with pseudo-random Latin hypercube sampling. Our model is enabled by three innovations: (a) flexible knowledge transfer between experimental processes by incorporating data from prior experimental data as a probabilistic constraint; (b) incorporation of both subjective human observations and ML insights when selecting next experiments; (c) adaptive strategy of locating the region of interest using Bayesian optimization first, and then conducting local exploration for high-efficiency devices. Furthermore, in virtual benchmarking, our framework achieves faster improvements with limited experimental budgets than traditional design-of-experiments methods (e.g., one-variable-at-a-time sampling). This framework shows the capability of incorporating researchers’ domain knowledge into the ML-guided optimization loop; therefore, it has the potential to facilitate the wider adoption of ML in scaling to perovskite PV manufacturing.

14 SOLAR ENERGY↗
DOE OSTI2026

Soil Water Retention and Hydraulic Conductivity Data and Model at Trail Creek in Taylor River Watershed, Colorado 2024-2025

This data package includes soil water retention and hydraulic conductivity data and model fitting results from measurements of ex-situ soil samples and in-situ soil sensors near Trail Creek. Soil water retention curves (SWRC) characterize soil water content as a function of soil water potential. SWRC depends on soil texture and pore structure and can be used to describe the constraints on biogeochemical processes in terms of soil water availability. In this data package, the sample identification follows the format TR-X-Y, where TR refers to Trail Creek, X is the treatment block identifier, and Y is the location identifier. Specifically, TR-ASCC1 is the control treatment block under the Adaptive Silviculture for Climate Change (ASCC) project, and TR-ASCC2 is the clear-cut treatment block. TR-ASCC-EHSn is associated with ecohydrology sites under the East-Taylor Watershed Community Observatory Sites directory, and TR-ASCC-ERTn (upslope n=1) are ecohydrology sites along the electrical resistivity tomography transects. The sample and location information can be found in metadata.csv, and the data from the soil sensors will be included in a future data version when the observation period becomes sufficiently long for data analysis. Sampling and Measurements Each sample falls into one of the two sampling methods – (1) intact cores or (2) soil sensors – and one of the two measurement methods – (a) laboratory or (b) in-situ. The intact cores were measured using the laboratory methods, which include measurements of soil water potential (HYPROP & WP4C, METER), saturated (KSAT, METER) and unsaturated hydraulic conductivity (HYPROP). The in-situ method uses a pair of co-located soil sensors to measure volumetric water content (TEROS12, METER) and soil water potential (TEROS21, METER), and the hydraulic conductivity was not measured. In comparison, the laboratory methods progress from full saturation to dry conditions, and the in-situ method includes both dry-to-wet and wet-to-dry cycles. The sampling and measurement methods for each sample can be found in metadata.csv, and more information about the measurements is detailed in the Methods section below. Models Retention and hydraulic conductivity data were fitted with four van-Genuchten-type models (specified by “model_name” column in the files): (1) traditional constrained van Genuchten model (“vG_constrained”), (2) traditional unconstrained van Genuchten model (“vG_unconstrained”), (3) PDI-variant of the constrained van Genuchten model (“vG_constrained_PDI”), and (4) PDI-variant of the unconstrained van Genuchten model (“vG_unconstrained_PDI”). The difference between the constrained (1: n) and the unconstrained (2: n, m) van Genuchten models is the number of pore-size distribution parameters in the model equations, giving the unconstrained model more degrees of freedom when fitting the data. Between the traditional and the PDI-variant models, model fitting differs the most at the dry end of the measurements. The traditional models allow infinite suction at the residual water content (water content does not drop below residual water content), and the PDI-variant models enforce a soil water potential value of pF=6.8 (~ -630 MPa) at oven-dryness (water content reaches 0). The inclusion of the van-Genuchten-type models is due to their common application. If other retention models are required, users can access the data in data.csv for further data fitting. More information about the models can be found in the Methods section below. Fitting Tasks The model fitting can be categorized into three levels of tasks (specified by “fitting_task” column in the files). Level 1 (“fit_retention”) only includes retention data fitting (the only level available for the in-situ method). Level 2 (“fit_retention_conductivity”) includes both retention and hydraulic conductivity data fitting, and the saturated hydraulic conductivity (Ks, a parameter of the hydraulic conductivity functions) is fixed by the measurements from KSAT. Level 3 (“fit_retention_conductivity_Ks”) also includes both retention and hydraulic conductivity data fitting, but Ks is a fitted parameter without the constraints from KSAT measurements. Among the same retention models (e.g. vG_constrained models of the same sample), level 1 should produce the best retention data fitting. Level 2 should have the highest misfit of the retention and hydraulic conductivity data, because the retention and hydraulic conductivity functions share common model parameters, and the unsaturated hydraulic conductivity (HYPROP) data fitting is subject to Ks measured independently by KSAT. Level 3 should have mid-level misfits of the retention and hydraulic conductivity data. While level 3 fits the hydraulic conductivity data better than level 2, the fitted Ks value might be unreasonable due to the lack of constraints at the wet end of the measurements. General recommendation when using this data package: (1) Choice of sampling methods: Intact cores might suffer from sample gaps that would lead to overestimation of Ks (sample gaps can be inferred from the “soil_sample_volume” column in metadata.csv when the value is < 249). In-situ method has higher uncertainty in characterizing the wet end of the SWRC because of sensor limitations and the difficulty in reaching full saturation under natural conditions. (2) Choice of fitting tasks: When only retention data is needed, level 1 (“fit_retention”) should be prioritized. When both retention and hydraulic conductivity data are needed, level 2 (“fit_retention_conductivity”) could be prioritized. (3) Choice of models: This could depend on what the downstream models call for. If no specific model is required, model misfit could be used as a ranking criterion. Model misfit values in terms of RMSE can be found in model_parameters.csv. The following files are included in this data package: (1) metadata.csv – This file includes the general information of each sample, including location (description, geocoordinates, elevation), sampling and measurements details (method, depth, time or period, volume, instruments), and soil physical properties (bulk density, saturated hydraulic conductivity, only applicable to physical soil samples). (2) data.csv – This file includes soil water potential, volumetric water content, and unsaturated hydraulic conductivity data of each sample. Column “instrument” specifies the instrument (HYPROP, WP4C, or TEROS) used to perform the measurements. (3) model_fit.csv – This file includes soil water potential, volumetric water content, and unsaturated hydraulic conductivity fitted from the four models and three fitting tasks. Column “model_name” specifies the retention model used, and “fitting_task” specifies the level of data fitting. Missing values indicate that the variable does not apply to that fitting task. (4) model_parameters.csv – This file includes the fitted model parameters, model misfits, and conventional water content thresholds (field capacity and wilting point) from the four models and three fitting tasks. Column “model_name” specifies the retention model used, and “fitting_task” specifies the level of data fitting. Missing values indicate that the parameter does not apply to that model and/or that fitting task. (5) data_Ks.csv – This file includes the saturated hydraulic conductivity measurements from KSAT. (6) /figure/*.png – This folder includes three quick visualizations of the data, retention model fitting results and misfits, and hydraulic conductivity model fitting results, misfits, and parameters. The model fitting results are separated by samples and fitting tasks and colored by models. Zoom-in required. (7) /hyprop/*.bdhx – This folder includes proprietary hyprop files that require the free Labros SoilView-Analysis (METER) to open. Users can explore data fitting using other retention models (i.e. Brooks-Corey, Fredlund-Xing, Kosugi, bimodal models). Be aware that Ks value is pre-entered under “Fitting tab, Conductivity functions parameters” for level 2 fitting. If the value is lost, please refer to metadata.csv under “Ks” column. (8) Six file-level metadata that summarize file, header, column, and variable information of all files. This work was supported by the Watershed Function Science Focus Area at Lawrence Berkeley National Laboratory funded by the US Department of Energy, Office of Science, Biological and Environmental Research under Contract No. DE-AC02-05CH11231.

EARTH SCIENCE > LAND SURFACE > SOILS↗