Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “sampling variability”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 343 records · Page 19
All sourcesNASA NTRSDOE OSTI
DOE OSTI2019

Uncertainty Quantification of Classifying Mechanical Breach in the Crash and Burn Problem

The prediction of mechanical breach in the Crash and Burn problem is important for designing the full system to minimize the probability of loss of containment. Due to uncertainties in the impact angle, material properties, and material models, it is not possible to define an exact critical impact speed at which the system breaches. Furthermore, the cost of running a large scale sampling study to determine the empirical probability of breach is prohibitive. In this work, surrogate models from machine learning, namely logistic regression and artificial neural networks, are introduced to predict binary classification of pass versus breach from a limited set of samples. The structure and calibration of these classifiers is discussed, and a set of metrics for describing the performance of the classifiers is introduced. The classifiers are used on the UUR version of the Crash model to attempt prediction of failure probability and perform variable sensitivity analysis. Where a single sample of the computational model can take hundreds of CPU-hours, training and evaluating a classifier can take seconds or less, thus giving high predictive power in a relatively short time.

42 ENGINEERING↗
DOE OSTI2018

Land use regression models for the oxidative potential of fine particles (PM2.5) in five European areas

Highlights: • OP moderately correlated (r ~.6) with PM{sub 2.5} mass, NO{sub 2}, and elemental constituents. • OP{sup AA} and OP{sup GSH} LUR models were developed and evaluated for five areas. • Three reasonably performing (R{sup 2}: .45–.58) OP{sup AA} LUR models in hold-out validation. • OP{sup GSH} models were not robust to new coefficients derived against sub-samples of sites. Oxidative potential (OP) of particulate matter (PM) is proposed as a biologically-relevant exposure metric for studies of air pollution and health. We aimed to evaluate the spatial variability of the OP of measured PM{sub 2.5} using ascorbate (AA) and (reduced) glutathione (GSH), and develop land use regression (LUR) models to explain this spatial variability. We estimated annual average values (m{sup −3}) of OP{sup AA} and OP{sup GSH} for five areas (Basel, CH; Catalonia, ES; London-Oxford, UK (no OP{sup GSH}); the Netherlands; and Turin, IT) using PM{sub 2.5} filters. OP{sup AA} and OP{sup GSH} LUR models were developed using all monitoring sites, separately for each area and combined-areas. The same variables were then used in repeated sub-sampling of monitoring sites to test sensitivity of variable selection; new variables were offered where variables were excluded (p > .1). On average, measurements of OP{sup AA} and OP{sup GSH} were moderately correlated (maximum Pearson's maximum Pearson's R = = .7) with PM{sub 2.5} and other metrics (PM{sub 2.5}absorbance, NO{sub 2}, Cu, Fe). HOV (hold-out validation) R{sup 2} for OP{sup AA} models was .21, .58, .45, .53, and .13 for Basel, Catalonia, London-Oxford, the Netherlands and Turin respectively. For OP{sup GSH}, the only model achieving at least moderate performance was for the Netherlands (R{sup 2} = .31). Combined models for OP{sup AA} and OP{sup GSH} were largely explained by study area with weak local predictors of intra-area contrasts; we therefore do not endorse them for use in epidemiologic studies. Given the moderate correlation of OP{sup AA} with other pollutants, the three reasonably performing LUR models for OP{sup AA} could be used independently of other pollutant metrics in epidemiological studies.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Optical Variability of ICRF3 Quasars in the Pan-STARRS 3Pi Survey with Functional Principal Component Analysis

We make use of individual (epoch) detection data from the Pan-STARRS “3π” survey for 2863 optical ICRF3 counterparts in the five wavelength bands g, r, i, z, and y, published as part of the Data Release 2. A dedicated method based on the Functional Principal Component Analysis is developed for these sparse and irregularly sampled data. With certain regularization and normalization constraints, it allows us to obtain uniform and compatible estimates of the variability amplitudes and average magnitudes between the passbands and objects. We find that the starting assumption of affinity of the light curves for a given object at different wavelengths is violated for several percent of the sample. The distributions of rms variability amplitudes are strongly skewed toward small values, peaking at ∼0.1 mag with tails stretching to 2 mag. Statistically, the lowest variability is found for the r band and the largest for the reddest y band. A small “brighter-redder” effect is present, with amplitudes in y greater than amplitudes in g in 57% of the sample. The variability versus redshift dependence shows a strong decline with z toward redshift 3, which we interpret as the time dilation of the dominant time frequencies. The colors of radio-loud ICRF3 quasars are correlated with redshift in a complicated, wavy pattern governed by the emergence of brightest emission lines within the five passbands.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Accelerated fission rate irradiation design, pre-irradiation characterization, and adaptation of conventional PIE methods for U-10Mo and U-17Mo

Metallic U alloys have high U density and thermal conductivity and thus have been explored since the beginning of nuclear power research. Alloys of U with modest amounts of Mo, such as U-10 wt % Mo (U-10Mo), are of particular interest because the γ-U crystal structure in this alloying addition shows prolonged stability in reactor service. Historically, radiation data on U-10Mo fuels were collected in Na fast reactors or lower temperature research reactor conditions, but little is known about irradiation behavior, particularly swelling and creep, at irradiation temperatures between 250 and 500°C. This work discusses the methodology and pre-irradiation characterization results from a U-Mo irradiation campaign performed in the High Flux Isotope Reactor at Oak Ridge National Laboratory. U-10Mo and U-17Mo samples irradiations are being completed at temperatures ranging from 250 to 500°C to three targeted fission densities between 2 × 10 20 and 1.5 × 10 21 fissions per cubic centimeter. Swelling measurement of the specimen sizes studied here required development and assessment of new methods for volume determination before and after irradiation. Laser profilometry and X-ray computation tomography (XCT) were used to provide preirradiation characterization of samples to determine the error and applicability of each to determine swelling following irradiation. These outcomes are contextualized through use of BISON simulations performed to assess the predicted expansion of U-Mo fuels subjected to the irradiation conditions of this work. Use of existing BISON fuel performance models predicted a maximum of 7% swelling under the irradiation conditions of this study. Pre-irradiation characterization revealed the as-cast U-Mo fuel samples were uniformly large-grained fully cubic U crystals with small U-C/N bearing precipitates and pores distributed throughout. Samples were found to contain a bulk porosity between .4 and 3% because of the casting process. Local porosity in areas far from large, interconnected pores was found by Slice-and-View to be under .2%. Nanometer-sized precipitates rich in C and N were identified in all samples, likely because of impurities during the fabrication process. Dendritic bands were also observed throughout the samples. These bands were characterized by variable Mo content that deviated from the overall Mo content by 2–3 wt %. No other microstructural features were correlated to these bands. Mechanical properties were found to be slightly strengthened compared to literature reports of bulk U-Mo fuels due to the nano-scale precipitates throughout the sample.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2020

Mechanical detwinning device for anisotropic resistivity measurements in samples requiring dismounting for particle irradiation

Uniaxial stress is used to detwin samples of orthorhombic iron based superconductors to study their intrinsic electronic anisotropy. Here we describe the development of a new detwinning setup enabling variable-load stress-detwinning with easy sample mounting/dismounting without the need to re-solder the contacts. It enables the systematic study of the anisotropy evolution as a function of an external parameter when the sample is modified between the measurements. In our case, the external parameter is the dose of 2.5 MeV electron irradiation at low temperature. We illustrate the approach by studying resistivity anisotropy in single crystals of Ba 1-x K x Fe 2 As 2 at x =0.25 where the much discussed unusual re-entrance of tetragonal C 4 phase, C 4 → C 2 → C 4 , is observed on cooling. With the described technique we found a significant anisotropy increase in C 2 phase after electron irradiation with dose of 2.35 C/cm 2 .

47 OTHER INSTRUMENTATION↗
DOE OSTI2019

Inclusive search for supersymmetry in pp collisions at $ \sqrt{s}=13 $ TeV using razor variables and boosted object identification in zero and one lepton final states

An inclusive search for supersymmetry (SUSY) using the razor variables is performed using a data sample of proton-proton collisions corresponding to an integrated luminosity of 35.9 fb$^{-1}$, collected with the CMS experiment in 2016 at a center-of-mass energy of $\sqrt{s} =$ 13 TeV. The search looks for an excess of events with large transverse energy, large jet multiplicity, and large missing transverse momentum. The razor kinematic variables are sensitive to large mass differences between the parent particle and the invisible particles of a decay chain and help to identify the presence of SUSY particles. The search covers final states with zero or one charged lepton and features event categories divided according to the presence of a high transverse momentum hadronically decaying W boson or top quark, the number of jets, the number of b-tagged jets, and the values of the razor kinematic variables, in order to separate signal from background for a broad range of SUSY signatures. The addition of the boosted W boson and top quark categories within the analysis further increases the sensitivity of the search, particularly to signal models with large mass splitting between the produced gluino or squark and the lightest SUSY particle. Furthermore, the analysis is interpreted using simplified models of $R$-parity conserving SUSY, focusing on gluino pair production and top squark pair production. Limits on the gluino mass extend to 2.0 TeV, while limits on top squark mass reach 1.14 TeV.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2023

Evaluating various composite sampling modes for detecting pathogenic SARS-CoV-2 virus in raw sewage

Inadequate sampling approaches to wastewater analyses can introduce biases, leading to inaccurate results such as false negatives and significant over- or underestimation of average daily viral concentrations, due to the sporadic nature of viral input. To address this challenge, we conducted a field trial within the University of Tennessee residence halls, employing different composite sampling modes that encompassed different time intervals (1 h, 2 h, 4 h, 6 h, and 24 h) across various time windows (morning, afternoon, evening, and late-night). Our primary objective was to identify the optimal approach for generating representative composite samples of SARS-CoV-2 from raw wastewater. Utilizing reverse transcription-quantitative polymerase chain reaction, we quantified the levels of SARS-CoV-2 RNA and pepper mild mottle virus (PMMoV) RNA in raw sewage. Our findings consistently demonstrated that PMMoV RNA, an indicator virus of human fecal contamination in water environment, exhibited higher abundance and lower variability compared to pathogenic SARS-CoV-2 RNA. Significantly, both SARS-CoV-2 and PMMoV RNA exhibited greater variability in 1 h individual composite samples throughout the entire sampling period, contrasting with the stability observed in other time-based composite samples. Through a comprehensive analysis of various composite sampling modes using the Quade Nonparametric ANCOVA test with date, PMMoV concentration and site as covariates, we concluded that employing a composite sampler during a focused 6 h morning window for pathogenic SARS-CoV-2 RNA is a pragmatic and cost-effective strategy for achieving representative composite samples within a single day in wastewater-based epidemiology applications. This method has the potential to significantly enhance the accuracy and reliability of data collected at the community level, thereby contributing to more informed public health decision-making during a pandemic.

sampling timing↗
DOE OSTI2022

Chronological changes in soil biogeochemical properties of the glacier foreland of Midtre Lovénbreen, Svalbard, attributed to soil-forming factors

We report that Glacier forelands provide an excellent opportunity to investigate vegetation succession and soil development along the chronosequence; however, there are few studies on soil biogeochemical changes from environmental factors, aside from time. This study aimed to investigate soil development and biogeochemical changes in the glacier foreland of Midtre Lovenbreen, Svalbard, by considering various factors, including time. Eighteen vegetation and soil variables were measured at 38 different sampling sites of varying soil age, depth, and glacio-fluvial activity. Soil organic matter (SOM) was quantitatively measured, and the compositional changes in SOM were determined following size-density fractionation. In the topsoil, the soil organic carbon (SOC) and total nitrogen (N) content was found to increase along the soil chronosequence and were highly correlated with vegetation-associated variables. These findings suggest that plant-derived material was the main driver of the light fraction of SOM accumulation in the topsoil. The heavy fractions of SOM were composed of microbially transformed organic compounds, eventually contributing to SOM stabilization within short 90-yr deglaciation under harsh climatic conditions. In addition to time, the soil vertical profiles showed that other environmental parameters, also affected the soil biogeochemical properties. The high total phosphorous (P) content and electrical conductivity in the topsoil were attributed to unweathered subglacial materials and a considerable amount of inorganic ions from subglacial meltwater. The high P and magnesium content in the subsoil were attributed to parent materials, while the high sodium and potassium content in the surface soil were a result of sea-salt deposition. Glacio-fluvial runoff hampered ecosystem development by inhibiting vegetation development and SOM accumulation. This study emphasizes the importance of considering various soil-forming factors, including parent/subglacial materials, aeolian deposition, and glacio-fluvial runoff, as well as soil age, to obtain a comprehensive understanding of the ecosystem development in glacier forelands.

glacio-fluvial runoff↗
DOE OSTI2018

Evaluating temporal controls on greenhouse gas (GHG) fluxes in an Arctic tundra environment: An entropy-based approach

We report that there is significant spatial and temporal variability associated with greenhouse gas (GHG) fluxes in high-latitude Arctic tundra environments. The objectives of this study are to investigate temporal variability in CO 2 and CH 4 fluxes at Barrow, AK and to determine the factors causing this variability using a novel entropy-based classification scheme. In particular, we analyzed which geomorphic, soil, vegetation and climatic properties most explained the variability in GHG fluxes (opaque chamber measurements) during the growing season over three successive years. Results indicate that multi-year variability in CO 2 fluxes was primarily associated with soil temperature variability as well as vegetation dynamics during the early and late growing season. Temporal variability in CH 4 fluxes was primarily associated with changes in vegetation during the growing season and its interactions with primary controls like seasonal thaw. Polygonal ground features, which are common to Arctic regions, also demonstrated significant multi-year variability in GHG fluxes. Our results can be used to prioritize field sampling strategies, with an emphasis on measurements collected at locations and times that explain the most variability in GHG fluxes. For example, we found that sampling primary environmental controls at the centers of high centered polygons in the month of September (when freeze-back period begins) can provide significant constraints on GHG flux variability – a requirement for accurately predicting future changes to GHG fluxes. In conclusion, entropy results document the impact of changing environmental conditions (e.g., warming, growing season length) on GHG fluxes, thus providing clues concerning the manner in which ecosystem properties may be shifted regionally in a future climate.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

A Provably Accurate Randomized Sampling Algorithm for Logistic Regression

In statistics and machine learning, logistic regression is a widely-used supervised learning technique primarily employed for binary classification tasks. When the number of observations greatly exceeds the number of predictor variables, we present a simple, randomized sampling-based algorithm for logistic regression problem that guarantees high-quality approximations to both the estimated probabilities and the overall discrepancy of the model. Our analysis builds upon two simple structural conditions that boil down to randomized matrix multiplication, a fundamental and well-understood primitive of randomized numerical linear algebra. We analyze the properties of estimated probabilities of logistic regression when leverage scores are used to sample observations, and prove that accurate approximations can be achieved with a sample whose size is much smaller than the total number of observations. To further validate our theoretical findings, we conduct comprehensive empirical evaluations. Overall, our work sheds light on the potential of using randomized sampling approaches to efficiently approximate the estimated probabilities in logistic regression, offering a practical and computationally efficient solution for large-scale datasets.

Chowdhury, Agniva↗
DOE OSTI2017

Comparison of a Micro-Neutralization Test with the Rapid Fluorescent Focus Inhibition Test for Measuring Rabies Virus Neutralizing Antibodies

The rapid fluorescent focus inhibition test (RFFIT) is routinely used in the United States to measure rabies virus neutralizing antibodies (rVNA). RFFIT has a long history of reproducible and reliable results. The test has been modified over the years to use smaller volumes of reagents and samples, but requires a 50 µL minimum volume of test serum. To conduct pathogenesis studies, small laboratory animals such as mice are regularly tested for rVNA, but the minimum volume for a standard RFFIT may be impossible to obtain, particularly in scenarios of repeated sampling. To address this problem, a micro-neutralization test was developed previously. In the current study, the micro-neutralization test was compared to the RFFIT using 129 mouse serum samples from rabies vaccine studies. Using a cut-off value of 0.1 IU/mL, the sensitivity, specificity, and concordance of the micro-neutralization test were 100%, 97.5%, and 98%, respectively. The geometric mean titer of all samples above the cut-off was 2.0 IU/mL using RFFIT and 3.4 IU/mL using the micro-neutralization test, indicating that titers determined using the micro-neutralization test are not equivalent to RFFIT titers. Based on four rVNA-positive hamster serum samples, the intra-assay coefficient of variability was 24% and inter-assay coefficient of variability was 30.4%. These results support continued use of the micro-neutralization test to determine rabies virus neutralizing antibody titers for low-volume serum samples.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2016

Dynamic Vertical Profiles of Peat Porewater Chemistry in a Northern Peatland

We measured pH, cations, nutrients, and total organic carbon (TOC) over 3 years to examine weekly to monthly variability in porewater chemistry depth profiles (0–3.0 m) in an ombrotrophic bog in Minnesota, USA. We also compared temporal variation at one location to spatial variation in depth profiles at 16 locations across the bog. Most solutes exhibited large gradients with depth. pH increased by two units and calcium concentrations increased over 20 fold with depth, and may reflect peatland development from minerotrophic to ombrotrophic conditions. Ammonium concentrations increased almost 20 fold and TOC concentrations decreased by half with depth, and these patterns likely reflect mineralization of peat or decomposition of TOC. There was also considerable temporal variation in the porewater chemistry depth profiles. Ammonium, soluble reactive phosphorus, and potassium showed greater temporal variation in near-surface porewater, while pH, calcium, and TOC varied more at depth. This variation demonstrates that deep peat porewater chemistry is not static. Lastly, temporal variation in solute chemistry depth profiles was greater than spatial variation in several instances, especially in shallow porewaters. In conclusion, characterizing both temporal and spatial variability is necessary to ensure representative sampling in peatlands, especially when calculating solute pools and fluxes and parameterizing process-based models.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2018

Variability of urinary pesticide metabolite concentrations during pregnancy in the MARBLES Study

Highlights: • Pyrethroid metabolite, 3-PBA, and organophosphate metabolite, TCPy, were commonly detected in urine samples collected from pregnant women in the MARBLES study, an enriched risk cohort. • Within subject pooling of multiple urine specimens may improve exposure classification for environmental epidemiology studies. • Pesticide metabolite concentrations from multiple pregnancy urine samples had relatively low within-person correlation. Variability of short-lived urinary pesticide metabolites during pregnancy raises challenges for exposure assessment.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2019

Machine-learning error models for approximate solutions to parameterized systems of nonlinear equations

Here, this work proposes a machine-learning framework for constructing statistical models of errors incurred by approximate solutions to parameterized systems of nonlinear equations. These approximate solutions may arise from early termination of an iterative method, a lower-fidelity model, or a projection-based reduced-order model, for example. The proposed statistical model comprises the sum of a deterministic regression-function model and a stochastic noise model. The method constructs the regression-function model by applying regression techniques from machine learning (e.g., support vector regression, artificial neural networks) to map features (i.e., error indicators such as sampled elements of the residual) to a prediction of the approximate-solution error. The method constructs the noise model as a mean-zero Gaussian random variable whose variance is computed as the sample variance of the approximate-solution error on a test set; this variance can be interpreted as the epistemic uncertainty introduced by the approximate solution. This work considers a wide range of feature-engineering methods, data-set-construction techniques, and regression techniques that aim to ensure that (1) the features are cheaply computable, (2) the noise model exhibits low variance (i.e., low epistemic uncertainty introduced), and (3) the regression model generalizes to independent test data. Finally, numerical experiments performed on several computational-mechanics problems and types of approximate solutions demonstrate the ability of the method to generate statistical models of the error that satisfy these criteria and significantly outperform more commonly adopted approaches for error modeling.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Metagenome-assembled genomes from topsoils collected during NEON campaign in East River, CO (06/14/2018-06/28/2018)

The Watershed Function Science Focus Area (WF SFA) at Lawrence Berkeley National Lab is working to build a mechanistic understanding of the distribution and dynamics of biogeochemical processes in mountainous watersheds and their response to perturbation. In June 2018, the NEON (National Ecological Observatory Network) Airborne Observatory Platform (AOP) performed a taskable airborne imaging campaign to collect visible to shortwave infrared (VSWIR) imaging spectroscopy and LiDAR data across 330 km2 in the Upper East River at Crested Butte, CO. We conducted a parallel ground sampling campaign to sample vegetation traits, as well as soil physical, chemical, and microbiological characteristics. We collected these samples from 438 sites across 12 locations spanning much of the elevation, topographic, and geologic variability across the study area. A subset of 250 samples were used for soil metagenomics which is presented here. In addition, at each site, vegetation samples were collected to measure species-specific leaf water content and leaf mass area, foliar elemental composition and foliar CN stable isotope ratios. Soil samples were collected to measure soil physical properties which include bulk density and soil texture analysis. A suite of soil chemical properties was measured from the samples collected at each site, including pH, organic matter, concentrations exchangeable cations, total elemental composition, and the concentrations of extractable N pools (e.g. total free amino acids, ammonium, nitrate, dissolved organic N, and total dissolved N). Additionally, we have measured soil microbial biomass CN stoichiometry. Here, we present 1982 metagenome-assembled genomes (MAGs) for the bacterial and archaeal community from topsoil collected from during NEON 2018 campaign. All metagenomes were sequenced at JGI (Joint Genome Institute) (GOLD Study ID: Gs0149986). Metagenomes were assembled using JGI Metagenome Workflow (10.1128/mSystems.00804-20). The dataset includes (1) zip files for 1982 MAG fasta files (neon_genomes1-5.tar.gz, split into 5 tarballs to keep tarballs under 0.5 GB), (2) neon_Gs0149986_samples_soilproperties_metagenomes.csv: the sample information together with the accession numbers for the underlying metagenomes and the associated soil physical and chemical measurements in NMDC (National Microbiome Data Collaborative) compliant format, (3) neon_Gs0149986.kml: location bounding box file for the sampled locations, (4) samples.csv: sample metadata file used to register Internationall Generic Sample Numbers (IGSNs), (5) flmd.csv: file level metadata file, and (6) dd.csv: data dictionary file. This work was supported by the Watershed Function Science Focus Area at Lawrence Berkeley National Laboratory funded by the US Department of Energy, Office of Science, Biological and Environmental Research under Contract No. DE-AC02-05CH11231.

2018 NEON and 2025 CHESS Campaigns↗
DOE OSTI2016

Data from: Predicting gene function from uncontrolled expression variation among individual wild-type Arabidopsis plants

Gene expression profiling studies are usually performed on pooled samples grown under tightly controlled experimental conditions to suppress variability among individuals and increase experimental reproducibility. In addition, to mask unwanted residual effects, the samples are often subjected to relatively harsh treatments that are unrealistic in a natural context. Here, we show that expression variations among individual wild-type Arabidopsis thaliana plants grown under the same macroscopic growth conditions contain as much information on the underlying gene network structure as expression profiles of pooled plant samples under controlled experimental perturbations. We advocate the use of subtle uncontrolled variations in gene expression between individuals to uncover functional links between genes and unravel regulatory influences. As a case study, we use this approach to identify ILL6 as a new regulatory component of the jasmonate response pathway.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

Simulating water dynamics related to pedogenesis across space and time: Implications for four-dimensional digital soil mapping

Digital soil mapping (DSM) relies on machine-learning and geostatistics to represent soil property observations across space. DSM techniques are powerful but often empirical, being limited to the quality and density of point samples. Water dynamics are closely related to soil variability, and the physics that govern water movement are well known. Hydrological properties can hence be simulated by physical models through space and time, unveiling key characteristics about soils. We propose the use of hydrologic models to map soils across the surface (2D), depth (1D), and time (1D)–which provides a 4D approach to digital soil mapping (4DSM). The Distributed Hydrology Soil Vegetation Model (DHSVM) was applied to a watershed currently under pasture. Moisture sensors and wells were installed at different depths in the watershed on summit, sideslope and toeslope positions to validate the model. DHSVM simulations of soil moisture distribution and depth to saturation were performed during the hydrological year (October 2008-September 2009). Clusters of similar pixels based on soil moisture values were determined using Dynamic Time Warping (DTW) to align temporal data and K-means. Clustering was performed both seasonally and for the entire year. Temporal patterns simulated by DHSVM matched measurements given by moisture sensors and wells. Seasonal clusters differed from the annual cluster. Distinct clusters were observed for each season and with depth, showing that spatiotemporal soil variability is lost when statically assessing soils. Spatiotemporal clusters corroborated field observations of fragipan occurrence not explicitly spatially mapped by Soil Survey Geographic Database (SSURGO). If a connection can be made between water and soils, static and dynamic soil variability can be predicted using physically based hydrologic models. Hydrologic models can benefit soil mapping by enabling reliable 4D simulation of water dynamics, which are fundamental to soil variability and soil classification and directly relate to biological, physical and chemical soil processes not captured by typical soil sampling protocols.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Consistency-Enhanced Evolution for Variable Selection Can Identify Key Chemical Information from Spectroscopic Data

In the last few decades, spectroscopic techniques such as near-infrared (NIR) spectroscopy have gained wide applications in several industries, such as the pharmaceutical, agricultural, oil, and gas industries. As a result, various soft sensors have been developed to predict sample properties from spectroscopic readings. Because the spectroscopic readings at different wavelengths, especially at the adjacent wavelengths, are highly correlated, it has been shown that variable selection could significantly improve a soft sensor’s prediction performance while reducing the model complexity. To improve the prediction performance, most variable selection methods focus on identifying the variables (i.e., wavelengths or wavelength segments) that are strongly correlated with the dependent variable. Although many successful applications have been reported, these variable selection methods do have their limitations. Specifically, the selected wavelengths sometimes show little connection to the chemical bounds or functional groups presenting in the sample. In addition, the selected variables can be quite sensitive to the choice of the training samples. In this work, we address these limitations from a different perspective: if a variable selection algorithm can identify the truly relevant input variables, it should consistently identify the same subset of variables regardless of the choice of the training samples. Therefore, we propose a variable selection method that aims to improve the consistency of variable selection resulting from different training samples. Furthermore, the new algorithm is termed consistency-enhanced evolution for variable selection (CEEVS). To demonstrate the performance and robustness of CEEVS, we compare the proposed method with three representative variable selection methods using five published NIR data sets. These case studies clearly demonstrate that by improving the variable selection consistency, we can not only achieve improved prediction performance, but also identify key chemical information from spectroscopic data.

42 ENGINEERING↗