Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Generalized Pareto Distribution”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

Detecting Permafrost Active Layer Thickness Change From Nonlinear Baseflow Recession

We report permafrost underlies about one fifth of the global land area and affects ground stability, freshwater runoff, soil chemistry, and surface-atmosphere gas exchange. The depth of thawed ground overlying permafrost (active layer thickness) has broadly increased across the Arctic in recent decades, coincident with a period of increased streamflow, especially the lowest flows (baseflow). Mechanistic links between active layer thickness and baseflow have recently been explored using linear reservoir theory, but most watersheds behave as nonlinear reservoirs. We derive theoretical nonlinear relationships between long-term average saturated soil thickness $\bar{η}$(proxy for active layer thickness) and long-term average baseflow. When applied to 38 years of daily streamflow data for the Kuparuk River basin on the North Slope of Alaska, the theory predicts $\bar{η}$ increased 0.17 ± 0.22[2σ] cm a -1 between 1983 and 2020 (6.4 ± cm total). The rate of increase nearly doubled to 0.29 ± 0.31 cm a -1 between 1990 and 2020, during which time local field measurements from Circumpolar Active Layer Monitoring sites indicate the active layer increased 0.31 ± 0.22 cm a -1 . The predicted rate of increase more than doubled again between 2002 and 2020, outpacing a near doubling of observed active layer thickening, consistent with trends in terrestrial water storage inferred from Gravity Recovery and Climate Experiment satellite gravimetry and Modern-Era Retrospective Analysis for Research and Applications climate reanalysis. Overall, hydrologic change is accelerating in the Kuparuk River basin, and we provide a theoretical framework for estimating basin-scale changes in active layer water storage from streamflow measurements.

54 ENVIRONMENTAL SCIENCES↗

Algorithm 1028: VTMOP: Solver for Blackbox Multiobjective Optimization Problems

VTMOP is a Fortran 2008 software package containing two Fortran modules for solving computationally expensive bound-constrained blackbox multiobjective optimization problems. VTMOP implements the algorithm of [32], which handles two or more objectives, does not require any derivatives, and produces well-distributed points over the Pareto front. The first module contains a general framework for solving multiobjective optimization problems by combining response surface methodology, trust region methodology, and an adaptive weighting scheme. The second module features a driver subroutine that implements this framework when the objective functions can be wrapped as a Fortran subroutine. Lastly, support is provided for both serial and parallel execution paradigms, and VTMOP is demonstrated on several test problems as well as one real-world problem in the area of particle accelerator optimization.

97 MATHEMATICS AND COMPUTING↗

Active learning enables generation of molecules that advance the known Pareto front

Although generative models hold promise for discovering molecules with optimized desired properties, they often fail to suggest synthesizable molecules that improve upon the properties of the structures represented in the training distribution. We find that this limitation arises not only from the molecule generation process itself, but also from the poor generalization capabilities of molecular property predictors. We address this challenge by creating a closed-loop molecule generation pipeline with iterative retraining on new quantum chemical simulation data. Compared against static, single-pass generative modeling approaches, only our closed-loop iterative workflow generates molecules with properties extending beyond the training distribution (up to 0.44 standard deviations beyond the original range) and achieves a 79% improvement in out-of-distribution molecule classification accuracy. Furthermore, by conditioning molecular generation on thermodynamic stability data obtained during the iterative loop, the proportion of stable and hence potentially synthesizable molecules generated is 3.5x higher than the next-best model.

Chemistry↗

Tula: Optimizing Time, Cost, and Generalization in Distributed Large-Batch Training

Distributed training increases the number of batches processed per iteration either by scaling-out (adding more nodes) or scaling-up (increasing the batch-size). However, the largest configuration does not necessarily yield the best performance. Horizontal scaling introduces additional communication overhead, while vertical scaling is constrained by computation cost and device memory limits. Thus, simply increasing the batch-size leads to diminishing returns: training time and cost decrease initially but eventually plateaus, creating a knee-point in the time/cost vs. batch-size pareto curve. The optimal batch-size therefore depends on the underlying model, data and available compute resources. Large batches also suffer from worse model quality due to the well-known “generalization gap”. In this paper, we present Tula, an online service that automatically optimizes time, cost, and convergence quality for large-batch training of convolutional models. It combines parallel-systems modeling with statistical performance prediction to identify the optimal batchsize. Tula predicts training time and cost within 7.5−14% error across multiple models, and achieves up to 20× overall speedup and improves test accuracy by ≈9% on average over standard large-batch training on various vision tasks, thus successfully mitigating the generalization gap and accelerating training at the same time.

Tyagi, Sahil [ORNL] (ORCID:0009000783144745)↗