Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “small dataset”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15

Improving the astrometric solution of the Hyper Suprime-Cam with anisotropic Gaussian processes

Context. We study astrometric residuals from a simultaneous fit of Hyper Suprime-Cam images. Aims. We aim to characterize these residuals and study the extent to which they are dominated by atmospheric contributions for bright sources. Methods. We used Gaussian process interpolation with a correlation function (kernel) measured from the data to smooth and correct the observed astrometric residual field. Results. We find that a Gaussian process interpolation with a von Kármán kernel allows us to reduce the covariances of astrometric residuals for nearby sources by about one order of magnitude, from 30 mas 2 to 3 mas 2 at angular scales of ~1 arcmin. This also allows us to halve the rms residuals. Those reductions using Gaussian process interpolation are similar to recent result published with the Dark Energy Survey dataset. We are then able to detect the small static astrometric residuals due to the Hyper Suprime-Cam sensors effects. We discuss how the Gaussian process interpolation of astrometric residuals impacts galaxy shape measurements, particularly in the context of cosmic shear analyses at the Rubin Observatory Legacy Survey of Space and Time.

79 ASTRONOMY AND ASTROPHYSICS↗

Modeling Multi-View Impedance-Based Cross-Geometry SOH Estimator for Li-ion Batteries

Abstract: Accurately estimating battery’s State of Health (SOH) remains challenging when models must generalize across cell designs and operating conditions. Most Electrochemical Impedance Spectroscopy (EIS)-based approaches either (i) hand-engineer a few Nyquist-plot features for shallow models—fast but does not generalize across geometries—or (ii) learn directly from Nyquist plots with deep networks, which removes manual feature extraction, yet still limited to a single plot type. As a result, cross-geometry robustness and deployability on constrained Internet of Things (IoT) devices remain open problems. We propose a compact Convolutional Neural Network (CNN) (∼ 10k parameters) that takes multi-representation EIS inputs—Nyquist (real/imaginary) and phase–magnitude (|Z|/ϕ) stacked as four channels, so the model can learn complementary degradation signatures while remaining small enough for fast inference. We build a dataset from cyclic aging of two geometries (LG INR18650MJ1 cylindrical cells and LIR2032 coin cells), acquire EIS every ten cycles from 10 kHz to 10 mHz (10 points/decade), and evaluate with leave-one-cell-out testing strategy. We further study fusion vs. single-representation inputs and assess feasibility for on-device deployment (e.g., NVIDIA Jetson device). The results show that training on multiple EIS representations improves SOH estimation accuracy and cross-geometry generalization compared to single-representation models, which uses only Nyquist or phase–magnitude plots. This design targets accurate, generalizable SOH prediction without manual feature engineering while enabling practical real-time use.

Bakr, Ahmed [The University of Alabama (UA)]↗

Deconstructing Solar Photovoltaic Pricing: The Role of Market Structure, Technology, and Policy

Solar photovoltaic (PV) system prices in the United States display considerable heterogeneity both across geographic locations and within a given location. Such heterogeneity may arise due to state and federal policies, differences in market structure, and other factors that influence demand and costs. This paper examines the relative importance of such factors on equilibrium solar PV system prices in the United States using a detailed dataset of roughly 100,000 recent residential and small commercial installations. As expected, we find that PV system prices differ based on characteristics of the systems. More interestingly, we find evidence suggesting that search costs and imperfect competition affect solar PV pricing. Installer density substantially lowers prices, while regions with relatively generous financial incentives for solar PV are associated with higher prices.

14 SOLAR ENERGY↗

The Role of the U.S. Electric Distribution System in Serving Data Center and Other Large Loads

The rapid expansion of data centers in the United States is reshaping how the electric distribution system must plan for and accommodate large load interconnections. This report evaluates the role of the distribution grid in serving these loads, from small edge facilities to hyperscale campuses. Using national datasets, utility filings, and industry studies, we assess demand growth, reliability requirements, interconnection thresholds, and infrastructure needs at substations and feeders. The analysis highlights the mismatch between fast data center development timelines and slower utility planning and construction cycles, as well as strategies such as phased energization, on-site generation, hosting capacity maps, and structured interconnection frameworks. While focused on data centers, the insights also apply to other high-density loads such as advanced manufacturing, hydrogen production, and electrified transportation. The report concludes with approaches to align planning processes, transparency tools, and regulatory frameworks so utilities can manage new large loads in ways that support a reliable and resilient grid.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

SAIL-Net CloudPuck CCN Data

SAIL-Net is a DOE funded project in the East River Watershed near Crested Butte, Colorado with the goal of advancing our understanding of aerosol-cloud interactions in complex, mountainous regions. Through the deployment of a network of six low cost microphysics nodes in Fall 2021 in the same domain at the SAIL campaign, SAIL-Net provides data on aerosol size distributions, cloud condensation nuclei (CCN), and ice nucleations particles (INP). This network enables the investigation of small-scale variations in complex terrain. This specific dataset provides the cleaned data recorded from the CloudPuck, an in house instrument made by Handix Scientific that counts CCN concentrations. The CloudPuck was deployed at the sites for the summer/fall of 2022 before winter conditions were too harsh to maintain the instrument. For more information on the the CloudPuck or how the raw data are processed, see the read me.

54 ENVIRONMENTAL SCIENCES↗

Logic programming and metadata specifications

Artificial intelligence (AI) ideas and techniques are critical to the development of intelligent information systems that will be used to collect, manipulate, and retrieve the vast amounts of space data produced by 'Missions to Planet Earth.' Natural language processing, inference, and expert systems are at the core of this space application of AI. This paper presents logic programming as an AI tool that can support inference (the ability to draw conclusions from a set of complicated and interrelated facts). It reports on the use of logic programming in the study of metadata specifications for a small problem domain of airborne sensors, and the dataset characteristics and pointers that are needed for data access.

Lopez, Antonio M., Jr.↗

The Need for Regular Monitoring and Prediction of Ephemeral Water Bodies in SERVIR Regions

With remote sensing and modeling techniques available today it is possible to regularly identify and monitor the presence of surface water globally, for a wide range of applications. Many of the available datasets and tools, however, do not adequately resolve small or ephemeral water bodies in a timely enough fashion to make local and subnational decisions about water resources management in developing regions. This presentation introduces a specific need focused on a basin in Senegal to develop a capability to identify and disseminate timely information on small and ephemeral water bodies, and we seek feedback on methods proposed to address this need.

Earth science↗

Satellite Level 3 & 4 Data Subsetting at NASA GES DISC

Earth Science data are available in many file formats (NetCDF, HDF, GRB, etc.) and in a wide range of sizes, from kilobytes to gigabytes. These properties have become a challenge to users if they are not familiar with these formats or only want a small region of interest (ROI) from a specific dataset. At NASA Goddard Earth Sciences Data and Information Services Center (GES DISC), we have developed and implemented a multipurpose subset service to ease user access to Earth Science data. Our Level 3 & 4 Regridder is capable of subsetting across multiple parameters (spatially, temporally, by level, and by variable) as well as having additional beneficial features (temporal means, regridding to target grids, and file conversion to other data formats). In this presentation, we will demonstrate how users can use this service to better access only the data they need in the form they require.

subsetting↗

MERIT-Plus Dataset: Delineation of endorheic basins in 5 and 15 min upscaled river networks

Endorheic drainage basins, those inland basins not connected directly to ocean, are essential for hydrological modeling of global and regional water balances, land surface water storage, gravity anomalies, sea level rise, etc. Within many hydrological model frameworks, river basins are defined by digital river networks through their flow direction and connectivity datasets. Here we present an improvement to gridded flow direction data and its derivatives produced from upscaled global 5 and 15 arc minute MERIT networks. We explicitly label endorheic and exorheic drainage basins and alter the delineation of endorheic basins by merging small inland watersheds to the adjacent host basins. The resulting datasets have a significantly reduced number of endorheic basins while preserving the total land portion of those basins since most of the merged catchments were inside other larger endorheic areas. We developed and present here the endorheic basin delineation method. This method performs an analysis of the contributing river and basin geometry relative to the location of the flow end point (i.e. potential endorheic lake), proximity of the latter to the drainage basin boundary and the elevation difference between the basin's lowest point and potential spillover location at the basin boundary. The new digital river network was validated using the University of New Hampshire Water Balance Model by comparing the water balance of endorheic inland depressions with modeled accumulation of water in their inland lakes based on the observed historical climate drivers used by WBM.

Earth Systems↗

MERIT-Plus Dataset: Delineation of endorheic basins in 5 and 15 min upscaled river networks

Endorheic drainage basins, those inland basins not connected directly to ocean, are essential for hydrological modeling of global and regional water balances, land surface water storage, gravity anomalies, sea level rise, etc. Within many hydrological model frameworks, river basins are defined by digital river networks through their flow direction and connectivity datasets. Here we present an improvement to gridded flow direction data and its derivatives produced from upscaled global 5 and 15 arc minute MERIT networks. We explicitly label endorheic and exorheic drainage basins and alter the delineation of endorheic basins by merging small inland watersheds to the adjacent host basins. The resulting datasets have a significantly reduced number of endorheic basins while preserving the total land portion of those basins since most of the merged catchments were inside other larger endorheic areas. We developed and present here the endorheic basin delineation method. This method performs an analysis of the contributing river and basin geometry relative to the location of the flow end point (i.e. potential endorheic lake), proximity of the latter to the drainage basin boundary and the elevation difference between the basin's lowest point and potential spillover location at the basin boundary. The new digital river network was validated using the University of New Hampshire Water Balance Model by comparing the water balance of endorheic inland depressions with modeled accumulation of water in their inland lakes based on the observed historical climate drivers used by WBM.

Earth Systems↗

MERIT-Plus Dataset: Delineation of endorheic basins in 5 and 15 min upscaled river networks

Endorheic drainage basins, those inland basins not connected directly to ocean, are essential for hydrological modeling of global and regional water balances, land surface water storage, gravity anomalies, sea level rise, etc. Within many hydrological model frameworks, river basins are defined by digital river networks through their flow direction and connectivity datasets. Here we present an improvement to gridded flow direction data and its derivatives produced from upscaled global 5 and 15 arc minute MERIT networks. We explicitly label endorheic and exorheic drainage basins and alter the delineation of endorheic basins by merging small inland watersheds to the adjacent host basins. The resulting datasets have a significantly reduced number of endorheic basins while preserving the total land portion of those basins since most of the merged catchments were inside other larger endorheic areas. We developed and present here the endorheic basin delineation method. This method performs an analysis of the contributing river and basin geometry relative to the location of the flow end point (i.e. potential endorheic lake), proximity of the latter to the drainage basin boundary and the elevation difference between the basin's lowest point and potential spillover location at the basin boundary. The new digital river network was validated using the University of New Hampshire Water Balance Model by comparing the water balance of endorheic inland depressions with modeled accumulation of water in their inland lakes based on the observed historical climate drivers used by WBM.

Earth Systems↗

MERIT-Plus Dataset: Delineation of endorheic basins in 5 and 15 min upscaled river networks

Endorheic drainage basins, those inland basins not connected directly to ocean, are essential for hydrological modeling of global and regional water balances, land surface water storage, gravity anomalies, sea level rise, etc. Within many hydrological model frameworks, river basins are defined by digital river networks through their flow direction and connectivity datasets. Here we present an improvement to gridded flow direction data and its derivatives produced from upscaled global 5 and 15 arc minute MERIT networks. We explicitly label endorheic and exorheic drainage basins and alter the delineation of endorheic basins by merging small inland watersheds to the adjacent host basins. The resulting datasets have a significantly reduced number of endorheic basins while preserving the total land portion of those basins since most of the merged catchments were inside other larger endorheic areas. We developed and present here the endorheic basin delineation method. This method performs an analysis of the contributing river and basin geometry relative to the location of the flow end point (i.e. potential endorheic lake), proximity of the latter to the drainage basin boundary and the elevation difference between the basin's lowest point and potential spillover location at the basin boundary. The new digital river network was validated using the University of New Hampshire Water Balance Model by comparing the water balance of endorheic inland depressions with modeled accumulation of water in their inland lakes based on the observed historical climate drivers used by WBM.

Earth Systems↗

Scaling the Earth System Grid to 100Gbps Networks

The SC11 demonstration, titled Scaling the Earth System Grid to 100Gbps Networks, showed the ability to use underlying infrastructure for the movement of climate data over 100Gbps network. Climate change research is one of the critical data intensive sciences, and the amount of data is continuously growing. Climate simulation data is geographically distributed over the world, and it needs to be accessed from many sources for fast and efficient analysis and inter-comparison of simulations. We used a 100Gbps link connecting National Energy Research Scientific Computing Center (NERSC) at Lawrence Berkeley National Laboratory (LBNL), Argonne National Laboratory (ANL) and Oak Ridge National Laboratory (ORNL). In the demo, the Intergovernmental Panel on Climate Change (IPCC) Fourth Assessment Report (AR4) phase 3 of the Coupled Model Intercomparison Project (CMIP-3) dataset was staged into the memory of computing nodes at ANL and ORNL from NERSC over the 100Gbps network for analysis and visualization. In general, climate simulation data consists of relatively small and large files with irregular file size distribution in each dataset. In this demo, we addressed challenges on data management in terms of high bandwidth networks, usability of existing protocols and middleware tools, and how applications can adapt and benefit from next generation networks.

97 MATHEMATICS AND COMPUTING↗

A dataset for understanding self-reported patterns influencing residential energy decisions

Household occupant behavior and decision-making dynamics substantially impact technology uptake and residential building energy performance. Although significant research underscores the importance of social science in energy studies, few public data with representative samples on household energy decision-making patterns are available. The dataset (UPGRADE-E: Understanding Patterns Guiding Residential Adoption and Decisions about Energy Efficiency) presents 9,919 responses from U.S. residents of single-family and small multifamily homes. Derived from a national-scale internet survey, the dataset contains 391 variables: demographics, building characteristics, home modifications, willingness to adopt new technologies, motivations for making changes, barriers, program participation, trusted information sources, and energy scenarios. Responses were validated via internal consistency checks and comparison with other U.S. national scale datasets. UPGRADE-E advances knowledge of household energy related decision-making, tying demographics, home modifications, and self-reported cognitive drivers together at a scale and breadth that has not been previously achieved. Policymakers and researchers at local, regional, and national levels may leverage this dataset to understand drivers influencing the adoption of key technologies in U.S. homes.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Enhancing dimensionality prediction in hybrid metal halides via feature engineering and class-imbalance mitigation

We present a machine learning (ML) framework for predicting the structural dimensionality of hybrid metal halides (HMHs), including organic-inorganic perovskites, using a combination of chemically-informed feature engineering and advanced class-imbalance handling techniques. This study is motivated by the small and highly imbalanced nature of experimentally available HMH datasets, which limits the applicability and reliability of conventional ML approaches. The dataset, consisting of 494 HMH structures, is highly imbalanced across dimensionality classes (0D, 1D, 2D, 3D), posing significant challenges to predictive modeling. To mitigate this limitation, the dataset was augmented to 1336 samples using the synthetic minority oversampling technique, enabling improved learning of underrepresented dimensionality classes while preserving chemically meaningful feature relationships. We developed interaction-based descriptors designed to capture coupled steric and polarity effects relevant to dimensionality prediction, which are not readily captured by standard single-parameter or composition-only descriptors. These descriptors are integrated into a multi-stage workflow combining feature selection, ensemble stacking, and performance optimization. Our approach significantly improves F1-scores for underrepresented classes, achieving robust cross-validation performance across all dimensionalities. This work demonstrates a generalizable strategy for extracting reliable and interpretable structure–dimensionality relationships from limited experimental data, enabling pre-synthesis screening of organic cations and providing a practical blueprint for small-data ML in hybrid materials systems.

36 MATERIALS SCIENCE↗

Quantum mechanical dataset of 836k neutral closed-shell molecules with up to 5 heavy atoms from C, N, O, F, Si, P, S, Cl, Br

Abstract We introduce the Vector-QM24 (VQM24) dataset comprehensively covering all possible neutral closed-shell small organic and inorganic molecules with up to five heavy (p-block) atoms: C, N, O, F, Si, P, S, Cl, Br. All valid stoichiometries, Lewis-rule-consistent graphs, and stable conformers (identified via GFN2-xTB) were enumerated combinatorially, yielding 577k conformational isomers spanning 258k constitutional isomers and 5,599 unique stoichiometries. DFT (ωB97X-D3/cc-pVDZ) optimizations were performed for all, and diffusion quantum Monte Carlo (DMC@PBE0(ccECP/cc-pVQZ)) energies are provided for 10,793 lowest-energy conformers with up to 4 heavy atoms. VQM24 includes structures, vibrational modes, rotational constants, thermodynamic properties (Gibbs free energies, enthalpies, ZPVEs, entropies, heat capacities), and electronic properties such as atomization, electron interaction, exchange-correlation, dispersion energies, multipole moments (dipole to hexadecapole), alchemical potentials, Mulliken charges, and wavefunctions. Machine learning models of atomization energies on this dataset reveal significantly higher complexity than QM9, with none achieving chemical accuracy. VQM24 offers a rigorous, high-fidelity benchmark for evaluating quantum machine learning models.

Science & Technology - Other Topics↗

Adversarial Perturbations Are Not So Weird: Entanglement of Robust and Non-Robust Features in Neural Network Classifiers

Neural networks trained on visual data are well-known to be vulnerable to often imperceptible adversarial perturbations. The reasons for this vulnerability are still being debated in the literature. Recently Ilyas et al. (2019) showed that this vulnerability arises, in part, because neural network classifiers rely on highly predictive but brittle “non-robust” features. In this paper we extend the work of Ilyas et al. by investigating the nature of the input patterns that give rise to these features. In particular, we hypothesize that in a neural network trained in a standard way, non-robust features respond to small, “non-semantic” patterns that are typically entangled with larger, robust patterns, known to be more human-interpretable, as opposed to solely responding to statistical artifacts in a dataset. Thus, adversarial examples can be formed via minimal perturbations to these small, entangled patterns. In addition, we demonstrate a corollary of our hypothesis: robust classifiers are more effective than standard (non-robust) ones as a source for generating transferable adversarial examples in both the untargeted and targeted settings. The results we present in this paper provide new insight into the nature of the non-robust features responsible for adversarial vulnerability of neural network classifiers.

97 MATHEMATICS AND COMPUTING↗

Sharpness-Aware Low-Dose CT Denoising Using Conditional Generative Adversarial Network

Low-dose computed tomography (LDCT) has offered tremendous benefits in radiation-restricted applications, but the quantum noise as resulted by the insufficient number of photons could potentially harm the diagnostic performance. Current image-based denoising methods tend to produce a blur effect on the final reconstructed results especially in high noise levels. In this paper, a deep learning-based approach was proposed to mitigate this problem. An adversarially trained network and a sharpness detection network were trained to guide the training process. Experiments on both simulated and real dataset show that the results of the proposed method have very small resolution loss and achieves better performance relative to state-of-the-art methods both quantitatively and visually.

62 RADIOLOGY AND NUCLEAR MEDICINE↗