Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “citation analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Unlocking Scholarly Insights: Leveraging Machine Learning Approaches for Citation Analysis and Intent Classification

Publicly funded organizations, notably institutions like the Los Alamos National Laboratory (LANL), are deeply vested in acquiring robust productivity metrics to gauge the entirety of their research output. Motivated by the imperative to enhance institutional productivity assessment, this study investigates the utilization of Large Language Models (LLM) such as BERT-based models, as well as local LLaMa-30b-instruct and Mixtral-8x7b-instruct architectures for classifying type of URL referenced resources in academic papers such as software, dataset, as well as authorship intent. Challenges in discerning resource types from context are highlighted, along with the potential of BERT and LLMs to address these challenges. Through comprehensive analysis, this research unveils a notable surge in documents featuring URL citations, indicative of the escalating importance of digital resources in scholarly publications. Moreover, citations to datasets and software demonstrate consistent growth over time, underscoring their increasing significance. Our findings also reveal that LANL authors contribute substantially to accessible science, comprising about 10% of dataset and software mentions in LANL

Large Language Models, BERT, citation classificati↗

U.S. Solar Siting Regulation and Zoning Ordinances (2025)

A machine readable collection of documented solar siting ordinances at the state and local (e.g., county, township) level throughout the United States. The data were compiled using the Infrastructure Continuous Ordinance Mapping for Planning and Siting Systems (INFRA-COMPASS) tool, which leverages Large Language Models (LLMs) to automate the collection of local codes and ordinances applicable to energy infrastructure. URLs for the ordinance source documents are included in the Solar Ordinances spreadsheet. The GeoPackage file included below contains the jurisdiction shapes for each ordinance. Note that the GeoPackage file is formatted for ingestion by NLR's reVX setbacks tool and therefore does not contain any of the state-level regulations. NOTE: This data was collected with the help of generative AI. The Large Language Models used for this effort make mistakes. Always validate the data for critical use cases. This data is an update to a previously developed database of wind ordinances found in OEDI Submission 5734: see the "U.S. Solar Siting Regulation and Zoning Ordinances 2022" link below. INFRA-COMPASS version used for collection: v0.11.3 LLMs used for collection: GPT-4.1, GPT-4.1 mini, GPT-4.1 nano

14 SOLAR ENERGY↗

U.S. Wind Siting Regulation and Zoning Ordinances (2025)

A machine readable collection of documented wind siting ordinances at the state and local (e.g., county, township) level throughout the United States. The data were compiled using the Infrastructure Continuous Ordinance Mapping for Planning and Siting Systems (INFRA-COMPASS) tool, which leverages Large Language Models (LLMs) to automate the collection of local codes and ordinances applicable to energy infrastructure. URLs for the ordinance source documents are included in the Wind Ordinances spreadsheet. The GeoPackage file included below contains the jurisdiction shapes for each ordinance. Note that the GeoPackage file is formatted for ingestion by NREL's reVX setbacks tool and therefore does not contain any of the state-level regulations. NOTE: This data was collected with the help of generative AI. The Large Language Models used for this effort make mistakes. Always validate the data for critical use cases. This data is an update to a previously developed database of wind ordinances found in OEDI Submission 5733: see the "U.S. Wind Siting Regulation and Zoning Ordinances 2022" link below. INFRA-COMPASS version used for collection: v0.8.2 LLMs used for collection: GPT-4.1, GPT-4.1 mini, GPT-4.1 nano, GPT-4o mini

17 WIND ENERGY↗

A meta-analysis of semantic classification of citations

The aim of this literature review is to examine the current state of the art in the area of citation classification. In particular, we investigate the approaches for characterizing citations based on their semantic type. We conduct this literature review as a meta-analysis covering 60 scholarly articles in this domain. Although we included some of the manual pioneering works in this review, more emphasis is placed on the later automated methods, which use Machine Learning and Natural Language Processing (NLP) for analyzing the fine-grained linguistic features in the surrounding text of citations. The sections are organized based on the steps involved in the pipeline for citation classification. Specifically, we explore the existing classification schemes, data sets, pre-processing methods, extraction of contextual and non-contextual features, and the different types of classifiers and evaluation approaches. The review highlights the importance of identifying the citation types for research evaluation, the challenges faced by the researchers in the process, and the existing research gaps in this field.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

Cited Reference Analysis in a National Laboratory to Assess Journal Usage

Librarians at a large, federally funded, multidisciplinary research organization sought to assess the value provided by the library’s collections. One method for capturing this value includes determining how well their library’s collections meet researcher needs, as expressed by the materials those researchers choose to cite in the production of new scholarly communications. A cited reference analysis was performed on the publications originating from the institution to provide the necessary data for the assessment, as well as to aid in the creation of a core list of journals which will inform future collection development efforts. Overall, this paper fills a gap in the library and information science literature by addressing the citation behaviors of researchers at a large multidisciplinary government research facility, a setting that has not been examined previously.

99 GENERAL AND MISCELLANEOUS↗

Ten simple rules for getting and giving credit for data

This article attempts to summarize current best practices that support the movement towards enabling researchers to cite and receive credit for their data. The authors are a small representation of the people and organizations trying to make this happen, and we acknowledge that it is not possible to capture all efforts behind this endeavor in 10 Simple Rules. We encourage interested readers to dive deeper by providing related resources along the way.

59 BASIC BIOLOGICAL SCIENCES↗

U.S. Wind Siting Regulation and Zoning Ordinances

A machine readable collection of documented wind siting ordinances at the state and local (e.g., county, township) level throughout the United States. The data were compiled from several sources including, DOE's Wind Exchange Ordinance Database (Linked in the submission), National Conference of State and Legislatures Wind Energy Siting (also linked in the submission), and scholarly legal articles. The citations for each ordinance are included in the spreadsheet. This data is an updated to a previously developed database of wind ordinances found in OEDI Submission 1932: "U.S. Wind Siting Regulation and Zoning Ordinances"

analysis↗

Data and scripts associated with a manuscript on a meta-analysis synthesizing stream biogeochemical response to wildfires across space and time (v2)

This data package is associated with the publication “Catchment characteristics modulate the influence of wildfires on nitrate and dissolved organic carbon in lotic systems across space and time: A meta-analysis” submitted to Global Biogeochemical Cycles (Cavaiani et al. 2025). This study uses meta-analytical techniques to evaluate the effect of wildfire on in-stream responses in burned and unburned watersheds. The study aims to provide additional insight into the range of responses and net influences that wildfires have on hydro-biogeochemistry across broad spatial scales, burn extents, and the persistence of water-quality change. This study compiles data and metadata from 18 total publications that includes 1) surface water geochemistry data (dissolved organic carbon; nitrate), 2) climate classifications, 3) year of the wildfire, 4) the time lag between when the fire occurred and when the sampling occurred, and 5) study design of the publication. In total, this meta-analysis draws data that spans 8 climate guilds, 3 biomes, 62 watersheds, and 20 unique wildfires. See Sites_meta_data.csv for citations of the papers used in this meta-analysis. All R scripts and the associated data can also be found on GitHub at This data package was originally published in March 2024. It was updated in April 2025 (v2; new and modified files). See the change history section in the readme for more details. This data package contains five primary folders that include the following: (1) inputs; (2) output for analysis; (3) initial plots; (4) R scripts; and (5) GIS data. The data package also contains a data dictionary (dd) that provides column header definitions and a file-level metadata (flmd) file that describes every file. The “inputs” folder contains a list of all publications identified during the formal web search and an indication of whether each publication was included in the final analysis. Additionally, it includes site-level metadata, catchment characteristics, and GIS data for all publications included in the final analysis. The “Output_for_analysis” folder contains all data frames and figures generated from each R script used for additional data analysis. The “initial_plots” folder includes all exploratory figures that will be included in a supplemental and figures that will be submitted with the manuscript for publication. The “R_scripts” folder contains the scripts that perform all the data manipulations, statistical analyses, and plots. The “gis_data” folder includes shape files for each fire included in this meta-analysis. This data package contains the following file types: csv, pdf, jpeg, cpg, dbf, prj, shp, shp.ea.iso.xml, shp.iso.xml, shx.

54 ENVIRONMENTAL SCIENCES↗

Grid resolution requirement of chemical explosive mode analysis for large eddy simulations of premixed turbulent combustion

Full Article Figures & data References Citations Metrics Reprints & Permissions Read this article Abstract The grid resolution requirement for trustworthy Chemical Explosive Mode Analysis (CEMA) in Large Eddy Simulation (LES) of premixed turbulent combustion is proposed. Explicit filtering, to emulate the effect of the LES filter, is applied to one-dimensional laminar flame and three-dimensional planar turbulent flames across a wide range of Karlovitz numbers (5 - 239). The identification of the flame front by CEMA is found relatively insensitive to the cell size (Δ), while the combustion mode identification shows more significant sensitivity. Specifically, increasing Δ falsely enhances the auto-ignition and local extinction modes and suppresses the diffusion-assisted mode. Limited dependence of the CEMA performance on the turbulent combustion regime (Karlovitz number) is observed. A simple grid size criterion for reliable CEMA mode identification in LES is proposed as Δ ≲ δ L /2; The criterion can be relaxed to Δ ≲ δ L in the laminar flame limit. Furthermore, theoretical analysis is conducted on an idealised chemistry-diffusion system. The effects of the filtering process and turbulence on the local combustion mode are demonstrated, which is consistent with the numerical observations. Further, by incorporating turbulent combustion models in CEMA, potential improvement in identifying local combustion modes can be expected.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Social Media Analytics Relevant to TikTok - a Literature Review and Directions for Future Research

We have attempted to capture a sense of the scientific state of the art in studying social media platforms, including data collection from platforms, understanding platform behavior, known adversarial uses, and adverse content detection, classification, and quantification. Our coverage of the field is backed up by roughly two hundred citations, and it concludes with a comparative analysis and a list of apparent gaps and potential paths forward.

99 GENERAL AND MISCELLANEOUS↗

CHESS 2025: Field-collected vegetation attributes and site photos

This dataset represents field observations of vegetation samples collected as part of the Colorado Headwaters Ecological Spectroscopy Study (CHESS) during June and July of 2025. Samples were collected in the field using tablet computers and digital forms, with target data differing by sample type (individual trees, individual shrubs, or 1-meter square plots of meadow and subshrub vegetation). Field samples were collected within 72 hours of airborne data collection using the National Ecological Observatory Network’s Aerial Observation Platform (NEON AOP). The NEON AOP collected waveform LiDAR (Light Detection and Ranging) and imaging spectrometer data in 426 spectral bands from the visible to shortwave infrared. Remote sensing data for the project is available on ESS-DIVE (DOI and citation to be added upon publication). Field data collected included canopy height and per-species horizontal proportional cover for meadow plots, species identity and height information for shrubs, as well as species identity, height, diameter at breast height, and health assessment information for trees. Photos of the focal site and surrounding landscape were taken for all sampling sites and are included in this archive. Green leaves or needles were collected for plant trait and foliar chemistry analysis. This data is archived separately (DOI and citation to be added upon publication). High-precision geospatial data for each sample (crown perimeter polygons for trees and shrubs, plot boundaries for meadow plots) is available here (Henderson et al., 2026). Field and remote sensing protocols largely followed those of a previous field and airborne imaging campaign performed in 2018 (described in Chadwick et al. 2020). Field data from the 2018 campaign can be found here (Chadwick et al., 2020 doi:10.15485/1618130). Because different field measurements were taken for meadow, shrub, and tree sites, data from these three sample types are archived as separate tables (chess_meadow_site_cleaned.csv, chess_shrub_site_cleaned.csv, chess_tree_site_cleaned.csv). Meadow proportional cover data is stored in a separate table (chess_meadow_cover_cleaned.csv). Taxonomy was treated identically between sample types, and the dataset shares a common set of voucher specimens (chess_voucher_IDs_cleaned.csv), as well as a single species list (chess_species_list_cleaned.csv). All taxonomic determinations were performed to the species level, and adhere to the Global Biodiversity Information Facility (GBIF) backbone taxonomy as of January 10th, 2026 (GBIF Secretariat 2023). CHESS Project Description: The Colorado Headwaters Ecological Spectroscopy Study (CHESS) comprised a multi-week airborne remote sensing and field observation campaign in the Upper Gunnison Basin, Colorado, conducted in June and July of 2025. Airborne remote sensing was conducted by the National Ecological Observatory Network Airborne Observation Platform (NEON AOP), concurrent with a field campaign run by the Rocky Mountain Biological Laboratory (RMBL), the Lawrence Berkeley National Laboratory (LBNL) and SLAC National Accelerator Laboratory Watershed Function Science Focus Area (SFA), and NASA-JPL (Jet Propulsion Laboratory) Earth Surface Mineral Dust Source Investigation (EMIT) program. Between June 10 and July 18, 2025, the NEON AOP flight team collected high-resolution aerial imaging spectroscopy and Light Detection and Ranging (LiDAR) data over three domains: the Upper East River (CRBU), Almont Triangle (ALMO), and the Upper Taylor Basin (UPTA). In coordination with the flights, a field campaign acquired ground-truth observations, including observations of vegetation composition, foliar traits, forest demography, and subsurface properties in 18 core sampling areas within the domains. Additional surface water observations were taken at over 380 point locations. All CHESS campaign datasets can be found within the CHESS ESS-DIVE data portal: https://data.ess-dive.lbl.gov/portals/chess. Funding Acknowledgment: Field and remote-sensing data acquisition was performed under a grant from the National Aeronautics and Space Administration (80NSSC24K1005). This work was also supported by the Watershed Function Science Focus Area at Lawrence Berkeley National Laboratory funded by the US Department of Energy, Office of Science, Biological and Environmental Research under Contract No. DE-AC02-05CH11231.

2018 NEON and 2025 CHESS Campaigns↗

Deep-learning methods for contrast enhancement and artifact reduction in cryo-electron tomography: a systematic analysis of the state of the art and proposed improvements

Cryo-electron tomography (cryo-ET) has emerged as the preferred technique for visualizing the organization of macromolecular complexes in situ and resolving their structures at subnanometre resolution [Tegunov et al. (2021)View full citation, Nat. Methods, 18, 186–193]. Despite improvements in data quality as a result of advances in detector technology, microscope stability and stage precision, the analysis and interpretation of tomograms remains challenging due to a low signal-to-noise ratio and reconstruction artifacts stemming from experimental constraints in specimen tilt during data collection resulting in a missing wedge in the Fourier space. Recently, self-supervised deep-learning methods have been proposed for contrast enhancement and reduction of resolution anisotropy in reconstructed tomograms. Here, we evaluate several state-of-the-art deep-learning methods which aim to improve the interpretability of cryo-ET reconstructions, with a focus on their performance on downstream tasks of template matching, sub­tomogram averaging and segmentation. We propose new training architectures and a loss function based on Fourier shell correlation that show improved performance over the standard U-Net with L1/L2 losses. We demonstrate our analysis on four diverse experimental datasets: purified 80S ribosomes, in situ Chlamydomonas reinhardtii, immature HIV-1 virus-like particles and INS-1E cells.

contrast enhancement↗

Bibliometric Analysis of Critical Materials Innovation Hub Publications 2013–2022

The Critical Materials Innovation Hub (the CMI Hub, formerly known as the Critical Materials Institute or CMI) is a U.S. Department of Energy (DOE) Energy Innovation Hub led by Ames National Laboratory and supported by DOE. Established in 2013, the CMI Hub focuses on “technologies that make better use of materials and eliminate the need for materials that are subject to supply disruptions” (Ames National Laboratory 2024). The CMI Hub researchers regularly publish articles that describe their research and its results. Nexight Group conducted a bibliographic analysis of the CMI Hub’s publications to develop a profile of the CMI Hub’s research community, identify growing and emerging research fronts in critical materials, and describe the impact the CMI Hub’s publications have had on the research community. The analysis focused on 475 the CMI Hub publications from 2013 through 2022 that were covered by the Scopus database. Citation counts and other information on each publication (authors, author affiliation, keywords, references, etc.) were downloaded from Scopus in early December 2022.

36 MATERIALS SCIENCE↗

Workforce planning: a review of methodologies

Workforce planning deals with determining the number of employees and associated skills necessary to meet the future operational needs of an organization. A workforce system consists of six elements: recruitment, attrition, promotion, training, retention, and scheduling. Historically, several workforce modeling and analysis methodologies have been developed to capture these elements. This paper reviews the results of workforce and manpower models published within peer-reviewed literature between 1959 and 2021 to provide an in-depth analysis of current models. The focus of this review is on analytical, simulation, and empirical models found in literature that were collected based on a citation requirement and keyword search criteria. Results demonstrate the trends in workforce modeling research and discuss the common uses of each model type and the advantages/disadvantages related to each model. Based on the common attributes of workforce systems, the discussion focuses on the most frequently used model type for each element and the best use for each model. Lastly, recommendations are made for the development of workforce models that allow the most comprehensive view of the workforce systems of the future.

42 ENGINEERING↗

Community detection robustness of graph neural networks

Graph neural networks (GNNs) are increasingly widely used for community detection in attributed networks. They combine structural topology with node attributes through message passing and pooling. However, their robustness or lack thereof with respect to different perturbations and targeted attacks in conjunction with community detection tasks is not well understood. To shed light on latent mechanisms behind GNN sensitivity on community detection tasks, we conduct a systematic computational evaluation of six widely adopted GNN architectures graph convolutional network, graph attention network, graph sample and aggregate (GraphSAGE), differentiable pooling (DiffPool), minimum cut pooling (MinCUT), and deep modularity networks (DMoN). The analysis covers three perturbation categories: node attribute manipulations, edge topology distortions, and adversarial attacks. We use element-centric similarity as the evaluation metric on synthetic benchmarks and real-world citation networks. Our findings indicate that supervised GNNs tend to achieve higher baseline accuracy, while unsupervised methods, particularly DMoN, maintain stronger resilience under targeted and adversarial perturbations. Furthermore, robustness appears to be strongly influenced by community strength, with well-defined communities reducing performance loss. Across all models, node attribute perturbations associated with targeted edge deletions and shifts in attribute distributions tend to cause the largest degradation in community recovery. These findings highlight important trade-offs between accuracy and robustness in GNN-based community detection and offer insights into selecting architectures resilient to noise and adversarial attacks.

Goel, Jaidev [Virginia Polytechnic Inst. and State↗

Exaggerated Plurivory of Macrophomina phaseolina : Accounting for the Large Host Range Claim and the Shifting of Scientific Language

Macrophomina phaseolina is a plant pathogenic fungus that is frequently described as having a broad host range encompassing more than 500 species. We noticed that citations provided in support of this statement do not actually demonstrate such a broad host range. To elucidate the true documented host range of this fungus, we initiated a literature meta-analysis of 894 publications on M. phaseolina since 1913. We discovered that the first host range summaries did not require Koch's postulates or other experimental demonstrations of pathogenicity. Most of the available early host claims were based on tenuous associations between the fungus and symptoms, sometimes without reporting isolation or morphological examination in vitro. These statements apparently led to a pattern of increasingly exaggerated host range claims, without support from a primary reference, until the claim that M. phaseolina has 500 hosts became common in the early 2000s. At present, the scientific community typically requires Koch's postulates to characterize pathogenicity on a new host. Among all the available literature, we only found primary experimental evidence for M. phaseolina’s pathogenicity on 97 hosts; 74 hosts confirmed by Koch's postulates and 23 hosts with all steps from Koch's postulates completed except for recovery of the pathogen from symptomatic tissues. This study demonstrates how scientific concepts can change over time and necessitate changes to historic axioms. We propose that the hyperbole surrounding the host range of M. phaseolina has obscured an accurate depiction of its biology.

Plant Sciences↗

Bibliometric review and recent advances in total scattering pair distribution function analysis: 21 years in retrospect

Global research activities have been driven by the quest to develop and characterize novel materials for technological advancements. The total scattering pair distribution function (TSPDF) is a powerful and versatile characterization technique for examining the structural details of diverse complex materials including liquid, amorphous, disordered crystalline, and nanostructured materials. Thus, it is critical to keep track of research progress, identify research gaps, and future research directions of the application of the TSPDF technique in materials development and discovery. In this work, a bibliometric analysis of literature regarding the TSPDF technique between 2000 and 2021 was conducted using datasets retrieved from the Web of Science database. The research trends based on publication outputs, research subject distribution, co-authorships among institutions, countries/regions, co-citation of referenced sources, and keyword co-occurrence are evaluated and discussed herein. The impact of the TSPDF technique is projected to increase due to its importance in probing emerging functional materials, and the advances in specialized facilities and instrumentation among the scientific communities engaged with it. Finally, current and emerging research hotspots related to TSPDF technique such as catalysis, computer modeling and simulation, pharmaceutics, machine learning, hydrogen storage, battery materials, and layered structured materials are also identified and discussed.

36 MATERIALS SCIENCE↗