Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “NLP”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10

De novo synthesis and near atomic resolution imaging of host immune receptors critical for pathogen recognition (Abbreviated Final Report)

The innate immune system serves as the body’s first line of defense against invading pathogens, responding rapidly through the deployment of immune cells at common sites of infection, such as the skin and airways. These immune-cell sentinels express a range of highly conserved receptors, including Toll-like receptors (TLRs), which recognize and bind to pathogen-derived components. This recognition event triggers intracellular signaling cascades that initiate and coordinate immune responses. Despite their significance, the complete structural characterization of full-length TLRs, including their extracellular domain (ECD), transmembrane domain (TMD), and Toll/interleukin-1 receptor (TIR) domain, remains incomplete. In this study, we examined the expression and isolation of human TLR4 incorporated into nanodiscs using two approaches: a cell-free synthesis system and a cell-based transfection strategy employing Expi293F cells derived from the human embryonic kidney lineage. Our findings demonstrate that NLP-bound human TLR4 produced via the cell-based method yielded functional protein suitable for time-resolved single-particle cryo-electron microscopy (cryo-EM). This advancement enables structural characterization of full-length TLR4, maintaining the integrity of its extracellular domain, transmembrane domain, and Toll/Interleukin-1 receptor (TIR) domain.

59 BASIC BIOLOGICAL SCIENCES↗

Distributed IELI, Rebuilding IELI for Scalability

IELI is an NLP-based system designed to transform text into structured knowledge graphs, integrate domain-specific ontologies, and answer conceptual logic-based queries. This poster talks about how redesigning IELI can help address scalability and modularity challenges, as well as improving responsiveness and health monitoring of the system.

Trejo, Edwin Horacio [Sandia National Laboratories↗

Knowledge Graph Entity Linking using Graph Embeddings

Details the use of a custom embedding model on knowledge graphs to aid in downstream natural language processing (NLP) models for Derivative Classification Assist. Motivations, algorithms, and results were discussed.

Mahesh, Aarav [Sandia National Laboratories (SNL-N↗

US Hydropower & Environmental Mitigations: A 1998-2023 inventory of mitigation measures inside licensing documents

Federal Energy Regulatory Commission (FERC) license documents mandate environmental mitigation requirements to reduce potential environmental damage caused by non-federal hydropower facilities. This StoryMap showcases a dataset that leveraged Natural Language Processing (NLP) to inventory environmental mitigations from 465 FERC licenses that were issued from 1998-2023 (Ruggles et al, 2025). Users can explore trends in mitigation requirements over time and space with interactive maps and are presented with a demonstration use case.

Ruggles, Thomas A. [Oak Ridge National Laboratory ↗

Towards Scaling Law Analysis For Spatiotemporal Weather Data

Compute-optimal scaling laws are relatively well studied for NLP and CV, where objectives are typically single-step and targets are comparatively homogeneous. Weather forecasting is harder to characterize in the same framework: autoregressive rollouts compound errors over long horizons, outputs couple many physical channels with disparate scales and predictability, and globally pooled test metrics can disagree sharply with per-channel, late-lead behavior implied by short-horizon training. We extend neural scaling analysis for autoregressive weather forecasting from single-step training loss to long rollouts and per-channel metrics. We quantify (1) how prediction error is distributed across channels and how its growth rate evolves with forecast horizon, (2) if power law scaling holds for test error, relative to rollout length when error is pooled globally, and (3) how that fit varies jointly with horizon and channel for parameter, data, and compute-based scaling axes. We find strong cross-channel and cross-horizon heterogeneity: pooled scaling can look favorable while many channels degrade at late leads. We discuss implications for weighted objectives, horizon-aware curricula, and resource allocation across outputs.

Kiefer Jr, Alexander [ORNL] (ORCID:000000025398874↗

NukeLM: Pre-Trained and Fine-Tuned Language Models for the Nuclear and Energy Domains

Natural language processing (NLP) tasks (text classification, named entity recognition, etc.) have seen amazing improvements over the last few years. This is due to models such as BERT that achieve deep knowledge transfer by using a large pre-trained model, then fine-tuning the model on specific tasks. The BERT architecture has shown even better performance on domain-specific tasks when the model is pre-trained using domain-relevant texts. Here, inspired by these recent advancements, we have developed NukeLM, a nuclear-domain BERT model pre-trained on 1.5 million abstracts from the DOE Office of Scientific and Technical Information (OSTI) database. This NukeLM model is then fine-tuned for the classification of research articles into either binary classes (related to the nuclear fuel cycle (NFC) or not) or multiple categories related to the subject of the article. We show that continued pre-training of a BERT-style architecture prior to fine-tuning results in greater performance in both article classification tasks. This information is critical for properly triaging manuscripts, a necessary task for better understanding citation networks that publish in the nuclear space and uncovering new areas of research in the nuclear (or nuclear relevant) domain.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

AI-powered topic modeling: comparing LDA and BERTopic in analyzing opioid-related cardiovascular risks in women

Topic modeling is a crucial technique in natural language processing (NLP), enabling the extraction of latent themes from large text corpora. Traditional topic modeling, such as Latent Dirichlet Allocation (LDA), faces limitations in capturing the semantic relationships in the text document although it has been widely applied in text mining. BERTopic, created in 2022, leveraged advances in deep learning and can capture the contextual relationships between words. In this work, we integrated Artificial Intelligence (AI) modules to LDA and BERTopic and provided a comprehensive comparison on the analysis of prescription opioid-related cardiovascular risks in women. Opioid use can increase the risk of cardiovascular problems in women such as arrhythmia, hypotension etc. 1,837 abstracts were retrieved and downloaded from PubMed as of April 2024 using three Medical Subject Headings (MeSH) words: “opioid,” “cardiovascular,” and “women.” Machine Learning of Language Toolkit (MALLET) was employed for the implementation of LDA. BioBERT was used for document embedding in BERTopic. Eighteen was selected as the optimal topic number for MALLET and 23 for BERTopic. ChatGPT-4-Turbo was integrated to interpret and compare the results. The short descriptions created by ChatGPT for each topic from LDA and BERTopic were highly correlated, and the performance accuracies of LDA and BERTopic were similar as determined by expert manual reviews of the abstracts grouped by their predominant topics. The results of the t-SNE (t-distributed Stochastic Neighbor Embedding) plots showed that the clusters created from BERTopic were more compact and well-separated, representing improved coherence and distinctiveness between the topics. Our findings indicated that AI algorithms could augment both traditional and contemporary topic modeling techniques. In addition, BERTopic has the connection port for ChatGPT-4-Turbo or other large language models in its algorithm for automatic interpretation, while with LDA interpretation must be manually, and needs special procedures for data pre-processing and stop words exclusion. Therefore, while LDA remains valuable for large-scale text analysis with resource constraints, AI-assisted BERTopic offers significant advantages in providing the enhanced interpretability and the improved semantic coherence for extracting valuable insights from textual data.

Research & Experimental Medicine↗

AI-powered municipal solid waste management: a comprehensive review from generation to utilization

The accumulation of municipal solid waste (MSW) continues to rise due to burgeoning population, rapid global urbanization and economic growth, intensifying ecological concerns associated with landfills and greenhouse gas (GHG) emissions. Over the past 2 decades, global waste generation has surged by 50%, with one-third remaining uncollected and about 70% sent to landfills. This review examines the critical role of integrating emerging technologies, such as advanced sensors and artificial intelligence (AI), into end-to-end MSW management to alleviate landfill burdens. The suitability of various AI tools for different stages of MSW management is assessed, alongside the deployment of advanced sensors including hyperspectral cameras, computer vision systems, and internet of things (IoT) devices for material identification. Applications of genetic algorithms and reinforcement learning for optimizing collection routes, reducing costs, and lowering emissions are highlighted. Life cycle assessment (LCA) across all stages of MSW management is also reviewed, along with future trends in leveraging generative AI, natural language processing (NLP), and agent-based AI systems to analyze waste generation patterns and public sentiment. Efficient collection and handling can be enhanced through route optimization with geographic information systems and real-time bin-level monitoring. Furthermore, sensor-embedded, real-time object detection systems paired with robotics enable material characterization and automated sorting, thereby lowering costs and diverting waste from landfills into value-added products for diverse industrial sectors including packaging, chemicals, textiles, metals and glass, transportation, and electronics industries. Without intervention, global waste is projected to reach 4.54 billion tons by 2050, contributing direct economic costs of $\$$400 billion and roughly 2.38 billion tons of CO 2 -equivalent emissions annually. This review demonstrates how AI-driven, end-to-end solutions for MSW management can mitigate economic and environmental challenges, while directly supporting the United Nations Sustainable Development (UNDP) goals related to innovation and infrastructure (SDG 9), sustainable cities (SDG 11), responsible consumption and production (SDG 12), and climate action (SDG 13).

09 BIOMASS FUELS↗

Crystallization of ApoA1 and ApoE4 Nanolipoprotein Particles and Initial XFEL-Based Structural Studies

Nanolipoprotein particles (NLPs), also called “nanodiscs”, are discoidal particles with a patch of lipid bilayer corralled by apolipoproteins. NLPs have long been of interest due to both their utility as membrane-model systems into which membrane proteins can be inserted and solubilized and their physiological role in lipid and cholesterol transport via high-density lipoprotein (HDL) and low-density lipoprotein (LDL) maturation, which are important for human health. Serial femtosecond crystallography (SFX) at X-ray free electron lasers (XFELs) is a powerful approach for structural biology of membrane proteins, which are traditionally difficult to crystallize as large single crystals capable of producing high-quality diffraction suitable for structure determination. To facilitate understanding of the specific role of two apolipoprotein/lipid complexes, ApoA1 and ApoE4, in lipid binding and HDL/LDL particle maturation dynamics, and to develop new SFX methods involving NLP membrane protein encapsulation, we have prepared and crystallized homogeneous populations of ApoA1 and ApoE4 NLPs. Crystallization of empty NLPs yields semi-ordered objects that appear crystalline and give highly anisotropic and diffuse X-ray diffraction, similar to fiber diffraction. Several unit cell parameters were approximately determined for both NLPs from these measurements. Thus, low-background, sample conservative methods of delivery are critical. Here we implemented a fixed target sample delivery scheme utilizing the Roadrunner fast-scanning system and ultra-thin polymer/graphene support films, providing a low-volume, low-background approach to membrane protein SFX. This study represents initial steps in obtaining structural information for ApoA1 and ApoE4 NLPs and developing this system as a supporting scaffold for future structural studies of membrane proteins crystalized in a native lipid environment.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Optimal Operation of PV Sources in DC Grids for Improving Technical, Economical, and Environmental Conditions by Using Vortex Search Algorithm and a Matrix Hourly Power Flow

This document presents a master–slave methodology for solving the problem of optimal operation of photovoltaic (PV) distributed generators (DGs) in direct current (DC) networks. This problem was modeled using a nonlinear programming model (NLP) that considers the minimization of three different objective functions in a daily operation of the system. The first one corresponds to the minimization of the total operational cost of the system, including the energy purchasing cost to the conventional generators and maintenance costs of the PV sources; the second objective function corresponds to the reduction of the energy losses associated with the transport of energy in the network, and the third objective function is related to the minimization of the total emissions of CO2 by the conventional generators installed on the DC grid. The minimization of these objective functions is achieved by using a master–slave optimization approach through the application of the Vortex Search algorithm combined with a matrix hourly power flow. To evaluate the effectiveness and robustness of the proposed approach, two test scenarios were used, which correspond to a grid-connected and a standalone network located in two different regions of Colombia. The grid-connected system emulates the behavior of the solar resource and power demand of the city of Medellín-Antioquia, and the standalone network corresponds to an adaptation of the generation and demand curves for the municipality of Capurganá-Choco. A numerical comparison was performed with four optimization methodologies reported in the literature: particle swarm optimization, multiverse optimizer, crow search algorithm, and salp swarm algorithm. The results obtained demonstrate that the proposed optimization approach achieved excellent solutions in terms of response quality, repeatability, and processing times.

14 SOLAR ENERGY↗

Machine Learning for Identifying Relevance to Biosurveillance in Multilingual Text

Objective: The objective is to develop an ensemble of machine learning algorithms to identify multilingual, online articles that are relevant to biosurveillance. Language morphology varies widely across languages and must be accounted for when designing algorithms. Here, we compare the performance of a word embedding-based approach and a topic modeling approach with machine learning algorithms to determine the best method for Chinese, Arabic, and French languages. Introduction: Global biosurveillance is an extremely important, yet challenging task. One form of global biosurveillance comes from harvesting open source online data (e.g. news, blogs, reports, RSS feeds). The information derived from this data can be used for timely detection and identification of biological threats all over the world. However, the more inclusive the data harvesting procedure is to ensure that all potentially relevant articles are collected, the more data that is irrelevant also gets harvested. This issue can become even more complex when the online data is in a non-native language. Foreign language articles not only create language-specific issues for Natural Language Processing (NLP), but also add a significant amount of translation costs. Previous work shows success in the use of combinatory monolingual classifiers in specific applications, e.g., legal domain [1]. A critical component for a comprehensive, online harvesting biosurveillance system is the capability to identify relevant foreign language articles from irrelevant ones based on the initial article information collected, without the additional cost of full text retrieval and translation.

Machine learning↗

The controlled growth method - A tool for structural optimization

An adaptive design variable linking scheme in a NLP based optimization algorithm is proposed and evaluated for feasibility of application. The present scheme, based on an intuitive effectiveness measure for each variable, differs from existing methodology in that a single dominant variable controls the growth of all others in a prescribed optimization cycle. The proposed method is implemented for truss assemblies and a wing box structure for stress, displacement and frequency constraints. Substantial reduction in computational time, even more so for structures under multiple load conditions, coupled with a minimal accompanying loss in accuracy, vindicates the algorithm.

Hajela, P.↗

An overview of computer-based natural language processing

Computer based Natural Language Processing (NLP) is the key to enabling humans and their computer based creations to interact with machines in natural language (like English, Japanese, German, etc., in contrast to formal computer languages). The doors that such an achievement can open have made this a major research area in Artificial Intelligence and Computational Linguistics. Commercial natural language interfaces to computers have recently entered the market and future looks bright for other applications as well. This report reviews the basic approaches to such systems, the techniques utilized, applications, the state of the art of the technology, issues and research requirements, the major participants and finally, future trends and expectations. It is anticipated that this report will prove useful to engineering and research managers, potential users, and others who will be affected by this field as it unfolds.

Gevarter, W. B.↗

Further developments in the controlled growth approach for optimal structural synthesis

It is pointed out that the use of nonlinear programming methods in conjunction with finite element and other discrete analysis techniques have provided a powerful tool in the domain of optimal structural synthesis. The present investigation is concerned with new strategies which comprise an extension to the controlled growth method considered by Hajela and Sobieski-Sobieszczanski (1981). This method proposed an approach wherein the standard nonlinear programming (NLP) methodology of working with a very large number of design variables was replaced by a sequence of smaller optimization cycles, each involving a single 'dominant' variable. The current investigation outlines some new features. Attention is given to a modified cumulative constraint representation which is defined in both the feasible and infeasible domain of the design space. Other new features are related to the evaluation of the 'effectiveness measure' on which the choice of the dominant variable and the linking strategy is based.

Hajela, P.↗

In-Situ F2-Region Plasma Density and Temperature Measurements from the International Space Station

The International Space Station orbit provides an ideal platform for in-situ studies of space weather effects on the mid and low latitude F-2 region ionosphere. The Floating Potential Measurement Unit (FPMU) operating on the ISS since Aug 2006. is a suite of plasma instruments: a Floating Potential Probe (FPP), a Plasma Impedance Probe (PIP), a Wide-sweep langmuir Probe (WLP), and a Narrow-sweep Langmuir Probe (NLP). This instrument package provides a new opportunity lor collaborative multi-instrument studies of the F-region ionosphere during both quiet and disturbed periods. This presentation first describes the operational parameters for each of the FPMU probes and shOWS examples of an intra-instrument validation. We then show comparisons with the plasma density and temperature measurements derived from the TIMED GUVI ultraviolet imager, the Millstone Hill ground based incoherent scatter radar, and DIAS digisondes, Finally we show one of several observations of night-time equatorial density holes demonstrating the capabilities of the probes lor monitoring mid and low latitude plasma processes.

Coffey, Victoria↗

In-situ Observations of the Ionospheric F2-Region from the International Space Station

The International Space Station orbit provides an ideal platform for in-situ studies of space weather effects on the mid and low latitude F-2 region ionosphere. The Floating Potential Measurement Unit (FPMU) operating on the ISS since Aug 2006, is a suite of plasma instruments: a Floating Potential Probe (FPP), a Plasma Impedance Probe (PIP), a Wide-sweep Langmuir Probe (WLP), and a Narrow-sweep Langmuir Probe (NLP). This instrument package provides a new opportunity for collaborative multi-instrument studies of the F-region ionosphere during both quiet and disturbed periods. This presentation first describes the operational parameters for each of the FPMU probes and shows examples of an intra-instrument validation. We then show comparisons with the plasma density and temperature measurements derived from the TIMED GUVI ultraviolet imager, the Millstone Hill ground based incoherent scatter radar, and DIAS digisondes, Finally we show one of several observations of night-time equatorial density holes demonstrating the capabilities of the probes for monitoring mid and low latitude plasma processes.

Coffey, Victoria N.↗

Space Flight Plasma Data Analysis

This slide presentation reviews a method to analyze the plasma data that is reported on board the International Space station (ISS). The Floating Potential Measurement Unit (FPMU), the role of which is to obtain floating potential and ionosphere plasma measurements for validation of the ISS charging model, assess photo voltaic array variability and interpreting IRI predictions, is composed of four probes: Floating Potential Probe (FPP), Wide-sweep Langmuir Probe (WLP), Narrow-sweep Langmuir Probe (NLP) and the Plasma Impedance Probe (PIP). This gives redundant measurements of each parameter. There are also many 'boxes' that the data must pass through before being captured by the ground station, which leads to telemetry noise. Methods of analysis for the various signals from the different sets are reviewed. There is also a brief discussion of LP analysis of Low Earth Orbit plasma simulation source.

Wright, Kenneth H.↗

Opportunities for Utilizing the International Space Station for Studies of F2- Region Plasma Science and High Voltage Solar Array Interactions with the Plasma Environment

The near circular, 51.6deg inclination orbit of the International Space Station (ISS) is maintained within an altitude range of approximately 300 km to 400 km providing an ideal platform for conducting in-situ studies of space weather effects on the mid and low-latitude F-2 region ionosphere. The Floating Potential Measurement Unit (FPMU) is a suite of instruments installed on the ISS in August 2006 which includes a Floating Potential Probe (FPP), a Plasma Impedance Probe (PIP), a Wide-sweep Langmuir Probe (WLP), and a Narrow-sweep Langmuir Probe (NLP). The primary purpose for deploying the FPMU is to characterize ambient plasma temperatures and densities in which the ISS operates and to obtain measurements of the ISS potential relative to the space plasma environment for use in characterizing and mitigating spacecraft charging hazards to the vehicle and crew. In addition to the engineering goals, data from the FPMU instrument package is available for collaborative multi-satellite and ground based instrument studies of the F-region ionosphere during both quiet and disturbed periods. Finally, the FPMU measurements supported by ISS engineering telemetry data provides a unique opportunity to investigate interactions of the ISS high voltage (160 volt) solar array system with the plasma environment. This presentation will provide examples of FPMU measurements along the ISS orbit including night-time equatorial plasma density depletions sampled near the peak electron density in the F2-region ionosphere, charging phenomenon due to interaction of the ISS solar arrays with the plasma environment, and modification of ISS charging due to visiting vehicles demonstrating the capabilities of the FPMU probes for monitoring mid and low latitude plasma processes as well as vehicle interactions with the plasma environment.

Minow, Joseph I.↗