Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Language”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,621 records · Page 90

Enabling Efficient Sparse Computations using Linear Algebra Aware Compilers

This project developed the LAPIS compiler framework, built on the Multilevel Intermediate Representation (MLIR), to optimize sparse linear algebra operations and support performance portability across diverse architectures. The main innovation of LAPIS is the Kokkos dialect, which allows for lowering codes from a high productivity language to different architectures in an elegant way. The dialect also allows the conversion of lower-level MLIR code to C++ Kokkos code, facilitating the integration of scientific machine learning (SciML) models into applications. To extend LAPIS for distributed memory architectures, a new partition dialect was created to manage the distribution of sparse tensors and express communication patterns for sparse linear algebra operations. This dialect also supports the distributed execution of operators and includes algorithmic optimizations to minimize communication to improve performance. The project also demonstrates that MLIR can enable effective linear algebra-level optimizations, improving performance on different GPUs for both sparse and dense linear algebra kernels. Key applications of LAPIS include sparse linear algebra and graph kernels, TenSQL, a relational database management solution built on GraphBLAS, and the development of subgraph isomorphism and monomorphism kernels, showcasing performance portability. In summary, the LAPIS framework supports productivity, performance, portability, and distributed memory execution, while also enabling linear algebra-level optimizations that are challenging in traditional programming languages, with successful applications ranging from simple sparse linear algebra to complex graph kernels.

97 MATHEMATICS AND COMPUTING↗

Masked Symbol Modeling for Demodulation of Oversampled Baseband Communication Signals in Impulsive Noise-Dominated Channels

Recent breakthroughs in natural language processing show that attention mech- anism in Transformer networks, trained via masked-token prediction, enables models to capture the semantic context of the tokens and internalize the grammar of language. While the application of Transformers to communication systems is a burgeoning field, the notion of context within physical waveforms remains under-explored. This paper addresses that gap by re-examining inter-symbol con- tribution (ISC) caused by pulse-shaping overlap. Rather than treating ISC as a nuisance, we view it as a deterministic source of contextual information embedded in oversampled complex baseband signals. We propose Masked Symbol Model- ing (MSM), a framework for the physical (PHY) layer inspired by Bidirectional Encoder Representations from Transformers methodology. In MSM, a subset of symbol-aligned samples is randomly masked, and a Transformer predicts the missing symbol identifiers using the surrounding “in-between” samples. Through this objective, the model learns the latent syntax of complex baseband waveforms. We illustrate MSM’s potential by applying it to the task of demodulating sig- nals corrupted by impulsive noise, where the model infers corrupted segments by leveraging the learned context. Our results suggest a path toward receivers that interpret, rather than merely detect communication signals, opening new avenues for context-aware PHY layer design.

Bedir, Oguz↗

Comprehensive Database of Environmental Mitigations Extracted from FERC-Licensed Hydropower Projects Using Artificial Intelligence Techniques, 1998-2023

This dataset provides a comprehensive inventory of environmental mitigation measures required by Federal Energy Regulatory Commission (FERC) licensed hydropower facilities from 461 licenses that were issued from 1998 to 2023. These licenses constitute 446 of the 1015 FERC projects that were active at the end of 2023. 17,612 mentions of environmental mitigations were identified and categorized in 128 unique categories. Mitigations were identified using a Natural Language Processing (NLP) approach, specifically with a Bidirectional Encoder Representations from Transformer (BERT) model. Model-derived results were then reviewed and updated by a subject matter expert as needed. This dataset introduces important enhancements to previous efforts to inventory environmental mitigations, such as including associated license text for each mitigation, tracking the number of instances a mitigation was identified within a license, and providing improved location information. These enhancements significantly expand the dataset's utility, offering greater analytical capabilities and ensuring reproducibility. The dataset is downloadable as a zip file containing the metadata and dataset files.

Ruggles, Thomas [Oak Ridge National Laboratory (OR↗

Automatically parallelizing batch inference on deep neural networks using Fiats and Fortran 2023 `do concurrent`

This paper introduces novel programming strategies that leverage features of the Fortran 2023 standard of the International Standards Organization (ISO) to automatically parallelize computations on deep neural networks. The paper focuses on the interplay of object-oriented, parallel, and functional programming paradigms in the Fiats deep learning library. We demonstrate how several infrequently used language features play a role in enabling efficient, parallel execution. Specifically, the ability to explicitly declare that a procedure is pure facilitates inference in the context of the language’s loop-parallelism construct `do concurrent`. Also, explicitly prohibiting the overriding of a parent type’s type-bound procedures eliminates the need for dynamic dispatch in performance-critical code. Finally, this paper uses batch inference calculations on a neural network surrogate for atmospheric aerosol dynamics to demonstrate that LLVM Flang compiler’s automatic parallelization of `do concurrent` achieves roughly the same performance and scalability as achieved by OpenMP compiler directives. We also demonstrate that double-precision inference costs 37–72% longer runtime than default-real precision with most values in the range 57-60%.

Rouson, Damian↗

U.S. Solar Siting Regulation and Zoning Ordinances (2025)

A machine readable collection of documented solar siting ordinances at the state and local (e.g., county, township) level throughout the United States. The data were compiled using the Infrastructure Continuous Ordinance Mapping for Planning and Siting Systems (INFRA-COMPASS) tool, which leverages Large Language Models (LLMs) to automate the collection of local codes and ordinances applicable to energy infrastructure. URLs for the ordinance source documents are included in the Solar Ordinances spreadsheet. The GeoPackage file included below contains the jurisdiction shapes for each ordinance. Note that the GeoPackage file is formatted for ingestion by NLR's reVX setbacks tool and therefore does not contain any of the state-level regulations. NOTE: This data was collected with the help of generative AI. The Large Language Models used for this effort make mistakes. Always validate the data for critical use cases. This data is an update to a previously developed database of wind ordinances found in OEDI Submission 5734: see the "U.S. Solar Siting Regulation and Zoning Ordinances 2022" link below. INFRA-COMPASS version used for collection: v0.11.3 LLMs used for collection: GPT-4.1, GPT-4.1 mini, GPT-4.1 nano

14 SOLAR ENERGY↗

U.S. Wind Siting Regulation and Zoning Ordinances (2025)

A machine readable collection of documented wind siting ordinances at the state and local (e.g., county, township) level throughout the United States. The data were compiled using the Infrastructure Continuous Ordinance Mapping for Planning and Siting Systems (INFRA-COMPASS) tool, which leverages Large Language Models (LLMs) to automate the collection of local codes and ordinances applicable to energy infrastructure. URLs for the ordinance source documents are included in the Wind Ordinances spreadsheet. The GeoPackage file included below contains the jurisdiction shapes for each ordinance. Note that the GeoPackage file is formatted for ingestion by NREL's reVX setbacks tool and therefore does not contain any of the state-level regulations. NOTE: This data was collected with the help of generative AI. The Large Language Models used for this effort make mistakes. Always validate the data for critical use cases. This data is an update to a previously developed database of wind ordinances found in OEDI Submission 5733: see the "U.S. Wind Siting Regulation and Zoning Ordinances 2022" link below. INFRA-COMPASS version used for collection: v0.8.2 LLMs used for collection: GPT-4.1, GPT-4.1 mini, GPT-4.1 nano, GPT-4o mini

17 WIND ENERGY↗

A Computational Theory for the Emergence of Grammatical Categories in Cortical Dynamics

A general agreement in psycholinguistics claims that syntax and meaning are unified precisely and very quickly during online sentence processing. Although several theories have advanced arguments regarding the neurocomputational bases of this phenomenon, we argue that these theories could potentially benefit by including neurophysiological data concerning cortical dynamics constraints in brain tissue. In addition, some theories promote the integration of complex optimization methods in neural tissue. In this paper we attempt to fill these gaps introducing a computational model inspired in the dynamics of cortical tissue. In our modeling approach, proximal afferent dendrites produce stochastic cellular activations, while distal dendritic branches–on the other hand–contribute independently to somatic depolarization by means of dendritic spikes, and finally, prediction failures produce massive firing events preventing formation of sparse distributed representations. The model presented in this paper combines semantic and coarse-grained syntactic constraints for each word in a sentence context until grammatically related word function discrimination emerges spontaneously by the sole correlation of lexical information from different sources without applying complex optimization methods. By means of support vector machine techniques, we show that the sparse activation features returned by our approach are well suited—bootstrapping from the features returned by Word Embedding mechanisms—to accomplish grammatical function classification of individual words in a sentence. In this way we develop a biologically guided computational explanation for linguistically relevant unification processes in cortex which connects psycholinguistics to neurobiological accounts of language. We also claim that the computational hypotheses established in this research could foster future work on biologically-inspired learning algorithms for natural language processing applications.

59 BASIC BIOLOGICAL SCIENCES↗

Editorial: Neuroscience, computing, performance, and benchmarks: Why it matters to neuroscience how fast we can compute

At the turn of the millennium the computational neuroscience community realized that neuroscience was in a software crisis: software development was no longer progressing as expected and reproducibility declined. The International Neuroinformatics Coordinating Facility (INCF) was inaugurated in 2007 as an initiative to improve this situation. The INCF has since pursued its mission to help the development of standards and best practices. In a community paper published this very same year, Brette et al. tried to assess the state of the field and to establish a scientific approach to simulation technology, addressing foundational topics, such as which simulation schemes are best suited for the types of models we see in neuroscience. In 2015, a Frontiers Research Topic “Python in neuroscience” by Muller et al. triggered and documented a revolution in the neuroscience community, namely in the usage of the scripting language Python as a common language for interfacing with simulation codes and connecting between applications. The review by Einevoll et al. documented that simulation tools have since further matured and become reliable research instruments used by many scientific groups for their respective questions. Open source and community standard simulators today allow research groups to focus on their scientific questions and leave the details of the computational work to the community of simulator developers. A parallel development has occurred, which has been barely visible in neuroscientific circles beyond the community of simulator developers: Supercomputers used for large and complex scientific calculations have increased their performance from ~10 TeraFLOPS (10 13 floating point operations per second) in the early 2000s to above 1 ExaFLOPS (10 18 floating point operations per second) in the year 2022. This represents a 100,000-fold increase in our computational capabilities, or almost 17 doublings of computational capability in 22 years. Moore's law (the observation that it is economically viable to double the number of transistors in an integrated circuit every other 18–24 months) explains a part of this; our ability and willingness to build and operate physically larger computers, explains another part. It should be clear, however, that such a technological advancement requires software adaptations and under the hood, simulators had to reinvent themselves and change substantially to embrace this technological opportunity. It actually is quite remarkable that—apart from the change in semantics for the parallelization—this has mostly happened without the users knowing. The current Research Topic was motivated by the wish to assemble an update on the state of neuroscientific software (mostly simulators) in 2022, to assess whether we can see more clearly which scientific questions can (or cannot) be asked due to our increased capability of simulation, and also to anticipate whether and for how long we can expect this increase of computational capabilities to continue.

biophysically detailed models↗

The effect of simultaneous exposure on the attention selection and integration of segments and lexical tones by Urdu-Cantonese bilingual speakers

In the perceptual learning of lexical tones, an automatic and robust attention-to-phonology system enables native tonal listeners to adapt to acoustically non-optimal speech, such as phonetic conflicts in daily communications. Previous tone research reveals that non-native listeners who do not linguistically employ lexical tones in their mother tongue may find it challenging to attend to the tonal dimension or integrate it with the segmental features. However, it is unknown whether the attentional interference initially caused by a maternal attentional system would continue influencing the non-optimal tone perception for simultaneous bilingual teenagers. From an endpoint in the age of language acquisition, we investigate whether the tone-specific attention mechanism developed by the Urdu-Cantonese simultaneous bilinguals is automatic enough to assist them in adapting to a phonetically-conflicting environment. Three groups of teenagers engaged in a four-condition ABX task: Urdu-Cantonese simultaneous bilinguals, Cantonese native listeners, and Urdu-speaking, late learners of Cantonese. The results showed that although the simultaneous bilinguals could phonologically process Cantonese tones in a Cantonese-like way under a conflict-free listening condition, they still failed in adapting to the phonetic conflicts, especially the segment-induced ones. It thus demonstrated that the simultaneous exposure and years of regular education in Hong Kong local schools still could not automatically guarantee simultaneous bilingual processing of Cantonese tones. In interpreting the findings, it hypothesized that, except for simultaneous exposure, the development of a tone-specific attention mechanism is also likely to be L1-inhibitory, tone experience-driven, and language-specific for simultaneous bilinguals.

Ning, Jinghong↗

Variational Quantum Chemistry Programs in JaqalPaq

We present example quantum chemistry programs written with JaqalPaq, a python meta-programming language used to code in Jaqal (Just Another Quantum Assembly Language). These JaqalPaq algorithms are intended to be run on the Quantum Scientific Computing Open User Testbed (QSCOUT) platform at Sandia National Laboratories. Our exemplars use the variational quantum eigensolver (VQE) quantum algorithm to compute the ground state energies of the H2, HeH+, and LiH molecules. Since the exemplars focus on how to program in JaqalPaq, the calculations of the second-quantized Hamiltonians are performed with the PySCF python package, and the mappings of the fermions to qubits are obtained from the OpenFermion python package. Using the emulator functionality of JaqalPaq, we emulate how these exemplars would be executed on an error-free QSCOUT platform and compare the emulated computation of the bond-dissociation curves for these molecules with their exact forms within the relevant basis.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

StructuredFuzzer: Fuzzing Structured Text-Based Control Logic Applications

Rigorous testing methods are essential for ensuring the security and reliability of industrial controller software. Fuzzing, a technique that automatically discovers software bugs, has also proven effective in finding software vulnerabilities. Unsurprisingly, fuzzing has been applied to a wide range of platforms, including programmable logic controllers (PLCs). However, current approaches, such as coverage-guided evolutionary fuzzing implemented in the popular fuzzer American Fuzzy Lop Plus Plus (AFL++), are often inadequate for finding logical errors and bugs in PLC control logic applications. They primarily target generic programming languages like C/C++, Java, and Python, and do not consider the unique characteristics and behaviors of PLCs, which are often programmed using specialized programming languages like Structured Text (ST). Furthermore, these fuzzers are ill suited to deal with complex input structures encapsulated in ST, as they are not specifically designed to generate appropriate input sequences. This renders the application of traditional fuzzing techniques less efficient on these platforms. To address this issue, this paper presents a fuzzing framework designed explicitly for PLC software to discover logic bugs in applications written in ST specified by the IEC 61131-3 standard. The proposed framework incorporates a custom-tailored PLC runtime and a fuzzer designed for the purpose. We demonstrate its effectiveness by fuzzing a collection of ST programs that were crafted for evaluation purposes. We compare the performance against a popular fuzzer, namely, AFL++. The proposed fuzzing framework demonstrated its capabilities in our experiments, successfully detecting logic bugs in the tested PLC control logic applications written in ST. On average, it was at least 83 times faster than AFL++, and in certain cases, for example, it was more than 23,000 times faster.

47 OTHER INSTRUMENTATION↗

Machine Reading at Scale: A Search Engine for Scientific and Academic Research

The Internet, much like our universe, is ever-expanding. Information, in the most varied formats, is continuously added to the point of information overload. Consequently, the ability to navigate this ocean of data is crucial in our day-to-day lives, with familiar tools such as search engines carving a path through this unknown. In the research world, articles on a myriad of topics with distinct complexity levels are published daily, requiring specialized tools to facilitate the access and assessment of the information within. Recent endeavors in artificial intelligence, and in natural language processing in particular, can be seen as potential solutions for breaking information overload and provide enhanced search mechanisms by means of advanced algorithms. As the advent of transformer-based language models contributed to a more comprehensive analysis of both text-encoded intents and true document semantic meaning, there is simultaneously a need for additional computational resources. Information retrieval methods can act as low-complexity, yet reliable, filters to feed heavier algorithms, thus reducing computational requirements substantially. In this work, a new search engine is proposed, addressing machine reading at scale in the context of scientific and academic research. It combines state-of-the-art algorithms for information retrieval and reading comprehension tasks to extract meaningful answers from a corpus of scientific documents. The solution is then tested on two current and relevant topics, cybersecurity and energy, proving that the system is able to perform under distinct knowledge domains while achieving competent performance.

Sousa, Norberto (ORCID:0000000329194817)↗

FM4NPP: A Scaling Foundation Model for Nuclear and Particle Physics

Large language models have revolutionized artificial intelligence by enabling large, generalizable models trained through self-supervision. This paradigm has inspired the development of scientific foundation models (FMs). However, applying this capability to experimental particle physics is challenging due to the sparse, spatially distributed nature of detector data, which differs dramatically from natural language. This work addresses if an FM for particle physics can scale and generalize across diverse tasks. We introduce a new dataset with more than 11 million particle collision events and a suite of downstream tasks and labeled data for evaluation. We propose a novel self-supervised training method for detector data and demonstrate its neural scalability with models that feature up to 188 million parameters. With frozen weights and task-specific adapters, this FM consistently outperforms baseline models across all downstream tasks. The performance also exhibits robust data-efficient adaptation. Further analysis reveals that the representations extracted by the FM are task-agnostic but can be specialized via a single linear mapping for different downstream tasks.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Pathways to IEC Standards for Heliostat Design Qualification and Site Acceptance in Central Receiver CSP Applications

This paper surveys the existing landscape of standards relevant to heliostats, identifies their gaps, and proposes a path forward to a comprehensive set of heliostat guidelines, technical specifications, and standards under the framework of International Electrotechnical Commission (IEC) TC 117. Gaps in existing guidelines and standards are surveyed using a three-tiered taxonomy: component-level, heliostat-level, and field-level. At each level, the gap analysis is followed by a proposal for a coordinated path forward on the development of standards. At the component level, advances in the understanding of wind loading should inform a technical specification for drives and structures. Reflectors require consolidation of measurement guidelines into existing standards documents. Communications & controls require technical standards to inform their selection and secure implementation. At the heliostat level, IEC 62817 (solar trackers) adequately characterizes drive systems, structures, and electronics, but requires adaptation to heliostats' use patterns, operating modes, and expected life cycles. IEC 62817 does not address heliostat beam quality and pointing accuracy, but the process for determining both is elaborated in the SolarPACES Guideline for Heliostat Performance Testing. This SolarPACES document requires two main modifications: adaptation to IEC language and inclusion of testing after heliostats which have undergone accelerated weathering and mechanical cycling (to understand performance degradation). At the field level, IEC 62862-4-2 addresses the function and control of heliostat fields but does not cover the statistically rigorous testing of heliostat groups, or field performance factors like security and soiling. The addition of documents under IEC-62862-4 is proposed to address this gap.

beam↗

Developing a sustainability science approach for water systems

We convened a workshop to enable scientists who study water systems from both social science and physical science perspectives to develop a shared language. This shared language is necessary to bridge a divide between these disciplines’ different conceptual frameworks. As a result of this workshop, we argue that we should view socio-hydrological systems as structurally co-constituted of social, engineered, and natural elements and study the “characteristic management challenges” that emerge from this structure and reoccur across time, space, and socioeconomic contexts. This approach is in contrast to theories that view these systems as separately conceptualized natural and social domains connected by bi-directional feedbacks, as is prevalent in much of the water systems research arising from the physical sciences. A focus on emergent characteristic management challenges encourages us to go beyond searching for evidence of feedbacks and instead ask questions such as: What types of innovations have successfully been used to address these challenges? What structural components of the system affect its resilience to hydrological events and through what mechanisms? Are there differences between successful and unsuccessful strategies to solve one of the characteristic management challenges? If so, how are these differences affected by institutional structure and ecological and economic contexts? To answer these questions, social processes must now take center stage in the study and practice of water management. We also argue that water systems are an important class of coupled systems with relevance for sustainability science because they are particularly amenable to the kinds of systematic comparisons that allow knowledge to accumulate. Indeed, the characteristic management challenges we identify are few in number and recur over most of human history and in most geographical locations. This recurrence should allow us to accumulate knowledge to answer the above questions by studying the long historical record of institutional innovations to manage water systems.

54 ENVIRONMENTAL SCIENCES↗

Projected Urban Morphology of the Los Angeles Area by the Year 2100

This dataset provides projections of urban building morphologies for the Los Angeles urban area at 30-meter spatial resolution. It contains 192 raster files that detail two primary building attributes: building footprint fractions (ranging from 0 to 1) and average building heights (ranging from 0 to 75 meters). The projections account for a wide range of future pathways, covering two Shared Socioeconomic Pathway (SSP) scenarios (SSP3 and SSP5), two population scenarios, two developed land intensification scenarios, and four distinct levels of intensification. The dataset was created using dual Generative Adversarial Networks (GANs) trained on 2015 land cover and building properties from the National Land Cover Database (NLCD) and Model America datasets. Supporting information on the dataset has been described in the LAUrbanAreaMorphologyProjections2100_README.txt file.

Pandey, Bhartendu↗

MSD CoP Webinar: "Generative agents: A new frontier for representing human actors and their behavior in MSD models"

Context: This webinar was hosted by the MultiSector Dynamics Community of Practice (MSD CoP; https://multisectordynamics.org). Talk #1: Behavioral Generative Agents for Energy Operations Presenter: Dr. Cong Chen (Thayer School of Engineering, Dartmouth College) Abstract: Accurately modeling consumer behavior in energy operations remains challenging due to inherent uncertainties, behavioral complexities, and limited empirical data. This talk introduces a novel approach leveraging generative agents--artificial agents powered by large language models--to realistically simulate customer decision-making in dynamic energy operations. Talk #2: Simulating multiple human perspectives in socio-ecological systems using large language models Presenter: Dr. Yongchao Zeng (Institute of Meteorology and Climate Research, Atmospheric Environmental Research (IMK-IFU) of the Karlsruhe Institute of Technology in Germany) Abstract: Understanding socio-ecological systems requires insights from diverse stakeholder perspectives. This talk describes a novel simulation system called HoPeS (Human-oriented Perspective Shifting). HoPeS enables model users to not only explore simulated socio-ecological systems (SESs) from a third-person observer's perspective but also take any of the simulated stakeholder roles, like playing an RPG game. By shifting multiple perspectives, model users can reflect and integrate the situated knowledge learned through the participatory simulation, approximating a more holistic and less biased understanding of SESs. Moderators: Jim Yoon (MSD CoP Human Systems Modeling Working Group Co-Chair); Stefano Galelli (MSD CoP Using AI to Enhance MSD Research Working Group Co-Chair); Patrick M. Reed (MSD CoP Facilitation Team) This webinar was held on: November 13th, 2025 from 12-1 PM EST.

Artificial Intelligence↗

Problems of Nuclear Technology and Radiation Safety

This work discusses ethical issues arising in the course of the development of nuclear technologies and related issues of radiation safety. Attention is paid to ethical dilemmas and proposed solutions. The author suggests a critical analysis of the relevant discussions, conducted, first of all, in the English-language literature, and muses on the specifics associated with their transfer to the Russian context. This study considers ethical problems arising in context of the depletion of uranium resources and nuclear waste management and including the inevitable risks for the present and future generations, such as inter- and intragenerational justice (Gardiner's problem) and the problem of the identity of future generations (Parfit’s problem); problems of collectivity and individuality in the assessment of permissible radiation doses for workers at nuclear enterprises and the population associated with the need to combine deontological and utilitarian approaches in the practice of radiation protection. The author demonstrates cultural differences in attitudes towards the safety of the current and future generations of the population of countries and regions and the associated ambiguities in the choice of technology for nuclear reactors, long-term disposal or processing of nuclear waste; double standards in ensuring the radiation safety of personnel of nuclear facilities and the population; ethical problems of risk compensation to workers of radiation-hazardous production facilities; issues of gender differences in sensitivity to radiation exposure, gender equality and discrimination in relation to access to the labor market in the nuclear industry. The article elucidates the importance of socio-humanitarian discussion of the ethical problems of nuclear technologies and radiation safety Such debates currently are almost absent in the Russian-language philosophical literature, despite its exceptional importance due to both the level of development of nuclear energy in Russia and the potential risks that these technologies pose to current and future generations of both employees of nuclear facilities and the population of the country, neighboring countries, and the world. The purpose of this article, thus, is to initiate such a discussion.

ethics of science and technology↗