Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Next generation networking”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 487 records · Page 27
All sourcesNASA NTRSDOE OSTI
NASA NTRSDate not supplied

Lunar Gateway Charging and Effects on Low-Energy Electron Measurements

The Electron Electrostatic Analyzer (EEA) is part of the HERMES instrument suite on Lunar Gateway and is designed to measure electrons in the energy range from 1 eV to 18 keV. Electrons in this range can be deflected or blocked from entering a detector by electric fields from a charged spacecraft platform, so many heliophysics missions (MMS, Cluster, etc.) use active potential control to minimize stray electric fields which would corrupt low-energy plasma measurements. Gateway, however, does not have such capabilities so the surface charging effects will influence the electron data. Further, some elements of Gateway partially block the instrument’s field of view to space. The effects of the Gateway platform on the low-energy electron population must be understood to maximize the accuracy of the EEA data. To investigate the electrostatic environment near Gateway and its effects on the EEA measurements, we use Nascap-2K to model the expected charging of Gateway under representative solar wind, magnetosheathic, and magnetospheric conditions. Next, we use the potential and electric field outputs from Nascap-2K along with in-house particle tracing codes to investigate how low-energy electrons are perturbed, blocked, or deflected by the spacecraft. We discuss how these perturbations impact the plasma moments computed from the EEA data and possible approaches for correcting the charging effects including application of advanced methods such as neural networks. In addition to electrons from the space environment being influenced by the electrostatic environment around Gateway, photoelectrons generated on Gateway surfaces will also be measured by EEA. We are investigating how knowledge of the potentials of various Gateway surfaces can be extracted from these measured photoelectrons using advanced numerical modeling and analysis. Such information would be valuable for validating charging models and planning mission operations around the platform. Finally, we discuss how the specific workflow developed for Gateway can be extended to a generalized process that is applicable to other future missions. As the space industry prepares for human exploration beyond low-Earth orbit, the need to obtain accurate space weather data from rideshare science payloads is critical. Our process for removing platform effects from the science data serves as a pathfinder for leveraging advanced simulations to maximize science returns and ensure the safety and success of future crewed missions.

Miles Bengtson↗
DOE OSTI2021

Synergy of Graphene Nanoribbons and Graphene Sheets for High-Rate Lithium-Sulfur Batteries

According to the increasing demands for shortening the battery charging time, high current rate (C-rate) performances become more significant in practical applications. With a higher theoretical capacity, lithium-sulfur batteries are treated as promising candidates for the next-generation batteries. In this work, the utilization of graphene nanoribbons (GNRs) exhibits the benefits in conductivity and other electrochemical performances, especially for high-rate applications. With air-controlled electrospray as the method, carbon encapsulated sulfur particles, poly(acrylic acid), reduced graphene oxide (rGO) sheets, and GNRs are mixed and directly deposited onto the carbon coated aluminum collector, to employ as the cathode. The scanning electron microscopy (SEM) imaging exhibits that the two-dimensional structure of GNRs helps construct inter-connected networks. This improved structure of cathode can increase the electroconductivity, confirmed by the electrochemical impedance spectroscopy (EIS), and modify the porosity, indicated through pore size distribution profiles. In this way, the polysulfides can be more efficiently trapped and utilized, realizing the promising behavior with faster charge transfer. In terms of the cycling performance at 0.2 C, the batteries with GNRs can perform 18% higher in capacity than those without GNRs, without decreasing the charge retention. According to the rate-capability tests, systems with GNRs can achieve enhanced performance compared to batteries with precursor carbon nanotubes (CNTs), especially at high C-rates. At 2 C, with 80 wt % of graphene-based materials as GNRs, batteries can achieve an increase in capacity by 78% and 41% compared with systems without GNRs and those with CNTs, respectively. Accordingly, the results testify the synergy of GNRs and rGO sheets in Li-S batteries.

25 ENERGY STORAGE↗
DOE OSTI2022

Application of Quantum Machine Learning to High Energy Physics Analysis at LHC Using Quantum Computer Simulators and Quantum Computer Hardware

Machine learning enjoys widespread success in High Energy Physics (HEP) analyses at LHC. However the ambitious HL-LHC program will require much more computing resources in the next two decades. Quantum computing may offer speed-up for HEP physics analyses at HL-LHC, and can be a new computational paradigm for big data analyses in High Energy Physics.We have successfully employed three methods (1) Variational Quantum Classifier (VQC) method, (2) Quantum Support Vector Machine Kernel (QSVM-kernel) method and (3) Quantum Neural Network (QNN) method for two LHC flagship analyses: ttH (Higgs production in association with two top quarks) and H->mumu (Higgs decay to two muons, the second generation fermions). We shall address the progressive improvements in performance from method (1) to method (3).We will present our experiences and results of a study on LHC High Energy Physics data analyses with IBM Quantum Simulator and Quantum Hardware (using IBM Qiskit framework), Google Quantum Simulator (using Google Cirq framework), and Amazon Quantum Simulator (using Amazon Braket cloud service). The work is in the context of a Qubit platform (a gate-model quantum computer). Taking into account the present limitation of hardware access, different quantum machine learning methods are studied on simulators and the results are compared with classical machine learning methods (BDT, classical Support Vector Machine and classical Neural Network). Furthermore, we do apply quantum machine learning on IBM quantum hardware to compare performance between quantum simulator and quantum hardware. The work is performed by an international and interdisciplinary collaboration with the Department of Physics and Department of Computer Sciences of University of Wisconsin, CERN Quantum Technology Initiative, IBM Research Zurich, IBM T.J. Watson Research Center, Fermilab Quantum Institute, BNL Computational Science Initiative, State University of New York at Stony Brook, and Quantum Computing and AI Research of Amazon Web Services. This work pioneers a close collaboration of academic institutions with industrial corporations in the High Energy Physics analyses effort. Though the size of event samples in future HL-LHC physics and the limited number of qubits pose some challenges to the Quantum Machine learning studies for High Energy Physics, more advanced quantum computers with larger number of qubits, reduced noise and improved running time (as envisioned by IBM and Google) may outperform classical machine learning in both classification power and in speed.Although the era of efficient quantum computing may still be years away, we have made promising progress and obtained preliminary results in applying quantum machine learning to High Energy Physics. A PROOF OF PRINCIPLE.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
NASA NTRS1973

Evolution of the satellite telemetry data processing facility at the Goddard Space Flight Center.

Data from scientific and application satellites managed by the NASA Goddard Space Flight Center are acquired through the world-wide Spacecraft Tracking and Data Network (STDN). These data are forwarded to a central telemetry data processing facility whose primary objective is the timely provision of the data to users in a form suitable for their analysis. In a successful evolution, a satellite data processing facility must adapt to changing support requirements while operationally supporting active spacecraft. Advances in the technology of data transmission, data storage systems, and file management make it feasible to implement a third-generation system which will be able to satisfy experimenter requirements for the next ten years.

Keipert, F. A.↗
NASA NTRS2012

Architecting the Human Space Flight Program with Systems Modeling Language (SysML)

The next generation of missions in NASA's Human Space Flight program focuses on the development and deployment of highly complex systems (e.g., Orion Multi-Purpose Crew Vehicle, Space Launch System, 21st Century Ground System) that will enable astronauts to venture beyond low Earth orbit and explore the moon, near-Earth asteroids, and beyond. Architecting these highly complex system-of-systems requires formal systems engineering techniques for managing the evolution of the technical features in the information exchange domain (e.g., data exchanges, communication networks, ground software) and also, formal correlation of the technical architecture to stakeholders' programmatic concerns (e.g., budget, schedule, risk) and design development (e.g., assumptions, constraints, trades, tracking of unknowns). This paper will describe how the authors have applied System Modeling Language (SysML) to implement model-based systems engineering for managing the description of the End-to-End Information System (EEIS) architecture and associated development activities and ultimately enables stakeholders to understand, reason, and answer questions about the EEIS under design for proposed lunar Exploration Missions 1 and 2 (EM-1 and EM-2).

scheduling↗
DOE OSTI2022

AI-Enhanced Co-Design for Next-Generation Microelectronics: Innovating Innovation [Workshop Report]

In April 5-7, 2022, Sandia National Laboratories hosted a second virtual workshop to further explore the potential for developing AI-enhanced co-design for microelectronics (AICoM). This second piece in an ongoing workshop series again brought together two themes. The first theme, co-design for next generation microelectronics, was drawn from the 2018 Department of Energy Office of Science (DOE SC) “Basic Research Needs for Microelectronics” (BRN) report (DOE/SC, 2018, 2021), which called for a “fundamental rethinking” of the traditional design approach to microelectronics, in which subject matter experts (SMEs) in each microelectronics discipline (materials, devices, circuits, algorithms, etc.) work near-independently. Instead, the BRN called for a non-hierarchical, egalitarian vision of co-design, wherein “each scientific discipline informs and engages the others” in “parallel but intimately networked efforts to create radically new capabilities.” The second theme, exploiting and advancing artificial intelligence (AI) to support co-design for microelectronics, acknowledges the continuing breakthroughs in AI that are currently enhancing and accelerating solutions to traditional design problems in materials synthesis and processing, circuit design, and electronic design automation (EDA).

42 ENGINEERING↗
DOE OSTI2026

CRADA Number NFE-24-10110 with Qubit Engineering Inc. (CRADA Final Report)

Over the past year, the Qubit Engineering team has pushed the frontiers of power‑grid optimization, working in close collaboration with Oak Ridge National Laboratory (ORNL) and the Tennessee Valley Authority (TVA). Their progress is reflected in three newly submitted conference papers, “Unified Relational GNN Architecture for AC Optimal Power Flow Calculations in Electric Grids,” “Graph‑Based Attention Mechanisms for Solving the AC Optimal Power Flow Problem in Electrical‑Power Networks,” and “Enhanced Power‑Grid Maintenance Planning and Quantum‑Inspired Combinatorial Prospects.” These publications showcase state‑of‑the‑art graph‑neural‑network methods for AC‑OPF and novel quantum‑inspired heuristics for maintenance scheduling. Beyond the academic results, the Qubit team has converted the research into two production‑grade tools built on TVA data: Neuro‑Grid, an AI‑driven power‑flow simulator that provides instant, interactive full‑grid load‑flow visualizations, and Quanta‑Grid, a quantum‑inspired maintenance‑scheduling engine to support logistics optimization for power utilities. Together, these advances demonstrate how Qubit’s partnership with ORNL and TVA is delivering practical, physics‑grounded analytics for next‑generation grid management.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2023

Lithium Metal Battery Quality Control via Transformer–CNN Segmentation

Lithium metal battery (LMB) has the potential to be the next-generation battery system because of its high theoretical energy density. However, defects known as dendrites are formed by heterogeneous lithium (Li) plating, which hinders the development and utilization of LMBs. Non-destructive techniques to observe the dendrite morphology often use X-ray computed tomography (XCT) to provide cross-sectional views. To retrieve three-dimensional structures inside a battery, image segmentation becomes essential to quantitatively analyze XCT images. This work proposes a new semantic segmentation approach using a transformer-based neural network called TransforCNN that is capable of segmenting out dendrites from XCT data. In addition, we compare the performance of the proposed TransforCNN with three other algorithms, U-Net, Y-Net, and E-Net, consisting of an ensemble network model for XCT analysis. Our results show the advantages of using TransforCNN when evaluating over-segmentation metrics, such as mean intersection over union (mIoU) and mean Dice similarity coefficient (mDSC), as well as through several qualitatively comparative visualizations.

Quenum, Jerome (ORCID:0000000271265853)↗
NASA NTRS2007

Collaborative PLM - The Next Generation AKA Cars on Mars

In this slide presentation the importance of collaboration in developing the next systems for space exploration is stressed. The mechanism of this collaboration are reviewed, and particular emphasis is given to our planned exploration of Mars and how this will require a great deal of collaboration. A system architecture for this collaboration is shown and the diagram for the collaborative environment is conceptualized.

collaboration↗
NASA NTRS2011

The 2010 AOP Workshop Summary Report

The rationale behind the current workshop, which was hosted by Biospherical Instruments Inc. (BSI), was to update the community and get community input with respect to the following: topics not addressed during the first workshop, specifically the processing of above-water apparent optical property (AOP data) within the Processing of Radiometric Observations of Seawater using Information Technologies (PROSIT) architecture; PROSIT data processing issues that have developed or tasks that have been completed, since the first workshop; and NASA instrumentation developments, both above- and in-water, that are relevant to both workshops and next generation mission planning. The workshop emphasized presentations on new AOP instrumentation, desired and required features for processing above-water measurements of the AOPs of seawater, working group discussions, and a community update for the in-water data processing already present in PROSIT. The six working groups were organized as follows: a) data ingest and data products; b) required and desired features for optically shallow and optically deep waters; c) contamination rejection (clouds), corrections, and data filtering; d) sun photometry and polarimetry; e) instrumentation networks; and f) hyperspectral versus fixed-wavelength sensors. The instrumentation networks working group was intended to provide more detailed information about desired and required features of autonomous sampling systems. Plenary discussions produced a number of recommendations for evolving and documenting PROSIT.

Hooker, Stanford B.↗
NASA NTRSDate not supplied

The Land Surface in Earth System Reanalysis

Current global atmospheric reanalysis products such as ERA-5, MERRA-2, and JRA-55 provide estimates of land surface states and fluxes, including soil moisture, soil temperature, snow mass, latent and sensible heat fluxes, and runoff. These land surface estimates are based on land surface process models and, depending on the reanalysis product, on precipitation observations or the assimilation of land surface observations of soil moisture and snow conditions from satellites and in situ networks. The land models used in the current global atmospheric reanalysis systems are generally focused on water and energy balance processes, with prescribed static land cover and prescribed climatological vegetation conditions. That is, current global atmospheric reanalysis products do not reflect changes in land use or land cover, nor do they provide dynamic estimates of the land carbon cycle. These and other gaps, including the omission of anthropogenic processes such as irrigation in the land model, need to be addressed in the development of the next generation Earth system reanalysis systems. This presentation provides an overview of the state-of-the-art and future developments of land surface estimates in global reanalysis systems.

Rolf Reichle↗
DOE OSTI2020

A comparison of computational models for predicting yield sooting index

Sooting propensity, a measurement of how much particulate matter is produced when a fuel is burned, is a property of significant interest among researchers who are striving to discover the next generation of cleaner, more efficient fuels and fuel additives. Many compounds are not viable as fuels and/or fuel additives, and as a result, designing cleaner-burning biofuels using only experimental techniques is inefficient. Predictive models have been instrumental in reducing this inherent difficulty, providing researchers with a tool to preemptively screen compounds before production and testing. The present work compares the accuracies and interpretabilities of existing models used to predict a particular measure of sooting propensity, Yield Sooting Index (YSI). These models include artificial neural networks, graph neural networks, and multivariate equations. A novel equation for predicting YSI based on atom path count and bond order is proposed, which can highlight key structural components that contribute to YSI. It was found that artificial neural networks slightly outperform graph neural networks and greatly outperform multivariate equations in blind (test set) prediction accuracy; however, graph neural networks and multivariate equations provide significantly more interpretability as to how compound structure relates to YSI. Predictions of YSI are compared to experimental measurements for previously un-tested compounds with cetane numbers comparable to diesel fuel (50-60) (butyl decanoate, ethyl decanoate, 1,4-bis(ethenoxymethyl)cyclohexane, and 5-heptyloxolan-2-one), and it was found that these compounds produce significantly less soot compared to diesel fuel.

09 BIOMASS FUELS↗
NASA NTRS1997

Dynamic Flow Management Problems in Air Transportation

In 1995, over six hundred thousand licensed pilots flew nearly thirty-five million flights into over eighteen thousand U.S. airports, logging more than 519 billion passenger miles. Since demand for air travel has increased by more than 50% in the last decade while capacity has stagnated, congestion is a problem of undeniable practical significance. In this thesis, we will develop optimization techniques that reduce the impact of congestion on the national airspace. We start by determining the optimal release times for flights into the airspace and the optimal speed adjustment while airborne taking into account the capacitated airspace. This is called the Air Traffic Flow Management Problem (TFMP). We address the complexity, showing that it is NP-hard. We build an integer programming formulation that is quite strong as some of the proposed inequalities are facet defining for the convex hull of solutions. For practical problems, the solutions of the LP relaxation of the TFMP are very often integral. In essence, we reduce the problem to efficiently solving large scale linear programming problems. Thus, the computation times are reasonably small for large scale, practical problems involving thousands of flights. Next, we address the problem of determining how to reroute aircraft in the airspace system when faced with dynamically changing weather conditions. This is called the Air Traffic Flow Management Rerouting Problem (TFMRP) We present an integrated mathematical programming approach for the TFMRP, which utilizes several methodologies, in order to minimize delay costs. In order to address the high dimensionality, we present an aggregate model, in which we formulate the TFMRP as a multicommodity, integer, dynamic network flow problem with certain side constraints. Using Lagrangian relaxation, we generate aggregate flows that are decomposed into a collection of flight paths using a randomized rounding heuristic. This collection of paths is used in a packing integer programming formulation, the solution of which generates feasible and near-optimal routes for individual flights. The algorithm, termed the Lagrangian Generation Algorithm, is used to solve practical problems in the southwestern portion of United States in which the solutions are within 1% of the corresponding lower bounds.

Patterson, Sarah Stock↗
NASA NTRS2018

Launch Control System / Spaceport Command and Control

NASA is developing the next generation launch vehicle that will take astronauts further into space than any previous manned vehicle. This project has many facets and one of them, the Spaceport Command and Control System (SCCS), was the primary focus of my work during this internship. A vital ability of SCCS is the communication from the firing rooms to the ground support equipment for the vehicle on the launch pad. During this internship, I was part of the Computer Systems Hardware Team, a group of engineers who handle the computer and networking aspects of the SCCS project. My job was to construct, handle, and test computer and network machines, configurations and cables.

Barbaro, Mark A.↗
NASA NTRS2020

Building a standardized Observing System Simulation Experiment (OSSE) framework for Mars

We advocate that the Decadal Survey recommends the NASA Science Mission Directorate to develop a rigorous Observing System Simulation Experiment (OSSE) framework for Mars, to optimize future atmospheric observations. Atmospheric conditions on Mars are a potential hazard source for landing missions. Errors in the estimates of atmospheric density profiles, inadequate knowledge of wind vertical structure and dust concentration as a function of height are likely causes of uncertainty at the landing site on the order of kilometers. An operational real-time weather forecasting capability for Mars would reduce such uncertainties, carrying enormous benefits to future robotic missions, and would be an invaluable prerequisite for human missions.A real-time forecasting capability relies upon three fundamental components: a critical mass of observing systems, a data assimilation system (DAS), and a global forecast model. The DAS allows the model to ingest the data effectively, optimizing the observational information content,and transforming them into a gridded representation of the atmosphere at a given time, called an ‘analysis’. The analysis is the best estimate of the atmospheric state for that time, and also represents a set of ‘initial conditions’ from which a global model can be initialized, to predict a future state of the atmosphere. The connection between analysis and forecast represents the foundation of modern weather forecasting. However, from the point of view of a forecast system,not all observations are equally impactful, partially because of the problem of “observational error correlation”, one important research topic in data assimilation development. For the Earth, partly due to the spontaneous and deregulated development of observations and forecast capabilities worldwide for more than half a century,the use of observations in contemporary operational forecast systems is suboptimal, with many potentially useful data being underutilized. On the contrary, Mars atmospheric scientists are in the unique situation of designing the next-generation observing systems by learning from the experience gathered on the Earth, so as to assure that the future instruments are specifically optimized to give the maximum benefit to a future weather forecast capability.An immensely powerful tool that has been firmly established by atmospheric scientists on the Earth is represented by a properly designed OSSE framework. A realistic OSSE framework cannot only quantify the benefit of future data types, be them surface based or space borne, but can also help design and optimize an entire observational network. Furthermore, OSSEs can provide deep insights into an atmosphere’s behavior, by addressing conceptual problems of its intrinsic predictability and delineating the regions or features of the atmosphere which are more sensitive to additional data and would benefit from a denser sampling. The difficulties posed by OSSEs are fundamentally different for Earth and Mars. For Earth, the enormous data volume imposes a tremendous constraint on any innovation in the observing systems: it is very hard for a single sensor to impact the skill. For Mars, the problem is the opposite: almost any additional instrument will exert some impact. However, OSSEs can help to evaluate the cost/benefit for every sensor and suggest optimal data configuration and density.The purpose of this white paper is to provide an introduction to a rigorously designed OSSE framework, explain the underlying problems and challenges, and engage the Mars community to collaborate with Earth Atmospheric scientists in order to develop a joint-OSSE framework for Mars with the largest consensual basis possible. An OSSE infrastructure would increase the understanding of the Martian atmosphere, would help NASA to optimize instrument specifications and orbit choice, providing the maximium benefit for a given expenditure of resources, and could even help establishing a roadmap for a future real-time weather forecasting capability.

Oreste Reale↗
DOE OSTI2026

Polymer Deconstruction and Redesign Strategies for Plastics Recycling

Advancing plastics recycling requires both the selective deconstruction of existing polymers and the design of new materials that enable efficient reuse without loss of performance. This perspective highlights an integrated approach that is rooted in polymer chemistry, catalysis, and process engineering which can enable a circular plastics economy. Here, we outline recent advances in catalytic, solvolytic, and enzymatic pathways for plastic deconstruction, and examine the molecular design principles driving next-generation recyclable-by-design and bio-based polymers. Despite these advances, major knowledge gaps remain in understanding the evolution of polymer morphology and catalyst structure during deconstruction, assessing deconstruction processes with realistic polymers, and offering redesigned polymers with competitive cost and environmental advantage over conventional plastics. United States Department of Energy (U.S. DOE) national laboratories offer unique capabilities to address these challenges through in situ and operando characterization, high-throughput experimentation, environmental studies, technoeconomic and life cycle assessment, scale-up support, and collaboration networks. Advances made in understanding plastic deconstruction mechanisms and structure-property correlations of redesigned polymers inform emerging research directions including autonomous experimentation, real-time feedback-enabled process optimization, and protein engineering for enzymatic depolymerization.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Precise Linker Length and Dynamic Bond Exchange Control Penetrant Diffusion in Dense Vitrimers

Polymer networks with dynamic covalent bonds have been investigated for their self-healing ability, recyclability, and potential as more sustainable materials. Recent results have indicated that in some cases, bond exchange can enhance the transport of penetrants in dense networks, pointing to their potential for separations of membranes. Here, imine dynamic bonds in ethylene oxide (EO) networks with precise linker lengths were synthesized to investigate the transport of N,N′-bis(2,5-di-tert-butylphenyl)-3,4,9,10-perylenedicarboximide (BTBP), a large, anisotropic dye molecule. Networks with mesh sizes smaller than, comparable to, and greater than the size of the penetrant axes were investigated to probe the effects of bond exchange and network confinement on transport. Mesh sizes, which ranged from 0.5 to 1.62 nm, were determined from shear rheology, glass transitions by calorimetry, and probe diffusion coefficients by fluorescence recovery after photobleaching. Permanent networks with identical EO chain lengths were prepared as control samples, and up to a 3 orders of magnitude increase in diffusion coefficient is observed in the dynamic systems for short linkers containing 13 backbone atoms. The longest linkers with 71 backbone atoms show no difference between the permanent and dynamic networks. Linkers shorter than 11 backbone atoms, corresponding to a mesh size smaller than the penetrant small axis, diffusion is no longer observable on the experimental time scale, indicating a sharp cutoff attributed to the precise linkers and narrow mesh size distribution. The dynamic imine exchange time scales were compared to the diffusive hopping times of penetrants and indicate that exchange can occur during a diffusive displacement. Furthermore, these findings provide insights into the factors affecting penetrant transport in dense polymers and inspire the development of next-generation selective polymer membranes.

Diffusion↗
DOE OSTI2024

Bridging the Gap Between LLMs and LNS with Dynamic Data Format and Architecture Codesign

Deep neural networks (DNNs) have achieved tremendous success in the past few years. However, their training and inference demand exceptional computational and memory resources. Quantization has been shown as an effective approach to mitigate the cost, with the mainstream data types reduced from FP32 to FP16/BF16 and recently FP8 in the latest NVIDIA H100 GPUs. With increasingly aggressive quantization, however, the conventional floating-point formats suffer from limited precision in representing numbers around zero. Recently, NVIDIA demonstrated the potential of using a Logarithmic Number System (LNS) for the next generation of tensor cores. While LNS mitigates the hurdles in representing small numbers, in this work we observed a mismatch between LNS and the emerging Large Language Models (LLM), where LLM exhibits significant outliers when directly adopting the LNS format. In this paper, we present a data-format/architecture codesign to bright this gap. On the format side, we propose a dynamic LNS format to flexibly represent outliers at a higher precision, by exploiting asymmetry in the LNS representation and identifying outliers through a per-vector basis. On the architecture side, for demonstration, we realize the dynamic LNS format in a systolic array, which can handle the irregularity of the outliers at runtime. We implement our approach on an Alveo U280 FPGA as a prototype. Experimental results show that our design can effectively handle the outliers and resolve the mismatch between LNS and LLM, contributing to an accuracy improvement of 15.4% and 16% over the floating-point and the original LNS baselines, using four state-of-the-art LLM models. Our observation and design lay a solid foundation for the large-scale adoption of the LNS format in the next-generation deep learning hardware.

Haghi, Pouya↗