Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “online”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,369 records · Page 76
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Ultrafast Error-bounded Lossy Compression for Scientific Datasets

Today's scientific high-performance computing applications and advanced instruments are producing vast volumes of data across a wide range of domains, which impose a serious burden on data transfer and storage. Error-bounded lossy compression has been developed and widely used in the scientific community because it not only can significantly reduce the data volumes but also can strictly control the data distortion based on the user-specified error bound. Existing lossy compressors, however, cannot offer ultrafast compression speed, which is highly demanded by numerous applications or use cases (such as in-memory compression and online instrument data compression). In this paper, we propose a novel ultrafast error-bounded lossy compressor that can obtain fairly high compression performance on both CPUs and GPUs and with reasonably high compression ratios. The key contributions are threefold. (1) We propose a generic error-bounded lossy compression framework---called SZx---that achieves ultrafast performance through its novel design comprising only lightweight operations such as bitwise and addition/subtraction operations, while still keeping a high compression ratio. (2) We implement SZx on both CPUs and GPUs and optimize the performance according to their architectures. (3) We perform a comprehensive evaluation with six real-world production-level scientific datasets on both CPUs and GPUs. Experiments show that SZx is 2~16x faster than the second-fastest existing error-bounded lossy compressor (either SZ or ZFP) on CPUs and GPUs, with respect to both compression and decompression.

Yu, Xiaodong↗
DOE OSTI2022

CEAZ: Accelerating Parallel I/O Via Hardware-Algorithm Co-Designed Adaptive Lossy Compression

As supercomputers continue to grow to exa-scale, the amount of data that needs to be saved or transmitted is exploding. To this end, many previous works have studied using error-bounded lossy compressors to reduce the data size and improve the I/O performance. However, little work has been done for effectively offloading lossy compression onto FPGA-based SmartNICs to reduce the compression overhead. In this paper, we propose a hardware-algorithm co-design of efficient and adaptive lossy compressor for scientific data on FPGAs (called CEAZ) to accelerate parallel I/O. Our contribution is fourfold: (1) We propose an efficient Huffman coding approach that can adaptively update Huffman codewords online based on codewords generated offline (from a variety of representative scientific datasets). (2) We derive a theoretical analysis to support a precise control of compression ratio under an error-bounded compression mode, enabling accurate offline Huffman codewords generation. This also help us create a fixed-ratio compression mode for consistent throughput. (3) We develop an efficient compression pipeline by adopting cuSZ’s dual-quantization algorithm to our hardware use case. (4) We evaluate CEAC on five real-world datasets with both a single FPGA board and 256 nodes from Bridges2 supercomputer. Experiments show that CEAZ outperforms the second-best FPGA-based lossy compressor by 2× of throughput and 9.6× of compression ratio. It also improves MPI_File_write and MPI_Gather throughputs by up to 32.7× and 31.4×, respectively.

Zhang, Chengming↗
DOE OSTI2022

Dictionary Learning with Accumulator Neurons

The Locally Competitive Algorithm (LCA) uses local competition between non-spiking leaky integrator neurons to infer sparse representations, allowing for potentially real-time execution on massively parallel neuromorphic architectures such as Intel's Loihi processor. Here, we focus on the problem of inferring sparse representations from streaming video using dictionaries of spatiotemporal features optimized in an unsupervised manner for sparse reconstruction. Non-spiking LCA has previously been used to achieve unsupervised learning of spatiotemporal dictionaries composed of convolutional kernels from raw, unlabeled video. We demonstrate how unsupervised dictionary learning with spiking LCA (\hbox{S-LCA}) can be efficiently implemented using accumulator neurons, which combine a conventional leaky-integrate-and-fire (\hbox{LIF}) spike generator with an additional state variable that is used to minimize the difference between the integrated input and the spiking output. We demonstrate dictionary learning across a wide range of dynamical regimes, from graded to intermittent spiking, for inferring sparse representations of both static images drawn from the CIFAR database as well as video frames captured from a DVS camera. On a classification task that requires identification of the suite from a deck of cards being rapidly flipped through as viewed by a DVS camera, we find essentially no degradation in performance as the LCA model used to infer sparse spatiotemporal representations migrates from graded to spiking. We conclude that accumulator neurons are likely to provide a powerful enabling component of future neuromorphic hardware for implementing online unsupervised learning of spatiotemporal dictionaries optimized for sparse reconstruction of streaming video from event based DVS cameras.

artificial intelligence↗
DOE OSTI2023

WiP Abstract: Edge-Based Privacy of Naturalistic Driving Data Collection

Collecting large driving datasets is important for data-driven transportation research and studied in naturalistic driving [3]. Due to the standard implementation of a Controller Area Network (CAN) bus for a vehicle’s inter-module communication, many off-the-shelf devices can easily transform a vehicle into a rich data collection utility [2]. Vehicles with Adaptive Cruise Control (ACC) are an example of a feature resulting in emergent traffic behavior when scaled [4]. While these utilities were designed with particular data use cases, data may be publicly shared to benefit other researchers through online tools like CyVerse [1]. However, such data should only be shared when any private information is removed. This private information may exist as a set of GPS coordinates, since the start and end points of a trip may designate a driver’s place of residence or work. When considering larger continuously-collected data sets with a focus on naturalistic driving, many drivers are needed to make data collection feasible. Removal of private information becomes much more of a challenge since every driver may uniquely define their geographic privacy. This project aims to build upon the foundation of libpanda [2] by adding features of edge-based data privacy enforcement. In it’s current form, libpanda uses a GPS in conjunction with a CAN interface to record data. Libpanda feature s a set of startup and shutdown scripts to perform automatic data collection and upload. With additional support hardware on a Raspberry Pi, the Pi can maintain power on vehicle shutdown to automatically upload data before shutdown.

Bunting, Matt↗
DOE OSTI2024

RAP: Resource-aware Automated GPU Sharing for Multi-GPU Recommendation Model Training and Input Preprocessing

Ensuring high-quality recommendations for newly onboarded users requires the continuous retraining of Deep Learning Recommendation Models (DLRMs) with freshly generated data. To serve the online DLRM retraining, existing solutions use hundreds of CPU computing nodes designated for input preprocessing, causing significant power consumption that surpasses even the power usage of GPU trainers. To this end, we propose RAP, an end-to-end DLRM training framework that supports Resource-aware Automated GPU sharing for DLRM input Preprocessing and Training. The core idea of RAP is to accurately capture the remaining GPU computing resources during DLRM training for input preprocessing, achieving superior training efficiency without requiring additional resources. Specifically, RAP utilizes a co-running cost model to efficiently assess the costs of various input preprocessing operations, and it implements a resource-aware horizontal fusion technique that adaptively merges smaller kernels according to GPU availability, circumventing any interference with DLRM training. In addition, RAP leverages a heuristic searching algorithm that jointly optimizes both the input preprocessing graph mapping and the co-running schedule to maximize the end-to-end DLRM training throughput. The comprehensive evaluation shows that RAP achieves 78.3× speedup on average over CPU-based DLRM input preprocessing frameworks. In addition, the end-to-end training throughput of RAP is only 2.04% lower than the ideal case, which has no input preprocessing overhead.

Wang, Zheng↗
DOE OSTI2025

Data Readiness for AI: A 360-Degree Survey

Artificial Intelligence (AI) applications critically depend on data. Poor-quality data produces inaccurate and ineffective AI models that may lead to incorrect or unsafe use. Evaluation of data readiness is a crucial step in improving the quality and appropriateness of data usage for AI. R&D efforts have been spent on improving data quality. However, standardized metrics for evaluating data readiness for use in AI training are still evolving. In this study, we perform a comprehensive survey of metrics used to verify data readiness for AI training. This survey examines more than 140 papers published by ACM Digital Library, IEEE Xplore, journals such as Nature, Springer, and Science Direct, and online articles published by prominent AI experts. This survey aims to propose a taxonomy of data readiness for AI (DRAI) metrics for structured and unstructured datasets. We anticipate that this taxonomy will lead to new standards for DRAI metrics that would be used for enhancing the quality, accuracy, and fairness of AI training and inference.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

FLYING SERVING: On-the-Fly Parallelism Switching for Large Language Model Serving

Production LLM serving must simultaneously deliver high throughput, low latency, and sufficient context capacity under non-stationary traffic and mixed request requirements. Data parallelism (DP) maximizes throughput by running independent replicas, while tensor parallelism (TP) reduces per-request latency and pools memory for long-context inference. However, existing serving stacks typically commit to a static parallelism configuration at deployment; adapting to bursts, priorities, or long-context requests is often disruptive and slow. We present Flying Serving, a vLLM-based system that enables online DP-TP switching without restarting engine workers. Flying Serving makes reconfiguration practical by virtualizing the state that would otherwise force data movement: (i) a zero-copy Model Weights Manager that exposes TP shard views on demand, (ii) a KV Cache Adaptor that preserves request KV state across DP/TP layouts, (iii) an eagerly initialized Communicator Pool to amortize collective setup, and (iv) a deadlock-free scheduler that coordinates safe transitions under execution skew. Across three popular LLMs and realistic serving scenarios, Flying Serving improves performance by up to 4.79 × under high load and 3.47 × under low load while supporting latency- and memory-driven requests.

Gao, Shouwei [ORNL]↗
DOE OSTI2025

Investigation of a U(IV)/U(III) Thermodynamic Reference Electrode for High-Temperature Molten Fluoride Salts

While thermodynamic reference electrodes with known and stable potentials are common in traditional aqueous systems, the high temperature and corrosive environment of a molten fluoride salt makes achieving long term stability with a thermodynamic reference electrode challenging, especially at temperatures of 600°C or higher. In this work, a thermodynamic reference electrode consisting of U(IV)/U(III) in a boron nitride compartment was evaluated for use in FLiBe at temperatures ≥ 600°C. FLiBe used in the study was purified by AlphaTech's proprietary process and characterized by ICP-MS and square wave voltammetry. The free oxide concentration was <2 ppm. Using the purified FLiBe, the U(IV)/U(III) thermodynamic reference electrode was shown to provide a stable, well-defined, and reproducible potential for more than 600+ hours of use in different tests. Moreover, the thermodynamic reference electrode showed a consistent potential with no signs of failure, even after being cooled between tests and then reheated for reuse. Thus, the U(IV)/U(III) reference electrode is suitable for use in rigorous electrochemical studies in molten fluoride salts. As a result, it may be useful as a common standard, facilitating the advancement of nuclear applications such as isotope separation or online monitoring of reactor systems through improved certainty in the measurement of thermodynamic potentials.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2020

Inner Engineering Practices and Advanced 4-day Isha Yoga Retreat Are Associated with Cannabimimetic Effects with Increased Endocannabinoids and Short-Term and Sustained Improvement in Mental Health: A Prospective Observational Study of Meditators

Anxiety and depression are common in the modern world, and there is growing demand for alternative therapies such as meditation. Meditation can decrease perceived stress and increase general well-being, although the physiological mechanism is not well-characterized. Endocannabinoids (eCBs), lipid mediators associated with enhanced mood and reduced anxiety/depression, have not been previously studied as biomarkers of meditation effects. Our aim was to assess biomarkers (eCBs and brain-derived neurotrophic factor [BDNF]) and psychological parameters after a meditation retreat. Methods. This was an observational pilot study of adults before and after the 4-day Isha Yoga Bhava Spandana Program retreat. Participants completed online surveys (before and after retreat, and 1 month later) to assess anxiety, depression, focus, well-being, and happiness through validated psychological scales. Voluntary blood sampling for biomarker studies was done before and within a day after the retreat. The biomarkers anandamide, 2-arachidonoylglycerol (2-AG), 1-arachidonoylglycerol (1-AG), docosatetraenoylethanolamide (DEA), oleoylethanolamide (OLA), and BDNF were evaluated. Primary outcomes were changes in psychological scales, as well as changes in eCBs and BDNF. Results. Depression and anxiety scores decreased while focus, happiness, and positive well-being scores increased immediately after retreat from their baseline values (P < 0.001). All improvements were sustained 1 month after BSP. All major eCBs including anandamide, 2-AG, 1-AG, DEA, and BDNF increased after meditation by > 70% (P < 0.001). Increases of ≥20% in anandamide, 2-AG, 1-AG, and total AG levels after meditation from the baseline had weak correlations with changes in happiness and well-being. Conclusions. A short meditation experience improved focus, happiness, and positive well-being and reduced depression and anxiety in participants for at least 1 month. Participants had increased blood eCBs and BDNF, suggesting a role for these biomarkers in the underlying mechanism of meditation. Meditation is a simple, organic, and effective way to improve well-being and reduce depression and anxiety.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

Numerical Simulations of Carbon Dioxide Storage Efficiency in Heterogeneous Reservoir Models

The U.S. Department of Energy’s National Energy Technology Laboratory (DOE-NETL) has been developing methods and tools (the online Carbon Dioxide Storage prospeCtive Resource Estimation Excel aNalysis (CO2-SCREEN) tool) to estimate carbon dioxide (CO2) storage potential in subsurface reservoirs. The CO2 storage efficiency terms are input in the tool to calculate storage potential in targeted reservoirs. In this effort, two CO2 storage efficiency terms were evaluated: volumetric displacement ( E V ) and microscopic displacement ( E d ). The first term deals with efficiency of CO2 propagation into an accessible reservoir volume, while the second term evaluates effectiveness of native fluid displacement with CO2. The interpreted well logs and core sample measurements were applied to create the heterogeneous reservoir models including geostatistical realizations of porosity and intrinsic permeability fields. Supercritical CO2 was injected over the course of 30 years into brine-saturated reservoir models for clastics, limestone, and dolomite lithologies and deltaic fluvial, aeolian, shallow marine, and reef depositional environments by means of varying reservoir parameters and injection scenarios. The reservoir models providing vertically heterogeneous petrophysical properties and designated as “layered reservoir models” (with homogeneous parameters along each layer of the model) were not determined to be a transition between the homogeneous and heterogeneous models in respect to storage efficiency. Another finding shows that high-efficiency factors do not necessarily mean increased CO2 storage; they rather indicate that the available volume and pore space are more fully utilized. The CO2 storage efficiency factors were evaluated dynamically at the select time points using P 10 ‐ P 50 ‐ P 90 percentiles. The results of this study show that the P 10 ‐ P 90 distribution for volumetric efficiency is wider when compared to the microscopic efficiency. It was found that where dominant buoyancy forces drive the plume to the top of a target formation, the volumetric efficiency is low. Tighter sandstone and carbonate formations show prevalence of capillary forces and better utilization of reservoir volume.

Myshakin, Evgeniy M.↗
DOE OSTI2026

Decision Making Under Uncertainty Human Subjects Data - Fire Evacuation Task

This dataset contains de-identified data from human subjects experiments, along with the images and code that were used to run the experiments (as a crowdsourced online study). In this study, participants were shown the probability of a house being in the burn zone of a wildfire. They were asked if they would stay in the house or evacuate in that scenario. The probability information was presented in different ways, including text and maps. The studies tested the impact of different visual cues on the participants' patterns of decisions.

Matzen, Laura E. [Sandia National Laboratories (SN↗
DOE OSTI2021

Automated CT registration, segmentation, and quantification (AutoCT) v1.0

Processing and analyzing brain imaging is crucial in both scientific development and clinical field. In this software package, we build a pipeline that integrates automatic registration, segmentation, and quantitative analysis for subjects' CT scans. Leveraging diffeomorphic transformations, we enable optimized forward and inverse mappings between an image and the reference. Furthermore, we extract localized features from deformation field based on an online template process, which advances statistical learning downstream. The created templates, atlas as well as our methods provide the brain imaging community tools for AI implementations.

Essiari, Abdelilah↗
DOE OSTI2021

wtDigiTwin (Wind Turbine Digital Twin) [SWR-21-15]

This wind turbine digital twin software (wtDigiTwin) provides a digital twin solution for wind turbine applications. The focus of wtDigiTwin is to estimate loads, motions and environmental conditions for an operating wind turbine. The program uses supervisory control and data acquisition (SCADA) measurements as inputs, together with a wind turbine model. The wind industry is currently challenged by the high cost of operation and maintenance. These costs could be mitigated if component failures are predicted, but such predictions are difficult unless the turbines are equipped with expensive measuring devices. The alternative is to use a digital twin such as wtDigiTwin to estimate the necessary signals. wtDigiTwin can perform online prediction of signals that are otherwise not measured, using a limited set of reliable measurements and a physics-based model. The predicted signals can be used in applications that have direct cost benefits: 1) real-time estimation of the fatigue consumption of key components of the wind turbine; 2) root cause analyses and failure detections ; 3) lifetime reassessments ; 4) improvements to follow-on designs. The current version provides examples to estimate wind speed, thrust, torque, tower-top position, and tower loads on an onshore wind turbine using the following measurements tower top acceleration, generator torque, pitch, and rotational speed. The model combines a linear state-space model, a wind speed estimator, and a Kalman filter algorithm that integrates measurements with the state model to perform state estimations. The state space model is obtained either using OpenFAST linearizations, or using the yams package provided with the software.

Branlard, Emmanuel↗
DOE OSTI2021

Automated CT registration, segmentation, and quantification (AutoCT) v1.1

Processing and analyzing brain imaging is crucial in both scientific development and clinical field. In this software package, we build a pipeline that integrates automatic registration, segmentation, and quantitative analysis for subjects' CT scans. Leveraging diffeomorphic transofrmations, we enable optimized forward and inverse mappings between an image and the reference. Furthermore, we extract localized features from deformation field based on an online template process, which advances statistical learning downstream. The created templates, atlas as well as our methods provide the brain imaging community tools for AI implementations

Bai, Zhe↗
DOE OSTI2021

slac-lcls/ami

The LCLS-II online graphical analysis monitoring package.

Yamajala, Seshu↗
DOE OSTI2022

Contributing to Sunny open source code

The Sunny package is an existing open source software to support the simulation of magnetic spin systems. It is available online under the MIT license here: https://github.com/SunnySuite/Sunny.jl The package aims to include the following features: - Analysis for symmetry-allowed interactions - Monte Carlo algorithms for simulating equilibrium configurations. - Schemes for integrating spin dynamics. - Inference of model Hamiltonians - Support for generalized SU(N) spins - Tools for interpreting experimental data, such as diffraction data, magnetization curves, and heat capacity data

Barros, Kipton↗
DOE OSTI2020

slaclab/lcls-cu-inj-live

This project contains the tools for running the live online model for the lcls-cu injector. The model is served over EPICS and the client uses bokeh for web-based rendering.

Garrahan, Jacqueline↗