MGARD: A multigrid framework for high-performance, error-controlled data compression and refactoring
Not Available
SEARCH · Engineering Papers
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Not Available
We present multiwavelength observations and a model for flat-spectrum radio quasar (FSRQ) NVSS J141922−083830, originally classified as a blazar candidate of unknown type (BCU II object) in the Third Fermi-LAT AGN Catalog. Relatively bright flares (>3 magnitudes) were observed on 2015 February 21 (MJD 57074) and 2018 September 8 (MJD 58369) in the optical band with the MASTER Global Robotic Net telescopes. Optical spectra obtained with the Southern African Large Telescope on 2015 March 1 (MJD 57082), during outburst, and on 2017 May 30 (MJD 57903), during quiescence, showed emission lines at 5325 Å and at ≈3630 Å that we identified as the Mg II III] 1909 Å lines, respectively, and hence derived a redshift z = 0.903. Analysis of Fermi-Large Area Telescope (LAT) data was performed in the quiescent regime (5 yr of data) and during four prominent flaring states in 2014 February–April, 2014 October–November, 2015 February–March, and 2018 September. We present spectral and timing analysis with Fermi-LAT . We report a hardening of the gamma-ray spectrum during the last three flaring periods, with a power-law spectral index Γ = 2.0–2.1. The maximum gamma-ray flux level was observed on 2014 October 24 (MJD 56954) at (7.57 ± 1.83) × 10 −7 ph cm −2 s −1 . The multiwavelength spectral energy distribution (SED) during the 2015 February–March flare supports the earlier evidence of this blazar to belong to the FSRQ class. The SED can be well represented with a single-zone leptonic model with parameters typical of FSRQs, but also a hadronic origin of the high-energy emission cannot be ruled out.
Analyzing the logs of even the smallest Information Technology (IT) system can be a challenge considering they can generate millions of lines of log data in a very short time. Splunk® Enterprise is an industry leading tool that allows analysis of log data, which can enhance troubleshooting capabilities, improve system performance, and improve the security posture of an IT system. Ivanti Connect Secure© (ICS) is a market-leading platform powered by the Ivanti Secure Socket Layer Virtual Private Network (SSL VPN) appliance, providing an architecture for secure access to and protection of network resources. This paper describes an approach for using Splunk Enterprise search capabilities to perform advanced data analysis of ICS logs.
Explore the source record for details and available documents.
Explore the source record for details and available documents.
Explore the source record for details and available documents.
Explore the source record for details and available documents.
AGR Program Overview and Current Activities Fission Product Transport Data Short-Lived Fission Product Release Fuel Performance Margin Data Oxidation Testing Data
There is a need to transfer knowledge among institutions and organizations to save effort in annotation and labeling or in enhancing task performance. However, knowledge transfer is difficult because of restrictions that are in place to ensure data security and privacy. Institutions are not allowed to exchange data or perform any activity that may expose personal information. With the leverage of a differential privacy algorithm in a high-performance computing environment, we propose a new training protocol, Bootstrap Aggregation of Teacher Ensembles (BATE), which is applicable to various types of machine learning models. The BATE algorithm is based on and provides enhancements to the PATE algorithm, maintaining competitive task performance scores on complex datasets with underrepresented class labels.We conducted a proof-of-the-concept study of the information extraction from cancer pathology report data from four cancer registries and performed comparisons between four scenarios: no collaboration, no privacy-preserving collaboration, the PATE algorithm, and the proposed BATE algorithm. The results showed that the BATE algorithm maintained competitive macro-averaged F1 scores, demonstrating that the suggested algorithm is an effective yet privacy-preserving method for machine learning and deep learning solutions.
This initial gap analysis considers proposed accident tolerant fuel (ATF) options currently being irradiated in commercial reactors, since these are most likely for future batch implementation. Also, advanced fuel (AF) options that may be likely for use in advanced reactors are considered. The cladding technologies considered were chromium-coated zirconium-based alloys, FeCrAl, and both monolithic and matrix composite Silicide carbide (SiC). The fuel technologies considered were chromium-doped uranium dioxide fuel, uranium alloys, uranium nitride, and uranium silicide. Numerous national labs, industry, and countries are performing significant testing and modeling on these proposed technologies to establish performance, but at this time none of the prototypes being irradiated have achieved end-of-life (EOL) burnup. There are some testing results after one burnup cycle to verify in-reactor performance, but little data beyond that. As the ATF prototypes acquire more burnup, data will be produced that is relevant to storage and transportation. The DOE:NE Spent Fuel and Waste Science and Technology (SWFST) Storage and Transportation (ST) Control Account will evaluate the performance data as it becomes available for application to the identified gaps for ST.
As awareness around building energy consumption increases, practitioners are encouraged to consider performance aspects regarding the built environment more closely and find ways to improve its efficiency. Improvements in building information modeling (BIM) and building performance simulation (BPS) tools present opportunities to facilitate information communication with a wider range of stakeholders. The building sector can benefit from the integration of performance informatics; however, there has been limited success in utilizing available technologies that promote data integration and management in favor of enriching our knowledge and understanding of buildings as artifacts of information. This phenomenon was investigated by conducting a survey, together with a review of relevant literature, to depict the relevant challenges and opportunities for the architecture, engineering, construction, and owner-operated (AECO) industry, as it undergoes digital transformation, as well as the working practices that have formed around them. It is argued that the current tools available to practitioners do not support effective data serialization between design and analytics processes, affecting the collaboration between team members. Lastly, a series of functional goals are proposed to support a higher level of reliability in the ways information is mobilized, by rethinking the technologies and methods for organizing information systems.
Here, we report on the upgrade of the electronics and data acquisition (DAQ) of the high-efficiency CAESium-iodide scintillator ARray (CAESAR) at the Facility for Rare Isotope Beams (FRIB). With the on-going capability ramp-up of FRIB, CAESAR is expected to continue to be an in-demand -ray spectrometer owing to its high detection efficiency, compactness, and modularity, enabling easy integration with additional detection and DAQ systems. Within this context, the CAESAR electronics and DAQ were upgraded to remove obsolete modules, enhance the ease of integration with external instruments, and optimize the DAQ live time. We present the comprehensive results from offline (γ-ray sources) and online (in-beam experiment) commissioning, characterizing the performance of CAESAR’s new electronics and DAQ.
Genomic datasets are growing dramatically as the cost of sequencing continues to decline and small sequencing devices become available. Enormous community databases store and share these data with the research community, but some of these genomic data analysis problems require large-scale computational platforms to meet both the memory and computational requirements. These applications differ from scientific simulations that dominate the workload on high-end parallel systems today and place different requirements on programming support, software libraries and parallel architectural design. For example, they involve irregular communication patterns such as asynchronous updates to shared data structures. We consider several problems in high-performance genomics analysis, including alignment, profiling, clustering and assembly for both single genomes and metagenomes. We identify some of the common computational patterns or ‘motifs’ that help inform parallelization strategies and compare our motifs to some of the established lists, arguing that at least two key patterns, sorting and hashing, are missing. This article is part of a discussion meeting issue ‘Numerical algorithms for high-performance computational science’.
This study introduces a novel labeling pipeline to accelerate the labeling process of scientific data sets by using artificial intelligence (AI)-guided tagging techniques. This pipeline includes a set of interconnected web-based graphical user interfaces (GUIs), where Data Clinic and MLCoach enable the preparation of machine learning (ML) models for data reduction and classification, respectively, while Label Maker is used for label assignment. Throughout this pipeline, data can be accessed through a direct connection to a file system or through Tiled for access through Hypertext Transfer Protocol (HTTP). Our experimental results present three use cases where this labeling pipeline has been instrumental for the study of large X-ray scattering data sets in the area of pattern recognition, the remote analysis of resonant soft X-ray scattering data and the fine-tuning process of foundation models. These use cases highlight the labeling capabilities of this pipeline, including the ability to label large data sets in a short period of time, to perform remote data analysis while minimizing data movement and to enhance the fine-tuning process of complex ML models with human involvement.
The DeepLynx DAG repository will contain several Airflow DAGs (Directed Acyclic Graphs) which will be used in the context of DeepLynx's deployed Apache Airflow instance. These DAGs will be used for multiple data management tasks for DeepLynx data, including but not limited to: - bringing data from various sources and tools into DeepLynx - managing sequential data workflows, such as running Python scripts on data to perform analysis and returning the results to DeepLynx - performing any necessary transformation or pre-processing on data coming into DeepLynx from external sources or out of DeepLynx to go to external applications
Life cycle inventory (LCI) data are critical for robust life cycle assessment (LCA), yet many widely used datasets such as the U.S. Life Cycle Inventory (USLCI) are not natively compatible with advanced modeling frameworks like Brightway2. This work presents an automated pipeline to transform USLCI data into a fully functional Brightway2 project. The workflow performs systematic data cleaning, resolves duplicate process and exchange identifiers, and applies allocation to multi-output processes. Technosphere and biosphere flows are harmonized through unit conversions and a bridge mapping to the biosphere3 database, with comprehensive logging of missing flows and cutoff issues. The resulting Brightway2 database is validated using matrix diagnostics to ensure consistency of the technosphere, and is benchmarked via life cycle impact assessment (LCIA) methods such as ReCiPe and IPCC GWP. Outputs include reproducible CSV exports of corrected processes, elementary flows, characterization factors, and LCIA results, alongside backup utilities for project sharing. This pipeline lowers barriers for integrating USLCI data into open-source LCA workflows, enabling reproducible, validated LCA inventories within the Brightway 2 framework.
Data analytics applications transform raw input data into analytics-specific data structures before performing analytics. Unfortunately, such data ingestion steps are often more expensive than analytics. In addition, various types of NVRAM devices are already used in many HPC systems today. Such devices will be useful for storing and reusing data structures beyond a single process life cycle. We developed Metall, a persistent memory allocator built on top of the memory-mapped file mechanism. Metall enables applications to transparently allocate custom C++ data structures into various types of persistent memories. Metall incorporates a concise and high-performance memory management algorithm inspired by Supermalloc and the rich C++ interface developed by Boost.Interprocess library. On a dynamic graph construction workload, Metall achieved up to 11.7x and 48.3x performance improvements over Boost.Interprocess and memkind (PMEM kind), respectively. We also demonstrate Metall’s high adaptability by integrating Metall into a graph processing framework, GraphBLAS Template Library. Here this study’s outcomes indicate that Metall will be a strong tool for accelerating future large-scale data analytics by allowing applications to leverage persistent memory efficiently.