Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Task Analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 847 records · Page 47
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

E-PiPEline: Quick to Market Emulated-PPE using Commonly Available Materials

The Center for Disease Control has recommended the public to wear cloth face coverings in public settings that reduce potential exposure to COVID-19 where other social distancing measures are difficult to maintain (e.g., grocery stores and pharmacies) especially in areas of significant community based transmission. These face coverings and other Emulated-Personal Protective Equipment (EPPE) can be made by using Commonly Available Materials (CAMs). As part of the Sandia COVID-19 LDRD effort (funded under the Materials Science Investment Area), the Sandia E-PiPEline task evaluated E-PPE design options for face coverings and face shields considering their effectiveness, durability, build difficulty, build cost, and comfort. Observations from this investigation are presented here to provide guidelines for home construction of E-PPE. This executive summary includes a brief roadmap of the analysis methodology, two one-page handouts geared to be distributed to the public at large (one for E-PPE face coverings and one for E-PPE face shields), and additional observations regarding the potential solutions for E-PPE face coverings and face shields included to further support the one-page handouts.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2023

JIRIAF: JLAB Integrated Research Infrastructure Acros Facilities

The JIRIAF project aims to combine geographically diverse computing facilities into an integrated science infrastructure. This project starts by dynamically evaluating temporarily unallocated or idled compute resources from multiple providers. These resources are integrated to handle additional workloads without affecting local running jobs. This paper describes our approach to launch best-effort batch tasks which exploit these underutilized resources. Our system measures the real-time behavior of jobs running on a machine and learns to distinguish typical performance from outliers. Unsupervised ML techniques are used to analyze hardware-level performance measures, followed by a real-time cross-correlation analysis to determine which applications cause performance degradation. We then ameliorate bad behavior by throttling these processes. We demonstrate that problematic performance interference can be detected and acted on, which makes it possible to continue to share resources between applications and simultaneously maintain high utilization levels in a computing cluster. We relocate the CLAS12 data processing workflow to a remote data center for a case study, preventing file migration and temporal data persistency.

Lawrence, David↗
DOE OSTI2024

Capability Enhancements for System-level thermal Hydraulic Modeling of Lead Fast Reactors

This project has focused on the use, assessment, and development of the SAS4A/SASSYS-1 (SAS) safety analysis software. Although SAS was originally intended as a safety analysis tool for Liquid Metal cooled Fast Reactors (LMFRs), which includes both Sodium Fast Reactors (SFRs) and Lead Fast Reactors (LFRs), the vast majority of its recent development and customization has been tailored to SFRs. In general, enhancements that are made to the software for SFRs are applicable to LFRs, however, the fuel composition and corrosive nature of lead requires careful consideration when performing safety analysis of an LFR. In this project an emphasis was placed on closing gaps that are associated with modeling LFRs using SAS. The principal objective of the project was to enhance the ability of SAS as a licensing tool for LFRs. This objective was to be accomplished through three tasks: 1) Enhance the ability of SAS to couple with external software; 2) Improve the underlying physics models in SAS, with priority given to models that are highly relevant to LFRs; 3) Extend the Verification and Validation (V&V) basis of the software

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2020

Super resolution convolutional neural network for feature extraction in spectroscopic data

Two dimensional (2D) peak finding is a common practice in data analysis for physics experiments, which is typically achieved by computing the local derivatives. However, this method is inherently unstable when the local landscape is complicated or the signal-to-noise ratio of the data is low. In this work, we propose a new method in which the peak tracking task is formalized as an inverse problem, which thus can be solved with a convolutional neural network (CNN). In addition, we show that the underlying physics principle of the experiments can be used to generate the training data. By generalizing the trained neural network on real experimental data, we show that the CNN method can achieve comparable or better results than traditional derivative based methods. This approach can be further generalized in different physics experiments when the physical process is known.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2021

Results for the Fourth Quarter Calendar Year 2020 Tank 50 Salt Solution Sample

In this Technical Report, the chemical and radionuclide contaminant results from the Fourth Quarter Calendar Year 2020 (CY20) sample of Tank 50 salt solution are presented in tabulated form. The information from this characterization will be used by Savannah River Remediation (SRR) for the transfer of aqueous waste from Tank 50 to the Saltstone Production Facility (SPF), where the waste will be treated and disposed in the Saltstone Disposal Facility. This Technical Report compares results, where applicable, to SPF Waste Acceptance Criteria (WAC) Limits and Targets. The chemical and radionuclide contaminant results from the characterization of the Fourth Quarter CY20 sampling of Tank 50 were requested by SRR personnel via a Task Technical Request (TTR) and details of the testing are presented in the Savannah River National Laboratory (SRNL) Task Technical and Quality Assurance Plan (TTQAP). This Technical Report is part of Deliverable 2 relating to Task 1 from the SRR request. Data pertaining to the regulatory limits for Resource Conservation and Recovery Act (RCRA) metals per Task 2 from the SRR request, will be obtained semi-annually for the 1QCY21 and 3QCY21 Tank 50 samples. However, data pertaining to the regulatory limits for Resource Conservation and Recovery Act (RCRA) metals for this current 4QCY20 Tank 50 sample will be obtained and documented per the special analysis associated with the vault classification sample as described in the associated TTQAP.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2026

Cybersecurity Workforce Training for SMR Integration into Distribution Grids: A Competency Framework and Containerized Hands-On Lab for the SMR/DER/Microgrid Boundary

Small modular reactors (SMRs) and microreactors are entering the U.S. distribution grid as synchronous generation on feeders designed for loads and inverter-based distributed energy resources (DERs). No existing cybersecurity training program addresses this intersection of nuclear operations, DER management, and operational technology security. As subcontractor to Iowa State University on the CyDERMS Center, Argonne analyzed the relevant standards and training landscape, translated the resulting gaps into a twelve-objective competency framework across distribution-operator and graduate-analyst role tracks, and built a containerized training lab using a ∼400-bus composite grid model behind a realistically simulated Modbus TCP SCADA stack. The analysis isolates the balance-of-plant / energy-management-system (BOP/EMS) boundary as the critical jurisdictional seam where, as of March 2026, neither NRC nor NERC CIP cleanly claims cybersecurity responsibility for distribution-connected SMRs. The framework maps each objective across NIST CSF 2.0, ISA/IEC 62443, NIST NICE Task–Knowledge–Skill statements, and NRC RG 5.71 awareness-and-training controls. The training lab implements operator-recognition assessment scenarios spanning grid-side disturbances and telemetry-layer anomalies.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2026

WM26 Paper Multi-Robot Collaboration for Hazardous Environments

Hazardous nuclear and industrial facilities are rarely designed for robots. Work in these domains demand precise manipulation and robust mobility in cluttered, constrained spaces where off-the-shelf platforms struggle and “one-size-fits-all” machines become costly and complex. Idaho National Laboratory (INL) is developing an autonomous, multi-robot inspection system that coordinates task-specific platforms rather than relying on a single omni-tool robot. An electric truck serves as a power and compute hub for a custom manipulator co-developed with Florida International University (FIU), a commercial mini crawler, a pan–tilt–zoom camera, and a Nexxis Argus LiDAR mapping system. Working in concert, these robots generate spatial, radiation, and temperature maps of the pit environments at the Hanford Waste Tank Farms. These systems will capture visual records and environmental telemetry to allow for analysis post inspection. The system architecture uses Robot Operating System 2 (ROS 2) for publish/subscribe integration, NVIDIA Isaac Sim and Unity for simulation and visualization, and algorithms such as NVBlox to fuse data into unified 3D overlays. This robot-agnostic approach reduces operator burden by enabling autonomy across heterogeneous platforms and lets each robot be used where it is strongest. Having autonomous functions means operators don’t have to fully control multiple different components. The ease of use could allow for more widespread adoption of advanced robotics at waste management sites that see continued use. By coordinating simpler, purpose-built mechanisms, the approach lowers design and manufacturing complexity, reduces capital risk in contaminated settings, and improves controllability for complex inspection and manipulation tasks. We present the architecture, early results, and lessons learned from building and deploying this coordinated multi-robot system, with the goal of accelerating safe, cost-effective adoption of advanced robotics at waste-management sites.

42 - ENGINEERING↗
DOE OSTI2025

MRCI Task 2: Addressing Key Technical Challenges - Executive Summary Report

This report provides a high-level overview of Task 2 products that were developed through defining carbon storage systems, Precambrian basement structure and stress, developing regional technical collaboration, modeling and risk assessment. Subtask 2.1: Defining Sub-Regional CS/CCUS Systems Subtask 2.2: Defining Precambrian basement faulting/stress Subtask 2.3: Developing industrial partnerships and regional technical collaborations Subtask 2.4: Conducting regional/subregional analysis Subtask 2.5: Assessing and managing risk for potential commercial-scale storage complexes

MRCI,Technical Challenges↗
DOE OSTI2020

Radioactive Source Localization via Bayesian Particle Filter

In the event of a misplaced radioactive source or other emergency situation, measuring a radiation field, mapping its distribution, and determining a source location are essential tasks to ameliorating the situation. However, radiation fields may be extremely hazardous to human surveyors and minimizing received radiation doses is just as essential. Robots appear to be a potential solution to these problems. Beyond simply measuring radiation, the robot's computer processing capabilities offer a way to apply complex data analysis methods to radiation measurements in real-time. Methods which predict likely source locations can then feed this information into other processes, potentially improving path planning and enabling more efficient measurements. Given a robot mounted with a gamma-ray detector, can we: develop a methodology to account for detector performance across a wide range of source angles, distances, and photon energies? operate an autonomously navigating robot to effectively survey and characterize an area of interest? implement a data analysis method, conventionally used in measurements of motion, for source localization purposes? An open-source TurtleBot 3 robot, running Robot Operating System (ROS) on Ubuntu 16.04 LTS, was fitted with a Kromek GR1{sup R} Cadmium Zinc Telluride (CZT) solid-state gamma-ray detector. As a part of ROS, the packages OpenSlam, gmapping, and amcl were used to perform Simultaneous Localization and Mapping (SLAM), determining the robot's position and mapping the surrounding area. Data was acquired via Lidar mounted on top the TurtleBot 3. Detector Calibration Fit: The equation was fit to 365 counts of various energies, distances, and angles. A MATLAB{sup R} program was written to simulate measurements taken a robot on a random walk, with count data and positions discretized into finite element pixels. Using this program, a sample of 100 runs was performed on a map with a simulated source at the center, with a total of 200 of 2 pixels each. Similarly, multiple runs of the filter were performed on recorded robot measurement data. In both simulation and real tests, when corrected for errors (particles placed outside of bounds or on the robot, and simulation-specific errors), corresponding t-tests of predicted x and y-coordinates were within a 95% confidence interval of the actual position. For the real trial, these positions are slightly skewed right in the x-axis as the robot remained mainly to the left side of the source within the sample area. These simulations demonstrate potential validity for the usage of a particle filter as method of radioactive source localization. In the future, true real-time implementation and data fusion may further augment the performance of the robot to localize lost sources. Additionally, identification of multiple sources, determination of source types, and usage of a collimator are areas to potentially be explored.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2022

Local conformations and heterogeneities in structures and dynamics of isotactic polypropylene adsorbed onto carbon fiber

Carbon fiber (CF) reinforced polymers (CFRPs) have experienced widespread use in various industries. One of the most important parameters that controls the macroscopic property of CFRPs is the interface between a polymer matrix and CF. There is growing evidence to suggest the formation of a bound polymer layer (BPL), i.e., polymer chains that physically adsorb on a filler surface. However, this interface is always in contact with the thicker part of a polymer matrix, rendering its understanding a difficult task. Therein, we use CF-reinforced isotactic polypropylene (iPP) as a rational CFRP. To characterize the BPL on the CF surface, we extracted it from the CFRP using solvent-rinsing with p-xylene. The physical and thermal properties of the BPL were characterized by differential scanning calorimetry and thermogravimetric analysis, while its microscopic structures and dynamics were probed by small-angle neutron scattering and quasi-elastic neutron scattering (QENS) techniques. Subsequently, we employed atomistic molecular dynamics (MD) simulations to complement the QENS results above the bulk melting temperature and reveal details that were experimentally inaccessible. In this work, we observed that the degree of crystallinity of the BPL was quite lower than the bulk, while the melting temperature of the BPL remained the same as the bulks. Within the given length and time scales probed by QENS and MD, we also observed that most of the bound chains were mobile, with the formation of a high-density region (less than 1 nm in thickness) near the CF surface. The segmental dynamics of the bound chains probed by both QENS and MD were also much faster than those of the free chains, possibly due to the presence of a free surface region at the topmost surface of the BPL. Furthermore, the MD results demonstrated that the backbone chains and side groups lie nearly flat on the CF surface, which is the driving force for the flattening process of the iPP BPL to overcome the conformational entropy loss in the total free energy.

36 MATERIALS SCIENCE↗
DOE OSTI2024

OrthoPhyl—streamlining large-scale, orthology-based phylogenomic studies of bacteria at broad evolutionary scales

Abstract There are a staggering number of publicly available bacterial genome sequences (at writing, 2.0 million assemblies in NCBI's GenBank alone), and the deposition rate continues to increase. This wealth of data begs for phylogenetic analyses to place these sequences within an evolutionary context. A phylogenetic placement not only aids in taxonomic classification but informs the evolution of novel phenotypes, targets of selection, and horizontal gene transfer. Building trees from multi-gene codon alignments is a laborious task that requires bioinformatic expertise, rigorous curation of orthologs, and heavy computation. Compounding the problem is the lack of tools that can streamline these processes for building trees from large-scale genomic data. Here we present OrthoPhyl, which takes bacterial genome assemblies and reconstructs trees from whole genome codon alignments. The analysis pipeline can analyze an arbitrarily large number of input genomes (>1200 tested here) by identifying a diversity-spanning subset of assemblies and using these genomes to build gene models to infer orthologs in the full dataset. To illustrate the versatility of OrthoPhyl, we show three use cases: E. coli/Shigella, Brucella/Ochrobactrum and the order Rickettsiales. We compare trees generated with OrthoPhyl to trees generated with kSNP3 and GToTree along with published trees using alternative methods. We show that OrthoPhyl trees are consistent with other methods while incorporating more data, allowing for greater numbers of input genomes, and more flexibility of analysis.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

Data-Driven Digital Twin for Reliability Assessment of DC/DC Buck Converter

In commercial applications, the operation of DC/DC converters significantly impacts overall system performance and long-term reliability. This study introduces a data-driven digital twin (DT) approach for estimating critical degradation parameters of DC/DC BUCK converter under steady-state condition. Initially, a circuit-level MATLAB/Simulink digital model (DM C ) is refined against a hardware prototype’s switching model dataset using offline particle swarm optimization. The optimized digital model’s steady-state response is then verified with its average model response while varying the duty and load. Subsequently, degradation profiles are imposed on the inductor, capacitor, MOSFET in the DMC. A large dataset is generated from this model, allowing training, validation, and testing of machine learning (ML) models for component health regression tasks. The proposed method employs random forest ML models, achieving impressive regression results with a squared R value as high as 0.99978 and a root mean square error of 4.2× 10 –6 . The method is further validated on a medium power level DC/DC BUCK prototype with varying load conditions, and includes the analysis of MOSFET’s on-resistance under degradation conditions. This data-driven DT method shows promise for identifying parasitic degradation and ohmic loss parameters, enhancing converter reliability assessments in a non-invasive, generalized, and computationally efficient manner.

14 SOLAR ENERGY↗
DOE OSTI2021

DEPRECATED AI-Batt-OS (Autonomous Identification of Battery Life Models - Open Source) [SWR 21-17]

DEPRECATED. This repository was archived by the owner on Jun 30, 2026. It is now read-only. Open source implementation of some of the methods utilized by AI-Batt, a battery lifetime modeling and analysis toolkit provided by the National Laboratory of the Rockies (NLR). This software demonstrates the use of bi-level optimization and symbolic regression techniques to semi-autonomously identify algebraic models predicting the capacity fade of lithium-ion batteries during calendar aging. Modeling the degradation of batteries is a complex task, due to the difficulty in separating the time-dependent and time-independent factors impacting cell level degradation, across multiple data series with different numbers of measurements and/or data quality. Bi-level optimization enables model parameters to be optimized to either the entire data set or to individual data series, allowing statistical disambiguation of global behaviors (data series independent) and local behaviors (data series dependent). Symbolic regression is used to automatically search for optimal low-dimesional models predicting the variation of locally optimized parameters versus time-independent experimental variables from millions of possible models, resulting in a more accurate and repeatable model identification process than is possible by a manual search. The provided tools also implement cross-validation and bootstrap resampling schemes, empowering statistical model comparison/selection and quantification of model uncertainties. An example script replicates the results from the manuscript "Challenging Practices of Algebraic Battery Life Models through Statistical Validation and Model Identification via Machine-Learning", submitted to ECS. All code is written in MATLAB. Requires the Statistics and Machine Learning Toolbox. Contact Dr. Paul Gasper at Paul.Gasper@nlr.gov for any questions.

Gasper, Paul↗
DOE OSTI2026

Geology of the One Earth Energy Site

The One Earth Energy site is one of two sites in the Illinois Storage Corridor (ISC) project. The objectives of the ISC project is to accelerate commercial deployment of carbon capture utilization and storage at two individual sites and receive approvals for Underground Injection Control (UIC) Class VI permits for construction at each site. At the One Earth Energy site, an extensive data collection program was undertaken, which included the drilling of a test well (One Earth Energy #1 [OEE #1]), four 2D seismic lines, and a small 3D seismic survey. The OEE #1 well was drilled in 2022 and acquired extensive core, log, and testing data to characterize the subsurface geology of the site. Coring was focused on the storage interval, the Mt. Simon Sandstone, and the confining interval, the Eau Claire Formation. The core and log data were used to evaluate the sedimentology and sequence stratigraphy, as well as to develop the conceptual geologic model. This report includes the geological summaries of the Mt. Simon Sandstone and the Eau Claire Formation. The extensive analysis of the log data is included in the petrophysical section, showing ranges of porosity, estimated pore size, and the mineral content of selected zones in the well. The separate petrographic technical report entitled “Petrographic and Advanced Geologic Characterization Report on One Earth Energy #1 (API# 1211325373)”, report number DOE-UIUC-0031892-04, details thin section point-counting analysis that includes mineralogical and pore space analysis, including grain size analysis, annotated thin section photomicrographs, scanning electron microscopy (SEM) with energy dispersive X-ray spectroscopy (EDS), and statistics of grain size analysis on Mt. Simon thin sections from OEE #1. The final OEE #1 well data to be included in this geology report is the routine core analysis of both whole core plugs and rotary sidewall core plugs. In addition to the OEE #1 well, four 2D seismic lines and a small 3D survey were acquired as part of the overall subsurface geological characterization. This geology report references the seismic interpretation report, entitled “One Earth Energy Site Seismic Interpretation Task 5.0”, report number DOE-UIUC-0031892-07. This report details the stratigraphic and structural interpretation of the 2D and 3D seismic data acquired at the One Earth Energy site. The 2D seismic data was acquired in 2019 and 2021, and the 3D survey was acquired in 2022. The objectives of the seismic programs were to contribute to the subsurface characterization of the Mt. Simon-Eau Claire Storage Complex by evaluating the continuity of potential storage reservoirs and containment intervals across the project area, and to determine if any geologic features are present that would increase containment risk to the proposed carbon storage project.

09 BIOMASS FUELS↗
DOE OSTI2021

Predicting Thermal Performance of an Enhanced Geothermal System From Tracer Tests in a Data Assimilation Framework

Abstract Predicting the thermal performance of an enhanced geothermal system (EGS) requires a comprehensive characterization of the underlying fracture flow patterns from practically available data such as tracer data. However, due to the inherent complexities of subsurface fractures and the generally insufficient geological/geophysical data, interpreting tracer data for fracture flow characterization and thermal prediction remains a challenging task. The present study aims to tackle the challenge by leveraging a data assimilation method to maximize the utilization of information inherently contained in tracer data, and meanwhile maintain the flexibility to handle various uncertainties. A tracer data interpretation framework was proposed with the following three components integrated: (a) We use principal component analysis (PCA) to reduce the dimensionality of model parameter space. (b) We use ES‐MDA (ensemble smoother with multiple data assimilation) to invert for fracture aperture/flow fields and obtain posterior model ensembles for uncertainty quantification. Various data types are assimilated jointly to improve the predictive ability of the posterior ensemble. (c) The inverted fracture aperture fields are then incorporated into reservoir models to predict thermal performance. We developed a field‐scale EGS model to verify the ability of the framework to characterize highly heterogeneous fracture aperture/flow fields and predicting thermal performance. We also applied the framework to a mesoscale field experiment to demonstrate its potential application in real‐world geothermal reservoirs. The results indicate that the proposed framework can effectively retrieve fracture flow information from tracer data for thermal prediction and uncertainty quantification, and thus provide informative guidance for EGS optimization and risk management.

15 GEOTHERMAL ENERGY↗
DOE OSTI2021

Scalable Comparative Visualization of Ensembles of Call Graphs

Optimizing the performance of large-scale parallel codes is critical for efficient utilization of computing resources. Code developers often explore various execution parameters, such as hardware configurations, system software choices, and application parameters, and are interested in detecting and understanding bottlenecks in different executions. They often collect hierarchical performance profiles represented as call graphs, which combine performance metrics with their execution contexts. The crucial task of exploring multiple call graphs together is tedious and challenging because of the many structural differences in the execution contexts and significant variability in the collected performance metrics (e.g., execution runtime). In this paper, we present Ensemble CallFlow to support the exploration of ensembles of call graphs using new types of visualizations, analysis, graph operations, and features. We introduce ensemble-Sankey , a new visual design that combines the strengths of resource-flow (Sankey) and box-plot visualization techniques. Whereas the resource-flow visualization can easily and intuitively describe the graphical nature of the call graph, the box plots overlaid on the nodes of Sankey convey the performance variability within the ensemble. Our interactive visual interface provides linked views to help explore ensembles of call graphs, e.g., by facilitating the analysis of structural differences, and identifying similar or distinct call graphs. Finally, we demonstrate the effectiveness and usefulness of our design through case studies on large-scale parallel codes.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

A comprehensive guide to CAN IDS data and introduction of the ROAD dataset

Although ubiquitous in modern vehicles, Controller Area Networks (CANs) lack basic security properties and are easily exploitable. A rapidly growing field of CAN security research has emerged that seeks to detect intrusions or anomalies on CANs. Producing vehicular CAN data with a variety of intrusions is a difficult task for most researchers as it requires expensive assets and deep expertise. To illuminate this task, we introduce the first comprehensive guide to the existing open CAN intrusion detection system (IDS) datasets. We categorize attacks on CANs including fabrication (adding frames, e.g., flooding or targeting and ID), suspension (removing an ID’s frames), and masquerade attacks (spoofed frames sent in lieu of suspended ones). We provide a quality analysis of each dataset; an enumeration of each datasets’ attacks, benefits, and drawbacks; categorization as real vs. simulated CAN data and real vs. simulated attacks; whether the data is raw CAN data or signal-translated; number of vehicles/CANs; quantity in terms of time; and finally a suggested use case of each dataset. State-of-the-art public CAN IDS datasets are limited to real fabrication (simple message injection) attacks and simulated attacks often in synthetic data, lacking fidelity. In general, the physical effects of attacks on the vehicle are not verified in the available datasets. Only one dataset provides signal-translated data but is missing a corresponding “raw” binary version. This issue pigeon-holes CAN IDS research into testing on limited and often inappropriate data (usually with attacks that are too easily detectable to truly test the method). The scarcity of appropriate data has stymied comparability and reproducibility of results for researchers. As our primary contribution, we present the Real ORNL Automotive Dynamometer (ROAD) CAN IDS dataset, consisting of over 3.5 hours of one vehicle’s CAN data. ROAD contains ambient data recorded during a diverse set of activities, and attacks of increasing stealth with multiple variants and instances of real (i.e. non-simulated) fuzzing, fabrication, unique advanced attacks, and simulated masquerade attacks. To facilitate a benchmark for CAN IDS methods that require signal-translated inputs, we also provide the signal time series format for many of the CAN captures. Our contributions aim to facilitate appropriate benchmarking and needed comparability in the CAN IDS research field.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Contextual Active Online Model Selection with Expert Advice

How can we collect the most useful labels to learn a model selection policy, when presented with arbitrary heterogeneous data streams? In this paper, we formulate this task as a contextual active model selection problem, where at each round the learner receives an unlabeled data point along with a context. The goal is to output the best model for any given context without obtaining an excessive amount of labels. In particular, we focus on the task of selecting pre-trained classifiers, and propose a contextual active model selection algorithm (CAMS), which relies on a novel uncertainty sampling query criterion defined on a given policy class for adaptive model selection. In comparison to prior art, our algorithm does not assume a globally optimal model. We provide rigorous theoretical analysis for the regret and query complexity under both adversarial and stochastic settings. Our experiments on several benchmark classification datasets demonstrate the algorithm’s effectiveness in terms of both regret and query complexity. Notably, to achieve the same accuracy, CAMS incurs less than 10% of the label cost when compared to the best online model selection baselines on CIFAR10.

Liu, Xuefeng↗