Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “INGESTION”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 793 records · Page 44

Visual Analytics for Law Enforcement: Deploying a Service-Oriented Analytic Framework for Web-based Visualization

This paper presents key components of the Law Enforcement Information Framework (LEIF) that provides communications, situational awareness, and visual analytics tools in a service-oriented architecture supporting web-based desktop and handheld device users. LEIF simplifies interfaces and visualizations of well-established visual analytical techniques to improve usability. Advanced analytics capability is maintained by enhancing the underlying processing to support the new interface. LEIF development is driven by real-world user feedback gathered through deployments at three operational law enforcement organizations in the US. LEIF incorporates a robust information ingest pipeline supporting a wide variety of information formats. LEIF also insulates interface and analytical components from information sources making it easier to adapt the framework for many different data repositories.

99 GENERAL AND MISCELLANEOUS↗

Interfractional variation in bladder volume and its impact on cervical cancer radiotherapy: Clinical significance of portable bladder scanner

Purpose: A constant bladder volume (BV) is essential to direct the radiotherapy (RT) of pelvic tumors with precision. The purpose of this study was to investigate changes in BV and their impact on cervical cancer RT and to assess the clinical significance of a portable bladder scanner (BS) in achieving a constant BV. Methods: A standard bladder phantom (133 ml) and measurements of actual urine volume were both used as benchmarks to evaluate the accuracy of the BS. Comparisons of BS with computed tomography (CT), cone-beam CT (CBCT), and an ultrasound diagnostic device (iU22) were made. Twenty-two consecutive patients with cervical cancer treated with external beam radical RT were divided into an experimental group (13 patients) and a control group (9 patients). In the experimental group, the BV was measured multiple times by BS pre-RT until it was consistent with that found by planning CT. Then a CBCT was performed. The BV was measured again immediately post-RT, after which the patient’s urine was collected and recorded. In the control group, CBCT only was performed pre-RT. Interfractional changes in BV and their impact on cervical cancer RT were investigated in both groups. The time of bladder filling was also recorded and analyzed. Results: In measuring the volume of the standard bladder phantom, the BS deviated by 1.4% in accuracy. The difference between the measurements of the BS and the iU22 had no statistical significance (linear correlation coefficient 0.96, P < 0.05). The BV measured by the BS was strongly correlated with the actual urine volume (R = 0.95, P < 0.05), planning CT (R = 0.95, P < 0.05), or CBCT (R = 0.91, P < 0.05). Compared with the BV at the time of CT, its value changed by −36.1% [1 SD (standard deviation) 42.3%; range, −79.1%–29.4%] in the control group, and 5.2% (1 SD 21.5%; range, −13.3%–22.1%) in the experimental group during treatment. The change in BV affected the target position in the superior–inferior (SI) direction but had little or no effect in the anterior–posterior and right–left directions. Based on the collected data, the target displacement in the SI direction was reduced from 2.0 to 0.4 mm, while the CTV-to-PTV (CTV: clinical target volume; PTV: planning target volume) margin in the SI direction was reduced from 11.1 to 6.4 mm. The BV increased by 3.7 ± 1.0 ml/min (range, 1.7–4.7 ml/min), which depended on the amount of water ingested by the patient (R = 0.96, P < 0.05). No correlation was found between the rate of urinary inflow and the patient’s body mass. The authors were able to reduce the workload of measuring by using individual patient information including the patient’s age, the water-drinking amount, time at which water-drinking began, and patient’s diet. Conclusions: Changes in the BV have an influence on the RT of cervical cancer. A consistent and reproducible BV is acquired by using a portable BS, whereby the target displacement and CTV-to-PTV margin can be both reduced in the SI direction.

60 APPLIED LIFE SCIENCES↗

SU-F-P-24: Radiological Disperse Device

Purpose: We are now living in a society of constant fear of terrorism. This topic is pertaining to give a general knowledge of what is a radiological dispersion device or RDD and in case of its detonation, what are the options open to public for a safe action in terms of reducing the exposure and knowing the proper steps. These RDD are also called dirty bombs. Methods: Compared to nuclear weapons, dirty bombs are easy to make. In order for a terrorist organization to construct and detonate a dirty bomb, it must acquire radioactive material by stealing it or buying it through legal or illegal channels. Possible RDD material could come from the millions of radioactive sources used in the industry, for medical purposes and in academic applications mainly for researches. These are, americium-{sup 241}, californium-{sup 252}, caesium-{sup 137}, cobalt-{sup 60}, iridium-{sup 192}, plutonium-{sup 238}, polonium-{sup 210}, radium-{sup 226} and strontium-{sup 90}. Results: Prompt detection of the type of radioactive material used will greatly assist advising people on the protective measures, like sheltering in place, or quickly leaving the immediate area. The effects of radiation are determined by:°the amount of radiation absorbed by body°the type of radiation °the distance from the radiation to an individual°the means of exposure absorbed by the skin, inhaled, or ingested; and length of time exposed. Conclusion: In any facility it is now much more important to keep a log list of all radioactive materials in use. In case there is a dirty bomb explosion, the chaos and economic cost could be enormous. The economic cost for the evaluation of the contamination, survey of people and surroundings and the after treatment, decontamination cost and effort will be a big challenge in any country. So awareness and preparation is the start to face this new type of challenge.

61 RADIATION PROTECTION AND DOSIMETRY↗

3,3’-Diindolylmethane Exhibits Significant Metabolism After Oral Dosing in Humans

3,3’-Diindolylmethane (DIM), a major phytochemical derived from ingestion of cruciferous vegetables such as Brussels sprouts, is also a dietary supplement. In preclinical models, DIM is an effective cancer chemopreventive agent and has been studied in a number of clinical trials. Previous pharmacokinetic studies in preclinical and clinical models have not reported DIM metabolites in plasma or urine following oral dosing and the pharmacological actions of DIM on target tissues is assumed to be solely via the parent compound. Seven subjects (6 males and 1 female) ranging from 26-65 years of age, on a cruciferous vegetable-restricted diet prior to and during the study, took 2 BioResponse-DIM® 150 mg capsules (45.3 mg DIM/capsule) in the evening for one week with a final dose the morning of the first blood draw. A complete time course was performed with plasma and urine collected over 48 hours and analyzed by UPLC-MS/MS. In addition to parent DIM, two mono-hydroxylated (2-ox- and 3-methylenehydroxy-DIM) and 1 dihydroxylated (3-methylenehydroxy-2-ox-DIM) metabolites, along with their sulfate and glucuronide conjugates, were present in both plasma and urine. The results reported here are indicative of significant phase 1 and phase 2 metabolism and differ from previous pharmacokinetic studies in rodents and humans which reported only parent DIM present following oral administration.

Vermillion-Maier, Monica↗

Cellulosome Localization Patterns Vary across Life Stages of Anaerobic Fungi

Anaerobic fungi ( Neocallimastigomycota ) isolated from the guts of herbivores excel at degrading ingested plant matter, making them attractive potential platform organisms for converting waste biomass into valuable products, such as chemicals and fuels. Major contributors to their biomass-hydrolyzing power are the multienzyme cellulosome complexes that anaerobic fungi produce, but knowledge gaps in how cellulosome production is controlled by the cellular life cycle and how cells spatially deploy cellulosomes complicate the use of anaerobic fungi and their cellulosomes in industrial bioprocesses.

59 BASIC BIOLOGICAL SCIENCES↗

Toward the Detection of Polyglot Files

Standardized file types play a key role in the development and use of computer software. However, it is possible to confound standardized file type processing by creating a file that is valid in multiple file types. The resulting polyglot (many languages) file can confuse file type identification, allowing elements of the file to evade analysis. This is especially problematic for malware detection systems that rely on file type identification for feature extraction. Although work has been done to identify file types using more comprehensive methods than file signatures, accurate identification of polyglot files remains an open problem. Since malware detection systems routinely perform file type-specific feature extraction, polyglot files need to be filtered out prior to ingestion by these systems. Otherwise, malicious content could pass through undetected. To address the problem of polyglot detection we assembled a data set using the mitra tool. We then evaluated the performance of the most commonly used file identification tools, including file, polydet, binwalk, and TrID. Our analysis demonstrates that existing file type detection tools fail to provide reliable polyglot detection. We then evaluated the ability of a range of machine and deep learning models to detect polyglot files. The most performant models were MalConv2 and Catboost, which demonstrated the highest recall on our data set with 95.16% and 95.45%, respectively. These models outperformed existing methods and could be incorporated into a malware detector’s file processing pipeline to filter out potentially malicious polyglots before file type-dependent feature extraction takes place.

Koch, Luke↗

Toward the Detection of Polyglot Files

Standardized file types play a key role in the development and use of computer software. However, it is possible to confound standardized file type processing by creating a file that is valid in multiple file types. The resulting polyglot (many languages) file can confuse file type identification, allowing elements of the file to evade analysis. This is especially problematic for malware detection systems that rely on file type identification for feature extraction. Although work has been done to identify file types using more comprehensive methods than file signatures, accurate identification of polyglot files remains an open problem. Since malware detection systems routinely perform file type-specific feature extraction, polyglot files need to be filtered out prior to ingestion by these systems. Otherwise, malicious content could pass through undetected. To address the problem of polyglot detection we assembled a data set using the mitra tool. We then evaluated the performance of the most commonly used file identification tools, including file, polydet, binwalk, and TrID. Our analysis demonstrates that existing file type detection tools fail to provide reliable polyglot detection. We then evaluated the ability of a range of machine and deep learning models to detect polyglot files. The most performant models were MalConv2 and Catboost, which demonstrated the highest recall on our data set with 95.16% and 95.45%, respectively. These models outperformed existing methods and could be incorporated into a malware detector’s file processing pipeline to filter out potentially malicious polyglots before file type-dependent feature extraction takes place.

Koch, Lucas↗

I/O in Machine Learning Applications on HPC Systems: A 360-degree Survey

Growing interest in Artificial Intelligence (AI) has resulted in a surge in demand for faster methods of Machine Learning (ML) model training and inference. This demand for speed has prompted the use of high performance computing (HPC) systems that excel in managing distributed workloads. Because data is the main fuel for AI applications, the performance of the storage and I/O subsystem of HPC systems is critical. In the past, HPC applications accessed large portions of data written by simulations or experiments or ingested data for visualizations or analysis tasks. ML workloads perform small reads spread across a large number of random files. This shift of I/O access patterns poses several challenges to modern parallel storage systems. In this paper, we survey I/O in ML applications on HPC systems, and target literature within a 6-year time window from 2019 to 2024. We define the scope of the survey, provide an overview of the common phases of ML, review available profilers and benchmarks, examine the I/O patterns encountered during offline data preparation, training, and inference, and explore I/O optimizations utilized in modern ML frameworks and proposed in recent literature. Lastly, we seek to expose research gaps that could spawn further R&D.

97 MATHEMATICS AND COMPUTING↗

Slycat v 2.0

Slycat™ is a web-based system for analysis of large, high-dimensional data such as that produced by High Performance Computing (HPC) platforms. The Slycat™ server integrates data ingestion, scalable analysis, data management, and visualization with commodity web clients using a multi-tiered hierarchy of data and model storage. Analysis inputs are pushed or pulled into Slycat™, where models are generated and analysis artifacts are stored in a project database. These artifacts are the basis for visualizations that are delivered to users’ desktops through ordinary web browsers, eliminating the need to build and deploy platform-specific client applications. Slycat™ currently provides four types of analysis: canonical correlation analysis (CCA) to model relationships between inputs and output metrics, time series analysis featuring clustering and comparative visualization of waveforms, parameter space visualization including remote retrieval of images and movies from HPC disks, and VideoSwarm for modeling video similarities over time.

Letter, Matthew↗

Python-ARM Radar Toolkit

The Python-ARM Radar Toolkit (Py-ART) is a collection of radar quality control and retrieval codes which all work on two unifying Python objects: the PyRadar and PyGrid objects. By building ingests to several popular radar formats and then abstracting the interface Py-ART greatly simplifies data processing over several other available utilities. In addition Py-ART makes use of Numpy arrays as its primary storage mechanism enabling use of existing and extensive community software tools.

Jonathan Helmus, ScottCollis↗

Soil Carbon Data: long tail recovery

The software is intended to be part of an open source effort regarding soils data. The software provides customized data ingestion scripts for soil carbon related data sets and scripts for output databases that conform to common templates.

Source record↗

DynamiteNSM

DynamiteNSM is a free Network Security Monitor (NSM), built on top of several leading, enterprise-grade technologies. The tool provides network and cybersecurity operators with holistic insights into their networks while giving them the ability to deep-dive into lower-level activities. The solution presents powerful dashboards, giving comprehensive view into performance and threat-based metrics. Dynamite-NSM can be easily deployed in different environments including high-speed data centers, small-to-large enterprises, IoT & industrial networks, and even at home. Dynamite-NSM handles massive volumes of network traffic through scalable ingestion and optimized network sensors. The solution includes two key components: the agent and the monitor. The agent analyzes and forwards network events, while the monitor processes incoming events and displays analytic information. The monitor component builds upon the OpenSearch stack and is coupled with network packet inspection by Zeek and Suricata. Dynamite-NSM is designed to be deployed very quickly with minimal configuration. Unlike many other tools, it can be installed and managed with a standalone command-line utility. The system is inherently passive without disruption to the network. There is no need to install agents on every computer, perform network scans, or directly interact with network assets.

Becker, Jamin↗

Splash-ML v0.1

The Splash database and portal, also under development (https://lbl.wellspringsoftware.net/kms/invention/detail/3980/), ingests experimental data and references to datasets from a variety of sources, primarily lightsource beamlines. After deployment, it will contain a great deal of metadata and references to data from which many insights can be extracted.

McReynolds, Dylan↗

Diventi

Diventi provides a write optimized index of network logs such as netflow or zeek. The program will ingest various network traffic logs (zeek connection logs or NetflowV5, v9 or IPFix logs) and index each IP address and time of its activity. This database can then be queried for timely tracking of network activity. It currently uses the ft-index library from Percona but is adaptable to any key-value store that supports the Berkeley DB api.SAND2019-15037 M Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Kroeger, Thomas↗

MyEMSL

MyEMSL provides the following features: user-assisted upload of data from scientific instruments to an archive, tracking data though the upload process, providing metadata for recovery of uploaded data, providing users with access to the data. These features are supplied by a mixture of open source software and internally developed software. MyESML also provides a notification system that allows the system to communicate with users and other parts of the MyEMSL system. This allows the system to support automated workflows and user interaction. Reprocessing of already ingested data is also supported.

Glass, Kevin↗

Multi-modal Free-moving Data Fusion (MFDF) v1.0

Multi-modal Free-moving Data Fusion (MFDF) is a python package that implements low and high-level functionality for performing qualitative and quantitative gamma-ray imaging analyses. Such analyses enable the use of gamma-ray spectrometers and/or imagers to estimate the distribution and quantity of radiological materials in an environment. Free-moving 3D imaging requires additional information about the 3D trajectory and orientation of the system, however all of these methods can be applied to 2D static gamma-ray imaging as well. The package includes methods (MLEM and MAP) for distributed source reconstruction, methods (PSL) for point source reconstruction, the ability to ingest and utilize quantitative detector response functions (for absolute analyses), and the ability to perform 3D estimation of dose-rates from quantitative reconstructions.

Joshi, Tenzing↗

Code Artifact for: Clustering Analysis of Commercial Vehicles Using Automatically Extracted Features from Time Series Data [SWR-21-96]

This repository contains data ingestion, feature extraction, and analysis code used in NREL Technical report "Clustering Analysis of Commercial Vehicles Using Automatically Extracted Features from Time Series Data." The code is written in Python. The ETL and feature extraction code must be run in a Spark context. The analysis code can be run without Spark, provided you have pre-computed features in a CSV file. Analysis code related to the NREL Technical Report NREL/TP-2C00-74212. Includes PySpark functions to perform trip segmentation and feature extraction over big time series data in Apache Spark. Includes "domain specific" features such as Aerodynamic Speed (ft/s), Characteristic Acceleration (ft/s2), Percent Below 55 (%), Percent Zero (%), Stops Per Mile, Average Speed (mph), Maximum Speed (mph), and Speed Standard Deviation (mph). Includes Pyspark UDF to compute "domain agnostic" features using the TSFresh library. This software record also includes the analysis notebooks and code to generate the results in the previously mentioned technical report.

Perr-Sauer, Jordan↗

Zotero Robust Links Extension

The Zotero Robust Links extension automatically creates an archival copy (memento) of the URI of an item ingested into a Zotero library. The extension can also manually be triggered to create mementos. The software also contains a "translator" that enables the export of "robustified" items with Robust Links-enhanced HTML code.

Jones, Shawn↗