Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Active Learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 757 records · Page 42

Deep Learning for Unsupervised Insider Threat Detection in Structured Cyber Security Data Streams

Analysis of an organization's computer network activity is a key component of early detection and mitigation of insider threat, a growing concern for many organizations. Raw system logs are a prototypical example of streaming data that can quickly scale beyond the cognitive power of a human analyst. As a prospective filter for the human analyst, we present an online unsupervised deep learning approach to detect anomalous network activity from system logs in real time. Our models decompose anomaly scores into the contributions of individual user behavior features for increased interpretability to aid analysts reviewing potential cases of insider threat. Using the CERT Insider Threat Dataset v6.2 and threat detection recall as our performance metric, our novel deep and recurrent neural network models outperform Principal Component Analysis, Support Vector Machine and Isolation Forest based anomaly detection baselines. For our best model, the events labeled as insider threat activity in our dataset had an average anomaly score in the 95.53 percentile, demonstrating our approach's potential to greatly reduce analyst workloads.

Deep Learning, Insider Threat↗

Deep Learning for Unsupervised Insider Threat Detection in Structured Cybersecurity Data Streams

Analysis of an organization’s computer network activity is a key component of early detection and mitigation of insider threat, a growing concern for many organizations. Raw system logs are a prototypical example of streaming data that can quickly scale beyond the cognitive power of a human analyst. As a prospective filter for the human analyst, we present an online unsupervised deep learning approach to detect anomalous network activity from system logs in real time. Our models decompose anomaly scores into the contributions of individual user behavior features for increased interpretability to aid analysts reviewing potential cases of insider threat. Using the CERT Insider Threat Dataset v6.2 and threat detection recall as our performance metric, our novel deep and recurrent neural network models outperform Principal Component Analysis, Support Vector Machine and Isolation Forest based anomaly detection baselines. For our best model, the events labeled as insider threat activity in our dataset had an average anomaly score in the 95.53 percentile, demonstrating our approach’s potential to greatly reduce analyst workloads.

Tuor, Aaron R.↗

Bioremediation of Chlorinated Volatile Organic Compounds: DOE Experiences and Lessons Learned

From the mid-1980s to the present, the Department of Energy (DOE) has developed, tested, and deployed diverse bioremediation strategies for chlorinated volatile organic compounds (cVOCs). A systematic review of these projects after decades of activity provides an opportunity to identify crosscutting themes and lessons learned. The knowledge provided by a DOE bioremediation retrospective represents a resource to support current and future bioremediation operations, and future decisions related to cVOC bioremediation. This systematic review examined the design, objectives, performance and outcomes for remediation projects at DOE sites including Savannah River, Hanford, Idaho, Mound and Pinellas. The results were used to identify emergent themes to provide actionable insights. The bioremediation retrospective technical team first developed standardized criteria to support the systematic review. Then, the evaluation was performed using a sequential process that was informed by local technical experts who identified and provided the structured information that served as the basis for the evaluation. The participation of these experts was invaluable to the effort. Importantly, DOE cVOC bioremediation efforts were implemented based on the foundational knowledge developed by U.S. Department of Defense (DoD) strategic and applied environmental technology development and certification programs, as well as technical, policy and regulatory guidance from the U.S. Environmental Protection Agency (EPA), Interstate Technology and Regulatory Council (ITRC), U.S. Geological Survey (USGS), industry, and universities. To maximize the value of the DOE cVOC bioremediation retrospective, the systematic review strategy focused on identifying important DOE-specific experiences, trends and lessons learned that would extend the knowledge available from these other key entities.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Evaluating Automated Face Identity-Masking Methods with Human Perception and a Deep Convolutional Neural Network

Face de-identification (or “masking”) algorithms have been developed in response to the prevalent use of video recordings in public places. Here, we evaluated the success of face identity masking for human perceivers and a deep convolutional neural network (DCNN). Eight de-identification algorithms were applied to videos of drivers’ faces, while they actively operated a motor vehicle. These masks were pre-selected to be applicable to low-quality video and to maintain coarse information about facial actions. Humans studied high-resolution images to learn driver identities and were tested on their recognition of active drivers in low-resolution videos. Faces in the videos were either unmasked or were masked by one of the eight algorithms. When participants were tested immediately after learning (Experiment 1), all masks reduced identification, with six of eight masks reducing identification to extremely poor performance. In a second experiment, two of the most effective masks were tested after a delay of 7 or 28 days. The delay did not further reduce identification of the masked faces. In all masked conditions, participants maintained stringent decision criteria, with low confidence in recognition, further indicating the effectiveness of the masks. Next, the DCNN performed an identity-matching task between high-resolution images and masked videos—a task analogous to that done by humans. The pattern of accuracy for the DCNN mirrored some, but not all, aspects of human performance, highlighting the need to test the effectiveness of identity masking for both humans and machines. The DCNN was also tested on its ability to match identity between masked and unmasked versions of the same video, based only on the face. DCNN performance for the eight masks offers insight into the nature of the information in faces that is coded in these networks.

97 MATHEMATICS AND COMPUTING↗

Promoting Physical Activity During Pregnancy and the Postpartum Period

Introduction Physical activity is important for improving and maintaining overall health across the life span, including during and after pregnancy. Achieving recommended levels of physical activity can be challenging during pregnancy and the postpartum period. The US Office of Disease Prevention and Health Promotion sought to promote physical activity during and after pregnancy through the development of health education materials for the Move Your Way campaign. Research was conducted with pregnant and postpartum people to learn what types of messages and materials would encourage physical activity in these populations. Methods Participants were recruited from 3 regions of the United States to participate in 90‐minute virtual focus groups. Eligible participants were aged 18 years or older and either pregnant or 6 weeks to 1 year postpartum. Participants were asked questions about their beliefs, attitudes, and perceptions about physical activity and prompted to provide feedback on health promotion messages and images. Sessions were recorded, transcribed, and analyzed for key themes. Results Twenty‐four focus groups were conducted with 48 pregnant participants and 52 postpartum participants. Sixteen sessions were conducted in English and 8 were conducted in Spanish. Most participants had questions about how much physical activity is recommended, and many cited their health care provider as a trusted source of information. Participants responded positively to materials that acknowledged the uniqueness of each pregnant or postpartum experience, referenced gradually increasing physical activity levels, highlighted the benefits of physical activity, focused on safety, addressed common barriers, and displayed realistic representations of physical activity. Discussion There is an opportunity to improve messaging about physical activity during and after pregnancy. To better promote physical activity, perinatal health care providers and other health professionals can share information about recommended amounts of physical activity, communicate the benefits, and promote realistic and achievable physical activity messages that address common barriers in these populations.

Nursing↗

Emulation Modeling for Development of Cyber-Defense Capabilities for Satellite Systems

The objective of this project was to develop a novel capability to generate synthetic data sets for the purpose of training Machine Learning (ML) algorithms for the detection of malicious activities on satellite systems. The approach experimented with was to a) generate sparse data sets using emulation modeling and b) enlarge the sparse data using Generative Adversarial Networks (GANs). We based our emulation modeling on the Open Source NASA Operational Simulator for Small Satellites (NOS3) developed by the Katherine Johnson Independent Verification and Validation (IV&V) program in West Virginia. Significant new capabilities on NOS3 had to be developed for our data set generation needs. To expand these data sets for the purpose of training ML, we experimented with a) Extreme Learning Machines (ELMs) and b) Wasserstein-GANs (WGAN-GP).

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

Contextual Active Online Model Selection with Expert Advice

How can we collect the most useful labels to learn a model selection policy, when presented with arbitrary heterogeneous data streams? In this paper, we formulate this task as a contextual active model selection problem, where at each round the learner receives an unlabeled data point along with a context. The goal is to output the best model for any given context without obtaining an excessive amount of labels. In particular, we focus on the task of selecting pre-trained classifiers, and propose a contextual active model selection algorithm (CAMS), which relies on a novel uncertainty sampling query criterion defined on a given policy class for adaptive model selection. In comparison to prior art, our algorithm does not assume a globally optimal model. We provide rigorous theoretical analysis for the regret and query complexity under both adversarial and stochastic settings. Our experiments on several benchmark classification datasets demonstrate the algorithm’s effectiveness in terms of both regret and query complexity. Notably, to achieve the same accuracy, CAMS incurs less than 10% of the label cost when compared to the best online model selection baselines on CIFAR10.

Liu, Xuefeng↗

Descriptors for Hydrogen Evolution on Single Atom Catalysts in Nitrogen-Doped Graphene

Single-atom catalysts (SACs) are a new research frontier in electrocatalysis such as in the hydrogen evolution reaction (HER). Recent theoretical and experimental studies have demonstrated that certain M–N–C (metal–nitrogen–carbon) based SACs exhibit excellent performance for HER. Here we report a new approach to tune HER activity for SACs by changing the size and dimensionality of the carbon substrate while maintaining the same coordination environment. In this work, we screen the 3d, 4d, and 5d transition metal SACs in N-doped 2D graphene and nanographenes of several sizes for HER using first-principles density functional theory (DFT). Nanographenes containing V, Rh, and Ir are predicted to have significantly enhanced HER activity compared to their 2D graphene counterparts. We turn to machine learning to accurately predict the free energy of hydrogen adsorption (ΔGH) based on various descriptors and compressed sensing to identify key descriptors for activity, which can be used to further screen for additional candidates.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Reactor Decommissioning - Balancing Remote and Manual Activities - 12159

Nuclear reactors come in a wide variety of styles, size, and ages. However, during decommissioned one issue they all share is the balancing of remotely and manually activities. For the majority of tasks there is a desire to use manual methods because remote working can be slower, more expensive, and less reliable. However, because of the unique hazards of nuclear reactors some level of remote activity will be necessary to provide adequate safety to workers and properly managed and designed it does not need to be difficult nor expensive. The balance of remote versus manual work can also affect the amount and types of waste that is generated. S.A.Technology (SAT) has worked on a number of reactor decommissioning projects over the last two decades and has a range of experience with projects using remote methods to those relying primarily on manual activities. This has created a set of lessons learned and best practices on how to balance the need for remote handling and manual operations. Finding a balance between remote and manual operations on reactor decommissioning can be difficult but by following certain broad guidelines it is possible to have a very successfully decommissioning. It is important to have an integrated team that includes remote handling experts and that this team plans the work using characterization efforts that are efficient and realistic. The equipment need to be simple, robust and flexible and supported by an on-site team committed to adapting to day-to-day challenges. Also, the waste strategy needs to incorporate the challenges of remote activities in its planning. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Machine Learning-Accelerated First-Principles Molecular Dynamics Reveals C–C Coupling Mechanisms toward Ethylene on Cu(100)

Here, the Cu(100) termination has been identified as the most effective facet for converting CO and CO 2 into ethylene. To enhance both the activity and selectivity of ethylene production, we perform machine-learning-accelerated, first-principles molecular dynamics simulations at 298 K in an explicit solvent at pH 7 to elucidate the C–C coupling mechanism─the critical reaction step in forming C 2+ products. Among the six potential C–C coupling pathways, the most feasible are CO* dimerization and CO – CHO* and CHO* – CHO* couplings. Using the computational hydrogen electrode method, we demonstrate that all three pathways are equally accessible at −0.6 V vs RHE. At a potential below −1.0 V vs RHE, the thermodynamic barriers for the CO – CHO* and CHO* – CHO* pathways become negligible. Our computational findings explain the experimental observations, particularly the absence of C 2+ products above −0.4 V vs RHE and the peaks in ethylene production near −0.6 and −1.0 V vs RHE. Since CHO* acts as a key intermediate common to both C–C coupling and CH 4 formation, we propose that suppressing CHO* hydrogenation would inhibit CH 4 pathways, thereby maximizing ethylene selectivity.

CO2 reduction↗

Comparing Mapper Graphs of Artificial Neuron Activations

The mapper graph is a popular tool from topological data analysis that provides a graphical summary of point cloud data. It has been used to study data from cancer research, sports analytics, neurosciences, and machine learning. In particular, mapper graphs have been used recently to visualize the topology of high-dimensional artificial neural activations from convolutional neural networks and large language models. However, a key question that arises from using mapper graphs across applications is how to compare mapper graphs to study their structural differences. In this paper, we introduce a distance between mapper graphs using tools from optimal transport. We demonstrate the utility of such a distance by studying the topological changes of neural activations across convolutional layers in deep learning, as well as by capturing the loss of structural information for multiscale mapper.

mapper graphs, computational topology, machine lea↗

Deciphering enhancer sequence using thermodynamics-based models and convolutional neural networks

Abstract Deciphering the sequence-function relationship encoded in enhancers holds the key to interpreting non-coding variants and understanding mechanisms of transcriptomic variation. Several quantitative models exist for predicting enhancer function and underlying mechanisms; however, there has been no systematic comparison of these models characterizing their relative strengths and shortcomings. Here, we interrogated a rich data set of neuroectodermal enhancers in Drosophila, representing cis- and trans- sources of expression variation, with a suite of biophysical and machine learning models. We performed rigorous comparisons of thermodynamics-based models implementing different mechanisms of activation, repression and cooperativity. Moreover, we developed a convolutional neural network (CNN) model, called CoNSEPT, that learns enhancer ‘grammar’ in an unbiased manner. CoNSEPT is the first general-purpose CNN tool for predicting enhancer function in varying conditions, such as different cell types and experimental conditions, and we show that such complex models can suggest interpretable mechanisms. We found model-based evidence for mechanisms previously established for the studied system, including cooperative activation and short-range repression. The data also favored one hypothesized activation mechanism over another and suggested an intriguing role for a direct, distance-independent repression mechanism. Our modeling shows that while fundamentally different models can yield similar fits to data, they vary in their utility for mechanistic inference. CoNSEPT is freely available at: https://github.com/PayamDiba/CoNSEPT.

59 BASIC BIOLOGICAL SCIENCES↗

PayamDiba/CoNSEPT

Deciphering the sequence-function relationship encoded in enhancers holds the key to interpreting non-coding variants and understanding mechanisms of transcriptomic variation. Several quantitative models exist for predicting enhancer function and underlying mechanisms; however, there has been no systematic comparison of these models characterizing their relative strengths and shortcomings. Here, we interrogated a rich data set of neuroectodermal enhancers in Drosophila, representing cis- and trans- sources of expression variation, with a suite of biophysical and machine learning models. We performed rigorous comparisons of thermodynamics-based models implementing different mechanisms of activation, repression and cooperativity. Moreover, we developed a convolutional neural network (CNN) model, called CoNSEPT, that learns enhancer ‘grammar’ in an unbiased manner. CoNSEPT is the first general-purpose CNN tool for predicting enhancer function in varying conditions, such as different cell types and experimental conditions, and we show that such complex models can suggest interpretable mechanisms. We found model-based evidence for mechanisms previously established for the studied system, including cooperative activation and short-range repression. The data also favored one hypothesized activation mechanism over another and suggested an intriguing role for a direct, distance-independent repression mechanism. Our modeling shows that while fundamentally different models can yield similar fits to data, they vary in their utility for mechanistic inference.

Dibaeinia, Payam↗

High-Throughput Microfluidics Platform for Intracellular Delivery and Sampling of Biomolecules from Live Cells

Nondestructive cell membrane permeabilization systems enable the intracellular delivery of exogenous biomolecules for cell engineering tasks as well as the temporal sampling of cytosolic contents from live cells for the analysis of dynamic processes. Here, in this paper, we report a microwell array format live-cell analysis device (LCAD) that can perform localized-electroporation induced membrane permeabilization, for cellular delivery or sampling, and directly interfaces with surface-based biosensors for analyzing the extracted contents. We demonstrate the capabilities of the LCAD via an automated high-throughput workflow for multimodal analysis of live-cell dynamics, consisting of quantitative measurements of enzyme activity using self-assembled monolayers for MALDI mass spectrometry (SAMDI) and deep-learning enhanced imaging and analysis. By combining a fabrication protocol that enables robust assembly and operation of multilayer devices with embedded gold electrodes and an automated imaging workflow, we successfully deliver functional molecules (plasmid and siRNA) into live cells at multiple time-points and track their effect on gene expression and cell morphology temporally. Furthermore, we report sampling performance enhancements, achieving saturation levels of protein tyrosine phosphatase activity measured from as few as 60 cells, and demonstrate control over the amount of sampled contents by optimization of electroporation parameters using a lumped model. Lastly, we investigate the implications of cell morphology on electroporation-induced sampling of fluorescent molecules using a deep-learning enhanced image analysis workflow.

59 BASIC BIOLOGICAL SCIENCES↗

Overview of International Activities in Hydrogen System Safety in IEA Hydrogen TCP Task 43

Safety and reliability have long been recognized as key issues for the development, commercialization, and implementation of new technologies and infrastructure, and hydrogen systems are no exception to this rule. Reliability engineering, quantitative risk assessment (QRA), and knowledge exchange each play a key role in proactive addressing safety - before problems happen - and help us learn from problems if they happen. Many international research activities are focusing on both reliability and risk assessment for hydrogen systems. However, the element of knowledge exchange is sometimes less visible. To support international collaboration and knowledge exchange, the International Energy Agency (IEA) convened a new Technology Collaboration Program, "Task 43: Safety and Regulatory Aspects of Emerging Large Scale Hydrogen Energy Applications" started in June 2022. Within Task 43, Subtask E focuses on Hydrogen Systems Safety. This paper discusses the structure of the Hydrogen Systems Safety subtask and the aligned activities and introduces opportunities for future work.

HYDROGEN↗

Machine Learning of Bacterial Transcriptomes Reveals Responses Underlying Differential Antibiotic Susceptibility

In vitro antibiotic susceptibility testing often fails to accurately predict in vivo drug efficacies, in part due to differences in the molecular composition between standardized bacteriologic media and physiological environments within the body. Here, we investigate the interrelationship between antibiotic susceptibility and medium composition in Escherichia coli K-12 MG1655 as contextualized through machine learning of transcriptomics data. Application of independent component analysis, a signal separation algorithm, shows that complex phenotypic changes induced by environmental conditions or antibiotic treatment are directly traced to the action of a few key transcriptional regulators, including RpoS, Fur, and Fnr. Integrating machine learning results with biochemical knowledge of transcription factor activation reveals medium-dependent shifts in respiration and iron availability that drive differential antibiotic susceptibility. By extension, the data generation and data analytics workflow used here can interrogate the regulatory state of a pathogen under any measured condition and can be applied to any strain or organism for which sufficient transcriptomics data are available.

59 BASIC BIOLOGICAL SCIENCES↗

Peer Review Lessons Learned - DOE and Regulator Perspectives - 17140

The DOE NNSA Nevada Field Office (NFO) Underground Test Area (UGTA) Activity requires an external peer review to complete an extensive stage of site characterization and groundwater flow and contaminant transport model(s) development. The external peer review evaluates whether assumptions, methods, and conclusions derived from model(s) outputs are based on sound scientific principles and examines the scientific appropriateness of the model(s) outputs for informing the regulatory decision. The regulatory decision which is made by the Nevada Division of Environmental Protection (NDEP) is whether the model is acceptable to advance to the next UGTA strategy stage. Depending on the specific corrective action unit, the next stage is a Corrective Action Decision Document/Corrective Action Plan or Closure Stage. Three external peer reviews have taken place to date for the UGTA Activity. The first one resulted in a second phase of characterization and model development. The second external peer review resulted in advancement to the next UGTA strategy stage. While advancement to the next strategy stage was recommended by the third external peer review, a series of supplemental data collection and analyses and model simulation activities to address external peer review comments, including drilling three new wells and sampling multiple wells, occurred before moving into the next UGTA strategy stage. Twelve participants representing different aspects of the peer reviews (NDEP, NNSA/NFO, science advisors, presenters, and external peer reviewers) were interviewed to generate a combined lessons learned. Questions were asked regarding their experience with the process including panel selection, focused questions, presentations, interactions between UGTA Activity participants and reviewers, and results. The interview results were combined with the outcome of a published lessons learned report developed following the first external peer review. In general, those interviewed believed that all three external peer reviews were satisfactory and met the goals of the FFACO process. The following seven lessons learned were identified: (1) Ensure the panel is not biased and has a balance of technical and regulatory background; (2) Clearly state the review objective(s) at the start of the review; (3) Ask focused questions that support the peer review objective(s) but that do not ask the specific regulatory question; (4) Establish a peer review panel earlier in the strategy process; (5) Establish one point of contact for the entire review and conduct periodic meetings with the peer review panel to ensure focus remains on the review objective(s) and to ensure that pertinent information is provided; (6) Ensure that presentations are well coordinated, anomalous data or analysis results are addressed, and are focused on supporting the peer review objective(s); and (7) Carefully consider the panel's recommendations prior to embarking on a particular path forward. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Machine-Learning-Based Rotating Detonation Engine Diagnostics: Evaluation for Application in Experimental Facilities

Real-time monitoring of combustion behavior is a crucial step toward actively controlled rotating detonation engine (RDE) operation in laboratory and industrial environments. Various machine learning methods have been developed to advance diagnostic efficiencies from conventional postprocessing efforts to real-time methods. Here this work evaluates and compares conventional techniques alongside convolutional neural network (CNN) architectures trained in previous studies, including image classification, object detection, and time series classification, according to metrics affecting diagnostic feasibility, external applicability, and performance. Real-time, capable diagnostics are deployed and evaluated using an altered experimental setup. Image-based CNNs are applied to externally provided images to approximate dataset restrictions. Image classification using high-speed chemiluminescence images and time series classification using high-speed flame ionization and pressure measurements achieve classification speeds enabling real-time diagnostic capabilities, averaging laboratory-deployed diagnostic feedback rates of 4–5 Hz. Object detection achieves the most refined resolution of 20 μs in postprocessing. Image and time series classification require the additional correlation of sensor data, extending their time-step resolutions to 80 ms. Comparisons show that no single diagnostic approach outperforms its competitors across all metrics. This finding justifies the need for a machine learning portfolio containing a host of networks to address specific needs throughout the RDE research community.

33 ADVANCED PROPULSION SYSTEMS↗