Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Active Learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 541 records · Page 30

Characterizing Defect Dynamics in Silicon Carbide Using Symmetry-Adapted Collective Variables and Machine Learning Interatomic Potentials

Silicon carbide (SiC) divacancies are attractive candidates for spin-defect qubits possessing long coherence times and optical addressability. The high activation barriers associated with SiC defect formation and motion pose challenges for their study by first-principles molecular dynamics. In this work, we develop and deploy machine learning interatomic potentials (MLIPs) to accelerate defect dynamics simulations while retaining ab initio accuracy. We employ an active learning strategy comprising symmetry-adapted collective variable discovery and enhanced sampling to compile configurationally diverse training data, calculation of energies and forces using density functional theory (DFT), and training of an E(3)-equivariant MLIP based on the Allegro model. Here, the trained MLIP reproduces DFT-level accuracy in defect transition activation free energy barriers, enables the efficient and stable simulation of multidefect 216-atom supercells, and permits an analysis of the temperature dependence of defect thermodynamic stability and formation/annihilation kinetics to propose an optimal annealing temperature to maximally stabilize VV divacancies.

Computer simulations↗

Predicting the hepatocarcinogenic potential of alkenylbenzene flavoring agents using toxicogenomics and machine learning

Identification of carcinogenic activity is the primary goal of the 2-year bioassay. The expense of these studies limits the number of chemicals that can be studied and therefore chemicals need to be prioritized based on a variety of parameters. We have developed an ensemble of support vector machine classification models based on male F344 rat liver gene expression following 2, 14 or 90 days of exposure to a collection of hepatocarcinogens (aflatoxin B1, 1-amino-2,4-dibromoanthraquinone, N-nitrosodimethylamine, methyleugenol) and non-hepatocarcinogens (acetaminophen, ascorbic acid, tryptophan). Seven models were generated based on individual exposure durations (2, 14 or 90 days) or a combination of exposures (2 + 14, 2 + 90, 14 + 90 and 2 + 14 + 90 days). All sets of data, with the exception of one yielded models with 0% cross-validation error. Independent validation of the models was performed using expression data from the liver of rats exposed at 2 dose levels to a collection of alkenylbenzene flavoring agents. Depending on the model used and the exposure duration of the test data, independent validation error rates ranged from 47% to 10%. The variable with the most notable effect on independent validation accuracy was exposure duration of the alkenylbenzene test data. All models generally exhibited improved performance as the exposure duration of the alkenylbenzene data increased. The models differentiated between hepatocarcinogenic (estragole and safrole) and non-hepatocarcinogenic (anethole, eugenol and isoeugenol) alkenylbenzenes previously studied in a carcinogenicity bioassay. In the case of safrole the models correctly differentiated between carcinogenic and non-carcinogenic dose levels. The models predict that two alkenylbenzenes not previously assessed in a carcinogenicity bioassay, myristicin and isosafrole, would be weakly hepatocarcinogenic if studied at a dose level of 2 mmol/kg bw/day for 2 years in male F344 rats; therefore suggesting that these chemicals should be a higher priority relative to other untested alkenylbenzenes for evaluation in the carcinogenicity bioassay. The results of the study indicate that gene expression-based predictive models are an effective tool for identifying hepatocarcinogens. Furthermore, we find that exposure duration is a critical variable in the success or failure of such an approach, particularly when evaluating chemicals with unknown carcinogenic potency.

60 APPLIED LIFE SCIENCES↗

Low Activity Tritium Detection in CCDs Using Deep Learning Techniques

Here, this study explores the use of charge-coupled devices (CCDs) for detecting low-energy beta particles from tritium decay - a critical signal for nuclear safety, nuclear nonproliferation, and environmental monitoring. We employ a dual approach utilizing both measured CCD data and detailed Geant4 simulations. Our analysis compares classical techniques with advanced deep learning methods, including convolutional neural networks (CNNs), autoencoders trained exclusively on tritium data, and preliminary studies on boosted decision trees (BDTs). The CNN, trained on mixed signal/background datasets, demonstrates superior classification performance, while the autoencoder shows the potential of unsupervised, background-agnostic strategies when background characteristics are poorly defined. These results highlight the excellent sensitivity achievable thanks to the background rejection made possible by information-rich CCD data, paving the way for improved portable tritium monitoring.

Autoencoder↗

Toward a Multimodal-Deep Learning Retrieval System for Monitoring Nuclear Proliferation Activities

As the amount of available data increases, the human ability to locate, process, and analyze it is strained and eventually overwhelmed. To address this challenge for nonproliferation analysts, the authors have been creating a large-scale multimodal retrieval system to help analysts triage and search open source science, technology, and news data for indicators of nuclear proliferation capabilities and activities. The system relies on a set of deep neural networks (DNNs) trained to evaluate conceptual similarities across data modalities, such as text, image, and video. These DNNs can be used to search and prioritize data, according to a nuclear fuel cycle (NFC) process template, that are conceptually closest to the seed query items regardless of data modality. The DNNs have been trained to map conceptually related words, sentences, and images to nearby points in a multimodal feature space, enabling intra- and intermodal retrieval via nearest-neighbor calculations to seed query points. The authors evaluate the system’s ability to retrieve NFC-related data that have been purposely hidden in collections of unrelated background data. They demonstrate quantitative and qualitative results for text-to-image, image-to-image, and image-to-video retrievals. This paper discusses data challenges confronting nonproliferation analysts, describes the DNNs designed to retrieve multimodal data that are proximal in the semantic space, and demonstrates their effectiveness by applying the DNNs to nonproliferation-specific multimodal data sets.

97 MATHEMATICS AND COMPUTING↗

German research and development for high level waste in light of the new site selection process - 15516

The German government decided 50 years ago, that radioactive waste is to be disposed of in Deep Geologic Repositories, preferably in a salt rock formation. Soon after, in 1967, research in the Asse salt mine was initiated. Since then substantial progress has been achieved in the development of the radioactive waste disposal programme in Germany. For a geologic repository for High Level Waste in salt a reference concept has been developed, which represented the radioactive waste management processes from transport of High Level Waste and Spent Nuclear Fuel to an interim storage site, waste conditioning and repackaging for disposal, to emplacement of the waste packages. The feasibility of the reference concept has been proven by demonstration tests for all relevant equipment: a pilot conditioning plant has been built as well as the main equipment for the entire transport chain including the shaft transport and emplacement technologies for heavy loads fulfilling strict requirements for nuclear and mining safety. Also the backfilling technology has been optimised for the purposes of a repository for radioactive waste. Finally, tests have been performed to verify thermo-mechanical models for the host rock. The demonstration tests have been performed to an extent which even would allow immediate licensing of the repository and the employed equipment. The Research and Development work was completed by further optimisation of the reference concept. Construction and operation of deep geologic repositories for low and intermediate level radioactive wastes in Germany benefited from the above mentioned but also stimulated the knowledge and experience build-up for the repositories for High Level Waste. Despite the well progressed work for a deep geologic repository in salt R and D work in Germany for already a long time also considered other host rock formations. While work for crystalline rock mainly consisted of relatively small contributions to international research projects due to the limited occurrence of suitable sites in Germany, projects and developments for repositories in clay formations have had an increasing contribution to the overall Research and Development work for radioactive waste repositories in Germany. In July 2013 a new site selection act was put into force, which set the initiating conditions for the German programme on radioactive waste management. Principally, a process was initiated to search for a site for a deep geologic repository for High Level Waste independent from earlier decisions. This means that a site shall be determined without predetermination by earlier decisions. Nevertheless, to enable a sound decision for a site selection it is necessary to be able draw back on the knowledge and experience from earlier activities. Otherwise, tedious learning processes would have to be experienced again. Since efforts to open up a site selection process again grew since the late 1990's projects had been implemented timely to capture existing knowledge. The paper at hand describes the achievements of R and D activities in Germany, the change of radioactive waste management policy and the endeavours to maintain the achievements. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

A Molecular View of Methane Activation on Ni(111) through Enhanced Sampling and Machine Learning

A combination of machine learned interatomic potentials (MLIPs) and enhanced sampling simulations is used to investigate the activation of methane on a Ni(111) surface. The work entails the development and iterative refinement of MLIPs, initially trained on a dataset constructed via ab initio molecular dynamics (AIMD) simulations, supplemented by adaptive biasing forces, to enrich the sampling of catalytically relevant configurations. Our results reveal that by incorporating collective variables that capture the behavior of the reactant molecule, as well as additional frames that describe the dynamic response of the catalytic surface, it is possible to enhance considerably the accuracy of predicted energies and forces. By employing enhanced sampling schemes in the refinement of the MLIP, we systematically explore the potential energy surface, leading to a refined MLIP capable of predicting DFT-level energies and forces and replicating key geometric characteristics of the catalytic system. The resulting free energy landscapes at several temperatures provide a detailed view of the thermodynamics and dynamics of methane activation. Specifically, as methane approaches and dissociates on the catalytic surface, the process involves the dynamic interplay of CH 4 and the Ni catalyst that includes both enthalpic and entropic contributions. The progression towards the transition state involves an CH 4 moiety that is increasingly restrained in its ability to rotate or translate, while the stage following the transition state is characterized by a notable rise of the Ni atom that interacts with the cleaved C–H bond. Furthermore, this leads to an increase in the mobility of the adsorbed species, a feature that becomes more pronounced at higher temperatures.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Deep Learning for Full Waveform Inversion of Elastic Active-Source Seismic Data to Estimate P-Wave Velocity Models

Seismic imaging methods are critical for Global Security and Energy & Homeland Security missions and activities that rely on subsurface characterization, but traditional methods remain computationally expensive and require significant labor hours and expertise to execute. Within the past few years, machine learning (ML), namely deep learning (DL), has been used to develop data-driven end-to-end full waveform inversion (FWI) methods to estimate 2D P-wave velocity (Vp) models in a fraction of the time as conventional FWI. These methods, however, are trained on simplistic acoustic wave seismic data and Vp models that are not realistic nor representative of real-world observations, leaving a large gap between the state-of-the-art and deployable, feasible, and practical DL FWI methods. Here, we generate a synthetic active-source, 3D, elastic wave seismic data set and a variety of Vp models with realistic geologic structure for training DL FWI methods. We evaluate six different methods that have performed well for acoustic DL FWI or medical imaging tasks using our more realistic dataset. We find that these six trained models do not match the performance of published acoustic end-to-end DL FWI methods, indicating more training data may be needed, physics may need to be incorporated to achieve good accuracy at the sacrifice of the end-to-end advantage, and/or novel methods need to be developed to enable end-to-end DL FWI methods to perform well for real-world seismic data.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

The phylogenetic roots of addiction: compulsive drug seeking, natural and drug-sensitive reward, and the acquisition of learned habits

Our rational faculties permit us humans to maximize the utility of our actions. We perform a fundamental type of cost-benefit analysis in which we frame a problem, assign values to the different paths, and then choose from among a set of available options, the course that promises the most favorable outcome. So why then does addiction appear to be so impervious to the associated costs, so unaffected by undesired consequences, and ultimately so resistant to cognitive oversight? The answer may likely be found in the fact that the drivers for compulsive drug seeking and drug taking are located in affective brain circuits, circuits that are structured and patterned by learning with repeated activation. These deep processes exhibit significant resistance to control by our cognitive faculties. The general consensus is that addiction arises from mechanisms that overvalue the magnitude of reward, discount the associated risks, and thereby bias individuals towards compulsive pursuit of addictive drugs. Behavioral disruption and dependence appear to arise at the intersection of a number of connected but separate phenomena: expectations for the occurrence of specific events, behaviors that seek encounters with them, the ability to notice and learn nonrandom, co-occurring conditions, the prediction and valuation of consequences, the forming of enduring memories, and the drivers of focused behavior through compulsion, habits, and acquired routines. It is important to recognize that each one of these individual faculties are present and well developed across the entire phylogenetic tree of bilateral metazoans. The goal of this special volume is dedicated to exploring the degree to which inherent elements can account for addiction and addiction-associated phenomena. In much of the literature on addiction, the underlying processes are often viewed as distinctly mammalian, arising, in part, from the strong cognitive capacities of this taxon. Some phenomena may even be regarded to exist only in primates, or even solely in humans. This supposition arises from the fact that studies are conducted almost exclusively in mammals and primates, while evolutionary antecedents of the behavior are rarely considered. A more comprehensive perspective that examines drug reward and reinforcement in a wider range of organisms demonstrates that many of the component traits are actually well developed across the greater metazoan lineage, and they may well predate the emergence of a mammalian clade by a wide margin. The collection of papers assembled here supports the notion that the capacity to associate cues and quences has not arisen in mammals de novo. Rather, the neural mechanisms for detecting contingencies and for predicting future outcomes are very deeply rooted across broad phylogenetic divisions. Our understanding of an ability to associate paired events has been enriched by work in invertebrate preparations in both classical and operant conditioning scenarios [Cook and Carew, 1986, 1989a, 1989b]. The ability to learn allows us to connect cues and behavioral actions to their associated consequences. Pavlovian conditioning enriches surrounding cues with predictive value. Outcomes with positive valence generate appetitive responses and approach to the associated cues, while those perceived as aversive bring cue avoidance and withdrawal. Humans are not the only life forms capable of such short- and long-term modulations of behavior

59 BASIC BIOLOGICAL SCIENCES↗

Biosynthesis of bioprivileged, linear molecules via novel carboligase reactions

Over the award period, we made progress on the three aims. We screened twenty-five carboligases for activity coupling twenty-one possible -keto acids (Aim 1). The carboligases were selected across a diverse set of protein sequences. Using Q-Exactive UHPLC-MS, we tested a total of 210 coupled products per enzyme and generated a dataset of 5250 enzyme-substrate activity relationships. We identified multiple enzymes that had activity for synthesizing suberic acid and heptanoic acid (Aim 2). We built a random forest model for predicting the activity of each enzyme toward substrates on which it was not tested using the data from Aim 1. Finally, we evaluated growth defects that occurred due to expression of different carboligases in E. coli (Aim 3). We were able to identify specific metabolites and putative pathways that, when supplemented in the media, recovered the growth defect associated with the presence of specific carboligases. We are in the process of publishing two manuscript describing the methods for high-throughput screening of enzyme promiscuity, using machine learning to predict activity on untested substrates, and enzyme activity data we collected. This project has produced enabling data for biosynthesis of a range of new-to-nature compounds to support biomanufacturing.

60 APPLIED LIFE SCIENCES↗

2021 ROMANIA TRANSPORT SECURITY TABLE-TOP EXERCISE (TTX) – LESSONS LEARNED AND GOOD PRACTICES

During the period of 15-18 March 2021, the IAEA conducted a national workshop addressing the security of radioactive material in transport. The workshop was jointly hosted by the Romanian regulatory authority and the General Inspectorate of Romanian Gendarmerie. The workshop assisted Romania in improving its capability to evaluate the ability of response forces to counter a malicious act against radioactive material in transport. The event consisted of briefings, exercises, a demonstration of transport security equipment, and a transport security table-top exercise (TTX). The workshop was conducted in a virtual-hybrid format in such a way as to meet the COVID-19 related requirements in compliance with Romania’s guidelines. This paper provides an overview of the workshop’s activities, lessons-learned, and good practices related to the transport security TTX exercises.

Maican, Catalin↗

Product Consistency Test Results for the LAW ML1 Glasses

This report summarizes the chemical analysis of Product Consistency Test (PCT) leachates received from Pacific Northwest National Laboratory (PNNL). The leachates are from a series of quenched simulated nuclear waste glasses designated Low-Activity Waste Machine Learning (LAW ML1) glasses that were designed and fabricated at PNNL. The reported data will be used in the development, validation, and implementation of enhanced property/composition models for waste glass vitrification at Hanford. The elemental release for the study glasses is reported as normalized concentration NCi. NCi of several elements was computed for both the target and measured glass compositions, which were similar, resulting in no significant differences. Several of the glasses exhibited NC B , NC Na , and/or NC Si values that were greater than the Waste Treatment Plant (WTP) low-activity waste constraint of 4 g/L. All reference glasses included with the study glasses had measurements that fell within the expected ranges.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

STRUCTURAL ANNOTATION OF EM IMAGES BY GRAPH CUT

Biological images have the potential to reveal complex signatures that may not be amenable to morphological modeling in terms of shape, location, texture, and color. An effective analytical method is to characterize the composition of a specimen based on user-defined patterns of texture and contrast formation. However, such a simple requirement demands an improved model for stability and robustness. Here, an interactive computational model is introduced for learning patterns of interest by example. The learned patterns bound an active contour model in which the traditional gradient descent optimization is replaced by the more efficient optimization of the graph cut methods. First, the energy function is defined according to the curve evolution. Next, a graph is constructed with weighted edges on the energy function and is optimized with the graph cut algorithm. As a result, the method combines the advantages of the level set method and graph cut algorithm, i.e.,"topological" invariance and computational efficiency. The technique is extended to the multi-phase segmentation problem; the method is validated on synthetic images and then applied to specimens imaged by transmission electron microscopy(TEM).

60 APPLIED LIFE SCIENCES↗

Integrated pre-feasibility study for CO 2 geological storage in the Cascadia Basin, offshore Washington State, British Columbia

The Cascadia CarbonSAFE project conducted a pre-feasibility study to evaluate technical and nontechnical aspects of storing 50 million metric tons (MMT) of carbon dioxide in a safe, ocean basalt reservoir offshore Washington State and British Columbia. Sub-seafloor basalts are very common on Earth and enable geological mineralization as a long-term storage mechanism, permanently sequestering the carbon in solid rock form. This project evaluated the offshore storage complex, developed potential industrial source/transport scenarios, built an inventory of existing geophysical/geological data and environmental monitoring capabilities, conducted laboratory studies and reservoir modeling to determine storage capacity, and analyzed economic factors, regulatory requirements, and project management risks. Our team included researchers at Columbia University in New York, Pacific Northwest National Laboratory (PNNL) in Washington, University of Victoria in British Columbia, University of California at Santa Cruz, and GHG Underground in Maine, as well as collaborators at University of Iceland in Reykjavik and University of Washington in Saint Louis. In the study region, large emitters (>100,000 MT/year) generate a total of approximately 40 MMT annually from stationary sources, such as power plants, refineries, ammonia production, and mineral processing plants. Five potential industry source/transport scenarios were identified (three in U.SA S. and two in Canada) to potentially provide 50 MMT of carbon dioxide to the offshore reservoir. One scenario included net carbon-negative sources that would reduce atmospheric levels. The inventory of existing data illustrated that basalt properties in the region are potentially beneficial for long-term storage. Permeability is on the order of 0.1 to 1 Darcies within the uppermost 600 m of ocean crust and density-derived porosity reaches 10–20% in thin layers that provide act as flow channels and provide access to porous and permeable basalt. Fine-grained sediments overlying basalt provide a low-permeability barrier separating the storage reservoir from the overlying ocean. Subsurface monitoring of the storage complex benefits from a unique opportunity close proximity of to the nearby NEPTUNE cabled seafloor observatory, which actively transmits data to shore and could be used to monitor reservoir properties. Injection pressure changes, reservoir chemistry, seismicity, well head corrosion, and potential leakage monitoring would be feasible in real time. Using existing data and published models, the STOMP-CO 2 modeling code developed at PNNL was used to simulate carbon dioxide injection, storage, and mineralization in the reservoir. Preliminary simulations indicate that a 50 MMT carbon dioxide plume injected over a 20-year period remains well within the reservoir area, both laterally and vertically, for at least a 50-year period of post-injection monitoring. Laboratory studies on core samples from Cascadia measured dissolution rates in CO 2 –basalt–seawater mixtures and indicated large variability in rates with the potential for complete mineralization. Compared to published data, the dissolution rate measured in these samples is faster, decreasing the time until full conversion to carbonate minerals would occur. Adding geochemical reactivity in the STOMP-CO 2 model indicates that carbon dioxide would be fully converted to carbonate minerals in 135 years or less after injection ceases. The project assessed the viability and costs for the five scenarios using either dedicated offshore pipelines or shipping vessels. Carbon dioxide capture costs were not considered. Shipping incurred lower upfront CAPEX costs, and because most viable sources were located near the shore and waterways, shipping is preferred; no dedicated carbon dioxide pipelines exist in the region. The project also considered potential risks from mixed-use impacts on surrounding lands and ocean areas, such as active use by commercial and recreational fisherman, and other community considerations in planning for public engagement in the future. Other project risks were identified, including project management, permitting and compliance, and financing, as well as technical issues such as long-term instrumentation, plume migration, and model development. Geological concerns like reservoir permeability, seal, and induced seismicity held relatively low risk. The regulatory framework for offshore storage in the U.S. and Canada may be covered by general legal/regulatory programs, but is not yet fully defined. Existing programs appear to restrict the transportation of carbon dioxide across national boundaries (e.g., Canada to U.S.) and its sub-seabed disposal in some circumstances. Our assessment suggests that developing specific and separate pilot projects will help to advance the technical feasibility and regulatory requirements in each country, and lessons learned from such activities may be transferable elsewhere around the globe.

42 ENGINEERING↗

PREDICTING CORONAL MASS EJECTIONS USING MACHINE LEARNING METHODS

Of all the activity observed on the Sun, two of the most energetic events are flares and coronal mass ejections (CMEs). Usually, solar active regions that produce large flares will also produce a CME, but this is not always true. Despite advances in numerical modeling, it is still unclear which circumstances will produce a CME. Therefore, it is worthwhile to empirically determine which features distinguish flares associated with CMEs from flares that are not. At this time, no extensive study has used physically meaningful features of active regions to distinguish between these two populations. As such, we attempt to do so by using features derived from (1) photospheric vector magnetic field data taken by the Solar Dynamics Observatory ’s Helioseismic and Magnetic Imager instrument and (2) X-ray flux data from the Geostationary Operational Environmental Satellite’s X-ray Flux instrument. We build a catalog of active regions that either produced both a flare and a CME (the positive class) or simply a flare (the negative class). We then use machine-learning algorithms to (1) determine which features distinguish these two populations, and (2) forecast whether an active region that produces an M- or X-class flare will also produce a CME. We compute the True Skill Statistic, a forecast verification metric, and find that it is a relatively high value of ∼0.8 ± 0.2. We conclude that a combination of six parameters, which are all intensive in nature, will capture most of the relevant information contained in the photospheric magnetic field.

79 ASTRONOMY AND ASTROPHYSICS↗

Composition Measurements of the LAW ML1 Glasses

This report provides the results from the chemical analyses of the glass compositions of the quenched Low Activity Waste Machine Learning study glasses, a series of simulated nuclear waste glasses designed and fabricated at Pacific Northwest National Laboratory. These data will be used in the development, validation, and implementation of enhanced property/composition models for waste glass vitrification at Hanford. Chemical analyses were performed on a representative sample of each of the quenched glasses to allow for comparisons with target compositions. The relative differences between the target and measured concentrations of F - for one glass, P 2 O 5 for two glasses, SO 3 for three glasses, and ZrO 2 for two of the glasses were greater than 10%. These results can be used in further characterization of this series of glasses, including the normalization of Product Consistency Test results.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Development, characterization, and modeling of a high-performance Ru/B2CA catalyst for ammonia synthesis

This paper documents the development and performance of a nano-phase Ru catalyst on a (BaO) x (CaO) y (Al 2 O 3 ) support. Extensive screening of the support’s ternary composition shows the best stoichiometry is (BaO) 2 (CaO)(Al 2 O 3 ), denoted B2CA. The paper first describes catalyst preparation and characterization. The paper reports a detailed 12-step reaction mechanism that represents ammonia synthesis over wide ranges of temperature, pressure, space velocity, and feed composition. Additionally, the mechanism is developed and validated using results of packed-bed experiments. The elementary reaction pathways consider surface adsorbates, including catalyst-poisoning behaviors. The rate expressions include important coverage-dependent activation barriers. Machine learning models assist interpretation of the catalyst-support interactions. The detailed chemistry is much more predictive than is possible with global representations (N 2 + 3H 2 ⇌ 2NH 3 ). The validated models can be applied to assist optimizing reactor design and operating conditions.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗