Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “stream extraction”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6
All sourcesNASA NTRSDOE OSTI
NASA NTRS2016

Validation of High-Resolution CFD Method for Slosh Damping Extraction of Baffled Tanks

The predicted slosh damping values from Loci-Stream-VOF agree with experimental data very well for all fill levels in the vicinity of the baffle. Grid refinement study is conducted and shows that the current predictions are grid independent. The increase of slosh damping due to the baffle is shown to arise from: a) surface breakup; b) cascade of energy from the low order slosh mode to higher modes; and c) recirculation inside liquid phase around baffle. The damping is a function of slosh amplitude, consistent with previous observation. Miles equation under predicts damping in the upper dome section.

Yang, H. Q.↗
DOE OSTI2021

Buffer-free process cycle for CO 2 sequestration and carbonate production from brine waste streams with high salinity

A method includes: (1) using a chelating agent, extracting divalent ions from a brine solution as complexes of the chelating agent and the divalent ions; (2) using a weak acid, regenerating the chelating agent and producing a divalent ion salt solution; and (3) introducing carbon dioxide to the divalent ion salt solution to induce precipitation of the divalent ions as a carbonate salt. Another method includes: (1) combining water with carbon dioxide to produce a carbon dioxide solution; (2) introducing an ion exchanger to the carbon dioxide solution to induce exchange of alkali metal cations included in the ion exchanger with protons included in the carbon dioxide solution and to produce a bicarbonate salt solution of the alkali metal cations; and (3) introducing a brine solution to the bicarbonate salt solution to induce precipitation of divalent ions from the brine solution as a carbonate salt.

Sant, Gaurav↗
DOE OSTI2023

Buffer-free process cycle for CO 2 sequestration and carbonate production from brine waste streams with high salinity

A method includes: (1) using a chelating agent, extracting divalent ions from a brine solution as complexes of the chelating agent and the divalent ions; (2) using a weak acid, regenerating the chelating agent and producing a divalent ion salt solution; and (3) introducing carbon dioxide to the divalent ion salt solution to induce precipitation of the divalent ions as a carbonate salt. Another method includes: (1) combining water with carbon dioxide to produce a carbon dioxide solution; (2) introducing an ion exchanger to the carbon dioxide solution to induce exchange of alkali metal cations included in the ion exchanger with protons included in the carbon dioxide solution and to produce a bicarbonate salt solution of the alkali metal cations; and (3) introducing a brine solution to the bicarbonate salt solution to induce precipitation of divalent ions from the brine solution as a carbonate salt.

Sant, Gaurav↗
DOE OSTI2022

Solvent Recovery and Management at the Savannah River Site H-Canyon Facility

NIOWAVE, Inc. is a domestic supplier of medical and industrial isotopes from uranium and radium. The Savannah River National laboratory (SRNL) is currently providing support to NIOWAVE, which plans to deploy a superconducting electron linear accelerator (LINAC) to fission uranium for Mo-99 production without the need for a nuclear reactor or HEU. The uranium from the Mo-99 production targets will be purified using a modified PUREX (Plutonium Uranium Reduction Extraction) solvent extraction process to recover the uranium in the product stream. The uranium will then be precipitated as an oxalate which is calcined to U 3 O 8 to fabricate pellets for new Mo-99 targets. In previous support provided to NIOWAVE, the SRNL demonstrated a solvent washing process to remove degradation products from the tributyl phosphate (TBP) solvent used in the modified PUREX process under development for uranium recovery. To supplement this technology demonstration, NIOWAVE requested the SRNL to provide summary information on the solvent recovery and management activities which are used at the Savannah River Site (SRS) H-Canyon facility. An existing reference document for the reprocessing of irradiated HEU fuels at the SRS was used as the primary reference for the solvent management activities; although, other reference documents were used to provide supplementary information. The information provided includes a brief summary of the solvent degradation issues which have been observed in the H-Canyon solvent extraction cycles and resulting process safety concerns. The solvent recovery processes for the three cycles of solvent extraction used in the H-Canyon were subsequently described including the process equipment which consists of the continuous and batch solvent washers, pumps, and tanks. A final section is provided on the monitoring and analysis of solvent quality based on the previous work performed at the SRNL for NIOWAVE and past research and development activities performed to support the solvent extraction processes in both the SRS F-Canyon and H-Canyon facilities.

07 ISOTOPE AND RADIATION SOURCES↗
DOE OSTI2021

Ensemble learning-iterative training machine learning for uncertainty quantification and automated experiment in atom-resolved microscopy

Deep learning has emerged as a technique of choice for rapid feature extraction across imaging disciplines, allowing rapid conversion of the data streams to spatial or spatiotemporal arrays of features of interest. However, applications of deep learning in experimental domains are often limited by the out-of-distribution drift between the experiments, where the network trained for one set of imaging conditions becomes sub-optimal for different ones. This limitation is particularly stringent in the quest to have an automated experiment setting, where retraining or transfer learning becomes impractical due to the need for human intervention and associated latencies. Here we explore the reproducibility of deep learning for feature extraction in atom-resolved electron microscopy and introduce workflows based on ensemble learning and iterative training to greatly improve feature detection. This approach allows incorporating uncertainty quantification into the deep learning analysis and also enables rapid automated experimental workflows where retraining of the network to compensate for out-of-distribution drift due to subtle change in imaging conditions is substituted for human operator or programmatic selection of networks from the ensemble. This methodology can be further applied to machine learning workflows in other imaging areas including optical and chemical imaging.

36 MATERIALS SCIENCE↗
NASA NTRS1982

LANDSAT-D accelerated payload correction subsystem output computer compatible tape format

The NASA GSFC LANDSAT-D Ground Segment (GS) is developing an Accelerated Payload Correction Subsystem (APCS) to provide Thematic Mapper (TM) image correction data to be used outside the GS. This correction data is computed from a subset of the TM Payload Correction Data (PCD), which is downlinked from the spacecraft in a 32 Kbps data stream, and mirror scan correction data (MSCD), which is extracted from the wideband video data. This correction data is generated in the GS Thematic Mapper Mission Management Facility (MMF-T), and is recorded on a 9-track 1600 bit per inch computer compatible tape (CCT). This CCT is known as a APCS Output CCT (AOT). The AOT follows standardized corrections with respect to data formats, record construction and record identification. Applicable documents are delineated; common conventions which are used in further defining the structure, format and content of the AOT are defined; and the structure and content of the AOT are described.

Source record↗
NASA NTRS2000

Gravitational Physics Research

Gravitational physics research at ISPAE is connected with NASA's Relativity Mission (Gravity Probe B (GP-B)) which will perform a test of Einstein's General Relativity Theory. GP-B will measure the geodetic and motional effect predicted by General Relativity Theory with extremely stable and sensitive gyroscopes in an earth orbiting satellite. Both effects cause a very small precession of the gyroscope spin axis. The goal of the GP-B experiment is the measurement of the gyroscope precession with very high precision. GP-B is being developed by a team at Stanford University and is scheduled for launch in the year 2001. The related UAH research is a collaboration with Stanford University and MSFC. This research is focussed primarily on the error analysis and data reduction methods of the experiment but includes other topics concerned with experiment systems and their performance affecting the science measurements. The hydrogen maser is the most accurate and stable clock available. It will be used in future gravitational physics missions to measure relativistic effects such as the second order Doppler effect. The HMC experiment, currently under development at the Smithsonian Astrophysical Observatory (SAO), will test the performance and capability of the hydrogen maser clock for gravitational physics measurements. UAH in collaboration with the SAO science team will study methods to evaluate the behavior and performance of the HMC. The GP-B data analysis developed by the Stanford group involves complicated mathematical operations. This situation led to the idea to investigate alternate and possibly simpler mathematical procedures to extract the GP-B measurements form the data stream. Comparison of different methods would increase the confidence in the selected scheme.

Wu, S. T.↗
NASA NTRS2013

Advanced Seal Sessions I and II

As aircraft operators continue to seek higher fuel efficiency, lower emissions, and longer on-wing performance, turbine engine designers are scrutinizing all components for areas of improvement. To achieve overall goals, turbine pressure ratios and by-pass ratios continue to climb. Also, designers are seeking to minimize parasitic and cooling flows to extract the most useful work out of the flow stream, placing a renewed interest on seal technology and secondary flow path management. In the area of future manned spacecraft, advancements are being examined for both habitat seals and re-entry thermal protection system thermal barrierseals. For long duration space craft, designers are continuing to look for savings in parasitic losses to reduce the amount of cabin re-supply air that needs to be brought along. This is placing greater demands on seal designs and materials to exhibit low leakage and be resistant to space environments. For future missions to and from distant planets, the re-entry heating will be higher than for low-earth orbit or lunar return motivating advanced thermal barrier development. This presentation will provide an overview of the seal challenges and opportunities in these diverse areas.

turbine engines↗
DOE OSTI2020

Analysis of Using a Hybrid ZIRCEX Process to Generate High-Assay Low-Enriched Uranium (HALEU) - 20158

Idaho National Lab (INL) is investigating the feasibility of providing High-Assay Low Enriched Uranium (HALEU) by recovering Highly Enriched Uranium (HEU) from spent nuclear fuel (SNF) and downblending the HEU with natural, low-enriched, or depleted uranium (NU, LEU, or DU). That investigation identified that significant quantities of HALEU could be produced with a Hybrid ZIRCEX process to further advanced reactor research while reducing INL's environmental liability. Many new advanced reactor designs are being developed with improved safety, efficiency, and economics. Most require nuclear fuel with U-235 enrichment between 5% and 20%, which is defined as HALEU. Although technically feasible, there is no current domestic capability to make HALEU in the US. While it is anticipated that industry will provide HALEU through commercial enrichment once advanced reactors mature, until a market is established, an interim source of HALEU is needed to enable research and demonstration. An interim source of HALEU could be provided by recovering the HEU in some DOE-managed SNF and downblending it to between 5% and 20% using the Hybrid ZIRCEX Process. ZIRCEX is a dry head-end process to remove cladding (zirconium or aluminum) from SNF. Drying of the SNF is needed prior to introduction to ZIRCEX. After cladding removal, uranium and fission products in the bed material are oxidized and elutriated. In a Hybrid ZIRCEX process, the HEU process stream is sent to a very compact, modular solvent extraction process for uranium purification. The uranyl nitrate from solvent extraction is denitrated and calcined to produce a HALEU product ready for fuel fabrication. The long-lived fission products from solvent extraction are immobilized in glass using a small in-can melt. By removing the cladding before dissolution, the volume of glass waste is reduced by a factor of up to 300 times (when compared to not removing the cladding from the fuel). Other radioactive wastes from the process could be disposed of as Class A or Class B low-level waste. In addition to producing HALEU for advanced reactors, consumption of SNF would reduce DoE's environmental liability. Incorporating low-enriched spent fuel (versus exclusive use of LEU, DU, or NU) into the downblending scheme could reduce the SNF inventory even further. Several downblending and enrichment scenarios using INL fuels were investigated in this study. The results of this analysis show that the Hybrid ZIRCEX process could make a significant contribution to needed HALEU feedstock and reduce the environmental liability of managing SNF at INL. (authors)

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2026

Process design for recovering rare-earth elements from mine tailings with low rare-earth concentrations via sequential leaching and solvent extraction

Rare earth elements (REEs) are essential for advanced technologies and yet face significant supply chain risks due to their concentrated global production and limited domestic availability. Addressing this challenge requires efficient processes capable of upgrading low-grade secondary resources such as mine tailings. In this study, we developed a novel separation flowsheet that integrates sequential leaching and 2-stage solvent extraction (SX) processes to recover high-purity heavy REEs (HREEs) and light REEs (LREEs) from a simulated mine-tailing concentrate containing 2.4 wt% total REEs (TREEs; 0.6 wt% LREEs and 1.8 wt% HREEs). Sequential leaching with controlled pH adjustment selectively precipitated REEs while retaining the large amount of impurities in the solution, producing an REE-enriched leachate by following leaching processes with roughly twice the REE concentration and half the impurity concentration compared to that of single-step leaching. The optimized SX flowsheet employed Cyanex 572 to extract HREEs and Fe over LREEs, followed by Fe removal using tributyl phosphate (TBP), while the raffinate stream was processed by SX with di(2-ethylhexyl)phosphoric acid (D2EHPA) to recover LREEs under optimized conditions balancing both extraction efficiency and purity. Although increased extractant availability in the organic phase improved LREE recovery, it also increased co-extraction of Ca, underscoring trade-offs in process optimization. Both HREE- and LREE-rich solutions were subsequently precipitated into solid products via oxalate precipitation, resulting in high-purity REE solids containing ∼92.0 wt% HREEs (∼95.7 wt% TREEs) and ∼92.8 wt% LREEs (∼94.0 wt% TREEs). In conclusion, this proof-of-concept study using simulated mine tailings demonstrates a promising approach for upgrading low-grade REE resources, while highlighting the need for future validation with real materials.

Mine tailings↗
DOE OSTI2020

NH 4 OH Looping with Membrane CO 2 Absorber and Distributed Stripper for Enhanced Algae Growth

The University of Kentucky Center for Applied Energy (UK CAER) has devised a unique, integrated CO2 capture and utilization technology. CO2 from coal-fired power generation flue gas is first captured at half the operating cost of a typical aqueous CO2 capture system (CCS), distributed in an aqueous stream and then fixed by algae in bioreactors where the algae production is increased by 50% over that with a typical intermittent nutrient feeding system. Lower CCS operating cost is achieved by eliminating the flue gas pretreatment step for cooling and SO2 removal, eliminating steam extraction from the power generation steam cycle for solvent regeneration, and eliminating CO2 compression. Higher algae production is achieved by continuous, just-in-time nutrient feed to the bioreactors directly from a distributed solvent regenerator, which maintains the bioreactor pH for optimum growth. The process starts with a uniquely configured membrane absorber, where the flue gas is indirectly contacted with an ammonium hydroxide (NH4OH) solvent. Dissolved NH3 is attractive for both CO2 capture and as an algae nutrient. For CO2 capture it is inexpensive, has a low regeneration energy, is thermally- and oxidatively-stable and has a viscosity near that of water, which makes is easy to transport. Numerous studies have shown that the scrubbing capacity of NH3 is approximately 0.9-1.2 kg of CO2/kg of NH3, with a CO2 removal efficiency of ~99% and half the solvent regeneration energy than that of 30 wt% MEA[1, 2, 3]. NH3 is attractive as an algae nutrient due to its low cost. The rich NH4OH solvent is pumped to a set of distributed regenerators which are co-located with the algae bioreactors. Solvent pumping, transport and distribution reduces the balance of plant (BOP) cost compared to a typical aqueous CCS related to the flue gas duct and boost fan required to transport the flue gas. The energy required for the distributed solvent regeneration is supplied by solar-thermal panels eliminating the need for steam extraction from the power generation steam cycle. After solvent regeneration, the product stream contains both the CO2 captured from the flue gas and volatized NH3 from the solvent. This product stream is fed directly to the bioreactors, eliminating the need for compression of the CO2 stream. The relative amounts of CO2 and NH3 in the product stream are adjusted and controlled by a controlling the regeneration conditions (pressure and temperature). The continuous feed of the right ratio of nutrients overcomes the typical inhibition of algae growth resulting from frequent pH swings in the bioreactor due to unbalanced (intermittent) feeding systems for CO2 and N. Also, because the regenerators will operate at pressure and be located in close proximity to the bioreactors, there is no worry about pressure drop when sparging the gas into the algae. Sparging produces small bubbles which is beneficial for mass transfer efficiency. One known challenge when using an NH4OH solvent is high NH3 emission. Hydrophobic membranes are used for CO2 capture using an aqueous NH3 solution[4, 5] without the direct contact between flue gas and aqueous solution. Additionally, UK CAER CO2 capture and utilization process manages NH3 slip in three extra measures. First, NH3 slip is minimized by working with minimal species partial pressure, which is proportional to the concentration in the liquid. Hence, lowering the capture solvent concentration will lower the NH3 partial pressure. Second, UK CAER’s previous work has demonstrated that the addition of Zn2+ into NH3 solutions to chelate the NH3 can reduce NH3 volatility. Third, the configuration of the membrane CO2 absorber utilizes condensed water from the flue gas to continually wash the gas-side of the membrane to reduce fouling and recapture NH3 slip. Additional details about the UK CAER unique, integrated CO2 capture and utilization technology will be presented along with technology development plans. Diao, N., Q. Li, and Z. Fang. 2004. Heat transfer in ground heat exchangers with groundwater advection. International Journal of Thermal Sciences. 43: 1203-1211, He, Q., M. Chen, L. Meng, K. Liu, and W. Pan. 2004. Study on Carbon Dioxide Removal from Flue Gas by Absorption of Aqueous Ammonia. Western Kentucky University. Yeh, A.C., and H. Bai. 1999. Comparison of ammonia and monoethanolamine solvents to reduce CO2 greenhouse gas emissions. The Science of the Total Environment. 228: 121-133, Villeneuve, K., D. Roizard, J.C. Remigy, M. Iacono, and S. Rode. 2018. CO2 capture by aqueous ammonia with hollow fiber membrane contactors: Gas phase reactions and performance stability. Separation and Purification Technology, 199: 189-197, Toro Molina, C., and C. Bouallou. 2016. Carbon dioxide absorption by ammonia intensified with membrane contactors. Clean Techn Environ Policy 18, 2133–2146 (2016)

20 FOSSIL-FUELED POWER PLANTS↗
DOE OSTI2026

rustpix

rustpix is a high-performance, open-source Rust library with first-class Python bindings (via PyO3) for processing pixel-detector data in neutron imaging. It targets time-stamping detectors such as Timepix3 (TPX3) at ORNL's Spallation Neutron Source (VENUS beamline), where each detected neutron deposits charge across a cluster of pixels within a very high-rate event stream (96M+ hits/sec). rustpix parses TPX3 event data in parallel using memory-mapped I/O, offers four interchangeable clustering algorithms (ABS adjacency-based search, DBSCAN, graph/union-find connected components, and a parallel grid method), and extracts weighted, super-resolved centroids to produce neutron-event lists. A streaming architecture lets it process files larger than available memory. rustpix is distributed as a pip-installable Python package (with NumPy integration), Rust crates, a command-line tool, and an interactive GUI; it writes HDF5, Apache Arrow, and CSV; and it is designed to extend to TPX4 and other detector types. Released as open-source under the MIT License.

Zhang, Chen [Oak Ridge National Laboratory (ORNL),↗
DOE OSTI2024

Effects of Injected Current Streams on MHD Equilibrium Reconstruction of Local Helicity Injection Plasmas in a Spherical Tokamak

Open field line currents are intrinsic to DC helicity injection plasma startup and pose a challenge for inferring the plasma equilibrium with standard reconstruction analysis. Local helicity injection (LHI) is a type of DC helicity injection which uses small, modular current sources to drive force-free current along helical field lines to produce tokamak plasmas. MHD modeling and magnetic measurements during LHI indicate the injected current streams remain coherent as helical structures on the outboard edge of a core toroidal plasma that is tokamak-like in a toroidally averaged sense. To extract core plasma equilibrium properties, external magnetic diagnostics corrected for contributions from the injected current streams are fitted by a standard Grad-Shafranov equilibrium code. An iterative approach for estimating and subtracting the stream contributions from the diagnostic signals is described and applied to a model equilibrium database to reduce systematic errors introduced by the streams. Convergence is usually attained with 2 to 4 iterations, with derived equilibrium parameters matching the prescribed axisymmetric core values to within estimated experimental uncertainties. Accurate recovery of core parameters occurs when the ratio of the net toroidal windup current from the streams to the core plasma current is less than 0.2, which is typically satisfied in most experiments.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2020

Separation of thorium, uranium, and rare earths from a strip solution generated from coarse coal refuse

This work systematically evaluated the separation performance of thorium, uranium, and rare earths when coal and coal byproduct were utilized as a non-traditional feedstock for rare earth production. A synthetic solution was prepared following the elemental composition of a strip solution generated from coarse coal refuse and used throughout the study. Various separation techniques including selective precipitation, solvent extraction, and a modified experimental protocol incorporating the two were applied to extract rare earths while minimizing the non-selective recovery of thorium and uranium into the product stream. Test results indicate that selective precipitation was effective for the removal of thorium at a pH value approaching 5 while solvent extraction preferentially removed uranium from rare earths. Therefore, a modified experimental protocol consisting of both selective precipitation and solvent extraction was subsequently developed and implemented. The findings following the modified experimental protocol indicate that extractant concentration, solvent extraction feed pH, and organic to aqueous (O/A) ratio all played a significant role in the removal of uranium. Among all the tests conducted, the best separation performance was achieved using a one-stage precipitation at a pH value of 4.8, 50 v% TBP, solvent extraction feed pH of 3.5, and an O/A ratio of 3, which corresponded to an overall rare earth, thorium, and uranium recovery of 79.6%, 0%, and 3.1%, respectively.

01 COAL, LIGNITE, AND PEAT↗
DOE OSTI2024

Investigating the Impacts of Direct Dissolution Conditions on the Radiolytic Longevity of Butyramide Extractants

Removing the nitric acid (HNO3) dissolution step in used nuclear fuel (UNF) reprocessing would reduce the volume of radioactive waste streams generated, thereby, improving process efficiency. A promising strategy for this is the direct dissolution of UNF that has been pretreated by voloxidation into an organic solvent composed of specialized extractants and diluent. However, removal of the aqueous HNO3 phase from the envisioned reprocessing system has the potential to drastically change the suite of radiation-induced processes occurring, and thus, alter the longevity of proposed reagents. Furthermore, the impacts of fission product and transuranic metal ion complexation on the aforementioned radiation-induced processes is poorly understood, and yet can cause significant changes in radiolytic longevity. To bridge these knowledge gaps and support the continued development of direct dissolution strategies, we present an investigation into the impacts of direct dissolution conditions on the gamma radiation-induced degradation of N,N-di-(2-ethylhexyl) butyramide (DEHBA) and N,N-di-(2-ethylhexyl)isobutyramide (DEHiBA) ligands—candidate replacements for tributyl phosphate—in pre-equilibrated n-dodecane solvent in the presence and absence of envisioned loading amounts of uranium.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗
DOE OSTI2024

Investigating the impacts of used nuclear fuel direct dissolution on the radiolytic longevity of solvent and butyramide extractants

Removing the nitric acid (HNO3) dissolution step in used nuclear fuel (UNF) reprocessing would reduce the volume of radioactive waste streams generated, thereby, improving process efficiency. A promising strategy for this is the direct dissolution of UNF that has been pretreated by voloxidation into an organic solvent composed of specialized extractants and diluent. However, removal of the aqueous HNO3 phase from the envisioned reprocessing system has the potential to drastically change the suite of radiation-induced processes occurring, and thus, alter the longevity of proposed reagents. Furthermore, the impacts of fission product and transuranic metal ion complexation on the aforementioned radiation-induced processes is poorly understood, and yet can cause significant changes in radiolytic longevity. To bridge these knowledge gaps and support the continued development of direct dissolution strategies, we present an investigation into the impacts of direct dissolution conditions on the gamma radiation-induced degradation of N,N-di-(2-ethylhexyl) butyramide (DEHBA) and N,N-di-(2-ethylhexyl)isobutyramide (DEHiBA) ligands—candidate replacements for tributyl phosphate—in pre-equilibrated n-dodecane solvent in the presence and absence of envisioned loading amounts of uranium.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗
DOE OSTI2022

ThunderSecure: deploying real-time intrusion detection for 100G research networks by leveraging stream-based features and one-class classification network

Nowadays, data generated by large-scale scientific experiments are on the scale of petabytes per month. These data are transferred through dedicated high-bandwidth networks (40/100G) across distributed sites for processing, storage, and analysis. Like general purpose networks, research networks experience intrusions. However, monitoring anomalies in such high-speed network traffics is challenging given current cyber-infrastructure. Moreover, traditional network intrusion detection systems (NIDS) are signature based. However, anomaly patterns are difficult to define and that rulesets are often not updated frequently enough to reflect the changes of attack behaviors. We present ThunderSecure, a high-throughput, unsupervised learning-based intrusions detection system for 100G research networks. ThunderSecure implements an efficient packet processing and detection pipeline using multi-cores and GPUs. It extracts statistical and temporal features from real-time network data streams and feeds them to a one-class anomaly detection network. A baseline of normal distribution will be created based on the training observation. Testing traffic deviated from the learned profile will be marked as anomalies. We trained ThunderSecure on hundreds of billions of science data packets mirrored from two 100G network connections at Fermi National Accelerator Laboratory. The detection performance was evaluated on traffic captured from the same research network days and weeks after the training with different types of attack flows injected. Results show that ThunderSecure can recognize science data traffic captured long after the training and made nearly certain detection on the segment of the streams where anomalous flows were injected.

100G research network↗
DOE OSTI2022

SNAD transient miner: Finding missed transient events in ZTF DR4 using k-D trees

Here we report the automatic detection of 11 transients (7 possible supernovae and 4 active galactic nuclei candidates) within the Zwicky Transient Facility fourth data release (ZTF DR4), all of them observed in 2018 and absent from public catalogs. Among these, three were not part of the ZTF alert stream. Our transient mining strategy employs 41 physically motivated features extracted from both real light curves and four simulated light curve models (SN Ia, SN II, TDE, SLSN-I). These features are input to a k-D tree algorithm, from which we calculate the 15 nearest neighbors. After pre-processing and selection cuts, our dataset contained approximately a million objects among which we visually inspected the 105 closest neighbors from seven of our brightest, most well-sampled simulations, comprising 89 unique ZTF DR4 sources. Our result illustrates the potential of coherently incorporating domain knowledge and automatic learning algorithms, which is one of the guiding principles directing the SNAD team. It also demonstrates that the ZTF DR is a suitable testing ground for data mining algorithms aiming to prepare for the next generation of astronomical data.

79 ASTRONOMY AND ASTROPHYSICS↗