Results for “generative model” — Page 13

DOE OSTI2021

D2U: Data Driven User Emulation for the Enhancement of Cyber Testing, Training, and Data Set Generation

Whether testing intrusion detection systems, conducting training exercises, or creating data sets to be used by the broader cybersecurity community, realistic user behavior is a critical component of a cyber range. Existing methods either rely on network level data or replay recorded user actions to approximate real users in a network. Our work is the first to produce generative models trained on actual user data (sequences of application usage) collected on endpoints. Once trained to the user's behavioral data, these models can generate novel sequences of actions %that appear to come from the same distribution as the training data. These sequences of actions are then fed to our custom software via configuration files, which replicate those behaviors on end devices. Notably, our models are platform agnostic and could generate behavior data for any emulation software package. In this paper we present our model generation process, software architecture, and an initial evaluation of the fidelity of our models. Our software is currently deployed in a cyber range to help evaluate the efficacy of defensive cyber technologies. We suggest additional ways that the cyber community as a whole can benefit from more realistic user behavior emulation. The data used to train our model, as well as sample configuration files produced by the model, are available at [redacted].

Oesch, T↗

NASA NTRS1993

Generating Finite-Element Models Of Composite Materials

Program starts at micromechanical level, from simple inputs supplied by user. COMGEN, COmposite Model GENerator, is interactive FORTRAN program used to create wide variety of finite-element models of continuous-fiber composite materials at micromechanical level. Quickly generates batch or "session files" to be submitted to finite-element preprocessor and postprocessor program, PATRAN. COMGEN requires PATRAN to complete model.

Melis, M. E.↗

DOE OSTI2020

Loosely Conditioned Emulation of Global Climate Models With Generative Adversarial Networks

Climate models encapsulate our best understanding of the Earth system, allowing research to be conducted on its future under alternative assumptions of how human-driven climate forces are going to evolve. An important application of climate models is to provide metrics of mean and extreme climate changes, particularly under these alternative future scenarios, as these quantities drive the impacts of climate on society and natural systems. Because of the need to explore a wide range of alternative scenarios and other sources of uncertainties in a computationally efficient manner, climate models can only take us so far, as they require significant computational resources, especially when attempting to characterize extreme events, which are rare and thus demand long and numerous simulations in order to accurately represent their changing statistics. Here we use deep learning in a proof of concept that lays the foundation for emulating global climate model output for different scenarios. We train two "loosely conditioned" Generative Adversarial Networks (GANs) that emulate daily precipitation output from a fully coupled Earth system model: one GAN modeling Fall-Winter behavior and the other Spring-Summer. Our GANs are trained to produce spatiotemporal samples: 32 days of precipitation over a 64x128 regular grid discretizing the globe. We evaluate the generator with a set of related performance metrics based upon KL divergence, and find the generated samples to be nearly as well matched to the test data as the validation data is to test. We also find the generated samples to accurately estimate the mean number of dry days and mean longest dry spell in the 32 day samples. Our trained GANs can rapidly generate numerous realizations at a vastly reduced computational expense, compared to large ensembles of climate models, which greatly aids in estimating the statistics of extreme events.

climate emulation, extreme climate, impacts, machi↗

DOE OSTI2023

Fitting a deep generative hadronization model

Hadronization is a critical step in the simulation of high-energy particle and nuclear physics experiments. As there is no first principles understanding of this process, physically-inspired hadronization models have a large number of parameters that are fit to data. Deep generative models are a natural replacement for classical techniques, since they are more flexible and may be able to improve the overall precision. Proof of principle studies have shown how to use neural networks to emulate specific hadronization when trained using the inputs and outputs of classical methods. However, these approaches will not work with data, where we do not have a matching between observed hadrons and partons. In this paper, we develop a protocol for fitting a deep generative hadronization model in a realistic setting, where we only have access to a set of hadrons in data. Our approach uses a variation of a Generative Adversarial Network with a permutation invariant discriminator. We find that this setup is able to match the hadronization model in Herwig with multiple sets of parameters. This work represents a significant step forward in a longer term program to develop, train, and integrate machine learning-based hadronization models into parton shower Monte Carlo programs.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

DOE OSTI2022

Synthetic Data and Graph Generation for Modeling Adversarial Activity (Final Project Report)

The Data and Graph Generation for Modeling Adversary Activity (MAA) project developed a methodology along with scalable graph modeling and generation tools to produce realistic large-scale background activity graphs with embedded adversarial activity pathways. The technical report presents PNNL methodology, released datasets, lessons learned, and recommendations to develop graph analytic algorithms for structure-only and attributed knowledge graphs.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2022

Calomplification — the power of generative calorimeter models

Motivated by the high computational costs of classical simulations, machine-learned generative models can be extremely useful in particle physics and elsewhere. They become especially attractive when surrogate models can efficiently learn the underlying distribution, such that a generated sample outperforms a training sample of limited size. This kind of GANplification has been observed for simple Gaussian models. We show the same effect for a physics simulation, specifically photon showers in an electromagnetic calorimeter.

47 OTHER INSTRUMENTATION↗

NASA NTRS1995

Reduction Of Sizes Of Semi-Markov Reliability Models

Trimming technique reduces computational effort by order of magnitude while introducing negligible error. Error bound depends on only three parameters from semi-Markov model: maximum sum of rates for failure transitions leaving any state, maximum average holding time for recovery-mode state, and operating time for system. Error bound computed before any model generated, enabling modeler to decide immediately whether or not model can be trimmed. Trimming procedure specified by precise and easy description, making it easy to include trimming procedure in program generating mathematical models for use in assessing reliability. Typical application of technique in design of digital control systems required to be extremely reliable. In addition to aerospace applications, fault-tolerant design has growing importance in wide range of industrial applications.

White, Allan L.↗

NASA NTRS1978

Procedures for generation and reduction of linear models of a turbofan engine

A real time hybrid simulation of the Pratt & Whitney F100-PW-F100 turbofan engine was used for linear-model generation. The linear models were used to analyze the effect of disturbances about an operating point on the dynamic performance of the engine. A procedure that disturbs, samples, and records the state and control variables was developed. For large systems, such as the F100 engine, the state vector is large and may contain high-frequency information not required for control. This, reducing the full-state to a reduced-order model may be a practicable approach to simplifying the control design. A reduction technique was developed to generate reduced-order models. Selected linear and nonlinear output responses to exhaust-nozzle area and main-burner fuel flow disturbances are presented for comparison.

Seldner, K.↗

DOE OSTI2024

Comparison of point cloud and image-based models for calorimeter fast simulation

Score based generative models are a new class of generative models that have been shown to accurately generate high dimensional calorimeter datasets. Recent advances in generative models have used images with 3D voxels to represent and model complex calorimeter showers. Point clouds, however, are likely a more natural representation of calorimeter showers, particularly in calorimeters with high granularity. Furthermore, point clouds preserve all of the information of the original simulation, more naturally deal with sparse datasets, and can be implemented with more compact models and data files. In this work, two state-of-the-art score based models are trained on the same set of calorimeter simulation and directly compared.

47 OTHER INSTRUMENTATION↗

DOE OSTI2016

A superstructure representation, generation, and modeling framework for chemical process synthesis

We present a framework for the efficient representation, generation, and modeling of superstructures for process synthesis. First, we develop a new representation based on three basic elements: units, ports, and conditioning streams. Second, we present four rules based on “minimal” and “feasible” component sets for the generation of simple superstructures containing all feasible embedded processes. Third, in terms of modeling, we develop a modular approach, and formulate models for each basic element. We also present a canonical form of element models using input/output variables and constrained/free variables. The proposed methods provide a coherent framework for superstructure‐based process synthesis, allowing efficient model generation and modification. © 2016 American Institute of Chemical Engineers AIChE J , 62: 3199–3214, 2016

Wu, WenZhao↗

DOE OSTI2016

A Deep Generative Deconvolutional Image Model

A deep generative model is developed for representation and analysis of images, based on a hierarchical convolutional dictionary-learning framework. Stochastic unpooling is employed to link consecutive layers in the model, yielding top-down image generation. A Bayesian support vector machine is linked to the top-layer features, yielding max-margin discrimination. Deep deconvolutional inference is employed when testing, to infer the latent features, and the top-layer features are connected with the max-margin classifier for discrimination tasks. The model is efficiently trained using a Monte Carlo expectation-maximization (MCEM) algorithm; the algorithm is implemented on graphical processor units (GPU) to enable large-scale learning, and fast testing. Excellent results are obtained on several benchmark datasets, including ImageNet, demonstrating that the proposed model achieves results that are highly competitive with similarly sized convolutional neural networks.

convolutional neural network↗

DOE OSTI2026

Flow matching meets biology and life science: a survey

Over the past decade, advances in generative modeling, such as generative adversarial networks, masked autoencoders, and diffusion models, have significantly transformed biological research and discovery, enabling breakthroughs in molecule design, protein generation, catalysis discovery, drug discovery, and beyond. At the same time, biological applications have served as valuable testbeds for evaluating the capabilities of generative models. Recently, flow matching has emerged as a powerful and efficient alternative to diffusion-based generative modeling, with growing interest in its application to problems in biology and life sciences. This paper presents the first comprehensive survey of recent developments in flow matching and its applications in biological domains. We begin by systematically reviewing the foundations and variants of flow matching, and then categorize its applications into three major areas: biological sequence modeling, molecule generation and design, and peptide and protein generation. For each, we provide an in-depth review of recent progress. We also summarize commonly used datasets and software tools, and conclude with a discussion of potential future directions.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2025

Point cloud-based diffusion models for the Electron-Ion Collider

At high-energy collider experiments, generative models can be used for a wide range of tasks, including fast detector simulations, unfolding, searches of physics beyond the Standard Model, and inference tasks. In particular, it has been demonstrated that score-based diffusion models can generate high-fidelity and accurate samples of jets or collider events. This work expands on previous generative models in three distinct ways. First, our model is trained to generate entire collider events, including all particle species with complete kinematic information. We quantify how well the model learns event-wide constraints such as the conservation of momentum and discrete quantum numbers. We focus on the events at the future Electron-Ion Collider, but we expect that our results can be extended to proton-proton and heavy-ion collisions. Second, previous generative models often relied on image-based techniques. The sparsity of the data can negatively affect the fidelity and sampling time of the model. We address these issues using point clouds and a novel architecture combining edge creation with transformer modules called Point Edge Transformers. Third, we adapt the foundation model OmniLearn, to generate full collider events. This approach may indicate a transition toward adapting and fine-tuning foundation models for downstream tasks instead of training new models from scratch.

Araz, Jack Y. [Stony Brook Univ., NY (United State↗

DOE OSTI2023

Blackout Diffusion: Generative Diffusion Models in Discrete-State Spaces

Typical generative diffusion models rely on a Gaussian diffusion process for training the backward transformations, which can then be used to generate samples from Gaussian noise. However, real world data often takes place in discrete-state spaces, including many scientific applications. Here, we develop a theoretical formulation for arbitrary discrete-state Markov processes in the forward diffusion process using exact (as opposed to variational) analysis. We relate the theory to the existing continuous-state Gaussian diffusion as well as other approaches to discrete diffusion, and identify the corresponding reverse-time stochastic process and score function in the continuous-time setting, and the reverse-time mapping in the discrete-time setting. As an example of this framework, we introduce “Blackout Diffusion”, which learns to produce samples from an empty image instead of from noise. Numerical experiments on the CIFAR-10, Binarized MNIST, and CelebA datasets confirm the feasibility of our approach. Generalizing from specific (Gaussian) forward processes to discrete-state processes without a variational approximation sheds light on how to interpret diffusion models, which we discuss.

Santos, Javier E.↗

DOE OSTI2015

MO-B-BRD-02: 3D Printing in the Clinic

This session is designed so that the learning objectives are practical. The intent is that the attendee may take home an understanding of not just the technology, but also the logistical steps necessary to execute these 3D printing techniques in the clinic. Four practical 3D printing topics will be discussed: (i) Creating bolus and compensators for photon machines; (ii) tools for proton therapy; (iii) clinical applications in imaging; (iv) custom phantom design for clinic and research use. The use of 3D printers within the radiation oncology setting is proving to be a useful tool for creating patient specific bolus and compensators with the added benefit of cost savings. Creating the proper protocol is essential to ensuring that the desired effect is achieved and modeled in the treatment planning system. The critical choice of printer material (since it determines the interaction with the radiation) will be discussed. Selection of 3D printer type, design methods, verification of dose calculation, and the printing process will be detailed to give the basis for establishing your own protocol for electron and photon fields. A practical discussion of likely obstacles that may be encountered will be included. The diversity of systems and techniques in proton facilities leads to different facilities having very different requirements for beam modifying hardware and quality assurance devices. Many departments find the need to design and fabricate facility-specific equipment, making 3D printing an attractive technology. 3D printer applications in proton therapy will be discussed, including beam filters and compensators, and the design of proton therapy specific quality assurance tools. Quality control specific to 3D printing in proton therapy will be addressed. Advantages and disadvantages of different printing technology for these applications will also be discussed. 3D printing applications using high-resolution radiology-based imaging data will be presented. This data is used to 3D print individualized physical models of patient’s unique anatomy for aid in planning complex and challenging surgical procedures. Methods, techniques and imaging requirements for 3D printing anatomic models from imaging data will be discussed. Specific applications currently being used in the radiology clinic will be detailed. Standardized phantoms for radiation therapy are abundant. However, custom phantom designs can be advantageous for both clinical tasks and research. 3D printing is a useful method of custom fabrication that allows one to construct custom objects relatively quickly. Possibilities for custom radiotherapy phantoms range from 3D printing a hollow shell and filling the shell with tissue equivalent materials to fully printing the entire phantom with materials that are tissue equivalent as well as suitable for 3D printing. A range of materials available for use in radiotherapy phantoms and in the case of phantoms for dosimetric measurements, this choice is critical. The necessary steps required will be discussed including: modalities of 3D model generation, 3D model requirements for 3D printing, generation of machine instructions from the 3D model, and 3D printing techniques, choice of phantoms material, and troubleshooting techniques for each step in the process. Case examples of 3D printed phantoms will be shown. Learning Objectives: Understand the types of 3D modeling software required to design your device, the file formats required for data transfer from design software to 3D printer, and general troubleshooting techniques for each step of the process. Learn the differences between materials and design for photons vs. electrons vs. protons. Understand the importance of material choice and design geometries for your custom phantoms. Learn specific steps of quality assurance and quality control for 3D printed beam filters and compensators for proton therapy. Learn of special 3D printing applications for imaging. Cunha: Research support from Phillips Healthcare.

60 APPLIED LIFE SCIENCES↗

DOE OSTI2015

MO-B-BRD-03: Principles, Pitfalls and Techniques of 3D Printing for Bolus and Compensators

This session is designed so that the learning objectives are practical. The intent is that the attendee may take home an understanding of not just the technology, but also the logistical steps necessary to execute these 3D printing techniques in the clinic. Four practical 3D printing topics will be discussed: (i) Creating bolus and compensators for photon machines; (ii) tools for proton therapy; (iii) clinical applications in imaging; (iv) custom phantom design for clinic and research use. The use of 3D printers within the radiation oncology setting is proving to be a useful tool for creating patient specific bolus and compensators with the added benefit of cost savings. Creating the proper protocol is essential to ensuring that the desired effect is achieved and modeled in the treatment planning system. The critical choice of printer material (since it determines the interaction with the radiation) will be discussed. Selection of 3D printer type, design methods, verification of dose calculation, and the printing process will be detailed to give the basis for establishing your own protocol for electron and photon fields. A practical discussion of likely obstacles that may be encountered will be included. The diversity of systems and techniques in proton facilities leads to different facilities having very different requirements for beam modifying hardware and quality assurance devices. Many departments find the need to design and fabricate facility-specific equipment, making 3D printing an attractive technology. 3D printer applications in proton therapy will be discussed, including beam filters and compensators, and the design of proton therapy specific quality assurance tools. Quality control specific to 3D printing in proton therapy will be addressed. Advantages and disadvantages of different printing technology for these applications will also be discussed. 3D printing applications using high-resolution radiology-based imaging data will be presented. This data is used to 3D print individualized physical models of patient’s unique anatomy for aid in planning complex and challenging surgical procedures. Methods, techniques and imaging requirements for 3D printing anatomic models from imaging data will be discussed. Specific applications currently being used in the radiology clinic will be detailed. Standardized phantoms for radiation therapy are abundant. However, custom phantom designs can be advantageous for both clinical tasks and research. 3D printing is a useful method of custom fabrication that allows one to construct custom objects relatively quickly. Possibilities for custom radiotherapy phantoms range from 3D printing a hollow shell and filling the shell with tissue equivalent materials to fully printing the entire phantom with materials that are tissue equivalent as well as suitable for 3D printing. A range of materials available for use in radiotherapy phantoms and in the case of phantoms for dosimetric measurements, this choice is critical. The necessary steps required will be discussed including: modalities of 3D model generation, 3D model requirements for 3D printing, generation of machine instructions from the 3D model, and 3D printing techniques, choice of phantoms material, and troubleshooting techniques for each step in the process. Case examples of 3D printed phantoms will be shown. Learning Objectives: Understand the types of 3D modeling software required to design your device, the file formats required for data transfer from design software to 3D printer, and general troubleshooting techniques for each step of the process. Learn the differences between materials and design for photons vs. electrons vs. protons. Understand the importance of material choice and design geometries for your custom phantoms. Learn specific steps of quality assurance and quality control for 3D printed beam filters and compensators for proton therapy. Learn of special 3D printing applications for imaging. Cunha: Research support from Phillips Healthcare.

60 APPLIED LIFE SCIENCES↗

DOE OSTI2015

MO-B-BRD-04: Sterilization for 3D Printed Brachytherapy Applicators

This session is designed so that the learning objectives are practical. The intent is that the attendee may take home an understanding of not just the technology, but also the logistical steps necessary to execute these 3D printing techniques in the clinic. Four practical 3D printing topics will be discussed: (i) Creating bolus and compensators for photon machines; (ii) tools for proton therapy; (iii) clinical applications in imaging; (iv) custom phantom design for clinic and research use. The use of 3D printers within the radiation oncology setting is proving to be a useful tool for creating patient specific bolus and compensators with the added benefit of cost savings. Creating the proper protocol is essential to ensuring that the desired effect is achieved and modeled in the treatment planning system. The critical choice of printer material (since it determines the interaction with the radiation) will be discussed. Selection of 3D printer type, design methods, verification of dose calculation, and the printing process will be detailed to give the basis for establishing your own protocol for electron and photon fields. A practical discussion of likely obstacles that may be encountered will be included. The diversity of systems and techniques in proton facilities leads to different facilities having very different requirements for beam modifying hardware and quality assurance devices. Many departments find the need to design and fabricate facility-specific equipment, making 3D printing an attractive technology. 3D printer applications in proton therapy will be discussed, including beam filters and compensators, and the design of proton therapy specific quality assurance tools. Quality control specific to 3D printing in proton therapy will be addressed. Advantages and disadvantages of different printing technology for these applications will also be discussed. 3D printing applications using high-resolution radiology-based imaging data will be presented. This data is used to 3D print individualized physical models of patient’s unique anatomy for aid in planning complex and challenging surgical procedures. Methods, techniques and imaging requirements for 3D printing anatomic models from imaging data will be discussed. Specific applications currently being used in the radiology clinic will be detailed. Standardized phantoms for radiation therapy are abundant. However, custom phantom designs can be advantageous for both clinical tasks and research. 3D printing is a useful method of custom fabrication that allows one to construct custom objects relatively quickly. Possibilities for custom radiotherapy phantoms range from 3D printing a hollow shell and filling the shell with tissue equivalent materials to fully printing the entire phantom with materials that are tissue equivalent as well as suitable for 3D printing. A range of materials available for use in radiotherapy phantoms and in the case of phantoms for dosimetric measurements, this choice is critical. The necessary steps required will be discussed including: modalities of 3D model generation, 3D model requirements for 3D printing, generation of machine instructions from the 3D model, and 3D printing techniques, choice of phantoms material, and troubleshooting techniques for each step in the process. Case examples of 3D printed phantoms will be shown. Learning Objectives: Understand the types of 3D modeling software required to design your device, the file formats required for data transfer from design software to 3D printer, and general troubleshooting techniques for each step of the process. Learn the differences between materials and design for photons vs. electrons vs. protons. Understand the importance of material choice and design geometries for your custom phantoms. Learn specific steps of quality assurance and quality control for 3D printed beam filters and compensators for proton therapy. Learn of special 3D printing applications for imaging. Cunha: Research support from Phillips Healthcare.

60 APPLIED LIFE SCIENCES↗

DOE OSTI2015

MO-B-BRD-00: Clinical Applications of 3D Printing

This session is designed so that the learning objectives are practical. The intent is that the attendee may take home an understanding of not just the technology, but also the logistical steps necessary to execute these 3D printing techniques in the clinic. Four practical 3D printing topics will be discussed: (i) Creating bolus and compensators for photon machines; (ii) tools for proton therapy; (iii) clinical applications in imaging; (iv) custom phantom design for clinic and research use. The use of 3D printers within the radiation oncology setting is proving to be a useful tool for creating patient specific bolus and compensators with the added benefit of cost savings. Creating the proper protocol is essential to ensuring that the desired effect is achieved and modeled in the treatment planning system. The critical choice of printer material (since it determines the interaction with the radiation) will be discussed. Selection of 3D printer type, design methods, verification of dose calculation, and the printing process will be detailed to give the basis for establishing your own protocol for electron and photon fields. A practical discussion of likely obstacles that may be encountered will be included. The diversity of systems and techniques in proton facilities leads to different facilities having very different requirements for beam modifying hardware and quality assurance devices. Many departments find the need to design and fabricate facility-specific equipment, making 3D printing an attractive technology. 3D printer applications in proton therapy will be discussed, including beam filters and compensators, and the design of proton therapy specific quality assurance tools. Quality control specific to 3D printing in proton therapy will be addressed. Advantages and disadvantages of different printing technology for these applications will also be discussed. 3D printing applications using high-resolution radiology-based imaging data will be presented. This data is used to 3D print individualized physical models of patient’s unique anatomy for aid in planning complex and challenging surgical procedures. Methods, techniques and imaging requirements for 3D printing anatomic models from imaging data will be discussed. Specific applications currently being used in the radiology clinic will be detailed. Standardized phantoms for radiation therapy are abundant. However, custom phantom designs can be advantageous for both clinical tasks and research. 3D printing is a useful method of custom fabrication that allows one to construct custom objects relatively quickly. Possibilities for custom radiotherapy phantoms range from 3D printing a hollow shell and filling the shell with tissue equivalent materials to fully printing the entire phantom with materials that are tissue equivalent as well as suitable for 3D printing. A range of materials available for use in radiotherapy phantoms and in the case of phantoms for dosimetric measurements, this choice is critical. The necessary steps required will be discussed including: modalities of 3D model generation, 3D model requirements for 3D printing, generation of machine instructions from the 3D model, and 3D printing techniques, choice of phantoms material, and troubleshooting techniques for each step in the process. Case examples of 3D printed phantoms will be shown. Learning Objectives: Understand the types of 3D modeling software required to design your device, the file formats required for data transfer from design software to 3D printer, and general troubleshooting techniques for each step of the process. Learn the differences between materials and design for photons vs. electrons vs. protons. Understand the importance of material choice and design geometries for your custom phantoms. Learn specific steps of quality assurance and quality control for 3D printed beam filters and compensators for proton therapy. Learn of special 3D printing applications for imaging. Cunha: Research support from Phillips Healthcare.

60 APPLIED LIFE SCIENCES↗