Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “SCORE”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,045 records · Page 58

CrossCheck: Rapid, Reproducible, and Interpretable Model Evaluation

Evaluation beyond aggregate performance metrics, e.g. F1-score, is crucial to both establish an appropriate level of trust in machine learning models and identify future model improvements. In this paper we demonstrate CrossCheck, an interactive visualization tool for rapid crossmodel comparison and reproducible error analysis. We describe the tool and discuss design and implementation details. We then present three use cases (named entity recognition, reading comprehension, and clickbait detection) that show the benefits of using the tool for model evaluation. CrossCheck allows data scientists to make informed decisions to choose between multiple models, identify when the models are correct and for which examples, investigate whether the models are making the same mistakes as humans, evaluate models’ generalizability and highlight models’ limitations, strengths and weaknesses. Furthermore, CrossCheck is implemented as a Jupyter widget, which allows rapid and convenient integration into data scientists’ model development workflows.

Arendt, Dustin L.↗

Leveraging Community and Author Context to Explain the Performance and Bias of Text-Based Deception Detection Models

Deceptive news posts shared in online communities can be detected with NLP models, and much recent research has focused on the development of such models. In this work, we use characteristics of online communities and authors --- the context of how and where content is posted --- to explain the performance of a neural network deception detection model and identify sub-populations who are disproportionately affected by model accuracy or failure. We examine who is posting the content, and where the content is posted to. We find that while author characteristics are better predictors of deceptive content than community characteristics, both characteristics are strongly correlated with model performance. Traditional performance metrics such as F1 score may fail to capture poor model performance on isolated sub-populations such as specific authors, and as such, more nuanced evaluation of deception detection models is critical.

machine learning (ML), machine learning explanatio↗

From Bricks to Clicks: Mapping the White Space in Building Innovation

It is a critical national imperative to transform the buildings sector, yet innovation is impeded by deployment failures that leave promising technologies stranded. Conventional market reports and techno-economic analysis provide an insufficient understanding of markets and resource allocation for emerging building technologies. They omit crucial commercialization factors such as ecosystem maturity and adoption friction, where the coordinated participation of a network of suppliers, contractors, financiers, regulators, and integrators is required to scale solutions. This study addresses these gaps by introducing an evaluation framework grounded in front-line data from six years of the DOE's IMPEL incubator, comprising experience from 300 building-sector innovators and the adjacent, complex ecosystem. Our methodology synthesizes top-down market analysis with bottom-up, practitioner-level data across five megatrends: (M1) Affordable materials and industrialized construction; (M2) Healthy and efficient mechanical systems; (M3) Intelligent building operations; (M4) Buildings as grid assets; and (M5) High-density power and cooling for data centers and therein identify twelve "white space" technology opportunities. Next, we develop a multi-criteria scoring rubric to rank these opportunities based on parameters, i.e., Affordability, Quality of Life, Reliability, and Security, yielding composite ‘Demand’ and ‘Maturity’ indices. Our results indicate that the most significant white spaces may not be incremental products but a new class of ‘Ecosystem Enablers’, such as logistics platforms, orchestration layers, and automated compliance software that solve structural deployment gaps. This paper summarizes this transparent, evidence-based, practitioner-informed evaluation framework for policymakers and investors to re-evaluate policy and resource allocation and unlock scalable market transformation.

Singh, Reshma↗

A Comparative Study of Deep Learning Models for Fracture and Pore Space Segmentation in Synthetic Fractured Digital Rocks

This study focuses on the comparative study of deep learning (DL) models for pore space and discrete fracture networks (DFNs) segmentation in synthetic fractured digital rocks, specifically targeting low-permeability rock formations, such as shale and tight sandstones. Accurate characterization of pore space and DFNs is critical for subsequent property analysis and fluid flow modeling. Four DL models, SegNet, U-Net, U-Net-wide, and nested U-Net (i.e., U-Net++), were trained, validated, and tested using synthetic datasets, including input and label image pairs with varying properties. The model performance was assessed regarding pixel-wise metrics, including the F1 score and pixel-wise difference maps. In addition, the physics-based metrics were considered for further analysis, including sample porosity and absolute permeability. Particularly, We first simulated the permeability of porous media containing only pore space and then simulated the permeability of porous media with DFNs added. The difference between these two values is used to quantify the connectivity of segmented DFNs, which is an important parameter for low-permeability rocks. The pixel-wise metrics showed that the nested U-Net model outperformed the rest of the DL models in pore space and DFNs segmentation, with the SegNet model exhibiting the second-best performance. Particularly, nested U-Net enhanced segmentation accuracy for challenging boundary pixels affected by partial volume effects. The U-Net-wide model achieved improved accuracy compared to the U-Net model, which indicated the influence of parameter numbers. Similarly, nested U-Net has the closest match to the ground truth of physics-based metrics, including the porosity of pore space and DFNs, and the permeability difference quantifying the connectivity of DFNs. The findings highlight the effectiveness of DL models, especially the U-Net++ model with nested architecture and redesigned skip connections, in accurately segmenting pore spaces and DFNs, which are crucial for pore-scale fluid flow and transport simulation in low-permeability rocks.

Wang, Hongsheng↗

Failure Analysis–Informed Risk Assessment Framework for Geological Carbon Storage Using Numerical Simulation and Machine Learning

Geological carbon storage (GCS) is recognized as a critical technology for achieving large-scale reductions in anthropogenic carbon dioxide (CO 2 ) emissions. Ensuring long-term containment and safety requires robust risk assessment frameworks that account for geological uncertainty and identify potential failure scenarios. Among various indicators, the area of review (AoR) serves as a key metric for evaluating storage performance, regulatory compliance, and monitoring design, as it delineates the spatial extent impacted by pressure buildup and plume migration. However, conventional AoR-based risk assessments typically perturb parameters within narrow uncertainty bounds, potentially overlooking rare but high-impact events arising from extreme geological conditions. In this study, we present a failure analysis–informed risk assessment framework for large-scale GCS projects to improve site prescreening and monitoring design. A suite of 300 numerical simulations was generated using stochastic geological models that vary five key parameters: net-to-gross ratio, anisotropy azimuth, porosity multiplier, permeability multiplier, and vertical-to-horizontal permeability ratio. Among these, 200 realizations represent normal geological uncertainty, while 100 additional cases explore extreme yet plausible conditions for failure-case analysis. The AoR was simulated and computed from pressure and CO 2 saturation fields, where the baseline AoR boundary, representing the extent predicted under typical geological uncertainty, was defined as the union of 200 normal-range simulations, and failure was identified when extreme-range cases exceeded this baseline. Results show that incorporating broader parameter uncertainty produces significantly larger AoR extents, underscoring the potential underestimation of risk under conventional uncertainty ranges. Furthermore, spatial probability maps derived from failure-induced AoR exceedance identify regions requiring enhanced monitoring attention. Various machine learning (ML)–based classifiers were developed to predict failure occurrence from geological parameters, with the random forest model achieving the highest performance (F1-score of 0.986). Consistent findings from correlation coefficient, feature importance, and Sobol sensitivity analyses reveal that low net-to-gross ratios and permeability multipliers are the dominant risk drivers, reflecting reduced reservoir connectivity and limited pressure dissipation. Altogether, these results provide a novel framework for risk-informed site prescreening and monitoring design that explicitly considers rare but high-impact geological scenarios in GCS projects.

25 ENERGY STORAGE↗

High-dimensional and permutation invariant anomaly detection

Methods for anomaly detection of new physics processes are often limited to low-dimensional spaces due to the difficulty of learning high-dimensional probability densities. Particularly at the constituent level, incorporating desirable properties such as permutation invariance and variable-length inputs becomes difficult within popular density estimation methods. In this work, we introduce a permutation-invariant density estimator for particle physics data based on diffusion models, specifically designed to handle variable-length inputs. We demonstrate the efficacy of our methodology by utilizing the learned density as a permutation-invariant anomaly detection score, effectively identifying jets with low likelihood under the background-only hypothesis. To validate our density estimation method, we investigate the ratio of learned densities and compare to those obtained by a supervised classification algorithm.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Description of the LASSO Data Bundles Product

The U. S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) user facility began a pilot project in May 2015 to design a routine, high-resolution modeling capability to complement ARM’s extensive suite of measurements. This modeling capability has evolved into the Large-Eddy Simulation (LES) ARM Symbiotic Simulation and Observation (LASSO) datastream. The datastream, broadly termed data bundles, contains high-resolution model output, input files, observations for evaluation, and skill scores for the simulations. The initial focus of LASSO is on shallow convection at the ARM Southern Great Plains (SGP) atmospheric observatory. The availability of LES simulations with concurrent observations serves many purposes. LES helps bridge the scale gap between DOE ARM observations and models, and the use of routine LES adds value to observations. It provides a self-consistent representation of the atmosphere and a dynamical context for the observations. Further, it elucidates unobservable processes and properties. LASSO generates a simulation library for researchers that enables statistical approaches beyond a single-case mentality. It also provides tools necessary for modelers to reproduce the LES and conduct their own sensitivity experiments. The LASSO library of data bundles is designed to facilitate a wide range of research. For an observationalist, LASSO can help inform instrument remote-sensing retrievals, conduct observation system simulation experiments (OSSEs), and test implications of radar scan strategies or flight paths. For a theoretician, LASSO can help calculate estimates of fluxes and co-variability of values, and test relationships without having to run the model personally. For a modeler, LASSO can help one know ahead of time which days have good forcing, have co-registered observations at high-resolution scales, and have simulation inputs and corresponding outputs to test parameterizations. Further details on the overall LASSO project are available at https://www.arm.gov/capabilities/modeling/lasso.

54 ENVIRONMENTAL SCIENCES↗

Influence Metrics for Value and Utility Functions

Methods are proposed to measure the sensitivity of utility or value function to the variations of attribute values for Multi-Criteria Decision Analyses that are based on functions that cannot be expressed as a weighted sum of the attribute values. These measures, called factor Influence Metrics, can be used to examine the characteristics of the option scoring algorithm and help verify the algorithm is consistent with decision makers value structure and processes.

97 MATHEMATICS AND COMPUTING↗

Modeling Simulation and Optimization of a Pressure Relief Feature in a Hermetically Sealed Volume Exposed to Abnormal Thermal Environments

This project investigates the behavior of a venting feature on a hermetically sealed volume under abnormal thermal environments. A pressure profile is used to simulate internal pressure build up due to thermal decomposition of foam caused by temperatures approaching 800K. For the purposes of his scoping study a small can composed of 304L stainless steel is used to emulate the problem at hand and simplify the model. The venting feature can be described as an elliptical thinned area with X-like scoring marks on the circumferential surface of the can where the highest stresses are located without the feature. The feature variables include elliptical size, depth, and quantity to optimize the venting feature geometry to vent at a desired pressure range. Cubit, SIERRA: Solid Mechanics, and Ensight modeling programs are used to simulate and analyze several iterations of this feature to determine the most optimal geometry. The model indicates through the simulations that the feature does in fact vent in a predictable manner and can be used in a variety of pressure vessel applications where uncontrolled over pressurizations are undesirable. Future work includes model validation tests, looking at different geometries, and using a more accurate failure criterion.

42 ENGINEERING↗

Estimating Regional Methane Emissions Through Atmospheric Measurements and Inverse Modeling

In this report we describe an enhanced methodology for performing stochastic Bayesian inversions of atmospheric trace gas inversions that allows the time variation of model parameters to be inferred. We use measurements of methane atmospheric mixing ratio made in Livermore, California along with atmospheric transport modeling and published prior estimates of emissions to estimate the regional emissions of methane and the temporal variations in inferred bias parameters. We compute Bayesian model evidence and continuous rank probability score to optimize the model with respect to temporal resolution. Using two different emissions inventories, we perform inversions for a series of models with increasing temporal resolution in the model bias representation. We show that temporal variation in the model bias can improve the model fit and can also increase the likelihood that the parameterization is appropriate, as measured by the Bayesian model evidence.

54 ENVIRONMENTAL SCIENCES↗

Energy Resilience Assessment Methodology

With increasing utility grid outages in the United States, there is growing interest in assessing risk and developing mitigations to reduce the impact of grid outages and other power disruptions. The U.S. Department of Energy's National Renewable Energy Laboratory worked with military bases and stakeholders in their local community to develop a replicable energy resilience assessment methodology for sites, bases, and campuses to assess energy risks and develop prioritized solutions to increase site resilience. This includes steps to assess the baseline resilience of the site, identify and score hazards and vulnerabilities, analyze risks based on hazard likelihood and vulnerability probability and consequence, identify and prioritize mitigation actions based on cost, difficulty, and risk reduction, and then develop an action plan and implement solutions. The method focuses on risks to a site's primary missions, infrastructure, and population, as well as risks to infrastructure and population in the surrounding community that may impact the site.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Jiangsu Nanjing – Lawrence Berkeley Life Sciences Center for Translational Medicine (CRADA AWD00000392)

Project 1: Our previous work demonstrated that the CES biomarker can be an approximate measure for the levels of chromosomal instability (CIN) in cancer, and that the CES (for Centromere and kinetochore gene Expression Score) biomarker effectively predicts which cancer patients benefit from adjuvant chemotherapies in lung and other cancer types. Such a utility can potentially reduce overtreatment that is common in lung cancer treatment. We determined performance of the multiplex Quantigene RNA assay platform for measuring mRNA levels of CES genes using clinical tumor samples. These experiments determined sensitivity, specificity and detection limit of 12 CES genes and 5 control genes using clinical tumor samples with paired normal tissue samples. We determined how sample concentration and storage conditions affect measurement sensitivity and specificity, and whether sample storage over time affects result reproducibility. Importantly, we confirmed that early stage lung cancer CES values are significantly higher than those of paired normal tissues in all cases. This result greatly extended our bioinformatic data mining by confirming that we can measure CES values directly from patient tumor tissue, and that tumors have higher CES values than normal tissues. Unfortunately, our CRADA partner in China did not finish measuring CES expression levels for a larger group of ~100 tumor samples, due to the long period time required for human subject review in China. This delay prevented us from generating enough additional data to generate a significant statistical model. We finished analyzing all the data acquired during the CRADA, and are trying to work collaboratively with the Shanghai University Lung Cancer Hospital to complete the analysis of more tumor samples. Although no publications have resulted from this research, the findings are crucial for ongoing efforts to obtain funding to develop the technology to address problems in deciding on appropriate treatment regimens for individual patients, in clinical settings. Project 2: The overarching milestones of CRADA Project 2 were to investigate the role of FAM83 family members in cancer progression. Two publications resulted from this work which are highlighted below. The first major goal of the CRADA was to broadly assess the role of FAM83 family oncogenes in human cancer using a multi-omic bioinformatic approach (Snijders et al 2017 Mol. Oncol 11). The second major goal was to specifically assess the role of FAM83D in a cancer progression and metastasis (Yin et al 2019 Cell Oncol; in revision). Role of FAM83 family oncogenes in human cancers Recent studies from our laboratory as well as other groups have demonstrated that FAM83 family members have oncogenic properties and have significantly elevated expression levels in multiple human tumor types, including breast cancers (BC). We performed an integrative multi-omics bio-informatic analysis of the role of FAM83 family oncogenes in human cancers. Our findings were published in the journal Molecular Oncology (Snijders et al; Mol Oncol. 2017 Feb;11(2):167-179). Highlights from this manuscript are: • Transcriptional levels of FAM83 family members are frequently and dramatically elevated across tumor types in human • DNA copy number increase appears to be a potential mechanism for increased expression of FAM83 genes • FAM83 family gene signature is associated with poor survival across human tumor types • FAM83 gene alterations are significantly correlated with TP53, PIK3CA and Ecadherin mutations. In conclusion, this analysis of FAM83 family members opened up a new horizon for further understanding the significance of FAM83 genes in cancer and clinical applications in diagnosis, prognosis and therapy. Role of FAM83D in human non-small cell lung cancer (NSCLC) metastasis and its impact on chemotherapy. Lung cancer is one of the most common malignant tumors in the world and non-small cell lung cancer (NSCLC) accounts for 80~85% of all diagnosed lung cancer cases, one of the deadliest cancers worldwide. FAM83D has been proposed as an oncoprotein in several types of human cancer, yet its role and molecular mechanism in human non-small cell lung cancer (NSCLC) metastasis and its impact on chemotherapy are poorly understood. We evaluated the expression of FAM83D in NSCLC cells and cancerous tissues and its prognostic significance, then investigated the effect of FAM83D on tumorigenic phenotypes such as cell proliferation, EMT and invasive capability, and finally assessed impact of FAM83D on NSCLC chemo-drug resistance. The results of this study are currently in revision at the journal Cellular Oncology. Highlights from this manuscript are: • FAM83D expression is elevated in NSCLC cells and tissues and associated with poor prognosis • FAM83D promotes NSCLC cell proliferation • FAM83D induces EMT in NSCLC cells • FAM83D promotes NSCLC cell migration and invasion • FAM83D promotes EMT and invasive capability of NSCLC cells by regulating AKT/mTOR pathway • FAM83D silencing increases cisplatin sensitivity of NSCLC cells In summary, this second study demonstrated for the first time that FAM83D promoted EMT and metastasis of NSCLC cells through AKT/mTOR signal pathway as well as increased the sensitivity of NSCLC to cisplatin. This study may provide potential targets for advanced NSCLC treatment and personalized therapy.

59 BASIC BIOLOGICAL SCIENCES↗

Inventory and Probabilistic Function of Natural Hazards in the United States: July 19, 2018 - September 18, 2018

The U.S. Department of Energy's National Renewable Energy Laboratory (NREL) developed a standardized risk assessment process that considers the location-specific vulnerabilities and threats (climate-related as well as human-caused) at a site to generate a ranked list of organizational risks and associated mitigation options for reducing those risks. To support this effort, the Southern Climate Impacts Planning Program (SCIPP), a National Oceanic and Atmospheric (NOAA) Regional Integrated Sciences and Assessments (RISA) team, was selected to provide climate science expertise to develop a comprehensive inventory and probabilistic function of natural hazards (e.g., hurricanes, tornadoes, flooding, and sea level rise) for the entire United States by region. The inventory of climate-related hazards and the associated likelihood scores are incorporated into a companion risk assessment tool enabling standardized comparisons of risk at sites across the country.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

North Dakota Integrated Carbon Storage Complex Feasibility Study. Final report

In spring 2017, the Energy & Environmental Research Center (EERC) initiated an effort to determine the feasibility of developing a commercial-scale CO 2 geologic storage complex able to store 50+ million tonnes (Mt) of CO 2 in central North Dakota safely, permanently, and economically. The objective was to fulfill the goals of the U.S. Department of Energy (DOE) Carbon Storage Assurance Facility Enterprise (CarbonSAFE) Initiative and address technical and nontechnical challenges specific to commercial-scale deployment of a CO2 storage project. The findings clearly show that the concept of capturing CO 2 from a lignite-fired electrical generation facility in central North Dakota and safely and permanently storing the CO 2 in the deep subsurface is indeed technically, economically, and socially feasible. This project evaluated two study areas and their respective geologic storage complexes located adjacent to separate coal-fired facilities in North Dakota: the Basin Electric Power Cooperative (BEPC)-owned Great Plains Synfuels Plant (GPSP) and the Minnkota Power Cooperative (Minnkota)-owned Milton R. Young Station (MRYS). These locations, one with CO 2 capture in place and an existing CO 2 pipeline, are bolstered by progressive North Dakota pore space ownership and long-term liability laws. These elements and a motivated team created an ideal synergistic scenario for ensuring success of the CarbonSAFE Initiative and promoting North Dakota’s statewide vision for carbon management. The project included drilling two new geologic characterization wells, integrating an existing 3-D seismic survey, creating a geologic model subsequently used for injection simulation, a risk assessment, public outreach, and generating a site development plan based on results. In addition, the performance of select National Risk Assessment Partnership tools was evaluated. The geologic characterization wells were drilled ~5600 feet deep to the Broom Creek Formation; ~350 feet of core was retrieved from each well. The core included the Broom Creek (targeted injection zone) and a portion of the overlying Opeche Shale (seal). The Flemmer-1 well, west of Beulah, North Dakota, yielded 169 feet of sandstone. The BNI-1 well located south of Center, North Dakota, yielded 124 feet of sandstone. In each case, laboratory analysis of the sandstone showed permeability in the 300–1000-mD range, with porosity of 20%–30%. The Flemmer-1 well was sited within the boundaries of an existing 3-D seismic survey. Colocating the well with the seismic survey maximized the relationship between new and legacy data and developed a first-of-its-kind interpretation of the geologic fabric of the Broom Creek. Geologic characterization data were integrated into a 5544-mi 2 geocellular model that encompassed both new wells and stratigraphy from the surface to the Amsden Formation (underlying the Broom Creek). The model was later expanded vertically to include the deeper Black Island–Deadwood interval to examine its potential viability as a storage target. The geocellular model provided the foundation for dynamic simulation of CO 2 into the Broom Creek. Results of the simulation suggest that the Broom Creek could accept the DOE target rate of 2 Mt/yr of CO 2 into as few as two wells. To bracket the expected capture from MRYS, simulations were also investigated for a 4-Mt/yr rate near MRYS. Although more wells are needed (two additional), the Broom Creek still has the storage resource to accept the CO 2 at the increased rate. A risk assessment exercise was conducted to identify and assess technical and nontechnical risks that could prevent potential candidate storage complexes within the study area from serving as commercial storage sites. The assessment identified and evaluated six technical risk categories: 1) CO 2 injectivity, 2) storage capacity, 3) lateral migration of CO 2 , 4) lateral pressure propagation, 5) vertical migration of CO 2 or formation brine, and 6) induced seismicity. Following two rounds of analysis and scoring, no risks were determined to preclude continued efforts to develop carbon capture, utilization, and storage (CCUS) in central North Dakota. The risk assessment results will be used to guide future site characterization, modeling and simulation, and monitoring activities. A specific nontechnical strategic risk based on challenges that may be realized in amalgamation of pore space resulted in vertically expanding the geologic model to incorporate the potential for stacked storage in multiple saline reservoirs. By including the Black Island–Deadwood interval (the basal sedimentary reservoir in this region), the amalgamated areal extent could be reduced by as much as 45%. Working with a smaller geographic area reduces risks and costs associated with monitoring and pore space leasing. An economic evaluation incorporating capture; transport (<5 mi); Class VI wells; permitting; and monitoring, verification, and accounting suggests implementing commercial-scale CCUS is economically attractive if the federal tax benefits of 45Q are included. This is validated by Minnkota’s continued pursuit of CO 2 capture and geologic storage at MRYS through its Project Tundra initiative, indicating that there is a business case for CCUS in central North Dakota. Currently, North Dakota is the only state with underground injection control (UIC) Class VI primacy. Built into the North Dakota Century Code is a series of regulatory requirements that guide the process to obtain a Class VI CO 2 storage facility permit. As part of this project, a site development plan was compiled to assure compliance with North Dakota’s requirements to permit a commercial-scale CO 2 storage operation and includes a prospective time line encompassing a general breakdown of activities. In total, an estimated 30 months would be needed to execute the necessary steps to attain a North Dakota CO 2 storage facility permit. Outreach was an integral part of the project and encompassed any project-related activity that had contact or exposure beyond the project team. The goals of outreach were to foster an environment from which stakeholders could make informed decisions about the project and gauge community receptiveness to a CCUS project. A consistent set of messages and outreach products were developed in conjunction with an outreach advisory board that integrated project partners and team members. To gauge public acceptability of geologically storing CO 2 , 5611 households in the project area were invited to participate in an online survey. The survey results indicate that the public attitude regarding CCUS is neutral to positive, with strong sentiment that CO 2 capture and storage may be an approach to maintain the economic vitality of the region. To achieve project objectives, critical support in the form of financial backing, engineering evaluations, site access, outreach collaboration, operations data, risk assessment/evaluation, and software access was provided by BEPC, the North Dakota Industrial Commission Lignite Research Council, ALLETE Clean Energy, BNI Energy, North American Coal Corporation, Minnkota, Prairie Public Broadcasting, Computer Modelling Group Ltd., and Schlumberger.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Multimodal Data Fusion via Entropy Minimization

The use of gradient-based data-driven models to solve a range of real-world remote sensing problems can in practice be limited by the uniformity of available data. Use of data from disparate sensor types, resolutions, and qualities typically requires compromises based on assumptions that are made prior to model training and may not necessarily be optimal given over-arching objectives. For example, while deep neural networks (NNs) are state-of-the-art in a variety of target detection problems, training them typically requires either limiting the training data to a subset over which uniformity can be enforced or training independent models which subsequently require additional score fusion. The method we introduce here seeks to leverage the benefits of both approaches by allowing correlated inputs from different data sources to co-influence preferred model solutions, while maintaining flexibility over missing and mismatching data. In this work we propose a new data fusion technique for gradient updated models based on entropy minimization and experimentally validate it on a hyperspectral target detection dataset. We demonstrate superior performance compared to currently available techniques using a range of realistic data scenarios, where available data has limited spacial overlap and resolution.

97 MATHEMATICS AND COMPUTING↗

Optimization of Geometric Perturbations on a Rod Moving Through a High Explosive Target

After completing a study to ensure the simulation results were converged, several high resolution 3D Smoothed Particle Hydrodynamic (SPH) simulations of copper rods impacting a high explosive (LX14) target were performed. This was then formulated into an optimization problem: I wanted to find the optimum shape and location of a perturbation on the rod that would maximize its erosion after it left the target. The shape of the perturbation was modeled as a 2D Gaussian bump and parameterized by its location along the rod axis (z 0 ) and amplitude (A). The final mass of the coherent part of the rod as it leaves the target was used as a metric to represent the erosion of the rod, and the optimization was formulated to maximize this metric with respect to the aforementioned design variables. Due to the expensive nature of the high-fidelity 3D SPH simulations, a surrogate model needed to be chosen so that many function calls to the optimizer would be feasible. Thus, a strategic full factorial sampling plan was chosen to build a dataset, which consisted of 24 high-fidelity simulations. Two surrogate models, a third order polynomial regression model and a Gaussian Process Model, were analyzed using a 14%/86% test/train holdout technique. The root mean square and R2 score of the test set was used to determine the best model, and the third order polynomial regression model was chosen as the surrogate model. Finally, the Nelder-Mead Simplex and Basin-hopping optimization algorithms were implemented, and it was found that the two algorithms gave slightly different optimum values. Nelder-Mead gave an optimum point of [z* 0 ;A*] = [9:9;0:4] and Basin-Hopping gave an optimum value of x* = [z* 0 ;A*] = [9:2;0:1].

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

SIGNAL Game Manual

SIGNAL is a first of its kind experimental wargame developed as part of the Project on Nuclear Gaming (PoNG). In this document we describe the rules and game mechanics associated with the online version of SIGNAL created by team members from the University of California, Berkeley, Sandia National Laboratories, and Lawrence Livermore National Laboratory and sponsored by the Carnegie Corporation of New York. The game was developed as part of a larger research project to develop the experimental wargaming methodology and explore its use on a model scenario: the impact of various military capabilities on conflict escalation dynamics. We discuss the results of this research in a forthcoming paper that will include this manual as an appendix. It is our hope that this manual will both contribute to our players' understanding of the game prior to play and that it will allow for replication of the SIGNAL game environment for future research purposes. The manual begins by introducing the terminology used throughout the document. It then outlines the technical requirements required to run SIGNAL. The following section provides a description of the map, resources, infrastructure, tokens, and action cards used in the game environment. The manual then describes the user interface including the chat functions, trade mechanism, currency and population counts necessary for players to plan their actions. It then turns to the sequence of player actions in the game describing the signaling, action, and upkeep phases that comprise each round of play. It then outlines the use of diplomacy including alliances with minor states and trade between players. The manual also describes the process for scoring the game and determining the winner. The manual concludes with tips for players to remember as they embark upon playing the game.

97 MATHEMATICS AND COMPUTING↗