Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Analyst”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14

Guided Text Search Using Adaptive Visual Analytics (Final Report)

This research demonstrates the promise of augmenting interactive visualizations with semi- supervised machine learning techniques to improve the discovery of significant associations and insights in the search and analysis of textual information. More specifically, we have developed a system called Gryffin that hosts a unique collection of techniques that facilitate individualized investigative search pertaining to an ever-changing set of analytical questions over an indexed collection of open-source documents related to critical national infrastructure. The Gryffin client hosts dynamic displays of the search results via focus+context record listings, temporal timelines, term-frequency views, and multiple coordinate views. Furthermore, as the analyst interacts with the display, the interactions are recorded and used to label the search records. These labeled records are then used to drive semi-supervised machine learning algorithms that re-rank the unlabeled search records such that potentially relevant records are moved to the top of the record listing. Gryffin is described in the context of the daily tasks encountered at the US Department of Homeland Security s Fusion Center, with whom we are collaborating in its development. The resulting system is capable of addressing the analysts information overload that can be directly attributed to the deluge of information that must be addressed in the search and investigative analysis of textual information.

machine learning↗

Canopy 2.1 User Guide

Canopy is a visual analytic software suite, developed by researchers at the Pacific Northwest National Laboratory (PNNL), to support intelligence analysts’ ability to efficiently analyze massive amounts of multimedia data. Canopy incorporates state-of-the-art computer vision algorithms and interactive visualizations so that analysts can comprehend and articulate the big picture, thereby reducing their workload and ultimately the effort of identifying the critical intelligence for decision makers.

Canopy↗

Rainfall-driven Flooding Capability Development Report

Globally, floods are among the most frequent and costly natural disasters, both socially and economically. Many of these floods result from excess rainfall collecting in streams and rivers, then overtopping banks and flowing overland into urban environments, damaging critical infrastructure. In Fiscal Year 2012, the National Infrastructure Simulation and Analysis Center’s (NISAC) goal was to enhance its existing flood modeling and simulation capability to be able to estimate flooding from rainfall-runoff events. To accomplish this task, NISAC modified the existing flood modeling code-base using commodity high-performance computing hardware, making it more suitable for regional rainfall events. NISAC also implemented new modules within the existing flood code to account for hydrologic processes, such as spatially variable rainfall and infiltration. Analysts subjected the new hydrologic model to a verification and validation process, wherein analysts evaluated the model using a bench-scale experiment and watershed scale rainfall-runoff events. The bench-scale experiment indicated that the new hydrologic model is mass and momentum conserving and can adequately simulate runoff for depths of inches of water. The watershed scale simulations indicated that the hydrologic model is a good predictor of the discharge hydrograph when compared to observations if the input parameters, such as roughness and hydraulic conductivity, are adequately calibrated. The intended use of the hydrologic model is to estimate flood potential during extreme rainfall events. The accuracy of the predictions is largely dependent on the availability of accurate spatial data for soil and roughness parameters. In addition, each simulation should be accompanied with a calibration exercise, which requires historical rainfall and river discharge observations.

13 HYDRO ENERGY↗

Omen: identifying potential spear-phishing targets before the email is sent.

We present the results of a two year project focused on a common social engineering attack method called "spear phishing". In a spear phishing attack, the user receives an email with information specifically focused on the user. This email contains either a malware-laced attachment or a link to download the malware that has been disguised as a useful program. Spear phishing attacks have been one of the most effective avenues for attackers to gain initial entry into a target network. This project focused on a proactive approach to spear phishing. To create an effective, user-specific spear phishing email, the attacker must research the intended recipient. We believe that much of the information used by the attacker is provided by the target organization's own external website. Thus when researching potential targets, the attacker leaves signs of his research in the webserver's logs. We created tools and visualizations to improve cybersecurity analysts' abilities to quickly understand a visitor's visit patterns and interests. Given these suspicious visitors and log-parsing tools, analysts can more quickly identify truly suspicious visitors, search for potential spear-phishing targeted users, and improve security around those users before the spear phishing email is sent.

Wendt, Jeremy Daniel.↗

Q-value (MeV/fission) Determination for the Advanced Test Reactor

This report documents a step-by-step procedure that can be used to calculate a Q-value for the Advanced Test Reactor (ATR) at Idaho National Laboratory (INL). The Q-value calculation here is an estimate of the total energy released per fission event in the ATR driver fuel in units of MeV/fission and is recognized as a reactor-specific Q-value for the ATR. Such a Q-value is needed INL ATR reactor physicists to normalize calculated fluxes and reaction rates to measured ATR total core and lobe powers. The calculated ATR Q-value and the procedure used to calculate this value are presented in a detailed manner so as to establish a credible basis, such that this single Q-value can be used consistently among all ATR reactor physicists. A Q-value is essentially the summation of all the kinetic energy from all radiation components released from a single fission event that ends up as heat in the reactor coolant. Estimation of a Q-value for a given reactor can theoretically be very complex because it is dependent on several variables, which include (1) the materials in the reactor core, (2) the neutron energy spectrum, and (3) the mix of actinide isotopes that are being simultaneously fissioned. Since these three variables can potentially change over time or with reactor burnup, this potentially makes the Q-value a time-dependent quantity. However, for ATR, we will invoke some simplifying assumptions, based on the unique features of the ATR core and supported by neutronic calculations, which will reduce the complexity of the problem and lead to a single time-independent Q-value. Of the three variables, the materials in the core have the greatest impact on the ATR Q-value. Since the materials in the core are most important, an array of components (materials) have been carefully selected to compose a typical ATR core configuration. It should be noted that the step-by-step procedure here for calculating a reactor-specific Q-value can be applied to any nuclear reactor. In a more general procedure, if one needed to include time-dependent spectral and actinide composition changes as a function of burnup for a specific reactor, this procedure can still be used, but at discrete time steps throughout the burnup. The result will be a set of discrete Q-values as a function of burnup. However, here we will apply the procedure to the ATR, as an example, and obtain a single Q-value that is valid for the ATR reactor as a function of burnup. In the evaluated nuclear data file (ENDF), Q-values for specific actinides are known for a reasonably high degree of accuracy, especially the major uranium and plutonium isotopes. The isotopic Q-values are composed of the kinetic energy of the fission fragments and the energies of the various radiation components emitted from the fission event. One complication is the fact that some of these energy components are dependent on the incident neutron energy (EINC) that induces the fission event (neutron energy spectrum dependence). For ATR, we will estimate an average neutron energy based on the neutron energy flux weighted by the fission cross sections and use this average neutron energy value in the ENDF formulas. This neutron energy dependence is one of two dependencies that make the final ATR Q-value a reactor-specific value. The second dependency, and the most important variable for ATR, involves the materials in the core and the de-excitation radiations produced from neutron radiative capture radiation; radiation energy that becomes heat in the reactor coolant. This important dependency is discussed in detail below. The third dependency, or the mix of fissioning actinides as a function of ATR burnup, is ignored because the bulk of the fissions over a cycle are always due to U-235 in the high-enriched ATR core. In a fission event, the fission energy is partitioned between the fission fragments and the radiation components that include neutrons, gamma rays, and beta particles. The main variable that makes the calculated Q-value reactor-specific is the amount of radiative capture energy produced in the core due to prompt and delayed neutron capture in the reactor core materials and the subsequent release of nuclear binding energy in the form of de-excitation gamma radiation energy in the reactor core. This energy component, neutron radiative capture energy, is not in the ENDF, because it depends on the reactor and its core materials. The radiative capture gamma energy release can be significant, or approximately 3–12 MeV/fission depending on the materials in the reactor core (fuel materials, cladding, structural components, coolant, targets, reflector, etc.). For the ATR, the energy released from radiative capture gamma radiation is calculated to be near the middle of the 3–12 MeV range. This makes the radiative capture radiation component an important and significant contribution to the total ATR Q-value. The ATR has unique reactor features that will allow us to simplify the complex procedure for determining an ATR reactor-specific Q-value. For example, the ATR is a thermal reactor and contains high-enriched fuel (93.15 wt% U-235). Consequently, the bulk of the fissions in the ATR core from beginning-of-cycle (BOC) to end-of-cycle are from U-235. Even though U-238 makes up approximately 7% of the uranium atoms in the fuel, the number of fissions relative to U-235 is insignificant, since U-238 is fertile and ATR is a thermal reactor. The same is true for U-234 and U-236 (both fertile). The ATR’s high-enriched uranium fuel also inhibits the buildup of large quantities of plutonium isotopes. So, even though there is some buildup of U-236, Np-237, and Pu-239 in the ATR driver fuel, the impact or contribution of these isotopes fissions on the ATR Q-value is minor compared to U-235. Nonetheless, we will include fission contributions from all the major uranium isotopes (U-234, U-235, U-236, and U-238) in the determination of an average isotopic Q-value that is used in the ATR Q-value determination. Although the ATR Q-value calculated here is based on BOC conditions (fresh fuel with no higher order actinide buildup), it is believed that the ATR Q-value is relatively constant with burnup or during any given ATR power cycle (14–60 days). The reason is that the vast majority of the core driver fuel fissions are always from U-235 during the cycle. Also, since we effectively assume instantaneous energy release for the fission product gammas and beta particles and delayed neutrons from a fission event, this corresponds to equilibrium conditions for all fission product concentrations in the ATR driver fuel too. The goal of this effort was to determine a specific numerical and core-average Q-value for the recoverable energy released by a single fission event (MeV/fission) for the ATR. This calculated value has the potential to help standardize and add credibility to not only the Monte Carlo tally normalization process used by many ATR core physics analysts, but also to the normalization process for all reactor physics calculation methods involving ATR analyses. Currently, the ATR core physics analysts use slightly different Q-values. Some values are known to be conservative for specific applications. However, sometimes a more accurate Q-value is needed for the calculation in which ATR test specimens require non-conservative and as-accurate-as-possible Q-values to estimate burnups, heat rates, neutron fluxes, nuclear reaction rates, etc., where corresponding measured post-irradiation examination data provides the ultimate validation for the calculated results. A detailed Q-value procedure was developed and is outlined in this document along with numerical values calculated specifically for the determination of the ATR Q-value. This report attempts to document in some detail the calculation methodology, nuclear data, computer code, computer model, code calculated results, hand calculations, assumptions, and logic that went into the determination of the ATR Q-value.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Review of Graph Databases for Big Data Dynamic Entity Scoring

Modeling data as a graph enables users to quickly analyze networked phenomenon, such as social network-based marketing data (e.g., linking entities in social media based on their friends and their "likes", their friend-of-a-friend's "likes", etc.) and scientific data, such as in biology to assess a gene's proximity in a graph to particular disease phenotype. Numerous purpose-built graph databases (DBs) called “NoSQL” or “Not Only SQL” DBs are emerging to support this type of graph analysis. These DBs differ from traditional relational DBs in that they are optimized to improve storage and query performance across large, complex graphs. This document reviews the state of the art in graph DBs and identifies potential DBs that show promise for dynamic entity-scoring algorithms. Dynamic entity scoring is a new area of research that allows analysis of data within graphs using undirected methods to weigh the edges of the graph based on the proximity or ambient influence of near-by nodes. The EntityScore (eScore) methodology developed at Lawrence Livermore National Laboratory (LLNL) is one application of these emerging graph-analysis algorithms to help analysts identify and prioritize entities, based on complex, analyst-defined weighting criteria. Our review examines a wide range of different, well-known graph DBs in use since at least 2010 and identifies unique advantages and disadvantages that may impact eScore-specific requirements. Specifically, we review data structures employed, query features employed, load times, query calculation times, memory usage and several other important attributes reported in the literature. We limited our considerations for eScore to Blueprints-compliant graph DBs (https://github.com/tinkerpop/blueprints/) because they provide a standard, java application programming interface (API) based on the property graph model.

42 ENGINEERING↗

User guidelines and best practices for CASL VUQ analysis using Dakota.

Sandia's Dakota software (available at http://dakota.sandia.gov) supports science and engineering transformation through advanced exploration of simulations. Specifically it manages and analyzes ensembles of simulations to provide broader and deeper perspective for analysts and decision makers. This enables them to enhance understanding of risk, improve products, and assess simulation credibility. This manual offers Consortium for Advanced Simulation of Light Water Reactors (LWRs) (CASL) partners a guide to conducting Dakota-based VUQ studies for CASL problems. It motivates various classes of Dakota methods and includes examples of their use on representative application problems. On reading, a CASL analyst should understand why and how to apply Dakota to a simulation problem. This SAND report constitutes the product of CASL milestone L3:VUQ.V&V.P8.01 and is also being released as a CASL unlimited release report with number CASL-U-2014-0038-000.

97 MATHEMATICS AND COMPUTING↗

Preliminary Assessment of Tecplot Chorus for Analyzing Ensemble of CTH Simulations

The exploration of large parameter spaces in search of problem solution and uncertainty quantifcation produces very large ensembles of data. Processing ensemble data will continue to require more resources as simulation complexity and HPC platform throughput increase. More tools are needed to help provide rapid insight into these data sets to decrease manual processing time by the analyst and to increase knowledge the data can provide. One such tool is Tecplot Chorus, whose strengths are visualizing ensemble metadata and linked images. This report contains the analysis and conclusions from evaluating Tecplot Chorus with an example problem that is relevant to Sandia National Laboratories. This report documents a preliminary evaluation of Tecplot Chorus for analyzing ensemble data from CTH simulations. The project that funded this report and evaluation is also evaluating and guiding development with SNL’s Slycat. Slycat and Tecplot Chorus each have their strengths, weaknesses, and overlapping capabilities. It is quite likely that, as the scale of ensemble data increases, both of these tools (and possibly others) will be needed for different processing goals. This report will focus on Tecplot Chorus and its application to an example ensemble of data supplied by David J. Peterson and John P. Korbin; this example is of a flyer plate impact and weld study henceforth referred to as CTH Impact Example. This evaluation also defines a workflow for analysts that can help reduce the time and resources for processing ensemble data.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

Advanced Small Modular Reactor Economics Model Development

The US Department of Energy Office of Nuclear Energy’s Advanced Small Modular Reactor (SMR) research and development activities focus on four key areas: Developing assessment methods for evaluating advanced SMR technologies and characteristics; and Developing and testing of materials, fuels and fabrication techniques; and Resolving key regulatory issues identified by US Nuclear Regulatory Commission and industry; and Developing advanced instrumentation and controls and human-machine interfaces. This report focuses on development of assessment methods to evaluate advanced SMR technologies and characteristics. Specifically, this report describes the expansion and application of the economic modeling effort at Oak Ridge National Laboratory. Analysis of the current modeling methods shows that one of the primary concerns for the modeling effort is the handling of uncertainty in cost estimates. Monte Carlo–based methods are commonly used to handle uncertainty, especially when implemented by a stand-alone script within a program such as Python or MATLAB. However, a script-based model requires each potential user to have access to a compiler and an executable capable of handling the script. Making the model accessible to multiple independent analysts is best accomplished by implementing the model in a common computing tool such as Microsoft Excel. Excel is readily available and accessible to most system analysts, but it is not designed for straightforward implementation of a Monte Carlo–based method. Using a Monte Carlo algorithm requires in-spreadsheet scripting and statistical analyses or the use of add-ons such as Crystal Ball. An alternative method uses propagation of error calculations in the existing Excel-based system to estimate system cost uncertainty. This method has the advantage of using Microsoft Excel as is, but it requires the use of simplifying assumptions. These assumptions do not necessarily bring into question the analytical results. In fact, the analysis shows that the propagation of error method introduces essentially negligible error, especially when compared to the uncertainty associated with some of the estimates themselves. The results of these uncertainty analyses generally quantify and identify the sources of uncertainty in the overall cost estimation. The obvious generalization—that capital cost uncertainty is the main driver—can be shown to be an accurate generalization for the current state of reactor cost analysis. However, the detailed analysis on a component-by-component basis helps to demonstrate which components would benefit most from research and development to decrease the uncertainty, as well as which components would benefit from research and development to decrease the absolute cost.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Analysis of Modeling Parameters on Threaded Screws

Assembled mechanical systems often contain a large number of bolted connections. These bolted connections (joints) are integral aspects of the load path for structural dynamics, and, consequently, are paramount for calculating a structure's stiffness and energy dissipation properties. However, analysts have not found the optimal method to model appropriately these bolted joints. The complexity of the screw geometry cause issues when generating a mesh of the model. This paper will explore different approaches to model a screw-substrate connection. Model parameters such as mesh continuity, node alignment, wedge angles, and thread to body element size ratios are examined. The results of this study will give analysts a better understanding of the influences of these parameters and will aide in finding the optimal method to model bolted connections.

42 ENGINEERING↗

The PANTHER User Experience

This document describes the PANTHER R&D Application, a proof-of-concept user interface application developed under the PANTHER Grand Challenge LDRD. The purpose of the application is to explore interaction models for graph analytics, drive algorithmic improvements from an end-user point of view, and support demonstration of PANTHER technologies to potential customers. The R&D Application implements a graph-centric interaction model that exposes analysts to the algorithms contained within the GeoGraphy graph analytics library. Users define geospatial-temporal semantic graph queries by constructing search templates based on nodes, edges, and the constraints among them. Users then analyze the results of the queries using both geo-spatial and temporal visualizations. Development of this application has made user experience an explicit driver for project and algorithmic level decisions that will affect how analysts one day make use of PANTHER technologies.

97 MATHEMATICS AND COMPUTING↗

NSRD-06. Computational Capability to Substantiate DOE-HDBK-3010 Data

Safety basis analysts throughout the U.S. Department of Energy (DOE) complex rely heavily on the information provided in the DOE Hand book, DOE-HDBK-3010, Airborne Release Fractions/Rates and Resp irable Fractions for Nonreactor Nuclear Facilities , to determine source terms. In calcula ting source terms, analysts tend to use the DOE Handbook's bounding values on airbor ne release fractions (ARFs) and respirable fractions (RFs) for various cat egories of insults (representing potential accident release categories). This is typica lly due to both time constraints and the avoidance of regulatory critique. Unfort unately, these bounding ARFs/RFs represent extremely conservative values. Moreover, th ey were derived from very limited small- scale table-top and bench/labo ratory experiments and/or fr om engineered judgment. Thus the basis for the data may not be re presentative to the actual unique accident conditions and configura tions being evaluated. The goal of this res earch is to develop a more ac curate method to identify bounding values for the DOE Handbook using the st ate-of-art multi-physics-based high performance computer codes. This enable s us to better understand the fundamental physics and phenomena associated with the ty pes of accidents for the data described in it. This research has examined two of the DOE Handbook's liquid fire experiments to substantiate the airborne release frac tion data. We found th at additional physical phenomena (i.e., resuspension) need to be included to derive bounding values. For the specific cases of solid powder under pre ssurized condition and mechanical insult conditions the codes demonstrated that we can simulate the phenomena. This work thus provides a low-cost method to establis h physics-justified sa fety bounds by taking into account specific geometri es and conditions that may not have been previously measured and/or are too costly to do so.

97 MATHEMATICS AND COMPUTING↗

PANTHER. Pattern ANalytics To support High-performance Exploitation and Reasoning.

Sandia has approached the analysis of big datasets with an integrated methodology that uses computer science, image processing, and human factors to exploit critical patterns and relationships in large datasets despite the variety and rapidity of information. The work is part of a three-year LDRD Grand Challenge called PANTHER (Pattern ANalytics To support High-performance Exploitation and Reasoning). To maximize data analysis capability, Sandia pursued scientific advances across three key technical domains: (1) geospatial-temporal feature extraction via image segmentation and classification; (2) geospatial-temporal analysis capabilities tailored to identify and process new signatures more efficiently; and (3) domain- relevant models of human perception and cognition informing the design of analytic systems. Our integrated results include advances in geographical information systems (GIS) in which we discover activity patterns in noisy, spatial-temporal datasets using geospatial-temporal semantic graphs. We employed computational geometry and machine learning to allow us to extract and predict spatial-temporal patterns and outliers from large aircraft and maritime trajectory datasets. We automatically extracted static and ephemeral features from real, noisy synthetic aperture radar imagery for ingestion into a geospatial-temporal semantic graph. We worked with analysts and investigated analytic workflows to (1) determine how experiential knowledge evolves and is deployed in high-demand, high-throughput visual search workflows, and (2) better understand visual search performance and attention. Through PANTHER, Sandia's fundamental rethinking of key aspects of geospatial data analysis permits the extraction of much richer information from large amounts of data. The project results enable analysts to examine mountains of historical and current data that would otherwise go untouched, while also gaining meaningful, measurable, and defensible insights into overlooked relationships and patterns. The capability is directly relevant to the nation's nonproliferation remote-sensing activities and has broad national security applications for military and intelligence- gathering organizations.

58 GEOSCIENCES↗

A Reduced Order Model of Force Displacement Curves for the Failure of Mechanical Bolts in Tension.

Assembled mechanical systems often contain a large number of bolted connections. These bolted connections (joints) are integral aspects of the load path for structural dynamics, and, consequently, are paramount for calculating a structure's stiffness and energy dissipation prop- erties. However, analysts have not found the optimal method to model appropriately these bolted joints. The complexity of the screw geometry causes issues when generating a mesh of the model. This report will explore different approaches to model a screw-substrate connec- tion. Model parameters such as mesh continuity, node alignment, wedge angles, and thread to body element size ratios are examined. The results of this study will give analysts a better understanding of the influences of these parameters and will aide in finding the optimal method to model bolted connections.

42 ENGINEERING↗

Manufacturing Cost Levelization Model – A User’s Guide

The Manufacturing Cost Levelization Model is a cost-performance techno-economic model that estimates total large-scale manufacturing costs for necessary to produce a given product. It is designed to provide production cost estimates for technology researchers to help guide technology research and development towards an eventual cost-effective product. The model presented in this user’s guide is generic and can be tailored to the manufacturing of any product, including the generation of electricity (as a product). This flexibility, however, requires the user to develop the processes and process efficiencies that represents a full-scale manufacturing facility. The generic model is comprised of several modules that estimate variable costs (material, labor, and operating), fixed costs (capital & maintenance), financing structures (debt and equity financing), and tax implications (taxable income after equipment and building depreciation, debt interest payments, and expenses) of a notional manufacturing plant. A cash-flow method is used to estimate a selling price necessary for the manufacturing plant to recover its total cost of production. A levelized unit sales price ($ per unit of product) is determined by dividing the net-present value of the manufacturing plant’s expenses ($) by the net present value of its product output. A user defined production schedule drives the cash-flow method that determines the levelized unit price. In addition, an analyst can increase the levelized unit price to include a gross profit margin to estimate a product sales price. This model allows an analyst to understand the effect that any input variables could have on the cost of manufacturing a product. In addition, the tool is able to perform sensitivity analysis, which can be used to identify the key variables and assumptions that have the greatest influence on the levelized costs. This component is intended to help technology researchers focus their research attention on tasks that offer the greatest opportunities for cost reduction early in the research and development stages of technology invention.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Documentation of operational protocol for the use of MAMA software

Image analysis of Scanning Electron Microscope (SEM) micrographs is a complex process that can vary significantly between analysts. The factors causing the variation are numerous, and the purpose of Task 2b is to develop and test a set of protocols designed to minimize variation in image analysis between different analysts and laboratories, specifically using the MAMA software package, Version 2.1. The protocols were designed to be “minimally invasive”, so that expert SEM operators will not be overly constrained in the way they analyze particle samples. The protocols will be tested using a round-robin approach where results from expert SEM users at Los Alamos National Laboratory, Lawrence Livermore National Laboratory, Pacific Northwest National Laboratory, Savannah River National Laboratory, and the National Institute of Standards and Testing will be compared. The variation of the results will be used to quantify uncertainty in the particle image analysis process. The round-robin exercise will proceed with 3 levels of rigor, each with their own set of protocols, as described below in Tasks 2b.1, 2b.2, and 2b.3. The uncertainty will be developed using NIST standard reference material SRM 1984 “Thermal Spray Powder – Particle Size Distribution, Tungsten Carbide/Cobalt (Acicular)” [Reference 1]. Full details are available in the Certificate of Analysis, posted on the NIST website (http://www.nist.gov/srm/).

97 MATHEMATICS AND COMPUTING↗

The MCDB System for Management and Analysis of Petabyte-Scale Uncertain Data

Analysts working with very large data sets often use statistical models to “guess” at unknown, inaccurate, or missing information associated with the data. For example, a distant object viewed through an optical lens will have its position slightly shifted by imperfections in the lens. Thus, rather than considering the object’s observed position to be absolutely correct, it makes sense to take into account the lens’s imperfections to obtain a probabilistic guess as to the object’s true position. For another example, it might be important to associate some sort of error distribution with each of the individual sensors in an array of magnetometers. This error distribution may be complex and include spatially-driven covariances, because errors in nearby sensors are likely to be correlated (caused, for example, by the presence of some nearby, fixed metal object). This project is concerned with the design and implementation of a prototype data management system called the Monte Carlo Database System, or MCDB for short. MCDB allows an expert-level analyst or statistician to attach arbitrary stochastic models to very large data sets in order to “guess” the values for unknown or inaccurate data, such as the actual position of the observed object in the lens example above. When the resulting data set is analyzed, the underlying stochastic models are used to generate hundreds or thousands of possible data set instances, and each of those possible instances is analyzed separately by MCDB. Thus, MCDB does not just give a single answer to the analysis, but it actually gives an empirical distribution of query results that embody the underlying uncertainty, and can in turn be analyzed using standard statistical techniques. The stochastic models in MCDB are implemented as user-defined, external C++ libraries called Variable Generation functions (VG functions for short). Because the VG function interface is exceedingly general, it allows MCDB to be used in a very wide variety of application domains, in conjunction with virtually any stochastic model. Ultimately, we ended up calling the system that we developed over the course of the project SimSQL, to denote the fact that it allowed for stochastic simulation of data. The software developed during the lifetime of the project is available for download from the SimSQL project website: http://cmj4.web.rice.edu/SimSQL/SimSQL.html.

42 ENGINEERING↗

Echo™ User Manual

Echo™ is a MATLAB-based software package designed for robust and scalable analysis of complex data workflows. An alternative to tedious, error-prone conventional processes, Echo is based on three transformative principles for data analysis: self-describing data, name-based indexing, and dynamic resource allocation. The software takes an object-oriented approach to data analysis, intimately connecting measurement data with associated metadata. Echo operations in an analysis workflow automatically track and merge metadata and computation parameters to provide a complete history of the process used to generate final results, while automated figure and report generation tools eliminate the potential to mislabel those results. History reporting and visualization methods provide straightforward auditability of analysis processes. Furthermore, name-based indexing on metadata greatly improves code readability for analyst collaboration and reduces opportunities for errors to occur. Echo efficiently manages large data sets using a framework that seamlessly allocates resources such that only the necessary computations to produce a given result are executed. Echo provides a versatile and extensible framework, allowing advanced users to add their own tools and data classes tailored to their own specific needs. Applying these transformative principles and powerful features, Echo greatly improves analyst efficiency and quality of results in many application areas.

97 MATHEMATICS AND COMPUTING↗