Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Information Theory”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 415 records · Page 23

Parsimonious Inference Information-Theoretic Foundations for a Complete Theory of Machine Learning (CIS-LDRD Project 218313 Final Technical Report)

This work examines how we may cast machine learning within a complete Bayesian framework to quantify and suppress explanatory complexity from first principles. Our investigation into both the philosophy and mathematics of rational belief leads us to emphasize the critical role of Bayesian inference in learning well-justified predictions within a rigorous and complete extended logic. The Bayesian framework allows us to coherently account for evidence in the learned plausibility of potential explanations. As an extended logic, the Bayesian paradigm regards probability as a notion of degrees of truth. In order to satisfy critical properties of probability as a coherent measure, as well as maintain consistency with binary propositional logic, we arrive at Bayes' Theorem as the only justifiable mechanism to update our beliefs to account for empiracle evidence. Yet, in the machine learning paradigm, where explanations are unconstrained algorithmic abstractions, we arrive at a critical challenge: Bayesian inference requires prior belief. Conventional approaches fail to yield a consistent framework in which we could compare prior plausibility among the infinities of potential choices in learning architectures. The difficulty of articulating well-justified prior belief over abstract models is the provinence of memorization in traditional machine learning training practices. This becomes exceptionally problematic in the context of limited datasets, when we wish to learn justifiable predictions from only a small amount of data.

97 MATHEMATICS AND COMPUTING↗

Information and Statistics in Nuclear Experiment and Theory (ISNET)

As with all empirical sciences, nuclear physics operates in the virtuous cycle of the scientific method: observations inspire theoretical models; models lead to new predictions; predictions are tested in experiments; experiments lead to new observations; and so on. Evaluating what we are inferring, and how certain we are of it, is key to this process. These requirements, and a general interest in applying novel statistical, mathematical, and computational techniques, led to the formation of a dedicated research community entitled “Information and Statistics in Nuclear Experiment and Theory (ISNET)” (https://isnet-series.github.io/), which now includes more than 300 members. While the community’s interests lean toward nuclear theory, the unifying theme for this group is the inference of knowledge from data.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Fuzzy geometry, entropy, and image information

Presented here are various uncertainty measures arising from grayness ambiguity and spatial ambiguity in an image, and their possible applications as image information measures. Definitions are given of an image in the light of fuzzy set theory, and of information measures and tools relevant for processing/analysis e.g., fuzzy geometrical properties, correlation, bound functions and entropy measures. Also given is a formulation of algorithms along with management of uncertainties for segmentation and object extraction, and edge detection. The output obtained here is both fuzzy and nonfuzzy. Ambiguity in evaluation and assessment of membership function are also described.

Pal, Sankar K.↗

AEOLUS: Advances in Experimental Design, Optimal Control, and Learning for Uncertain Complex Systems

Sustained advances in the mathematics of modeling and simulation have resulted in the capability today for routine simulation of a number of large scale complex DOE-relevant systems. As remarkable as this capability for solving the so-called forward problem is, it is typically only the first step-an inner loop within an outer loop that explores the simulation model's parameter space and decision space to characterize uncertainty in the model's predictions, learn unknown model parameters from data, design the most informative experiments, determine optimal control strategies, and create optimal designs. Broadly, what unifies all of these outer loop problems is that they are, in one form or another, optimization problems over parameter/control/design space that are constrained by complex uncertain models. To fully realize the power of scientific simulation as a basis for scientific discovery, technological innovation, and rational decision-making, it is imperative to move beyond simulation to tackle the outer loop of optimization for learning from data, experimental design, and control with complex uncertain models. When the models under consideration are large-scale and complex, and when the optimization variable and uncertain parameter spaces are high (or infinite) dimensional, this constitutes a grand challenge of the highest order, and is intractable with conventional methods. To overcome these challenges, the AEOLUS Center was established to develop a unified mathematical, computational, and statistical framework for (1) Learning predictive models from complex data via Bayesian inference and optimization, and (2) Optimizing experiments, processes, and designs using the resulting uncertain models. These problems are intractable with conventional methods, for several reasons: (1) The simulation problems that govern the inner loops of the optimization problems are expensive to execute (due to severe nonlinearity, heterogeneity, multiphysics/multiscale coupling); (2) The optimization variable and uncertain parameter spaces are high dimensional, often stemming from discretizations of infinite dimensional fields such as initial conditions, sources, or material properties. We argue that the key to overcoming these challenges is to develop new mathematical, computational, and statistical methods that exploit the structure of the Bayesian inference and optimization problems mediated by their underlying complex uncertain models. This structure includes the regularity, sparsity, geometry, low intrinsic dimensionality, and multifidelity nature of the maps from uncertain parameter/optimization variable spaces to the specific objectives targeted: Bayesian inference, optimal experimental design, and optimal control design. Black box methods developed as generic tools are incapable of exploiting this structure. To be successful, we must create, integrate, and cross-fertilize ideas across multiple areas of applied math--including approximation theory, Bayesian inference, data science, experimental design, information theory, machine learning, model reduction, optimal control theory, parallel algorithms, PDE-constrained optimization, randomized algorithms, stochastic optimization, and uncertainty quantification--all while exploiting the structure of the problems at hand. With this goal in mind, we have marshaled a team of leading authorities in these areas. While the methods we develop will be broadly applicable across a wide spectrum of DOE problems in which experiments inform models and the systems those models describe must be optimized under uncertainty, we have chosen a specific area, advanced manufacturing and materials, to drive our work. AMM is characterized by complex models across multiple scales, and is a rich source of challenging problems in inference, experimental design, and optimal control, requiring multifaceted and integrated advances in applied mathematics. As such, AMM serves as an excellent vehicle to motivate and demonstrate the advances in applied mathematics developed by our center.

97 MATHEMATICS AND COMPUTING↗

Autoignition of Fuel-Oxidizer Mixtures in Microgravity

Microgravity autoignition phenomena that may be influenced by chemically significant walls as well as by photochemically significant radiative fields are examined. First, the limitations of quasi-steady autoignition theory in providing information needed for the characterization of autoignition temperature fields are discussed. Time-dependent autoignition theory is then used to analyze the autoignition behavior of a reactive system where both wall catalysis and gas phase kinetic rates are significant. Space-time trajectories of temperature and species concentrations for such cases are presented

Berlad, A. L.↗

From the Field to the Lab and Back Again

University-based research is often driven by questions of theory and is carried out in artificial manner. Applied research is aimed at solving practical problems in ways that are informed by the theories and in a manner that is ecologically valid. The talk discusses the two approaches and describes two studies in which the practical problem drove laboratory studies resulting in practical solutions.

experimental design↗

A robust offering strategy for wind producers considering uncertainties of demand response and wind power

This paper proposes a risk-constrained decision-making approach for a wind power producer participating in the day-ahead market. In the developed model, a flexible demand response trading scheme between the wind power producer and different customers is employed. Through the proposed demand response mechanism, the wind power producer is able to trade demand response resource internally with different customers, and then trade energy externally with the market to increase the expected profit and the wind energy utilization. The uncertainties in the wind power and demand response are modeled by using the information gap decision theory approach from risk averse (robust) and risk-seeking (opportunistic) perspectives. The objective of the robust model is to maximize the robust level while satisfying the desired profit, whereas the opportunistic model aims to evaluate the possibility of achieving windfall profits with favorable uncertainties. The overall offering strategy problem is modeled as a bi-objective mixed integer nonlinear programming, which is linearized by proper techniques and solved efficiently by using the normal boundary intersection technique. In this work, simulation results show that utilizing demand response resource to mitigate wind power deviations can increase a wind power producer's profit and reduce potential risks. In addition, the results demonstrate that the proposed bi-objective optimization approach enables the wind power producer to select appropriate offering decisions with respect to uncertainties.

17 WIND ENERGY↗

Theoretical prediction of interference loading on aircraft stores. Part 3: Programmer's manual

A FORTRAN program is described for predicting interference loading on aircraft stores. An analysis of the program is presented from a programmer's point of view, including program organization, subroutine explanations, and FORTRAN variable definitions. This information is intended for use in any program modification, extension, or troubleshooting efforts. This manual is supplementary to the separately documented program theory and user information.

Danfernandes, F.↗

A finite element method for nonlinear panel flutter

Panel flutter is the self excited oscillations of a plate in supersonic flow. Linear theory gives no information about the panel's deflections and stresses. Hence, the service life of the panel cannot be predicted by linear methods. Nonlinear structural theory determines the limit cycle oscillating frequency, and also panel deflections and stresses. Panel fatigue life, therefore, can be predicted. For a more thorough understanding of panel flutter behavior, the geometric nonlinearity effects due to large deflections must be considered in the formulation. The Galerkin's method was used in the investigation of limit cycle oscillations of panels in supersonic flow in the spatial domain, and the panel deflections. All nonlinear flutter methods and results presently available were limited to a linear or linearized aerodynamic theory. Extension of the finite element flutter formulation to include nonlinear hypersonic aerodynamic loading and finite element nonlinear panel flutter results are presented.

Mei, Chuh↗

MCNP ® Code V.6.3.0 Release Notes

The Monte Carlo N-Particle ® (MCNP ® ) code is a general-purpose, continuous-energy, generalized geometry, time-dependent, radiation transport code developed by the MCNP development team. The MCNP calculations provide predictive capabilities that can replace expensive or impossible-to perform experiments. Specific application problems include simulations of experimental diagnostics, intrinsic radiation, radiation detection and measurement, criticality safety, nuclear threat reduction and response, radiation health protection, nuclear weapons effects, and nuclear forensics. This MCNP code, version 6.3.0, follows the MCNP6.2.0 version. Since the release of MCNP6.2.0, many changes have been made to the MCNP code. These changes include new or improved features, a new build system, code enhancement and modernization, and bug fixes. The MCNP code, version 6.3.0, theory and user input information is documented in MCNP ® Code Version 6.3.0 Theory & User Manual, the build guidance for various platforms is documented in MCNP ® Code Version 6.3.0 Build Guide, and the verification and validation testing for various application benchmark test suites is documented in MCNP ® Code Version 6.3.0 Verification & Validation Testing.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

MCNP® Code Version 6.3.1 Release Notes

The Monte Carlo N-Particle® (MCNP® ) code is a general-purpose, continuous-energy, generalized-geometry, time-dependent, radiation transport code developed by the MCNP development team. MCNP calculations provide predictive capabilities that can replace expensive or impossible-to-perform experiments. Specific application problems include simulations of experimental diagnostics, intrinsic radiation, radiation detection and measurement, criticality safety, nuclear threat reduction and response, radiation health protection, nuclear weapons effects, and nuclear forensics. This MCNP code, version 6.3.1, follows the MCNP6.3.0 version. Since the release of MCNP6.3.0, a variety of bug fixes and code enhancements have been completed for MCNP6.3.1. A few new features have also been added to this release to support both ongoing research and the release of the latest ENDF/B-VIII.1 nuclear data library. The MCNP code, version 6.3.1, theory and user input information is documented in MCNP® Code Version 6.3.1 Theory & User Manual, the build guidance for various platforms is documented in MCNP® Code Version 6.3.1 Build Guide, and the verification and validation testing for various application benchmark test suites is documented in MCNP® Code Version 6.3.1 Verification & Validation Testing.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Biophysical information in asymmetric and symmetric diurnal bidirectional canopy reflectance

The authors present a theory for partitioning the information content in diurnal bidirectional reflectance measurements in order to detect differences potentially related to biophysical variables. The theory, which divides the canopy reflectance into asymmetric and symmetric functions of solar azimuth angle, attributes asymmetric variation to diurnal changes in the canopy biphysical properties. The symmetric function is attributed to the effects of sunlight interacting with a hypothetical average canopy which would display the average diurnal properties of the actual canopy. The authors analyzed radiometer data collected diurnally in the Thematic Mapper wavelength bands from two walnut canopies that received differing irrigation treatments. The reflectance of the canopies varied with sun and view angles and across seven bands in the visible, near-infrared, and middle infrared wavelength regions. Although one of the canopies was permanently water stressed and the other was stressed in mid-afternoon each day, no water stress signature was unambiguously evident in the reflectance data.

Vanderbilt, Vern C.↗

Movement with meaning: integrating information into meta-ecology

Fluxes of matter, energy and information over space and time contribute to ecosystems' functioning and stability. The meta-ecosystem framework addresses the dynamics of ecosystems linked by these fluxes but, to date, has focused solely on energy and matter. Here, we synthesize existing knowledge of information's effects on local and connected ecosystems and demonstrate how new hypotheses emerge from the integration of ecological information into meta-ecosystem theory. First, we begin by defining information and reviewing how it flows among ecosystems to affect connectivity, local ecosystem function and meta-ecosystem dynamics. We focus on the role of semiotic information: that which can reduce an individual's – or a group's – uncertainty about the state of the world. Semiotic information elicits behavioral, developmental and life history responses from organisms, potentially leading to fitness consequences. Organisms' responses to information can ripple through trophic interactions to influence ecosystem processes, their local and regional dynamics, and the spatiotemporal flows of energy and matter, therefore information should affect meta-ecosystem dynamics such as stability and productivity. While specific subdisciplines of ecology currently consider different types of information (e.g. social and cultural information, natural and artificial light or sound, body condition, genotype and phenotype), many ecological models currently account for neither the spatio–temporal distribution of information nor its perception by organisms. We identify the empirical, theoretical and philosophical challenges in developing a robust information meta-ecology and offer ways to overcome them. Finally, we present new hypotheses for how accounting for realistic information perception and responses by organisms could impact processes such as home range formation and spatial insurance, and thus our understanding of ecological dynamics across spatial and temporal scales. Accounting for information will be essential to understanding how dynamics such as fitness, organismal movement and trophic interactions influence meta-ecosystem functioning, and predicting how ecosystem processes are affected by anthropogenic pressures.

54 ENVIRONMENTAL SCIENCES↗

An Open Computing Infrastructure that Facilitates Integrated Product and Process Development from a Decision-Based Perspective

Computer applications for design have evolved rapidly over the past several decades, and significant payoffs are being achieved by organizations through reductions in design cycle times. These applications are overwhelmed by the requirements imposed during complex, open engineering systems design. Organizations are faced with a number of different methodologies, numerous legacy disciplinary tools, and a very large amount of data. Yet they are also faced with few interdisciplinary tools for design collaboration or methods for achieving the revolutionary product designs required to maintain a competitive advantage in the future. These organizations are looking for a software infrastructure that integrates current corporate design practices with newer simulation and solution techniques. Such an infrastructure must be robust to changes in both corporate needs and enabling technologies. In addition, this infrastructure must be user-friendly, modular and scalable. This need is the motivation for the research described in this dissertation. The research is focused on the development of an open computing infrastructure that facilitates product and process design. In addition, this research explicitly deals with human interactions during design through a model that focuses on the role of a designer as that of decision-maker. The research perspective here is taken from that of design as a discipline with a focus on Decision-Based Design, Theory of Languages, Information Science, and Integration Technology. Given this background, a Model of IPPD is developed and implemented along the lines of a traditional experimental procedure: with the steps of establishing context, formalizing a theory, building an apparatus, conducting an experiment, reviewing results, and providing recommendations. Based on this Model, Design Processes and Specification can be explored in a structured and implementable architecture. An architecture for exploring design called DREAMS (Developing Robust Engineering Analysis Models and Specifications) has been developed which supports the activities of both meta-design and actual design execution. This is accomplished through a systematic process which is comprised of the stages of Formulation, Translation, and Evaluation. During this process, elements from a Design Specification are integrated into Design Processes. In addition, a software infrastructure was developed and is called IMAGE (Intelligent Multidisciplinary Aircraft Generation Environment). This represents a virtual apparatus in the Design Experiment conducted in this research. IMAGE is an innovative architecture because it explicitly supports design-related activities. This is accomplished through a GUI driven and Agent-based implementation of DREAMS. A HSCT design has been adopted from the Framework for Interdisciplinary Design Optimization (FIDO) and is implemented in IMAGE. This problem shows how Design Processes and Specification interact in a design system. In addition, the problem utilizes two different solution models concurrently: optimal and satisfying. The satisfying model allows for more design flexibility and allows a designer to maintain design freedom. As a result of following this experimental procedure, this infrastructure is an open system that it is robust to changes in both corporate needs and computer technologies. The development of this infrastructure leads to a number of significant intellectual contributions: 1) A new approach to implementing IPPD with the aid of a computer; 2) A formal Design Experiment; 3) A combined Process and Specification architecture that is language-based; 4) An infrastructure for exploring design; 5) An integration strategy for implementing computer resources; and 6) A seamless modeling language. The need for these contributions is emphasized by the demand by industry and government agencies for the development of these technologies.

Hale, Mark A.↗

Adaptive Multi-Agent Systems for Constrained Optimization

Product Distribution (PD) theory is a new framework for analyzing and controlling distributed systems. Here we demonstrate its use for distributed stochastic optimization. First we review one motivation of PD theory, as the information-theoretic extension of conventional full-rationality game theory to the case of bounded rational agents. In this extension the equilibrium of the game is the optimizer of a Lagrangian of the (probability distribution of) the joint state of the agents. When the game in question is a team game with constraints, that equilibrium optimizes the expected value of the team game utility, subject to those constraints. The updating of the Lagrange parameters in the Lagrangian can be viewed as a form of automated annealing, that focuses the MAS more and more on the optimal pure strategy. This provides a simple way to map the solution of any constrained optimization problem onto the equilibrium of a Multi-Agent System (MAS). We present computer experiments involving both the Queen s problem and K-SAT validating the predictions of PD theory and its use for off-the-shelf distributed adaptive optimization.

Macready, William↗

Adaptive, Distributed Control of Constrained Multi-Agent Systems

Product Distribution (PO) theory was recently developed as a broad framework for analyzing and optimizing distributed systems. Here we demonstrate its use for adaptive distributed control of Multi-Agent Systems (MASS), i.e., for distributed stochastic optimization using MAS s. First we review one motivation of PD theory, as the information-theoretic extension of conventional full-rationality game theory to the case of bounded rational agents. In this extension the equilibrium of the game is the optimizer of a Lagrangian of the (Probability dist&&on on the joint state of the agents. When the game in question is a team game with constraints, that equilibrium optimizes the expected value of the team game utility, subject to those constraints. One common way to find that equilibrium is to have each agent run a Reinforcement Learning (E) algorithm. PD theory reveals this to be a particular type of search algorithm for minimizing the Lagrangian. Typically that algorithm i s quite inefficient. A more principled alternative is to use a variant of Newton's method to minimize the Lagrangian. Here we compare this alternative to RL-based search in three sets of computer experiments. These are the N Queen s problem and bin-packing problem from the optimization literature, and the Bar problem from the distributed RL literature. Our results confirm that the PD-theory-based approach outperforms the RL-based scheme in all three domains.

Bieniawski, Stefan↗